JP4345756B2 - Image editing apparatus, image editing method, image editing program, image reading system, and image reading method - Google Patents

Description

  The present invention relates to an image editing apparatus, an image editing method, an image editing program, an image reading system, and an image reading method for editing an image according to user preferences.

  Various image reading apparatuses such as an image scanner are generally connected to a so-called computer apparatus such as a personal computer by wire or wireless, and transmit an image read from a document as image data to the computer apparatus. The computer device receives the image data transmitted from the image reading device and stores it in a data storage device such as various memories or a hard disk device. At this time, the computer apparatus can perform various kinds of processing such as image processing on the image data sent from the image reading apparatus according to the user's preference.

Examples of the adjustment processing performed here include histogram adjustment for adjusting the contrast of an image, density correction for partially changing the expression of light and shade of an image, and the like. These adjustments are automatically executed by various programs such as a driver program and an application program of the image reading apparatus installed in the computer apparatus, or are executed by a user or the like. In addition, various methods have been proposed for various adjustments, adjustment methods, editing methods, and the like applied to an image read by an image reading device (see Patent Documents 1 to 5).
Japanese Patent Laid-Open No. 2002-16798 JP-A-7-220043 JP 11-345321 A JP-A-7-99589 JP 2004-153684 A

  However, when the user wants to adjust the image to a desired color tone, even if various adjustments and adjustment methods such as histogram adjustment and density correction, and editing methods are prepared, an appropriate adjustment method is selected from these. In addition, in the adjustment method, an appropriate adjustment must be performed through trial and error in order to change to a color desired by the user. For this reason, it has often been very difficult to change to a color desired by the user. In particular, a large amount of labor is required for users who are not familiar with color adjustment and the like.

  In particular, each adjustment processing such as histogram adjustment and density correction performed here is generally performed in a predetermined order with respect to an image from the image reading apparatus. Specifically, for example, various adjustments such as performing histogram adjustment on an image from the image reading apparatus and then performing density correction, and conversely, performing density adjustment first and then performing histogram adjustment. Implemented by procedure. For this reason, depending on the adjustment process performed by the user, a problem such as an overflow may occur and the original image information may not be fully utilized, or a smooth gradation may be lost. There was a case.

  The present invention has been made in view of such circumstances, and an object of the present invention is to enable a user to easily adjust the color of an image to be edited.

The main invention for achieving the object is as follows:
(A) a first data converter that converts data of pixels constituting the image into first output data based on the first setting information;
(B) a second data conversion unit that converts the first output data converted by the first data conversion unit into second output data based on second setting information;
(C) a setting information changing unit that changes the first setting information when an attribute of the second output data for the pixel is designated by a user;
An image editing apparatus including (D).

  Other features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

  At least the following matters will become apparent from the description of the present specification and the accompanying drawings.

(A) a first data converter that converts data of pixels constituting the image into first output data based on the first setting information;
(B) a second data conversion unit that converts the first output data converted by the first data conversion unit into second output data based on second setting information;
(C) a setting information changing unit that changes the first setting information when an attribute of the second output data for the pixel is designated by a user;
An image editing apparatus comprising (D).

  In such an image editing apparatus, when the attribute of the second output data is designated by the user, the setting information changing unit converts the data of the pixels constituting the image into the first output data by the setting information changing unit. By changing the first setting information that is referred to when converting to, it is possible to suppress the occurrence of problems such as overflow.

  In such an image editing apparatus, when the attribute of the second output data for the pixel is designated by the user, the second setting information may be retained as it is. As described above, since the second setting information is held as it is, it is possible to suppress occurrence of problems such as overflow.

  In the image editing apparatus, the setting information changing unit may be configured to update the second output data for the pixel when an attribute of the second output data for the pixel constituting the image is designated by a user. The first setting information may be changed so that the attribute is the attribute specified by the user. As described above, when the attribute of the second output data for the pixels constituting the image is designated by the user, the setting information changing unit changes the second output data attribute for the pixels to the attribute designated by the user. By changing the one setting information, it is possible to suppress occurrence of problems such as overflow, and to adjust the attribute of the second output data to the attribute specified by the user.

  In the image editing apparatus, the pixel data may be data of each color of RGB of the pixel. In this way, when the pixel data is RGB color data, it is possible to suppress the occurrence of problems such as overflow.

  In the image editing apparatus, the first data conversion unit may convert data of all pixels constituting the image into the first output data. As described above, the first data conversion unit converts the data of all the pixels constituting the image into the first output data, so that the entire image can be adjusted.

  In the image editing apparatus, the first data conversion unit and the second data conversion unit are configured to output the first output data or the second data conversion unit each time an attribute of the second output data for the pixel is designated by a user. Conversion to the second output data may be performed. As described above, each time the attribute of the second output data is designated by the user, the first data conversion unit and the second data conversion unit convert the first output data or the second output data into the latest second data. Output data can be acquired sequentially.

  In such an image editing apparatus, the first setting information may be changeable by a user. Since the first setting information can be changed by the user as described above, the first output data can be converted based on the first setting information changed by the user.

  In such an image editing apparatus, the second setting information may be changeable by a user. Since the second setting information can be changed by the user as described above, the second output data can be converted based on the second setting information changed by the user.

  In the image editing apparatus, the pixel for which the attribute of the second output data is designated by the user may be one of a plurality of pixels constituting the image. As described above, since the pixel for which the attribute of the second output data is designated by the user is one pixel among the plurality of pixels constituting the image, occurrence of problems such as overflow can be suppressed. .

  In the image editing apparatus, the designation of the attribute of the second output data performed by the user may be performed through an operation input unit. Thus, by specifying the attribute of the second output data performed by the user through the operation input unit, it is possible to easily obtain the attribute information of the second output data specified by the user.

  In such an image editing apparatus, the designation of the attribute of the second output data by the user may be performed by designating a color for the pixel. As described above, when a color is designated as an attribute of the second output data by the user for the pixels constituting the image, it is possible to suppress the occurrence of problems such as overflow.

  The image editing apparatus may further include an image display unit that displays an image generated based on the second output data. If such an image display unit is provided, an image generated based on the second output data can be easily displayed.

(A) a first data converter that converts data of pixels constituting the image into first output data based on the first setting information;
(B) a second data conversion unit that converts the first output data converted by the first data conversion unit into second output data based on second setting information;
(C) a setting information changing unit that changes the first setting information when an attribute of the second output data for the pixel is designated by a user;
(D)
(E) When the attribute of the second output data for the pixel is designated by the user, the second setting information is retained as it is,
(F) When the attribute of the second output data with respect to the pixels constituting the image is designated by the user, the setting information changing unit is configured so that the attribute of the second output data with respect to the pixels is designated by the user. Change the first setting information to become an attribute,
(G) The pixel data is RGB data of the pixel,
(H) the first data conversion unit converts data of all pixels constituting the image into the first output data;
(I) The first data conversion unit and the second data conversion unit convert the second output data to the first output data or the second output data each time an attribute of the second output data for the pixel is designated by a user. And
(J) The first setting information and the second setting information can be set by a user,
(K) The pixel for which the attribute of the second output data is designated by the user is one of a plurality of pixels constituting the image,
(L) The designation of the attribute of the second output data performed by the user is performed through the operation input unit,
(M) The designation of the attribute of the second output data by the user is performed by designating a color for the pixel,
(N) An image editing apparatus comprising an image display unit on which an image generated based on the second output data is displayed.

(A) converting data of pixels constituting the image into first output data based on the first setting information;
(B) converting the converted first output data into second output data based on second setting information;
(C) changing the first setting information when an attribute of the second output data for the pixel is designated by a user;
An image editing method comprising (D).

(A) converting data of pixels constituting the image into first output data based on the first setting information;
(B) converting the converted first output data into second output data based on second setting information;
(C) changing the first setting information when an attribute of the second output data for the pixel is designated by a user;
An image editing program that executes (D).

(A) an image reading unit for reading an image from a document;
(B) a first data conversion unit that converts pixel data constituting the image read by the image reading unit into first output data based on first setting information;
(C) a second data conversion unit that converts the first output data converted by the first data conversion unit into second output data based on second setting information;
(D) a setting information changing unit that changes the first setting information when an attribute of the second output data for the pixel is designated by a user;
An image reading apparatus comprising (E).

(A) a step of reading an image from a document;
(B) converting pixel data constituting the read image into first output data based on the first setting information;
(C) converting the converted first output data into second output data based on second setting information;
(D) changing the first setting information when an attribute of the second output data for the pixel is designated by a user;
An image reading method comprising (E).

=== Overview of Image Reading System etc. ===
Embodiments of an image reading system and the like according to the present invention will be described below. 1 to 4 describe an embodiment of an image reading system. FIG. 1 illustrates an embodiment of an image reading system. FIG. 2 is a diagram illustrating an example of the internal configuration of the image reading apparatus. FIG. 3 is a diagram illustrating an example of a system configuration of the image reading apparatus. FIG. 4 is a diagram for explaining the system configuration of the computer apparatus.

  As shown in FIG. 1, the image reading system 2 includes an image reading device 10 and a computer device 20 connected to the image reading device 10 so as to be communicable by wire or wireless. As shown in FIG. 1, the image reading device 10 is a device generally called an image scanner, and includes a document table 12 and a document table cover 14 that opens and closes the upper surface of the document table 12. A document 15 from which an image is read is set on the document table 12. The document table cover 14 is provided at the rear end portion of the document table 12 through a hinge portion 18 so as to be freely opened and closed.

  On the other hand, the computer device 20 includes, for example, a computer main body 22, a display device 24, and an input device 26 as shown in FIG. The computer main body 22 includes various computers such as a personal computer. Here, the computer main body 22 includes a reading device 32 such as an FD drive device 28 or a CD-ROM drive device 30 therein. In addition, the computer main body 22 may include, for example, an MO (Magnet Optical) disk drive device or a DVD drive device. The display device 24 includes various display devices such as a CRT display, a plasma display, and a liquid crystal display. The input device 26 includes a keyboard 34, a mouse 36, and the like.

  Here, the display device 24 corresponds to an “image display unit”. The input device 26 such as the keyboard 34 and the mouse 36 corresponds to an “operation input unit”.

<Image reading device>
As shown in FIG. 2, a carriage 40 and the carriage 40 are arranged in parallel with each other along the direction of arrow A in FIG. A drive mechanism 42 for moving the vehicle and a guide 44 for guiding the movement while supporting the carriage 40 are provided.

  The carriage 40 has an exposure lamp 46 as a light source for irradiating light on the document 15 via the document table 12, a lens 48 on which reflected light reflected by the document 15 is incident, and the inside of the carriage 40 through the lens 48. And an image sensor 50 for receiving the reflected light taken in. The image sensor 50 includes a linear CCD sensor or the like in which photoelectric conversion elements such as photodiodes that convert optical signals into electric signals are arranged in a line. The image data read by the image sensor 50 is output to the control unit 52.

  The drive mechanism 42 includes a timing belt 54 connected to the carriage 40, a pair of pulleys 55, 56 around which the timing belt 54 is stretched, and a drive motor 58 that rotationally drives one pulley 55. Yes. The drive motor 58 is driven and controlled by a control signal from the control unit 52.

  As shown in FIG. 3, the control unit 52 includes a controller 60, a motor control unit 62, a lamp control unit 64, a sensor control unit 66, an AFE (Analog Front End) unit 68, a digital processing circuit 70, And an interface circuit 72. Further, the AFE (Analog Front End) unit 68 includes an analog signal processing circuit 74 and an A / D conversion circuit 76.

  The controller 60 controls the motor control unit 62, the lamp control unit 64, the sensor control unit 66, the AFE (Analog Front End) unit 68, the digital processing circuit 70, and the interface circuit 72 based on commands from the computer main body 22. The motor control unit 62 performs drive control of the drive motor 58 for moving the carriage 40 according to a command from the controller 60. The lamp control unit 64 controls the light emission of the exposure lamp 46. The sensor control unit 66 controls the image sensor 50.

  An analog signal processing circuit 74 of an AFE (Analog Front End) unit 68 performs signal processing on an analog signal of an image read by the image sensor 50. An A / D conversion circuit 76 in an AFE (Analog Front End) unit 68 performs A / D conversion of the image signal processed by the analog signal processing circuit 74 into a digital signal.

  The digital processing circuit 70 performs digital signal processing on the digital signal sent from the A / D conversion circuit 76 of the AFE (Analog Front End) unit 68. Here, specifically, various image processing and the like are performed, including correction processing such as shading correction. The digital signal subjected to the digital signal processing is output as image data (image data) read from the document 15 to the outside, that is, to the computer main body 22 to which the image reading apparatus 10 is connected in this case. The In addition to this, the interface circuit 72 receives commands (commands) and the like from the computer main body 22 to the image reading apparatus 10.

<Computer body>
As shown in FIG. 4, the computer main body 22 includes a CPU 80, a memory 82, an HDD (Hard Disk Drive Device) 84, an operation input unit 86, a display control unit 88, an external communication unit 90, and a bus 92. I have. In addition, the computer main body 22 includes the CD-ROM drive device 30 and the FD drive device 28 described above. The CPU 80, the memory 82, the HDD (Hard Disk Drive Device) 84, the CD-ROM drive device 30, the FD drive device 28, the operation input unit 86, the display control unit 88, and the external communication unit 90 are buses. 92 are communicably connected to each other.

  The CPU 80 performs overall control of the computer main body 22. The memory 82 is for storing various data such as a program executed by the CPU 80 and work data used by the program. An HDD (Hard Disk Drive Device) 84 stores an operating system (OS) executed by the CPU 80, various programs such as various application programs and drivers, and various other data such as image data. Yes. The operation input unit 86 is connected to the input device 26 such as the keyboard 34 and the mouse 36, and acquires information input by the user through the input device 26. Further, the display control unit 88 controls an image displayed on the screen of the display device 24 based on a command from the CPU 80. The external communication unit 90 communicates with various peripheral devices such as the image reading apparatus 10 connected to the outside of the computer main body 22.

  The CPU 80 reads out a program from an HDD (Hard Disk Drive Device) 84 and executes various programs under an operating system (OS). The programs executed here include various applications programs and various drivers for controlling the image reading device 10, the operation input unit 86, the display control unit 88, and the like.

  A driver for controlling the image reading apparatus 10 is generally called a scanner driver. The scanner driver is a program installed in the computer main body 22 through various communication lines such as the Internet and various storage media such as a CD-ROM and a floppy disk (FD). When the scanner driver is installed in the computer main body 22, the computer main body 22 functions as a control device that controls the image reading apparatus 10.

=== Scanner Driver ===
Next, an example of the user interface of the scanner driver will be described. FIG. 5 shows the main dialog box 100 of this user interface. The CPU 80 of the computer main body 22 displays this user interface on the display screen of the display device 24 through the display control unit 88. The user can make various settings of the scanner driver through the input device 26 such as the keyboard 34 and the mouse 36 while looking at the dialog box 100 of the user interface displayed on the display screen of the display device 24.

  The main dialog box 100 includes a “mode selection field” 102, a “setting storage field” 104, an “original setting field” 106, an “output setting field” 108, and an “adjustment field” 110. ing. In the “mode selection field” 102, the user can select one mode from a plurality of modes. Here, “professional mode” is selected. In the “setting storage field” 104, the user can save or delete the current setting by clicking the “save button” or “delete button”.

  Further, in the “original setting field” 106, the user can set each of “original type” 112, “reading device” 114, and “automatic exposure” 116. In the “original type” 112, the type of original set can be selected. For example, “reflection original”, “film”, or the like can be selected. In the “reading device” 114, for example, “original table” can be selected. In the “automatic exposure” 116, an exposure setting suitable for the type of document to be read can be performed. For example, “photo orientation”, “document orientation”, and the like can be selected.

  In the “output setting field” 108, the user can make various settings related to image output. Specifically, in the “output setting field” 108, the “image type” 118 of the output image, “resolution” 120 at the time of reading, “original size” 122 at the time of reading, and “output size” 124 are set. Is possible. In “image type” 118, the number of colors of the read image can be selected from three types of color, gray scale, and monochrome. In “Resolution” 120, the resolution of the read image can be set. In “Original Size” 122, the size of the read image can be set.

  When the “scan button” 126 at the bottom of the dialog box 100 is clicked by the user, the scanner driver controls the external image reading device 10 based on information set by the user through the dialog box 100 to An image is read from a document set on the reading device 10. The image data thus read is sent to the computer main body. When the “preview button” 127 at the bottom of the dialog box 100 is clicked by the user, the scanner driver displays a preview window for displaying the image read by the image reading device 10 on the display screen of the display device 24.

  In addition, the scanner driver has a function of adjusting an image read by the image reading device 10. The read image is adjusted through the “adjustment column” 110 of the main dialog box 100. The “adjustment column” 110 is provided with five buttons and four check boxes for adjusting an image read by the image reading apparatus 10. The five buttons 128A, 128B, 128C, 128D, and 128E are an automatic exposure button 128A, a histogram adjustment button 128B, a density correction button 128C, an image adjustment button 128D, and a color palette adjustment button 128E, respectively. is there. The four check boxes 130A, 130B, 130C, and 130D include an unsharp mask filter check box 130A, a moire removal filter check box 130B, a fading restoration check box 130C, and a dust removal check box 130D, respectively. It is.

  The automatic exposure button 128A is clicked when it is desired to automatically adjust the exposure. The histogram adjustment button 128B is a button that is clicked when it is desired to adjust the brightness of an image. When this histogram adjustment button 128B is clicked, a histogram adjustment dialog box is called up. The density correction button 128C is a button that is clicked when it is desired to correct the density balance of the image. When this density correction button 128C is clicked, a dialog box for density correction is called. The image adjustment button 128D is a button that is clicked when it is desired to adjust the brightness, contrast, saturation, and color balance of the image. When this image adjustment button 128D is clicked, an image adjustment dialog box is called up. The color palette adjustment button 128E is a button that is clicked when it is desired to directly specify a color for an arbitrary position in the image. When the color palette adjustment button 128E is clicked, a color palette adjustment dialog box is called up.

  On the other hand, the unsharp mask filter check box 130A is a check box for instructing whether or not the unsharp mask filter can be used, and is checked when it is desired to sharpen the image. Also, the moire removal filter check box 130B is a check box for instructing whether or not to use a filter that removes moire (mesh shading) generated in the scan of the printed material, and is checked when moire is conspicuous. The color fading restoration check box 130C is checked when restoring the color of the faded photograph. The dust removal check box 130D is checked to reduce dust on the film during film scanning.

=== Image adjustment ===
Next, histogram adjustment, density correction, and image adjustment for performing image adjustment will be described. The color palette adjustment will be described in detail later. 6 to 9 describe the histogram adjustment, the density correction, and the image adjustment, respectively. FIG. 6 shows a histogram adjustment dialog box. FIG. 7 explains a specific adjustment outline of histogram adjustment. FIG. 8 shows a dialog box for density correction. FIG. 9 shows an image adjustment dialog box.

<Histogram adjustment>
In “histogram adjustment”, the brightness of the image is adjusted to improve the appearance of the read image. In the histogram adjustment dialog box 131, as shown in FIG. 6, a histogram display field 132 in which a histogram of an image to be edited is displayed, and a tone curve display in which a tone curve indicating the result of adjustment using the histogram is displayed. A column 134 and a gray balance adjustment column 136 for adjusting the gray balance for removing the color cast are provided. Here, the “histogram” represents the brightness and color distribution of the entire image, and is a graph representing the data distribution (number of pixels) from black to white of the image.

  The histogram display column 132 is provided with a channel column 138 for selecting the type (channel (color)) of the histogram to be displayed. In this channel column 138, it is possible to select from four types of RGB (red, green, blue) all colors, only R (red), only G (green), and only B (blue). If you want to adjust all RGB (red, green, blue) colors, select the top switch in this channel column 138, and a histogram of all RGB (red, green, blue) colors will be displayed on the right. If only the R (red) is to be adjusted, the second switch from the top of the channel field 138 is selected, and a histogram of only R (red) is displayed on the right side. When only G (green) is to be adjusted, when the third switch from the top of the channel field 138 is selected, a histogram of only G (green) is displayed on the right side. If only B (blue) is to be adjusted, selecting the bottom switch from the top of this channel field 138 displays a histogram of only B (blue) on the right side.

  When the displayed histogram is adjusted, the adjustment is performed using the three sliders 140A, 140B, and 140C provided below the displayed histogram. The three sliders 140A, 140B, and 140C are a slider 140A that adjusts shadows, a slider 140B that adjusts gamma, and a slider 140C that adjusts highlights. The slider 140A for adjusting the shadow is represented by a black triangle “▲”. The slider 140B for adjusting gamma is represented by a gray triangle mark. The slider 140C for adjusting the highlight is represented by a white triangle “Δ”. When adjustment is performed using these three sliders 140A, 140B, and 140C, the three sliders 140A, 140B, and 140C are individually moved in the left-right direction. Specifically, the slider 140A for adjusting the shadow is moved so as to be positioned slightly to the right of the left end of the peak of the histogram. Further, the slider 140C for adjusting the highlight is moved so as to be located slightly to the left of the right end of the histogram peak. The slider 140B for adjusting the gamma is adjusted so that the brightness of the intermediate portion is appropriate by moving it to the left and right between the slider 140A for adjusting the shadow and the slider 140C for adjusting the highlight. As a result, the overall light / dark balance of the image to be edited is improved, and the appearance of the image can be improved.

  In addition, the histogram display field 132 is provided with numerical value input fields 142A, 142B, and 142C for directly and directly specifying the positions of the three sliders 140A, 140B, and 140C. A shadow input value is input to the numerical value input field 142A. In addition, the gamma value is input to the numerical value input field 142B. In addition, a highlight input value is input to the numerical value input field 142C. Thereby, it is possible to easily specify the shadow input value, the highlight input value, and the gamma value by directly inputting the numerical value into each numerical value input field 142A, 142B, 142C.

  Further, dropper buttons 143A, 143B, and 143C are provided on the right side of these three numerical value input fields 142A, 142B, and 142C, respectively. These dropper buttons 143A, 143B, and 143C are buttons for directly instructing points from the image to be edited displayed on the preview screen displayed separately from the dialog box for adjusting the histogram. In the three numerical value input fields 142A, 142B, and 142C, numerical values corresponding to points (pixels) designated from the image to be edited on the preview screen are directly input using the dropper buttons 143A, 143B, and 143C. .

  Further, two numerical value input fields 142D and 142E are provided below the two numerical value input fields 142A and 142C to which the shadow input value and the highlight input value are input, respectively. A shadow output value corresponding to the shadow input value is input to the left numeric input field 142D. Further, a highlight output value corresponding to the highlight input value is input to the numerical value input field 142E on the right side.

  For adjustment using these sliders 140A, 140B, and 140C and numerical value input fields 142A, 142B, 142C, 142D, and 142E, RGB (red, green, blue) all colors, R (red) only, G (green) ) And B (blue) only.

  FIG. 7 explains this histogram adjustment in detail. In this histogram adjustment, the shadow input value α01, the shadow output value α03, the highlight input value α02, the highlight output value α04, which are set through the sliders 140A, 140B, 140C or the numerical value input fields 142A, 142B, 142C, 142D, 142E, Based on the gamma value α05, a tone curve representing the correspondence between input data and output data as shown in the figure is defined. That is, the tone curve defined here includes a point T1 (also referred to as a shadow point) defined by the set shadow input value α01 and shadow output value α03, and a set highlight input value α02 and highlight output value α04. It is formed so as to pass through a point T2 (also referred to as a highlight point) defined by. Further, the tone curve is formed so as to swell toward one of the straight lines connecting the points T1 and T2 in accordance with the set gamma value α05. Based on the shadow input value α01, the shadow output value α03, the highlight input value α02, the highlight output value α04, and the gamma value α05 set in this way, a tone curve representing the correspondence between the input data and the output data is obtained. It is prescribed. The tone curve is defined for each color of R (red), G (green), and B (blue).

  The tone curve thus defined is displayed in the tone curve display field 134 as shown in FIG. In the tone curve display field 134, a tone curve corresponding to the adjustment result performed in the histogram display field 132 is displayed. Further, in the tone curve display field 134, the gradation outside the point T1 (shadow point) or the point T2 (highlight point) can be adjusted so that the tone curve can be finely adjusted. Specifically, the end curve shape change buttons 144A and 144B provided at the lower left portion and the upper right portion of the tone curve are clicked, and the desired end curve shape is selected from the displayed pull-down menu. It has become. Here, for example, the end curve shape can be selected from three types of “boost”, “normal”, and “soft”. Here, “boost” is selected when it is desired to remove the unevenness by making the white background part white or making the black background part black. “Normal” is selected when a highlight portion and a shadow portion are expressed as they are. Also, “soft” is selected when returning a pure white part to the original white background or returning a pure black part to the original black background.

  In the gray balance adjustment column 136, a slider 145 for adjusting the gray balance is provided. By moving the slider 145 left and right, the gray balance can be adjusted and the color cast can be removed.

<Density correction>
“Density correction” is an adjustment used when partially changing the expression of light and shade of an image. Specifically, in this “density correction”, the tone curve is adjusted to improve the appearance of the read image. In other words, by adjusting the density curve (tone curve) that changes to shadow (darkest part), midtone (halftone), and highlight (lightest part), the brightness and contrast of the entire image are balanced. Can be finished. Therefore, in the density correction dialog box 150, as shown in FIG. 8, the tone curve display unit 152 and the type (channel (color)) of the tone curve displayed on the tone curve display unit 152 are selected. Channel column 154 is provided.

  In this channel column 154, it is possible to select from all four colors of RGB (red, green, blue), only R (red), only G (green), and only B (blue). If you want to adjust all RGB (red, green, blue) colors, select the top switch in this channel field 154, and the tone curves for all RGB (red, green, blue) colors will be displayed on the right. . In addition, when it is desired to adjust only R (red), when the second switch from the top of the channel field 154 is selected, a tone curve of only R (red) is displayed on the right side. If only G (green) is to be adjusted, selecting the third switch from the top of the channel field 154 displays a tone curve for only G (green) on the right side. If it is desired to adjust only B (blue), the tone curve of only B (blue) is displayed on the right side by selecting the lowest switch from the top of the channel field 154.

  The tone curve display unit 152 displays a tone curve having the horizontal axis as an input value and the vertical axis as an output value. When the output value is set so as not to change with respect to the input value, the tone curve becomes a straight line as shown as line L1 in the figure.

  When the tone curve is adjusted, an arbitrary point is set on the tone curve displayed on the tone curve display unit 152, and the tone curve is adjusted while shifting this point in the vertical and horizontal directions. In the present embodiment, three points P1, P2, and P3 are arbitrarily set on the tone curve displayed on the tone curve display unit 152, and these three points P1, P2, and P3 are set up, down, left, and right from the reference line L1, respectively. Move and move in each direction. As a result, a tone curve desired by the user is formed on the tone curve display portion 152. The coordinates of the three points P1, P2, and P3 can be set through two numerical value input fields 156A and 156B provided on the left side of the tone curve display unit 152, respectively. Here, by inputting an input value in the upper numerical value input field 156A and inputting an output value in the lower numerical value input field 156B, the coordinates of each point P1, P2, and P3 can be set.

  Such adjustment of the tone curve is possible for each of four types of RGB (red, green, blue), R (red) only, G (green) only, and B (blue) only. The tone curve setting can be stored through a density correction setting storage field 158 provided at the top of the density correction dialog box 150.

<Image adjustment>
“Image adjustment” includes (1) brightness adjustment, (2) contrast adjustment, (3) saturation adjustment, and (4) as shown in the image adjustment dialog box 160 of FIG. There are four types of adjustments: color balance adjustments. Further, “(4) Color balance adjustment” includes an adjustment between “cyan (C) -red (R)”, an adjustment between “magenta (M) -green (G)”, and “yellow”. There are three types of adjustments, with adjustments between (Y)-Blue (B) ".

(1) Brightness adjustment “(1) Brightness adjustment” is performed when an image is too bright or too dark. “(1) Brightness adjustment” can be performed by moving the slider 162A to the left or right, or by directly inputting a numerical value into the numerical value input field 164A provided on the right side of the slider 162A.

(2) Contrast adjustment “(2) Contrast adjustment” is performed when the contrast is made clear or, conversely, the difference between brightness and darkness is reduced. “(2) Contrast adjustment” can be performed by moving the slider 162B to the left or right, or by directly inputting a numerical value into the numerical value input field 164B provided on the right side of the slider 162B.

(3) Saturation adjustment “(3) Saturation adjustment” is performed when it is desired to make the color vivid. “(3) Saturation adjustment” can be performed by moving the slider 162C to the left or right, or by directly inputting a numerical value into the numerical value input field 164C provided on the right side of the slider 162C.

(4) Color balance adjustment “(4) Color balance adjustment” is performed when the image is reddish or bluish. “(4) Color balance adjustment” is performed by moving the sliders 162D, 162E, and 162F to the left and right, and in numerical value input fields 164D, 164E, and 164F provided on the right side of the sliders 162D, 162E, and 162F, respectively. This can be done by directly entering a numerical value. As a result, the image can be adjusted to an appropriate hue. Specifically, the strength of cyan and red (R) can be adjusted by moving the adjustment slider 162D between “cyan (C) and red (R)” to the left and right. Further, the strength of magenta (M) and green (G) can be adjusted by moving the adjustment slider 162E between “magenta (M) and green (G)” to the left and right. Further, the strength of yellow (Y) and blue (B) can be adjusted by moving the adjustment slider 162F between “yellow (Y) and blue (B)” to the left and right.

  Here, “(1) Brightness adjustment” and “(4) Color balance adjustment” are all three colors of red (R), green (G), and blue (B), or shades of each color as a whole. This is a process of performing conversion to shift. “(2) Contrast adjustment” is a process of performing conversion to increase or decrease the change in shading for all three colors of red (R), green (G), and blue (B).

On the other hand, “(3) Saturation adjustment” uses the following conversion formulas (1) to (3), for example, for each color of red (R), green (G), and blue (B). This is a process of converting data. Here, input data of each color of red (R), green (G), and blue (B) is indicated by “R”, “G”, and “B”, respectively. Further, output data of each color of red (R), green (G), and blue (B) are indicated by “R ′”, “G ′”, and “B ′”, respectively.
R ′ = S11 × R + S12 × G + S13 × B (1)
G ′ = S21 × R + S22 × G + S23 × B (2)
B ′ = S31 × R + S32 × G + S33 × B (3)
Here, S11, S12, S13, S21, S22, S23, S31, S32, and S33 are coefficients set according to the set saturation value. When increasing the saturation, values larger than “1” are set in S11, S22, and S33, and negative values are set in S12, S13, S21, S23, S31, and S32. In this way, “(3) Saturation adjustment” is executed.

<Setting data>
FIG. 10A to FIG. 10C describe the data set by the histogram adjustment, density correction, and image adjustment, respectively. FIG. 10A explains data set by histogram adjustment. FIG. 10B explains data set by density correction. FIG. 10C explains data set by image adjustment.

  In the case of histogram adjustment, as shown in FIG. 10A, the shadow input values α11, α21, and α31 and the shadow output values α13, α23, and α33 for each color of R (red), G (green), and B (blue) Highlight input values α12, α22, α32, highlight output values α14, α24, α34, and gamma values α15, α25, α35 are set as data. In addition to this, data α41 and α42 relating to the “lower end shape” and “upper end shape” as the end shape of the tone curve and the adjustment value α51 in gray balance adjustment are set as data. The scanner driver stores these data α11, α21, α31, α13, α12, α22, α32, α23, α33, α14, α24, α34, α15, α25, α35, α41, α42, α51 as setting data. These setting data α11, α21, α31, α13, α23, α33, α12, α22, α32, α14, α24, α34, α15, α25, α35, α41, α42, α51 will be described with reference to FIG. 6, for example. In addition to being set by the user through the histogram adjustment dialog box 131, the scanner driver may be automatically set by calculation or the like. The scanner driver uses the stored setting data α11, α21, α31, α13, α23, α33, α12, α22, α32, α14, α24, α34, α15, α25, α35, α41, α42, α51 based on the input image. To adjust the image.

  In the case of density correction, as shown in FIG. 10B, a plurality of points P1, P2, P3... Set on the tone curve for each color of R (red), G (green), and B (blue). The input coordinates β11, β13, β21, β23, β31, β33,... And the output coordinates β12, β14, β22, β24, β32, β34,. The scanner driver inputs the input coordinates β11, β13, β21, β23, β31, β33... And the output coordinates β12, β14, β22, β24, β32, β34. Is stored as setting data. These setting data β11, β13, β21, β23, β31, β33,..., Β12, β14, β22, β24, β32, β34,. Besides being set by the user through the dialog box 150, it may be set automatically by calculation or the like by the scanner driver. The scanner driver executes density correction based on the stored setting data β11, β13, β21, β23, β31, β33..., Β12, β14, β22, β24, β32, β34.

  In the case of image adjustment, as shown in FIG. 10C, the setting value γ1 of “(1) Brightness adjustment”, the setting value γ2 of “(2) Contrast adjustment”, and “(3) Color” Setting value γ3 of “degree adjustment” and setting values γ4, γ5, and γ6 of “(4) Color balance adjustment” are set. “(4) Color balance adjustment” includes a setting value γ4 between “cyan (C) -red (R)” and a setting value γ5 between “magenta (M) -green (G)”. And a set value γ6 between “yellow (Y) -blue (B)”. The scanner driver stores these setting values γ1, γ2, γ3, γ4, γ5, and γ6 as setting data. These setting data γ1, γ2, γ3, γ4, γ5, and γ6 are set by the user through the image adjustment dialog box 160 described with reference to FIG. May be set automatically. The scanner driver performs image adjustment based on the stored setting data γ1, γ2, γ3, γ4, γ5, and γ6.

=== Adjustment procedure ===
An example of a procedure for adjusting an input image, that is, an image read by the image reading device 10 based on data set by the histogram adjustment, density correction, and image adjustment will be described. FIG. 11A shows an example of this procedure.

  The scanner driver performs histogram adjustment on the input image, that is, the image read by the image reading device 10 here (S002). In this histogram adjustment, the scanner driver adjusts R (red), G (green), and B (blue) based on tone curves defined for R (red), G (green), and B (blue), respectively. Data Rin, Gin, Bin of each pixel of the input image is converted and output for each color. Here, the scanner driver is set by the user through the histogram adjustment dialog box 131 described with reference to FIG. 6 or automatically set for each color of R (red), G (green), and B (blue). Shadow input values α11, α21, α31, shadow output values α13, α23, α33, highlight input values α12, α22, α32, highlight output values α14, α24, α34, gamma values α15, α25, α35, and others The histogram adjustment is executed based on these data with reference to the data α41 and α42 of the end shape of the tone curve and the adjustment value α51 of the gray balance adjustment. Thus, the scanner driver converts the data Rin, Gin, Bin (input data) of each pixel of the input image into output data Rout1, Gout1, Bout1, and outputs the converted data.

  After performing the histogram adjustment in this way, the scanner driver proceeds to step S004, and performs image adjustment on the image data on which the histogram adjustment has been performed (S004). Here, the scanner driver performs (1) brightness adjustment, (2) contrast adjustment, and (3) color balance adjustment as image adjustment. That is, the scanner driver sets the setting value γ1 of “(1) Brightness adjustment”, the setting value γ2 of “(2) Contrast adjustment”, and the setting values γ4, γ5 of “(4) Color balance adjustment”. , And γ6 are adjusted respectively. As a result, the scanner driver converts the output data Rout1, Gout1, and Bout1 resulting from the histogram adjustment into output data Rout2, Gout2, and Bout2, and outputs them.

  Then, after performing image adjustment (excluding (3) saturation adjustment) in this way, the scanner driver proceeds to step S006, and performs density correction on the image data subjected to image adjustment. (S006). In this density correction, the scanner driver adjusts R (red), G (green), and B (blue) based on tone curves adjusted for R (red), G (green), and B (blue), respectively. Data of each pixel of the input image is converted and output for each color. That is, here, the scanner driver inputs the input coordinates β11 of a plurality of points P1, P2, P3,... Set on the tone curve for each color of R (red), G (green), and B (blue). Referring to the setting data of β13, β21, β23, β31, β33 ………… and output coordinates β12, β14, β22, β24, β32, β34 …………, the tone curve formed based on these setting data Based on the above, density correction is executed. As a result, the scanner driver converts the output data Rout2, Gout2, and Bout2 resulting from image adjustment (excluding (3) saturation adjustment) into output data Rout3, Gout3, and Bout3 and outputs them.

  After performing the density correction in this manner, the scanner driver proceeds to step S008, and performs “(3) Saturation adjustment” as image adjustment on the image data subjected to density correction ( S008). Here, the scanner driver performs adjustment based on the set value γ3 of “(3) Saturation adjustment”. As a result, the scanner driver converts the output data Rout3, Gout3, and Bout3 resulting from the density correction into output data Rout4, Gout4, and Bout4 and outputs them.

After performing “(3) saturation adjustment” as image adjustment in this way, the scanner driver then performs color conversion on the image data that has been subjected to “(3) saturation adjustment”. Processing is performed (S010). This color conversion process is a process for converting data into data suitable for handling in various output devices (here, display devices, various printers, and the like). Specifically, for example, the following conversion formulas (4) to (6) are used.
R '= A11 * R + A12 * G + A13 * B (4)
G ′ = A21 × R + A22 × G + A23 × B (5)
B '= A31 * R + A32 * G + A33 * B (6)
Here, input data of red (R), green (G), and blue (B) before conversion are indicated by “R”, “G”, and “B”, respectively. Further, output data of each color of red (R), green (G), and blue (B) after conversion is indicated by “R ′”, “G ′”, and “B ′”, respectively. A11, A12, A13, A21, A22, A23, A31, A32, and A33 are coefficients that are appropriately set according to the characteristics of various output devices (display device 24, printer, etc.).

  In this way, the scanner driver performs color conversion processing according to the characteristics of various output devices on the image data on which “(3) saturation adjustment” has been performed. As a result, the scanner driver converts the output data Rout4, Gout4, and Bout4 resulting from image adjustment ((3) saturation adjustment) into output data Rout5, Gout5, and Bout5 and outputs them. Then, after executing the color conversion process in this way, the scanner driver outputs the image subjected to the color conversion process as an output image.

  Although the case where the color conversion process is executed at the final stage has been described as an example here, the color conversion process is executed as necessary.

  Here, the histogram adjustment corresponds to a “first data conversion unit”. The output data Rout1, Gout1, and Bout1 correspond to “first output data” here. Also, R (red), G (green) and B (blue) shadow input values α11, α21, α31, shadow output values α13, α23, α33, highlight input values α12, α22, α32, highlight output The values α14, α24, α34, gamma values α15, α25, α35, tone curve edge shape data α41, α42, and gray balance adjustment value α51 correspond to “first setting information” here.

  At least one of image adjustment (excluding saturation), density correction, and image adjustment (saturation) corresponds to a “second data conversion unit”. The output data Rout2, Gout2, Bout2, the output data Rout3, Gout3, Bout3 or the output data Rout4, Gout4, Bout4 here correspond to “second output data”. Also, the input coordinates β11, β13, β21, β23, β31, β33,... And the output coordinates β12 of the set values γ1, γ2, γ4, γ5, γ6, or a plurality of points P1, P2, P3. .beta.14, .beta.22, .beta.24, .beta.32, .beta.34... or the set value .gamma.3 here corresponds to "second setting information".

=== Pre-scan ===
FIG. 11B describes an example of an image reading procedure by the image reading device 10. When an image is read by the image reading device 10, a pre-scan may be executed. For example, in the case of reading an image at a high resolution, this pre-scan does not execute an operation for reading an image at a high resolution from the beginning, but an operation for reading an image at a high resolution (main scan). For example, reading an image at a low resolution once.

  As shown in the figure, the pre-scan is first executed (S050). The scanner driver acquires a pre-scan image (pre-image) by this pre-scan operation (S052). Next, the scanner driver performs automatic adjustment or the like on the acquired pre-scan image (pre-image). Here, the scanner driver obtains an appropriate adjustment value in histogram adjustment, density correction, image adjustment, etc., and automatically corrects the acquired pre-scan image (pre-image) (S054). The automatically corrected image is displayed on the display device 24, for example.

  The user performs various adjustments (corrections) while viewing the pre-scan image (pre-image) displayed on the display device 24 or the like in this way (S056). Here, the user performs various adjustments (corrections) through the histogram adjustment dialog box 131 in FIG. 6, the density correction dialog box 150 in FIG. 8, the image adjustment dialog box 160 in FIG.

  After various adjustments (corrections) are made by the user in this way, the main scan is executed. In this main scan, the image is read from the document 15 with high resolution by the image reading device 10 (S058). The scanner driver performs various adjustments (corrections) such as histogram adjustment, density correction, and image adjustment based on the data set by the user or the like for the high-resolution image acquired by the main scan in this way. To do. Thereby, the main image subjected to various adjustments (corrections) is acquired (S060).

=== Conventional Problems and Solutions ===
<Conventional problems>
By individually setting the histogram adjustment, the density correction, the image adjustment, and the like, the user can perform various adjustments on the image read by the image reading apparatus. However, when the user wants to adjust the image to a desired color, an appropriate adjustment method is selected from various adjustments such as histogram adjustment, density correction, and image adjustment, and the user desires in the adjustment method. Appropriate adjustments must be made through trial and error in order to change to a hue, and it may be very difficult to change to a hue desired by the user. In particular, a large amount of labor is required for users who are not familiar with color adjustment and the like.

  Further, the adjustment processes such as histogram adjustment and density correction performed here are performed in a predetermined order with respect to the image read by the image reading apparatus 10, that is, the original image, as described with reference to FIG. 11A. Is done. For this reason, depending on the adjustment process performed by the user, an overflow may occur, and the original image information may not be fully utilized, or smooth gradation may be lost. For this reason, it has been extremely difficult to determine which adjustment process should be executed by the user.

<Solution>
Therefore, in the present embodiment, the user can designate a desired color for the finally output image. Moreover, since an upstream adjustment element is selected from a plurality of adjustment elements based on the desired color information specified by the user and changes are made to the adjustment elements, there is a problem such as overflow. Can also be prevented. As a result, the user can easily adjust the color.

  In particular, here, the user can arbitrarily specify a pixel on the image to be edited, and the user can directly specify a desired color for the pixel. The scanner driver has a user interface capable of such designation. The user can adjust the color of the image to be edited through such a user interface. Thus, the user can easily change the desired color of the image to be edited without performing adjustments by various conventional adjustments such as histogram adjustment, density correction, and image adjustment.

=== Specific Adjustment Method ===
Here, first, the user arbitrarily designates a pixel for which a color is desired to be designated on the image to be adjusted. Next, the user designates a desired color for the designated pixel.

<Pixel specification>
Here, the pixel designation by the user is performed through a preview window in which an image to be edited is displayed. FIG. 12 shows an example of the preview window 170. As shown in the figure, the preview window 170 performs a preview area 172 in which an image to be edited is displayed and various operations such as setting a capture frame and zooming on the image displayed in the preview area 172. And an operation area 174 provided with various operation buttons. In the present embodiment, the preview area 172 includes various adjustments (corrections) performed by the scanner driver or the user on the image read by the image reading apparatus as an image to be edited, that is, histogram adjustment and the like. The image after density correction, image adjustment, etc. is displayed.

  In addition to the image to be edited, the preview area 172 displays a pointer 176 for the user to arbitrarily specify a pixel from the image. The pointer 176 can be arbitrarily moved by the user in the vertical and horizontal directions on the image displayed in the preview area 172. Thus, the user moves the pointer 176 in the vertical and horizontal directions on the image displayed in the preview area 172, stops the pointer 176 at the position of the pixel for which the color is desired, and designates it by an operation.

<Specify color>
Designation of a desired color for a pixel designated by the user is performed through a dialog box for color palette adjustment. FIG. 13 illustrates an example of the dialog box 180 for adjusting the color palette. The dialog box 180 is provided with two types of color palettes, a hue color palette 182 and a lightness color palette 184.

  The hue color palette 182 includes a plurality of types of selected color patches 188 having different hues, and a desired color patch can be selected from the plurality of types of selected color patches 188 to specify a color. it can. On the other hand, the lightness color palette 184 has a selection color patch 192 of a plurality of types of colors each having a different lightness, and selects a desired color patch from the plurality of types of selection color patches 192 to designate a color. be able to. The hue color palette 182 and the lightness color palette 184 will be described in detail below.

(1) Hue Color Palette The Hue Color Palette 182 has a designated color patch 186 for indicating the currently designated color, in addition to the selected color patches 188 of a plurality of types of colors having different hues. . The designated color patch 186 is arranged at the center of the selection color patches 188 of a plurality of types of colors. The selected color patches 188 of a plurality of types of colors are arranged around the designated color patch 186 so as to surround the designated color patch 186. The designated color patch 186 and the selection color patch 188 are each formed in a regular hexagonal shape having the same size. The designated color patch 186 and the selection color patch 188 are arranged so that the sides are in close contact with each other. As a result, the designated color patch 186 and the selected color patch 188 have a regular hexagonal shape as a whole.

  The designated color patch 186 located in the center is set to the same color as the pixel arbitrarily designated by the user through the pointer 176 from the image displayed in the preview area 172 of the preview window 170. On the other hand, the selected color patch 188 around the designated color patch 186 is set so that the hue is stepwise different from the color of the designated color patch 186 located at the center. In other words, the color of the selected color patch 188 is set so that the hue is individually different from that of the designated color patch 186. Here, the colors set for each of the selected color patches 188 will be described.

  FIG. 14 describes in detail the colors set in the selected color patch 188 of the hue color palette 182. The color of the selected color patch 188 is set so that the hue gradually differs from the color of the designated color patch 186 outward from the designated color patch 186 with the designated color patch 186 as the center. More specifically, the selected color patch 188 is centered on the specified color patch 186 and is directed upward, downward, diagonally lower left, diagonally upper left, diagonally lower right, and diagonally upper right from the designated color patch 186. The color of each selected color patch 188 is set so that the hue changes to a different color.

  In the upward direction from the designated color patch 186, the colors of the selected color patches Y1, Y2, and Y3 are set so that the yellow (Y) color gradually increases with respect to the color of the designated color patch 186. . Here, the hue changes in three stages from the designated color patch 186 upward. The ratio of the hue change of each selected color patch Y1, Y2, Y3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that yellow (Y) is stronger in the selected color patch Y2 than in the selected color patch Y1. Furthermore, the hue is set so that yellow (Y) is stronger in the selected color patch Y3 than in the selected color patch Y2.

  Further, in the diagonally upper right direction from the designated color patch 186, the colors of the selected color patches R1, R2, and R3 are set so that the color of the red (R) gradually increases with respect to the color of the designated color patch 186. Has been. Here, the hue changes in three steps from the designated color patch 186 toward the diagonally upper right direction. The ratio of the hue change of each selected color patch R1, R2, R3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that red (R) is stronger in the selected color patch R2 than in the selected color patch R1. Furthermore, the hue is set so that the selected color patch R3 has a stronger red (R) than the selected color patch R2.

  Further, in the diagonally lower right direction from the designated color patch 186, the colors of the selected color patches M1, M2, and M3 are respectively set so that the magenta (M) color gradually increases with respect to the color of the designated color patch 186. Is set. Here, the hue changes in three stages from the designated color patch 186 toward the diagonally lower right. The ratio of the hue change of each selected color patch M1, M2, M3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that the selected color patch M2 has a stronger magenta (M) than the selected color patch M1. Furthermore, the hue is set so that the selected color patch M3 has a stronger magenta (M) than the selected color patch M2.

  Further, in the downward direction from the designated color patch 186, the colors of the selected color patches B1, B2, and B3 are set so that the color of blue (B) gradually increases with respect to the color of the designated color patch 186. ing. Here, the hue changes in three stages from the designated color patch 186 downward. The ratio of the hue change of each selected color patch B1, B2, B3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that blue (B) is stronger in the selected color patch B2 than in the selected color patch B1. Furthermore, the hue is set so that blue (B) is stronger in the selected color patch B3 than in the selected color patch B2.

  Further, in the diagonally lower left direction from the designated color patch 186, the colors of the selected color patches C1, C2, and C3 are set so that the cyan (C) color gradually increases with respect to the color of the designated color patch 186. Has been. Here, the hue changes in three steps from the designated color patch 186 toward the diagonally lower left direction. The ratio of the hue change of each selected color patch C1, C2, C3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that cyan (C) is stronger in the selected color patch C2 than in the selected color patch C1. Furthermore, the hue is set so that cyan (C) is stronger in the selected color patch C3 than in the selected color patch C2.

  Further, in the diagonally upper left direction from the designated color patch 186, the colors of the selected color patches G1, G2, and G3 are set so that the color of the green (G) gradually increases with respect to the color of the designated color patch 186. Has been. Here, the hue changes in three steps from the designated color patch 186 toward the diagonally upper left direction. The ratio of the hue change of each selected color patch G1, G2, G3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that the selected color patch G2 has a stronger green (G) than the selected color patch G1. Furthermore, the hue is set so that the selected color patch G3 is stronger in green (G) than the selected color patch G2.

  Furthermore, between the three selection color patches Y1, Y2, Y3 arranged in the upward direction from the designated color patch 186 and the three selection color patches R1, R2, R3 arranged in the diagonally upper right direction from the designated color patch 186, these Selection color patches YR1, YR2, and YR3 having intermediate colors are arranged. Here, the hues of the selection color patches YR2 and YR3 are set so that yellow (Y) or red (R) is stronger than the selection color patch YR1.

  In addition, between the three selection color patches R1, R2, and R3 arranged in the diagonally upper right direction from the designated color patch 186 and between the three selection color patches M1, M2, and M3 arranged in the obliquely lower right direction from the designated color patch 186, Selection color patches RM1, RM2, and RM3 having intermediate colors of these colors are arranged. Here, the hues of the selection color patches RM2 and RM3 are set so that red (R) or magenta (M) is stronger than the selection color patch RM1.

  In addition, between the three selection color patches M1, M2, and M3 arranged obliquely from the designated color patch 186 in the lower right direction and the three selection color patches B1, B2, and B3 arranged downward from the designated color patch 186, Selection color patches BM1, BM2, and BM3 having intermediate colors of these colors are arranged. Here, the hues of the selected color patches BM2 and BM3 are set so that magenta (M) or blue (B) is stronger than the selected color patch BM1.

  Further, between the three selection color patches B1, B2, B3 arranged in the downward direction from the designated color patch 186 and the three selection color patches C1, C2, C3 arranged in the obliquely lower left direction from the designated color patch 186, these Selection color patches CB1, CB2, and CB3 having intermediate colors are arranged. Here, the hues of the selection color patches CB2 and CB3 are set so that cyan (C) or blue (B) is stronger than the selection color patch CB1.

  In addition, between the three selection color patches C1, C2, and C3 arranged in the diagonally lower left direction from the designated color patch 186 and the three selection color patches G1, G2, and G3 arranged in the obliquely upper left direction from the designated color patch 186, Selection color patches GC1, GC2, and GC3 having intermediate colors of these colors are arranged. Here, the hues of the selection color patches GC2 and GC3 are set so that cyan (C) or green (G) is stronger than the selection color patch GC1.

  Also, between the three selection color patches G1, G2, G3 arranged obliquely from the designated color patch 186 in the upper left direction and the three selection color patches Y1, Y2, Y3 arranged upward from the designated color patch 186, these Selection color patches YG1, YG2, and YG3 having intermediate colors are arranged. Here, the hues of the selection color patches YG2 and YG3 are set so that yellow (Y) or green (G) is stronger than the selection color patch YG1.

(2) Lightness Color Palette On the other hand, the lightness color palette 184 indicates the currently designated color, as well as the hue color palette 182, in addition to the selected color patches 192 of a plurality of colors having different hues. The designated color patch 190 is provided. The designated color patch 190 is arranged at the center of the selection color patch 192 of a plurality of types of colors. The selected color patches 192 of a plurality of types of colors are arranged in a straight line along the vertical direction (vertical direction) around the designated color patch 190. The designated color patch 190 and the selection color patch 192 are each formed in a regular hexagonal shape having the same size. The designated color patch 190 and the selection color patch 192 are arranged so that the sides are in close contact with each other.

  The designated color patch 190 located in the center is set to the same color as the pixel arbitrarily designated by the user through the pointer 176 from the image displayed in the preview area 172 of the preview window 170. On the other hand, the selected color patch 192 is set so that the brightness varies stepwise with respect to the color of the designated color patch 190 located at the center. That is, the color of the selected color patch 192 is set so that the brightness is individually different from the color of the designated color patch 190. Here, the color set for each selected color patch 192 will be described.

  FIG. 15 describes in detail the colors set in the selected color patch 192 of the lightness color palette 184. The selected color patch 192 is set such that the brightness varies stepwise with respect to the color of the designated color patch 186 from the designated color patch 186 upward and downward with the designated color patch 186 as the center. Yes.

  In the upward direction from the designated color patch 190, the colors of the selected color patches L1, L2, and L3 are set so that the designated color patch 190 becomes gradually brighter. Here, the brightness changes in three stages from the designated color patch 190 upward. The ratio of the change in brightness of each selected color patch L1, L2, L3 is set to a ratio of 1: 3: 6, for example. That is, the brightness is set so that the selected color patch L2 is brighter than the selected color patch L1. Furthermore, the brightness is set so that the selected color patch L3 is brighter than the selected color patch L2.

  On the other hand, in the downward direction from the designated color patch 190, the colors of the selected color patches D1, D2, and D3 are set so as to gradually darken with respect to the designated color patch 190. Here, the brightness changes in three stages from the designated color patch 190 downward. The ratio of the change in brightness of each selected color patch D1, D2, D3 is set to a ratio of 1: 3: 6, for example. That is, the brightness is set so that the selected color patch D2 is darker than the selected color patch D1. Furthermore, the brightness is set so that the selected color patch D3 is darker than the selected color patch D2.

(3) Color designation The user can select and designate an arbitrary selection color patch from among a plurality of types of color selection color patches 188 and 192 provided in these two color palettes 182 and 184. it can. When one selected color patch is selected by clicking from the plurality of types of selected color patches 188 and 192, the colors of the specified color patches 186 and 190 positioned at the centers of the color palettes 182 and 184 are displayed. The color of the selected color patch 188 or 192 designated by the user is replaced. That is, the color of the selected color patch designated by the user moves to the center where the designated color patches 186 and 190 are located.

  As a result, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are changed. That is, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are changed based on the colors of the designated color patches 186 and 190 newly set by the user. In other words, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are reset so that the hue or brightness changes stepwise with respect to the colors newly set in the designated color patches 186 and 190. It is.

  Further, when the user again clicks and selects an arbitrary selected color patch 188, 192 from among the plurality of selected color patches 188, 192 of the two color palettes 182, 184, the selected color patch 188 selected here is selected. , 192 are newly set as the colors of the designated color patches 186, 190. Then, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are again set and changed again.

  In this way, the user sequentially clicks and selects an arbitrary selected color patch from among the selected color patches 188 and 192 of the plurality of types of colors in the two color palettes 182 and 184, so that the desired color is obtained. You can go closer. As a result, the user can easily find the selected color patch 188, 192 of the desired color.

(4) Other In addition to this, in the color palette adjustment dialog box 180, as shown in FIG. 13, the colors of the designated color patches 186 and 190 respectively arranged at the centers of the two color palettes 182 and 184 are numerically expressed. Three numerical value input fields 194A, 194B, and 194C for specifying are provided. These three numerical value input fields 194A, 194B, and 194C are configured to input numerical values of red (R), green (G), and blue (B), respectively. The user can easily specify a color by inputting numerical values into these three numerical value input fields 194A, 194B, and 194C, respectively.

  Further, the color palette adjustment dialog box 180 is provided with a color storage field 196 for storing the color designated by the user below the two color palettes 182 and 184. In this color storage column 196, nine color storage boxes 198 are provided. The user can store different colors in these nine color storage boxes 198. In order to save colors in these nine color saving boxes 198, the user clicks a save button 197B provided on the upper side of the color saving column 196. If the user wants to specify the color stored in the color storage box 198 as the color of the specified color patch, the user clicks the apply button 197A provided on the upper side of the color storage field 196. As a result, the designated color patches 186 and 190 having the same color as the color stored in the color storage box 198 are displayed on the two color palettes 182 and 184.

  Further, the color palette adjustment dialog box 180 includes an extraction dropper button 195B for calling a pointer for designating an arbitrary pixel on the image to be edited displayed in the preview area of the preview window 170, and the two An application dropper button 195A for applying the color designated on the color palettes 182 and 184, that is, the color of the designated color patch, to any pixel on the image to be edited displayed in the preview area of the preview window 170; Is provided.

=== Adjusting the whole image ===
The scanner driver adjusts the overall color of the image to be edited so that the pixel specified by the user has the color specified by the user. In this adjustment, the scanner driver does not perform adjustment in the form of post-processing on an image that has already been adjusted or corrected, such as histogram adjustment, density correction, and image adjustment. Alternatively, adjustment is performed by changing the correction. This is because the information of the original image (here, the image read by the image reading device 10) is fully utilized when adjustment is performed in the form of post-processing such as histogram adjustment, density correction, and image adjustment that has already been executed. This is because there is a case where an adverse effect may occur, such as when there is no smooth gradation or when a smooth gradation is lost. The scanner driver adjusts the overall color of the image to be edited while changing these adjustments and corrections that have already been performed, while eliminating these adverse effects. The adjustment method executed here will be described in detail below. The scanner driver corresponds to a “setting information changing unit”.

  FIG. 16 explains the outline of the color palette adjustment executed here. Before performing color palette adjustment, as described in FIG. 11A, histogram adjustment is first performed on an input image such as an image read by the image reading apparatus 10 (S102), and then image adjustment is performed ( S104). In this image adjustment, other adjustments except the saturation adjustment, that is, brightness adjustment, contrast adjustment, and color balance adjustment are performed. After performing the image adjustment in this way, the image subjected to the image adjustment is subjected to density correction (S106), and then the saturation is adjusted as the image adjustment (S108). As a result, an output image subjected to various adjustments is acquired from the input image (the image read by the image reading device 10). Here, the color conversion process is omitted.

  Here, it is assumed that an arbitrary pixel is designated on the image to be edited by the user by color palette adjustment, and a desired color is designated by the user for the pixel. The color of the pixel specified by the user is obtained by changing the input color A of the corresponding pixel on the input image to the existing color B through histogram adjustment, density correction, image adjustment, and the like. In order to change the existing color B changed in this way to the designated color C designated by the user, at least one of histogram adjustment, density correction and image adjustment is changed, and the corresponding on the input image is changed. It is necessary to adjust the input color A of the pixel to be changed from the existing color B to the designated color C.

  In this embodiment, in order to change the existing color B to the designated color C, the most upstream adjustment element, that is, here, the histogram adjustment is changed, and the input color A of the corresponding pixel on the input image is designated. Adjust to color C. In this way, in order to change the existing color B of the pixel designated by the user to the designated color C designated by the user, the adjustment element at the most upstream side, that is, the histogram adjustment here, is selected as follows. For reasons. That is, other adjustment elements excluding the most upstream adjustment element, that is, here, for example, an intermediate adjustment element such as image adjustment (excluding saturation), density correction, and saturation adjustment, and a downstream adjustment element are used. This is because if it is selected, overflow may occur. If such an overflow occurs, information of the original image (here, the image read by the image reading device 10) may not be fully utilized, or smooth gradation may be lost. In addition, the reason for selecting the histogram adjustment is that the histogram adjustment has a larger influence on the image than other adjustment elements.

  In order to change the existing color B to the designated color C by changing the histogram adjustment, it is necessary to obtain an appropriate change amount of the histogram adjustment. Here, an appropriate change amount of the histogram adjustment is obtained by the following method.

  FIG. 17 illustrates an example of a procedure for obtaining an appropriate change amount of the histogram adjustment in order to change the existing color B to the designated color C. In order to obtain an appropriate change amount of the histogram adjustment, first, the color specified by the user, that is, the specified color C is subjected to inverse conversion of the saturation adjustment, and the RGB value before the saturation adjustment is performed. Rin1, Gin1, and Bin1 are acquired (S202). Here, the scanner driver performs the inverse conversion of the saturation adjustment based on the setting data for the saturation adjustment, that is, the setting value γ3 here.

  Next, the RGB values Rin1, Gin1, and Bin1 before saturation adjustment obtained in this way are subjected to inverse transformation of density correction, and the RGB values Rin2, Gin2 before density correction are performed. , Bin2 is obtained (S204). Here, the scanner driver sets density correction setting data, that is, a plurality of points P1, P2, P3... Set on the tone curve for each color of R (red), G (green), and B (blue). Refer to the setting data of the input coordinates β11, β13, β21, β23, β31, β33 ………… and the output coordinates β12, β14, β22, β24, β32, β34 ………… Based on the tone curve formed based on the data, inverse conversion of density correction is executed.

  Further, image conversion (excluding saturation) is performed by performing inverse conversion of image adjustment (excluding saturation) on the RGB values Rin2, Gin2, and Bin2 before density correction obtained in this way. The RGB values Rin3, Gin3, and Bin3 before being processed are obtained (S206). Here, the scanner driver sets image adjustment (excluding saturation) setting data, that is, a setting value γ1 of “(1) Brightness adjustment” and a setting value γ2 of “(2) Contrast adjustment”. Based on the set values γ4, γ5, and γ6 of “(4) Color balance adjustment”, inverse conversion of image adjustment (excluding saturation) is executed. Thereby, the RGB values Rin3, Gin3, and Bin3 after the histogram adjustment corresponding to the designated color C are obtained. A color expressed by the RGB values Rin3, Gin3, and Bin3 is set as a target color E here. Then, an appropriate change amount of the histogram adjustment is obtained such that the color D after the histogram adjustment is performed on the input color A becomes the target color E (S208).

In the description of FIG. 17, the description of the reverse conversion of the color conversion process is omitted, but if necessary, the reverse conversion of the color conversion process may be performed. An example of a conversion formula for the inverse conversion of the color conversion process is shown below.
R = A11 ′ × R ′ + A12 ′ × G ′ + A13 ′ × B ′ …………… (4 ′)
G = A21 ′ × R ′ + A22 ′ × G ′ + A23 ′ × B ′ (5 ′)
B = A31 ′ × R ′ + A32 ′ × G ′ + A33 ′ × B ′ (6 ′)
In the conversion formulas (4 ′) to (6 ′), “R”, “G”, and “B” are red (R), green (G), and blue (B) data after reverse conversion. Indicates. In addition, “R ′”, “G ′”, and “B ′” indicate data of each color of red (R), green (G), and blue (B) before reverse conversion. A11 ′, A12 ′, A13 ′, A21 ′, A22 ′, A23 ′, A31 ′, A32 ′, and A33 ′ are appropriately set according to the characteristics of various output devices (display device 24, printer, etc.). It is a coefficient.

  With such conversion equations (4 ') to (6'), the inverse conversion of the color conversion process can be easily executed.

<How to determine the amount of change>
FIG. 18 illustrates a method for obtaining the amount of change in histogram adjustment from the RGB value of the target color E. As described with reference to FIG. 17, the output value after changing the histogram adjustment is obtained by performing saturation adjustment, density correction, and inverse image adjustment conversion from the color designated by the user, that is, the designated color C. It becomes the value of each RGB color of the obtained target color E. Therefore, the input / output characteristics of the histogram adjustment after the change are as shown in FIG. 18, the output value after the change of the histogram adjustment, that is, the RGB values of the target color E, and the RGB colors of the designated pixel. The value (input value) must pass through the corresponding point W1. Here, as the input / output characteristics passing through the point W1, various characteristics can be considered as shown in the modification examples (1) to (4) as shown in FIG.

  Here, when the conditions under which the histogram adjustment can be changed while considering the image quality before the change of the histogram adjustment as much as possible are considered, the input / output characteristics as shown in the modified example (3) are preferable. The input / output characteristics of this modified example (3) are the points Q1, at which the output values of the input / output characteristics before the change of the histogram adjustment are the minimum value (here “0”) and the maximum value (here “255”), It is set to pass Q2. In this way, the changed input / output characteristics are expressed in the output image by being set to pass through the minimum and maximum points Q1 and Q2 of the output values of the input / output characteristics before the histogram adjustment is changed. Therefore, it is possible to retain the gray level information as much as possible.

  FIG. 19 illustrates an example of a method for specifically obtaining the change amount of the histogram adjustment by calculation. Here, the output value after changing the histogram adjustment, that is, the RGB values of the target color E and the RGB values (input values) of the designated pixel correspond to the coordinates of the point W1 (80, 122). ). Further, the coordinates of the point W2 corresponding to the output value before the change of the histogram adjustment, that is, the value of each RGB color of the color D and the value (input value) of each RGB color of the designated pixel are (80, 75). . Further, the coordinates of the points Q1 and Q2 at which the output value of the input / output characteristic before the change of the histogram adjustment becomes the minimum value (here “0”) and the maximum value (here “255”) are respectively (30, 0). ), (200, 255).

The input / output characteristics by this histogram adjustment are specified by two input / output points, that is, the coordinates of points Q1 and Q2, and an adjustment parameter called gamma (“γ”) that determines the curve shape. Therefore, if the output value is y and the input value is x, the input / output characteristics by the histogram adjustment can be expressed by the equation y = b × (x−a) ^{1 / γ} . Here, “b” and “a” are coefficients determined by input / output points, that is, points Q 1 and Q 2 and “γ”.

For example, if “γ” before the histogram adjustment is changed to “1”, the following equations (7) and (8) can be derived.
0 = b × (30−a) ^1/1 (7)
255 = b × (200−a) ^1/1 (8)
By solving these two equations (7) and (8), two coefficients “a = 30” and “b = 1.5” can be obtained. From this, the input / output characteristics of the histogram adjustment before the change are expressed by the following relational expression (9).
y = 1.5 × (x−30) ^1/1 (9)
As the input / output characteristics of the histogram adjustment after the change, the gamma value “γ” may be changed when the characteristics pass through the points Q1 and Q2. When the changed gamma value is “γ ′”, the output value before the change is “y”, and the output value after the change is “y ′”, the following relational expression (10) can be derived. . Further, since the output value “y” before the change is “75” at the point W2, and the output value “y ′” after the change is “122” at the point W1, it is changed as follows. "Γ '" can be obtained.
γ ′ = γ × {log (y / 255) / log (y ′ / 255)}
= 1 × {log (75/255) / log (122/255)}
= 1.66 …………… (10)
If “γ ′” after the change is obtained from this equation, “γ ′ = 1.66” is obtained. That is, the target change can be realized by setting the gamma value “γ” to “1.66”.

In this way, the changed gamma value “γ ′” is set to “1.66”, and the input / output characteristics of the changed histogram adjustment are obtained. Here, since the input / output characteristics of the histogram adjustment after the change pass through the points Q1 and Q2 similarly to the input / output characteristics of the histogram adjustment before the change, as in the case described above, the following relational expression (11 ), (12).
0 = b × (30−a) ^{1 / 1.66} (11)
255 = b × (200−a) ^{1 / 1.66} (12)
By solving these two equations (11) and (12), two coefficients “a = 30” and “b = 11.56” can be obtained. From this, the input / output characteristics of the histogram adjustment after the change are expressed by the following relational expression (13).
y = 11.56 × (x−30) ^{1 / 1.66} (13)
In this case, since the coordinates of the points Q1 and Q2 are not changed as the parameters for histogram adjustment, only the gamma value “γ” may be changed from “1.0” to “1.66”.

=== Summary ===
As described above, in the present embodiment, the user can arbitrarily designate a pixel on the image to be edited displayed in the preview window 170, and the user can designate a desired color for the pixel. By doing so, the user can easily change the image to be edited to a desired hue without performing adjustments by various conventional adjustments such as histogram adjustment, density correction, and image adjustment.

  In particular, when the user selects a desired color, color palettes 182 and 184 are displayed on the screen, and the user can select a plurality of different color selection color patches 188 and 192 provided in the color palettes 182 and 184. Since a desired color can be selected from among them, the user can easily find the desired color and specify it easily.

  Further, the color palettes 182 and 184 include a plurality of different color selection color patches 188 and 192 as a plurality of different color selection color patches 188 and 192 that have different hues or lightnesses with respect to the color designated by the user. Since 192 can be displayed, the user can search for a relatively different color around the specified color. As a result, the user can more easily find a desired color.

  Further, by displaying two types of color palettes, a hue color palette 182 and a lightness color palette 184, the user can further expand the selection range and more efficiently find a desired color.

  Further, when adjusting the entire color of the image to be edited based on the color specified by the user, the scanner driver has already been adjusted and corrected, such as histogram adjustment, density correction, and image adjustment. The original image (the image read by the image reading device 10) is not performed by performing adjustment on the image in the form of post-processing, but by performing adjustment by changing the adjustment or correction that has already been performed. It is possible to reduce adverse effects such as failure to make full use of this information or loss of smooth gradation.

  In particular, here, the most upstream adjustment element among a plurality of adjustment elements such as histogram adjustment, density correction, and image adjustment, that is, here, the histogram adjustment is changed to change the overall color of the image to be edited. Since the adjustment is performed, the entire image can be adjusted while avoiding problems such as overflow as much as possible.

=== Other Embodiments <Part 1> ===
In the above-described embodiment, the user designates a desired color for the pixel designated on the image to be edited by the user, whereby “second output data”, that is, image adjustment (here, image adjustment ( The output data of at least one of density correction and image adjustment (saturation) was specified, but “second output data” (here, image adjustment (excluding saturation)) The designation of at least one output data of density correction and image adjustment (saturation) is not necessarily limited to such a designation of color. That is, if the attribute of “second output data” (here, at least one output data of image adjustment (excluding saturation), density correction, and image adjustment (saturation)) is changed by the user. The attribute may be changed by any method by the user.

  Here, the color designation is performed through the color palettes 182 and 184, but the color designation is not necessarily performed through the color palettes 182 and 184. That is, the user may directly input the values of each color of red (R), green (G), and blue (B) to specify a desired color, or specify a pixel from the image. A color may be specified. In addition, in the color designation, it is not always necessary to designate a color using such a color palette 182 of hue or a color palette 184 of lightness. The color may be specified using a color palette or the like in which various types of colors are arranged.

  The order of performing various adjustments (corrections) on an input image such as an image read by the image reading apparatus 10 is <histogram adjustment> → <image adjustment (excluding saturation)> → <density as described above. Although the order of correction> → <image adjustment (saturation)> is performed, the order of various adjustments (correction) performed on the input image may be other orders other than these orders. . That is, for example, <image adjustment (excluding saturation)> → <image adjustment (saturation)> may be performed in this order, and <density correction> → <histogram adjustment> → <image adjustment (excluding saturation). > → <Image adjustment (saturation)>.

  In the above-described embodiment, as the “first data conversion unit”, the scanner driver converts the data of the pixels constituting the image read by the image reading apparatus 10 by histogram adjustment. The “first data conversion unit” is not necessarily limited to the case where data conversion is performed by such histogram adjustment. In other words, the “first data conversion unit” here is an adjustment performed on the upstream side of other adjustments based on the order in which various adjustments such as histogram adjustment, density correction, and image adjustment are performed. Any adjustment is included in the “first data conversion unit”.

  That is, in the present embodiment, image adjustment (excluding saturation) executed upstream of density correction and saturation adjustment also corresponds to the “first data conversion unit” described here. In this case, density correction or saturation adjustment corresponds to the “second data conversion unit”. Further, the density correction executed on the upstream side of the saturation adjustment corresponds to the “first data conversion unit” here. In this case, the saturation adjustment corresponds to the “second data conversion unit”. In the present embodiment, since the histogram adjustment located at the most upstream side is the most effective, the setting information is changed.

  Further, the “first data conversion unit” here is not necessarily limited to only one adjustment element. That is, in the present embodiment, the “first data conversion unit” is not limited to histogram adjustment, and image adjustment and density correction may be included in the “first data conversion unit”. Furthermore, if the order in which the various adjustments are performed is different, the saturation adjustment is also included in the “first data conversion unit”.

  Similarly for the “second data conversion unit”, in the above-described embodiment, the scanner driver performs “image adjustment (excluding saturation)”, density correction, and saturation adjustment as the “second data conversion unit”. However, this is not always the case. That is, in the “second data conversion unit” referred to here, the adjustment is performed on the downstream side of other adjustments based on the order in which various adjustments such as histogram adjustment, density correction, and image adjustment are performed. Any adjustment is included in the “second data conversion unit”. If the order in which the various adjustments are performed is different, the histogram adjustment is also included in the “second data conversion unit”.

=== Other Embodiments <Part 2> ===
As described above, the case where the present invention is applied to an image reading system including an image reading device has been described as an example based on one embodiment, but the above embodiment is for facilitating the understanding of the present invention. It is not intended to limit the invention. The present invention can be changed or improved without departing from the gist thereof, and needless to say, the present invention includes equivalents thereof. In particular, the embodiments described below are also included in the present invention.

<About images>
In the above-described embodiment, an image read from the document 15 by the image reading device 10 is described as an example of the “image”. However, the “image” referred to here is the document read by the image reading device 10. The image read from 15 is not limited. In other words, any image that is edited by the user corresponds to the “image” here.

<About pixels>
In the above-described embodiment, as “pixels”, pixel data is converted into first output data by the first data converter for all the pixels constituting the image, and the first output data is further converted to the second data converter. However, it is not always necessary to convert all the pixels constituting the image in this way.

<Regarding data of pixels constituting an image>
In the above-described embodiment, since the first data conversion unit performs the histogram adjustment, the “pixel data constituting the image” is the pixel constituting the image read from the document 15 by the image reading device 10. Although it was data, the “data of the pixels that make up the image” here is converted after various adjustments such as histogram adjustment, density correction, and image adjustment are performed on the data of the pixels that make up the image. The data output in this manner is also included in the “data of pixels constituting the image”.

<About the first setting information>
In the above-described embodiment, since the “first data conversion unit” is the histogram adjustment, the “first setting information” includes R (red), G (green), and B (blue) in the histogram adjustment. Shadow input values α11, α21, α31 and shadow output values α13, α23, α33 for each color, highlight input values α12, α22, α32, highlight output values α14, α24, α34, gamma values α15, α25, α35, tone curve The edge shape data α41 and α42 and the gray balance adjustment value α51 are used, but the “first setting information” is not necessarily in this case. That is, the “first setting information” differs depending on the form of the “first data conversion unit”.

<About the second setting information>
In the above-described embodiment, the “second data conversion unit” has the “second setting” based on a relationship corresponding to at least one of image adjustment (excluding saturation), density correction, and image adjustment (saturation). "Information" is a set value γ1, γ2, γ4, γ5, γ6, or input coordinates β11, β13, β21, β23, β31, β33 ............ and output coordinates of a plurality of points P1, P2, P3. β12, β14, β22, β24, β32, β34..., or the set value γ3, but the “second setting information” is not necessarily such a case. That is, the “second setting information” varies depending on the form of the “second data conversion unit”.

<About the first output data and second output data>
In the embodiment described above, the histogram adjustment output data Rout1, Gout1, and Bout1 are exemplified as the “first output data”. However, the “first output data” described here is not necessarily such. Not necessarily the case. That is, the “first output data” varies depending on the form of the “first data conversion unit”.

  The same applies to the “second output data”. In the embodiment described above, the “second output data” is at least one of image adjustment (excluding saturation), density correction, and image adjustment (saturation). The case of one output data Rout2, Gout2, Bout2, output data Rout3, Gout3, Bout3 or output data Rout4, Gout4, Bout4 has been exemplified. However, the “second output data” here is not necessarily this. This is not always the case. That is, the “second output data” varies depending on the form of the “second data conversion unit”.

<About the attribute of the second output data>
In the above-described embodiment, the user designates the color as the “second output data attribute”. However, in the “second output data attribute” here, such a color designation is not necessarily performed. It is not limited to. That is, any property may be used as long as it is a property related to “second output data”.

<About the setting information change section>
In the above-described embodiment, as the “setting information changing unit”, the scanner driver changes the setting information of the histogram adjustment) as the “first data converting unit”, for example, the gamma values α15, α25, α35). However, the “setting information changing unit” described here is not necessarily limited to such a case. That is, the “first setting information” changed by the “setting information changing unit” varies depending on the form of the “first data converting unit”.

<About the image display>
In the above-described embodiment, the case of the display device 24 has been described as an example of the “image display unit”. However, in the “image display unit” here, in addition to the display device 24, editing is possible. Any “image display unit” may be used as long as it is an “image display unit” that displays a target image.

<About users>
As a user, in addition to a person who uses the image reading system 2 including the image reading apparatus 10 and the computer apparatus 20, a person who performs maintenance on the image reading system 2 uses the image reading system 2. Any person who specifies the attribute of the second output data may be used.

1 is an explanatory diagram of an embodiment of an image reading system. FIG. FIG. 3 is an explanatory diagram illustrating an example of an internal configuration of an image reading apparatus. 1 is an explanatory diagram illustrating an example of a system configuration of an image reading apparatus. FIG. Explanatory drawing of an example of the system configuration | structure of a computer main body. FIG. 3 is an explanatory diagram illustrating an example of a main dialog box of a scanner driver. FIG. 5 is an explanatory diagram of an example of a dialog box for adjusting a histogram. Explanatory drawing about the definition method of a tone curve. FIG. 4 is an explanatory diagram of an example of a density correction dialog box. FIG. 4 is an explanatory diagram of an example of an image adjustment dialog box. Explanatory drawing of the data set by histogram adjustment. Explanatory drawing of the data set by density correction. Explanatory drawing of the data set by image adjustment. Explanatory drawing of an example of the adjustment procedure of an image. Explanatory drawing of an example of an image reading procedure. Explanatory drawing of an example of the preview window which displays the image of edit object. FIG. 3 is an explanatory diagram illustrating an example of a color palette adjustment dialog box. Explanatory drawing of an example of the color palette of a hue. Explanatory drawing of an example of the lightness color palette. Explanatory drawing about the outline | summary of color palette adjustment. Explanatory drawing of an example of the procedure which calculates | requires the suitable change amount of histogram adjustment. Explanatory drawing of an example of the method of calculating | requiring the suitable change amount of histogram adjustment. Explanatory drawing of an example of the method of calculating | requiring the change amount of histogram adjustment concretely by an operation.

Explanation of symbols

2 image reading system, 10 image reading device, 12 document table,
14 Document cover, 15 Document, 18 Hinge, 20 Computer device,
22 computer body, 24 display device, 26 input device,
28 FD drive device, 30 CD-ROM drive device,
32 readers, 34 keyboards, 36 mice,
40 Carriage, 42 Drive mechanism, 44 Guide, 46 Exposure lamp,
48 lens, 50 image sensor, 52 control unit, 54 timing belt,
55 pulley, 56 pulley, 58 drive motor, 60 controller,
62 motor control unit, 64 lamp control unit, 66 sensor control unit,
68 AFE (Analog Front End) part, 70 Digital processing circuit,
72 interface circuit, 74 analog signal processing circuit, 76 A / D conversion circuit,
80 CPU, 82 memory, 84 HDD (hard disk drive),
86 operation input unit, 88 display control unit, 90 external communication unit, 92 bus,
100 dialog box, 102 “mode selection field”, 104 “save setting”,
106 “Original setting field”, 108 “Output setting field”, 110 “Adjustment field”,
112 “Document Type”, 114 “Scanning Device”, 116 “Auto Exposure”,
118 “Image type”, 120 “Resolution”, 122 “Original size”,
124 “Output Size”, 126 “Scan Button”,
127 “Preview button”, 128A button, 128B button,
128C button, 128D button, 128E button,
130A check box, 130B check box,
130C check box, 130D check box,
130E check box, 131 dialog box,
132 Histogram display field, 134 Tone curve display field,
136 Gray balance adjustment field, 138 channel field,
140A slider, 140B slider, 140C slider,
142A Numerical input field, 142B Numerical input field, 142C Numerical input field,
142D numeric input field, 142E numeric input field, 143A syringe button,
143B syringe button, 143C syringe button,
144A End curve shape change button, 144B End curve shape change button,
145 slider, 150 dialog box, 152 tone curve display area,
154 Channel field, 156A Numerical value input field, 156B Numerical value input field,
158 Density correction setting save field, 160 dialog box,
162A slider, 162B slider, 162C slider,
162D slider, 162E slider, 162F slider,
164A Numerical input field, 164B Numerical input field, 164C Numerical input field,
164D numeric input field, 164E numeric input field, 164F numeric input field,
170 preview window, 172 preview area, 174 operation area,
176 pointer, 180 dialog box, 182 color palette,
184 color palette, 186 specified color patch, 188 selected color patch,
190 Specified color patch, 192 Selected color patch, 194A Numerical value input field,
194B numeric input field, 194C numeric input field, 195A dropper button,
195B dropper button, 196 color storage field, 197A apply button,
197B Save button, 198 color save box

Claims (11)

A first adjustment unit that performs a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment, and at least one other adjustment An image editing apparatus including a second adjustment unit that performs the second adjustment.
Displaying the image after the second adjustment after the first adjustment on the original image;
When the specified color is specified by the user for the specified pixel specified by the user from the displayed image,
A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
The image editing characterized in that the first adjustment is changed so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment. apparatus. When the designated color is designated for the designated pixel, the first color is adjusted so that the color of the pixel at the designated pixel position of the original image becomes the target color by performing the first adjustment. When the adjustment is changed
The image editing apparatus according to claim 1, wherein the second adjustment is maintained without being changed . The image editing apparatus according to claim 1 , wherein the pixel data is RGB data of the pixel. The first adjustment is an adjustment of at least one of the histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment with respect to data of all pixels constituting the original image. image editing apparatus according to claim 1, characterized in that the subjecting. Each time the designated pixel and the designated color are designated by a user, the first adjustment is changed, and the second adjustment is performed after the first adjustment after the change is applied to the original image. The image editing apparatus according to any one of claims 1 to 4 .   The first adjustment is a histogram adjustment;
  The tone curve of the histogram adjustment after changing the first adjustment passes through a point where the color of the pixel at the position of the designated pixel of the original image is an input value and the target color is an output value.
The image editing apparatus according to claim 1, wherein the image editing apparatus is an image editing apparatus. The tone curve after changing the first adjustment passes through a point where the output value of the tone curve before changing the first adjustment becomes a minimum value and a maximum value. Image editing device.   Applying a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment; and a second adjustment that is at least one of the other adjustments. An image editing method comprising the steps of:
  Displaying the image that has been subjected to the second adjustment after the first adjustment has been made to the original image;
  When the specified color is specified by the user for the specified pixel specified by the user from the displayed image,
        A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
        Changing the first adjustment so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment;
An image editing method characterized by comprising:   Applying a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment; and a second adjustment that is at least one of the other adjustments. An image editing program for executing an adjustment step,
  Displaying the image that has been subjected to the second adjustment after the first adjustment has been made to the original image;
  When the specified color is specified by the user for the specified pixel specified by the user from the displayed image,
        A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
        Changing the first adjustment so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment;
An image editing program characterized by executing (A) an image reading unit that reads an original image from a document;
(B) a first adjustment unit that performs a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment, and at least one of the other A second adjustment unit for performing a second adjustment that is an adjustment of
An image reading system comprising (C),
(D) displaying the image subjected to the second adjustment after performing the first adjustment on the original image read by the image reading unit;
When the specified color is specified by the user for the specified pixel specified by the user from the displayed image,
A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
The image reading characterized in that the first adjustment is changed so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment. system. Reading the original image from the document;
Performing a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment; and a second adjustment that is at least one of the other adjustments. Steps to make adjustments and
An image reading method comprising:
Displaying the image subjected to the second adjustment after performing the first adjustment on the read original image;
When the specified color is specified by the user for the specified pixel specified by the user from the displayed image,
A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
Changing the first adjustment so that the color of the pixel at the position of the designated pixel in the original image becomes the target color by performing the first adjustment;
An image reading method comprising: