JP2713677B2 - Color image color change processing method and color image synthesis processing method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a color image color change processing system for changing the color of an image portion in a color image, and a color image in which an image portion included in the color image is cut out and combined with another color image. Regarding the synthesis processing method, in particular, when changing the color, a color image color change processing method that allows the color to be changed while preserving the naturalness of the hue of the boundary image portion located between the image portions, The present invention relates to a color image synthesizing method that enables an image to be synthesized while preserving the natural color tone of a boundary image portion located between image portions during image synthesis.

An electronic catalog creation system using a computer or an electronic design system such as a poster using a computer adopts a configuration in which a base color image is read by a reading device and displayed on a color monitor. By changing the color of the image part in the middle or cutting out the image part in this color image and combining it with another image,
The process of completing catalogs and designs will be executed. Similarly, when creating computer graphics, similarly, color changing processing of changing the color of the image part in the color image, cutting out the image part in the color image and combining it with another image Image synthesis processing.

In such a color changing process of a color image on a computer, it is necessary to make it possible to change the color while maintaining the natural color tone of the boundary image portion.
In the image synthesis processing of a color image on such a computer, it is necessary to enable the image synthesis while maintaining the naturalness of the hue of the boundary image portion.

[0004]

2. Description of the Related Art When changing the color of a color image, a configuration is adopted in which a color palette in which many colors are arranged is displayed on a color monitor so that an operator can specify an image portion to be changed. The color of the color-change-target image portion is changed by selecting the correction color of the color-change-target image portion from the displayed color palette.

Further, as shown in FIG. 5, a configuration is adopted in which an image representing a knob for adjusting brightness, saturation and hue is displayed on a color monitor in a simulated manner, so that the operator can change the color. The color of the color change target image is changed by causing the target image portion to be specified and changing the position of the setting value of the knob to be displayed to the correction color of the color change target image portion. .

In such a color change process, conventionally, a boundary image portion located between an image portion to be color-changed and an image portion to be non-color-changed is replaced with an image portion to be color-changed. Either the method of changing the color including the color or the method of leaving the color as it is in the non-color-change target image portion has been adopted.

Conventionally, even in a color image synthesizing process, a boundary image portion located between an image portion to be cut out and a remaining image portion is treated as a part of the image portion to be cut out. Or the combination of images that are treated as a part of the remaining image part.

[0008]

However, according to the prior art, there is a problem that the color of the boundary image portion becomes unnatural after the color changing process or the image synthesizing process. . That is, for a color image such as a natural image input via a camera, a drum scanner, an image scanner, or the like, the color of the boundary image portion is included in either the color change target side or the non-color change target side to perform the color change. Or the image is synthesized by including the color of the boundary image portion on either the cut-out side or the remaining side, and the color of the boundary image portion is smooth before the color change / image synthesis. However, after the color change / image synthesis, the continuity is lost and the image suddenly changes. As a result, a pseudo outline occurs in the boundary image portion, and the color image becomes unnatural.

Next, the cause will be described. Even if there is no mixed color at the color boundary of the color document to be read by the image input device, when the color document is read as a digital color image via a camera, a drum scanner, an image scanner, or the like, the color boundary is read. In the part, the colors of the two adjacent image parts are mixed. That is, a color document is irradiated with light, photoelectrically converted by a CCD image sensor or the like, and read as a color image. At this time, as shown in FIG. Reflected light from an area wider than the area of the document corresponding to one pixel of the sensor is incident on one pixel of the sensor, and is in a blurred state. As a result, an intermediate color that is not present in the original color original is generated at the boundary of the object in a form such as additive color mixture of the reflected lights of the two colors. This gives the image continuity and a natural feeling.

[0010] Against this background, the present applicant has previously filed Japanese Patent Application No. 3-283479 (title of the invention: color image color adjustment and image synthesizing method and apparatus). By using an additive color mixture model, the invention discloses that the color can be changed while maintaining the naturalness of the hue of the boundary image portion, and the image can be synthesized.

That is, as shown in FIG.
The color data of the object image inside (Ro, Go, Bo) is
-The color data of the background image in the image is (Rb, Gb, Bb)
, The boundary located between the object image and the background image
The color data (Re, Ge, Be) of the field image portion is expressed as: Re = k1_r・ Ro + k2_r・ Rb Ge = k1_g・ Go + k2_g· Gb · · · · · Equation 1 Be = k1_b・ Bo + k2_b・ Bb where k1_r+ K2_r= 1 k1_g+ K2_g= 1 k1_b+ K2_b= 1, and this equation 1
Color data of object image (Ro, Go, Bo), background image
Color data (Rb, Gb, Bb), color data of the boundary image
(Re, Ge, Be), the color mixture ratio value
k1_r,k1_g,k1 _b(K2_r,k2_g,k2_bBut the same)
calculate.

Next, the color data (Ro ', Go', Bo ') of the object image after the color change and the color data (R
b ′, Gb ′, Bb ′), the calculated color mixture ratio values k1 _r, k1 _g, k1 _b are used to calculate Re ′ = k1 _r · Ro ′ + (1−k1 _r ) · Rb. according to equation 2 _{as' Ge '= k1 g · Go} ' + (1-k1 g) · Gb '····· equation _{2 Be' = k1 b · Bo} '+ (1-k1 b) · Bb', boundary Color data (R
e ', Ge', Be ') to determine the color data of the boundary image portion after the color change.

Also, in the image synthesizing process, when the image portion to be cut out is on the object side, a configuration is adopted in which the boundary image portion is attached to the object image and moved, and the color data (Ro) of the object image after image synthesis is adopted. ', Go', 'a), the color data of the background image (Rb' Bo, the Gb ', Bb') and are determined by using the calculated mixing ratio value _{k1 r, k1 g, k1 b} , above According to Equation 2, the color data (Re ′, G
e ′, Be ′), the color data of the boundary image portion after image synthesis is determined.

In this way, by using the additive color mixture model for the boundary image portion, it is possible to execute color change and image synthesis while preserving the natural color tone of the boundary image portion in the color image.

Certainly, Japanese Patent Application No. 3-283479, which was filed earlier.
According to the invention, color change and image composition can be executed while preserving the natural color tone of the boundary image portion.
However, when the color mixture ratio values k1 _r, k1 _{g, and} k1 _b are actually obtained, the color mixture ratio values k1
_In some cases, _r, k1 _{g, and} k1 _b do not fall between 0 and 1, which are the original values.

That is, in the image scanner, a unique color shift phenomenon based on the reading principle occurs at the boundary of the image. In the case of using the contact sensor shown in FIG. 7A, since each pixel of RGB does not read the same original position in the main scanning direction, for example, as shown in FIG. Colors not found in the original document may occur, such as the occurrence of orange at the boundary of a black and white image. In the case of using the light source switching method shown in FIG. 7B, in order to sequentially switch light sources and read three colors in a time-division manner, for example, as shown in FIG. A color that does not exist in the original document may occur, such as the occurrence of orange at the boundary of an image. In addition, in addition to this, due to noise of the image input device, etc.,
Colors not found in the original document may occur. These cause the color mixture ratio values k1 _r, k1 _{g, and} k1 _b not to fall between 0 and 1.

However, in the invention of Japanese Patent Application No. 3-283479 previously filed, no consideration has been given to this point.
Unexistent colors appear in the boundary image portion, and the problem remains that the color tone of the boundary image portion is rather unnatural.

The present invention has been made in view of such circumstances, and in accordance with the invention of Japanese Patent Application No. 3-283479 filed earlier, the naturalness of the hue of the boundary image portion included in the color image is preserved. A new color image color change processing method and a new color image synthesis processing method are provided to make this effect even more reliable when adopting a configuration that enables color change / image synthesis as it is. It is assumed that.

[0019]

FIG. 1 shows the principle configuration of the present invention. In the figure, reference numeral 1 denotes a color image data processing device equipped with the present invention, 2 denotes a man-machine interface device connected to the color image data processing device 1, and 3 denotes input means connected to the man-machine interface device 2. .

The color image data processing apparatus 1 includes an input / output control unit 10, a color image data management unit 11, a color image data display control unit 12, an object extraction unit 13, a boundary / background specification unit 14, a color mixture Ratio calculating means 15, forced setting means 16, color mixing ratio storing means 17, condition setting means 18
And boundary color data calculation means 19.

The input / output control means 10 includes a man-machine
An interface process with the interface device 2 is executed. The color image data management means 11 manages the color data of each pixel of the color image displayed on the display screen of the man-machine interface device 2. The color image data display control means 12 displays a color image on the display screen of the man-machine interface device 2 according to the management data of the color image data management means 11.

The object extracting means 13 extracts an object image to be subjected to color change / image synthesis from a color image displayed on the display screen of the man-machine interface device 2. The boundary / background specifying unit 14 specifies a background image of the object image extracted by the object extracting unit 13 and a boundary image portion located between the background image and the background image.

The color mixing ratio calculating means 15 is provided for the object extracting means 1.
3 using the color data of the object image to be extracted and the color data of the boundary image portion / background image specified by the boundary / background specifying means 14 to solve the color mixing ratio of each pixel in the boundary image portion. to calculate the value _{k1 r, k1 g, k1 b} . The forcible setting means 16 is developed by the color mixing ratio calculating means 15, and when the calculated color mixing ratio values k1 _r, k1 _{g, and} k1 _b do not fall between the original values of 0 and 1, the values are set to 0. From 1
Is forcibly set to the specified value set in the range.
The color mixture ratio storage unit 17 stores the color mixture ratio values k1 _r, k1 _{g, and} k1 _b calculated by the color mixture ratio calculation unit 15.

When executing the color changing process, the condition setting means 18 sets the color data of the object image to be color-changed extracted by the object extracting means 13 (at this time, when the color data of the background image is also changed). When the image combining process is executed, the color data of an image serving as a new background image of the object image extracted by the object extracting means 13 is set (at this time, the color data of the object image is set). When changing also, set the color data)
I do. The boundary color data calculation unit 19 is provided with a condition setting unit 18.
And color data requirements for color change processing / image synthesizing process set by color mixing ratio value is stored in the mixing ratio storage means _{17 k1 r, k1 g, k1} b itself or their mixing ratio value k1 _r, k1 _{g, ,} k1 _b and the color mixture ratio values derived from Equation 2 to obtain
The color data after the color change / image synthesis of the boundary image portion specified by the above is calculated and stored in the color image data management means 11.

[0025]

According to the present invention, the object extracting means 13 extracts an object image to be subjected to color change / image synthesis by interacting with an operator, and upon receiving the extraction, the boundary / background specifying means 14 extracts the object image. A background image of the object image and a boundary image portion located between the background image and the background image are specified.

In this way, the color data of the object image to be subjected to the color change / image synthesis, the color data of the background image of the object image, and the color data of the boundary image portion located around the object image Can be determined, the color mixture ratio calculation means 15 solves Equation 1 using these color data, and thereby the color mixture ratio value k of each pixel in the boundary image portion.
1 _r, k1 _{g, and} k1 _b are calculated and stored in the color mixture ratio storage unit 17. At this time, the compulsory setting means 16 determines that the calculated color mixture ratio values k1 _r, k1 _{g, and} k1 _b are from 0, which is the original value, to 1
If the value does not fall within the range, the value is forcibly set to a specified value set in the range of 0 to 1. For example, when the color mixture ratio values k1 _r, k1 _{g, and} k1 _b indicate a value of 0 or less, the value is set to 0, and when the color mixture ratio value indicates a value of 1 or more, the value is set to 1; In such a case, a process of setting the value to a value near 0.5 is executed.

On the other hand, the condition setting means 18 sets the color data of the object image and the background image after the color change processing / image synthesis processing by interacting with the operator, and manages the color image data according to the set color data. The management data of the means 11 is updated.

In this way, the color mixture ratio storage means 17
Color mixture ratio value k1 of each pixel in the boundary image portion_r,k1_g,k
1_bIs stored, and the color is
Of the object image and the background image after the change processing / image synthesis processing
When the color data is set, the boundary color data calculation means 19
Represents the color data and the color mixture ratio value k1_r,k1_g,k1
_bItself or their color mixture ratio value k1_r,k1_g,
k1_bAnd the color mixture ratio value derived from
To calculate the color data of each pixel in the boundary image part.
And stored in the color image data management means 11.

When the color data of the boundary image portion calculated by the boundary color data calculation unit 19 is stored in the color image data management unit 11 in this way, the color image data display control unit 12 In accordance with the color data of the image part and the color data of the object image and the background image set by the condition setting means 18, the color image after the color change processing / image synthesis is displayed on the display screen of the man-machine interface device 2. To go.

As described above, according to the present invention, according to the invention of Japanese Patent Application No. 3-283479, the natural color tone of the boundary image portion is preserved by applying the additive color mixture model to the boundary image portion. When adopting a configuration that allows color change and image synthesis to be performed while the color mixture ratio value used for constructing the additive color mixture model is always within the original value range, the boundary image part Thus, it is possible to prevent the appearance of a color that is impossible in the above, and it is possible to ensure the naturalness of the hue of the boundary image portion.

[0031]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below in detail with reference to embodiments. FIG. 2 shows a system configuration of a color image data processing system implementing the present invention. In the figure, reference numeral 20 denotes a color image data processing device for realizing the present invention, reference numeral 30 denotes an image input device connected to the color image data processing device 20, and reference numeral 40 denotes a color monitor connected to the color image data processing device 20. Here, the image input device 30 has an input function of color image information and also has an input function of data information.

The color image data processing device 20 includes an image holding memory 21 for holding color image information and the like read by an image scanner or the like of the image input device 30.
A first-stage process executing unit 22 that executes a first-stage process of a color changing process / image synthesizing process; and a second-stage process executing unit 23 that executes a second-stage process of a color changing process / image synthesizing process. And a display memory 24 for reading out and developing color image information to be displayed on the color monitor 40 from the image holding memory 21.

FIG. 3 shows an embodiment of the processing flow executed by the first-stage processing execution means 22, and FIG. 4 shows an embodiment of the processing flow executed by the second-stage processing execution means 23.
Next, the color changing process and the image synthesizing process of the color image of the present invention will be described in detail according to these process flows.

When the color of the image portion included in the color image displayed on the color monitor 40 is changed, or the image portion included in the color image is cut out and combined with another color image, the first stage processing As shown in the processing flow of FIG.
An object image to be subjected to color change / image synthesis is extracted from the color image. In the extraction process, for example, an object cut out by a mouse or the like provided in the image input device 30 is extracted as an object image to be subjected to color change / image synthesis,
Alternatively, according to the invention of Japanese Patent Application No. 3-49981 (title of the invention: color extraction method and color extraction device) previously filed by the present applicant, the same system as the color pointed by the mouse or the like provided in the image input device 30 is used. This is executed by extracting an object having the color as an object image to be subjected to color change / image synthesis.

Next, in step 2, the peripheral part of the extracted object image is specified as a boundary image part,
An image portion located further outside the boundary image portion is specified as a background image. Subsequently, in step 3, the color data (Ro, G) of the object image extracted from the image holding memory 21 is read.
o, Bo) and the color data (Rb, G
b, Bb) and the color data (Re
, Ge, Be) are read out, and in the subsequent step 4, the color mixing ratio values k1 _r, k1 _g, k1 of the pixels in the boundary image portion are solved by solving Equation 1 using the read color data.
Calculate _b .

[0036] Then, in Step 5, it is determined whether the color mixing ratio value calculated as described above k1 _r, k1 _g, k1 _b falls between 0 and 1, which is the original value. If it is determined in step 5 that there is something that does not fall between the original values of 0 and 1, the process proceeds to step 6, where the color mixing ratio values k1 _r, k1 _{g, and} k1 that do not indicate the original values are displayed. _b is forcibly set to a specified value set between 0 and 1. For example, when the color mixture ratio values k1 _r, k1 _{g, and} k1 _b indicate a value of 0 or less, the value is set to 0, and when the color mixture ratio value indicates a value of 1 or more, the value is set to 1; In such a case, a process of setting the value to a value near 0.5 is executed.

Then, in the following step 7, the calculated and forcibly set values are set.
Fixed color mixture ratio value k1_r,k1_g,k1 _bThe image retention note
And the process is terminated. On the other hand, in step 5
By the judgment, all the calculated color mixing ratio values k1_r,k1_g,
k1_bIs between 0 and 1 which is the original value
When performing, without performing the processing of step 6,
Proceeding immediately to step 7, the calculated color mixture ratio value k
1_r,k1_g,k1_bIs stored in the image holding memory 21 and processed.
End the process.

As described above, the color mixing ratio values k1 _r, k1 _g, k of the pixels in the boundary image portion are stored in the image holding memory 21.
When _1b is stored, the second-stage process execution unit 23 executes the process flow of FIG. 4 to change the color of the object image extracted by the first-stage process execution unit 22, or to execute another process. A process for combining with a color image is executed.

That is, the second stage processing execution means 23
As shown in the processing flow of FIG. 4, first, in step 10, by interacting with the image input device 30, the color data of the object image and the background image after the color change processing / image synthesis processing are set. For example, in the color change processing, when the color of only the object image to be changed is changed, the color data (Ro ', Go', Bo ') of the object image after the color change processing is used.
Is set, and (Rb, Gb, Bb) before the color change processing is set for the color data of the background image, and when the color of the background image is changed together with the object image to be changed, the object after the color change processing is set. Image color data (Ro ', Go',
Bo ′) and the color data (Rb ′, Gb ′, Bb ′) of the background image after the color change processing. In the image synthesis processing, the color data (R
b ′, Gb ′, Bb ′), and (Ro, Go, Bo) before color change processing are set (this can also be changed) for the color data of the object image.

Next, in step 11, the color mixture ratio value k1 _r,
k1 _{g and} k1 _b are read out, and in the following step 12, the color data set in step 10 and the read out color mixture ratio values k1 _r, k1 _{g and} k1 _b are substituted into equation 2 to change the color. The color data (Re ', Ge', Be ') of the boundary image portion after the processing / image synthesis processing is calculated. In this case, rather than using color mixing ratio value k1 _r, k1 _g, k1 _b itself directly, or using it to calculate three average values as color mixing ratio value is substituted into Equation 2, one of It is also possible to select a representative value and use it as a color mixing ratio value to be substituted into Equation 2.

Then, in the subsequent step 13, in the color changing process, the color data of the object image and the background image stored in the image holding memory 21 are updated to those set in step 10, and the image holding The color data of the boundary image portion stored in the image memory 21 is updated to the color data calculated in step 12, while in the image synthesizing process, the image data of the synthesis destination stored in the image holding memory 21 is updated. Is updated to that of the color data of the object image set in step 10, and the color data of the surrounding image portion of the object image corresponding to the color data of the boundary image portion calculated in step 14 is associated therewith. Update to

When new color data of each pixel is stored in the image holding memory 21 in this manner, the color monitor 40 displays a color image obtained by color change / image synthesis.

Although the illustrated embodiment has been described, the present invention is not limited to this. For example, in the embodiment,
Although the present invention has been disclosed according to the additive color mixture model represented by the RGB color system, the present invention is not limited to this, and may include an additive color model represented by another color system.

[0044]

As described above, according to the present invention,
According to the invention of Japanese Patent Application No. 3-283479 filed earlier, by applying an additive color mixture model to a boundary image portion, it is possible to execute color change and image synthesis while preserving the natural color tone of the boundary image portion. When adopting the configuration, since the color mixture ratio value used for constructing the additive color mixture model is always within the range of the original value, it is possible to prevent the appearance of an impossible color in the boundary image portion. As a result, the naturalness of the hue of the boundary image portion can be ensured.

[Brief description of the drawings]

FIG. 1 is a principle configuration diagram of the present invention.

FIG. 2 is a system configuration diagram of a color image data processing system implementing the present invention.

FIG. 3 is an embodiment of a processing flow executed by a first stage processing executing means.

FIG. 4 is an embodiment of a processing flow executed by a second stage processing executing means.

FIG. 5 is an explanatory diagram of a color change processing configuration of a color image.

FIG. 6 is an explanatory diagram of image input characteristics.

FIG. 7 is an explanatory diagram of an image scanner.

FIG. 8 is an explanatory diagram of occurrence of color shift by the image scanner.

FIG. 9 is an explanatory diagram of the invention of the prior application.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Color image data processing device 2 Man-machine interface device 3 Input means 10 Input / output control means 11 Color image data management means 12 Color image data display control means 13 Object extraction means 14 Boundary / background specification means 15 Color mixture ratio calculation means 16 Mandatory Setting means 17 color mixing ratio storage means 18 condition setting means 19 boundary color data calculation means

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁶ Identification code Agency reference number FI Technical display location G06F 15/68 310A 15/72 310

Claims (6)

(57) [Claims] 1. A method for converting color data of a boundary image portion located between a first image portion displayed on a display device and a second image portion adjacent to the first image portion into a first image portion. Of the color data defined by the multiplication of the color data of the portion and the color mixture ratio value ki (i = 1 to 3) and the color data of the second image portion and the color mixture ratio value (1-ki) When the color data of the first and second image portions and the color data of the boundary image portion are specified, the color data is expressed by an addition vector with the color data defined by the multiplication. According to the configuration, the color mixture ratio value ki of the boundary image portion is calculated, and when the color data of the first and second image portions serving as the color change condition is given, these color data, The calculated color mixture ratio value ki itself or derived from the color mixture ratio value ki. A color image color change processing method for processing to calculate the color data of the boundary image portion from the output ratio value k-j (j = 1 to 3). A color image color change processing method characterized in that when i does not fall within the range of 0 to 1, processing is performed so as to be handled as a specified value set in the range of 0 to 1. 2. The color image color change processing method according to claim 1, wherein when the calculated color mixture ratio value ki has a value of 0 or less, the color mixture ratio value ki is treated as having a value of 0 and the value of 1 or more is treated. A color image color change processing method characterized in that when indicated, it is processed to be treated as having a value of 1. 3. The color image color change processing method according to claim 1, wherein the calculated color mixture ratio value ki has a value of 0 or less.
A color image color change processing method characterized in that when a value of 1 or more is indicated, processing is performed such that it is handled as having a value near 0.5. 4. A method for converting color data of a boundary image portion located between a first image portion displayed on a display device and a second image portion adjacent to the first image portion into a first image portion. Of the color data defined by the multiplication of the color data of the portion and the color mixture ratio value ki (i = 1 to 3) and the color data of the second image portion and the color mixture ratio value (1-ki) When the color data of the first and second image portions and the color data of the boundary image portion are specified, the color data is expressed by an addition vector with the color data defined by the multiplication. Is employed to calculate the color mixture ratio value k−i of the boundary image portion according to the following formula. When the first image portion and the boundary image portion are combined with another image, When color data and color data of the different image are given, these color data, The issued 該混 color ratio value k-i itself, or the ratio value is derived from 該混 color ratio value k-i k-j (j = 1~
3) is a color image synthesis processing method for calculating the color data of the boundary image portion from the above, and when the calculated color mixture ratio value k-i does not fall within the range of 0 to 1, A color image synthesizing processing method characterized in that processing is performed so as to be handled as a specified value set in a range of 0 to 1. 5. The color image synthesizing method according to claim 4, wherein when the calculated color mixture ratio value ki has a value of 0 or less, the color mixture ratio value ki is treated as having a value of 0 and indicates a value of 1 or more. A color image synthesis processing method characterized by processing that is sometimes treated as having a value of 1. 6. The color image synthesizing method according to claim 4, wherein the calculated color mixture ratio value ki has a value of 0 or less;
A color image synthesis processing method characterized in that when it indicates a value of 1 or more, it is processed so as to be treated as having a value near 0.5.