JPH05204348A - Color image color changing processing system and color image synthesizing processing system - Google Patents

Abstract

PURPOSE:To prevent impossible color from appearing in a border image part by putting color mixture proportion value used for the construction of an adding color mixture model in the range of original value. CONSTITUTION:A condition setting means 18 sets the color data of an object image and a background image after color changing processing/image synthesizing processing by interacting with an operator, and simultaneously, updates the control data of a color image data control means 11 corresponding to the set color data. Them, color data in a border image part calculated by a border color data calculating means 19 is stored in a color image data control means 11, and a color image data display control means 12 displays a color image after color changing processing/image synthesizing on the display screen of a man-machine.interface device 2 in accordance with the color data of the border image part and the color data of the object image and the background image set by the condition setting means 18.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a color image color changing processing method for changing the color of an image portion in a color image, and a color image for cutting out an image portion included in a color image and combining it with another color image. Regarding a combining processing method, in particular, when changing colors, a color image color changing processing method that allows the color to be changed while preserving the naturalness of the hue of the boundary image portion located between the image portions, The present invention relates to a color image composition processing method that enables image composition while preserving the naturalness of the hue of a boundary image part located between image parts when synthesizing images.

In an electronic catalog creating system for a product using a computer and an electronic design system such as a poster using a computer, a color image as a base is read by a reading device and displayed on a color monitor. By changing the color of the image part inside, or cutting out the image part in this color image and combining it with another image,
The process of completing the catalog and design will be executed. Also, when creating computer graphics, similarly, color change processing that changes the color of the image part in the color image, or cutting out the image part in the color image and combining with another image The image synthesizing process of performing is performed.

In such a color changing process of a color image on a computer, it is necessary to change the color while preserving the naturalness of the hue of the boundary image portion.
In such an image synthesizing process of a color image on a computer, it is necessary to perform image synthesizing while preserving the naturalness of the hue of the boundary image portion.

[0004]

2. Description of the Related Art When a color change of a color image is executed, a color palette in which a large number of colors are arranged is displayed on a color monitor so that an operator can designate an image part to be changed in color. The color of the color change target image portion is changed by selecting the correction color of the color change target image portion from the displayed color palette.

Further, as shown in FIG. 5, a color monitor is used to display a pseudo image of knobs for adjusting lightness, saturation, and hue to change the color for the operator. The color of the color change target image portion is changed by specifying the target image portion and changing the position of the setting value of those knobs to be displayed to the correction color of the color change target image portion. .

In such a color changing process, conventionally, the boundary image portion located between the color changing target image portion and the non-color changing target image portion is changed to the color change target image portion. Either the color is changed or the color is changed, or the color is included in the non-color-change target image part and the color is left as it is.

Even in the color image synthesizing process, conventionally, the boundary image portion located between the image portion to be cut out and the remaining image portion is treated as a part of the image portion to be cut out and image synthesis is performed. Either, or they are treated as a part of the remaining image portion and the image is synthesized.

[0008]

However, according to such a conventional technique, there is a problem that the color of the boundary image portion becomes unnatural after the color changing process and the image synthesizing process. .. That is, for a color image such as a natural image that is input via a camera, a drum scanner, an image scanner, etc., the color of the boundary image part is changed to either the color change target side or the non-color change target side. If you adopt the method of combining images by including the color of the boundary image part on either the cutout side or the remaining side, the color of the boundary image part will be smooth before the color change / image combination. However, after the color is changed / the image is combined, the continuity is lost and the change is rapidly made. As a result, a pseudo contour is generated in the boundary image portion, and the color image becomes unnatural.

Next, the cause will be described. Even if there are no mixed colors in the color boundary of the color original to be read by the image input device, if the color original is read as a digital color image through a camera, drum scanner, image scanner, etc., the color boundary In the part, the colors of two adjacent image parts are mixed. That is, the color original is illuminated with light and photoelectrically converted by a CCD image sensor or the like to be read as a color image. However, at this time, due to the limit of the resolution of the lens, as shown in FIG. The reflected light from an area wider than the area of the document corresponding to one pixel of the sensor is incident on the one pixel of the sensor, which causes a blur. As a result, an intermediate color that does not exist in the original color original is generated at the boundary of the object in the form of additive color mixture of the reflected lights of the two colors. This gives the image continuity and gives it a natural feel.

Against this background, the applicant of the present application filed Japanese Patent Application No. 3-283479 (Title of Invention: Color Adjustment and Image Compositing Method and Apparatus for Color Image) of the boundary image portion. On the other hand, the invention has been disclosed in which, by using an additive color mixture model, it is possible to change the color while preserving the naturalness of the hue of the boundary image portion and to perform image synthesis.

That is, as shown in FIG. 9, a color image
Color data of the object image inside (Ro, Go, Bo)
-Color data of the background image in the image (Rb, Gb, Bb)
, The boundary located between the object image and the background image.
The color data (Re, Ge, Be) of the boundary image portion is Re = k1_r・ Ro + k2_r・ Rb Ge = k1_g・ Go + k2_g・ Gb ・ ・ ・ Equation 1 Be = k1_b・ Bo + k2_b・ Bb where k1_r+ K2_r= 1 k1_g+ K2_g= 1 k1_b+ K2_bIt is expressed by the additive color mixture model of = 1 and
Color data of object image (Ro, Go, Bo), background image
Color data (Rb, Gb, Bb), color data of boundary image part
By substituting the parameters (Re, Ge, Be), the color mixture ratio value
k1_r,k1_g,k1 _b(K2_r,k2_g,k2_bBut the same)
calculate.

Then, the color data (Ro ', Go', Bo ') of the object image after the color change and the color data (R of the background image
b ′, Gb ′, Bb ′) are determined, Re ′ = k1 _r · Ro ′ + (1−k1 _r ) · Rb using the calculated color mixture ratio values k1 _r, k1 _g, k1 _b according to equation 2 _{as' Ge '= k1 g · Go} ' + (1-k1 g) · Gb '····· equation _{2 Be' = k1 b · Bo} '+ (1-k1 b) · Bb', boundary Color data (R
By calculating e ′, Ge ′, Be ′), the color data of the boundary image portion after the color change is determined.

Further, in the image synthesizing process, when the image portion to be cut out is on the object side, the boundary image portion is attached to the object image and moved, and the color data (Ro of the object image after image synthesizing) is adopted. ', Go', Bo ') and the color data (Rb', Gb ', Bb') of the background image are determined, using the calculated color mixture ratio values k1 _r, k1 _g, k1 _b , The color data (Re ′, G
By calculating e ′, Be ′), the color data of the boundary image portion after image combination is determined.

In this way, the additive color mixture model is used for the boundary image portion so that the color change and the image composition can be executed while the naturalness of the hue of the boundary image portion in the color image is preserved.

Certainly, Japanese Patent Application No. 3-283479 filed in the future.
According to the invention of the issue, it becomes possible to execute color change and image composition while preserving the naturalness of the hue of the boundary image portion.
However, when actually _{calculating the} color mixing ratio values k1 _r, k1 _{g, and} k1 _b , the color mixing ratio value k1
_{It is possible that r,} k1 _g, k1 _b do not fall between the original values of 0 and 1.

That is, in the image scanner, a peculiar color shift phenomenon occurs based on the reading principle at the boundary portion of the image. In the case where the contact sensor shown in FIG. 7A is used, the RGB pixels do not read the same document position in the main scanning direction, and therefore, for example, as shown in FIG. Occurrence of a color that is not in the original document, such as an orange color at the boundary of a black and white image. In the case of using the light source switching method shown in FIG. 7B, the light sources are sequentially switched to read three colors in a time-division manner. For example, as shown in FIG. 8B, black and white in the sub-scanning direction. Occurrence of a color that is not in the original document, such as orange at the boundary of the image. In addition to this, due to noise or the like of the image input device, in the boundary portion of the image,
Occurrence of colors that are not in the original document. These are the causes that the color mixture ratio values k1 _r, k1 _{g, and} k1 _b do not fall between 0 and 1.

However, in the invention of Japanese Patent Application No. 3-283479 previously filed, this point was not taken into consideration.
There was a problem that colors that could not exist appeared in the boundary image portion, and the hue of the boundary image portion became rather unnatural.

The present invention has been made in view of such circumstances, and in accordance with the invention of Japanese Patent Application No. 3-283479 previously filed, the naturalness of the hue of the boundary image portion included in the color image is preserved. The purpose is to provide a new color image color change processing method and a new color image composition processing method that can achieve this effect even more when adopting a configuration that allows color modification / image composition as it is. It is what

[0019]

FIG. 1 illustrates the principle configuration of the present invention. In the figure, 1 is a color image data processing apparatus equipped with the present invention, 2 is a man-machine interface apparatus connected to the color image data processing apparatus 3, and 3 is an input means connected to the man-machine interface apparatus 2. ..

The color image data processing apparatus 1 includes an input / output control unit 10, a color image data management unit 11, a color image data display control unit 12, an object extraction unit 13, a boundary / background specifying unit 14, and a color mixture. Ratio calculating means 15, compulsory setting means 16, color mixture ratio storing means 17, condition setting means 18
And boundary color data calculation means 19.

The input / output control means 10 is a man-machine
The interface processing with the interface device 2 is executed. The color image data management means 11 manages the color data of each pixel of the color image displayed on the display screen of the man-machine interface device 2. The color image data display control means 12 displays a color image on the display screen of the man-machine interface device 2 according to the management data of the color image data management means 11.

The object extracting means 13 extracts an object image to be a color change target / image combination target from the color images displayed on the display screen of the man-machine interface device 2. The boundary / background specifying unit 14 specifies a background image of the object image extracted by the object extracting unit 13 and a boundary image portion located between the background image and the background image.

The color mixture ratio calculating means 15 is the object extracting means 1
By using the color data of the object image to be extracted of No. 3 and the color data of the boundary image portion / background image specified by the boundary / background specifying means 14 and solving Equation 1, the color mixture ratio of each pixel of the boundary image portion The values k1 _r, k1 _g, k1 _b are calculated. The compulsory setting means 16 is expanded to the color mixing ratio calculating means 15, and when the calculated color mixing ratio values k1 _r, k1 _{g, and} k1 _b do not fall between the original values of 0 and 1, this value is set to 0. From 1
Forcibly set to the specified value set in the range.
The color mixture ratio storage unit 17 stores the color mixture ratio values k1 _r, k1 _g, k1 _b calculated by the color mixture ratio calculation unit 15.

When executing the color changing process, the condition setting means 18 sets the color data of the object image which is the color change target extracted by the object extracting means 13 (at this time, when the color data of the background image is also changed). , The color data thereof is also set), and when the image synthesizing process is executed, the color data of the image serving as a new background image of the object image extracted by the object extracting means 13 is set (at this time, the color data of the object image). When changing, also set the color data)
To do. The boundary color data calculation means 19 is the condition setting means 18
The color data condition of the color changing process / image synthesizing process set by the above, and the color mixture ratio values k1 _r, k1 _g, k1 _b themselves stored in the color mixture ratio storing means 17 or their color mixture ratio values k1 _r, k1 _{g. ,} and the color mixture ratio value derived from k1 _b are substituted into Equation 2 to obtain the boundary / background specifying unit 14
The color data after color change / image combination of the boundary image portion specified by is calculated and stored in the color image data management means 11.

[0025]

In the present invention, the object extracting means 13 extracts the object image to be the color change object / image combining object by interacting with the operator, and in response to this extraction, the boundary / background specifying means 14 is extracted. The background image of the object image and the boundary image portion located between the background image and the background image are specified.

In this way, the color data of the object image to be color-changed / image-combined, the color data of the background image of the object image, and the color data of the boundary image portion located around the object image. Then, the color mixture ratio calculation means 15 uses these color data and solves Equation 1, thereby obtaining the color mixture ratio value k of each pixel in the boundary image portion.
1 _r, k1 _g, k1 _b are calculated and stored in the color mixture ratio storage means 17. At this time, the compulsory setting unit 16 sets the calculated color mixture ratio values k1 _r, k1 _{g, and} k1 _b from 0 to 1 which are the original values.
If it does not fall within the range of 0, this value is forcibly set to a prescribed value set in the range of 0 to 1. For example, when the color mixture ratio values k1 _r, k1 _{g, and} k1 _b are 0 or less, the value is set to 0, and when the color mixing ratio values are 1 or more, the value is set to 1 or In such a case also, processing such as setting to a value near 0.5 is executed.

On the other hand, the condition setting means 18 sets the color data of the object image and the background image after the color change processing / image combination processing by interacting with the operator, and manages the color image data according to the set color data. The management data of the means 11 is updated.

In this way, the color mixture ratio storage means 17
Color mixture ratio value k1 of each pixel in the boundary image part_r,k1_g,k
1_bIs stored and the color is set by the condition setting means 18.
Of the object image and background image after change processing / image combination processing
When the color data is set, the boundary color data calculation means 19
Is these color data and the color mixture ratio value k1_r,k1_g,k1
_bItself, or their color mixture ratio value k1_r,k1_g,
k1_bSubstituting the color mixture ratio value derived from
By calculating the color data of each pixel in the boundary image
And stores it in the color image data management means 11.

When the color image data managing means 11 stores the color data of the boundary image portion calculated by the boundary color data calculating means 19 in this way, the color image data display control means 12 determines According to the color data of the image part and the color data of the object image and the background image set by the condition setting means 18, the color image after the color change processing / image combination is displayed on the display screen of the man-machine interface device 2. To go.

As described above, according to the present invention, according to the invention of Japanese Patent Application No. 3-283479 previously filed, the naturalness of the hue of the boundary image portion is preserved by applying the additive color mixture model to the boundary image portion. In the case of adopting a configuration that allows color change and image composition to be executed without changing the color mixture ratio value used for constructing an additive color mixture model, it is always within the original value range. It is possible to prevent the appearance of a color that cannot be seen in the above, and to ensure the naturalness of the hue of the boundary image portion.

[0031]

EXAMPLES The present invention will be described in detail below with reference to examples. FIG. 2 illustrates a system configuration of a color image data processing system implementing the present invention. In the figure, 20 is a color image data processing device for implementing the present invention, 30 is an image input device connected to the color image data processing device 20, and 40 is a color monitor connected to the color image data processing device 20. The image input device 30 has a color image information input function and a data information input function.

The color image data processing device 20 includes an image holding memory 21 for holding color image information read by an image scanner or the like of the image input device 30.
A first stage process executing means 22 for executing the first stage process of the color changing process / image combining process, and a second stage process executing means 23 for executing the second stage process of the color changing process / image combining process. And a display memory 24 that reads out color image information to be displayed on the color monitor 40 from the image holding memory 21 and expands it.

FIG. 3 shows an example of the process flow executed by the first step process executing means 22, and FIG. 4 shows an example of the process flow executed by the second step process executing means 23.
Next, the color changing process and the image synthesizing process of the color image of the present invention will be described in detail according to these process flows.

When the color of the image portion included in the color image displayed on the color monitor 40 is changed, or when the image portion included in the color image is cut out and combined with another color image, the first stage processing is performed. As shown in the processing flow of FIG. 3, the executing means 22 firstly, in step 1,
An object image to be a color change target / image combination target is extracted from the color image. In this extraction processing, for example, an object cut out by a mouse or the like included in the image input device 30 is extracted as a color change target / image combination target object image,
Alternatively, according to the invention of Japanese Patent Application No. 3-49981 (the title of the invention: a color extracting method and a color extracting apparatus) previously filed by the present applicant, the same system as the color pointed by the mouse or the like included in the image input apparatus 30 This is executed by extracting an object having the color of as the object image of the color change target / image combining target.

Next, in step 2, the peripheral portion of the extracted object image is specified as the boundary image portion, and
An image portion located further outside the boundary image portion is specified as a background image. Then, in step 3, the color data (Ro, G) of the object image extracted from the image holding memory 21.
o, Bo) and the specified background image color data (Rb, G)
b, Bb) and the color data (Re
, Ge, Be) and in the subsequent step 4, by using this read color data and solving equation 1, the color mixture ratio values k1 _r, k1 _g, k1 of each pixel in the boundary image part are solved.
Calculate _b .

Then, in step 5, it is judged whether or not the calculated color mixture ratio values k1 _r, k1 _g, k1 _b fall between the original values of 0 and 1. If it is determined in step 5 that some of the values do not fall between the original values of 0 and 1, the process proceeds to step 6 and the color mixture ratio values k1 _r, k1 _g, k1 that do not show the original value. Forcibly set _b to the specified value set between 0 and 1. For example, when the color mixture ratio values k1 _r, k1 _{g, and} k1 _b are 0 or less, the value is set to 0, and when the color mixing ratio values are 1 or more, the value is set to 1 or In such a case also, processing such as setting to a value near 0.5 is executed.

Then, in the subsequent step 7, the calculation is made and the forced setting is made.
Specified color mixture ratio value k1_r,k1_g,k1 _bA note for image retention
The data is stored in the memory 21 and the process ends. On the other hand, in step 5
All color mixture ratio values k1 calculated by judgment_r,k1_g,
k1_bDetermines that is between 0 and 1 which is the original value
When performing, without performing the processing of step 6,
Immediately proceed to step 7 to calculate the calculated color mixture ratio value k.
1_r,k1_g,k1_bIs stored in the image holding memory 21 and processed.
End the reason.

In this way, the color mixing ratio values k1 _r, k1 _g, k of each pixel in the boundary image portion are stored in the image holding memory 21.
When 1 _b is stored, the second stage process executing means 23 changes the color of the object image extracted by the first stage process executing means 22 by executing the process flow of FIG. Executes processing to combine with a color image.

That is, the second stage processing executing means 23
As shown in the process flow of FIG. 4, first, in step 10, by interacting with the image input device 30, the color data of the object image and the background image after the color changing process / image combining process are set. For example, in the color changing process, when changing only the color of the object image to be color-changed, the color data (Ro ', Go', Bo ') of the object image after the color changing process is used.
Is set, and the color data of the background image is set to (Rb, Gb, Bb) before the color change processing, and when the color of the background image is changed together with the object image to be color changed, the object after the color change processing is set. Image color data (Ro ', Go',
Bo ') is set, and the color data (Rb', Gb ', Bb') of the background image after the color change processing is also set. In the image combining process, the color data (R
b ', Gb', Bb ') are set, and (Ro, Go, Bo) before the color change processing is set for the color data of the object image (this can also be changed in color).

Next, at step 11, from the image holding memory 21, the color mixture ratio value k1 _{r, which} each pixel of the boundary image portion has _,
k1 _g, k1 _b are read out, and in the following step 12, the color data set in step 10 and the read out color mixture ratio values k1 _r, k1 _g, k1 _b are substituted into Equation 2 to change the color. The color data (Re ', Ge', Be ') of the boundary image portion after processing / image combination processing is calculated. At this time, instead of directly using the color mixture ratio values k1 _r, k1 _{g, and} k1 _b themselves, three average values are calculated and used as the color mixture ratio values to be substituted into Equation 2, or one of them is used. It is also possible to select it as a representative value and use it as the color mixing ratio value to be substituted into the equation 2.

Then, in the following step 13, in the color changing process, the color data of the object image and the background image stored in the image holding memory 21 are updated to those set in step 10 and the image holding is performed. The color data of the boundary image portion stored in the image memory 21 is updated to that calculated in step 12, while in the image combination processing, the image portion of the combination destination stored in the image holding memory 21 is updated. Of the object image color data set in step 10, and in association with it, the color data of the surrounding image part of the object image of the boundary image part color data calculated in step 14 To update.

In this way, when the new color data of each pixel is stored in the image holding memory 21, the color monitor 40 displays the color-changed / image-combined color image.

Although the illustrated embodiment has been described, the present invention is not limited to this. For example, in the example,
Although the present invention has been disclosed according to the additive color mixture model represented by the RGB color system, the present invention is not limited to this, and an additive color mixture model represented by another color system may be used.

[0044]

As described above, according to the present invention,
According to the invention of Japanese Patent Application No. 3-283479, which has been previously filed, by applying an additive color mixture model to the boundary image portion, it is possible to execute color change and image composition while preserving the naturalness of the hue of the boundary image portion. Since the color mixture ratio value used for constructing the additive color mixture model always falls within the original range when adopting the configuration, it is possible to prevent the appearance of colors that cannot be present in the boundary image part. As a result, the naturalness of the hue of the boundary image portion can be ensured.

[Brief description of drawings]

FIG. 1 is a principle configuration diagram of the present invention.

FIG. 2 is a system configuration diagram of a color image data processing system implementing the present invention.

FIG. 3 is an example of a processing flow executed by first-stage processing execution means.

FIG. 4 is an example of a processing flow executed by a second stage processing execution means.

FIG. 5 is an explanatory diagram of a color changing processing configuration of a color image.

FIG. 6 is an explanatory diagram of image input characteristics.

FIG. 7 is an explanatory diagram of an image scanner.

FIG. 8 is an explanatory diagram of occurrence of color misregistration by the image scanner.

FIG. 9 is an explanatory diagram of the invention previously filed.

[Explanation of symbols]

 1 Color Image Data Processing Device 2 Man-Machine Interface Device 3 Input Means 10 Input / Output Control Means 11 Color Image Data Management Means 12 Color Image Data Display Control Means 13 Object Extracting Means 14 Boundary / Background Specifying Means 15 Color Mixing Ratio Calculating Means 16 Forced Setting means 17 Color mixture ratio storing means 18 Condition setting means 19 Boundary color data calculating means

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Internal reference number FI Technical display location G09G 5/36 9177-5G H04N 1/387 4226-5C

Claims (6)

[Claims] 1. The color data of a boundary image portion positioned between a first image portion displayed on a display device and a second image portion adjacent to the first image portion is converted into the first image portion. Of the color data defined by multiplication of the color data of the part and the color mixture ratio value k-i (i = 1 to 3) and the color data of the second image part and the color mixture ratio value (1-k-i) The color data of the first and second image parts and the color data of the boundary image part are specified when the color data of the first and second image parts are specified. In accordance with the above, the color mixing ratio value k-i of the boundary image portion is calculated, and when the color data of the first and second image portions which are the color change conditions are given, these color data and The calculated color mixture ratio value k-i itself or derived from the color mixture ratio value k-i A color image color change processing method in which the color data of the boundary image portion is calculated from the output ratio value k-j (j = 1 to 3), wherein the calculated color mixture ratio value k- A color image color change processing method characterized in that when i does not fall within the range of 0 to 1, processing is performed so that it is treated as a prescribed value set in the range of 0 to 1. 2. The color image color change processing method according to claim 1, wherein when the calculated color mixture ratio value k-i shows a value of 0 or less, it is treated as having a value of 0, and a value of 1 or more is treated. A color image color change processing method characterized by processing so that it is treated as having a value of 1 when shown. 3. The color image color change processing method according to claim 1, wherein the calculated color mixture ratio value k-i indicates a value of 0 or less,
A color image color change processing method characterized in that when it shows a value of 1 or more, it is treated as if it had a value near 0.5. 4. The color data of the boundary image portion located between the first image portion displayed on the display device and the second image portion adjacent to the first image portion is set to the first image portion. Of the color data defined by multiplication of the color data of the part and the color mixture ratio value k-i (i = 1 to 3) and the color data of the second image part and the color mixture ratio value (1-k-i) The color data of the first and second image parts and the color data of the boundary image part are specified when the color data of the first and second image parts are specified. Accordingly, there is a case where the first image portion and the boundary image portion are combined with another image by adopting a configuration for calculating the color mixture ratio value k-i of the boundary image portion. When color data and color data of the separate image are given, these color data, The issued 該混 color ratio value k-i itself, or the ratio value is derived from 該混 color ratio value k-i k-j (j = 1~
3) is a color image synthesizing processing method for processing to calculate the color data of the boundary image portion, and when the calculated color mixture ratio value k-i does not fall within the range of 0 to 1, A color image synthesizing method characterized by processing so that it is treated as a prescribed value set in the range of 0 to 1. 5. The color image composition processing method according to claim 4, wherein when the calculated color mixture ratio value k-i shows a value of 0 or less, it is treated as having a value of 0, and also shows a value of 1 or more. A color image composition processing method characterized in that processing is sometimes performed so that it is treated as having a value of 1. 6. The color image composition processing method according to claim 4, when the calculated color mixture ratio value k-i indicates a value of 0 or less,
A color image composition processing method characterized in that when it shows a value of 1 or more, it is treated as if it had a value near 0.5.