JPH03164981A - Image editing system - Google Patents

Abstract

PURPOSE:To obtain the synthetic image being free from a sense of incongruity with satisfactory operability by converting in a lump lightness, saturation and hue of a partial or the whole area of a foreground image, based on lightness, saturation and hue of a partial or the whole area of a background image and the foreground image. CONSTITUTION:The system is provided with a coordinate input part 3 for designating an arbitrary area in a background image 21 or a foreground image 22 stored in an image store part. In such a state, an image processing part 4 calculates lightness, saturation and hue of a partial or the whole area in the designated background image and foreground image, and converts in a lump lightness, saturation and hue of a partial or the whole area of the foreground image, based on the calculated lightness, saturation, hue, etc. In such a way, the image becomes a form in which areas are joined together as a unit, it can be obtained with satisfactory operability.

Description

Detailed Description of the Invention [Summary] In an image editing device that edits a color image, there is a method for batch converting the brightness and saturation of a part or the entire area of the target color image. ), green (G), blue (
B) From the image expressed by the color model, hue (H),
The purpose of this system is to input a color image into an image editing device that edits color images, with the aim of converting it to a color image expressed using the lightness (L) and saturation (S) color model without causing a decrease in operability. an image input unit that stores a background color image, an image storage unit that stores a foreground color image, and an image input unit that stores a background color image, an image storage unit that stores a foreground color image, and an arbitrary rfI in the background image or foreground image stored in the image storage unit. Calculates the brightness, saturation, and hue of a part or all of the background image and foreground image specified by the coordinate input section for specifying the area, and calculates the hue of the calculated area. an image processing unit that converts the brightness, saturation, and five hues of an arbitrary area in the foreground image stored in the image storage unit based on the brightness, saturation, and hue of the background image and the foreground image; An image transfer unit that transfers image data between the storage unit and the image processing unit, and an image display unit that displays the contents of the image storage unit are provided, and one of the background image and the foreground image is displayed. or a portion of the foreground image based on the brightness, saturation 1 hue of the entire area, or the brightness, chroma 1 hue of the entire area, multiplied by a certain multiplier. Alternatively, the brightness, saturation, and hue of the entire area may be converted at once.

[Industrial Application Field] The present invention provides an image editing device for editing a color image, in which the brightness of a part or the entire area of the target color image,
The present invention relates to a method for converting a chroma-1 hue into -.

Traditionally, image editing devices have been used by professionals such as broadcasting stations and publishers, but in recent years, with the lower prices and higher performance of video cameras, video recorders, electronic still cameras, etc., they have become popular in general households. Video images have also been edited.

Historically, as the price of personal computers has decreased and their performance has increased, image generation, image processing, and image editing have come to be performed on personal computers.

Under these circumstances, there is a desire to use the above-mentioned personal computer to perform more complex image editing, such as inserting and compositing a part of an image from another scene into an image from one scene. However, in this case, there is a need for an image editing method that can synthesize color images as naturally as possible with good operability.

[Prior art and problems to be solved by the invention] Fig. 2 is a diagram explaining a conventional image editing method, in which (a) shows a color scheme using a color table, and (b) shows three attributes of color. (9 brightness, 9 hues, and chroma).

In the color scheme using a color table in (a), for example, the color numbers (e.g., 8 bits) of each pixel stored in the frame filter are assigned to red (R), green (G), The blue (B) gradation (8 hints each for R, G, and B) is converted into analog red (R), green (G), and blue (B) signals through digital-to-analog conversion. However, when compositing images as described above, trying to obtain the desired color requires knowledge of additive color mixture, and it is difficult to create a strict color scheme. There is a problem with image synthesis using the method that unnaturalness remains.

Therefore, an expression system using three color attributes (brightness, hue, and saturation) as shown in FIG. 3(b) has been considered.

This has the advantage that, for example, in the field of computer graphics, color specification can be done intuitively without requiring knowledge of additive color mixture.

In this case, the color model of the three attributes and the color display red (1?), green (G), blue (B) (hereinafter referred to as ROB
It is necessary to define the correspondence with the color model, but various methods have been proposed depending on how to define it.

Among these, the rHLS color model proposed by the "Graphics Standards Planning Committee"] (for example, "Color scheme of computer graphics screens", Hiromichi Izawa, Hide Tamegaya-2 2nd Chromatic Optics conference,
6-1, p. 123~).

In this color model, the color of an image is expressed by hue (I+), lightness (L), and saturation (S), and these are expressed as a bicone color solid.

6 For example, hue (11) is expressed by a hue wheel from 0° to 360', blue (1 () is Oo, macenta (old is 60
°, red (1?) power moon 20°, yellow (Y) 180° green ([
) is defined as 240− cyan (C) is 30 +1”.

The brightness (17) is 0.0 (
black) to 1.0 (white), red (R), green (G
), is defined as the average value of the maximum value (M) and minimum value (m>) in blue (B).

In addition, the saturation (S) changes from 0.0 (achromatic color) to 1.0 (the most vivid color for a certain brightness), and the colors on the back of the color solid have all the saturation. It is 1.0.

The colors with the highest saturation within the isohue plane are arranged on a hue wheel with a lightness of 0.5.

According to the above-mentioned document, the conversion formula to the S color model is shown as follows.

Step 0: Preparation) M-max (R, G, B); m=m1n (It,
G, B) ii) When M=m, the color is achromatic and the process proceeds to step 1.

1ii) r= (M-R) 7M-m;g-(M
-G) 7M-m; b= (MB)7M-m; Here, among r', g, and b, at least - is 0.
0 and less (both one is 1.0).

Step 1: Calculation of brightness I, -(M l-m) / 2. [3 Step 2:
Calculation of saturation S When M=m (achromatic color), S=O, OM-#m and when L≦0.5, S-(M-m)/ (M+m) M≠m and L >0.5, S-(M-m) / (2-M-m) Step 3: Calculation of hue H When S=0.0 (achromatic color), H'-O8≠0.0,
And when R=M, H' -2+b-g When S≠0.0 and G=M, 11'=4+r-b When S≠0.0 and B=M, If - 6+JZ-r H=6D H' (mod 360) The above conversion formula is just an example, and is not limited to this.

Hereinafter, an image synthesis method based on the conventional HLS color model representation will be explained with reference to FIG.

First, in the image input unit 1, the background image is colored red (R
), green (G), and blue (B), and then store the image in the next image storage unit 2.
1, and the foreground images are also red (It) and green (G).

*(II) is decomposed into ζ and stored in the next image storage unit 22.

When coordinates in pixel units are inputted from the coordinate input unit 3 using, for example, a keyboard, the coordinates 1ii stored in the image storage unit 22 at the coordinates specified by the coordinate input unit 3 are
Pixel values of one scene and both images are input from the image storage section 22 to the image processing section 4 under the control of the image transfer section 5.

The image processing unit 4 applies the rRGB color model J shown in steps O to Step 3 to the foreground image in pixel units at the coordinates specified in the coordinate input unit 3.
rHLS color model", the coordinate input section 3 performs conversion by an amount (conversion multiplier: %) specified separately, and after a portion is adjusted to fit the background image, the image transfer section 5
Under the control of , the background image is transferred to the same coordinate position of the image storage unit 21 where the background image is stored, and the foreground image is synthesized with the background image.

In this conventional method, since processing is performed pixel by pixel, it is necessary to manually specify the conversion amount to match the foreground image to the background image, even if the brightness, saturation, and hue conversion is performed. There was a problem that the operability was extremely poor.

In view of the above-mentioned conventional drawbacks, the present invention provides an image editing device for editing a color image, in which a part of a target color foreground image or the entire area of the background image is synthesized without unnaturalness. The hue (IIL brightness) is calculated from an image expressed using the red (R), green (G), and blue (B) color models.
The purpose of this paper is to provide an image editing method that uses conversion to an image expressed using the chroma (S) color model and can be performed without deteriorating operability. be.

[Means for Solving the Problems] The above problems are solved by an image editing method configured as follows.

An image editing device that edits a color image includes an image input unit that inputs a color image, an image storage unit that stores a background color image, an image storage unit that stores a foreground color image, and an image storage unit that stores a color image in the image storage unit. Specify any area in the background image or foreground image, or set the brightness and saturation of any area in the foreground image to 1
A coordinate input section for specifying a multiplier for converting hue, and a background image specified by the coordinate input section, and calculates the brightness, saturation, and hue of a part or all of the foreground image. , Based on the calculated background image and the foreground image's brightness, saturation, 9 hues, - convert the brightness, saturation, 5 hues of an arbitrary area in the foreground image stored in the image storage section below. an image processing section, an image transfer section that transfers image data between the image storage section and the image processing section, and an image display section that displays the contents of the image storage section, and a background image; Based on the brightness and saturation of a part of the foreground image or the entire area, one color plus the old color, or the brightness and saturation of a part or the entire area of the foreground image, one hue multiplied by a specific multiplier. In this way, the brightness, saturation, and hue of a part or all of the foreground image are converted all at once.

[Effect]

That is, according to the present invention, in an image editing apparatus that edits a color image, there is a means for eliminating unnaturalness when combining a part or the entire region of a target color foreground image with a background color image. , the foreground color image is red (R
), green (G), blue (B) color model representation, hue (
H), brightness (L), and saturation (S) color model expressions are used.

At this time, first, red (R), green (G
), blue (B) color model representation to hue (H), lightness (I, saturation (S)) color model representation, and the hue (IIL lightness (L), saturation (S)), For example, the average direct kl (II), kl (+,), kl(S
).

Next, for the foreground image, red (R), green (G), blue (B
) color model representation to the hue (IIL lightness (L), saturation (S)) color model representation, and convert the hue (
H), brightness (L), and saturation (S), for example, the average (l!
Find 2(It)k2 (L) and k2 (S).

Here, in the present invention, instead of specifying the conventional pixel unit, the area of the foreground color image is specified using a mouse or the like in the coordinate input section, and the hue (II) and brightness (1 ), the average value of saturation (S) is 2 (11),
For each of k2 (1,) and k2 (S),
For example, by performing batch conversion of multiplying kl()I)/ by 2(H), kl(+, )/ by 2(L), and kl(S)/ by 2(S), the foreground image Hue (■), brightness (L), saturation (S), and hue (H) of the background image.

After matching the lightness (l,) and saturation (S), it is inversely converted to red (R), green (G), and blue (B) color model expressions (for the inverse conversion method, see 3- the above-mentioned literature). The converted image is inserted in the same area of the background image in a cross-shaped pattern to perform image synthesis.

Furthermore, instead of simply performing a batch conversion using an average value, a -batch conversion may be performed by multiplying each hue (■), lightness (L), and saturation (S) by a specific multiplier. .

Therefore, in image synthesis according to the present invention, the hue (II), brightness (1,) and saturation (S) of a part or all of the background image are combined with the color 4 of part or all of the foreground image.・1” (
Since the IIL brightness (L) and saturation (S) are combined on a region-by-region basis, it is possible to obtain a natural-looking composite image with improved operability, contributing to improved performance of image editing devices. It has many effects.

〔Example〕 Embodiments of the present invention will be described in detail below with reference to the drawings.

FIG. 1 shows an embodiment of the present invention, in which (a) shows an example of the configuration of an image editing device, (bl), (b2)
shows an example of image compositing, where red (
R), green (G), blue (U) Conversion is performed from the color model representation to the hue 4- (IIL lightness (L), saturation (S)) color model representation, and the hue (11), lightness (L) ),saturation(
S), for example, find the average value and also for the foreground image,
From the red (1υ, green (f;), 'l'7 (B) color model representation, hue (1 (), lightness (L), saturation +, = (
s) Conversion to color model representation and its hue (I
For example, calculate the average values of I), brightness (I,), and saturation (S), and calculate the calculated hue (11), brightness (I, ), and saturation for the specified foreground image area. Using ・1′ uniform II′1 of degree (S) (, the +ii1 scenery image scenery image (It),
Brightness (I,).

The saturation (S) is the hue (11) of the background image, the brightness (I, ),
A means for adjusting to saturation (S) is a necessary means for implementing the present invention. Note that the same reference numerals indicate the same objects throughout the figures.

Hereinafter, the image editing method of the present invention will be explained using the first M.

Even if the present invention is implemented, the red (R) 5 green (G) color image
From the blue (B) color model expression, hue (■), brightness (1
7) Saturation (S) The basic operation of the conversion method to color model representation does not change in particular, so it will be omitted, and the details are as follows.
Hue (II) of part or all of the background image of the present invention,
Using the lightness (L), saturation (S), and hue (+1), lightness (L), and saturation (S) of part or all of the foreground image, determine the hue (II) of the foreground image. , brightness (L), saturation (S)
The hue (II), lightness (L), and saturation (S) of the background image
The explanation will focus on the method of synthesizing the data according to the following.

First, for example, in the image input unit 1 functioning as an NTSC-RGl+ converter, a background image is decomposed into red (R), green (G), and blue (B) and stored in the image storage unit 21.
Continuing ′(, make the foreground image the same as ゛(, red (+7),
Green (G).

It is decomposed into blue (B) and stored in the image storage unit 22.

Using an input device such as a mouse (not shown), a coordinate input unit 3 is used to designate a region of the foreground image that is to be inserted into the - section of the background image and combined.

The area generation unit 71 generates coordinates within the area based on the specified area, and inputs the coordinates to the image processing unit 4.

The image processing unit 4 decomposes the background image stored in the image storage unit 21 into red (R), green (G), and blue (B) via the image transfer unit 5 activated by the control unit 7. The area to be synthesized or all of the image data thus obtained is loaded into the storage unit 42, and the red (R), green (G), blue (B) color model representation of the above-mentioned color image stored in the control storage unit 43 is carried out. According to the conversion method to the hue (11), brightness (1,), saturation (S) color model representation, the red (R), green (G), blue (11) color model is applied to the background image. The expression is converted to hue (+1), brightness (1,), saturation (S) color model expression, and for example, the average value is set to 1 (I
I), kl(L), and kl(S).

Similarly, using the coordinates corresponding to the area specified from the coordinate input section 3, cut out image data to be synthesized from the foreground image stored in the image storage section 22, The red (IO5 green (G), blue (B) color model representation is converted to the hue (II), lightness (L), saturation (S) color model representation, and the average value is 2 (old,
Find k2 (L) and k2 (S). (See FIG. 1 (b2)) When a part or all of the foreground image is inserted into a part of the background image, as described above, it is necessary to match the colors as much as possible so as not to create an unnatural feeling.

Therefore, the hue (II), lightness (L) of the background image,
Average value of chroma 7 degrees (S) kl (H), kl (L), kl (S)
and the hue (II), lightness (L), and saturation (S) of the foreground image.
The average value of 2 (H), k2 (1,), 2 (S)
For example, the ratios Kll, Kl4. I<5KH
-kl (H)/2(+1).

KL=kl(L)/2(L).

K5=kl(S)/2(S) is calculated, and the average values of hue (H), brightness (L), and saturation (S) of the foreground image are 2(+1) and k2(+,).
, Hue (II), brightness (Shi) multiplied by k2 (S)
, the image data of saturation (S) is obtained, and this time, the image data of the hue (H
), brightness (L), and saturation (S) from the color model expression to red (
R), green (G), and blue (13) color model expressions are generated and stored in the corresponding area of the image storage unit 21 in the form of overwriting via the image transfer unit 5. do.

Of course, the hue (old, brightness (old), brightness ( ), saturation (S) k3(II), 3(L), 3(S), and instead of the above ratios KH, KL, KS, K)I'=kl(■)/ 3(11).

8 KL'=kl(L)/to 3(L).

KS'=kl(S)/to 3(S).

Alternatively, the hue of the target image (1) may be determined.
11), Brightness (1,), Saturation (S) k3 (It), 3 (+, ), 3 (S) as they are used to create red (R),
Images expressed in green (G) and blue (R) color models may be generated and overwritten in the image storage unit 21.

As described above, the present invention is an image editing device that edits a color image, and it is possible to generate a composite image by inserting part or all of a foreground image into a part of a color image serving as a background without any discomfort. The national luck of color matching is red (In2 green (G)
, :; From the image data expressed by the (l()) model, the hue (IIL brightness,
Focusing on the fact that there is a conversion method to image data expressed using the saturation (S) color model, the background image 1 and the foreground image to be combined are colored red (R) and green (G).

Hue (H) and lightness (L) from blue (B) color model expression
, after converting to saturation (S) color model representation and zero color matching, generate image data in the original red (R), green (G), and blue (B) color model representation, and synthesize the background image. The feature is that it is inserted in the form of an overwrite in the target area.

〔Effect of the invention〕

As described above in detail, the image editing method of the present invention includes an image input section for inputting a color image, an image storage section for storing a background color image, and a foreground color image in an image editing device for editing a color image. an image storage section for storing a color image of the color image; a coordinate input section for specifying an arbitrary area in the background image or foreground image stored in the image storage section; Calculate the brightness, saturation, and five hues of the specified back n''C image and the front (part or entire area in the image, and calculate the brightness of the calculated background image and foreground image.

an image processing unit that converts the brightness of an arbitrary area in the foreground image stored in the image storage unit based on the chroma level 9 hues, and the chroma level 1 hue; and the image storage unit and the image processing unit An image transfer unit that transfers image data between the two and an image display unit that displays the contents of the image storage unit are provided, and the brightness and saturation of a part or the entire area of the background image and foreground image are adjusted to 1. ζ based on the hue, etc., the brightness of a part of the foreground image or the entire area,
Since it is designed to convert 9 hues of saturation at once,
Hue (IIL brightness) of part or all of the background image
, saturation (S), hue of part or all of the foreground image (
It is possible to obtain a composite image that does not look strange, with good operability, and improves the performance of the image editing device. There are effects that often contribute to

[Brief explanation of the drawing]

FIG. 1 is a diagram showing an embodiment of the present invention. FIG. 2 is a diagram explaining a conventional image editing method. It is. In the drawing, l is an image input section. 3 is the coordinate input section. 42 is a storage section. 21.22 is an image storage unit. 4 is the image processing section 43 is a control storage section. 1 is the image transfer section. is the image display section is the control section. are shown respectively. 2

Claims (1)

[Claims] An image editing device for editing a color image includes an image input section (1) for inputting a color image, an image storage section (21) for storing a color image of a background, and a color image of a foreground. an image storage unit (22) for storing an image, and a background image stored in the image storage unit (21, 22), or
a coordinate input section (3) for specifying an arbitrary region in the foreground image or a multiplier for converting the brightness, saturation, and hue of the arbitrary region in the foreground image; A background image specified by the input section (3), and
The brightness, saturation, and hue of a part or all of the foreground image are calculated, and the image storage unit (22 ); an image processing unit (4) that converts the brightness, saturation, and hue of an arbitrary area in the foreground image stored in the foreground image; the image storage unit (21, 22);
); an image transfer unit (5) that transfers image data between the
an image display section (6) that displays the contents of the image storage section (21);
), and the brightness, saturation, and hue of a part or the entire area of the background image and the foreground image, or the brightness, saturation, and hue of the part or the entire area of the foreground image. An image editing method characterized by converting the brightness, saturation, and hue of a part or all of a foreground image at once based on a value multiplied by a specific multiplier.