JPH06258732A - Pink-eye effect position detector - Google Patents

Abstract

PURPOSE:To easily and surely detect the pink-eye effect position of an object person extracting the image of plural color components peculiar to the face from the picked up color image of a film after being developed. CONSTITUTION:On the picked up image of the developed color film picked up on an image pickup part 20 and fetched in an image memory 2, a low illuminance part, a low saturation part and a flesh color part are detected by LUTs 4, 5 and 6, respectively. Further, each detection region is enlarged through filters 8-10 and then, a logical product is obtained by an ADC circuit 12 and written in a binary data memory 13. Then, the logical product of the logical product data and a reversal flesh color part from the LUT 6 via an INV 11 and a red color part from the LUT 5 is obtained to extract the red-eye effect position and rewrite it in the binary data memory 13. At the time of reading from the image memory 2, the pink-eye effect position signal of the binary data memory 13 is synchronously read and when it is at the pink-eye effect position, the LUTs 4, 5 and 6 are changed over to color converting tables respectively.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a red-eye position detecting device for correcting red-eye of a human image of a subject which may occur during flash photography.

[0002]

2. Description of the Related Art When flash photography is performed on a person as a subject, a part of the flash light is reflected by blood vessels in the eyeball,
When returning to the camera side, the so-called red-eye phenomenon may occur, where the center of the black eye becomes red. In particular, with the recent miniaturization of cameras, the red-eye phenomenon is more likely to occur due to the optical axis of the taking lens and the optical axis of the flash approaching each other. Therefore, in order to prevent such a red-eye generation, a camera with a red-eye generation prevention function is commercially available which is pre-lighted immediately before the main flash is fired to take a picture in a state where the pupil is blocked. It is also practiced to correct red eyes when printing on photographic paper.

[0003]

However, even in the above-described camera with a red-eye prevention function, the occurrence of red-eye cannot always be prevented under individual photographing conditions of individual persons and other photographing conditions. Further, even in the case of red-eye correction at the time of printing on photographic paper, it is not common when the correction work requires complexity and skill.

On the other hand, with respect to an image obtained by color-imaging a developed color film, the pupil position is extracted by using pattern recognition technology or the red part in the image is extracted and this part is colored. Although conversion may be possible, if an attempt is made to accurately detect the position of the red eye, the image processing technology becomes extremely complicated and the apparatus itself becomes expensive. On the other hand, in a normal image processing technique, there is a risk that the red portion other than the red eye position may be uniformly or erroneously converted in color, which may result in providing an unnatural photograph.

The present invention has been made in view of the above,
An object of the present invention is to provide a red-eye position detecting device that detects a red-eye position of a subject person by capturing a color image of a developed film and extracting a plurality of face-specific color component images from the color image.

[0006]

SUMMARY OF THE INVENTION A red-eye position detecting device according to the present invention comprises means for color-imaging a developed color film and at least one of a low-saturation region and a low-illuminance region portion extracted from the captured film image. First extracting means for extracting, a second extracting means for extracting a skin color region from the captured film image, a third extracting means for extracting a red part from the captured film image, first, second and And a detection means for detecting the position of the red eye in the image using the extraction signal from the third extraction means.

[0007]

According to the present invention, the developed color film is imaged in color, at least one of the low-saturation region and the low-illuminance region and the skin color region are extracted from the imaged image, and these extracted signals are extracted. By using, for example, a logical product, the region including the eyes of the person is extracted. Further, when the red eye is generated from the area including the eye, the red eye position is detected using the extracted red part signal.

In the red-eye position data thus obtained, when the picked-up image data is read out to a monitor or the like, the red color at the red-eye position is corrected to another color, for example, a normal black eye of a person. Used to.

[0009]

1 is a general block diagram showing a first embodiment of a red-eye correction apparatus to which the present invention is applied. In the figure,
Reference numeral 1 denotes an A / D converter that converts each image signal of R, G, and B colors obtained by color-imaging the developed color film by the imaging unit 20 into an 8-bit digital signal for each pixel, for example. The image memory 2 includes memory units 201, 202, and 203 for storing R, G, and B image signals input from the A / D converter 1 in synchronization with each other. It has a storage capacity corresponding to one frame.

As shown in FIG. 2, the image pickup section 20 is disposed between the film cartridge 21 and a winding means 22 for drawing and winding the developed color film F, and between the film cartridge 21 and the winding means 22. A light source 23 and a mirror 24 are provided so as to face each other so as to sandwich the film F to be drawn out, and R, G, and
It is composed of an image pickup means 26 such as a CCD equipped with each filter of B color, and can be fed out one frame at a time by the manual instruction or automatically by the winding means 22. The feeding of each frame by the winding means 22 can be performed through an optical means (not shown) for detecting the perforation of the film. Further, a recording medium such as a magnetic tape is arranged at an appropriate position of the film cartridge 21 or at a lower end position of the film corresponding to each frame of the film F, and the photographing magnification β for each frame and continuous shooting information are arranged on the recording medium. In the case where other required photographing information can be recorded, a magnetic head 27 is attached so that the photographing magnification β and the like can be read as necessary.

Returning to FIG. 1, the L, u, v chromaticity matrix circuit 3 reads the R, G,
The B signal is converted to an L, u, v color system (International Commission on Illumination CIE compliant: JIS8730). LUT4
Each of the to LTUs 6 has a plurality of built-in tables, and uses the selected table to perform the conversion process described later on the input signal and output the processed signal. LUT4 ~ L in Table 1
The table built in the TU 6 is shown.

[0012]

[Table 1]

The microcomputer 7 sends an R / W control and address control signal to the image memory 2 and a binary data memory 13 described later, a selection signal for each table of the LUTs 4 to 6, and a switching signal for switches SW1 to SW4 described later. It is output as needed. The microcomputer 7 controls a required circuit unit so as to repeatedly read out the image signal from the image memory 2 at a predetermined cycle, thereby providing a still image to a monitor or the like. Further, the microcomputer 7 is capable of inputting the photographing magnification β for each frame of the imaged film by reading it from the magnetic head 27, and using this photographing magnification β, the filter characteristics of low-pass filters LPF8 to 10 to be described later are changed. It is a thing. If the image pickup unit 20 is of a type that cannot automatically read the photographing magnification β, it may be one that can be manually input.

The LPFs 8 to 10 provide a so-called filter effect to dull an input signal. For example, by filtering the signal input from the LUT 4 via the low illuminance detection table, the low illuminance detection in the image is performed. Try to expand the range. INV11 inverts the input level and outputs it. The binary data memory 13 stores the logical product output from the AND circuit 12. The binary data memory 13 has an address corresponding to the memory portion of each color of the image memory 2. The output of the binary data memory 13 is based on a control signal from the microcomputer 7 and is sent via the switch SW4 and LPF10 to AN.
It is possible to re-input to one input end of the D circuit 12.

The switches SW1 to SW4 are switches for switching signal paths, and are switched and controlled by a switching signal from the microcomputer 7. Switch SW1 and switch SW
2 are connected in series, and the output of LUT6 is LPF8
And the output of LUT6 directly via INV11
Switching between the case of leading to the ND circuit 12 (state shown in the figure). The switch SW3 switches between the case of guiding the output of the LUT 5 to the LPF 9 and the case of directly guiding the output of the LUT 5 to the AND circuit 12 (state shown in the figure). Switch SW4 is L
The case where the output of the UT 4 is guided to the LPF 10 (state shown in the figure) and the case where the output from the binary data memory 13 is guided to the LPF 10 are switched. At this time, a switch may be added to the output side of the switch SW4 so that the output from the binary data memory 13 is directly guided to one input terminal of the AND circuit 12 without passing through the LPF 10.

The matrix circuit 14 converts the signals input from the LUTs 4 to 6 into Y, RY and BY signals. The encoder 15 encodes each of the above signals from the matrix circuit 14 into a Y signal and a C signal, or an NTSC signal. The D / A converter 16 converts the output signal of the encoder 15 into an analog signal and outputs it to a monitor (not shown).

Next, the red eye position detection and its color correction will be described with reference to FIGS. FIG. 3 is a diagram for explaining the red eye position, FIGS. 4 (a) to 4 (j) are diagrams for explaining the image processing contents for each detection procedure of the red eye position, and FIGS. 5 to 8 are red eye position detection and color. It is a figure which shows the algorithm of a correction process.

Assuming that the film image is the color person image shown in FIG. 4A, this image is picked up by the image pickup section 20 and taken in as R, G, and B color image signals, and A / A
The D converter 1 converts each into an 8-bit digital signal and stores it in the image memory 2 (# 2 to # 6).
Then, based on the address control signal from the microcomputer 7, the R, G, B signals are read synchronously,
It is converted into L, u, v signals by the chromaticity matrix circuit 3 (# 8). Then, for this converted signal, first, the process A
(# 10) is executed.

FIG. 6 is a diagram showing the algorithm of this processing A in detail, which is # 30 to # 34, # 36 to # 40, # 42.
# 46 are processed synchronously as a first routine (first reading cycle). That is, in # 30 and # 32, the LUT
The low illuminance detection table is selected as the internal table of No. 4, whereby the low illuminance portion of the L signal becomes “1”,
Other parts are binarized as "0" (see FIG. 4).
(b)). Further, in # 36 and # 38, the low saturation detection table is selected as the internal table of the LUT 5, whereby the u and v signals are used to set the low saturation portion to “1” and the other portions to “0”. Is binarized as "" (FIG. 4 (c)). Further, in # 42 and # 44, the flesh color detection table is selected as the internal table of the LUT 6, whereby the u and v signals are used to set the flesh color portion to “1” and the other portions to “0”, which are binary. (Fig. 4 (d)).

Then, these binarized signals are introduced into the matrix circuit 14 and the LPF, respectively.
Guided by 8, 9 and 10 (# 34, # 40, # 46), low illuminance area (Fig. 4 (e)), low saturation area (Fig. 4 (f)) and skin color area (Fig. 4 (g)). ). Here, the degree of expansion of the low illuminance area is determined based on the photographing magnification β corresponding to each frame. For example, the greater the imaging magnification β, the greater the degree of signal blunting. Also, # 34, #
As shown in FIG. 3, the processing in 40 focuses on the fact that a low-illuminance and low-saturation black eye portion remains around the red eye, and the extraction range is expanded to include the periphery of the black eye portion. This is to ensure that the red-eye occurrence position is within the detection range. The process of # 40 uses the fact that red eyes occur in the part surrounded by the skin color so that the entire face or the like is included in the detection range.

2 output synchronously from the LPFs 8 to 10
The value signal is ANDed by the AND circuit 12 (see FIG. 4).
(h)) It is stored in the binary data memory 13 (# 48-
# 50).

Subsequently, # 52, # 54, # 56 to # 60
And the second routine of # 62 and # 64 (the second read cycle) is executed. That is, in # 52, the red color detection table is selected as the internal table of the LUT 5, and by this,
The u and v signals are used to binarize the red part as "1" and the other parts as "0"(# 54, (Fig. 4).
(i))). At this time, the switch SW3 is switched, and the binary signal from the LUT 5 is directly guided to the AND circuit 12 without passing through the LPF 9. Furthermore, # 56
Then, the flesh color detection table is selected as the internal table of the LUT 6, and by this, the u and v signals are used to binarize the flesh color portion as "1" and the other portions as "0"(# 58). . This binary signal is inverted by INV11 by switching the switch SW1 (# 60), and further LPF8
It is directly guided to the AND circuit 12 without going through. Each of the processes of # 52, # 54, and # 56 to # 60 is performed on the area detected as the skin color when the red area and the skin color area may overlap due to various conditions such as individual differences and photographing light sources. On the other hand, this is a preparation process for prohibiting color correction at positions other than the red eye position.

Then, the signals from the LUT5 and INV11 are ANDed by the AND circuit 12 together with the binary data (FIG. 4 (h)) read out synchronously from the binary data memory 13 by switching the switch SW4. Being
It is again stored in the binary data memory 13 (# 62, # 6).
4). As a result, the binary data memory 13 is shown in FIG.
As shown in, only the red eye position is captured as data "1". Next (reading third cycle), returning to FIG. 5, the process B (# 12) is executed. At this time, the binary signal passing through the switch SW4 may be guided to the AND circuit 12 without passing through the LPF 10 as described above.

FIG. 7 is a diagram showing the algorithm of the process B in detail. In the process B, the microcomputer 7 sequentially reads the binary data from the binary data memory 13 in synchronization with the reading of the image signal from each color memory portion of the image memory 2 (# 70). And this binary data memory 1
It is determined whether the output value from 3 is "1" or "0", that is, whether it is the red eye position or not (# 72). The microcomputer 7 responds to "1" and "0" of this binary data by the LUT.
Change the built-in tables in 4-6. That is,
If the binary data is "0", all of the LUTs 4 to 6 are switched to the through table, and the 8-bit input signal is output as it is without being converted (# 74).
On the other hand, if the binary data is "1", the process C is executed (# 76).

FIG. 8 shows the details of the algorithm of this processing C. The LUT 4 is switched to a table for lowering the Low level (# 80, # 82), and the LUTs 5 and 6 are switched to the red suppression table for the red eye position. The red color is suppressed and, for example, corrected to black eyes (# 84, # 86, # 8).
8, # 90).

The respective signals (# 82, # 86, # 90) output from the LUTs 4 to 6 in this manner are converted into Y, RY and BY signals by the matrix circuit 15, and then, Encoder 16 converts to Y and C signals, or NT
It is coded to SC signal and further converted to analog signal by D / A converter as Y and C signals or NT
It is output as an SC signal (# 14 to # 20). The Y, C signals or the NTSC signal is guided to a monitor (not shown) and reproduced as a still image. After starting playback,
Once the red-eye position is detected, it is not necessary to continuously perform such detection processing in every read cycle.
The signal line from 4 to 6 to the AND circuit 12 side, or between the AND circuit 12 and the binary data memory 13, may be controlled. These points are the same in the examples described later.

In this embodiment, an image which is not red-eye corrected in the first two cycles from the image memory 2 is guided to the monitor, and an image which is red-eye corrected in the third cycle or later is guided to the monitor. However, the time between them is short and the observer does not feel any discomfort. Alternatively, the image signal output may be cut off by any of the matrix circuit 14 to the D / A converter 16 until the correction data is obtained in the binary data memory 13.

FIG. 9 is an overall block diagram showing a second embodiment of the red-eye correction device. Note that, in the figure, those denoted by the same reference numerals as those in FIG. 1 perform the same function. Further, the image pickup unit is omitted from the drawing.

In the configuration of the second embodiment, switches SW10 and SW11 and multiplication units 17 and 18 are provided between the image memory 2 and the matrix circuit 3. Switch S
W10 is for switching the R color memory unit 201 and the multiplying unit 17 and connecting them to the chromaticity matrix circuit 3.
W11 switches the G color memory unit 202 and the multiplication unit 18 and connects them to the chromaticity matrix circuit 3.

The multiplication unit 17 is interposed between the B color memory unit 203 of the image memory 2 and the switch SW10, and multiplies the output from the B color memory unit 203 by the coefficient k1.
The multiplication unit 18 is interposed between the B color memory unit 203 of the image memory 2 and the switch SW11, and multiplies the output from the B color memory unit 203 by the coefficient k2. Therefore, when the switches SW10 and SW11 are switched to the multiplication units 17 and 18, the chromaticity matrix circuit 3 has (R ',
A signal of G ′, B ′) = (k1 · B, k2 · B, B) is input. The microcomputer 7 uses these switches SW10,
SW11 is appropriately switched as described later. L in Table 2
The table incorporated in UT41,51,61 is shown.

[0031]

[Table 2]

The red-eye correction processing in the second embodiment is
In FIG. 5 of the first embodiment, the contents of process B (# 12) are different. FIG. 10 is a diagram showing the algorithm of this processing in detail. That is, the microcomputer 7 causes the binary data memory 13 to sequentially read the binary data, and in synchronization with this, reads the image signals of the respective colors from the image memory 2 (# 100). Then, the binary data read from the binary data memory 13 is discriminated as "1" or "0". If the binary data is "0", the control signal from the microcomputer 7 causes the LUTs 41, 51,
All of the 61 built-in tables are switched to the through tables, and the 8-bit image signals from the chromaticity matrix circuit 3 are not converted and the matrix circuit 1 is directly converted.
5 (# 104).

On the other hand, when the binary data is "0", LU
The built-in tables of T41, 51, 61 are the through tables as they are, but the switches SW10, SW11 are switched to the multiplication units 17, 18 side to perform the following signal processing. That is, the chromaticity matrix circuit 3 has (R ′,
G ′, B ′) = (k1 · B, k2 · B, B) converted 8-bit signal is input.

By doing so, as compared with the first embodiment, the level conversion table as the table in the LUT 41 and the red extreme pressure table as the table in the LUTs 51 and 61 are not necessary, and the table capacity is reduced accordingly. It can be reduced.

Next, FIG. 11 is an overall block diagram showing a third embodiment of the red-eye correction device, and FIG. 12 is a diagram showing an algorithm of red-eye position detection processing. Note that, in the figure, those denoted by the same numbers as in FIG. 9 perform the same functions. Further, the image pickup unit is omitted from the drawing.

The LUT 52 has a through table and a red color detection table, and the LUT 62 has a through table and a skin color detection table. The L signal from the chromaticity matrix circuit 3 is not used at the time of detecting the red position and is only directly input to the matrix circuit 14 at the time of red-eye correction, so that the LUT 41 shown in FIG. 9 is unnecessary.

The contour extraction unit 31 extracts the region in which the red portion exists as a block from the binary data sequentially output from each address of the binary data memory 13 and also the contour of the region. The shape identifying unit 32 determines whether or not the contour of the extracted red portion is circular by using a pattern recognition technique, and identifies the circular one as the red eye position. The filter characteristics of the LPF 81 can be changed according to the photographing magnification β from the microcomputer 71,
The larger the shooting magnification β, the larger the face portion of the person is taken, and the higher the filter effect is. A voltage corresponding to the level "1" is applied to one input ends of the switches SW5 and SW6.

Next, the red eye position detection processing will be described with reference to FIG.
This will be described using the algorithm of No. 2. It is assumed that the film image is the color person image shown in FIG. 4A and that the image is captured as image signals of R, G, and B colors and stored in the image memory 2. Then, based on the address control signal from the microcomputer 7, the R,
The G and B signals are read out in synchronization and converted into L, u and v signals by the chromaticity matrix circuit 3, and then # 110 and # 112.
~ # 116 are processed synchronously. That is, LUT5
The red detection table is selected as the internal table of 2.
As a result, the u and v signals are used to binarize the red portion as "1" and the other portions as "0"(# 110,
Figure 4 (i)). On the other hand, the flesh color detection table is selected as the internal table of the LUT 62, and the u and v signals are used to binarize the flesh color portion as "1" and the other portions as "0"(# 112, Figure 4 (d)).

Then, the signal from the LUT 52 is expanded to the AND circuit 12 through the switch SW5, and the signal from the LUT 62 is expanded through the switches SW1 and SW2 and the LPF 81 (# 114, FIG. g)), A
It is led to the ND circuit 12. Here, the area expansion degree of the flesh-colored portion is determined based on the photographing magnification β corresponding to each frame. For example, the greater the imaging magnification β, the greater the degree of signal blunting. At this time, the switch SW6 is switched to the level "1" side. Therefore, the AND circuit 12 takes the logical product of the red portion and the enlarged skin color area and stores it in the binary data memory 13.

Next, in the next cycle, the switches SW1, 2, 5, 6 are switched based on the switching signal from the microcomputer 7, and the binary signals are similarly read from the LUTs 52 and 62 based on the address control signal. The signal output from the LUT 62 is inverted by the INV 11, and then directly guided to the AND circuit 12 via the switches SW1 and SW2 without passing through the LPF 81. on the other hand,
The switch SW5 is switched to the level "1" side, and the switch SW6 is connected to the binary data memory 13 side, so that the AND circuit 12 executes the processes of # 116 and # 118. In this way, the red portion existing near the skin color area is extracted.

Next, the red color signals are sequentially read from the binary data memory 13, and the contours of the respective red color signals are extracted by the contour extraction section 31 by image processing (# 12).
0). Then, each of the obtained contour signals is guided to the shape identifying unit 32 at the next stage, and if the contour is a circle, that is, a circle, it is determined to be a red eye position, and if not, another red object (for example, FIG. i) Ribbon etc.) (# 122). The contour data determined to be the red eye position is fetched by the microcomputer 71.

Then, in the next cycle, each time the address at which the red-eye position exists is specified when the signal is read out from the image memory 2, the switches SW10 and SW11 are switched to the chromaticity matrix circuit 3 (R ', G). ', B') = (k1 · B, k
2 · B, B) signal is transmitted. At this time,
As in the second embodiment, the through table is selected for both LUTs 52 and 62.

Further, in order to perform the red-eye discrimination in the shape discriminating unit 32 with higher accuracy, it is equivalent to the circular signal obtained by the shape discriminating unit 32, that is, the distance converted to the interocular distance on the screen. It is also possible to determine whether or not the circular signal is a red-eye portion by determining whether or not the circular signal is present (# 124). Alternatively, the shape identification unit 32 converts the area of the red portion extracted by the contour extraction unit 31, for example, a value converted into a value obtained by summing the number of red addresses, to obtain the imaging magnification β.
It is also possible to identify the red-eye part depending on whether or not the size is expected from (# 126). Further, the accuracy may be improved by taking the logical product of the red-eye detection data obtained in the binary data memory 13 in the first and second embodiments.

Next, FIG. 13 is an overall block diagram showing a fourth embodiment of the red-eye correction apparatus, and FIG. 14 is a diagram showing an algorithm of red-eye position detection processing. Note that, in the figure, those denoted by the same reference numerals as those in FIGS. 9 and 11 perform the same function.

In the figure, the labeling unit 33 extracts each red region in which the red signal exists as one lump, assigns, for example, a serial number to each of these red regions, and predicts from the imaging magnification β. Those that exist in a pair in the binocular distance are extracted.

Next, the red eye position detection processing will be described with reference to FIG. 14. First, the R, G, B signals are synchronously read out based on the address control signal No. 3 from the microcomputer 72, and the chromaticity matrix is obtained. The circuit converts the signals into L, u, and v signals and executes the processes of # 130 to # 136.
That is, the red color detection table is selected as the internal table of the LUT 52, whereby the red and red parts are binarized to "1" and the other parts to "0" using the u and v signals (# 130). .

This binary signal is image-processed by the labeling section 33, and a serial number is given to each red area obtained (# 132), and the coordinate value of each labeled red area,
That is, the address data on the image memory 2 is the microcomputer 7
Guided to 2. The microcomputer 72 obtains the center coordinate value of the obtained red area, that is, the center address, and temporarily stores it.
On the other hand, the binocular distance expected from the photographing magnification β is converted into the distance on the address. Then, for each combination, two from the obtained center addresses are compared with the address distance corresponding to the binocular distance, and the two red areas when they match are determined to be red-eye portions (# 136). . Then, the microcomputer 72 stores a correction, for example, "1" for the address of the area determined to be the red eye portion. Note that correction is unnecessary for other areas, resulting in "0".
It is said that Note that the processing at the time of red-eye correction is the same as in the third embodiment, so a description thereof will be omitted.

Further, in FIG. 13, the contour extraction unit 31 and the shape identification unit 32 enclosed in parentheses show a modified example of the red eye position detection in this embodiment, and the contours of the respective labeled red regions are contoured. The extraction unit 31 extracts each of them, and the shape identification unit 32 determines that each contour is a circle and determines that it is a red eye position, and otherwise determines that it is another red object (# 138). The detection accuracy is improved. The detection accuracy may be further improved by taking the logical product of the red-eye detection data obtained in the binary data memory 13 in the first and second embodiments.

Next, FIG. 15 shows the fifth and sixth red-eye correction devices.
16 is an overall block diagram showing an embodiment, and FIG. 16 shows an algorithm of red-eye position detection processing in the fifth embodiment.
FIG. 7 is a diagram showing an algorithm of red-eye position detection processing in the sixth embodiment. The fifth embodiment is a case where the switch SW7 is in the illustrated state, and the sixth embodiment is a case where the switch SW7 is directly connected to the microcomputer 73.
Note that, in the figure, those denoted by the same reference numerals as those in FIGS. 9 and 11 perform the same function.

In the figure, a contour extraction unit 34 is for extracting the contour of a region including a skin color signal. Shape identification unit 35
Previously stores the human face shape as a reference shape,
The face is identified by determining which of the one or more contours obtained by the contour extraction unit 34 matches the reference shape by using the pattern recognition technique. The filling processing unit 36 fills the inside of the closed region of the face shape identified by the shape identifying unit 35, that is, writes “1” in all of the region.

Next, the red-eye position detection processing in the case of the fifth embodiment will be described using the algorithm of FIG. First, based on the address control signal from the microcomputer 7, the R, G, B signals are synchronously read out, converted into L, u, v signals by the chromaticity matrix circuit 3, and # 150 and #. The processes of 152 to # 158 are executed in synchronization. That is, the red color detection table is selected as the internal table of the LUT 52, whereby u,
By using the v signal, the red part is binarized as "1" and the other parts are binarized as "0"(# 150). This binary signal is guided as it is to one input terminal of the AND circuit 121. On the other hand, the flesh color detection table is selected as the internal table of the LUT 62, and the u and v signals are used to binarize the flesh color portion as "1" and the other portions as "0".

This binary signal is input to the contour extracting section 34, and the contour of each of the areas where the skin color portion exists as an area is extracted (# 152). Further, each of the extracted contours is discriminated by the shape discriminating unit whether or not it has, for example, an oval shape which is a reference of the facial shape of the person (# 156). Then, when the contour is identified as an oval shape, the inside of the contour is uniformly painted (# 158). Then, the face area signal subjected to the filling processing is subjected to area expansion according to the photographing magnification β via the LPF 82, and is then guided to the other input end of the AND circuit 121, where the logical product is obtained with the red portion. (# 160). By this logical product, the red part in the face is detected. Next, the contour of the obtained red part is extracted (# 162), and it is further identified whether the extracted contour is a circle, that is, a circle (# 164).
If it is circular, it is determined that the position is the red eye position, and the signal in the area is captured by the microcomputer. Then, the obtained red-eye position signal is guided to the microcomputer 73 and subjected to red-eye correction processing in the same manner as in the second embodiment.

Further, in order to identify the red-eye part more accurately, whether or not the circular signal is the red-eye part depends on whether or not there is an equivalent circular signal near the circular signal obtained in the shape identifying part 32. Can also be determined (# 16
6). Alternatively, the shape identifying unit 32 may identify the red-eye portion based on whether the area of the red portion extracted by the contour extracting unit 31 is the size expected from the photographing magnification β (# 168). Further, the accuracy may be improved by taking the logical product of the red-eye detection data obtained in the binary data memory 13 in the first and second embodiments.

Next, the red eye position detection processing in the case of the sixth embodiment will be described using the algorithm of FIG. In the sixth embodiment, the shape identifying unit 35 shown in FIG. 15 identifies the eye shape instead of the human face shape, and stores the reference shape of the human eye in advance. Using the pattern recognition technique, it is determined which of the one or more contours obtained by the contour extraction unit 34 matches the reference shape. First, as in the fifth embodiment,
The red color detection table is selected as the internal table of the LUT 52, and the u and v signals are used to binarize the red color portion as "1" and the other portions as "0"(# 180). This binary signal is AND circuit 12 as it is.
1 to one input end. On the other hand, the flesh color detection table is selected as the internal table of the LUT 62.
The u and v signals are used to binarize the flesh color part as "1" and the other parts as "0".

This binary signal is input to the contour extraction unit 34, and the boundaries between the skin color portion and the other color portions are extracted as contours (# 182). For example, since the face and the eyes in the face have different colors, a contour is formed on the outer periphery of the eyes as a result. In this way, each of the extracted contours is discriminated by the shape discriminating unit 35 as to whether or not it has a lateral oval shape, which is a reference of the human eye shape (# 1).
84). Then, when the contour is identified as the shape of an eye (# 186), a uniform filling process is performed on the closed region surrounded by the contour (# 188). Then
The eye area signal subjected to the filling processing is subjected to the area expansion according to the imaging magnification β via the LPF 82, and then ANDed.
It is led to the other input terminal of the circuit 121, and is ANDed with the red portion (# 190). The red product in the eye is detected by this logical product. Then, the obtained red-eye position signal is guided to the microcomputer 73 and subjected to red-eye correction processing in the same manner as in the second embodiment.

Further, in order to perform the red-eye identification with higher accuracy, the red-eye portion may be identified based on whether or not there is a signal having an equivalent shape near the obtained eye position signal (# 192). Alternatively, the shape identifying unit 35 may identify the red-eye portion based on whether the area of the eye shape extracted by the contour extracting unit 34 is the size expected from the imaging magnification β (# 194). In addition, the first embodiment,
The accuracy may be improved by taking the logical product of the red-eye detection data obtained in the binary data memory 13 in the second embodiment. In addition, the fifth and sixth embodiments may be combined to perform more accurate red-eye position detection, and by combining this with the third embodiment,
Higher accuracy red-eye position detection can be expected.

Next, FIG. 18 is an overall block diagram showing a seventh embodiment of the red-eye correction apparatus. In the figure, those designated by the same numbers as in FIG. 9 perform the same functions. FIG. 19 is a diagram showing an algorithm of red-eye position detection processing.

In the figure, the microcomputer 74 is a monitor 19
The upper pressed position coordinates (x, y) are input. The coordinates (x, y) correspond to the address of the image memory 2. It should be noted that the method of specifying the position on this monitor is as follows.
It is performed by pressing or by operating a display marker on the screen which can be instructed to move by an operation from the operation unit.

FIG. 20 is a diagram for explaining the conversion from the signal (L, u, v) to the luminance system (L) and the polar coordinate system (r, φ). FIG. 20A shows (u, v). ) Signal is converted to a (r, φ) signal, and FIG. 20B shows a case where the luminance signal L is extracted.

In the red-eye correction table 37, signals (L, u, v) at designated positions input from the image memory 2 through the switches SW10, SW11 in the illustrated state are converted into a luminance system (L) and a polar coordinate system (r, φ). ), And FIG.
As shown in (a) and (b), a luminance signal (L ± d) and a color signal (r ± α, φ ± β) in which an allowable range is added to the converted value.
In addition to the above, the color signal is further inversely transformed to obtain (u ₁ ≦ u ≦ u ₂ , v ₁ ≦ v ≦ v ₂ ). The microcomputer 74 sets this value to the switches SW8 and SW9.
Through LUTs 43 and 53. Further, the LUT 43 outputs "1" when the signals (L) sequentially read from the image memory 2 are included in the range of (L ± d), and outputs "0" otherwise. The LUT 53 outputs “1” when the signals (u, v) sequentially read from the image memory 2 are included in the range of (u ₁ ≦ u ≦ u ₂ , v ₁ ≦ v ≦ v ₂ ), and otherwise. In the case of, "0" is output. Each binary output from the LUTs 43 and 53 at this time is guided to the AND circuit 121 through the switches SW8 and SW9 by the switching signal from the microcomputer 74.

Next, the red eye position detection processing will be described with reference to FIG. 19. First, when the position (x, y) is designated for the red eye position from the reproduced image on the monitor screen (# 2
00), the address (x, y) is read from the microcomputer 74 and supplied to the image memory 2. Then, the R, G, B signals of the corresponding address are read from the image memory 2, converted into L, u, v signals by the chromaticity matrix circuit 3 and guided to the red-eye correction table 37 (# 202, # 21).
0). Next, with respect to the luminance signal L, # 204 to # 20
6 is executed, and the color signals U and v are processed from # 212 to # 212.
The process of # 218 is executed.

For the luminance signal, the detection area (L ± d) in which the allowable range is added is designated, and this content is LUT4.
3 is written (# 204, # 206). On the other hand, the color signal is once converted into polar coordinates (r, φ), and after the detection area (r ± α, φ ± β) in which the allowable range is added is specified, the inverse transformation (u ₁ ≦ u ≦ u ₂ , v ₁ ≤ v ≤ v ₂ ) and this content is written to the LUT 53 (# 212-
# 216).

Next, based on the address control signal from the microcomputer 74, the image signals are sequentially read out from the image memory 2, and the chromaticity matrix circuit 33 outputs L, u, v.
It is converted to a signal and guided to the LUTs 43 and 53 (# 2
08, # 218). In the LUT 43, 53, L, u, v
The detection area (L ± d) where the signal is written in advance, (u
₁ ≤ u ≤ u ₂ and v ₁ ≤ v ≤ v ₂ ), each outputs "1", and otherwise outputs "0" to the AND circuit 121 and outputs the logical value. The products are taken and sequentially written in the binary data memory 13 (# 22
0).

When reading from the image memory 2 in the next cycle, it is read in synchronization with the contents of the binary data memory 121, and when "1" is output from the binary data memory 121, it is regarded as the red eye position. Then switch SW10,
SW11 is switched to the state opposite to that shown in the drawing, and the multiplication unit 17,
It is output to the chromaticity matrix circuit 3 via 18 and becomes “0”.
Is output, the switches SW10 and SW11 are switched to the illustrated state and the output of the image memory 2 is guided to the chromaticity matrix circuit 3 as it is.

Next, FIG. 21 is an overall block diagram showing an eighth embodiment of the red-eye correction device, and FIG. 22 is a diagram showing an algorithm of red-eye position detection processing. Note that, in the figure, those denoted by the same reference numerals as those in FIGS. 9 and 11 perform the same function.

In this embodiment, with respect to a series of frames photographed continuously, only the area near the position determined to be the red eye position in the first frame is treated as the region in which the red eye position should be detected from the next frame. The red-eye position detection is facilitated and speeded up.

In the figure, the microcomputer 75 is adapted to take in the continuous shooting information inputted from the image pickup section 20 or manually and the photographing magnification β of the series of frames. The LPF 83 has a filter effect changeable according to the photographing magnification β. The circuit block shown in FIG. 21 includes the red-eye position detection circuit section shown in the second or third embodiment. It is assumed that the binary data of the detected red-eye position in is captured.

Next, the red eye detection processing will be described with reference to FIG. When it is determined by the microcomputer 75 that the series of frames shot continuously are reproduced (# 230), even if the reproduction for the first frame of continuous shooting ends, the binary data in the binary data memory 13 remains It is kept as it is. Next, by the time the reproduction process for the second frame of continuous shooting is started, it is confirmed whether or not a red eye exists in the first frame of continuous shooting (# 23).
2) If the red-eye does not exist in the first frame of continuous shooting, the red-eye position detection processing according to the second and third embodiments is performed for the second and subsequent frames.

On the other hand, if a red eye is present in the first frame of continuous shooting, only the near area of the confirmed red eye position is extracted and detected in the second and subsequent frames (# 234). That is,
The red-eye position data of the first frame is read from the binary data memory 13, and the area is enlarged according to the photographing magnification β via the LPF 83. Then, the area signal in which the data “1” is generated is guided to one input terminal of the AND circuit 121 even in the near area so as to surround the red eye position confirmed in the first frame. This is because it is expected that the larger the photographing magnification β, the larger the movement of the eye position between the first frame and the second and subsequent frames, and accordingly the eye part is surely included in the detection region. To do so. Further, the data “1” indicating the red portion in the frame output from the LUT 52 via the red detection table is the AND circuit 12
1 is led to the other input end.

Then, both data are ANDed by the AND circuit 121 (# 236) and output to the microcomputer 75 for storage. Further, from the third frame onward, up to the last frame in the continuous shooting mode, red-eye position detection is performed based on the detected red-eye position data in the first frame as described above.

Although this embodiment has been described based on the binary data in the binary data memory 13, the same applies to the fourth to sixth embodiments based on the data of the red eye position taken in the microcomputer. Can also be processed. Also,
The configuration of the red-eye correction processing unit may be the same as that of the first embodiment.

Next, a ninth embodiment of the red-eye correction device will be described. In the red eye position detection in the ninth embodiment, the red eye position is directly manually instructed on the reproduced image on the monitor to correct the red eye. That is, the manually designated coordinate position (x, y) is detected, and the detected position data is enlarged through a low pass filter (x
± Δx, y ± Δy) to secure the detection accuracy, and the LUT5 (or LUT5) is applied to the enlarged detection area.
The red-eye position is detected by taking the logical product with the red part output via the red detection table of (1, 52). At this time, the enlargement range may be variable according to the photographing magnification β. As shown in FIG. 18, the manual instruction method is such that a transparent touch panel that outputs the pressed position coordinates (x, y) is placed on the monitor screen in a superimposed manner or moved by an operation from the operation unit. The position may be designated by operating the display marker on the screen that can be designated.

Further, the logical product of the ninth embodiment and the seventh embodiment may be taken (# 222 in FIG. 19) to perform more accurate red-eye position detection.

[0074]

As described above, according to the present invention,
From the film image obtained by color-imaging the developed color film, at least one of the low saturation area and the low illuminance area portion is extracted by the first extracting means, and the skin color area is extracted by the second extracting means, Extract the red part with the third extraction means,
Further, since the red eye position in the image is detected by using the extraction signals from the first, second and third extracting means, that is, by using the plural color components peculiar to the face, the red eye position is easy and reliable. The position can be detected.

Further, the red-eye position data thus obtained can be easily used for color correction for the red-eye position by synchronously reading the picked-up image data when it is read out to a monitor or the like. Become.

[Brief description of drawings]

FIG. 1 is an overall block diagram showing a first embodiment of a red-eye correction device to which the present invention is applied.

FIG. 2 is a perspective view showing the overall structure of an imaging unit.

FIG. 3 is a diagram for explaining a red eye position.

FIG. 4A to FIG. 4J are diagrams for explaining the image processing contents for each detection procedure of the red eye position.

FIG. 5 is a diagram showing an algorithm of red-eye position detection and color correction processing.

FIG. 6 is a diagram showing an algorithm of a process A in detail.

FIG. 7 is a diagram showing an algorithm of a process B in detail.

FIG. 8 is a diagram showing an algorithm of a process C in detail.

FIG. 9 is an overall block diagram showing a second embodiment of the red-eye correction device.

FIG. 10 is a diagram showing an algorithm of red-eye correction processing in the second embodiment.

FIG. 11 is an overall block diagram showing a third embodiment of the red-eye correction device.

FIG. 12 is a diagram showing an algorithm of red-eye position detection processing in the third embodiment.

FIG. 13 is an overall block diagram showing a fourth embodiment of the red-eye correction device.

FIG. 14 is a diagram showing an algorithm of red-eye position detection processing in the fourth embodiment.

FIG. 15 is an overall block diagram showing fifth and sixth embodiments of the red-eye correction device.

FIG. 16 is a diagram showing an algorithm of red-eye position detection processing in the fifth embodiment.

FIG. 17 is a diagram showing an algorithm of red-eye position detection processing in the sixth embodiment.

FIG. 18 is an overall block diagram showing a seventh embodiment of the red-eye correction device.

FIG. 19 is a diagram showing an algorithm of red-eye position detection processing in the seventh embodiment.

FIG. 20 is a diagram for explaining a conversion from a signal (L, u, v) to a luminance system (L) and a polar coordinate system (r, φ), and FIG. r, φ) signal is converted and formed, and FIG. 7B shows a case where the luminance signal L is extracted.

FIG. 21 is an overall block diagram showing an eighth embodiment of the red-eye correction device.

FIG. 22 is a diagram showing an algorithm of red-eye position detection processing in the eighth embodiment.

[Description of Reference Signs] 1 A / D converter 2 Image memory 3 Chromaticity matrix circuit 4, 41, 42, 5, 51, 52, 53, 6, 61, 6
2 LUT 7, 71, 72, 73, 74, 75 Microcomputer 8, 81, 82, 83, 9, 10 LPF 11 INV 12, 121 AND circuit 13 Binary data memory 14 Matrix circuit 15 Encoder 16 D / A converter 17, 18 Multiplier 19 Monitor 20 Imager 31,34 Contour extractor 32,35 Shape discriminating unit 33 Labeling unit 36 Filling unit 37 Red-eye correction table SW1 to SW11 switches

Claims (1)

[Claims] 1. A means for color-imaging a developed color film, a first extracting means for extracting at least one of a low-saturation region and a low-illuminance region portion from the captured film image; In the image using the second extraction means for extracting the skin color region, the third extraction means for extracting the red part from the captured film image, and the extraction signals from the first, second and third extraction means. A red-eye position detecting device for detecting the red-eye position.