JPH08251475A - Open eye sensor for image pickup device - Google Patents

Abstract

PURPOSE: To prevent the waste of a photo film and an image pickup time by sensing an object whose eyes are open in the case of image pickup of a portrait so as to permit a shutter of the image pickup device to be driven thereby picking up a photograph where eyes of a person are always open. CONSTITUTION: An image input section for image pickup to sense open eyes is installed in the vicinity of of an optical system 1 for image pickup. When a shutter button 20 is half depressed, an invisible light by a lighting 11a of a coaxial system and a lighting 11b of a non-coaxial system of an image input section 10 is emitted sequentially to an object 8 and image data are inputted from the image input section 10, A/D-converted and the result is stored in an image memory 13. A reflection image extract section 14 extracts an eyeground reflecting image based on a difference of image data. A reflecting image presence discrimination section 15 discriminates whether or not the eyeground reflecting image is included in the image data, and when the image is included, the drive of the shutter 3 is allowed. But when not included, the drive of the shutter 3 is inhibited and an alarm tone is raised.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an eye-opening detection device for a photographing device, which detects an eye-opened state of a subject when photographing a person using the photographing device.

[0002]

2. Description of the Related Art Conventionally, since there is no means for detecting that a subject is in an open eye state when taking a picture of a person, a photograph of a closed eye state due to careless blinking of the subject may be taken. Professional photographers respond by taking a plurality of photographs at the time of shooting.

[0003]

However, in the conventional photographing apparatus, it is necessary to wait for the completion of the photograph to determine whether the subject is in the eye open state, and if the subject is in the eye closed state, it is necessary to take the photograph again. Waste of film and shooting time occurs. Also, since it is rare to take multiple identical photos when taking photos during a trip,
Even if you know that the eyes are closed after the photo is finished,
It's difficult to take a picture again, and it's a shame that the precious and memorable photos have their eyes closed. Therefore,
In view of the above conventional problems, the present invention detects that the subject is in an eye-opened state when taking a portrait photograph, and by taking the photograph, always takes a photograph in an eye-opened state. It is an object of the present invention to provide an eye-opening detection device for an imaging device that can prevent waste.

[0004]

In order to achieve the above object, the present invention according to claim 1 is connected to a photographing device,
An image input unit including an optical system for capturing a fundus reflection image and a photoelectric conversion element, a coaxial system illumination in which the optical axis of the optical system for capturing the fundus reflection image coincides with the irradiation direction, and the optical system for capturing the fundus reflection image, Illuminating means including a non-coaxial illumination provided at a non-coaxial position, an image memory for storing image data of a subject by each illumination input by the image input means, and a fundus based on a difference between the image data. From the fundus reflection image extraction means for extracting the reflection image, the fundus reflection image presence determination means for determining whether or not the fundus reflection image is included in the image data, and the fundus reflection image presence or absence determination means. It comprises a shutter control means for controlling the drive of the shutter mechanism of the photographing device according to the determination output, and an overall control means for controlling each means. The shutter control means is the fundus reflection image presence / absence determination means, If it is determined that the fundus reflection image is included, the drive of the shutter mechanism is permitted, and if it is determined that the fundus reflection image is not included in the image data, the shutter mechanism is driven. I decided to prevent it.

Further, in the present invention according to claim 2, in the above-mentioned constitution, when the fundus reflection image presence / absence determining means determines that the fundus reflection image is not included in the image data, Until it is determined that the data includes the fundus reflection image, and the drive of the shutter mechanism is permitted, the overall control unit controls each of the units and repeats the operation.

According to a third aspect of the present invention, an image input means connected to a photographing device and comprising a fundus reflection image pickup optical system and a photoelectric conversion element, and an optical axis of the fundus reflection image pickup optical system. And an illumination means including a coaxial illumination whose irradiation directions coincide with each other, and a non-coaxial illumination provided in a non-coaxial position with the fundus reflection image pickup optical system, and the illumination input by the image input means. An image memory that stores image data of a subject by each illumination, a fundus reflection image extraction unit that extracts a fundus reflection image from a difference between the image data, and a number of fundus reflection images that determines the number of fundus reflection images included in the image data. A comparing means, a subject number input means for inputting the number of subjects to be photographed in advance, a fundus reflection image number determined by the fundus reflection image number determining means and a multiple of the subject number input from the subject number input means are compared. The comparison means and the ratio According to the result, it comprises a shutter control means for controlling the drive of the shutter mechanism of the photographing device and a general control means for controlling each means. The shutter control means is judged by the fundus reflection image number judging means in the comparing means. If it is determined that the number of fundus reflection images matches a multiple of the number of subjects input from the subject number input means, driving of the shutter mechanism is permitted, and the comparison means determines the number of fundus reflection images. When it is determined that the number of fundus reflection images determined by the means does not match the multiple of the number of subjects input from the number-of-subjects input unit, the drive of the shutter mechanism is blocked.

The present invention according to claim 4 is the above claim 3
In the configuration described in (1), it is determined that the comparison means does not match the fundus reflection image number determined by the fundus reflection image number determining means and the multiple of the subject number input from the subject number input means. In this case, the overall control unit controls each unit until it is determined that the determined number of fundus reflection images and the input multiple number of subjects match, and the drive of the shutter mechanism is permitted. However, the operation is to be repeated.

According to a fifth aspect of the present invention, an image input means connected to a photographing device and comprising a fundus reflection image pickup optical system and a photoelectric conversion element, and an optical axis of the fundus reflection image pickup optical system. And an illumination means including a coaxial illumination whose irradiation directions coincide with each other, and a non-coaxial illumination provided in a non-coaxial position with the fundus reflection image pickup optical system, and the illumination input by the image input means. An image memory that stores image data of a subject by each illumination, a fundus reflection image extraction unit that extracts a fundus reflection image from a difference between the image data, and a number of fundus reflection images that determines the number of fundus reflection images included in the image data. The determination means, the fundus reflection image number display means for displaying the determined number of fundus reflection images in the finder of the photographing apparatus, and the overall control means for controlling the respective means are provided.

[0009]

According to the first aspect of the present invention, the subject is illuminated by the coaxial illumination and the non-coaxial illumination to capture an image. The image data input by the image input unit is stored in the image memory, and the fundus reflection image extracting unit extracts the fundus reflection image based on the difference between the image data captured by each illumination. The fundus reflection image presence / absence determining unit determines whether or not the extracted fundus reflection image is present as a result of these selection processes. The shutter control means permits the drive of the shutter mechanism when the fundus reflection image presence / absence determining means determines that the fundus reflection image is included in the image data, and the fundus reflection image is included in the image data. If it is determined that the shutter mechanism is not in operation, the drive of the shutter mechanism is blocked. The overall control means controls each means. As a result, when it is detected that the subject is in the eye-closed state, the driving of the shutter mechanism is blocked.

According to a second aspect of the present invention, when the fundus reflection image presence / absence determining means in the above configuration determines that the fundus reflection image is not included in the image data, the shutter control means causes the shutter to operate. The drive of the mechanism is blocked, and the overall control means again repeats the processing from the imaging by each illumination to the fundus reflection image determination. As a result, when it is detected that the subject is in the eye-closed state, the drive of the shutter mechanism is blocked and the eye-opening detection is performed again.

According to a third aspect of the present invention, the number of fundus reflection images is determined by the number of fundus reflection images determination means. In the comparison means, a multiple of the number of subjects preliminarily input from the subject number input means is compared with the number of fundus reflection images determined by the number of fundus reflection image determination means, and the comparison result is controlled to drive the shutter mechanism of the photographing apparatus. To the shutter control means. The shutter control means, when the comparison means determines that the number of fundus reflection images determined by the number of fundus reflection images determination means and the multiple of the number of subjects input from the number of subjects input means match, the shutter mechanism If the driving of is allowed and it is determined that the number of fundus reflection images determined by the number of fundus reflection image determination means in the comparison means and the multiple of the number of subjects input from the number-of-subjects input means do not match, The drive of the shutter mechanism is blocked. The overall control means controls each means. As a result, the drive of the shutter mechanism is blocked when it is detected that at least one person has the eyes closed.

According to a fourth aspect of the present invention, in the above construction, the number of fundus reflection images determined by the number of fundus reflection image determination means in the comparison means and a multiple of the number of subjects input from the number of subjects input means are equal to each other. If it is determined that you have not done so,
The shutter control means blocks the driving of the shutter mechanism, and the overall control means repeats the processing from the imaging by each illumination to the fundus reflection image determination again. This allows
When it is detected that at least one of the subjects is in an eye-closed state, the drive of the shutter mechanism is blocked,
Eye opening detection is performed again.

According to a fifth aspect of the present invention, the number of fundus reflection images is determined by the number of fundus reflection images determination means, and the number of fundus reflection images extracted by the fundus reflection image extraction means is determined. Display the number. This allows the photographer to determine whether or not all of the subjects have their eyes open.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a block diagram showing a first embodiment of an eye opening detection device for a photographing apparatus according to the present invention. This embodiment is particularly suitable when there is one subject. A mirror 2 is installed behind an optical system 1 for taking an image of a subject 8,
Further, a shutter 3 and a film 4 are provided on the rear side. A finder 5 including a pentaprism 5a and an eyepiece optical system 5b is installed above the mirror 2. The photographer 7 observes the subject 8 from the viewfinder 5. An optical system 10a for picking up an image of a subject 8 and a photoelectric conversion element 10b using a CCD or the like are provided in the vicinity of the optical system 1 for photographing.
The image input unit 10 is installed. On the front surface of the image input unit 10, a coaxial illumination 11a including a near-infrared LED and the like is provided so that the optical axis of the optical system 10a is aligned with the irradiation direction. Further, a non-coaxial illumination 11b having the same specifications as the illumination 11a is provided at a position where the relative relationship with the illumination 11a is known.

The image pickup output from the photoelectric conversion element 10b is A /
The image data is A / D converted by the D converter 12 and stored in the image memory 13. A reflection image extraction unit 14 is connected to the image memory 13, and a reflection image presence / absence determination unit 15 and a shutter control unit 16 are sequentially connected thereto. The reflection image extraction unit 14 extracts the fundus reflection image from the difference between the image data stored in the image memory 13. The reflected image presence / absence determining unit 15 determines whether or not the fundus reflected image is included in the image data. Shutter control unit 16
Is connected to the shutter 3 and an alarm output unit 17 that emits an alarm sound. An illumination light emission control unit 18 that controls the light emission is connected to the illuminations 11a and 11b, and the entire illumination light emission control unit 18, the A / D converter 12, and the alarm output unit 17 that control the operation of the entire device are included. A control unit 19 is provided. A shutter button 20 and an eye opening detection switch 21 are connected to the overall control unit 19. When the shutter button 20 is pressed halfway, a control start signal is output from the overall control section 19, and when it is pressed further, the shutter 3 is driven.

First, the operating principle of this embodiment will be described. When shooting a person using strobe light, the subject's eyes may glow red. This red-eye phenomenon is caused by the fact that the fundus reflected light reflected by the retina of the fundus returns to the direction of the photographing device when illuminated from a direction substantially equal to the photographing direction. In the present embodiment, when the subject has his eyes open, when the illumination light is emitted, the fundus reflected light can be observed to detect the opened state of the subject. Illumination 11 arranged so as to be coaxial with image input unit 10.
In the image captured using a, the pupil portion of the eyeball is captured brightly due to the reflected light from the fundus. In addition, since the reflected light from the fundus of the eye is not captured in the image captured using the illumination 11b arranged so as to be non-coaxial with the image input unit 10, the pupil part of the eyeball is captured darkly. The fundus reflection image is extracted from the difference between the two images to detect the eye open state.

Next, the operation of this embodiment will be described.
FIG. 2 is a flowchart showing the flow of the fundus reflection image extraction processing in this embodiment. First, the eye opening detection switch 21
When the switch is turned on and the shutter button 20 is half-pressed, a control start signal is output from the overall control unit 19 to start control. In step 101, the illumination light emission control unit 18 outputs a control signal to turn on the illumination 11a and turn off the illumination 11b. In step 102, the image input from the optical system 10a is converted into an electric signal by the photoelectric conversion element 10b, A / D converted by the A / D converter 12, and stored in the image memory 13. Let this image be I1 (x, y). Step 103
Then, with the control signal of the illumination light emission control unit 18, the illumination 11a is turned off and the illumination 11b is turned on. In step 104, the face image input from the optical system 10a is converted into an electric signal by the photoelectric conversion element 10b, and then the A / D converter 12 is used.
Is A / D converted and stored in the image memory 13. Let this image be I2 (x, y).

In step 105, the reflection image extraction unit 1
At 4, the image I2 (x, y) is subtracted from the image I1 (x, y) to generate the image I3 (x, y). Step 1
At 06, the image I3 (x, y) is set to 2 with a fixed threshold value Th1.
It is binarized to generate a binary image I4 (x, y). In step 107, the image I4 (x, y) is labeled and the regions are numbered. In step 108,
The area Ri of each region obtained as a result of labeling is compared with predetermined threshold values S1 and S2 (S1 <S2), and only the region satisfying S1 <Ri <S2 is extracted. That is, in the image I4 (x, y), in addition to the fundus reflection image, for example, a spectacle lens reflection image, a spectacle frame reflection image,
Various noises may be included, such as a part of the face caused by changes in external lighting. Since these noises generally have an indefinite shape and an indefinite area, they can be clearly discriminated from a fundus reflex image observed as a circle or an ellipse having an area expected in advance. Therefore, here, first, the selection is performed according to the area of the region.

The threshold values S1 and S2 are determined by the image input unit 1
The area of the pupil having the expected pupil diameter (diameter 2 to 8 mm) estimated from the photographing magnification of 0 and the distance to the subject is set to the upper limit value and the lower limit value of the corresponding pixel number. In this embodiment, the distance information to the subject obtained by the autofocus function is used for setting the threshold values S1 and S2. Although the spectacle lens reflection image due to the light from the illumination light source is also observed as a circular region, for example, by narrowing the diaphragm of the lens of the optical system 10a, the area of the spectacle lens reflection image is always smaller than the area of the fundus reflection image. If so, both can be identified by the area. Step 109
Then, the region remaining as a result of the sorting process by the area is sorted by the region shape. Here, the ratio F of the area of the area to the circumscribed rectangle is calculated. Since the fundus reflection image is observed as a circle or an ellipse, the ratio F is equal to or greater than a certain value, whereas, for example, the spectacle frame reflection is an elongated region along the frame, and is therefore equivalent to the fundus reflection image. Even if it has an area, it is identified because F becomes small.

In step 110, the reflected image presence / absence determining unit 1
5, if there is a remaining area as a result of these sorting processes, it is determined that the fundus reflection image is captured in the image I4 (x, y). If there is no remaining area, the image I4 is obtained. It is determined that the fundus reflection image is not captured at (x, y). In this way, the presence / absence of the fundus reflection image is determined by the reflection image presence / absence determining unit 15. Steps 105 to 109 constitute the fundus reflection image extracting means of the invention, and step 110 constitutes the fundus reflection image presence / absence determining means.

The shutter control unit 16 permits further pressing of the shutter button 20 when it is determined based on the output result of the reflection image presence / absence determination unit 15 that the fundus reflection image is included. When the photographer 7 further presses the shutter button 20 from the half-pressed state, the shutter 3 is driven and the subject 8 is photographed. When it is determined that the fundus reflection image is not included, the shutter control unit 16 prevents the shutter button 20 from being further pressed, and activates the alarm output unit 17. The alarm output unit 17 informs the photographer 7 by the alarm sound that the fundus reflection image has not been detected. When the alarm sound is emitted, if the photographer 7 stops half-pressing the shutter button 20, the control from the overall control unit 19 is stopped and the alarm sound is also stopped.

Accordingly, when it is determined that the fundus reflection image is included in the image data when the shutter button 20 is pressed halfway, that is, when it is detected that the subject 8 has the eyes open. The shutter control unit 16 permits the driving of the shutter 3, and when it is determined that the fundus reflection image is not included in the image data, that is, when it is detected that the subject 8 is in the eye-closed state, The drive of the shutter 3 is blocked and an alarm sound is emitted. In addition, since blinking is performed at the same time for both eyes unless intentionally performed, the subject is considered to have eyes open if any one of the fundus reflection images is detected.

Since this embodiment is configured as described above, when taking a picture of a person, the fact that the subject is in the eye open state is detected and the image is taken. Therefore, it is possible to take the picture in the eye open state at all times. Therefore, it is possible to prevent waste of film and shooting time. In the above-described embodiment, light is used as the alarm output, and the alarm output unit 17 is provided in the viewfinder 5, so that the photographer 7 determines the shutter timing in the same manner as other aperture information and shutter speed information. It can also be used as one of the shooting information to be set.

Next, FIG. 3 shows a second embodiment of the present invention.
In this embodiment, a shutter control unit 31 is connected to the reflected image presence / absence determining unit 15. The shutter control unit 31 is connected to the shutter 3, the alarm output unit 17, and the overall control unit 32. The overall control unit 32 is connected to the shutter button 20 and the eye opening detection switch 21, and controls the operation of the entire apparatus including the illumination light emission control unit 18, the A / D converter 12, and the alarm output unit 17. From the shutter control unit 31,
When the signal for controlling the shutter 3 to be driven is output, the control start signal is again output from the general controller 32. Therefore, when the eye opening detection operation is repeated and the eye opening is detected for the first time, the driving of the shutter 3 is permitted, and the shutter button 20 can be further pressed.

In this case, there is a time lag between the half-press operation of the shutter button 20 of the photographer 7 and the photographing. But,
As described in "A real-time blink detection method using color moving images" (Tanabe et al., 1992 23rd Image Engineering Conference), the time required for one blink is usually about 3 times.
It is a short time from 00 to 400 msec, and several hundred ms after the alarm 8 is notified that the subject 8 is closed.
Since the shutter 3 is driven with a time lag around ec,
There is no problem in shooting. Other configurations and operations are similar to those of the first embodiment shown in FIG.

Thus, when it is determined that the fundus reflection image is not included in the image data when the shutter button 20 is pressed halfway, that is, when it is detected that the subject 8 is in the eye-closed state, The drive of the shutter 3 is blocked, an alarm sound is emitted, and the eye opening detection is performed again. When it is determined that the fundus reflection image is included in the image data, that is, when it is detected that the subject 8 is open,
The shutter controller 31 permits the driving of the shutter 3.

Since this embodiment is configured as described above, when a person is photographed, it is detected that the subject is in an open eye state and the image is taken. Therefore, a photograph in an open eye state is always taken, It is possible to prevent waste of film and shooting time. Further, when the subject is in the eye-closed state, the eye-opening detection is automatically repeated, and the eye-opening can be closed to take a picture. Therefore, it is not necessary to redo the photographing, and it is possible to prevent the photographing time from being wasted.

Next, FIG. 4 is a block diagram showing a third embodiment particularly suitable for photographing two or more subjects 9. The reflected image number determination unit 41 and the comparison unit 42 are sequentially connected to the reflected image extraction unit 14. The reflection image number determination unit 41 determines the number of fundus reflection images and outputs the result to the comparison unit 42. The comparison unit 42 is connected to the number-of-subjects input unit 43, which includes a dial with numbers. The comparison unit 42 compares the output from the reflected image number determination unit 41 with a multiple of the number of subjects input from the subject number input unit 43. The shutter control unit 44 is connected to the shutter 3 and the alarm output unit 17. Lighting 11
An illumination light emission control unit 18 for controlling the light emission is provided in a and 11b.
Is provided, and an overall control unit 45 including the illumination light emission control unit 18, the A / D converter 12, and the alarm output unit 17 for controlling the operation of the entire apparatus is provided. Overall control unit 45
A shutter button 20 and an eye opening detection switch 21 are connected to. If you press the shutter button 20 halfway,
A control start signal is output from the overall control unit 45, and when further pressed, the shutter 3 is driven.

Next, the operation of this embodiment will be described. Based on the output result of the comparison unit 42, the shutter control unit 44 permits further pressing of the shutter button 20 when the number of reflected images of the fundus and the number of input subjects match. When the photographer 7 further presses the shutter button 20 from the half-pressed state, the shutter 3 is driven and the subject 9 is photographed. When they do not match, the shutter control unit 44
Prevents further pressing of the shutter button 20 and activates the alarm output unit 17. The alarm output unit 17 informs the photographer 7 by an alarm sound that the determined number of fundus reflection images does not match the number of input subjects. When the alarm sound is emitted, if the photographer 7 stops pressing the shutter button 20, the control from the overall control unit 45 is stopped and the alarm is also stopped. The other operations are similar to those of the first embodiment shown in FIG.

As a result, when the shutter button 20 is pressed halfway, it is determined that the number of fundus reflection images contained in the image data and the multiple of the number of subjects input from the subject number input unit 43 match. In this case, that is, when it is detected that all the subjects 9 have their eyes open, the shutter control unit 44 permits the driving of the shutter 3. When it is determined that the number of fundus reflection images included in the image data does not match the input multiple of the number of subjects, that is, at least one of the subjects 9 is detected to be in the eye-closed state. In the case, the shutter 3 is prevented from being driven and an alarm sound is emitted.

Since this embodiment is constructed as described above, when photographing not only one subject but also two or more subjects, it is detected that all the subjects are in the eye open state,
Since it is taken, everyone can always take a picture with the eyes open. Therefore, it is possible to prevent waste of film and shooting time. In the above embodiment, the number of subjects to be frequently photographed is stored as the default value in the subject number input unit 43 in advance, so that the labor of operation can be saved.

Next, FIG. 5 shows a fourth embodiment particularly suitable for photographing two or more subjects. In this embodiment, a shutter control unit 51 is connected to the reflected image number determination unit 41. The shutter control unit 51 is connected to the shutter 3, the alarm output unit 17, and the overall control unit 52. A shutter button 20 and an eye opening detection switch 21 are connected to the overall control unit 52, and the illumination light emission control unit 18, the A / D converter 12,
The operation of the entire apparatus including the alarm output unit 17 is controlled. When a signal for controlling the shutter 3 to be driven is output from the shutter controller 51, the overall controller 52 is again activated.
A control start signal is issued from. Therefore, the eye-opening detection operation is repeated, and the drive of the shutter 3 is permitted when the eye-opening of all the subjects is detected for the first time. In this case, a time lag occurs between the half-press operation of the shutter button 20 of the photographer 7 and the photographing. However, after a warning sound notifies that the subject 9 is closed, the shutter 3 is released with a time lag of about several hundred msec. Since it is driven, there is no problem in shooting.
Other configurations and operations are similar to those of the third embodiment shown in FIG.

As a result, when the shutter button 20 is pressed halfway, it is determined that the number of fundus reflection images contained in the image data does not match the multiple of the number of subjects input from the subject number input means 43. Case, that is, subject 9
When it is detected that at least one of them is in the eye-closed state, driving of the shutter 3 is blocked, an alarm sound is emitted, and the eye-opening detection is performed again. If it is determined that the number of fundus reflection images included in the image data and the input multiple of the number of subjects match, that is, if it is detected that all the subjects 9 have their eyes open, the shutter is released. Control unit 51
Allows the shutter 3 to be driven.

Since this embodiment is constructed as described above, when photographing not only one subject but also two or more subjects, it is detected that all the subjects are in the eye open state,
Since the photograph is taken, it is possible to prevent the waste of film and photographing time by always taking the photograph with the eyes open. Further, when the subject 9 is in the eye-closed state, the eye-opening detection is automatically repeated, and the eye-opening can be closed to take a picture. Therefore, it is not necessary to redo the photographing, and it is possible to prevent the photographing time from being wasted.

Next, FIG. 6 is a block diagram showing a fifth embodiment particularly suitable for photographing two or more subjects 9. A reflected image number determination unit 64 and a reflected image number display unit 61 are sequentially connected to the reflected image extraction unit 14. The reflection image extraction unit 14 performs difference calculation processing of each image data stored in the image memory 13, the reflection image number determination unit 64 determines the number of fundus reflection images, and the result is a reflection image provided below the viewfinder 50. It is output to the number display unit 61. Illumination light emission control unit 18, A /
An overall control unit 62 for controlling the operation of the entire device including the D converter 12 and the reflected image number display unit 61 is provided. A shutter button 63 and an eye opening detection switch 21 are connected to the overall control unit 62. When the shutter button 63 is pressed halfway down, a control start signal is output from the overall control section 62, and when it is pressed further down, the shutter 3 is driven. The other structure is similar to that of the third embodiment shown in FIG.

Next, the operation of this embodiment will be described. When the shutter button 63 is pressed halfway, a control start signal is output from the overall control unit 62, the number of fundus reflection images is determined, and the determined number of fundus reflection images is displayed on the reflection image number display unit 61. For example, when two people are photographed, if both are in the eye-opened state, 4 is displayed on the reflection image number display section 61 installed in the lower right part of the finder 50 as shown in (a) of FIG. Is
When one person is in the eye-closed state, 2 is displayed on the reflected image number display unit 61 as shown in FIG. 7B. Shutter button 63
If is held in the half-pressed state, the control start signal is again output from the overall control unit 62 after the number of fundus reflection images is detected, and the eye-opening detection operation is automatically repeated. When the shutter button 63 is pushed further, the shutter 3 is driven,
Shooting is done. If the half-press of the shutter button 63 is stopped, the overall control unit 62 stops the control and the eye-opening detection operation is stopped. Other operations are similar to those of the third embodiment shown in FIG.

As a result, when the shutter button 63 is half pressed, the number of fundus reflection images is determined and displayed. The fundus reflection image number determination operation and display are repeated while the shutter button 63 is held in the half-pressed state. Further pressing of the shutter button 63 drives the shutter 3.

Since this embodiment is constructed as described above, it is indicated that all of the subjects are in the open-eye state when photographing not only one subject but also two or more subjects. Since the photographer confirms from the display number of 61 and shoots, everyone can take a picture with the eyes open. Therefore, it is possible to prevent waste of film and shooting time. In the above-described embodiment, the photographer 7 confirms the number of eyes opened by dividing the determined number of reflection images by 2 in the number displayed in the reflection image number display unit 61 and displaying the number as the number of subjects having eyes opened. You can make it easier.

[0039]

As described above, according to the present invention, the fundus reflection image is extracted from the image data input from the image input means, and whether or not the fundus reflection image is included in the image data. When it is determined that the fundus reflection image is included in the image data, the shutter mechanism of the image capturing device is allowed to be driven, and it is determined that the fundus reflection image is not included in the image data. In this case, the shutter mechanism is prevented from being driven, so that it is possible to detect that the subject is in the open-eye state when taking a picture of a person and take the picture. Therefore, it is possible to always take a photograph with the eyes open and prevent waste of film and photographing time. Further, when it is determined that the fundus reflection image is not included in the image data, when the drive of the shutter mechanism of the imaging device is blocked and the eye opening detection is performed again, when the subject is in the eye closed state, Eye detection can be repeated by automatically repeating eye opening detection. Therefore, it is not necessary to redo the photographing, and it is possible to prevent the photographing time from being wasted. The present invention is suitable not only for a portable imaging device but also for an automatic imaging device for stationary identification photography.

Further, a fundus reflection image is extracted from the image data input from the image inputting means, and the number of fundus reflection images included in the image data is compared with a multiple of the number of preliminarily input subjects, and they match each other. If the shutter mechanism of the image capturing apparatus is allowed to be driven, and if the shutter mechanism of the image capturing apparatus is not matched, the shutter mechanism is prevented from being driven. In this case, it is possible to detect that all the subjects are in the open eye state and shoot. Therefore, everyone can always take a photograph with the eyes open, and it is possible to prevent waste of film and photographing time. Further, when the number of fundus reflection images included in the image data does not match the multiple of the number of subjects input in advance, the shutter mechanism of the image capturing device is prevented from being driven and the eye opening detection is performed again. In this case, when one or more subjects are photographed, of course, when at least one of the subjects is in the eye-closed state, the eye-opening detection is automatically repeated and all the subjects are in the eye-opened state. You can wait and shoot. Therefore, it is not necessary to redo the image capturing, and it is possible to prevent the image capturing time from being wasted.

When a fundus reflection image is extracted from the image data input from the image input means and the number of fundus reflection images included in the image data is displayed on the fundus reflection image number display means, one subject is Of course, when two or more subjects are photographed, the photographer can confirm that all of the subjects are in the eye-opened state from the number displayed on the fundus reflection image number display means and photograph. Therefore, everyone can take a photograph with the eyes open, and it is possible to prevent waste of film and photographing time.

[Brief description of drawings]

FIG. 1 is a diagram showing a first embodiment of the present invention.

FIG. 2 is a diagram showing a flow of processing in an eye opening detection device.

FIG. 3 is a diagram showing a second embodiment.

FIG. 4 is a diagram showing a third embodiment.

FIG. 5 is a diagram showing a fourth embodiment.

FIG. 6 is a diagram showing a fifth embodiment.

FIG. 7 is an explanatory diagram showing a display state of the number of reflected images in the finder.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Optical system 2 Mirror 3 Shutter 4 Film 5a Penta prism 5b Optical system 5,50 Finder 7 Photographer 8,9 Subject 10 Image input part (image input means) 10a Optical system 10b Photoelectric conversion element 11a Illumination 11b Illumination 12 A / D Converter 13 Image memory 14 Reflected image extraction unit 15 Reflected image presence / absence determination unit 16, 31, 44, 51, Shutter control unit (shutter control unit) 17 Alarm output unit (alarm output unit) 18 Illumination light emission control unit 19, 32, 45, 52, 62 Overall control unit (overall control unit) 20 Shutter button 21 Eye-opening detection switch 41, 64 Reflected image number determination unit (fundus reflex image number determination unit) 42 Comparison unit (comparison unit) 43 Subject number input unit (subject Number input means) 61 Reflection image number display unit (fundus reflex image number display means)

Claims (7)

[Claims] 1. A coaxial system illumination which is connected to an image pickup device and which has an image inputting means comprising an optical system for imaging a fundus reflection image and a photoelectric conversion element and an optical axis of the optical system for imaging the fundus reflection image and an irradiation direction thereof coincide with each other. And illuminating means including a non-coaxial illumination provided at a non-coaxial position with the fundus reflection image pickup optical system, and image data of a subject by each illumination input by the image input means is stored. An image memory, a fundus reflection image extraction unit that extracts a fundus reflection image from the difference between the image data, and a fundus reflection image presence / absence determining unit that determines whether or not the fundus reflection image is included in the image data. And a shutter control means for controlling the drive of the shutter mechanism of the photographing device based on the judgment output from the fundus reflection image presence / absence judgment means, and an overall control means for controlling the respective means. When it is determined by the projection image presence / absence determining unit that the fundus reflection image is included in the image data, the drive of the shutter mechanism is permitted, and it is determined that the fundus reflection image is not included in the image data. In the case of the above, the eye-opening detection device for an imaging device, which is configured to prevent the drive of the shutter mechanism. 2. When the fundus reflection image presence / absence determining unit determines that the fundus reflection image is not included in the image data, it is determined that the fundus reflection image is included in the image data. The eye opening detection device for a photographing apparatus according to claim 1, wherein the overall control unit is configured to control the respective units and repeat the operation until the driving of the shutter mechanism is permitted. 3. A coaxial system illumination which is connected to a photographing device and which has an image inputting means composed of a fundus reflection image pickup optical system and a photoelectric conversion element, and an optical axis of the fundus reflection image pickup optical system and an irradiation direction thereof coincide with each other. And illuminating means including a non-coaxial illumination provided at a non-coaxial position with the fundus reflection image pickup optical system, and image data of a subject by each illumination input by the image input means is stored. An image memory, a fundus reflection image extraction unit that extracts a fundus reflection image from the difference between the image data, a fundus reflection image number determination unit that determines the number of fundus reflection images included in the image data, and the number of subjects to be captured in advance. The subject number input means for inputting, the comparing means for comparing the number of fundus reflection images determined by the fundus reflection image number determining means with a multiple of the number of subjects input from the subject number input means, and the photographing based on the comparison result. Device shuffle Shutter control means for controlling the drive of the shutter mechanism, and overall control means for controlling each means, wherein the shutter control means is the number of fundus reflection images determined by the number of fundus reflection image determination means in the comparison means and the shutter control means. When it is determined that the multiples of the number of subjects input from the number-of-subjects input unit match, the driving of the shutter mechanism is permitted, and the fundus determined by the number of fundus reflection image determination unit in the comparison unit When it is determined that the number of reflected images does not match a multiple of the number of subjects input from the subject number input means, the shutter mechanism is prevented from being driven. Eye-opening detection device for imaging devices. 4. When the comparison unit determines that the number of fundus reflection images determined by the number of fundus reflection images determination unit does not match a multiple of the number of subjects input from the subject number input unit, Is determined that the determined number of fundus reflection images and a multiple of the number of input subjects match, until the drive of the shutter mechanism is permitted, the overall control unit controls the respective units, The eye-opening detection device for an imaging device according to claim 3, wherein the device is configured to repeat the operation. 5. A coaxial system illumination which is connected to a photographing device and which has an image inputting means composed of an optical system for capturing a fundus reflection image and a photoelectric conversion element, and an optical axis of the optical system for capturing the fundus reflection image and an irradiation direction of which coincides with each other. And illuminating means including a non-coaxial illumination provided at a non-coaxial position with the fundus reflection image pickup optical system, and image data of a subject by each illumination input by the image input means is stored. An image memory, a fundus reflection image extraction unit that extracts a fundus reflection image from the difference between the image data, a fundus reflection image number determination unit that determines the number of fundus reflection images included in the image data, and a finder of the imaging device. An eye-opening detection device for a photographing device, comprising: a fundus reflection image number display means for displaying the number of fundus reflection images determined by 1. and an overall control means for controlling each means. 6. An alarm means for issuing an alarm, connected to the shutter control means, and configured to issue an alarm from the alarm means when the drive of the shutter mechanism is blocked. The eye-opening detection device for an imaging device according to 2, 3, or 4. 7. An eye opening detection switch connected to the overall control means, wherein the operation of the overall control means is selected by the eye opening detection switch. The eye opening detection device for an imaging device according to 4, 5, or 6.