JP4829186B2 - Imaging device - Google Patents

Description

The present invention relates to imaging equipment, more particularly, relates to an imaging equipment to perform photographing when the change of the object image.

In the case of self-photographing in which a photographer himself photographs as a subject, it is often used that a camera operator remotely controls the camera with a remote control device and shoots (see, for example, Patent Document 1). However, the remote control device has a problem that it is generally small and easily lost, and annoying that it must always be carried with the camera.

Therefore, Patent Document 2 discloses a digital camera that enables remote release without carrying a remote control device. The digital camera disclosed in Patent Document 2 is configured to detect a face image and perform shutter release when the face image is detected.

Japanese Patent No. 2790268 JP 2003-92700 A

According to the digital camera disclosed in Patent Document 2, it is freed from the hassle of having to carry a remote control device, but when a face image is detected, the camera shifts to the release operation of the camera. There are cases where the person (= subject) does not match the intended shutter timing.

That is, as a first problem, when performing self-photographing alone, the camera moves to the release operation even if the camera operator is not at the center of the screen. In order to eliminate this inconvenience, it can be considered that the camera is shifted to the release operation only when the camera operator is at the center of the screen. However, even with this configuration, it is necessary to adjust the position of the camera operator so that the camera operator enters the center position of the screen, which is very troublesome. As a second problem, when a plurality of persons perform self-photographing, a face image already exists in the screen, so that it does not function as a remote release.

This onset Ming has been made in view of such circumstances, even self-shooting alone, even self photographing a plurality of persons, the release by the shutter timing intended by the camera operator and an object thereof is to provide an imaging equipment having a remote release function can transition to the operation.

An imaging apparatus according to the first aspect of the present invention for achieving the above object, an imaging means for imaging an object image, in the image pickup apparatus having a, an image recording means for recording the output of the imaging means, the A face image detecting means for detecting an image corresponding to a person's face from the output of the imaging means; a face image change detecting means for detecting a change in the face image detected by the face image detecting means; Control means for operating the image recording means when the face image detection means detects the face image and the face image change detection means detects that the face image has changed. The image change detection means extracts the eyes from the face image detected by the face image detection means, measures the area of the white eye above and below the line connecting the eyes of both eyes of the face image, White eyes The first smile level obtained by normalizing the product difference with the sum is obtained, the lips are extracted from the face image detected by the face image detecting means, and the area of the lip above and below the line connecting the both ends of the mouth of the face image is extracted. A third smile obtained by measuring the area of the lips on the side, obtaining a second smile degree obtained by normalizing the difference between the areas of the upper and lower lips, and adding the first smile degree and the second smile degree. A change is detected by determining whether the degree is equal to or greater than a predetermined value.

In the imaging device according to a second aspect based on the first aspect, the face image change detecting means determines whether or not teeth can be seen in the mouth based on the face image detected by the face image detecting means. When a tooth is visible, a predetermined value is added to the third smile level.
In the imaging device according to a third aspect of the present invention, in the first aspect, the face image change detecting means is based on the face image detected by the face image detecting means, and whether or not there is a shadow at the mouth end. If it is determined that there is a shadow, a predetermined value is added to the third smile level.
Furthermore, in the imaging apparatus according to a fourth aspect of the present invention, in the first aspect, the face image change detection means determines whether there is a wrinkle between both eyes based on the face image detected by the face image detection means. If it is determined that there is a wrinkle, a predetermined value is subtracted from the third smile level.

According to the present invention, imaging with a remote release function capable of shifting to a release operation at a shutter timing as intended by a camera operator, whether for self-photographing by one person or for self-photographing by a plurality of persons. it is possible to provide the equipment.

Hereinafter, the preferred embodiments will be described using a digital camera to which the imaging equipment of the present invention with reference to the drawings. The digital camera according to the present embodiment converts a subject image into image data using an image sensor, and the image data is recorded on a recording medium when a release operation is performed. In addition, a face image can be detected from the image data, and it can also be detected that the face image has changed to a smile. In addition, the smile detection release mode can be selected together with the self-timer mode. When this mode is selected, image data is taken in when a change to smile is detected, and the image at this time is stored in the recording medium. Data is recorded. Shooting at this time is continuously performed a plurality of times, and flash irradiation is performed by a flash device.

FIG. 1 is a block diagram of a digital camera and its surroundings according to an embodiment of the present invention. The camera 100 includes a photographing lens 2, an AF (autofocus) control unit 2a, an aperture 2b, an aperture control unit 2c, an image sensor 3, and an analog front end (hereinafter abbreviated as AFE) unit 4. The taking lens 2 has a focus lens inside, and forms an image of the incident subject 15 on the image sensor 3.

The AF control unit 2a performs image processing in an image processing unit 5 to be described later, detects an in-focus position of the photographic lens 2, detects it by a so-called hill-climbing method, drives the focus lens, and moves it to the in-focus position. Note that the hill-climbing method is a method for detecting the in-focus position (focus position) from the contrast signal peak of the photographed image. In addition to the hill-climbing method, for example, a known focusing method such as a phase difference method or a triangulation method can be used. It may be replaced. When the in-focus position is reached by AF, the distance can be determined by detecting the photographing lens 2 at this time. In this case, when the photographing lens 2 is a zoom lens, the distance is determined in consideration of the zoom position and the like.

A diaphragm 2b that provides the effects of a shutter and a diaphragm is provided in or near the photographing lens 2. The diaphragm 2b is opened to a predetermined aperture at the time of photographing, and is closed when the exposure is finished to finish the exposure. The aperture control unit 2c drives the aperture 2b to set the aperture diameter. The image sensor 3 is a CCD or CMOS sensor having a large number of light receiving surfaces (pixels) and receives an image from the subject 15 via the photographing lens 2 and converts it into an image signal.

The analog front end (AFE) unit 4 includes analog-digital (AD) conversion means, and converts a signal from the image sensor 3 into a digital signal. The AFE unit 4 performs various processes on the image signal output from the image sensor 3. The AFE unit 4 is also provided with a function of reading several pixels of the image pickup device 3 together and reading them together. For example, when the signal level of each pixel is small, such as 4 pixels (2 × 2) and 9 pixels (3 × 3), several pixel signals can be added to improve the S / N. Sensitivity can also be increased.

The AFE unit 4 has a function of selecting signals output from the image sensor 3 and can extract image data in a limited range from the light receiving range. In general, when pixel signals thinned out from the pixels of the image sensor 3 are extracted, high-speed reading is possible. Thus, the image signal for composition confirmation is processed at high speed by the image processing unit 5 and displayed on the display unit 8 via the display control unit 8a, thereby enabling framing.

The output of the AFE unit 4 is connected to the image processing unit 5. The image processing unit 5 corrects the color, gradation, and sharpness of the input signal. Further, it has an intensifying unit that amplifies the image signal obtained from the image sensor 3 to a predetermined level and sets the correct gray level and the correct gray level. This is a digital operation so that the digitized signal level becomes a predetermined level.

In addition, the image processing unit 5 includes a resizing unit that processes a signal from the image sensor 3 into a size that can be displayed on the display unit 8 so that a live view image (also referred to as a through image) can be displayed on the display unit in real time. By this function, an image incident on the image sensor can be confirmed on the display unit 8 instead of the finder prior to photographing, and the timing and photo opportunity at the time of photographing can be determined while viewing this.

In addition, the image processing unit 5 has an image determination function for determining characteristics of an image input from the image sensor 3 by using a signal from the image processing unit 5. From the contour information obtained by processing the image information, a shape determination unit 5a that detects the shape of the object being imaged, and a face detection unit 5d that detects the position of the main subject by examining the characteristics of the image, etc. Included in the system. This is for optimizing the shooting control by determining what kind of photo the user is going to take when taking a photo. It becomes possible to do.

In addition, the image processing unit 5 is connected to a facial expression determination unit 5c that determines facial expression from a facial image obtained by the image sensor 3. The facial expression determination unit 5c can infer the subject's emotion, the atmosphere of the shooting scene, and the like. The image processing unit 5 has a function of determining the above-described image contrast, and performs autofocus control in conjunction with the focusing unit of the photographing lens. The distance of the subject, the distance of the background, and the like can be determined based on the information on the lens position when the photographing lens 2 is focused.

The camera 100 includes a compression unit 6, a recording unit 9a, a recording medium 9, a data transmission / reception unit 9c, a display unit 8, and a display control unit 8a. The compression unit 6 compresses the signal output from the image processing unit 5 at the time of shooting. The compression unit 6 includes MPEG (Moving Picture Experts Group) 4 and H.264. A compression unit for moving images composed of a compression core unit such as H.264 and JPEG (Joint
A still image compression unit such as a Photographic Experts Group) core unit is provided. The compression unit 6 also performs image expansion when reproducing the image recorded on the recording medium 9 on the display unit 8.

The recording unit 9 a records the compressed image signal on the recording medium 9. The recording medium 9 is a storage recording medium that can be attached to and detached from the camera. In recording the image signal, in addition to the compressed image data described above, accompanying data such as the shooting time is also recorded. The shooting time information is measured by a clock unit 1t in the MPU 1 described later, and the MPU 1 associates with the image.

The captured image data recorded on the recording medium 9 may be transmitted to the outside via the Internet or the like by the data transmitting / receiving unit 9c using a technology such as an IC card such as an RFID or a wireless data technology such as a wireless LAN. it can. The display unit 8 is composed of, for example, a liquid crystal or an organic EL, and a backlight such as a white LED is disposed on the back surface of the display unit 8. By irradiating the display unit 8 with light from the backlight, the visibility of the display unit 8 can be improved.

The camera 100 is provided with an auxiliary light emitting unit 11, an MPU (Micro Processing Unit) 1, a release switch 1a, a mode switch 1b, and another switch 1c. The MPU 1 is a control unit that controls the entire camera. A release switch 1a, a mode switch 1b, another switch 1c, and a ROM (not shown) storing a program and the like are connected to the MPU 1.

As described above, the MPU 1 is provided with the clock unit 1t for detecting the date and time, and detects the shooting date and time of the photograph and associates it with the captured image. Note that the switches 1a, 1b, and 1c are generically displayed switches, and actually include a large number of switch groups that are linked to a large number of operation members as shown in FIG.

Each switch 1a-1c detects a user's operation, and notifies the result to MPU1 which is a calculation control means consisting of a microcontroller. The MPU 1 switches the operation according to the operation of these switches. According to the operation of these switches, a shooting preparation operation and a shooting operation can be performed, and a setting mode of a self-timer and a smile release mode that is released when a smile is detected can be set.

The auxiliary light emitting unit 11 includes a white LED and a Xe discharge light emitting tube, and the amount of light can be controlled by the amount of current. Depending on the situation, the subject 15 is irradiated with light to prevent insufficient brightness or uneven brightness.

FIG. 2 is an external rear view of the digital camera according to the present embodiment. A TFT color liquid crystal monitor (hereinafter referred to as TFT) 20 is disposed on the back of the camera, and is a part of the display unit 8. At the top of the camera, a release button 21 that is linked to the switch 1a is arranged. A zoom button 22 for changing the focal length of the photographic lens 2 is disposed on the upper right side of the rear surface of the camera, and a rotary mode setting dial 23 is disposed below the zoom button 22.

The mode setting dial 23 can select and set a still image shooting mode, a playback mode, a camera shake reduction shooting mode, a moving image shooting mode, and the like. A cross-type cross key switch 24 is disposed below the mode setting dial 23. By operating each key part of the cross key switch 24, exposure correction setting, flash setting, self shooting mode setting, and macro shooting mode setting can be performed. Further, when the menu setting screen is displayed, the cursor can be moved by the operation of the key switch, and the menu hierarchy can be switched.

An index 25 provided at a position facing the triangular mark on the upper end portion side of the cross key switch 24 indicates an exposure correction setting position, and the exposure correction mode is set by operating the cross key switch 24 facing this position. . An index 26 provided at a position facing the triangle mark on the right end side of the cross key switch 24 indicates a flash setting position. By operating the cross key switch 24 facing this position, the flash emission mode is set. Be changed.

An index 27 provided at a position facing the triangular mark on the lower end side of the cross key switch 24 indicates a self shooting mode setting position. By operating the cross key switch 24 facing this position, the self shooting mode mode is set. It becomes. An index 28 provided at a position facing the triangular mark on the left end side of the cross key switch 24 indicates a macro shooting mode setting position. By operating the cross key switch 24 facing this position, the macro shooting mode is set. Be changed.

A menu button 29 is disposed on the upper left side of the cross key switch 24. When this menu button 29 is operated, a menu setting screen is displayed on the TFT 20. An OK button 30 is disposed at the center of the cross key switch 24. The OK button 30 is used as a confirmation key for determining a menu item or a transition key for transitioning to the function setting mode when the menu setting screen is displayed.

Next, the setting screen for the above-described self-timer shooting mode will be described with reference to FIG. This setting screen is a screen for selecting a smile detection release, which will be described in detail in the present embodiment. When the lower side of the cross key switch 24 is operated, as shown in FIG. The shooting mode is displayed.

First, when “cell timer / smile detection release off” is selected, both the self-timer shooting mode and the smile detection release mode are turned off. Selecting “Self-timer on” turns on the self-timer shooting mode. When “smile detection release on” is selected, the smile detection release mode is turned on. In FIG. 3, “cell timer / smile detection release off” is the cursor position, which is a default value.

Next, FIG. 4 shows a live view display of a subject image on the TFT 20 in a state where the smile detection release mode is selected. At the upper left of the display screen of the TFT 20 is a battery remaining amount display 40, at the lower left is an icon 41 indicating the smile detection mode, at the lower center is a photographic image quality 42, and at the lower right is a shootable number 43. It is displayed.

FIG. 4A shows a subject image before smiling, and FIG. 4B shows a smiling subject image. When the camera detects that the subject 15 is smiling, that is, detects that the subject 15 has changed from FIG. 4A to FIG. 4B, it automatically performs a release operation to acquire subject image data. Record. In the present embodiment, when the release operation is performed in this mode, the three-frame continuous shooting and the flash irradiation from the auxiliary light emitting unit 11 are performed.

In the present embodiment, the change in facial expression is converted into a numerical value R when detecting the change in facial expression of the subject 15. FIGS. 5A and 5B are diagrams showing human facial expressions. FIG. 5A shows a smiling state, and FIG. 5B shows a comparison of situations when troubled. Comparing the two, it can be seen that there are features in the eyes and mouth.

In other words, when the eyes are compared, it can be seen that if there are many white eyes above the line 61 connecting the centers of the eyes of both eyes, it is close to a smile. The mouth can also be determined based on the same concept. That is, if the area of the lower lip is larger than the line 62 connecting both ends of the mouth, the degree of smile increases.

A method of obtaining the smile level R using the determination method shown in FIG. 5 will be described based on the flowchart shown in FIG. Before entering this flow, based on the output of the image sensor 3, the face detection unit 5d detects the face, and the eyes and mouth are extracted from the detected face by pattern recognition. The mouth and eye are detected, which will be described later with reference to FIG.

When this flow is entered, the smile level is detected from the area of the white of the eye in steps S61 to S63. First, the area of the white eye above the line 61 connecting the eyes of both eyes is measured, and this value is set as EA (S61). Similarly, the area of the white eye below the line 61 is measured, and this value is defined as EB (S62). Next, the difference between EA and EB obtained in this way is normalized by the sum of these, that is, (EA−EB) / (EA + EB) is obtained to obtain a numerical value RE (S63). It is determined that the larger the numerical value RE, the higher the smile degree.

Next, in steps S64 to S66, the smile level is detected from the area of the lips. First, the area of the lips above the line 62 connecting both ends of the mouth is measured, and this value is set as LA (S64). Similarly, the area of the lips below the line 62 is measured, and this value is set to LB (S65). The difference between LA and LB thus obtained is normalized with the sum of these, that is, (LB−LA) / (LA + LB) is obtained to obtain a numerical value RL (S66). It is determined that the larger the numerical value RL, the higher the smile degree.

Subsequently, the smile level R is obtained by adding the values RE and RL obtained in steps S63 and S66 (S67). The larger the value R, the closer to smile. Furthermore, in order to improve the accuracy of determination of the smile level, the state near the arrow 64 in FIG. That is, it is determined whether or not teeth are visible in the mouth (S68), and if it is visible, the probability of smile is high, so 0.7 is added to the smile level R (S69). Further, it is determined whether a shadow is present in the mouth end (S70), if there is a shadow, there is a high smile probability, adding 0.3 to smile degree R (S 71).

However, if there is a wrinkle between the eyebrows, it cannot be said that it is a smile, so this is determined. That is, it is determined whether or not there is a wrinkle between the eyes in the vicinity of the arrow 65 in FIG. 5B (S72). As a result of the determination, when a wrinkle is detected between the eyebrows, one point is deducted from the smile level R (S73). In this way, the numerical value (R) can be obtained such that the closer to a smile, the higher the score.

In the present embodiment, the degree of smile is determined based on whether there are many white eyes above the line connecting the centers of the eyes of both eyes. However, the present invention is not limited to this. Good. That is, in FIG. 6, the position ET at the highest point of the heel with respect to the width EH of the heel is obtained, and the smile degree can also be obtained by the ratio ET / EH. When ET / EH increases, it becomes close to a smile, and when this ratio decreases and the inclination of the upper eye increases, it tends to move away from the smile.

Next, the operation of the digital camera 100 according to the present embodiment will be described using the flowcharts shown in FIGS. When the power source of the camera 100 is turned on, the MPU 1 of the camera 100 starts processing of the program shown in FIG. First, it is determined whether the mode dial 23 of the camera is set to the shooting mode or the playback mode (S2).

If the result of determination is that playback mode has been set, the routine jumps to a playback processing routine (not shown) (S3). On the other hand, when the photographing mode is set, the lens frame initial operation, that is, after the lens frame of the photographing lens 2 is extended to a predetermined initial position, the lens for focus adjustment is extended to the initial position ( S4).

Subsequently, the display of the TFT 20 is turned on (S5), and the operation of the imaging system is started (S6). Thus, live view display is performed on the TFT 20 based on the image data of the subject image acquired by the image sensor 3. Next, it is determined whether or not an operation input has occurred (S7). This is to determine whether or not a switch linked to the zoom button 22, the mode setting dial 23, or the like has been operated.

If there is no operation input as a result of the determination, it is subsequently determined whether or not a predetermined time has passed without any operation input (S8). As a result of the determination, if the predetermined time has not elapsed, the process returns to step S7, and this determination is repeated. On the other hand, if the predetermined time has elapsed, the process shifts to a sleep mode that is an energy saving mode (S9).

If there is an operation input in step S7, it is determined whether the operation input is under the cross key (S10). This is to determine whether or not the cross key switch 24 on the index 27 side indicating the self-photographing setting position has been operated. If the result of determination is that other operation input has been made, this is not shown. The process proceeds to another operation input process (S11). On the other hand, if the result of determination is Yes, the self-menu display shown in FIG. 3 is displayed on the TFT 20. The initial state of the cursor position is “self-timer / smile detection release off” as described above.

Subsequently, in order to determine which mode is selected in the self-menu display, a key determination subroutine is called (S13). Details of this subroutine will be described later with reference to FIG. If the mode is determined by operating the OK button 30 in the key determination subroutine, the process proceeds to step S14.

In step S14, it is determined whether or not the smile detection release mode is selected. If the result of determination is not smile detection release mode, processing proceeds to other mode processing (S15). On the other hand, if it is in the smile detection release mode, a face detection subroutine is called (S16). Details of the face detection subroutine will be described later with reference to FIG.

Next, in the face detection subroutine, it is determined whether or not the release transition OK is determined (S17). In the smile detection subroutine called in the face detection, the smile level R is obtained, and the process returns to step S17 (S48, S50). If it is determined in step S17 that the smile level R has not been determined to be OK in step S47, the process shifts to the sleep mode as in step S9 (S19).

On the other hand, if the smile level R is at the level at which release OK is determined in step S47, the process proceeds to the shooting sequence, white balance adjustment, focus adjustment, and exposure are performed, and image data acquired by the image sensor 3 is acquired. Is recorded on the recording medium 9 (S18). Details of this imaging sequence will be described later with reference to FIG.

The overall control of the digital camera 100 is performed as described above. Next, the key determination subroutine in step S13 will be described with reference to FIG. When the key determination subroutine starts, it is first determined whether or not the OK button 30 has been operated (S31). If the OK button 30 has been operated, the process returns to the original routine (S32). That is, when the OK button 30 is operated, any mode is selected and confirmed in the self menu.

If the result of determination in step S31 is that the OK button 30 has not been operated, it is next determined whether or not the cross key switch 24 has been operated (S33). If the result of determination is that it has not been operated, the operation jumps to step S35, while if it has been operated, the cursor on the menu is moved up and down in the direction in which the cross key switch 24 has been operated. (S34).

Subsequently, it is determined whether or not the menu button 29 has been operated (S35). As a result of the determination, if operated, the cursor movement is canceled and a shooting standby state is entered (S36). On the other hand, if it has not been operated, it is determined whether or not a predetermined time has passed without any operation input (S37). If the predetermined time has not elapsed as a result of the determination, the process returns to step S31, whereas if the predetermined time has elapsed, the process shifts to the sleep mode (S38).

Next, the face detection subroutine in step S16 (see FIG. 6) will be described with reference to FIG. When this subroutine starts, first, the eyes, nose, and mouth, which are parts constituting the face, are detected from the image captured by the image sensor 3 (S41 to S43). Subsequently, data collation is performed (S44).

In this data collation, the face database stored in the MPU 1 is collated, the degree of correlation is calculated, and when the degree of correlation is high, the captured image includes a face, and when the degree of correlation is low, imaging is performed. It is assumed that no face is included in the obtained image. Note that the face database stores general eye, nose and mouth shapes and mutual positional relationships as a database.

Then, based on the data collation in step S44, it is determined whether a face has been detected (S45). If the face is not detected as a result of the determination, the process jumps to step S49. On the other hand, when a face is detected, a smile detection subroutine is called (S46). The smile detection subroutine is as described above with reference to FIG. 9, and the numerical value R obtained by quantifying the smile is obtained in this subroutine.

When the smile detection subroutine of step S46 ends, it is subsequently determined whether or not the numerical value R is equal to or greater than a predetermined value (S47). If the result of determination is greater than or equal to the predetermined value, processing returns to the original routine (S48). On the other hand, if the result of determination is that the numerical value R is less than the predetermined value, it is determined whether or not a predetermined time has elapsed (S49). As a result of the determination, if the predetermined time has not elapsed, the process returns to step S41. On the other hand, if the predetermined time has elapsed, the process returns to the original routine (S50).

Next, the shooting sequence subroutine in step S18 (see FIG. 6) will be described with reference to FIG. When this subroutine starts, it is determined whether or not the camera has shifted to shooting in the smile detection release mode (S81). If the result of determination is that shooting has shifted to a mode other than the smile detection release, the mode shifts to another shooting mode (not shown) (S82).

On the other hand, as a result of the determination, when the mode is shifted to the smile detection release mode, the flash mode is set to the forced light emission mode (S83). As a result, the flash is always emitted at the time of exposure, so that the subject can easily determine whether or not the photograph has been taken, and there is no suspicion as to whether or not a smile has been detected during the photographing.

Next, subject luminance is measured based on the output of the image sensor 3 (S84). Based on this, an exposure control value for controlling the diaphragm 2b can be determined. Subsequently, the subject is focused (S85). Here, as described above, the AF control unit 2a focuses the photographing lens 2 based on the contrast signal detected by the image processing unit 5.

Thereafter, three frames are photographed while synchronizing the flash (S86 to S88). In the present embodiment, since three-frame shooting is performed, it is possible to record including a process of changing a smile, and it is possible to reliably record a smile. When the exposure is finished, subsequently, the photographed image data of the three frames is recorded on the recording medium 9 (S89). When recording is completed, the camera enters a shooting standby state (S90).

As described above, according to the present embodiment, since it is configured to detect a smile and shift to the release operation, the camera operator can perform the self-photographing of one person or the self-photographing of a plurality of persons. It is possible to provide an imaging device having a remote release function that can shift to a release operation at the shutter timing as intended.

Also, even when a smile cannot be intentionally made like a baby, it is possible to make a smile without effort. Furthermore, after detecting a smile and moving to the release operation, the subject performs shooting synchronized with the flash, so that the subject can easily determine whether or not the current smile has been detected. Never become a suspicion demon. Furthermore, since three frames are shot after the release operation is shifted, it is possible to record including the process of changing the smile, so that the smile can be recorded reliably.

In the present embodiment, a smile is detected as the change in the subject image, and the release is performed to record the image data. However, in addition to the smile, the facial expression changes and the body such as the face and hands. It is also possible to detect a part of the movement and start shooting. In addition, the flash is synchronized when shooting in the smile detection release mode, and the shooting is notified to the subject. As a means for this, in addition to the flash, a visual display such as an LED or an auditory display such as a sound can be used. Of course it is good. Furthermore, in this embodiment, when a smile is detected, continuous shooting of three frames is performed, but it is needless to say that the number of frames may be changed as appropriate. Furthermore, the number of continuous shots is not limited to a fixed number of frames. For example, smile detection is continued during continuous shooting, and continuous shooting is continued while smiling is detected. May be terminated.

In the description of the present invention, an example in which the imaging apparatus is applied to a digital camera has been described. However, the digital camera can be applied to various digital cameras such as a compact camera and a single-lens reflex camera. In addition to a normal digital camera, the present invention can also be applied to various imaging devices such as a built-in camera such as a mobile phone or a PDA.

1 is a block diagram of a camera and its surroundings according to an embodiment of the present invention. It is an external appearance rear view of the camera concerning one embodiment of the present invention. It is a figure which shows the display screen of a self menu in the camera concerning one Embodiment of this invention. FIG. 6 is a diagram showing a live view display of a subject image on the TFT 20 in a state where a smile detection release mode is selected in the camera according to an embodiment of the present invention, where (A) shows a normal subject image and (B ) Indicates a smiling subject image. In one Embodiment of this invention, it is a figure which compares the smile of a to-be-photographed object and a troubled face, (A) shows a smile, (B) shows a troubled face. 6 is a flowchart showing a power-on operation in the camera according to the embodiment of the present invention. It is a flowchart which shows the operation | movement of the key judgment in the camera which concerns on one Embodiment of this invention. It is a flowchart which shows the operation | movement of the face detection in the camera which concerns on one Embodiment of this invention. It is a flowchart which shows the operation | movement of the smile detection in the camera which concerns on one Embodiment of this invention. It is a flowchart which shows the operation | movement of the imaging | photography sequence in the camera which concerns on one Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... MPU, 1a ... Release switch, 1b ... Mode changeover switch, 1c ... Other switch, 1t ... Clock part, 2 ... Shooting lens, 2a ... AF (automatic Focus) control unit, 2b ... aperture, 2c ... aperture control unit, 3 ... imaging device, 4 ... analog front end (AFE) unit, 5 ... image processing unit, 5a ... Shape determination unit, 5c ... facial expression determination unit, 5d ... face detection unit, 6 ... compression unit, 8 ... display panel, 8a ... display control unit, 9 ... recording medium, 9a ... Recording unit, 9c ... Data transmission / reception unit, 11 ... Auxiliary light emitting unit, 15 ... Subject, 20 ... TFT color liquid crystal monitor, 21 ... Release button, 22 ... Zoom Button, 23... Mode setting dial, 24. Indicator (exposure correction setting position), 26 ... Indicator (flash setting position), 27 ... Indicator (self-shooting setting position), 28 ... Indicator (macro shooting setting position), 29 ... Menu button , 30 ... OK button, 40 ... Battery remaining amount display, 41 ... Smile detection mode icon, 42 ... Shooting image quality display, 43 ... Number of shootable images, 61 ... Line (pupil) Connecting line), 64... Arrow (mouth), 65... Arrow (between eyebrows), 100.

Claims (4)

Imaging means for capturing a subject image;
Image recording means for recording the output of the imaging means;
In an imaging apparatus comprising:
A face image detecting means for detecting an image corresponding to a human face from the output of the imaging means;
A face image change detecting means for detecting a change in the face image detected by the face image detecting means;
Control means for operating the image recording means when the face image is detected by the face image detection means and when the face image change detection means detects that the face image has changed ;
Have
The face image change detecting means is
Eyes are extracted from the face image detected by the face image detecting means, the area of the white eye above and below the line connecting the pupils of both eyes of the face image is measured, and the difference between the areas of the upper and lower white eyes Find the first smile level normalized by sum
Extract the lips from the face image detected by the face image detection means, measure the area of the lips above and below the line connecting the ends of the mouth of the face image, the difference between the areas of the upper and lower lips Find the second smile level normalized by sum
A change is detected by determining whether or not a third smile degree obtained by adding the first smile degree and the second smile degree is a predetermined value or more;
An imaging apparatus characterized by that. The face image change detecting means determines whether or not teeth are visible in the mouth based on the face image detected by the face image detecting means, and if teeth are visible, sets a predetermined value for the third smile degree. The imaging apparatus according to claim 1, wherein addition is performed . The face image change detecting means determines whether or not there is a shadow on the mouth edge based on the face image detected by the face image detecting means, and if it is determined that there is a shadow, the third smile The imaging apparatus according to claim 1 , wherein a predetermined value is added each time . The face image change detecting means determines whether or not there is a wrinkle between both eyes based on the face image detected by the face image detecting means. If it is determined that there is a wrinkle, the third smile degree The imaging apparatus according to claim 1, wherein a predetermined value is subtracted .