JP2006087083A - Imaging device, and control method of imaging device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device such as a digital camera which gives an alarm to a user when an unintended picture is photographed, and can perform re-photographing automatically or by intention of the user. <P>SOLUTION: When an imaging condition of a photographing object is not suitable by detecting the photographing object in the image data photographed, and discriminating the imaging condition of the photographing object, the device gives an alarm to the user by displaying the image attached with an alarm content which suggests the fact in an electronic view finder, or by other measures. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to control for capturing an optimal image in an imaging apparatus such as a digital camera or a digital video camera.

  In an imaging apparatus such as a digital camera or a digital video camera, as a function for confirming a captured image, there is a REC review function for displaying an image taken immediately after imaging on a liquid crystal display in the imaging mode.

  In the playback mode, there is a function for sequentially displaying images taken in response to a user operation. When using the above functions in a digital camera, digital video camera, etc., the electronic viewfinder (hereinafter referred to as EVF), which is a liquid crystal used for confirming the captured image, has a small screen size and reduces the captured image. It is often displayed.

  Therefore, even if the subject's eyes are closed, the eyes are red, the brightness of the subject's face is too high, or the subject is not in focus, the subject cannot be captured. When it is small, it is difficult to confirm such a situation.

  For this reason, these image pickup apparatuses have a function of confirming an image after enlarging the image by a button operation by the user.

  However, it is troublesome to enlarge the image every time it is taken. Therefore, even if there is a defect in the photographed image and an attempt is made to redo the photographing, there is a high possibility that the composition of the subject has changed during the operation.

  In addition, some users do not check the image every time one image is taken, but may use the method of checking the picked-up images collectively after taking a plurality of images.

  In this case, after a while has passed since the first image was photographed, it was noticed that the intended photographing was not performed. Also in this case, there is a high possibility that the composition of the subject has changed during the operation even if there is a defect in the captured image and an attempt is made to redo the shooting.

  Therefore, there is a demand for a function that can immediately determine the success or failure of imaging without requiring the user to bother to enlarge the image.

For example, an ID photo system has been proposed that detects the position of a subject's face and eyes, automatically eliminates images that are not suitable as output photos such as blinking, and can always output the best image ( Patent Document 1).
JP 2000-292853 A

  Japanese Patent Application Laid-Open No. 2004-133620 detects an eye position of a subject, determines the state of the eye, and captures an image only when the pupil is open.

  Such a method is effective when it is assumed that one subject is an object to be imaged and the eyes are open like an ID photo.

  However, when using a general digital camera, digital video camera, or the like in which the user captures images at an arbitrary timing, the user may capture a state where the eyes are closed, and the processing is uniquely performed according to the state of the subject. The method of deciding is not preferable.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an imaging apparatus or an imaging method that makes it possible to easily capture an optimal image.

  In order to solve the above problems and achieve the object, an imaging apparatus according to the present invention includes subject detection means for detecting a subject region from image data captured in accordance with an instruction from a user, and the captured image data. Based on the detection result of the signal processing means for generating the display image data, the display means for displaying the display image data processed by the signal processing means, and the detection result of the subject detection means Determining means for determining whether or not, and notifying means for giving a warning according to the determination result of the determining means, the control unit automatically changes the control parameters of the imaging unit according to the content of the warning Then, the imaging apparatus is configured to cause the imaging unit to capture an image.

  In order to solve the above problems and achieve the object, the control method of the imaging apparatus of the present invention is a subject detection method for detecting a subject for detecting a subject area from image data captured in accordance with an instruction from a user. A signal processing step for generating display image data based on the captured image data, a display step for displaying the display image data processed in the signal processing step, and a subject detection step. Based on the detection result, it has a determination step for determining whether or not to warn, and a notification step for performing warning according to the determination result of the determination means, the control unit according to the content of the warning, A control method for an image pickup apparatus, wherein a control parameter of an image pickup unit is automatically changed and the image pickup unit picks up an image.

  According to the present invention, at the time of imaging with a digital camera, a digital video camera, or the like, the state of the subject is determined by image processing, and re-imaging according to the determination result, or a warning that prompts re-imaging is performed, It is possible to easily take an optimal image.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 shows the configuration of the imaging apparatus 20 in the present embodiment. Here, a digital camera will be described as an example of the imaging device.

  In the figure, reference numeral 1 denotes a control unit that controls signals for controlling each function of the imaging apparatus 20.

  2 is a solid-state imaging device such as a CCD or CMOS having a photoelectric conversion function, an imaging optical system for guiding subject light to the solid-state imaging device, a light amount adjusting member including a diaphragm or a shutter for adjusting the amount of light reaching the solid-state imaging device, And an imaging unit having an AGC (auto gain controller) for adjusting the gain of the output signal of the solid-state imaging device.

  Reference numeral 3 denotes an image processing unit that receives a signal output from the imaging unit 2 and performs signal processing such as known color correction processing and luminance correction processing to generate image data.

  An image storage buffer 4 stores the image data generated by the image processing unit 3.

  Reference numeral 5 denotes a signal conversion unit that reads out image data stored in the image storage buffer 4 and converts the image data into image data obtained by thinning out the data amount.

  A face detection unit 9 detects a human face from the image data using the image data stored in the image storage buffer 4.

  A determination unit 8 determines whether or not the face of the person detected by the face detection unit 9 satisfies a predetermined condition.

  Reference numeral 6 denotes an image generation unit that synthesizes the image data generated by the signal conversion unit 5 and the warning display according to the determination result of the determination unit 8.

  A display unit 7 converts the output of the image generation unit 6 into an analog signal by a D / A converter (not shown) and displays the analog signal.

  Reference numeral 10 denotes a recording unit such as a flash memory in which image data temporarily stored in the image storage buffer 4 is finally stored.

  FIG. 2 is a flowchart for explaining the flow of processing in the present embodiment. The operation will be described below with reference to this flowchart.

  This flowchart is described from the processing after the control unit 1 gives an instruction to record the captured image data when the release switch (not shown) of the camera is operated by the user.

  In step S101, the imaging unit 2 performs an exposure operation on the solid-state imaging device so as to follow the set exposure value, and adjusts the gain of the output signal of the solid-state imaging device.

  In step S102, the image processing unit 3 processes the signal output from the imaging unit 2 to generate image data.

  In step S103, the control unit 1 records the image data generated in S102 in the image accumulation buffer 4. The process of the next step S104 and the processes of steps S105 and S106 are performed on the image data recorded in the image storage buffer 4 in parallel.

  In step S <b> 104, the signal conversion unit 5 generates display image data having a smaller resolution than the image data stored in the image storage buffer 4.

  The reason for converting to display image data with a small resolution is that the resolution that can be displayed is limited due to the performance of EVF, and handling high-resolution image data causes an increase in processing time, so the data is thinned out. This is because conversion to an image with a small resolution reduces the amount of data to be handled and speeds up the processing.

  In step S105, the face detection unit 9 performs face detection described later from the image data stored in the image storage buffer 4 in S103.

  In step S106, the determination unit 8 determines whether the eyes of the face detected by the face detection unit 9 are closed. In the present embodiment, a warning is given when it is determined that the subject has closed eyes. Here, the reason why the process of step S104 and the processes of steps S105 and S106 are performed separately will be described. Since the display image data generated in step S104 has a low resolution, if the determination unit 8 tries to make a determination using the display image data, the determination may fail, particularly when the subject is small. Therefore, in steps S105 and S106, it is determined whether or not the eyes are closed by using image data having a resolution higher than that of the display image data, as compared with the case where the display image data is used. Can improve the accuracy. In order to increase the determination speed, a determination image having a resolution higher than that of the display image data generated in step S104 but a resolution lower than that of the image data stored in the image storage buffer 4 in step S103. Data may be generated, and face detection and blinking determination may be performed from now on.

  In step S107, if it is determined in step S106 that it is necessary to give a warning, the image generation unit 6 generates new image data by combining the image data generated in step S104 with a warning display. Output. If it is determined in step S106 that there is no need to issue a warning, the image generation unit 6 outputs the image data generated in step S104 as it is.

  In step S108, the display unit 7 receives the output from the image generation unit 6 and displays it.

  In step S109, it is determined whether or not it is determined in step S106 that the subject has closed eyes. If it is determined that the subject does not have eyes closed, the process proceeds to step S110, where the image data stored in the image storage buffer 4 is recorded on a recording medium such as a flash memory, and this flow ends.

  If it is determined in step S109 that the subject has closed eyes, the control unit 1 holds the control parameters of the imaging unit 2 such as the flash light amount, imaging sensitivity, shutter speed, and the like, and drives the imaging unit 2 again. Then, the process returns to step S101 to perform the exposure operation for the solid-state imaging device. Alternatively, the control unit 1 performs the focus adjustment operation and the photometry operation again to set a new control parameter of the image pickup unit 2, and then drives the image pickup unit 2 again to perform the exposure operation to the solid-state image pickup device. Return to S101.

  If it is determined in step S109 that the subject has closed eyes, the process proceeds to step S111, and the control parameters of the imaging unit 2 such as the exposure amount, the flash light amount, and the shutter speed are changed.

  The reason why the control parameter is changed in step S111 is that there is a possibility that the situation of the imaging scene has changed from the initial imaging performed due to the time change.

  If the control unit 1 has changed the control parameter of the image pickup unit 2 in step S111, the control unit 1 sets the changed control parameter, returns to step S101, and drives the image pickup unit 2 again to drive the solid-state image sensor. The exposure operation is performed.

  Next, the face detection process performed by the face detection unit 9 will be described.

  As a typical face detection method, a method using learning typified by a neural network, a part having a characteristic shape such as an eye, nose or mouth is searched from an image region using template matching, and if the similarity of the shape is high Many methods have been proposed, such as a method that considers a face, a method that detects image features such as skin color and eye shape, and uses statistical analysis. In general, the face detection is performed by combining a plurality of these methods.

  Specifically, a face detection method using wavelet transform and image feature amount described in JP-A No. 2002-251380 is cited.

  Here, a method of performing face detection by performing template matching from color information and a characteristic shape of eyes will be described.

  FIG. 3 is a diagram illustrating an example of the face detection method and the eye state determination method according to the present embodiment. FIG. 4 is a flowchart for explaining the face detection method in this embodiment. The operation will be described below with reference to this flowchart.

  In step S401, the face detection unit 9 extracts a skin color region from the target image data.

  FIG. 5 is a chromaticity diagram showing representative colors in the color space of CIELab, and an area indicated by an ellipse is an area that is likely to be a skin color.

  FIG. 3A is a diagram showing image data to be subjected to face detection.

  FIG. 3b is a diagram showing an area extracted from the image shown in FIG. 3a which is the chromaticity of the skin color area.

  In step S402, the face detection unit 9 applies, for example, a high-pass filter to the image that is the target of face detection.

  FIG. 3c is an example of an image obtained by applying a high-pass filter to the image shown in FIG. 3b.

  In this embodiment, the face detection unit 9 detects characteristic parts of the face such as eyes, nose, mouth, and eyebrows from the extracted skin color area, and excludes skin color areas other than the face.

  In step S403, as shown in FIG. 6, template matching is performed on the area detected in step S402 using template data of eyes recorded in advance in a memory in the imaging device (imaged with template data). The image data is compared to verify whether there is a match or approximation, and eyes are detected in the captured image data.

In step S404, the face detection unit 9 compares the eye image data detected in step S403 with the eye position detected by template matching.
As a result of the comparison, when the degree of opening of the eyes is not sufficient, when only one eye is detected, or when both eyes cannot be detected, it is determined that the eyes of the subject are closed, and this flow ends.

  FIG. 7 is a diagram showing a state where a warning is displayed on the screen that the subject has closed his eyes.

  When the subject closes his / her eyes in this way, the image generation unit 6 can synthesize a character and an icon on the screen and display them in an easy-to-understand manner.

  It should be noted that the method of issuing a warning is not limited to this, and it is needless to say that the warning can be replaced by blinking or lighting an LED or the like.

  The user can know that imaging is immediately performed again on the spot when the warning is issued.

  In the above flowchart, the imaging is automatically performed again when the subject closes his eyes. However, the present invention is not limited to this.

  Since it is also assumed that the scene that the determination unit 8 determines to be inappropriate, such as a scene in which the subject is winking, it is assumed that re-imaging after issuing a warning is performed. It may be left to the user.

  By pressing a selection button (not shown), it may be configured such that re-imaging is automatically performed or the user is allowed to select.

  If the user determines whether or not re-imaging is necessary when a warning is issued, the user should determine whether or not to re-capture the image immediately in consideration of the composition of the image displayed on the EVF. Can do.

  Since the image displayed on the EVF has a low resolution, it may be difficult to determine whether or not the subject has closed eyes. It is possible to know with certainty, and it is possible to redo the imaging before the composition of the subject is largely changed.

  As a result, the composition of the image and the state of the subject's eyes can be compared, and the user can freely select whether or not to perform imaging again.

  In this embodiment, the parameter is changed when the re-shooting is performed as a result of the warning. However, the time from the shooting immediately before the image data used as the basis of the warning determination is obtained. If a predetermined time or more has passed, the photometric operation or the distance measuring operation may be performed again to newly set the control parameters of the imaging unit 2.

  Next, a modification of the first embodiment will be described.

  In this modification, face detection is performed before a release switch (not shown) of the camera is operated by the user. A shooting mode in which the user can monitor the subject on the display unit 7 from a point in time before the release switch is operated by the user will be described as an example with reference to the flowchart of FIG.

  When a mode for taking a still image is set in the camera, in step S1101, the imaging unit 2 performs an exposure operation on the solid-state imaging device in order to obtain image data for the user to monitor the subject. The gain of the output signal of the image sensor is adjusted.

  In step S1102, the image processing unit 3 processes the signal output from the imaging unit 2 to generate image data.

  In step S1103, the control unit 1 records the image data generated in S1102 in the image storage buffer 4.

  In step S <b> 1104, the signal conversion unit 5 generates display image data having a smaller resolution than the image data stored in the image storage buffer 4.

  In step S1105, the face detection unit 9 performs face detection from the image data stored in the image storage buffer 4 in S1103. This process is the same as the process in step S105 shown in FIG.

  In step S1106, the coordinates of the area where the detected face exists are recorded.

  In step S1107, a frame corresponding to the coordinates recorded in step S1106 is generated, and new image data is generated by combining this frame with the image data generated in step S1104.

  In step S1108, the display unit 7 performs display using the new image data. Thus, the user can recognize which area the camera detects as a face and which area is subjected to focus adjustment and exposure control preferentially. The camera weights the image data of the area where the face exists, performs focus adjustment and control of the aperture value, and sets the exposure time.

  In step S1109, it is determined whether or not a release switch (not shown) of the camera has been operated by the user. If not operated, the process returns to step S1101, and if operated, the process proceeds to step S101.

  In step S101, the imaging unit 2 performs an exposure operation on the solid-state image sensor, and adjusts the gain of the output signal of the solid-state image sensor.

  In step S102, the image processing unit 3 processes the signal output from the imaging unit 2 to generate image data.

  In step S103, the control unit 1 records the image data generated in S102 in the image accumulation buffer 4. The process of the next step S104 and the process of step S106 are performed in parallel on the image data recorded in the image storage buffer 4.

  In step S <b> 104, the signal conversion unit 5 generates display image data having a smaller resolution than the image data stored in the image storage buffer 4.

  In step S106, the determination unit 8 determines from the image data stored in the image storage buffer 4 whether a pair of eyes exists in the area corresponding to the coordinates recorded in step S1106. The determination unit 8 determines that the subject's eyes are closed when there is no pair of eyes, and issues a warning.

  In step S107, if it is determined in step S106 that it is necessary to give a warning, the image generation unit 6 generates new image data by combining the image data generated in step S104 with a warning display. Output. If it is determined in step S106 that there is no need to issue a warning, the image generation unit 6 outputs the image data generated in step S104 as it is.

  In step S108, the display unit 7 receives the output from the image generation unit 6 and displays it.

  In step S109, it is determined whether or not it is determined in step S106 that the subject has closed eyes. If it is determined that the subject does not have eyes closed, the process proceeds to step S110, where the image data stored in the image storage buffer 4 is recorded on a recording medium such as a flash memory, and this flow ends.

  If it is determined in step S109 that the subject has closed eyes, the control unit 1 holds the control parameters of the imaging unit 2 such as the flash light amount, imaging sensitivity, shutter speed, and the like, and drives the imaging unit 2 again. Then, the process returns to step S101 to perform the exposure operation for the solid-state imaging device. Alternatively, the control unit 1 performs the focus adjustment operation and the photometry operation again to set a new control parameter of the image pickup unit 2, and then drives the image pickup unit 2 again to perform the exposure operation to the solid-state image pickup device. Return to S101.

  As described above, the position of the face is detected from the image data before the instruction to record the captured image data is issued from the user, and it is determined whether or not the eyes are closed based on the coordinates. Good.

(Second Embodiment)
Next, another embodiment of the present invention will be described. A description will be given centering on differences from the first embodiment.

  In the present embodiment, whether or not a red-eye phenomenon has occurred in the subject is used as a criterion for warning.

  As is well known, the red-eye phenomenon is known when a person is imaged under low illuminance conditions. The strobe device emits light to capture the image, but the flash emitted from the strobe device reflects off the back of the person's eyeball. This is a phenomenon in which a person's eyes appear red.

  The determination unit 8 in the present embodiment determines whether or not red eyes are generated on the face detected by the face detection unit.

  FIG. 9 is a flowchart for explaining the flow of processing in this embodiment.

  Hereinafter, the operation will be described with reference to this flowchart.

  In FIG. 2, it is determined that red eyes are detected from the face area detected from the image data stored in the image storage buffer 4 to determine whether or not there is a warning (steps S105 and S201), and that the warning is performed. The difference is that the control parameter of the imaging unit 2 forcibly changing the amount of flash light is forcibly changed (step S202).

  In the red eye detection, first, the face detection unit 9 detects an eye from image data by the same processing as steps S401 to S404 in FIG. The determination unit 8 examines the hue of the area detected as the eye, detects the average hue of the image position of the eye, and determines that the red eye is generated when the red component is equal to or greater than the set threshold value.

  The determination unit 8 determines whether or not to warn the user based on the result of this red-eye detection and the imaging conditions such as the flash emission amount at the time of imaging, the ambient brightness, imaging sensitivity, and shutter speed. I do.

  As a specific determination method, if the brightness of the subject to be photographed is dark and a large amount of flash is emitted, the possibility of red eyes increases, so the determination of red eyes is established. Increase (that is, lower the threshold value of the red eye component).

  On the contrary, when the flash emission is not performed, it is not necessary to consider the result of the face detection output by the face detection unit 9 and it is possible to perform high-speed and high-accuracy by performing control so as not to perform the red-eye warning. High judgment is possible.

  FIG. 10 is a diagram showing a state where a warning is given by displaying on the screen that the eye is red.

  In this way, when the image is red-eye, the image generation unit 6 can give a warning to the user in an easy-to-understand manner by synthesizing and displaying characters and icons on the screen.

  Needless to say, a warning may be given by blinking or lighting a voice or LED.

  When the warning is issued, the process proceeds to step S202, and the control parameter of the imaging unit 2 relating to the flash light amount is changed.

  Specifically, by increasing the lighting time of the red-eye mitigation lamp, increasing the light amount of the red-eye mitigation lamp, or changing the flash light emission amount, the control unit 1 is less likely to cause the red-eye phenomenon. As described above, the control parameters of the imaging unit 2 are changed.

  If the control parameter of the imaging unit 2 is changed in step S202, the control unit 1 sets the changed control parameter, returns to step S101, drives the imaging unit 2 again, and solid-state imaging device. The exposure operation is performed.

(Third embodiment)
Still another embodiment of the present invention will be described. In the second embodiment, whether or not the red-eye phenomenon has occurred is used as a criterion for warning. In this embodiment, whether or not the face area of the subject is in focus or whether or not it is blurred is determined. This is a warning criterion.

  The determination unit 8 in the present embodiment determines the state of blurring or the in-focus state detected by the face detection unit.

  In general, there are blurred images and images that are not in focus as images that are not suitable for shooting.

  In addition, there are camera shakes that cause the camera to move when the shutter is pressed, and camera shakes that occur because the subject has moved.

  Both of them often move in a certain direction of the image area. For example, when it is determined that there are many specific frequency components that do not exist in a normal image by using Fourier transform or the like as a frequency analysis method. There is a technique for detecting blurring.

  As a method of detecting that there is no focus, there is a method of performing a frequency analysis in the same manner as the shake detection method and determining that there is no focus when there are few high-frequency components.

  FIG. 11 is a flowchart for explaining the flow of processing in this embodiment.

  9 differs from FIG. 9 in that the face detection unit 9 detects the face area from the image data stored in the image storage buffer 4 and determines the in-focus state of the detected face area (steps S105 and S301). ing.

  If a warning is issued, the control parameters of the imaging unit 2 such as the shutter speed and sensitivity are forcibly changed in step S202.

  In order to prevent blur, the exposure time is shortened (shutter speed is increased), and this is compensated by the aperture value and sensitivity.

  According to the present embodiment, it is possible to capture a suitable image by detecting a situation where the image is blurred or out of focus, and alerting the photographer to that effect.

  In the above-described embodiment, the case where the subject is a person and it is detected that the eyes are closed, the case where the red eyes are detected, or the case where it is blurred is described as an example. However, the present invention is not limited to these.

In addition, if the image processing is performed to detect the characteristics of the subject from the image data and the presence or absence of a warning is displayed according to the detection result, or if re-photographing is performed automatically, a criterion for deficiencies in the image data May be other than the above.
If the subject that is the main subject is discriminated and the problem that has occurred in the main subject is that the displayed captured image data is small and the user cannot visually recognize it, the present invention can be freely used. Can be applied.

  By satisfying the above-described configuration, even if there is a defect in the image data that cannot be confirmed unless the user enlarges the image data, a warning is given so that shooting can be performed quickly, or automatic re-shooting can be performed. Therefore, desired shooting can be performed without losing timing.

It is a block diagram of the imaging device in a 1st embodiment. It is a figure which shows the flowchart of the process in 1st Embodiment. It is explanatory drawing of the face detection method in 1st Embodiment. It is a figure which shows the flowchart of the face detection method in 1st Embodiment. FIG. 3 is a representative chromaticity diagram in a CIELab color space. It is a figure which shows the template matching in 1st Embodiment. It is a figure which shows the form of the warning in 1st Embodiment. It is a figure which shows the flowchart of the process in the modification of 1st Embodiment. It is a figure which shows the flowchart of the process in 2nd Embodiment. It is a figure which shows the form of the warning in 2nd Embodiment. It is a figure which shows the flowchart of the process in 3rd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Control part 2 Imaging part 3 Image processing part 4 Image storage buffer 5 Signal conversion part 6 Image generation part 7 Display part 8 Judgment part 9 Face detection part 10 Recording part

Claims (16)

Subject detection means for detecting a subject region from image data captured in accordance with an instruction from a user;
Signal processing means for generating display image data based on the imaged image data;
Display means for displaying the display image data processed by the signal processing means;
Determination means for determining whether or not to warn based on the detection result of the subject detection means;
An informing means for giving a warning according to the determination result of the determining means,
The control unit automatically changes a control parameter of the image pickup unit according to the content of the warning and causes the image pickup unit to pick up an image.   The imaging apparatus according to claim 1, wherein when the determination unit determines that there is no need to give a warning, the recording unit records the image data.   The said notification means produces | generates the warning content display image which added the content of the said warning to the said display image data, and displays this warning content display image on the said display means. Imaging device.   4. The imaging according to claim 1, wherein the control unit causes the imaging unit to capture an image when detecting an instruction from a user after notifying the warning content by the notification unit. 5. apparatus.   5. The imaging apparatus according to claim 1, wherein the warning content performed by the notification unit is determined based on a focus state of a subject area detected by the subject detection unit.   5. The imaging apparatus according to claim 1, wherein the warning content performed by the notification unit is determined based on a hue of an eye of a subject.   5. The imaging apparatus according to claim 1, wherein the warning content performed by the notification unit is determined based on a degree of eye opening of the subject.   As a result of the determination by the determination unit, if a predetermined time or more has passed since the last shooting when re-shooting is performed, the control parameter of the imaging unit is newly set again. Item 5. The imaging device according to Item 4. A subject detection step for detecting a subject for detecting a subject region from image data captured in accordance with an instruction from a user;
A signal processing step for generating display image data based on the imaged image data;
A display step of displaying the display image data processed in the signal processing step;
A determination step of determining whether or not to warn based on the detection result of the subject detection step;
A notification step for giving a warning according to the determination result of the determination means,
A control unit automatically changes a control parameter of an imaging unit according to the content of the warning and causes the imaging unit to capture an image.   The method of controlling an imaging apparatus according to claim 9, further comprising a recording step of causing the recording unit to record the image data when it is determined that there is no need to issue a warning in the determination step.   11. The notification step generates a warning content display image in which the warning content is added to the display image data, and displays the warning content display image in the display step. Method for controlling the imaging apparatus.   The imaging unit according to claim 9, wherein the control unit causes the imaging unit to capture an image when detecting an instruction from a user after notifying the warning content in the notification process. Device control method.   13. The imaging device according to claim 9, wherein the warning content performed by the notification unit is determined based on a focus state of a subject area detected by the subject detection unit. Control method.   The method for controlling an imaging apparatus according to any one of claims 9 to 12, wherein the warning content performed by the notification unit is determined based on a hue of an eye of a subject.   The method for controlling an imaging apparatus according to any one of claims 9 to 12, wherein the warning content performed by the notifying unit is determined based on an eye open degree of a subject.   The control parameter setting of the imaging process is performed again if a predetermined time or more has passed since the last shooting when the determination result in the determination process results in re-imaging. A control method for the imaging apparatus according to the description.

Images