JP2007081992A - Image pickup device and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for notifying a face in a predetermined state among faces in a picked-up image. <P>SOLUTION: When a collective photographing mode is set, objects within a captured image are detected and states of the detected objects are recognized (step S105). An indication is performed for notifying an object of which the recognition result indicates a predetermined state (step S107). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for performing desired imaging.

  When shooting a person, the person who is the subject often looks away or closes his eyes. In particular, when taking a group photo, there is a higher possibility that a person who is looking away or a person whose eyes are closed is included. Even if the photographer notices this later, he cannot return to the scene where the group photo was taken, and as a result cannot obtain the intended group photo.

  Usually, a digital still camera has a quick review function for displaying a photographed image on a display immediately after photographing. However, in the case of a group photo with a large number of people, it is difficult to instantly find a person who is looking away or a person whose eyes are closed only by checking an image taken by quick review.

In the technical field, the following conventional technique (see Patent Document 1) is disclosed. That is, a face image is extracted from the input image by using a face detection technology that automatically detects a face area by detecting a characteristic part of a subject's face from a captured image or detecting a skin color part. Then, it is registered as a reference image together with additional information such as name and date of birth. Then, a face image that matches the reference image is detected from the newly input image. When the pointer is moved over the face image with a pointing device or the like, the additional information registered in the reference information is displayed or enlarged.
JP 2004-013871 A

  The present invention has been made in view of the above problems, and an object thereof is to provide a technique for notifying a face in a predetermined state among faces in a captured image.

  Another object of the present invention is to provide a technique for starting imaging when each face is in a desired state.

  In order to achieve the object of the present invention, for example, an imaging apparatus of the present invention comprises the following arrangement.

That is, an acquisition means for acquiring an image of the outside world by imaging the outside world,
An image pickup apparatus comprising: display means for displaying an image obtained by the obtaining means;
When a predetermined mode is set, a detection unit that detects a subject in the image acquired by the acquisition unit;
Recognition means for recognizing the state of the subject detected by the detection means;
Display control means for controlling the display means so as to perform display for reporting a subject whose recognition result by the recognition means indicates a predetermined state.

  In order to achieve the object of the present invention, for example, an imaging apparatus of the present invention comprises the following arrangement.

That is, an acquisition means for acquiring an image of the outside world by imaging the outside world,
An image pickup apparatus comprising: display means for displaying an image obtained by the obtaining means;
When a predetermined mode is set, a detection unit that detects a subject in the image acquired by the acquisition unit;
Recognition means for recognizing the state of the subject detected by the detection means;
And a recording control unit that records an image acquired by the acquisition unit in a predetermined memory when the recognition result by the recognition unit is in a predetermined state.

  In order to achieve the object of the present invention, for example, an imaging apparatus of the present invention comprises the following arrangement.

That is, an acquisition means for acquiring an image of the outside world by imaging the outside world,
An image pickup apparatus comprising: display means for displaying an image obtained by the obtaining means;
When a predetermined mode is set, a recording control unit that sequentially records the images acquired by the acquisition unit in a memory;
Detecting a predetermined instruction input, detecting means for detecting a subject in the correction target image among the image group recorded in the memory;
Recognition means for recognizing the state of the subject detected by the detection means;
When the recognition result by the recognition means is in a predetermined state, it comprises correction means for correcting the correction target image using one of the image groups.

  In order to achieve the object of the present invention, for example, a method for controlling an imaging apparatus of the present invention comprises the following arrangement.

That is, an acquisition means for acquiring an image of the outside world by imaging the outside world,
A display means for displaying an image acquired by the acquisition means, and a control method for an imaging apparatus comprising:
When a predetermined mode is set, a detection step of detecting a subject in the image acquired by the acquisition unit;
A recognition step for recognizing the state of the subject detected in the detection step;
A display control step of controlling the display means so as to perform a display for notifying a subject whose recognition result in the recognition step indicates a predetermined state.

  In order to achieve the object of the present invention, for example, a method for controlling an imaging apparatus of the present invention comprises the following arrangement.

That is, an acquisition means for acquiring an image of the outside world by imaging the outside world,
A display means for displaying an image acquired by the acquisition means, and a control method for an imaging apparatus comprising:
When a predetermined mode is set, a detection step of detecting a subject in the image acquired by the acquisition unit;
A recognition step for recognizing the state of the subject detected in the detection step;
And a recording control step of recording an image acquired by the acquisition unit in a predetermined memory when the recognition result by the recognition step is in a predetermined state.

  In order to achieve the object of the present invention, for example, a method for controlling an imaging apparatus of the present invention comprises the following arrangement.

That is, an acquisition means for acquiring an image of the outside world by imaging the outside world,
A display means for displaying an image acquired by the acquisition means, and a control method for an imaging apparatus comprising:
When a predetermined mode is set, a recording control step of sequentially recording images acquired by the acquisition unit in a memory;
When detecting a predetermined instruction input, a detection step of detecting a subject in the correction target image among the image group recorded in the memory;
A recognition step for recognizing the state of the subject detected in the detection step;
A correction step of correcting the correction target image using one of the image groups when the recognition result of the recognition step is in a predetermined state.

  According to the configuration of the present invention, it is possible to notify the face in a predetermined state among the faces in the captured image.

  Further, imaging can be started when each face is in a desired state.

  Hereinafter, the present invention will be described in detail according to preferred embodiments with reference to the accompanying drawings.

[First Embodiment]
In the present embodiment, a case where a digital camera is applied as an imaging device will be described. FIG. 7 is a block diagram showing a hardware configuration of the digital camera according to the present embodiment.

  The digital camera according to the present embodiment includes a shooting mode that is a mode for capturing a subject image, a playback mode that is a mode for browsing captured images, and a group shooting mode that is a mode for group photo shooting. There are three modes. When the operator of the digital camera operates the mode switch 1021 shown in the figure and selects one of these three modes, a signal indicating the selected mode is notified from the mode switch 1021 to the CPU 1003 via the IO 1025. Is done.

  As a result, the CPU 1003 can detect the mode selected by the mode switch 1021 and controls each unit shown in FIG. 7 to perform an operation according to the detected mode. Below, operation | movement of each part in each mode is demonstrated. In the following description, a human face is used as the subject.

<Shooting mode>
First, the operation of each unit shown in FIG. 7 when the shooting mode, which is a mode for capturing a subject image, is set will be described. Note that each unit described below operates by being controlled by the CPU 1003 using a program or data read from the ROM 1004 via the ROM controller 1015.

  The lens 1019 forms a subject image, and the formed subject image is output as an analog image signal by the imaging sensor 1009. The AD converter 1028 performs A / D conversion or the like on the analog image signal output from the image sensor 1009 and outputs the analog image signal as a digital image signal. The imaging circuit 1010 obtains adjusted image data by performing processing for adjusting exposure and white balance on the digital image signal output from the AD converter 1028. Further, during still image shooting, this image data is compressed, and the compressed image data is output to the memory controller 1005 via the bus 1002. In the case of an EVF operation described later, uncompressed image data is output to the memory controller 1005.

  The memory controller 1005 stores this compressed image data in the DRAM 1006. The display circuit 1012 decompresses the compressed image data stored in the DRAM 1006 and outputs the decompressed image data to the DA converter 1029 or outputs the uncompressed image data stored in the DRAM 1006 to the DA converter 1029. The DA converter 1029 performs analog-to-digital conversion on the image data to generate an analog image signal and outputs the analog image signal to the subsequent display 1011. With the above operation, the subject image is displayed on the display screen of the display 1011.

  Here, when the operator of the digital camera presses the shutter switch 1023, a signal indicating that is sent from the shutter switch 1023 to the CPU 1003 via the IO 1025. When the CPU 1003 detects from this signal that the shutter switch 1023 has been pressed, the CPU 1003 controls the memory controller 1005. By this control, the imaging circuit 1010 performs a process for adjusting exposure and white balance on the digital image signal output from the AD converter 1028, further performs a compression process on the image data, and transfers the compressed image data to the bus. The data is recorded in the memory controller 1005 via 1002. The memory controller 1005 reads the compressed image data stored in the DRAM 1006 and transfers the read compressed image data to the memory card 1007 connected to the socket 1008.

By performing such processing, when the operator presses the shutter switch 1023, an image stored in the DRAM 1006 can be recorded on the memory card 1007 in accordance with the timing.
<Group shooting mode>
Next, the operation of each unit shown in FIG. 7 when the group shooting mode, which is a mode for taking a group photo, is set will be described. Note that each unit described below operates by being controlled by the CPU 1003 using a program or data read from the ROM 1004 via the ROM controller 1015.

  When the group shooting mode is set, the feature detection circuit 1000 operates in addition to the operation when the shooting mode is set. FIG. 1 is a flowchart of processing performed by the digital camera when the group shooting mode is set.

  First, processing (EVF display) for displaying a subject on the display 1011 is performed (step S102). That is, as described above, the digital image signal of the subject output via the lens 1019, the image sensor 1009, the AD converter 1028, and the image pickup circuit 1010 is output to the memory controller 1005 as image data by the image pickup circuit 1010. The memory controller 1005 stores this image data in the DRAM 1006.

  The display circuit 1012 outputs the image data stored in the DRAM 1006 to the DA converter 1029. The DA converter 1029 generates an analog image signal by performing D / A conversion on the developed image data, and outputs the analog image signal to the subsequent display 1011.

  If the CPU 1003 detects that the operator of the digital camera has pressed the shutter switch 1023 via the IO 1025 and the bus 1002, the process proceeds to step S104 via step S103. The CPU 1003 transfers the latest compressed image data stored in the DRAM 1006 to the memory card 1007 connected to the socket 1008 (step S104). Further, in the same step, the CPU 1003 creates a decompressed image data (photographed image data) in the DRAM 1006.

  Then, the feature detection circuit 1000 performs recognition processing on the human face included in the captured image using the captured image data, and performs processing for determining the state of the recognized face (step S105). ).

  FIG. 2 is a flowchart showing details of the processing in step S105.

  First, the CPU 1003 and the feature detection circuit 1000 perform a process of detecting a face from a captured image stored in the DRAM 1006 (step S202). The parameter 1001 is used for this detection process. A parameter 1001 is a parameter used for face detection and recognition. Various methods for detecting a face in an image are conceivable. For example, techniques disclosed in Japanese Patent Application Laid-Open Nos. 2002-183731 and 2004-062565 can be used.

  In the face detection algorithms disclosed therein, looking away can be detected by determining the position of the eye with respect to the face outline in the image. Further, when the same algorithm is used, a face with closed eyes can be detected by performing face detection after changing the threshold setting so as to determine that the eyes are thin even when eyes are determined. Furthermore, if the algorithm is used, a face with red eyes can be detected by determining the color of the eyes.

  In this embodiment, since it is necessary to detect a face that has been looked away or a face that has closed its eyes, a threshold for determining the aspect ratio of the face outline, the position of the eyes with respect to the face, and the characteristics of the eyes used for face determination Is set so that the face can be detected widely.

  If no face is detected from the captured image as a result of the face detection process in step S202, the process according to this flowchart is terminated. On the other hand, if one or more faces are detected, the process proceeds to step S203, and the CPU 1003 performs a process of storing, in the DRAM 1006, coordinate values that define a frame surrounding the detected face area in the captured image for each detected face. (Step S203). For example, the coordinate values of the four corners of the frame may be stored in the DRAM 1006, or the coordinate values of the upper left corner and the lower right corner of the frame may be stored in the DRAM 1006. In addition, although what surrounds the area | region of the detected face is made into the square frame here, the shape of this frame may be what.

  With such processing, for each face in the captured image, coordinate values that define a frame surrounding the face can be stored in the DRAM 1006. Here, the CPU 1003 resets a pointer for pointing to each detected face (step S204). That is, when a number is assigned to each detected face, the number indicated by the pointer is set to the first number.

  Next, the CPU 1003 refers to the coordinate value data defining the frame surrounding the face pointed to by the current pointer, detects the eyes in this face (step S205), and determines whether or not the detected eyes are looking away. A check is performed (step S206). Whether or not the detected eyes are looking away is determined using, for example, the face contour and the eye position detected in the face detection process in step S202. In the case of a human face, the eyes should be in a range of positions relative to the face outline. However, if two eyes are present to the right or left of the center of the face, it can be determined that the face is looking away.

  Therefore, if the result of such check processing is that the detected eye is looking away, the processing proceeds to step S210, and coordinate value data defining the frame surrounding the face pointed to by the current pointer is stored in the DRAM 1006. In the error information area (step S210).

  On the other hand, if the detected eyes are not looking away as a result of the check process in step S206, or after the process in step S210, the process proceeds to step S207. Then, it is checked whether or not the eyes detected in step S205 are open, and if they are open, whether or not the eyes are red eyes (step S207). For checking whether or not the detected eyes are open, for example, the aspect ratio of the eyes detected during the face detection process in step S202 is measured. When the ratio is extremely long, it is determined that the eyes are closed. Whether or not the eyes are red eyes can be checked by determining the color of the pupil region obtained by detecting the pupil.

  As a result of the check process in step S207, if it is determined that the eyes are closed or the eyes are open and the eyes are red eyes, the process proceeds to step S211. Then, coordinate value data defining a frame surrounding the face pointed to by the current pointer is stored in the error information area in the DRAM 1006 (step S211).

  On the other hand, as a result of the check processing in step S207, if the detected eye is open and the eye is not red-eye, the process proceeds to step S208. Then, it is checked whether or not the processes after step S205 have been performed for all the faces detected in step S202 (step S208). If not, the process proceeds to step S209 and the pointer is incremented by one ( Step S209). As a result, a face that is not yet a processing target after step S205 is set as a processing target after the next step S205. Then, the process returns to step S205, and the processes after step S205 are performed on the face indicated by the incremented pointer.

  On the other hand, when the processes after step S205 have been performed for all the faces, the processes in this flowchart are terminated.

  According to the processing according to the flowchart of FIG. 2 described above, among the faces in the captured image, a face looking away, a face with closed eyes, a face with open eyes but red eyes, Can be stored in the DRAM 1006.

  When the process according to the flowchart of FIG. 2 described above is completed, the process returns to step S106 of FIG. 1, and the captured image data is read from the DRAM 1006 and displayed on the display 1011 (quick review screen display) (step S106). ). That is, the captured image is output to the display circuit 1012. The display circuit 1012 outputs this captured image to the DA converter 1029. The DA converter 1029 generates an analog image signal by performing D / A conversion on the captured image, and outputs the analog image signal to the display 1011 at the subsequent stage.

  Next, the CPU 1003 refers to the error information area in the DRAM 1006, reads coordinate value data defining a frame, if there is, and overwrites the frame for each face on the image data on the DRAM 1006. (Step S107).

  Since the display circuit 1012 starts sending image data to the DA converter 1029 from step S106, the display image with the frame overwritten is sent to the DA converter 1029. The DA converter 1029 D / A converts the image data and sends it to the display 1011 as an analog image signal. As a result, on the captured image displayed on the display screen of the display 1011, a frame is formed on the face looking away, the face with closed eyes, and the face with open eyes but red eyes. Will be displayed.

  FIG. 8 is a diagram illustrating a display example when a frame is displayed on a face that is looking away and a face with closed eyes on a captured image displayed on the display screen of the display 1011. As shown in the figure, frame images 801 and 802 are superimposed and displayed on a face looking away and a face with closed eyes, respectively.

  Here, the frame is displayed in the same color for the face looking away, the face with closed eyes, and the face with open eyes but red eyes. The display form such as the color of the frame may be different for each type.

  Next, the CPU 1003 creates the coordinate value data for each face stored in the error information area as an error information file, and stores it in the memory card 1007 in association with the compressed image data recorded in the memory card 1007 in step S104. (Step S109).

  By the above processing, if a captured image includes a face looking away, a face with closed eyes, or a face with open eyes but red eyes, such a face is framed. Can be displayed. Note that the form for notifying such a face is not limited to displaying a frame. For example, the color in the image area of such a face may be changed. Various things can be considered.

<Playback mode>
Next, an operation performed by each unit shown in FIG. 7 when a playback mode that is a mode for displaying an image recorded on the memory card 1007 on the display 1011 is set will be described. Note that each unit described below operates by being controlled by the CPU 1003 using a program or data read from the ROM 1004 via the ROM controller 1015.

  FIG. 3 is a flowchart of processing performed by the digital camera when the playback mode is set. First, the CPU 1003 resets a pointer indicating an image recorded in the memory card 1007 so that the pointer points to an image recorded most recently in the memory card 1007 (step S302).

  Next, the CPU 1003 reads the image pointed to by the current pointer from the memory card 1007 and displays it on the display 1011 (step S303). More specifically, the CPU 1003 controls the memory card controller 1013 in order to read the image indicated by the current pointer from the memory card 1007. As a result, the memory card controller 1013 reads an image instructed by the CPU 1003 and outputs it to the display circuit 1012. The display circuit 1012 expands this image and records the expanded image data in the DRAM 1006 once. Further, the display circuit 1012 repeatedly sends the data on the DRAM 1006 to the DA converter 1029. The DA converter 1029 D / A converts this image data and sends it to the display 1011 as an analog image signal. As a result, an image indicated by the current pointer is displayed on the display screen of the display 1011.

  If an error information file is stored in the memory card 1007 in association with the image indicated by the current pointer, the error information file is also read in step S303. Therefore, after the display process in step S303, if the error information file is stored in association with the image data pointed to by the current pointer, the process proceeds to step S305 via step S304. Then, the CPU 1003 generates a frame image using the coordinate value data stored in the error information file, and overwrites the displayed image data on the DRAM 1006. (Step S305).

  As a result, on the captured image displayed on the display screen of the display 1011, a frame is formed on the face looking away, the face with closed eyes, and the face with open eyes but red eyes. It will be displayed superimposed.

  When an operator of the digital camera displays the next image recorded on the memory card 1007 on the display 1011, the operator of the digital camera presses the feed button constituting the operation switch 1022. When the feed button is pressed, a signal indicating that is sent from the operation switch 1022 to the CPU 1003 via the IO 1025.

  When the CPU 1003 detects this signal, the process proceeds to step S307 via step S306, and the CPU 1003 sets a pointer to point to the next new image in the memory card 1007 (step S307). Then, the process returns to step S303, and the processes after step S303 are performed on the new image.

  As described above, according to the present embodiment, when a photographed image includes a face looking away, a face with closed eyes, and a face with open eyes but red eyes. , A frame can be displayed on such a face. As a result, the operator of the digital camera can easily recognize that the face has been photographed.

[Second Embodiment]
In the present embodiment, a digital camera that performs group shooting such that a face looking away, a face with closed eyes, and a face with open eyes but red eyes will not be present will be described.

  FIG. 4 is a flowchart of processing performed by the digital camera when the group shooting mode according to the present embodiment is set.

  First, processing (EVF display) for displaying a subject on the display 1011 is performed (step S402). The process in step S402 is performed in the same manner as the process in step S102.

  If the CPU 1003 detects that the operator of the digital camera has pressed the shutter switch 1023 via the IO 1025 and the bus 1002, the process proceeds to step S405 via step S403. In step S <b> 405, first, the CPU 1003 creates in the DRAM 1006 a developed version of the latest compressed image data stored in the DRAM 1006 (captured image data).

  The feature detection circuit 1000 performs recognition processing on the human face included in the captured image using the captured image data, and performs processing for determining the state of the recognized face. The process in step S405 is performed in the same manner as the process in step S105.

  Next, the CPU 1003 checks whether coordinate value data is stored in the error information area in the DRAM 1006 (step S406). Thereby, it is possible to check whether or not there is a face looking away, a face with closed eyes, and a face with open eyes but red eyes in the captured image.

  If the coordinate value data is stored in the error information area in the DRAM 1006 as a result of this check process, the process returns to step S402.

  On the other hand, if the coordinate value data is not stored in the error information area in the DRAM 1006, the process proceeds to step S407, and the process of displaying the photographed image data on the display 1011 (quick review screen display) is performed (step S407). . That is, the captured image is output to the display circuit 1012. The display circuit 1012 outputs this captured image to the DA converter 1029. The DA converter 1029 generates an analog image signal by performing D / A conversion on the captured image, and outputs the analog image signal to the display 1011 at the subsequent stage.

  Next, the CPU 1003 outputs the compressed image data from which the captured image data is expanded to the memory controller 1005 via the bus 1002, and stores it therein (step S408).

  As described above, in this embodiment, the subject is photographed only in a situation where none of the face looking away, the face with closed eyes, and the face with open eyes but red eyes are present. Is called. Therefore, if the shutter switch 1023 is kept pressed, when there is a state in which none of the face looking away, the face with closed eyes, or the face with open eyes but red eyes is present, An image in which none of the face looking away, the face with closed eyes, or the face with open eyes but red eyes is present is taken.

  As described above, according to the present embodiment, it is possible to capture an image in which neither a face looking away, a face with closed eyes, or a face with open eyes but red eyes is present. it can.

[Third Embodiment]
In the group shooting mode according to the second embodiment, it is possible to capture an image in which none of a face looking away, a face with closed eyes, and a face with open eyes but red eyes are present. it can. However, if a person who looks away or a person who closes his eyes continues to appear during the shooting, the shooting cannot be performed indefinitely. Therefore, in this embodiment, a group shooting mode that solves such a problem will be described.

  FIG. 5 is a flowchart of processing performed by the digital camera when the group shooting mode according to the present embodiment is set.

  First, processing (EVF display) for displaying a subject on the display 1011 is performed (step S502). The process in step S502 is performed in the same manner as the process in step S102.

  If the CPU 1003 detects that the operator of the digital camera has pressed the shutter switch 1023 via the IO 1025 and the bus 1002, the process proceeds to step S504 via step S503.

  The CPU 1003 transfers the latest compressed image data stored in the DRAM 1006 to the memory card 1007 connected to the socket 1008 (step S504). Here, unless the CPU 1003 detects that the operator of the digital camera has released the press of the shutter switch 1023 via the IO 1025 and the bus 1002, the process returns to step S504 via step S506. That is, as long as the shutter switch 1023 is pressed, the compressed image data is sequentially stored in the DRAM 1006, and the stored compressed image data is sequentially transferred to the memory card 1007.

  On the other hand, when the CPU 1003 detects that the operator of the digital camera has released the press of the shutter switch 1023 via the IO 1025 and the bus 1002, the process proceeds to step S507 via step S506. In step S507, first, the CPU 1003 controls the memory card controller 1013, and the shutter switch 1023 is pressed to read the compressed image data first recorded on the memory card 1007 from the memory card 1007 to the DRAM 1006. Then, the read compressed image data is expanded, and the expanded image data (first photographed image data) is processed according to the flowchart of FIG. 2 (step S507).

  That is, it is checked whether or not the coordinate value data is stored in the error information area for the first captured image. More specifically, it is checked whether or not a face looking away, a face with closed eyes, and a face with open eyes but red eyes are present in the first photographed image. As a result of the check, if any of the face looking away, the face with closed eyes, or the face with open eyes but red eyes is present, the process proceeds to step S512 via step S508. Then, the correction process described below is performed for the existing face (step S512).

  FIG. 6 is a flowchart showing details of the processing in step S512.

  First, the CPU 1003 reads coordinate value data corresponding to the first captured image from the error information area (step S602). Next, an image to be processed is set as decompressed image data (second photographed image data) obtained by decompressing the compressed image data secondly recorded on the memory card 1007 by pressing the shutter switch 1023 (step S604). ). Then, in the second photographed image data, the face looking away, the face with eyes closed, and the eyes open with red eyes within the frame defined by the coordinate value data read in step S602. It is checked whether or not a face is present (step S605). This check process is performed by the CPU 1003 and the feature detection circuit 1000, as described with reference to the flowchart of FIG.

  As a result of this check process, if any of the face looking away, the face with closed eyes, or the face with open eyes but red eyes is present, the process returns to step S604. Then, an image to be processed is set as decompressed image data (third photographed image data) obtained by decompressing the compressed image data recorded on the memory card 1007 third by pressing the shutter switch 1023. And the process in step S605, S606 is performed about 3rd picked-up image data.

  In the following description, a case will be described in which none of the above faces exists in the frame defined by the coordinate value data read out in step S602 in the xth (x ≧ 2) photographed image. Here, the x-th photographed image is a developed image obtained by decompressing the compressed image recorded in the xth memory card 1007 by pressing the shutter switch 1023.

  In the x-th photographed image, the face looking away, the face with closed eyes, the face with open eyes but red eyes within the frame defined by the coordinate value data read in step S602. If neither is included, the process proceeds from step S607 to step S608. Then, the image area in the frame is copied and pasted in the frame defined by the coordinate value data read in step S602 in the first captured image (step S608). Thereby, even if there is a face looking away, a face with closed eyes, or a face with open eyes but red eyes in the first captured image, this can be corrected.

  Then, the process returns to step S509 in FIG. 5, and a process (quick review screen display) for displaying the corrected image in step S608 on the display 1011 is performed (step S509). That is, the corrected image is output to the display circuit 1012. The display circuit 1012 outputs the corrected image to the DA converter 1029. The DA converter 1029 generates an analog image signal by performing D / A conversion on the image, and outputs the analog image signal to the subsequent display 1011.

  Next, the CPU 1003 records the corrected image as an image file on the memory card 1007 via the memory card controller 1013 (step S510). When recording, the corrected image is compressed and recorded.

  Further, the CPU 1003 refers to the error information area in the DRAM 1006, reads the coordinate value data defining the frame, if any, and records it in the memory card 1007 in association with the image file recorded in step S510 (step S511). .

  In the present embodiment, the image to be corrected is an image obtained by developing compressed image data first recorded on the memory card 1007 by pressing the shutter switch 1023. However, any image recorded while the shutter switch 1023 is pressed may be used, and the image is not limited to the first photographed image.

  Here, in each of the above embodiments, a human face is used as a subject. However, other objects may be used as the subject, and in that case, a parameter necessary for recognizing the state of the subject needs to be created in advance as the parameter 1001.

  In addition, an embodiment in which any one of the first to third embodiments is appropriately combined can be implemented.

[Other Embodiments]
Needless to say, the object of the present invention can be achieved as follows. That is, a recording medium (or storage medium) that records a program code of software that implements the functions of the above-described embodiments is supplied to a system or apparatus. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

  Further, by executing the program code read by the computer, an operating system (OS) or the like running on the computer performs part or all of the actual processing based on the instruction of the program code. Needless to say, the process includes the case where the functions of the above-described embodiments are realized.

  Furthermore, it is assumed that the program code read from the recording medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU included in the function expansion card or function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is realized by the processing. Needless to say.

  When the present invention is applied to the recording medium, program code corresponding to the flowchart described above is stored in the recording medium.

6 is a flowchart of processing performed by a digital camera when a group shooting mode is set. It is a flowchart which shows the detail of the process in step S105. It is a flowchart of the process which a digital camera performs when the reproduction mode is set. It is a flowchart of the processing which a digital camera performs when the group shooting mode according to the second embodiment of the present invention is set. It is a flowchart of the processing which a digital camera performs when the group shooting mode according to the third embodiment of the present invention is set. It is a flowchart which shows the detail of the process in step S512. It is a block diagram which shows the hardware constitutions of the digital camera which concerns on the 1st Embodiment of this invention. 10 is a diagram illustrating a display example when a frame is displayed on a face looking away and a face with closed eyes on a captured image displayed on the display screen of the display 1011. FIG.

Claims (11)

Acquisition means for acquiring an image of the outside world by imaging the outside world;
An image pickup apparatus comprising: display means for displaying an image obtained by the obtaining means;
When a predetermined mode is set, a detection unit that detects a subject in the image acquired by the acquisition unit;
Recognition means for recognizing the state of the subject detected by the detection means;
An image pickup apparatus comprising: a display control unit that controls the display unit so as to perform display for notifying a subject whose recognition result by the recognition unit indicates a predetermined state.   The imaging apparatus according to claim 1, wherein the subject is a human face.   When the recognizing means recognizes that the human face detected by the detecting means is a face looked away, a face with closed eyes, or a face with red eyes, the display control means The image pickup apparatus according to claim 2, wherein the display unit is controlled to perform display for notifying the face that has been performed. Acquisition means for acquiring an image of the outside world by imaging the outside world;
An image pickup apparatus comprising: display means for displaying an image obtained by the obtaining means;
When a predetermined mode is set, a detection unit that detects a subject in the image acquired by the acquisition unit;
Recognition means for recognizing the state of the subject detected by the detection means;
An image pickup apparatus comprising: a recording control unit that records an image acquired by the acquisition unit in a predetermined memory when a recognition result by the recognition unit is in a predetermined state. Acquisition means for acquiring an image of the outside world by imaging the outside world;
An image pickup apparatus comprising: display means for displaying an image obtained by the obtaining means;
When a predetermined mode is set, a recording control unit that sequentially records the images acquired by the acquisition unit in a memory;
Detecting a predetermined instruction input, detecting means for detecting a subject in the correction target image among the image group recorded in the memory;
Recognition means for recognizing the state of the subject detected by the detection means;
An imaging apparatus comprising: correction means for correcting the correction target image using one of the image groups when the recognition result by the recognition means is in a predetermined state.   The correction means corrects the correction target image using an image recognized by the recognition means that the subject in the image is not in the predetermined state in the image group. 5. The imaging device according to 5. Acquisition means for acquiring an image of the outside world by imaging the outside world;
A display means for displaying an image acquired by the acquisition means, and a control method for an imaging apparatus comprising:
When a predetermined mode is set, a detection step of detecting a subject in the image acquired by the acquisition unit;
A recognition step for recognizing the state of the subject detected in the detection step;
A display control step of controlling the display means so as to perform display for notifying a subject whose recognition result in the recognition step indicates a predetermined state. Acquisition means for acquiring an image of the outside world by imaging the outside world;
A display means for displaying an image acquired by the acquisition means, and a control method for an imaging apparatus comprising:
When a predetermined mode is set, a detection step of detecting a subject in the image acquired by the acquisition unit;
A recognition step for recognizing the state of the subject detected in the detection step;
And a recording control step of recording an image acquired by the acquisition unit in a predetermined memory when the recognition result of the recognition step is in a predetermined state. Acquisition means for acquiring an image of the outside world by imaging the outside world;
A display means for displaying an image acquired by the acquisition means, and a control method for an imaging apparatus comprising:
When a predetermined mode is set, a recording control step of sequentially recording images acquired by the acquisition unit in a memory;
When detecting a predetermined instruction input, a detection step of detecting a subject in the correction target image among the image group recorded in the memory;
A recognition step for recognizing the state of the subject detected in the detection step;
And a correction step of correcting the correction target image using one of the image groups when the recognition result in the recognition step is in a predetermined state.   A program for causing an imaging apparatus to execute the control method according to claim 7.   A computer-readable program storing the program according to claim 10.

Images