JP2010021795A - Image capturing apparatus, correction controller, correction control method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image capturing apparatus that captures an image while previously confirming an effect of processing for the area of a specified face organ of a subject including the face, a correction controller, a correction control method, and a program. <P>SOLUTION: A display unit 28 updates and displays a subject image output from an image sensor 11 as a live-view image at a predetermined display frame rate. An organ detection unit 22 detects the area of the specified face organ included in the face from the live-view image including the face in the live-view image. An image correction unit 201 processes the area of the face organ detected by the organ detection unit 22 to perform correction processing on the live-view image. When a correction mode is selected, a correction control unit 261 performs control so that the image correction unit 201 performs the correction processing and also performs control to make the display frame rate of the live-view image lower than that of the display frame rate when the correction mode is not selected according to a time needed for the correction processing. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, a correction control apparatus provided in the imaging apparatus, a correction control method in the imaging apparatus, and a program executed by a computer of the imaging apparatus.

  2. Description of the Related Art Conventionally, as one technique for photographing a person, a photographing technique is known in which a light called a catch light is reflected on a subject's pupil to make a person's facial expression lively. In general, catchlight photography is performed using a reflex board, which requires a large amount of equipment and skill of the photographer. As a technique for solving this type of problem, there is known a technique for generating a catch light in the pupil of a subject by detecting an eye region in an image and performing image processing. For example, Patent Document 1 discloses a technique for determining a synthetic position of a catch light by detecting a subject situation such as the size and orientation of the subject's face and the direction of illumination in order to realize a natural catch light. .

JP-A-2005-222152

  By the way, in an imaging apparatus such as a digital camera, an output from an imaging element is displayed on a display unit in real time as a live view image and used as an electronic viewfinder. If processing such as synthesizing a catch light is performed on a specific facial organ region such as the eye region shown in the live view image, the processing effect on the facial organ can be confirmed before imaging. However, when a specific facial organ is detected from the live view image and processed, the processing load for displaying the live view image increases. For example, in Patent Document 1, it is necessary to detect the state of a subject by analyzing an image that generates a catchlight in order to determine a combined position of the catchlight. For this reason, there has been a problem that a situation occurs in which the live view image cannot be displayed properly without being processed in time.

  The present invention has been made in view of the above, and is an imaging device, a correction control device, and a correction device that can perform imaging while confirming in advance the effect of processing on a specific facial organ region of a subject including a face It is an object to provide a control method and a program.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention includes an imaging unit that captures a subject, and a subject image captured by the imaging unit as a live view image at a predetermined display frame rate. A display unit for updating display, an organ detection unit for detecting a region of a specific facial organ included in the face from a live view image including a face of the live view image, and a face detected by the organ detection unit An image correction unit that corrects the live view image by processing an organ region, a correction setting unit that sets whether the image correction unit corrects the live view image, and a setting that performs the correction. If the image correction unit controls, the image correction unit controls to perform the correction process, and the display frame rate of the live view image when the correction is set to be Than the display frame rate when the setting is not corrected, it characterized in that it comprises a correction control unit that performs control to slow depending on the time required for the correction processing.

  In the imaging device according to the present invention, in the above invention, the image correction unit processes the facial organ region by synthesizing a predetermined synthesis image with the specific facial organ region. It is characterized by.

  In the imaging device according to the present invention, in the above invention, the organ detection unit detects an eye region included in a face of the live view image using the specific facial organ as an eye, and the image correction unit includes: A catchlight image is synthesized with the eye area detected by the organ detection unit.

  Further, the imaging apparatus according to the present invention includes a camera shake correction unit that detects vibration of the apparatus main body and controls driving of the imaging unit based on a result of the detection in the above invention, and the correction control unit includes: In the case of setting to perform the correction, control for operating the camera shake correction unit is performed.

  The imaging apparatus according to the present invention further includes a face detection unit that detects a face area from the live view image, and the correction control unit is configured to perform the correction, and When the detection unit detects a face area from the live view image, control is performed to reduce the display frame rate.

  In the image pickup apparatus according to the present invention, in the above invention, the image correction unit includes an enlargement processing unit that enlarges a partial image including the processed facial organ region in the live view image, The correction control unit controls the enlargement processing unit to perform the enlargement processing when the correction is set to be performed.

  The imaging device according to the present invention is detected by the face data storage unit that stores a plurality of face data, a face detection unit that detects a face area from the live view image, and the face detection unit in the above invention. A face recognition unit that compares the face area with the face data stored in the face data storage unit and recognizes the face of a specific person included in the live view image, and the correction control unit performs the correction. In the case of setting to perform, when the face of a specific person included in the live view image is recognized by the person recognition unit, the image correction unit is controlled to perform the correction process, and the display frame rate It is characterized by performing control for slowing down.

  The imaging apparatus according to the present invention may further include a motion detection unit that detects the motion of the subject in the live view image, and the correction control unit is configured to perform the correction. The display frame rate is controlled to be slow when there is no motion of the subject as a result of detection by the motion detection unit.

  The correction control apparatus according to the present invention includes an imaging unit that captures a subject, a display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate, and the live view. An organ detection unit for detecting a region of a specific facial organ included in the face from a live view image including a face in the image, and processing the region of the facial organ detected by the organ detection unit to perform the live view A correction control device provided in an imaging apparatus, comprising: an image correction unit that performs image correction processing; and a correction setting unit that sets whether or not the image correction unit corrects the live view image. When the setting for performing the correction is performed, the image correction unit controls the correction processing to be performed, and the display frame of the live view image in the setting for performing the correction is performed. Mureto a and performs control to slow depending on the time required for the correction processing than the display frame rate when the setting is not performed the correction.

  The correction control method according to the present invention includes an imaging unit that captures a subject, a display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate, and the live view. An organ detection unit for detecting a region of a specific facial organ included in the face from a live view image including a face in the image, and processing the region of the facial organ detected by the organ detection unit to perform the live view A correction control method in an imaging apparatus, comprising: an image correction unit that performs image correction processing; and a correction setting unit that sets whether or not the image correction unit corrects the live view image. When the setting is made, the image correction unit controls the correction processing to be performed, and the display frame of the live view image in the setting to perform the correction The chromatography bets, and performs control to slow depending on the time required for the correction processing than the display frame rate when the setting is not performed the correction.

  According to another aspect of the present invention, there is provided a program for an imaging apparatus including: an imaging unit that captures a subject; and a display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate. A computer detects a specific facial organ region included in the face from a live view image including a face of the live view image, and processes the facial organ region detected in the organ detecting step. When the correction step for correcting the live view image, the setting step for setting whether or not to correct the live view image, and the setting for correction in the setting step are performed, the correction step The display frame rate of the live view image in the case of the setting for performing the correction Characterized in that to execute a correction control step of controlling so as to slow down depending on the time required for the correction processing than the display frame rate when the setting is not performed the correction.

  Further, in the program according to the present invention, in the above invention, the detection step detects an eye region included in a face of the live view image using the specific facial organ as an eye, and the correction step includes the detection step. A catchlight image is synthesized with the eye area detected in step (1).

  According to the present invention, it is possible to provide an imaging device, a correction control device, a correction control method, and a program capable of capturing an image while confirming in advance the effect of processing on a specific facial organ region of a subject including a face. it can.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, a case where the imaging apparatus of the present invention is applied to a digital camera will be described as an example. Note that the present invention is not limited to the embodiments. Moreover, in description of drawing, the same code | symbol is attached | subjected and shown to the same part.

(Embodiment 1)
FIG. 1 is a rear view of the digital camera 1. As shown in FIG. 1, the digital camera 1 includes a release button (shutter button) 3 for instructing photographing timing provided on the upper surface of the camera body 2, and a power button 4 provided on the back surface of the camera body 2. And menu button 5, cross button 6 having up / down / left / right direction buttons (up button, down button, left button and right button), OK button 7 for confirming operation details, and display unit for displaying various screens 28 etc. Although not shown, an imaging lens or the like is disposed on the front surface of the camera body 2. When the user presses the power button 4 to turn on the power, the digital camera 1 is in a state where it can shoot (shooting mode). In this shooting mode, the subject image formed on the image sensor 11 (see FIG. 2) through the imaging lens is output every frame (for example, 1/30 second) and displayed on the display unit 28 in real time as a live view image. It has come to be. For example, electronic photographing is performed at the timing when the release button 3 is pressed.

  FIG. 2 is a block diagram showing a system configuration of the digital camera 1. As shown in FIG. 2, the digital camera 1 includes an imaging device 11, a lens system unit 12, a lens driving circuit 13, an imaging circuit 14, a vibration sensor 15, an image stabilization control unit 16, and an SDRAM (Synchronous Dynamic Random Access Memory) 17, AE unit 18, AF unit 19, image processing unit 20, face detection unit 21, organ detection unit 22, face dictionary 23 as a face data storage unit, and person recognition unit 24 The motion detection unit 25, the CPU 26, the built-in memory 27, the display unit 28, the display drive circuit 29, the communication I / F 30, the operation unit 31, the removable memory 32, the power supply circuit 33, and the battery 34. With. The imaging circuit 14, the lens driving circuit 13, the image stabilization control unit 16, the SDRAM 17, the AE unit 18, the AF unit 19, the image processing unit 20, the organ detection unit 22, the face detection unit 21, the face dictionary 23, and the person recognition unit 24. The motion detector 25, the CPU 26, the display drive circuit 29, and the removable memory 32 are connected via a bus 35. In addition, the imaging element 11, the lens system unit 12, and the imaging circuit 14 constitute an imaging unit that captures an image of a subject.

  The image pickup device 11 is an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and photoelectrically converts a subject image incident through the lens system unit 12 in units of frames and outputs an analog electric signal. To do. The lens system unit 12 includes an imaging lens including an AF (Auto-Focus) lens, a zoom lens, and the like, a diaphragm, a shutter, and the like. The lens driving circuit 13 drives the lens system unit 12.

  The imaging circuit 14 performs analog signal processing such as CDS (Correlated Double Sampling) and AGC (Automatic Gain Control) on the analog electrical signal output from the imaging device 11 and converts the analog electrical signal into a digital electrical signal. Digital signal processing such as pixel interpolation processing and color correction processing is performed on the digital electrical signal and output as image data. This image data is temporarily stored in the SDRAM 17.

  The vibration sensor 15 is for detecting the vibration of the camera body 2 and constitutes a camera shake correction unit together with the image stabilization control unit 16. The vibration sensor 15 is realized by an angular velocity sensor such as a gyro, for example. The optical axis direction of the optical system of the digital camera 1 is the Z-axis direction, and a plane perpendicular to the Z-axis direction (imaging surface of the image sensor 11) is an XY plane. In this case, the angular velocities around the X, Y, and Z axes are detected by individual gyros or the like. Then, the image stabilization control unit 16 controls the drive of the image sensor 11 based on the detection result of the vibration sensor 15, and performs image stabilization control processing (camera shake correction processing) for suppressing image shake due to camera shake or the like. This image stabilization control process is performed by appropriately applying a known technique. Further, as a camera shake correction method, a method of driving a part of the lenses of the lens system unit instead of driving the imaging device may be used.

  The SDRAM 17 is used for temporary storage of image data output from the imaging circuit 14 and image data being processed by the image processing unit 20. For example, image data of an image (live view image) output from the imaging circuit 14 for each frame, image data of an image output from the imaging circuit 14 at the shooting timing (hereinafter referred to as “captured image”), and the like. Temporarily stored. In the shooting mode, which is one of the modes of the digital camera 1, the subject image formed on the image sensor 11 is displayed on the display unit 28 in a moving image in real time. What is a live view image? This is the image.

  The AE unit 18 performs automatic exposure based on the image data output from the imaging circuit 14. The AF unit 19 performs automatic focus adjustment based on the image data output from the imaging circuit 14.

  The image processing unit 20 performs various types of image processing on the image data output from the imaging circuit 14 and performs processing for converting into image data suitable for recording, display, catchlight synthesis, and the like. For example, when recording image data of a photographed image or displaying recorded image data, image data compression processing or decompression processing based on a JPEG (Joint Photographic Experts Group) method or the like is performed. Various images for image data, such as processing to increase or decrease image data by increasing or decreasing the number of pixels, processing to cut out a part from image data, brightness adjustment processing or color adjustment processing to adjust the luminance component or color component of each pixel, etc. Perform processing as needed. The image processing unit 20 processes an eye region detected from a live view image including a face and corrects the live view image, and an eye processed by the image correction unit 201 in the live view image. And an enlargement processing unit 203 that enlarges a partial image including the region.

  The face detection unit 21 detects a face area (face area) in the image data by applying pattern matching which is a well-known technique based on the image data of the live view image. The organ detection unit 22 detects regions of face parts (facial organs) such as left and right eyes, nose, and lips in the face region detected by the face detection unit 21. In the present embodiment, the organ detection unit 22 detects eyes as a specific facial organ. Then, the organ detection unit 22 detects the left and right eye regions (eye regions) based on the detection results of the face regions by the face detection unit 21, and based on the detection results of the eye regions, The shape, the pupil portion in the eye region, the black eye region that is the iris portion around the pupil, and the like are specified. Face part data including face area position coordinates, eye area position coordinates, eye size, shape, and black eye area position coordinates in the live view image detected by the face detection unit 21 and the organ detection unit 22 Is stored in the SDRAM 17.

  The face dictionary 23 is a data table in which face images (face data) obtained by actually photographing a person are registered (stored) in association with a person ID uniquely assigned to the person, for example, according to a registration operation by the user. Face images are registered as needed. For example, the user registers a face image of the person in the face dictionary 23 by photographing the person to be registered.

  The person recognition unit 24 collates the face area in the live view image with the face dictionary 23 and recognizes (identifies) the face of a specific person included in the live view image. For example, the person recognizing unit 24 compares the face area detected from the live view image by the face detecting unit 21 with each face image registered in the face dictionary 23, and calculates the similarity. Then, the person recognizing unit 24 outputs the person ID of the face image having the highest similarity as the recognition result.

  The motion detection unit 25 detects a motion vector for each frame based on the image data of the live view image output from the imaging circuit 14 and outputs it as the amount of motion of the subject. The live view image is captured as needed every frame (for example, every 1/30 seconds), temporarily stored in the SDRAM 17, and displayed on the display unit 28 at a predetermined display frame rate. A motion vector is detected by obtaining a difference between adjacent live view images. Specifically, the motion detection unit 25 compares the image data of the live view image previously captured and stored for detecting the motion vector with the newly captured image data of the live view image. Ask for. Thereby, it is possible to detect a motion vector representing the amount of change in the same subject position shown in each live view image. Here, a motion vector may be detected by obtaining a difference between adjacent live view images, or motion detection may be performed at a predetermined frame interval. In addition, the detection of the motion vector is appropriately performed using a known technique.

  The CPU 26 reads and executes a camera program from the built-in memory 27 in response to an operation signal from the operation unit 31, etc., and gives instructions to each unit constituting the digital camera 1, transfers data, and the like to control the operation of the digital camera 1. Control. The CPU 26 includes a correction control unit 261. When correcting the live view image, the correction control unit 261 controls the image correction unit 201 to perform the correction process, and corrects the display frame rate of the live view image according to the time required for the correction process. The control is made slower than when there is no. For example, the live view image is corrected when the user selects a correction mode which is one of the settings related to the shooting mode. Then, in the shooting mode in which the correction mode such as the normal shooting mode is not selected, the live view image is not corrected. In the first embodiment, the correction control unit 261 controls the image stabilization control unit 16 to perform the image stabilization control process when the live view image is corrected.

  The built-in memory 27 is an electrically rewritable nonvolatile memory such as a flash memory, for example. The built-in memory 27 operates the digital camera 1 and realizes various functions provided in the digital camera 1. The various camera programs and data used during the execution of the camera program are recorded in advance. The data includes catchlight image data to be described later. The built-in memory 27 stores a correction control program 271 for causing the CPU 26 to function as the correction control unit 261. That is, the processing performed by the correction control unit 261 is realized by the correction control unit 261 reading and executing the correction control program 271 from the built-in memory 27, and this program itself realizes the function of the correction control unit 261. . The program recording medium is not limited to a flash memory, and an optical recording medium such as a CD-ROM or DVD-ROM, a magnetic recording medium such as an MD, a tape medium, or a semiconductor memory such as an IC card is used. it can.

  The display unit 28 displays various setting information of the digital camera 1 in addition to the photographed image and the live view image, and is realized by a display device such as an LCD (Liquid Crystal Display) or an EL display (Electroluminescence Display). Is done. The display drive circuit 29 drives the display unit 28. On the display unit 28, the live view image is redrawn at a predetermined display frame rate during the shooting mode and continuously displayed as a moving image, and the shot image is displayed during the playback mode.

  The operation unit 31 is for accepting various operations by the user, such as an instruction for photographing timing, a setting operation for various photographing modes including a correction mode and a playback mode, a setting operation for photographing conditions, and the like, and notifies the CPU 26 of an operation signal. It is realized by a button switch to which various functions are assigned. In the first embodiment, the operation unit 31 sets a correction mode as one of settings related to a shooting mode in accordance with a user operation as a correction setting unit. The operation unit 31 includes the release button 3, the power button 4, the menu button 5, the cross button 6, and the OK button 7 in FIG. 1.

  The communication I / F 30 is an interface for connecting the digital camera 1 to an external device such as a personal computer according to a communication standard such as USB (Universal Serial Bus).

  The removable memory 32 is a memory card that is detachable from the digital camera 1 such as an xD-Picture Card (registered trademark) or a CompactFlash (registered trademark) card. In the detachable memory 32, image data of a photographed image is written by a read / write device (not shown) corresponding to the type, or image data recorded in the detachable memory 32 is read by the read / write device.

  The power supply circuit 33 converts the power supplied by the battery 34 loaded therein into predetermined power and supplies it to each part of the digital camera 1.

  Here, an outline of the correction mode, which is one of the functions of the digital camera 1 configured as described above, will be described. The digital camera 1 according to the first embodiment changes the display frame rate of the live view image depending on whether the correction mode is selected as the setting relating to the shooting mode. Specifically, the display frame rate when the correction mode is selected is set lower than the display frame rate when the correction mode such as the normal shooting mode is not selected. FIG. 3 is a diagram for explaining the display / update timing of the live view image. The uppermost row indicates the image capture timing of the live view image on the image sensor 11. And the timing which displays the said captured image 1a is each shown by the 2nd and 3rd column according to the presence or absence of correction mode. The second is the first frame rate at the display / update timing of the live view image in the shooting mode in which the correction mode is not selected. The third is the second frame rate at the display / update timing of the live view image in the shooting mode in which the correction mode is selected.

  First, the image capture timing of the live view image at the image sensor 11 is set to a standard of 30 (frames / second). Since it is necessary to perform image processing for display in order to display the captured image Ia, the display timing is after a predetermined image processing time after capturing the image. If the display image processing time when the correction mode is not selected is 1/30 seconds or less, the captured image is displayed on the display unit 28 every time as shown in the first frame rate column. It can be updated and displayed as Ib. That is, the first frame rate is 30 (frames / second), which is the same as the capture rate.

  Next, when the correction mode is selected, extra processing accompanying correction is added to the normal display processing. In the example of this embodiment, it is assumed that the time required for image processing to which correction is added is 1/30 second or more. Then, the display at the same timing as the first frame rate is broken. Therefore, as shown in the second frame rate column, the captured live view image Ia is thinned out by one frame, image processing is performed every two frames, and the processed live view image Ic is updated and displayed on the display unit 28. . That is, the second frame rate is 15 (frames / second) which is half of the capture rate.

  Here, in the image processing performed when the correction mode is selected, in addition to display image processing, processing (correction processing) for detecting a face region from a live view image and processing the eye region is performed. That is, first, an eye area in the face area is detected. When a plurality of face areas are detected, an eye area is detected from each face area. Then, the detected eye area is processed. When two left and right eye areas are detected, each eye area is processed. The processing of the eye area is performed by, for example, synthesizing a catchlight image prepared for the catchlight in advance as an image for synthesis with the eye area. Here, the display frame rate when the correction mode is selected is set to 15 (frames / second). However, this display frame rate is an example, and should be set as appropriate according to the time required for the correction process. Can do.

  Next, the operation of the digital camera 1 will be described. FIG. 4 is a flowchart showing the basic operation of the digital camera 1. As shown in FIG. 4, when the power button 4 is pressed and the power is turned on (power ON) (step a1: Yes), the digital camera 1 transitions to a power ON state (step a3).

  When there is a menu operation (when the menu button 5 is pressed) (step a5: Yes), the operation proceeds to the menu operation (step a7). In this menu operation, the CPU 26 starts menu processing, displays a menu screen on the display unit 28, and presents menu items such as a mode setting menu and various shooting condition setting menus. Then, the CPU 26 performs a process according to the menu item selected by the user operation, and executes a process for setting a mode, setting / changing a shooting condition, and the like according to an operation signal from the operation unit 31. By the menu processing here, for example, a shooting mode, a playback mode, or the like can be set, and a normal shooting mode in which the correction mode is not selected as the shooting mode or a shooting mode in which the correction mode is selected can be set.

  If there is no menu operation (step a5: No), it moves to the operation according to the currently set mode. That is, when the current mode is the shooting mode (step a9: Yes), the process proceeds to the shooting mode operation (step a11). Here, when the shooting mode operation is started, a live view image display state in which a live view image is continuously displayed on the display unit 28 is set. In other words, the image data of the subject image formed on the image sensor 11 is temporarily stored in the SDRAM 17 and a series of processes for displaying the image data on the display unit 28 at a predetermined frame rate is repeated to perform live view. Display images continuously as a movie. Then, for example, photographing processing is performed at the timing when the release button 3 is pressed, and an image in the photographing range at this time is generated as a photographed image. On the other hand, when the current mode is not the shooting mode (step a9: No) and in the playback mode (step a13: Yes), the operation proceeds to the playback mode (step a15). At this time, for example, the CPU 26 performs control for reading out the image data of the photographed image recorded in the removable memory 32 and reproducing and displaying it on the display unit 28. If the current mode is not the playback mode (step a13: No) and other modes (step a17: Yes), the operation proceeds to the mode (step a19).

  When the power button 4 is pressed and the power is turned off (power OFF) (step a21: Yes), the digital camera 1 transitions to the power OFF state (step a23) and ends the basic operation. If the power is not turned off (step a21: No), the process returns to step a5.

  Next, the shooting mode operation of the digital camera 1 in the shooting mode will be described. FIG. 5 is a flowchart showing the shooting mode operation of the digital camera 1 in the first embodiment.

  As shown in FIG. 5, in the shooting mode operation, first, the imaging circuit 14 activates the imaging device 11 under the control of the CPU 26 (step b1). In the case of the image capture timing of the live view image (step b3: Yes), the process proceeds to step b7. In the case of the display / update timing of the live view image (step b5: Yes), the process proceeds to step b35. At this time, the CPU 26 determines the display / update timing of the live view image according to the set display frame rate. If it is not the image capture timing of the live view image (step b3: No) and not the display / update timing (step b5: No), the process proceeds to step b37.

  In step b7, photometric processing is performed, and then a live view image is captured (step b9). Subsequently, the CPU 26 determines the type of shooting mode. When the correction mode is selected as the shooting mode setting (step b11: Yes), the correction control unit 261 controls the image stabilization control unit 16 to perform the image stabilization control process. The image stabilization control unit 16 drives the vibration sensor 15 to perform image stabilization control processing (step b17). Then, the correction control unit 261 sets the display frame rate to the second display frame rate (step b19) and sets the correction flag (sets “ON”) (step b21).

  Subsequently, the face detection unit 21 performs face detection processing, and detects a face area from the live view image captured in step b9 (step b23). Then, the organ detection unit 22 performs face organ detection processing, and detects face parts such as the eye region based on the detection result of the face region by the face detection unit 21 (step b25). Here, when a plurality of faces are shown in the live view image and a plurality of face areas are detected, eye areas are detected for each face area. At this time, the organ detection unit 22 specifies the size and shape of the eyes, the black eye area, and the like based on the detection result of the eye area. If the face of the face is reflected in the live view image and two eye areas are detected from the face area, the eye size, shape, black eye area, etc. are specified for each of the two eye areas. .

  Subsequently, the image correction unit 201 processes the eye area in the detected live view image (if each of the left and right eye areas is detected, processes each eye area), and corrects the live view image. (Step b27). That is, first, the image correction unit 201 performs enlargement / reduction processing, trimming processing, or the like on the catchlight image based on the size and shape of the specified eye so that the catchlight image does not protrude from the eye area. Then, the image correction unit 201 synthesizes a catchlight image with the eye area. The catchlight image data is read from the built-in memory 27 and used.

  Here, the method for synthesizing the catchlight image is not particularly limited, and it may be synthesized by overwriting the color component and luminance component of the catchlight image, or only the luminance component of the catchlight image may be overwritten. It may be. For example, the color component and the luminance component may be overwritten for the black eye region, and only the luminance component may be overwritten for the white eye region. Also, the image used as the catchlight image is not particularly limited. For example, a plurality of types of catchlight images may be prepared in advance, and catchlight images designated by the user may be appropriately selected and used. Alternatively, the catch light image may be synthesized so as not to protrude from the pupil (black eye) region. That is, based on the size and shape of the black eye, the catchlight image is enlarged or reduced so as not to protrude from the pupil, and the catchlight image after the enlargement / reduction processing is trimmed so as to follow the outline of the black eye. Note that a predetermined shape such as a circular shape or an elliptical shape may be set in advance as a trimming shape. Alternatively, a circular or elliptical image may be prepared as a catchlight image. According to this, the processed template image can be combined as a catch light with the pupil portion of the eye region.

  On the other hand, when the shooting mode is not selected (step b11: No), the CPU 26 sets the display frame rate to the first display frame rate (step b31) and clears the correction flag (set to “OFF”). (Step b33).

  In step b35, control for displaying the live view image on the display unit 28 is performed. That is, when the correction mode is selected and the display frame rate is set to the second frame rate in step b19, for example, the display of the live view image corrected in step b27 is captured every two frames of the image. Update. Therefore, a sufficient time for correcting the live view image can be secured. On the other hand, if the correction mode is not selected and the display frame rate is set to the first frame rate in step b31, the display of the live view image is updated every frame.

  FIG. 6 is a diagram illustrating an example of a live view image including a face. FIG. 7 is a diagram showing an example of the corrected live view image, and shows a state in which the catchlight image is combined with the black eye portion of the face shown in the live view image of FIG. This live view image is an image obtained by detecting the eye area from the live view image of FIG. 6 and synthesizing the catch light image with the detected eye area. When the correction mode is selected as the setting related to the shooting mode, As shown in FIG. 7, the corrected live view image is displayed on the display unit 28.

  As shown in FIG. 5, in step b37, the CPU 26 determines whether the input operation is a shooting operation when there are various operation inputs such as a shooting operation, a mode switching operation, and a menu operation (step b37: Yes). Determine whether or not. In other words, when the input operation is a pressing operation of the release button 3 (step b39: Yes), a photographing process is performed to photograph a still image in the photographing range at this time (step b41), and step a11 in FIG. Return to On the other hand, if the input operation is an operation other than the shooting operation (step b39: No), the process returns to step a11 in FIG. 4 and then proceeds to step a21.

  FIG. 8 is a flowchart showing a detailed processing procedure of the photographing process. As shown in FIG. 8, in the photographing process, first, as photographing preparation operations, the AF unit 19 performs an AF (automatic focus) operation, and the AE unit 18 performs an AE (automatic exposure) operation (step c1). Then, the process proceeds to the photographing operation (step c3).

  When the photographing operation is finished, the CPU 26 determines a correction flag (step c5). When the correction flag is “ON”, as in steps b23 to b27 of FIG. 5, the face detection unit 21 performs face detection processing to detect a face area (step c7), and the organ detection unit 22 A face organ detection process is performed to detect an eye area in the face area (step c9), and the image correction unit 201 synthesizes the catchlight image to process the eye area and correct the image for imaging (step). c11). If the determination result in step c5 is “OFF”, or if the correction process in step c11 is completed, the process proceeds to step c13, where the captured image is compressed and recorded in the removable memory 32. That is, when the correction flag is “OFF”, the captured image obtained as a result of the imaging operation in step c3 is recorded in the removable memory 32. On the other hand, if the correction flag is “ON”, the captured image corrected in step c11 is recorded in the removable memory 32. In addition, you may make it record the picked-up image before correction processing in the attachment / detachment memory 32 with the picked-up image which carried out the correction process. Then, the process returns to step b41 in FIG.

  As described above, according to the first embodiment, the display frame rate of the live view image in the shooting mode in which the correction mode is selected is set according to the time required for the correction process, and the correction mode is selected. It can be slower than the display frame rate of the live view image in no shooting mode. According to this, it is possible to secure time for the correction processing for processing the eye region in the live view image and synthesizing the catchlight image. Therefore, since it is possible to appropriately perform correction processing on the live view image in real time without complicating the configuration, shooting is performed while confirming in advance the effect of combining the catchlight image with the eye area of the subject including the face. There is an effect that can be. In addition, since the display frame rate of the live view image only needs to be slower than usual according to the time required for the correction process, there is little influence on the shooting. Furthermore, image stabilization of the live view image due to vibration of the camera body 2 such as camera shake can be suppressed by the camera shake correction function realized by the vibration sensor 15 and the image stabilization control unit 16. Therefore, the catch light can be prevented from being displaced due to the shake of the eye position, so that the accuracy of the correction process can be improved and the correction process can be performed more appropriately.

(Embodiment 2)
Next, a second embodiment will be described. The second embodiment can be realized by the digital camera 1 having the system configuration shown in FIG. 2, and the same reference numerals are given to the respective components in the following.

  In the second embodiment, the correction control unit 261 of the CPU 26 sets whether or not the image correction unit 201 corrects the live view image as in the first embodiment. When the correction mode is selected and the live view image is corrected and the face area is detected from the live view image by the face detection unit 21, the correction control unit 261 uses the image correction unit 201. Control is performed so that the correction process is performed, and control is performed so that the display frame rate of the live view image is slower than when no correction is performed according to the time required for the correction process.

  FIG. 9 is a flowchart showing the shooting mode operation of the digital camera 1 in the second embodiment. In FIG. 9, the same processing steps as those in FIG. As shown in FIG. 9, in the shooting mode operation of the second embodiment, when the correction mode is selected as a result of determining the type of shooting mode in step b11 (step b11: Yes), the face detection unit 21 detects the face. A detection process is performed, and a face area is detected from the live view image captured in step b9 (step d13). If the face area is detected (step d14: Yes), the process proceeds to step b19, and the correction control unit 261 sets the display frame rate to the second display frame rate in the same manner as in the first embodiment. Then, after the correction control unit 261 sets the correction flag (step b21), the organ detection unit 22 performs face organ detection processing, and based on the detection result of the face area performed by the face detection unit 21 in step d13, Face parts such as the eye area are detected (step b25). On the other hand, when the correction mode is not selected (step b11: No), the process proceeds to step b31. Even when the correction mode is selected, when a face area is not detected (step d14: No), the process proceeds to step b31 to set the display frame rate as the first display frame rate.

  As described above, according to the second embodiment, the display frame rate of the live view image when the correction mode is selected and the face area is detected from the live view image is used for the correction process. Depending on the time required, it can be slower than the display frame rate of the live view image in the shooting mode in which the correction mode is not selected. Here, even when the correction mode is selected, if the face area is not detected from the live view image, the live view image is not corrected, and the correction mode is selected for the live view image. Displayed at the normal display frame rate (first frame rate) when there is no frame. According to this, the same effect as in the first embodiment is achieved, and the correction is set because the live view image is corrected by reducing the display frame rate only when the face is included in the live view image. However, if there is no face on the screen, a smooth live view image is displayed, and correction processing can be performed appropriately.

(Embodiment 3)
Next, Embodiment 3 will be described. The third embodiment can be realized by the digital camera 1 having the system configuration shown in FIG. 2, and the same reference numerals are given to the respective components in the following.

  In the third embodiment, when the user selects the enlarged preview display mode as the setting relating to the correction mode, the live view image is corrected, and the live view image obtained by enlarging the partial image including the processed eye area is displayed. That is, the correction control unit 261 of the CPU 26 sets whether or not the image correction unit 201 corrects the live view image as in the first embodiment. At this time, the correction control unit 261 sets whether or not to enlarge the partial image. Then, when the enlarged preview display mode is selected, the partial image is enlarged and displayed. When the face detection unit 21 detects a face area from the live view image, the correction control unit 261 displays the image correction unit. 201 performs correction processing, and controls the enlargement processing unit 203 to perform enlargement processing. In addition, the correction control unit 261 performs control to make the display frame rate of the live view image slower than the case where correction is not performed according to the time required for the correction process.

  FIG. 10 is a flowchart illustrating the shooting mode operation of the digital camera 1 according to the third embodiment. In FIG. 10, the same processing steps as those in FIG. As shown in FIG. 10, in the shooting mode operation of the third embodiment, when the correction mode is selected as a result of determining the type of shooting mode in step b11 (step b11: Yes), the face detection unit 21 detects the face. Detection processing is performed, and a face area is detected from the live view image captured in step b9 (step e12). When a face area is detected (step e13: Yes), the correction control unit 261 sets a correction flag (step e14).

  Subsequently, the correction control unit 261 determines the setting of the correction mode, and when the enlarged preview display mode is selected (step e15: Yes), the process proceeds to step b19, and the correction control unit 261 performs the first embodiment. The display frame rate is set to the second display frame rate in the same manner as described above. Subsequently, the organ detection unit 22 performs a face organ detection process, and detects face parts such as an eye region based on the detection result of the face region performed by the face detection unit 21 in step e12 (step b25). Then, after the image correction unit 201 processes the eye region and corrects the live view image (step b27), the enlargement processing unit 203 enlarges the partial image including the processed eye region (step e29).

11 and 12 are diagrams for explaining the principle of enlargement processing. First, as shown in FIG. 11, a partial image I1 including a processed eye region in the live view image is extracted. For example, the partial image I1 is extracted by obtaining the coordinate values of (x ₁ , y ₁ ) and (x ₂ , y ₂ ) based on the position of the eye region. Subsequently, the partial image I1 is enlarged at a predetermined magnification set in advance. Then, as shown in FIG. 12, the enlarged partial image I3 is arranged, for example, so as to coincide with the center position of the partial image I1 (FIG. 11) before the enlargement process, and is displayed on the display unit 28 as a live view image. 11 and 12 exemplify the case where the partial image including the left eye region is enlarged among the processed left and right eye regions, the partial image including the right eye region is extracted and enlarged. Processing may be performed, or partial images including both the left and right eye regions may be extracted and enlarged.

  On the other hand, as shown in FIG. 10, when the correction mode is not selected (step b11: No), the correction flag is cleared (step e31), and the process proceeds to step e33. Even when the correction mode is selected, when the face area is not detected (step e13: No), the correction flag is cleared (step e31), and the process proceeds to step e33. If the enlarged preview display mode is not selected (step e15: No), the process proceeds to step e33. In step e33, the CPU 26 sets the display frame rate to the first display frame rate.

  As described above, according to the third embodiment, when the correction mode is selected and the enlarged preview display mode is selected, the live view image when the face area is detected from the live view image is displayed. The display frame rate can be made slower than the display frame rate of the live view image in the shooting mode in which the correction mode is not selected according to the time required for the correction process. Here, even when the correction mode is selected, only when the enlarged preview display mode is selected, that is, when there is an instruction that positively confirms the effect of the correction, the live view image is displayed. Correction processing is performed. Even when the correction mode is selected, if the enlarged preview display mode is not selected, the live view image has a normal display frame rate (first frame rate when the correction mode is not selected). ) Is displayed. According to this, the same effect as in the first embodiment can be obtained, and the partial image including the processed eye region can be enlarged. Therefore, even if the eye area, which is a processing location in the live view image, is smaller than the size of the live view image, this processing effect can be easily confirmed. Further, when the user selects the enlargement preview mode, the live view image correction process can be performed, the processed portion can be displayed in an enlarged manner, and the correction process and the enlargement process can be performed as necessary. For example, although correction is desired, it is possible to display an image at a normal frame rate during live view with a simple operation.

(Embodiment 4)
Next, a fourth embodiment will be described. The fourth embodiment can be realized by the digital camera 1 having the system configuration shown in FIG. 2, and the same reference numerals are given to the respective components in the following.

  In the fourth embodiment, the correction control unit 261 of the CPU 26 sets whether or not the image correction unit 201 corrects the live view image as in the first embodiment. When the correction mode is selected and the live view image is corrected and the face area is detected from the live view image by the face detection unit 21, the correction control unit 261 uses the image correction unit 201. Control is performed so that the correction process is performed, and control is performed so that the display frame rate of the live view image is slower than when no correction is performed according to the time required for the correction process.

  FIG. 13 is a flowchart illustrating the shooting mode operation of the digital camera 1 according to the fourth embodiment. In FIG. 13, the same processing steps as those in FIG. As shown in FIG. 13, in the shooting mode operation of the fourth embodiment, when the correction mode is selected as a result of determining the type of shooting mode in step b11 (step b11: Yes), the same as in the second embodiment. Then, the face detection unit 21 performs face detection processing (step f13). When the face area is detected (step f14: Yes), the person recognition unit 24 performs a person recognition process (step f15). That is, the person recognizing unit 24 collates the face area detected by the face detecting unit 21 with the face dictionary 23 and recognizes the face of the specific person included in the live view image. Here, the specific person to be recognized is set by accepting, for example, a user operation for designating a specific person from face images registered in the face dictionary 23 in advance. If the face of the specific person included in the live view image is recognized as a result of the recognition (step f16: Yes), the process proceeds to step b19, and the display frame rate is set to the second display frame in the same manner as in the first embodiment. The rate is used to correct the live view image. The correction process performed here is performed only for the eye area of the specific person. On the other hand, when the correction mode is not selected (step b11: No), the process proceeds to step b31. Even when the correction mode is selected, when a face area is not detected (step f14: No), or when the face of a specific person is not recognized from the live view image (step f16: No), Moving to step b31, the display frame rate is set as the first display frame rate.

  As described above, according to the fourth embodiment, when the correction mode is selected, the face area detected from the live view image is recognized as the face of a specific person specified in advance by a user operation or the like. In this case, the display frame rate of the live view image can be made slower than the display frame rate of the live view image in the shooting mode in which the correction mode is not selected according to the time required for the correction process. Here, even if the correction mode is selected, if the face area is not detected from the live view image, or if the face area is not recognized as the face of the specific person even if it is detected The live view image is not corrected, and the live view image is displayed at the normal display frame rate (first frame rate) when the correction mode is not selected. According to this, while having the same effect as Embodiment 1, it is possible to perform correction processing by processing only the eye area of a specific person, and it is possible to confirm this processing effect in advance.

(Embodiment 5)
Next, a fifth embodiment will be described. The fifth embodiment can be realized by the digital camera 1 having the system configuration shown in FIG. 2, and the same reference numerals are given to the respective components in the following.

  In the fifth embodiment, the correction control unit 261 of the CPU 26 sets whether or not the image correction unit 201 corrects the live view image as in the first embodiment. When the correction mode is selected and the live view image is corrected, the face area is detected from the live view image by the face detection unit 21 and the motion amount of the subject detected by the motion detection unit 25 is predetermined. The correction control unit 261 controls the image correction unit 201 to perform the correction process when the threshold value K is equal to or less than the threshold value K, and does not correct the display frame rate of the live view image according to the time required for the correction process. Control slower than that. Here, as the value of the threshold value K, a value that can be estimated that the amount of movement of the subject is sufficiently small and the subject does not move is set in advance.

  FIG. 14 is a diagram illustrating an example of a live view image including a person P. In FIG. 14, the position of the person P in the live view image captured before (immediately before) is indicated by a two-dot chain line. The position of the person P in the live view image captured before (two before) is indicated by a one-dot chain line. That is, the movement of the person P between the live view image captured two times before and the previously captured live view image moves greatly from the position indicated by the alternate long and short dash line to the position indicated by the alternate long and two short dashes line. On the other hand, between the live view image captured last time and the live view image captured this time, the person P moves from the position indicated by the two-dot chain line to the position indicated by the solid line, and the amount of movement is small. P's movement is almost stopped. In the fifth embodiment, when a face area is detected from a live view image, the amount of movement of the subject between the live view images is detected, and the presence or absence of the subject movement is estimated by comparing the amount of movement with a predetermined threshold K. To do.

Here, the amount of motion of the subject is determined based on the detection result of the motion detection unit 25, and when the amount of motion is sufficiently small, the display frame rate is slowed down and the live view image correction processing is performed. The method for determining the amount of movement of the subject is not limited to this. In other words, the amount of change in the position of the face area between adjacent live view images may be calculated based on the position of the face area detected by the face detection unit 21. FIG. 15 is a diagram illustrating the calculation principle of the amount of change in the position of the face region. For a subject whose position has changed as shown in FIG. 14, the person P indicated by a solid line, a one-dot chain line, and a two-dot chain line in FIG. The change of the position of the face area is shown. As shown in FIG. 15, for example, the amount of change in the center positions C _n−2 , C _n−1 , and C _n of the face area detected from the live view image may be calculated. Then, the presence or absence of the movement of the subject may be estimated by comparing the amount of change with a predetermined threshold.

  FIG. 16 is a flowchart showing the shooting mode operation of the digital camera 1 according to the fifth embodiment. In FIG. 16, the same processing steps as those in FIG. As shown in FIG. 16, in the shooting mode operation of the fifth embodiment, when the correction mode is selected as a result of determining the type of shooting mode in step b11 (step b11: Yes), the same as in the second embodiment. Then, the face detection unit 21 performs face detection processing (step g13). When a face area is detected (step g14: Yes), a correction flag is set (step g15).

  Next, the motion detection unit 25 performs a motion detection process (step g16). That is, the motion detection unit 25 detects a motion vector representing a change amount of the same subject position shown in an adjacent live view image as a subject motion amount. Then, when it is estimated that the amount of motion is equal to or less than a predetermined threshold value K set in advance as a result of motion detection and there is no subject motion (step g17: Yes), the process proceeds to step b19, and is the same as in the first embodiment. In this manner, the display frame rate is set to the second display frame rate, and the live view image is corrected. On the other hand, when the correction mode is not selected (step b11: No), or when the face area is not detected (step g14: No), the correction flag is cleared (step g31), and the process proceeds to step g33. Even when the correction mode is selected, if it is estimated that the amount of motion is greater than the threshold value K and the subject is moving (step g17: No), the process proceeds to step g33, and the display frame rate is changed. The first display frame rate is assumed.

  As described above, according to the fifth embodiment, when the correction mode is selected and the face area is detected from the live view image and it is estimated that there is no movement of the subject, the live view The display frame rate of the image can be made slower than the display frame rate of the live view image in the shooting mode in which the correction mode is not selected according to the time required for the correction process. Here, even when the correction mode is selected, when the face area is not detected from the live view image or when the movement amount of the subject is large even if it is detected, the live view image The correction process is not performed, and the live view image is displayed at the normal display frame rate (first frame rate) when the correction mode is not selected. According to this, the same effect as in the first embodiment can be obtained, and the correction process can be prevented from being performed when the subject's movement is large, so that the accuracy of the correction process is improved and the correction is performed more appropriately. Can be processed.

  The preferred embodiment of the present invention has been described above, but the present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the spirit of the invention.

  For example, in the above-described embodiment, the case where the catchlight image is synthesized with the eye area detected from the live view image has been described. However, the eye processing is appropriately performed by performing image processing such as brightness adjustment processing, color adjustment processing, and transparency processing. The region may be processed and the live view image may be corrected.

  In addition, as an example of processing of a specific facial organ region, a case where a catchlight image is combined with an eye region has been described, but the present invention is not limited to this.

  For example, the size of the black eye included in the eye area may be changed and processed to correct the live view image. FIG. 17 is a diagram for explaining the outline of the correction processing in this modification. In this case, the eye area A11 is detected and the black eye area A13 is specified (a). Subsequently, the diameter D11 is calculated from the detected black eye area A13 (b). Then, for example, the diameter D13 of the corrected black eye is calculated by multiplying by a predetermined magnification set in advance (c). Then, a black-eye area A15 processed by enlarging the black-eye size based on the calculated black-eye diameter D13 after correction processing is obtained (d).

  Alternatively, the color of the black eye area included in the eye area may be changed and processed to correct the live view image. FIG. 18 is a diagram for explaining the outline of the correction processing in this modification. In this case, the eye area A21 is detected and the black eye area A23 is specified (a). Then, the color of the surrounding area A25 excluding the central part of the detected black eye area A23 is changed to process the black eye area A23 (b).

  In the above-described embodiment, the case where the eye region is detected as the specific facial organ region has been described. However, the present invention is not limited to this. For example, the mouth region (mouth region) is used as the specific facial organ. It may be detected.

  For example, a lip region (lip region) included in the mouth region may be detected, and image processing such as brightness adjustment processing and color adjustment processing may be appropriately performed on the lip region for processing and correction processing. FIG. 19 is a diagram illustrating an example of a live view image including a face. FIG. 20 is a diagram showing an example of the corrected live view image, and shows a state in which the lip portion of the face shown in the live view image of FIG. 19 is processed. The live view image shown in FIG. 20 is an image obtained by detecting the lip region from the live view image of FIG. 19, detecting the position where the luminance value in the detected lip region is maximum, and performing correction processing. That is, in the present modification, for example, correction processing such as changing the color of the predetermined range (A31) in the lip region with the position where the detected luminance value is the maximum as the reference position, or changing the luminance value is performed. Or it is good also as performing the correction process which emphasizes brightness about the area | region where a luminance value is more than predetermined value. Alternatively, a synthesis image prepared in advance at a position having the maximum luminance value may be synthesized. According to this, it is possible to generate a glossy feeling and a three-dimensional feeling by processing the lip region.

  Alternatively, a tooth region included in the mouth region may be detected, the detected tooth region may be processed into white, and the live view image may be corrected. FIG. 21 is a diagram for explaining the outline of the correction processing in the present modification. In this case, first, the mouth area A41 is detected, and the tooth area A43 is detected from the detected mouth area A41 (a). Then, the detected tooth region A43 is processed to have a white color, or a process for increasing the luminance is performed so that the glossiness is obtained (b).

  Further, the present invention is not limited to the above-described embodiments as they are, and various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiments. For example, some components may be excluded from all the components shown in the embodiment. Or you may form combining the component shown in different embodiment suitably.

  In addition, the processing performed by the correction control unit 261 is not limited to being realized as software by executing a program (correction control program 271), and part or all of the processing may be configured by hardware. On the other hand, the configuration in which the image processing unit 20, the image correction unit 201, the enlargement processing unit 203, the organ detection unit 22, the face detection unit 21, the person recognition unit 24, the motion detection unit 25, and the like are realized by hardware has been described. It is good also as implement | achieving as software by running this program.

  In the above embodiment, a digital camera has been described as a specific example of the imaging apparatus. However, the present invention is not limited to this, and the present invention may be applied to a camera unit of a mobile phone or a camera unit attached to a PC. The case where the correction processing is performed by processing still image data has been described, but the target of the correction processing is not limited to still image data, and can be similarly applied to moving image data.

2 is a rear view of the digital camera 1. FIG. 1 is a block diagram showing a system configuration of the digital camera 1. FIG. It is a figure explaining the display and update timing of a live view image. 3 is a flowchart showing a basic operation of the digital camera 1. 3 is a flowchart illustrating a shooting mode operation of the digital camera 1 according to the first embodiment. It is a figure which shows an example of the live view image containing a face. It is a figure which shows an example of the live view image which carried out the correction process. It is a flowchart which shows the detailed process sequence of an imaging | photography process. 6 is a flowchart illustrating a shooting mode operation of the digital camera 1 according to the second embodiment. 10 is a flowchart illustrating a shooting mode operation of the digital camera 1 according to the third embodiment. It is a figure explaining the principle of an expansion process. It is another figure explaining the principle of an expansion process. 10 is a flowchart illustrating a shooting mode operation of the digital camera 1 according to the fourth embodiment. It is a figure which shows an example of the live view image containing a person. It is a figure which shows the calculation principle of the variation | change_quantity of the position of a face area. 10 is a flowchart illustrating a shooting mode operation of the digital camera 1 according to the fifth embodiment. It is a figure explaining the outline | summary of the correction process in a modification. It is a figure explaining the outline | summary of the correction process in another modification. It is a figure which shows an example of the live view image containing a face. It is a figure which shows an example of the live view image which carried out the correction process. It is a figure explaining the outline | summary of the correction process in another modification.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital camera 2 Camera body 3 Release button 5 Menu button 6 Cross button 7 OK button 11 Image sensor 12 Lens system unit 13 Lens drive circuit 14 Imaging circuit 15 Vibration sensor 16 Anti-vibration control part 17 SDRAM
18 AE unit 19 AF unit 20 image processing unit 201 image correction unit 203 enlargement processing unit 21 face detection unit 22 organ detection unit 23 face dictionary 24 person recognition unit 25 motion detection unit 26 CPU
261 Correction control unit 27 Built-in memory 271 Correction control program 28 Display unit 29 Display drive circuit 30 Communication I / F
31 Operation Unit 32 Detachable Memory 33 Power Supply Circuit 34 Battery 35 Bus

Claims (12)

An imaging unit for photographing a subject;
A display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate;
An organ detection unit for detecting a region of a specific facial organ included in the face from a live view image including a face of the live view image;
An image correction unit that corrects the live view image by processing a region of the facial organ detected by the organ detection unit;
A correction setting unit for setting whether the image correction unit corrects the live view image;
When the setting to perform the correction is made, the image correction unit controls to perform the correction process, and the display frame rate of the live view image in the setting to perform the correction is not corrected. A correction control unit that performs control to be slower than the display frame rate in the case of setting according to the time required for the correction process;
An imaging apparatus comprising:   The imaging apparatus according to claim 1, wherein the image correction unit processes the facial organ region by combining a predetermined composition image with the specific facial organ region. The organ detection unit detects an eye region included in a face of the live view image using the specific facial organ as an eye,
The imaging apparatus according to claim 2, wherein the image correction unit synthesizes a catchlight image with an eye region detected by the organ detection unit. A camera shake correction unit that detects the vibration of the apparatus body and controls the driving of the imaging unit based on the detection result,
The imaging apparatus according to claim 1, wherein the correction control unit performs control to operate the camera shake correction unit when the correction is set to be performed. A face detection unit for detecting a face area from the live view image;
The correction control unit performs control to slow down the display frame rate when a face area is detected from the live view image by the face detection unit when the correction is set. The imaging device according to claim 1. The image correction unit includes an enlargement processing unit that enlarges a partial image including the processed facial organ region in the live view image,
The imaging apparatus according to claim 1, wherein the correction control unit controls the enlargement processing unit to perform the enlargement processing when the correction is set to be performed. A face data storage unit storing a plurality of face data;
A face detection unit for detecting a face region from the live view image;
A person recognition unit that compares the face area detected by the face detection unit with the face data stored in the face data storage unit, and recognizes the face of a specific person included in the live view image;
With
The correction control unit is configured to perform the correction, and when the person recognition unit recognizes a face of a specific person included in the live view image, the image correction unit performs the correction process. The image pickup apparatus according to claim 1, wherein control is performed so as to reduce the display frame rate. A motion detection unit that detects the motion of the subject in the live view image;
The correction control unit performs control to slow down the display frame rate when there is no movement of the subject as a result of detection by the motion detection unit when the correction is set. Item 2. The imaging device according to Item 1. From an imaging unit that captures a subject, a display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate, and a live view image including a face of the live view image An organ detection unit that detects a region of a specific facial organ included in the face; an image correction unit that processes the region of the facial organ detected by the organ detection unit to correct the live view image; and A correction control device provided in an imaging apparatus including a correction setting unit configured to set whether or not the image correction unit corrects the live view image;
When the setting to perform the correction is made, the image correction unit controls to perform the correction process, and the display frame rate of the live view image in the setting to perform the correction is not corrected. A correction control apparatus that performs control so as to be slower than the display frame rate in the case of setting according to the time required for the correction processing. From an imaging unit that captures a subject, a display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate, and a live view image including a face of the live view image An organ detection unit that detects a region of a specific facial organ included in the face; an image correction unit that processes the region of the facial organ detected by the organ detection unit to correct the live view image; and A correction control method in an imaging apparatus comprising: a correction setting unit that sets whether or not the image correction unit corrects the live view image,
When the setting to perform the correction is made, the image correction unit controls to perform the correction process, and the display frame rate of the live view image in the setting to perform the correction is not corrected. A correction control method, characterized in that control is performed so as to be slower than the display frame rate in the case of setting according to the time required for the correction processing. A computer of an imaging apparatus comprising: an imaging unit that captures a subject; and a display unit that updates and displays a subject image captured by the imaging unit as a live view image at a predetermined display frame rate.
A detection step of detecting a region of a specific facial organ included in the face from a live view image including a face of the live view image;
A correction step of correcting the live view image by processing a region of the facial organ detected in the organ detection step;
A setting step for setting whether to correct the live view image;
When correction is set in the setting step, the correction process is controlled to be performed in the correction step, and the display frame rate of the live view image in the setting for correction is set to the correction. A correction control step for controlling the display frame rate to be slower than the display frame rate in the case of setting not to be performed according to the time required for the correction processing;
A program characterized by having executed. The detection step detects an eye region included in the face of the live view image using the specific facial organ as an eye,
The program according to claim 11, wherein the correcting step synthesizes a catchlight image with the eye area detected in the detecting step.