JP2010136214A - Camera, and method and program for controlling the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera for correcting captured images without affecting normal camera operation after imaging, and to provide a method and a program for controlling cameras. <P>SOLUTION: An imaging section 10 captures a subject to generate a captured image. An operation section 26 inputs camera operation instructions or the like. A face image correction section 181 applies predetermined correction to the captured image for recording generated by the imaging section 10 when an imaging instruction is input by the operation section 26. A correction control section 211 interrupts the correction of the face image correction section 181 when any user operation including operation instructions of a digital camera 1 is input by the operation section 26 after the imaging, and resumes the correction of the face image correction section 181 if no new operation is input after processing according to the input user's operation. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a camera, a control method for the camera, and a control program.

  In recent years, a face detection technique for detecting a face such as a person included in an image, and face parts such as eyes, mouth, and nose constituting the face has been known and is used in various fields. For example, a camera that uses this face detection technology to specify the position of a face within the shooting range, and performs focusing and exposure control during shooting based on the specified face position has been put into practical use.

  Furthermore, recently, various image processing techniques for performing correction processing on a face area or an area of each face part in an image detected using a face detection technique have been proposed. For example, Patent Document 1 discloses an image processing method in which an eye image or an image feature amount is registered in advance, and an eye region in a captured image is corrected (corrected) using the eye image or image feature amount. Has been.

JP 2007-157176 A

  By applying the image processing technology as described above to the camera and correcting the face in the image when taking a picture of a person as a subject, it becomes possible to make the facial expression of the person appear brighter or more beautiful. . Here, it is desirable that the timing for performing the correction process on the photographed image is immediately after photographing. Although a specification for performing correction processing in response to a user's operation input at a timing different from that at the time of shooting, such as at the time of reproduction display of a shot image, can be considered, the operation is troublesome for the user and is not preferable. However, the correction process takes some time. For this reason, when correction processing is performed immediately after shooting, there is a problem that the camera cannot move to normal camera operation such as next shooting or playback display of the shot image until the correction processing is completed. .

  The present invention has been made in view of the above, and provides a camera, a camera control method, and a control program capable of performing correction processing on a captured image without affecting normal camera operation after shooting. The purpose is to do.

  In order to solve the above-described problems and achieve the object, a camera according to the present invention includes an imaging unit that shoots a subject and generates a captured image, an operation unit for inputting an operation instruction of the camera, and the operation unit An image correction unit that executes a predetermined correction process on a recorded image generated by the imaging unit in response to the shooting instruction when the camera operation instruction input from the camera is a shooting instruction; A correction control unit that controls execution of correction processing by the image correction unit, and a recording control unit that performs control to record the recording image that has been corrected by the image correction unit in the recording unit as a recorded image. The correction control unit interrupts the correction process by the image correction unit when an operation instruction of the camera is input from the operation unit during the execution of the correction process by the image correction unit. After the processing according to, characterized in that resuming the correction processing by said disrupting the image correcting unit.

  Further, the camera according to the present invention includes an organ detection unit that detects a face from the captured image for recording and detects a predetermined facial organ included in the detected face in the above-described invention, and the image correction unit Is characterized in that as the correction process, a process of correcting the region of the facial organ detected by the organ detection unit is performed.

  In the camera according to the present invention, in the above invention, the correction control unit may be configured such that the camera operation instruction input during execution of the correction process by the image correction unit is a power-off instruction for the camera. The correction processing by the interrupted image correction unit is resumed, and the power of the camera is shut off after the correction processing is completed.

  In the camera according to the present invention, in the above invention, the correction control unit may perform the shooting when the operation instruction of the camera input during the execution of the correction process by the image correction unit is the shooting instruction. The correction process by the image correction unit is interrupted when an instruction is input.

  Further, the camera according to the present invention includes, in the above invention, at least a display unit for displaying the recorded image and a display control unit that performs control for displaying the recorded image on the display unit. When the camera operation instruction input during execution of the correction process by the image correction unit is a reproduction instruction for the recorded image, the control unit corrects the image correction unit at the time when the reproduction instruction is input. The processing is interrupted, and the display control unit performs control to display the recording image for which the correction processing is interrupted as a processing image and to display the processing image together with the recording image. .

  In the camera according to the present invention, in the above invention, the image correction unit may be a display small-sized image obtained by reducing the recording image before the correction process performed on the recording image. The correction processing is performed on the image, and the display control unit performs control to display the small image for display after the correction processing as the image being processed.

  A camera control method according to the present invention is a camera control method including an imaging unit that captures a subject and generates a captured image, and an operation unit that inputs an operation instruction of the camera, An image correction step of performing a predetermined correction process on a recorded photographed image generated by the imaging unit in response to the photographing instruction when the camera operation instruction input from the operation unit is a photographing instruction; , A correction control step for controlling the execution of the correction process in the image correction step, and a recording control for performing control for recording the recorded image for recording after the correction processing in the image correction step as a recorded image in a recording unit The correction control step interrupts the correction processing in the image correction step when an operation instruction of the camera is input from the operation unit during the execution of the correction processing in the image correction step. , Enter After the processing according to the the operation instruction, and wherein the resuming the correction process in the interrupted the image correction process was.

  The control program according to the present invention is input from the operation unit to a camera computer including an imaging unit that captures a subject and generates a captured image, and an operation unit for inputting a camera operation instruction. When the camera operation instruction is a photographing instruction, an image correction step for executing a predetermined correction process on the recording photographed image generated by the imaging unit in response to the photographing instruction; and the image correction step A correction control step for controlling the execution of the correction process at the recording step, and a recording control step for performing a control for recording the recorded image for recording that has been subjected to the correction process in the image correction step as a recorded image in a recording unit. The correction control step is configured to issue an instruction to operate the camera from the operation unit during execution of the correction process in the image correction step. The correction processing in the image correction step is interrupted when it is force, after the processing corresponding to the input operation instruction, and wherein the resuming the correction processing in the image correction step that is the interruption.

  According to the present invention, when a camera operation instruction is input, the correction process for the recording image to be recorded can be interrupted, and the correction process can be resumed after the process corresponding to the input camera operation instruction. Therefore, it is possible to perform correction processing on a captured image after shooting without affecting normal camera operation.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, a digital camera to which the camera of the present invention is applied will be described. Note that the present invention is not limited to the embodiments. Moreover, in description of each drawing, the same code | symbol is attached | subjected and shown to the same part.

(Embodiment)
FIG. 1 is a rear view of the digital camera 1. As shown in FIG. 1, the digital camera 1 includes a release switch (shutter switch) 3 for instructing photographing timing provided on the upper surface of the camera body 2, and a power switch 4 provided on the back surface of the camera body 2. And a menu switch 5, a cross key 6 having up / down / left / right direction switches (upper switch, lower switch, left switch and right switch), an OK switch 7 for confirming operation contents, a shooting mode and a playback mode. A playback switch 8 for switching, a display unit 23 for displaying various screens, and the like are provided. The power switch 4 is used for switching and inputting power on / off of the digital camera 1 and is realized by using, for example, a slide switch. The release switch 3 is, for example, a two-stage press button. When the release switch 3 is half-pressed, the first release switch is turned ON, and when the release switch 3 is fully pressed, the second release switch is turned ON. Although not shown, a flash, an imaging lens, and the like are disposed on the front surface of the camera body 2.

  When the power switch 4 is slid in the digital camera 1 to give an instruction to turn on the power, the digital camera 1 enters a state where it can shoot (shooting mode). In the shooting mode, a subject image incident through the imaging lens is output every frame (for example, 1/30 second) and continuously displayed in real time on the display unit 23 as a live view image. While viewing the view image, the release switch 3 is pressed to shoot a still image or a moving image. On the other hand, when the power is turned on, the shooting mode and the playback mode are switched according to the pressing operation of the playback switch 8. In this playback mode, the user enjoys displaying (playing back) still images and moving images captured by the digital camera 1 on the display unit 23.

  FIG. 2 is a block diagram showing a system configuration of the digital camera 1. As shown in FIG. 2, the digital camera 1 includes an imaging device 11, a lens system unit 12, a lens driving circuit 13, an imaging circuit 14, an SDRAM (Synchronous Dynamic Random Access Memory) 15, an AE unit 16, AF unit 17, image processing unit 18, organ detection unit 20, CPU 21, built-in memory 22, display unit 23, display drive circuit 24, communication I / F 25, operation unit 26, and recording unit A removable memory 27, which is an example, a power supply circuit 28, and a battery 29 are provided. The imaging circuit 14, SDRAM 15, AE unit 16, AF unit 17, image processing unit 18, organ detection unit 20, CPU 21, display drive circuit 24, and removable memory 27 are connected via a bus 30. Further, the image sensor 11, the lens system unit 12, the lens driving circuit 13, and the imaging circuit 14 constitute an imaging unit 10 that photoelectrically converts a subject image to generate image data of a captured image.

  The image pickup device 11 is an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and photoelectrically converts a subject image incident through the lens system unit 12 in units of frames and outputs an analog electric signal. To do. The lens system unit 12 includes an imaging lens including an AF (Auto-Focus) lens, a zoom lens, and the like, a diaphragm, a shutter, and the like. The lens driving circuit 13 drives the lens system unit 12.

  The imaging circuit 14 performs analog signal processing such as CDS (Correlated Double Sampling) and AGC (Automatic Gain Control) on the analog electrical signal output from the imaging device 11 and converts the analog electrical signal into a digital electrical signal. Digital signal processing such as pixel interpolation processing and color correction processing is performed on the digital electrical signal and output as image data. This image data is temporarily recorded in the SDRAM 15.

  The SDRAM 15 is used for temporary recording of image data output from the imaging circuit 14 and image data being processed by the image processing unit 18. For example, image data of a display photographed image (hereinafter referred to as “live view image”) output from the imaging circuit 14 for each frame, or a recording photographed image output from the imaging circuit 14 at the photographing timing. Image data (hereinafter simply referred to as “photographed image”) and the like are temporarily recorded. In the shooting mode, which is one of the operation modes of the digital camera 1, the subject image formed on the image sensor 11 is updated and displayed on the display unit 23 continuously (moving image) in real time. The live view image refers to this image.

  The AE unit 16 performs automatic exposure based on the image data output from the imaging circuit 14. The AF unit 17 performs automatic focus adjustment based on the image data output from the imaging circuit 14.

  The image processing unit 18 performs various types of image processing on the image data output from the imaging circuit 14 and performs processing for converting the image data into image data suitable for recording and display. For example, when recording image data of a photographed image or displaying recorded image data, image data compression processing or decompression processing based on a JPEG (Joint Photographic Experts Group) method or the like is performed. In addition, resizing processing to increase / decrease image data by increasing / decreasing the number of pixels, trimming processing to cut out a part from the image data, brightness adjustment processing to adjust the luminance component and color component of each pixel, color adjustment processing, transparency processing, etc. Perform various image processing on data as needed.

  The image processing unit 18 includes a face image correction unit 181 as an image correction unit. The face image correcting unit 181 is used when the correction mode for correcting the face in the photographed image is selected as the setting relating to the photographing mode, and when the face in the photographed image is detected by the organ detecting unit 20. Correction processing for processing the face area is performed on an image and a small display image (thumbnail: hereinafter referred to as “display small image”) obtained by reducing the captured image. Hereinafter, the correction process that the face image correction unit 181 performs on the captured image is referred to as “main image correction process”, and the correction process that the face image correction unit 181 performs on the small display image is referred to as “small image correction process”. A captured image that has undergone the main image correction processing is referred to as a “captured captured image”. Although details of the correction process will be described later, in the present embodiment, the content of the correction process performed on the captured image and the small display image is the same. However, since the image size differs greatly between the captured image and the display small image, the small image correction processing does not take time like the main image correction processing, and can be realized in a short time. Note that the correction process performed on the small display image may be a process (for example, a rough process) in which the correction process performed on the captured image is simplified. According to this, the processing time of the small image correction process can be further shortened.

  The organ detection unit 20 detects pattern areas (face areas) in the image data by applying pattern matching, which is a well-known technique, based on the image data of the photographed image, and the left and right eyes, nose, lips, etc. Detect each face part. Data such as the position coordinates of the face area in the detected human image and the position coordinates of each part are recorded in the SDRAM 15.

  The CPU 21 reads out and executes a camera program from the built-in memory 22 in response to an operation signal from the operation unit 26, etc., and gives instructions to each unit constituting the digital camera 1, data transfer, and the like to control the operation of the digital camera 1. Control. For example, as a recording control unit, the CPU 21 performs control for recording a captured image or a corrected captured image as a recorded image and recording image data of the recorded image in the removable memory 27.

  The CPU 21 includes a correction control unit 211 and a display control unit 213 as processing functions by software. The correction control unit 211 controls interruption and resumption of the main image correction process performed by the face image correction unit 181. The display control unit 213 performs control to display the live view image, the confirmation image, and the recorded image on the display unit 23, and the captured image that has not been subjected to the main image correction process (hereinafter referred to as “processing image”). When there is an auxiliary image, control is performed to display an auxiliary image indicating the image being processed on the display unit 23 together with the live view image and the recorded image.

  The built-in memory 22 is an electrically rewritable nonvolatile memory such as a flash memory. For example, the built-in memory 22 operates the digital camera 1 and realizes various functions provided in the digital camera 1. The various camera programs and data used during the execution of the camera program are recorded in advance. The recording medium for recording the camera program and data used during the execution of the camera program is not limited to the flash memory, but an optical recording medium such as a CD-ROM or DVD-ROM, or a magnetic recording such as an MD. A semiconductor memory such as a medium, a tape medium, or an IC card can be used.

  The display unit 23 is for displaying various setting information of the digital camera 1 in addition to the live view image, the confirmation image, and the recorded image, and displays such as an LCD (Liquid Crystal Display) or an EL display (Electroluminescence Display). Realized in the device. The display drive circuit 24 drives the display unit 23. On the display unit 23, live view images are continuously displayed as a moving image at a predetermined display frame rate during the shooting mode, and recorded images recorded in the removable memory 27 are displayed during the playback mode.

  The operation unit 26 is, for example, an operation instruction of the digital camera 1 such as a photographing instruction, a reproduction instruction, a power-on instruction, and a power-off instruction, a setting operation related to the operation mode of the digital camera 1 such as various photographing modes including a correction mode and a reproduction mode This is for inputting various operations by the user, such as a shooting condition setting operation, and notifies the CPU 21 of an operation signal corresponding to the operation input. The operation unit 26 is realized by a button switch, a slide switch, a dial or the like to which various functions are assigned. The release switch 3, the power switch 4, the menu switch 5, the cross key 6, the OK switch 7 and the playback switch 8 shown in FIG. including.

  The communication I / F 25 is an interface for connecting the digital camera 1 to an external device such as a personal computer according to a communication standard such as USB (Universal Serial Bus).

  The removable memory 27 is a memory card that is detachable from the digital camera 1 such as an xD-Picture Card (registered trademark) or a Compact Flash (registered trademark) card. In the detachable memory 27, the image data of the recorded image is written by a read / write device (not shown) corresponding to the type, or the image data recorded in the detachable memory 27 is read by the read / write device.

  The power supply circuit 28 converts the power supplied by the battery 29 loaded therein into predetermined power and supplies it to each part of the digital camera 1.

  Here, an outline of the correction mode, which is one of the functions of the digital camera 1 configured as described above, will be described. As described above, the digital camera 1 according to the present embodiment performs the correction process on the face or the area of each face part constituting the face when the correction mode is selected as the setting relating to the shooting mode.

  Here, the correction process is a process for expressing the face of a subject such as a person beautifully, and the processing content is not particularly limited, but examples include a smoothing process for smoothing the skin, Whitening processing for processing white, catchlight processing for synthesizing catchlight on the pupil, glossing processing for adjusting gloss and color of the lips by adjusting the brightness and color of the lips, and the like. In the smoothing process, for example, correction is performed by detecting a wrinkle or a spot portion from the skin region and replacing it with the surrounding skin state. In the whitening process, for example, correction for detecting a reddish portion of the skin and replacing it with the color of the surrounding skin, correction for increasing the whiteness of the skin, or processing for correcting the skin to a tan color is performed. In addition to the exemplified correction processing, for example, correction that makes the eyes look larger by adjusting the degree of opening of the eyes may be performed. These correction processes can be realized by using known techniques disclosed in, for example, Japanese Unexamined Patent Application Publication Nos. 2004-180114, 2004-222118, and 2004-318205. However, the present invention is not limited to the known techniques disclosed in these documents, and correction processing as necessary can be appropriately selected and used. Also, one of these correction processes may be performed, or a plurality of correction processes may be combined.

  By the way, it takes a certain amount of time to perform the above-described various correction processes on the captured image. Therefore, after shooting, the digital camera 1 of the present embodiment moves to the next shooting without waiting for the end of the correction process (main image correction process), and resumes the display of the live view image. Then, until a new user operation is input, the main image correction process is continuously performed in parallel with the display of the live view image. Then, for example, the release switch 3, the power switch 4, the menu switch 5, the cross key 6, the OK switch 7, and the playback switch 8 are pressed, and some user operation including an operation instruction of the digital camera 1 such as a shooting instruction and a playback instruction is input. At this point, the image correction process is interrupted. In addition, after performing a process according to the input user operation, the image correction process is restarted unless another user operation is newly input. According to this, even when a correction process with a long required time is performed as the main image correction process, it does not affect a normal camera operation such as the next shooting or reproduction of a recorded image. Therefore, since the user can move to the next shooting immediately after shooting, a situation in which, for example, a photo opportunity is missed by the correction process does not occur.

  Furthermore, the digital camera 1 according to the present embodiment performs display for presenting the progress status to the user when the correction process is performed in parallel with the normal camera operation. Specifically, the digital camera 1 displays an auxiliary image indicating the image being processed on the display unit 23 during normal camera operation.

  FIG. 3 is a diagram illustrating a screen configuration example in the shooting mode when the main image correction process is being executed or when the main image correction process is interrupted. As shown in FIG. 3, in the shooting mode display screen during execution or interruption of the main image correction processing, a main screen Wm for displaying a live view image is arranged in the center of the screen, and a processing image is displayed below the main screen Wm. Are arranged to form auxiliary images Ws (Ws-1, 2,...). Here, the auxiliary image Ws indicating the image being processed is subjected to correction processing (small image correction processing), for example, on a small image for display of a captured image that has not been subjected to the main image correction processing, which is an image being processed. (Hereinafter referred to as “processed small image”). When the main image correction processing for the image being processed is completed, the corresponding auxiliary image Ws is deleted from the screen. For example, when the auxiliary image Ws indicating a plurality of images being processed is displayed, the auxiliary image Ws is deleted in order from the one after the completion of the main image correction processing. When the main image correction processing for all the images being processed is finally completed, the main screen Wm at the center of the screen is displayed on the full screen. On the other hand, when a new image being processed is added, a corresponding auxiliary image Ws is added.

  In FIG. 3, the auxiliary image is arranged below the main screen, but the arrangement position may be above or on the side of the main screen Wm. Although an example of the screen configuration in the shooting mode is shown here, the recorded image is played back with the same screen configuration when the main image correction process is being executed or interrupted even in the playback mode. That is, during the playback mode, as in the screen configuration shown in FIG. 3, a main screen for reproducing (displaying) the recorded image recorded in the removable memory 27 is arranged at the center of the screen, and processing is being performed below the main screen. An auxiliary image (for example, a processed small image) indicating an image is arranged.

  According to this, it is possible to present to the user an in-process image during execution of the main image correction process or interruption of the main image correction process during the shooting mode or the playback mode. At this time, if the small process image is used as an auxiliary image as in the present embodiment, a corrected image of the image being processed can be presented. Therefore, the user can check the presence / absence and number of images being processed while viewing the live view image or the recorded image, and can grasp the progress of the image correction process. In addition, a correction image of the image being processed can be confirmed by the small processing image.

  FIG. 4 is a diagram illustrating a transition example of the display screen during the shooting mode when the correction mode is selected. As shown in FIG. 4A, the main screen Wm1 is displayed on the full screen and the live view image is displayed on the main screen Wm1 unless the image correction process is being executed or interrupted during the shooting mode.

  For example, it is assumed that the release switch 3 is pressed in the state shown in FIG. 4A and the second release switch is turned on. In this case, the display of the live view image is temporarily stopped, and shooting is performed with the subject range of the live view image shown on the main screen Wm1 in FIG. Then, face detection in the captured image is executed, and main image correction processing for correcting the face in the captured image is started.

  Thereafter, the display of the live view image is restored. At this time, if the main image correction processing for the photographed image taken after FIG. 4A is not completed, the live view image is shown in FIG. Displayed with an auxiliary image in the screen configuration. That is, as shown in FIG. 4B, the live view image is displayed on the main screen Wm2 at the center of the screen. Then, a processed small image of the photographed image obtained by the photographing after FIG. 4A is displayed as the auxiliary image Ws21 indicating the image being processed, below the main screen Wm2.

  Here, it is assumed that the release switch 3 is further pressed in the state shown in FIG. 4B and the second release switch is turned on. In this case, the main image correction process for the in-process image indicated by the auxiliary image Ws21 is interrupted. Then, shooting is performed with the subject range of the live view image shown on the main screen Wm2 of FIG. 4B as the shooting range, and then the display of the live view image is restored. For example, assuming that the main image correction processing for the photographed image taken after FIG. 4A has not been completed at this time, two photographs of the photographed image and the photographed image photographed after FIG. 4B are taken. This means that the main image correction process for the image has not been completed. Therefore, in the subsequent display screen, as shown in FIG. 4C, auxiliary images Ws31 and Ws32, which are processed small images of the two captured images, are arranged below the main screen Wm3.

  If the state in which no user operation is input continues in this state, the interrupted main image correction processing is resumed, and the main image correction processing is sequentially performed on the images being processed. When the main image correction process for the first photographed image is completed, the corresponding auxiliary image is deleted. For example, as shown in FIG. 4D, only the auxiliary image Ws41 indicating the second captured image as the processing image is arranged below the main screen Wm4. When the main image correction processing for the second photographed image is completed, the auxiliary image is also erased, and as shown in FIG. 4E, the main screen Wm5 on which the live view image is displayed is a full screen. Is displayed.

  Next, the operation of the digital camera 1 will be described. 5 and 6 are flowcharts showing the basic operation of the digital camera 1. As shown in FIG. 5, the digital camera 1 is in a standby state until the power switch 4 is slid and an instruction to turn on the power (power switch ON) is given, and sleep while the power switch is OFF (step a1: No). The state is continued (step a3), and the process returns to step a1.

  When the power switch is turned on (step a1: Yes), the power supply circuit 28 starts supplying power to each unit (step a5), and first, the shooting mode is set (step a7). For example, various settings relating to the shooting mode such as settings relating to photometry and exposure calculation, and settings relating to AE / AF operation are performed. In this embodiment, at this time, a correction mode for correcting the face when a face is detected in the captured image is set. Thereafter, photometry / calculation processing is performed (step a9).

  Subsequently, the processing branches depending on whether the correction processing flag is “ON” or “OFF”. Here, the correction process in progress flag is flag information set in a shooting process (step a33 in FIG. 6) described later, and is set (ON) when the main image correction process is started. When finished, it is cleared (OFF). When the correction processing flag is OFF (step a11: No), the display control unit 213 captures the live view image and normally displays it on the display unit 23 (step a13). By this processing, the image data of the subject image formed on the image sensor 11 is temporarily recorded in the SDRAM 15 and displayed on the display unit 23 as a live view image. The live view image is updated at a predetermined frame rate and is continuously displayed as a moving image. On the other hand, even when the correction processing flag is ON (step a11: Yes), the display control unit 213 captures the live view image in the same manner as in step a13, but the captured live view image is illustrated in FIG. It displays on the display part 23 with an auxiliary image with the demonstrated screen structure (step a15).

  Subsequently, the CPU 21 determines whether or not there is a user operation. When any user operation is input (step a17: Yes), the process proceeds to step a29, and the correction control unit 211 first interrupts the currently executed main image correction process. In response to this, the face image correction unit 181 interrupts the currently executed main image correction process. Here, the main image correction process is a process started during the photographing process (step a33 in FIG. 6). When the main image correction process is not being executed, no particular process is performed. Thereafter, the process proceeds to step a31 in FIG. 6, and processing according to the input user operation is performed.

  On the other hand, when there is no operation input at step a17 (step a17: No), the CPU 21 subsequently determines a correction processing flag, and when the correction processing flag is OFF (step a19: No), the step Return to a9. On the other hand, when the correction process flag is ON (step a19: Yes), the process proceeds to the main image correction restart process (step a21). Although details of the main image correction restart process will be described later, in the main image correction restart process, the interrupted main image correction process is restarted. Then, the main image correction process is continued while no user operation is input, and the main image correction restart process is ended when the main image correction process is completed. In addition, when a user operation is input during execution of the resumed main image correction process, the main image correction process is interrupted again, and the main image correction restart process ends.

  When the main image correction process is completed in the main image correction restart process in step a21 (step a23: Yes), the CPU 21 clears the correction process in progress flag (step a25) and prints a recorded image (here, with correction). The image data of the photographed image is recorded in the removable memory 27 (step a27). Thereafter, the process returns to step a9. If the main image correction process has not been completed in the main image correction restart process in step a21, that is, if the main image correction restart process has been completed due to the input of a user operation (step a23: No), step a9 Returning to the above, processing corresponding to the operation input is performed in the subsequent steps.

  Further, as shown in FIG. 6, in step a31, it is determined whether or not the release switch 3 is depressed by one step and the first release switch is turned on. If the first release switch is turned on (step a31: Yes), a photographing process is performed (step a33). If not ON (step a31: No), the process proceeds to step a35. When the playback switch 8 is turned on and a playback instruction is input (step a35: Yes), the playback mode is set and playback processing is performed (step a37). If the regeneration switch 8 is not turned on (step a35: No), the process proceeds to step a39. When the menu switch 5 is turned on (step a39: Yes), a setting change process is performed (step a41). If the menu switch 5 is not turned on (step a39: No), the process proceeds to step a43.

  In step a43, a power-off instruction is determined. If the power switch 4 is not slid to instruct power-off (power switch OFF) (step a43: No), the process returns to step a9 in FIG. When the power switch 4 is turned off and a power-off instruction is input (step a43: Yes), the CPU 21 determines a correction processing flag. When the correction processing flag is OFF (step a45: No), the power supply of each part by the power supply circuit 28 is stopped (step a55), and the basic operation is finished.

  On the other hand, when the correction process flag is ON (step a45: Yes), the process proceeds to the main image correction restart process (step a47). That is, in the main image correction restart process, the interrupted main image correction process is restarted as in step a21 of FIG. Then, the main image correction process is continued while no user operation is input, and the main image correction restart process ends when the main image correction process ends. When a user operation is input during execution of the resumed main image correction process, the main image correction process is interrupted again, and the main image correction restart process ends.

  When the main image correction process is completed in the main image correction restart process in step a47 (step a49: Yes), the CPU 21 clears the correction process in progress flag (step a51) and prints a recorded image (here, with correction). The image data of the captured image is recorded in the removable memory 27 (step a53). Thereafter, the power supply of each part by the power supply circuit 28 is stopped (step a55), and the basic operation is finished.

  If the main image correction process has not been completed in the main image correction restart process in step a47, that is, if the main image correction restart process has been completed due to the input of a user operation (step a49: No), step a43 Returning to the above, processing corresponding to the operation input is performed in the subsequent steps.

  Next, the photographing process (step a33) performed when the first release switch is turned on in the basic operation shown in FIG. 6 will be described. 7 and 8 are flowcharts showing the detailed processing procedure of the photographing process.

  As shown in FIG. 7, in the photographing process, first, as photographing preparation operation, the AF unit 17 performs an AF (automatic focus) operation (step b1), and the AE unit 16 performs an AE (automatic exposure) operation (step b3). . Thereafter, the second release switch is not turned on (step b5: No), and the first release switch remains on (step b7: Yes), and the standby state is entered. If the first release switch is turned off (step b7: No), the process returns to step a35 in FIG.

  When the release switch 3 is pressed in two steps and the second release switch is turned on and a shooting instruction is input (step b5: Yes), the display control unit 213 displays the live view image on the display unit 23. Is temporarily stopped (step b8). Thereafter, the CPU 21 drives the imaging unit 10 to control the exposure during the photographing process (step b9), and performs the image data reading process (step b11). With this processing, an image in the shooting range at the timing when the second release switch is turned on is generated as a shot image, and the image data is temporarily recorded in the SDRAM 15.

  Subsequently, the image processing unit 18 performs necessary image processing on the captured image (step b13). At this time, the image processing unit 18 performs a process of reducing the captured image to generate a small display image (thumbnail). Then, the CPU 21 determines whether or not the shooting mode in which the correction mode is selected is set. If the correction mode is not selected (step b15: No), the process proceeds to step b25 in FIG. On the other hand, when the correction mode is selected (step b15: Yes), the organ detection unit 20 performs face detection (step b17). The organ detection unit 20 detects each face area from the captured image, and detects each face part in the face area based on the detection result of the face area.

  Thereafter, the CPU 21 determines whether or not a face is detected by the face detection in step b17. If no face is detected (step b19: No), the process proceeds to step b25 in FIG. On the other hand, if a face is detected (step b19: Yes), then the face image correction unit 181 of the image processing unit 18 performs a small image correction process prior to the main image correction process starting at step b37 in FIG. Then, the face area in the small display image is corrected (step b21). Then, after the CPU 21 sets (ON) the correction processing flag (step b23), the process proceeds to step b25 in FIG.

  That is, in step b25, the display control unit 213 starts control (rec view) for displaying the confirmation image on the display unit 23. Here, the confirmation image is a display for confirmation for presenting the user with the contents of the recorded image that is generated as a result of photographing and recorded in the removable memory 27. For example, when the correction mode is not selected, or when the correction mode is selected but no face is detected in the captured image, the captured image after normal image processing is displayed on the display unit 23 as a confirmation image. . On the other hand, when the correction mode is selected and a face is detected in the photographed image, a processed small image after the small image correction process in which the face area is corrected is displayed on the display unit 23 as a confirmation image.

  Subsequently, the CPU 21 starts a timer and starts measuring a predetermined time (display time of the confirmation image) (step b27), and determines the correction processing flag. If the correction processing flag is OFF (step b29: No), the image data of the recorded image is recorded in the removable memory 27 (step b31). In this step b31, for example, when the correction mode is not selected, or when the correction mode is selected but the face is not detected in the corrected image, the captured image after the normal image processing is used as the recorded image, and the image data Is recorded in the removable memory 27. Alternatively, if there is unrecorded image data for which the main image correction processing has been completed, the image data is recorded in the removable memory 27 using the corrected photographed image as a recorded image.

  Thereafter, the CPU 21 monitors the time count of the timer, and determines whether there is a user operation while the time count of the timer does not exceed the display time of the confirmation image and the time is not up (step b33: No). If there is no operation input (step b35: No), the process returns to step b33. When the time of the timer exceeds the predetermined time and the time is up (step b33: Yes), or when a user operation is input (step b35: Yes), the process proceeds to step b49 and the display control unit 213 is reached. However, the display (rec view) of the confirmation image on the display unit 23 ends. Then, the process proceeds to Step a35 in FIG.

  On the other hand, when the correction process in progress flag determined in step b29 is ON (step b29: Yes), the face image correction unit 181 starts the main image correction process (step b37). By the main image correction process started here, the face area in the captured image is corrected, and a corrected captured image is obtained when the main image correction process is finally completed. If the main image correction process is interrupted at this time, for example, if the main image correction process for the previously captured image has not been completed, the correction control unit 211 processes the captured image captured this time. Add to the middle image and resume the interrupted main image correction process.

  Thereafter, the CPU 21 determines whether or not the main image correction process is finished while the timer does not expire (step b39: No). If the main image correction process is completed while the confirmation image is displayed (step b41: Yes), the correction process in progress flag is cleared (OFF) (step b43), and then the process proceeds to step b31. If the image correction process is not finished (step b41: No), the presence / absence of a user operation is determined. If there is no operation input (step b45: No), the process returns to step b39.

  If the timer expires without any user operation being input (step b39: Yes), the process proceeds to step b49, and the display control unit 213 ends the display (rec view) of the confirmation image on the display unit 23. To do. Then, the process proceeds to Step a35 in FIG.

  On the other hand, when any user operation is input during the display of the confirmation image (step b45: Yes), the correction control unit 211 interrupts the currently executed image correction process (step b47). Thereafter, the process proceeds to step b49, and the display control unit 213 ends the display (rec view) of the confirmation image on the display unit 23. Then, the process proceeds to Step a35 in FIG. In addition, after proceeding to step a35 in FIG. 6, in a subsequent step (specifically, step a13 or step a15 in FIG. 5), the display of the live view image that was temporarily stopped during the photographing is started. Thereby, the control for resuming the display of the live view image without waiting for the end of the main image correction process by the face image correction unit 181 is realized. In a subsequent step, processing corresponding to the operation input is performed.

  Next, the reproduction process (step a37) performed when the reproduction switch 8 is turned on in the basic operation shown in FIG. 6 will be described. FIG. 9 is a flowchart showing a detailed processing procedure of the reproduction process.

  As shown in FIG. 9, in the reproduction process, first, the CPU 21 performs a process of reading a recorded image from the removable memory 27 (step c1). Subsequently, the CPU 21 determines a correction processing flag. When the correction processing flag is OFF (step c3: No), the display control unit 213 performs control to display the read recorded image on the display unit 23 and reproduces it (step c5). On the other hand, even when the correction processing flag is ON (step c3: Yes), the read recorded image is displayed and reproduced on the display unit 23. At this time, the display control unit 213 displays in FIG. In the same way as the display of the live view image shown and described, the read recorded image is displayed together with the auxiliary image on the display unit 23 for reproduction (step c7). The recorded image may be reproduced by, for example, a configuration in which image data of a recorded image that has been captured in the past and recorded in the removable memory 27 is sequentially read and displayed one by one in the order of shooting. The thumbnail data may be read and displayed as a list, and the image data of the recorded image selected from the list according to the user operation may be displayed.

  Subsequently, for example, when the cross key 6 is turned on and a switching operation of a recorded image being reproduced is input (step c9: Yes), the CPU 21 performs a process of reading the designated recorded image from the removable memory 27. (Step c11), the process returns to step c3.

  On the other hand, when the cross key 6 is not turned on (step c9: No), the CPU 21 determines a correction processing flag, and when the correction processing flag is OFF (step c13: No), the CPU 21 proceeds to step c23. . On the other hand, when the correction process flag is ON (step c13: Yes), the main image correction restart process is performed (step c15). That is, in the main image correction restart process, the interrupted main image correction process is restarted as in step a21 in FIG. 5 and step a47 in FIG. Then, the main image correction process is continued while no user operation is input, and the main image correction restart process ends when the main image correction process ends. When a user operation is input during execution of the resumed main image correction process, the main image correction process is interrupted again, and the main image correction restart process ends.

  When the main image correction process is completed in the main image correction restart process in step c15 (step c17: Yes), the CPU 21 clears the correction process flag (step c19) and prints a recorded image (here, with correction). The image data of the captured image is recorded in the removable memory 27 (step c21). Thereafter, the process proceeds to step c23. Further, when the main image correction process is not completed in the main image correction restart process in step c15, that is, when the main image correction restart process is ended by inputting a user operation (step c17: No), step c23 The process according to the operation input is performed in the subsequent steps.

  That is, in step c23, it is determined whether or not there is an instruction to turn off the power, and if the power switch 4 is not slid to instruct the turning off of the power (power switch OFF) (step c23: No), the process proceeds to step c25. When the power switch 4 is turned off and a power-off instruction is input (step c23: Yes), the process proceeds to step a39 in FIG. For example, when a user operation is input during the main image correction restart process in step c15 and the main image correction process is interrupted, and the user operation input at this time is a power-off instruction, step a39 in FIG. Proceed to

  In step c25, it is determined whether or not the regeneration switch 8 is turned on. If the regeneration switch 8 is not turned on (step c25: No), the process returns to step c9. If the regeneration switch 8 is turned on (step c25: Yes), the regeneration process is terminated, and the process proceeds to step a39 in FIG. For example, when a user operation is input during the main image correction restart process in step c15 and the main image correction process is interrupted, and the user operation input at this time is an ON operation of the reproduction switch, FIG. Proceed to step a39. With this processing, the digital camera 1 changes from the playback mode to the shooting mode.

  Next, the setting change process (step a41) performed when the menu switch 5 is turned on in the basic operation shown in FIG. 6 will be described. FIG. 10 is a flowchart showing a detailed processing procedure of the setting change process.

  As shown in FIG. 10, in the setting change process, first, the CPU 21 performs control to display a setting / change request notification on the display unit 23 together with an operation screen presenting various setting menus (step d1). Then, the CPU 21 executes a process for changing the setting of various operation modes in accordance with the setting / changing operation input in response to the notification of the setting / changing request (step d3). Various settings relating to the shooting mode and the playback mode can be changed by the setting change processing here. For example, the setting as to whether or not the correction mode is selected as the shooting mode can be changed (switched).

  Subsequently, the CPU 21 determines a correction processing flag, and if the correction processing flag is OFF (step d5: No), the CPU 21 proceeds to step d15. On the other hand, when the correction processing flag is ON (step d5: Yes), the main image correction restart processing is performed (step d7). That is, in the main image correction restart process, the interrupted main image correction process is restarted as in step a21 in FIG. 5, step a47 in FIG. 6, and step c15 in FIG. Then, the main image correction process is continued while no user operation is input, and the main image correction restart process ends when the main image correction process ends. When a user operation is input during execution of the resumed main image correction process, the main image correction process is interrupted again, and the main image correction restart process ends.

  When the main image correction process is completed in the main image correction restart process at step d7 (step d9: Yes), the CPU 21 clears the correction process flag (step d11), and prints a recorded image (here, with correction). The image data of the captured image is recorded in the removable memory 27 (step d13). Thereafter, the process proceeds to step d15. If the main image correction process has not been completed in the main image correction restart process in step d7, that is, if the main image correction restart process has been completed due to the input of a user operation (step d9: No), step d15 The process according to the operation input is performed in the subsequent steps.

  In step d15, it is determined whether or not there is an instruction to turn off the power. If the power switch 4 is not slid to instruct to turn off the power (power switch OFF) (step d15: No), the process proceeds to step d17. When the power switch 4 is turned off and a power-off instruction is input (step d15: Yes), the process proceeds to step a43 in FIG. For example, when a user operation is input during the main image correction restart process in step d7 and the main image correction process is interrupted, and the user operation input at this time is a power-off instruction, step a43 in FIG. Proceed to

  In step d17, it is determined whether a setting end operation has been input. If the setting end operation has not been input (step d17: No), the process returns to step d3. On the other hand, when the setting end operation is input (step d17: Yes), the setting change process is ended, and the process proceeds to step a43 in FIG. For example, when a user operation is input during the main image correction restart process in step d7 and the main image correction process is interrupted, and the user operation input at this time is a setting end operation, step a43 in FIG. Proceed to

  Next, the main image correction restarting process performed in step a21 in FIG. 5, step a47 in FIG. 6, step c15 in FIG. 9, and step d7 in FIG. 10 will be described. FIG. 11 is a flowchart showing a detailed processing procedure of the main image correction restart process.

  As shown in FIG. 11, in the main image correction restart process, first, the correction control unit 211 restarts the interrupted main image correction process (step e1). In response to this, the face image correction unit 181 executes the interrupted main image correction process from the previous interrupt position (step e3). And CPU21 determines the presence or absence of user operation. If there is no operation input (step e5: No) and the main image correction process is completed (step e7: No), the process returns to step e3 to continue the main image correction process. When the main image correction process is completed (step e7: Yes), the process ends (proceeds to step a23 in FIG. 5, step a49 in FIG. 6, step c17 in FIG. 9, and step d9 in FIG. 10).

  On the other hand, when any user operation is input (step e5: Yes), the correction control unit 211 interrupts the currently executed image correction process (step e9). In response to this, the face image correction unit 181 interrupts the currently executed main image correction process. Thereafter, the processing ends (proceeds to step a23 in FIG. 5, step a49 in FIG. 6, step c17 in FIG. 9, and step d9 in FIG. 10).

  As described above, according to the present embodiment, after generating a photographic image for recording in accordance with a photographic instruction, correction processing for the recorded photographic image is started, but the end of the correction processing is awaited. The display of the live view image can be resumed without any change. Then, when any user operation including an operation instruction of the digital camera 1 is input, the correction process being executed can be interrupted, and the process according to the input user operation can be performed with priority. Further, after the process according to the user operation, the correction process can be resumed if there is no new operation input. Therefore, it is possible to perform correction processing on a captured image after shooting without affecting normal camera operation.

  If the power switch is turned off and a power-off instruction is input during execution or interruption of the main image correction process, the main image correction process being executed or interrupted is completed before the power is turned off. be able to. Therefore, the power supply can be shut off after the correction process for the image being processed is completed with certainty.

  In the above-described embodiment, the correction process for the face area included in the photographed image is exemplified as the correction process performed on the recording photographed image. However, the correction process may be performed on an area other than the face area. The same applies. For example, the present invention can be applied to a case where various types of filter processing, such as performing an effect such as a photograph taken with a cross filter attached to an imaging lens, is performed as correction processing.

  In the above-described embodiment, the processing small image obtained by performing the small image correction process on the small display image is used as the auxiliary image or the confirmation image. However, the present invention is not limited to this. For example, a small display image may be used as an auxiliary image or a confirmation image.

  Further, the present invention is not limited to the above-described embodiments as they are, and various inventions can be formed by appropriately combining a plurality of components disclosed in the above-described embodiments. For example, some components may be excluded from all the components shown in the embodiment.

  Further, the processing described as being performed by the CPU 21 in the above-described embodiment, such as processing performed by the correction control unit 211 and the display control unit 213, is limited to the case where the CPU 21 is implemented as software by executing a program. Instead, some or all of them may be configured by hardware. On the other hand, the configuration in which the image processing unit 18, the face image correction unit 181, the organ detection unit 20, and the like are realized by hardware has been described, but may be realized by software by executing a predetermined program.

  In the above embodiment, a digital camera has been described as an example of the camera of the present invention. However, the present invention is not limited to this, and may be applied to a camera unit of a mobile phone or a camera unit attached to a PC. Good. The case where the correction processing is performed by processing still image data has been described, but the target of the correction processing is not limited to still image data, and can be similarly applied to moving image data.

It is a rear view of a digital camera. It is a block diagram which shows the system configuration | structure of a digital camera. It is a figure which shows the example of a screen structure in imaging | photography mode during execution or interruption of this image correction process. It is a figure which shows the example of a transition of the display screen in imaging | photography mode when correction | amendment mode is selected. 3 is a flowchart showing basic operations of the digital camera. 3 is a flowchart showing basic operations of the digital camera. It is a flowchart which shows the detailed process sequence of an imaging | photography process. It is a flowchart which shows the detailed process sequence of an imaging | photography process. It is a flowchart which shows the detailed process sequence of a reproduction | regeneration process. It is a flowchart which shows the detailed process sequence of a setting change process. It is a flowchart which shows the detailed process sequence of this image correction resumption process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital camera 3 Release switch 4 Power switch 5 Menu switch 6 Four-way controller 7 OK switch 8 Playback switch 10 Image pick-up part 11 Image pick-up element 12 Lens system unit 13 Lens drive circuit 14 Image pick-up circuit 15 SDRAM
16 AE unit 17 AF unit 18 image processing unit 181 face image correction unit 20 organ detection unit 21 CPU
211 Correction Control Unit 213 Display Control Unit 22 Built-in Memory 23 Display Unit 24 Display Drive Circuit 25 Communication I / F
26 Operation Unit 27 Detachable Memory 28 Power Supply Circuit 29 Battery 30 Bus

Claims (8)

An imaging unit that shoots a subject and generates a captured image;
An operation unit for inputting camera operation instructions;
When the camera operation instruction input from the operation unit is a shooting instruction, an image correction unit that performs a predetermined correction process on a recording shot image generated by the imaging unit in response to the shooting instruction When,
A correction control unit that controls execution of correction processing by the image correction unit;
A recording control unit that performs control to record the recorded image for recording that has been subjected to correction processing by the image correcting unit as a recorded image in a recording unit;
With
The correction control unit interrupts the correction process by the image correction unit when an operation instruction of the camera is input from the operation unit during the correction process by the image correction unit, and responds to the input operation instruction. After the processing, the correction processing by the interrupted image correction unit is resumed. An organ detection unit that detects a face from the recorded image for recording and detects a predetermined facial organ included in the detected face;
The camera according to claim 1, wherein the image correction unit performs a process of correcting a region of the facial organ detected by the organ detection unit as the correction process. The correction control unit resumes the interrupted correction process by the image correction unit when the camera operation instruction input during execution of the correction process by the image correction unit is a power-off instruction of the camera. Let
The camera according to claim 1, wherein the camera is turned off after the correction process is completed.   When the camera operation instruction input during execution of the correction process by the image correction unit is the shooting instruction, the correction control unit performs the correction process by the image correction unit when the shooting instruction is input. The camera according to claim 1, wherein the camera is interrupted. A display unit for displaying at least the recorded image;
A display control unit that performs control to display the recorded image on the display unit;
With
When the camera operation instruction input during execution of the correction process by the image correction unit is a reproduction instruction for the recorded image, the correction control unit is configured to input the reproduction unit when the reproduction instruction is input. The correction process by
2. The control according to claim 1, wherein the display control unit controls the captured image for recording in which the correction processing is interrupted to be a processing image, and displays the processing image together with the recording image. Camera. The image correction unit performs the correction process on a small display image obtained by reducing the recording image before the correction process performed on the recording image.
The camera according to claim 5, wherein the display control unit performs control to display the small image for display after the correction processing as the image being processed. A camera control method comprising an imaging unit that shoots a subject and generates a captured image, and an operation unit for inputting a camera operation instruction,
When the camera operation instruction input from the operation unit is a shooting instruction, an image correction step of executing a predetermined correction process on a recording shot image generated by the imaging unit in response to the shooting instruction When,
A correction control step for controlling the execution of correction processing in the image correction step;
A recording control step for performing control to record the recorded image for recording that has undergone the correction processing in the image correction step as a recorded image in a recording unit;
Including
The correction control step interrupts the correction processing in the image correction step when an operation instruction of the camera is input from the operation unit during the execution of the correction processing in the image correction step, and the input operation instruction A control method for a camera, comprising: resuming the correction processing in the interrupted image correction step after the processing according to the method. A camera computer having an imaging unit that shoots a subject and generates a captured image, and an operation unit for inputting a camera operation instruction,
When the camera operation instruction input from the operation unit is a shooting instruction, an image correction step of executing a predetermined correction process on the recording captured image generated by the imaging unit in response to the shooting instruction When,
A correction control step for controlling execution of correction processing in the image correction step;
A recording control step for performing control to record the recorded image for recording that has undergone the correction processing in the image correction step as a recorded image in a recording unit;
A control program for executing
The correction control step interrupts the correction process in the image correction step when an operation instruction of the camera is input from the operation unit during the execution of the correction process in the image correction step. After the process according to the control program, the correction process in the interrupted image correction step is resumed.

Images