JP2008109503A - Imaging apparatus, control method thereof, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To shorten a time lag from performing photographing until performing quick review display even in the case of performing red-eye correction processing of a photographed image. <P>SOLUTION: The imaging apparatus comprises: an imaging part for imaging an object image; a display part for displaying an image; a red-eye correcting part for performing red-eye correction processing for correcting a part where a red-eye phenomenon occurs with respect to the imaged still image by the imaging part; and a control part for controlling the imaging part and the display part so as to make the display part display a first image for display generated from a first still image before performing red-eye correction processing of the first still image after making the imaging part image the first still image, and make the display part display a second image for display generated from the second still image obtained by hereafter performing red-eye correction processing of the first still image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique for correcting red eyes of an image photographed using a strobe.

  Conventionally, an imaging device such as an electronic camera that records and reproduces still images and moving images using a memory card having a solid-state memory element as a recording medium is already on the market.

  In a conventional camera using a silver salt film, when a person is photographed using a strobe, a red-eye phenomenon may occur in which the eye color is photographed in red. This red-eye phenomenon is a phenomenon in which strobe light incident on a pupil opened in a dark place projects the blood vessels of the retina. On the other hand, conventional silver salt cameras also use a lamp, LED, or strobe pre-light emission to irradiate the subject with light before photographing, and contract the pupil during photographing to reduce the red-eye phenomenon. However, when the subject is not gazing at the photographer side, it is difficult to completely eliminate the red-eye phenomenon because the red-eye reduction effect is small.

  On the other hand, the red-eye phenomenon at the time of flash photography similarly occurs in an electronic camera. On the other hand, a proposal has been made that automatically detects the position of a person's face and eyes and automatically corrects red eyes when a red-eye phenomenon occurs based on the information (see Patent Document 1). .

  Furthermore, in order to improve the convenience for the user, by recording the pre-correction image information and the corrected image information, if the user is not satisfied with the automatic correction result, red-eye correction is performed again without image quality degradation. Proposals that enable this have been made (see Patent Document 2).

Further, the following proposals have been made as countermeasures against a reduction in processing speed of red-eye automatic correction due to higher resolution of the imaging device. That is, the processing speed is improved by detecting red eyes from low-resolution image data created at the time of shooting and correcting red-eye of the recording image data based on this detection information (see Patent Document 3).
Japanese Patent Laid-Open No. 10-0233929 JP 2003-427704 A Japanese Patent Laying-Open No. 2005-167697

  By the way, in the electronic camera as described above, a quick review display of a red-eye corrected image is performed after a user performs a red-eye correction process after a photographing operation. That is, the user cannot see the quick review display until the red-eye correction process is completed. The quick review display is a photographed image that is automatically displayed on an image display unit such as a TFT or LCD after photographing so that the user can confirm the photographed image.

  However, as described above, although red-eye detection is performed from low-resolution image data created at the time of shooting, the processing speed is increased. In particular, when red-eye detection processing or red-eye correction processing is realized by software, red-eye detection is performed. And the correction processing time is long. Therefore, compared to shooting without red-eye correction processing, the blackout period from shooting to quick review display is longer, so the operation feeling is poor and whether red-eye correction processing is being performed or not. There was a problem that it was difficult for the user to understand.

  Therefore, the present invention has been made in view of the above-described problems, and the purpose thereof is from when shooting is performed until quick review display is performed even when red-eye correction processing is performed on a captured image. It is to shorten the time lag.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention provides an imaging unit that captures a subject image, a display unit that displays an image, and a still image captured by the imaging unit. A red-eye correction unit that performs a red-eye correction process for correcting a portion in which a red-eye phenomenon occurs, and after the first still image is captured by the imaging unit, the red-eye correction is performed on the first still image. A second still image obtained by causing the display means to display a first display image generated from the first still image before performing the processing, and then performing the red-eye correction processing on the first still image. The image pickup means and a control means for controlling the display means so as to display a second display image generated from the image on the display means.

  In the control method of the image pickup apparatus according to the present invention, the red-eye phenomenon occurs with respect to the image pickup means for picking up the subject image, the display means for displaying the image, and the still image picked up by the image pickup means. A red-eye correction unit that performs a red-eye correction process for correcting a portion, and an imaging step of capturing a first still image by the imaging unit, and the first still image A first display step for causing the display means to display a first display image generated from the first still image before performing the red-eye correction process, and the red-eye correction for the first still image. And a second display step of displaying on the display means a second display image generated from the processed second still image.

  A program according to the present invention causes a computer to execute the above control method.

  A storage medium according to the present invention stores the above program.

  According to the present invention, even when the red-eye correction process is performed on a photographed image after photographing, it is possible to shorten the time lag from when photographing is performed until the photographed image is displayed. .

  Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram showing a configuration of a digital camera according to an embodiment of the present invention.

  In FIG. 1, reference numeral 100 denotes a digital camera.

  Reference numeral 10 denotes a photographing lens, 12 denotes a shutter having a diaphragm function, 14 denotes an image sensor that converts an optical image into an electrical signal, and 16 denotes an A / D converter that converts an analog signal output from the image sensor 14 into a digital signal.

  A timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22.

  The image processing circuit 20 performs TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing. These processes are processes in which predetermined calculation processing is performed using captured image data, and the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the obtained calculation result. is there.

  Further, the image processing circuit 20 performs predetermined arithmetic processing using captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

  A memory control circuit 22 is an A / D converter 16, a timing generation circuit 18, an image processing circuit 20, an image display memory 24, a D / A converter 26, a memory 30, a compression / decompression circuit 32, a resizing circuit 34, a red eye. The detection circuit 36 and the red-eye correction circuit 38 are controlled.

  The data of the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is directly passed through the memory control circuit 22. It is.

  Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, 28 denotes an image display unit composed of a TFT, an LCD, and the like. Display image data written in the image display memory 24 passes through the D / A converter 26. Are displayed by the image display unit 28.

  If the image data captured using the image display unit 28 is sequentially displayed, the electronic viewfinder function can be realized. The image display unit 28 is connected to the digital camera body via a hinge unit, and can be freely set to a state where the display unit is stored toward the digital camera 100 and a state where the display unit is not stored.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a storage capacity sufficient to store a predetermined number of still images and a moving image for a predetermined time.

  Thereby, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed.

  The memory 30 can also be used as a work area for the system control circuit 50.

  Reference numeral 32 denotes a compression / decompression circuit that compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the memory 30, performs compression processing or decompression processing, and stores the processed data in the memory 30. Write to.

  A resize circuit 34 generates a low-resolution image from a captured still image (original image).

  This is used to record image data on a recording medium with a pixel number (size) different from the number of pixels of the image sensor 14, or to generate an index thumbnail image attached when recording image data. Further, since the image display unit 28 has a considerably smaller number of pixels than the imaging element 14, the image display unit 28 is also used to generate a display image when displaying on the image display unit 28. The resolution of the resized image is configured to be selected from a plurality of predetermined resolutions depending on the application. The resizing circuit 34 reads an image stored in the memory 30 and performs resizing processing, and writes the processed data in the memory 30.

  Reference numeral 36 denotes a red-eye detection circuit that detects the coordinate position of the red-eye where the red-eye phenomenon has occurred from the image data, reads an image stored in the memory 30, and performs face detection based on known hue, saturation, brightness, and the like. . In the face area, the position of the human eye in the image data is detected by a method such as local pattern matching, and the red eye phenomenon occurs in the eye from the hue, saturation, brightness, etc. of the detected eye. It is detected whether it is doing. In this way, the coordinate position of the place where the red-eye phenomenon occurs is detected.

  Reference numeral 38 denotes a red-eye correction circuit, and the color of the red-eye portion so that the red-eye portion of the original image data stored in the memory 30 based on the red-eye coordinate position detected by the red-eye detection circuit 36 becomes a natural eye expression. Is replaced with the color of the surrounding iris part. Alternatively, correction is performed by a known correction method such as painting with a specific color.

  Reference numeral 40 denotes an exposure control unit that controls the shutter 12 having a diaphragm function, and has a flash light control function in cooperation with the flash device 400.

  A distance measuring control unit 42 controls focusing of the photographing lens 10.

  The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing circuit 20, the system control circuit 50 performs the exposure control unit 40 and the distance measurement. The controller 42 is controlled.

  Reference numeral 44 denotes a zoom control unit that controls zooming of the photographing lens 10, and reference numeral 46 denotes a barrier control unit that controls the operation of the protection unit 102 that is a barrier.

  Reference numeral 48 denotes a connector, which is also called an accessory shoe, and includes an electrical contact with the flash device 400 and a mechanical fixing portion.

  A system control circuit 50 controls the entire digital camera 100, and a memory 52 stores constants, variables, programs, and the like for operation of the system control circuit 50.

  Reference numeral 54 denotes a display unit such as a liquid crystal display device or a speaker that displays an operation state, a message, and the like using characters, images, sounds, and the like in accordance with execution of a program in the system control circuit 50. The display unit 54 is installed in a single or a plurality of positions near the operation unit of the digital camera 100 so as to be easily visible, and is configured by a combination of, for example, an LCD, an LED, and a sounding element.

  The display unit 54 has a part of its function installed in the optical viewfinder 104.

  Among the display contents of the display unit 54, what is displayed on the LCD or the like includes single shot / continuous shooting display, self-timer display, compression rate display, number of recorded pixels, number of recorded pixels, number of remaining images that can be captured, shutter There are speed display, aperture value display, exposure compensation display, and so on. In addition, flash display, red-eye reduction display, macro shooting display, buzzer setting display, watch battery remaining amount display, battery remaining amount display, error display, information display with multiple digits, display / removal state display of recording media 200 and 210, There are also communication I / F operation display, date / time display, and the like.

  Among the display contents of the display unit 54, what is displayed in the optical viewfinder 104 includes in-focus display, camera shake warning display, flash charge display, shutter speed display, aperture value display, exposure correction display, and the like.

  Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory such as an EEPROM.

  Reference numerals 60, 62, 64, 66, 68, and 70 denote operation units for inputting various operation instructions of the system control circuit 50. A single unit such as a switch, a dial, a touch panel, pointing by eye-gaze detection, a voice recognition device, or the like Consists of multiple combinations.

  Here, a specific description of these operation units will be given.

  Reference numeral 60 denotes a mode dial switch, which can switch and set various function modes such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, playback mode, multi-screen playback / erase mode, and PC connection mode.

  Reference numeral 62 denotes a shutter switch SW1, which is turned on when a shutter button (not shown) is being operated (half-pressed), and performs AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash). ) Instruct the start of operations such as processing.

  A shutter switch SW2 64 is turned on when the operation of the shutter button is completed (fully pressed), and instructs the start of a series of photographing processing operations. In the photographing process, an exposure process is performed in which a signal read from the image sensor 14 is written as image data in the memory 30 via the A / D converter 16 and the memory control circuit 22. Further, development processing using calculation in the image processing circuit 20 and the memory control circuit 22 is also performed. Further, a recording process is performed in which the image data is read from the memory 30, compressed by the compression / decompression circuit 32, and the image data is written to the recording medium 200 or 210.

  Reference numeral 66 denotes an image display ON / OFF switch which can set ON / OFF of the image display unit 28.

  With this function, when photographing using the optical viewfinder 104, it is possible to save power by cutting off the current supply to the image display unit 28 composed of TFT, LCD, and the like.

  68 is a single shooting / continuous shooting switch. When the shutter switch SW2 is pressed, a single shooting mode is set in which one frame is shot, and a continuous shooting mode in which shooting is continuously performed while the shutter switch SW2 is pressed. And can be set.

  An operation unit 70 includes various buttons, a touch panel, and the like, and includes a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, and the like. In addition, a menu movement + (plus) button, a menu movement-(minus) button, a reproduction image movement + (plus) button, a reproduction image movement-(minus) button, and the like are also provided. A shooting / image quality selection button, an exposure correction button, a date / time setting button, and a selection / switching button for setting selection and switching of various functions when shooting and playback such as panorama mode are also provided. Also, when executing shooting and playback in panorama mode, etc., a decision / execution button for setting and determining various functions and a quick review function for automatically reproducing image data taken immediately after shooting are set ON / OFF. It also has a switch. In addition, a compression mode switch that is a switch for selecting a compression rate for JPEG compression or for selecting a CCD RAW mode in which a signal from an image sensor is directly digitized and recorded on a recording medium is also provided. Also provided is a playback mode switch that can set each function mode such as a playback mode, a multi-screen playback / erase mode, and a PC connection mode. Furthermore, a playback switch for instructing the start of a playback operation for reading a captured image from the memory 30 or the recording medium 200 or 210 and displaying it on the image display unit 28 in the shooting mode state is provided.

  A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like. Then, the presence / absence of a battery, the type of battery, the remaining battery level are detected, the DC-DC converter is controlled based on the detection result and the instruction of the system control circuit 50, and the necessary voltage is recorded for a necessary period. To each part including

  82 is a connector, 84 is a connector, 86 is a primary battery such as an alkaline battery or lithium battery, a secondary battery such as a NiCd battery, NiHM battery or Li ion battery, an AC adapter, or the like.

  Reference numerals 90 and 94 denote interfaces with recording media such as memory cards and hard disks, and reference numerals 92 and 96 denote connectors for connecting to recording media such as memory cards and hard disks. Reference numeral 98 denotes a recording medium attachment / detachment detection unit that detects whether or not the recording medium 200 or 210 is attached to the connectors 92 and / or 96.

  In the present embodiment, it is assumed that there are two systems of interfaces and connectors for attaching a recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or a plurality of systems and any number of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard.

  The interface and connector may be configured using a PCMCIA card, a CF (Compact Flash (registered trademark)) card, or the like that conforms to a standard.

  Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using a PCMCIA card, a CF (Compact Flash (registered trademark)) card, or the like, the following operation can be performed. . That is, various communication cards such as a LAN card, a modem card, a USB card, an IEEE 1394 card, a P1284 card, a SCSI card, and a communication card such as a PHS are connected. As a result, image data and management information attached to the image data can be transferred to and from peripheral devices such as other computers and printers.

  A protection unit 102 is a barrier that prevents the imaging unit from being soiled or damaged by covering the imaging unit including the photographing lens 10 of the digital camera 100.

  Reference numeral 104 denotes an optical viewfinder, which can take an image using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are installed.

  Reference numeral 106 denotes an image display unit open / close detection unit, which can detect whether or not the image display unit 28 is in a stored state in which the display portion of the image display unit 28 is stored facing the digital camera 100.

  Here, if the storage state is detected, the display operation of the image display unit 28 can be stopped and unnecessary power consumption can be prohibited.

  Reference numeral 200 denotes a recording medium such as a memory card or a hard disk.

  The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface 204 with the digital camera 100, and a connector 206 for connecting with the digital camera 100.

  Reference numeral 210 denotes a recording medium such as a memory card or a hard disk.

  The recording medium 210 includes a recording unit 212 composed of a semiconductor memory, a magnetic disk, and the like, an interface 214 with the digital camera 100, and a connector 216 for connecting with the digital camera 100.

  Reference numeral 400 denotes a flash device.

  Reference numeral 402 denotes a connector for connecting to the accessory shoe of the digital camera 100. A flash 404 has an AF auxiliary light projecting function and a flash light control function.

  Next, the operation of the digital camera of this embodiment will be described with reference to FIGS.

  2 to 4 are flowcharts of the main routine of the digital camera 100 of this embodiment.

  The operation of the digital camera 100 will be described with reference to FIGS.

  Upon power-on such as battery replacement, the system control circuit 50 initializes flags, control variables, and the like (step S101), and initializes the image display of the image display unit 28 to an OFF state (step S102).

  The system control circuit 50 determines the setting position of the mode dial switch 60 (step S103). If the mode dial switch 60 is set to power OFF, the display on each display unit is changed to the end state, the barrier of the protection unit 102 is closed, and the imaging unit is protected. In addition, necessary parameters, setting values, and setting modes including flags and control variables are recorded in the nonvolatile memory 56. Further, the power controller 80 shuts off unnecessary power sources for the respective parts of the digital camera 100 including the image display unit 28 (step S105). After performing these end processes, the process returns to step S103.

  If the mode dial switch 60 is set to the photographing mode (step S103), the process proceeds to step S106.

  If the mode dial switch 60 is set to another mode (step S103), the system control circuit 50 executes a process according to the selected mode (step S104). Return.

  The system control circuit 50 determines whether or not there is a problem with the operation of the digital camera 100 in terms of the remaining capacity and operation status of the power supply 86 configured by a battery or the like by the power supply control unit 80 (step S106). If there is a problem, a predetermined warning is displayed by image or sound using the display unit 54 (step S108), and the process returns to step S103.

  If there is no problem with the power supply 86 (step S106), the system control circuit 50 determines whether the operation state of the recording medium 200 or 210 is a problem with the operation of the digital camera 100, particularly with respect to the recording / reproducing operation of image data on the recording medium. Is determined (step S107). If there is a problem, a predetermined warning is displayed by image or sound using the display unit 54 (step S108), and the process returns to step S103.

  If there is no problem in the operation state of the recording medium 200 or 210 (step S107), the process proceeds to step S109.

  The system control circuit 50 displays various setting states of the digital camera 100 using images and sounds using the display unit 54 (step S109). If the image display of the image display unit 28 is ON, the image display unit 28 is also used to display various setting states of the digital camera 100 using images and sounds.

  Subsequently, the system control circuit 50 checks the setting state of the image display ON / OFF switch 66 (step S114). If the image display is set to ON, the system control circuit 50 proceeds to step S115.

  The system control circuit 50 sets the image display flag (step S115) and sets the image display of the image display unit 28 to the ON state (step S116). Furthermore, the captured image data is set to a through display state for sequentially displaying (step S117), and the process proceeds to step S131 in FIG.

  In the through display state, the data sequentially written in the image display memory 24 via the image sensor 14, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 are transferred to the memory control circuit 22, D The images are sequentially displayed by the image display unit 28 via the / A converter 26. Thereby, the electronic finder function is realized.

  If the image display ON / OFF switch 66 is set to image display OFF (step S114), the image display flag is canceled (step S118), and the image display on the image display unit 28 is set to the OFF state (step S118). The process proceeds to step S119) and step S131.

  When the image display is OFF, shooting is performed using the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In this case, it is possible to reduce power consumption of the image display unit 28, the D / A converter 26, and the like that consume a large amount of power.

  The state of the image display flag is stored in the internal memory of the system control circuit 50 or the memory 52.

  If it is determined in step S131 in FIG. 3 that the shutter switch SW1 has not been pressed, the process returns to step S103.

  If the shutter switch SW1 is pressed (step S131), the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (step S132). If the image display flag has been set, the display state of the image display unit 28 is set to the freeze display state (step S133), and the process proceeds to step S134.

  In the freeze display state, rewriting of image data in the image display memory 24 via the image sensor 14, A / D converter 16, image processing circuit 20, and memory control circuit 22 is prohibited. The image data written last is displayed by the image display unit 28 via the memory control circuit 22 and the D / A converter 26, whereby the frozen video is displayed on the electronic viewfinder.

  If the image display flag has been canceled (step S132), the process proceeds to step S134.

  The system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, performs a photometry process, and determines an aperture value and a shutter time (step S134). In the photometric process, the flash is set if necessary.

  Details of the distance measurement / photometry processing routine performed in step S134 will be described later with reference to FIG.

  If the distance measurement / photometry processing routine is completed in step S134, the process proceeds to step S135. The system control circuit 50 determines whether or not the shutter speed to be set exceeds the shutter speed on the fastest side of the mechanical shutter from the set photographing operation mode and the exposure result determined in the distance measurement / photometry processing routine. (Step S135). If not exceeded, the mechanical shutter speed is set (step S136), and the process proceeds to step S138.

  If it is exceeded in step S135, the shutter time is set using both the mechanical shutter and the electronic shutter (step S137), and the process proceeds to step S138.

  The system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (step S138). If the image display flag has been set, the display state of the image display unit 28 is set to the through display state (step S139), and the process proceeds to step S140.

  Thus, when the shutter speed to be set exceeds the shutter speed on the fastest side of the mechanical shutter, the electronic shutter is used in combination. Accordingly, it is possible to prevent smear from being generated by the mechanical shutter and to enable a high shutter speed by the electronic shutter.

  If the shutter switch SW2 is not pressed (step S140) and the shutter switch SW1 is also released (step S141), the process returns to step S103.

  If the shutter switch SW2 is pressed (step S140), the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (step S142). If the image display flag is set, the display state of the image display unit 28 is set to the fixed color display state (step S143), and the process proceeds to step S161 in FIG.

  In the fixed color display state, instead of the photographic image data written in the image display memory 24 via the image sensor 14, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22, the fixed image is replaced. Display color image data. The fixed color image data is displayed by the image display unit 28 via the memory control circuit 22 and the D / A converter 26, thereby displaying a fixed color image on the electronic viewfinder.

  If the image display flag has been canceled (step S142), the process proceeds to step S161 in FIG.

  The system control circuit 50 executes the following shooting process (step S161). That is, the image data captured in the memory 30 is acquired via the image sensor 14, the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter via the memory control circuit 22. Write exposure processing. Further, using the memory control circuit 22 and, if necessary, the image processing circuit 20, the image data written in the memory 30 is read and various development processes are performed.

  Details of the photographing processing routine performed in step S161 will be described later with reference to FIG.

  The system control circuit 50 reads out part of the image data written in a predetermined area of the memory 30 via the memory control circuit 22 and performs WB (white balance) integration calculation processing OB ( (Optical black) Performs integral calculation processing. Then, the calculation result is stored in the internal memory of the system control circuit 50 or the memory 52.

  Then, the system control circuit 50 reads out the captured image data written in a predetermined area of the memory 30 using the memory control circuit 22 and, if necessary, the image processing circuit 20. Then, various development processes including an AWB (auto white balance) process, a gamma conversion process, and a color conversion process are performed using the calculation result stored in the internal memory of the system control circuit 50 or the memory 52 (step S163). Details of the development processing routine executed in step S163 will be described later with reference to FIG.

  When the development processing (step S163) is completed, the system control circuit 50 generates thumbnail images and low-resolution image data for quick review display using the resizing circuit 34 for the image data written in the memory 30. (Step S164). The low-resolution image data is resized to a display image size using the resizing circuit 34, recorded in the image display memory 24, and displayed on the image display unit 28, and a first quick review display is performed (step S165). . An example of the first quick review display is shown in FIG. 8A.

  In the quick review displayed here, the red-eye phenomenon is not corrected, but it can be used for confirming the photographing result other than the red-eye, such as confirmation of the angle of view.

  Next, the system control circuit 50 determines whether or not the shooting is shooting using a flash (step S166). If the flash is used, the process proceeds to the next step S167. If it is not flash photography, red-eye detection and correction processing is not performed, and the process proceeds to step S171.

  In step S167, the system control circuit 50 determines whether the red-eye phenomenon has occurred in the image data captured by the red-eye detection circuit 36 for the low-resolution image data recorded in the memory 30 generated in step S164. Detecting that.

  If the red-eye phenomenon has occurred (step S168), the system control circuit 50 superimposes and displays the character “processing” in the quick review (step S180). Then, the coordinates where the red-eye is generated for the low-resolution image data obtained in step S167 are converted into coordinates for the captured image by calculation (step S169). For example, if the captured image is 2048 × 1536 (3 million pixels) and the low-resolution image is 640 × 480 (VGA 300,000 pixels), the red-eye coordinates obtained from the display image are multiplied by 3.2 in both the vertical and horizontal directions. Thus, the red-eye coordinates on the photographed image are obtained.

  FIG. 8B shows an example of a display during processing.

  If the red-eye phenomenon is not detected (step S168), the process proceeds to step S171.

  When the red-eye coordinates on the captured image are obtained, the system control circuit 50 corrects the red-eye phenomenon around the red-eye coordinates of the original image data using the red-eye correction circuit 38 and records it in the memory 30 (step S170).

  The system control circuit 50 ends the “processing in progress” display on the image display unit 28 (step S181). Then, the captured image data written in the memory 30 is read out, various image processing is performed using the memory control circuit 22 and the image processing circuit 20 as necessary, and the mode set using the compression / decompression circuit 32 is determined. The image compression process is performed (step S171).

  Here, only when red-eye is detected by red-eye detection, the in-process display is displayed during red-eye correction. However, if the red-eye detection circuit is configured with software, the red-eye detection process also takes time, so red-eye detection is performed. You may be made to perform a display during processing.

  In this embodiment, the quick review whose red-eye phenomenon is not corrected is displayed before the red-eye coordinate detection. However, there is no problem even if the quick review is displayed after the red-eye coordinate detection (before the red-eye correction).

  Next, the system control circuit 50 uses the resize circuit 34 to re-generate thumbnail image and low-resolution image data for quick review display on the image data after the red-eye correction process written in the memory 30 ( Step S172). The low-resolution image data is resized to a display image size using the resizing circuit 34, recorded in the image display memory 24, and displayed on the image display unit 28, and a second quick review display is performed (step S173). . An example of the second quick review display is shown in FIG. 8C.

  Here, the quick review in which the red-eye phenomenon is not corrected is displayed in step S165, and the quick review in which the red-eye phenomenon is corrected is displayed in step S173, so that the user can easily confirm the effect of the red-eye correction due to the change in the display image. Become.

  In addition, during red-eye correction, red-eye correction processing was automatically performed by displaying “In-process” etc. along with the quick review display before red-eye correction, and then displaying the quick review after red-eye correction. It becomes easier for the user to understand. If the red-eye correction process is not performed, the process of step S172 may not be executed, and the quick review display may be performed using the low-resolution image data generated in step S164 in step S173. At this time, the first quick review display and the second quick review display in step S165 are the same display.

  The system control circuit 50 generates a thumbnail image from the low-resolution image data generated in step S172 using the compression / decompression circuit 32, adds the thumbnail image to the image data, and records it (step S174).

  The system control circuit 50 reads the image data stored in the image storage buffer area of the memory 30. Then, a recording process for writing to the recording medium 200 or 210 such as a memory card or a compact flash (registered trademark) card is performed via the interface 90 or 94 and the connector 92 or 96 (step S174).

  Until the shutter switch SW1 is released (step S175), the system control circuit 50 repeats the current processing.

  If the shutter switch SW1 is released (step S175), the process proceeds to step S176.

  The system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (step S176). If the image display flag has been set (step S176), the display state of the image display unit 28 is set to the through display state (step S177), and a series of photographing operations are finished, and the process returns to step S103.

  If the image display flag has been canceled (step S176), the image display of the image display unit 28 is set to the OFF state, a series of photographing operations are finished, and the process returns to step S103.

  FIG. 5 is a detailed flowchart of the distance measurement / photometry process in step S134 of FIG.

  The system control circuit 50 reads the charge signal from the image sensor 14 and sequentially reads the captured image data into the image processing circuit 20 via the A / D converter 16 (step S201). Using the sequentially read image data, the image processing circuit 20 is a predetermined used for TTL (through-the-lens) AE (automatic exposure) processing, EF (flash pre-flash) processing, and AF (autofocus) processing. The operation is performed.

  In each processing here, a specific portion of the total number of photographed pixels is extracted by extracting a necessary portion according to necessity and used for calculation. As a result, in the TTL method AE, EF, AWB, and AF processes, it is possible to perform an optimal calculation for each different mode such as the center-weighted mode, the average mode, and the evaluation mode.

  Using the calculation result in the image processing circuit 20, the system control circuit 50 performs AE control using the exposure control unit 40 (step S203) until it is determined that the exposure (AE) is appropriate (step S202).

  Using the measurement data obtained by the AE control, the system control circuit 50 determines whether or not the flash is necessary (step S204). If the flash is necessary, the flash flag is set and the flash 404 is charged (step S205). ).

  If it is determined that the exposure (AE) is appropriate (step S202), the measurement data and / or setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50.

  Using the calculation result in the image processing circuit 20 and the measurement data obtained by the AE control, the system control circuit 50 uses the image processing circuit 20 until the white balance (AWB) is determined to be appropriate (step S206). AWB control is performed (step S207). In AWB control, color processing parameters are adjusted.

  If it is determined that the white balance (AWB) is appropriate (step S206), the measurement data and / or setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50.

  Using the measurement data obtained by the AE control and the AWB control, the system control circuit 50 performs the AF control using the distance measurement control unit 42 until the distance measurement (AF) is determined to be in focus (step S208). (Step S209).

  If distance measurement (AF) is determined to be in focus (step S208), the measurement data and / or setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52, and the distance measurement / photometry processing routine S134 is terminated. .

  FIG. 6 is a detailed flowchart of the photographing process in step S161 of FIG.

  After performing the charge clear operation of the image sensor 14 (step S301), the system control circuit 50 starts charge accumulation of the image sensor 14 (step S302). Thereafter, the shutter 12 is opened by the exposure controller 40 (step S303), and exposure of the image sensor 14 is started (step S304).

  Here, it is determined whether or not the flash 404 is necessary based on the flash flag (step S305), and if necessary, the flash is emitted (step S306).

  If the flash 404 is unnecessary or unusable, the process proceeds to step S307.

  The system control circuit 50 waits for the end of exposure of the image sensor 14 according to the photometric data (step S307), closes the shutter 12 by the exposure control unit 40 (step S308), and ends the exposure of the image sensor 14.

  If the set charge accumulation time has elapsed (step S309), the system control circuit 50 ends the charge accumulation of the image sensor 14 (step S310). Thereafter, a charge signal is read out from the image sensor 14, and the memory 30 is connected via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22. The photographed image data is written in the predetermined area (step S311).

  When the series of processing is finished, the photographing processing routine S161 is finished.

  FIG. 7 is a detailed flowchart of the development processing in step S163 of FIG.

  The system control circuit 50 reads the captured image data and dark image data written in the memory 30 and sequentially performs luminance signal processing (step S501) and color processing (step S502), and then finishes processing in the memory 30. Write the image data.

  When the series of processing is finished, the development processing routine S163 is finished.

  The embodiment of the present invention has been described above.

  In the above embodiment, the case where the present invention is applied to a lens shutter type digital camera has been described. However, the present invention is also applicable to a single-lens reflex digital camera with interchangeable lenses. is there.

  Needless to say, the red-eye detection circuit 36 and the red-eye correction circuit 38 may be configured by hardware, or may be configured by software built in the system control circuit 50.

  Of course, there is no problem even if the recording media 200 and 210 are composite media in which a memory card and a hard disk are integrated. Further, there is no problem even if a part of the composite medium is detachable.

  In the above embodiment, the recording media 200 and 210 are described as being separated from the digital camera 100 and can be arbitrarily connected. However, any or all of the recording media remain fixed to the digital camera 100. Of course, there is no problem.

  Further, the digital camera 100 may be configured such that any one or a plurality of recording media 200 or 210 can be connected.

  Further, although the description has been given of the configuration in which the recording mediums 200 and 210 are mounted on the digital camera 100, there is of course no problem even if the recording medium has a single or a plurality of combinations.

  Further, although the flash device 400 is described as being separated from the digital camera 100 and can be arbitrarily connected, it is of course no problem if the flash device 400 remains fixed to the digital camera 100.

  In addition, there is no problem even if the plurality of flash devices 400 are individually connectable to the digital camera 100 and / or remain fixed.

(Other embodiments)
The object of each embodiment is also achieved by the following method. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but the present invention includes the following cases. That is, based on the instruction of the program code, an operating system (OS) or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  Furthermore, the following cases are also included in the present invention. That is, the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, a CPU or the like provided in the function expansion card or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  When the present invention is applied to the above storage medium, the storage medium stores program codes corresponding to the procedure described above.

It is a figure which shows the structure of the digital camera concerning one Embodiment of this invention. It is a flowchart of the main routine of the digital camera concerning one Embodiment of this invention. It is a flowchart of the main routine of the digital camera concerning one Embodiment of this invention. It is a flowchart of the main routine of the digital camera concerning one Embodiment of this invention. It is a flowchart of a distance measurement and photometry routine in the digital camera of one embodiment. It is a flowchart of the imaging | photography routine in the digital camera of one Embodiment. 6 is a flowchart of a development routine in the digital camera of the embodiment. It is a figure which shows the quick review display before red-eye correction | amendment. It is a figure which shows the quick review display during red-eye correction | amendment. It is a figure which shows the quick review display after red-eye correction | amendment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Shooting lens 12 Shutter 14 Image pick-up element 16 A / D converter 18 Timing generation circuit 20 Image processing circuit 22 Memory control circuit 24 Image display memory 26 D / A converter 28 Image display part 30 Memory 32 Image compression / decompression circuit 34 Resize Circuit 36 Red-eye detection circuit 38 Red-eye correction circuit 40 Exposure control unit 42 Distance control unit 44 Zoom control unit 46 Barrier control unit 48 Connector (accessory shoe)
50 System control circuit 52 Memory 54 Display unit 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1
64 Shutter switch SW2
66 Image display ON / OFF switch 68 Single shooting / Continuous shooting switch 70 Operation unit 80 Power supply control unit 82 Connector 84 Connector 86 Power supply unit 90 Interface 92 Connector 94 Interface 96 Connector 98 Recording medium attachment / detachment detection unit 100 Digital camera 102 Protection unit 104 Optical Finder 106 Image display unit open / close detection unit 200 Recording medium 202 Recording unit 204 Interface 206 Connector 210 Recording medium 212 Recording unit 214 Interface 216 Connector 400 Flash device 402 Connector 404 Flash

Claims (7)

Imaging means for capturing a subject image;
Display means for displaying an image;
A red-eye correction unit that performs a red-eye correction process for correcting a portion in which a red-eye phenomenon occurs with respect to the still image captured by the imaging unit;
The first display image generated from the first still image after the first still image is captured by the imaging unit and before the red-eye correction process is performed on the first still image is displayed. The imaging means is configured to display on the display means a second display image generated from a second still image that has been displayed on the means and then subjected to the red-eye correction process on the first still image. And control means for controlling the display means;
An imaging apparatus comprising:   First low-resolution image generation means for generating a first low-resolution image as the first display image from the first still image, and the second display from the second still image The imaging apparatus according to claim 1, further comprising: a second low-resolution image generation unit configured to generate a second low-resolution image as a work image.   The red-eye correction means performs a red-eye correction process on the first still image using information regarding a position of a portion where a red-eye phenomenon detected from the first low-resolution image has occurred. Item 3. The imaging device according to Item 2.   While the display means is displaying the first display image, the control means superimposes the first display image on the display means to indicate that the red-eye correction processing is being performed. The imaging apparatus according to claim 1, wherein the imaging apparatus is displayed. An imaging unit that captures a subject image, a display unit that displays an image, and a red-eye correction unit that performs a red-eye correction process for correcting a portion in which a red-eye phenomenon occurs with respect to a still image captured by the imaging unit. A method for controlling an imaging device comprising:
An imaging step of capturing a first still image by the imaging means;
A first display step of causing the display means to display a first display image generated from the first still image before performing the red-eye correction process on the first still image;
A second display step of causing the display means to display a second display image generated from the second still image obtained by performing the red-eye correction process on the first still image;
An image pickup apparatus control method comprising:   A program for causing a computer to execute the control method according to claim 5.   A computer-readable storage medium storing the program according to claim 6.