JP2007295545A - Image processing device, image processing method, image pickup device, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To correct a portion in which a red-eye phenomenon occurs in a screen more accurately. <P>SOLUTION: The device comprises: a first red-eye corrector 20 for automatically detecting a red eye from a subject image to be corrected, and correcting the red eye; a second red-eye corrector 20 for correcting a red eye of the subject image specified by a user; a determining section 50 for determining whether or not the subject image has been corrected by at least one of the first and second red-eye correctors; and a correction suppressor 50 for suppressing a red-eye correction operation of the first red-eye corrector if determined that the subject image has been subjected to the red-eye correction. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique for correcting a red-eye phenomenon that occurs in an image taken by an imaging device such as a digital camera.

  Conventionally, an imaging apparatus such as a digital camera that records and reproduces a still image using a memory card having a solid-state memory element as a recording medium is already on the market.

  Further, in a conventional camera using a silver salt film, when a person is photographed using a flash, there is a problem that a red-eye phenomenon may occur in which the eye color is photographed in red. This red-eye phenomenon is a phenomenon in which flash light incident on the pupil projects blood vessels in the retina. Particularly in the dark, the eye pupil is open, so there is a high possibility that the red-eye phenomenon will occur. In contrast, conventional silver halide cameras also use a lamp, LED, or flash pre-flash to irradiate the subject with light in order to contract the pupil during shooting, and contract the pupil during shooting. Trying to alleviate the red eye phenomenon. However, when the subject is not gazing at the photographer side, it is difficult to completely eliminate the red-eye phenomenon because the red-eye reduction effect is small.

  The red-eye phenomenon at the time of flash photography also occurs in digital cameras. In conventional digital cameras, red-eye mitigation measures are taken to irradiate the subject with light before shooting, as with silver-salt cameras. Therefore, as with silver-salt cameras, the red-eye phenomenon during shooting cannot be completely avoided. . Therefore, in order to correct the generated red-eye phenomenon, it is necessary to manually correct the red eye using image processing software or the like on the electronic image after shooting.

  On the other hand, there has been proposed an image processing apparatus that automatically detects the position of a person's face and eyes and automatically or semi-automatically corrects red eyes when a red-eye phenomenon occurs based on the information. . For example, there is a technique in which face detection is first performed by cutting out an area regarded as skin color, and red-eye detection is performed on the detected face area (see Patent Document 1).

In addition, there has been proposed a camera that performs face detection using a combination of an algorithm that compares a face shape model with a face probability and pattern matching (see Patent Document 2).
Japanese Patent Laid-Open No. 10-0233929 JP 2001-309225 A

  However, it is technically difficult to automatically detect and correct the face for all the locations where the red-eye phenomenon occurs in the image. For example, in the correction for detecting a face by using an algorithm for comparing the face shape model with the face probability and pattern matching together, the faces of all people are not always detected when a plurality of people are captured as subjects. Absent. In other words, people who are facing sideways may not be able to detect, and some undetectable face red eyes may remain, or if the skin area is identified to identify the face area and red eye correction is performed, May be mistaken for red-eye and an unnatural correction may be performed. In addition, in the correction method in which automatic detection is performed and correction is automatically performed, when redevelopment is performed on an image that has already been corrected, and red-eye has already been corrected, There are cases where the portion cannot be detected. For example, a case will be described as an example where there is a person whose blood vessels are seen through and the edges of the eyelids are reddish. Before red-eye correction, the red pupil is more easily recognized as red-eye than the eyelid edge, so the possibility of erroneous detection is reduced. However, after red-eye correction, since there are no red eyes, there is a possibility that red eyes may be recognized as red eyes near the eyes and the reddish eyelids. It will be higher than if it exists. For this reason, there is a problem in that erroneous correction (an area other than red-eye is corrected) may be performed on an image whose red-eye has already been corrected.

  Therefore, the present invention has been made in view of the above-described problems, and an object thereof is to make it possible to more accurately correct a portion where a red-eye phenomenon occurs in a screen.

  In order to solve the above-described problems and achieve the object, an image processing apparatus according to the present invention includes a processing unit that performs correction processing for correcting a region that satisfies a condition to be corrected in a target image, and the target image. Is a determination unit that determines whether or not the correction process has been performed, and the correction process for the target image when the determination unit determines that the target image has been subjected to the correction process. Correction suppression means for suppressing the implementation of the above.

  An image pickup apparatus according to the present invention includes an image pickup device that performs photoelectric conversion of a subject image, a storage unit that stores an image picked up by the image pickup device, and the image processing device.

  The image processing method according to the present invention includes a correction step of correcting a region satisfying a condition as a target to be corrected in the target image, and whether or not the target image has been corrected in the correction step. And a correction suppressing step for suppressing execution of correction in the correction step for the target image when it is determined in the determination step that the target image has been corrected in the correction step. It is characterized by providing.

  A program according to the present invention causes a computer to execute the above image processing method.

  A storage medium according to the present invention stores the above program.

  According to the present invention, it is possible to more accurately correct a portion in the screen where the red-eye phenomenon occurs.

  Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

  In the present embodiment, processing for correcting a red-eye image photographed with a digital camera will be described.

  FIG. 1 is a block diagram showing a configuration of a digital camera (image processing apparatus) 100 according to an embodiment of the present invention.

  In FIG. 1, 10 is a photographing lens, 12 is a shutter, 14 is an image sensor that converts an optical image into an electrical signal (photoelectrically converts a subject image), and 16 is an analog signal output from the image sensor 14 that is converted into a digital signal A. / D converter. The timing generator 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26 to control their operations. The timing generator 18 is controlled by the memory controller 22 and the system controller 50. The image processing unit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control unit 22. In addition, the image processing unit 20 performs predetermined calculation processing using the captured image data, and the system control unit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the calculation result obtained therefrom. Execute. That is, TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed. The image processing unit 20 performs predetermined calculation processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained calculation result.

  The memory control unit 22 controls the A / D converter 16, the timing generation unit 18, the image processing unit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression unit 32. Thus, the digital data A / D converted by the A / D converter 16 is sent to the image display memory 24 or the memory 30 via the image processing unit 20, the memory control unit 22, or directly via the memory control unit 22. Is written to.

  The image display memory 24 stores data to be displayed on the image display unit 28, and the data stored in the image display memory 24 is supplied to an image display unit such as a TFT or LCD via a D / A converter 26. It is output to 28 and displayed. If the captured image data is sequentially displayed by the image display unit 28, a function as an electronic viewfinder can be realized. The image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control unit 50. When the display is turned off, the power consumption of the digital camera 100 can be greatly reduced.

  The memory 30 is a memory for storing captured still images and moving images, and has a storage capacity sufficient to store a predetermined number of still images and a predetermined amount of moving images. This makes it possible to write a large amount of image data to the memory 30 at high speed even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot. The memory 30 can also be used as a work area for the system control unit 50. The compression / decompression unit 32 can compress and decompress image data by, for example, adaptive discrete cosine transform (ADCT), wavelet transform, or the like. In other words, the image data stored in the memory 30 can be read and compressed, or the compressed image data can be read and decompressed, and the processed data can be written to the memory 30.

  The exposure control unit 40 controls the shutter 12 having a diaphragm function, and also has a flash light control function in cooperation with the flash unit 48. The distance measurement control unit 42 controls the focusing of the lens 10 and detects the distance of the subject from the focusing position of the lens 10. The zoom control unit 44 controls zooming of the lens 10. The barrier control unit 46 controls the operation of the protection unit 102. The flash unit (flash) 48 also has an AF auxiliary light projecting function and a flash light control function. The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing unit 20, the system control unit 50 performs the exposure control unit 40 and the distance measurement. The controller 42 and the barrier controller 46 are controlled. The auxiliary light source 49 is used as an auxiliary light source for through display when it is dark, used as auxiliary light for the distance measurement control unit 42, and further used as red-eye reduction illumination.

  The system control unit 50 controls the overall operation of the digital camera 100. The memory 52 stores constants, variables, programs, and the like for operation of the system control unit 50, and is also used as a work memory. The display unit 54 includes a liquid crystal display unit, a speaker, and the like that display an operation state, a message, and the like using characters, images, sounds, and the like according to execution of the program by the system control unit 50. The display unit 54 is installed at a single or a plurality of positions in the vicinity of the operation unit 70 of the digital camera 100 so as to be easily visible, and is configured by a combination of an LCD, an LED, a sound generation element, and the like. In addition, a part of the function of the display unit 54 is installed in the optical viewfinder 104. Among the display contents of the display unit 54, what is displayed on the LCD or the like includes single shot / continuous shooting display, self-timer display, compression rate display, recording pixel number display, recording number display, remaining image number display, There are shutter speed display, aperture value display, exposure compensation display, and the like. Also, flash display, red-eye reduction display, red-eye correction display, macro shooting display, buzzer setting display, clock battery level display, battery level display, error display, information display with multiple digits, and storage media 200 and 210 There are also attachment / detachment status display, communication I / F operation display, date / time display, and the like. Among the display contents of the display unit 54, what is displayed on the optical viewfinder 104 includes in-focus display, camera shake warning display, flash charge display, shutter speed display, aperture value display, exposure correction display, and the like.

  The nonvolatile memory 56 is an electrically erasable and recordable (storable) memory. For example, an EEPROM or the like is used. The mode switching lever 60, shutter switches 62 and 64, image display on / off switch 66, quick review on / off switch 68, and operation unit 70 are operation units for inputting various operation instructions of the system control unit 50. . These are composed of one or a plurality of combinations such as a switch, dial, touch panel, pointing by eye-gaze detection, and a voice recognition device.

Next, these operation units will be specifically described here.
The mode switching lever 60 can switch and set each function mode such as power-off, playback mode, moving image shooting mode, and still image shooting mode.

  The shutter switch (SW1) 62 is turned on during the operation of the shutter button 303 (see FIG. 2), and instructs to start operations such as AF (autofocus) processing, AE (automatic exposure) processing, and AWB (auto white balance) processing. To do. The shutter switch (SW2) 64 is turned on when the operation of the shutter button 303 is completed. In the flash photographing mode, the shutter switch (SW2) 64 instructs to start the light emission control of the flash unit 48. In addition, an instruction to start an exposure process for writing a signal read from the image sensor 14 as image data to the memory 30 via the A / D converter 16 and the memory control unit 22 is also given. In addition, an instruction to start development processing using calculation in the image processing unit 20 and the memory control unit 22 is also given. Further, the image data is read from the memory 30, red-eye detection and correction processing, compression is performed by the compression / decompression unit 32, and an instruction to start recording (storage) processing for writing the image data to the storage medium 200 or 210 is also given.

  The image display on / off switch 66 can set on / off of image display on the image display unit 28. With this function, when photographing is performed using the optical viewfinder 104, it is possible to save power by cutting off the power supply to the image display unit 28 including TFT, LCD, and the like.

  The quick review on / off switch 68 sets a quick review function for automatically reproducing the captured image data immediately after shooting. In the present embodiment, it is assumed that a function for setting a quick review function when the image display unit 28 is turned off is provided.

  The red-eye correction on / off switch 69 sets a red-eye correction function as to whether to detect red-eye and correct the red-eye portion of the captured image. In the present embodiment, red-eye detection and red-eye correction are performed only when the red-eye correction on / off switch 69 is turned on.

  The operation unit 70 includes various buttons, a touch panel, and the like. These switches and buttons include a menu button, a set button, a macro button, a multi-page playback page break button, a flash setting button, single shooting / continuous shooting / self-timer switching. There are buttons. There are also a menu movement + (plus) button, menu movement-(minus) button, reproduction image movement + (plus) button, reproduction image movement-(minus) button, and the like. Further, there are a shooting image quality selection button, an exposure correction button, a date / time setting button, a red-eye reduction button, a red-eye edit button, a red-eye correction print button, and the like.

  The power supply control unit 80 includes a battery detection unit, a DC-DC converter, a switch unit that switches a block to be energized, and the like. Then, the presence / absence of a battery, the type of battery, and the remaining battery level are detected, the DC-DC converter is controlled based on the detection result and the instruction of the system control unit 50, and the necessary voltage is stored for a necessary period. Supply to each part including the medium. Reference numerals 82 and 84 denote connectors, and the power source 86 includes primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCD batteries, NiMH batteries, and Li ion batteries, or AC adapters.

  Reference numerals 90 and 94 denote interfaces with a storage medium such as a memory card or a hard disk, and reference numerals 92 and 96 denote connectors for connecting to a storage medium such as a memory card or a hard disk. The storage medium attachment / detachment detection unit 98 detects whether or not the storage medium 200 or 210 is attached to the connector 92 and / or 96.

  In the present embodiment, the description has been given assuming that there are two systems of interfaces and connectors for attaching the storage medium. Of course, the interface and connector to which the storage medium is attached may have a single or plural number of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard. The interface and connector may be configured using a PCMCIA card, a CF (Compact Flash (registered trademark)) card, or the like that conforms to a standard.

  Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using a PCMCIA card, a CF (Compact Flash (registered trademark)) card, or the like, the following processing can be performed. That is, various communication cards such as a LAN card, a modem card, a USB card, an IEEE 1394 card, a P1284 card, a SCSI card, and a communication card such as a PHS are connected. As a result, image data and management information attached to the image data can be transferred to and from peripheral devices such as other computers and printers.

  The protection unit 102 functions as a barrier that prevents the imaging unit from being soiled or damaged by covering the imaging unit including the lens 10 of the digital camera 100. The optical viewfinder 104 can take an image using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28. The optical viewfinder 104 is provided with some functions of the display unit 54, such as a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, and an exposure correction display. The communication unit 110 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication. An antenna (connector) 112 is used to connect the digital camera 100 to another device by the communication unit 110, and is a connector in the case of wired connection, and an antenna in the case of wireless communication.

  The storage medium 200 is a storage medium such as a memory card or a hard disk. The storage medium 200 includes a storage unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface 204 with the digital camera 100, and a connector 206 for connecting with the digital camera 100. The storage medium 210 is a storage medium such as a memory card or a hard disk. The storage medium 210 also includes a storage unit 212 composed of a semiconductor memory, a magnetic disk, or the like, an interface 214 with the digital camera 100, and a connector 216 that connects to the digital camera 100.

  FIG. 2 is an external perspective view of the digital camera of the present embodiment.

  Reference numeral 302 denotes a mode switching lever which can switch and set each function mode such as power-off, playback mode, moving image shooting mode, still image shooting mode, and the like. The mode switching lever 302 corresponds to the mode switching lever 60 in FIG. Reference numeral 303 denotes a shutter button. An image captured by the camera is displayed on the image display unit 304, which is normally referred to as an LCD since it normally uses an LCD (liquid crystal display). The image display unit 304 corresponds to the image display unit 28 in FIG. A screen for reproducing a still image and / or a moving image is also displayed on the LCD 304. Reference numeral 305 denotes a MENU button that is used to enter and exit a menu screen for changing shooting parameters and camera settings. A SET button 306 is used for determining a menu. Reference numeral 307 denotes a delete button, which can specify deletion of an image. A DISP button 308 is a button for switching presence / absence of display on the LCD 304. The DISP button 308 corresponds to the image display on / off switch 66 in FIG. Reference numeral 309 denotes a cross button, which is used to move items on the menu screen using the up / down / left / right buttons, or to push the left / right buttons to perform image forwarding in the playback mode. Reference numeral 69 denotes a red-eye correction switch for entering a mode for correcting red-eye of a photographed image.

  3A and 3B are flowcharts for explaining the operation in the main processing routine in the digital camera 100 according to the present embodiment.

  This process is started when the power is turned on, for example, after battery replacement. First, in step S101, the system control unit 50 initializes various flags and control variables in the memory 52, and in step S102, the image display unit 28 and the display are displayed. The display of the unit 54 is initialized to the off state. Next, in step S103, the setting position of the mode switching lever 60 is determined. If the mode switching lever 60 is set to power off, the process proceeds to step S105, the display of each display unit is changed to the end state, and the protection unit The imaging unit is protected by closing the barrier 102. In addition, necessary parameters, setting values, and setting modes including flags and control variables are stored in the nonvolatile memory 56, and unnecessary power sources for various parts of the digital camera 100 including the image display unit 28 are shut off by the power source control unit 80. Then, the process returns to step S103 again.

  In step S103, if the mode switching lever 60 is set to the shooting mode, the process proceeds to step S106. If the other mode is set, the process proceeds to step S104, and the mode selected by the mode switching lever 60 is set. Perform the appropriate process. Then, when the process is finished, the process returns to step S103.

  If the shooting mode is set, the process proceeds to step S106, and based on the signal from the power control unit 80, is the remaining capacity of the power source 86 constituted by a battery or the operation status problematic in the operation of the digital camera 100? Judge whether or not. If it is determined that there is a problem, the process proceeds to step S108, where a predetermined warning is displayed by an image or sound using the display unit 54, and then the process returns to step S103.

  If it is determined in step S106 that there is no problem with the power source 86, the process proceeds to step S107, and whether or not the operation state of the storage medium 200 or 210 has a problem in the operation of the digital camera 100, particularly in the storage / reproduction operation of image data with respect to the storage medium. Judging. If it is determined that there is a problem, the process proceeds to step S108 described above, and a predetermined warning is displayed by an image or sound using the display unit 54, and then the process returns to step S103.

  If it is determined in step S107 that there is no problem, the process proceeds to step S109, and UI display of various setting states of the digital camera 100 is performed using an image or sound using the display unit 54. If the image display of the image display unit 28 is on (the image display on / off switch 66 is on), the UI display of various setting states of the digital camera 100 is also performed using the image display unit 28 using the image and sound. You may go. Thus, various settings are made by the user.

  In step S110, the setting state of the red-eye correction on / off switch 69 is checked. If red-eye correction is set to on, the process proceeds to step S111, and the red-eye correction flag is set to on. On the other hand, if the red-eye correction switch is set to OFF in step S110, the process proceeds to step S112, and the red-eye correction flag is turned off.

  In step S113, the setting state of the image display on / off switch 66 is checked. If the image display is set to on, the process proceeds to step S114, and the image display flag in the memory 52 is set to on. In step S115, the image display on the image display unit 28 is set to an on state. Further, in step S116, the image data captured by the image sensor 14 is set to a through display state in which the image data is sequentially displayed, and the process proceeds to step S119 (FIG. 3B). In this through display state, data sequentially written in the image display memory 24 via the image sensor 14, the A / D converter 16, the image processing unit 20, and the memory control unit 22 are stored in the memory control unit 22, the D / A. The images are sequentially displayed by the image display unit 28 via the converter 26. Thereby, the electronic finder function is realized.

  On the other hand, if the image display on / off switch 66 is set to image display off in step S113, the process proceeds to step S117, the image display flag is turned off, and the display of the image display unit 28 is turned off in step S118. Set and go to step S119. When the image display is off, the image is taken using the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In this case, it is possible to reduce power consumption of the image display unit 28, the D / A converter 26, and the like that consume a large amount of power.

  In step S119, it is checked whether or not the shutter switch (SW1) 62 is pressed. If not, the process returns to step S103. On the other hand, if the shutter switch (SW1) 62 has been pressed, the process proceeds to step S120 to check whether the image display flag is set to ON. If it is set to ON, the process proceeds to step S121, the display state of the image display unit 28 is set to the freeze display state, and the process proceeds to step S122. In this freeze display state, rewriting of image data in the image display memory 24 via the image sensor 14, A / D converter 16, image processing unit 20, and memory control unit 22 is prohibited. The image data written last is displayed by the image display unit 28 via the memory control unit 22 and the D / A converter 26, thereby displaying the frozen image on the optical viewfinder 104.

  If the image display flag is off in step S120, the process proceeds to step S122. In step S122, a distance measurement process is performed to focus the lens 10 on the subject, and a photometry process is performed to determine an aperture value and a shutter speed. In this photometric process, the flash is set if necessary.

  In step S122, when the distance measurement and photometry processing ends, the process proceeds to step S123, and the state of the image display flag is determined. If the image display flag is set to ON, the process proceeds to step S124, the display state of the image display unit 28 is set to the through display state, and the process proceeds to step S125. The through display state in step S124 is the same operation as the through state in step S116.

  In step S125, if the shutter switch (SW2) 64 is not pressed and the shutter switch (SW1) 62 is turned off, the process returns to step S103 (FIG. 3A).

  On the other hand, when the shutter switch (SW2) 64 is pressed in step S125, the process proceeds to step S127 to determine whether the image display flag is on. If the image display flag is on, the process proceeds to step S128, the display state of the image display unit 28 is set to the fixed color display state, and the process proceeds to step S129. In this fixed color display state, the captured image data written in the image display memory 24 via the image sensor 14, A / D converter 16, image processing unit 20, and memory control unit 22 is not displayed. Instead, the replaced fixed-color image data is displayed on the image display unit 28 via the memory control unit 22 and the D / A converter 26. In this way, a fixed color image is displayed on the electronic viewfinder.

  If it is determined in step S127 that the image display flag is off, the process proceeds to step S129. In this step S129, the captured image data is acquired via the image sensor 14, the A / D converter 16, the image processing unit 20, the memory control unit 22, or directly from the A / D converter 16 via the memory control unit 22. Is written in the memory 30. Further, by using the memory control unit 22 and, if necessary, the image processing unit 20, the image data written in the memory 30 is read and various development processes are performed. A combination of the exposure process and the development process is a photographing process.

  When the photographing process of step S129 is executed in this way, the process proceeds to step S130, and the state of the quick review on / off switch is detected in advance to determine whether the image display flag is on. If the image display flag is on, the process proceeds to step S133, and it is determined in step S110 whether the red-eye correction switch is turned on and the red-eye correction flag is set. If the red-eye correction flag is set, automatic red-eye correction is performed in step S134, and the process proceeds to step S135 to perform a click review display of the image with the red-eye automatically corrected. Details of the automatic red-eye correction will be described later with reference to the flowchart of FIG. On the other hand, if the red-eye correction flag has not been set in step S133, the process proceeds to step S135 as it is, and an image that has not been corrected for red-eye is displayed as a quick review. Note that the state in which the image display flag is turned on in step S130 is a state in which the image display unit 28 is always displayed as an electronic viewfinder even during shooting, and quick review display immediately after shooting is also performed.

  If it is determined in step S130 that the image display flag is off, the process advances to step S131 to check whether the quick review flag is on. If the quick review flag is on, the process proceeds to step S132, the image display of the image display unit 28 is set to the on state, the above-described operations of steps S133 to S135 are performed, and then the process proceeds to step S136.

  If the image display flag is off in step S130 and the quick review flag is off in step S131, the process proceeds to the recording (storing) process in step S136 while the image display unit 28 remains off. In this case, the image display unit 28 remains off even after shooting, and no quick review display is performed. This is a usage method that places importance on power saving without using the electronic viewfinder function of the image display unit 28 without the need to check the photographed image immediately after photographing, as in the case of continuing photographing using the optical viewfinder 104. .

  In step S136, the captured image data written in the memory 30 is read out, and various image processes are executed using the memory control unit 22 and, if necessary, the image processing unit 20. Further, after performing image compression processing according to the mode set using the compression / decompression unit 32, recording processing for writing the compressed image data to the storage medium 200 or 210 is executed.

  When the recording process of step S136 is completed in this way, the process proceeds to step S137 to check whether the shutter switch (SW2) 64 has been pressed. If it has been pressed, the process proceeds to step S138, and the state of the continuous shooting flag is determined. If the continuous shooting flag is ON, the process proceeds to step S129 to continuously shoot and the next video is shot. On the other hand, if the continuous shooting flag is off in step S138, the process proceeds to step S137, and the processes in steps S137 and S138 are repeated until the shutter switch (SW2) 64 is released.

  If the shutter switch (SW2) 64 is turned off in step S137, the process proceeds to step S139, and after waiting for a predetermined minimum review time to elapse, the process proceeds to step S140. In step S140, it is checked whether the image display flag is on. If it is on, the process proceeds to step S141, the display state of the image display unit 28 is set to the through display state, and the process proceeds to step S143. Thereby, after confirming the captured image by the quick review display on the image display unit 28, it is possible to enter a through display state in which image data captured for the next imaging is sequentially displayed. If the image display flag is off in step S140, the process proceeds to step S142, the display of the image display unit 28 is set to the off state, and the process proceeds to step S143. Thus, after confirming the captured image by the quick review display on the image display unit 28, the function of the image display unit 28 is stopped for power saving, and the image display unit 28 or D / A conversion with large power consumption is stopped. It is possible to reduce the power consumption of the device 26 and the like.

  In step S143, it is checked whether the shutter switch (SW1) 62 is turned on. If so, the process proceeds to step S125 to prepare for the next shooting. If it is determined in step S143 that the shutter switch (SW1) 62 is off, the series of shooting operations is terminated and the process returns to step S103 (FIG. 3A).

  FIG. 4 is a flowchart showing a flow of red-eye automatic correction processing in step S134 of FIG. 3B. The red-eye correction process in step S134 is performed during a REC review immediately after shooting.

  When flash photography is performed by the camera, there is a possibility that red eyes are generated. Therefore, when the red eye correction flag is set in step S133 in FIG. 3B, automatic red eye correction is performed.

  First, in step 402, it is automatically determined whether red-eye correction has already been performed on the target image. If red-eye correction has already been performed on the target image, the process proceeds to step 405, and the red-eye automatic correction operation is terminated. This is because if the red-eye correction has already been performed once, the red-eye portion has been corrected. Therefore, if automatic red-eye correction is performed, lips other than the eyes are erroneously determined as red-eye portions, and incorrect correction is performed. It is because there is a possibility of doing.

  On the other hand, if red-eye correction has not been performed in step S402, the process proceeds to step 403. In addition, since the description here is at the time of a rec review immediately after shooting, there is no possibility other than the case where “red-eye correction is not executed”. In the red-eye automatic detection in step S403, a detailed description is omitted here, but the face is detected using the face detection technique disclosed in Japanese Patent Laid-Open Nos. 10-232934 and 2000-48184, etc. The eye area is determined, and red-eye correction is performed (step S404). Specifically, the edge information is used to identify an area where the position or shape is estimated to be a human eye, and it exists within the identified area, and the brightness, saturation, and hue are A region that satisfies a predetermined condition is recognized as red-eye. Although a detailed description of the red-eye correction method is omitted, the red-eye correction technique is, for example, using the technique described in Japanese Patent No. 3684017 to change the brightness and saturation of a region recognized as red-eye, or It is conceivable to change the hue. When the red-eye automatic detection and correction is completed, the red-eye automatic correction is ended in step S405.

  In the quick review screen in step S135 of FIG. 3B after this red-eye automatic correction is performed, as shown in FIG. 5, a frame is displayed in the portion showing the red-eye that has been corrected by red-eye automatic detection. That is, regarding the portion where the frame is displayed, the red-eye automatic correction target, and the eye portion where the frame is not displayed are not subject to red-eye automatic correction.

  Next, FIG. 6 is a flowchart showing the flow of processing when red-eye correction is performed on an already captured image while reproducing the image.

  First, the DISP button 308 (see FIG. 2) of the digital camera 100 is pressed to set the playback mode, and an image to be subjected to red-eye correction is selected (step S501). When the target image is selected, it is determined whether or not the red-eye correction on / off switch 69 (see FIG. 2) has been pressed, and waits until the red-eye correction on / off switch 69 is pressed (step S503).

  If the red-eye correction on / off switch 69 has been pressed in step S503, it is automatically determined in step S505 whether red-eye correction has already been performed on the target image. A method for determining whether or not the target image has already undergone red-eye correction will be described later. If the target image has not yet been subjected to red-eye correction, a selection screen for automatically correcting red eyes, manually correcting, or canceling is displayed below the image display section of the LCD 304 as shown in FIG. To do. On the other hand, if the target image has already been subjected to red-eye correction, as shown in FIG. 8, the automatic correction selection icon is displayed in gray or the like on the selection screen, and only manual correction or cancellation can be selected. This is because if the red-eye correction has already been performed at least once regardless of whether it is automatic or manual, the red-eye part is corrected. This is because the possibility of making a determination and making an incorrect correction increases.

  Next, while viewing the selection screen shown in FIG. 7 or FIG. 8, the user selects whether to correct red eyes automatically, manually correct, or cancel. In this case, as described above, when the target image has already been subjected to the red-eye correction, the red-eye automatic correction cannot be selected as shown in FIG. 8 (step S507).

  If cancel is selected in step S507, the red-eye correction routine is terminated without doing anything.

  If automatic correction is selected in step S507, the process proceeds to step S509 to automatically detect red eyes. In the automatic red-eye detection, a detailed description is omitted here, but the face is detected by using the face detection technique described in JP-A-10-232934, JP-A-2000-48184, etc. The area is determined and red-eye correction is performed (step 511). Although a detailed description of the red-eye correction method is omitted, it is conceivable that the technique described in Japanese Patent No. 3684017 is used as the red-eye correction technique.

  When automatic red-eye detection and correction are completed, as shown in FIG. 5, a frame is displayed in the portion indicating the red-eye that has been corrected by red-eye automatic detection. That is, regarding the portion where the frame is displayed, the red-eye automatic correction target, and the eye portion where the frame is not displayed are not subject to red-eye automatic correction.

  Thereafter, the process proceeds to step S521, the image after red-eye correction is stored in the memory, and the red-eye correction routine is ended.

  On the other hand, if the manual correction is selected in step S507, and if the red-eye correction has been performed once so far, as shown in FIG. 9, the red-eye that has been the target of the previous red-eye correction is shown in FIG. A frame is displayed in the part shown. While confirming the image of FIG. 9, the user selects whether or not to execute the setting of the red-eye manual frame (step 513). If there is no portion to be corrected for red eyes in the image of FIG. 9, the process proceeds to the corrected image storage in step 521, and the red eye correction is completed as it is.

  If the execution of red-eye manual frame addition (corresponding to execution of red-eye manual frame setting in step 513) is selected in FIG. Set. Here, a description of adding a red-eye manual frame will be given with reference to FIGS.

  10A is a diagram showing a screen after the red-eye manual frame addition button in FIG. 9 is selected. A red-eye manual addition frame is displayed in the center of the screen with a preset frame size. The user moves the red-eye manual additional frame with the cross button on the back of the camera. It is also possible to change the size of the red-eye manual additional frame with the zoom lever. When the position and size of the red-eye manual addition frame is determined and the user selects the position determination button in FIG. 10B, the screen shown in FIG. 11 is displayed. At this time, the red-eye area is extracted from the setting area, and the correction of the red-eye area is performed. It is executed (step S517). Here, if there is a red-eye portion to be further added, the red-eye manual frame addition operation in FIG. 11 is selected again to perform the red-eye manual frame addition operation. If it is not necessary to add a red-eye manual frame, a corrected image saving button is selected (step S519).

  When the corrected image storage is selected, the corrected image is stored as a file (step S521), and the process ends. However, at this time, information indicating that red-eye correction has been performed is written in the header area of the file. Note that the information indicating that red-eye correction has been performed is written in the header area of the file in the same manner when red-eye automatic correction is performed during quick review or playback.

  Here, it is determined whether or not the target image file has been subjected to red-eye correction based on a method of writing information indicating whether or not the target image file has executed red-eye correction (hereinafter referred to as red-eye correction execution information) and the red-eye correction execution information. A method will be described.

  Information indicating whether or not red-eye correction has been executed (hereinafter referred to as red-eye correction execution information) is written together when the image data is saved in a file as JPEG image data. Specifically, it is held in the same file separately from the image data by a method according to the Exif standard (Exchangeable image file format for digital still cameras).

  The red-eye correction execution information of the present embodiment is stored in the private tag area using a method according to the Exif standard private tag. Even if there is a device or application that cannot interpret the information stored in the private tag area, the device or application may ignore the information associated with the tag. Therefore, even in the case of a device or application that does not have the ability to interpret the red-eye correction execution information, only normal image data can be accessed, so that no particular problem occurs. Therefore, this is a very effective technique for holding such JPEG image data and red-eye correction execution information in the same file.

  In this embodiment, a red-eye correction execution information tag RedEyeTag is prepared in advance in the private tag area, and RedEyeTag = 0 is set when red-eye correction is not executed. When red-eye correction is executed, RedEyeTag = 1 is set and written in the private tag area. That is, when the RedEyeTag is confirmed, if it is 0, it is possible to confirm that red-eye correction has not been performed, and if it is 1, red-eye correction has been performed.

  As described above, according to the above-described embodiment, the red-eye correction may be erroneously corrected by suppressing the red-eye correction for the image file that has already been subjected to the red-eye correction in the process of performing the red-eye correction. Can be reduced. Even for files that have already undergone red-eye correction, the red-eye area can be set by the user using the red-eye manual frame setting, so that red-eye that has not been automatically detected and corrected can be easily corrected. It becomes possible.

  In the above description, the case where the operation of the flowchart shown in FIG. However, the present invention is not limited to this, and the operation of the flowchart shown in FIG. 6 may be performed by a personal computer or an image processing apparatus outside the digital camera to perform the red-eye correction process.

  In the above description, the processing for prohibiting automatic red-eye correction is given as an example for an image file for which red-eye correction has already been performed. However, the present invention is not limited to this.

  FIG. 12 shows a flowchart of a process of notifying the user of whether or not red-eye automatic correction is necessary when performing red-eye automatic correction on an image file that has already been subjected to red-eye correction. Of the steps described in FIG. 12, those with the same step numbers as in FIG. 6 are assumed to perform the same processing as in FIG.

  However, in this process, since red-eye automatic correction can be performed even for an image file that has already been subjected to red-eye correction, the screen shown in FIG. 7 in which automatic correction can be selected is always displayed in step S507. Shall.

  If automatic correction is selected in step S507, the process proceeds to step S601. If the target image has not yet undergone red-eye correction, the process proceeds to step S509. In step S509, red-eye is automatically detected for the target image, and red-eye correction is performed in step S511.

  In step S601, if red-eye correction has already been performed on the target image, display indicating that is performed as shown in FIG. 13 in step S602. In this display, a screen for selecting whether or not to execute red-eye correction is also displayed, and the user selects whether to execute red-eye correction or cancel while viewing this selection screen.

  If it is selected in step S603 to cancel the red-eye correction, this flowchart is ended. If it is selected to execute the red-eye correction, the process proceeds to step S509, and red-eye automatic detection is performed on the target image. I do.

  As described above, when red-eye automatic correction is performed on an image file that has already been subjected to red-eye correction, the user is once asked whether the red-eye correction needs to be executed. In this way, the possibility of erroneous correction can be reduced by not easily executing a plurality of red-eye automatic correction processes on the same image file.

  Next, in FIG. 14, when the set red-eye manual frame includes an area where red-eye correction has already been performed, the user is informed so and whether or not red-eye correction is necessary is confirmed. The flowchart of the process of taking is shown. The processes with the same step numbers as in FIG. 12 are the same as those in FIG.

  When red-eye manual correction is selected in step S507 and a red-eye manual frame is set in steps S513 and S515, it is determined in step S701 whether the red-eye manual frame already includes an area for which red-eye correction has been executed. To do.

  If the red-eye manual frame already includes an area for which red-eye correction has been performed, in step S702, a display to that effect is displayed as shown in FIG. In this display, a screen for selecting whether or not to execute red-eye correction is also displayed, and the user selects whether to execute red-eye correction or cancel while viewing this selection screen.

  If it is selected in step S703 to cancel the red-eye correction, this flowchart is ended. If it is selected to execute the red-eye correction, the process proceeds to step S517, and the red-eye area is selected from the red-eye manual frame. The red-eye region is extracted and extracted.

  As described above, when manual red-eye correction is performed on an area for which red-eye correction has already been performed, the user is once asked whether the red-eye correction needs to be performed. In this way, the possibility of erroneous correction can be reduced by not easily executing a plurality of red-eye correction processes on the same region.

(Other embodiments)
The object of each embodiment is also achieved by the following method. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but the present invention includes the following cases. That is, based on the instruction of the program code, an operating system (OS) running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  Furthermore, the following cases are also included in the present invention. That is, the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion card or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  When the present invention is applied to the above storage medium, the storage medium stores program codes corresponding to the procedure described above.

It is a block diagram which shows the structure of the digital camera which concerns on one Embodiment of this invention. 1 is an external perspective view of a digital camera according to an embodiment. It is a flowchart explaining the operation | movement by the main process routine in the digital camera which concerns on one Embodiment. It is a flowchart explaining the operation | movement by the main process routine in the digital camera which concerns on one Embodiment. It is a flowchart which shows the flow of the red-eye automatic correction process in step S134 of FIG. 3B. It is a figure which shows the quick review screen after red-eye automatic correction | amendment. It is a flowchart which shows the flow of a process in the case of performing red-eye correction | amendment, reproducing the image about the already image | photographed image. It is a figure which shows the selection screen of red-eye automatic correction | amendment, manual correction | amendment, or cancellation. It is a figure which shows the selection screen of red-eye correction manually or canceling. It is a figure which shows a screen at the time of selecting red-eye manual correction. It is a figure showing the screen after the red-eye manual addition button in FIG. 9 was selected. It is a figure showing the screen after the red-eye manual addition button in FIG. 9 was selected. It is a figure which shows the screen after a user selects the position determination button of a red-eye manual addition frame. It is a flowchart which shows the flow of another process in the case of performing red-eye correction | amendment, reproducing the image about the already image | photographed image. It is a figure which shows the selection screen which performs red-eye correction | amendment or cancels. It is a flowchart which shows the flow of another process in the case of performing red-eye correction | amendment, reproducing the image about the already image | photographed image. It is a figure which shows the selection screen which performs red-eye correction | amendment or cancels.

Claims (16)

Processing means for performing correction processing for correcting a region satisfying a condition as a target to be corrected in the target image;
Determination means for determining whether or not the target image has been subjected to the correction processing;
A correction suppression unit that suppresses the execution of the correction process on the target image when the determination unit determines that the target image has been subjected to the correction process;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the region that satisfies the condition to be corrected is a red-eye region. The processing means automatically detects and corrects a region satisfying a condition as a target to be corrected from the target image, and corrects a region specified by the user in the target image. 2 correction processing,
When the determination unit determines that the target image has been subjected to at least one of the first and second correction processes, the correction suppression unit performs the first correction process on the target image. The image processing apparatus according to claim 1, wherein the image processing apparatus is suppressed.   The image processing apparatus according to claim 3, wherein the region that satisfies the condition to be corrected is a red-eye region.   The image processing apparatus according to claim 4, further comprising display means for displaying a screen for allowing the user to select the red-eye area from the target image.   When the target image has already been subjected to at least one of the first and second correction processes, the display means displays a frame indicating the corrected portion on the target image. The image processing apparatus according to claim 5.   When the determination unit determines that the target image is subjected to at least one of the first and second correction processes, the correction suppression unit performs the first correction process on the target image. The image processing apparatus according to claim 4, wherein the image processing apparatus is prohibited. An image sensor that photoelectrically converts a subject image;
Storage means for storing an image captured by the image sensor;
An image processing apparatus according to any one of claims 1 to 7,
An imaging apparatus comprising: A correction process for correcting a region satisfying a condition as a target to be corrected in the target image;
A determination step of determining whether or not the target image has been corrected in the correction step;
In the determination step, when it is determined that the target image has been subjected to correction in the correction step, a correction suppression step that suppresses execution of correction in the correction step on the target image;
An image processing method comprising:   The image processing method according to claim 9, wherein the region that satisfies the condition to be corrected is a red-eye region. The correction step includes a first correction step of automatically detecting and correcting a region satisfying a condition as a target to be corrected from the target image, and a first correction step of correcting a region specified by the user in the target image. 2 correction steps,
When it is determined in the determination step that the target image has been corrected by at least one of the first or second correction step, the first correction for the target image is performed in the correction suppression step. The image processing method according to claim 9, wherein execution of correction by a process is suppressed.   The image processing method according to claim 11, wherein the region that satisfies the condition to be corrected is a red-eye region.   The image processing method according to claim 12, further comprising a display step of displaying a screen for allowing the user to select the red-eye region from the target image.   When the target image has already been corrected by at least one of the first and second correction steps, the display step displays a frame indicating the corrected portion on the target image. The image processing method according to claim 13.   A program for causing a computer to execute the image processing method according to any one of claims 9 to 14.   A computer-readable storage medium storing the program according to claim 15.

Images