JP4808918B2 - Imaging device - Google Patents

Description

  The present invention relates to an image correction apparatus and an imaging apparatus that detect a predetermined defect relating to an eye such as a red-eye part or a gold-eye part in an image and correct the detected defect.

  2. Description of the Related Art Conventionally, a camera including a flash device having a light emitting unit that emits flash light is known. Here, the eyes of humans and animals have a structure that allows more light to be taken in by opening the pupils greatly in the dark. Therefore, when a person or animal with a pupil wide open in a dark place is photographed using the flash device provided in the camera, the flash emitted from the light emitting part of the flash device through the wide open pupil The so-called red-eye phenomenon, in which the pupil part of a person or animal is reproduced in red, may occur by being reflected by the capillaries of the retina covering the inner surface of the eyeball. Also, when taking a picture using the flash device provided in the camera, depending on the incident angle at which the flash light emitted from the flash device is incident on the eyeball, the flashlight is reflected by the sclera and cornea surrounding the outermost layer of the eyeball. By doing so, a so-called gold eye phenomenon may occur in which the pupil portion of a person or animal is reproduced as white.

Accompanying the development of digital processing technology in recent years, image data representing photographs in which the pupil portion of a person or animal is reproduced in red or white as described above is acquired, and the acquired image data There has been proposed an image processing apparatus and an electronic camera that detect a red-eye part and a gold-eye part in an image represented by (2) and correct the detected red-eye part and gold-eye part (for example, see Patent Document 1).
JP 2000-305141 A

  An electronic camera proposed in Patent Document 1 described above that forms an image of a subject on a Charge Coupled Device (CCD) solid-state imaging device and captures image data representing the subject as a signal is as described above. It is equipped with a function of an image processing device that detects a red-eye portion in a photographed person or animal image and corrects the detected red-eye portion. In addition, the electronic camera proposed in Patent Document 1 includes an image display device that displays an image. When a red-eye portion is detected, the eyes of a person or an animal are reproduced on the image display device. Based on the display, a user such as a photographer confirms the red-eye portion in the image obtained by photography, and determines whether or not to correct the red-eye portion. As a result of the determination, when an instruction to correct the red-eye part is given, an image after the red-eye part is corrected is displayed on the image display device, thereby confirming whether or not the red-eye part has been corrected correctly.

  However, since an image display device provided in an electronic camera generally has a small screen, it is difficult to visually check the red-eye portion with such a small image display device, and the red-eye portion may be overlooked. is there.

  As means for solving such a problem, means for facilitating the confirmation of the red-eye part by visual observation by enlarging the red-eye part in the image displayed on the image display device is known. In an image in which red eyes are reproduced, the confirmation work becomes complicated.

  The above problem is not limited to the field of cameras and photographs, but generally occurs in the field of image processing, for example, when image processing is performed on an arbitrary image such as an image captured from the WEB.

  SUMMARY OF THE INVENTION In view of the above circumstances, an object of the present invention is to provide an image correction apparatus and an imaging apparatus that can easily confirm a predetermined defect relating to an eye such as a red-eye part or a gold-eye part in an image.

The image correction apparatus of the present invention that achieves the above object is
An image acquisition unit for acquiring image data representing an image;
A correction unit that detects a predetermined defect relating to the eye in the image represented by the image data acquired by the image acquisition unit, and corrects the detected defect;
An image display unit that displays the number of locations where a defect has been detected by the correction unit together with an image including the location is provided.

  The image correction device of the present invention includes the number of places where a predetermined defect relating to the eye such as a red-eye part or a gold-eye part in the image is detected, the image before the defect is corrected by the correction unit, Alternatively, since the image is displayed together with the image after the defect is corrected by the correction unit, for example, even if the image is a reproduction of a plurality of eyes with red eyes, the defect can be determined by referring to the number of displayed points. Failures can be easily confirmed without making mistakes that are overlooked.

Here, in the image correction device of the present invention, the correction unit detects a defect in the image, and prioritizes a place where the defect is found based on a predetermined criterion.
It is preferable that the image display unit preferentially displays a portion with a high priority given by the correction unit when displaying an image.

  For example, give priority to the main subject by giving high priority to subjects that are in the center of the shooting angle of view or subjects that have a large face, and low priority to other subjects. Confirmation and unnecessary work confirmation such as passersby can be omitted.

  In the image correction apparatus of the present invention, it is preferable that the image display unit displays a list of the locations when displaying an image.

  According to this preferred image correction apparatus, it is possible to confirm the location where a defect is found at a time.

  In the image correction apparatus of the present invention, it is preferable that the image display unit displays the portion in an enlarged manner when displaying an image.

  As described above, if the number of locations where a predetermined defect related to the eyes in the image is detected is displayed together with an image in which the location is enlarged, the defect can be confirmed more easily.

  In the image correction apparatus of the present invention, it is preferable that the image display unit displays a normal image in which the portion is not enlarged and an enlarged image in which the portion is enlarged when displaying the image. .

  According to this preferred image correction apparatus, it is possible to confirm the details and position of the location where the defect is detected while confirming the entire normal image.

Further, the image correction device of the present invention includes a confirmation unit that receives an operation of confirming a location where a defect is detected by the correction unit in the image displayed on the image display unit,
The image display unit preferably performs display indicating the number of locations obtained by subtracting the number confirmed by the confirmation unit when performing display indicating the number of locations.

  In the case of an image correction apparatus that includes such a confirmation unit and displays the number of places subtracted from the number confirmed, the number of places can be calculated even if a predetermined defect related to the eyes in the image is overlooked. It is possible to confirm the defect reliably by referring to it.

  In the image correction device of the present invention, it is further preferable that the correction unit detects a red-eye part in the image and corrects the detected red-eye part.

  Among the predetermined defects relating to the eye, the red eye has a strong psychological discomfort, but it is difficult to visually confirm, so such an image correction device that makes it easy to check the red eye portion in the image. Is particularly useful.

  Furthermore, in the image correction device according to the present invention, the image display unit may display the number of eyes in which the defect is detected by the correction unit as the number of locations, or the image display unit May display the number of persons whose defect has been detected by the correction unit as the number of places.

The first imaging device of the present invention that achieves the above object is
In an imaging apparatus that obtains image data representing a subject image by forming a subject image by subject light that has passed through a photographing optical system on a solid-state imaging device,
A correction unit that detects a predetermined defect related to the eye in the subject image and corrects the detected defect;
The image display unit includes an image display unit that displays an image including a location where a defect is detected by the correction unit and displays a number indicating the number of locations where the defect is detected.

  As described in “Problems to be Solved by the Invention”, an image display device provided in an imaging device generally has a small screen. However, like the imaging device of the present invention, The number of places where a predetermined defect relating to the eye such as a gold-eye part is detected, an image including that part before the defect is corrected by the correction unit, or an image after the defect is corrected by the correction unit For example, even if it is an image in which multiple eyes are reproduced with red eyes, by referring to the number of displayed points, it is possible to easily confirm the defect without making a mistake that would cause the defect to be overlooked. be able to.

  Here, in the first image pickup apparatus of the present invention, it is preferable that the image display unit enlarges and displays the portion when displaying an image.

In addition, the first imaging device of the present invention includes a confirmation unit that receives an operation of confirming a location where a defect is detected by the correction unit in the image displayed on the image display unit,
In a preferred mode, the image display unit displays the number of locations obtained by subtracting the number confirmed by the confirmation unit when displaying the number of locations.

  In the first imaging device of the present invention, it is further preferable that the correction unit detects a red-eye part in the image and corrects the detected red-eye part.

  Furthermore, in the first imaging device of the present invention, the image display unit may display the number of eyes in which the defect is detected by the correction unit as the number of locations, or the image display The unit may display the number of persons whose defect has been detected by the correction unit as the number of places.

The second imaging device of the present invention that achieves the above object is
An imaging unit that obtains image data representing a subject image by forming a subject image by subject light that has passed through the photographing optical system on a solid-state image sensor;
A shooting condition acquisition unit for acquiring shooting conditions for shooting a subject;
An estimation unit that estimates whether or not a predetermined defect relating to the eye occurs in the subject image represented by the image data obtained by the imaging unit based on the imaging condition acquired by the imaging condition acquisition unit. And

  By preliminarily estimating whether or not a predetermined defect relating to the eye occurs in the subject image, it is possible to reliably check if a defect occurs, and to omit the confirmation work when no defect occurs. Can do.

Further, in the second imaging device of the present invention, a flash light emitting unit that emits a flash in synchronization with photographing by the imaging unit,
It is preferable to further include a control unit that controls light emission in the flash light emitting unit according to the estimation result in the estimation unit.

  When it is estimated that a predetermined defect occurs in the photographed image, the occurrence of the defect can be reduced by adjusting, for example, the light emission intensity in the flash light emitting unit.

  Further, in the second imaging device of the present invention, a correction unit that detects a predetermined defect related to the eyes in the subject image and corrects the detected defect when the estimation unit estimates that a problem occurs. Furthermore, it is also preferable to provide.

  When it is estimated that a predetermined defect occurs in the captured image, it is possible to obtain an image that is visually appealing without a defect by detecting and correcting the defect in the subject image.

  Alternatively, it is preferable that the second imaging apparatus of the present invention further includes a warning unit that issues a warning indicating that a problem occurs when the estimation unit estimates that a problem occurs.

  By receiving a warning indicating that a malfunction occurs, the photographer can prevent the malfunction from occurring by changing the distance from the subject and shooting.

The second imaging device of the present invention further includes a flash light emitting unit that emits flash light,
The imaging unit obtains first image data by avoiding light emission in the flash light emitting unit, and obtains second image data in synchronization with light emission in the flash light emitting unit,
The estimation unit compares the color of the first image represented by the first image data with the color of the second image represented by the second image data, and the defect is found at a location where the colors differ by a predetermined degree or more. You may provide the malfunction detection part considered that it has arisen.

  A predetermined defect related to an eye such as a red eye is usually caused by a flash in a flash light emitting unit. Therefore, the color of the first image obtained without flashing and having no defects is compared with the color of the second image obtained with flashing, and those colors are not less than a predetermined level. By assuming that a defect has occurred in a different location, it is possible to easily detect the defect in the captured image.

  ADVANTAGE OF THE INVENTION According to this invention, the image correction apparatus and imaging device which can confirm easily the predetermined | prescribed malfunctions regarding eyes, such as a red eye part and a gold-eye part in an image, can be provided.

  Hereinafter, embodiments of the present invention will be described.

  Here, an embodiment will be described in which the present invention is applied to an electronic camera that forms an image of a subject on a charge coupled device (CCD) solid-state imaging device and captures image data representing the subject as a signal.

  FIG. 1 is an external perspective view of an electronic camera according to an embodiment of the present invention as seen from diagonally above the front. Here, first, a general configuration of the electronic camera will be described with reference to FIGS. The feature of the electronic camera of the present embodiment as the present invention lies in processing operations of a “first automatic red-eye correction processing” mode and a “second automatic red-eye correction processing” mode, which will be described later. Will be described in detail later.

  A camera 100 shown in FIG. 1 is a camera that takes a picture on a photographic film (not shown).

  On the front surface of the camera 100, a lens barrel 101 having a photographing lens 101a therein is provided. The photographing lens 101a forms an image of incident subject light on a photographing surface of a CCD solid-state image pickup device (not shown here) disposed therein, and generates image data representing the subject by the CCD solid-state image pickup device. Is done.

  Further, on the front surface of the camera 100, a flash light emitting device 103 that emits flash light, a dimming sensor 102 that measures the amount of light emitted from the flash light emitting device 103, a self-timer LED 115 that lights and informs the subject of the start of photographing, An optical viewfinder objective window 104a that the photographer looks into in order to determine the position of the subject is provided. The flash light emitting device 103 corresponds to an example of a flash light emitting unit according to the present invention.

  Further, a shutter release button 105 that is pressed at the time of shooting is provided at the right end of the upper surface of the camera 100. Note that the photographing mode dial 112 provided at the upper back will be described with reference to FIG.

  Further, below the left side surface of the camera 100, a USB terminal to which a Universal Serial Bus (USB) cable used for transmitting image data obtained by taking a photograph to a personal computer or the like is connected in order from the top. 106 and a power input terminal 107 to which a power cable used when supplying external power to the camera 100 is connected.

  FIG. 2 is an external perspective view of the camera shown in FIG.

  On the back of the camera 100, there are an optical viewfinder eyepiece window 104b, a liquid crystal display (LCD) panel 108 for displaying images and date and time, and an LCD panel start button for turning on / off image display by the LCD panel 108. 109, a cross key 110 that is operated when selecting a variation and zooming, for example, a menu such as date and date setting is displayed on the LCD panel 108, or a menu / OK used to confirm the menu. A switch 111, a cancel switch 116 used when invalidating a setting changed by various operations, a shooting mode dial 112 used when selecting various modes to be described later, and a "shooting recording" function for taking a picture. Photographed and recorded Function selection lever 113 used when selecting any one of the “image data reproduction” functions for reproducing the recorded image data, and a main switch 114 provided on the axis of the function selection lever 113 Is provided. Further, in this camera 100, a “first automatic red-eye correction process” mode for correcting a detected red-eye part by detecting a red-eye part in the subject image or a “second automatic red-eye correction” according to an operation with the cross key 110. The “Process” mode can be selected. A detailed description of the “first automatic red-eye correction process” mode and the “second automatic red-eye correction process” mode will be given later. Here, the LCD panel 108 corresponds to an example of each of the image display unit and the warning unit referred to in the present invention.

  In this camera 100, the “shooting / recording” function is selected by moving the function selection lever 113 to the “shooting / recording” side 113a, and the “image data” is moved by moving the function selection lever 113 to the “image data playback” side 113b. The “Play” function is selected. In addition, when the “shooting and recording” function is selected by the function selection lever 113, by rotating the shooting mode dial 112, a “portrait shooting” mode suitable for taking a picture of a person, a landscape photo “Landscape Shooting” mode suitable for photographing, “Sport” mode suitable for photographing a fast-moving subject, and giving a time difference from when the shutter release button 105 is pressed to when the photograph is actually photographed. Either a “self-timer” mode or a “self-photographing” mode suitable for taking a picture of the photographer himself can be selected. If no mode is selected, shooting is performed assuming that the “portrait shooting” mode is selected.

  FIG. 3 is a block diagram showing the configuration of the signal processing unit provided in the camera shown in FIGS.

  The configuration of the signal processing unit provided in the camera 100 will be described with reference to the configuration block diagram shown in FIG.

  In the camera 100 shown in FIGS. 1 and 2, all processes are controlled by the CPU 211. The CPU 211 corresponds to an example of each of the imaging condition acquisition unit and the control unit referred to in the present invention.

  First, various switches will be described.

  A shutter release button 105 (see FIGS. 1 and 2) for instructing to start taking a photograph is provided with a shutter switch 105 a that operates in synchronization with the depression of the shutter release button 105. An on / off signal of the shutter switch 105 a is input to the CPU 211. The CPU 211 receives an ON signal of the shutter switch 105a as a signal for starting shooting. At this time, the function selection lever 113 has been switched to the “image recording” side 113a, and the CPU 211 has detected that photography is being performed.

  With the cross key 110, one of a plurality of items in a selection menu displayed on the LCD panel 108 can be selected. FIG. 3 shows the contacts 1101 to 1104 of the cross key 110. For example, when the contact 1101 is pressed, the cursor moves upward. When the button 1102 is pressed, it moves to the right. When any of the contacts 1101 to 1104 is connected and an on / off signal is input to the CPU 211, the CPU 211 transfers a cursor movement instruction to the LCD panel 108 via the bus 220 based on the movement instruction. Then, the cursor moves to one of the displayed items. Therefore, based on the cursor displayed on the LCD panel 108, the user can select any of a plurality of items in the selection menu with the cross key 110. Here, when the electronic zoom is selected, a partial area within the shooting angle of view is cut out with the center of the subject as the center, and the electronic zoom is performed. At this time, the size of the area to be cut out can be specified.

  When the function selection lever 113 is switched to the “image data reproduction” side 113b, reproduction from the recording medium 240 is performed. At this time, no processing is performed even if a signal is input from the shutter switch 105a or the like that gives an instruction for taking a picture.

  Next, various elements other than the switch will be described.

  In addition to the various switches described above, the CPU 211 drives the flash light emitting device 103, the timing generator 212, the motor driver 217 for driving the focus lens 216, and the motor provided in the light amount adjusting device 300 as shown in FIG. A motor driver 214 and a CDSAMP 213 are connected.

  When the user takes a picture, a subject image is displayed on the LCD panel 108 in accordance with the movement of the subject. While viewing the displayed image of the subject, the user performs framing and presses the shutter release button 105 to take a picture. At this time, when the shutter switch 105a that operates in synchronization with the shutter release button 105 is turned on, the CPU 211 knows that an instruction to start shooting is sent from the user. Therefore, the CPU 211 outputs a signal instructing light emission to the flash light emitting device 103 and a signal instructing start of photographing to the timing generator 212. The flash light emitting device 103 emits a flash in response to a light emission instruction. In addition, the timing generator 212 supplies a signal notifying that the shutter release button 105 has been pressed to the CCD solid-state image sensor 210 in response to an instruction to start shooting. In response to this signal, the CCD solid-state image sensor 210 outputs image data captured by the CCD solid-state image sensor 210 as an RGB signal when the shutter release button 105 is pressed. At this time, since the RGB signal read from the CCD solid-state image sensor 210 has a lot of noise, the CPU 211 outputs a timing signal for performing noise reduction processing to the CDSAMP 213 in order to reduce this noise.

  The signals output from the CPU 211 in response to the input signals from the various switches shown in FIGS. 1 and 2 are as described above.

  From here, how the image signal picked up by the CCD solid-state image sensor 210 is processed will be described in order.

  A case where the shutter release button 105 is pressed when the function selection lever 113 shown in FIG. 2 is on the “image recording” side 113a will be described.

  When the function selection lever 113 connected to the CPU 211 is on the “image recording” side 113a and the shutter release button 105 is pressed, the shutter switch 105a is connected, and the CPU 211 detects that the shutter release button 105 is pressed. . Thus, when the shutter release button 105 is pressed by the user, the CPU 211 instructs the timing generator 212 to start photographing. In response to this start instruction, the CCD solid-state imaging device 210 outputs RGB signals.

  Even if the shutter release button is not pressed, the subject image in the direction in which the photographing lens is directed is always displayed on the LCD panel 108 of the image display device 227. The displayed subject image is obtained by converting image data composed of RGB signals read out from the CCD solid-state imaging device 210 at predetermined time intervals into YC signals by the image signal processing circuit 222, and passing the YC signals through the VideoEncoder 226. The image display device 227 can be obtained. When such a subject image is displayed, the AE & AWB detection circuit 231 continuously performs exposure adjustment, and the AF detection circuit 230 continuously performs contrast detection. Here, the image signal processing circuit 222 bears an example of the functions of the correction unit and the confirmation unit according to the present invention, and detects and corrects the red-eye portion in the photographed image at the time of taking a picture as will be described later. . A combination of the CPU 211 and the image signal processing circuit 222 corresponds to an example of each of the estimation unit and the defect detection unit according to the present invention.

  In exposure adjustment, exposure adjustment is performed by the AE & AWB detection circuit 231 based on luminance information of RGB signals read out from the CCD solid-state imaging device 210 at predetermined time intervals. When exposure adjustment is performed by the AE & AWB detection circuit 231, the result is transmitted to the CPU 211, and the CPU 211 issues an instruction to the motor driver 214 based on the result, and the light amount adjustment is performed so as to obtain a light amount that provides appropriate exposure. The motor provided in the apparatus 300 is driven (hereinafter, a series of processes from when the luminance information is acquired until the light amount adjusting apparatus 300 is adjusted to appropriate exposure is referred to as an exposure process). In the focus adjustment, the focus lens 216 is moved by the AF detection circuit 230, and the contrast of the RGB signals is detected by the AF detection circuit 230 at every predetermined time interval to perform the focus adjustment. When contrast detection is performed by the AF detection circuit 230, the result is transmitted to the CPU 211. The CPU 211 issues a drive instruction for the focus lens 216 to the motor driver 217 based on the result, and the focal point at which the detected contrast is maximized. The focus lens 216 is driven to the position (hereinafter, a series of processes from when the contrast is detected until the focus lens 216 is disposed at the in-focus position is referred to as a focusing process). When the focus lens 216 is disposed at the in-focus position, an image capture signal is supplied from the CPU 211 to the timing generator 212, and an imaging start signal is supplied from the timing generator 212 to the CCD solid-state image sensor 210. The accumulated charge is read out to the CDSAMP 213 side as an RGB signal by the read signal of the timing generator 212.

  In the CDSAMP 213 to which the read RGB signal is supplied, noise reduction processing is performed, and the RGB signal from which noise has been removed is supplied to the A / D conversion circuit 218. In the A / D conversion circuit 218, the analog RGB signals are A / D converted and converted into digital RGB signals.

  The CPU 211, the image input controller 219, the memory (SDRAM) 221, the image signal processing circuit 222, the compression processing circuit 223, the media controller 224, the USB controller 225, the VideoEncoder 226, the AF detection circuit 230, and the AE & AWB detection circuit 231 are connected by the bus 220. The address and data are exchanged via the bus 220. Various registers for transmitting and receiving data via the bus 220 are prepared in the CPU 211, and the contents of these registers are rewritten according to the progress of processing of each processing unit. In the CPU 211, the contents of this register are read and processing is performed.

  The RGB signals converted into digital signals are guided to the bus 220 side by the image input controller 219, controlled by the CPU 211, and written in the memory (SDRAM) 221. Here, the image input controller 219 corresponds to an example of the image acquisition unit referred to in the present invention. When the RGB signal capturing is completed, the RGB signal is read from the memory (SDRAM) 221 and supplied to the image signal processing circuit 222 via the bus 220. The image signal processing circuit 222 converts RGB signals into YC signals, and the image data compressed by the compression processing circuit 223 is recorded as a JPEG file on the recording medium 240 via the media controller 224.

  Note that the USB controller 225 is also provided in the camera shown in FIGS. 1 and 2, and can be connected to an external device conforming to the USB standard.

  The above is the flow of the image data until recording is performed on the recording medium 240 when the camera 100 shown in FIGS.

  FIG. 4 is a flowchart for explaining the operation flow when the “first automatic red-eye correction process” mode is selected.

  First, the “shooting / recording” function is selected by moving the function selection lever 113 shown in FIG. 2 to the “shooting / recording” side 113a, the desired shooting mode is selected by rotating the shooting mode dial 112, and the cross The photograph is taken by pressing the shutter release button 105 after selecting the “first automatic red-eye correction processing” mode in accordance with the operation with the key 110 (step S101).

  Here, FIG. 5 is a diagram illustrating an example of a photographed image photographed in step S101.

  In this case, after the “portrait shooting” mode is selected by the shooting mode dial 112 shown in FIG. 2 and the “first automatic red-eye correction processing” mode is selected according to the operation with the cross key 110, the shutter release button 105 is pressed. In addition, an example of a photographed image in which three persons 410, 420, and 430 are photographed is shown.

  Next, in response to the selection of the “first automatic red-eye correction processing” mode according to the operation with the cross key 110 shown in FIG. 2, the red-eye portion in the photographed image obtained by photographing in step S101. The automatic red-eye correction process for correcting the detected red-eye portion is started (step S102).

  Next, when the red-eye portion is detected in the photographed image in step S102 (step S103: YES), out of the number of persons in which the red-eye portion is detected, a confirmation operation described later is performed. The number of unconfirmed parts that have not been confirmed is displayed on the LCD panel 108 shown in FIG. 2 together with the red-eye correction result image after the automatic red-eye correction processing is performed (step S104). Here, the number of unconfirmed places corresponds to an example of the number of places referred to in the present invention.

  In addition, when the red-eye portion in the photographed image is detected in step S102 (step S103: NO), the image data representing the photographed image is transmitted via the media controller 224 shown in FIG. It is recorded as a JPEG file on the recording medium 240 (step S112).

  Here, FIG. 6 is a diagram showing a display example in which the red-eye correction result image and the number of unconfirmed places after the automatic red-eye correction processing is performed in step S104 are displayed on the LCD panel.

  Here, the red-eye correction result image after the automatic red-eye correction processing is performed on the captured image shown in FIG. 5 is the faces 411a, 421a, and 431a of the persons 411, 421, and 431 corrected by the automatic red-eye correction processing. Of the number of persons whose red-eye part is detected on the upper left of the LCD panel 108 while being emphasized so as to be surrounded by solid circles 510, 520 and 530 and displayed on the LCD panel 108 shown in FIG. An example in which the number 610 of unconfirmed parts that have not been confirmed by a confirmation operation described later is displayed is shown. In the example shown in FIG. 6, the number of unconfirmed points 610 is displayed as “3” on the upper left of the LCD panel 108, indicating that red-eye portions have been detected and corrected for all three persons 411, 421, and 431. Has been.

  FIG. 7 is a diagram showing a display example different from FIG. 6 in the red-eye correction result image and the number of unconfirmed portions.

  In the number of unconfirmed places 610 in FIG. 6, the number of unconfirmed places is represented by numbers, but in the number 611 of unconfirmed places shown in part (A) of FIG. In the number of unconfirmed places 612 shown in FIG. As described above, the number of unconfirmed points may be expressed by a number other than a number.

  As described above, when the number of unconfirmed portions that have not been confirmed because the red-eye portion in the red-eye correction result image has been detected is displayed together with the red-eye correction result image, the eyes of a plurality of persons have red eyes as shown in FIG. Even in an image reproduced in the above manner, the red-eye portion can be easily confirmed without making a mistake of overlooking the red-eye portion by referring to the displayed number of unconfirmed portions. In addition, when a face having a red-eye portion in the red-eye correction result image is displayed with being emphasized, confirmation of the red-eye portion in the red-eye correction result image is further facilitated.

  Next, when the user determines that the red-eye portion is appropriately detected and properly corrected as a result of the confirmation of the red-eye portion by the red-eye correction result image after the automatic red-eye correction processing is performed in step S104. When the menu / OK switch 111 shown in FIG. 2 is pressed (step S105: YES), the image data representing the red-eye correction result image is transferred to the recording medium 240 via the media controller 224 shown in FIG. Is recorded as (step S112).

  As described above, in the “first automatic red-eye correction processing” mode, after the shutter release button 105 is pressed to take a picture, the red-eye portion is confirmed by only one operation of pressing the menu / OK switch 111 in step S105. Is completed, the red-eye part can be checked very easily.

  Further, as a result of confirming the red-eye portion by the red-eye correction result image after the automatic red-eye correction processing is performed in step S104, when it is desired to enlarge the face of the person corrected by the automatic red-eye correction processing and confirm the red-eye portion. By pressing the cancel switch 116 shown in FIG. 2 (step S105: NO), the face can be selected using the cross key 110 shown in FIG. 2 (step S106).

  Here, FIG. 8 is a diagram showing a display example in which a red-eye correction result image capable of selecting a face with the cross key is displayed on the LCD panel in step S106.

  Here, the face 411a of the person 411 whose face is selected by the cross key 110 shown in FIG. 2 is surrounded by a solid circle 511, and the faces 421a, 421a, 421a, 431 of other persons whose faces can be selected by the cross key 110 are shown. An example in which a red-eye correction result image 431a surrounded by broken-line circles 521 and 531 is displayed on the LCD panel 108 shown in FIG. The solid circle 510 moves to another person's face according to the operation with the cross key 110, and the faces 411a, 421a, 431a of the desired persons 411, 421, 431 can be selected.

  FIG. 9 is a diagram showing a display example different from FIG. 8 in the red-eye correction result image in which the face can be selected in step S106.

  In part (A) of FIG. 9, faces 541, 542, and 543 corresponding to the faces 411 a, 421 a, and 431 a shown in FIG. 8 that can be selected by the cross key 110 are displayed side by side under the red-eye correction result image. Part (B) shows a display example in which only the faces 541, 542, and 543 are displayed as a list without displaying the red-eye correction result image shown in part (A). ing. The pointer 540 moves in response to an operation with the cross key 110, and a desired face can be selected from the displayed faces 541, 542, and 543. In this way, by displaying a list of human faces 541, 542, and 543 corrected by the automatic red-eye correction process, the faces 541, 542, and 543 can be confirmed at a time. In the present embodiment, the description of the example in which the red-eye correction result image is displayed in step S106 as shown in FIG.

  Next, after selecting a desired person's face in accordance with the operation of the cross key 110 shown in FIG. 2, the menu / OK switch 111 is pressed to enlarge the face of the selected person. Is displayed on the LCD panel 108 (step S107).

  Here, FIG. 10 is a diagram illustrating a display example in which the face enlarged in step S107 is displayed on the LCD panel.

  Here, after selecting the face 411a of the person 411 whose face is surrounded by the solid circle 510 in the red-eye correction result image shown in FIG. 8, the face 411a is displayed by pressing the menu / OK switch 111. An example enlarged and displayed on the LCD panel 108 shown in FIG. 2 is shown.

  FIG. 11 is a diagram showing a display example different from FIG. 10 in the enlarged face.

  In part (A) of FIG. 11, the LCD panel 108 is divided into two regions 108_1 and 108_2, the red-eye correction result image is displayed in the first region 108_1, and the selected face 411a is enlarged to the second region. Is displayed in the area 108_2. Thus, by displaying the red-eye correction result image and the enlarged face side by side, it is possible to easily confirm the position where the red-eye correction has been performed. When two or more LCD panels are provided, as shown in Part (B), a captured image may be displayed on one panel 108A and an enlarged face may be displayed on another panel 108B. . In the present embodiment, an example in which an enlarged face is displayed by the display method shown in FIG. 10 in step S107 will be described.

  Next, when the user determines that the red-eye portion is appropriately detected and appropriately corrected as a result of the confirmation of the red-eye portion after the automatic red-eye correction processing is performed using the face enlarged in step S107 2 is confirmed by pressing the menu / OK switch 111 shown in FIG. 2 (step S108: YES), the automatic red-eye correction process for the enlarged red-eye portion of the face is confirmed, and the process returns to step S104 to return the entire image. Is displayed on the LCD panel 108 shown in FIG. Further, as described above, the number of unconfirmed places displayed on the upper left of the LCD panel 108 is displayed as the number of unconfirmed places by subtracting one each time the confirmation operation in step S108 is received. After that, it is possible to select a person other than the person for which the automatic red-eye correction process has been determined by the same procedure as described above.

  In this way, with an electronic camera that displays the number of unconfirmed points after subtracting the confirmed number, refer to the number of unconfirmed points even when the red-eye portion in the red-eye correction result image is overlooked. The red eye portion can be confirmed with certainty.

  Further, as a result of confirming the red-eye portion after the automatic red-eye correction process is performed by the face enlarged in step S107, when it is desired to further enlarge the eye portion of the enlarged face and confirm the red-eye portion, FIG. When the cancel switch 116 shown in FIG. 2 is pressed (step S108: NO), the enlarged eye portion is displayed on the LCD panel 108 shown in FIG. 2 (step S109).

  Here, FIG. 12 is a diagram illustrating a display example in which the eye portion enlarged in step S109 is displayed on the LCD panel.

  Here, an example is shown in which the eye portion 411b of the enlarged face 411a shown in FIG. 10 is enlarged and displayed on the LCD panel 108 shown in FIG.

  In the description of the present embodiment, an example in which both eyes are enlarged and displayed is shown as an example in which the eye portion is enlarged and displayed, but one eye may be enlarged and displayed.

  Next, as a result of the confirmation of the red-eye part after the automatic red-eye correction process is performed by the eye part enlarged in step S109, the user determines that the red-eye part is appropriately detected and appropriately corrected. In this case, the confirmation operation for depressing the menu / OK switch 111 shown in FIG. 2 (step S110: YES) confirms the automatic red-eye correction processing for the red-eye portion of the enlarged face, and the process returns to step S104 to return the image. The whole is displayed on the LCD panel 108 shown in FIG. In addition, as described above, the number of unconfirmed places displayed on the upper left of the LCD panel 108 is displayed as the number of unconfirmed places by subtracting one each time the confirmation operation in step S110 is received. After that, it is possible to select a person other than the person for which the automatic red-eye correction process has been determined by the same procedure as described above.

  In addition, as a result of the confirmation of the red-eye portion after the automatic red-eye correction processing is performed by the eye portion enlarged in step S109, erroneous detection or inappropriate correction is performed in the detection or correction of the red-eye portion. If the user determines that there is, the detection and correction of the red-eye portion for the enlarged eye is canceled by depressing the cancel switch 116 shown in FIG. 2 (step S110: NO) (step S111). Returning to S104, the entire image is displayed on the LCD panel 108 shown in FIG. Further, as described above, the number of unconfirmed places displayed on the upper left of the LCD panel 108 is displayed as the number of unconfirmed places by subtracting one each time the confirmation operation in step S111 is received. After that, it is possible to select a person other than the person whose automatic red-eye correction process has been confirmed or canceled, by the same procedure as described above.

  FIG. 13 is a flowchart for explaining the operation flow when the “second automatic red-eye correction process” mode is selected.

  First, the “shooting / recording” function is selected by moving the function selection lever 113 shown in FIG. 2 to the “shooting / recording” side 113a, the desired shooting mode is selected by rotating the shooting mode dial 112, and the cross The photograph is taken by pressing the shutter release button 105 after selecting the “second automatic red-eye correction process” mode in accordance with the operation with the key 110 (step S201).

  When photographing is performed, the CPU 211 is obtained by photographing in step S201 in response to the selection of the “second automatic red-eye correction processing” mode in accordance with the operation with the cross key 110 shown in FIG. Detect red-eye part in the captured image. Furthermore, an automatic red-eye correction process for correcting the detected red-eye part is started (step S202).

  Subsequently, when the red-eye part is detected in the captured image in step S202 (step S203: YES), the number of persons whose red-eye part is detected (hereinafter, this number is referred to as the number of detections). Is displayed on the LCD panel 108 shown in FIG. 2 together with the red-eye correction result image after the automatic red-eye correction processing is performed (step S204).

  If the red-eye portion in the captured image is detected in step S202 (step S203: NO), the image data representing the captured image is sent via the media controller 224 shown in FIG. It is recorded as a JPEG file on the recording medium 240 (step S213).

  Here, FIG. 14 is a diagram showing a display example in which the red-eye correction result image and the number of detections after the automatic red-eye correction processing is performed in step S204 are displayed on the LCD panel.

  Here, the red-eye correction result image after the automatic red-eye correction process is performed on the same captured image as the captured image shown in FIG. 5 in which the three persons 410, 420, and 430 are photographed in step S201. The faces 411a, 421a, 431a of the persons 411, 421, 431 corrected by the automatic red-eye correction process are highlighted so as to be surrounded by solid circles 510, 520, 530 and displayed on the LCD panel 108 shown in FIG. In addition, an example in which the detection number 620 in which the red-eye portion is detected is displayed on the upper left of the LCD panel 108 is shown. In the example shown in FIG. 14, the detection number 620 is displayed as “3” in the upper left of the LCD panel 108, indicating that the red-eye portion has been detected and corrected for all three persons 411, 421, and 431. ing.

  As described above, when the number of detected red-eye portions in the red-eye correction result image is displayed together with the red-eye correction result image, as shown in FIG. However, by referring to the displayed number of detections, the red-eye portion can be easily confirmed without making a mistake that overlooks the red-eye portion. In addition, when a face having a red-eye portion in the red-eye correction result image is displayed with being emphasized, confirmation of the red-eye portion in the red-eye correction result image is further facilitated.

  Next, in the CPU 211, a priority order for confirmation is given to the red-eye portion that has been subjected to the automatic red-eye correction processing in step S202. In this embodiment, the priority order is such that “the red eye part closer to the center of the shooting angle of view” has a higher priority, and then the “red eye part has a larger area” has a higher priority. Is added (step S205).

  Next, after confirming the red-eye portion by the red-eye correction result image after the automatic red-eye correction processing is performed in step S204, the red-eye portion is not confirmed by an image in which the face and the eye portion are enlarged and displayed later. When the cancel switch 116 shown in FIG. 2 is pressed (step S206: NO), the image data representing the red-eye correction result image is stored as a JPEG file on the recording medium 240 via the media controller 224 shown in FIG. Recording is performed (step S213).

  As described above, in the “second automatic red-eye correction processing” mode, after the shutter release button 105 is pressed to take a picture, the confirmation of the red-eye portion is completed with only one operation of pressing the cancel switch 116 in step S206. Therefore, it is very easy to check the red eye part.

  In addition, as a result of the confirmation of the red-eye portion by the red-eye correction result image after the automatic red-eye correction processing is performed in step S204, when it is desired to confirm the red-eye portion by enlarging the face of the person corrected by the automatic red-eye correction processing When the menu / OK switch 111 shown in FIG. 2 is pressed (step S206: YES), the person highlighted in step S204 so that the face is surrounded by a solid circle is added in step S205. The face of the person having the red-eye portion with the highest priority is enlarged and displayed on the LCD panel 108 shown in FIG. 2 together with the number of unconfirmed portions (step S207). The number of unconfirmed places here is the same as the number of unconfirmed places in the “first automatic red-eye correction processing” mode described above, and the number of persons in which the red-eye portion is detected is not confirmed by the confirmation operation described later. The number of unconfirmed places corresponds to an example of the number of places referred to in the present invention.

  In this way, with an electronic camera that displays the number of unconfirmed points after subtracting the confirmed number, refer to the number of unconfirmed points even when the red-eye portion in the red-eye correction result image is overlooked. The red eye portion can be confirmed with certainty.

  Here, FIG. 15 is a diagram showing a display example in which the face enlarged in step S207 and the number of unconfirmed places are displayed on the LCD panel.

  Here, in the red-eye correction result image shown in FIG. 14, the face 411a of the person 411 among the persons 411, 421, and 431 in which the faces 411a, 421a, and 431a are surrounded by solid circles 510, 520, and 530 is enlarged. 2 and displayed on the LCD panel 108 shown in FIG. 2, and the number 610 of unconfirmed parts that have not been confirmed by the confirmation operation described later, among the number of persons whose red-eye portions have been detected, are displayed on the upper left of the LCD panel 108. An example in which is displayed is shown.

  Next, when the user determines that the red-eye portion is appropriately detected and appropriately corrected as a result of the confirmation of the red-eye portion after the automatic red-eye correction processing is performed using the face enlarged in step S207 The confirmation operation for depressing the menu / OK switch 111 shown in FIG. 2 (step S208: YES) confirms the automatic red-eye correction process for the red-eye portion of the enlarged face, and the automatic red-eye correction process is confirmed. If there is a person other than the person who has been subjected to the automatic red-eye correction process in step S204 (step S212: YES), the red-eye part having the highest priority is selected except for the person for which the automatic red-eye correction process has been confirmed. The person's face is enlarged and displayed on the LCD panel 108 shown in FIG. 2 (step S207). Further, as described above, the number of unconfirmed places 610 displayed on the upper left of the LCD panel 108 is displayed as the number of unconfirmed places by subtracting one each time the confirmation operation in step S208 is received.

  In step S208: YES, the automatic red-eye correction process for the red-eye portion of the enlarged face is confirmed, the automatic red-eye correction process is confirmed, or a person other than the person canceled by the “result erasure” mode described later, in step S204. If there is no person who has been subjected to the automatic red-eye correction process (step S212: NO), an image representing the red-eye correction result image that has been confirmed in step S208: YES or canceled in a “result deletion” mode described later. The data is recorded as a JPEG file on the recording medium 240 via the media controller 224 shown in FIG. 3 (step S213).

  In addition, as a result of checking the red-eye part after the automatic red-eye correction process is performed by the face enlarged in step S207, when it is desired to further enlarge the eye part of the enlarged face and check the red-eye part, FIG. When the cancel switch 116 shown in FIG. 2 is pressed (step S208: NO), the enlarged eye portion is displayed on the LCD panel 108 shown in FIG. 2 together with the number of unconfirmed places (step S209).

  Here, FIG. 16 is a diagram showing a display example in which the eye portion enlarged in step S209 and the number of unconfirmed portions are displayed on the LCD panel.

  Here, the eye part 411b of the enlarged face 411a shown in FIG. 15 is enlarged and displayed on the LCD panel 108 shown in FIG. 2, and the person whose red-eye part is detected is displayed on the upper left of the LCD panel 108. Of the numbers, an example is shown in which the number 610 of unconfirmed parts that have not been confirmed by the confirmation operation described below is displayed.

  In the description of the present embodiment, an example in which both eyes are enlarged and displayed is shown as an example in which the eye portion is enlarged and displayed, but one eye may be enlarged and displayed.

  Next, as a result of confirmation of the red-eye part after the automatic red-eye correction process is performed by the eye part enlarged in step S209, the user determines that the red-eye part is appropriately detected and appropriately corrected. In this case, the automatic red-eye correction process for the enlarged red-eye portion of the enlarged face is confirmed by the confirmation operation for depressing the menu / OK switch 111 shown in FIG. 2 (step S210: YES), and the automatic red-eye correction process is confirmed. If there is a person who has been subjected to the automatic red-eye correction process in step S204 (step S212: YES), among the persons other than the person for which the automatic red-eye correction process has been confirmed, the highest priority is given. The face of the person having the red-eye portion is enlarged and displayed on the LCD panel 108 shown in FIG. 2 (step S207). As described above, the number 610 of unconfirmed places displayed on the upper left of the LCD panel 108 is displayed as the number of unconfirmed places obtained by subtracting one each time the confirmation operation in step S210 is received.

  In step S210: YES, the automatic red-eye correction process for the red-eye portion of the enlarged face is confirmed, the automatic red-eye correction process is confirmed, or a person other than a person who is canceled by the “result erase” mode described later, in step S204. If there is no person who has been subjected to the automatic red-eye correction process (step S212: NO), an image representing the red-eye correction result image that has been confirmed in step S210: YES or canceled in a “result deletion” mode described later. The data is recorded as a JPEG file on the recording medium 240 via the media controller 224 shown in FIG. 3 (step S213).

  Here, as the number of unconfirmed places decreases, the priority order of the red-eye portion in the face of the person to be enlarged is lowered. Therefore, when it is determined that the red-eye portion of the enlarged face is no longer important by repeating a series of processing from step S207 to step S212, the user presses the cancel switch 116 shown in FIG. The process proceeds from S212 to step S213, and a red-eye correction result image can be recorded.

  In addition, as a result of the confirmation of the red-eye part after the automatic red-eye correction process is performed by the eye part enlarged in step S209, the red-eye part is erroneously detected or inappropriately corrected. If the user determines that there is, the cancel switch 116 shown in FIG. 2 is pressed (step S210: NO).

  When the camera 100 of this embodiment selects the “second automatic red-eye correction processing” mode and takes a picture, the “result erase” mode in which the detection and correction of the red-eye portion with respect to the enlarged eye is canceled, or It is assumed that one of the “correction” modes in which the red-eye portion for the enlarged eye can be manually corrected again is selected and set in advance. If any one of such modes is set in advance, when the cancel switch 116 is pressed in step S210: NO, the mode automatically shifts to any one of the preset modes.

  If the “result erase” mode is set, the cancel switch 116 is pressed in step S210: NO, thereby canceling the detection and correction of the red-eye portion for the enlarged eye (step S211). If there is a person who has been subjected to the automatic red-eye correction process in step S204 other than the person whose correction process has been canceled (step S212: YES), among the persons other than the person whose automatic red-eye correction process has been canceled, The face of the person who has the red eye part with the highest priority is enlarged and displayed on the LCD panel 108 shown in FIG. 2 (step S207). As described above, the number 610 of unconfirmed places displayed on the upper left of the LCD panel 108 is displayed as the number of unconfirmed places obtained by subtracting one each time the confirmation operation in step S211 is received.

  Further, the automatic red-eye correction processing for the red-eye portion of the face enlarged in step S211 is canceled, the automatic red-eye correction processing is canceled, or the automatic red-eye correction processing is performed in step S204 other than the person confirmed by the above-described confirmation operation. When the applied person does not exist (step S212: NO), the image data representing the red-eye correction result image canceled by the step S211 or confirmed by the confirmation operation described above is the media controller 224 shown in FIG. Is recorded as a JPEG file on the recording medium 240 (step S213).

  Next, when the “correction” mode is set, the cancel switch 116 is pressed in step S210: NO, thereby detecting the red-eye portion for the enlarged eye, the correction misalignment, the size change, and the like. Such erroneous detection and inappropriate correction can be manually corrected again.

  Above, description of 1st Embodiment in this invention is complete | finished, and 2nd Embodiment of this invention is demonstrated. The camera of this embodiment has the same configuration as that of the camera 100 of the first embodiment shown in FIGS. 1 to 3, and these FIGS. 1 to 3 are also used in the description of this embodiment to perform the first implementation. Only the differences from the form will be described.

  FIG. 17 is a flowchart showing a series of processes from photographing a subject with the camera of the present embodiment to storing the photographed image.

  First, as in the first embodiment, when the user moves the function selection lever 113 shown in FIG. 2 to the “image recording” side 113a, a subject image is captured at predetermined time intervals by the CCD solid-state imaging device 210 shown in FIG. The rough reading is performed, and RGB signals are output, and the series of exposure processing and focusing processing described above are performed (pre-shooting in step S301).

  The operator uses the shooting mode dial 112 shown in FIG. 2 to select a mode (“portrait shooting” mode, “landscape shooting” mode, “sport” mode, “self timer” mode, “self shooting” mode), and When flash photography with flash is performed, flash photography is designated by pressing a flash button (not shown). The depression state of the shooting mode dial 112 and the flash button is transmitted to the CPU 211.

  If the flash button is not pressed (step S302: NO), the CPU 211 estimates that there is no red-eye defect in the captured image, and the process proceeds from step S302 to step S310 in the flowchart of FIG.

  When the shutter release button 105 is pressed by the user, the CPU 211 detects that the shutter release button 105 has been pressed. Further, the CPU 211 instructs the timing generator 212 to start taking a picture, the CCD solid-state image sensor 210 reads the subject image finely, and the photographing process similar to step S101 in FIG. 4 is performed (step S310). .

  Image data obtained by shooting is subjected to predetermined image processing such as gradation correction processing by the image signal processing circuit 222, and the image data subjected to the image processing is recorded on the recording medium 240. (Step S313 in FIG. 17). Image processing such as tone correction processing is processing that has been performed extensively in the past, and is not described in this specification.

  In general, when flash photography is not performed, eye-related problems such as red eyes are unlikely to occur. Therefore, when flash photography is not performed, the processing speed can be increased by omitting the red-eye correction processing.

  In addition, even when the flash button is pressed by the user (step S302: YES) and a mode other than the “portrait photographing” mode is selected as the mode (step S303: NO), the CPU 211 displays red-eye in the captured image. It is estimated that the above problem does not occur, and the process proceeds from step S303 to step S311 in the flowchart to perform the photographing process.

  Further, the flash button is pressed by the user (step S302: YES), the “portrait shooting” mode is selected as the mode (step S303: YES), and the calculation is performed in the focusing process during pre-shooting in step S301. Even when the distance to the subject near the center of the shooting angle of view (subject distance) is outside the predetermined range (step S304: NO), the CPU 211 estimates that no red-eye defect occurs in the shot image. Then, the process proceeds from step S304 in the flowchart to step S311 to perform the photographing process.

  When the subject distance is too close or too far, and the distance is outside the predetermined range, the possibility that red eyes are generated is low even if a person is captured in the captured image. In the present embodiment, when a mode other than the “portrait shooting” mode (“landscape shooting” mode, “sport” mode, “self-timer” mode, and “self-shooting” mode) is selected as the mode. Does not include the person in the photographed image or estimates that the subject distance is outside the predetermined range even if the person is photographed, and omits the red-eye correction process. In this embodiment, since the initial state is the “portrait shooting” mode, the “portrait shooting” mode is adopted even when the user has shot without being particularly conscious of the mode. (Step S303: YES), shooting is performed to prevent a red-eye problem to be described later. In the case of a camera whose initial state is a mode other than the “portrait shooting” mode or in the auto mode in which the camera automatically selects an appropriate mode, for example, “the mode is“ portrait shooting ”mode (step S303). ”And“ Subject distance within predetermined range (step S304) ”may be true, the process may proceed to a photographing process for preventing red-eye defects in and after step S305.

  Further, when the flash button is pressed by the user (step S302: YES), the “portrait photographing” mode is selected as the mode (step S303: YES), and the subject distance is within a predetermined range (step S303). In S304: YES), the CPU 211 estimates that red eyes are generated in the captured image. At this time, the CPU 211 displays a warning “red-eye occurs” on the LCD panel 108 shown in FIG. 2 (step S305). By receiving the warning, the user can surely recognize that “red eyes may occur”.

  Further, the CPU 211 gives an instruction to the flash light emitting device 103 shown in FIG. 3, and adjusts the light emission intensity and the light emission time in the flash light emitting device 103 to predetermined values that are unlikely to cause red eyes (step S306).

  When the adjustment of the flash light emitting device 103 is finished and the shutter release button 105 is pressed by the user, the CPU 211 detects that the shutter release button 105 is pressed, and performs a photographing process with flash (step S307). In the image data obtained by the photographing process in step S307, the occurrence of red eyes is suppressed in advance.

  In addition, the CPU 211 gives an instruction to the CDSAMP 213 to adjust the amplifier gain (step S308).

  The image data obtained by shooting is subjected to the same image processing as in step S312 (step S309), and the image data subjected to the image processing is recorded on the recording medium 240 (step S310).

  In this way, when it is estimated that a defect such as red-eye occurs in the captured image in advance based on the shooting conditions such as the shooting mode, the presence or absence of flash, the subject distance, etc. In addition, the occurrence of red eyes can be reduced by adjusting the light emission in the flash light emitting device.

  Further, in the present embodiment, since the occurrence of red eyes is reduced, the confirmation operation of the captured image is not performed, but if a warning is issued, the confirmation operation may be performed just in case.

  Above, description of 2nd Embodiment in this invention is complete | finished, and 3rd Embodiment in this invention is demonstrated. The camera of this embodiment also has the same configuration as the camera 100 of the first embodiment shown in FIGS. 1 to 3, and these FIGS. 1 to 3 are also used in the description of this embodiment to perform the first implementation. Only differences between the embodiment and the second embodiment will be described.

  The camera of the present embodiment can press the shutter release button 105 shown in FIG. 1 in two stages. When the first stage is pressed, the above-described pre-photographing (exposure processing and focusing processing) is performed. When the step is pressed, actual shooting processing is performed.

  FIG. 18 is a flowchart showing a series of processes from photographing a subject with the camera of the present embodiment to storing the photographed image.

  First, the user selects a mode (“portrait shooting” mode, “landscape shooting” mode, “sports” mode, “self-timer” mode, “self-shooting” mode) using the shooting mode dial 112 shown in FIG. Furthermore, when performing flash photography with flash, flash photography is designated with a flash button (not shown). Further, when the automatic red-eye correction process is performed, the “automatic red-eye correction process” mode (detects the red-eye part in the subject image and corrects the detected red-eye part) is selected by the cross key 110. The setting state of the cross key 110, the shooting mode dial 112, and the flash button is transmitted to the CPU 211.

  Subsequently, the user points the camera toward a desired subject and presses the first stage of the shutter release button 105 (step S401).

  When the flash photography is not selected with the flash button (step S402 in FIG. 18: NO), the photographing process without flash is performed (step S411), which is the same as step S310 in FIG. 17, and obtained by the photographing process. Image data is recorded on the recording medium 240 (step S410). Since there are few problems relating to eyes such as red eyes in a photographed image taken without flashing, the red-eye correction process can be omitted.

  When flash photography is selected with the flash button (step S402 in FIG. 18: YES), pre-photographing similar to step S301 in FIG. 17 is performed inside the camera, and the flash from the flash light emitting device 103 is performed. In this way, image data having coarse pixels (hereinafter, this coarse image data of pixels is referred to as low resolution data) is acquired (step S403). This low resolution data corresponds to an example of the first image data referred to in the present invention, and the low resolution image represented by the low resolution element data corresponds to an example of the first image referred to in the present invention.

  Further, the user presses the second stage of the shutter release button 105 to instruct photographing (step S404).

  Inside the camera, photographing processing with flashing is performed in the same manner as in step S307 in FIG. 7, and image data with fine pixels (hereinafter, image data with fine pixels is referred to as high resolution data) is acquired (step S307). S405). This high resolution data corresponds to an example of the second image data according to the present invention, and the high resolution image represented by the high resolution element data corresponds to an example of the second image according to the present invention.

  Here, when the “automatic red-eye correction process” mode is not selected (step S406: NO), the acquired high-resolution data is recorded on the recording medium 240 without performing the red-eye correction process (step S410). ).

  When the “automatic red-eye correction processing” mode is selected (step S406: YES), the image signal processing circuit 222 uses the color of the low-resolution image represented by the low-resolution data obtained in step S403, and in step S405. The color of the high resolution image represented by the obtained high resolution data is compared (step S407). In the present embodiment, the image signal processing circuit 222 acquires the hue difference between the high resolution image and the low resolution image.

  If the hue difference acquired in step S407 is smaller than the predetermined value (step S408: NO), it is estimated that no red-eye has occurred in the high-resolution image, and the red-eye correction processing in the image signal processing circuit 222 is not performed. High-resolution image data is recorded on the recording medium 240 (step S410). Since the low-resolution image was acquired without flashing, there is a low possibility of red eyes. On the other hand, since the high-resolution image was acquired with flashing light, there is a high possibility that red-eye has occurred, but if the difference between the color of the high-resolution image and the color of the low-resolution is smaller than a predetermined value, red-eye has not occurred. Determined.

  If the hue difference acquired in step S407 is greater than or equal to a predetermined value (step S408: YES), the image signal processing circuit 222 has a problem at a location where the hue difference in the high-resolution image is greater than or equal to the predetermined value. It is considered. In addition, when the brightness difference in the part where the defect occurs in the high-resolution image is changed more greatly than the brightness difference in the peripheral part of the part, it is considered that the defect occurring in the part is a gold eye, If the hue difference or saturation difference at a location changes more greatly than the hue difference or saturation difference at the periphery of the location, it is considered that the defect occurring at that location is red-eye.

  When a defect is detected, the automatic red-eye correction process similar to step S102 in FIG. 4 is performed on the high-resolution data (step S409), and after confirming the red-eye portion, the automatic red-eye correction process is performed. The applied image data is recorded on the recording medium 240 (step S410).

  As described above, only when it is presumed that red eyes are generated in the captured image in advance, the processing load can be reduced by performing the red eye correction process, and the confirmation work of the image subjected to the red eye correction process can be performed. It can also be reduced.

  In the present embodiment, an example in which the present invention is applied to an electronic camera in which an image of a subject is formed on a CCD solid-state imaging device and image data representing the subject is captured as a signal has been described. However, the present invention is not limited to this, and a predetermined defect related to the eye in the image represented by the acquired image data is detected, the detected defect is corrected, and the number of points where the defect is detected is included in the image. The present invention can also be applied to an image correction apparatus that is displayed together with, for example, a personal computer.

  In the description of the present embodiment, an example in which automatic red-eye correction processing is performed in response to selection of the “first automatic red-eye correction processing” mode or the “second automatic red-eye correction processing” mode is shown. The automatic red-eye correction process may always be performed after taking a picture, or the automatic red-eye correction process may be always given after taking a picture using a flash.

  In the above description, an example in which red-eye correction processing and confirmation work are performed immediately after shooting has been described. However, the image correction device and the imaging device of the present invention first acquire a plurality of shot images, and then perform red-eye correction processing. The confirmation work may be performed collectively later, the red-eye correction process may be performed immediately after shooting, and the confirmation work may be performed collectively later. When only the confirmation operation for the red-eye correction process is performed later, the original captured image and the corrected image after the red-eye correction are stored, and unnecessary images are deleted after the confirmation operation. In this case, the entire image may not be stored, but only an image portion where a defect has occurred may be stored, or correction information or the like may be stored instead of the image.

  In the above description, an example in which a warning indicating that a malfunction occurs is displayed on the image display unit. However, the warning according to the present invention may be displayed on, for example, a finder that the user peeks at the time of shooting. .

  In the above description, an example in which a warning indicating that a malfunction occurs is displayed on the image display unit. However, the warning unit according to the present invention may issue a warning by voice, for example.

  In the above description, an example of a warning unit that issues a warning indicating that a problem has occurred has been described. However, for example, an automatic red-eye correction processing mode is set in the warning unit according to the present invention in conjunction with the shooting mode. In this case, a notification indicating that the correction process is working may be issued, and setting of the automatic red-eye correction processing mode is set when the flash photography is set without setting the automatic red-eye correction processing mode. It may be one that issues a recommendation to proceed.

  Further, in the above, it is estimated whether or not there is a problem in the photographed image based on the difference between the color of the first image acquired without flashing and the color of the second image acquired with flashing. Although the image correction apparatus and the imaging apparatus of the present invention emit a flash even during pre-photographing and perform red-eye detection and warning based on low-resolution data acquired by the pre-photographing. Good. In this way, the processing is distributed by detecting red eyes using the low resolution data acquired in the pre-shooting, and the time required for the red-eye correction processing after the main shooting can be shortened.

  In the description of the present embodiment, an example in which a red-eye portion in a captured image is detected and the detected red-eye portion is corrected has been described. However, the present invention is not limited to this, and for example, a gold-eye portion or the like. A predetermined defect related to the eyes may be detected and the detected defect may be corrected.

  In the description of the present embodiment, as an example of the “number of places” referred to in the present invention, the “number of unconfirmed places” representing the number of persons in which the red-eye portion is detected has been described, but the “number of places” referred to in the present invention. May be the number of eyes in which a defect such as a red-eye portion is detected.

  In the above description, the example of displaying the number of locations where a defect has been detected has been described. However, the image display unit according to the present invention displays, for example, the number of locations of defects at each level of the problem. There may be.

  Further, in the description of the present embodiment, the number of locations where the red-eye portion is detected in the captured image is displayed together with the red-eye correction result image after the red-eye portion in the captured image including the location is detected and corrected. Although an example has been shown, the present invention is not limited to this, and the number of locations where the red-eye portion is detected in the captured image is detected and corrected by detecting the red-eye portion in the captured image including the location. It may be displayed together with the previous photographed image.

It is the external appearance perspective view which looked at the camera of 1st Embodiment of this invention from front diagonally upward. It is the external appearance perspective view which looked at the camera shown in FIG. 1 from back diagonally upward. FIG. 3 is a block diagram illustrating a configuration of a signal processing unit provided in the camera illustrated in FIGS. 1 and 2. FIG. 10 is a flowchart for explaining an operation flow when a “first automatic red-eye correction process” mode is selected. FIG. It is a figure which shows an example of the picked-up image image | photographed by step S101. It is a figure which shows the example of a display by which the red-eye correction result image after the automatic red-eye correction process was performed by step S104, and the number of unconfirmed places were displayed on the LCD panel. It is a figure which shows the example of a display different from FIG. 6 in a red-eye correction result image and the number of unconfirmed places. It is a figure which shows the example of a display by which the red-eye correction result image which can select the face by a cross key by step S106 was displayed on the LCD panel. It is a figure which shows the example of a display different from FIG. 8 in the red-eye correction result image which can select a face by step S106. It is a figure which shows the example of a display as which the face expanded by step S107 was displayed on the LCD panel. It is a figure which shows the example of a display different from FIG. 10 in the expanded face. It is a figure which shows the example of a display as which the eye part expanded by step S109 was displayed on the LCD panel. 12 is a flowchart for explaining an operation flow when a “second automatic red-eye correction process” mode is selected. It is a figure which shows the example of a display in which the red eye correction result image after the automatic red eye correction process was performed by step S204, and the number of detections were displayed on the LCD panel. It is a figure which shows the example of a display by which the face expanded by step S207 and the number of unidentified parts were displayed on the LCD panel. It is a figure which shows the example of a display by which the eye part expanded by step S209 and the number of unconfirmed places were displayed on the LCD panel. It is a flowchart which shows a series of processes until it image | photographs a to-be-photographed object with the camera of 2nd Embodiment, and preserve | saves a picked-up image. It is a flowchart which shows a series of processes until it image | photographs a to-be-photographed object with the camera of 3rd Embodiment, and preserve | saves a picked-up image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Camera 101 Lens barrel 101a Image taking lens 102 Light control sensor 103 Flash light emitting device 104a Optical viewfinder objective window 104b Optical viewfinder eyepiece window 105 Shutter release button 105a Shutter switch 106 USB terminal 107 Power input terminal 108 LCD panel 109 LCD panel activation Button 110 Four-way controller 111 Menu / OK switch 112 Shooting mode dial 113 Function selection lever 113a “Recording and recording” side 113b “Image data playback” side 114 Main switch 115 Self-timer LED
116 Cancel switch 210 CCD solid-state image sensor 211 CPU
212 Timing Generator 213 CDSAMP
214, 217 Motor driver 216 Focus lens 218 A / D conversion circuit 219 Image controller 220 Bus 221 Memory (SDRAM)
222 Image signal processing circuit 223 Compression processing circuit 224 Media controller 225 USB controller
226 VideoEncoder
227 Image display device 230 AE detection circuit 231 AE & AWB detection circuit 240 Recording medium 300 Light amount adjustment device 410, 411, 420, 421, 430, 431 Person 411a, 421a, 431a Face 411b Eye portion 510, 511, 520, 521, 530, 531 Circle 610 Number of unconfirmed points 620 Number of detections

Claims (5)

In an imaging device that forms an image of a subject by subject light that has passed through a photographing optical system on a solid-state image sensor to obtain image data representing the subject image, and records the image data.
Detecting a red eye in a person's eye in the image represented by the image data, correcting the detected red eye, and a correction unit that prioritizes a place where the red eye is found according to a predetermined criterion ;
An image display unit that displays the number of places representing the number of persons whose red eyes are detected by the correction unit together with an image including the place ;
The image display unit is characterized in that when displaying the image, the image display unit preferentially displays a portion with a high priority given by the correction unit . The imaging apparatus according to claim 1 , wherein the image display unit displays a list of the locations when displaying the image. The imaging apparatus according to claim 1 , wherein the image display unit enlarges and displays the portion when displaying the image. The imaging apparatus according to claim 3 , wherein when displaying the image, the image display unit displays a normal image in which the portion is not enlarged and an enlarged image in which the portion is enlarged . A confirmation unit that receives an operation of confirming a location where a defect is detected by the correction unit in the image displayed on the image display unit;
The image display section, when performing display representing the number of the point, the imaging apparatus according to claim 1, characterized in that to perform a display representing the location number obtained by subtracting the number identified in the check unit.

Images