KR101654671B1 - Photographing apparatus and photographing method - Google Patents

Abstract

The present invention relates to an image pickup apparatus having a light emitting unit for irradiating light to a subject at the time of photographing, a first image pickup element for converting light from the subject received through the first optical system into an electric signal, An image signal processing section for generating a first image signal and a second image signal for still images, and a second image signal processing section for generating, from the first image signal and the second image signal, An extracting unit for extracting a color component of an eye part and determining a color configuration of a color component of the eye part based on the extracted image data; And a recording control section for recording on the recording medium any one of the red component of the color components of the recording medium.

Image pickup device, image pickup method

Description

[0002] Photographing apparatus and photographing method [0003]

The present invention relates to an imaging apparatus and an imaging method.

In order to secure the brightness of a subject in an image pickup apparatus such as a digital camera, there is a case where photographing is performed using a flash at the time of the main photographing. At this time, if the subject includes eyes such as a person, the phenomenon in which the eyes are reddish (red eye phenomenon) occurs. Thus, for example, Japanese Patent Application Laid-Open No. 2007-235531 discloses a technique for reducing red eye for an obtained image.

Japanese Patent Laid-Open No. 2007-235531 aims at reducing red eye without being affected by automatic adjustment such as white balance and saturation at the time of photographing a person using a flash. First, a first image and a second image having white balance or different colors are generated by the photographing means. Then, red eye is detected in the first image and the color of the same area as the red eye area in the second image is corrected.

The detection of the red eye is performed using an image analysis (including prior learning) such as a face detection function (pattern matching) and a face part recognition function. And the color correction of the red eye area is simply to color overlay. However, in the conventional art, the original color of the eye corresponding to the detected red-eye part is unclear, and therefore, it is merely changed to the general eye color assumed for the red-eye part. However, since there is an individual difference in the color of the eyes, there is a problem that it is difficult to reproduce the original color of the eyes when the eyes become completely red in the image obtained by the photographing.

An object of the present invention is to provide an image pickup apparatus and an image pickup method capable of expressing an eye closer to an original color component by reducing red eye caused by an influence of a light emitting portion in an image obtained by photographing.

The present invention relates to an image pickup apparatus which includes a light emitting portion for irradiating light to a subject at the time of photographing, a first image pickup element for converting light from the subject received through the first optical system into an electric signal, A second image pickup device for converting the light from the subject received through the second optical system into an electric signal, and a second image pickup device for converting the light received from the subject through the second optical system into an electric signal based on the electric signal converted by the first pick- An image signal processing section for generating a second image signal for a still image at the same timing as the first image signal based on the first image signal and the electric signal converted by the second image pickup element; An extracting unit that extracts a color component of an eye part of the subject from the second image signal and determines a color configuration of a color component of the eye part; And a recording control section for recording on the recording medium any one of the image signals whose red component is smaller than the color component of the extracted eye part generated based on the light by the light emitting section.

A first imaging device for converting light from the subject received through the first optical system into an electric signal; and a second imaging device for converting light from the subject received through the first optical system into an electric signal, Based on the electric signal converted by the first image pickup element when the still image is actually photographed, a second image pickup device for converting the light from the subject received through the second optical system different from the first image pickup device into an electric signal, An image signal processing section for generating a second image signal for still images at the same timing as the first image signal based on the first image signal for image and the electrical signal converted by the second image sensor, An extracting unit for extracting a color component of an eye part of the subject from the image signal and the second image signal and determining a color configuration of a color component of the eye part; A color component of an eye part of the subject of the other of the color components of the extracted eye part generated based on the light by the light emitting part is used as the color component of the other eye part of the subject And a correcting unit for correcting the corrected image.

The image pickup apparatus may further include: a position misalignment detecting unit for detecting a misalignment between the first image signal and the second image signal; and a second misalignment detecting unit for detecting a misalignment between the first image signal and the second image signal by using the detected misalignment, And a combining unit for combining the first image signal and the second image signal.

A step of converting light from the object received by the first imaging device through the first optical system into an electric signal; and a step of converting the light from the object received through the first optical system into an electric signal, 2) converting the light from the subject received through the second optical system, which is different from the first optical system, into an electric signal by the image pickup element, and a step of, when the still image is actually photographed, Generating a second image signal for a still image at the same timing as the first image signal based on the first image signal for still image and the electric signal converted by the second image sensor based on the signal, Extracting a color component of an eye portion of the subject from the first image signal and the second image signal to determine a color configuration of a color component of the eye portion; Of the signal, the method comprising the extracted optical recording picture signals of less than either one of the appropriateness minutes the color of the eye area in the recording medium based on the generated by the light emitting portion; provides an imaging method comprising a.

A step of converting light from the object received by the first imaging device through the first optical system into an electric signal; and a step of converting the light from the object received through the first optical system into an electric signal, 2) converting the light from the subject received through the second optical system, which is different from the first optical system, into an electric signal by the image pickup element, and a step of, when the still image is actually photographed, Generating a second image signal for a still image at the same timing as the first image signal based on the first image signal for still image and the electric signal converted by the second image sensor based on the signal, Extracting a color component of an eye portion of the subject from the first image signal and the second image signal to determine a color configuration of a color component of the eye portion; The color component of the eye part of the subject of one of the color components of the extracted eye part which is generated based on the light from the light emitting part among the image signals, And correcting the color components.

According to the present invention, it is possible to reduce the red eye caused by the influence of the light emitting portion in the image obtained by photographing, and to display an eye closer to the original color component.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and drawings, the same reference numerals are used for constituent elements having substantially the same configuration, and redundant description is omitted.

(Configuration of one embodiment of the present invention)

First, an image pickup apparatus 100 according to an embodiment of the present invention will be described. Fig. 1 is a block diagram showing the image pickup apparatus 100 according to the present embodiment. Fig. 2 is a block diagram showing the DSP 121 (122) of the image pickup apparatus 100 according to the present embodiment.

The image capturing apparatus 100 includes, for example, two optical systems and an image capturing system, and it is possible to capture an object from each system and acquire an image from each system. For example, when a live view display is performed, an image for live view is acquired from one system and photometry is performed in another system. Further, since the optical system is disposed on the right and left sides, it is possible to generate a stereoscopic image (a planar image in which a subject can be stereoscopically viewed) by taking an image and acquiring an image at the same timing.

The imaging apparatus 100 includes an imaging optical system 101 and 102, an image sensor 103 and 104, an SDRAM 105 and 106, a memory card 107, a ROM 109, A release button 115, a timing generator 117, a DSP 121, a flash controller 131, a flash 133, an LCD controller 135, an LCD 137 Lt; / RTI >

The imaging optical system 101 (102) is an example of a first optical system and a second optical system, and is an optical system for forming external light information on the image sensors 103 and 104. The imaging optical system 101, (104).

The light from the imaging optical system 101 reaches the image sensor 103 and the light from the imaging optical system 102 reaches the image sensor 104. [ The imaging optical systems 101 and 102 are, for example, a zoom lens, a diaphragm, a focus lens, or the like. The zoom lens is a lens for changing the angle of view by changing the focal distance, and the diaphragm is a mechanism for adjusting the amount of transmitted light. The focus lens shifts from one side to the other or from one side to the other, thereby focusing the subject image on the image pickup surface of the image sensor 103 (104).

The image sensors 103 and 104 are an example of the first image pickup element and the second image pickup element (photoelectric conversion element), and are photoelectric conversion systems for converting the optical information transmitted through the imaging optical systems 101 and 102 into electric signals And is composed of several possible devices. Each element generates an electric signal corresponding to the received light. As the image sensors 103 and 104, a charge coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor, or the like may be used.

In order to control the exposure time of the image sensors 103 and 104, a mechanical shutter (not shown) may be applied so as to block the light at the time of non-photographing and to make the light reach only at the time of photographing. However, the present invention is not limited to this, and an electronic shutter (not shown) may be used. In addition, the operation of the mechanical shutter or the electronic shutter is performed by the switch of the release button 115 (operating member) connected to the DSP 121 (122).

The image sensors 103 and 104 further include a CDS / AMP unit and an A / D conversion unit.

The CDS / AMP unit (correlated double sampling / amplifier) removes the low frequency noise included in the electrical signals output from the image sensors 103 and 104, and at the same time, Amplified.

The A / D conversion unit digitally converts the electrical signal output from the CDS / AMP unit to generate a digital signal. The A / D conversion unit outputs the generated digital signal to the image signal processing unit 141. [

SDRAM (Synchronous DRAM) 105 and 106 temporarily store the image data of the photographed image. The SDRAMs 105 and 106 have a storage capacity capable of storing image data of a plurality of images. The SDRAMs 105 and 106 are connected to the DSPs 121 and 122, respectively. Reading and writing of the image in the SDRAM 105 (106) is controlled by the memory controller 151.

In the SDRAM 105, an area as a VRAM is secured. The VRAM has a plurality of channels as image display memories. The VRAM can simultaneously execute the input of image data for image display and the output of image data to the LCD controller 135. [ The resolution or maximum number of colors of the LCD 137 depends on the capacity of the VRAM.

The memory card 107 is, for example, a semiconductor storage medium such as a flash memory. The image data generated by the photographing is recorded in the memory card 107 or read out from the memory card 107. [ The storage medium is not limited to the memory card 107 such as a flash memory and may be an optical disk (CD, DVD, Blu-ray disk, etc.), a magneto-optical disk, a magnetic disk, or the like. The memory card 107 may be configured to be detachable from the image capturing apparatus 100.

The ROM 109 stores an operation program of the DSP 121 (122).

The release button 115 can be half-pressed, fully pressed, and released by the user. When the release button 115 is pressed halfway (S1 operation), the focus control start operation signal is output, and the focus control is terminated by half depression. Further, the release button 115 outputs a photographing start operation signal when fully depressed (S2 operation).

In addition, an operation member (not shown) other than the release button 115 is provided on the image capturing apparatus 100. The operation member is, for example, an up / down / left / right key provided in the image capturing apparatus 100, a power switch, a mode dial, or the like. The operation member sends an operation signal to the DSP 121 (122) or the like based on an operation by the user.

The timing generator 117 outputs a timing signal to the image sensor 103 or 104 or the CDS / AMP unit to control the exposure period or charge of each pixel constituting the image sensor 103 ).

The DSP 121 (122) is an example of an image signal processing unit, and functions as an arithmetic processing unit and a control unit by a program and controls the processing of each component installed in the image pickup apparatus 100. [

The DSP 121 (122) outputs a signal to a driver (not shown) based on, for example, focus control or exposure control to drive the imaging optical system 101 (102). The DSP 121 (122) controls each component of the image pickup apparatus 100 based on a signal from an operation member (not shown). In addition, in the present embodiment, the DSP 121 (122) is provided for each imaging system, for example, as shown in Fig. The DSPs 121 and 122 are individually configured to perform commands of the signal system and commands of the operation system separately.

The imaging apparatus 100 of the present embodiment includes two DSPs 121 and 122, but the present invention is not limited thereto. For example, the imaging apparatus according to the present invention may include one DSP 221 as shown in FIG. In this case, the command of the signal system and the command of the operating system are performed in one DSP 221. 5 is a block diagram showing an image pickup apparatus 200 as a modification of the image pickup apparatus 100 according to the present embodiment. Here, the remaining details of the image capturing apparatus 200 except for the DSP 221 are the same as those of the image capturing apparatus 100 shown in Fig. 1, and therefore detailed description thereof will be omitted.

The flash controller 131 generates a control signal based on the signal received from the DSP 121 and sends the generated control signal to the flash 133. [ The flash 133 irradiates the subject with light during the main photographing or the focus control before the main photographing, and is an example of the light emitting portion of the present invention.

The LCD controller 135 receives image data from the encoder LCD controller 163, for example, and displays an image on an LCD (liquid crystal display) The LCD 137 is provided in the main body of the image capturing apparatus 100.

The image displayed by the LCD 137 is, for example, an image (live view display) before shooting taken by the SDRAM 105, various setting screens of the imaging apparatus 100, and images captured and recorded. In the present embodiment, the LCD 137 is used as a display unit and the LCD controller 135 is used as a display drive unit. However, the present invention is not limited to the above example. For example, an organic EL display may be used as a display unit, A control unit or the like.

Next, the DSP 121 (122) of the image pickup apparatus 100 according to the present embodiment will be described.

The DSP 121 and the DSP 122 are provided with an image signal processing section 141, an AE / AF / AWB calculation section 142, an exposure control / AF operation control section 143, a memory controller 151, A correspondence / feature point detection unit 153, an image correlation detection unit 154, a scene determination unit 155, a storage medium control unit 161, an external communication control unit 162, an encoder LCD control unit 163, an image compression / expansion processing unit 164, a CPU 171, an SIO 172, an I / O port 173, and the like.

The image signal processing section 141 receives image signals from the image sensors 103 and 104 and processes the digital signals output from the A / D conversion section of the image sensors 103 and 104 to perform image processing Thereby generating an image signal. The image signal processing section 141 generates an image signal subjected to the image processing based on the WB control value, the? Value, the contour enhancement control value and the like. Further, the image signal processing section 141 calculates an AE evaluation value, an AWB evaluation value, and an AF evaluation value based on the image signal.

The AE / AF / AWB calculating section 142 calculates the cooking improvement and the shutter speed of the iris based on the AE (auto exposure) evaluation value calculated by the image signal processing section 141. The AE / AF / AWB calculating section 142 calculates, for example, the gain of the three primary color signals based on the AWB (auto white balance) evaluation value calculated by the image signal processing section 141. The AE evaluation value and the AWB evaluation value are calculated by the image signal processing section 141 based on the luminance value of the image signal.

The exposure control / AF operation control section 143 outputs the cooking improvement calculated by the AE / AF / AWB calculation section 142 to the driver (not shown) of the imaging optical system 101 as a control signal. The driver generates a drive signal based on the control signal received from the exposure control / AF operation control section 143. [ The exposure control / AF operation control section 143 controls exposure by other exposure time, gain, and read mode of the image sensor 103 (104). The gain is used to calculate the contrast value. The read mode of the image sensors 103 and 104 is a signal processing mode for reading out image data from the image sensors 103 and 104. When the subject image is dark, pixels are added. When the subject image is bright This is a process for reading out all the pixels as they are. The exposure control / AF operation control section 143 is an example of the exposure amount setting section.

Upon receiving the focus control start operation signal, the exposure control / AF operation control unit 143 generates a control signal for moving the focus lens in one direction, and outputs the generated control signal to the driver. The exposure control / AF operation control section 143 calculates the in-focus position of the focus lens based on the AF (auto focus) evaluation value calculated by the image signal processing section 141. [ The AF evaluation value is calculated by the image signal processing section 141 based on the luminance value of the image signal. The AF evaluation value is a contrast value of an image, for example, when the contrast value becomes a peak, it is determined that the subject image is in-focus on the image sensing surface of the image sensor 103 (104) (contrast detection method).

The memory controller 151 controls reading and writing of image data to and from the SDRAMs 105 and 106. In addition, the SDRAMs 105 and 106 may be DRAMs.

The image synthesis processing unit 152 is an example of a position shift detection unit and a synthesis unit, and combines two images captured by the image sensors 103 and 104 at the same or different timing. At this time, a position misalignment amount between images is detected and an image is synthesized based on the position misalignment amount.

The corresponding point / feature point detection unit 153 extracts feature points from the frame images, finds corresponding points among the frame images, and associates the points with each other or tracks corresponding points.

The image correlation detection section 154 calculates correlation between frame images. The image correlation detection unit 154 can perform correspondence between images when the number of feature points detected by the corresponding point / feature point detection unit 153 is small or when the corresponding point can not be found.

The scene discrimination section 155 discriminates from the detection results of the corresponding point / feature point detection section 153 or the image correlation detection section 154 what kind of scenery the scenery is, for example, scenery, portrait or sports.

The storage medium control unit 161 controls writing of image data into the memory card 107 as a storage medium (recording medium), or reading of image data and setting information recorded in the memory card 107. [ Here, the storage medium control section 161 is an example of the recording control section of the present invention.

The external communication control unit 162 transmits and receives signals to and from external equipment such as a PC and a printer.

The encoder LCD control section 163 encodes image display image data and generates data that can be displayed on the LCD 137. [

The image compression / expansion processing unit 164 receives the image signal before the compression processing, and compresses the image signal in a compression format such as a JPEG compression format or an MPEG compression format, for example. The image compression / expansion processing unit 164 sends the image data generated by the compression processing to the storage medium control unit 161, for example.

The CPU 171 is an arithmetic processing unit and a control unit of the DSP 121 (122). SIO 172 or the I / O port 173, as shown in FIG.

The series of processing in the image pickup apparatus 100 may be processed by hardware or may be realized by software processing by a program on a computer.

As described above, the present embodiment has been described with respect to the case where two optical systems and imaging systems are provided, but the present invention is not limited thereto. For example, the present invention may include three or more optical systems and imaging systems.

The imaging apparatus 100 of the present embodiment includes a plurality of optical systems and imaging systems and acquires image data from each of them at the same or different timing. The imaging apparatus 100 includes, for example, a functional block for calculating the degree of correlation between images acquired by the DSP 121 (122), a functional block capable of extracting an image of a specific shape and comparing the tones, And a function block for correcting color components of a specific shape portion. Here, the "functional block capable of extracting a specific shape image and comparing color tones" included in the image pickup apparatus 100 is an example of the extraction unit of the present invention, Function block for correcting color components "is an example of a correction unit of the present invention.

Further, the imaging apparatus 100 of the present embodiment is capable of both a normal image (plane image, not a stereo image) photographing sequence and a stereo image photographing sequence.

In the present embodiment, a plurality of respective image data can be acquired, but only an image with a low red-eye level is recorded in the planar image pickup mode. In the stereo image pick-up mode, the color of the other eye is corrected in accordance with the color of the lower red eye. As a result, it is possible to generate a more natural image in a flash photographing using a person as a subject.

(Operation of an embodiment of the present invention)

Next, the operation of the image pickup apparatus 100 according to the present embodiment will be described.

First, the operation of the image pickup apparatus 100 in the planar image pickup mode according to the present embodiment will be described with reference to FIG.

3 is a flowchart showing the operation of the image pickup apparatus 100 in the planar image pickup mode according to the present embodiment.

L in Fig. 3 represents a left optical system / imaging system (hereinafter, referred to as L system) of the image capturing apparatus 100 and R designates a right optical system and image capturing system (hereinafter referred to as R system) . The optical system and image pickup system according to the present embodiment have the same performance (resolution, etc.) on the left and right sides.

First, it is determined whether or not the depression of the release button 115 is detected while the exposure parameter or the like is set (step S101). When the pushing is detected, the process proceeds to step S102. On the other hand, the process remains in the standby state in step S101 until the pressing is detected.

When the pushing is detected, the two systems of the L system and the R system output image data at the same timing, and the two image data photographed from the L system and the R system are input to the image signal processing unit 141 (step S102).

Then, the image correlation detection unit 154 performs pattern matching on the two image data (step S103). When the subject includes eyes of a person, eye positions of two pieces of image data are detected by pattern matching.

Next, the color components of the eyes of the two pieces of image data are calculated on the detected eyes (step S104).

Then, it is judged whether or not each eye is a red eye including a lot of aberrations (step S105).

When it is determined that there is no red eye, the reference image among the image data acquired in the L system and the R system is recorded on a recording medium (medium) such as the memory card 107 (step S107). As to the reference image, it may be determined in advance which image data of the L-system or R-system is to be the reference image, and the content and image quality of the L-system or R-

On the other hand, when it is determined in step S105 that there is a red eye, the image data of both the L-system and the R-system are compared and the levels of the red eye are compared (step S106). Then, in the image data of both the L-system and the R-system, an image judged to have a low degree of red-eye (close to normal) is recorded on the recording medium (recording medium) (step S108).

On the other hand, when it is determined that the degree of red-eye is high for both the L-system image data and the R-system image data, the reference image of the image data acquired in the L system and the R system is recorded on a recording medium (medium) such as the memory card 107 (Step S107).

In the present embodiment, it is possible to acquire image data for a plurality of images, but only an image with a low red-eye level is recorded in the planar image pickup mode, except for cases where the degree of red-eye is high. This makes it possible to save an image having a more natural eye color without processing the image data.

Next, the operation of the stereo image pickup mode of the image pickup apparatus 100 according to the present embodiment will be described with reference to Fig.

4 is a flowchart showing the operation of the stereo image pickup mode of the image pickup apparatus 100 according to the present embodiment.

L in Fig. 4 represents the left optical system and image pickup system (hereinafter referred to as L system) of the image pickup apparatus 100 and R represents the right optical system and image pickup system (hereinafter referred to as R system) . The optical system and image pickup system according to the present embodiment have the same performance (resolution, etc.) on the left and right sides.

First, it is determined whether or not the depression of the release button 115 is detected while the exposure parameter or the like is set (step S201). When the pushing is detected, the process proceeds to step S202. On the other hand, the process remains in the standby state at step S201 until the pressing is detected.

When the pushing is detected, the two systems of the L system and the R system output image data at the same timing, and the two image data photographed by the L system and the R system are input to the image signal processing unit 141 (step S202).

Then, the image correlation detecting unit 154 performs pattern matching on the two image data (step S203). When the subject includes eyes of a person, eye positions of two pieces of image data are detected by pattern matching. Further, correlation between two images is calculated by pattern matching, and positional misalignment is detected. Then, a parameter for generating a stereo image is calculated on the basis of two images or an amount of positional misalignment between an image photographed on the R system, an image photographed on the L system, characteristics possessed by the image sensing apparatus, and the like.

Next, the color components of the eyes of the two pieces of image data are calculated on the detected eyes (step S204).

Then, it is judged whether or not each eye is a red eye including many aberrations (step S205).

When it is determined that there is no red eye, the image data in the stereo image format and the parameters calculated in step S203 are recorded on a recording medium (medium) such as the memory card 107 based on the image data acquired in the L system and the R system S208).

On the other hand, when it is determined in step S205 that there is a red eye, the image data of both the L-system and the R-system are compared and the levels of the red eye are compared (step S206).

When it is determined that the red eye level of the image data of both the L-system and the R-system is low (close to normal), the red-eye part of the image determined to have a high red-eye level is changed to the eye color of the other (Step S207).

Then, the image data in the stereo image format and the parameters calculated in step S203 are recorded on a recording medium (medium) such as the memory card 107 based on the image data acquired in the L system and the R system (step S208).

On the other hand, when it is determined that the degree of red-eye is high for both the L-system image data and the R-system image data, the image data in the stereo image format and the parameters calculated in step S203 are stored in the memory card (Media) such as the recording medium 107 (step S208).

In the present embodiment, image data for each number can be acquired, but the red-eye is corrected on the basis of an image having a low red-eye level in the stereo image pickup mode, except for cases where the red- The image data is recorded in the stereo image format. This can save the red eye and preserve the image with a more natural eye color.

Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited thereto. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents. .

In the above description, the optical system and the image pickup system according to the present embodiment have the same performance on both the left and right sides. However, if the image quality of the left and right images can be made equal by the image processing, the optical system and the image pickup system may have different resolutions.

1 is a block diagram showing an image pickup apparatus according to an embodiment of the present invention.

2 is a block diagram showing a DSP of an image pickup apparatus according to an embodiment of the present invention.

3 is a flowchart showing the operation of the planar imaging mode of the imaging apparatus according to the embodiment of the present invention.

4 is a flowchart showing the operation of the stereo image pickup mode of the image pickup apparatus according to the embodiment of the present invention.

5 is a block diagram showing a modification of the image pickup apparatus according to the embodiment of the present invention.

Description of the Related Art

100, 200: imaging device 101, 102: imaging optical system

103, 104: image sensor 105, 106: SDRAM

107: memory card 109: ROM

115: Release button 117: Timing generator

121, 122, 221: DSP 131: Flash controller

133: Flash 135: LCD controller

137: LCD 141: Image signal processor

142: AE / AF / AWB calculating section 151: Memory controller

152: image synthesis processing section 153: corresponding point / minutia point detection section

154: image correlation detector 155:

161: storage medium control unit 162: external communication control unit

163: Encoder LCD control unit 164: Image compression / decompression processing unit

171: CPU 172: SIO

173: I / O port

Claims (5)

A light emitting unit for irradiating the subject with light during the main photographing; A first image pickup element for converting light from the object received through the first optical system into an electric signal; A second image pickup element for converting light from the subject received through a second optical system different from the first optical system into an electric signal; A first image signal for a still image based on the electric signal converted by the first image pickup element when the still image is actually photographed and a second image signal for the first image based on the electric signal converted by the second image pickup element, An image signal processing unit for generating a second image signal for still images at the same timing as the signal; An extracting unit for extracting a color component of an eye portion of the subject from the first image signal and the second image signal and determining a color configuration of a color component of the eye portion; And Wherein either one of the first image signal and the second image signal, which has a smaller red component than the color component of the extracted eye portion generated based on light from the light emitting portion, is recorded on a recording medium And a recording control unit. A light emitting unit for irradiating the subject with light during the main photographing; A first image pickup element for converting light from the object received through the first optical system into an electric signal; A second image pickup element for converting light from the subject received through a second optical system different from the first optical system into an electric signal; A first image signal for a still image based on the electric signal converted by the first image pickup element when the still image is actually photographed and a second image signal for the first image based on the electric signal converted by the second image pickup element, An image signal processing unit for generating a second image signal for still images at the same timing as the signal; An extracting unit for extracting a color component of an eye portion of the subject from the first image signal and the second image signal and determining a color configuration of a color component of the eye portion; And Using the color component of the eye part of the subject in either one of the image signals of which the quality of the extracted eye part is smaller than that of the extracted eye part generated based on the light of the light emitting unit among the first image signal and the second image signal And correcting the color component of the eye part of the other subject. 3. The method of claim 2, A position misalignment detecting unit for detecting misalignment between the first image signal and the second image signal; And And a synthesis unit for synthesizing the first image signal and the second image signal using the detected positional shift after the color component is corrected by the correcting unit. Irradiating the subject with light during the main photographing; Converting light from the subject received by the first imaging device through the first optical system into an electrical signal; Converting the light from the subject received by the second imaging device through the second optical system different from the first optical system into an electrical signal; A first image signal for a still image based on the electric signal converted by the first image pickup element when the still image is actually photographed and a second image signal for the first image based on the electric signal converted by the second image pickup element, Generating a second image signal for a still image having the same timing as the signal; Extracting a color component of an eye portion of the subject from the first image signal and the second image signal to determine a color configuration of a color component of the eye portion; And And recording one of the first image signal and the second image signal on the recording medium, the image signal of which of the color components of the extracted eye part generated based on the light by the light emitting unit is less than the optimum color component . Irradiating the subject with light during the main photographing; Converting light from the subject received by the first imaging device through the first optical system into an electrical signal; Converting the light from the subject received by the second imaging device through the second optical system different from the first optical system into an electrical signal; A first image signal for a still image based on the electric signal converted by the first image pickup element when the still image is actually photographed and a second image signal for the first image based on the electric signal converted by the second image pickup element, Generating a second image signal for a still image having the same timing as the signal; Extracting a color component of an eye portion of the subject from the first image signal and the second image signal to determine a color configuration of a color component of the eye portion; And Using the color component of the eye part of the subject of either one of the image signals of which the quality of the extracted eye part is less than that of the extracted eye part generated based on the light of the light emitting unit among the first image signal and the second image signal And correcting a color component of an eye portion of the other subject.

Images