JP2014220701A - Imaging device and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device and an imaging method capable of achieving color filter effects intended by a user.SOLUTION: An imaging device includes: an image sensor part 203 for converting an optical signal into the image signal of an electric signal by photography; a camera signal processing part 105 including a white balance control part 106 for adjusting a color signal included in the image signal output from the image sensor part 203 in accordance with the gain of a white balance, which performs the processing of the image signal; a color temperature estimation part 115 for estimating the color temperature of a scene in which photography has been performed; and a white balance setting determination part 116 for comparing the color temperature estimated by the color temperature estimation part 115 with the color temperature estimated from the state of the white balance controlled by the white balance control part 106 to determine the presence/absence of a difference. The camera signal processing part 105 changes the content of the processing of the image signal on the basis of the result of determination by the white balance setting determination part 116.

Description

  The present invention relates to an imaging apparatus such as a digital video camera, an imaging method, and the like.

  When using an imaging apparatus such as a digital video camera, a user may use a white balance function in order to obtain a color filter effect. For example, by using a “preset white balance light bulb” during outdoor photography, the image may be deliberately cold-colored. Also, when shooting under a low color temperature light source, a blue subject may be captured with white set white balance, and the white balance may be set to a high color temperature setting state to make the image warm.

  On the other hand, an imaging apparatus such as a digital video camera may perform light source estimation from a white balance state and perform video signal processing according to the estimated light source. For example, when a white set white balance is used, light source estimation may be performed from a white balance gain amount, and color correction may be performed in accordance with the estimated light source. In addition, since the assumed light source is determined in the preset white balance, video signal processing may be performed in accordance with the assumed light source. For example, when “Preset White Balance Light Bulb” is selected, color correction under halogen light, which is an assumed light source, may be performed.

  When the preset white balance gain amount is a predetermined fixed value, individual differences may occur due to variations in optical components such as sensors and low-pass filters (LPF). For this reason, automatic white balance control (automatic control) may be performed. According to auto control, white balance performance under an assumed light source can be improved by providing a white detection range and a control range according to the assumed light source.

  Regarding white balance, a technique has also been proposed in which a shooting scene is estimated, the control of auto white balance is changed according to the estimation result, and the camera control is changed to draw white more correctly (Patent Document 1).

JP 2008-301279 A

  However, in the conventional technology, when the user tries to obtain the color filter effect using the white balance, the user's intended color may not be obtained by the control set according to the estimated light source. is there. In addition, the color filter effect may not be constant due to auto control. As described above, in the conventional auto control, the color filter effect intended by the user may not be obtained. The same applies to the method described in Patent Document 1.

  An object of the present invention is to provide an imaging device, an imaging method, and the like that can realize a color filter effect intended by a user.

  An image pickup apparatus according to the present invention includes an image pickup element that converts an optical signal into an image signal of an electric signal by photographing, and a white signal that adjusts a color signal included in the image signal output from the image pickup element in accordance with a white balance gain. Signal processing means for processing the image signal, color temperature estimation means for estimating the color temperature of the scene where the image was taken, color temperature estimated by the color temperature estimation means and the white White balance setting determination means for comparing the color temperature estimated from the white balance state controlled by the balance control means to determine the presence or absence of a difference, and the signal processing means includes the white balance setting The content of the processing of the image signal is changed based on the result of determination by the determination means.

  An imaging method according to the present invention includes an imaging step for converting an optical signal into an image signal of an electrical signal by imaging, and a white balance for adjusting a color signal included in the image signal acquired in the imaging step according to a white balance gain. Including a control step, a signal processing step for processing the image signal, a color temperature estimation step for estimating a color temperature of the scene where the shooting was performed, a color temperature estimated in the color temperature estimation step, and the white balance A white balance setting determination step of comparing the color temperature estimated from the white balance state controlled in the control step to determine the presence or absence of a difference, and the signal processing step includes the white balance setting determination The processing content of the image signal is changed based on the determination result in the step It characterized by having a step.

  According to the present invention, the color filter effect intended by the user can be more reliably realized.

1 is a block diagram illustrating a configuration of a digital video camera (imaging device) according to an embodiment of the present invention. It is a figure which shows the relationship between the gain amount of R and B in white balance. It is a figure which shows the criteria of the imaging | photography place by a color temperature estimation part. It is a flowchart which shows the operation | movement which estimates the color temperature by a white balance setting determination part. It is a figure which shows the relationship between the amount of gains of white balance, and a light source. It is a figure which shows the gain control range at the time of the auto control of a preset white balance light bulb. It is a figure which shows the reliability of indoor / outdoor determination. It is a figure which shows the control range of the gain amount of white balance according to reliability. It is a figure which shows the time characteristic of an auto control range.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the accompanying drawings. FIG. 1 is a block diagram showing the configuration of a digital video camera (imaging device) according to an embodiment of the present invention.

  The digital video camera according to the present embodiment includes a lens unit 101, an aperture 102, an image sensor unit 103, a CDS / AGC unit 104, a camera signal processing unit 105, a display device unit 109, and a recording unit 110. The digital camera further includes a focus operation unit 111, a lens driving unit 112, a white balance mode selection UI unit 113, a system control unit 114, a color temperature estimation unit 115, and a white balance setting determination unit 116. The camera signal processing unit 105 includes a white balance control unit 106, a detection unit 107, and a video signal processing unit 108.

  The lens unit 101 is also provided with a focus lens group, and the lens unit 101 forms an image of incident light from a subject. The diaphragm 102 has a function of adjusting the amount of light reaching the image sensor unit 103. A CCD (Charged Coupled Device) element or a CMOS (Complementary Metal Oxide Semiconductor) element or the like is used for the image sensor unit 103. The image sensor unit 103 converts the formed optical image (optical signal) into an image signal of an electrical signal. The CDS / AGC unit 104 reduces the noise of the analog image signal by correlated double sampling, and automatically controls the signal level by automatic gain control. In the present embodiment, the white balance control unit 106 controls the R gain and the B gain to change the white balance gain. That is, the white balance control unit 106 adjusts the color signal included in the image signal output from the image sensor of the image sensor unit 103 according to the white balance gain. The white balance control unit 106 can apply independent gains of R (red) / G (green) / B (blue) for white balance control described later. The detection unit 107 detects an image for white balance feedback control. The video signal processing unit 108 performs gamma processing, noise reduction processing (NR processing), and / or edge enhancement. As described above, the camera signal processing unit 105 performs known camera processing such as white balance processing, gamma processing, noise reduction processing (NR processing), and color processing on the video signal.

  A liquid crystal display panel or the like is used for the display device unit 109, and the display device unit 109 displays an image. The recording unit 110 records image data and records the image data on a recording medium. The focus operation unit 111 includes a mechanism for the user to adjust the focus. The lens driving unit 112 drives a focus lens group included in the lens unit 101. The white balance mode selection UI unit 113 is a user interface (UI) for the user to select a white balance mode. The system control unit 114 reads information of each part of the digital video camera (imaging device) and controls the operation of each part based on the information.

  The color temperature estimation unit 115 estimates the color temperature of the subject from camera settings and image data. The white balance setting determination unit 116 compares the color temperature estimated by the color temperature estimation unit 115 with the color temperature estimated from the white balance state, and determines whether there is a difference between them. In the determination of the presence / absence of this difference, for example, if the range of one color temperature is within the range of the other color temperature, it is assumed that there is no presence / absence. Details of the configuration of the color temperature estimation unit 115 and the white balance setting determination unit 116 and the white balance control operation related thereto will be described later.

  Next, an outline of the operation of the digital video camera according to the present embodiment will be described.

  The subject image formed by the lens unit 101 is adjusted in light amount by the diaphragm 102, and then the optical image is converted into an electrical signal by the image sensor unit 103. The image sensor unit 103 can adjust the charge accumulation time, thereby realizing an electronic shutter function. Subsequently, in the CDS / AGC unit 104, the noise of the analog image signal from the image sensor unit 103 is reduced by correlated double sampling, and the signal level is automatically controlled by automatic gain control (Auto Gain Controller). This is supplied to the camera signal processing unit 105. The camera signal processing unit 105 executes known camera signal processing such as white balance processing including automatic control, gamma processing, NR processing, and color processing.

  The signal subjected to the camera signal processing in the camera signal processing unit 105 is sent to the display device unit 109 so that the user can check the angle of view and the like. Further, the image data subjected to the signal processing output from the camera signal processing unit 105 is sent to the recording unit 110. The recording unit 110 records image data and records the image data on a recording medium. Examples of the recording medium include an SD card, an optical disk, and a hard disk.

  Here, the details of the white balance control operation in the present embodiment will be described. Here, among R, G, and B, the gain of G is fixed, and the control amount of the gain of R and B is changed. Therefore, as described above, in the present embodiment, the white balance control unit 106 controls the R gain and the B gain to change the white balance gain. Even if the gain of R is fixed and the control amounts of the gains of G and B are changed, the same effect can be obtained even if the gain of B is fixed and the control amounts of the gains of R and G are changed. .

  The user can select an arbitrary white balance mode from a plurality of preset white balance modes using the white balance mode selection UI unit 113. The plurality of white balance modes include, for example, preset white balance and white set white balance. The preset white balance is a mode in which a predetermined gain amount is controlled according to the assumed light source. The preset white balance includes, for example, a preset white balance light bulb and a preset white balance shade. Further, in the preset white balance, automatic control in accordance with an assumed light source, that is, so-called auto white balance (AWB) control may be performed instead of a fixed gain amount.

  The white balance mode selected by the white balance mode selection UI unit 113 is sent to the system control unit 114. The system control unit 114 controls the white balance control unit 106 to change the gain amounts to R and B set in advance according to the selected arbitrary white balance mode. For example, in the example shown in FIG. 2, a broken line area 201 indicates a control amount when a light source having a relatively low color temperature of about 3000 K, such as a halogen bulb and an incandescent bulb, is an assumed light source, and the gain amount of B is high. , R gain amount is low. On the other hand, a dotted line area 202 indicates a control amount when a light source having a relatively high color temperature such as shade is about 10000 K is an assumed light source, and the gain amount of B is low and the gain amount of R is high.

  When auto control is performed, the detection unit 107 extracts only the color of the white extraction range from the image data, or obtains the average color of the entire surface and compares it with a reference value corresponding to white to obtain white. Calculate balance correction data. Here, the color of the white extraction range is a color corresponding to the achromatic color portion. Then, white balance control is automatically performed by correcting each RGB signal or RY / BY signal based on the calculated correction data.

  In the white set white balance, white balance correction data is calculated by capturing an image of a subject such as white paper or cloth, extracting color information from a predetermined area in the image data, and comparing it with a reference value corresponding to white. White balance control is performed by correcting each RGB signal or RY / BY signal based on the calculated correction data.

  Next, the focus operation will be described. During the focus operation, the user can instruct the system control unit 114 to focus using the focus operation unit 111. For example, a focus ring that can be rotated by a user is provided on the outer periphery of a lens barrel that houses the lens unit 101, and the focus position is instructed to the lens driving unit 112 by the user rotating the focus ring. At this time, the electronic or mechanical rotation detection mechanism detects the rotation direction and rotation angle of the focus ring, and notifies the system control unit 114 of it. Such electronic or mechanical rotation detection mechanisms are well known. The lens driving unit 112 moves the focus lens group in accordance with a control signal from the system control unit 114.

  Next, the operation of the color temperature estimation unit 115 will be described. In this embodiment, the color temperature estimation unit 115 determines whether the shooting location is indoors or outdoors from the brightness information (EV value) and the focus information, and estimates the color temperature based on this result. Do. When the shooting location is determined to be indoor, the color temperature is estimated to be 2500 [K] to 5000 [K], and when the shooting location is determined to be outdoor, the color temperature is estimated to be 5000 [K] to 14000 [K]. Focus position information is sent from the focus operation unit 111 to the color temperature estimation unit 115 through the system control unit 114. The color temperature estimation unit 115 receives aperture information from the aperture 102 through the system control unit 114, shutter information from the image sensor unit 103, and gain information from the CDS / AGC unit 104. Therefore, the color temperature estimation unit 115 can calculate an EV value that is brightness information using these pieces of information. The EV value indicates that the higher the value, the brighter the image.

  FIG. 3 is a diagram illustrating a criterion for determining the shooting location by the color temperature estimation unit 115 in the present embodiment. As shown in FIG. 3, based on the EV value and focus information, an area 301 that is determined to be taken indoors and an area 302 that is determined to be taken outdoor are provided. As shown in FIG. 3, the color temperature estimation unit 115 tends to determine that the shooting location is outdoors as the EV value is higher, that is, as the image is brighter. Also, as the focus is at infinity, that is, the distance to the subject is larger, it tends to be easier to determine that the shooting location is outdoors. In other words, the color temperature estimation unit 115 tends to determine that the shooting location is indoors as the darker image and the distance to the subject are smaller. In this embodiment, a threshold value is set for the relationship between the EV value and the focus information, and the region 301 and the region 302 are defined with the threshold value as a boundary. The color temperature estimation unit 115 thus performs indoor / outdoor determination and estimates the color temperature. The result of the estimated color temperature is sent to the white balance setting determination unit 116 through the system control unit 114. Note that the color temperature of the shooting scene may be estimated using any information that can be acquired by the digital video camera such as position information and face detection information indicated by GPS (Global Positioning System).

  Next, the operation of the white balance setting determination unit 116 in the present embodiment will be described. The white balance setting determination unit 116 receives the R and B gain information from the white balance control unit 106 through the system control unit 114 and the white balance mode information from the white balance mode selection UI unit 113. The white balance setting determination unit 116 is also supplied with the estimation result of the color temperature of the shooting scene estimated by the color temperature estimation unit 115 through the system control unit 114. The white balance setting determination unit 116 determines whether there is a difference between the color temperature estimated by the color temperature estimation unit 115 and the color temperature estimated from the white balance mode information.

  Here, the estimation of the color temperature from the information of the white balance mode will be described. The estimation of the color temperature from the white balance mode information is performed by, for example, the white balance setting determination unit 116 itself. Here, it is assumed that three types of preset white balance bulb, preset white balance shade, and white set white balance are set in the white balance mode. FIG. 4 is a flowchart showing an operation of estimating the color temperature by the white balance setting determination unit 116. FIG. 5 is a diagram showing the relationship between the amount of white balance gain and the light source.

  First, in step S401, the white balance setting determination unit 116 determines whether a preset white balance light bulb (preset WB light bulb) is selected. If the preset white balance bulb has not been selected, the process proceeds to step S402. If the preset white balance bulb has been selected, it is determined that the shooting location is indoors. In this case, the white balance setting determination unit 116 estimates the color temperature from 2500 [K] to 3500 [K].

  In step S402, the white balance setting determination unit 116 determines whether a preset white balance shade (preset WB shade) is selected. If the preset white balance shade is not selected, the process proceeds to step S403. If the preset white balance shade is selected, it is determined that the shooting location is outdoors. In this case, the white balance setting determination unit 116 estimates the color temperature from 8000 [K] to 14000 [K].

  Thus, in the preset white balance, since the assumed light source is clear, it is possible to estimate the shooting scene according to the selected white balance mode, and it is possible to estimate the color temperature.

  If the preset white balance shade is not selected in step S402, the white balance mode is white set white balance. In step S <b> 403, the white balance setting determination unit 116 determines whether the white balance gain amount is within the halogen lamp region (region A) 501. If it is not in the area A, the process proceeds to step S404. If it is in the area A, it is determined that the shooting location is under the halogen lamp light source. In this case, the white balance setting determination unit 116 estimates the color temperature from 2500 [K] to 3500 [K].

  In step S <b> 404, the white balance setting determination unit 116 determines whether the white balance gain amount is within the shaded area (area B) 502. If it is within the area B, it is determined to be shaded. In this case, the white balance setting determination unit 116 estimates the color temperature from 8000 [K] to 14000 [K].

  Thus, in the white set white balance, the color temperature of the light source can be estimated according to the gain amount of the white balance. If the white balance gain amount is not within the region B in step S404, it is determined that the photographic scene cannot be estimated from the white balance gain amount.

  In this way, the color temperature of the shooting scene is estimated from the state of white balance. The color temperature estimation may be performed by the color temperature estimation unit 115.

  The white balance setting determination unit 116 determines whether there is a difference between the color temperature estimated by the color temperature estimation unit 115 and the color temperature estimated from the white balance state. If there is a difference, the white balance setting determination unit 116 requests the camera signal processing unit 105 to change the camera signal processing through the system control unit 114. Upon receiving this request, the camera signal processing unit 105 changes the processing content of the image signal based on the determination result. That is, the camera signal processing unit 105 changes at least one content selected from the group consisting of brightness control, white balance control, color balance control, and noise reduction control of the image signal.

  Next, the operation of the camera signal processing unit 105 when changing the camera signal processing will be described. Here, as an example of the change in the camera signal processing, a change in the gain control range when the auto control is performed instead of fixing the preset white balance to a predetermined gain amount will be described.

  The automatic transition of the white balance may draw a predetermined color regardless of the user's intention to add the color filter effect with the white balance, so that the color filter effect may be reduced. Further, it is desirable that the color filter effect be constant, but the color tone of the image data may change due to auto transition, and the color filter effect may appear to change. FIG. 6 is a diagram illustrating a gain control range at the time of automatic control of the preset white balance bulb. The control range 601 is a gain control range at normal time (when there is no difference between the color temperature estimation result by the color temperature estimation unit 115 and the color temperature estimation result estimated from the white balance state). On the other hand, the control range 602 is a gain control range when there is a difference between the color temperature estimation result by the color temperature estimation unit 115 and the color temperature estimation result estimated from the white balance state. As shown in FIG. 6, in this embodiment, when there is a difference between the color temperature estimation result by the color temperature estimation unit 115 and the color temperature estimation result estimated from the white balance state, the gain control range To narrow. As a result, it is possible to reduce color pull-in and color variation associated with auto-transition, and it is possible to make it difficult to impair the color filter effect.

  As changes in camera signal processing, changes in white detection range in white balance control, changes in color correction for various light sources such as color correction for halogen lamps performed when selecting a preset white balance bulb, etc. Also good. In addition, when the target area of NR processing to be applied to human skin is set with hue and saturation, the hue and saturation of the target area to be subjected to NR processing are set in consideration of applying the color filter effect. It may be changed.

  Furthermore, in the present embodiment, it is preferable to adjust the range for changing the contents of the camera signal processing in accordance with the reliability of the estimation result of the color temperature estimation unit 115. FIG. 7 is a diagram illustrating the reliability of indoor / outdoor determination. As shown in FIG. 7, based on the EV value and focus information, an area 701 that is determined with high reliability that the image is taken indoors and an area 702 that is determined with low reliability that the image is taken indoors are provided. The sum of the area 701 and the area 702 corresponds to the determination reference area 301 shown in FIG. Similarly, based on the EV value and focus information, an area 704 that is determined with high reliability that the image is taken outdoors and an area 703 that is determined with low reliability that the image is taken outdoors are provided. The sum of the areas 703 and 704 corresponds to the determination reference area 302 shown in FIG. That is, in FIG. 7, an area 701 is an area having a low EV value, a focus that is close to the closeness, and a high reliability that the image is taken indoors. The region 702 is a region with such a low reliability. A region 704 is a region having a high EV value, a focus close to infinity, and a high reliability of being photographed outdoors. A region 703 is a region having such a low reliability. Then, the reliability is determined by weighting according to the estimation result of the color temperature estimation unit 115, that is, where the color temperature estimation unit 115 belongs to.

  FIG. 8 is a diagram illustrating a control range of the white balance gain amount according to the reliability when the preset white balance light bulb is selected.

  As shown in FIG. 8, three types of auto control ranges 801, 802, and 803 are set in the auto control range when the preset white balance light bulb is selected. The auto control range 801 is a control range at the normal time, that is, when the white balance setting determination unit 116 determines that there is no difference in color temperature. The auto control range 802 is a control range when it is determined with low reliability that the image is taken outdoors. The auto control range 803 is a control range when it is determined with high reliability that the image is taken outdoors. Then, the white balance control unit 106 appropriately changes the auto control range of the preset white balance bulb based on the reference shown in FIG. That is, the higher the reliability, the narrower the auto control range is adopted.

  Even when the preset white balance shade is selected, the control range of the white balance gain amount according to the reliability can be adjusted. In this case, the control range when the white balance setting determination unit 116 determines that there is no difference in color temperature, the control range when it is determined with high reliability that the image is taken indoors, and the low reliability when it is imaged indoors The control range in the case where the determination is made at is used.

  Further, the camera signal processing unit 105 may change the content of the image signal processing according to the reliability of the color temperature estimated from the white balance state. For example, the higher the reliability, the more the image signal may be processed in a narrow control range. In this case, for example, a relationship between the white balance gain and the reliability is obtained in advance, and the reliability is determined by weighting based on this relationship.

  In the present embodiment, the time variation of the control range between the display on the display device 109 such as a liquid crystal display panel before recording using the recording unit 110 and the recording using the recording unit 110 is performed. It is preferable that the ratios of these are different. FIG. 9 is a diagram illustrating the time characteristic of the auto control range when it is determined that white balance is used as the color filter effect. As shown in FIG. 9, the time characteristic 901 during non-recording (through) and the time characteristic 902 during recording are different. For example, the slope of the time characteristic 902 at the time of recording is set to ½ of the slope of the time characteristic 901 at the time of through. In this case, the transition to a predetermined auto control range 903 takes twice as long as the through time during recording. That is, the variable time constant is different between through and recording. This control is performed by the system control unit 114, for example. Further, the larger the auto control range 903, the wider the control range shown in FIG.

  By such control, it is possible to quickly confirm the color filter effect using the display device unit 109, and during recording using the recording unit 110, control of camera signal processing accompanying determination result transition accompanying scene change. Avoid extreme changes in change.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

  Each process of the present invention can also be realized by executing software (program) acquired via a network or various storage media by a processing device (CPU, processor) such as a personal computer.

  105: Camera signal processing unit 111: Focus operation unit 112: Lens drive unit 113: White balance mode selection UI unit 114: System control unit 115: Color temperature estimation unit 116: White balance setting determination unit

Claims (16)

An image sensor that converts an optical signal into an image signal of an electrical signal by photographing;
Signal processing means for processing the image signal, including white balance control means for adjusting a color signal included in the image signal output from the image sensor according to a gain of white balance;
Color temperature estimation means for estimating the color temperature of the scene where the shooting was performed;
A white balance setting determination unit that compares the color temperature estimated by the color temperature estimation unit and the color temperature estimated from the white balance state controlled by the white balance control unit to determine whether there is a difference;
Have
The image processing apparatus, wherein the signal processing unit changes a processing content of the image signal based on a determination result by the white balance setting determination unit.   When the white balance setting determination unit determines that there is no difference, the signal processing unit performs processing of the image signal in a wider control range than when the white balance setting determination unit determines that there is the difference. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized.   The imaging apparatus according to claim 1, wherein the color temperature estimation unit estimates the color temperature from focus information and brightness information at the time of shooting.   The color temperature estimation means estimates the color temperature higher as the focus information indicates that the distance to the subject is greater, and the color temperature as the brightness information indicates that the subject is brighter. The imaging apparatus according to claim 3, wherein the image pickup device is estimated to be high.   5. The signal processing unit according to claim 1, wherein the signal processing unit changes at least one content selected from the group consisting of brightness control, white balance control, color balance control, and noise reduction control of the image signal. The imaging device according to any one of the above.   The imaging apparatus according to claim 5, wherein the white balance control includes control of a white extraction range and a gain control range in auto white balance.   The image pickup apparatus according to claim 5, wherein the noise reduction control includes control of hue and saturation that are a target area of a noise reduction process applied to human skin.   The imaging apparatus according to claim 1, wherein the signal processing unit adjusts a range in which the content of the processing of the image signal is changed according to the reliability of estimation by the color temperature estimation unit.   9. The image pickup apparatus according to claim 8, wherein the reliability of estimation by the color temperature estimation unit is determined by weighting from focus information and brightness information at the time of shooting.   The image pickup apparatus according to claim 8, wherein the signal processing unit processes the image signal in a narrow control range as the reliability of the estimation by the color temperature estimation unit is higher.   8. The signal processing unit according to claim 1, wherein the signal processing unit adjusts a range in which the processing content of the image signal is changed in accordance with a reliability of a color temperature estimated from the white balance state. The imaging apparatus of Claim 1.   The image pickup apparatus according to claim 11, wherein the reliability of the color temperature estimated from the white balance state is determined by weighting from the white balance gain.   10. The imaging apparatus according to claim 8, wherein the signal processing unit processes the image signal in a narrow control range as the reliability of the color temperature estimated from the white balance state is higher. .   The imaging apparatus according to claim 1, wherein the signal processing unit changes a variable time constant between a through time and a recording time. An imaging step of converting an optical signal into an image signal of an electrical signal by photographing;
A signal processing step of processing the image signal, including a white balance control step of adjusting a color signal included in the image signal acquired in the imaging step according to a gain of white balance;
A color temperature estimation step for estimating the color temperature of the scene where the shooting was performed;
A white balance setting determination step of comparing the color temperature estimated in the color temperature estimation step with the color temperature estimated from the white balance state controlled in the white balance control step to determine whether there is a difference;
Have
The image processing method, wherein the signal processing step includes a step of changing a processing content of the image signal based on a determination result in the white balance setting determination step. On the computer,
An imaging step of converting an optical signal into an image signal of an electrical signal by photographing;
A signal processing step of processing the image signal, including a white balance control step of adjusting a color signal included in the image signal acquired in the imaging step according to a gain of white balance;
A color temperature estimation step for estimating the color temperature of the scene where the shooting was performed;
A white balance setting determination step of comparing the color temperature estimated in the color temperature estimation step with the color temperature estimated from the white balance state controlled in the white balance control step to determine whether there is a difference;
A program for executing
The program characterized in that the signal processing step includes a step of changing the processing content of the image signal based on a result of determination in the white balance setting determination step.

Images