JP2013153248A - Image pickup device, white balance control method, and white balance control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable photographing to be performed with appropriate AWB processing corresponding to a photographing environment.SOLUTION: When there is not sufficient valid data equal to or greater than a threshold as a result of determination in step S307, determination of whether a flag UF=1 is made (step S312). The flag UF indicates that when UF=1, it means through-image data taken in immediately before capture-image data was taken in in step S302 contains valid data equal to or greater than a threshold. Furthermore, the flag UF indicates that when UF=1, it means through R and B needed for controlling the WB of through-image data taken in immediately before capture-image data was taken in are stored in memory. Therefore, through R and B gains determined in AWB data analysis processing are converted into capture R and B gains (step S313). These converted capture R and B gains are used to adjust the R and B components of capture image data (step S309).

Description

  The present invention relates to an imaging apparatus, a white balance control method, and a white balance control program.

  In a camera device using a solid-state imaging device such as a CCD (Charge Coupled Device), the color temperature of the light source changes when the color temperature of the light source changes in order to make the white color of the imaging target an achromatic white color in the imaging result. An auto white balance (AWB) process is performed to automatically match white that appears to be colored in the imaging result in accordance with the change with achromatic white. At that time, a pull-in limit frame for limiting the range for white balance is set for each type of light source, and pixels of colors in this pull-in limit frame (for example, a color range determined to be gray under the light source) Is detected. If the number of detected pixels is equal to or greater than the threshold, the WB gain l [Cb integrated value and Cr integrated value corresponding to the determined light source is “0” (Cb = Cr = 0). The AWB process is executed according to the R component gain and the B component gain] (see, for example, Patent Document 1 below).

JP-A-11-136698

  As described above, in the related art, when the number of pixels detected in the pull-in restriction frame is equal to or larger than the threshold value, the AWB process is executed using the WB gain corresponding to the determined light source. Therefore, if the number of pixels detected in the pull-in limit frame is less than the threshold value or the pixel cannot be found, the AWB process cannot be executed.

  The present invention has been made in view of such a conventional problem. Even if the number of pixels detected in the pull-in restriction frame is less than a threshold value or the pixel cannot be found, the present invention is not limited to a shooting environment. An object of the present invention is to provide an imaging apparatus, a white balance control method, and a white balance control program that can perform imaging with appropriate AWB processing.

  In order to solve the above-described problems, the present invention provides an imaging unit that images a subject and sequentially outputs image data, and for adjusting white balance based on each image data sequentially output from the imaging unit. First generation means for generating a first white balance adjustment value, and display of an image by adjusting the white balance of the image data based on the first white balance adjustment value generated by the first generation means Responding to an imaging instruction during control by the first control means, first adjustment means for storing the first white balance adjustment value generated by the first generation means, A capturing unit that captures the image data output from the imaging unit, and the image data captured by the capturing unit generates a white balance adjustment value. First determination means for determining whether or not the image data is valid above, and an image captured by the capture means when the first determination means determines that the image data is valid A second generation unit that generates a second white balance adjustment value for adjusting white balance based on the data; and the adjustment value when the first determination unit determines that the image data is not valid. Acquisition means for acquiring the first white balance adjustment value stored in the storage means, second white balance adjustment value generated by the second generation means, and first acquired by the acquisition means Second control means for adjusting the white balance of the image data captured by the capturing means and using it for image recording based on the white balance adjustment value of And wherein the door.

  According to the present invention, when effective data cannot be obtained at the time of capture, white balance is controlled using data of a through image, so that it is possible to always perform appropriate AWB processing according to the shooting environment. .

It is a block block diagram of the electronic still camera which shows one embodiment of this invention. (A) is a gain table, (b) is a through detection frame table, (c) is a capture detection frame table, (d) is a through reference WB gain table, and (e) is a conceptual diagram showing a capture reference WB gain table. is there. It is a flowchart which shows the procedure of the process performed before shipment. It is a flowchart which shows the main routine in the REC mode of this Embodiment. It is a flowchart which shows the interrupt routine with respect to the main routine of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram when the present invention is applied to an electronic still camera.

  The CCD 25 disposed behind the lens 20 is driven by a timing signal generator 26 and a vertical driver 27. The CCD 25 is provided with a color filter array of primary colors R (red), G (green), and B (blue). The optical image formed on the light receiving surface of the CCD 25 is received by each of R, G, and B. The charge is accumulated in the unit, converted into R, G, and B signal charges corresponding to the intensity of light, and then output to the unit circuit 28 as an analog image signal. The unit circuit 28 includes a CDS that removes noise from the input imaging signal and an A / D converter that converts the imaging signal from which noise has been removed into digital image data. The image data output from the unit circuit 28 (RAW data) is temporarily stored in the buffer memory 28 ′, read out, and sent to the first and second gain adjustment circuits 21 and 22.

  The first and second gain adjustment circuits 21 and 22 include R amplifiers 21a and 22a, G amplifiers 21b and 22b, and B amplifiers 21c and 22c for each of R, G, and B color components, respectively. The gain of each amplifier 21a, 22a, 21b, 22b, 21c, 22c is controlled using the white balance adjustment value sent from the unit 35 as a control signal. The image signal amplified by the first gain adjustment circuit 21 is sent to the first color process circuit 23, where color process processing is performed, and then a digital luminance signal (Y signal) and a color difference signal (Cb signal, Cr). Signal) is written to the buffer of the DMA controller 29 as YUV data. At the same time, in the buffer, the DMA controller 29 transfers the YUV data written in the buffer to the designated area of the DRAM 30 and expands it.

  The video encoder 31 generates a video signal based on the YUV data read from the buffer and outputs it to a display device 32 comprising an LCD. Thereby, in the REC through mode in the imaging standby state in the REC mode (imaging mode), the captured subject image is displayed on the display device 32 as a through image.

  Further, at the time of a shooting instruction in the REC mode in which the shutter key is pressed, the image data read from the buffer memory 28 ′ is sent to the second gain adjustment circuit 22 and is taken in by an instruction from the control unit 35. The gain of the R and B components of the image data captured by the second gain adjustment circuit 22 is adjusted by the second gain adjustment circuit 22 controlled by the control unit 35.

  The image data in which the R and B gains are adjusted is sent to the second color process circuit 24, where color process processing is performed, and then a digital luminance signal (Y signal) and a color difference signal (Cb signal, Cr). Signal) is written to the buffer of the DMA controller 29 as YUV data. One frame worth of YUV data written in this buffer is sent to the compression / expansion unit 33, subjected to compression processing, and recorded in the flash memory 34. Thereby, the image data of the subject image in which the white balance is ensured can be recorded in the flash memory 34.

  The control unit 35 includes a CPU, a ROM in which programs and data are stored, and a working RAM. The control unit 35 controls the operation of each unit described above according to a predetermined program and corresponds to a status signal sent from the operation unit 36. Thus, each function of the electronic still camera, that is, automatic exposure control (AE) and auto white balance (AWB) is realized. The operation unit 36 is provided with various keys such as the shutter key and a key for switching between the REC through mode and the PLAY mode, and sends a state signal corresponding to the key operation to the control unit 35. The strobe 37 is driven as necessary when the shutter key is operated (during shooting) and emits auxiliary light.

  The control data storage unit 38 includes a gain table 381 shown in FIG. 2A, a through detection frame table 382 shown in FIG. 2B, a capture detection frame table 383 shown in FIG. 2C, and FIG. A through reference WB gain table 384 and a capture reference WB gain table 385 shown in FIG. The gain table 381 stores the through gain and capture gain of the R component and the B component for each type of light source “sunlight”, “fluorescent lamp”, and “bulb” measured as described later. The through gain and the capture gain are also an R gain value and a B gain value used for setting an appropriate white balance at the time of imaging under each light source.

  In the through detection frame table 382, a gray that is an area for detecting gray necessary for executing the AWB process when displaying a through image for each of the types of light sources “sunlight”, “fluorescent lamp”, and “bulb”. Data indicating the detection area frame is stored. In the capture detection frame table 383, for each of the types of light sources “sunlight”, “fluorescent lamp”, and “bulb”, a gray detection that is an area for detecting gray necessary for executing an AWB process when an image is recorded Data indicating the area frame is stored.

  In the through reference WB gain table 384, when the through data is displayed for each of the light source types “sunlight”, “fluorescent lamp”, and “bulb”, there is no valid data necessary for executing the AWB process exceeding the threshold value. The reference WB gain used in is stored as an R gain and a B gain. In the capture reference WB gain table 385, for each of the types of light sources “sunlight”, “fluorescent lamp”, and “bulb”, when the effective data necessary for executing the AWB process when recording an image is not equal to or greater than a threshold value, A reference WB gain to be used is stored as an R gain and a B gain.

  In the present embodiment having the above-described configuration, before the electronic still camera is manufactured and shipped from the factory to the market, the manufacturer's worker first turns the light source into the “sun” in the room where the luminance box is installed. "Light". Subsequently, when a predetermined operation is performed by the operation unit 36 and the pre-shipment processing mode is set, the control unit 35 executes the process shown in the flowchart of FIG. 3 in accordance with a program stored in advance in the ROM.

  That is, the photographing process is performed using the same photographing condition as that when setting the REC through mode in the imaging standby state (step S101). Further, the image data stored in the buffer memory 28 'by the through image photographing process is taken into the RAM of the control unit 35 (step S102).

  Next, when sunlight is selected by a predetermined key operation by the user (operator), a gray detection region frame of sunlight is selected (determined) (step S103). Thereafter, a pixel of a color in the selected (determined) gray detection area frame (retraction restriction frame) (for example, a color range determined to be gray under the light source) is detected, and the number of detected pixels is a threshold value. In the case of the above, the WB gain 1 based on the center of gravity (the integrated value of Cb and the integrated value of Cr in the gray detection area frame for sunlight of the image data stored in the RAM is “0”. R component gain and B component gain such that Cb = Cr = 0 is obtained (step S104). Further, the R gain and B gain acquired in step S104 are recorded in the “through gain (R, B)” column of the type of sunlight “sunlight” selected (determined) in step S103 of the gain table 381. (Step S105).

  Therefore, the “through gain (R, B)” reflecting the individual difference of the CCD 25 assembled in the electronic still camera and the individual difference of the electronic still camera is recorded by the above processing.

  Further, the control unit 35 performs the main photographing process using the photographing conditions for the main photographing that are different from the photographing conditions used in the above-described through image photographing processing, and thereby the image data stored in the buffer memory 28 'is obtained. The data is taken into the RAM of the control unit 35 (step S106). Next, pixels of the color in the “sunlight” gray detection area frame determined in step S103 are detected. If the number of detected pixels is equal to or greater than the threshold, WB based on the center of gravity is detected. Gain l (the accumulated value of Cb and the accumulated value of Cr in the gray detection area frame for sunlight of the image data stored in the RAM is “0” (Cb = Cr = 0), R component gain and B component gain) are acquired (step S107). Further, the R gain and the B gain acquired in step S107 are recorded in the “capture gain (R, B)” column of the light source type “sunlight” selected (determined) in step S103 of the gain table 381, respectively. (Step S108).

  Therefore, by the above processing, “capture gain (R, B)” reflecting individual differences of the CCD 25 assembled in the electronic still camera, and further, individual differences of the electronic still camera is recorded.

  Further, the above processing is also executed for “fluorescent lamp” and “bulb” by changing the light source. Thus, as illustrated in FIG. 2A, the gain table 381 stores through gain (R, B) and capture gain (R, B) reflecting individual differences of the electronic still camera for each light source. Will be.

  When the electronic still camera shipped after that is purchased by the user and the user sets the REC mode, the control unit 35 starts processing according to the flowchart shown in FIG. 4 and drives the CCD 25 by one frame (step S201). Next, image data composed of digital data for one frame stored in the buffer memory 28 'by this driving is taken into the RAM of the control unit 35 (step S202), and a light source is used using the image data stored in the RAM. Is determined (step S203). In other words, the gray detection area where the number of gray pixels in each gray detection area frame of the image data captured in the RAM is counted while sequentially switching the gray detection area frames such as sunlight, fluorescent light, light bulb, etc. A process of determining a frame and determining a light source corresponding to the gray area detection frame as a light source type is executed.

  Further, since the type of the light source up to the previous time is stored in the RAM in step S205 described later, it is determined whether or not the type of the light source has changed by comparing this with the determination light source determined this time (step S204). ). If the result of this determination is that the type of the determined light source has changed, the through light source flag SKF is set to SKF = 1, and the type of light source that has been changed this time is stored in the RAM (step S205).

  Next, AWB data analysis processing is executed (step S206). In the AWB process, data indicating a gray detection area frame corresponding to the type of light source determined in step S203 is read with reference to the through detection frame table 382 shown in FIG. Then, in the gray detection frame area indicated by this data, gray pixels are regarded as valid data, and the number of valid data in the image data acquired in step S202 is counted. Since the number of valid data has already been counted in order to determine the light source in step S203, the count here can be omitted by using the already acquired count number. In addition, the integrated value of Cb and the integrated value of Cr in the image data stored in the RAM in step S202 in the gray detection area frame corresponding to the type of light source determined in step S203 are “0” ( R component gain and B component gain (based on the detected barycenter of the pixel) such as Cb = Cr = 0 are determined. However, since the R component gain and the B component gain determined here are used only when it is determined that the valid data counted in step S207, which will be described later, is greater than or equal to the threshold value, the counted valid data is the threshold value. The R component gain and the B component gain may be determined only when it is determined that there is the above.

  Subsequently, it is determined whether or not the counted valid data is greater than or equal to a threshold (step S207). If the valid data is greater than or equal to the threshold, if the valid data flag UF = 0, the valid data flag UF is set to UF = 1 (step S208). Further, the through R gain and the through B gain determined by the AWB data analysis processing in step S206 are stored in the RAM (step S209). Here, if the through R gain and the through B gain are already stored in the RAM, they are updated (overwritten).

  Further, WB control is performed on image data for displaying a through image using the stored through R gain and through B gain (step S210). Further, display control is executed for causing the display device 32 to display an image based on the WB-controlled image data (step S211).

  That is, the image data output from the unit circuit 28 and stored in the buffer memory 28 ′ is used by the first gain adjustment circuit 21 to store the R amplifiers 21 a and B using the stored through R gain and through B gain. Amplified by the amplifier 21c. The image signal amplified by the first gain adjustment circuit 21 is sent to the first color process circuit 23, where color process processing is performed, and then a digital luminance signal (Y signal) and a color difference signal (Cb signal, The YUV data including the Cr signal is written to the buffer of the DMA controller 29.

  The video encoder 31 generates a video signal based on the YUV data read from the buffer and outputs it to the display device 32. Thus, in the REC through mode in the imaging standby state in the REC mode (imaging mode), the captured subject image is displayed as a through image on the display device 32 with an appropriate white balance.

  Thereafter, it is determined whether or not there is an instruction to change from the REC mode to another mode (step S212). If there is no instruction to change to another mode, the process from step S201 is repeated. If there is an instruction to change, the process according to this flow is terminated.

  On the other hand, if the result of determination in step S207 is that the valid data is not greater than or equal to the threshold, if the valid data flag UF = 1, the valid data flag UF is reset to UF = 0 (step S213). ), It is determined whether or not the through light source SKF = 1 (step S214). If SKF = 1, it means that the type of light source has changed as a result of the determination in step S204. In this case, the through reference R gain and the through reference B gain corresponding to the changed current light source are read from the through reference WB gain table 384 shown in FIG. 2D (step S215). In step S216, the through light source flag SKF is reset to SKF = 0, and then the processes in and after step S210 described above are executed using the through reference R gain and the through reference B gain read out in step S214.

  As a result of the determination in step S213, if the through light source flag SKF ≠ 1 (SKF = 0) and the type of the light source has not changed, the previous WB gain is held (step S217), and the above-mentioned The process after step S210 is executed. That is, since the previous through R and B gains are stored by the process in step S209 described above, the processes in and after step S210 are executed using the through R and B gains again.

  On the other hand, the control unit 35 executes the processing by interrupting the main routine shown in FIG. 4 at regular intervals according to the flowchart shown in FIG. That is, it is determined whether or not there has been a shooting instruction (step S301), and the system waits until there is a shooting instruction. When a shooting instruction is generated by the user operating the shutter key, the control unit 35 advances the processing from step S301 to step S302, and shooting processing using shooting conditions for main shooting different from shooting conditions for through images. The image data composed of the digital data output from the unit circuit 28 and stored in the buffer memory 28 'is taken into the RAM of the control unit 35 (step S302). Next, the light source type stored in the RAM in step S205 is fetched as the light source type at the time of the current capture (step S303).

  Further, since the light source type at the time of the previous capture is stored in the RAM in step S305, which will be described later, by comparing this with the light source type acquired in the step S303, the type of the light source between the previous time and the current time of capture. It is determined whether or not has changed (step S304). If the result of this determination is that the light source type has changed, the capture light source flag CKF is set to CKF = 1, and the light source type at the current capture is stored in the RAM instead of the light source type at the previous capture ( Step S305).

  Next, AWB data analysis processing is executed (step S306). In this AWB process, a gray detection area frame corresponding to the type of light source determined in step S203 of FIG. 4 and stored in the RAM with reference to the capture detection frame table 383 shown in FIG. Read data indicating. Then, in the gray detection frame area indicated by this data, gray pixels are regarded as valid data, and the number of valid data in the image data read in step S302 is counted. Further, the integrated value of Cb and the integrated value of Cr in the image data stored in the RAM in step S302 in the read gray detection area frame are “0” (Cb = Cr = 0). Determine R component gain and B component gain (based on the detected center of gravity of the pixel).

  Subsequently, it is determined whether or not the counted valid data is greater than or equal to a threshold value (step S307). If the valid data is greater than or equal to the threshold value, the capture R gain and capture B gain determined in the AWB data analysis process in step S306 are stored in the RAM (step S308). Here, if the capture R gain and the capture B gain are already stored in the RAM, they are updated (overwritten). Further, using the stored capture R gain and capture B gain, the second gain adjustment circuit 22 is controlled to adjust the gains of the R and B components of the captured image data (step S309).

  Thereafter, a recording process is executed (step S310). That is, by outputting the image data stored in the buffer memory 28 ′ to the second gain adjustment circuit 22, the image data adjusted for the R and B gains is sent to the second color process circuit 24, and the color data After performing the process processing, the data is written in the buffer of the DMA controller 29 as YUV data including a digital luminance signal (Y signal) and a color difference signal (Cb signal, Cr signal). The written YUV data for one frame is sent to the compression / decompression unit 33, subjected to compression processing, and recorded in the flash memory 34. Thereby, the image data of the subject image in which the white balance is ensured can be recorded in the flash memory 34. Thereafter, when the valid data flag UF = 1, the reset is performed to set UF = 0, and when the capture light source flag CKF = 1 is set, the reset is performed to set CKF = 0 (step S311).

  If the result of determination in step S307 is that the valid data is not greater than or equal to the threshold value, it is determined whether or not the valid data flag UF = 1 (step S312). This valid data flag UF is a flag that is set in step S208 in the above-described flowchart. In the gray detection frame area of the through image data that is captured immediately before capture image data is captured in step S302 due to UF = 1, Indicates that the valid data is equal to or greater than a threshold value. In the valid data flag UF, when UF = 1, a through R gain and a through B gain for WB control of through image data captured immediately before the capture image data is captured are stored in the RAM. It shows that.

  If UF = 1 as described above, the slew R gain and the slew B gain determined in the AWB data analysis process in step S206 and stored in the RAM in step S209 are converted into capture gains. (Step S313).

  That is, the relative relationship between the through gain and the capture gain of the electronic still camera according to the present embodiment is stored in the gain table 381 shown in FIG. If the light source determined in S203 is “bulb”, the converted value under the bulb is as follows.

In the “bulb” column of the gain table 381, (293,775) is stored as the through gain (R, B) and (282,791) is captured as the capture gain (R, B).
R gain conversion value = Through R gain x 282/293
B gain conversion value = Through B gain x 791/775
It becomes.

  In the present embodiment, the through gain (R, B) and the capture gain (R, B) for each light source type are stored in the gain table 381, but the through gain (R, B) for each light source type is stored. ) And the capture gain (R, B) may be stored. In this case, for example, an R gain ratio (282 / 293≈0.962) and an R gain ratio (791 / 775≈1.021) are stored in the “bulb” column of the gain table 381. In this case, the R and B gain converted values can be easily calculated by multiplying the capture gain (R, B) and the gain ratio (R, B) stored in the gain table 381.

  If the R gain converted value and the B gain converted value are calculated in this way, they are stored in the RAM as the capture R gain and the capture B gain used for the current capture, and the capture R converted in step S312. Using the gain and the capture B gain, the processes after step S309 described above are executed. That is, by using the capture R gain and the capture B gain, the second gain adjustment circuit 22 is controlled to adjust the gains of the R and B components of the captured image data (step S309).

  Thereafter, a recording process is executed (step S310). That is, by outputting the image data stored in the buffer memory 28 ′ to the second gain adjustment circuit 22, the image data adjusted for the R and B gains is sent to the second color process circuit 24, and the color data After performing the process processing, the data is written in the buffer of the DMA controller 29 as YUV data including a digital luminance signal (Y signal) and a color difference signal (Cb signal, Cr signal). The written YUV data for one frame is sent to the compression / decompression unit 33, subjected to compression processing, and recorded in the flash memory 34.

  (1) That is, when valid data cannot be obtained at the time of capture, in step S309, WB control is executed using a value obtained by converting the through R and B gains into the capture R and B gains. Since the through image in which the through R and B gains are calculated is data obtained at a time close to the photographing time, appropriate AWB processing according to the photographing environment can be performed.

  (2) In addition, in the present embodiment, the captured image data is WB controlled using the through R gain and the through B gain for WB control of the through image data captured immediately before the capture image data is captured. A capture R gain and a capture B gain are calculated, and the WB of the captured image using these is controlled. Accordingly, the through image data and the captured image data are image data having a minimum time difference in the electronic still camera at a very close point. Therefore, even when valid data cannot be obtained from the captured image data, the electronic still camera can perform the most appropriate AWB process according to the shooting environment.

  (3) The value used for the conversion is a value measured at the time of shipment of the electronic still camera. Therefore, the WB control can be performed by “capture (R, B)” reflecting the individual difference of the CCD 25 assembled in the electronic still camera, that is, the individual difference of the electronic still camera. Therefore, it is possible to record image data of a subject image in which white balance is ensured in consideration of individual differences.

  On the other hand, if the valid data flag UF ≠ 1 = 0 and the determination in step S312 is NO, whether or not the capture light source flag CKF = 1, that is, whether or not the light source has changed between the previous and current captures. Is determined (step S314). If CKF = 1, it means that the type of the light source has changed as a result of the determination in step S304. In this case, the capture reference R gain and the capture reference B gain corresponding to the changed current light source are read from the capture reference WB gain table 385 shown in FIG. The capture R gain and capture B gain to be used are stored in the RAM (step S315). Then, using the capture reference R gain and capture reference B gain read out in step S315, the processes in and after step S309 are executed. Note that, only when the determination in step S311 is NO, it is determined whether or not the light source has changed between the previous capture and the current capture. Therefore, if the determination in step S311 is NO, the processes in steps S303 to S305 are performed. You may make it perform.

  If the light source flag CKF ≠ 1 (CKF = 0) and the type of the light source has not changed as a result of the determination in step S314, the previous WB gain, that is, used in the previous capture, is stored in the RAM. The acquired capture R and B gains are acquired, and these are stored in the RAM as the capture R gain and capture B gain used for the current capture (step S316), and the processing after step S309 described above is executed.

Here, the previous WB gain includes the following.
(A) The capture R and B gains determined in the AWB data analysis process in step S306 and stored in step S308 when the valid data is equal to or greater than the threshold at the previous capture.
(B) Capture R and B gains converted using the R and B gains of the through image in step S312 when (A) was not possible at the previous capture.
(C) Reference capture R, B read and determined in accordance with the light source in step S315 when (A) is not possible and (B) is not executed at the previous capture. gain.
(D) Capture R and B gains used in the previous capture read from the RAM in step S317 when (A), (B), and (C) are not executed during the previous capture.

  Therefore, if not particularly limited, in step S317, any of the capture R and B gains in the above (A), (B), (C), and (D) is held, and the processing from step S309 onward is executed using this. Will be.

  In the present embodiment, the electronic still camera that records an image captured at that time when the shutter key is pressed in a state where a through image is displayed has been described. However, the present invention is not limited to the above-described camera. The present invention is not limited to this, and any device that performs automatic white balance control of an image to be captured can be applied.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these, The invention described in the claim and its equal range are included.

  The invention described in the claims of the present application will be added below.

<Claim 1>
Imaging means for imaging a subject and sequentially outputting image data;
First generation means for generating a first white balance adjustment value for adjusting white balance based on each image data sequentially output from the imaging means;
First control means for adjusting the white balance of the image data based on the first white balance adjustment value generated by the first generation means and providing the image for display;
Adjustment value storage means for storing the first white balance adjustment value generated by the first generation means;
In response to an imaging instruction during control by the first control unit, a capturing unit that captures image data output from the imaging unit;
First determination means for determining whether or not the image data captured by the capture means is image data effective in generating a white balance adjustment value;
When it is determined by the first determination means that the image data is valid, a second white balance adjustment value for adjusting white balance is generated based on the image data captured by the capture means. A second generating means;
An acquisition means for acquiring the first white balance adjustment value stored in the adjustment value storage means when the first determination means determines that the image data is not valid;
Based on the second white balance adjustment value generated by the second generation unit and the first white balance adjustment value acquired by the acquisition unit, the white balance of the image data captured by the capture unit is calculated. A second control means for adjusting and providing for image recording;
An imaging apparatus comprising:

<Claim 2>
The first determination means determines whether or not the valid data is equal to or greater than a threshold in a predetermined detection area in the image data captured by the capture means using a predetermined color component as valid data,

  The second generation unit adjusts a white balance based on the image data captured by the capture unit when the first determination unit determines that the valid data is greater than or equal to a threshold value. 2 white balance adjustment values are generated,

  The acquisition unit acquires the first white balance adjustment value stored in the adjustment value storage unit when the first determination unit determines that the valid data is not greater than or equal to a threshold value. The imaging apparatus according to claim 1.

<Claim 3>
Based on the image data output from the imaging means, comprising a determination means for determining the type of light source at the time of imaging,
The first determination unit determines whether or not the image data includes valid data that is equal to or greater than a threshold value within a detection region corresponding to a type of light source determined by the determination unit. The imaging device described.

<Claim 4>
The acquisition means is a first generation means that is generated by the first generation means based on the image data output from the imaging means immediately before the acquisition means takes in the image data, and is stored in the adjustment value storage means. The image pickup apparatus according to claim 1, wherein a white balance adjustment value of 1 is acquired.

<Claim 5>
Second determination means for determining whether or not the first white balance adjustment value can be generated by the first generation means;
If it is determined by the second determining means that the first white balance adjustment value cannot be generated, the first generating means generates the first white balance adjustment value and the adjustment value storing means. Prohibiting means for prohibiting storage of the first white balance adjustment value;
First white balance adjustment generated by the first generation unit and stored in the adjustment value storage unit based on the image data output from the imaging unit immediately before the capture unit captures the image data. A third determination means for determining whether or not there is a value;
The acquisition unit is conditioned on the condition that the third determination unit determines that there is a first white balance adjustment value stored in the adjustment value storage unit immediately before. The imaging apparatus according to claim 4, wherein:

<Claim 6>
First determination means for determining a type of a light source based on image data sequentially output from the imaging means;
Second determination means for determining whether the light source determined this time by the first determination means has changed from the light source determined last time;
Table means storing a white balance adjustment value as a reference for each type of light source,
In the case where it is determined that the first white balance adjustment value stored in the adjustment value storage unit is not immediately before by the third determination unit,
A first acquisition unit configured to acquire a white balance adjustment value corresponding to the light source determined by the first determination unit from the table unit when the second determination unit determines that the light source has changed;
A second acquisition unit configured to acquire a first white balance adjustment value stored in the adjustment value storage unit at the time when the second determination unit determines that the light source is not changed;
The imaging apparatus according to claim 5, further comprising:

<Claim 7>
7. The first determination unit according to claim 1, wherein a predetermined color component set for each light source is used as effective data, and it is determined whether or not the effective data is greater than or equal to a threshold value. Imaging device.

<Claim 8>
A photographing control unit that causes the imaging unit to perform a photographing process based on a first photographing condition and a photographing process based on a second photographing condition different from the first photographing condition;
The first generation means generates a first white balance adjustment value for adjusting a white balance based on each image data obtained by a shooting process based on the first shooting condition,
The capturing means captures image data obtained by a photographing process based on the second photographing condition,
Furthermore, a conversion means for converting the first white balance adjustment value acquired by the acquisition means into the second white balance adjustment value,
The second control means captures by the capture means based on the second white balance adjustment value generated by the second generation means and the second white balance adjustment value converted by the conversion means. The imaging apparatus according to claim 1, wherein the image data is adjusted for white balance and used for image recording.

<Claim 9>
The conversion means includes a relationship storage means for storing a relative relationship between the first white balance adjustment value and the second white balance adjustment value used when converting the first white balance adjustment value.
Calculating means for calculating a second white balance adjustment value corresponding to the first white balance adjustment value using a coefficient based on the relation stored in the relation storage means;
The imaging apparatus according to claim 8, further comprising:

<Claim 10>
The imaging control unit causes the imaging unit to sequentially perform imaging processing based on the first imaging condition and the second imaging condition for the predetermined subject before the imaging device is shipped. And second image data are sequentially output,
The relation storage means stores information based on a first white balance adjustment value generated based on the first image data and a second white balance adjustment value generated based on the second image data. The imaging device according to claim 9.

<Claim 11>
An imaging step of imaging a subject and sequentially outputting image data;
A first generation step of generating a first white balance adjustment value for adjusting white balance based on each image data sequentially output in the imaging step;
A first control step of adjusting the white balance of the image data based on the first white balance adjustment value generated in the first generation step and providing the image for display;
An adjustment value storage step for storing the first white balance adjustment value generated in the first generation step;
In response to an imaging instruction during control by the first control step, a capturing step for capturing the image data output in the imaging step;
A determination step for determining whether or not the image data captured in this capture step is effective image data for generating a white balance adjustment value;
When it is determined that the image data is valid in this determination step, a second white balance adjustment value for adjusting a white balance is generated based on the image data captured in the capture step. Generation step;
An acquisition step of acquiring the first white balance adjustment value stored in the adjustment value storage step when it is determined that the image data is not valid in the first determination step;
Based on the second white balance adjustment value generated in the second generation step and the first white balance adjustment value acquired in the acquisition step, the white balance of the image data acquired in the acquisition step is calculated. A second control step for adjusting and providing for image recording;
A white balance control method comprising:

<Claim 12>
A computer included in an apparatus including an imaging unit that images a subject and sequentially outputs image data,
First generation means for generating a first white balance adjustment value for adjusting white balance based on each image data sequentially output from the imaging means;
First control means for adjusting the white balance of the image data based on the first white balance adjustment value generated by the first generation means and providing the image for display;
Adjustment value storage means for storing the first white balance adjustment value generated by the first generation means;
In response to an imaging instruction during control by the first control unit, a capturing unit that captures image data output from the imaging unit;
First determination means for determining whether or not the image data captured by the capture means is image data effective in generating a white balance adjustment value;
When it is determined by the first determination means that the image data is valid, a second white balance adjustment value for adjusting white balance is generated based on the image data captured by the capture means. A second generating means;
An acquisition means for acquiring the first white balance adjustment value stored in the adjustment value storage means when the first determination means determines that the image data is not valid;
Based on the second white balance adjustment value generated by the second generation unit and the first white balance adjustment value acquired by the acquisition unit, the white balance of the image data captured by the capture unit is calculated. A second control means for adjusting and providing for image recording;
White balance control program characterized by functioning as

21 First gain adjustment circuit 22 Second gain adjustment circuit 23 First color process circuit 24 Second color process circuit 25 CCD
26 Timing signal generator 27 Vertical driver 28 Unit circuit 28 'Buffer memory 29 DMA controller 30 DRAM
31 Video encoder 32 Display device 33 Compression / decompression unit 34 Flash memory 35 Control unit 38 Control data storage unit 381 Gain table 382 Through detection frame table 383 Capture detection frame table 384 Through reference WB gain table 385 Capture reference WB gain table CKF Capture light source Flag SKF Through light source flag UF Valid data flag

Claims (12)

Imaging means for imaging a subject and sequentially outputting image data;
First generation means for generating a first white balance adjustment value for adjusting white balance based on each image data sequentially output from the imaging means;
First control means for adjusting the white balance of the image data based on the first white balance adjustment value generated by the first generation means and providing the image for display;
Adjustment value storage means for storing the first white balance adjustment value generated by the first generation means;
In response to an imaging instruction during control by the first control unit, a capturing unit that captures image data output from the imaging unit;
First determination means for determining whether or not the image data captured by the capture means is image data effective in generating a white balance adjustment value;
When it is determined by the first determination means that the image data is valid, a second white balance adjustment value for adjusting white balance is generated based on the image data captured by the capture means. A second generating means;
An acquisition means for acquiring the first white balance adjustment value stored in the adjustment value storage means when the first determination means determines that the image data is not valid;
Based on the second white balance adjustment value generated by the second generation unit and the first white balance adjustment value acquired by the acquisition unit, the white balance of the image data captured by the capture unit is calculated. A second control means for adjusting and providing for image recording;
An imaging apparatus comprising: The first determination means determines whether or not the valid data is equal to or greater than a threshold in a predetermined detection area in the image data captured by the capture means using a predetermined color component as valid data,
The second generation unit adjusts a white balance based on the image data captured by the capture unit when the first determination unit determines that the valid data is greater than or equal to a threshold value. 2 white balance adjustment values are generated,
The acquisition unit acquires the first white balance adjustment value stored in the adjustment value storage unit when the first determination unit determines that the valid data is not greater than or equal to a threshold value. The imaging apparatus according to claim 1. Based on the image data output from the imaging means, comprising a determination means for determining the type of light source at the time of imaging,
The first determination unit determines whether or not the image data includes valid data that is equal to or greater than a threshold value within a detection region corresponding to a type of light source determined by the determination unit. The imaging device described.   The acquisition means is a first generation means that is generated by the first generation means based on the image data output from the imaging means immediately before the acquisition means takes in the image data, and is stored in the adjustment value storage means. The image pickup apparatus according to claim 1, wherein a white balance adjustment value of 1 is acquired. Second determination means for determining whether or not the first white balance adjustment value can be generated by the first generation means;
If it is determined by the second determining means that the first white balance adjustment value cannot be generated, the first generating means generates the first white balance adjustment value and the adjustment value storing means. Prohibiting means for prohibiting storage of the first white balance adjustment value;
First white balance adjustment generated by the first generation unit and stored in the adjustment value storage unit based on the image data output from the imaging unit immediately before the capture unit captures the image data. A third determination means for determining whether or not there is a value;
The acquisition unit is conditioned on the condition that the third determination unit determines that there is a first white balance adjustment value stored in the adjustment value storage unit immediately before. The imaging apparatus according to claim 4, wherein: First determination means for determining a type of a light source based on image data sequentially output from the imaging means;
Second determination means for determining whether the light source determined this time by the first determination means has changed from the light source determined last time;
Table means storing a white balance adjustment value as a reference for each type of light source,
In the case where it is determined that the first white balance adjustment value stored in the adjustment value storage unit is not immediately before by the third determination unit,
A first acquisition unit configured to acquire a white balance adjustment value corresponding to the light source determined by the first determination unit from the table unit when the second determination unit determines that the light source has changed;
A second acquisition unit configured to acquire a first white balance adjustment value stored in the adjustment value storage unit at the time when the second determination unit determines that the light source is not changed;
The imaging apparatus according to claim 5, further comprising:   7. The first determination unit according to claim 1, wherein a predetermined color component set for each light source is used as effective data, and it is determined whether or not the effective data is greater than or equal to a threshold value. Imaging device. A photographing control unit that causes the imaging unit to perform a photographing process based on a first photographing condition and a photographing process based on a second photographing condition different from the first photographing condition;
The first generation means generates a first white balance adjustment value for adjusting a white balance based on each image data obtained by a shooting process based on the first shooting condition,
The capturing means captures image data obtained by a photographing process based on the second photographing condition,
Furthermore, a conversion means for converting the first white balance adjustment value acquired by the acquisition means into the second white balance adjustment value,
The second control means captures by the capture means based on the second white balance adjustment value generated by the second generation means and the second white balance adjustment value converted by the conversion means. The imaging apparatus according to claim 1, wherein the image data is adjusted for white balance and used for image recording. The conversion means includes a relationship storage means for storing a relative relationship between the first white balance adjustment value and the second white balance adjustment value used when converting the first white balance adjustment value.
Calculating means for calculating a second white balance adjustment value corresponding to the first white balance adjustment value using a coefficient based on the relation stored in the relation storage means;
The imaging apparatus according to claim 8, further comprising: The imaging control unit causes the imaging unit to sequentially perform imaging processing based on the first imaging condition and the second imaging condition for the predetermined subject before the imaging device is shipped. And second image data are sequentially output,
The relation storage means stores information based on a first white balance adjustment value generated based on the first image data and a second white balance adjustment value generated based on the second image data. The imaging device according to claim 9. An imaging step of imaging a subject and sequentially outputting image data;
A first generation step of generating a first white balance adjustment value for adjusting white balance based on each image data sequentially output in the imaging step;
A first control step of adjusting the white balance of the image data based on the first white balance adjustment value generated in the first generation step and providing the image for display;
An adjustment value storage step for storing the first white balance adjustment value generated in the first generation step;
In response to an imaging instruction during control by the first control step, a capturing step for capturing the image data output in the imaging step;
A determination step for determining whether or not the image data captured in this capture step is effective image data for generating a white balance adjustment value;
When it is determined that the image data is valid in this determination step, a second white balance adjustment value for adjusting a white balance is generated based on the image data captured in the capture step. Generation step;
An acquisition step of acquiring the first white balance adjustment value stored in the adjustment value storage step when it is determined that the image data is not valid in the first determination step;
Based on the second white balance adjustment value generated in the second generation step and the first white balance adjustment value acquired in the acquisition step, the white balance of the image data acquired in the acquisition step is calculated. A second control step for adjusting and providing for image recording;
A white balance control method comprising: A computer included in an apparatus including an imaging unit that images a subject and sequentially outputs image data,
First generation means for generating a first white balance adjustment value for adjusting white balance based on each image data sequentially output from the imaging means;
First control means for adjusting the white balance of the image data based on the first white balance adjustment value generated by the first generation means and providing the image for display;
Adjustment value storage means for storing the first white balance adjustment value generated by the first generation means;
In response to an imaging instruction during control by the first control unit, a capturing unit that captures image data output from the imaging unit;
First determination means for determining whether or not the image data captured by the capture means is image data effective in generating a white balance adjustment value;
When it is determined by the first determination means that the image data is valid, a second white balance adjustment value for adjusting white balance is generated based on the image data captured by the capture means. A second generating means;
An acquisition means for acquiring the first white balance adjustment value stored in the adjustment value storage means when the first determination means determines that the image data is not valid;
Based on the second white balance adjustment value generated by the second generation unit and the first white balance adjustment value acquired by the acquisition unit, the white balance of the image data captured by the capture unit is calculated. A second control means for adjusting and providing for image recording;
White balance control program characterized by functioning as

Images