JP4852490B2 - Imaging apparatus and post-view image generation method thereof - Google Patents

Description

  The present invention relates to an imaging device including a display unit that displays image data captured by a solid-state imaging device, and more particularly, to an imaging device that displays captured image data on a display unit immediately after imaging a subject and generation of a postview image thereof Regarding the method.

  The imaging apparatus captures a subject image and then displays the captured image data on a liquid crystal display unit or the like without delay so that a user can check the function (hereinafter referred to as “post view function” or “rec view function”). Is called post-view function.)

  When the captured image data is displayed on the display unit using the post-view function, the resolution of the display image is not particularly limited because the number of pixels of the display unit and the like is small. Therefore, display image data is generated by thinning out image data obtained by actual imaging.

  However, in recent years, the number of pixels of a solid-state image sensor has become more than several million pixels, and it takes time to generate data for generating post-view display image data, making it difficult to display immediately after shooting. It has become to.

  In addition, when the number of pixels of the solid-state image sensor increases, the image data is often read out from the solid-state image sensor in a multi-field. In this case, R (red) and G (green) necessary for color image generation are required. ) And B (blue), it takes time to read out the image data of three colors, which is also a factor that makes it difficult to display the postview immediately after shooting.

  Note that the following patent documents 1, 2, 3 and the like are known as related arts regarding the post-view function.

JP 2003-60968 A JP 2004-129242 A JP 2004-241813 A

  When shooting a subject with an imaging device, check the post-view image immediately to see if it is beautifully taken, not blurred, or in focus. There is a high demand from users who want to photograph a subject.

  However, as described above, as the number of pixels of the solid-state imaging device increases, it takes time to generate image data for postview, and it becomes difficult to display a postview image immediately after shooting.

  An object of the present invention is to provide a post-view image generation method capable of reducing the time for generating image data for post-view, and an imaging device equipped with an execution function of the image generation method.

The imaging device and the post-view image generation method thereof according to the present invention are arranged in a two-dimensional array, transparent filters are stacked on half of the pixels provided at periodic positions, and red, green, and blue are applied to the remaining half of the pixels. A color filter of any one of the three colors is stacked, image data captured by each pixel is read out in at least two fields , and the three color colors are read out based on the image data read out in the two fields. The image data is prepared in the form of a solid-state image sensor having a color filter array in which any one of the three colors is missing as the image data read out in each of the two fields. When an object is imaged by an element, an image pickup apparatus that displays an image in a color of the object as a post-view image immediately after the image pickup, and its post-view A chromatography image generation method, when generating the post-view image from the image data read out in one field of the two fields, one color for the missing of the image data read out by said one field The post-view image is estimated based on the image data of the remaining two colors read out in the one field of the three colors and the image data read out from the pixel on which the transparent filter is laminated. Is generated .

The imaging apparatus and the post-view image generation method thereof according to the present invention are characterized in that a readout field of image data for generating the post-view image is selected from the two fields according to a color temperature of the imaging color of the subject. .

In the imaging apparatus and the post-view image generation method of the present invention, the image data for generating the post-view image is read out from the image data in the other field preceding the readout field, and the white balance correction coefficient is calculated from the image data in the other field. The white balance correction of the post-view image is performed using the white balance correction coefficient .

In the imaging apparatus and the post-view image generation method of the present invention, when the imaging color temperature of the subject is higher than a predetermined temperature, the post-view is based on read data of a field including color data of a pixel on which the red color filter is stacked. An image is generated, and when the imaging color temperature of the subject is lower than a predetermined temperature, the post-view image is generated from read data of a field including color data of a pixel on which the blue color filter is laminated. .

The image pickup apparatus and the post-view image generation method thereof according to the present invention provide data read from a field different from a field including color data of a pixel on which the red color filter is laminated when the image pickup color temperature of the subject is higher than a predetermined temperature. When the imaging color temperature of the subject is lower than a predetermined temperature, the white balance correction coefficient is calculated based on data read from a field different from the field including the color data of the pixel on which the blue color filter is stacked. And the post-view image is corrected by the calculated white balance correction coefficient .

In the imaging device and the post-view image generation method thereof according to the present invention, one pixel row of the odd-numbered row or the even-numbered row of the solid-state imaging device is arranged with a shift of ½ pixel pitch with respect to the other pixel row. Alternatively, the transparent filter is stacked on each pixel of one pixel row of the even rows, and three color filters are Bayer arranged on each pixel of the other pixel row of the odd rows or even rows, and the captured image is taken from each pixel. When reading data, each pixel is divided into adjacent two odd-numbered and even-numbered pixel rows, and the pixel row in which the transparent filter is laminated, and the green color filter and the blue color filter are alternately arranged for each pixel. A field for reading a pixel row stacked on the pixel, a pixel row on which the transparent filter is stacked, and a pixel row in which a red color filter and a green color filter are alternately stacked for each pixel. A field to be read out, characterized in that provided alternately.

In the imaging apparatus and the post-view image generation method thereof according to the present invention, each pixel of the solid-state imaging device is arranged in a square lattice, and the transparent filter is stacked on the pixel arranged at the checkered position among the pixels of the square lattice arrangement. In addition, color filters of three colors of red, green, and blue are stacked on each pixel at the remaining checkered positions, and fields for reading out odd-numbered pixel rows and fields for reading out even-numbered pixel rows are alternately provided. Features.

In the imaging apparatus and the post-view image generation method thereof according to the present invention, each pixel of the solid-state imaging device is arranged in a square lattice, and the transparent filter is stacked on each pixel of one of the odd-numbered or even-numbered columns, Alternatively, red, green, and blue color filters are stacked on each pixel in the other pixel column, and fields for reading out odd-numbered pixel rows and fields for reading out even-numbered pixel rows are alternately provided. characterized in that was.

  According to the present invention, since a post-view image can be generated at high speed even when a subject image is captured by a solid-state imaging device having a large number of pixels, the post-view image can be displayed on the display unit immediately after imaging. It becomes.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a functional block configuration diagram of an imaging apparatus (an example shown is a digital camera) according to an embodiment of the present invention. This imaging apparatus includes a CCD type or CMOS type solid-state imaging device 1 and an analog front end (AFE) that performs correlated double sampling (CDS) processing, gain control processing, analog-digital conversion processing, and the like on output data of the solid-state imaging device 1. ) A circuit 2, a control unit (CPU) 3 that performs overall control of the entire imaging apparatus, and a timing generator 4 that generates a timing signal for controlling the imaging device 1 and the AFE circuit 2 according to an instruction from the control unit 3.

  The imaging apparatus further includes an image processing unit 5 that performs image processing on digital captured image data output from the AFE circuit 2 and post-view data processing by performing simple image processing on the digital captured image data output from the AFE circuit 2. A post-view data dedicated processing unit (post-view image generation processing unit) 6 that performs the processing, a main memory (frame memory) 7 that temporarily stores digital captured image data output from the AFE circuit 2, and an image processing unit 5 JPEG conversion processing unit 10 that converts image data composed of luminance (Y) and color difference (C) into JPEG image data and saves it on recording medium 9 through IF unit 8, and a post-view data dedicated processing unit attached to the back of the camera, etc. The liquid crystal display unit 11 that displays the post-view image generated by 6 and the control unit 4 are connected to each other. And a scan 12.

  An operation unit 13 for inputting an instruction from a user is connected to the control unit (CPU) 4. The operation unit 13 includes a two-stage shutter button used to capture a still image with a camera.

  The image processing unit 5 is equipped with an image processing function that constitutes a known recording processing system in the imaging apparatus, and is a main memory 7 that temporarily stores all of the captured image data of the image sensor 1 output from the AFE circuit 2. A white balance (WB) correction processing unit 51 that takes in accumulated data and performs white balance correction processing, a matrix (MTX) calculation processing unit 52 that performs matrix calculation processing such as interpolation processing and square conversion, and gamma conversion processing A gamma (γ) conversion processing unit 53 and a YC conversion processing unit 54 that converts R (red), G (green), and B (blue) image data into luminance (Y) color difference (C) signals.

  The post-view data dedicated processing unit 6 includes processing units 61, 62, 63, and 64 for generating a post-view image. These processing units directly capture a part of data output from the AFE circuit 2 from the AFE circuit 2 and perform a matrix (MTX) calculation processing unit 61 that performs matrix calculation processing, which will be described in detail later, and calculations performed by the MTX calculation processing unit 61. A white balance (WB) correction processing unit 62 that captures processing results and performs white balance correction processing, a gamma (γ) conversion processing unit 63 that captures processing results of the WB correction processing unit 62 and performs gamma conversion processing, and γ conversion The processing unit 63 includes a YC conversion processing unit 64 that takes in the processing result, converts it into luminance (Y) color difference (C) data, outputs it to the bus 12 and displays it on the display unit 11.

  The image processing unit 5 and the postview data dedicated processing unit 6 are configured by a digital signal processor (DSP). A separate DSP may be prepared for each processing unit, or both processing units 5 and 6 may be realized by sharing one DSP.

  FIG. 2 is a schematic view of the surface of the CCD solid-state imaging device 1 used in the present embodiment. A plurality of photoelectric conversion elements (photodiodes PD: hereinafter referred to as pixels) 21 are arranged and formed in a two-dimensional array on the surface portion of the semiconductor substrate.

  The solid-state imaging device 1 according to the present embodiment has a so-called honeycomb pixel arrangement in which even-numbered pixel rows are shifted by 1/2 pixel pitch with respect to odd-numbered pixel rows. Transparent pixels for luminance detection (indicated as “W” indicating white in FIG. 2) are stacked on the pixels 21 in the odd rows (or even rows), and the pixels in the even rows (or odd rows) are colored. Filters are stacked.

  As the color filters, three primary colors red (R), green (G), and blue (B) are prepared, and when only the color filter stacked pixels are viewed, the color filters are arranged in a Bayer array.

  The solid-state imaging device 1 having such a configuration is provided with high-sensitivity W pixels that allow all incident light to enter the pixels, and the number of W pixels is not increased so much, but only the same number as the color filter pixels. There is an advantage that the S / N ratio can be increased while keeping the color resolution at a relatively high level. Further, the maximum resolution for the gray signal is the resolution corresponding to the total number of W pixels and color pixels.

  A vertical charge transfer path (VCCD) 22 for transferring a signal charge read from each pixel is arranged to meander in the vertical direction along each pixel column, and along the transfer direction end of each vertical charge transfer path 22. A horizontal charge transfer path (HCCD) 23 is provided, and an amplifier 24 is provided at the output end of the horizontal charge transfer path 23 to output a voltage value signal corresponding to the transferred charge amount as captured image data. It has been.

  From the solid-state imaging device 1 shown in FIG. 2, captured image data is read out in two fields. In the first field, in the example shown in the figure, each captured image data of the W pixel row and the RG pixel row immediately below the W pixel row is transferred to the horizontal charge transfer path 23, and the horizontal charge transfer path 23 receives the signal charges aligned with WRWGWRWG. Transfer and output from the amplifier 24.

  In the second field, each imaged image data of the W pixel row and the GB pixel row immediately below it is transferred to the horizontal charge transfer path 23. The horizontal charge transfer path 23 transfers signal charges aligned with WGWBWGWB. Output from.

  The image processing unit 5 shown in FIG. 1 performs image processing on the image data read in the first field and the second field, and generates one piece of still image data by performing field synthesis.

  However, if a postview image is generated from a single piece of still image data obtained by field synthesis, the display of the postview image is delayed because the number of signals to be processed is enormous. Therefore, in this embodiment, a post-view image is generated based on the image data read in the first field or the second field, and the post-view image can be displayed immediately after shooting.

  FIG. 3 is a flowchart showing an imaging process procedure performed by the imaging apparatus shown in FIG. First, it waits for whether or not the two-stage shutter button is half-pressed (switch S1 is turned on) (step S1). If half-pressed, the image sensor 1 performs automatic exposure (next exposure) in the next step S2. AE), and thinning-out reading of image data is performed in order to obtain data necessary for focus alignment (AF). Based on this data, the exposure amount is determined (step S3) and the photographing lens is focused (step S4).

  Next, it is determined whether or not the two-stage shutter has been fully pressed (switch S2 is turned on) (step S5). If not, the process returns to step S2 to acquire data for AE and AF, respectively. Is repeated, and if it is fully pressed, the process proceeds to the next step S6.

  In step S6, the image data obtained in step S2 when the two-stage shutter is fully pressed is analyzed to obtain a rough auto white balance correction coefficient, and further, it is determined whether or not the imaging color temperature of the subject is higher than 5000K. (Step S7).

  When the color temperature is lower than 5000K (determination result is NO), the second field shown in FIG. 2 is read first (step S10), and then the first field is read (step S11). If it is higher than 5000K (determination result is affirmative YES), the first field shown in FIG. 2 is read first (step S8) and then the second field is read (step S9).

  After reading out the image data of the first field and the second field, in step S12, the image processing unit 5 combines the image data of the first field and the image data of the second field, and further performs known image processing. . For example, since the pixel position of the image data obtained from the image sensor 1 is a honeycomb position, that is, a checkered position as shown in FIG. 2, data at a position where there is no pixel data is interpolated by matrix calculation processing or the like, Calculation processing for obtaining color data of three colors of RGB is performed. Also performs gamma conversion processing and the like. Then, the generated single still image data is recorded on the recording medium 9, and this process ends.

  When the image data of the first field or the second field is read from the image sensor 1 in step S8 or step S10, the postview data dedicated processing unit 6 receives this image data in parallel with the image processing unit 5, and the image processing unit In addition to the image processing of 5, post-view processing (step S15) is performed.

  The post-view process includes a post-view image generation process (step S15a) and a process step S15b for displaying the generated post-view image on the display unit 11.

  Hereinafter, the post-view image data generation process (step S15a) will be described. The image data received by the postview data processing unit 6 is data of only the first field or only the second field.

  The first field image data does not include blue (B) image data, and the second field image data does not include red (R) image data.

  Therefore, in the post-view data generation process, a simple process for generating image data of colors not included is performed. Since the imaging device of this embodiment has W pixels, the detection signal of the remaining one color pixel is calculated from the detection signal of the W pixel and the detection signals of the other two color pixels.

  That is, RGB image data of three colors is generated by performing the following matrix calculation processing on the first field image data composed of the W signal, R signal, and G signal. Alternatively, the RGB three-color image data is generated by subjecting the second field image data composed of the W signal, the G signal, and the B signal to the matrix calculation processing of Formula 2.

  Then, the image data of these three colors is thinned out so as to match the number of pixels of the display unit 11, white balance correction is performed using the rough auto white balance correction coefficient obtained in step S6, and further gamma conversion is performed to obtain luminance data. Post-view image data composed of (Y) and color difference data (C) is generated.

  The overall processing procedure shown in FIG. 3 is “exposure control” → “first (second) field readout” → “second (first) field readout” → “development of image data to the memory 7” → “Signal processing by the image processing unit 5” is the basis, and the post-view processing starts after receiving the read data after starting the first (second) field reading. For this reason, it is possible to speed up post-view display. This post-view processing is preferably performed for sequential processing without receiving the image data when the image data is read from the image sensor 1 and developing the image data in the memory.

  In the embodiment shown in FIG. 3, the color temperature is determined in step S7, and the reading order of the first field and the second field is controlled based on the color temperature. However, the first field is read first and the first field is read first. It is also possible to generate a postview image and vice versa.

  However, in this embodiment, a field for generating a postview image is selected according to the color temperature. The reason is that as the matrix coefficient is larger, the S / N after processing is deteriorated. Therefore, the first readout field used for the post-view image is switched according to the color temperature to improve the image quality of the post-view image.

  When the color temperature is low, the blue (B) signal is small, so a post-view image is generated from the second field for reading G / B / W so that the S / N of the B signal does not deteriorate. On the other hand, when the color temperature is high, the R signal is small, so that a post-view image is generated from the first field for reading R / G / W so that the S / N of the R signal does not deteriorate.

  In the embodiment described with reference to FIG. 3, the correction coefficient calculated in step S6 is used for the white balance of the post-view image. In the CCD type solid-state imaging device, the voltage applied to the imaging device substrate when acquiring data for AE (step S3) and AF (step S4) is different from the voltage applied when actually capturing a still image. . For this reason, the coarse white balance correction coefficient calculated in step S6 may be different from the actual highly accurate white balance correction coefficient, which may degrade the image quality of the post-view image.

  FIG. 4 is a flowchart illustrating a processing procedure according to the embodiment in which the white balance correction accuracy of the post-view image is improved. The processing up to step S7 shown in FIG. 3 and the processing after step 12 are the same as those in the embodiment of FIG.

  In the present embodiment, when the color temperature is lower than 5000K (determination result is NO), the image data of the first field is read prior to the reading of the second field image data used for the postview image generation (step S10). Reading is performed (step S23). Then, a highly accurate white balance correction coefficient is obtained based on the image data W (= R + G + B), R, and G of the first field (step S24).

  Note that R and G data may be extracted from the image data of the first field, and B data may be extracted from the image data of the second field read in the next step S10 to obtain the white balance correction coefficient. . The same applies to the following.

  When the color temperature is higher than 5000 K (the determination result is YES), the image data of the second field is read (step S8) prior to the reading of the first field image data used for generating the postview image (step S8). S21). Then, based on the second field image data W (= R + G + B), G, B, a highly accurate white balance correction coefficient is obtained (step S22).

  After the first field reading is started in step S8 or the second field reading is started in step S10, post-view image data generation processing is obtained in steps S22 and S24 in parallel with the respective reading processing. Each time the post-view processing unit 6 directly receives image data from the AFE circuit 2 of FIG.

  In this embodiment, the post-view image generation process is delayed by the amount of data read out by one field as compared with the embodiment of FIG. 3, but the post-view image generation process is delayed by using a highly accurate white balance correction coefficient obtained from the image data of another field. Since the white balance of the view image can be corrected, highly accurate color reproduction can be performed.

  FIG. 5 is a schematic view of the surface of a CCD solid-state imaging device used in another embodiment of the present invention. In the solid-state imaging device 30, pixels 21 are arranged in a square lattice, and a W filter is arranged at a checkered position. In addition, R, G, and B color filters are arranged at the remaining checkered positions. For example, an array of filters called WGWGWG is stacked in odd-numbered pixel rows, and a sequence of BWRWBWRW... And RWBWRWBW... Are alternately stacked in even-numbered pixel rows.

  In such a solid-state imaging device, if the field from which image data is read from the pixel rows arranged in the order of BWRW ... or RWBW ... is a first field, and the field from which image data is read from the pixel row, called WGWG, is the second field. If the image data is acquired, it is possible to obtain RGB three-color data from the image data WRB by performing the matrix operation shown in the following equation (3).

  In this case, step S7 in FIG. 3 is deleted, the first field is always read regardless of the color temperature, and a postview image is generated from the data in the first field.

  FIG. 6 is a schematic view of the surface of a CCD solid-state imaging device according to still another embodiment of the present invention. In the CCD type solid-state imaging device of FIG. 6, a plurality of pixels 21 are arranged in a square lattice pattern, and W pixels are arranged in a checkered pattern. In the horizontal direction, rows having a filter array of “RWGWRWGW...” And rows having a filter array of “WGWBWGWB. In the solid-state imaging device having such a filter array, the same row as the above embodiment can be performed by setting the array row of “RWGWWRGW” as the first field and the array row of “WGWBWGWB” as the second field. .

  FIG. 7 is a schematic view of the surface of a CCD solid-state imaging device according to still another embodiment of the present invention. In the CCD type solid-state imaging device of FIG. 7, a plurality of pixels 21 are arranged in a square lattice pattern, and W pixel columns are provided in every other column. In the horizontal direction, rows having a filter array “GWWBWGWBW” and rows having a filter array “RWGWWRGW” are alternately provided. In the solid-state imaging device having such a filter array, the same row as the above embodiment can be performed by setting the array row of “RWGWWRGW” as the first field and the array row of “GWWBWGWBW” as the second field. .

  Since the post-view data processing method according to the present invention can display a post-view image at high speed, it is useful when applied to a digital still camera or the like.

It is a functional block diagram of the imaging device concerning one embodiment of the present invention. It is a surface schematic diagram of the solid-state image sensor shown in FIG. 3 is a flowchart illustrating an imaging process procedure performed by the imaging apparatus illustrated in FIG. 1. It is a flowchart of the imaging process procedure which concerns on embodiment replaced with FIG. It is a surface schematic diagram of the solid-state image sensor to which another embodiment of the present invention is applied. It is the surface schematic diagram of the solid-state image sensor to which another embodiment of this invention is applied. It is the surface schematic diagram of the solid-state image sensor to which another embodiment of this invention is applied.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,30 Solid-state image sensor 3 Control part 5 Image processing part 6 Post view data exclusive processing part 7 Main memory 11 Display part 21 Pixel 22 Vertical charge transfer path (VCCD)
23 Horizontal charge transfer path (HCCD)
24 Output amplifier R Red filter G Green filter B Blue filter W Luminance filter (transparent filter)

Claims (16)

A transparent filter is stacked on half of the pixels arranged in a two-dimensional array, and the color filter of any one of three colors of red, green, and blue is placed on the remaining half of the pixels. The image data that are stacked and imaged by each of the pixels are read out in at least two fields, and the image data of the three colors are aligned by the image data read out in the two fields, and each of the fields of the two fields is arranged. The image data to be read is a solid-state image sensor having a color filter array in which any one of the three colors is missing , and
When a subject is imaged by the solid-state imaging device, a captured image with the color of the subject is displayed immediately after the imaging (hereinafter, this display is referred to as a postview, and the displayed image is referred to as a postview image). and,
When generating the postview image from the image data read out in one of the two fields, the missing one-color image data out of the image data read out in the one field is changed to the three colors. A post-view image generation unit that estimates the post-view image based on the remaining two-color image data read out in the one field and the image data read out from the pixel on which the transparent filter is stacked. An imaging apparatus comprising: The imaging apparatus according to claim 1, wherein the post-view image generation unit selects a readout field of image data for generating the post-view image from the two fields, based on a color temperature of the imaging color of the subject. An imaging apparatus characterized by: The imaging apparatus according to claim 1 or 2, wherein the post-view image generation unit reads image data of another field in advance of a read field of image data for generating the post-view image, and the other An imaging apparatus , wherein a white balance correction coefficient is obtained from field image data, and the white balance correction of the postview image is performed using the white balance correction coefficient . 4. The imaging device according to claim 1, wherein the post-view image generation unit is configured to stack the red color filter when an imaging color temperature of the subject is higher than a predetermined temperature. The post-view image is generated based on the readout data of the field including the color data of the pixel, and when the imaging color temperature of the subject is lower than a predetermined temperature, the field of the field including the color data of the pixel on which the blue color filter is laminated An image pickup apparatus that generates the post-view image based on read data . 5. The imaging device according to claim 4, wherein the post-view image generation unit includes a field including color data of a pixel on which the red color filter is stacked when an imaging color temperature of the subject is higher than a predetermined temperature. A white balance correction coefficient is calculated from data read from a different field, and when the imaging color temperature of the subject is lower than a predetermined temperature, the white balance correction coefficient is read from a field different from the field containing the color data of the pixel on which the blue color filter is stacked. An imaging apparatus, wherein a white balance correction coefficient is calculated from data, and the postview image is corrected using the calculated white balance correction coefficient . 6. The imaging device according to claim 1, wherein one pixel row of the odd-numbered row or the even-numbered row of the solid-state imaging element is ½ pixel pitch with respect to the other pixel row. The transparent filters are stacked on each pixel in one of the odd-numbered or even-numbered pixel rows, and three color filters are arranged in a Bayer array in each pixel in the other odd-numbered or even-numbered pixel row. When the captured image data is read out from each pixel, each pixel is divided into two adjacent pixel rows, odd and even rows, and the pixel row in which the transparent filter is stacked, the green color filter, and the blue color A field for reading a pixel row in which a filter is alternately stacked for each pixel, a pixel row in which the transparent filter is stacked, a red color filter, and a green color filter are alternately stacked for each pixel. Imaging device provided alternately and field reading of pixel rows. 6. The imaging device according to claim 1, wherein the pixels of the solid-state imaging device are arranged in a square lattice, and pixels arranged at checkered positions among the pixels of the square lattice arrangement. The transparent filter is stacked, and the color filters of three colors of red, green, and blue are stacked on the remaining pixels at the checkered position, and a field for reading the odd-numbered pixel rows and a field for reading the even-numbered pixel rows are provided. Imaging devices provided alternately . 6. The imaging device according to claim 1, wherein each pixel of the solid-state imaging device is arranged in a square lattice, and the transparent pixel is disposed in each pixel of one of the odd-numbered or even-numbered pixel columns. Filters are stacked, and color filters of red, green, and blue are stacked on each pixel in the other pixel column of the odd column or the even column, and the field for reading the pixel row of the odd row and the pixel row of the even row are read. An imaging device provided with fields alternately . A transparent filter is stacked on half of the pixels arranged in a two-dimensional array, and the color filter of any one of three colors of red, green, and blue is placed on the remaining half of the pixels. The image data that are stacked and imaged by each of the pixels are read out in at least two fields, and the image data of the three colors are aligned by the image data read out in the two fields, and each of the fields of the two fields is arranged. The image data to be read is mounted with a solid-state image sensor having a color filter array in which any one of the three colors is missing, and when the subject is imaged by the solid-state image sensor, the image data is immediately after the imaging. A method for generating a post-view image of an imaging apparatus that displays an image of a subject color as a post-view image,
When the postview image is generated from the image data read out in one of the two fields, the missing one-color image data out of the image data read out in the one field is changed to the three colors. A post-view image generation method for generating the post-view image by inferring based on the remaining two-color image data read out in the one field and image data read out from a pixel in which the transparent filter is laminated . 10. The post-view image generation method according to claim 9, wherein a post-view image generation method for selecting a readout field of image data for generating the post-view image from the two fields according to a color temperature of a captured color of the subject. Method. The post-view image generation method according to claim 9 or 10, wherein the image data for generating the post-view image is read from the image data of another field prior to the read field, and the image data of the other field is read out. A post-view image generation method for obtaining a white balance correction coefficient and correcting the white balance of the post-view image using the white balance correction coefficient . 12. The post-view image generation method according to claim 9, wherein when the imaging color temperature of the subject is higher than a predetermined temperature, color data of a pixel on which the red color filter is stacked. The post-view image is generated from the read data of the field including the image, and when the imaging color temperature of the subject is lower than the predetermined temperature, the post-view image is read from the read data of the field including the color data of the pixel on which the blue color filter is stacked. A post-view image generation method for generating a view image. The post-view image generation method according to claim 12, wherein when the imaging color temperature of the subject is higher than a predetermined temperature, reading is performed from a field different from a field including color data of pixels on which the red color filter is stacked. The white balance correction coefficient is calculated from the data, and when the imaging color temperature of the subject is lower than the predetermined temperature, the white balance correction is performed from the data read from a field different from the field including the color data of the pixel on which the blue color filter is laminated. A post-view image generation method for calculating a coefficient and correcting the post-view image by the calculated white balance correction coefficient . 14. The post-view image generation method according to claim 9, wherein one pixel row of the odd-numbered row or the even-numbered row of the solid-state imaging device is ½ with respect to the other pixel row. The transparent filters are stacked on each pixel row of the odd row or even row, and the color filters of three colors are placed on each pixel of the other row of odd rows or even rows. When the captured image data is read out from each pixel, the pixels are divided into adjacent two odd-numbered and even-numbered pixel rows, the pixel rows in which the transparent filters are stacked, and a green color filter; A field for reading a pixel row in which a blue color filter is alternately stacked for each pixel, a pixel row in which the transparent filter is stacked, a red color filter, and a green color filter are pixels. Post-view image generation method fields and are provided alternately reading of pixel rows that are alternately stacked on. 14. The post-view image generation method according to claim 9, wherein each pixel of the solid-state imaging device is arranged in a square lattice, and is arranged at a checkered position among the pixels of the square lattice arrangement. The transparent filter is stacked on the pixels that have been processed, and the color filters of three colors of red, green, and blue are stacked on the remaining pixels in the checkered position, and the field that reads the odd-numbered pixel rows and the pixel rows that are even-numbered are read A post-view image generation method in which fields are provided alternately . 14. The post-view image generation method according to claim 9, wherein each pixel of the solid-state imaging device is arranged in a square lattice, and each pixel in one pixel column of an odd column or an even column. The transparent filters are stacked, and color filters of three colors of red, green, and blue are stacked on each pixel in the other pixel column of the odd number column or the even number column, and a field for reading out the odd number pixel row and the even number pixel A post-view image generation method in which fields for reading out rows are alternately provided .

Images