JP4551307B2 - Single-plate color imaging device - Google Patents

Description

  The present invention relates to a single-plate color imaging apparatus, and more particularly to a single-plate color imaging apparatus that can improve color resolution.

  Color image pickup devices using charge coupled devices (CCD) or the like as image pickup devices are roughly classified into a multi-plate type using a plurality of image pickup devices and a single plate type using one image pickup device. A single-plate type camera that can capture a high-resolution color image relatively easily is widely used.

  In a color image sensor used in a single-plate color image pickup device, a color filter is stacked on the image sensor. Various patterns have already been proposed as color filter color arrangement patterns, and one of them is an RGB primary color Bayer arrangement (see, for example, Patent Document 1).

  FIG. 17A is a front view of a color filter of RGB primary color Bayer arrangement, and includes two G filters and a two-row two-column filter in which one R filter and one B filter are arranged in a checkered pattern. The basic unit.

  FIG. 17B is a graph showing a Nyquist region when the filters are arranged at a pitch d. The Nyquist region of R and B is represented by a square whose Nyquist frequency in the horizontal and vertical directions is 1 / 4d. The spatial resolution of G is represented by a diamond shape with a Nyquist frequency at the apex of 1 / 2d. That is, the horizontal and vertical Nyquist frequencies of R and B are half of G, and the Nyquist frequencies of G, R, and B do not match.

  For this reason, for a color including the G component and the R component or the B component, the aliasing error (aliasing error) differs depending on the luminance of each component, and generation of a false color signal cannot be avoided.

  To solve the above problem, an optical low-pass filter (low-pass filter) can be inserted in front of the light-receiving surface of the color image sensor to suppress the occurrence of aliasing errors. However, the cutoff frequency of the optical low-pass filter is Since it is defined by the lowest Nyquist frequency among the Nyquist frequencies for RGB, that is, the Nyquist frequency of R and B, the spatial resolution of G is also suppressed to the spatial resolution of R and B.

  Furthermore, when a general interlaced scanning is applied in television broadcasting, the B and R components are sequentially framed, and the resolution is further reduced.

Therefore, in a two-plate color image pickup device in which two CCDs having a Bayer color filter are arranged in a pixel-shifted manner, interpolation processing is performed on image data picked up by two CCDs so that RGB color data exists at each pixel position. In addition, a technique has been proposed in which two image data are combined with a shift of 1/2 pixel, and image data at each pixel position of the combined image is generated by interpolation processing to improve the resolution of the image (for example, a patent) Reference 2).
U.S. Pat. No. 3,971,065 (column 5, line 52 to column 6, line 6, FIG. 6) JP 2001-169301 A ([0010], FIGS. 21 to 23)

  However, the color imaging device disclosed in Patent Document 2 requires two CCDs, which not only makes the structure complicated, but also has an economical disadvantage.

  The present invention has been made to solve the conventional problems, and an object thereof is to provide a single-plate color imaging device capable of improving the resolution.

  A single-plate color image pickup device according to the first aspect of the present invention includes a pixel array in which pixels composed of four light receiving elements arranged in two rows and two columns are arranged in a grid pattern, and each pixel of the pixel array. A filter array covering a light receiving surface, each including at least one of an R filter, a G filter, and a B filter, wherein filters of the same color are arranged on one diagonal and filters of the other two colors are arranged on the other diagonal A filter array in which pixel filters of 2 rows and 2 columns are arranged in a grid, an optical element that is disposed on the subject side of the filter array and distributes one light beam to the four light receiving elements that are continuous in a row direction, A color imaging device including a pixel scanning line generation unit that generates one pixel scanning line from four light receiving element scanning lines sequentially scanned by the light receiving element, wherein the filter array reads each of the light receiving elements At the timing, the pixel scanning line is output by the R light receiving element that is the light receiving element covered by the R filter, the output of the G light receiving element that is the light receiving element covered by the G filter, and the output covered by the B filter. Two pixel filters adjacent to each other in the row direction are arranged so as to include at least one output of each of the B light receiving elements as the light receiving elements.

  With this configuration, it is possible to suppress occurrence of aliasing errors due to differences in Nyquist frequencies of RGB components in the scanning line without installing a horizontal optical low-pass filter, and to improve horizontal resolution. Become.

  In the single-plate color imaging device according to the second invention, the filter array includes a G filter disposed at the upper left of the pixel filter, a B filter disposed at the upper right, an R filter disposed at the lower left, and a right A first pixel filter including another G filter disposed below; a B filter disposed on the upper left side of the pixel filter; a G filter disposed on the upper right side; and another one disposed on the lower left side. You may have the structure which has arrange | positioned the 2nd pixel filter containing G filter and R filter arrange | positioned at the lower right in the row direction.

  In the single-plate color imaging device according to a third aspect of the invention, the pixel filter array includes a G filter arranged at the upper left of the pixel filter, a B filter arranged at the upper right, an R filter arranged at the lower left, A first pixel filter including another G filter disposed at the lower right, a G filter disposed at the upper left of the pixel filter, an R filter disposed at the upper right, and a B filter disposed at the lower left And a second pixel filter including another G filter arranged in the lower right may be arranged in the row direction.

  A single-plate color imaging device according to a fourth aspect of the invention has a configuration including an electrical LPF connected to a subsequent stage of the pixel scanning line generation unit.

  With this configuration, it is possible to maintain a high MFT of the scanning line and to suppress the occurrence of a folding error.

  A single-plate color imaging device according to a fifth aspect of the present invention is a pixel array in which pixels composed of four light receiving elements arranged in two rows and two columns are arranged in a grid pattern, and light reception of each pixel of the pixel array. 2 is a filter array that covers a surface, and includes at least one R filter, G filter, and B filter, each having the same color filter arranged on one diagonal and the other two color filters arranged on the other diagonal. A filter array in which pixel filters of two rows and columns are arranged in a grid, an optical element that is arranged on the subject side of the filter array and distributes one light beam to two light receiving elements that are continuous in a row direction, and the light receiving A color imaging device including a pixel scanning line generation unit that generates one pixel scanning line from two light receiving element scanning lines obtained by sequentially scanning the elements, wherein the pixel scanning line generation unit Elemental At each reading timing, one color component that is not read at the two reading timings is read at the two reading timings so that each of the light receiving element scanning lines includes all of the R component, the G component, and the B component. It has a configuration including a complementing unit that complements with one color component.

  With this configuration, it is possible to improve the resolution particularly with respect to the luminance change.

  The present invention is a filter array that covers a light receiving surface of each pixel of a pixel array, and at each reading timing of the light receiving element, at least one output of the R light receiving element, an output of the G light receiving element, and an output of the B light receiving element. By arranging two pixel filters adjacent in the row direction so as to include one, a folding error due to a difference in Nyquist frequency of RGB components occurs in the scanning line without installing a horizontal optical low-pass filter. It is possible to provide a single-plate color imaging device having the effect of suppressing the above and improving the resolution in the horizontal direction.

Hereinafter, embodiments of a single-plate color imaging device according to the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram of a single-plate color imaging device 1 according to the first embodiment, and FIG. 2 is a perspective view of a pixel array and a filter array.

  That is, the single-plate color imaging device 1 according to the first embodiment includes a pixel array 11 in which pixels PX including four light receiving elements LE arranged in two rows and two columns are arranged in a grid pattern, and the pixel array 11. Filter array 12 covering the light receiving surface of each pixel PX, including at least one R filter, G filter, and B filter, with the same color filter on one diagonal and the other two color filters on the other Filter array 12 in which pixel filters PF of 2 rows and 2 columns arranged diagonally are arranged in a grid pattern, and four light receiving elements arranged on the subject side of filter array 12 and continuing one light beam in the row direction The filter array 12 includes: an optical element 13 to be distributed; and a pixel scanning line generation unit 14 that generates one pixel scanning line from four light receiving element scanning lines obtained by sequentially scanning the light receiving elements LE. At each readout timing of the optical element LE, the output of the R light receiving element RLE, which is the light receiving element LE whose pixel scanning line is covered by the R filter, the output of the G light receiving element GLE, which is the light receiving element LE covered by the G filter, and the B filter The pixel filters adjacent to each other in the row direction of the filter array 12 are arranged so as to include at least one output of the B light receiving element BLE that is the light receiving element LE covered with the filter array 12.

  FIG. 3 is a front view of the pixel array 11 according to the first embodiment. Four light receiving elements LE arranged in two rows and two columns are set as one pixel PX, and 1920 in the column direction and in the row direction. It is assumed that 1080 pixels PX are arranged in a grid and have a configuration capable of capturing a high-definition image. The pixel array 11 according to the first embodiment is configured to be capable of sequential scanning in which the light receiving elements LE are main-scanned in the column (horizontal) direction and sub-scanned in the row (vertical) direction.

  The four scanning lines SL (j) to SL (j + 3) output by sequentially scanning the light-receiving elements constituting the pixel array 11 in the main scanning in the column direction and the sub-scanning in the row direction are expressed by [Equation 1]. And

  As shown in the block diagram of FIG. 4, the television camera 2 to which the single-plate color imaging device according to the present invention is applied includes a lens system 21 that generates an optical image of a subject, and an imaging device that converts the optical image into an electrical signal. 1, a signal processing unit 22 that processes the output of the imaging device 1, and a control unit 23 that controls the imaging device 1 and the signal processing unit 22.

  As illustrated in the block diagram of FIG. 1, the pixel scanning line generation unit 14 includes a color separation unit 141 that separates four scanning lines obtained by sequentially scanning the light receiving elements output from the pixel array 11 into RGB three primary color components. And a calculation unit 142 that calculates one scanning line by vertical two-pixel addition based on the output of the color separation unit 141.

  As shown in FIG. 2, the filter array 12 used in the first embodiment includes a G filter G11, a B filter B1 adjacent in the column direction of the G filter, and an R filter adjacent in the row direction of the G filter G11. A first pixel filter PF1 including R1 and another G filter G12 disposed at a diagonal position of the G filter G11; a first pixel filter adjacent to the first pixel filter in the row direction; a B filter B2; A second pixel including a G filter G21 adjacent in the column direction of B2, another G filter G22 adjacent in the row direction of the B filter B2, and an R filter R2 arranged at a diagonal position of the B filter B2. And a filter PF2.

  That is, in the filter array 12 used in the first embodiment, four sequential scanning lines obtained by sequentially scanning the light receiving elements LE have two G components, 1 at the read timing of each light receiving element LE. It is configured to include one R component and one B component.

  FIG. 5 is a block diagram showing a specific configuration example of the color separation unit 141. When the pixel array 11 is configured to sequentially output scanning lines, the color separation unit 141 includes a memory unit 141a and a writing control unit 141b. When the pixel array 11 is configured to output four sequential scanning lines simultaneously, the memory type color separation unit (a) is configured with a switch unit 141c and a switching control unit 141d. A switchable color separation unit (b) can be applied.

  FIG. 6 is a block diagram illustrating a specific configuration example of the calculation unit 142. The calculation unit 142 includes a color signal output calculation unit 142a that outputs RGB color signals, a luminance / color difference signal output calculation unit 142b that outputs luminance / color difference signals, and the like. is there.

  Hereinafter, the operation of the imaging apparatus according to the first embodiment will be described.

  The light emitted from the subject OJ forms a subject image on the pixel array 11 via the lens system 21, the optical element 13, and the filter array 12.

  FIG. 7 is a cross-sectional view for explaining the operation of the optical element 13. Light rays emitted from the subject OJ side pass through the lens system 21 and then enter the optical element 13. The optical element 13 distributes incident light to four light receiving elements LE that are continuous in the row direction.

  Although the quartz optical LPF can be used as the optical element 13, the quartz optical LPF cannot be divided into four by one, so the separation width is actually the same as the first quartz optical LPF 131 having a separation width of 2d. It is necessary to arrange the second quartz optical LPF 132 which is d in series.

  As a result of one light beam being divided into four in the row direction by the optical element 13, the same light beam is incident on four light receiving elements continuous in the row direction. Therefore, when the light receiving elements LE of the pixel array 11 are sequentially scanned, The array 11 outputs four sequential scanning lines represented by [Equation 2].

  The color separation unit 141 reads the above four sequential scanning lines and outputs two G signals, one B signal, and one R signal at read timings i and i + 1.

  Then, the calculation unit 142 reads two G signals, one B signal, and one R signal, performs vertical two-pixel addition processing, and outputs a color signal or a luminance / color difference signal.

  That is, the color signal output calculation unit 142a reads two G signals G1 and G2, one B signal, and one R signal, and calculates a color signal based on [Equation 3].

  Specifically, the function g can use [Equation 4].

The luminance and color difference signals output computing part 142b reads the two G signals G1 and G2,1 one B signals and one of the R signal, luminance and color difference signals Y based on the formula [5], P _b, the P _r Calculate.

  Here, specifically, [Equation 6] can be used as each function.

Note that the calculation of the luminance Y can be simplified by calculating the luminance Y based on the function f ₁ .

  As shown in the graph of FIG. 8, the Nyquist region of the single-plate color imaging device of the first embodiment is (+ 1 / (2d), 0), (0, + 1 / (4d)), (−1 / ( 2d), 0) and (0, -1 / (4d)) are inside the rhombus with apexes. The region surrounded by the broken line is the Nyquist region of the Bayer-arranged G signal, and the region surrounded by the alternate long and short dash line is the Nyquist region of the Bayer-arranged B signal and R signal.

As described above, according to the first embodiment, although the Nyquist frequency of the G signal in the row (vertical) direction is reduced to ± 1 / (4d), the R signal and the B signal in the column (horizontal) direction are reduced. The Nyquist frequency can be increased to ± 1 / (2d), similar to the Nyquist frequency of the G signal, and even if an optical low-pass filter is not installed, aliasing errors due to differences in the Nyquist frequency of RGB components occur in the scanning line. It is possible to suppress and improve the horizontal resolution.
(Second Embodiment)
As shown in the perspective view of FIG. 9, the filter array 12 used in the second embodiment includes a G filter G11, a B filter B1 adjacent in the column direction of the G filter G11, and a row direction of the G filter G11. A first pixel filter PF1 including an adjacent R filter R1 and another G filter G12 disposed at a diagonal position of the G filter G11; adjacent to the first pixel filter PF1 in the row direction; G21, an R filter R2 adjacent in the column direction of the G filter G21, a B filter B2 adjacent in the row direction of the G filter G21, and another G filter G22 arranged at a diagonal position of the G filter G21. Including a second pixel filter PF2.

  Since other configurations are the same as those of the first embodiment, detailed description thereof is omitted.

  In the second embodiment, when the light receiving elements LE of the pixel array 11 are sequentially scanned, four sequential scanning lines represented by [Expression 7] are output from the pixel array 11.

  The color separation unit 141 reads the above four sequential scanning lines and outputs two G signals, one B signal, and one R signal at read timings i and i + 1.

  The Nyquist regions of the R signal and the B signal of the imaging apparatus according to the second embodiment are (+ 1 / (2d), 0), (0, + 1 / (8d)), (− The rhombus has 1 / (2d), 0) and (0, -1 / (8d)) as vertices. The Nyquist area of the G signal is the same as in the Bayer arrangement. The region surrounded by the broken line is the Nyquist region of the Bayer-arranged G signal, and the region surrounded by the alternate long and short dash line is the Nyquist region of the Bayer-arranged B signal and R signal.

As described above, according to the second embodiment, the Nyquist frequency of the R signal and B signal in the row (vertical) direction is reduced to ± 1 / (8d), but the R signal in the column (horizontal) direction and The Nyquist frequency of the B signal can be increased up to ± 1 / (2d), the same as the Nyquist frequency of the G signal, and aliasing errors due to differences in the Nyquist frequency of the RGB components occur in the scanning line without installing an optical low-pass filter. It is possible to suppress this and improve the horizontal resolution.
(Third embodiment)
According to the first and second embodiments described above, the Nyquist frequencies of the R, G, and B components in the column (horizontal) direction are {1 / (2d)}. For example, an optical LPF having a cutoff frequency of {1 / (4d)} can be omitted.

  FIG. 11 is a graph showing the modulation degree MFT of the imaging devices of the first embodiment and the second embodiment. As shown in FIG. 11A, if the aperture is 100%, the cutoff frequency is For example, it can be understood that the MFT of the pixel array is smaller than the MFT of the optical LPF which is {1 / (2d)}, and the MFT of the scanning line is limited by the MFT of the pixel array.

Therefore, using the imaging devices of the first and second embodiments, 3840 light receiving elements in the horizontal direction and 2160 light receiving elements in the vertical direction are arranged, 1920 pixels in the horizontal direction, and 1080 pixels in the vertical direction. In the case of manufacturing a high-definition television screen having the following, as shown in FIG. 11B, an electric LPF 15 (for example, digital) having a cutoff frequency of {1 / (4d)} at the subsequent stage of the pixel scanning line generation unit 14 is used. By inserting a filter, it is possible to keep the MFT of the scanning line high and suppress the occurrence of aliasing errors.
(Fourth embodiment)
As shown in FIG. 12, the single-plate color image pickup device 3 of the fourth embodiment has a pixel array 31 in which pixels PX composed of four light receiving elements LE arranged in two rows and two columns are arranged in a grid pattern. And a filter array 32 covering the light receiving surface of each pixel PX of the pixel array 31, each including at least one R filter, G filter, and B filter, with the same color filter in one diagonal and the other two A filter array 32 in which pixel filters of 2 rows and 2 columns in which color filters are arranged on the other diagonal are arranged in a grid pattern, and one light beam is arranged in the row direction on the object side OJ of the filter array 32 An optical element 33 that distributes the light to the two light receiving elements, and a scanning line generation unit 34 that generates one pixel scanning line from two light receiving element scanning lines obtained by sequentially scanning the light receiving element LE. Generator 4 represents two color components that are not read out at two light receiving element readout timings so that each of the light receiving element scanning lines includes all of the R component, G component, and B component at every two light receiving element readout timings. A complementing unit 35 that complements with two color components read at the light receiving element readout timing is included.

  As shown in FIG. 13, the filter array 32 used in the fourth embodiment includes a G filter G11, a B filter B1 adjacent in the column direction of the G filter, and an R filter adjacent in the row direction of the G filter G11. R1 and another G filter G12 disposed at a diagonal position of the G filter G11.

  As shown in the block diagram of FIG. 14, the television camera 4 to which the single-plate color imaging device according to the fourth embodiment is applied, converts a lens system 21 that generates an optical image of a subject, and the optical image into an electrical signal. An imaging device 3 that performs processing, a signal processing unit 22 that processes the output of the imaging device 3, and a control unit 23 that controls the imaging device 3 and the signal processing unit 22.

  FIG. 15 is a detailed block diagram of the scanning line generation unit 34 of the fourth embodiment, which includes a color separation unit 141 and a complementing unit 35.

  As the color separation unit 141, the memory type color separation unit (a) or the switching type color separation unit (b) shown in FIG. 5 can be used as in the first embodiment.

  The complement unit 35 includes an interpolation R signal generation unit 351 that generates an interpolation R signal based on the G signal and the B signal, and an interpolation B signal generation unit 352 that generates an interpolation B signal based on the G signal and the R signal. .

  Next, the operation of the fourth embodiment will be described.

  Light emitted from the subject OJ forms a subject image on the pixel array 31 via the lens system 21, the optical element 33, and the filter array 32.

  The optical element 33 is an optical LPF that divides one light beam into two in the row direction. As a result of one light beam being divided into two in the row direction, the same light beam is applied to two light receiving elements that are continuous in the row direction. Therefore, when the light receiving elements LE of the pixel array 31 are sequentially scanned, a sequential scanning line represented by [Equation 8] is output from the pixel array 31.

  The color separation unit 141 reads the above two sequential scanning lines and outputs two G signals, one B signal, and one R signal per pixel at the pixel readout timing (I, J).

  However, pixel readout timings I and J are calculated by the following equation.

  The RGB signal output from the color separation unit 141 is output as a video signal through the complementing unit 35 and transmitted to the subsequent image processing unit as necessary.

  Here, the reason for inserting the complement part 35 will be described.

  In a general image in which the change in luminance is abrupt compared to the change in hue, if all RGB color components are included in the output signal for each pixel readout timing of each light receiving element scanning line, The luminance resolution can be increased.

  However, when a filter array 32 including at least one of an R filter, a G filter, and a B filter, in which the same color filter is arranged on one diagonal and the other two color filters are arranged on the other diagonal, is applied. Although the G component is included at every read timing of the light receiving element, the R component and the B component are output at every other light receiving element read timing, so that the luminance resolution is lowered.

  Therefore, in the fourth embodiment, the complementing unit 35 is installed at the subsequent stage of the color separation unit 141 so that all RGB color components are output at each pixel readout timing of each light receiving element scanning line.

  That is, when [Equation 8] is rewritten to the pixel readout timing I, [Equation 10] is obtained.

  That is, the R component is not included in the pixel readout timing 2I in the scanning line SL (j), and the B component is not included in the pixel readout timing 2I in the scanning line SL (j + 1).

  Therefore, the R component complementing unit 351 and the B component complementing unit 352 included in the complementing unit 35 generate the complementing R component R ′ and the complementing B component B ′ using [Equation 11].

The functions h _r and h _b may be arbitrary functions and are not particularly defined, but it is desirable to use the weighted average value of [Equation 12] considering that the G component is dominant in the luminance.

  Therefore, the video signal output from the complementing unit 35 is expressed by [Equation 13].

  FIG. 16 is a graph for explaining the operation of the complementing unit 35, and shows a case where a white subject is imaged (a) and a case where a black subject is imaged (b). In FIG. 16, broken lines indicate components that are not included in the output of the pixel array 31, and thick lines indicate components that are interpolated by the complementing unit 35.

  When a white subject is imaged (a), as shown in [Equation 10], the j-th scanning line includes the G component and the B component in the output of the second I-th pixel, and includes the R component. Not. Therefore, the R component complementing unit 351 calculates and outputs the complement R component R ′ using [Equation 11].

  Although FIG. 16 illustrates the case where white or black extends over two lines, the present embodiment is effective even for a subject in which black and white are reversed for each line.

  That is, when the pixel array 31 has 2160 light receiving elements in the row direction, a resolution of 2160 TV lines can be obtained.

  When the above complement processing is applied to an image with a gradual change in luminance and a sharp change in hue, there is a risk that the hue will not be captured correctly.

  Therefore, when the luminance change frequency is lower than a predetermined threshold frequency, it is desirable to stop the complementing process or reduce the effect of the complementing process. It is appropriate to detect the luminance change frequency based on the change frequency of the G component, the time difference of the G component, and the like.

  In the description of the fourth embodiment, the filter array 32 is the first filter array of the first embodiment, but the second filter array of the first embodiment, The first or second filter array of the second embodiment or a Bayer-arranged filter array may be used.

  As described above, according to the single-plate color image pickup device according to the fourth embodiment, since all RGB components are included in each light receiving element read timing, it is possible to improve the resolution especially for the luminance change.

  In the above embodiment, assuming a television camera, the rows are in the vertical direction and the columns are in the horizontal direction. However, the present invention can also be applied when the columns are in the vertical direction and the rows are in the horizontal direction. it is obvious.

  As described above, the imaging apparatus according to the present invention has an effect that the resolution in the horizontal direction can be improved in a single-plate color imaging apparatus, and is effective as a television camera, a still camera, or the like.

1 is a block diagram of a single-plate color imaging device according to a first embodiment of the present invention. The perspective view of the pixel array and filter array in the 1st Embodiment of this invention 1 is a front view of a single-plate pixel array according to a first embodiment of the present invention. 1 is a block diagram of a television camera to which a single-plate color imaging device according to a first embodiment of the present invention is applied. Color separation block diagram Block diagram of the calculation unit Block diagram of optical element The graph which shows the Nyquist area | region of the single-plate-type color imaging device in the 1st Embodiment of this invention The perspective view of the pixel array and filter array in the 2nd Embodiment of this invention The graph which shows the Nyquist area | region of the single-plate-type color imaging device in the 2nd Embodiment of this invention The graph which shows the modulation factor of the single plate type color imaging device in the 1st and 2nd embodiment of this invention Block diagram of a single-plate color imaging device in the fourth embodiment of the present invention The perspective view of the pixel array and filter array in the 4th Embodiment of this invention Block diagram of a television camera to which a single-plate color imaging device according to a fourth embodiment of the present invention is applied. Block diagram of the complement A graph explaining the operation of the complement A graph showing the Nyquist area of a color imaging device with a Bayer arrangement

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Single plate type color imaging device 11 Pixel array 12 Filter array 13 Optical element 14 Scan line generation part 141 Color separation part 142 Operation part 15 Electric LPF
LE light receiving element PX pixel PF pixel filter

Claims (5)

A pixel array in which pixels composed of four light receiving elements arranged in two rows and two columns are arranged in a grid pattern;
A filter array covering a light receiving surface of each pixel of the pixel array, each including at least one of an R filter, a G filter, and a B filter, wherein the same color filter is on one diagonal and the other two color filters are A filter array in which pixel filters of 2 rows and 2 columns arranged on the other diagonal are arranged in a grid pattern;
An optical element that is arranged on the subject side of the filter array and distributes one light beam to the four light receiving elements that are continuous in a row direction;
A color imaging device including a pixel scanning line generation unit that generates one pixel scanning line from four light receiving element scanning lines obtained by sequentially scanning the light receiving elements;
The filter array outputs, at each readout timing of the light receiving element, the output of the R light receiving element which is the light receiving element covered by the R filter, and the G light receiving which is the light receiving element covered by the G filter. A single-plate color having a configuration in which two pixel filters adjacent in the row direction are arranged so as to include at least one output of an element and an output of a B light receiving element which is the light receiving element covered by a B filter Imaging device. The filter array is
A first pixel filter including a G filter disposed at the upper left of the pixel filter, a B filter disposed at the upper right, an R filter disposed at the lower left, and another G filter disposed at the lower right. When,
A second pixel filter including a B filter arranged at the upper left of the pixel filter, a G filter arranged at the upper right, another G filter arranged at the lower left, and an R filter arranged at the lower right The single-plate color image pickup device according to claim 1, wherein the single-plate color image pickup device has a configuration in which are arranged in a row direction. The pixel filter array is
A first pixel filter including a G filter disposed at the upper left of the pixel filter, a B filter disposed at the upper right, an R filter disposed at the lower left, and another G filter disposed at the lower right. When,
A second pixel filter including a G filter disposed at the upper left of the pixel filter, an R filter disposed at the upper right, a B filter disposed at the lower left, and another G filter disposed at the lower right. The single-plate color image pickup device according to claim 1, wherein the single-plate color image pickup device has a configuration in which are arranged in a row direction. The color imaging device according to claim 1, further comprising an electric LPF connected to a subsequent stage of the pixel scanning line generation unit. A pixel array in which pixels composed of four light receiving elements arranged in two rows and two columns are arranged in a grid pattern;
A filter array covering a light receiving surface of each pixel of the pixel array, each including at least one of an R filter, a G filter, and a B filter, wherein the same color filter is on one diagonal and the other two color filters are A filter array in which pixel filters of 2 rows and 2 columns arranged on the other diagonal are arranged in a grid pattern;
An optical element disposed on the subject side of the filter array and distributing one light beam to the two light receiving elements that are continuous in a row direction;
A color imaging device including a pixel scanning line generation unit that generates one pixel scanning line from two light receiving element scanning lines obtained by sequentially scanning the light receiving elements;
The pixel scanning line generation unit does not read out at the two readout timings so that each of the light receiving element scanning lines includes all of the R component, the G component, and the B component at every two readout timings of the light receiving elements. A single-plate color imaging apparatus including a complementing unit that complements one color component with two color components read out at the two readout timings.

Images