CN101312537B - Drive method for solid-state imaging device, solid-state imaging device, and imaging apparatus - Google Patents

Abstract

A drive method for a solid-state imaging device having an oblique pixel pattern includes the steps of: adding, separately for an odd-numbered row and an even-numbered row, x pixels in the horizontal direction and y pixels in the vertical direction, the x pixels and the y pixels having the same color, in an area having adjacent n pixels in the horizontal direction and adjacent n pixels in the vertical direction, where n is an odd number of three or greater and n>=x>=y; and repeatedly adding the x pixels and the y pixels while shifting the nxn area by m pixels in the vertical or horizontal direction, where m is an odd number of three or greater. The nxn area of odd-numbered rows is displaced from that of even-numbered rows by m pixels in the oblique direction in the oblique pixel pattern.

Description

Solid state image pickup device and imaging device

The application is to be December 27, application number in 2005 the dividing an application for the application for a patent for invention of " solid-state imaging device driving method, solid state image pickup device and imaging device " that be 200510135801.X, denomination of invention the applying date.

Cross reference to related application

The present invention comprises the theme relevant with following application: the Japanese patent application JP 2004-375405 that submitted at Japan Office on December 27th, 2004, on April 4th, 2005 are herein incorporated its full content by reference at the Japanese patent application JP 2005-107034 of Japan Office submission and the Japanese patent application JP 2005-107037 that submitted at Japan Office on April 4th, 2005.

Technical field

The present invention relates to driving method, solid state image pickup device and the imaging device of solid state image pickup device.More specifically, the present invention relates to the driving method for X-Y addressing solid state image pickup device (its exemplary is complementary metal oxide semiconductors (CMOS) (CMOS) installation drawing image-position sensor), the solid state image pickup device of realizing top driving method and the imaging device that uses this solid state image pickup device.

The present invention is relevant solid-state imaging apparatus and vision facilities also, and more specifically, about wherein having the lip-deep solid-state imaging apparatus that is arranged in pixel for the colour filter of the primary color component (primary color component) that generates brightness (Y) component and other color component, and, also relevant to the imaging device of solid-state imaging apparatus as imaging device.

Background technology

As announcing in Japanese unexamined patent application publication for example 2004-266369 number, in order to improve the frame rate of solid state image pickup device, usually, by the information phase Calais minimizing Pixel Information amount with relevant a plurality of pixels.

The example of above-mentioned technology is as follows.In the color-code (color coding) of Bayer pattern shown in Figure 1 (Bayer pattern), from 3 * 3 pixel regions, extract the pixel of the same color in also addition two row and two row, simultaneously, by do not change that the color space repeat patterns does not change vertically yet, level and inclining

Keep original colour image, and do not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.

Be necessary also to provide in a kind of situation not causing wrong color that the two all realizes high-resolution solid-state imaging apparatus and imaging device to achromatic object and colored object.

According to embodiments of the invention, provide a kind of driving method of the solid state image pickup device be used to having the oblique pixel pattern that pixel is in tilted layout.This driving method may further comprise the steps: on having horizontal direction on an adjacent n pixel and the vertical direction in the zone of an adjacent n pixel, respectively for the row of odd-numbered and the row of even-numbered, with y pixel addition on the pixel of the x on the horizontal direction and the vertical direction, this x pixel has identical color with y pixel, and wherein n is three or larger odd number and n 〉=x 〉=y; And with y pixel repeated addition on the pixel of the x on the horizontal direction and the vertical direction, simultaneously will have on the horizontal direction a regional mobile m pixel of an adjacent n pixel on the adjacent n pixel and vertical direction on the horizontal or vertical direction, wherein m is three or larger odd number.Odd-numbered is capable have on the horizontal direction zone of an adjacent n pixel and even-numbered on the adjacent n pixel and vertical direction capable have on the horizontal direction spatial relation between the zone of an adjacent n pixel on the adjacent n pixel and vertical direction so that they are in the incline direction of oblique pixel pattern m the pixel that be shifted each other.

With pixel addition, can keep original colour image as described above, and the pitch ratio on should not variable color color space repeat patterns or vertical, level and the incline direction.

According to still another embodiment of the invention, provide a kind of solid-state imaging apparatus, having comprised: pixel, it comprise by bidimensional be arranged in photoelectric transformer in the matrix; And colour filter, comprise that this colour filter is disposed in the surface of pixel as primary color component and other color component of the fundamental component that is used for the generation luminance component.Primary color component and other color component are arranged such that primary color component surrounds other color component.Other color component arranges by interlacing with every row so that the sampling rate of other color component on vertical and horizontal direction become primary color component sampling rate 1/4, wherein, other color component has two kinds of colors; And the row that only comprises primary color component arranged by interlacing, and, comprise the going and comprise that the row of other color component of primary color component and another kind of color arranged by alternate interlaced of other color component of primary color component and a kind of color.Can use this solid-state imaging apparatus as the imaging device in the imaging device such as digital still life camera or video camera.

The solid-state imaging apparatus that the above disposes or use this solid-state imaging apparatus to have following colour image as the imaging device of imaging device, wherein the color component (for example, G color component) as the fundamental component that is used for the generation luminance component has surrounded other color component (for example R and B color component).In this colour image, in all row and all row, all there is the G component.Therefore, can increase human eyes it is had the spatial frequency characteristic of more highly sensitive G component, and the processing that is used for adjusting the balance of power level of RGB component becomes and there is no need.

According to still another embodiment of the invention, a kind of imaging device is provided, comprise: solid-state imaging apparatus, it comprises having as the primary color component of the fundamental component that is used for the generation luminance component and the colour filter of other color component, and this primary color component and other color component are arranged such that primary color component surrounds other color component; Optical system, be configured to the imaging surface of solid-state imaging apparatus form corresponding to from the image of light of object; And signal processing circuit, be configured to process the output signal of solid-state imaging apparatus.Other color component arranges by interlacing with every row so that the sampling rate of other color component on vertical and horizontal direction become primary color component sampling rate 1/4, wherein, other color component has two kinds of colors; And the row that only comprises primary color component arranged by interlacing, and, comprise the going and comprise that the row of other color component of primary color component and another kind of color arranged by alternate interlaced of other color component of primary color component and a kind of color.

According to embodiments of the invention, in having the solid state image pickup device of oblique pixel pattern, after with pixel addition, can keep original colour image, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space (spatially equal sampling), can obtain high-quality sum signal.Meanwhile, can export the signal of addition with the colour image identical with the colour image that obtains by gradual (progressive) (both full-pixel) read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

In addition, can increase conduct for the spatial frequency characteristic of the color component of the fundamental component that generates luminance component.Like this, not only to achromatic object, and can obtain high-resolution to the object of colour.In addition, the processing that is used for the balance of power level of adjustment rgb pixel becomes and there is no need, thereby prevents the appearance of wrong color.

Description of drawings

The color-code of Fig. 1 diagram Bayer pattern;

The color-code of the Bayer pattern that Fig. 2 diagram is shown in Figure 1;

The pattern of the independent color in Fig. 3 A to 3D diagram Bayer pattern and the relation between the sampling rate;

The frequency characteristic of Fig. 4 diagram Bayer pattern;

Fig. 5 diagram Baeyer pixel moves the color-code of pattern;

Fig. 6 A to 6D diagram Baeyer pixel moves the pattern of the independent color in the pattern and the relation between the sampling rate;

Fig. 7 diagram Baeyer pixel moves the frequency characteristic of pattern;

The color-code of 45 ° colour image is moved in Fig. 8 diagram from Bayer pattern;

Fig. 9 is the schematic diagram of example of the configuration of the cmos image sensor of diagram with oblique pixel pattern;

Figure 10 is the block diagram of another example of the configuration of the cmos image sensor of diagram with oblique pixel pattern;

Figure 11 diagram is by according to the driving method of the first embodiment of the invention thought with pixel addition;

Figure 12 diagram is by according to the driving method of the second embodiment of the invention thought with pixel addition;

Figure 13 diagram is by according to the driving method of the third embodiment of the invention thought with pixel addition;

Figure 14 diagram is by according to the driving method of the fourth embodiment of the invention thought with pixel addition;

Figure 15 diagram is by according to the driving method of the fifth embodiment of the invention thought with pixel addition;

Figure 16 is the according to an embodiment of the invention schematic diagram of the configuration of cmos image sensor of diagram;

Figure 17 is the circuit diagram of example of the configuration of diagram odd-numbered column processing circuit;

Figure 18 is the sequential chart of the operation of diagram cmos image sensor shown in Figure 16;

Figure 19 is the according to an embodiment of the invention block diagram of the example of the configuration of imaging device of diagram;

Figure 20 is the according to an embodiment of the invention block diagram of the example of the configuration of imaging device of diagram;

The colour image of Figure 21 diagram colour filter according to a sixth embodiment of the invention;

Figure 22 A and 22B diagram be the G pattern extracted out from the colour image of the 6th embodiment of G pixel only wherein;

Figure 22 C and 22D diagram be the R pattern extracted out from the colour image of the 6th embodiment of R pixel only wherein;

Figure 23 diagram is according to the spatial frequency characteristic of the colour image of the 6th embodiment;

The colour image of Figure 24 diagram colour filter according to a seventh embodiment of the invention;

Figure 25 A and 25B diagram be the G pattern extracted out from the colour image of the 7th embodiment of G pixel only wherein;

Figure 25 C and 25D diagram wherein only the R pixel from the colour image of the 7th embodiment, extracted out the R pattern;

Figure 26 diagram is according to the spatial frequency characteristic of the colour image of the 7th embodiment;

Figure 27 diagram is according to the colour image of the colour filter of the eighth embodiment of the present invention;

Figure 28 A and 28B diagram be the G pattern extracted out from the colour image of the 8th embodiment of G pixel only wherein;

Figure 28 C and 28D diagram wherein only the R pixel from the colour image of the 8th embodiment, extracted out the R pattern;

Figure 29 diagram is according to the spatial frequency characteristic of the colour image of the 8th embodiment;

Figure 30 A diagram is according to the comparative result between the spatial frequency characteristic of the spatial frequency characteristic of the G pixel of the 6th to the 8th embodiment and known colour image;

Figure 30 B diagram is according to the comparative result between the spatial frequency characteristic of the spatial frequency characteristic of the R of the 6th to the 8th embodiment and B pixel and known colour image;

The characteristic of Figure 31 diagram frequency band limits low pass filter (LPF); And

The thought of processing is extracted in Figure 32 diagram.

Embodiment

Describe embodiments of the invention in detail below in conjunction with accompanying drawing.

Discuss driving method for the pixel addition of carrying out solid state image pickup device below by the explanation of the first to the 5th embodiment.

The solid state image pickup device of this driving method of use that present hypothesis is discussed below has ensuing oblique pixel pattern.In this pattern of pixels, the many pixels that comprise optical-electrical converter in matrix, have been arranged, and with the row pixel of even-numbered on column direction from 1/2 of the about pixel pitch of row pixel shift of odd-numbered, and the capable pixel of even-numbered gone up in the row direction from 1/2 of the about pixel pitch of capable pixel shift of odd-numbered.

In ensuing embodiment of the present invention, in solid-state imaging apparatus, the pixel that comprises optical-electrical converter is arranged on bidimensional ground, and arranges to have as the color component of the primary color component that is used for generation brightness (Y) component and the colour filter of other color on the surface of pixel.In this solid-state imaging apparatus, the colour image of colour filter is extremely important.

Therefore, in ensuing three embodiment, the colour image of colour filter is described mainly.Have according to each the solid-state imaging apparatus of colour filter among three embodiment and can shift solid-state imaging apparatus for: electric charge, its exemplary is charge coupled device (CCD) solid-state imaging apparatus; Perhaps X-Y addressing solid-state imaging apparatus, its exemplary is the MOS solid-state imaging apparatus.

In ensuing description, suppose: in colour filter, be the G component as the color component for the primary colours that generate brightness (Y) component, and other color component is R and B component.

Yet in the present invention, these color components only are examples, for example can be used for generating with white, cyan and yellow color component conduct the primary colours of Y component, and, for example can be with purple, cyan and yellow color component as other color component.

In the above-mentioned solid state image pickup device with oblique pixel pattern, do not change keeping original colour image in the pitch ratio on color space repeat patterns or vertical, level and the incline direction, can the carries out image addition.

The first embodiment

Figure 11 diagram is by according to the driving method of the first embodiment of the present invention thought with pixel addition.Move 45 ° the color-code of pattern of pixels according to oblique pixel pattern and from Bayer pattern, from 3 * 3 pixel regions, extract and be added in mutually the pixel of the same color in two row and two row out, simultaneously this 3 * 3 pixel region is moved three pixels, namely take three pixels as the unit.Lower mask body is discussed the process of such pixel addition.

In Figure 11, will be arranged in R pixel 111,113,151 and 153 additions of the row of odd-numbered, then, with the addition R signal framing of gained at centre of form A.Similarly, by moving horizontally three pixels from R pixel 111,113,151 and 153, with B pixel 114,116,154 and 156 additions, then, with the addition B signal framing of gained at centre of form B.By further moving horizontally three pixels from B pixel 114,116,154 and 156, with R signal 117,119,157 and 159, then addition, with the addition R signal framing of gained at centre of form C.

By mobile three pixels that tilt from R signal 117,119,157 and 159, will be arranged in G pixel 142,144,182 and 184 additions of the row of even-numbered, and, with the addition G signal framing of gained at centre of form D.By moving horizontally three pixels from G pixel 142,144,182 and 184, with G pixel 145,147,185 and 187 additions, then, with the addition G signal framing of gained at centre of form E.

By this way, by on whole pixel region as described above with the color pixel addition, the pixel addition of same color can be kept original colour image simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.In this oblique pixel pattern, be not both corresponding to the column number of the capable pixel of odd-numbered and column number corresponding to the capable pixel of even-numbered and be necessary.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export the signal of addition with the colour image identical with the colour image that obtains by gradual (both full-pixel) read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The second embodiment

The driving method of Figure 12 diagram by according to a second embodiment of the present invention is with the thought of pixel addition.Move 45 ° the color-code of pattern of pixels according to oblique pixel pattern and from Bayer pattern, from 5 * 5 pixel regions, extract and be added in mutually the pixel of the same color in three row and three row out, simultaneously this 5 * 5 pixel region is moved three pixels.Lower mask body is discussed the process of such pixel addition.

In Figure 12, will be arranged in the capable R pixel 211,213,215,251,253,255,291 of odd-numbered, 293 and 295 additions, then, with the addition R signal framing of gained at centre of form A.By moving horizontally three pixels from R pixel 211,213,215,251,253,255,291,293 and 295, with B pixel 214,216,218,254,256,258,294,296 and 298 additions, then, with the addition B signal framing of gained at centre of form B.By further moving horizontally three pixels from B pixel 214,216,218,254,256,258,294,296 and 298, with R pixel 217,219,21b, 257,259,25b, 297,299 and the 29b addition, then, with the addition R signal framing of gained at centre of form C.

By mobile three pixels that tilt, will be arranged in the capable G pixel 242,244,246,282,284,286 of even-numbered, 2c2,2c4 and 2c6 addition, and with the addition G signal framing of gained at centre of form D.By move horizontally three pixels from G pixel 242,244,246,282,284,286,2c2,2c4 and 2c6, with G pixel 245,247,249,285,287,289,2c5,2c7 and 2c9 addition, then, with the addition G signal framing of gained at centre of form E.

By this way, by on whole pixel region as mentioned above with the color pixel addition, the pixel addition of same color can be kept original colour image simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export the signal of addition with the colour image identical with the colour image that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The 3rd embodiment

The driving method of Figure 13 diagram by a third embodiment in accordance with the invention is with the thought of pixel addition.There not being the oblique pixel pattern of colour filter, from 3 * 3 pixel regions, extract and be added in mutually the neighbor in two row and two row out, simultaneously this 3 * 3 pixel region is moved three pixels.Lower mask body is discussed the process of such pixel addition.

In Figure 13, will be arranged in pixel 311,312,331 and 332 additions of the row of odd-numbered, then, the sum signal of gained is positioned at centre of form A.By moving horizontally three pixels from pixel 311,312,331 and 332, with pixel 314,315,334 and 335 additions, then, the sum signal of gained is positioned at centre of form B.By being moved further three pixels from 314,315,334 and 335, with pixel 317,318,337 and 338 additions, then, the sum signal of gained is positioned at centre of form C.

Then, by mobile three pixels that tilt, will be arranged in pixel 342,343,362 and 363 additions of the row of even-numbered, then, the sum signal of gained will be positioned at centre of form D.By moving horizontally three pixels from pixel 342,343,362 and 363, with pixel 345,346,365 and 366 additions, and the sum signal of gained is positioned at centre of form E.

By this way, by on whole pixel region as mentioned above with pixel addition, these pixel addition can be kept master pattern simultaneously, and not change the pitch ratio on vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export sum signal with the pattern identical with the pattern that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The 4th embodiment

The driving method of Figure 14 diagram by a fourth embodiment in accordance with the invention is with the thought of pixel addition.In not having the oblique pixel pattern of colour filter, from 3 * 3 pixel regions, extract and be added in mutually the neighbor in three row and three row out, simultaneously this 3 * 3 pixel region is moved three pixels.Lower mask body is discussed the process of such pixel addition.

In Figure 14, will be arranged in pixel 411,412,413,431,432,433,451,452 and 453 additions of the row of odd-numbered, then, the sum signal of gained is positioned at centre of form A.By moving horizontally three pixels from pixel 411,412,413,431,432,433,451,452 and 453, with pixel 414,415,416,434,435,436,454,455 and 456 additions, then, the sum signal with gained is positioned at centre of form B.By being moved further three pixels from pixel 414,415,416,434,435,436,454,455 and 456, with pixel 417,418,419,437,438,439,457,458 and 459 additions, and the sum signal of gained is positioned at centre of form C.

Then, by mobile three pixels that tilt, addition is arranged in the capable pixel of even-numbered 442,443,444,462,463,464,482,483 and 484, then, the sum signal of gained is positioned at centre of form D.By moving horizontally three pixels from pixel 442,443,444,462,463,464,482,483 and 484, with pixel 445,446,447,465,466,467,485,486 and 487 additions, and the sum signal of gained is positioned at centre of form E.

By this way, by on whole pixel region as mentioned above with pixel addition, these pixel addition can be kept original pattern simultaneously, and not change the pitch ratio on vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export the signal of addition with the pattern identical with the pattern that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The 5th embodiment

The driving method of Figure 15 diagram by according to a fifth embodiment of the invention is with the thought of pixel addition.In the special-purpose color-code as special-purpose color-code example, from 5 * 5 pixel regions, extract and be added in mutually the pixel of the same color in two row and two row out, simultaneously this 5 * 5 pixel region is moved three pixels.Lower mask body is discussed the process of such pixel addition.

In Figure 15, will be arranged in R pixel 511,513,551 and 553 additions of the row of odd-numbered, then, with the addition R signal framing of gained at centre of form A.Similarly, by moving horizontally three pixels from R pixel 511,513,551 and 553, with G pixel 514,516,554 and 556 additions, then, with the addition G signal framing of gained at centre of form B.By further moving horizontally three pixels from G pixel 514,516,554 and 556, with R image signal 517,519,557 and 559 additions, then, with the addition R signal framing of gained at centre of form C.

By mobile three pixels that tilt, will be arranged in G pixel 542,544,582 and 584 additions of the row of even-numbered, and with the addition G signal framing of gained at centre of form D.By moving horizontally three pixels from G pixel 542,544,582 and 584, with G pixel 545,547,585 and 587 additions, then, with the addition G signal framing of gained at centre of form E.

By this way, by on whole pixel region as mentioned above with the color pixel addition, the pixel addition of same color can be kept the original color pattern simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Meanwhile, can export sum signal with the colour image identical with the colour image that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

Citation form

By the first to the 5th embodiment, discussed and be used for by with the driving method of various patterns with pixel addition.General type with pixel addition is described below.

In comprising pixel region (pel array) solid state image pickup device with oblique pixel pattern, at the n of adjacent n * n pixel ²In the zone (n be three or larger odd number), extract out and be added in mutually x row and y (pixel of the same color in the row of n 〉=x 〉=y), simultaneously in horizontal or vertical direction with the regional mobile m pixel of n * n (m be three or larger odd number).In this situation, capable for odd-numbered of even-numbered is about to pixel addition respectively.In this case, the spatial relation between the neighbor in capable adjacent n * n the pixel of the neighbor in adjacent n * n the pixel that odd-numbered is capable and even-numbered is like this: their m pixels that in an inclined direction be shifted each other.

Driving method according to being used for carrying out above-mentioned pixel addition can keep the original color pattern simultaneously with pixel addition, and does not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.

As a result, by the impartial sampling in space, can obtain high-quality sum signal.Meanwhile, can export the signal of addition with the pattern identical with the pattern that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.In addition, as described below, because n 〉=x 〉=y, so there is no need to increase sample-hoking capacitor for pixel addition.

Solid state image pickup device

Provide now realizing the description with the example of the configuration of the solid state image pickup device of the driving method of pixel addition of being used for according to the first to the 5th embodiment.

Figure 16 schematic illustrations is the configuration of X-Y addressing solid state image pickup device (for example, cmos image sensor) according to an embodiment of the invention.

Cmos image sensor shown in Figure 16 comprises: pixel 10, pel array 11, colour filter 12, odd-numbered row drive wire group 13, even-numbered row drive wire group 14, odd-numbered column signal line (vertical signal line) group 15, even-numbered column signal line (vertical signal line) group 16, the capable circuit 17 of vertically selecting of odd-numbered, the capable circuit 18 of vertically selecting of even-numbered, odd-numbered ranks treatment circuit 19, even-numbered ranks treatment circuit 20, the capable transversal switch 21 of odd-numbered, the capable horizontal signal lines 22 of odd-numbered, the capable level of odd-numbered is selected circuit 23, output amplifier 24 and 28, the capable transversal switch 25 of even-numbered, the capable horizontal signal lines 26 of even-numbered, the capable level of even-numbered is selected circuit 27, and timing generative circuit 29.

In Figure 16, have by the pixel 10 with the optical-electrical converter of matrix arrangements and form pel arrays (pixel region) 11.In pel array 11, even numbered columns pixel 10 is upper from 1/2 of the about pixel pitch of odd numbered columns pixel 10 displacements at column direction (vertical direction among Figure 16), and with the capable pixel 10 of even-numbered in the row direction (horizontal direction among Figure 16) upper from 1/2 of the about pixel pitch of capable pixel 10 displacements of odd-numbered.In other words, pel array 11 has formed oblique pixel pattern.

In the pel array 11 with oblique pixel pattern, will have the colour filter 12 that moves 45 ° color-code (seeing Fig. 8) from Bayer pattern and be arranged on the pixel 10.Provide the odd-numbered row drive wire of odd-numbered row drive wire group 13 to each odd number code line of pixel 10, and, each even numbered row of pixel 10 is provided the even-numbered row drive wire of even-numbered row drive wire group 14.The odd-numbered column signal line of odd numbered columns signal line group 15 is connected to each odd numbered columns pixel 10, and, the even-numbered column signal line of even numbered columns signal line group 16 is connected to each even numbered columns pixel 10.

One end of each odd-numbered row drive wire of odd-numbered row drive wire group 13 is connected to the capable corresponding output of vertically selecting circuit 17 of odd-numbered.One end of each even-numbered row drive wire of even-numbered row drive wire group 14 is connected to the capable corresponding output of vertically selecting circuit 18 of even-numbered.The capable capable vertical circuit 18 of selecting of circuit 17 and even-numbered of vertically selecting of odd-numbered has formed the row selector that is used for being chosen in via odd-numbered row drive wire group 13 and even-numbered row drive wire group 14 respectively pel array 11 pixels 10 not adjacent to each other, that odd-numbered is capable and even-numbered is capable.

One end of each odd-numbered column signal line of odd numbered columns signal line group 15 is connected to the input of the corresponding odd-numbered ranks treatment circuit 19 of a side (in this embodiment, the downside among Figure 16) that is disposed in pel array 11.Picture element signal during odd-numbered ranks treatment circuit 19 storage odd-numbereds are capable, and picture element signal addition in other row with each.

One end of each even-numbered column signal line of even numbered columns signal line group 16 is connected to the input of the corresponding even-numbered ranks treatment circuit 20 of the opposite side (in this embodiment, the upside among Figure 16) that is disposed in pel array 11.Picture element signal in the row of even-numbered ranks treatment circuit 20 storage even-numbereds, and picture element signal additions in other row with all.

The physical circuit configuration of odd-numbered ranks treatment circuit 19 and even-numbered ranks treatment circuit 20 is described below.Being attached to odd-numbered ranks treatment circuit 19 among Figure 16 and symbol A, B on the even-numbered ranks treatment circuit 20 and C is for distinguishing the switch shown in Figure 17.

Via the capable transversal switch 21 of odd-numbered of correspondence the output of odd-numbered ranks treatment circuit 19 is connected to odd-numbered horizontal signal lines 22.Select the capable transversal switch 21 of circuit 23 selective sequential odd-numbereds by the capable level of odd-numbered, so that signal that will addition in odd-numbered ranks treatment circuit 19 reads into the capable horizontal signal lines 22 of odd-numbered.In output amplifier 24, amplify the signal that is read out to the capable horizontal signal lines 22 of odd-numbered, and then with its output.

Via the capable transversal switch 25 of even-numbered of correspondence the output of even-numbered ranks treatment circuit 20 is connected to the capable horizontal signal lines 26 of even-numbered.Select the capable transversal switch 25 of circuit 27 selective sequential even-numbereds by the capable level of even-numbered, so that signal that will addition in even-numbered ranks treatment circuit 20 reads into the capable horizontal signal lines 26 of even-numbered.In output amplifier 28, amplify the signal that is read out to the capable horizontal signal lines 26 of even-numbered, and then with its output.

The capable level of odd-numbered selects circuit 23 and the capable level of even-numbered to select circuit 27 to be formed for selecting the column selector that is listed as, so that column number and even-numbered the column number capable in of odd-numbered in capable is inconsistent.Select circuit 23 and the capable level of even-numbered to select the driving control of circuit 27 based on carry out capable circuit 17, capable circuit 18, odd-numbered ranks treatment circuit 19, even-numbered ranks treatment circuit 20, the capable level of odd-numbered vertically selected of even-numbered vertically selected of odd-numbered from the various timing signals of timing generative circuit 29 outputs.

Figure 17 is the circuit diagram of example of the configuration of diagram odd-numbered ranks treatment circuit 19, supposes the pixel of the same color in addition two row and two row move 45 ° color-code (seeing Fig. 8) from Bayer pattern.Even-numbered ranks treatment circuit 20 has identical configuration basically.

In Figure 17, clamper (clamp) impulse line 31, clamp voltage line 32, record controls line 33, addition control line 34, A switching line 35, B switching line 36, C switching line 37 and clamp voltage line 38 are connected to odd-numbered column processing circuit 19A, the 19B of a unit of formation and each among the 19C (corresponding to column processing circuit A, B and C shown in Figure 16).

Column processing circuit 19A, 19B, 19C have identical Circnit Layout basically.Column processing circuit 19A comprises: clamp capacitor 41A; First, second, and third switch 42A, 43A and 44A; And sample-hoking capacitor 45A.Column processing circuit 19B comprises: clamp capacitor 41B; First, second and the 3rd switch 42B, 43B and 44B; And sample-hoking capacitor 45B.Column processing circuit 19C comprises: clamp capacitor 41C; First, second and the 3rd switch 42C, 43C and 44C; And sample-hoking capacitor 45C.Can be with the N-channel MOS transistor as first, second and the 3rd switch.

Below by the more specifically configuration of discussing column processing circuit 19 take column processing circuit 19A as example.The end of clamp capacitor 41A is connected to an end of the corresponding odd-numbered column signal line (vertical signal line) of odd numbered columns signal line group 15.Between the other end of clamp capacitor 41A and clamp voltage line 32, connect the first switch 42A, and the grid of the first switch 42A is connected to clamp pulse line 31.The main electrode of second switch 43A is connected to the other end of clamp capacitor 41A, and its gate electrode is connected to record controls line 33.

The main electrode of the 3rd switch 44A is connected to another main electrode of second switch 43A, and its gate electrode is connected to A switching line 35.In column processing circuit 19B, the gate electrode of the 3rd switch 44B is connected to B switching line 36.In column processing circuit 19C, the gate electrode of the 3rd switch 44C is connected to C switching line 37.The end of sample-hoking capacitor 45A is connected to another main electrode of the 3rd switch 44A, and its other end is connected to clamp voltage line 38.

Among column processing circuit 19A, the 19B and 19C of configuration in the above, in this embodiment, with the picture element signal addition among column processing circuit 19A and the 19C.In addition, between column processing circuit 19A and 19C, more specifically, between the 3rd switch 44A in column processing circuit 19A and 19C and the main electrode of 44C, connect addition switch 46.Can be with the N-channel MOS transistor as addition switch 46.The grid of addition switch 46 is connected to addition control line 34.

The operation that comprises the cmos image sensor with oblique pixel pattern of the column processing circuit 19A, the 19B that dispose above and 19C according to this embodiment is described below with reference to the sequential chart of Figure 18.

Figure 18 illustrates the timing relationship between the following pulse: reset pulse is used for the electromotive force in the floating diffusion region of reset of pixels 10; Electric charge shifts pulse, is used for being transferred to floating diffusion region by the signal charge of light-to-current inversion at photoelectric transformer; Clamp pulse is provided to clamp pulse line 31; The record controls pulse is provided to record controls line 33; The addition control impuls is provided to addition control line 34; The A switching pulse is provided to A switching line 35; The B switching pulse is provided to B switching line 36; And the C switching pulse, be provided to C switching line 37.

When operation has the cmos image sensor of oblique pixel pattern of this embodiment in the addition read mode, the addition control impuls is changed to the H level, so that addition switch 46 is in " leading to " (ON) state.If do not carry out the phase add operation, the addition control impuls is changed to the L level, so that addition switch 46 is in " breaking " (OFF) state.In this situation, preferably dummy switch (dummyswitch) is arranged in column processing circuit 19 and 20, becomes not obvious so that be connected to the variation of load capacitance of the addition switch 46 of vertical signal line in the odd-numbered row signal line group 15 and the vertical signal line in the even-numbered row signal line group 16.

In Figure 16, select the first row by the capable circuit 17 vertically selected of odd-numbered by vertical scanning, select fourth line by the capable circuit 18 vertically selected of even-numbered by vertical scanning.By selecting by this way row, it is capable and even-numbered is capable to read simultaneously odd-numbered not adjacent to each other, and this is the feature of embodiments of the invention.For easy to understand, below and the first embodiment (Figure 11) come together to describe this point.

At first reset pulse is provided to pixel in selected two row (first and fourth line), then, reflects that the resetting voltage of the reset level of this pixel appears in the respective signal line of vertical signal line group 15 and 16.In this situation, clamp pulse is changed to the H level, so that the first switch 42A, 42B and 42C among Figure 17 connect " leading to ", then, the resetting voltage with the holding wire in vertical signal line group 15 and 16 is stored in (the first resetting voltage reads period) among clamp capacitor 41A, 41B and the 41C.Then, clamp pulse is changed to the L level, to close " breaking " first switch 42A, 42B and 42C.

Subsequently, electric charge is shifted pulse be provided to selected two row (first and fourth line), then, the signal voltage of the optical signalling level of reflection pixel 10 appears in the respective signal line of vertical signal line group 15 and 16.In this situation, owing to generated signal voltage and be stored in poor between the resetting voltage among clamp capacitor 41A, 41B and the 41C, so eliminated fixed pattern noise (first signal voltage reads period) from pixel 10.

Then, the record controls pulse is changed to the H level, and, the A switching pulse is changed to the H level, so that will be wherein the 3rd switch 44A (hereinafter, be called " A switch 44A " for short) be connected to the signal in signal plus in the row of A switching line 35 is connected to C switching line 37 to the 3rd switch 44C (being called hereinafter, " C switch 44C " for short) wherein the row.

As a result, will be connected to the signal in the row of A switch 44A via addition switch 46 and be connected to signal plus in the row of C switch 44C, and, with the signal storage of addition in the sample-hoking capacitor 45A of column processing circuit 19A.More specifically, in Figure 11, in the row of odd-numbered, with the signal of R pixel 111 and the signal plus of R pixel 113, with the signal of G pixel 114 and the signal plus of G pixel 116, etc.In the row of even-numbered, with the signal of G pixel 142 and the signal plus of G signal 144, with the signal of B signal 145 and the signal plus of B signal 147, etc.

Then, record controls pulse and A switching pulse are all changed to the L level.After this, the reset unsteady diffusion (FD) of selected two row.Be to comprise that the first resetting voltage reads period and first signal voltage and reads first of period and read period the period of these operations up till now.

Subsequently, in Figure 16, select fifth line by the capable circuit 17 vertically selected of odd-numbered by vertical scanning, and, the 8th row selected by the capable circuit 18 of vertically selecting of even-numbered by vertical scanning.It is capable and even-numbered is capable to read simultaneously odd-numbered not adjacent to each other.

At first reset pulse is provided to the pixel in selected two row (fifth line and the 8th row), then, reflects that the resetting voltage of the reset level of this pixel appears in the respective signal line of vertical signal line group 15 and 16.Then, clamp pulse is changed to the H level, in order to meet " leading to " first switch 42A, 42B and 42C, and the resetting voltage of the holding wire in vertical signal line group 15 and 16 is stored in (the second resetting voltage reads period) among clamp capacitor 41A, 41B and the 41C.Then, clamp pulse is changed to the L level, to close " breaking " first switch 42A, 42B and 42C.

Subsequently, electric charge is shifted pulse be provided to selected two row (the 5th and the 8th row), and, reflect that the signal voltage of the optical signalling level of this pixel appears in the respective signal line of vertical signal line group 15 and 16.Owing to generated signal voltage and be stored in poor between the resetting voltage among clamp capacitor 41A, 41B and the 41C, so can eliminate fixed pattern noises (secondary signal voltage reads period) from pixel 10.

Then, the record controls pulse is changed to the H level, and, the C switching pulse is changed to the H level, be added to signal in the row that are connected to C switch 44C so that be connected to signal in the row of A switch 44A, and with the signal storage of addition in the sample-hoking capacitor 45C of column processing circuit 19C.

As a result, will be connected to the signal in the row of A switch 44A via addition switch 46 and be connected to signal plus in the row of C switch 44C, and, with the signal storage of addition in the sample-and-hold circuit 45C of column processing circuit 19C.More specifically, in Figure 11, in the row of odd-numbered, with the signal of R pixel 151 and the signal plus of R pixel 153, with the signal of B pixel 154 and the signal plus of B pixel 156, etc.In the row of even-numbered, with the signal of G pixel 182 and the signal plus of G pixel 184, with the signal of G pixel 185 and the signal plus of G pixel 187, etc.

Subsequently, record controls pulse and C switching pulse are changed to the L level, and, the floating diffusion region of the pixel of selected two row that reset.Then, A switching pulse and C switching pulse are changed to the H level, in order to connect A switch 44A and C switch 44C.As a result, the sample-hoking capacitor 45A of column processing circuit 19A and 19C and the vertically addition of horizontal summation signal (vertical summation period) among the 45C will be stored in.

More specifically, in the row of odd-numbered, with the horizontal summation signal (signal of the signal of R pixel 111 and R pixel 113, B pixel 114 and B pixel 116 that is stored among the sample-hoking capacitor 45A, etc.) and the horizontal summation signal (signal of the signal of R pixel 151 and R pixel 153, B pixel 154 and B pixel 156, etc.) vertically addition.

In the row of even-numbered, with the horizontal summation signal (signal of the signal of G pixel 142 and G pixel 144, G pixel 145 and G pixel 147 that is stored among the sample-hoking capacitor 45A, etc.) and the horizontal summation signal (signal of the signal of G pixel 182 and G pixel 183, G pixel 185 and G pixel 187, etc.) vertically addition.

According to above-mentioned phase add operation, move 45 ° the color-code of the first embodiment from Bayer pattern, from 3 * 3 pixel regions, extract out and addition two row and two row in the pixel of same color.Can from sample-hoking capacitor 45A or 45C, read the signal that obtains by with these pixel addition.Be to comprise that the second resetting voltage reads second of the period of reading in period, secondary signal voltage and vertical summation period and reads period the period of operation up till now.

In the read method of mentioning in front, with the signal of the addition of a horizontal x pixel (in this embodiment, x=2) being stored in unitary sampling keeps in the capacitor 45 (45A, 45B or 45C), and, the vertical y row of similar number (y=2) are repeated this operation in this embodiment.In this situation, if x 〉=y is enough for the sample-hoking capacitor 45 that the row of the original pixels pattern of similar number provide then.Like this, the phase add operation does not just need extra sample-hoking capacitor

First reads and forms horizontal blanking interval (blanking period) in period and the second period of reading.Interim a horizontal blanking, the row of odd-numbered not adjacent to each other and the row of even-numbered are read repeatedly (in this embodiment, because with vertical two pixels (two row) addition, think twice), this is the feature of this embodiment of the present invention.After this horizontal blanking interval, level begins the period of reading.

If the interim signal of reading addition from the sample-hoking capacitor 45A of column processing circuit 19A when vertical summation then can select to select in the circuit 23 first row, the 4th row, the 7th row etc. according to the capable level of odd-numbered that is configured in shown in Figure 16.Then, can extract the signal of the addition in the row of odd-numbered out.Similarly, can select circuit 27 to select secondary series, the 5th row, the 8th row etc. by the capable level of even-numbered, then, can extract the signal of the addition in the row of this even-numbered out.

In this situation, select corresponding to the capable row of odd-numbered with corresponding to the capable row of even-numbered, so that they are shifted each other.In other words, select the capable corresponding column number of circuit 23 selected odd-numbereds and select the capable corresponding column number of circuit 27 selected even-numbereds inconsistent with the capable level of even-numbered with the capable level of odd-numbered.The pattern of sum signal needs the master pattern of matched pixel signal.

As mentioned above, the solid state image pickup device with oblique pixel pattern comprises: vertically select circuit 17 and 18, be used for repeatedly selecting simultaneously respectively odd-numbered not adjacent to each other capable and even-numbered is capable in that horizontal blanking is interim; Column processing circuit 19 (19A, 19B and 19C) and 20 (20A, 20B and 20C) have respectively the capable transversal switch 21 of odd-numbered and the capable transversal switch 25 of even-numbered; And level selection circuit 23 and 27, be respectively applied to selector switch 21 and 25.Utilize this configuration, make with the capable corresponding row of selected odd-numbered with row corresponding to the row of even-numbered to be shifted each other.Therefore, after with pixel addition, can keep original color coding, and not change the pixel pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Meanwhile, can export sum signal with the colour image identical with the colour image that obtains by the progressive read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

Example application

Above-mentioned X-Y addressing solid state image pickup device (its exemplary is cmos image sensor) with oblique pixel pattern is suitably used the imaging device that acts on the imaging device (camera module) such as digital still life camera or video camera.

Figure 19 is the according to an embodiment of the invention block diagram of the example of the configuration of imaging device of diagram.Imaging device shown in Figure 19 comprises lens 51, imaging device 52, signal processing circuit 52, mode setting unit 54 and device drive circuit 55.

Lens 51 form image corresponding to light that reflects with object at the imaging surface (imaging plane) of imaging device 52.Under the control of device drive circuit 55, imaging device 52 forms scioptics 51 at imaging surface optical imagery is converted into the signal of telecommunication take pixel as unit, and the picture signal of output gained.With according to the X-Y addressing solid state image pickup device (its exemplary is cmos image sensor) that comprises oblique pixel pattern of above-described embodiment as imaging device 52.Can will install drive circuit 55 by technology in the chip is installed on the imaging device 52.

53 pairs of picture signals from imaging device 52 outputs of signal processing circuit are carried out various signal processing operations.In response to user's indication, the addition read mode that mode setting unit 54 optionally is provided for reading the gradual read mode of all picture element signals or is used for carrying out pixel addition is as the operator scheme of imaging device 52.

Device drive circuit 55 is formed by timing generative circuit 29 for example shown in Figure 16, and the driving that the mode signal that provides from mode setting unit 54 is controlled timing device 52 is provided.

More specifically, when in imaging device shown in Figure 16 (cmos image sensor), having specified progressive read mode, device drive circuit 55 is carried out control, so that level selects circuit 17 and 18 to select respectively odd-numbered capable and even-numbered is capable, and, select the respectively signal that from the pixel of selected row, reads of selective sequential of circuit 23 and 27 by level.

When having specified the addition read mode, device drive circuit 55 is carried out control, so that by vertical selection circuit 17 and 18 at the interim row of odd-numbered not adjacent to each other and a row of even-numbered repeatedly selected simultaneously respectively of horizontal blanking, and, respectively with the signal level ground addition of the pixel of selected row, and select circuit 23 and 27 to call over the signal of addition by level by the column processing circuit 19 with transversal switch 21 and 25 (19A, 19B and 19C) and 20 (20A, 20B and 20C).

As discussed above, will be carried in the imaging device such as digital still life camera or video camera according to the X-Y addressing solid state image pickup device (its exemplary is cmos image sensor) with oblique pixel pattern of one of above-described embodiment.Therefore, this imaging device can tackle gradual read mode and addition read mode the two.In addition, this imaging device can be exported the signal that gradual read mode acquisition is passed through in the sum signal conduct with identical colour image.As a result, by the impartial sampling in space, can obtain the signal of high-quality addition, and the signal that can be convenient in the signal processing circuit 53 is processed.

The 6th embodiment

The colour image of Figure 21 diagram colour filter according to a sixth embodiment of the invention.In the solid state image pickup device that comprises according to the colour image of the 6th embodiment, the pixel (not shown) that will have as shown in figure 21, in the vertical direction photoelectric transformer on (column direction) and the horizontal direction (line direction) is arranged in the cage with equal intervals (pixel pitch) d.

In this cage pattern of pixels, in the first row, RGRB is repeated as the unit to arrange in the horizontal direction take four pixels, in the second row, only arrange the G pixel, in the third line, BGRG is repeated as the unit to arrange in the horizontal direction take four pixels, and in fourth line, only arrange the G pixel.After this, repeat to arrange this four lines.

In the colour image of this embodiment, as finding out from Figure 21, be arranged such that as color component (being in this embodiment the G component) and other component (being in this example R and B component) for the primary color component that generates brightness (Y) component the G component surrounds R and B component.In addition, in this colour image, on vertical and horizontal direction, arrange R and B pixel with regular interval 4d.

In the colour image of above-mentioned configuration, if the pixel sampling rate on vertical and the horizontal direction is set to pixel pitch d, be d to the sampling rate of G pixel then, and the sampling rate of R and B pixel is 2d.In other words, every row (in this embodiment, the row of odd-numbered) and interlacing (in this embodiment, the row of odd-numbered) arrange R pixel or B pixel so that on vertical and horizontal direction, the sampling rate of R and B pixel is become 1/2 of the sampling rate of G pixel.Therefore, the resolution of R and B pixel be the G pixel resolution 1/2.On 45 ° of incline directions, to the sampling rate of G pixel be

And to the sampling rate of R and B pixel be

Figure 22 A and 22B illustrate wherein the G pattern that G pixel is only extracted out from colour image shown in Figure 21.Consider the spatial frequency characteristic of G pixel in conjunction with Figure 22 A and 22B.On vertical and horizontal direction, because the sampling rate of G pixel is d, shown in Figure 22 A, so can collection frequency the highest (1/2) fs (fs: signal component sampling frequency) according to sampling theorem.On 45 ° of incline directions, owing to the sampling rate of G pixel be

Shown in Figure 22 B, so can collection frequency the highest according to sampling theorem

Signal component.

Similarly, the below considers the spatial frequency characteristic of R and B pixel.In this situation, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Figure 22 C and 22D illustrate wherein the R pattern that R pixel is only extracted out from colour image shown in Figure 21.In Figure 22 A to 22D, indicate the threshold frequency component that on vertical, level and incline direction, can collect with empty row and halftoning row.

On vertical and horizontal direction, owing to the sampling rate of R pixel is 2d, shown in Figure 22 C, thus according to sampling theorem can collection frequency the signal component of the highest 1/4fs.On the direction of 45 ° of inclinations, owing to the sampling rate of R pixel be

Shown in Figure 22 D, so can collection frequency the highest according to sampling theorem

Signal component.

According to above-mentioned some, Figure 23 indicates the spatial frequency characteristic of the colour image of the 6th embodiment.About the spatial frequency characteristic of G pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/2) fs, and in an inclined direction is can collection frequency the highest

Signal component.About the spatial frequency characteristic of R and B pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/4) fs, and in an inclined direction is can collection frequency the highest

Signal component.

The 7th embodiment

The colour image of Figure 24 diagram colour filter according to a seventh embodiment of the invention.As use the solid-state imaging apparatus of colour image of the 6th embodiment shown in Figure 21, use the solid-state imaging apparatus of the colour filter of this embodiment to have the pattern of pixels of cage.

In the colour image of this embodiment, in the first row, RGGG is repeated as the unit to arrange in the horizontal direction take four pixels, in the second row, only arrange the G pixel, in the third line, GGBG is repeated as the unit to arrange in the horizontal direction take four pixels, and in fourth line, only arrange the G pixel.After this, repeat to arrange this four lines.

In the colour image of this embodiment, as finding out from Figure 24, wherein color component (being in this embodiment the G component) and other component (being in this example R and B component) as the primary color component that is used for generation brightness (Y) component is arranged such that the G component surrounds R and B component.In addition, in this colour image, as the colour image among the 6th embodiment, on vertical and horizontal direction, arrange R and B pixel with regular interval 4d.

In the colour image of above-mentioned configuration, if the pixel sampling rate on vertical and the horizontal direction is set to pixel pitch d, be d to the sampling rate of G pixel then, and be 4d for the sampling rate of R and B pixel.In other words, every row (in this embodiment, odd-numbered is capable) and interlacing (in this embodiment, odd numbered columns) arrange R pixel or B pixel so that on vertical and horizontal direction, the sampling rate of R and B pixel is become 1/4 of the sampling rate of G pixel.Therefore, the resolution of R and B pixel be the G pixel resolution 1/4.On the direction of 45 ° of inclinations, to the sampling rate of G pixel be

Sampling rate to R and B pixel is

Figure 25 A and 25B illustrate wherein the G pattern that G pixel is only extracted out from colour image shown in Figure 24.Consider the spatial frequency characteristic of G pixel in conjunction with Figure 25 A and 25B.On vertical and horizontal direction, because the sampling rate of G pixel is d, shown in Figure 25 A, so can collection frequency the highest (1/2) fs (fs: signal component sampling frequency) according to sampling theorem.On the direction of 45 ° of inclinations, owing to the sampling rate of G pixel be

Shown in Figure 25 B, so can collection frequency the highest according to sampling theorem

Signal component.

Similarly, the below considers the spatial frequency characteristic of R and B pixel.In this situation, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Figure 25 C and 25D illustrate wherein the R pattern that R pixel is only extracted out from pattern of pixels shown in Figure 24.In Figure 25 A to 25D, indicate the threshold frequency component that on vertical, level and incline direction, can collect by sky row and halftoning row.

On vertical and horizontal direction, owing to the sampling rate to the R pixel is 4d, shown in Figure 25 C, thus according to sampling theorem can collection frequency the signal component of the highest 1/8fs.On the direction of 45 ° of inclinations, owing to the sampling rate of R pixel be Shown in Figure 25 D, so can collection frequency the highest according to sampling theorem

Signal component.

According to above-mentioned some, Figure 26 indicates the spatial frequency characteristic of the colour image of the 7th embodiment.About the spatial frequency characteristic of G pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/2) fs, and in an inclined direction is can collection frequency the highest

Signal component.About the spatial frequency characteristic of R and B pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/8) fs, and in an inclined direction is can collection frequency the highest

Signal component.

The 8th embodiment

Figure 27 diagram is according to the colour image of the colour filter of the eighth embodiment of the present invention.As shown in figure 27, use the solid-state imaging apparatus according to the colour image of this embodiment to have oblique pixel pattern, wherein the pixel pitch on vertical and the horizontal direction is set to different from the pixel pitch d of cage pattern of pixels shown in Figure 21

And, the even numbered columns pixel is expert at and the about pixel pitch of column direction superior displacement from the odd numbered columns pixel

1/2.In other words, in every delegation, in the horizontal direction with

The pitch laying out pixel, and at each row, in the vertical direction with

The pitch laying out pixel.

In having the colour image of this oblique pixel pattern, in the first row, alternately arrange G and R pixel, in the second row, only arrange the G pixel, in the third line, alternately arrange B and G pixel, and in fourth line, only arrange the G pixel.After this, repeat to arrange this four lines.

In the colour image of this embodiment, as finding out from Figure 27, wherein color component (being in this embodiment the G component) and other component (being in this example R and B component) as the primary color component that is used for generation brightness (Y) component is arranged such that the G component surrounds R and B component.In this colour image, on vertical and horizontal direction with regular interval

Arrange R and B pixel.This colour image equals colour image from the cage pattern of pixels of the 6th embodiment shown in Figure 21 and moves pattern after 45 °.

In the colour image of above-mentioned configuration, on vertical and horizontal direction, to the sampling rate of G pixel be And for the sampling rate of R and B pixel be

In other words, every row (in this embodiment, the row of odd-numbered) and interlacing (in this embodiment, the row of odd-numbered) arrange R pixel or B pixel so that on vertical and horizontal direction, the sampling rate of R and B pixel is become 1/4 of the sampling rate of G pixel.Therefore, the resolution of R and B pixel be the G pixel resolution 1/4.On 45 ° of incline directions, be d to the sampling rate of G pixel, and be 2d to the sampling rate of R and B pixel.

Figure 28 A and 28B illustrate wherein the G pattern that G pixel is only extracted out from colour image shown in Figure 27.Consider the spatial frequency characteristic of G pixel in conjunction with Figure 28 A and 28B.On vertical and horizontal direction, because the sampling rate of G pixel is Shown in Figure 28 A, so can collection frequency the highest according to sampling theorem

(fs: signal component sampling frequency).On 45 ° of incline directions owing to be d to the sampling rate of G pixel, shown in Figure 28 B, thus according to sampling theorem can collection frequency the highest (1/4) fs signal component.

Similarly, the below considers the spatial frequency characteristic of R and B pixel.In this situation, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Figure 28 C and 28D illustrate wherein the R pattern that R pixel is only extracted out from pattern of pixels shown in Figure 27.In Figure 28 A to 28D, indicate the threshold frequency component that on vertical, level and incline direction, can collect by sky row and halftoning row.

On vertical and horizontal direction, owing to the sampling rate of R pixel be

Shown in Figure 28 C, so can collection frequency the highest according to sampling theorem

Signal component.On 45 ° of incline directions because the sampling rate of R pixel is 2d, shown in Figure 28 D, thus according to sampling theorem can collection frequency the highest (1/2) fs signal component.

According to above-mentioned some, Figure 29 indicates the spatial frequency characteristic of the colour image of the 8th embodiment.About the spatial frequency characteristic of G pixel, on vertical and horizontal direction, can collection frequency the highest

Signal component, and in an inclined direction, signal component that can collection frequency the highest (1/4) fs.About the spatial frequency characteristic of R and B pixel, on vertical and horizontal direction, can collection frequency the highest

Signal component, and in an inclined direction, signal component that can collection frequency the highest (1/2) fs.

In the above-described embodiments, the spatial frequency characteristic of the G pixel shown in Figure 23,26 and 29 is theoretic frequency characteristic, supposes that camera signal treatment system (the camera signal treatment circuit 1014 shown in Figure 20) execution of discussing below is used for the interpolation processing of interpolation G pixel on R and B locus.

Figure 30 A illustrates according to the comparative result between the spatial frequency characteristic of the G pixel of the spatial frequency characteristic (spatial resolution) of the G pixel of the colour image of the 6th to the 8th embodiment and known colour image (Bayer pattern and Baeyer pixel move pattern).Figure 30 B illustrates according to the comparative result between the spatial frequency characteristic of the R of the spatial frequency characteristic (spatial resolution) of the R of the colour image of the 6th to the 8th embodiment and B pixel and known colour image (Bayer pattern and Baeyer pixel move pattern) and B pixel.

Figure 30 A illustrates: the 6th is identical with the additional space frequency characteristic that the Baeyer pixel moves pattern with the spatial frequency characteristic of G pixel on 45 ° of incline directions of the colour image of the 7th embodiment, and wherein to move the additional space frequency characteristic of pattern higher than the additional space frequency characteristic of Bayer pattern for the Baeyer pixel; And the 6th is higher than the additional space frequency characteristic of Bayer pattern with the spatial frequency characteristic of G pixel on vertical and horizontal direction of the colour image of the 7th embodiment, and wherein the additional space frequency characteristic of Bayer pattern is higher than the additional space frequency characteristic that Baeyer pixel moves pattern.

Figure 30 A also illustrates: the spatial frequency characteristic of the G pixel of the colour image of the 8th embodiment on vertical and horizontal direction is identical with the additional space frequency characteristic of Bayer pattern, and wherein the additional space frequency characteristic of Bayer pattern moves the additional space frequency characteristic height of pattern than Baeyer pixel; And the spatial frequency characteristic of the G pixel of the 8th embodiment on 45 ° of incline directions is higher than the additional space frequency characteristic that Baeyer pixel moves pattern, and wherein the Baeyer pixel moves the additional space frequency characteristic of pattern than the additional space frequency characteristic height of Bayer pattern.

Figure 30 B illustrates: the R of the colour image of the 6th embodiment and the B pixel spatial frequency characteristic on vertical and horizontal direction is identical with the additional space frequency characteristic of Bayer pattern, and wherein the additional space frequency characteristic of Bayer pattern is lower than the additional space frequency characteristic that Baeyer pixel moves pattern; And the R of the colour image of the 6th embodiment and the B pixel spatial frequency characteristic on 45 ° of incline directions is lower than the additional space frequency characteristic that Baeyer pixel moves pattern, and wherein the Baeyer pixel moves the additional space frequency characteristic of pattern than the additional space frequency characteristic height of Bayer pattern.

Figure 30 B also illustrates: the R of the colour image of the 7th embodiment is lower than the additional space frequency characteristic of Bayer pattern with the spatial frequency characteristic of B pixel on vertical and horizontal direction, and wherein the additional space frequency characteristic of Bayer pattern is lower than the additional space frequency characteristic that Baeyer pixel moves pattern; And the R of the colour image of the 7th embodiment is identical with the additional space frequency characteristic of the 6th embodiment with the spatial frequency characteristic of B pixel on 45 ° of incline directions.

Figure 30 B also illustrates: the R of the colour image of the 8th embodiment is lower than the additional space frequency characteristic of Bayer pattern with the spatial frequency characteristic of B pixel on vertical and horizontal direction, and wherein the additional space frequency characteristic of Bayer pattern is lower than the additional space frequency characteristic that Baeyer pixel moves pattern; And the R of the colour image of the 8th embodiment and the B pixel spatial frequency characteristic on 45 ° of incline directions is lower than the additional space frequency characteristic that Baeyer pixel moves pattern.

These comparative results show: the 6th with the G pixel of the colour image of the 7th embodiment on vertical and horizontal direction and the G pixel of the colour image of the 8th embodiment represented the higher spatial frequency characteristic of spatial frequency characteristic than known colour image (Bayer pattern and Baeyer pixel move pattern) at 45 ° of incline directions.Because the G pixel is for the basic pixel that generates brightness (Y) component, so the higher spatial frequency characteristic of G pixel helps to improve resolution very much.

On the contrary, the spatial frequency characteristic of R and B pixel is lower than the spatial frequency characteristic of known colour image (Bayer pattern and Baeyer pixel move pattern).Yet as mentioned above, human eyes are more insensitive to R and B color, and like this, the low characteristic of R and B color can not have a strong impact on the raising of resolution.

As discussed above, the pixel that comprises therein photoelectric transformer by bidimensional be arranged in the matrix and comprise that the colour filter as the G component of the fundamental component that is used for generating brightness (Y) component and other R and B component is disposed in the lip-deep solid-state imaging apparatus of pixel, arrange colour filter, so that the G pixel is surrounded R and B pixel.Therefore, the G pixel arrangement in all row of colour filter and all row, had the spatial frequency characteristic (spatial resolution) of the G component of higher sensitivity thereby increase human eyes to it.

More specifically, the resolution of G pixel on vertical and horizontal direction is greater than or equal to the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on 45 ° of incline directions is greater than or equal to the corresponding resolution that the Baeyer pixel moves pattern, and wherein the Baeyer pixel corresponding resolution that moves pattern is higher than the corresponding resolution of Bayer pattern.As a result, not only to achromatic object, and to the object of colour, can represent higher resolution.

In addition, to move pattern different from known Baeyer pixel, there is no need to adjust the RGB balance in the camera signal treatment system that to be described below, overcome the low resolution of G pixel, thereby prevented the generation that departs from caused wrong color in the balance of power level.

Particularly, in the colour image of the 6th embodiment, interlacing and arrange R and B pixel every row so that R and the B pixel sampling rate on vertical and horizontal direction become the G pixel sampling rate 1/2.Therefore, the resolution of G pixel on vertical and horizontal direction is higher than the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on 45 ° of incline directions is comparable to the resolution that the Baeyer pixel moves pattern, and wherein the Baeyer pixel corresponding resolution that moves pattern is higher than the corresponding resolution of Bayer pattern.

In the colour image of the 7th embodiment, interlacing and arrange R and B pixel every row so that R and the B pixel sampling rate on vertical and horizontal direction become the G pixel sampling rate 1/4.Therefore, as the colour image of the 6th embodiment, the resolution of G pixel on vertical and horizontal direction is higher than the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on 45 ° of incline directions is comparable to the corresponding resolution that the Baeyer pixel moves pattern, and wherein the Baeyer pixel corresponding resolution that moves pattern is higher than the corresponding resolution of Bayer pattern.

In the colour image of the 8th embodiment, therein the pixel of even-numbered is expert at and column direction on from the oblique pixel pattern of pixel shift 1/2 pixel pitch of odd-numbered, interlacing and arrange R and B pixel every row ground so that R and the B pixel sampling rate on vertical and horizontal direction become the G pixel sampling rate 1/4.Therefore, as the colour image of the 8th embodiment, the resolution of G pixel on vertical and horizontal direction is comparable to the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on the 45 ° of directions that tilt doubles the corresponding resolution of Bayer pattern.

Particularly, in the colour image of the 8th embodiment with oblique pixel pattern, sampling rate is the sampling rate of Bayer pattern

Doubly.Therefore, can obtain the many Pixel Information of twice of cage pattern of pixels, that is, compare with the cage pattern of pixels and can obtain higher resolution.If resolution that need to be identical with cage pattern of pixels resolution, then can be on wider pitch laying out pixel.As a result, can increase pixel aperture (pixel aperture), so that can increase the photo sensitivity of pixel, thus obtain to have the signal of high S/N ratio.

In the colour image of the 6th embodiment, Figure 23 illustrates: on vertical and horizontal direction, the spatial frequency characteristic of R and B pixel be the G pixel spatial frequency characteristic 1/2, and, on 45 ° of incline directions, its be the G pixel spatial frequency characteristic 1/4.In the colour image of the 7th embodiment, Figure 26 illustrates: on vertical and horizontal direction, the spatial frequency characteristic of R and B pixel be the G pixel spatial frequency characteristic 1/4, and on 45 ° of incline directions, its be the G pixel spatial frequency characteristic 1/4.In the colour image of the 8th embodiment, Figure 29 illustrates: on vertical and horizontal direction, the spatial frequency characteristic of R and B pixel be the G pixel spatial frequency characteristic 1/4, and on 45 ° of incline directions, its be the G pixel spatial frequency characteristic 1/2.

Yet the human human eyes of observability characteristic proof are easy to be familiar with the resolution of high brightness and are difficult to be familiar with high color-resolution.Therefore, the spatial frequency characteristic of above-mentioned R and B pixel is enough.

For example, in common television format signal, the frequency band (band) of colourity (C) signal be brightness (Y) signal frequency band 1/4, this is enough for color-resolution.The colour image of the 6th to the 8th embodiment has utilized this characteristic best.

In other words, colour image according to the 6th to the 8th embodiment, the color space frequency characteristic is reduced to the minimum level that can not allow human eyes produce factitious sensation, as an alternative, increase considerably the brightness space frequency characteristic with respect to known colour image.

In addition, in the colour image of the 6th to the 8th embodiment, in all row and all row, arrange the G pixel.This helps to be used for increasing the interpolation precision when the interpolation of R and B locus interpolation G pixel is processed when carrying out in the camera signal treatment system very much, and this point will be discussed below.

The solid-state imaging apparatus that comprises the colour filter of the colour image with the 6th to the 8th embodiment is suitable for being particularly suitable for as the imaging device in the video camera as the imaging device such as digital still life camera and video camera.

Imaging device

Figure 20 is the according to an embodiment of the invention block diagram of the example of the configuration of imaging device of diagram.In Figure 20, the image that the formation of the optical system such as lens 1011 on the imaging surface of imaging device 1012 is corresponding with the light that the object (not shown) reflects.As imaging device 1012, used comprising the pixel of photoelectric transformer and arranged by bidimensional ground and have a lip-deep solid-state imaging apparatus that is disposed in this pixel as the colour filter of the color component of the fundamental component that is used for generating luminance component and other color component.In this case, use the colour filter that has according to the colour image of the 6th, the 7th or the 8th embodiment.

Imaging device shown in Figure 20 comprises lens 1011, imaging device (solid state image pickup device) 1012, analog digital (A/D) transducer 1013 and camera signal treatment circuit 1014.Camera signal treatment circuit 1014 comprises optical system correcting circuit 1021, interpolation circuit 1022, brightness (Y) signal processing circuit 1023, colored (C) signal processing circuit 1024, frequency band limits low pass filter (LPF) 1025, and extracts treatment circuit 1026.

In the light on being incident on imaging device 1012, only the light component corresponding with the color component of colour filter passed through colour filter, and is incident on the pixel.Then, the light that will incide on the pixel by the photoelectric transformer such as photodiode is converted into the signal of telecommunication, and it is read as analog signal.Then, by A/D converter 1013 this analog signal conversion is become digital signal, and this digital signal is input to camera signal treatment circuit 1014.

The correction that optical system correcting circuit 1021 is carried out transducer or optical system is such as coming the correcting digital clamper for the adjustment for black level or being used for for the defect correction of defect correction imaging device 1012 and blackspot (shading) correction that is used for coming for edge light dark and gloomy (eclipse) correcting lens 1011.

Interpolation circuit 1022 generates the three dimensions signal from the rgb signal of space out-phase each other, the rgb signal that has same spatial location with generation, and this rgb signal is supplied to Y-signal treatment circuit 1023 and C signal processing circuit 1024.Y-signal treatment circuit 1023 generates brightness (Y) signal according to above-mentioned formula (1).C signal processing circuit 1024 generates color difference signal Cr (R-Y) and Cb (B-Y) according to equation (2).

Cr＝(R-Y)＝R-(0.3R+0.6G+0.1B)

Cb＝(B-Y)＝B-(0.3R+0.6G+0.1B) (2)

Frequency band limits LPF 1025 is that cut-off frequency equals 1/8 the filter of sampling frequency fs as shown in figure 31, and it is that (1/2) fs is to Cr and the Cb color difference signal of (1/8) fs that this filter weakens (drop) frequency range.Cr and Cb color difference signal according to television format signal output band restriction LPF 1025.If output Cr and Cb color difference signal then are that 1/8fs or higher signal are output as rub-out signal with frequency in the situation of not carrying out frequency band limits.Shown in figure 32, extract treatment circuit 1026 and extract Cr and Cb color difference signal.

The reason that be used for to extract Cr and Cb color difference signal is 1/4 of Cr and the Cb color difference signal frequency band that only needs brightness (Y) signal.This is to be determined by television format signal, and this also is difficult to recognize high-frequency colourity (C) signal because human eyes are easy to recognize high-frequency brightness (Y) signal.

When with Y: Cr: Cb=4: 4: 4 (output band of Y and C signal is identical) and Y: Cr: Cb=4: when the difference between 1: 1 is observed as output signal, except the special object of the object that for example uses red or Bluepoint light source, be difficult to the difference in the output image of identifying object.In other words, if the C signal have Y-signal frequency band 1/4, then can obtain the resolution of enough level, this is to be determined by television format signal.

This means the color filter pattern that can be used as colour filter according to the colour image of the 6th, the 7th or the 8th embodiment, wherein this colour filter serves as the imaging device 1012 of solid-state imaging apparatus.

More specifically, the spatial frequency of R and B color component---from as the different color component of the G component of the primary color component that be used for to generate luminance component---is as described below.In the colour image of the 6th embodiment, as shown in figure 23, the spatial frequency of R and B color component is 1/2 and be 1/4 in 45 ° of directions in vertical and horizontal direction.In the colour image of the 7th embodiment, as shown in figure 26, the spatial frequency of R and B color component is 1/4 and be 1/4 in 45 ° of directions in vertical and horizontal direction.In the colour image of the 8th embodiment, as shown in figure 29, the spatial frequency of R and B color component is 1/4 and be 1/2 in 45 ° of directions in vertical and horizontal direction.Therefore, any one color pixel all satisfies Y: Cr: Cb=4: 1: 1 condition.

As mentioned above, by be used for the imaging device 1012 of the imaging device such as digital still life camera or video camera (particularly video camera) with the colour image conduct of the 6th, the 7th or the 8th embodiment, can increase human eyes it is had the spatial frequency characteristic (spatial resolution) of highly sensitive G component.As a result, not only can obtain high brightness resolution to the achromaticity object but also to colored object.

In addition, to move pattern different from known Baeyer pixel, need to not adjust the balance of power level of rgb pixel in camera signal treatment circuit 1014, overcome the lower resolution of G pixel.In addition, circuit operation is simplified, and can be prevented by the generation that departs from caused wrong color in the balance of power level.

In in the colour image of the 6th, the 7th and the 8th embodiment any, the G pixel is surrounded R and B pixel.Therefore since with the G pixel arrangement in all row and all row, so greatly improved when in the interpolation circuit 1022 at camera signal treatment circuit 1014 with the G pixel interpolating interpolation precision on R and B locus the time.

It should be appreciated by those skilled in the art according to design needs and other factors, various changes, combination, sub-portfolio and change to be arranged, as long as they are within the scope of claims or its equivalent.

Claims (3)

1. solid-state imaging apparatus comprises:

Pixel, comprise by bidimensional be arranged in photoelectric transformer in the matrix; And

Colour filter comprises that this colour filter is disposed on the surface of pixel as primary color component and other color component of the fundamental component that is used for the generation luminance component,

Wherein primary color component and other color component are arranged such that primary color component surrounds other color component, and

Other color component arranges by interlacing with every row so that the sampling rate of other color component on vertical and horizontal direction become primary color component sampling rate 1/4,

Wherein, other color component has two kinds of colors; And

The row that only comprises primary color component arranged by interlacing, and, comprise the going and comprise that the row of other color component of primary color component and another kind of color arranged by alternate interlaced of other color component of primary color component and a kind of color.

2. according to claim 1 solid-state imaging apparatus, wherein, every row pixel is by from adjacent lines pixel shift 1/2 pixel pitch, and every row pixel is by from adjacent column pixel shift 1/2 pixel pitch.

3. imaging device comprises:

Solid-state imaging apparatus, it comprises having as the primary color component of the fundamental component that is used for the generation luminance component and the colour filter of other color component, this primary color component and other color component are arranged such that primary color component surrounds other color component;

Optical system, be configured to the imaging surface of solid-state imaging apparatus form corresponding to from the image of light of object; And

Signal processing circuit is configured to process the output signal of solid-state imaging apparatus,

Wherein other color component is arranged by interlacing with every row so that the sampling rate of other color component on vertical and horizontal direction become primary color component sampling rate 1/4,

Wherein, other color component has two kinds of colors; And

The row that only comprises primary color component arranged by interlacing, and, comprise the going and comprise that the row of other color component of primary color component and another kind of color arranged by alternate interlaced of other color component of primary color component and a kind of color.

Images