JP2023121120A - Solid-state imaging element, camera module, image processing device, and imaging method - Google Patents

Abstract

To provide a high-definition solid-state imaging element.SOLUTION: A solid-state imaging element (100) synthesizes luminance signals and chrominance signals to obtain an image. The solid-state imaging element includes a plurality of first pixels (5) and a plurality of second pixels (6). Each of the second pixels (6) has a spectral response characteristic in white. The solid-state imaging element generates the chrominance signals, using output signals from the first pixels (5), and generates the luminance signals, using output signals from the second pixels (6), without using the output signals from the first pixels (5).SELECTED DRAWING: Figure 1

Description

The present invention relates to solid-state imaging devices, camera modules, image processing apparatuses, and imaging methods.

Conventionally, a solid-state imaging device is known that obtains a captured image by synthesizing a luminance signal and a color signal.

JP 2007-274632 A JP 2007-258686 A

In a conventional solid-state imaging device, a luminance signal is generated using output signals from a plurality of pixels having different spectral sensitivity characteristics. As a result, in the conventional solid-state imaging device, jaggies occur in the peripheral portion of the captured image due to the chromatic aberration of the imaging lens that collects light on the solid-state imaging device. As a result, conventional solid-state imaging devices have low resolution. This jaggy occurs when normalizing the level of the output signal from each of the red and blue pixels to the level of the output signal from the green pixel in the local white balance adjustment process. can occur when using as a green pixel (luminance signal).

A solid-state imaging device according to an aspect of the present invention is a solid-state imaging device that obtains a captured image by synthesizing a luminance signal and a color signal, comprising a plurality of first pixels and a plurality of second pixels, The spectral sensitivity characteristic of each of the plurality of second pixels is white, the color signal is generated using the output signals from the plurality of first pixels, and the output signals from the plurality of first pixels are not used. and generating the luminance signal using output signals from the plurality of second pixels.

According to one aspect of the present invention, a high-resolution solid-state imaging device can be realized.

3 is a block diagram showing a schematic configuration of a solid-state imaging device according to each of Embodiments 1 to 12 of the present invention; FIG. 2 is a schematic diagram of a camera module including the solid-state imaging device shown in FIG. 1; FIG. 2 is a block diagram showing a schematic configuration of an image processing section of the solid-state imaging device shown in FIG. 1; FIG. FIG. 8 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 2 of the present invention; FIG. 10 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 3 of the present invention; 8A and 8B are plan views showing the arrangement of a plurality of first pixels according to Comparative Example 1 and the arrangement of a plurality of first pixels according to Comparative Example 2; It is a table|surface which contrasts the structure which concerns on Embodiment 3 of this invention, and the structure which concerns on a comparative example. FIG. 11 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 4 of the present invention; FIG. 11 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 5 of the present invention; FIG. 11 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 6 of the present invention; FIG. 11 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 7 of the present invention; FIG. 11 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 7 of the present invention; FIG. 14 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 8 of the present invention; FIG. 14 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 8 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 9 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 9 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 9 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 10 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 11 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 11 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 12 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 12 of the present invention; FIG. 20 is a plan view showing the arrangement of a plurality of first pixels and a plurality of second pixels according to Embodiment 12 of the present invention;

Modes for carrying out the present invention will be described below. For convenience of explanation, members having the same functions as those previously explained may be denoted by the same reference numerals, and the explanation thereof may not be repeated.

[Embodiment 1]
FIG. 1 is a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 1 of the present invention. FIG. 2 is a schematic diagram of a camera module 300 that includes the solid-state imaging device 100. As shown in FIG.

The camera module 300 includes a solid-state imaging device 100 and an imaging lens 200 that collects light on the solid-state imaging device 100 . Camera module 300 is, for example, a surveillance camera module. Sensitivity is important in surveillance camera modules. Sensitivity is an index relating to the output with respect to the brightness of an imaging location, in other words, an index relating to the sharpness of a captured image in imaging in a dark place.

The solid-state imaging device 100 includes a pixel section 1 that receives light that has passed through an imaging lens 200 and an image processing section 2 . The image processing unit 2 uses the output signal from the pixel unit 1 to generate a luminance signal and a color signal, and combines them to obtain a captured image. Combining the luminance signal and the color signal to obtain the captured image may be performed by a member other than the image processing section 2 . The output signal from the pixel unit 1 is a video signal, and to give a further specific example, it is a video signal corresponding to RAW data.

The pixel section 1 includes a first pixel group 3 and a second pixel group 4 . A first pixel group 3 consists of a plurality of first pixels 5 . A second pixel group 4 consists of a plurality of second pixels 6 . A specific example of arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 will be described later.

When the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a matrix, the solid-state imaging device 100 may include a row selection circuit that selects at least one row of the matrix, A column selection circuit for selecting at least one column from the matrix may be provided. The solid-state imaging device 100 may include a constant-current source circuit that converts the output signal from the pixel unit 1 into a current voltage. The solid-state imaging device 100 may include an analog-to-digital conversion circuit that applies analog-to-digital conversion to a signal obtained from the output signal from the pixel section 1 and supplies the converted signal to the image processing section 2 .

The solid-state imaging device 100 uses output signals from the plurality of first pixels 5 to generate color signals. The peak of the spectral sensitivity characteristic of each of the plurality of first pixels 5 is preferably in a primary color (e.g., the three primary colors of light and the three primary colors of the colorant), but is not limited to this. good. The output signals from the plurality of first pixels 5 correspond to the plurality of first pixels 5 among the output signals from the pixel section 1 .

In each embodiment of the present invention, it is assumed that the peaks of the spectral sensitivity characteristics of the plurality of first pixels 5 are in the three primary colors of light. In other words, each of the multiple first pixels 5 is either a red pixel, a green pixel, or a blue pixel. The red pixel is the first pixel 5 whose spectral sensitivity characteristic has a peak in red. The green pixel is the first pixel 5 whose spectral sensitivity characteristic peaks in green. The blue pixel is the first pixel 5 whose spectral sensitivity characteristic peaks in blue.

The spectral sensitivity characteristics of each of the plurality of second pixels 6 are white. The spectral sensitivity characteristic being white means that it has spectral sensitivity in the entire or almost the entire visible light region (wavelengths of 360 nm to 700 nm) without a color filter that blocks specific wavelengths interposed therebetween.

In order to realize a configuration in which the spectral sensitivity characteristic of the second pixel 6 is white, the second pixel 6 may have a filter whose passband is the entire or substantially the entire visible light region, It is not necessary to have the filter.

The solid-state imaging device 100 generates a luminance signal using output signals from the plurality of second pixels 6 without using output signals from the plurality of first pixels 5 . The output signals from the plurality of second pixels 6 correspond to the plurality of second pixels 6 among the output signals from the pixel section 1 .

FIG. 3 is a block diagram showing a schematic configuration of the image processing section 2. As shown in FIG. The image processing unit 2 includes a black subtraction unit 13, a white balance adjustment unit 14, a colorization interpolation processing unit 15, a monochrome interpolation processing unit 17, a synthesis unit 18, a contrast enhancement processing unit 7, and a gamma correction processing unit 8. there is

The black subtraction unit 13 performs black subtraction processing (also referred to as dark subtraction processing) on the signal obtained from the output signal from the pixel unit 1 .

The white balance adjustment section 14 performs white balance adjustment processing on the signal obtained from the output signals from the plurality of first pixels 5 among the output signals from the black subtraction section 13 . The white balance adjustment unit 14 does not perform white balance adjustment processing on the signal obtained from the output signals from the plurality of second pixels 6 among the output signals from the black subtraction unit 13 .

For example, as white balance adjustment processing, the white balance adjustment unit 14 adjusts the level of the signal corresponding to the red pixel and the level of the signal corresponding to the blue pixel based on the level of the signal corresponding to the green pixel. Thereby, white can be appropriately expressed in the captured image of the solid-state imaging device 100 .

The colorization interpolation processing unit 15 performs interpolation processing based on the three primary color components of light on the output signal from the white balance adjustment unit 14 . The output signal from the colorization interpolation processing unit 15 corresponds to the color signal. The output signal from the colorization interpolation processing unit 15 may be expressed in the RGB color system, but may also be expressed in the UV coordinate system.

The monochrome interpolation processing unit 17 performs monochrome interpolation processing on signals obtained from the output signals from the plurality of second pixels 6 among the output signals from the black subtraction unit 13 . The monochrome interpolation processing unit 17 does not perform monochrome interpolation processing on the signal obtained from the output signals from the plurality of first pixels 5 among the output signals from the black subtraction unit 13 .

The monochrome interpolation processing unit 17 performs processing based on a so-called adaptive processing correction method. In adaptive processing correction methods, vertical lines and horizontal lines are determined from vertical and horizontal patterns, and information from surrounding pixels is weighted. When the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in an oblique lattice arrangement, the monochrome interpolation processing section 17 may perform interpolation processing from the oblique lattice arrangement to the square lattice arrangement. The output signal from the monochrome interpolation processing section 17 corresponds to the luminance signal. This luminance signal is a monochrome signal.

Synthesis unit 18 synthesizes the luminance signal (output signal from monochrome interpolation processing unit 17) and the color signal (output signal from colorization interpolation processing unit 15) to form an image captured by solid-state imaging device 100. . The synthesizing unit 18 forms a captured image of the solid-state imaging device 100 by mapping the color information indicated by the color signal with respect to the luminance information indicated by the luminance signal.

The contrast enhancement processing section 7 subjects the output signal from the synthesizing section 18 to contrast enhancement processing. A gamma correction processing unit 8 applies gamma correction processing to the output signal from the contrast enhancement processing unit 7 .

The image processing unit 2 generates a color matrix (not shown) that performs color matrix processing on the output signal from the colorization interpolation processing unit 15 or the synthesized signal obtained by mapping the color signal to the luminance signal in the synthesizing unit 18. may have The color matrix performs processing on the input signal to determine the color density and/or hue of the captured image of the solid-state imaging device 100 . The degree of color reproduction has a trade-off relationship with the amount of color noise.

In the solid-state imaging device 100, luminance signals are generated without using output signals from the plurality of first pixels 5 having different spectral sensitivity characteristics for the red, green, and blue pixels. As a result, in the solid-state imaging device 100, it is possible to reduce the risk of jaggies occurring in the peripheral portion of the captured image due to the chromatic aberration of the imaging lens 200. FIG. As a result, the solid-state imaging device 100 has high resolution.

The human eye is generally sensitive to the luminance resolution defined by the luminance signal and insensitive to the color resolution defined by the chrominance signal. Considering these characteristics of the human eye, low color resolution is acceptable compared to low luminance resolution. It can be said that the solid-state imaging device 100 aims to increase the sensitivity of the solid-state imaging device 100 by increasing the luminance resolution in exchange for the color resolution.

When the luminance signal is a monochrome signal, different techniques may be applied for the white balance adjustment processing corresponding to the color signal and the white balance adjustment processing corresponding to the luminance signal. In this case, there is a risk that the configuration responsible for white balance adjustment processing will become complicated. On the other hand, the white balance adjustment section 14 of the image processing section 2 can be realized with a simple configuration because it is sufficient if it can perform white balance adjustment processing corresponding to color signals.

[Embodiment 2]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 2 of the present invention. FIG. 4 is a plan view showing the arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 according to Embodiment 2 of the present invention. This arrangement is hereinafter referred to as a pixel arrangement 101 .

In the pixel arrangement 101, the plurality of first pixels 5 are indicated by R, G, or B, respectively. Specifically, in the pixel arrangement 101, R indicates red pixels, G indicates green pixels, and B indicates blue pixels. In the pixel arrangement 101, W indicates each of the plurality of second pixels 6. As shown in FIG.

Each of the plurality of first pixels 5 has a square shape. Each of the plurality of second pixels 6 has a square shape. In the pixel arrangement 101, the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a matrix. In the pixel arrangement 101, the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a square lattice arrangement. The resolution pitch in the pixel arrangement 101 is represented by a resolution pitch 19 in FIG. A pixel is a general term for one of the plurality of first pixels 5 and one of the plurality of second pixels 6 .

One of the plurality of second pixels 6 is arranged between two of the plurality of first pixels 5 adjacent to each other in the row direction and the column direction in the square lattice array forming the pixel arrangement 101. .

In the pixel arrangement 101 , the number of second pixels 6 is much larger than the number of first pixels 5 . In the pixel arrangement 101, the ratio of the number of red pixels, the number of green pixels, and the number of blue pixels in the plurality of first pixels 5 is, for example, 1:2:1.

[Embodiment 3]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 3 of the present invention. FIG. 5 is a plan view showing the arrangement of a plurality of first pixels 5 and a plurality of second pixels 6 according to Embodiment 3 of the present invention. This arrangement is hereinafter referred to as a pixel arrangement 102 . The pixel arrangement 102 and the pixel arrangement 101 are different in the following points, and are identical in other points.

In the pixel arrangement 102, the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a diagonal lattice arrangement. The rotation angle θ of the pixels of the pixel arrangement 102 with respect to the pixels of the pixel arrangement 101 is, for example, 45°, but is not limited to this.

The resolution pitch in the pixel arrangement 102 is represented by a resolution pitch 20 in FIG. Assuming that the rotation angle θ is 45° and the resolution pitch 19 and the resolution pitch 20 are the same, the maximum pixel size in the pixel arrangement 102 is √2 times the pixel size in the pixel arrangement 101. can do. That is, according to the pixel arrangement 102 (diagonal arrangement), compared to the pixel arrangement 101 (square arrangement), it is possible to increase the physical pixel size while maintaining the "resolution pitch" as an output image (the number of pixels can be reduced), so the sensitivity can be increased.

In the oblique grid arrangement forming the pixel arrangement 102 , one of the plurality of second pixels 6 is arranged between two adjacent pixels among the plurality of first pixels 5 . However, this "one of the plurality of second pixels 6" means that when two adjacent pixels of the plurality of first pixels 5 are considered to be in the same row (or the same column), the same row (or the same column) ) is assumed to belong to

In the pixel arrangement 102 , the number of second pixels 6 is much larger than the number of first pixels 5 .

FIG. 6 is a plan view showing the arrangement of the plurality of first pixels 5 according to Comparative Example 1 and the arrangement of the plurality of first pixels 5 according to Comparative Example 2. As shown in FIG. Hereinafter, the arrangement of the plurality of first pixels 5 according to Comparative Example 1 will be referred to as pixel arrangement 104 , and the arrangement of the plurality of first pixels 5 according to Comparative Example 2 will be referred to as pixel arrangement 105 .

In the pixel arrangement 104, the plurality of first pixels 5 are indicated by R, G, or B, respectively. Specifically, in the pixel arrangement 104, R indicates red pixels, G indicates green pixels, and B indicates blue pixels.

Each of the plurality of first pixels 5 has a square shape. In the pixel arrangement 104, the multiple first pixels 5 are arranged in a matrix. In the pixel arrangement 104, the multiple first pixels 5 are arranged in a square lattice arrangement. The resolution pitch in the pixel arrangement 104 is represented by a resolution pitch 19 in FIG.

The pixel arrangement 105 and the pixel arrangement 104 are different in that the plurality of first pixels 5 are arranged in an oblique lattice arrangement, and are otherwise the same. The resolution pitch in the pixel arrangement 105 is represented by a resolution pitch 20 in FIG.

FIG. 7 is a table comparing the pixel arrangement 104, the pixel arrangement 105, and the pixel arrangement 102. In FIG. According to FIG. 7, if the sensitivity of the solid-state imaging device 100 corresponding to the pixel arrangement 104 is S, the sensitivity of the solid-state imaging device 100 corresponding to the pixel arrangement 105 is 2S. has a sensitivity of 3S. By changing the arrangement of the plurality of first pixels 5 from the square lattice arrangement to the oblique lattice arrangement, the sensitivity of the solid-state imaging device 100 is approximately doubled. By applying the plurality of second pixels 6 in addition to the plurality of first pixels 5, the sensitivity of the solid-state imaging device 100 is increased by approximately 1.5 times. This is because light absorption by the plurality of second pixels 6 is sufficiently smaller than light absorption by the plurality of first pixels 5 .

[Embodiment 4]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 4 of the present invention. FIG. 8 is a plan view showing the arrangement of a plurality of first pixels 5 and a plurality of second pixels 6 according to Embodiment 4 of the present invention. This arrangement is hereinafter referred to as a pixel arrangement 103 . The pixel arrangement 103 and the pixel arrangement 102 are different in the following points and identical in other points.

In the oblique lattice arrangement forming the pixel arrangement 103, two or more (here, two) of the plurality of second pixels 6 are arranged between two adjacent ones of the plurality of first pixels 5. . However, this “two or more of the plurality of second pixels 6” means that when two adjacent pixels among the plurality of first pixels 5 are considered to be in the same row (or the same column), the same row (or the same column) column).

In the pixel arrangement 103 , the number of second pixels 6 is much larger than the number of first pixels 5 .

[Embodiment 5]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 5 of the present invention. FIG. 9 is a plan view showing the arrangement of a plurality of first pixels 5 and a plurality of second pixels 6 according to Embodiment 5 of the present invention. This arrangement is hereinafter referred to as a pixel arrangement 106 . The pixel arrangement 106 and the pixel arrangement 103 are different in the following points.

In the pixel arrangement 106, the plurality of first pixels 5 includes a plurality of third pixels 21 whose spectral sensitivity characteristic peaks in red (first color), and a plurality of pixels whose spectral sensitivity characteristic peaks in green (second color). It includes a fourth pixel 22 and a plurality of fifth pixels 23 whose spectral sensitivity characteristic peaks in blue (third color). In the pixel arrangement 106, R indicates the third pixel 21, G indicates the fourth pixel 22, and B indicates the fifth pixel .

A pixel arrangement 106 indicating the arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 included in the solid-state imaging device 100 includes a third pixel 21, a fourth pixel 22, and a fifth pixel 23. It has rectangular regions 24 containing the same number of each other. In the pixel arrangement 106 , the rectangular area 24 includes, for example, 12 third pixels 21 , 12 fourth pixels 22 and 12 fifth pixels 23 . The number of each of the third pixels 21, the fourth pixels 22, and the fifth pixels 23 included in the rectangular area 24 is not limited to twelve.

A third pixel 21, a fourth pixel 22, and a fifth pixel 23 are repeatedly arranged in this order in both the vertical direction and the horizontal direction in the pixel arrangement 106. FIG. 9, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are repeatedly arranged in this order from the bottom to the top in the vertical direction. Focusing on the inside of the two-dot chain line in FIG. 9, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are repeatedly arranged in this order from left to right in the horizontal direction. The vertical and/or horizontal third pixel 21, fourth pixel 22, and fifth pixel 23 may not be arranged repeatedly in this order. Also, in the pixel arrangement 106, the order of repeated arrangement of the third pixel 21, the fourth pixel 22, and the fifth pixel 23 in the vertical direction and/or the horizontal direction may differ depending on the location of interest.

According to the pixel arrangement 106 , it is possible to suppress uneven distribution of the plurality of third pixels 21 , the plurality of fourth pixels 22 , and the plurality of fifth pixels 23 . Therefore, according to the pixel arrangement 106 , it is possible to suppress generation of false colors in the solid-state imaging device 100 while suppressing degradation of the resolution of the solid-state imaging device 100 due to processing by the image processing unit 2 .

[Embodiment 6]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 6 of the present invention. FIG. 10 is a plan view showing the arrangement of a plurality of first pixels 5 and a plurality of second pixels 6 according to Embodiment 6 of the present invention. This arrangement is hereinafter referred to as a pixel arrangement 107 . The pixel arrangement 107 differs from the pixel arrangement 106 in that the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a square lattice arrangement. In the pixel arrangement 107 , the rectangular area 24 includes, for example, six third pixels 21 , six fourth pixels 22 and six fifth pixels 23 .

[Embodiment 7]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 7 of the present invention. 11 and 12 are plan views showing the arrangement of multiple first pixels 5 and multiple second pixels 6 according to Embodiment 7 of the present invention. Each of these arrangements is hereinafter referred to as a pixel arrangement 108 . The pixel arrangement 108 and the pixel arrangement 106 are different in the following points.

A plurality of pixel groups 25 are included in the direction in which the plurality of first pixels 5 and the plurality of second pixels 6 in the pixel arrangement 108 are arranged (the first direction in FIG. 11 and the second direction in FIG. 12). Each of the plurality of pixel groups 25 has a third pixel 21, a fourth pixel 22, and a fifth pixel 23 arranged in this order. In each of the plurality of pixel groups 25 , no second pixel 6 is arranged between two adjacent pixels among the third pixel 21 , fourth pixel 22 and fifth pixel 23 .

According to the pixel arrangement 108, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are brought as close to each other as possible to simplify the prediction of color change, thereby suppressing the occurrence of false colors in the solid-state imaging device 100. be able to.

11 and 12 show a total of two examples of pixel arrangement 108. FIG. In either example, the same action and effect can be obtained.

The third pixel 21, the fourth pixel 22, and the fifth pixel 23 do not have to be arranged repeatedly in this order in the vertical direction and/or the horizontal direction in the pixel arrangement 108. FIG.

[Embodiment 8]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 8 of the present invention. 13 and 14 are plan views showing the arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 according to Embodiment 8 of the present invention. Each of these arrangements is hereinafter referred to as a pixel arrangement 109 . The pixel arrangement 109 differs from the pixel arrangement 108 in that the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a square lattice arrangement.

13 and 14 show a total of two examples of pixel arrangement 109. FIG. In either example, the same action and effect can be obtained.

[Embodiment 9]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 9 of the present invention. 15 to 17 are plan views showing the arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 according to Embodiment 9 of the present invention. Each of these arrangements is hereinafter referred to as a pixel arrangement 110 . The pixel arrangement 110 and the pixel arrangement 108 are different in the following points.

At least one of the plurality of second pixels 6 is arranged between two adjacent pixels among the plurality of pixel groups 25 . Between two pixel groups 25 parallel to each other, there is another pixel group 25 orthogonal to these two pixel groups 25 .

15 to 17 show a total of three examples of pixel arrangement 110. FIG. FIG. 15 shows an example in which one of the plurality of second pixels 6 is arranged between two adjacent pixels among the plurality of pixel groups 25, and FIG. FIG. 17 shows an example in which three of the plurality of second pixels 6 are arranged.

[Embodiment 10]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 10 of the present invention. FIG. 18 is a plan view showing the arrangement of multiple first pixels 5 and multiple second pixels 6 according to the tenth embodiment of the present invention. This arrangement is hereinafter referred to as a pixel arrangement 111 . The pixel arrangement 111 is different from the pixel arrangement 110 in that the plurality of first pixels 5 and the plurality of second pixels 6 are arranged in a square grid arrangement.

[Embodiment 11]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 11 of the present invention. 19 and 20 are plan views showing the arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 according to the eleventh embodiment of the present invention. Each of these arrangements is hereinafter referred to as a pixel arrangement 112 . The pixel arrangement 112 and the pixel arrangement 108 are different in the following points.

In the pixel arrangement 112 , similarly to the pixel arrangement 106 , the third pixel 21 , the fourth pixel 22 , and the fifth pixel 23 may be repeatedly arranged in this order in the vertical direction and the horizontal direction of the pixel arrangement 112 . 19 and 20, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are repeatedly arranged in this order from the bottom to the top or from the top to the bottom in the vertical direction. good too. 19 and 20, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are repeatedly arranged in this order from left to right or right to left in the horizontal direction. may The third pixel 21, the fourth pixel 22, and the fifth pixel 23 do not have to be repeatedly arranged in this order in the vertical direction and the horizontal direction.

19 and 20 show a total of two examples of the pixel arrangement 112. FIG. In either example, the same action and effect can be obtained.

[Embodiment 12]
FIG. 1 is also a block diagram showing a schematic configuration of a solid-state imaging device 100 according to Embodiment 12 of the present invention. 21 to 23 are plan views showing the arrangement of the plurality of first pixels 5 and the plurality of second pixels 6 according to the twelfth embodiment of the present invention. Each of these arrangements is hereinafter referred to as a pixel arrangement 113 . The pixel arrangement 113 and the pixel arrangement 110 are different in the following points.

In the pixel arrangement 113 , similarly to the pixel arrangement 106 , the third pixel 21 , the fourth pixel 22 , and the fifth pixel 23 may be repeatedly arranged in this order in the vertical direction and the horizontal direction of the pixel arrangement 113 . 21 to 23, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are repeatedly arranged in this order from the bottom to the top or from the top to the bottom in the vertical direction. good too. 21 to 23, the third pixel 21, the fourth pixel 22, and the fifth pixel 23 are repeatedly arranged in this order from left to right or right to left in the horizontal direction. may The third pixel 21, the fourth pixel 22, and the fifth pixel 23 do not have to be repeatedly arranged in this order in the vertical direction and the horizontal direction.

21 to 23 show a total of three examples of pixel arrangement 113. FIG. FIG. 21 shows an example in which one of the plurality of second pixels 6 is arranged between two adjacent pixels among the plurality of pixel groups 25, and FIG. FIG. 23 shows an example in which three of the plurality of second pixels 6 are arranged.

[Embodiment 13]
An image processing apparatus including the image processing section 2 is also included in the scope of the present invention. The image processing device is provided for a solid-state imaging device 100 that synthesizes a luminance signal and a color signal to obtain a captured image. each of the plurality of second pixels 6 has a spectral sensitivity characteristic of white, and the image processing device uses output signals from the plurality of first pixels 5 to generate color signals. , an image processing apparatus that generates a luminance signal using output signals from a plurality of second pixels 6 without using output signals from a plurality of first pixels 5 .

An imaging method corresponding to the solid-state imaging device 100 is also included in the scope of the present invention. The imaging method is an imaging method in a solid-state imaging device 100 that obtains a captured image by synthesizing a luminance signal and a color signal. The spectral sensitivity characteristics of each of the plurality of second pixels 6 are white, and in the imaging method, output signals from the plurality of first pixels 5 are used to generate color signals, and the plurality of first pixels 6 This is an imaging method for generating a luminance signal using output signals from a plurality of second pixels 6 without using output signals from 5 .

[Modification]
As mentioned above, in each embodiment of the present invention, the peak of the spectral sensitivity characteristic of each of the plurality of first pixels 5 may be the complementary color to the three primary colors of light. In other words, each of the plurality of first pixels 5 may be one of a cyan pixel, a magenta pixel, and a yellow pixel. The cyan pixel is the first pixel 5 whose spectral sensitivity characteristic peak is in cyan. The magenta color pixel is the first pixel 5 whose spectral sensitivity characteristic has a peak in magenta. The yellow pixel is the first pixel 5 whose spectral sensitivity characteristic peaks in yellow. The same applies to the third pixel 21, the fourth pixel 22, and the fifth pixel 23 as well.

〔summary〕
A solid-state imaging device according to aspect 1 of the present invention is a solid-state imaging device for synthesizing a luminance signal and a color signal to obtain a captured image, comprising a plurality of first pixels and a plurality of second pixels, The spectral sensitivity characteristic of each of the plurality of second pixels is white, the color signal is generated using the output signals from the plurality of first pixels, and the output signals from the plurality of first pixels are not used. and generating the luminance signal using output signals from the plurality of second pixels.

According to the above configuration, the luminance signal is generated without using output signals from the plurality of first pixels having different spectral sensitivity characteristics. Thus, according to the above configuration, it is possible to reduce the risk of jaggies occurring in the peripheral portion of the captured image due to the chromatic aberration of the imaging lens that collects light on the solid-state imaging device. As a result, according to the above configuration, a high-resolution solid-state imaging device can be realized.

In the solid-state imaging device according to aspect 2 of the present invention, in aspect 1, the plurality of first pixels and the plurality of second pixels are arranged in a diagonal lattice arrangement.

In the solid-state imaging device according to aspect 3 of the present invention, in aspect 2, one of the plurality of second pixels is arranged between two adjacent pixels among the plurality of first pixels.

In the solid-state imaging device according to aspect 4 of the present invention, in aspect 2, two or more of the plurality of second pixels are arranged between two adjacent pixels among the plurality of first pixels.

In the solid-state imaging device according to aspect 5 of the present invention, in aspect 1, the plurality of first pixels are a plurality of third pixels whose spectral sensitivity characteristic peak is in the first color, and the spectral sensitivity characteristic peak is in the second color. A pixel arrangement including a plurality of fourth pixels in a color and a plurality of fifth pixels whose spectral sensitivity characteristic peaks in a third color, and showing the arrangement of the plurality of first pixels and the plurality of second pixels. has a rectangular area containing the same number of the third pixels, the fourth pixels, and the fifth pixels.

A solid-state imaging device according to aspect 6 of the present invention is the solid-state imaging device according to aspect 5, wherein the third pixel, the fourth pixel, and the fifth pixel are repeatedly arranged in this order in the vertical direction and the horizontal direction in the pixel arrangement. there is

In the solid-state imaging device according to aspect 7 of the present invention, in aspect 5 or 6, the third pixel and the A plurality of pixel groups in which the fourth pixel and the fifth pixel are arranged in this order, and the pixel group includes two adjacent pixels among the third pixel, the fourth pixel, and the fifth pixel. The second pixel is not arranged between.

In the solid-state imaging device according to aspect 8 of the present invention, in aspect 7, at least one of the plurality of second pixels is arranged between two adjacent pixels among the plurality of pixel groups.

The solid-state imaging device according to aspect 9 of the present invention is the solid-state imaging device according to any one of aspects 1 to 8, wherein white balance adjustment processing is performed on signals obtained from output signals from the plurality of first pixels, and the plurality of a white balance adjustment unit that does not perform white balance adjustment processing on signals obtained from the output signals from the second pixels of the above; and monochrome interpolation processing on signals obtained from the output signals from the plurality of second pixels. and a monochrome interpolation processing unit that does not perform monochrome interpolation processing on signals obtained from output signals from the plurality of first pixels.

A camera module according to aspect 10 of the present invention includes the solid-state imaging device according to any one of aspects 1 to 9.

An image processing device according to aspect 11 of the present invention is an image processing device provided for a solid-state imaging device that obtains a captured image by synthesizing a luminance signal and a color signal, wherein the solid-state imaging device includes a plurality of second The image processing device includes one pixel and a plurality of second pixels, wherein the spectral sensitivity characteristics of each of the plurality of second pixels are white, and the image processing device uses output signals from the plurality of first pixels to perform the A color signal is generated, and the luminance signal is generated using the output signals from the plurality of second pixels without using the output signals from the plurality of first pixels.

An imaging method according to aspect 12 of the present invention is an imaging method in a solid-state imaging device for synthesizing a luminance signal and a color signal to obtain a captured image, wherein the solid-state imaging device includes a plurality of first pixels and a plurality of second pixels. comprising two pixels, wherein each of the plurality of second pixels has a spectral sensitivity characteristic of white, and in the imaging method, using output signals from the plurality of first pixels to generate the color signal; The luminance signal is generated using the output signals from the plurality of second pixels without using the output signals from the plurality of first pixels.

The present invention is not limited to the above-described embodiments, but can be modified in various ways within the scope of the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. is also included in the technical scope of the present invention. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment.

1 pixel unit 2 image processing unit 3 first pixel group 4 second pixel group 5 first pixel 6 second pixel 7 contrast enhancement processing unit 8 gamma correction processing unit 13 black subtraction unit 14 white balance adjustment unit 15 colorization interpolation processing unit 17 Monochrome interpolation processing unit 18 Combining unit 19, 20 Resolution pitch 21 Third pixel 22 Fourth pixel 23 Fifth pixel 24 Rectangular area 25 Pixel group 100 Solid-state imaging devices 101 to 113 Pixel arrangement 200 Imaging lens 300 Camera module θ Rotation angle

Claims (12)

A solid-state imaging device that obtains a captured image by synthesizing a luminance signal and a color signal,
comprising a plurality of first pixels and a plurality of second pixels;
the spectral sensitivity characteristics of each of the plurality of second pixels are white;
generating the color signal using output signals from the plurality of first pixels;
A solid-state imaging device that generates the luminance signal using output signals from the plurality of second pixels without using output signals from the plurality of first pixels. 2. The solid-state imaging device according to claim 1, wherein said plurality of first pixels and said plurality of second pixels are arranged in a diagonal lattice arrangement. 3. The solid-state imaging device according to claim 2, wherein one of the plurality of second pixels is arranged between two adjacent pixels among the plurality of first pixels. 3. The solid-state imaging device according to claim 2, wherein two or more of said plurality of second pixels are arranged between two adjacent ones of said plurality of first pixels. The plurality of first pixels includes a plurality of third pixels having a spectral sensitivity characteristic peak in a first color, a plurality of fourth pixels having a spectral sensitivity characteristic peak in a second color, and a spectral sensitivity characteristic peak having a second color. contains a plurality of fifth pixels in three colors,
A pixel arrangement indicating the arrangement of the plurality of first pixels and the plurality of second pixels has a rectangular area including the same number of the third pixels, the fourth pixels, and the fifth pixels. 2. The solid-state imaging device according to claim 1. 6. The solid-state imaging device according to claim 5, wherein the third pixel, the fourth pixel, and the fifth pixel are repeatedly arranged in this order in the vertical direction and the horizontal direction in the pixel arrangement. a pixel group in which the third pixel, the fourth pixel, and the fifth pixel are arranged in this order in the direction in which the plurality of first pixels and the plurality of second pixels in the pixel arrangement are arranged; contains multiple
6. The solid-state imaging device according to claim 5, wherein said pixel group does not include said second pixel between two adjacent ones of said third pixel, said fourth pixel and said fifth pixel. 8. The solid-state imaging device according to claim 7, wherein at least one of the plurality of second pixels is arranged between two adjacent pixels among the plurality of pixel groups. A signal obtained from the output signals from the plurality of first pixels is subjected to white balance adjustment processing, and a signal obtained from the output signals from the plurality of second pixels is subjected to white balance adjustment processing. with no white balance adjustment section;
Monochrome in which a signal obtained from the output signals from the plurality of second pixels is subjected to monochrome interpolation processing, and a signal obtained from the output signals from the plurality of first pixels is not subjected to monochrome interpolation processing. The solid-state imaging device according to any one of claims 1 to 8, further comprising an interpolation processing section. A camera module comprising the solid-state imaging device according to claim 1 . An image processing device provided for a solid-state imaging device for synthesizing a luminance signal and a color signal to obtain a captured image,
The solid-state imaging device is
comprising a plurality of first pixels and a plurality of second pixels;
the spectral sensitivity characteristics of each of the plurality of second pixels are white;
The image processing device is
generating the color signal using output signals from the plurality of first pixels;
An image processing device that generates the luminance signal using output signals from the plurality of second pixels without using output signals from the plurality of first pixels. An imaging method in a solid-state imaging device for synthesizing a luminance signal and a color signal to obtain a captured image,
The solid-state imaging device is
comprising a plurality of first pixels and a plurality of second pixels;
the spectral sensitivity characteristics of each of the plurality of second pixels are white;
In the imaging method,
generating the color signal using output signals from the plurality of first pixels;
An imaging method for generating the luminance signal using output signals from the plurality of second pixels without using output signals from the plurality of first pixels.

Images