JP5066476B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus having an imaging element including a large number of photoelectric conversion elements arranged two-dimensionally in a vertical direction on a substrate and in a horizontal direction perpendicular thereto.

  As a method of updating a moving image with high image quality at high speed, there is interlaced readout by a complementary color difference line sequential method. However, since a complementary color filter is used, color reproducibility is inferior compared with a primary color filter. Furthermore, contrast is lowered by adding charges vertically.

  In addition, a method of taking a moving image using a primary color filter is disclosed in Patent Document 1. However, in this method, the color filter array is a stripe array, and the color array for each field is not isotropic. Information on the image structure of the subject cannot be obtained uniformly.

  In addition, interlaced readout for the purpose of still image shooting is based on the premise that information obtained in each of the two fields is obtained during the same exposure period. Image misalignment and color misregistration occur, and image quality deteriorates.

JP 2000-308075 A

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an imaging device capable of performing high-quality moving image shooting.

An image pickup apparatus according to the present invention is an image pickup apparatus having an image pickup element including a large number of photoelectric conversion elements arranged two-dimensionally in a vertical direction on a substrate and in a horizontal direction perpendicular thereto. Are divided into a first photoelectric conversion element group consisting of a first photoelectric conversion element and a second photoelectric conversion element group consisting of a second photoelectric conversion element, and the first photoelectric conversion element and the second photoelectric conversion element. Are arranged adjacent to each other, and the first photoelectric conversion element group and the second photoelectric conversion element group can read signals independently from each other, and the first photoelectric conversion element The first signal read from the element group and the second signal read from the second photoelectric conversion element group are signals that can obtain the luminance information of the subject by themselves. And the first signal and the second signal. At least one of them is a signal that can obtain color information of primary colors of R (red), G (green), and B (blue) by itself, and at the time of moving image shooting, the first photoelectric conversion element A field for reading a signal only from a group and a field for reading a signal only from the second photoelectric conversion element group, and alternately driving the solid-state imaging element every frame period; An image signal obtained from the image sensor and an image signal obtained from the image sensor in the adjacent field of the arbitrary field are combined to generate an entire pixel signal composed of the same number of signals as the total number of the photoelectric conversion elements. and the total pixel signal generating means for, an image data generation means for generating image data based on the all pixel signals, to said image data, said first photoelectric conversion elements, Comprising the response to a distance between the second photoelectric conversion element adjacent to Le and a filtering means for performing filtering becomes zero, the.

In the imaging apparatus of the present invention, the all-pixel signal generation means includes an imaging signal obtained from the imaging element in the arbitrary field, and an imaging signal obtained from the imaging element in a field immediately before the arbitrary field. Are combined to generate the all-pixel signal, and the image data generating means generates image data for a frame corresponding to a frame period in which the arbitrary field is implemented based on the all-pixel signal.

  In the image pickup apparatus of the present invention, the filter array provided above each photoelectric conversion element of the first photoelectric conversion element group is isotropic.

  The imaging device of the present invention includes a filter array provided above each photoelectric conversion element of the first photoelectric conversion element group and a filter array provided above each photoelectric conversion element of the second photoelectric conversion element group. Isotropic.

  In the imaging apparatus of the present invention, the first photoelectric conversion element array and the second photoelectric conversion element array are square arrays having the same array pitch, and the first photoelectric conversion element group and the second photoelectric conversion element group The photoelectric conversion element groups are arranged so as to be shifted in the vertical direction and the horizontal direction by ½ of the photoelectric conversion element arrangement pitch included in each.

  In the imaging apparatus of the present invention, the first photoelectric conversion element group includes an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric conversion element that detects B light. The second photoelectric conversion element group is configured by a W photoelectric conversion element that detects a luminance component of light.

  In the imaging apparatus of the present invention, the first photoelectric conversion element group and the second photoelectric conversion element group each include an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, It is composed of a B photoelectric conversion element that detects B light.

  In the imaging device of the present invention, the arrangement of the plurality of photoelectric conversion elements is a square arrangement, and the first photoelectric conversion elements and the second photoelectric conversion elements are arranged in a checkered pattern.

  In the imaging apparatus of the present invention, the first photoelectric conversion element group includes an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric conversion element that detects B light. The second photoelectric conversion element group is configured by a W photoelectric conversion element that detects a luminance component of light.

  In the imaging apparatus of the present invention, the first photoelectric conversion element group and the second photoelectric conversion element group each include an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, It is comprised with the B photoelectric conversion element which detects B light.

  In the imaging apparatus of the present invention, the array of the plurality of photoelectric conversion elements is a square array, the photoelectric conversion elements in the odd rows are the first photoelectric conversion element group, and the photoelectric conversion elements in the even rows are the first ones. 2 photoelectric conversion element groups.

  In the imaging apparatus of the present invention, the first photoelectric conversion element group and the second photoelectric conversion element group each include an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, It is composed of a B photoelectric conversion element that detects B light and a W photoelectric conversion element that detects a luminance component of light.

  The imaging apparatus according to the present invention includes an exposure control unit that changes an exposure condition between exposure of the first photoelectric conversion element group and exposure of the second photoelectric conversion element group.

  The image pickup apparatus of the present invention includes means for changing a component of light incident on the image pickup element between exposure of the first photoelectric conversion element group and exposure of the second photoelectric conversion element group.

  The imaging apparatus of the present invention is a signal amplifying means for amplifying a signal output from the imaging element, a signal output from the first photoelectric conversion element group, and output from the second photoelectric conversion element group. And a gain control means for changing a signal gain by the signal amplifying means.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which can perform high-quality moving image photography can be provided.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a schematic partial plan view of an image sensor mounted on the image pickup apparatus according to the first embodiment of the present invention.
A solid-state imaging device 5 shown in FIG. 1 includes a photoelectric conversion element 51R (character “R” in the figure) that detects R light arranged in a square lattice in a horizontal direction on a semiconductor substrate and a vertical direction perpendicular thereto. ), Photoelectric conversion element 51G for detecting G light (character “G” in the figure), and photoelectric conversion element 51B for detecting B light (character “B” in the figure) And a photoelectric conversion element 51W for detecting a luminance component of light arranged in a square lattice pattern in a horizontal direction on the semiconductor substrate and in a vertical direction perpendicular thereto. And a second photoelectric conversion element group (indicated by the letter “W” in the figure), which is approximately half the respective photoelectric conversion element arrangement pitch, in the horizontal and vertical directions. It is arranged at a position shifted to. The arrangement pitch of the photoelectric conversion elements in the first photoelectric conversion element group and the photoelectric conversion elements in the second photoelectric conversion element group are the same.

  The arrangement of the photoelectric conversion elements of the first photoelectric conversion element group is as follows: a GR photoelectric conversion element array that is a line composed of photoelectric conversion elements 51G and 51R arranged in the vertical direction Y, and photoelectric conversion aligned in the vertical direction Y. It can be said that the BG photoelectric conversion element rows, which are rows made up of the elements 51B and the photoelectric conversion elements 51G, are alternately arranged in the horizontal direction. In addition, the arrangement of the photoelectric conversion elements in the first photoelectric conversion element group is such that the photoelectric conversion elements 51G and the photoelectric conversion elements 51B arranged in the horizontal direction are aligned with the GB photoelectric conversion element rows and the horizontal photoelectric conversion. It can also be said that RG photoelectric conversion element rows, which are rows composed of the elements 51R and the photoelectric conversion elements 51G, are alternately arranged in the vertical direction.

  The arrangement of the photoelectric conversion elements of the second photoelectric conversion element group can be said to be a plurality of W photoelectric conversion element arrays that are arrays of photoelectric conversion elements 51W arranged in the vertical direction Y in the horizontal direction. Further, the arrangement of the photoelectric conversion elements of the second photoelectric conversion element group can be said to be a plurality of W photoelectric conversion element rows arranged in the vertical direction, which are rows of photoelectric conversion elements 51W arranged in the horizontal direction. .

  On the right side of each photoelectric conversion element array, a vertical charge transfer unit (for transferring charges accumulated in the photoelectric conversion elements constituting each photoelectric conversion element array in the vertical direction corresponding to each photoelectric conversion element array ( (Not shown) is formed. A horizontal charge transfer unit (not shown) for transferring the charges transferred here in the horizontal direction is connected to the end of the vertical charge transfer unit, and the horizontal charge transfer is connected to the end of the horizontal charge transfer unit. An output amplifier (not shown) that outputs an imaging signal corresponding to the charge transferred through the unit is provided.

  A color filter is provided above each photoelectric conversion element of the first photoelectric conversion element group, and the arrangement of the color filters is a Bayer arrangement. As a result, it is possible to obtain color information of the primary colors of R, G, and B and luminance information of the subject from the RGB signals that are the imaging signals read from the first photoelectric conversion element group. .

  Above each photoelectric conversion element of the second photoelectric conversion element group, a filter having a spectral characteristic correlated with light luminance information, that is, a luminance filter is provided. This luminance filter corresponds to an ND filter, a transparent filter, a white filter, a gray filter, or the like, but the configuration in which light is directly incident on the light receiving surface without providing anything above the light receiving surface of the photoelectric conversion element is also possible. It can be said that a filter is provided. Thereby, each photoelectric conversion element of a 2nd photoelectric conversion element group can be functioned as a photoelectric conversion element which detects the luminance component of light. Further, it is possible to obtain luminance information of the subject from the W signal that is an imaging signal read from the second photoelectric conversion element group.

  Arrangement of readout electrodes for reading out charges from each photoelectric conversion element to the vertical charge transfer section so that the first photoelectric conversion element group and the second photoelectric conversion element group can read signals independently of each other. Etc. are decided.

FIG. 2 is a diagram illustrating a schematic configuration of a digital camera that is an example of an imaging apparatus in which the solid-state imaging device illustrated in FIG. 1 is mounted.
The imaging system of the illustrated digital camera includes a photographic lens 1, a solid-state imaging device 5 shown in FIG. 1, a diaphragm 2 provided therebetween, an infrared cut filter 3, and an optical low-pass filter 4.

  A system control unit 11 that performs overall control of the electrical control system of the digital camera controls the flash light emitting unit 12 and the light receiving unit 13 and controls the lens driving unit 8 to adjust the position of the photographing lens 1 to the focus position and zoom. The exposure amount is adjusted by adjusting the aperture amount of the aperture 2 via the aperture drive unit 9.

  Further, the system control unit 11 drives the solid-state imaging device 5 via the imaging device driving unit 10 and outputs a subject image captured through the photographing lens 1 as an imaging signal. An instruction signal from the user is input to the system control unit 11 through the operation unit 14.

  The electric control system of the digital camera further includes an analog signal processing unit 6 that performs analog signal processing such as correlated double sampling processing and signal amplification processing connected to the output of the solid-state imaging device 5, and the analog signal processing unit 6. An A / D conversion circuit 7 that converts the output imaging signal into a digital signal is provided, and these are controlled by the system control unit 11.

  The imaging device driving unit 10 alternately performs a field for reading an imaging signal only from the first photoelectric conversion element group and a field for reading the imaging signal only from the second photoelectric conversion element group for each frame period during moving image shooting. The solid-state imaging device 5 is driven repeatedly. One frame period is a period from the rising edge of the vertical synchronizing signal to the rising edge of the next vertical synchronizing signal. During this period, the imaging signal is read according to the charge accumulated in the photoelectric conversion element.

For example, when the exposure period of a certain frame period ends, the imaging element driving unit 10 reads a field for reading only the imaging signal corresponding to the charge accumulated in each photoelectric conversion element of the first photoelectric conversion element group according to the exposure period. The charge accumulated in each photoelectric conversion element of the second photoelectric conversion element group by the exposure period is started within the frame period, and then the exposure period of the next frame period is started and the exposure period ends. It repeats that the field which reads only the imaging signal according to is implemented within the next frame period.
Note that the exposure period for exposing the photoelectric conversion element does not have to be ended for each frame period. For example, the exposure periods may overlap in adjacent frame periods. In this case, the exposure period becomes longer, and an increase in charge amount can be expected.

  In the following description, it is assumed that the imaging element driving unit 10 first performs a field for reading an imaging signal from only the first photoelectric conversion element group at the time of moving image shooting, and a field to be performed odd times is referred to as an odd field. The field that is executed evenly is called an even field.

  The electric control system of the digital camera uses the main memory 16, the memory control unit 15 connected to the main memory 16, and two imaging signals obtained in two adjacent fields output from the A / D conversion circuit 7. A field synthesizing unit 19 for synthesizing, and a digital signal processing unit (DSP) for generating color image data by performing an interpolation operation, a gamma correction operation, an RGB / YC conversion process, or the like on the imaging signal obtained by the synthesis by the field synthesizing unit ) 17, an external memory to which the compression / decompression processing unit 18 that compresses the color image data generated by the digital signal processing unit 17 into the JPEG format or decompresses the compressed image data, and the removable recording medium 21 is connected. A control unit 20 and a display control unit 22 to which a liquid crystal display unit 23 mounted on the rear surface of the camera is connected are provided. Are interconnected by a bus 25, it is controlled by a command from the system controller 11.

3 and 4 are diagrams for explaining the function of the field composition unit 19 shown in FIG.
As shown in FIG. 3, the image signal output from the solid-state image sensor 5 every frame period by driving the image sensor driving unit 10 is temporarily stored in the main memory 16. In FIG. 4, imaging signals output from the solid-state imaging device 5 by moving image shooting are illustrated with serial numbers. In the example of FIG. 4, the imaging signal (1) obtained in the first field (1), the imaging signal (2) obtained in the second field, the imaging signal (3) obtained in the third field, and the fourth time. The imaging signal (4) obtained in the first field, the imaging signal (5) obtained in the fifth field, and the imaging signal (6) obtained in the sixth field are stored in this order in the main memory 16. It is shown that.

  As shown in FIG. 4, the field synthesis unit 19 is obtained in an imaging signal obtained in an arbitrary field among fields executed for each frame period during moving image shooting, and in an adjacent field of the arbitrary field. By combining the imaging signals, an all-pixel signal including the same number of signals as the total number of photoelectric conversion elements included in the solid-state imaging element 5 is generated.

  For example, as shown in FIG. 4, the field synthesis unit 19 uses the imaging signal (2) obtained in the second field, which is an arbitrary field, and the first field performed immediately before the arbitrary field. The obtained imaging signal (1) is combined to generate an all pixel signal, which is input to the digital signal processing unit 17.

  FIG. 5 is a schematic diagram showing a flow of generating all pixel signals by synthesizing the imaging signal (2) and the imaging signal (1). In FIG. 5, circles with “R”, “G”, “B”, and “W” are obtained from the photoelectric conversion element 51R, the photoelectric conversion element 51G, the photoelectric conversion element 51B, and the photoelectric conversion element 51W, respectively. The imaging signal is shown.

  In the first field, the imaging signal (1) is obtained only from the first photoelectric conversion element group as shown in FIG. Further, in the second field, as shown in FIG. 5, the imaging signal (2) is obtained only from the second photoelectric conversion element group. For this reason, on the main memory 16, the imaging signal (1) is arranged in a region corresponding to the position of the photoelectric conversion elements 51R, 51G, and 51B that is the generation source, and the imaging signal (2) is the generation source. By arranging in the region corresponding to the position of the photoelectric conversion element 51W that has become, all pixel signals as shown in FIG. 5 can be obtained.

  In the digital signal processing unit 17, an imaging signal (an imaging signal (2) in the example of FIG. 5) input from the field synthesis unit 19 and obtained in an arbitrary field and obtained in the field immediately before the arbitrary field. Color image data is generated by performing signal processing on all pixel signals consisting of the imaging signal (imaging signal (1) in the example of FIG. 5), and this color image data corresponds to the frame period in which the arbitrary field is implemented. To be recorded on the recording medium 21 as a frame to be recorded. Alternatively, the color image data is recorded as a field image corresponding to the arbitrary field. Even in this case, since a field image is generated from all the pixel signals, a high-quality field image can be obtained.

  Hereinafter, a specific example of color image data generation processing by the digital signal processing unit 17 will be described. Here, as shown in FIG. 5, a case where all pixel signals are composed of an imaging signal (1) and an imaging signal (2) will be described as an example.

  First, the digital signal processing unit 17 interpolates a color signal that does not exist at the position where the imaging signal (1) of all the pixel signals is arranged from the surrounding imaging signal (1) to obtain an R signal. , G signal, and B signal are generated. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at the position where the imaging signal (1) is arranged.

  Next, the digital signal processing unit 17 interpolates the color difference signal using the color difference signal at the position where the surrounding imaging signal (1) is arranged at the position where the imaging signal (2) of all the pixel signals is arranged. And generate. For the luminance signal at the position where the imaging signal (2) is arranged, the W signal at this position is used as the luminance signal as it is.

  Thereby, the luminance signal and the color difference signal exist at the position of each signal of all the pixel signals, and color image data having the same number of pixels as the total number of photoelectric conversion elements of the solid-state imaging element 5 is generated.

  Note that since the image pickup signal (1) and the image pickup signal (2) are obtained in different exposure periods, there is a possibility that an image shift occurs when the subject is moving. (1) and the imaging signal (2) are obtained from adjacent photoelectric conversion elements, and the image shift is a high-frequency component because it is every pixel, and this image shift is not so noticeable, so it is not a problem.

  Preferably, in order to make the image shift more inconspicuous, the digital signal processing unit 17 applies each photoelectric element of the first photoelectric conversion element group to the luminance signal at each pixel position of the color image data generated as described above. The distance between the conversion element and each photoelectric conversion element in the second photoelectric conversion element group adjacent to the conversion element (of the first photoelectric conversion element group adjacent in the direction intersecting the vertical direction or horizontal direction in FIG. 1 at 45 °) A filter process is performed in which the response to the distance between the photoelectric conversion element and the photoelectric conversion element of the second photoelectric conversion element group becomes zero.

  Each photoelectric conversion element of the first photoelectric conversion element group and each photoelectric conversion element of the second photoelectric conversion element group in a direction crossing the vertical direction or horizontal direction in FIG. 1 at 45 ° (hereinafter referred to as 45 ° direction). When the arrangement pitch (frequency) of each element is B, each photoelectric conversion element of the first photoelectric conversion element group adjacent in the 45 ° direction, and each photoelectric conversion element of the second photoelectric conversion element group adjacent thereto This distance is B / 2 corresponding to the Nyquist frequency. For this reason, the filter processing having the filter coefficient indicated by reference symbol A in FIG. 5 that averages the imaging signals obtained from two photoelectric conversion elements adjacent in the 45 ° direction is performed at each pixel position of the color image data. By applying it to the luminance signal, it is possible to cancel the image shift while maintaining the resolution.

  As described above, according to the digital camera of the present embodiment, the luminance signal generated at the position of each signal of all the pixel signals is generated from the imaging signals obtained in each of the two fields constituting the all pixel signals. Therefore, the image quality equivalent to the all-pixel readout can be realized for a stationary subject.

  Moreover, according to the digital camera of this embodiment, since each photoelectric conversion element of the first photoelectric conversion element group and each photoelectric conversion element of the second photoelectric conversion element group are adjacent to each other, adjacent photoelectric conversion elements The difference in sampling points between them is minimized. For this reason, the image shift due to the moving subject becomes a high-frequency component and is not noticeable. In addition, by performing a filter process in which the response to the interval between two adjacent photoelectric conversion elements is zero with respect to the luminance signal of color image data, it is possible to cancel the image shift while maintaining the resolution. High image quality can be achieved.

  Further, according to the digital camera of this embodiment, the luminance signal of the color image data for each frame is composed of a combination of luminance signals obtained in different fields, so the luminance information of the subject is updated for each frame. be able to. In addition, since the luminance information can be updated by reading signals from half of the photoelectric conversion elements included in the solid-state imaging element 5, the luminance information can be updated at high speed. As described above, since the luminance information for each frame can be updated at a high speed, it is possible to follow a moving subject, and a further improvement in image quality can be realized together with a reduction in image shift.

  Further, according to the digital camera of this embodiment, the arrangement of the color filters provided above the photoelectric conversion elements of the first photoelectric conversion element group is isotropic with no color deviation in the direction of the colors. Therefore, the arrangement of the photoelectric conversion elements in the first photoelectric conversion element group is also isotropic. Therefore, color information can be isotropically obtained from the first photoelectric conversion element group, and color reproduction can be performed regardless of the image structure of the moving subject. In addition, RGB color information can be obtained only in the odd field, and the imaging signal obtained in the odd field is always used for generating color image data, so that color information is not lost due to movement and color shift is suppressed. Can do.

(Second embodiment)
FIG. 6 is a schematic partial plan view of an image sensor mounted on a digital camera according to the second embodiment of the present invention.
The solid-state imaging device shown in FIG. 6 has a configuration in which the second photoelectric conversion element group of the solid-state imaging device 5 shown in FIG. 1 is changed to the same element arrangement as the first photoelectric conversion element group. Since the configuration of the digital camera equipped with the solid-state imaging device shown in FIG. 6 is the same as that of FIG. The information stored in the main memory 16 is as shown in FIG.

  Hereinafter, a specific example of color image data generation processing by the digital signal processing unit 17 of the digital camera equipped with the solid-state imaging device shown in FIG. 6 will be described. Here, as shown in FIG. 7, a case where all pixel signals are composed of an imaging signal (1) and an imaging signal (2) will be described as an example.

  First, the digital signal processing unit 17 interpolates a color signal that does not exist at the position where the imaging signal (1) of all the pixel signals is arranged from the surrounding imaging signal (1) to obtain an R signal. , G signal, and B signal are generated. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at the position where the imaging signal (1) is arranged.

  Next, the digital signal processing unit 17 interpolates the color signal that does not exist at the position where the imaging signal (2) of all the pixel signals is arranged from the surrounding imaging signal (2), and R A signal, a G signal, and a B signal are generated. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at the position where the imaging signal (2) is arranged.

  Thereby, the luminance signal and the color difference signal exist at the position of each signal of all the pixel signals, and color image data having the same number of pixels as the total number of photoelectric conversion elements of the solid-state imaging element 5 is generated.

  The digital signal processing unit 17 applies each of the photoelectric conversion elements of the first photoelectric conversion element group and the second adjacent to the luminance signal and the color difference signal at each pixel position of the color image data generated in this way. Filtering is performed so that the response to the distance from each photoelectric conversion element in the photoelectric conversion element group becomes zero, and the generation of the color image data is completed.

  As described above, even in the configuration of the solid-state imaging device as in the present embodiment, the luminance signal generated at the position of each signal of all the pixel signals was obtained in each of the two fields constituting the all pixel signals. It can be generated from the imaging signal. For this reason, the image quality equivalent to the all-pixel readout can be obtained for a stationary subject. In addition, image shift due to a moving subject is not noticeable because it becomes a high-frequency component, and further, by performing the above filter processing, it is possible to cancel the image shift while maintaining resolution. In addition, since the luminance information for each frame can be updated at high speed, it is possible to follow a moving subject, and a higher image quality can be achieved together with a reduction in image shift.

  Further, according to the digital camera of the present embodiment, the arrangement of the color filters provided above the photoelectric conversion elements of the first photoelectric conversion element group and the second photoelectric conversion element group is biased toward the color arrangement. Therefore, the arrangement of the photoelectric conversion elements in the first photoelectric conversion element group and the second photoelectric conversion element group is also isotropic. Therefore, color information can be obtained isotropically from any field, and color reproduction can be performed regardless of the image structure of the moving subject. In addition, color information is not lost due to movement, and color misregistration can be suppressed.

  In the present embodiment, when the filter processing described in the first embodiment is performed, an RGB color signal is generated at the position of each signal of all pixel signals, and then the filter processing is performed on the color signal. A luminance signal and a color difference signal may be generated from the RGB color signals after processing. As a result, image shift due to motion can be canceled and color change can be made inconspicuous by the blending effect by the filter processing.

  In the first embodiment and the second embodiment, the solid-state imaging device is an example of a CCD type, but this may be a MOS type.

(Third embodiment)
FIG. 8 is a schematic partial plan view of an image sensor mounted on a digital camera according to the third embodiment of the present invention.
The solid-state imaging device shown in FIG. 8 includes a large number of photoelectric conversion elements arranged in a square lattice pattern in the vertical direction on the semiconductor substrate and in the horizontal direction perpendicular thereto.

  The large number of photoelectric conversion elements include a photoelectric conversion element 51R that detects R light (the letter “R” is attached in the drawing) and a photoelectric conversion element 51G that detects G light (“G” in the drawing). And a photoelectric conversion element 51B for detecting B light (indicated by a letter “B” in the drawing).

  A large number of photoelectric conversion elements include a RRBB photoelectric conversion element row in which two photoelectric conversion elements 51R and two photoelectric conversion elements 51B are alternately arranged in the horizontal direction, starting with the photoelectric conversion element 51R, and the photoelectric conversion element 51G in the horizontal direction. And BBRR photoelectric conversion element rows in which two photoelectric conversion elements 51B and two photoelectric conversion elements 51R are alternately arranged in the horizontal direction, starting from the photoelectric conversion element 51B. The conversion element rows and the BBRR photoelectric conversion element rows are alternately arranged in the vertical direction with the G photoelectric conversion element rows interposed therebetween.

  These many photoelectric conversion elements include a first photoelectric conversion element group composed of photoelectric conversion elements not hatched in FIG. 8 and a second photoelectric conversion element composed of photoelectric conversion elements hatched in FIG. It is divided into element groups.

  Each of the photoelectric conversion elements of the first photoelectric conversion element group and each of the photoelectric conversion elements of the second photoelectric conversion element group have a checkered pattern so that these colors have a checkered pattern when they are given different colors. It is arranged in a checkered pattern.

  The solid-state imaging device shown in FIG. 8 is of the MOS type, and a MOS circuit composed of MOS transistors provided in the vicinity of each photoelectric conversion device that outputs an imaging signal corresponding to the charge accumulated in each of the many photoelectric conversion devices. Can be output independently of each other. The configuration of the digital camera equipped with the solid-state imaging device shown in FIG. 8 is the same as that in FIG.

  Similarly to the first embodiment, the image sensor driving unit 10 of the digital camera of the present embodiment has a field for reading out an image signal from only each photoelectric conversion element of the first photoelectric conversion element group, and the second The solid-state imaging device is driven by alternately repeating the field in which the imaging signal is read from only each photoelectric conversion device of the photoelectric conversion device group every frame period. In the following description, it is assumed that a field in which an imaging signal is read from only each photoelectric conversion element in the first photoelectric conversion element group is first implemented.

  Hereinafter, a specific example of color image data generation processing by the digital signal processing unit 17 will be described. The information stored in the main memory 16 is as shown in FIG. Here, as shown in FIG. 9, a case where all pixel signals are composed of an imaging signal (1) and an imaging signal (2) will be described as an example.

  First, the digital signal processing unit 17 interpolates a color signal that does not exist at the position where the imaging signal (1) of all the pixel signals is arranged from the surrounding imaging signal (1) to obtain an R signal. , G signal, and B signal are generated. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at the position where the imaging signal (1) is arranged.

  Next, the digital signal processing unit 17 interpolates the color signal that does not exist at the position where the imaging signal (2) of all the pixel signals is arranged from the surrounding imaging signal (2), and R A signal, a G signal, and a B signal are generated. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at the position where the imaging signal (2) is arranged.

  As a result, the luminance signal and the color difference signal exist at the positions of the signals of all the pixel signals, and color image data having the same number of pixels as the total number of photoelectric conversion elements of the solid-state imaging device is generated.

  The digital signal processing unit 17 applies each photoelectric conversion element of the first photoelectric conversion element group and the second photoelectric element adjacent thereto to the luminance signal and color difference signal of each pixel position of the color image data generated in this way. A filter process in which the response to the distance from each photoelectric conversion element in the conversion element group becomes zero is performed, and the generation of the color image data is completed.

  For example, a luminance signal and a color difference signal at each pixel position of color image data using a filter that takes an average of two signals adjacent in the vertical direction (a filter having a filter coefficient as indicated by reference symbol C in FIG. 9). Filter processing for.

  As described above, even in the configuration of the solid-state imaging device as in the present embodiment, the luminance signals generated at the positions of the signals of all the pixel signals are obtained from each of the two fields constituting the all pixel signals. Since it can be generated from the signal, the image quality equivalent to the all-pixel readout can be obtained for a stationary subject.

  Moreover, according to the digital camera of this embodiment, since each photoelectric conversion element of the first photoelectric conversion element group and each photoelectric conversion element of the second photoelectric conversion element group are adjacent to each other, adjacent photoelectric conversion elements The difference in sampling points between them is minimized. For this reason, the image shift due to the moving subject becomes a high-frequency component and is not noticeable. In addition, by performing a filter process that eliminates the response to the interval between two adjacent photoelectric conversion elements for color image data, it is possible to cancel the image shift while maintaining the resolution. Can be realized. In addition, since the luminance information for each frame can be updated at high speed, it is possible to follow a moving subject, and a higher image quality can be achieved together with a reduction in image shift.

  Further, according to the digital camera of the present embodiment, the arrangement of the color filters provided above the respective photoelectric conversion elements of the first photoelectric conversion element group and the respective photoelectric conversion elements of the second photoelectric conversion element group, Since the color arrangement is isotropic with no direction bias, each arrangement is also isotropic. Accordingly, isotropic color information can be obtained from each of the first photoelectric conversion element group and the second photoelectric conversion element group, and color reproduction is possible without being influenced by the image structure of the moving subject. Become. In addition, color information is not lost due to movement, and color misregistration can be suppressed.

  In the present embodiment, when color image data is subjected to filter processing in which the response to the interval between two adjacent photoelectric conversion elements is zero, RGB color signals are placed at the positions of the signals of all the pixel signals. After generation, filter processing may be performed on the color signal, and a luminance signal and a color difference signal may be generated from the RGB color signal after the filter processing. As a result, image shift due to motion can be canceled and color change can be made inconspicuous by the blending effect by the filter processing.

(Fourth embodiment)
FIG. 10 is a schematic partial plan view of an image sensor mounted on a digital camera according to the fourth embodiment of the present invention.
The solid-state image sensor 5 shown in FIG. 10 has a configuration in which each photoelectric conversion element in the second photoelectric conversion element group of the solid-state image sensor shown in FIG. 8 is replaced with the photoelectric conversion element 51W described in the first embodiment. Yes. Since the configuration of the digital camera on which the solid-state imaging device shown in FIG. 10 is mounted is the same as that of FIG. The information stored in the main memory 16 is as shown in FIG.

  Hereinafter, a specific example of color image data generation processing by the digital signal processing unit 17 of the digital camera equipped with the solid-state imaging device shown in FIG. 10 will be described. Here, as shown in FIG. 11, a case where all pixel signals are composed of an imaging signal (1) and an imaging signal (2) will be described as an example.

  First, the digital signal processing unit 17 interpolates a color signal that does not exist at the position where the imaging signal (1) of all the pixel signals is arranged from the surrounding imaging signal (1) to obtain an R signal. , G signal, and B signal are generated. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at the position where the imaging signal (1) is arranged.

  Next, the digital signal processing unit 17 interpolates the color difference signal using the color difference signal at the position where the surrounding imaging signal (1) is arranged at the position where the imaging signal (2) of all the pixel signals is arranged. And generate. For the luminance signal at the position where the imaging signal (2) is arranged, the W signal at this position is used as the luminance signal as it is.

  Thereby, the luminance signal and the color difference signal exist at the position of each signal of all the pixel signals, and color image data having the same number of pixels as the total number of photoelectric conversion elements of the solid-state imaging element 5 is generated.

  The digital signal processing unit 17 applies each photoelectric conversion element of the first photoelectric conversion element group and the second photoelectric conversion element adjacent thereto to the luminance signal at each pixel position of the color image data generated in this way. Filtering is performed so that the response to the distance from each photoelectric conversion element in the group becomes zero, and the generation of color image data is completed.

  As described above, even in the configuration of the solid-state imaging device as in the present embodiment, the luminance signal generated at the position of each signal of all the pixel signals was obtained in each of the two fields constituting the all pixel signals. Since it can be generated from the imaging signal, the image quality equivalent to the all-pixel readout can be obtained for a stationary subject. Further, the image shift due to the moving subject is also inconspicuous because it becomes a high frequency component, and furthermore, each photoelectric conversion element of the first photoelectric conversion element group and each photoelectric conversion element of the second photoelectric conversion element group adjacent to the first photoelectric conversion element group By performing the filtering process in which the response to the distance to is zero, it is possible to cancel the image shift while maintaining the resolution. In addition, since the luminance information for each frame can be updated at high speed, it is possible to follow a moving subject, and a higher image quality can be achieved together with a reduction in image shift.

  Further, according to the digital camera of this embodiment, the arrangement of the color filters provided above the photoelectric conversion elements of the first photoelectric conversion element group is isotropic with no color deviation in the direction of the colors. Therefore, the arrangement of the photoelectric conversion elements in the first photoelectric conversion element group is also isotropic. Therefore, color information can be isotropically obtained from the first photoelectric conversion element group, and color reproduction can be performed regardless of the image structure of the moving subject. In addition, RGB color information can be obtained only in the odd field, and the image signal obtained in the odd field is always used for generating a frame, so that color information is not lost due to movement and color shift can be suppressed. .

(Fifth embodiment)
FIG. 12 is a schematic partial plan view of an image sensor mounted on a digital camera according to the fifth embodiment of the present invention.
The solid-state imaging device shown in FIG. 12 includes a large number of photoelectric conversion elements arranged in a square lattice pattern in the vertical direction on the semiconductor substrate and in the horizontal direction perpendicular thereto.

  The large number of photoelectric conversion elements include a photoelectric conversion element 51R that detects R light (the letter “R” is attached in the drawing) and a photoelectric conversion element 51G that detects G light (“G” in the drawing). And the photoelectric conversion element 51B for detecting B light (indicated by the letter "B" in the figure) and the first embodiment. Photoelectric conversion element 51W.

  The large number of photoelectric conversion elements include a RWGW photoelectric conversion element row in which the photoelectric conversion elements 51R and the photoelectric conversion elements 51G are alternately arranged in the horizontal direction with the photoelectric conversion elements 51W interposed therebetween, and the photoelectric conversion elements 51W. WGWR photoelectric conversion element rows in which the photoelectric conversion element 51G and the photoelectric conversion element 51R are alternately arranged in the horizontal direction with the photoelectric conversion element 51W interposed therebetween, and the photoelectric conversion element 51G and the photoelectric conversion GWBW photoelectric conversion element rows in which the elements 51B are alternately arranged in the horizontal direction with the photoelectric conversion elements 51W interposed therebetween, and the photoelectric conversion elements 51W at the head, the photoelectric conversion elements 51B and the photoelectric conversion elements 51G in the horizontal direction with the photoelectric conversion elements 51W in between. WBWG photoelectric conversion element rows alternately arranged in the direction, and the RWGW photoelectric conversion element rows and the WGWR photoelectric conversion element rows are GWBW A photoelectric conversion element rows, and a WBWG photoelectric conversion element row, in this order, and has a repeated sequence configurations vertically.

  These many photoelectric conversion elements are in the first photoelectric conversion element group composed of the photoelectric conversion elements in the odd-numbered rows not shown in FIG. 12 and in the even-numbered rows in FIG. It is divided into a second photoelectric conversion element group consisting of photoelectric conversion elements.

  The configuration of the digital camera equipped with the solid-state imaging device shown in FIG. 12 is the same as that in FIG. The information stored in the main memory 16 is as shown in FIG.

  Hereinafter, a specific example of color image data generation processing by the digital signal processing unit 17 of the digital camera equipped with the solid-state imaging device shown in FIG. Here, as shown in FIG. 13, a case where all pixel signals are composed of an imaging signal (1) and an imaging signal (2) will be described as an example.

  First, the digital signal processing unit 17 obtains a color signal that does not exist at the position where the RGB color signal is arranged from the imaging signal (1) around the pixel signal from the surrounding imaging signals (1). Interpolate to generate R, G, and B signals. Then, a luminance signal and a color difference signal are generated from the R signal, the G signal, and the B signal at a position where the RGB color signal is arranged in the imaging signal (1).

  Next, the digital signal processing unit 17 positions the W signal in the imaging signal (1) of all the pixel signals, and positions the RGB color signals in the surrounding imaging signal (1). A color difference signal is interpolated and generated using a certain color difference signal. For the luminance signal at the position where the W signal is arranged in the imaging signal (1), the W signal at this position is used as the luminance signal as it is.

  Next, the digital signal processing unit 17 converts a color signal that does not exist at the position where the RGB color signal is arranged in the image signal (2) of all the pixel signals into an image signal (2) around it. Are interpolated to generate an R signal, a G signal, and a B signal. Then, from the R signal, the G signal, and the B signal, a luminance signal and a color difference signal are generated at a position where the RGB color signal is arranged in the imaging signal (2).

  Next, the digital signal processing unit 17 is located at the position where the W signal is arranged in the imaging signal (2) of all the pixel signals, and at the position where the RGB color signal is arranged in the surrounding imaging signal (2). A color difference signal is interpolated and generated using a certain color difference signal. For the luminance signal at the position where the W signal is arranged in the imaging signal (2), the W signal at this position is used as the luminance signal as it is.

  Thereby, the luminance signal and the color difference signal exist at the position of each signal of all the pixel signals, and color image data having the same number of pixels as the total number of photoelectric conversion elements of the solid-state imaging element 5 is generated.

  The digital signal processing unit 17 adds each photoelectric conversion element of the first photoelectric conversion element group and the second photoelectric conversion adjacent thereto to the luminance signal and color difference signal of each pixel position of the color image data generated as described above. A filter process in which the response to the distance from each photoelectric conversion element of the element group becomes zero is performed, and the generation of the color image data is completed.

  As described above, even in the configuration of the solid-state imaging device as in the present embodiment, the luminance signal generated at the position of each signal of all the pixel signals was obtained in each of the two fields constituting the all pixel signals. Since it can be generated from the imaging signal, the image quality equivalent to the all-pixel readout can be obtained for a stationary subject.

  Moreover, according to the digital camera of this embodiment, since each photoelectric conversion element of the first photoelectric conversion element group and each photoelectric conversion element of the second photoelectric conversion element group are adjacent to each other, adjacent photoelectric conversion elements The difference in sampling points between them is minimized. For this reason, the image shift due to the moving subject becomes a high-frequency component and is not noticeable. Further, the color image data is subjected to a filter process in which the response to the interval between two adjacent photoelectric conversion elements becomes zero, thereby canceling the image shift while maintaining the resolution and changing the color change by the filter process. It can be made inconspicuous by blend effect. In addition, since the luminance information for each frame can be updated at high speed, it is possible to follow a moving subject, and a higher image quality can be achieved together with a reduction in image shift.

(Sixth embodiment)
In the present embodiment, the digital camera described in the first embodiment on which the solid-state imaging device shown in FIG. 1 is mounted and the digital camera described in the fourth embodiment on which the solid-state imaging device shown in FIG. Will be described.

  In the photoelectric conversion elements 51R, 51G, and 51B and the photoelectric conversion element 51W, the sensitivity of the photoelectric conversion element 51W is higher. Therefore, in the solid-state imaging element shown in FIGS. If the second and second photoelectric conversion element groups are driven under the same conditions, there arises a problem that the dynamic range cannot be effectively used. Therefore, means for solving this problem are listed below.

(A) At the time of exposure of the first photoelectric conversion element group (exposure period in the frame period in which the odd field is implemented), and at the time of exposure of the second photoelectric conversion element group (exposure period in the frame period in which the even field is implemented) To change the exposure condition.
For example, by making the exposure time of the second photoelectric conversion element group shorter than the exposure time of the first photoelectric conversion element group, it is optimal for the dynamic ranges of the photoelectric conversion elements 51R, 51G, 51B and the photoelectric conversion element 51W. It can be exposure.

  Also, when shooting in the dark or when using a digital camera as an endoscope to shoot a subject and shooting, the amount of illumination light at the time of exposure of the second photoelectric conversion element group is set to By reducing the amount of illumination light at the time of exposure of the photoelectric conversion element group, it is possible to achieve exposure optimal for the dynamic ranges of the photoelectric conversion elements 51R, 51G, 51B and the photoelectric conversion element 51W.

  Alternatively, when the subject is illuminated for shooting, the photoelectric conversion element 51 </ b> R is obtained by reducing the illumination time during exposure of the second photoelectric conversion element group to be shorter than the illumination time for the first photoelectric conversion element group. , 51G, 51B and photoelectric conversion element 51W can be optimally exposed to the dynamic range.

  Alternatively, when shooting is performed by illuminating the subject, and the light is intermittently applied to the subject, the dynamic range of each of the photoelectric conversion elements 51R, 51G, and 51B and the photoelectric conversion element 51W is controlled by controlling the interval. Optimal exposure can be achieved.

  Alternatively, when shooting with the subject illuminated, the light source that emits light to illuminate the subject is changed between the exposure of the first photoelectric conversion element group and the exposure of the second photoelectric conversion element group. Thus, it is possible to perform exposure optimal for the dynamic ranges of the photoelectric conversion elements 51R, 51G, and 51B and the photoelectric conversion element 51W.

  Further, by changing the aperture value of the diaphragm 2 between the exposure of the first photoelectric conversion element group and the exposure of the second photoelectric conversion element group, the photoelectric conversion elements 51R, 51G, 51B and the photoelectric conversion element 51W respectively. The exposure can be optimized for the dynamic range of.

  In addition, an optical filter such as an ND filter can be inserted into and removed from the front surface of the solid-state image sensor 5, and the ND filter is retracted from the front surface of the solid-state image sensor 5 when the first photoelectric conversion element group is exposed. By exposing the ND filter to the front surface of the solid-state imaging device 5 at the time of exposure of the photoelectric conversion element group, the exposure can be optimized for the dynamic ranges of the photoelectric conversion elements 51R, 51G, 51B and the photoelectric conversion element 51W.

(B) The component of light incident on the solid-state imaging device 5 is changed between the exposure of the first photoelectric conversion element group and the exposure of the second photoelectric conversion element group.
The photoelectric conversion element 51W can acquire luminance information by itself, but each of the photoelectric conversion elements 51R, 51G, and 51B can obtain only one color information. For this reason, the element pitch per color is wider in the photoelectric conversion elements 51R, 51G, and 51B than in the photoelectric conversion element 51W. Therefore, the optical low-pass filter process suitable for the exposure of the first photoelectric conversion element group and the exposure of the second photoelectric conversion element group is performed and light is incident on the solid-state imaging element 5, thereby obtaining the sampling characteristics. Optimization can be achieved.

  For example, the optical low-pass filter 4 is made movable so that it can be switched between a state where the optical low-pass filter 4 is inserted into the front surface of the solid-state imaging device 5 and a state where it is retracted from the front surface. The optical low-pass filter 4 is inserted into the front surface of the solid-state image sensor 5 only during the exposure. As a result, it is possible to reduce the false signal due to the interpolation of the color signal while maintaining the information from the photoelectric conversion element 51W.

(C) The signal amplifying means included in the analog signal processing unit 6 in which the system control unit 11 includes an imaging signal output from the first photoelectric conversion element group and an imaging signal output from the second photoelectric conversion element group. The gain of the imaging signal by the VGA (variable gain amplifier) is changed.
The dynamic range of the imaging signal also changes due to quantization by A / D conversion. For this reason, the quantization can be optimized by controlling the analog gain before the A / D conversion of the imaging signal.

Schematic diagram of a partial plane of an image sensor mounted on the image pickup apparatus according to the first embodiment of the present invention. The figure which shows schematic structure of the digital camera which is an example of the imaging device carrying the solid-state image sensor shown in FIG. The figure for demonstrating the function of the field synthetic | combination part 19 shown in FIG. The figure for demonstrating the function of the field synthetic | combination part 19 shown in FIG. The schematic diagram which showed the flow which synthesize | combines the imaging signal (2) and imaging signal (1) of FIG. The partial plane schematic diagram of the image pick-up element mounted in the digital camera which is 2nd embodiment of this invention The figure which shows all the pixel signals produced | generated by the field synthetic | combination part of the digital camera carrying the solid-state image sensor shown in FIG. Partial plan view of an image sensor mounted on a digital camera according to a third embodiment of the present invention. The figure which shows all the pixel signals produced | generated by the field synthetic | combination part of the digital camera carrying the solid-state image sensor shown in FIG. Partial plan view of an image sensor mounted on a digital camera according to a fourth embodiment of the present invention. The figure which shows all the pixel signals produced | generated by the field synthetic | combination part of the digital camera carrying the solid-state image sensor shown in FIG. Partial plan view of an image sensor mounted on a digital camera according to a fifth embodiment of the present invention The figure which shows all the pixel signals produced | generated by the field synthetic | combination part of the digital camera carrying the solid-state image sensor shown in FIG.

Explanation of symbols

5 Solid-state image sensors 51R, 51G, 51B, 51W Photoelectric conversion element 10 Image sensor driving unit 17 Digital signal processing unit 19 Field composition unit

Claims (15)

An image pickup apparatus having an image pickup device including a large number of photoelectric conversion elements arranged two-dimensionally in a vertical direction on a substrate and in a horizontal direction perpendicular thereto,
The large number of photoelectric conversion elements are divided into a first photoelectric conversion element group consisting of a first photoelectric conversion element and a second photoelectric conversion element group consisting of a second photoelectric conversion element,
The first photoelectric conversion element and the second photoelectric conversion element are disposed adjacent to each other,
The first photoelectric conversion element group and the second photoelectric conversion element group can each independently read a signal,
The first signal read from the first photoelectric conversion element group and the second signal read from the second photoelectric conversion element group can each obtain luminance information of the subject alone. Signal,
Furthermore, at least one of the first signal and the second signal is a signal that can obtain color information of primary colors of R (red), G (green), and B (blue) by itself. And
At the time of moving image shooting, a field for reading a signal only from the first photoelectric conversion element group and a field for reading a signal only from the second photoelectric conversion element group are alternately repeated for each frame period, so that the solid-state image pickup element is Driving means for driving;
Combining an image pickup signal obtained from the image pickup element in an arbitrary field and an image pickup signal obtained from the image pickup element in an adjacent field of the arbitrary field, the signal includes the same number of signals as the total number of the photoelectric conversion elements. All pixel signal generating means for generating all pixel signals;
Image data generating means for generating image data based on all the pixel signals ;
An image pickup apparatus comprising: a filter processing unit that performs a filtering process on the image data so that a response to an interval between the first photoelectric conversion element and the second photoelectric conversion element adjacent thereto is zero. The imaging apparatus according to claim 1,
The all-pixel signal generating means combines the imaging signal obtained from the imaging element in the arbitrary field and the imaging signal obtained from the imaging element in the field immediately before the arbitrary field. Produces
An image pickup apparatus in which the image data generation unit generates image data for a frame corresponding to a frame period in which the arbitrary field is implemented based on the all pixel signals. The imaging apparatus according to claim 1 or 2,
  An imaging apparatus in which a filter array provided above each photoelectric conversion element of the first photoelectric conversion element group is isotropic. The imaging apparatus according to claim 1 or 2,
  The filter array provided above each photoelectric conversion element of the first photoelectric conversion element group and the filter array provided above each photoelectric conversion element of the second photoelectric conversion element group are isotropic, respectively. Imaging device. The imaging apparatus according to any one of claims 1 to 4,
  The array of the first photoelectric conversion elements and the array of the second photoelectric conversion elements are each a square array having the same array pitch,
  An imaging apparatus in which the first photoelectric conversion element group and the second photoelectric conversion element group are arranged to be shifted in the vertical direction and the horizontal direction by a half of the photoelectric conversion element arrangement pitch included in each of the first photoelectric conversion element group and the second photoelectric conversion element group . The imaging apparatus according to claim 5, wherein
  The first photoelectric conversion element group includes an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric conversion element that detects B light.
  The imaging apparatus in which the second photoelectric conversion element group includes a W photoelectric conversion element that detects a luminance component of light. The imaging apparatus according to claim 5, wherein
  The first photoelectric conversion element group and the second photoelectric conversion element group are respectively an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric that detects B light. An imaging device composed of a conversion element. The imaging apparatus according to any one of claims 1 to 4,
  The arrangement of the multiple photoelectric conversion elements is a square arrangement,
  An imaging apparatus in which the first photoelectric conversion element and the second photoelectric conversion element are arranged in a checkered pattern. The imaging apparatus according to claim 8, wherein
  The first photoelectric conversion element group includes an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric conversion element that detects B light.
  The imaging apparatus in which the second photoelectric conversion element group includes a W photoelectric conversion element that detects a luminance component of light. The imaging apparatus according to claim 8, wherein
  The first photoelectric conversion element group and the second photoelectric conversion element group are respectively an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric that detects B light. An imaging device configured with a conversion element. The imaging apparatus according to any one of claims 1, 2, and 3,
  The arrangement of the multiple photoelectric conversion elements is a square arrangement,
  The photoelectric conversion elements in the odd rows are the first photoelectric conversion element group,
  An imaging apparatus in which photoelectric conversion elements in even-numbered rows form the second photoelectric conversion element group. The imaging apparatus according to claim 11,
  The first photoelectric conversion element group and the second photoelectric conversion element group are respectively an R photoelectric conversion element that detects R light, a G photoelectric conversion element that detects G light, and a B photoelectric that detects B light. An imaging apparatus including a conversion element and a W photoelectric conversion element that detects a luminance component of light. The imaging apparatus according to claim 6 or 9, wherein
  An imaging apparatus comprising an exposure control unit that changes an exposure condition between exposure of the first photoelectric conversion element group and exposure of the second photoelectric conversion element group. The imaging apparatus according to claim 6 or 9, wherein
  An image pickup apparatus comprising: means for changing a component of light incident on the image pickup element between exposure of the first photoelectric conversion element group and exposure of the second photoelectric conversion element group. The imaging apparatus according to claim 6 or 9, wherein
  A signal amplifying means for amplifying a signal output from the image sensor;
  Amplification rate control means for changing a signal amplification rate by the signal amplification means between a signal output from the first photoelectric conversion element group and a signal output from the second photoelectric conversion element group. Imaging device.

Images