JP2014068404A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately adjust a difference of resolution, which occurs between a region where pixel addition is performed and a region where pixel addition is not performed.SOLUTION: An image processing section of an imaging apparatus adjusts resolution between an image shown by signals outputted with pixel signal addition and an image shown by signals outputted without pixel signal addition when an imaging element output an image signal in which pixel signal addition is performed on pixel signals read from designated pixels among a plurality of pixels arranged in the imaging element. A pixel addition discrimination section obtains an area ratio of a bright part of a subject and a dark part of the subject within an imaging range of the imaging element from luminance distribution information, and gives an instruction to enlarge the image shown by the signals outputted with pixel signal addition to the image processing section when the bright part of the subject is larger than the dark part of the subject within the imaging range of the imaging element, and gives an instruction to reduce the image shown by the signals outputted without pixel signal addition to the image processing section when the dark part of the subject is larger than the bright part of the subject within the imaging range of the imaging element.

Description

  The present invention relates to an imaging apparatus.

  Conventionally, as shown in Patent Document 1, for example, there has been proposed an imaging device that locally performs pixel addition in a low-luminance region in an image when imaging a scene having a luminance difference.

JP2007-251694A

  However, Patent Document 1 has room for improvement in how to adjust a difference in resolution generated between a region where pixel addition is performed and a region where pixel addition is not performed to output one image.

  An imaging apparatus according to one aspect includes a first imaging element, a second imaging element, a pixel addition determination unit, a timing generator, and an image processing unit. The first image sensor is an image sensor in which a plurality of pixels are arranged, and can add and output a pixel signal read from a designated pixel among the plurality of pixels. The second image sensor captures a subject and generates luminance distribution information indicating a correspondence relationship between the imaging range of the first image sensor and the luminance of the subject. The pixel addition determination unit generates pixel position information indicating the position of the pixel to which the pixel signal is added among the plurality of pixels arranged in the first image sensor based on the luminance distribution information. The timing generator supplies a drive signal for causing the pixel designated based on the pixel position information to be added to the first image sensor. When the image processing unit adds and outputs a pixel signal read from a designated pixel among a plurality of pixels arranged in the first image sensor, the image processing unit is indicated by the signal output by adding the pixel signal. The resolution is adjusted between the image and the image indicated by the output signal without adding the pixel signal. The pixel addition determining unit obtains an area ratio between a bright part of the subject and a dark part of the subject within the imaging range of the first image sensor from the luminance distribution information, and a dark part of the subject within the imaging range of the first image sensor. When there are more bright parts of the subject, the image processing unit is instructed to enlarge the image indicated by the output signal by adding the pixel signals, and the subject is within the imaging range of the first image sensor. If there are more dark parts of the subject than bright parts, the image processing unit is instructed to reduce the image indicated by the output signal without adding the pixel signals.

  An imaging device according to another aspect includes an imaging device, a pixel addition determination unit, a timing generator, and an image processing unit. The image sensor is an image sensor in which a plurality of pixels are arranged, and can output a pixel signal read from a designated pixel among the plurality of pixels. The pixel addition determination unit generates pixel position information indicating a position of a pixel to which pixel signals are added among a plurality of pixels, based on luminance distribution information indicating a correspondence relationship between the imaging range of the imaging element and subject luminance. The timing generator supplies a drive signal for causing the pixel designated based on the pixel position information to be added to the image sensor. When the image processing unit adds and outputs a pixel signal read from a specified pixel among a plurality of pixels, the image processing unit does not add the pixel signal to the image indicated by the output signal and add the pixel signal. The resolution is adjusted with the image indicated by the signal output to. The pixel addition determination unit obtains an area ratio between a bright part of the subject and a dark part of the subject in the imaging range of the image sensor from the luminance distribution information, and the subject area is more than the dark part of the subject in the imaging range of the image sensor. When there are many bright parts, the image processing unit is instructed to enlarge the image indicated by the signal output by adding the pixel signals, and the subject is located within the imaging range of the image sensor rather than the bright part of the subject. When there are many dark portions, the image processing unit is instructed to reduce the image indicated by the output signal without adding pixel signals.

  In the imaging apparatus of the present invention, the difference in resolution generated between the area where pixel addition is performed and the area where pixel addition is not performed is appropriately adjusted.

1 is a block diagram illustrating a configuration example of an imaging apparatus according to an embodiment. (A): Diagram showing an example of pixel addition for four pixels on the R plane, (b): Diagram showing an example of pixel addition for 16 pixels on the R plane. The figure which shows the circuit structural example of the 1st image pick-up element in one Embodiment. 6 is a flowchart for explaining an operation example of an imaging apparatus according to an embodiment. (A): Schematic diagram explaining the case where pixel addition is performed inside the image sensor, (b): Schematic diagram explaining the case where pixel addition is performed outside the image sensor (comparative example) (A): A diagram showing an example of enlarging a portion where pixel addition has been performed and aligning the resolution of an image, (b): A diagram showing an example of reducing a portion where pixel addition has not been performed and aligning the resolution of an image

  FIG. 1 is a block diagram illustrating a configuration example of an imaging apparatus according to an embodiment. The imaging apparatus includes an imaging optical system 11 and an aperture 12, a first imaging element 13, an AFE 14, an image processing unit 15, a timing generator (TG) 16, a frame memory 17, a recording I / F 18, and a lens 19. And a second image sensor 20, a signal processing unit 21, a CPU 22, and an operation unit 23. The aperture 12, the image processing unit 15, the TG 16, the recording I / F 18, the signal processing unit 21, and the operation unit 23 are connected to the CPU 22, respectively.

  The imaging optical system 11 includes a plurality of lenses including a zoom lens and a focusing lens. For simplicity, the imaging optical system 11 is illustrated as a single lens in FIG. The diaphragm 12 adjusts the amount of light per unit time incident on the first image sensor 13. The opening amount (aperture value) of the diaphragm 12 is adjusted according to an instruction from the CPU 22.

  On the light receiving surface of the first image sensor 13, a plurality of pixels are arranged in a matrix. Further, red (R), green (Gr, Gb), and blue (B) color filters are arranged in a known Bayer array in each pixel of the first image sensor 13. Then, the first image sensor 13 captures an image of the subject by the light flux that has passed through the imaging optical system 11 and the diaphragm 12, and generates an analog image signal. Note that the output of the first image sensor 13 is connected to the AFE 14.

  The first image sensor 13 is configured by a CMOS solid-state image sensor that can read an image signal of an arbitrary pixel by random access. The first image sensor 13 can add and output the signal values of the pixel group included in the partial area specified in the pixel array on the light receiving surface. In this pixel addition, signal values are added for each color filter (R plane, Gr plane, Gb plane, B plane) in the designated partial region. In addition, the first image sensor 13 in one embodiment includes pixel addition for adding a range of 2 × 2 pixels (for 4 pixels) in each color to 1 pixel, and 4 × 4 pixels (for 16 pixels) in each color. Pixel addition for adding the range to one pixel can be selectively executed. As an example, FIG. 2A shows an example of pixel addition for four pixels on the R plane, and FIG. 2B shows an example of pixel addition for 16 pixels on the R plane. It is assumed that the same pixel addition is performed for the other colors described above.

  FIG. 3 is a diagram illustrating a circuit configuration example of the first image sensor 13 in the embodiment. In FIG. 3, for simplification, only the 2 × 2 R pixels (pixels PX1 to PX4) shown in FIG. 2 are partially shown, but the pixels PX5 to PX8, PX9 to PX12 shown in FIG. The circuits PX13 to PX16 are also configured similarly to the pixels PX1 to PX4. Of course, it goes without saying that a larger number of pixels are arranged on the light receiving surface of the actual first image sensor 13. In FIG. 3, illustration of a vertical decoder, a horizontal decoder, etc. is omitted.

  In the pixels PX1 to PX4 shown in FIG. 3, one photodiode PD and one transfer transistor TX are arranged for each pixel. Further, in the four pixels PX1 to PX4, the floating diffusion FD, the reset transistor RES, the amplification transistor AMP, and the selection transistor SEL are shared (so-called 7.75 / 4 pixel 1.75Tr configuration).

  Said photodiode PD produces | generates a signal charge according to the light quantity of incident light. The transfer transistor TX transfers the signal charge accumulated in the photodiode PD to the floating diffusion FD. The reset transistor RES resets the floating diffusion FD to the power supply voltage. The amplification transistor AMP outputs a read current to the output terminal via the selection transistor SEL according to the voltage value of the floating diffusion FD. The selection transistor SEL connects the source of the amplification transistor AMP to the output terminal.

  Further, when the signal values of the pixels PX1 to PX4 are read out separately, the first image sensor 13 may output the signal charges of the four photodiodes PD sequentially in a time division manner. On the other hand, when the pixels PX1 to PX4 are added and read out, the first image sensor 13 may accumulate the signal charges of the four photodiodes PD in the floating diffusion FD and output them. When pixel addition is performed, the amplification transistor AMP adjusts the gain of the signal value according to the number of pixels to be added. For example, when adding four pixels as described above, the amplification transistor AMP multiplies the signal value after the addition by ¼.

  Note that the outputs of the four systems of pixels PX 1 -PX 4, PX 5 -PX 8, PX 9 -PX 12, and PX 13 -PX 16 are connected to the pixel addition circuit in the first image sensor 13, respectively. This pixel addition circuit adds signal values for 16 pixels of the pixels PX1 to PX16 in accordance with an instruction from the CPU 22.

  Returning to FIG. 1, the AFE 14 is an analog front-end circuit that performs analog signal processing on the output of the first image sensor 13. The AFE 14 performs correlated double sampling, image signal gain adjustment, and A / D conversion of the image signal. The output of the AFE 14 is connected to the image processing unit 15. The CPU 22 adjusts the imaging sensitivity corresponding to the ISO sensitivity by adjusting the gain of the image signal by the AFE 14.

  The image processing unit 15 performs various types of image processing (color interpolation processing, gradation conversion processing, white balance adjustment, etc.) on the digital image signal. In addition, when the image processing unit 15 performs pixel addition with the first image sensor 13 to acquire a captured image, the pixel added portion and the pixel addition are not performed in the captured image of one frame. Adjust the resolution (image size) between parts.

  The TG 16 supplies a driving signal for synchronization to the first image sensor 13, the AFE 14, and the image processing unit 15 based on the output of the CPU 22. In addition, when performing pixel addition, the TG 16 supplies a drive signal instructing readout of a signal value by pixel addition to each pixel in the partial area of the first image sensor 13.

  The frame memory 17 is a memory connected to the image processing unit 15 and temporarily stores image data in the pre-process and post-process of image processing. For example, the frame memory 17 is configured by an SDRAM that is a volatile storage medium.

  The recording I / F 18 is formed with a connector for connecting a nonvolatile storage medium 24. The recording I / F 18 writes / reads data to / from the storage medium 24 connected to the connector. The storage medium 24 is composed of a hard disk, a memory card incorporating a semiconductor memory, or the like. In FIG. 1, a memory card is illustrated as an example of the storage medium 24.

  The second image pickup device 20 is a photometric sensor that picks up an image of a subject including the image pickup range of the first image pickup device 13 in color with a light beam that has passed through a lens 19 separate from the image pickup optical system 11. In one embodiment, the resolution (number of pixels) of the second image sensor 20 is set lower than the resolution of the first image sensor 13. The second image sensor 20 acquires luminance distribution information indicating the correspondence between the imaging range of the first image sensor 13 and the luminance of the subject. The output of the second image sensor 20 is connected to the signal processing unit 21. The signal processing unit 21 performs various signal processing and A / D conversion on the output of the second image sensor 20.

  The CPU 22 is a processor that comprehensively controls the operation of the imaging apparatus. The CPU 22 includes a pixel addition determination unit 25, an imaging condition adjustment unit 26, and a work memory 27 that stores calculation results obtained by the CPU 22.

  The pixel addition discriminating unit 25 designates the position of the partial area where pixel addition is performed in the pixel array of the first image sensor 13 using the luminance distribution information. Further, the pixel addition determination unit 25 determines a resolution adjustment method by the image processing unit 15 using the luminance distribution information.

  The imaging condition adjustment unit 26 adjusts imaging conditions when the first imaging element 13 captures a captured image using the luminance distribution information. For example, the imaging condition adjustment unit 26 performs a known automatic exposure (AE) calculation using the luminance distribution information. Then, the imaging condition adjustment unit 26 sets the aperture value of the aperture 12, the charge accumulation time of the first image sensor 13 (in shutter seconds), and the gain (imaging sensitivity) of the AFE 14.

  In addition, the imaging condition adjustment unit 26 performs white balance calculation using the luminance distribution information. At this time, the imaging condition adjustment unit 26 obtains the white balance adjustment values (Grd, Gbd) based on the average values Rave, Gave, and Bave of the gradations in the respective color components of the subject. The white balance adjustment value Grd for correcting the R level can be obtained by Gave / Rave. The white balance adjustment value Gbd for correcting the B level can be obtained by Gave / Bave. Note that the image processing unit 15 executes the white balance adjustment of the captured image by applying the white balance adjustment values (Grd, Gbd) described above.

  The operation unit 23 includes a plurality of switches that accept user operations. The operation unit 23 includes, for example, a release button that receives a captured image acquisition instruction, a cross-shaped cursor key, a determination button, and the like.

  Next, an operation example of the imaging apparatus according to the embodiment will be described with reference to the flowchart of FIG. The process of the flowchart of FIG. 4 is started when the CPU 22 receives an instruction to acquire a captured image by pressing the release button.

  Step S101: The CPU 22 drives the second image sensor 20 to acquire luminance distribution information. The luminance distribution information is stored in the work memory 27 under the control of the CPU 22.

  Step S102: The pixel addition discriminating unit 25 generates address information indicating the position of the partial region in which the pixel addition is performed within the imaging range of the first imaging element 13, based on the luminance distribution information (S101). At this time, the pixel addition determination unit 25 pays attention to the magnitude of the luminance value at each position indicated by the luminance distribution information. Then, the pixel addition determining unit 25 designates, as the partial area, a portion where the luminance value of the subject is equal to or less than the threshold within the imaging range of the first imaging element 13.

  As an example, when the gradation of the RAW image captured by the first image sensor 13 is 12 bits (0-4095), the pixel addition determination unit 25 sets the value corresponding to 200 LSB when converted to the output of the RAW image. The first threshold is set, and a value corresponding to 100 LSB when converted into the output of the RAW image is set as the second threshold. Then, the pixel addition determination unit 25 designates a portion where the luminance value is equal to or less than the second threshold in the imaging range of the first imaging element 13 as a partial region where pixel addition for 16 pixels is performed. In addition, the pixel addition determination unit 25 designates a portion where the luminance value exceeds the second threshold value but is equal to or less than the first threshold value in the imaging range of the first imaging element 13 as a partial region for performing pixel addition for four pixels. .

  In addition, the pixel addition determination unit 25 generates address information indicating the position of the partial area. This address information is stored in the work memory 27 under the control of the CPU 22. Note that if the luminance value exceeds the first threshold value in the entire imaging range of the first imaging element 13, the pixel addition determination unit 25 shifts the process to S103 without generating address information.

  Here, the reason why pixel addition is performed in the low-luminance portion in one embodiment is that noise becomes more conspicuous in the low-luminance portion of the image. If the signal values are averaged by performing pixel addition, the influence of noise can be reduced. In one embodiment, the influence of noise can be further suppressed by performing pixel addition inside the image sensor.

FIG. 5A is a schematic diagram illustrating a case where pixel addition is performed inside the image sensor. In this example, an example in which outputs for two pixels are added will be described. Figure in example 5 (a), the noise generated in each pixel is _{N P1, N P2,} the baseline noise and _{N B,} when the gain of the amplifier and A, total noise _{N 1} is the following formula (1 ).

In the above formula (1), for the sake of simplicity, when N _P1 = N _P2 = N _P and the gain A is set to 1 and divided by 2 in consideration of the addition of two pixels, the following formula (2) Can be organized like

On the other hand, FIG. 5B is a schematic diagram illustrating a case where pixel addition is performed outside the imaging device as a comparative example. In the example of FIG. 5B, assuming that the noise generated in each pixel is N _P1 and N _P2 , the respective baseline noises are N _B1 and N _B2, and the gain at the amplifier is A, the total noise N ₂ is It can be represented by the following formula (3).

In the above formula (3), for the sake of simplicity, N _P1 = N _P2 = N _P , N _B1 = N _B2 = N _B , and the gain A is set to 1, and the two pixels are added and divided by 2 And can be organized as the following equation (4).

Comparing the _{N 2} of formula (2) _{N 1} and equation (4) of, according to _N ^{B 2} in the square root in the numerator in the formula by "2" of the minute, the _{N 2} shown in equation (4) The value is larger. From this, it is understood that noise can be reduced by performing pixel addition inside the image sensor, compared to the case where pixel addition is performed outside the image sensor.

  Step S103: The imaging condition adjustment unit 26 uses the luminance distribution information (S101) to adjust imaging conditions (aperture value, shutter speed, etc.) when the first imaging element 13 captures a captured image. Further, the imaging condition adjustment unit 26 obtains a white balance adjustment value using the luminance distribution information (S101).

  Step S104: The pixel addition discriminating unit 25 determines whether or not a partial area for pixel addition is designated based on the presence / absence of the address information (S102) in the work memory 27. If the address information exists, the pixel addition determination unit 25 makes a determination on the YES side of S104 and shifts the process to S105. On the other hand, if the address information does not exist, the pixel addition determination unit 25 performs the determination on the NO side in S104 and shifts the process to S107.

  Step S105: The CPU 22 drives the first image sensor 13 via the TG 16 to execute subject imaging processing.

  The pixel addition determination unit 25 in S105 outputs address information (S102) to the TG 16 prior to imaging, and instructs the TG 16 to determine the position of the partial region where pixel addition is to be performed. Then, the TG 16 at the time of imaging supplies a drive signal instructing reading of a signal value by pixel addition to each pixel in the partial area of the first image sensor 13.

  Accordingly, the image signal of the captured image is output from the first image sensor 13 in a state where the outputs of the pixels in the partial area designated by the address information are locally added. As an example, when imaging with all-pixel readout is performed, one signal value is output per pixel in a portion where pixel addition is not performed by the first image sensor 13, but pixel addition is performed by the first image sensor 13. In the portion, one signal value is output for every 4 pixels or 16 pixels.

  Each image signal output from the first image sensor 13 passes through the AFE 14 and the image processing unit 15 in a pipeline manner and is buffered in the frame memory 17.

  Step S106: The image processing unit 15 adjusts the resolution of the captured image of one frame stored in the frame memory 17 between a portion where pixel addition is performed and a portion where pixel addition is not performed. At this time, the image processing unit 15 may (b) enlarge the portion where the pixel addition has been performed to align the resolution of the image (see FIG. 6A). Further, the image processing unit 15 may (b) reduce the portion where the pixel addition is not performed to make the image resolution uniform (see FIG. 6B). In addition, when the pixel addition for 16 pixels and the pixel addition for 4 pixels are respectively performed in one captured image, the image processing unit 15 has the resolution even between the portions where the pixel addition is performed with different numbers of pixels. Adjustments shall be made.

  In addition, the pixel addition determination unit 25 determines whether the resolution adjustment in S106 is performed by the above method (A) or (B) based on the luminance distribution information (S101). As an example, the pixel addition determination unit 25 obtains the area ratio between the bright part and the dark part of the subject in the imaging range based on the luminance distribution information (S101). When the bright area becomes larger than the dark area with the above area ratio, the pixel addition determination unit 25 instructs to enlarge the pixel-added part and align the resolution of the image. On the other hand, if the dark portion and the bright portion are equal in the above area ratio, or if the dark portion is larger than the bright portion, the pixel addition determining unit 25 reduces the portion where the pixel is not added. To instruct the image to have the same resolution.

  Then, after the above processing, the CPU 22 records the captured image data in the storage medium 24 via the recording I / F 18, and ends the series of processing in FIG.

  Step S107: The CPU 22 drives the first image sensor 13 via the TG 16 to execute subject imaging processing. In S108, the CPU 22 instructs the first image sensor 13 to perform normal signal readout via the TG 16. Then, the first image sensor 13 outputs an image signal of the captured image without performing local pixel addition. Note that the captured image data is recorded in the storage medium 24 via the recording I / F 18 after predetermined processing is performed by the AFE 14 and the image processing unit 15. Above, description of the flowchart of FIG. 4 is complete | finished.

  The imaging apparatus according to the embodiment uses the luminance distribution information acquired from the second imaging element 20 to obtain a location where the luminance of the subject is equal to or lower than a threshold (S101, S102). Then, the imaging apparatus locally performs pixel addition in the first imaging element 13 at a location where the luminance of the subject is equal to or less than the threshold value, and acquires a captured image (S105, S106). Thereby, in the imaging device of one embodiment, it is possible to acquire a captured image in which the influence of noise is suppressed in the low luminance part of the subject.

  In the imaging device of one embodiment, luminance distribution information is acquired by the second imaging element 20 that is separate from the first imaging element 13 that captures a captured image. For this reason, in the imaging apparatus according to one embodiment, the luminance distribution information can be acquired without driving the first imaging element 13, so that imaging with pixel addition can be performed more quickly.

  In the imaging device of one embodiment, by performing local pixel addition inside the first imaging element 13, it is possible to further reduce noise in a low-luminance portion of the captured image. In the imaging device of one embodiment, reading of a captured image can be speeded up by performing local pixel addition inside the first imaging element 13.

<Supplementary items of the embodiment>
(1) In the above-described embodiment, the example in which the luminance distribution information is acquired according to the captured image acquisition instruction has been described. However, for example, the luminance distribution information is acquired during the AF operation prior to the captured image acquisition instruction. Also good.

  (2) In the above-described one embodiment, an example in which a still image is acquired as a captured image has been described. However, the image capturing apparatus of the present invention also performs local pixels in each frame in the same manner as described above when capturing a moving image. Addition may be performed.

  (3) The configuration of pixel addition in the above one embodiment is merely an example. For example, the imaging apparatus of the present invention may perform only pixel addition for four pixels by the first imaging element. The first image sensor of the present invention may perform pixel addition with two pixels in the vertical direction or the horizontal direction (illustration is omitted in this case).

  (4) In one embodiment described above, the resolution of the second image sensor may be the same as the resolution of the first image sensor.

  From the above detailed description, features and advantages of the embodiments will become apparent. It is intended that the scope of the claims extend to the features and advantages of the embodiments as described above without departing from the spirit and scope of the right. Further, any person having ordinary knowledge in the technical field should be able to easily come up with any improvements and modifications, and there is no intention to limit the scope of the embodiments having the invention to those described above. It is also possible to use appropriate improvements and equivalents within the scope disclosed in.

DESCRIPTION OF SYMBOLS 13 ... 1st image sensor, 15 ... Image processing part, 16 ... Timing generator (TG), 20 ... 2nd image sensor, 22 ... CPU, 25 ... Pixel addition discrimination | determination part, 26 ... Imaging condition adjustment part

Claims (7)

A first imaging device that is an imaging device in which a plurality of pixels are arranged and is capable of adding and outputting a pixel signal read from a designated pixel among the plurality of pixels;
A second imaging element that images a subject and generates luminance distribution information indicating a correspondence relationship between the imaging range of the first imaging element and the luminance of the subject;
A pixel addition determining unit that generates pixel position information indicating a position of a pixel to which a pixel signal is added among the plurality of pixels arranged in the first image sensor based on the luminance distribution information;
A timing generator that supplies a drive signal for adding a pixel signal to a pixel designated based on the pixel position information to the first image sensor;
When a pixel signal read from a designated pixel among the plurality of pixels arranged in the first image sensor is added and output, an image and a pixel indicated by the signal output by adding the pixel signal An image processing unit that adjusts the resolution with the image indicated by the signal output without adding the signal,
The pixel addition determining unit obtains an area ratio between a bright part of the subject and a dark part of the subject within the imaging range of the first image sensor from the luminance distribution information, and the subject is within the imaging range of the first image sensor. When there are more bright parts of the subject than dark parts, the image processing unit is instructed to enlarge the image indicated by the signal output by adding the pixel signals, and the imaging range of the first image sensor When there are more dark parts of the subject than bright parts of the subject, the image processing unit is instructed to reduce the image indicated by the output signal without adding the pixel signal. An imaging device. The imaging device according to claim 1,
The pixel addition determination unit is configured to add a pixel signal among a plurality of the pixels arranged in the first image sensor based on the luminance distribution information before the first image sensor performs an imaging operation. An image pickup apparatus characterized by setting. In the imaging device according to claim 1 or 2,
The resolution of the second image sensor is set to be lower than the resolution of the first image sensor. In the imaging device according to any one of claims 1 to 3,
An imaging apparatus, further comprising: an imaging condition adjustment unit that adjusts an imaging condition when the first imaging element performs imaging using the luminance distribution information generated by the second imaging element. An image sensor in which a plurality of pixels are arranged, and an image sensor capable of adding and outputting a pixel signal read from a designated pixel among the plurality of pixels,
A pixel addition determining unit that generates pixel position information indicating a position of a pixel to which a pixel signal is added among the plurality of pixels based on luminance distribution information indicating a correspondence relationship between an imaging range of the imaging element and subject luminance;
A timing generator that supplies a drive signal to the image sensor for adding a pixel signal to a pixel designated based on the pixel position information;
When the pixel signals read from the specified pixel among the plurality of pixels are added and output, the pixel signal is added and the image indicated by the output signal is output without adding the pixel signal An image processing unit that adjusts the resolution with the image indicated by the signal,
The pixel addition determination unit obtains an area ratio between a bright part of the subject and a dark part of the subject in the imaging range of the image sensor from the luminance distribution information, and is larger than a dark part of the subject in the imaging range of the image sensor. When there are many bright portions of the subject, the image processing unit is instructed to enlarge the image indicated by the signal output by adding the pixel signals, and the bright portion of the subject within the imaging range of the image sensor An image pickup apparatus that instructs the image processing unit to reduce an image indicated by an output signal without adding a pixel signal when there are more dark portions of the subject. The imaging apparatus according to claim 5,
The pixel addition determination unit generates pixel position information indicating a position of a pixel to which a pixel signal is added among the plurality of pixels based on luminance distribution information before the imaging element performs an imaging operation. An imaging device. In the imaging device according to claim 5 or 6,
An imaging apparatus, further comprising: an imaging condition adjustment unit that adjusts an imaging condition when the imaging element performs imaging using the luminance distribution information.

Images