JP2010074314A - Imaging apparatus, control method thereof, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform stable exposure control even when exposure correction is performed by a user's operation in an imaging apparatus for displaying image data imaged by an imaging element and performing exposure control on the basis of the image data. <P>SOLUTION: In this imaging apparatus 600, a timing generating part 615 divides a plurality of photoelectric converters of the imaging element 614 into two element groups under the control of a control part 624, and makes the respective element groups perform imaging at a set exposure time. A preprocessing part 618a distributes outputs from the imaging element 614 to outputs of each element group. A luminance integrating part 618b calculates a luminance value of a field image on the basis of an output of one of the distributed element groups, and calculates a proper exposure time relating to imaging of the field image on the basis of the calculation result. A cross switch 623 receives an instruction about exposure correction from a user. The control part 624 sets an exposure time of one of the element groups to the calculated proper exposure time, and sets the other exposure time of the element groups to a time obtained by reflecting exposure correction on the proper exposure time. A monitor 651 switches outputs of the distributed element groups to display a picked-up image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a program.

  2. Description of the Related Art Conventionally, there is an image pickup apparatus that picks up an object scene image formed by an image pickup optical system with an image pickup element such as a CCD or a CMOS image sensor and records the picked up image data on a recording medium. Some image pickup apparatuses have an electronic viewfinder (hereinafter referred to as EVF) function for sequentially driving the image pickup element and displaying the image on a liquid crystal monitor. The image pickup apparatus has an automatic exposure function of a TTL (through-the-lens) photometry method that measures the field luminance from image data picked up by the image pickup device and adjusts the exposure based on the measurement result. There is.

In general, the image pickup device has a dynamic range shortage for EVF display and TTL photometry. Patent Documents 1 and 2 are known as techniques for compensating for the lack of dynamic range. In Patent Documents 1 and 2, imaging is performed for each line with a standard exposure time and a short exposure time, and pixels with a luminance value within a predetermined value within a standard exposure time are captured with a short exposure time. The dynamic range is expanded by replacing the pixels in the image.
JP 2003-198948 A JP 2006-148621 A

  At the time of EVF display, a user who views an image captured with proper exposure by the automatic exposure function of the TTL photometry method may instruct exposure correction from the proper exposure via the operation unit. When the exposure correction from the proper exposure is instructed, the image is captured with the exposure value according to the correction instruction, and thus the field luminance of the captured image is deviated from the appropriate exposure.

  FIG. 14 is a schematic diagram showing a dynamic range of the image sensor in 10-bit conversion and a photometric range (photometric range) in TTL photometry. As shown in FIG. 14, at the brightness level of appropriate exposure, the brightness range of about 2.5 steps on the high brightness side and about 3 steps on the low brightness side is the metering range in TTL metering. Here, when the user instructs +2 steps of exposure correction from the appropriate exposure and the image is taken based on the instructions, there is only a margin of about 0.5 steps on the high luminance side in the photometric range in TTL metering. The range will be biased. Similarly, when the user instructs a -2 step exposure correction from the appropriate exposure, there is only a margin of about one step on the low luminance side, and the photometric range is biased.

  Therefore, when the exposure is corrected from the appropriate exposure by the user's operation, even if the dynamic range is expanded by the above-described conventional technique, the automatic exposure by the TTL metering method becomes unnatural due to the deviation of the metering range. There was a thing.

  The present invention has been made in view of such problems of the prior art. An object of the present invention is to provide stable exposure control even when exposure correction is performed by a user's operation in an imaging apparatus that displays image data captured by an image sensor and performs exposure control based on the image data. Is to make it possible.

  In order to achieve the above object, an image pickup apparatus according to the present invention divides an object scene with an image pickup element including a plurality of photoelectric conversion elements, and the plurality of photoelectric conversion elements of the image pickup element into two element groups. Imaging control means for capturing an image with an exposure time set for each element group; distribution means for distributing output from the imaging means to outputs for each element group; and the elements distributed by the distribution means An operation for calculating a luminance value of the object scene based on an output from one of the groups, calculating an appropriate exposure time of the object scene based on the luminance value, and an operation for receiving an instruction for exposure correction from a user And control means for setting one exposure time of the element group to the appropriate exposure time, and setting the other exposure time of the element group to a time reflecting the instructed exposure correction in the appropriate exposure time; The distribution Display means for switching between a captured image based on an output from one of the element groups distributed by the stage and a captured image based on an output from the other of the element group distributed by the distributing means; It is characterized by providing.

  Further, according to the control method of the imaging apparatus of the present invention, the imaging means for imaging the object scene with an imaging element including a plurality of photoelectric conversion elements, and the plurality of photoelectric conversion elements of the imaging element are divided into two element groups. An imaging apparatus control method comprising: an imaging control unit that captures an image with an exposure time set for each element group; a distribution unit that distributes an output from the imaging unit to an output for each element group; and a display unit. And calculating a luminance value of the object scene based on an output from one of the element groups distributed by the distributing means, and calculating an appropriate exposure time of the object field based on the luminance value. A step, an operation step of accepting an exposure correction instruction from a user, one exposure time of the element group is set to the appropriate exposure time, and the other exposure time of the element group is set to the appropriate exposure time. Reflect exposure compensation A control step for setting a predetermined time, a captured image based on an output from one of the element groups distributed by the distributing unit, and a captured image based on an output from the other of the element group distributed by the distributing unit. A display step of switching a captured image to be displayed on the display means.

  According to the present invention, in an imaging apparatus that displays image data captured by an imaging device and performs exposure control based on the image data, stable exposure control even when exposure correction is performed by a user operation. Can be made possible.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments. Further, the embodiment of the present invention shows the most preferable mode of the invention, and does not limit the scope of the invention.

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 600 according to the present embodiment. A zoom lens 610 performs zooming of an object scene (image) formed on the image sensor 614. The focus adjustment lens 611 adjusts the focus of the object field formed on the imaging surface of the image sensor 614. The shutter 612 blocks the light flux to the subsequent stage. The diaphragm 613 adjusts the light flux to the subsequent stage. The image sensor 614 is a CCD, a CMOS image sensor, or the like, and acquires a captured image by photoelectrically converting an object scene formed on the imaging surface. Details of the image sensor 614 will be described later.

  The timing generator 615 generates timing pulses necessary for driving and sampling the image sensor 614 under the control of the controller 624. For example, when EVF display (sequential display) is performed using images sequentially captured by the image sensor 614, timing pulses are sequentially generated so that the image sensor 614 is sequentially driven with an exposure time set under the control of the control unit 624. Will be output. The CDS 616 performs double correlation sampling on the output of the image sensor 614 based on the timing pulse output from the timing generator 615. The A / D converter 617 (Analog-To-Digital) quantizes (digital converts) the output (analog signal) from the CDS 616.

  The image processing unit 618 includes a preprocessing unit 618a, a luminance integration unit 618b, a signal processing unit 618c, a reduction unit 618d, a raster-block conversion unit 618e, and a compression unit 618f. The digital processing unit 618 outputs the digital signal output from the A / D converter 617. Image processing is performed on the image data.

  The preprocessing unit 618a distributes the image data input from the A / D converter 617 to the luminance integration unit 618b and the signal processing unit 618c in units of lines. Note that the line-by-line distribution in the pre-processing unit 618a is performed according to a distribution rule set under the control of the control unit 624 (for example, distribution on even and odd lines in the horizontal / vertical scanning direction of the image). Further, the distribution of the preprocessing unit 618a is not limited to line units. For example, the pre-processing unit 618a may distribute image data according to the pixel position or the like by setting a distribution rule in pixel coordinate units. The luminance integration unit 618b mixes and generates luminance components from the RGB signals of the input image data. Note that the luminance integration unit 618b may generate a luminance component for each divided region when the image related to the input image data is divided into a plurality of regions. The signal processing unit 618c performs color carrier removal, aperture correction, gamma correction processing, and the like on the image data input from the A / D converter 617 to generate a luminance signal. At the same time, the signal processing unit 618c performs color interpolation, matrix conversion, gamma processing, gain adjustment, and the like on the input image data to generate a color difference signal, thereby generating YUV format image data.

  The reduction unit 618d receives the output of the signal processing unit 618c, performs input pixel data clipping, thinning, linear interpolation processing, and the like, and performs image reduction processing in both the horizontal and straight directions. The raster-block conversion unit 618e converts the raster scan image data scaled by the reduction unit 618d into block scan image data. The compression unit 618f compresses the block scan image data converted by the raster-block conversion unit 618e in units of blocks, and generates, for example, JPEG image data. Note that the processing in the image processing unit 618 described above is realized by using the memory unit 626 as a buffer memory.

  The control unit 624 centrally controls the operation of the imaging device 600. The imaging device 600 includes a CPU (Central Processing Unit) and its interface circuit, a DMAC (Direct Memory Access Controller), a bus arbiter, and the like. The memory unit 626 implements the central control by sequentially executing the program data developed by the CPU in the work area of the memory unit 626. Program data executed by the CPU is stored in the flash memory 625.

  The flash memory 625 stores program data executed by the control unit 624 and various setting data. The memory unit 626 is a memory for temporarily storing data, temporarily stores image data and the like processed by the image processing unit 618, and is also used as a work area when the control unit 624 sequentially executes program data. The I / F unit 627 is an interface that connects the control unit 624 and a recording unit 630 described later.

  The exposure control unit 619 controls the shutter 612 and the diaphragm 613 under the control of the control unit 624. The lens driving unit 620 moves the zoom lens 610 and the focus adjustment lens 611 along the optical axis under the control of the control unit 624 to form an image of the object field on the image sensor 614. The display changeover switch 621 receives an instruction to change the display image displayed on the monitor 651 from the user. Although the details will be described later, the display changeover switch 621 is an image (first captured image) captured with an appropriate exposure time by automatic exposure control, or an image captured by reflecting an exposure correction instruction from the user (second captured image). A switching instruction for displaying (captured image) is received from the user (switching means). The exposure correction switch 622 switches the display screen of the monitor 651 to an exposure correction value setting screen, and receives an input of an exposure correction value to be set from the user. That is, the exposure correction switch 622 receives an exposure correction value acceptance start instruction from the user (start instruction means). The cross switch 623 receives an instruction to input an exposure correction value from the user when the exposure correction value setting screen is displayed (operation unit). Specifically, the cross switch 623 accepts an operation instruction in the vertical direction or the horizontal direction and sets an exposure correction value or the like.

  Note that the display switching of the monitor 651 performed by operating the display switching switch 621 includes switching of the display state during EVF display in which an image continuously acquired from the image sensor 614 is displayed on the monitor 651. The display state of the EVF display to be switched includes a display state in which information indicating the setting state of the imaging apparatus 600 is also displayed during EVF display. In addition, there is a display state in which an image captured as appropriate exposure is displayed by performing automatic exposure using the TTL metering method during EVF display. Further, there is a display state in which an image captured by the image sensor 614 is displayed by reflecting the exposure correction value set by the user with the exposure correction switch 622. Or the display state which combined the display state mentioned above may be sufficient.

  The shutter switch 623 a as an imaging instruction unit receives an imaging instruction for a still image or a moving image from the user and outputs it to the control unit 624. The control unit 624 starts capturing a still image or a moving image by the image sensor 614 based on an imaging instruction from the shutter switch 623a. Although not particularly illustrated, the imaging apparatus 600 includes an operation unit such as an operation mode switch that receives a switching instruction for an operation mode in addition to the display switch 621, the exposure correction switch 622, the cross switch 623, and the shutter switch 623a. You may have.

  The battery BOX 640 stores and holds the battery 642 in the imaging device 600. The connection connectors 641 and 670 connect the battery 642 and a power supply circuit (not shown) of the imaging device 600. The battery 642 supplies power to the power supply circuit. The power supply circuit distributes the power supplied from the control unit 624 to each unit of the imaging device 600.

  The recording unit 630 includes connection connectors 628 and 631 connected to the recording medium 632, a recording medium attachment / detachment detection unit 629, and a recording prohibition detection unit 633. The recording medium attachment / detachment detection unit 629 detects attachment / detachment of the recording medium 632. The recording prohibition detection unit 633 detects ON / OFF of a write prohibition switch provided in the recording medium 632 loaded. In the recording unit 630, an image after being imaged by the image sensor 614 and subjected to image processing by the image processing unit 618 when the recording medium 632 in which the write prohibition switch is OFF is mounted under the control of the control unit 624. Data (for example, JPEG format image data) is recorded on the recording medium 632.

  The reproduction circuit 650 converts the image data generated by the image processing unit 618 and stored in the memory unit 626 into display image data and outputs the image data to the monitor 651. The monitor 651 is a display device such as an LCD (Liquid Crystal Display). In the reproduction circuit 650, YUV format image data is separated into a luminance component signal (Y signal) and a modulated color difference component signal (C signal), and an analogized Y signal subjected to D / A conversion is converted into an LPF (low-pass filter). Process). Also, the reproduction circuit 650 performs BPF (band pass filter processing) on the analog C signal that has been subjected to D / A conversion, and extracts only the frequency component of the modulated color difference component. The reproduction circuit 650 converts and generates the Y signal and the RGB signal based on the signal component thus generated and the subcarrier frequency, and outputs it to the monitor 651. When the imaging device 614 continuously performs imaging at a predetermined frame rate, the playback circuit 650 sequentially processes the image data processed by the image processing unit 618, thereby realizing EVF display on the monitor 651.

  Next, the configuration and operation details of the image sensor 614 will be specifically described with reference to FIGS. FIG. 2 is a circuit diagram showing a part of the configuration of the image sensor 614. As shown in FIG. 2, the image sensor 614 employs an XY address type scanning method. In the illustrated example, pixels of 4 rows × 4 columns are shown, and the unit pixels 101 are arranged in 4 rows × 4 columns. In the actual imaging device 614, the unit pixels 101 are two-dimensionally arranged with a predetermined aspect ratio on the imaging surface on which the object scene image is formed.

  The unit pixel 101 includes a PD 102, an FD 103, a transfer switch 104, a reset switch 105, an amplification MOS amplifier 106, and a selection switch 107.

  The PD 102 (photo diode, hereinafter abbreviated as PD) is a photoelectric conversion element that converts light into electric charge. The FD 103 temporarily accumulates charges converted by the unit pixel 101 (floating diffusion, hereinafter abbreviated as FD). The transfer switch 104 transfers the charge converted by the PD 102 to the FD 103 by a signal from the transfer pulse signal line φTX. The reset switch 105 removes charges accumulated in the FD 103 by a signal from the reset pulse signal line φRES. The amplification MOS amplifier 106 functions as a source follower. The selection switch 107 selects a pixel by a signal from the selection pulse signal line φSEL.

  The transfer switch 104, the reset switch 105, and the selection switch 107 are connected to the transfer pulse signal line φTX, the reset pulse signal line φRES, and the selection pulse signal line φSEL in units of rows, and are signals output from the vertical scanning circuit 110 to each signal line. Is selectively scanned. The constant current source 160 supplies a constant current that becomes a load of the amplification MOS amplifier 106. The unit pixel 101 and the constant current source 160 are connected to the readout circuit 120 via the signal output line 108 in units of columns. The output selection switch 140 is driven by the horizontal scanning circuit 130 and selects an output signal from the readout circuit 120. The output amplifier 150 amplifies a signal output to the outside of the image sensor 614.

  Although the imaging device 614 described here includes a single readout circuit 120, a configuration in which the readout time is increased by dividing the readout circuit 120 into a plurality of channels in units of columns is also conceivable. For example, a two-channel readout circuit 120 and a horizontal scanning circuit 130 are provided, and odd and even columns are separately read out and rearranged by a signal processing circuit that receives an output from the image sensor 614. However, since the basic operation is not directly related, the description is omitted.

  The unit pixel 101 is provided with a hue filter of R (red), G (green), or B (blue), and the arrangement of the hue filter when the unit pixels 101 are arranged forms a Bayer arrangement. . That is, the RG rows in which RGRG... Are arranged and the GB rows in which GBGB.

  When a still image is captured, image generation is performed by reading out almost all pixels in the effective area (area other than the optical black area) of the image sensor 614. In this case, batch reset reading is often employed in which charges of PD and FD of each pixel are collectively reset and reading is performed in units of rows. At this time, a shutter using a mechanical light shielding member is often used for the rear curtain. In this driving for reading out almost all pixels, the rate of image data in units of planes obtained from the image sensor 614 is extremely low relative to the display update rate.

  On the other hand, in the case of driving in the case of performing EVF display or moving image shooting, it is preferable that the display is close to the update rate (frame rate). For this reason, it is necessary to thin out the number of pixels to be read out so as to be in the vicinity of the number of pixels necessary for display image generation, or to perform averaging. However, when performing pixel addition and thinning, it is necessary to devise so that the Bayer pixel center of gravity of the completed output image does not deviate greatly.

  In driving when EVF display or moving image shooting is performed, it is necessary to continuously read out pixel data from the image sensor 614. Therefore, while maintaining an exposure time in units of pixels or rows, photoelectric is continuously generated in units of pixels or rows. Scanning that sequentially reads the converted charges is employed. Specifically, the charges accumulated in the PD and FD are reset in units of pixels or rows. Charges are accumulated (exposed) by photoelectric conversion in the reset PD and FD. Therefore, when a predetermined exposure time has elapsed, the charges accumulated in the PD and FD are read out in units of pixels or rows. Such a reading method is called a rolling electronic shutter, a rolling shutter, a focal plane electronic shutter, a focal plane shutter, or the like. In the following description, this reading method is called a rolling shutter.

  Here, a reading method in the image sensor 614 will be specifically described with reference to FIGS. The assumed imaging device 614 is equivalent to 12 million pixels. The readout method described below reads out twice the number of rows necessary for generating a VGA (640 × 480) image. Specifically, the RG line and the GB line of the image to be read are set as one set, and the two lines are alternately distributed to obtain two VGA images for the vertical transfer period. In addition, between the two screen images, under the control of the control unit 624, the signal output to the reset pulse signal line φRES is independently controlled, and the exposure start timing is individually controlled, thereby exposing the two images. The time is different.

  With reference to FIG. 3, driving when three rows are added and averaged to read one RG line and one BG line from six rows will be described. This driving is performed by the control unit 624 controlling the vertical scanning circuit 110 and the horizontal scanning circuit 130. Here, FIG. 3A is a conceptual diagram showing the read driving state in units of rows, and FIG. 3B is a concept showing the driving state on the time axis separately for the RG system row and the GB system row. FIG.

  As shown in FIG. 3A, first, the first row is read and transferred to the line memory in the read circuit 120. Since the second row is used in the BG system, it is skipped without resetting the pixels. Next, the third row is read and transferred to the line memory in the reading circuit 120. Since the fourth row is used in the BG system, it is skipped without resetting the pixels. Next, the fifth row is read out, averaged in the reading circuit 120, and then the horizontal scanning circuit 130 performs horizontal data transfer. Here, in order to match the time axis with the BG system row readout, the pixel reset is not performed and the backward row skipping is performed twice so that the BG system readout can be performed in the horizontal period in the next image sensor. . Next, in order to read the second row of the first row of the BG system, the second row is read by going back to the row and transferred to the line memory. Here, since no time is required for the reverse addressing, the timing control is the same as the first row reading of the RG system. The third row is skipped without pixel reset. Next, the fourth row is read and transferred to the line memory. The fifth line is skipped without pixel reset. Next, the sixth row is read out, transferred to the line memory in the reading circuit 120, and after averaging, horizontal data transfer is performed by the horizontal scanning circuit 130. Here, in order to match the time axis with the RG row reading, dummy skip without pixel reset is performed twice.

  In FIG. 3A, the row skip without pixel reset for two rows exists in the RG readout, whereas the GB readout does not show it. However, as shown in FIG. 3 (b), there is a dummy skip in which GB selection is not performed so that one horizontal period is the same in the RG system and the BG system on the time axis.

  As described above, there are a plurality of horizontal periods in the image sensor 614 for one row viewed from the outside of the image sensor 614, that is, for one horizontal period. One horizontal period viewed from the outside of the image sensor 614 needs to be the same in the RG row and the GB row. This will be apparent from the description of the rolling shutter operation described later, in order to align the exposure times of the RG and GB rows.

  Next, referring to FIGS. 4 and 5, during the rolling shutter operation of the image sensor 614 that is performed based on various control signals output from the timing generator 615 serving as the imaging controller under the control of the controller 624. The drive sequence will be described. For each of the transfer pulse signal line φTX, the reset pulse signal line φRES, and the selection pulse signal line φSEL, pulse signals to be applied to the nth scanning row selected by the vertical scanning circuit 110 are subscripted with TXn, RESn, and SELn. Describe with n. In FIG. 2, only the nth to n + 3th rows are shown, whereas in FIG. 4 and FIG. 5, more rows are shown, but there is no structural difference.

  Also, in this embodiment, for convenience of explanation, the reset timing for determining the exposure time is determined by adding the RG system odd rows and the RG system even rows after addition averaging, and the GB system odd rows after addition averaging. The control is divided into even-numbered GB lines. In addition, a description will be given of a method in which the exposure time is the same between odd rows and even rows in both the RG system and the GB system. That is, in this embodiment, the device is divided into two element groups that are evenly distributed on the imaging surface of the element groups of the RG system odd rows and the GB system odd rows of the RG system even rows and GB system even rows. The exposure time of each element group is controlled.

  Specifically, in the case where three rows are averaged and one row of RG system and one row of BG system are read from 6 rows, the first row of RG system (an odd number row of RG system) is obtained from the nth to n + 5th rows. ), The first row of the BG system (odd row of the BG system) is generated. Also, from the (n + 6) th row to the (n + 11) th row, an RG second row (RG even row) and a BG second row (BG even row) are generated. Thereafter, the RG system odd rows and the BG system odd rows, the RG system even rows and the BG system even rows are sequentially generated in the n + 12th and subsequent rows. The exposure times of the thus generated RG system odd rows and GB system odd rows, RG system even rows and BG system even rows are controlled separately by reset timing. The actual reset control is determined in consideration of the number of pixels of the image sensor 614, the number of rows to be averaged, and the pixel centroid in the obtained image, and is not limited to the one exemplified in this embodiment.

  First, with reference to FIG. 4, the drive timings of the RG system odd-numbered row and the BG system odd-numbered row in the image sensor 614 will be described. As shown in FIG. 4, in the n line, first, RESn and TXn are applied during a period from time t30 to time t31, and the transfer switch 104 and the reset switch 105 are turned on. Next, a reset operation for removing unnecessary charges accumulated in the PD 102 and the FD 103 in the nth line is performed. At time t31, the transfer switch 104 is turned off, and an operation for accumulating charges generated in the PD 102 by photoelectric conversion is started. Similarly, after performing the reset operation on the n + 2 line and the n + 4 line, the accumulation operation is started (time t33, t34). In addition, for the (n + 1) th line and the (n + 3) th line, only PHD is applied and skipped in order.

  Next, at time t36, TXn is applied, the transfer switch 104 is turned on, and the charge accumulated in the PD 102 by photoelectric conversion is transferred to the FD 103. The reset switch 105 needs to be turned off prior to the transfer operation, and the accumulation (exposure) time of the n-th line is from time t31 to time t36 when the reset switch 105 is turned off.

  After the transfer operation of the n-th line is completed, SELn is applied and the selection switch 107 is turned on, whereby the charge held in the FD 103 is converted into a voltage by the amplification MOS amplifier 106 and output to the readout circuit 120 ( Time t37). The read circuit 120 has a built-in line memory, and the read n-th line data is transferred to the line memory and held. Similarly, the transfer operation is similarly performed for the n + 2 line and the n + 4 line (time t38, t39, t3a, t3b). In addition, for the (n + 1) th line and the (n + 3) th line, only PHD is applied and skipped in order.

  When the n + 4th line is read at time t3b, the n + 4th line data is averaged and held in the reading circuit 120 with the previously read nth line and n + 2th line data. The data held in the readout circuit 120 is sequentially horizontally transferred by the horizontal scanning circuit 130 from time t3c when HSR is applied. Here, since the n-th line, the n + 2 line, and the n + 4 line are the RG system, the backward feed direction is skipped twice from the time t3d to the time t3e. Accordingly, the line to be driven changes from the (n + 4) th line to the (n + 2) th line.

  In the next field, reverse feed skip is further performed, and for the n + 1-th line, during the period from time t40 to time t41, RESn + 1 and TXn + 1 are applied, and the transfer switch 104 and the reset switch 105 are turned on. Next, a reset operation for removing unnecessary charges accumulated in the PD 102 and the FD 103 in the (n + 1) th line is performed. At time t41, the transfer switch 104 is turned off, and an operation for accumulating charges generated in the PD 102 by photoelectric conversion is started. Similarly, after performing the reset operation on the n + 3 line and the n + 5 line, the accumulation operation is started (time t43, t45).

  Next, at time t46, TXn + 1 is applied, the transfer switch 104 is turned on, and the charge accumulated in the PD 102 by photoelectric conversion is transferred to the FD 103. The reset switch 105 needs to be turned off prior to the transfer operation, and the accumulation time (exposure time) of the (n + 1) th line is from time t41 to time t46 when the reset switch 105 is turned off.

  After the transfer operation of the (n + 1) th line is completed, SELn + 1 is applied and the selection switch 107 is turned on, whereby the charge held in the FD 103 is converted into a voltage by the amplification MOS amplifier 106 and output to the readout circuit 120 ( Time t47). The read data of the (n + 1) th line is transferred to the line memory in the read circuit 120 and held. Similarly, the transfer operation is similarly performed for the n + 3 line and the n + 5 line (time t48, t49, t4a, t4b). In addition, the n + 2 line and the n + 4 line are skipped in order by applying only PHD.

  When the n + 5th line is read at time t4b, the data of the n + 5th line is added and averaged in the reading circuit 120 with the previously read data of the (n + 1) th line and the n + 3th line and held. The data held in the readout circuit 120 is sequentially horizontally transferred by the horizontal scanning circuit 130 from time t4c when HSR is applied. Here, since the (n + 1) th line, the (n + 3) th line, and the (n + 5) th line are GB systems, dummy skip in the reverse feed direction is performed twice from time t4d to time t4e. Accordingly, the line to be driven is the (n + 6) th line which is the next RG system (even numbered row).

  As described above, the exposure time of each line is from the falling edge of the reset pulse signal RES to the rising edge of the transfer pulse signal TX in the odd-numbered rows of the RG system and the odd-numbered rows of the BG system. Therefore, the control unit 624 controls the exposure time of each line by controlling the reset pulse signal RES and the transfer pulse signal TX. Specifically, the control unit 624 controls the exposure time of each line by controlling the reset pulse signal RES so as to start and stop the exposure. For example, the exposure time of the nth line is from the fall of RESn (time t31) to the rise of TXn (time t36). The control unit 624 can control the exposure time of the n-th line by controlling RESn and TXn, and can control the exposure time of the n-th line by controlling the RESn so as to start and stop the exposure. Yes.

  As shown in FIG. 5, the RG system even rows and the GB system even rows after the (n + 6) th line are read out in the same drive sequence as the above-mentioned RG system odd rows and BG system odd rows. . That is, the exposure time of each line is from the falling edge of the reset pulse signal RES to the rising edge of the transfer pulse signal TX also in the even-numbered row of the RG system and the even-numbered row of the GB system. Therefore, the control unit 624 controls the exposure time of each line by controlling the reset pulse signal RES and the transfer pulse signal TX. Specifically, the control unit 624 controls the exposure time of each line by controlling the reset pulse signal RES so as to start and stop the exposure. For example, the exposure time of the n + 6th line is from the fall of RESn + 6 (time t51) to the rise of TXn + 6 (time t56). The control unit 624 can control the exposure time of the n + 6th line by controlling RESn + 6 and TXn + 6, and can control the exposure time of the n + 6th line by controlling the RESn + 6 to start and stop the exposure. Yes.

  Note that the timing of the reset pulse signal RES in the above-described odd-numbered row of RG system and odd-numbered row of BG system, and even-numbered row of RG system and even-numbered row of GB system is individually controlled in the processing of the control unit 624 described later. The That is, the exposure time of the even-numbered row of the RG system and the even-numbered row of the GB system and the exposure time of the odd-numbered row of the RG system and the odd-numbered row of the BG system are individually controlled by the control unit 624.

  FIG. 6A and FIG. 6B are sequence diagrams schematically showing a state in which the above-described horizontal period operation is continuously performed in the vertical period. In FIG. 6A, as described above, the case where the reset timing for determining the exposure time is controlled by a driving method in which the exposure time is the same between odd-numbered rows and even-numbered rows in both the RG system and the GB system is illustrated. The reset timing for determining the exposure time is controlled separately for the RG system odd-numbered row and the RG-system even-numbered row, and the GB-system odd-numbered row and the GB-system even-numbered row. Further, a driving method in which the exposure time is the same between the odd-numbered rows of the RG system and the even-numbered rows of the GB-system and between the even-numbered row of the RG-type and the odd-numbered rows of the GB system is as shown in FIG. The driving method shown in FIG. 6B is not described in detail for convenience of explanation, but the control unit 624 does not change the control of the reset timing of each line. As shown in FIG. 6, an image read from the image sensor 614 continuously in the vertical period is an image in which two types of exposure times are combined. Specifically, the image read out from the image sensor 614 looks like rows with different exposure times arranged alternately in pairs of the RG system and the BG system.

  FIG. 7 is a conceptual diagram showing a processing flow of a captured image G1 obtained by combining two types of exposure times obtained from the image sensor 614. Under the control of the CPU of the control unit 624, it is determined whether or not the captured image G1 input to the image processing unit 618 is distributed to two images having the same exposure time by the preprocessing unit 618a. . If not distributed, the image processing of the image processing unit 618 described above is performed on the captured image G1, and a high-definition display image is generated.

  Although details will be described later, when the display image is generated without distributing the captured image G1 into two images, the exposure correction value with respect to the exposure control value is ± zero. The exposure time for all lines is the same. Also, when the image is distributed to the two images, the exposure correction value with respect to the exposure control value is different, and the image pickup device is driven by the drive method described above with the exposure time corresponding to the exposure control value and the exposure time corresponding to the exposure correction value This is when 614 is driven.

  In the case of distribution, lines with different exposure times are sequentially input separately into the luminance integration unit 618b and the signal processing unit 618c and the subsequent under the control of the CPU of the control unit 624, and the photometric image G2 and the display image G3. And are generated independently. The control unit 624 inputs a photometric image G2 obtained by being imaged by the image sensor 614 with an appropriate exposure time for obtaining an appropriate exposure necessary for automatic exposure control, which will be described later, to the luminance integrating unit 618b. In addition, the control unit 624 inputs the other display image G3 to the signal processing unit 618c and the subsequent generation unit, and generates image data to be displayed on the monitor 651.

Next, automatic exposure control performed by the control unit 624 will be described.
The TTL automatic exposure control of the relative feedback metering method using the image picked up by the image sensor 614 performed by controlling the exposure control unit 619 sequentially executes program data stored in the flash memory 625 by the CPU of the control unit 624. Done. The control unit 624 executes the program data sequentially to measure the field luminance value (Bv value) of the captured image, and uniquely determines the exposure control value from the Bv value and the imaging sensitivity value (Sv value). It functions as a program diagram part to be derived. Further, the control unit 624 converts the exposure control value derived from the program diagram, that is, the aperture control value (Av value) and the shutter speed value (Tv value) into each control unit (exposure control unit 619, timing generation unit). 615). In this manner, the control unit 624 controls the amount of light incident on the image sensor 614 and the exposure time of the image sensor 614 to an appropriate amount of light and an appropriate exposure time. Aperture control, shutter speed control, and the like are performed by converting the delivered Av value and Tv value into actual control data depending on the device to be controlled. The details of the control data and the control method depending on each device are already known, and will not be described.

  The luminance integration unit 618b sequentially reads the charge signal read from the image sensor 614 in the vertical transfer period immediately after the exposure period via the CDS 616 and the A / D converter 617, and the photometric image distributed by the preprocessing unit 618a. Integrate the luminance component. The integration of the luminance component in the luminance integration unit 618b may be performed for each region divided by the integration region preset by the control unit 624.

  The flow of automatic exposure control performed under the control of the control unit 624 will be described with reference to the flowchart of FIG. When automatic exposure control is started in accordance with a user instruction via the operation unit, the exposure control unit 619 performs initial exposure control (S801). Next, the control unit 624 waits for completion of exposure control by the exposure control unit 619 (S802), and when exposure control is completed, waits for the first read timing from the image sensor 614 (S803). Next, the control unit 624 sets the luminance integration unit 618b to integrate the luminance component of the exposure data from the read image from the image sensor 614 (S804), and waits for the integration by the luminance integration unit 618b (S805).

  After the integration result is obtained, the control unit 624 performs an object field luminance evaluation calculation based on the obtained integration result to calculate a field luminance value (Bv value) (S806). Next, the control unit 624 calculates a target exposure control value for obtaining an appropriate exposure by inputting the field luminance value, which is the calculation result of S806, into the program diagram (S807). Next, the control unit 624 obtains an appropriate exposure control value that reflects the exposure correction value input from the user by the operation of the exposure correction switch 622 in the target exposure control value (S808). Specifically, the appropriate exposure control value is an exposure time that reflects the exposure correction value in the appropriate exposure time acquired by automatic exposure control, and is calculated by adding the exposure correction value to the program diagram. .

  Next, the control unit 624 sets the exposure time based on the target exposure control value for obtaining the appropriate exposure obtained in S807 to the odd-numbered row of the RG system and the odd-numbered row of the GB system in the image sensor 614. Further, the control unit 624 sets the exposure time based on the appropriate exposure control value obtained in S808 to the even-numbered row of the RG system and the even-numbered row of the GB system in the image sensor 614 (S809). That is, in S809, the exposure time reflecting the exposure correction instructed in the appropriate exposure time is set for the other element group of the image sensor 614 including the even-numbered row of the RG system and the even-numbered row of the GB system. In addition, an appropriate exposure time is set for one of the element groups of the image sensor 614 including the odd-numbered rows of the RG system and the odd-numbered rows of the GB system.

  Next, the control unit 624 determines whether or not the process is terminated based on a user instruction or the like via the operation unit (S810). If the process is continued, the process returns to S802. With the above-described processing, the image sensor 614 acquires an image (an image for photometry) of an odd-numbered row of the RG system and an odd-numbered row of the GB system, and an image (display image) of the even-numbered row of the RG system and the even-numbered row of the GB system. Therefore, imaging is performed with two types of exposure times.

Here, the setting of exposure correction by the user's operation will be described.
As shown in FIG. 9, the control unit 624 displays a normal GVF display screen G90 on the display screen of the monitor 651 during EVF display, and the exposure correction value based on the depression of the exposure correction switch 622 by the user. Is switched to the screen G91 for setting. The control unit 624 changes the exposure correction value based on the pressing of the cross switch 623 by the user when the screen G91 is displayed.

  When the exposure correction value is changed, an image (display image) of the RG system even-numbered line and the GB system even-numbered line captured with the exposure time based on the above-described appropriate exposure control value is displayed on the monitor 651 as an EVF. The That is, the EVF display on the monitor 651 reflects the exposure correction value. For example, when the exposure correction value is changed to +1 step, a screen G92 obtained by correcting the exposure by +1 step from the appropriate exposure in the TTL automatic exposure control is displayed on the monitor 651. Similarly, when the exposure correction value is changed to −1 step, a screen G93 in which −1 step exposure correction is performed from the appropriate exposure in the TTL automatic exposure control is displayed on the monitor 651.

  As illustrated in FIG. 10, the control unit 624 may switch the display screen of the monitor 651 during EVF display based on the user pressing the display changeover switch 621. Specifically, based on pressing of the display changeover switch 621, a screen G100 that performs EVF display without displaying information such as various statuses, a screen G101 that performs EVF display with information display, and an EVF display that reflects exposure correction values. The screens G102a and G102b for performing the above may be switched.

  Next, a series of operations of the imaging apparatus 600 performed by the control unit 624 will be described with reference to the flowchart of FIG. A series of operations in the imaging apparatus 600 is activated in response to an operation of a main switch (not shown) by the user. As shown in FIG. 11, when processing is started by the main switch, the control unit 624 controls the lens driving unit 620 and the exposure control unit 619 based on a predetermined sequence preset in the flash memory 625 or the like. . Under the control of the lens driving unit 620 and the exposure control unit 619, the variable power lens 610, the focus adjustment lens 611, the shutter 612, and the diaphragm 613 are moved to the standby position (S1201). In the movement to the standby position, for example, the zoom lens 610 is moved to a position where the wide end (widest angle) is at the maximum, or the diaphragm 613 is opened.

  Next, the control unit 624 activates the image sensor 614 (S1202). The control unit 624 distributes, to the luminance integration unit 618b, the first row group including the RG system odd rows and the BG system odd rows among the outputs of the A / D converter 617 serving as the output from the image sensor 614. In this manner, the preprocessing unit 618a is set (S1203). Further, the control unit 624 sets the preprocessing unit 618a to distribute the second row group including the RG system odd rows and the BG system odd rows to the signal processing unit 618c (S1204).

  Next, the control unit 624 performs the above-described automatic exposure control using the photometric image by the first row group (S1205), and controls the exposure time so that a captured image with proper exposure can be obtained by the image sensor 614. The control unit 624 performs automatic exposure control in the first row group in which a proper exposure captured image is always obtained after the exposure control in which a proper exposure captured image is obtained, and the display image in the other second row group. Is generated (S1206).

  When the control unit 624 detects an ON operation of the exposure correction switch 622 (S1207: YES), the control unit 624 displays a setting screen for setting the exposure correction value on the monitor 651, and sets the exposure correction value set by the cross switch 623 from the user instruction. It memorize | stores in the memory part 626 (S1208). At this time, the control unit 624 performs automatic exposure control by the first row group (S1209), and generates a display image in the second row group reflecting the exposure correction value set in S1208 (S1210). . That is, EVF display reflecting the exposure correction value is performed on the monitor 651. Further, in the first row group of the image sensor 614 at this time, a photometric image is captured with appropriate exposure by automatic exposure control. Therefore, in the imaging apparatus 600, even when the exposure correction value is set, the photometric range is not biased and stable exposure control is possible.

  Further, at the time of imaging by the shutter switch 623a at this time, the control unit 624 performs TTL automatic exposure control on the photometric image by the first row group and starts imaging of a still image or a moving image. Therefore, the imaging apparatus 600 can suppress the occurrence of a release time lag even when exposure correction is performed by the user.

  Next, when detecting the ON operation of the exposure correction switch 622 (S1211: YES), the control unit 624 cancels the setting screen for setting the exposure correction value and returns the display on the monitor 651 to the normal EVF display (S1212). Next, the control unit 624 determines whether or not the process is terminated based on a user instruction or the like via the operation unit (S1213), and when the process is continued, the process returns to S1203.

[Modification 1]
Next, the operation of the imaging apparatus 600 according to Modification 1 will be described with reference to the flowchart of FIG. In the first modification illustrated in FIG. 12, the normal EVF distributes the first row group to the luminance integration unit 618 b and the signal processing unit 618 c in contrast to the case illustrated in FIG. 11, and appropriate exposure is always obtained. (S1303 to S1306). In Modification 1, a display image is generated from the first row group (S1306).

  In the first modification, when the setting screen for setting the exposure correction value is displayed on the monitor 651, the generation of the display image from the first row group is temporarily stopped and the second row group is stopped. The distribution of the preprocessing unit 618a is changed so as to generate a display image from (S1309). Then, a display image is generated from the second row group reflecting the exposure correction value (S1309 to S1311). Next, when exiting the setting screen for setting the exposure correction value and returning to the normal EVF display, generation of the display image from the second row group is temporarily stopped, and the display image is started from the first row group. The distribution of the preprocessing unit 618a is changed so as to generate. Then, a display image is generated from the first row group reflecting the set exposure correction value.

  Although not shown, every time the display changeover switch 621 switches whether or not the exposure correction value is reflected in the EVF display in the same manner as when setting the exposure correction value, the control unit 624 controls the preprocessing unit 618a. Switch distribution. Specifically, the control unit 624 determines whether the distribution source to the signal processing unit 618c is output from the first row group of the image sensor 614 or output from the second row group. Switching between switching and generating the display image from the first row group or from the second group of row groups is performed. In the meantime, the control unit 624 sets the preprocessing unit 618a so as to generate a photometric image used for automatic exposure control from the first row group.

  In the first modification, even when the exposure correction switch 622 is pressed and the exposure correction value is set to a value other than zero, photometry with the appropriate exposure photometric image obtained in the first row group is performed regardless of the exposure correction value. To obtain an exposure control value reflecting the set exposure correction value. Although not shown, when the exposure time as a result of reflecting the exposure correction value becomes longer than the vertical period when driving the image sensor 614, the control unit 624 decreases the gain of the image sensor 614. Furthermore, the control unit 624 recalculates the exposure time for obtaining proper exposure and sets the exposure time so as to be within the length of the vertical period. Note that the control unit 624 may control the gain of the image sensor 614 separately for the first row group and the second row group. When the gain circuit (not shown) can be configured independently, the control reflecting the exposure correction value can be performed independently, so that the degree of freedom in control increases. In any case, the effect of performing exposure correction while always performing metering with appropriate exposure is not limited.

[Modification 2]
Next, the operation of the imaging apparatus 600 according to Modification 2 will be described with reference to the flowchart of FIG.
As shown in FIG. 13, the second modification is the same as the first modification described with reference to FIG. 12 until the automatic exposure control is performed (S1404). After the automatic exposure control, the control unit 624 determines whether or not the exposure correction value (ExpComp) set and stored in the memory unit 626 or the like is zero (S1405).

  Next, the control unit 624 generates a display image in the first row group when the exposure correction value is zero (S1406, S1407), and displays from the second row group when the exposure correction value is not zero. A work image is generated (S1408, S1409).

  When the control unit 624 detects the ON operation of the exposure correction switch 622 (S1410: YES), the control unit 624 displays a setting screen for setting the exposure correction value on the monitor 651, and sets the exposure correction value set by the cross switch 623 from the user instruction. It memorize | stores in the memory part 626 (S1411). At this time, the control unit 624 performs automatic exposure control by the first row group (S1412), and generates a display image in the second row group reflecting the exposure correction value set in S1411 (S1413). . Reflection of the exposure correction value on the exposure correction value setting screen and display switching may be switched according to the exposure correction value in the same manner as in S1405 to S1409.

  When detecting the ON operation of the exposure correction switch 622 (S1414: YES), the control unit 624 cancels the setting screen and returns the display on the monitor 651 to the normal EVF display (S1415). Next, the control unit 624 determines whether or not the process is terminated based on a user instruction from the operation unit (S1416).

  The generation of the display image by the first row group or the second row group is not limited to the method described above. Although not shown, the control unit 624 inputs the first row group and the second row group for the output from the image sensor 614 while the preprocessing unit 618a inputs the first row group to the luminance integration unit 618b. Is temporarily stored in the memory unit 626. Next, the control unit 624 reads out the first row group and the second row group independently from the memory unit 626 and generates two types of display images. In this case, the display image displayed on the monitor 651 may be switched by the display changeover switch 621 only by switching between two types of display images generated in advance. Therefore, by performing switching in the preprocessing unit 618a in accordance with an instruction from the display switching switch 621, response performance can be improved as compared to switching the display image displayed on the monitor 651.

  As described above, in the imaging apparatus 600, the control unit 624 controls the reset timing in the imaging element 614 in two row groups. The control unit 624 always sets the exposure time for obtaining appropriate exposure for one row group, and reflects the exposure correction value set by the user for the exposure time for the other row group. Therefore, in the image pickup apparatus 600, EVF display in which the exposure is adjusted to the change in the field luminance and the exposure correction value of the user is reflected while performing automatic exposure control based on the image data picked up at the appropriate exposure by the image pickup device 614. Is possible. In addition, the image capturing apparatus 600 can always perform metering using image data captured with appropriate exposure while performing EVF display reflecting exposure correction by the user, so there is no need to perform metering again during still image shooting. Time lag can be reduced. Furthermore, it can always be applied to automatic focus adjustment and white balance adjustment with appropriate exposure.

  Note that the description in the above-described embodiment shows an example, and the present invention is not limited to this. The configuration and operation in the embodiment described above can be changed as appropriate.

(Other embodiments)
The above-described embodiment can also be realized in software by a computer of a system or apparatus (or CPU, MPU, etc.). Therefore, the computer program itself supplied to the computer in order to implement the above-described embodiment by the computer also realizes the present invention. That is, the computer program itself for realizing the functions of the above-described embodiments is also one aspect of the present invention.

  The computer program for realizing the above-described embodiment may be in any form as long as it can be read by a computer. For example, it can be composed of object code, a program executed by an interpreter, script data supplied to the OS, but is not limited thereto. A computer program for realizing the above-described embodiment is supplied to a computer via a storage medium or wired / wireless communication. Examples of the storage medium for supplying the program include a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, an optical / magneto-optical storage medium such as an MO, CD, and DVD, and a nonvolatile semiconductor memory.

  As a computer program supply method using wired / wireless communication, there is a method of using a server on a computer network. In this case, a data file (program file) that can be a computer program forming the present invention is stored in the server. The program file may be an executable format or a source code. The program file is supplied by downloading to a client computer that has accessed the server. In this case, the program file can be divided into a plurality of segment files, and the segment files can be distributed and arranged on different servers. That is, a server apparatus that provides a client computer with a program file for realizing the above-described embodiment is also one aspect of the present invention.

  In addition, a storage medium in which the computer program for realizing the above-described embodiment is encrypted and distributed is distributed, and key information for decrypting is supplied to a user who satisfies a predetermined condition, and the user's computer Installation may be allowed. The key information can be supplied by being downloaded from a homepage via the Internet, for example. Further, the computer program for realizing the above-described embodiment may use an OS function already running on the computer. Further, a part of the computer program for realizing the above-described embodiment may be configured by firmware such as an expansion board attached to the computer, or may be executed by a CPU provided in the expansion board. Good.

It is a block diagram which shows the structure of the imaging device which concerns on this embodiment. It is a circuit diagram showing a part of composition of an image sensor. (A) is a conceptual diagram showing a read driving state in units of rows, and (b) is a conceptual diagram showing a driving state on the time axis divided into an RG system row and a GB system row. 6 is a signal timing chart showing drive timings of an RG system odd row and a BG system odd row in the image sensor; 5 is a signal timing chart showing drive timings of an even-numbered row of RG system and an even-numbered row of BG system in the image sensor. (A) is a sequence diagram schematically showing a continuous operation in the vertical period in the image sensor, and (b) is a sequence diagram schematically showing a continuous operation in the vertical period in the image sensor. It is a conceptual diagram which shows the processing flow of the captured image obtained from the image pick-up element. It is a flowchart which shows the automatic exposure control in an imaging device. It is a conceptual diagram which illustrates the display screen in a monitor, and the setting screen of exposure correction value. It is a conceptual diagram which illustrates switching of the display screen in a monitor. It is a flowchart which shows operation | movement of an imaging device. 10 is a flowchart illustrating an operation of an imaging apparatus according to Modification 1. 12 is a flowchart illustrating an operation of an imaging apparatus according to Modification 2. It is the schematic which showed the dynamic range of an image pick-up element, and the photometry range in TTL photometry.

Explanation of symbols

600 Imaging device 610 Variable magnification lens 611 Focus adjustment lens 612 Shutter 613 Aperture 614 Image sensor 615 Timing generator 616 CDS
617 A / D converter 618 Image processing unit 618a Preprocessing unit 618b Luminance integration unit 618c Signal processing unit 618d Reduction unit 618e Raster-block conversion unit 618f Compression unit 619 Exposure control unit 620 Lens drive unit 621 Display changeover switch 622 Exposure correction switch 623 Cross switch 624 Control unit 625 Flash memory 626 Memory unit 627 I / F unit 632 Recording medium 642 Battery 650 Playback circuit 651 Monitor

Claims (7)

Imaging means for imaging an object scene with an imaging device comprising a plurality of photoelectric conversion elements;
Imaging control means for dividing the plurality of photoelectric conversion elements of the imaging element into two element groups and imaging with an exposure time set in each of the element groups;
Distributing means for distributing the output from the imaging means to the output for each of the element groups;
Calculating means for calculating a luminance value of the object scene based on an output from one of the element groups distributed by the distributing means, and calculating an appropriate exposure time of the object scene based on the luminance value;
Operation means for accepting an instruction for exposure compensation from a user;
Control means for setting one exposure time of the element group to the appropriate exposure time, and setting the other exposure time of the element group to a time reflecting the instructed exposure correction in the appropriate exposure time;
Display means for switching between a captured image based on an output from one of the element groups distributed by the distributing means and a captured image based on an output from the other of the element groups distributed by the distributing means; ,
An imaging apparatus comprising:   The display means displays a captured image based on an output from one of the element groups when there is no instruction for exposure correction, and outputs an output from the other of the element group when there is an instruction for exposure correction. The imaging apparatus according to claim 1, wherein a captured image based on the image is displayed. A start instruction means for receiving an instruction reception start instruction by the operation means from a user;
The imaging apparatus according to claim 1, wherein the display unit displays a captured image based on an output from the other of the element groups when the start instruction is received. A switching unit that receives a switching instruction from a user to switch a captured image displayed between the first captured image captured at the appropriate exposure time and the second captured image captured at a time reflecting the exposure correction at the appropriate exposure time. In addition,
The display means displays a captured image based on one output of the element group when the switching means instructs the display of the first captured image, and the switching means displays the second captured image. 4. The imaging apparatus according to claim 1, wherein when the display is instructed, a captured image based on the other output of the element group is displayed. 5. An image capturing instruction means for receiving an image capturing instruction from the user;
5. The imaging apparatus according to claim 1, wherein the imaging unit captures an image using an appropriate exposure time calculated by the calculation unit during imaging according to the imaging instruction. 6. An imaging unit that captures an image of an object scene with an imaging device including a plurality of photoelectric conversion elements, and a plurality of photoelectric conversion elements of the imaging element are divided into two element groups, and the exposure time set for each of the element groups. An image pickup control method comprising: an image pickup control means for picking up an image; a distribution means for distributing an output from the image pickup means to an output for each element group; and a display means,
A calculating step of calculating a luminance value of the object scene based on an output from one of the element groups distributed by the distributing unit, and calculating an appropriate exposure time of the object field based on the luminance value;
An operation process for receiving an instruction for exposure compensation from a user;
A control step of setting one exposure time of the element group to the appropriate exposure time, and setting the other exposure time of the element group to a time reflecting the instructed exposure correction in the appropriate exposure time;
A captured image to be displayed on the display means with a captured image based on an output from one of the element groups distributed by the distributing means and a captured image based on an output from the other of the element groups distributed by the distributing means. A display process for switching;
A method for controlling an imaging apparatus, comprising:   The program which makes a computer perform each process of the control method of the imaging device of Claim 6.

Images