JP2011166515A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To further shorten a period of time during which camera control data cannot be acquired when capturing a still image. <P>SOLUTION: An imaging section 12 has a pixel part where a plurality of pixels are arrayed in a two-dimensional manner each of which has a photoelectric conversion part for generating a signal charge corresponding to the quantity of incident light and a charge storage part for storing the signal charge generated by the photoelectric conversion part. The imaging section 12 performs a global shutter operation at the same exposure start timing and exposure period for the entire pixels in a predetermined region of the pixel part. A first readout part 121 reads the signal charge in the predetermined pixel region among the signal charges stored in the charge storage part before signal charges in other pixel regions, and reads the signal charges in the other pixel regions later. A second readout part 122 reads pixel data once or more as a signal charge to be used for control, contained in the predetermined pixel region within a time interval for reading out the signal charges in the other pixel region with the first readout part 121. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus.

  In recent years, an imaging device that converts an optical image into an electric signal is mounted on an imaging device such as a digital camera or a digital video camera. The imaging device is changed from a CCD (Charge Coupled Device) to a CMOS (Charge Coupled Device). Complementary Metal Oxide Semiconductor (Complementary Metal Oxide Semiconductor) is shifting its market share.

  A MOS type image pickup device such as a CMOS mounted on the image pickup apparatus sequentially reads out the charges of a large number of pixels arranged in a two-dimensional manner on the image pickup surface. Is different for each pixel (or for each line). Therefore, there is provided a MOS type image pickup device that is configured so that the exposure start time of all the pixels can be made the same and the exposure end time of all the pixels can be made the same (that is, control by a global shutter is possible). Are known. A MOS imaging device configured to be controlled by a global shutter includes a photoelectric conversion unit such as a photodiode that generates a signal corresponding to an exposure amount, and temporarily generates a signal charge generated in the photoelectric conversion unit. And a transistor functioning as a switch when charge transfer or reset is performed.

In order to suppress kTC noise (reset noise) when this image sensor is used in a digital camera, a technique for driving the image sensor in the following sequence is known (for example, see Patent Document 1).
(1) The signal storage unit FD is reset by the transistor Mr, and the reset data is sequentially scanned and read for each line and stored.
(2) The photoelectric conversion units PD of all the pixels are collectively reset, and after a predetermined exposure time has elapsed, the pixel data of the photoelectric conversion units PD are collectively transferred to the signal storage unit FD.
(3) The pixel data transferred to the signal accumulation unit FD is sequentially scanned and read for each line, and the reset data stored in (1) is subtracted (a difference is taken).

  Further, image data for one frame is read out from a solid-state imaging device such as a CMOS image sensor at a speed faster than the normal speed, and a time (blanking period) free in one frame period is created. Then, a distance measurement image for AF (Autofocus), here, a distance measurement image is obtained by thinning out pixels at a predetermined thinning readout rate using this blanking period. A technique for performing AF control at high speed without stopping the imaging operation by calculating an evaluation value for evaluating the degree of focusing for automatic focus control from the distance measurement image is known. (For example, refer to Patent Document 2).

JP 2005-65184 A JP 2008-199477 A

  However, when the imaging device is driven in the sequence as described above, new pixel data cannot be acquired after the start of exposure until the completion of reading of the signal charge accumulated in the signal accumulation unit. Therefore, data used for camera control such as AF, AE (Automatic Exposure), and AWB (Auto White Balance) is acquired at a desired timing during a series of operations for obtaining an image. Such a phenomenon occurs that it cannot be performed or that the period of live view (image display) update (the display portion is blacked out and no image is displayed) becomes longer.

  In particular, in the above-described sequence, both the readout operation of all pixel signals for reset data before exposure and the readout operation of all pixel signals for pixel data after exposure are necessary, so that the captured image acquisition is completed. One sequence period, which is a period until this, is lengthened. In particular, recent image sensors tend to increase the number of pixels and the time required to read out all pixel signals, resulting in a longer period during which live view and camera control data cannot be acquired. Is becoming a more important issue.

  In addition, camera control data is not only used for autofocus and automatic exposure, but is also often used for display on the display unit. Therefore, data for camera control until the time immediately before the exposure period. It is desirable to be able to obtain

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an imaging apparatus capable of shortening a period during which camera control data cannot be acquired when capturing a still image. To do.

  The present invention has a pixel unit in which a plurality of pixels each having a photoelectric conversion unit that generates a signal charge corresponding to the amount of incident light and a charge storage unit that stores the signal charge generated by the photoelectric conversion unit are arranged two-dimensionally. A solid-state imaging device that performs a global shutter operation with the same exposure start timing and exposure period for all the pixels in the predetermined area of the pixel section, and a predetermined pixel area of the signal charges stored in the charge storage section. A signal charge is read before the signal charge of the other pixel region, and then the signal charge of the other pixel region is read, and the first signal charge reading unit reads the signal charge of the other pixel region. A second signal charge reading unit that reads pixel data, which is a signal charge used for control included in the predetermined pixel area, at least once in a time interval in which signal charges are read, and the first signal charge reading Selects the order of the pixel regions from which signal charges are read out, and the second signal charge readout unit reads out the pixel data from among the pixel regions from which the first signal charge readout unit has read out the signal charges. The two-signal charge reading unit selects the order of the pixel regions from which the pixel data is read, or the second signal charge reading unit selects the order of the pixel regions from which the pixel data is read, and the second signal charge reading unit A selection unit that selects the order of the pixel regions from which the first signal charge reading unit reads out the signal charges so that the signal charges in the pixel region including the pixel are read out before reading out the pixel data; This is an imaging apparatus.

  Further, according to the present invention, an autofocus evaluation value calculation unit that calculates an autofocus parameter based on pixel data read by the second charge reading unit, and the first signal charge reading unit reads the signal charge. An autofocus control unit that performs autofocus control based on a calculation result of the autofocus evaluation value calculation unit during the period, and the selection unit converts the pixel data used for the autofocus control into the second signal charge. The image pickup apparatus is characterized in that the second signal charge reading unit selects the order of the pixel areas from which the pixel data is read so that the reading unit reads the pixel data.

  The present invention further includes an image recognition unit that performs image recognition of a subject using the pixel data read by the second charge reading unit, and the selection unit includes the subject recognized by the image recognition unit. The imaging apparatus is characterized in that the second signal charge reading unit next selects the order of the pixel areas from which the pixel data is read so that the pixel data is read by the second signal charge reading unit.

  In addition, the present invention includes an autofocus position designation unit that receives designation of a position for performing autofocus by a user, and the selection unit receives the pixel data of the position for performing autofocus received by the autofocus position designation unit. The imaging apparatus is characterized in that the second signal charge reading unit selects an order of pixel areas from which the pixel data is read out so that the second signal charge reading unit reads out the pixel data.

  In the imaging device according to the aspect of the invention, the selection unit may perform camera control for taking a next image when the first signal charge reading unit finishes reading the signal charges in all the pixel regions. The order of the pixel regions from which the second signal charge reading unit reads out the pixel data is selected so that the second signal charge reading unit reads out the pixel data.

  In addition, the present invention includes an image processing unit that generates display image data based on the pixel data read by the second charge reading unit, and the selection unit, when the display data is required The second signal charge reading unit reads out the pixel data so that the display image formed by the display image data has the same field angle as the still image field angle. The order of the pixel areas to be read out is selected, and the second signal charge readout unit reads out the pixel data used for the autofocus control when the autofocus control unit performs the autofocus control. An image pickup apparatus, wherein a charge reading unit selects an order of pixel regions from which the pixel data is read.

  In the imaging apparatus of the present invention, the image recognition unit performs image recognition of the subject using the pixel data read by the second charge reading unit when a still image was previously captured, and the selection unit Are arranged in the order of the pixel areas from which the second signal charge reading unit reads out the pixel data so that the second signal charge reading unit reads out the pixel data including the subject recognized by the image recognition unit. It is characterized by selecting.

  In the imaging apparatus of the present invention, the image recognition unit predicts a moving position of a subject using the pixel data read by the second charge reading unit, and the selection unit predicts the image recognition unit. The second signal charge reading unit selects an order of pixel areas from which the pixel data is read out so that the second signal charge reading unit reads out the pixel data including the moving position of the subject.

  According to the present invention, the selection unit selects the order of the pixel regions from which the first signal charge readout unit reads out the signal charges, and the second signal charge readout unit selects from the pixel regions read out by the first signal charge readout unit. In order to read out the pixel data, the second signal charge reading unit selects the order of the pixel areas from which the pixel data is read out. Alternatively, the selection unit selects the order of the pixel regions from which the second signal charge reading unit reads out the pixel data, and reads out the signal charges in the pixel region including the pixel before the second signal charge reading unit reads out the pixel data. As described above, the first signal charge reading unit selects the order of the pixel regions from which the signal charge is read.

  Then, according to the order of the pixel regions from which the signal charges selected by the selection unit are read, the first signal charge reading unit converts the signal charges in a predetermined pixel region among the signal charges stored in the charge storage unit to other pixel regions. Read out before the signal charge, and then read out the signal charges in the other pixel regions. In addition, the second signal charge reading unit reads the pixel data included in the predetermined pixel region one or more times within the time interval in which the first signal charge reading unit reads the signal charges in the other pixel regions. As a result, the present invention can further shorten the period during which camera control data cannot be acquired when a still image is captured.

1 is a block diagram illustrating a configuration of an imaging apparatus according to an embodiment of the present invention. It is the figure which showed the structure of the single pixel in this embodiment. It is a timing chart which shows the timing of image pick-up operation of the image pick-up part which operates by a general global shutter. 6 is a timing chart showing the timing of an imaging operation of an imaging unit when a still image is captured by a general global shutter while camera control (live view display) image data is being acquired. In this embodiment, it is a timing chart which shows the operation timing at the time of the imaging part of an imaging device acquiring the image data for camera control, while imaging a still image. In this embodiment, it is the figure which showed an example of the pixel area | region from which a signal charge is read by the 1st read-out part and the 2nd read-out part. 6 is a timing chart showing detailed operation timings when acquiring camera control image data while the imaging unit of the imaging apparatus captures a still image in the present embodiment. In this embodiment, it is a figure which shows the example of the line read in order to use it for a live view display. In this embodiment, it is a timing chart which shows the operation timing at the time of the image pick-up part of an image pick-up device acquiring live view display image data while picturizing a still picture. In this embodiment, the imaging unit of the imaging device is a timing chart showing operation timing when the order of acquiring control data is variable according to the result of automatic recognition of a subject while imaging a still image. is there.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus according to the present embodiment. In the illustrated example, the imaging apparatus 1 includes a lens 11, an imaging unit 12 (solid-state imaging device), an image processing unit 13, an AF (autofocus) evaluation value calculation unit 14, an imaging control unit 15, and camera shake detection. Unit 16, camera shake correction unit 17, AF control unit 18, camera operation unit 19, and camera control unit 20. In addition, although the display part 21 and the memory card 22 are described in the figure, since these are configured to be detachable with respect to the imaging apparatus 1, the configuration may not be unique to the imaging apparatus 1. Absent.

  The lens 11 is a photographic lens for forming an optical image of a subject on the imaging surface of the imaging device of the imaging unit 12. The imaging unit 12 includes a pixel unit in which a plurality of pixels each having a photoelectric conversion unit that generates a signal charge corresponding to the amount of incident light and a charge storage unit that stores the signal charge generated by the photoelectric conversion unit are arranged two-dimensionally. ing. The configuration of the pixel will be described later. The imaging unit 12 includes a first reading unit 121 that reads signal charges for generating a still image, and a second reading unit 122 that reads image data for camera control (pixel data). The imaging unit 12 photoelectrically converts the optical image of the subject formed by the lens 11 and converts the optical image into a digital signal, and outputs the digital signal. The imaging unit 12 is configured to be able to perform an operation using at least a global shutter having the same exposure start time and exposure end time for all pixels. Further, in addition to the operation by the global shutter, the imaging unit 12 may be configured to be able to perform an operation by a rolling shutter that sequentially performs exposure in line units (or pixel units), for example.

  The imaging control unit 15 includes a readout control unit 150, a first readout order selection unit 151 (selection unit), and a second readout order selection unit 152 (selection unit), and in response to a command from the camera control unit 20 Based on this, the imaging unit 12 is driven, and exposure control, readout area, readout timing, and the like are controlled. The readout control unit 150 controls the first readout unit 121 so as to read out the signal charge for generating a still image from the charge storage unit, and the signal charge used as camera control image data (pixel data) is stored in the charge storage unit. The second reading unit 122 is controlled so as to read from. The first readout order selection unit 151 selects the order of pixel regions from which the first readout unit 121 reads out signal charges so that the second readout unit 122 can read out the camera control image data in a desired order. The second reading order selection unit 152 selects the order of the pixel areas from which the second reading unit 122 reads the camera control image data.

  The image processing unit 13 performs various digital image processing on the image signal output from the imaging unit 12. The image processing unit 13 includes a first image processing unit 131 that processes an image signal for recording, and a second image processing unit 132 that processes the image signal for display and camera control. Note that the imaging apparatus 1 may include an image processing unit that processes an image signal for display and an image processing unit that processes an image signal for camera control instead of the second image processing unit 132. . The image processing unit 13 includes an image recognition unit 133 and a recognition position prediction unit 134. The image recognition unit 133 recognizes a subject included in the image and acquires position information of the subject. The recognition position prediction unit 134 calculates the position information of the subject in consideration of the moving speed, the direction, and the like of the subject using an AF tracking method that tracks a moving object, for example.

  The AF evaluation value calculation unit 14 is based on the average value of the entire image signal output from the imaging unit 12, the calculated value calculated from the peak value of a certain region, the luminance equivalent signal, and the like, and the degree of focusing on the subject. An AF evaluation value indicating is calculated. The AF evaluation value calculated by the AF evaluation value calculation unit 14 is output to the camera control unit 20. The camera control unit 20 controls the AF control unit 18 using this AF evaluation value. The AF control unit 18 drives the focus lens included in the lens 11 based on the control of the camera control unit 20 so that the subject image formed on the imaging unit 12 is focused.

  The display unit 21 displays an image based on the signal image-processed for display by the second image processing unit 132 of the image processing unit 13. The display unit 21 can reproduce and display still images and moving image recorded images, and can perform live view (LV) display that displays an imaging range in real time. The memory card 22 is a recording medium for storing a signal image-processed for recording by the first image processing unit 131 of the image processing unit 13. The data stored in the memory card 22 may be converted into still image data or moving image data that has been compressed by the image processing unit 13 to reduce its capacity or that has been subjected to non-compression processing to maintain image quality. Many. Further, the imaging apparatus 1 may include an output unit and an external I / F (interface) unit for communicating with an external computer or the like instead of the memory card 22.

  The camera shake detection unit 16 detects a camera shake of the imaging apparatus 1 itself. The camera shake correction unit 17 drives the lens 11 and the imaging unit 12 so as to cancel the influence of the camera shake on the captured image based on the camera shake information detected by the camera shake detection unit 16. The camera operation unit 19 is for a user to perform various operation inputs to the imaging apparatus 1. Examples of the operation members included in the camera operation unit 19 include a power switch for turning on / off the power of the imaging apparatus 1, a release button including a two-stage press button for inputting an instruction for still image shooting, and shooting. Shooting mode switch for switching between single shooting mode and continuous shooting mode, AF mode switch for switching AF mode between single AF mode and continuous AF mode, switch for specifying the position for auto focus, etc. Can be mentioned.

  Based on the AF evaluation value from the AF evaluation value calculation unit 14, camera shake information from the camera shake detection unit 16, operation input from the camera operation unit 19, and the like, the camera control unit 20 The entire image pickup apparatus 1 including the unit 13, the memory card 22, the camera shake correction unit 17, the AF control unit 18 and the like is controlled.

  A combination of the first reading unit 121 and the reading control unit 150 corresponds to the first signal charge reading unit. A combination of the second reading unit 122 and the reading control unit 150 corresponds to the second signal charge reading unit.

  Next, a configuration of a pixel (single pixel) included in the pixel unit of the imaging unit 12 will be described. FIG. 2 is a diagram showing a configuration of a single pixel in the present embodiment. In the illustrated example, a single pixel 100 includes a photoelectric conversion unit 101, a transfer transistor 102, a charge storage unit (FD) 103, an FD reset transistor 104, an amplification transistor 105, a selection transistor 106, and a PD reset transistor 107. Yes.

  The photoelectric conversion unit 101 is a photoelectric conversion unit PD (photodiode) that converts incident light into signal charges and accumulates them. The transfer transistor 102 is a transistor that functions as a transfer unit and a gate unit for transferring the signal charges accumulated in the photoelectric conversion unit 101 to the charge accumulation unit 103 (FD). (It is connected to a signal line φTRi for applying a transfer pulse.)

  The charge storage unit 103 temporarily holds the signal charge transferred from the photoelectric conversion unit 101 by the transfer transistor 102. The FD reset transistor 104 is a transistor that functions as a second reset unit that resets the signal charge in the charge storage unit 103 and the input unit of the amplification transistor 105. (It is connected to the signal line φRMi for applying the FD reset pulse.)

  Note that if the application of the transfer pulse to the transfer transistor 102 and the application of the FD reset pulse to the FD reset transistor 104 are performed at the same time, not only the charge storage unit 103 (FD) can be reset, but also The photoelectric conversion unit 101 (PD) can be reset. Therefore, the combination of the transfer transistor 102 and the FD reset transistor 104 also functions as a first reset unit for the photoelectric conversion unit 101 (PD).

  The amplifying transistor 105 is an amplifying transistor that functions as an amplifying unit, and is a transistor for amplifying the voltage level of the charge storage unit 103 and outputting it as a pixel signal. The selection transistor 106 is a selection transistor for outputting a pixel signal to the vertical signal line 114 when the pixel 100 is selected as a pixel from which signal charges are read. (It is connected to the signal line φSEi for applying the selection pulse.)

  The PD reset transistor 107 is a transistor that functions as a first reset unit that resets signal charges in the photoelectric conversion unit 101. (It is connected to the current source VDD and connected to the signal line φRPDi for applying the PD reset pulse.) Here, the parts other than the photoelectric conversion unit 101 are shielded from light.

  In addition to the vertical signal line 114, a pixel power line 110, an FD reset line 111, a transfer line 112, a selection line 113, and a PD reset line 115 are arranged in the pixel 100. The pixel power supply line 110 is a signal line for applying the power supply voltage VDD, and is electrically connected to the drain side of the amplification transistor 105, the drain side of the PD reset transistor 107, and the drain side of the FD reset transistor 104. . The FD reset line 111 is a signal line for applying an FD reset pulse φRMi (i = 1 to m, where m is the number of rows) for resetting the charge accumulating unit 103 for one row. The reset transistor 104 is connected to the gate.

  The transfer line 112 is a signal line for applying a row transfer pulse φTRi (i = 1 to m) for transferring the signal charge of the pixels 100 for one row to the charge storage unit 103 of each pixel 100, It is electrically connected to the gate of the transfer transistor 102 of the pixels 100 for one row. The selection line 113 is a signal line for applying a row selection pulse φSEi (i = 1 to m) for selecting the pixels 100 for one row from which pixel signals are read, and is a selection transistor of the pixels 100 for one row. 106 is electrically connected to the gate. Thus, a photoelectric conversion function, a reset function, an amplification read function, a temporary memory function, and a selection function are realized by a pixel configuration using five transistors.

  Next, an imaging operation of the imaging unit 12 that operates with a general global shutter will be described. FIG. 3 is a timing chart showing the timing of the imaging operation of the imaging unit 12 that operates with a general global shutter. VD (vertical synchronization signal) is a signal for obtaining synchronization. In the illustrated example, VD is a signal having one of two types of values, a high value and a low value, and the exposure and readout are synchronized based on this signal. The exposure indicates the timing at which the pixel portion is exposed to capture a still image. Reading indicates the timing for reading reset data (reset data reading) and the timing for reading image data (image data reading). READPOINTER RESETPOINTER is a timing for reading reset data and image data from the charge storage unit 103 (straight lines 301 and 302), a reset timing of the photoelectric conversion unit 101 (broken line 303), and a signal charge from the photoelectric conversion unit 101 to the charge storage unit 103. The transfer timing (straight line 304) is shown.

  The imaging unit 12 first resets the charge storage unit 103 and reads out reset noise in the reset data reading period before performing exposure by the global shutter operation. In the case of an image sensor in which the pixels 100 are arranged two-dimensionally, such an operation is performed from the pixels 100 in the first row to the pixels 100 in the n-th row (final row) included in the pixel portion. The reset noise of all the pixels 100 is read out by sequentially performing (Straight line 301). A period during which reset noise is read is referred to as a reset data reading period.

  Subsequently, the imaging unit 12 starts exposure of all pixels 100 of all lines included in the pixel unit at the same time, and ends exposure of all pixels 100 at the same time when a predetermined exposure period has elapsed. Then, the imaging unit 12 reads data from the pixels 100 in the first row (start row) to the pixels 100 in the n-th row (final row) (straight line 302). This period is set as an image data reading period.

  The CMOS image sensor may be configured to store the reset noise read here and perform an operation of subtracting it from a signal charge to be read later. Further, the exposure timing may be a timing before the reset data reading period, not between the reset data reading period and the image data reading period as shown in the figure.

  Next, the imaging operation of the imaging unit 12 when a still image is captured by a general global shutter while acquiring camera control (live view) image data will be described. FIG. 4 is a timing chart showing the timing of the imaging operation of the imaging unit 12 when a still image is captured by a general global shutter while the camera control (live view) image data is being acquired. .

  In the figure, VD, exposure, readout, READPOINTER RESETPOINTER, and camera control data (LV display) are shown. The contents indicated by VD and exposure are as described above. Reading indicates the timing (A to I) for reading image data for camera control (LV display), the timing for reading reset data (reset data reading), and the timing for reading image data (image data reading α). .

  READPOINTER RESETPOINTER includes timings (dashed lines 401 to 409) for reading camera control image data (LV display) from the charge storage unit 103, timings for reading reset data and image data from the charge storage unit 103 (straight lines 410 and 411), The reset timing of the photoelectric conversion unit 101 (broken line 412) and the timing of transferring signal charges from the photoelectric conversion unit 101 to the charge storage unit 103 (straight line 413) are shown. The camera control data (LV display) indicates live view images (A to I, α) displayed on the display unit 21.

  When reading out all high-definition still images, the imaging unit 12 requires, for example, 62.5 ms (16 fps), but reads out image data only in a certain area such as thinning out or clipping for camera control (live view). For example, it is possible to read out at a high speed of about 8.33 ms (120 fps). In the former case, the imaging unit 12 reads at most 16 image data per second, but in the latter case, 120 image data can be read out per second.

  Therefore, when acquiring image data for camera control, the imaging unit 12 acquires image data, for example, at 120 frames per second until the release button is pressed (here, the second step) (in the drawing). To the image processing unit 13. At this time, as illustrated, when the image capturing unit 12 acquires image data in a certain frame, the image processing unit 12 processes the image data in the next frame. If the release button is pressed during this operation, in the case shown in the figure, that is, when the imaging unit 12 captures a still image with a general global shutter, the camera control image data The capturing is stopped and the imaging operation as shown in FIG. 3 is performed.

  During the still image capturing operation, since the live view image data is not acquired, the camera control is performed using the camera control image data F captured last as shown in FIG. Note that since the result does not change even if processing is performed using the camera control image data F fetched last, the result of the previous processing may be used without performing the predetermined processing during the imaging operation.

  When the still image capturing operation as shown in FIG. 3 is completed, the imaging unit 12 acquires the camera control image data again, and uses the acquired camera control image data for the next frame process. In the example shown in FIG. 4, in order to reduce the period in which the camera control image data is not updated even by one frame, in the next frame after the still image capturing operation (image data reading) indicated by the straight line 411 is completed. In the example, camera control image data α is generated from a still image and used for camera control.

  Next, the imaging operation of the imaging unit 12 when acquiring camera control image data while capturing a still image will be described. FIG. 5 is a timing chart showing the operation timing when the image capturing unit 12 of the image capturing apparatus 1 acquires camera control image data while capturing a still image in the present embodiment. In the figure, exposure, reading, READPOINTER RESETPOINTER, camera control data (LV display), and release are shown. The release indicates the timing when the release button is pressed.

  When the imaging unit 12 is driven at the timing shown in FIG. 4, a still image is also used for AE, AF, etc. until the still image capturing operation is completed after the release button is pressed. The control image data is not updated either. On the other hand, when the imaging unit 12 is driven at the timing shown in FIG. 5, camera control image data is acquired even after the release button is pressed until the imaging operation ends. It has become a thing.

  The operation of the imaging unit 12 illustrated in FIG. 5 is the same as the operation illustrated in FIG. 4 until the release button is pressed. Then, when the release button is pressed, the reading of the reset data is started. However, the imaging unit 12 performs the operation of acquiring the camera control image data when reading the reset data of several lines. . Specifically, the read control unit 150 causes the second read unit 122 to acquire the image data for camera control at least once before the first read unit 121 finishes reading the reset data (signal charge). Control. At this time, when the second reading unit 122 acquires the image data for camera control twice or more, the reset data is read between them.

  As described above, after the reading of the reset data is completed, the exposure operation is started, and the exposure period is ended in the same manner as the operation shown in FIG.

  Subsequently, the image data reading period is started, and the image pickup unit 12 reads image data (signal charge). At this time, the read control unit 150 causes the first reading unit 121 of the image pickup unit 12 to first perform the camera control image. Control is performed so that the signal charge of each line used to acquire data is read, and then the signal charge of the other lines is read. The read control unit 150 then reads the signal charge of each line used to acquire the camera control image data by the first read unit 121 at an appropriate time (appropriate time in the image data read period). ), The second reading unit 122 performs control so as to acquire camera control image data (pixel data) at least once. At this time, when the second reading unit 122 acquires the image data for camera control more than once, it is performed with the reading of the image data in between.

  At this time, the first readout order selection unit 151 of the imaging control unit 15 selects the order of the pixel areas from which the first readout unit 121 reads out the signal charges. In addition, the second signal charge reading unit 152 of the imaging control unit 15 selects the order of pixel regions from which the second reading unit 122 reads the camera control image data.

  Specifically, the first reading order selection unit 151 selects the order of the pixel regions from which the first reading unit 121 reads signal charges, and the second reading order selection unit 152 sets the pixels read by the first reading unit 121. The order of the pixel regions from which the second reading unit 122 reads pixel data is selected so that the second reading unit 122 reads pixel data from the region. Alternatively, the second readout order selection unit 152 selects the order of the pixel areas from which the second readout unit 122 reads out pixel data, and the first readout order selection unit 151 determines before the second readout unit 122 reads out pixel data. The first reading unit 121 selects the order of the pixel areas from which the signal charges are read out so that the signal charges in the pixel area including the pixels are read out.

  For example, in the case where the image data for camera control is used for autofocus control, the second reading is performed when it is desired to focus on the center portion by designation by the user or recognition of the subject by the image recognition unit 133 or the recognition position prediction unit 134. The order selection unit 152 selects the order of the pixel areas from which the second readout unit 122 reads out the pixel data so that the second readout unit 122 reads out the pixel data in the central pixel area of the pixel units. Then, the first readout order selection unit 151 selects the order of the pixel regions of the first readout unit 121 so that the order of the pixel regions of the second readout unit 122 can be selected.

  The imaging unit 12 according to the present embodiment transfers signal charges accumulated by the photoelectric conversion unit 101 of the pixel 100 to the charge accumulation unit 103 when a still image is captured by the global shutter. The charge storage unit 103 stores the transferred signal charge. Thereafter, the first reading unit 121 sequentially reads the signal charges stored in the charge storage unit 103. The pixel 100 from which the signal charges have been read out by the first reading unit 121 has already been read out before the signal charges of the other pixels 100 are read out. The still image captured by the unit 12 is not affected. Therefore, even when the imaging unit 12 is capturing a still image (during reset data reading or image data reading), the imaging control unit 15 reads the signal charge of the still image read out by the first reading unit 121. 100 is newly exposed, and the second reading unit 122 is controlled to read the control image data (pixel data). As a result, the imaging device 1 can acquire camera control image data and live view display image data even while acquiring a still image. The period during which data cannot be acquired can be further shortened.

  For example, while the imaging unit 12 is capturing a still image (while the first reading unit 121 is reading signal charges), the AF evaluation value calculation unit 14 reads the control image read by the second reading unit 122. An autofocus parameter is calculated based on the data, and the AF control unit 18 performs autofocus control of the lens 11 based on the autofocus parameter. Thereby, the imaging device 1 can perform autofocus control while capturing a still image.

  The imaging device 1 performs the above-described processing, and the imaging unit 12 acquires normal camera control image data again at the end of the image data reading period, similarly to the example shown in FIG. By such processing, the imaging apparatus 1 of the present embodiment acquires camera control image data while capturing a still image.

  Next, an example of a pixel region from which signal charges are read by the first readout unit 121 and the second readout unit 122 will be described. FIG. 6 is a diagram illustrating an example of a pixel region from which signal charges are read by the first reading unit 121 and the second reading unit 122 in the present embodiment.

  In the illustrated example, the total number of lines (number of rows) of the pixel unit included in the imaging unit 12 is 3000 lines from 0 line to 2999 lines. In FIG. 6A, when all lines (from 0 to 2999 lines) are read as still image data, the areas are changed from 0 to 999 lines (area A) and from 1000 lines to 1999 lines (area B). ), An example in which 2000 lines are divided into 2999 lines (area C) is shown. In FIG. 6B, a pixel area to be read as camera control image data is shown as area a which is a pixel area included in area A.

  Here, a region A indicates a read region at the read timings A-1 and A-2 in FIG. A region B indicates a read region at the read timings B-1 and B-2 in FIG. A region C indicates a read region at the read timings C-1 and C-2 in FIG. An area a indicates a read area at the read timings a-1 to a-4 (read frames G to J) in FIG. Since the reading of the area A is completed, the area a can be read anytime thereafter.

  In the example illustrated in FIG. 6B, the pixel area read by the second reading unit 122 as the camera control image data is an area a that is a part of the area A (read-out area). However, the entire region A may be used. Of course, if the number of readout lines increases, it will naturally take a readout time like readout of a still image, so it is desirable to read out only the necessary lines used as camera control image data. Furthermore, in the example shown in FIG. 6 (2), the continuous line is an example of one pixel area. However, the continuous line is not read, but the thinning function and the addition (average) function are read. It may be used to reduce the amount of read data.

  Next, details of the operation timing when acquiring the camera control image data while the imaging unit 12 of the imaging device 1 captures a still image will be described. FIG. 7 is a timing chart showing detailed operation timings when the camera control image data is acquired while the imaging unit 12 of the imaging device 1 captures a still image in the present embodiment. In the figure, VD, exposure, readout, READPOINTER RESETPOINTER, and a readout image as a specific example are shown.

  As reading, there are shown for still image indicating the timing for reading out signal charges of a still image and for camera control indicating the timing for reading out image data for camera control. As a specific example, a still image read image indicating an area from which signal charges of a still image are read and a camera control read image indicating an area from which camera control image data is read are illustrated.

  Note that broken lines c′-1 to c′-5 shown as RESETPOINTER indicate the timing for resetting the photoelectric conversion unit 101 in order to acquire camera control image data. Further, straight lines c-1 to c-5 shown as READPOINTER indicate timings for reading camera control image data. Therefore, the exposure time for the photoelectric conversion unit 101 to acquire camera control image data is between the broken line c′-1 and the straight line c-1, between the broken line c′-2 and the straight line c-2, Between the broken line c'-3 and the straight line c-3, between the broken line c'-4 and the straight line c-4, and between the broken line c'-5 and the straight line c-5.

  In the illustrated example, unlike the example illustrated in FIG. 5, an example in which the image data reading period is divided into five is illustrated. The division of the readout period can be arbitrarily changed by a desired camera control signal. Although the timing after the exposure operation is illustrated, the relationship between readout of reset data and readout of image data for camera control is substantially the same as the relationship between readout of image data and readout of image data for camera control. It is omitted for this reason.

  After the exposure period, the still image data reading period is started. First, the imaging unit 12 reads out a pixel signal of a still image in the region C including a region used as camera control image data (still image signal read a). After this reading is completed, the camera control image data c after the exposure period can be read even within the still image signal read period, and the camera control image data c-1 is read (second exposure). Read a). The exposure start timing at the time of the second exposure reading is indicated by a dotted line. The exposure time of the camera control image data is a period from the dotted line to the second exposure reading for each row. The timing of the second exposure reading is indicated by a solid line.

  Here, the area c read out by the imaging unit 12 is an area of interest including, for example, image data for camera control for AF control, and may be an area including the area C in the central portion of the screen. The attention area is, for example, an AF area arbitrarily determined by the photographer at the time of shooting using an AF area frame displayed on the screen of the display unit 21 by a user interface (UI), or an AF evaluation value calculation unit. 14 or the second image processing unit 132, and an automatic focusing area determined from the calculation result. In the example shown in the figure, the reading area is shown as an example of a central band, but it may be set at one position in the central area, and is not limited to the central area, and may be a plurality of areas. .

  Similarly, in the still image signal read-out b, image data in an area including an area to be read out next as camera control image data may be read in advance. In the illustrated example, since only the region c is the region of interest, the subsequent reading order may not be defined, and all of the image data to be read during the period of the still image bright signal readings a to e divided into five. Should be read. In the example shown in the figure, reading is performed in the order of the region B and the region D, which are the peripheral regions of the region C, and then the region E and the region A are read in this order.

  When the read live view display image data is displayed on the display unit 21, the second image processing unit 132 performs display such as enlargement in accordance with the number of pixels of the display unit 21 and performs display. Further, the camera control image data e after the end of the image data read period (still image read signal read e) is read out of the entire image thinned out for LV in addition to the camera control image data. It may be switched and controlled so that it can be performed. As a result, the live view display of the entire still image can be performed after the still image capturing is completed (still image bright signal reading e).

  Next, an example of lines read for use in live view display will be described. FIG. 8 is a diagram illustrating an example of lines read for use in live view display in the present embodiment. In the illustrated example, the total number of lines (number of rows) of the pixel unit included in the imaging unit 12 is 3000 lines from 0 line to 2999 lines. In addition, an example is shown in which live view pixel data is read from these all lines at a rate of 1 line per 5 lines (5 divisions). In the example shown in the figure, the 5N line is selected as a line for reading out the live view pixel data, but the 5N line, the (5N + 1) line, the (5N + 2) line, the (5N + 3) line, and ( 5N + 4) line (N is an integer of 0 or more) may be selected and read.

  In addition, when reading out camera control image data as live view display image data, reading is performed by dividing into five as described above, but when reading out as camera control image data for AF or AE, 5 is read. Instead of reading all of the divisions (600 lines in the figure), only a certain area may be read. For example, when only the central 400 lines are read out of 600 lines, it is possible to shift to the next reading operation at a higher speed. Further, when the image pickup device is a single-plate color image pickup device, for example, a Bayer color filter is provided. In this case, G (green) and R (red) color filters or G (green) and B (blue) color filters are alternately used for even lines and odd lines. Only G and R or only G and B image data for live view display are obtained. Therefore, at the time of reading, it is desirable to finely adjust the selection position of the reading line so that all color components of RGB can be obtained and a desired image can be obtained by the image processing unit 13.

  Next, an imaging operation of the imaging unit 12 when acquiring live view display image data while capturing a still image will be described. FIG. 9 is a timing chart showing the operation timing when the image capturing unit 12 of the image capturing apparatus 1 acquires live view display image data while capturing a still image in the present embodiment. In the figure, VD, exposure, readout, READPOINTER RESETPOINTER, and a readout image as a specific example are shown.

  The illustrated example shows the timing after the exposure operation as in the timing chart shown in FIG. In the example shown in the drawing, the still image data reading period starts after the exposure period. Then, first, in the period when reading of the second exposure readout a is started, the signal charge of the still image of the line read out in the second exposure readout a after the exposure period is read out (still image bright signal readout a). After the reading is completed, the live view display image data after the exposure period can be read even within the still image signal reading period, and the live view display image data is read by the second exposure reading a. Is possible. Similarly, in the still image bright signal readout b, since the next second exposure readout is possible if the still image readout after the exposure period is completed, the readout of the signal charge of the still image of the line to be read out in advance. Just do it.

  In the illustrated example, the reading control unit 150 controls the second reading order selection unit 152 so that the second reading unit 122 reads the (5N) line in the second exposure reading a as the live view display image data. To do. That is, the second readout order selection unit 152 reads out the pixel data by thinning out the rows in the pixel region, but performs the second readout so that the live view display image data has the same field angle as that of the still image. The unit 122 selects the order of pixel areas from which pixel data is read. Therefore, the first readout order selection unit 151 selects the order of the pixel regions so that the first readout unit 121 reads out the (5N) line under the control of the readout control unit 150 in the still image signal readout a.

  Next, the imaging unit 12 performs reading of live view display image data (second exposure reading b), and acquires data for performing live view display. In this example, all (5N) lines are used for live view display, but (5N + 1) lines, (5N + 2) lines, (5N + 3) lines, and (5N + 4) lines are used for live view display. May be. Further, when only the (5N) line is used for live view display, the reading order does not have to be defined in the subsequent still image bright signal reading b to e, and image data to be read in the still image bright signal reading b to e period. All you need to do is read. In this example, reading is performed in the order of (5N + 1) line, (5N + 2) line, (5N + 3) line, and (5N + 4) line.

  7 and 9, the camera control image data is read only during the image data read period. However, the camera control image data is read only during either or both of the reset data read period and the image data read period. Of course, it is also possible to do so. That is, the camera control image data can be read within at least one of the reset data reading period and the image data reading period. In particular, in the continuous shooting mode, it is desirable that AF data and AE data can be acquired and the photographer can check the subject in order to perform the next image shooting even when one image shooting is completed.

  Further, the live view display image data is not only used for live view display on the display unit 21, but can also be used as AF data or AE data. Still image data reading is controlled according to the area used for control or live view.

  As a result, live view display image data is acquired in order to shorten the time when the live view display is not updated or blacked out while performing AF or AE processing with the camera control image data when shooting by continuous shooting. However, even if the subject is a moving subject, it is easy for the photographer to change the shooting direction of the imaging apparatus 1 so that the subject is within the shooting range.

  Further, the second readout order selection unit 152 selects the order of the pixel areas from which the pixel data is read out so that the second readout unit 122 reads out the camera control image data to be used for capturing a still image next time. May be. As a result, each image captured during continuous shooting can be an image focused with higher accuracy based on AF tracking and an image with more appropriate exposure based on AE tracking. Further, the image recognition unit 133 or the recognition position prediction unit 134 may recognize the position of the subject using the camera control image data. For example, when the subject is located at the center and it is desired to focus on the center, the second readout order selection unit 152 uses the pixel data of the pixel area in the center of the pixel part of the second readout unit 122. The second reading unit 122 may select the order of pixel areas from which pixel data is read out.

  The first reading order selection unit 151 and the second reading order selection unit 152 of the imaging control unit 15 select the reading order of the pixel areas for still image reading according to the desired camera operation. For example, the first reading order selection unit 151 and the second reading order selection unit 152 of the imaging control unit 15 read out from the periphery of the region of interest as camera control image data as shown in FIG. 7, or as shown in FIG. As live view display image data, control is performed so as to read out from an area for performing thinning display and enlarged display, or to read them while switching them.

  On the other hand, since it is sufficient to perform normal AF operation and AE operation in the single shooting mode, the image pickup unit 12 is driven by the control by the general global shutter shown in FIG. 4 and the release button is pressed. You may make it shorten the time until the recording to the memory card 22 is complete | finished.

  Furthermore, in order to improve noise performance, the time from the end of reset data read to the start of image data read (the period between dotted lines 412 to 413 in FIG. 4) is basically (depending on the timing). If the reading order is the same (although some exceptions may occur), the amount of noise due to dark current (with a few exceptions as described above) It is possible to be the same. Therefore, it is possible to prevent deterioration in image quality due to a difference in noise amount depending on the line.

  Next, an example in which the reading order of the camera control image data is made variable according to the result of automatic recognition of the subject will be described. FIG. 10 illustrates a case where, in the present embodiment, the imaging unit 12 of the imaging apparatus 1 changes the order in which the camera control image data is acquired according to the automatic recognition result of the subject while the still image is being captured. It is a timing chart which shows the operation timing. In the figure, VD, exposure, readout, READPOINTER RESETPOINTER, and a readout image as a specific example are shown.

  In the example shown in FIG. 7, the example in which the camera control readout area (target area) is all the area C is shown, but in the example shown in FIG. 10, the area for reading out the camera control image data in accordance with the movement of the subject. Is changed to region a, region a, region b, region c, and region c. In this example, the second image processing unit 132 generates an image using the read camera control image data, and the image recognition unit 133 recognizes the position of the subject based on this image, and automatically uses the position information. Determine the focusing area. Then, the second reading order selection unit 152 selects an area for reading the camera control image data. That is, the second reading order selection unit 152 selects the order of the pixel areas read by the second reading unit 122 so as to read the camera control image data in the area where the subject is located. As a method for recognizing the position of the subject, for example, an AF tracking method that tracks a moving object is used.

  First, the subject position is recognized as the region A from the calculation result of the AF evaluation value calculation unit 14 and the position information of the image recognition unit 133. The second reading order selection unit 152 selects an area a for reading the camera control image data. The first reading order selection unit 151 selects a region from which a still image is read as a region A according to the region a selected by the second reading order selection unit 152. Thereby, the imaging unit 12 starts reading the signal charges in the region A. Next, the imaging unit 12 reads out the image data of the area a as camera control image data and inputs it to the second image processing unit 132. The second image processing unit 132 generates an image based on the input image data. The image recognition unit 133 acquires subject position information based on the image generated by the second image processing unit 132. In addition, since the imaging apparatus 1 includes the recognition position prediction unit 134, it is possible to obtain position information that takes into account the moving speed and direction of the subject. Based on these pieces of position information, the second reading order selection unit 152 selects an area from which camera control image data is next read.

  In the illustrated example, since the subject of interest has moved from the region A to the region C via the region B, the imaging unit 12 reads the camera control image data while changing from the region a to the region c via the region a. ing. At the same time, when reading a still image, the imaging unit 12 first starts reading the area A in the still image bright signal reading a, and performs the operation of reading the camera control reading area after exposure first. As described above, the imaging apparatus 1 can determine the area from which the camera control image data is next read according to the position information calculated by the recognition position prediction unit 134, and according to the determined area, Since the still image reading area and the reading order are determined, the AF tracking method can be supported.

  As described above, in the present embodiment, the first readout order selection unit 151 selects the order of the pixel areas from which the first readout unit 121 reads signal charges, and the second readout order selection unit 152 selects the first readout unit 121. The order in which the second reading unit 122 reads out the pixel data is selected so that the second reading unit 122 reads out the pixel data from the pixel region read out by the. Alternatively, the second readout order selection unit 152 selects the order in which the second readout unit 122 reads out the pixel data, and the first readout order selection unit 151 selects the pixel before the second readout unit 122 reads out the pixel data. The order in which the first readout unit 121 reads out the signal charges is selected so that the signal charges in the included pixel region are read out.

  Then, in accordance with the order of the pixel regions from which the signal charges selected by the first reading order selection unit 151 are read, the reading control unit 150 determines whether the first reading unit 121 is a predetermined pixel among the signal charges stored in the charge storage unit 103. Control is performed so that the signal charges in the area are read out before the signal charges in the other pixel areas, and then the signal charges in the other pixel areas are read out. In addition, in accordance with the order of the pixel regions from which the pixel data selected by the second readout order selection unit 152 is read, the readout control unit 150 performs the second operation within the time interval in which the first readout unit 121 reads the signal charges of the other pixel regions. The reading unit 122 performs control so that pixel data included in a predetermined pixel region is read once or more.

  As a result, the imaging device 1 can acquire camera control image data and live view display image data even during acquisition of a still image. Therefore, when capturing a still image, the camera control image is acquired. The period during which data cannot be acquired can be further shortened, and camera control image data can be acquired quickly. In addition, desired camera control can be performed using the acquired camera control image data.

  Although one embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes design and the like within a scope not departing from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... Lens, 12 ... Imaging part, 13 ... Image processing part, 14 ... AF evaluation value calculating part, 15 ... Imaging control part, 16 ... Camera shake detection unit, 17 ... Camera shake correction unit, 18 ... AF control unit, 19 ... Camera operation unit, 20 ... Camera control unit, 21 ... Display unit, 22 ... Memory card, DESCRIPTION OF SYMBOLS 100 ... Pixel, 101 ... Photoelectric conversion part, 102 ... Transfer transistor, 103 ... Charge storage part, 104 ... FD reset transistor, 105 ... Amplification transistor, 106 ... Selection transistor 107, PD reset transistor, 110, pixel power supply line, 111, FD reset line, 112, transfer line, 113, selection line, 114, vertical signal line, 115,. PD reset line, 1 DESCRIPTION OF SYMBOLS 1 ... 1st reading part, 122 ... 2nd reading part, 131 ... 1st image processing part, 132 ... 2nd image processing part, 133 ... Image recognition part, 134 ... Recognition position predicting unit, 150... Reading control unit, 151... First reading order selecting unit, 152.

Claims (8)

A pixel unit in which a plurality of pixels each having a photoelectric conversion unit that generates a signal charge according to an incident light amount and a charge storage unit that stores a signal charge generated by the photoelectric conversion unit are arranged two-dimensionally; A solid-state imaging device that performs a global shutter operation with the same exposure start timing and exposure period for all pixels in a predetermined area of the unit;
A first signal charge that reads out signal charges in a predetermined pixel region out of signal charges stored in the charge storage unit before signal charges in other pixel regions, and then reads out signal charges in the other pixel regions. A reading unit;
Secondly, pixel data that is signal charges used for control included in the predetermined pixel region is read one or more times within a time interval in which the signal charge of the other pixel region is read by the first signal charge reading unit. A signal charge readout unit;
The order of the pixel regions from which the first signal charge readout unit reads out the signal charges is selected, and the second signal charge readout unit selects the pixel data from among the pixel regions from which the first signal charge readout unit has read out the signal charges. The second signal charge reading unit selects the order of the pixel regions from which the pixel data is read, or the second signal charge reading unit selects the order of the pixel regions from which the pixel data is read, The order of the pixel regions from which the first signal charge readout unit reads out the signal charges is selected so that the second signal charge readout unit reads out the signal charges in the pixel region including the pixel before the pixel data is read out. A selection section;
An imaging apparatus comprising: An autofocus evaluation value calculator that calculates an autofocus parameter based on the pixel data read by the second charge reading unit;
An autofocus control unit that performs autofocus control based on a calculation result of the autofocus evaluation value calculation unit during a period in which the first signal charge readout unit reads out the signal charge;
With
The selection unit selects an order of pixel areas from which the second signal charge reading unit reads out the pixel data so that the second signal charge reading unit reads out the pixel data used for the autofocus control. The imaging apparatus according to claim 1. An image recognition unit that performs image recognition of a subject using the pixel data read by the second charge reading unit;
The selection unit is a pixel region in which the second signal charge reading unit reads out the pixel data next so that the second signal charge reading unit reads out the pixel data including the subject recognized by the image recognition unit. The image pickup apparatus according to claim 2, wherein the order is selected. It has an autofocus position specification part that accepts specification of the position to perform autofocus by the user,
The selection unit reads the pixel data so that the second signal charge reading unit reads the pixel data of the position where the autofocus received by the autofocus position designation unit is performed. The imaging apparatus according to claim 2, wherein the order of the pixel areas is selected. When the first signal charge reading unit finishes reading the signal charges of all the pixel regions, the selection unit converts the pixel data for performing camera control for the next image shooting to the second signal charge. The imaging apparatus according to any one of claims 1 to 4, wherein the second signal charge reading unit selects an order of pixel regions from which the pixel data is read so that the reading unit reads the data. An image processing unit that generates display image data based on the pixel data read by the second charge reading unit;
When the selection unit needs the display data, the selection unit thins out and reads out the rows in the pixel area, but the display image formed by the display image data has the same field angle as the still image field angle. As described above, when the second signal charge reading unit selects the order of the pixel areas from which the pixel data is read, and the autofocus control unit performs the autofocus control, the pixel data used for the autofocus control is selected. 5. The order of pixel areas from which the second signal charge readout unit reads out the pixel data is selected so that the second signal charge readout unit reads out the data. 5. The imaging device described. The image recognition unit performs image recognition of the subject using the pixel data read by the second charge reading unit when a still image was previously captured,
The selection unit is a pixel region in which the second signal charge reading unit reads out the pixel data next so that the second signal charge reading unit reads out the pixel data including the subject recognized by the image recognition unit. The imaging apparatus according to claim 3, wherein the order is selected. The image recognition unit predicts a moving position of a subject using the pixel data read by the second charge reading unit,
The selection unit is a pixel from which the second signal charge reading unit reads out the pixel data so that the second signal charge reading unit reads out the pixel data including the movement position of the subject predicted by the image recognition unit. The imaging apparatus according to claim 3, wherein the order of the areas is selected.

Images