JP2012004819A - Reading control device, reading control method, imaging device, solid state imaging device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a reading control device, a reading control method, an imaging device, a solid state imaging device, and a program, capable of performing an imaging sequence of still images reliably without changing significantly an update speed of displaying a moving image, even during a period when the imaging device is performing an imaging operation.SOLUTION: The reading control device, the reading control method, the imaging device, the solid state imaging device, and the program, comprises: an imaging control part to read out a signal for a still image to generate one still image from a plurality of pixels disposed on the imaging device by dividing into n times (n is an integer of 2 or larger), and also read out a signal for a moving image from pixels during an interval between periods of reading out a signal for a still image by dividing it; and a reading pixel control part to control the number of pixels which are to be read out as a signal for a still image for the first time to the n-th time.

Description

  The present invention relates to a readout control device, a readout control method, an imaging device, a solid-state imaging device, and a program.

  In recent years, an imaging apparatus such as a digital camera, a digital video camera, or an endoscope has a so-called live view function of displaying a moving image on a display screen of an imaging apparatus in order to confirm a subject to be photographed by the imaging apparatus, for example. This function is implemented, and a function for taking a still image while live view is displayed is incorporated in an actual product. Various technical proposals have been made, such as a function for compensating for a frame of a live view display, which is interrupted by taking a still image during live view display, by image processing.

  Moreover, in recent years, the number of pixels of an image sensor mounted on such an image pickup apparatus tends to increase, and the time required to read out all pixel signals tends to increase. Therefore, it is becoming a more important problem that a period during which an image signal for live view cannot be acquired becomes long.

  As one method for solving such a problem, there is a technique of acquiring an image signal for a still image using the vertical blanking period while driving the imaging device in a moving image (live view) mode ( Patent Document 1). In the technology disclosed in Patent Document 1, the acquisition of image signals of a moving image and a still image is processed in a time-sharing manner, and a still image is captured without interrupting the moving image.

  In addition, as another method for solving the above-described problem, in live view display, the image signal from the image sensor is thinned out and read out, and the readout period of one live view image signal is shortened. There is also a technique for displaying a live view without frame (frame) dropping (see Patent Document 2). In the technique disclosed in Patent Document 2, when recording a still image in response to a release operation, the display of a live image is read from all pixels while the live view display is fixed (frozen). I do. The live view display is resumed after the reading of the still image signal is completed. Furthermore, in the technique disclosed in Patent Document 2, during continuous shooting (continuous shooting) of still images, live view display is performed between the first recorded still image and the next recorded still image. I try to let them.

  Many of such current imaging apparatuses not only display live view images on a display unit, but also display live view images with autofocus (autofocus: AF) and automatic exposure control in the imaging apparatus. It is also used for processing such as (AE). Therefore, it is desirable for the imaging apparatus to be able to acquire an image for live view until just before the exposure period for acquiring a still image.

Japanese Patent Laid-Open No. 2005-311572 JP 2003-224760 A

  However, in the technique disclosed in Patent Document 1, the live view display is not interrupted in the middle of acquiring the image signal for the still image, but the vertical blanking period in the moving image (live view) mode is limited. The image signal for the still image is read out little by little. For this reason, there is a problem that it takes a long time to record one still image. Furthermore, since a time lag occurs in the image signal for the still image to be read, when the subject to be recorded as a still image is moving, the still image to be recorded becomes very distorted, There is also the problem of blurring.

  In the technique disclosed in Patent Document 2, the live view display is black (blackout) or the same screen is continuously displayed during the period when the image signal for the still image is acquired. It becomes a state (freeze). In this way, if the update speed of the live view display changes greatly, for example, in a scene where the subject is moving fast, the movement of the subject should be followed while checking the displayed live view image. There is also a problem that the difference between the live view display image and the actually shot still image becomes very large. As a result, the user (photographer) of the imaging apparatus who is photographing while viewing the display screen will feel uncomfortable or uncomfortable.

  The present invention has been made on the basis of the above-described problem recognition, and even when the imaging apparatus is performing an imaging operation, still image capturing is performed without greatly changing the update speed of the moving image display. An object of the present invention is to provide a readout control device, a readout control method, an imaging device, a solid-state imaging device, and a program capable of reliably performing a sequence.

  In order to solve the above-described problem, a readout control device according to an aspect of the present invention divides n times (n is an integer of 2 or more) from a plurality of pixels arranged on an image sensor, and displays one still image. An imaging control unit that reads out a video signal from the pixel during a period during which the still image signal is read out, and the still image signal is read out separately, and the first to nth times A readout pixel control unit that controls the number of pixels to be read out as a still image signal.

  In addition, a solid-state imaging device according to an aspect of the present invention includes a pixel including a photoelectric conversion unit that generates a signal charge according to an incident light amount, and a charge storage unit that stores a signal charge generated by the photoelectric conversion unit. A two-dimensional array of pixels, and a still image for generating one still image by dividing n times (n is an integer of 2 or more) from a plurality of pixels arranged on the pixel portion An image pickup control unit that reads out a moving image signal from the pixel and a first to n-th still image signal during a period in which the image signal is read and the still image signal is read separately. A readout pixel control unit that controls the number of target pixels.

  In addition, the readout control method according to an aspect of the present invention divides n times (n is an integer of 2 or more) from a plurality of pixels arranged on the image sensor, and generates a still image for generating one still image. The image signal is read out, and further, the imaging control step of reading out the moving image signal from the pixel and the first to n-th still image signals are read between the periods in which the still image signals are read out separately. And a readout pixel control step for controlling the number of pixels to be processed.

  A program according to an aspect of the present invention is for a still image for generating a single still image by dividing n times (n is an integer of 2 or more) from a plurality of pixels arranged on an image sensor. An imaging control step of reading out a signal and further reading out a moving image signal from the pixel during a period of reading out the still image signal separately, and a target to be read out as the first to nth still image signals And a readout pixel control step for controlling the number of pixels to be executed.

  Further, an imaging apparatus according to an aspect of the present invention includes a pixel including a photoelectric conversion unit that generates a signal charge according to an incident light amount, and a charge storage unit that stores the signal charge generated by the photoelectric conversion unit. A solid-state imaging device having a plurality of two-dimensionally arranged pixel units, and a global shutter operation in which the exposure start timing and the exposure period of all the pixels of the pixel unit of the solid-state imaging device are the same, and the solid-state imaging A still image signal for generating one still image is read out from a plurality of pixels arranged on the element n times (n is an integer of 2 or more), and the still image signal is further divided. In the interval between the readout periods, the imaging control unit that reads out the moving image signal from the pixel, and the readout pixel that controls the number of pixels to be read out as the first to n-th still image signals It includes a control unit, a.

1 is a block diagram illustrating a configuration of an imaging apparatus according to an embodiment of the present invention. It is the block diagram which showed the more detailed structure of the imaging part in the imaging device of this embodiment. It is the circuit diagram which showed in detail the 1st structural example of the pixel in the pixel part in the imaging part of this embodiment. 6 is a timing chart showing the timing of a global shutter operation according to the first pixel configuration of the imaging apparatus of the present embodiment. It is the figure which showed the example of the row | line | column (line) of the pixel part read at the time of a live view in the 1st pixel structure of the imaging device of this embodiment. It is the figure which showed the example of the 1st drive method for imaging a still image in live view in the 1st pixel structure of the imaging device of this embodiment. It is the figure which showed the example of the 2nd drive method for imaging a still image in live view in the 1st pixel structure of the imaging device of this embodiment. It is the circuit diagram which showed the 2nd structural example of the pixel in the pixel part in the imaging part of this embodiment in detail. 6 is a timing chart showing the timing of a global shutter operation by the second pixel configuration of the imaging apparatus according to the present embodiment. It is the figure which showed the example of the 3rd drive method for imaging a still image in live view in the 2nd pixel structure of the imaging device of this embodiment. It is the figure which showed the example of the 4th drive method for imaging a still image in live view in the 2nd pixel structure of the imaging device of this embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following description includes specific details for illustrative purposes. However, those skilled in the art will understand that even if various modifications are made to the detailed contents described below, the scope of the present invention is not exceeded. Accordingly, the exemplary embodiments of the invention described below are set forth without loss of generality or limitation to the claimed invention. .

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus according to the present embodiment. Each component shown here can be realized in terms of hardware by elements such as a CPU and a memory of a computer, and in terms of software, it can be realized by a computer program. These are shown as functional blocks realized by these linkages. Therefore, those skilled in the art will understand that these functional blocks can be realized in various forms by a combination of hardware and software.

  An imaging apparatus 100 illustrated in FIG. 1 includes a lens 1, an imaging unit 2, an image processing unit 3, a display unit 4, a memory card 5, an imaging / exposure control unit 6, a lens control unit 7, and a camera. An operation unit 8 and a camera control unit 9 are provided. The imaging / exposure control unit 6 includes a readout pixel control unit 61, and the readout pixel control unit 61 further includes a pixel number acquisition unit 611 and a resolution acquisition unit 612. Note that the memory card 5 that is a component of the imaging device 100 illustrated in FIG. 1 is configured to be detachable from the imaging device 100, and may not have a configuration unique to the imaging device 100.

  The lens 1 is controlled by the lens control unit 7 to drive a focus lens provided in the lens 1, a diaphragm mechanism, a shutter mechanism, and the like to form an optical image of a subject on the imaging surface of the imaging unit 2. It is a photographic lens.

  The imaging unit 2 includes a solid-state imaging device that photoelectrically converts an optical image of a subject formed by the lens 1 and outputs an image signal (digital signal) corresponding to the subject light. The imaging unit 2 has a global shutter function that makes at least the exposure start time and the exposure end time of all the pixels the same, and performs a global shutter operation by drive control by the imaging / exposure control unit 6. The imaging unit 2 also has a rolling shutter function that sequentially performs exposure and readout of pixel signals in units of pixels or in units of pixels, for example, and a rolling shutter operation is performed by drive control by the imaging / exposure control unit 6. I do. Then, the imaging unit 2 outputs an image signal obtained by the global shutter operation or the rolling shutter operation to the image processing unit 3.

  The image processing unit 3 performs various digital image processing on the image signal output from the imaging unit 2. The image processing by the image processing unit 3 includes, for example, recording image processing for recording an image signal and display image processing for displaying an image of a subject on the display unit 4. Then, the image signal subjected to the recording image processing is output to the camera control unit 9, and the image signal subjected to the display image processing is output to the display unit 4 and the camera control unit 9.

  The display unit 4 includes a display device such as an LCD (Liquid Crystal Display), for example, and displays an image based on the image signal subjected to image processing for display by the image processing unit 3. The display unit 4 can reproduce and display still images captured by the imaging device 100 and images stored in the memory card 5 and also display a live view that displays a captured range captured by the imaging device 100 in real time. Images can be displayed.

  The memory card 5 is a recording medium for storing still images taken by the imaging device 100. The memory card 5 records still image data on which the camera control unit 9 has performed image processing such as compression processing based on the image signal that has been subjected to image processing for recording by the image processing unit 3. .

  The imaging / exposure control unit 6 drives the imaging unit 2 based on the imaging / exposure command input from the camera control unit 9 and controls imaging and exposure by the imaging unit 2. The readout pixel control unit 61 in the imaging / exposure control unit 6 controls the number of image signals (digital signals) read from the imaging unit 2, for example, in units of pixels or in units of pixels. In addition, the pixel number acquisition unit 611 in the readout pixel control unit 61 acquires information on the number of pixels (reference pixel number) serving as a reference of the live view image set in the imaging apparatus 100. Further, the resolution acquisition unit 612 in the readout pixel control unit 61 acquires information on the resolution of the live view image that can be displayed on the display unit 4. A detailed description of drive control of the imaging unit 2 by the imaging / exposure control unit 6 will be described later.

  The lens control unit 7 controls the aperture and focus position of the lens 1 based on the lens control command input from the camera control unit 9. More specifically, the lens control unit 7 drives the focus lens included in the lens 1 based on the focus control command input from the camera control unit 9, and focuses the subject image formed on the imaging unit 2. Let Further, the lens control unit 7 drives the aperture mechanism provided in the lens 1 based on the exposure control command input from the camera control unit 9, and changes the brightness of the subject image formed on the imaging unit 2. Further, the lens control unit 7 drives a shutter mechanism provided in the lens 1 based on the shutter control command input from the camera control unit 9 to form a subject image on the imaging unit 2.

  The camera operation unit 8 is an operation unit for a user of the imaging apparatus 100 to input various operations to the imaging apparatus 100. Examples of operation members included in the camera operation unit 8 include a power switch for turning on / off the power of the imaging apparatus 100, and a two-stage system for inputting an instruction to capture a still image (subject) to the imaging apparatus 100. There are a release button which is a push button, a still image shooting mode switch for switching the shooting mode of the imaging apparatus 100 between a single shooting mode and a continuous shooting mode. The camera operation unit 8 outputs camera operation information set by these operation members to the camera control unit 9.

  The camera control unit 9 controls the entire imaging apparatus 100. The camera control unit 9 captures an image based on an image signal subjected to recording image processing input from the image processing unit 3, an image signal subjected to display image processing, an operation input from the camera operation unit 8, and the like. Control commands relating to the imaging operation and recording operation in the apparatus 100 are output to the imaging / exposure control unit 6, the lens control unit 7, and the memory card 5.

  Next, an imaging unit provided in the imaging apparatus of the present embodiment will be described. FIG. 2 is a block diagram illustrating a more detailed configuration of the imaging unit 2 in the imaging apparatus 100 of the present embodiment. In FIG. 2, the imaging unit 2 has a global shutter function, for example, a MOS (Metal Oxide Semiconductor) type solid-state imaging device 21, an A / D (analog / digital) conversion unit 22, And a KTC noise removing unit 23. Further, the solid-state imaging device 21 includes a pixel unit 24, a CDS (Correlated Double Sampling) unit 25, a vertical control circuit 26, and a horizontal scanning circuit 27.

  In the pixel portion 24, a plurality of pixels 28 are arranged in a two-dimensional shape in the row direction and the column direction (9 rows and 9 columns in FIG. 2). The configuration of the pixel 28 will be described later.

  The vertical control circuit 26 is a vertical scanning circuit that outputs a control signal for controlling the pixels 28 arranged in the pixel unit 24 in units of rows (lines) for each row of the pixels 28. In addition to the vertical scanning circuit, the vertical control circuit 26 includes a reset control unit for resetting the pixels 28 and a signal readout control unit for reading signals from the pixels 28. A signal output from the pixel 28 in the row selected by the vertical control circuit 26 is output to an output signal line (vertical transfer line VTL in FIG. 3 described later) of the pixel 28 provided for each column.

  The CDS unit 25 performs correlated double sampling processing on the pixel signal transferred through the vertical transfer line VTL when the imaging unit 2 performs a rolling shutter operation by the drive control by the imaging / exposure control unit 6. Do.

  The horizontal scanning circuit 27 takes in the pixel signals for one row that are selected by the vertical control circuit 26 and transferred via the vertical transfer line VTL and the CDS unit 25. Then, the horizontal scanning circuit 27 outputs pixel signals (analog pixel signals) captured in the horizontal order of the pixels 28 to the A / D conversion unit 22 in time series.

  The A / D converter 22 converts the analog pixel signal output from the solid-state imaging device 21 into a digital pixel signal (digital pixel signal). Then, the A / D conversion unit 22 outputs the converted digital image signal to the KTC noise removal unit 23.

  The KTC noise removal unit 23 performs KTC noise removal processing on the digital image signal output from the A / D conversion unit 22 when the imaging unit 2 performs a global shutter operation. The digital image signal subjected to the KTC noise removal process is output to the image processing unit 3 as an image signal corresponding to the subject light output from the imaging unit 2.

<First pixel configuration>
Next, a configuration example of pixels in the imaging unit provided in the imaging apparatus of the present embodiment will be described. FIG. 3 is a circuit diagram illustrating in more detail the first configuration example of the pixel 28 in the pixel unit 24 in the imaging unit 2 of the present embodiment. In FIG. 3, two pixels 28 are shown. The pixel 28 illustrated in FIG. 3 includes a photodiode PD, a charge storage unit FD, a transfer transistor Mtx1, a reset transistor Mtx2, an amplification transistor Ma, a selection transistor Mb, and a reset transistor Mr. In the pixel 28 shown in FIG. 3, the global shutter function is enabled by using the charge storage portion FD as an in-pixel memory.

  The photodiode PD is a photoelectric conversion unit that photoelectrically converts subject light to generate signal charges. The charge accumulation unit FD is a charge accumulation unit (floating diffusion) that temporarily holds signal charges generated in the photodiode PD. The reset transistor Mtx2 resets the signal charge generated in the photodiode PD to the level of the voltage source VDD in response to the PD reset pulse TX2. The transfer transistor Mtx1 transfers the signal charge generated by the photodiode PD to the charge storage unit FD in response to the row transfer pulse TX1. The amplification transistor Ma amplifies and outputs the signal charge held in the charge storage unit FD. The amplification transistor Ma constitutes a source follower amplifier with the voltage source VDD. The selection transistor Mb selects the signal charge amplified by the amplification transistor Ma according to the row selection pulse SEL, and outputs it to the vertical transfer line VTL that is the output signal line of the pixel 28. The reset transistor Mr resets the charge storage unit FD and the input unit of the amplification transistor Ma to the level of the voltage source VDD in response to the FD reset pulse RES.

  In the configuration example of the pixel 28 illustrated in FIG. 3, the charge transfer unit FD is reset by simultaneously applying the row transfer pulse TX1 and the FD reset pulse RES and simultaneously turning on the transfer transistor Mtx1 and the reset transistor Mr. Not only can the photodiode PD be reset at the same time. As described above, the photodiode PD can be reset by the combination of the transfer transistor Mtx1 and the reset transistor Mr, similarly to the reset transistor Mtx2.

<Global shutter operation>
Next, the global shutter operation in the imaging apparatus according to the present embodiment will be described. FIG. 4 is a timing chart showing the timing of the global shutter operation by the first pixel configuration of the imaging apparatus 100 of the present embodiment. The timing of the global shutter operation shown in FIG. 4 is the same as the timing of the global shutter operation when the image capturing apparatus 100 captures a still image. The driving control in the progressive mode is shown in which the pixels 28 are sequentially driven and read.

  The drive of the image pickup unit 2 is controlled by the image pickup / exposure control unit 6, but at the timing of the global shutter operation shown in FIG. 4, the vertical control circuit corresponds to the drive control by the image pickup / exposure control unit 6. 26 shows control pulses (a row selection pulse SEL, an FD reset pulse RES, a row transfer pulse TX1, and a PD reset pulse TX2) output from the pixel unit 24.

  Before a still image is exposed by the global shutter operation, first, a reset signal (reset noise) of the charge storage unit FD is read in a reset data reading period. More specifically, first, an “H” level FD reset pulse RES is applied to the reset transistor Mr of each pixel 28 arranged in the first row of the pixel unit 24 to store the charge in the first row. The unit FD is reset. Further, the “H” level row selection pulse SEL is applied to the selection transistors Mb of the pixels 28 arranged in the first row of the pixel unit 24. As a result, the reset level signal of the charge storage unit FD provided in each pixel 28 in the first row of the pixel unit 24 is used as the reset noise (analog reset noise signal) amplified by the amplification transistor Ma as the vertical transfer line VTL. Is read out.

  Similarly, each pixel 28 in the second row to the last row (the ninth row in the imaging unit 2 shown in FIG. 2) of the pixel unit 24 is driven, and the charge storage unit provided in all the pixels 28. Read FD reset noise. The analog reset noise signal read by the reset noise reading operation is output to the A / D converter 22 via the CDS unit 25 and the horizontal scanning circuit 27, and the digital reset noise is output by the A / D converter 22. (Hereinafter referred to as “reset data”) and then stored in the KTC noise removal unit 23. Note that in the reset noise readout operation by the global shutter operation, the correlated double sampling process by the CDS unit 25 is not performed.

  In the reset data reading period, the row transfer pulse TX1 is at the “L” level, and the PD reset pulse TX2 is at the “H” level. Therefore, the photodiodes PD provided in all the pixels 28 of the pixel unit 24 are reset, and the reset signal charges of the photodiodes PD are not transferred to the charge storage unit FD.

  Subsequently, the still image is exposed by the global shutter operation in the exposure period. More specifically, first, the PD reset pulse TX2 of all the pixels 28 in the pixel unit 24 is set to the “L” level. As a result, the reset transistors Mtx2 included in all the pixels 28 are turned off (the reset of the photodiodes PD is released), and accumulation of signal charges in the photodiodes PD of all the pixels 28 is started. That is, exposure of all the pixels 28 is started simultaneously.

  Thereafter, after a predetermined exposure time has elapsed, the row transfer pulse TX1 of “H” level is applied to all the pixels 28 of the pixel unit 24, and the signal charges accumulated in the photodiode PD are changed to the charge accumulation unit FD. Forward to. That is, the exposure of all the pixels 28 is completed simultaneously. The exposure period from the start to the end of exposure is determined by the camera control unit 9 determining the shutter speed of the imaging device 100 based on the result of the AE calculation calculated by the image processing unit 3 or the camera control unit 9. The exposure time in the imaging unit 2 is controlled according to the shutter speed that has been set. More specifically, an imaging / exposure command is output to the imaging / exposure control unit 6 based on the shutter speed determined by the camera control unit 9. Then, the imaging / exposure control unit 6 drives the imaging unit 2 based on the imaging / exposure command input from the camera control unit 9.

  Subsequently, the exposed pixel signal is read in the pixel data reading period. More specifically, first, the row selection pulse SEL of “H” level is applied to the selection transistor Mb of each pixel 28 arranged in the first row of the pixel unit 24. As a result, the signal charge transferred to the charge accumulation unit FD included in each pixel 28 in the first row of the pixel unit 24 is used as a pixel signal (analog pixel signal) amplified by the amplification transistor Ma. To the vertical transfer line VTL.

  Similarly, each pixel 28 in the second row to the last row (the ninth row in the imaging unit 2 shown in FIG. 2) of the pixel unit 24 is driven, and the charge storage unit provided in all the pixels 28. The signal charges of the FD are sequentially read out to the vertical transfer line VTL in units of rows (lines). The analog pixel signal read by this pixel signal read operation is output to the A / D converter 22 via the CDS unit 25 and the horizontal scanning circuit 27, and the digital pixel signal ( After being converted into a digital pixel signal), it is output to the KTC noise removing unit 23. Then, the KTC noise removing unit 23 performs difference processing between the reset data stored in the reset data reading period and the digital pixel signal read in the pixel data reading period. The digital pixel signal from which the KTC noise has been removed is output to the image processing unit 3 as pixel data output from the imaging unit 2. It should be noted that the correlated double sampling process by the CDS unit 25 is not performed in the pixel signal readout operation by the global shutter operation.

<Live view operation>
Next, a live view operation in the imaging apparatus according to the present embodiment will be described. In the live view operation, the pixel data from the imaging unit 2 is acquired by a rolling shutter operation in which the pixels 28 are sequentially exposed in units of rows and pixel signals are read out in units of rows. FIG. 5 is a diagram illustrating an example of a row (line) of the pixel unit 24 that is read out in the live view in the first pixel configuration of the imaging apparatus 100 of the present embodiment. FIG. 5 shows a case where the number of all rows (lines) of the pixels 28 provided in the pixel unit 24 is 3000 lines. FIG. 5 shows an example in which pixel data for live view is read at a rate of one line for every three lines among all lines. 5 shows an example in which 3N lines (N is an integer of 0 or more) are selected as lines for reading live view pixel data (hereinafter referred to as “LV lines”). As a line, any one of a 3N line, a (3N + 1) line, or a (3N + 2) line can be selected and read.

  Consider a case where the time required to read out pixel data of all lines from the pixel unit 24 having 3000 lines as shown in FIG. 5 by the reading operation of the rolling shutter operation is, for example, 100 ms. In this case, when image processing for display is performed based on the pixel data of all the read lines and live view display (hereinafter referred to as “LV display”) is performed on the display unit 4, the update of the LV display is performed in one second. 10 times. At this time, as shown in FIG. 5, 1000 lines of live view pixel data (hereinafter referred to as “LV data”) is read out by thinning out the lines of the pixel unit 24 at a rate of 1 line per 3 lines. Then, the time required for reading out the pixel data is shortened (in the example of FIG. 5, it is shortened to 1/3), for example, 33.33 ms. This indicates that the LV display is updated 30 times per second, that is, 30 frames per second. Note that, by thinning out the lines of the pixel unit 24, the LV data becomes smaller than the pixel data of all lines. However, since the total number of display elements provided in the display unit 4 is smaller than the total number of pixels 28 provided in the pixel unit 24, the line of the pixel unit 24 is thinned out only for the purpose of display on the display unit 4. Even if LV data is acquired, there is no problem.

<First driving method>
Next, the relationship between the live view operation and the global shutter operation in the imaging apparatus according to the present embodiment will be described. FIG. 6 is a diagram illustrating an example of a first driving method for capturing a still image during live view in the first pixel configuration of the imaging apparatus 100 of the present embodiment.

  In the first driving method, when performing LV display, the lines of the pixel unit 24 are thinned out, for example, LV data is acquired at 30 frames per second, and image processing for display is performed based on the acquired LV data. After that, LV display is performed on the display unit 4. Then, when shooting a still image (subject), the imaging / exposure control unit 6 performs interlaced driving to read out the pixels 28 in the pixel unit 24 for each field, and obtains a plurality of still image pixel data. Get divided into fields. The fields that the imaging / exposure control unit 6 performs interlace driving are, for example, fields (three fields in FIG. 5) obtained by dividing the line of the pixel unit 24 as illustrated in FIG. Further, during the period in which the still image pixel data is acquired, the LV display is updated by acquiring the LV data between the fields for acquiring the still image pixel data.

  In the first driving method, a case will be described in which the imaging unit 2 in which the line of the pixel unit 24 is divided into three fields is driven as shown in FIG. In each field of pixel data for still images, for example, the 3N line shown in FIG. 5 is field_1, the (3N + 1) line is field_2, and the (3N + 2) line is field_3.

  More specifically, as shown in FIG. 6, the LV is pressed until the release button for inputting an instruction to take a still image to the imaging apparatus 100 is pressed (for example, the second step of the two-step press button). Repeat the display. FIG. 6 illustrates an example in which LV data LV_A to LV_F is acquired, image processing for display is performed based on the acquired LV_A to LV_F, and LV display (A to F) is performed on the display unit 4 in the next frame. Yes.

  Then, while the live view is being displayed, the reset data is read out when the release button is instructed to capture a still image. In the first driving method, first, the field_1 is read. Read the reset data. Then, after the reading of the reset data of the field_1 is completed, the reset data is not read, for example, the LV data LV_G is acquired using the field_3, and the display image processing is performed based on the acquired LV_G. The LV display (G) is displayed on the display unit 4. Subsequently, the reset data in the field_2 is read. After the reading of the reset data of the field_2 is finished, the reset data is not read. For example, the LV data LV_H is acquired using the field_3, and the image processing for display is performed based on the acquired LV_H. (H) is displayed on the display unit 4. Finally, the reset data in field_3 is read.

  As described above, in the still image capturing operation, LV data can be acquired once or more before the reading of the reset data of all the lines of the pixel unit 24 is completed. The reset data of each line in the field used for acquiring the LV data is acquired at the end of the reset data reading period. Further, as shown in FIG. 6, when acquiring LV data twice or more during the reset data reading period, the LV data is acquired during the reading of the reset data. By doing so, the frame rate of the live view image displayed is lower than that of the normal LV display. However, in the conventional imaging apparatus, the same live view image is displayed in a plurality of display frames during the reset data reading period. The LV display that has been fixed (freeze) or black (blackout) can be updated by continuing the display over a period of time.

  Thereafter, in the exposure period of the still image, exposure of all the pixels 28 in the pixel unit 24 is started at the same time as in the global shutter operation shown in FIG.

  Subsequently, when the exposure period of the still image ends, the pixel data for the still image is read out. In the first driving method, first, the pixel data in the field_1 is read out. Then, after the reading of the pixel data in the field_1 is finished, the reading of the pixel data is finished. For example, the LV data LV_I is acquired using the field_1, and the image processing for display is performed based on the acquired LV_I. The display (I) is displayed on the display unit 4. Subsequently, the pixel data in the field_2 is read. After the reading of the pixel data in the field_2 is finished, the reading of the pixel data is finished. For example, the LV data LV_J is acquired using the field_1, and the image processing for display is performed based on the acquired LV_J ( J) is displayed on the display unit 4. Finally, the pixel data in the field_3 is read out. In FIG. 6, in order to reduce the period during which the LV display is fixed, that is, to reduce the number of times the LV display is updated, the pixel data in the field_1 is displayed in the next frame after the exposure period of the still image ends. An example in which the LV display (α) subjected to display image processing based on the display is displayed on the display unit 4 is shown.

  As described above, in the still image capturing operation, LV data can be acquired once or more before the reading of the pixel data of all the lines of the pixel unit 24 is completed. The acquisition of LV data is performed using the field from which the pixel data for the still image is read out at the beginning of the pixel data reading period. Further, as shown in FIG. 6, when acquiring LV data twice or more during the pixel data reading period, the LV data is acquired during the reading of the pixel data. By doing so, the frame rate of the live view image displayed is lower than that of the normal LV display. However, in the conventional imaging device, the same live view image is displayed in a plurality of display frames during the pixel data reading period. By continuing the display over a period of time, the LV display that has been fixed (freeze) or black (blackout) can be updated as much as possible.

  Thereafter, when the still image capturing operation ends, LV data is acquired again, and LV display on the display unit 4 based on the acquired LV data is resumed from the next frame.

  As described above, in the first driving method of the present embodiment, a series of operations after a release button is pressed by interlaced driving for each field obtained by dividing pixel data for still images by the number of equally spaced lines. The live view image can be updated until the acquisition of the still image pixel data is completed. However, as can be seen from FIG. 6, in the first driving method, the update speed of the LV display before and after the still image exposure period is slightly reduced. This is because the LV data acquisition period cannot be provided in the reset data readout period in the field_3 and the pixel data readout period in the field_1 before and after the still image exposure period. This is because the interval to be performed is long.

  However, as described above, the live view image is not only displayed on the display unit 4 but also used for processing such as autofocus (AF) and automatic exposure control (AE) in the imaging apparatus 100. It is desirable that LV data can be acquired until just before the exposure period of the still image. However, the exposure period of the still image, the reset data readout period and the pixel data readout period before and after the still image exposure period are necessary periods in the first driving method. In the still image capturing operation, the exposure period of the still image cannot be shortened.

<Second Driving Method>
FIG. 7 is a diagram illustrating an example of a second driving method for capturing a still image during live view in the first pixel configuration of the imaging apparatus 100 of the present embodiment.

  In the second driving method, as in the first driving method shown in FIG. 6, when shooting a still image (subject), the imaging / exposure control unit 6 performs the pixel 28 in the pixel unit 24. Is interlaced and read out for each field, and pixel data for still images is acquired by dividing into a plurality of fields. However, in the second driving method, the number of lines of the pixel unit 24 included in the field in which the imaging / exposure control unit 6 performs interlace driving is different from that in the first driving method shown in FIG. More specifically, in the first driving method shown in FIG. 6, pixel data for a still image is acquired for each field obtained by dividing the pixel unit 24 by the number of lines at equal intervals. In the second driving method, pixel data for a still image is acquired for each field obtained by dividing the pixel unit 24 by the number of lines at unequal intervals. This shortens the reset data readout period and the pixel data readout period before and after the still image exposure period. As a result, the acquisition of LV data can be brought closer to the exposure period of the still image, and the change in the update speed (cycle) of the LV display during the still image capturing operation can be reduced.

  The second driving method is the same as the first driving method shown in FIG. 6 except that the number of lines for dividing the pixel portion 24 in the interlace driving described above is different. Therefore, in the following description, A detailed description of the operation of the second driving method will be omitted, and a method of determining the number of lines for dividing the pixel unit 24 will be described.

  A field_3 (hereinafter referred to as “reset field_3”) in which reset data is read out immediately before the exposure period of the still image, and a field_1 (hereinafter referred to as “pixel field_1” in which pixel data is read out immediately after the exposure period of the still image). )) Is determined by the readout pixel control unit 61. The number of lines of the reset field_3 and the pixel field_1 by the readout pixel control unit 61 is determined by, for example, the display unit 4 acquired by the pixel number acquisition unit 611 and set by the camera operation unit 8 by the user of the imaging device 100. It is determined based on information on the number of pixels (reference pixel number) of the live view image to be displayed. Further, for example, the resolution is determined based on the resolution information of the live view image that can be displayed on the display unit 4 mounted on the imaging apparatus 100 and acquired by the resolution acquisition unit 612. Note that the number of lines in the reset field_3 and the pixel field_1 is at least equal to or more than the number of lines of LV data for obtaining a live view image.

  Further, the readout pixel control unit 61 determines the number of lines in fields other than the reset field_3 and the pixel field_1 based on the determined number of lines in the reset field_3 and the pixel field_1. The number of lines in the fields other than the reset field_3 and the pixel field_1 by the readout pixel control unit 61 is determined by first subtracting the number of lines in the reset field_3 or the pixel field_1 from the total number of lines in the pixel unit 24. Is calculated. Then, the calculated number of lines is divided by the number of fields, and the number of lines at the time of the division is set as the number of lines in each field other than the reset field_3 and the pixel field_1. More specifically, for example, the number of lines in the field_1 and the field_2 in which the reset data is read at a timing other than immediately before the exposure period of the still image is the number of lines in the reset field_3 from the total number of lines in the pixel unit 24. Is the number of lines divided by the number of fields (number of fields = 2 in the second driving method shown in FIG. 7). Further, for example, the number of lines in the field_2 and the field_3 from which pixel data is read at a timing other than immediately after the exposure period of the still image is a line obtained by subtracting the number of lines in the pixel field_1 from the number of all lines in the pixel unit 24. The number of lines is obtained by dividing the number by the number of fields (in the second driving method shown in FIG. 7, the number of fields = 2).

  The second driving method shown in FIG. 7 shows an example in which the number of readout lines in the reset field_3 and the pixel field_1 is about the number of lines of LV data. In the second driving method shown in FIG. 7, since the number of readout lines in the reset field_3 and the pixel field_1 is reduced, the number of lines in other fields is increased. This shortens the LV display update cycle before and after the still image exposure period.

  As described above, in the second driving method of the present embodiment, a series of operations after the release button is pressed by interlaced driving for each field obtained by dividing pixel data for still images by the number of lines at unequal intervals. The update cycle of the LV display until the acquisition of the still image pixel data can be averaged. As a result, the user (photographer) of the imaging apparatus 100 can take a picture without feeling uncomfortable in the LV display when taking a picture while viewing the LV display.

  As long as the number of divisions of the field is not changed, the time required to read out the reset data for generating one still image even in interlaced driving for each field divided by the number of lines at unequal intervals, The total time with the time required for reading out the pixel data is unchanged. Therefore, the imaging sequence of the imaging device 100 is determined in accordance with characteristics such as the number of pixels of the pixel unit 24 provided in the solid-state imaging device 21 in the imaging unit 2 and the frame rate of the image signal output from the imaging unit 2. Accordingly, it is possible to realize an imaging device 100 that is easy to use.

<Second pixel configuration>
Next, a second configuration example of the pixels in the imaging unit provided in the imaging apparatus of the present embodiment will be described. FIG. 8 is a circuit diagram illustrating the second configuration example of the pixel 28 in the pixel unit 24 in the imaging unit 2 of the present embodiment in more detail. In FIG. 8, the pixel 28 in an area for two pixels is shown. The solid-state imaging device 21 shown in FIG. 2 has the configuration of the pixels 28 shown in FIG. 8 for every two pixels adjacent vertically. In the following description, the pixel 28 of the second configuration example is referred to as a “pixel 29”. The imaging device 100 having the pixel configuration of the pixels 29 is referred to as an “imaging device 200”. Note that the configuration of the imaging device 200 and the configuration of the imaging unit 2 according to the present embodiment are the same as those in the block diagram of the imaging device 100 illustrated in FIGS. 1 and 2. Only the pixel 29 shown in FIG. Therefore, the same reference numerals are given to the same components in the imaging apparatus 200 as in the imaging apparatus 100, and detailed description thereof is omitted.

  8 includes photodiodes PD1 and PD2, transfer transistors Mtx1a and Mtx1b, reset transistors Mtx2a and Mtx2b, charge storage units C1 and C2, PD transfer transistors Mtx3 and Mtx4, charge storage unit FD, amplification transistor Ma, It consists of a selection transistor Mb and a reset transistor Mr. In the pixel 29 shown in FIG. 8, the global shutter function is enabled by using the charge storage units C1 and C2 and the charge storage unit FD as in-pixel memory.

  The photodiodes PD1 and PD2 are photoelectric conversion units that photoelectrically convert subject light to generate signal charges. The reset transistors Mtx2a and Mtx2b reset the signal charges generated in the photodiodes PD1 and PD2 to the level of the voltage source VDD, respectively, in response to the PD reset pulse TX2. The transfer transistors Mtx1a and Mtx1b transfer the signal charges generated in the photodiodes PD1 and PD2 to the charge storage units C1 and C2, respectively, according to the row transfer pulse TX1. The charge storage units C1 and C2 are charge storage units that temporarily hold signal charges generated in the photodiodes PD1 and PD2, respectively. The PD transfer transistor Mtx3 transfers the signal charge generated by the photodiode PD1 held in the charge storage unit C1 to the charge storage unit FD in response to the PD transfer pulse TX3. The PD transfer transistor Mtx4 transfers the signal charge generated by the photodiode PD2 held in the charge storage unit C2 to the charge storage unit FD in response to the PD transfer pulse TX4. Since each of the charge storage unit FD, the amplification transistor Ma, the selection transistor Mb, and the reset transistor Mr is the same as the pixel 28 having the first configuration illustrated in FIG. 3, detailed description thereof is omitted.

<Second global shutter operation>
Next, a global shutter operation in the pixel 29 having the second configuration in the imaging apparatus according to the present embodiment will be described. FIG. 9 is a timing chart showing the timing of the global shutter operation by the second pixel configuration of the imaging apparatus 200 of the present embodiment. The timing of the global shutter operation illustrated in FIG. 9 indicates the drive control of the imaging unit 2 performed by the imaging / exposure control unit 6 when the imaging device 200 captures a still image. The solid-state imaging device 21 having the pixel configuration of the pixel 29 shown in FIG. 8 is controlled to perform exposure first and then read out reset data and pixel data when the global shutter operation is started. .

  The driving of the imaging unit 2 is controlled by the imaging / exposure control unit 6, but at the timing of the global shutter operation shown in FIG. 9, the vertical control circuit is in accordance with the drive control by the imaging / exposure control unit 6. 26 shows control pulses (FD reset pulse RES, row transfer pulse TX1, PD reset pulse TX2, PD transfer pulse TX3, PD transfer pulse TX4) output from 26.

  When the release button of the camera operation unit 8 is pressed and the global shutter operation is started, the still image is exposed by the global shutter operation in the exposure period. More specifically, first, the PD reset pulse TX2 of all the pixels 29 in the pixel unit 24 is set to the “L” level. As a result, the reset transistors Mtx2a and Mtx2b included in all the pixels 29 are simultaneously turned off (the reset of the photodiodes PD1 and PD2 is released), and accumulation of signal charges in the photodiodes PD1 and PD2 of all the pixels 29 is started. Is done. That is, exposure of all the pixels 29 is started simultaneously.

  Thereafter, after a predetermined exposure time has elapsed, the row transfer pulse TX1 of “H” level is applied to all the pixels 29 of the pixel unit 24, and the signal charges accumulated in the photodiodes PD1 and PD2 are respectively charged. The data are transferred to the storage units C1 and C2. That is, the exposure of all the pixels 29 is finished simultaneously. Note that the exposure period from the start to the end of exposure is based on the result of the AE calculation calculated by the image processing unit 3 or the camera control unit 9 as in the imaging device 100 including the pixel 28 of the first configuration. The exposure time in the imaging unit 2 is controlled according to the determined shutter speed.

  Subsequently, the reset data and the exposed pixel signal are read in the reset data and pixel data reading period. More specifically, first, an “H” level FD reset pulse RES is applied to the reset transistor Mr of each pixel 29 in the first row and the second row of the pixel unit 24, so that the first row In addition, the common charge storage portion FD is reset in the second row. Further, the row selection pulse SEL of “H” level is applied to the selection transistor Mb. As a result, the reset level signal of the charge storage unit FD provided in common in the pixels 29 in the first row and the second row of the pixel unit 24 is vertically converted as an analog reset noise signal amplified by the amplification transistor Ma. Read to the transfer line VTL.

  Immediately thereafter, the PD transfer pulse TX3 of “H” level is applied to the PD transfer transistor Mtx3 of each pixel 29 in the first row of the pixel unit 24. Thereby, the signal charge of the photodiode PD1 stored in the charge storage unit C1 provided in each pixel 29 in the first row of the pixel unit 24 is transferred to the charge storage unit FD. Further, the “H” level row selection pulse SEL is applied to the selection transistors Mb provided in common to the pixels 29 in the first row and the second row of the pixel unit 24. As a result, the signal charge transferred to the charge storage unit FD included in each pixel 29 in the first row of the pixel unit 24 is vertically converted as an analog pixel signal amplified by the amplification transistor Ma via the selection transistor Mb. Read to the transfer line VTL.

  Thus, in the pixel 29, the analog pixel signal is read out to the vertical transfer line VTL following the analog reset noise signal. Then, the analog pixel signal from which the analog reset noise signal has been subtracted by the CDS unit 25 is output to the A / D conversion unit 22 via the horizontal scanning circuit 27. Therefore, in the imaging unit 2 including the pixel 29 having the pixel configuration illustrated in FIG. 8, the KTC noise removing unit 23 that is a component of the imaging unit 2 illustrated in FIG. 2 is not necessarily a necessary component. Then, the imaging unit 2 including the pixel 29 having the pixel configuration illustrated in FIG. 8 outputs the digital pixel signal converted by the A / D conversion unit 22 to the image processing unit 3 as pixel data output from the imaging unit 2. Output.

  Similarly, each pixel 29 in the odd-numbered row (from the third row to the first row before the last row) of the pixel unit 24 is driven, and the pixel data of all the odd-numbered rows from which the reset noise has been removed is transferred to the image processing unit 3. Output.

  Thereafter, the pixel data of the even-numbered rows (second row to last row) of the pixel unit 24 is output to the image processing unit 3. More specifically, first, an “H” level FD reset pulse RES is applied to the reset transistor Mr of each pixel 29 in the first row and the second row of the pixel unit 24, so that the first row In addition, the common charge storage portion FD is reset in the second row. Further, the row selection pulse SEL of “H” level is applied to the selection transistor Mb. As a result, the reset level signal of the charge storage unit FD provided in common in each pixel 29 in the first row and the second row of the pixel unit 24 is again used as an analog reset noise signal amplified by the amplification transistor Ma. , Read to the vertical transfer line VTL.

  Immediately thereafter, the PD transfer pulse TX4 of “H” level is applied to the PD transfer transistor Mtx4 of each pixel 29 in the second row of the pixel unit 24. Thereby, the signal charge of the photodiode PD2 stored in the charge storage unit C2 provided in each pixel 29 in the second row of the pixel unit 24 is transferred to the charge storage unit FD. Further, the “H” level row selection pulse SEL is applied to the selection transistors Mb provided in common to the pixels 29 in the first row and the second row of the pixel unit 24. As a result, the signal charge transferred to the charge accumulation unit FD included in each pixel 29 in the second row of the pixel unit 24 is used as the second row analog pixel signal amplified by the amplification transistor Ma as the selection transistor Mb. To the vertical transfer line VTL.

  Then, the analog pixel signal in the second row from which the analog reset noise signal has been subtracted by the CDS unit 25 is output to the A / D conversion unit 22 via the horizontal scanning circuit 27. Then, the digital pixel signal of the second row converted by the A / D conversion unit 22 is output to the image processing unit 3 as pixel data of the second row output from the imaging unit 2.

  Similarly, the pixels 29 in the even-numbered rows (second to last rows) of the pixel unit 24 are driven, and all the even-numbered pixel data from which the reset noise has been removed are output to the image processing unit 3.

<Third driving method>
Next, the relationship between the live view operation and the global shutter operation in the imaging apparatus according to the present embodiment will be described. FIG. 10 is a diagram illustrating an example of a third driving method for capturing a still image during live view in the second pixel configuration of the imaging apparatus 200 of the present embodiment.

  In the third driving method, as in the first driving method shown in FIG. 6, the pixel data for still image is divided into a plurality of fields from the pixel unit 24 divided into a plurality of fields with the number of lines at equal intervals. Get every time. Note that the pixel configuration of the pixel 29 is, for example, a configuration in which two pixels vertically adjacent to each other are paired as described above, and therefore the pixel unit 24 has the same configuration as the first driving method illustrated in FIG. The field cannot be divided for each line. However, in the following description, the first driving method shown in FIG. 6 is considered in consideration of facilitating the description and easy comparison with the first driving method shown in FIG. A case where the imaging unit 2 in which the pixel unit 24 is divided into three fields is driven in the same manner as described above will be described. In each divided field, the first field is field_1, the second field is field_2, and the third field is field_3. As described above, the field_1 to the field_3 include reset data and pixel data.

  In the third driving method, the same as the first driving method shown in FIG. 6 is performed between fields for acquiring still image reset data and pixel data (hereinafter referred to as “still image data”). In addition, the LV display is updated by acquiring the LV data.

  More specifically, as shown in FIG. 10, the LV display is repeatedly performed until the release button for inputting an instruction to capture a still image to the imaging apparatus 200 is pressed. FIG. 10 illustrates an example in which LV data LV_A to LV_H are acquired and LV display (A to H) is displayed on the display unit 4 in the next frame, as in the first driving method illustrated in FIG. 6.

  When a still image is instructed by the release button during live view display, first, the photodiodes PD1 of all the pixels 29 in the pixel section 24 are exposed during the still image exposure period. By resetting PD2 and PD2, exposure of all the pixels 29 is started simultaneously. Then, the signal charges accumulated in the photodiodes PD1 and PD2 of all the pixels 29 are simultaneously transferred to the charge accumulating units C1 and C2, respectively, and the exposure of all the pixels 29 is finished simultaneously.

  Subsequently, in the reset data and pixel data reading period, as described above, the reading of the reset data and the reading of the pixel data are first performed on the field_1. This field_1 is a field from which LV data has been acquired in LV display. Then, the LV display (α) subjected to the display image processing based on the pixel data in the still image data read from the field_1 is displayed on the display unit 4 in the immediately subsequent display frame.

  Thereafter, similarly to the first driving method shown in FIG. 6, acquisition of LV data using the field_1 is performed at a rate of once per display frame of a plurality of live views, for example. However, as described above, it is not necessary to acquire LV data at a timing synchronized with the display frame of the live view in the reset data and pixel data reading period. By doing so, the frame rate of the live view image displayed is lower than that of the normal LV display. However, in the conventional imaging device, a plurality of the same live view images are read during the reset data and pixel data reading period. The LV display that has been fixed (freeze) or black (blackout) can be updated by continuing to display over the display frame.

  Subsequently, during the period when the LV data is not acquired, the readout of the still image data of each field (non-live view field) is performed in a predetermined order (for example, as in the first driving method shown in FIG. 6). In this order, the line numbers are in ascending order, odd lines are first, even lines are later, and so on.

  Thereafter, when the still image capturing operation is completed, the LV data is acquired again in the same manner as in the first driving method shown in FIG. 6, and the LV display of the display unit 4 based on the acquired LV data is obtained from the next frame. To resume.

  As described above, in the third driving method of the present embodiment, the second pixel configuration shown in FIG. 8 is performed by interlaced driving for each field in which pixel data for still images is divided by the number of equally spaced lines. In this case, substantially the same effect as that of the first driving method shown in FIG. 6 can be obtained.

<Fourth driving method>
FIG. 11 is a diagram illustrating an example of a fourth driving method for capturing a still image during live view in the second pixel configuration of the imaging apparatus 200 of the present embodiment.

  In the fourth driving method, as in the second driving method shown in FIG. 7, the pixel data for still images is divided from the pixel unit 24 divided into a plurality of fields with the number of lines having unequal intervals. Get for each field. The fourth driving method is the same as the third driving method shown in FIG. 10 except that the number of lines dividing the pixel unit 24 is different. The method for determining the number of lines dividing the pixel unit 24 is also the same. Therefore, in the following description, operations that are different between the third driving method shown in FIG. 10 and the fourth driving method will be described. In the fourth driving method, the still image reset data and the pixel data are collectively referred to as “still image data”.

  The number of lines in the field_1 (hereinafter referred to as “data field_1”) from which the still image data is read out immediately before the still image exposure period is determined by the readout pixel control unit 61. The readout pixel control unit 61 determines the number of lines in the data field_1, for example, the live view image displayed on the display unit 4 acquired by the pixel number acquisition unit 611 and set by the camera operation unit 8 by the user of the imaging device 100. It is determined based on the information on the number of pixels (reference pixel number). Further, for example, the resolution is determined based on the resolution information of the live view image that can be displayed on the display unit 4 mounted on the imaging apparatus 100 and acquired by the resolution acquisition unit 612. The number of lines in the data field_1 is at least equal to or more than the number of lines of LV data for obtaining a live view image.

  Further, the readout pixel control unit 61 determines the number of lines in fields other than the data field_1 based on the determined number of lines in the data field_1. To determine the number of lines in fields other than the data field_1 by the readout pixel control unit 61, first, the number of lines excluding the number of lines in the data field_1 from the number of all lines in the pixel unit 24 is calculated. Then, the calculated number of lines is divided by the number of fields, and the number of lines at the time of the division is set as the number of lines in each field other than the data field_1. More specifically, for example, the number of lines in the field_2 and the field_3 in which the pixel data is read at a timing other than immediately after the exposure period of the still image is the number of lines in the data field_1 from the total number of lines in the pixel unit 24. Is the number of lines divided by the number of fields (number of fields = 2 in the fourth driving method shown in FIG. 11).

  The fourth driving method shown in FIG. 11 shows an example in which the number of read lines in the data field_1 is about the number of lines of LV data. In the fourth driving method shown in FIG. 11, since the number of read lines in the data field_1 is reduced, the number of lines in other fields is increased. Thereby, the update cycle of the LV display after the exposure period of the still image is averaged.

  As described above, in the fourth driving method of the present embodiment, the second pixel shown in FIG. 8 is obtained by interlaced driving for each field obtained by dividing still image pixel data by the number of lines at unequal intervals. Also in the configuration, substantially the same effect as the second driving method shown in FIG. 7 can be obtained. As described above, in the driving method in the imaging apparatus 200 of the present embodiment, the user (photographer) of the imaging apparatus 100 captures an image while visually recognizing the LV display, similarly to the driving method in the imaging apparatus 100 of the present embodiment. When performing, it is possible to take a picture without feeling uncomfortable in the LV display.

  It should be noted that, as long as the number of field divisions is not changed, it is necessary to read reset data and pixel data for generating one still image even in interlaced driving for each field divided by the number of unequal intervals. Time is unchanged. Accordingly, as in the second driving method shown in FIG. 7, the number of pixels of the pixel unit 24 provided in the solid-state imaging device 21 in the imaging unit 2, the frame rate of the image signal output from the imaging unit 2, etc. By determining the imaging sequence of the imaging apparatus 100 in accordance with the characteristics, it is possible to realize the imaging apparatus 100 that is easy to use.

  As described above, according to the embodiment for carrying out the present invention, even when the imaging device is performing the imaging operation, the update speed of the moving image display does not change greatly, and the still image The imaging sequence can be reliably performed.

  In the present embodiment, the readout control device according to an aspect of the present invention corresponds to, for example, a part of the imaging unit 2, the imaging / exposure control unit 6, and the camera control unit 9, and the imaging control unit Corresponds to, for example, the imaging / exposure control unit 6, the vertical control circuit 26, and the horizontal scanning circuit 27.

  In the embodiment for carrying out the present invention, an example in which a still image is divided into three fields and read has been described. However, the number of fields into which a still image is divided is the form for carrying out the present invention. It is not limited to. For example, the number of field divisions can be determined in consideration of the resolution of still images and live views, and also the frame rate of live views.

  In the embodiment for carrying out the present invention, an example in which reset data, pixel data, or still image data during still image capturing operation is read out for each field divided in units of lines has been described. The method of dividing and reading out the data to be read during the still image capturing operation is not limited to the mode for carrying out the present invention. For example, data read during a still image capturing operation can be divided and read in units of groups or pixels.

  In the imaging apparatus, the selection of whether to drive the imaging unit 2 by the first driving method shown in FIG. 6 or the second driving method shown in FIG. The selection of whether to drive the imaging unit 2 by the third driving method shown in FIG. 11 or to drive the imaging unit 2 by the fourth driving method shown in FIG. It is also possible to adopt a configuration in which selection is made according to the mode setting or other factors.

  In addition, the specific configuration of the circuit configuration and the driving method in the present invention is not limited to the mode for carrying out the present invention, and various modifications can be made without departing from the spirit of the present invention. . For example, the number of fields to be divided can be increased. In addition, even when the pixel components and the driving method are changed, for example, the driving method can be changed according to the components and circuit configuration in the imaging unit 2 and the solid-state imaging device 21.

  Further, the arrangement of the pixels in the row direction and the column direction is not limited to the mode for carrying out the present invention, and the number of pixels in the row direction and the column direction in which the pixels are arranged without departing from the gist of the present invention. Can be changed.

  As described above, the description has been given based on the embodiment for carrying out the present invention. However, any combination of each component, each processing process, and the expression of the present invention converted into a computer program product or the like is also an aspect of the present invention. It is effective as Here, the computer program product includes a recording medium (DVD medium, hard disk medium, memory medium, etc.) on which a program code is recorded, a computer on which the program code is recorded, and an Internet system (for example, a server and the like) on which the program code is recorded. A recording medium, apparatus, device or system in which a program code is recorded, such as a system including a client terminal. In this case, each component and each processing process described above are mounted in each module, and a program code including the mounted module is recorded in a computer program product.

  For example, a computer program product according to an aspect of the present invention divides n times (n is an integer of 2 or more) from a plurality of pixels arranged on an image sensor, and generates a still image for generating one still image. An image pickup control module that reads out the image signal, and further reads out the moving image signal from the pixel during the period in which the still image signal is read out separately, and is read out as the first to n-th still image signals. A computer program product in which a program code for causing a computer to execute a readout pixel control module that controls the number of target pixels is recorded.

  Further, for example, a program for realizing processing by each component of the imaging apparatus 100 shown in FIG. 1 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system. By executing, the above-described various processes related to the imaging apparatus 100 may be performed. Here, the “computer system” may include an OS and hardware such as peripheral devices. Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

  Further, the “computer-readable recording medium” refers to a volatile memory (for example, DRAM (Dynamic) in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Random Access Memory)) that holds a program for a certain period of time is also included. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  The embodiment of the present invention has been described above with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes various modifications within the scope of the present invention. It is.

  In addition, a readout control device according to an aspect of the present invention divides n times (n is an integer of 2 or more) from a plurality of pixels arranged on an image sensor, and generates a still image for generating one still image. The image signal is read out, and further, the imaging control means for reading out the moving image signal from the pixel and the first to n-th still image signals are read during the period in which the still image signals are read separately. And a read pixel control means for controlling the number of pixels to be read.

  In addition, a solid-state imaging device according to an aspect of the present invention includes a pixel including a photoelectric conversion unit that generates a signal charge according to an incident light amount, and a charge storage unit that stores a signal charge generated by the photoelectric conversion unit. A plurality of pixels arranged in a two-dimensional manner, and a still image for generating one still image by dividing the plurality of pixels arranged on the pixel means n times (n is an integer of 2 or more) In addition, the image pickup control means for reading out the moving image signal from the pixel and the first through nth still image signals are read out during the period in which the still image signals are read out separately. It may be a solid-state imaging device characterized by comprising reading pixel control means for controlling the number of target pixels.

  In addition, an imaging apparatus according to an aspect of the present invention includes a pixel including a photoelectric conversion unit that generates a signal charge according to an incident light amount, and a charge storage unit that stores a signal charge generated by the photoelectric conversion unit. A solid-state imaging unit having a plurality of two-dimensionally arranged pixel units, and a global shutter operation in which the exposure start timing and the exposure period of all the pixels of the pixel unit of the solid-state imaging unit are the same, and the solid-state imaging A still image signal for generating one still image is read out from a plurality of pixels arranged on the means n times (n is an integer of 2 or more), and the still image signal is further divided. In this period, the imaging control means for reading the moving image signal from the pixels and the number of pixels to be read as the first to n-th still image signals are controlled. A read pixel control unit that may be an imaging device characterized by comprising a.

  The embodiment of the present invention has been described above with reference to the drawings. However, the specific configuration is not limited to this embodiment, and various alternatives and modifications can be made without departing from the spirit of the present invention. The equivalent can also be changed. Accordingly, the scope of the invention should not be determined with reference to the above description, but should be determined by the claims, including the full scope of equivalents. In addition, any of the features described above may be combined with other features regardless of whether or not they are preferable. Also, in the claims, each component is one or more quantities unless explicitly stated otherwise. In addition, the claims should not be construed as including means-plus-function limitations unless explicitly stated in the claims using words such as “means for”.

DESCRIPTION OF SYMBOLS 100 ... Imaging device 1 ... Lens 2 ... Imaging part 3 ... Image processing part 4 ... Display part 5 ... Memory card 6 ... Imaging / exposure control part 7 ... Lens Control unit 8 ... Camera operation unit 9 ... Camera control unit 61 ... Reading pixel control unit 611 ... Pixel number acquisition unit 612 ... Resolution acquisition unit 21 ... Solid-state imaging device 22 ... A / D conversion unit 23 ... KTC noise removal unit 24 ... pixel unit 25 ... CDS unit 26 ... vertical control circuit 27 ... horizontal scanning circuits 28 and 29 ... pixels PD, PD1, PD2... Photodiode FD... Charge storage unit C1, C2... Charge storage unit Ma... Amplification transistor Mb... Selection transistor Mr. Mtx2, Mt 2a, Mtx2b ··· reset transistor Mtx3, Mtx4 ··· PD transfer transistor

Claims (14)

A still image signal for generating one still image is read out from a plurality of pixels arranged on the image sensor n times (n is an integer of 2 or more), and the still image signal is An imaging control unit that reads out a moving image signal from the pixel in a period of reading separately.
A readout pixel control unit that controls the number of pixels to be read out as the first to n-th still image signals;
A reading control apparatus comprising: The readout pixel control unit includes:
The number of pixels to be read out as the still image signal for the sth time (s is an integer from 1 to n) and the still image for the tth time (t is an integer from 1 to n other than s) The number of pixels to be read as a signal for use is set to a different number.
The reading control apparatus according to claim 1. The readout pixel control unit includes:
The number of pixels to be read out as the still image signal in the first round after the still picture exposure period ends, or as the still picture signal in the last round before starting the still picture exposure period The number of pixels to be read is set to be smaller than the number of pixels to be read as the still image signal at other times.
The reading control apparatus according to claim 1. The still image signal is:
It includes a reset signal for still images and an optical signal for still images,
The readout pixel control unit includes:
The number of pixels to be read out as the optical signal for the still image in the first round after the exposure period of the still picture ends, or for the still picture in the last round before starting the still picture exposure period The number of pixels to be read as the reset signal is set to a number smaller than the number of pixels to be read as the still image signal at other times.
4. The read control apparatus according to claim 3, wherein The readout pixel control unit includes:
The number of pixels to be read out as the still image signal in the first round after the still picture exposure period ends, or as the still picture signal in the last round before starting the still picture exposure period By making the number of pixels to be read out smaller than the number of pixels to be read out as the still image signal at other times, the first round after the exposure period of the still picture ends. Or including the still image signal of the pixel that has been excluded from being read in the last round before the exposure period of the still picture is included in the target from which the still picture signal is read in other rounds.
4. The read control apparatus according to claim 3, wherein The readout pixel control unit includes:
A pixel number acquisition unit for acquiring a reference pixel number set as the number of pixels to be output as a moving image;
Further comprising
The number of pixels to be read out as the still image signal in the first round after the still picture exposure period ends, or as the still picture signal in the last round before starting the still picture exposure period The number of pixels to be read is set to a number that is at least the reference pixel number acquired by the pixel number acquisition unit,
4. The read control apparatus according to claim 3, wherein The readout pixel control unit includes:
A resolution acquisition unit that acquires a resolution of a display unit that displays a video generated based on the video signal;
Further comprising
The number of pixels to be read out as the still image signal in the first round after the still picture exposure period ends, or as the still picture signal in the last round before starting the still picture exposure period The number of pixels to be read out is at least equal to or greater than the resolution of the display unit acquired by the resolution acquisition unit,
4. The read control apparatus according to claim 3, wherein The imaging control unit
A plurality of pixels arranged on the image sensor are divided into n groups, and divided into n groups, and the still image signal is read out from the pixels belonging to each group. Furthermore, the moving image is generated from pixels belonging to the group from which the still image signal is read out in the divided n group units during a period in which the still image signal is read out separately in the divided n group units. Read out the signal for
The readout pixel control unit includes:
Controlling the number of pixels to be read as the still image signal in the first to n-th groups to be read;
The reading control apparatus according to claim 1. The imaging control unit
Dividing the plurality of pixels arranged on the image sensor into n groups in units of lines;
The readout pixel control unit includes:
Controlling the number of pixels to be read out as the still image signal in the first to n-th groups in units of lines.
The read control apparatus according to claim 8, wherein: A pixel unit in which a plurality of pixels are arranged in a two-dimensional manner, each including a photoelectric conversion unit that generates a signal charge according to an incident light amount, and a charge storage unit that stores a signal charge generated by the photoelectric conversion unit;
A still image signal for generating one still image is read out n times (n is an integer of 2 or more) from a plurality of pixels arranged on the pixel portion, and the still image signal An imaging control unit that reads out a moving image signal from the pixel during a period of separately reading,
A readout pixel control unit that controls the number of pixels to be read out as the first to n-th still image signals;
Comprising
A solid-state imaging device. The imaging control unit
When exposing the still image,
A global shutter operation is performed so that the exposure start timing and the exposure period of all the pixels are the same.
The reading control apparatus according to claim 1. A still image signal for generating one still image is read out from a plurality of pixels arranged on the image sensor n times (n is an integer of 2 or more), and the still image signal is An imaging control step of reading out a moving image signal from the pixel during a period of reading separately.
A read pixel control step for controlling the number of pixels to be read as the first to n-th still image signals;
A read control method comprising: A still image signal for generating one still image is read out from a plurality of pixels arranged on the image sensor n times (n is an integer of 2 or more), and the still image signal is An imaging control step of reading out a moving image signal from the pixel during a period of reading separately.
A read pixel control step for controlling the number of pixels to be read as the first to n-th still image signals;
A program that causes a computer to execute. Solid-state imaging having a pixel unit in which a plurality of pixels are arranged two-dimensionally, each of which includes a photoelectric conversion unit that generates a signal charge corresponding to the amount of incident light and a charge storage unit that stores the signal charge generated by the photoelectric conversion unit. Elements,
A global shutter operation is performed so that the exposure start timing and exposure period of all the pixels in the pixel portion of the solid-state image sensor are the same, and n times (n is 2) from a plurality of pixels arranged on the solid-state image sensor. Imaging that reads out a still image signal for generating one still image and reads out a moving image signal from the pixels during a period in which the still image signal is read out separately. A control unit;
A readout pixel control unit that controls the number of pixels to be read out as the first to n-th still image signals;
An imaging apparatus comprising:

Images