JP5624804B2 - Read control device, read control method, program, imaging device, and solid-state imaging device - Google Patents

Description

  The present invention relates to a read control device, a read control method, a program, an imaging device, and a solid-state imaging device.

  An imaging device such as a digital camera or a digital video camera is equipped with an imaging device that converts an optical image into an electrical signal. Recently, this imaging device has been changed from a CCD (Charge Coupled Device) to a CMOS (Charge Coupled Device). Complementary Metal Oxide Semiconductor (Complementary Metal Oxide Semiconductor) is shifting its market share.

  A MOS type image pickup device such as a CMOS mounted on the image pickup apparatus sequentially reads out the charges of a large number of pixels arranged in a two-dimensional manner on the image pickup surface. In addition, the exposure end time differs from pixel to pixel (or from line to line), and distortion occurs in the image. Therefore, there is provided a MOS type image pickup device that is configured so that the exposure start time of all the pixels can be made the same and the exposure end time of all the pixels can be made the same (that is, control by a global shutter is possible). Are known. This MOS type image pickup device includes a photoelectric conversion unit such as a photodiode that generates a signal corresponding to the exposure amount, and a signal storage unit that temporarily stores signal charges generated in the photoelectric conversion unit. The transistor includes a transistor that functions as a switch when performing transfer or reset.

  As an example of the pixel configuration of such an image sensor, a configuration in which five transistors are provided in one pixel as shown in FIG. 7 is known. FIG. 7 is a circuit diagram showing a circuit configuration of a conventionally known pixel. In the example shown in the figure, the signal storage unit FD is used as an in-pixel memory to enable control by a global shutter. When this image sensor is used in a digital camera, a technique of driving in the following sequence is known to suppress KTC noise (reset noise) (see, for example, Patent Document 1).

(1) The signal storage unit FD is reset by the transistor Mr, and the reset data is sequentially scanned and read for each line via the amplification transistor Ma and the selection transistor Ms and stored.
(2) The photoelectric conversion units PD of all the pixels are collectively reset by the discharge transistor Mf, and after a predetermined exposure time has elapsed, the pixel data of the photoelectric conversion unit PD is collectively signaled via the transfer transistor Mt. Transfer to the storage unit FD.
(3) The pixel data transferred to the signal storage unit FD is sequentially scanned and read for each line via the amplification transistor Ma and the selection transistor Ms, and the reset data stored in (1) is subtracted ( Take the difference).

JP 2005-65184 A

  However, when the image sensor is driven in the sequence as described above, the live view (image display) cannot be updated during a series of operations for obtaining an image, and the same image is displayed on the display unit. There is a problem that a phenomenon such as being continued, or a display portion blacking out and an image not being displayed occurs.

  The present invention has been made to solve the above-described problem, and a read control apparatus, a read control method, a program, and the like that can update an image for live view during a series of operations for obtaining an image, An object is to provide an imaging device and a solid-state imaging device.

  The readout control device according to an aspect of the present invention reads out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor, A readout unit that reads a moving image signal from a second charge accumulation unit among a plurality of charge accumulation units, and the still image signal from the first charge accumulation unit is divided into n times (n is an integer of 2 or more). A readout control unit that controls to read out the moving image signal from the second charge storage unit at a timing before or after the readout period of the still image signal.

  The readout control device according to an aspect of the present invention reads out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. A readout unit that reads out a moving image signal from a second charge storage unit among the plurality of charge storage units, and the still image signal from the first charge storage unit n times (n is an integer of 2 or more) And a readout control unit that controls to perform exposure for moving images during the period of reading separately.

  According to another aspect of the present invention, there is provided a read control method for reading a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. A readout step of reading out a moving image signal from a second charge storage unit among the plurality of charge storage units, and the still image signal from the first charge storage unit n times (n is an integer of 2 or more) A readout control step of controlling to read out the moving image signal from the second charge storage unit at a timing before or after the readout period of the still image signal.

  Further, the program according to an aspect of the present invention reads out a still image signal from a first charge accumulation unit among a plurality of charge accumulation units provided in each pixel arranged on the imaging element, A readout step of reading out a moving image signal from a second charge storage unit among a plurality of charge storage units, and dividing the still image signal from the first charge storage unit n times (n is an integer of 2 or more) In the reading, the computer is caused to execute a reading control step of controlling the moving image signal to be read from the second charge storage unit at a timing before or after the reading period of the still image signal.

  According to another aspect of the present invention, there is provided a read control method for reading a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. A readout step of reading out a moving image signal from a second charge storage unit among the plurality of charge storage units, and the still image signal from the first charge storage unit n times (n is an integer of 2 or more) And a read control step for controlling to perform exposure for moving images during the period of reading separately.

  Further, the program according to an aspect of the present invention reads out a still image signal from a first charge accumulation unit among a plurality of charge accumulation units provided in each pixel arranged on the imaging element, A readout step of reading out a moving image signal from a second charge storage unit among a plurality of charge storage units, and dividing the still image signal from the first charge storage unit n times (n is an integer of 2 or more) During the readout period, the computer is caused to execute a readout control step for controlling to perform exposure for moving images.

  An imaging device according to an aspect of the present invention includes a pixel unit including a plurality of pixels each including a plurality of charge storage units, and a first charge storage among the plurality of charge storage units provided in the pixels. A still image signal from the first charge storage unit, a readout unit that reads out a video signal from a second charge storage unit among the plurality of charge storage units, and a still image signal from the first charge storage unit. Read control for controlling to read out the moving image signal from the second charge storage unit at a timing before or after the reading period of the still image signal when reading is divided into times (n is an integer of 2 or more). A section.

  An imaging device according to an aspect of the present invention includes a pixel unit including a plurality of pixels each including a plurality of charge storage units, and a first charge storage among the plurality of charge storage units provided in the pixels. A still image signal from the first charge storage unit, a readout unit that reads out a video signal from a second charge storage unit among the plurality of charge storage units, and a still image signal from the first charge storage unit. A reading control unit that controls to perform exposure for moving images during a period of reading divided into times (n is an integer of 2 or more).

  The solid-state imaging device according to an aspect of the present invention includes a pixel unit including a plurality of pixels each including a plurality of charge storage units, and a first charge among the plurality of charge storage units provided in the pixels. While reading the still image signal from the storage unit, the reading unit reads the moving image signal from the second charge storage unit among the plurality of charge storage units, and the still image signal from the first charge storage unit. Read that controls to read out the moving image signal from the second charge storage unit at a timing before or after the reading period of the still image signal when reading it divided into n times (n is an integer of 2 or more) A control unit.

  The solid-state imaging device according to an aspect of the present invention includes a pixel unit including a plurality of pixels each including a plurality of charge storage units, and a first charge among the plurality of charge storage units provided in the pixels. While reading the still image signal from the storage unit, the reading unit reads the moving image signal from the second charge storage unit among the plurality of charge storage units, and the still image signal from the first charge storage unit. a readout control unit that controls to perform exposure for moving images during a period of reading divided into n times (n is an integer of 2 or more).

1 is a block diagram illustrating a configuration of an imaging apparatus according to an embodiment of the present invention. It is the schematic which showed the structure of the imaging part in this embodiment. It is a circuit diagram showing a circuit configuration of a pixel in the present embodiment. 6 is a timing chart showing the operation timing of a global shutter operation of the image sensor in the present embodiment. In this embodiment, it is the schematic which showed the example of the field at the time of dividing a pixel into three fields. 6 is a timing chart showing the operation timing of the global shutter operation of the image sensor when performing live view image capturing during still image capturing in the present embodiment. It is the circuit diagram which showed the circuit structure of the pixel known conventionally.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The contents described below include many specific details for illustration, but it will be understood by those skilled in the art that even if various changes are made to these detailed contents, the scope of the present invention is not exceeded. It can be judged as a matter of course. Therefore, the embodiment of the present invention to be described below does not lose generality and does not limit the claimed invention.

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 10 according to the present embodiment. The imaging device 10 can be mounted on an electronic device such as a digital video camera or an endoscope in addition to a digital camera. In the illustrated example, the imaging apparatus 10 includes a lens 1, an imaging unit 2, an image processing unit 3, a display unit 4, a drive control unit 6, a lens control unit 7, a camera control unit 8, and camera operations. Part 9. Although the memory card 5 is also shown in FIG. 1, the memory card 5 is configured to be detachable from the imaging apparatus, and thus may not have a configuration unique to the imaging apparatus 10. Note that the solid-state imaging device according to the claims corresponds to, for example, the imaging unit 2.

  The lens 1 is a photographic lens for forming an optical image of a subject on an imaging surface of an imaging element (described later) of the imaging unit 2. The imaging unit 2 photoelectrically converts an optical image of a subject formed by the lens 1 into a digital signal and then outputs it as an image signal. The image processing unit 3 performs various digital image processing on the image signal output from the imaging unit 2. The image processing unit 3 includes a first image processing unit 3a that processes an image signal (image data) for recording, and a second image processing unit 3b that processes the image signal for display. The display unit 4 displays an image based on the image signal subjected to image processing for display by the second image processing unit 3b of the image processing unit 3. The display unit 4 can reproduce and display a still image, and can perform live view (LV) display that displays an imaging range in real time.

  The memory card 5 is a recording medium for storing an image signal subjected to image processing for recording by the first image processing unit 3a. The drive control unit 6 controls the operation of the imaging unit 2 based on a command from the camera control unit 8. The lens control unit 7 controls the lens aperture and the focal position based on a command from the camera control unit 8. The camera control unit 8 controls each unit included in the imaging device 10. The camera operation unit 9 is for performing various operation inputs to the imaging device 10. For example, a power switch for turning on and off the imaging device 10, a release button for instructing still image shooting, Examples include a still image shooting mode switch for switching the still image shooting mode between the single shooting mode and the continuous shooting mode.

  Next, the configuration of the imaging unit 2 will be described. FIG. 2 is a schematic diagram illustrating the configuration of the imaging unit 2 in the present embodiment. In the illustrated example, the imaging unit 2 includes an imaging device 21 that is a MOS solid-state imaging device, an AD conversion unit 22, and a noise removal unit 23. Each block shown here can be realized in hardware by an element such as a CPU and a memory of a computer, and can be realized in software by a computer program or the like, but here, functional blocks realized by their cooperation It is described as. Therefore, those skilled in the art can naturally understand that these functional blocks can be realized in various forms by a combination of hardware and software.

  The image pickup device 21 includes a pixel unit 24 including pixels 28, a column processing circuit 25, a vertical control circuit 26, and a horizontal scanning circuit 27. Note that the readout control unit and the exposure control unit according to the claims correspond to, for example, the vertical control circuit 26. A reading unit according to the claims corresponds to the horizontal scanning circuit 27, for example. The readout control device according to the claims corresponds to, for example, a device including the vertical control circuit 26 and the horizontal scanning circuit 27.

  The image sensor 21 can be performed in a global shutter mode in which the charge accumulation operation of the pixels 28 is controlled collectively for all the pixels. Note that a rolling shutter mode in which the charge accumulation operation of the pixels 28 is controlled for each row may be provided.

  In the pixel portion 24, a plurality of pixels 28 are two-dimensionally arranged in the row direction and the column direction. The vertical control circuit 26 applies a signal for controlling the pixel operation in units of rows to the pixels 28 of the pixel unit 24, and includes a vertical scanning circuit, a reset control unit, and a signal readout control unit. . The pixel signal of the pixel 28 in the row that is selected and controlled by the vertical control circuit 26 is output to a vertical signal line ReadBus (see FIG. 3) provided for each column. The column processing circuit 25 processes the pixel signal output to the vertical signal line ReadBus for each column. For example, the column processing circuit 25 performs CDS (Correlated Double) for noise removal when an amplification operation or a rolling shutter operation of the image sensor is performed. (Sampling, correlated double sampling) processing. The horizontal scanning circuit 27 outputs the output of the column processing circuit 25 in time series in the order of horizontal arrangement.

  The AD conversion unit 22 converts an analog pixel signal output from the image sensor 21 into a digital pixel signal. Needless to say, when the column processing circuit 25 includes an AD conversion circuit, the AD conversion circuit 22 is unnecessary. The noise removal unit 23 performs noise removal processing on the digital pixel signal output from the AD conversion unit 22 when the image sensor 21 operates with a global shutter.

  Next, the configuration of the pixel 28 will be described. FIG. 3 is a circuit diagram showing a circuit configuration of the pixel 28 in the present embodiment. The photoelectric conversion unit PD generates signal charges corresponding to the received light. Here, a photodiode is shown as an example of the photoelectric conversion unit PD. The charge transfer units Mtx1 and Mtx2 are configured to be able to transfer the signal charge generated by the photoelectric conversion unit PD to the subsequent charge storage units FD1 and FD2.

  The charge storage units FD1 and FD2 are configured to hold the signal charge generated by the photoelectric conversion unit PD. The amplifiers SF1 and SF2 amplify signals based on the signal charges stored in the charge storage units FD1 and FD2 and read out to the outside. Here, as an example of the amplifiers SF1 and SF2, a source follower circuit using a MOS transistor including a current source connected to ReadBus is shown. The reset units Mr1 and Mr2 are configured to be able to supply a reference voltage to the charge storage units FD1 and FD2. The selection units Mb1 and Mb2 are configured to be able to select each pixel and read a signal to the outside for each pixel or each pixel row. The charge discharging unit Mft can discharge the photoelectric conversion unit PD. For example, a MOS transistor can be used as the charge discharging unit Mft. In this case, a semiconductor region having the same polarity as the signal charge constituting a part of the photoelectric conversion unit PD is used as a source, and a semiconductor region (overflow drain region, OFD region) supplied with a power supply voltage is used as a drain. ing.

  As a feature of the present embodiment, the pixel 28 includes one photoelectric conversion unit PD, one charge discharge unit Mft, two charge transfer units Mtx1 and Mtx2, and two charge storage units FD1 and FD2. Two amplification units SF1, SF2, two selection units Mb1, Mb2, and two reset units Mr1, Mr2 are provided. The vertical control circuit 26 controls the horizontal scanning circuit 27 so as to read still image data from the charge storage unit FD1 in a plurality of times. In addition, the vertical operation circuit 26 controls the horizontal scanning circuit 27 to read moving image data from the charge storage unit FD2.

  With this configuration, after the signal charge generated by exposure of the photoelectric conversion unit PD for the still image is transferred to the charge storage unit FD1, the photoelectric conversion unit PD is used for moving images before the signal is read out from the charge storage unit FD1. Even when exposed to light, the signal charge for still images is not affected. Therefore, it is possible to shoot a moving image during still image shooting. An operation procedure for shooting a moving image during still image shooting will be described later (see FIG. 6).

  In FIG. 3, a circuit that outputs a signal of the photoelectric conversion unit PD, which includes the charge transfer unit Mt1, the charge storage unit FD1, the reset unit Mr1, the amplification unit SF1, and the selection unit Mb1, is an in-pixel circuit. 281. In addition, a circuit that outputs a signal of the photoelectric conversion unit PD, which includes the charge transfer unit Mt2, the charge storage unit FD2, the reset unit Mr2, the amplification unit SF2, and the selection unit Mb2, is used as an in-pixel circuit 282. Note that the first charge storage unit according to the claims corresponds to, for example, the charge storage unit FD1. A second charge storage unit according to the claims corresponds to, for example, the charge storage unit FD2.

  Next, the operation of the imaging unit 2 will be described. The image pickup device 21 included in the image pickup unit 2 can perform a global shutter operation. Hereinafter, the global shutter operation of the image sensor 21 will be described.

  4A, the reset signal (pixel signal) and the optical signal (pixel signal) are sequentially read from the pixel 28 in the first row to the pixel 28 in the n-th row in the reset signal readout period and the optical signal readout period. 6 is a timing chart showing the operation timing of the global shutter operation of the image sensor 21 in the case. The example shown in the figure is an example showing an operation when a signal of the photoelectric conversion unit PD is output using the in-pixel circuit 281. Note that a similar operation can be performed in the in-pixel circuit 282.

  The horizontal axis of the timing chart shown in the figure indicates time. The vertical direction shows a state in which the pixels 28 arranged in the pixel unit 24 are sequentially selected from the first row to the n-th row (final row), and the signals of the pixels are output. As for the timing of signals applied to the signal line TX1 and the signal line FT, only the timing of signals applied simultaneously to the signal line TX1 and the signal line FT of all the pixels 28 in the pixel unit 24 is shown.

  In the reset signal readout period before the optical signal accumulation (exposure) by the global shutter operation, the horizontal scanning circuit 27 reads out the reset signal (reset level) of the charge accumulation unit FD1 under the control of the vertical control circuit 26. . In this period, first, the vertical control circuit 26 applies a reset pulse from the signal line RST1 to the transistor Mr1 of each pixel 28 arranged in the first row of the pixel unit 24, thereby accumulating the charge in the first row. The unit FD1 is reset. Further, the vertical control circuit 26 applies a selection pulse from the signal line SEL1 to the selection transistor Mb1 of each pixel 28 in the first row, and causes the charge accumulation unit FD1 to output a reset signal to the vertical signal line ReadBus. The reset signal is read out and stored in the noise removing unit 23 via the column processing circuit 25, the horizontal scanning circuit 27, and the AD converting unit 22. By performing such an operation from the first row to the n-th row (final row) of the pixel portion 24, the reset signal readout period is completed.

  Next, the vertical control circuit 26 simultaneously resets the photoelectric conversion units PD of all the pixels 28 by simultaneously turning on the charge discharging units Mft of all the pixels 28 via the signal line FT. By simultaneously turning off the discharge unit Mft, exposure (accumulation of signal charge) of the photoelectric conversion unit PD is started. When a predetermined exposure period has elapsed after the start of exposure, the vertical control circuit 26 applies a transfer pulse to the charge transfer units Mtx1 of all the pixels 28 via the signal line TX1 at the same time, thereby The signal charges accumulated in the conversion unit PD are collectively transferred to the charge accumulation unit FD1. That is, exposure of all the pixels 28 is completed at the same time.

  Thereafter, an optical signal readout period is entered, and the vertical control circuit 26 applies a selection pulse from the signal line SEL1 to the selection transistor Mb1 of each pixel 28 in the first row, and transmits light from the charge storage unit FD1 to the vertical signal line ReadBus. A signal (signal level) is output. This optical signal is read out to the noise removal unit 23 via the column processing circuit 25, the horizontal scanning circuit 27, and the AD conversion unit 22. The noise removing unit 23 performs a differential process between the read optical signal of the charge storage unit FD1 and the reset signal of the charge storage unit FD1 stored in the reset signal reading period, and the optical signal from which noise has been removed is obtained. An image signal is output to the image processing unit. By performing the above operation on the pixels 28 from the first row to the n-th row (final row) of the pixel unit 24, the optical signal readout period ends, and the image signal during one global shutter operation is obtained. Is output to the image processing unit 3.

  FIG. 4B is a timing chart showing the timing of the global shutter operation of the image sensor 21 when each signal is read out for each field during the reset signal readout period and the optical signal readout period. The illustrated example shows an example of the operation timing when the pixel 28 is divided into three fields.

  FIG. 5 is a schematic diagram illustrating an example of a field when the pixel 28 is divided into three fields in the present embodiment. In the illustrated example, among the pixels 28 arranged in the pixel unit 24, a pixel group including the pixels 28 in the first row, the fourth row, the seventh row,. 1 field (f-A), the pixel group consisting of the pixels 28 in the 2nd row, 5th row, 8th row,..., (3m-1) row is defined as a second field (f-B). The case where the pixel group consisting of the pixels in the 3rd row, 6th row, 9th row,..., 3m row is the third field (f-C) is shown (m is an integer of 1 or more).

  Hereinafter, the description returns to FIG. The example shown in FIG. 4B is different from the example shown in FIG. 4A in the reset signal readout period and the optical signal readout period, respectively, in the first field (f-A) and the second field (f -B) and the third field (f-C) in this example, the reset signal and the optical signal are read from the pixels 28 included in each field. In other words, the example shown in FIG. 4A and the example shown in FIG. 4B differ only in the order in which the reset signal and the optical signal are read from the pixel 28. As described above, in the global shutter operation, the order of reading the reset signal and the optical signal from the pixels 28 arranged in the pixel unit 24 does not necessarily need to be read in order from the first row to the last row.

  Next, the operation of the imaging device 10 will be described. FIG. 6 is a timing chart showing the operation timing of the global shutter operation of the image sensor 21 when shooting live view images (moving images) during still image shooting in the present embodiment. In the illustrated timing chart, the pixel 28 is divided into three fields of a first field (f-A) to a third field (f-C) as in the example shown in FIG. In the example, the reset signal and the optical signal are read from the pixels 28 included in each field in the order of the field (f-A), the second field (f-B), and the third field (f-C).

  First, a procedure for reading a still image signal will be described. The still image signal includes a still image reset signal and a still image optical signal. In this embodiment, a still image signal is acquired using the in-pixel circuit 281.

  Under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads a reset signal from the in-pixel circuit 281 of the pixel 28 included in the first field (f-A) in the period T2. Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads a reset signal from the in-pixel circuit 281 of the pixel 28 included in the second field (f-B) in the period T5. Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads a reset signal from the in-pixel circuit 281 of the pixel 28 included in the third field (f-C) in the period T8. As a result, a still image reset signal for all the pixels 28 is acquired.

  The period T10 is a still image exposure period, and the vertical control circuit 26 applies a pulse to the signal lines FT of all the pixels 28, simultaneously resets the photoelectric conversion units PD of all the pixels 28, and starts exposure. Then, after a predetermined time has elapsed, the vertical control circuit 26 applies a pulse to the signal line TX1 of all the pixels 28, and the signal charges accumulated in the photoelectric conversion units PD of all the pixels 28 during exposure are simultaneously transmitted to the charge holding unit FD1. And the still image exposure period ends.

  Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads an optical signal from the in-pixel circuit 281 of the pixel 28 included in the first field (f-A) in the period T12. Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads a reset signal from the in-pixel circuit 281 of the pixel 28 included in the second field (f-B) in the period T15. Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads a reset signal from the in-pixel circuit 281 of the pixel 28 included in the third field (f-C) in the period T18. As a result, the still image optical signals of all the pixels 28 are acquired. The still image signal is read in the global shutter operation according to the procedure described above.

  Next, a procedure for reading a moving image signal will be described. The moving image signal includes a moving image reset signal and a moving image optical signal. In this embodiment, a moving image signal is acquired using the in-pixel circuit 282.

  Under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads a still image reset signal or a still image optical signal from the in-pixel circuit 281 of the pixel 28 included in the first field (f-A). , T12, the moving image signal is read from the in-pixel circuit 282 of the pixel 28 included in the first field (f-A). Also, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads out a still image reset signal or a still image optical signal from the in-pixel circuit 281 of the pixel 28 included in the second field (f-B). Before and after the periods T5 and T15, a moving image signal is read from the in-pixel circuit 282 of the pixel 28 included in the second field (f-B). Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads out the still image reset signal or the still image optical signal from the in-pixel circuit 281 of the pixel 28 included in the third field (f-C). Before and after the periods T8 and T18, the moving image signal is read from the in-pixel circuit 282 of the pixel 28 included in the third field (f-C).

  Specifically, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 resets the reset signal from the in-pixel circuit 282 of the pixel 28 included in the first field (f-A) in the period T1 before the period T2. Is read. Subsequently, in the period T2, the vertical control circuit 26 applies a pulse to the signal line FT of the pixel 28 included in the first field (f-A), and the pixel 28 included in the first field (f-A). The photoelectric conversion unit PD is simultaneously reset to start exposure. After a predetermined time has elapsed, the vertical control circuit 26 applies a pulse to the signal line TX2 of the pixel 28 included in the first field (f-A), and the pixel 28 included in the first field (f-A). The signal charges accumulated by the photoelectric conversion unit PD during the exposure are transferred all at once to the charge holding unit FD2 of the in-pixel circuit 282, and the moving image exposure period ends. Subsequently, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads the optical signal from the charge holding portion FD2 of the pixel 28 included in the first field (f-A) in the period T3 after the period T2. I do.

  Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads the reset signal from the in-pixel circuit 282 of the pixel 28 included in the second field (f-B) in the period T4 before the period T5. Do. Subsequently, in the period T5, the vertical control circuit 26 applies a pulse to the signal line FT of the pixel 28 included in the second field (f-B), and the pixel 28 included in the second field (f-B). The photoelectric conversion unit PD is simultaneously reset to start exposure. After a predetermined time elapses, the vertical control circuit 26 applies a pulse to the signal line TX2 of the pixel 28 included in the second field (f-B), and the pixel 28 included in the second field (f-B). The signal charges accumulated by the photoelectric conversion unit PD during the exposure are transferred all at once to the charge holding unit FD2 of the in-pixel circuit 282, and the moving image exposure period ends. Subsequently, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads an optical signal from the charge holding unit FD2 of the pixel 28 included in the second field (f-B) in a period T6 after the period T5. I do.

  Further, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads out the reset signal from the in-pixel circuit 282 of the pixel 28 included in the third field (f-C) in the period T7 before the period T8. Do. Subsequently, in the period T8, the vertical control circuit 26 applies a pulse to the signal line FT of the pixel 28 included in the third field (f-C), and the pixel 28 included in the third field (f-C). The photoelectric conversion unit PD is simultaneously reset to start exposure. After a predetermined time has elapsed, the vertical control circuit 26 applies a pulse to the signal line TX2 of the pixel 28 included in the third field (f-C), and the pixel 28 included in the third field (f-C). The signal charges accumulated by the photoelectric conversion unit PD during the exposure are transferred all at once to the charge holding unit FD2 of the in-pixel circuit 282, and the moving image exposure period ends. Subsequently, under the control of the vertical control circuit 26, the horizontal scanning circuit 27 reads the optical signal from the charge holding unit FD2 of the pixel 28 included in the third field (fC) in the period T9 after the period T8. I do.

  As described above, during the periods T2, T5, and T8 in which the still image reset signal of the moving image signal is read from the in-pixel circuit 281 of the pixel 28 included in the first field (f-A) to the third field (f-C). The moving image signal is read from the in-pixel circuit 282 of the pixel 28 included in the first field (f-A) to the third field (f-C) using the preceding and following periods. Similarly, before and after periods T12, T15, and T18 in which the still image optical signal of the moving image signal is read from the intra-pixel circuit 281 of the pixel 28 included in the first field (f-A) to the third field (f-C). In this period, the moving image signal is read out from the in-pixel circuit 282 of the pixel 28 included in the first field (f-A) to the third field (f-C).

  As described above, in the present embodiment, the reading unit reads the still image signal from the first charge storage unit among the plurality of charge storage units provided in each pixel arranged on the image sensor, The moving image signal is read from the second charge storage unit among the plurality of charge storage units. In addition, when the read control unit reads the still image signal from the first charge storage unit in n times (n is an integer of 2 or more), at a timing before or after the read period of the still image signal. The moving image signal is controlled to be read from the second charge storage unit. Therefore, the image for live view can be updated during a series of operations for obtaining an image.

  In the present embodiment, the pixel 28 includes a charge holding unit FD1 that holds a reset signal and an optical signal for a still image, and a charge holding unit FD2 that holds a reset signal and an optical signal for a moving image. Therefore, before the readout of the reset signal and the optical signal for the still image from the charge holding unit FD1 is completed, the exposure for the moving image of the photoelectric conversion unit PD and the readout of the reset signal and the optical signal for the moving image from the charge holding unit FD2. It can be performed. That is, the moving image reset signal and the optical signal are read before and after reading the still image reset signal and the optical signal, respectively, and the moving image data is read from the same field in time series while the still image data is being read. It becomes possible.

  Therefore, during the series of operations for obtaining a still image by the global shutter method, it becomes possible to obtain a plurality of moving image images by the global shutter method. The image can be updated. Furthermore, since the still image and the moving image can be acquired by the global shutter method, the difference caused by the distortion between the image displayed on the monitor screen using the moving image and the stored still image is eliminated. As a result, the entire camera system can ensure comfortable visibility for the user and photographing of a fast moving subject.

  Further, it is preferable to perform control so that exposure for moving images is performed during a period in which a still image signal is read. Thus, by performing exposure for moving images during the period during which the still image signal is read, the photoelectric conversion unit can be operated efficiently and the frame rate can be improved.

  Further, it is preferable that the read control unit controls so as to share the photoelectric conversion unit that is the transfer source of the still image signal and the moving image signal. Further, it is preferable to perform control so as to read out the still image signal and the moving image signal from the photoelectric conversion unit without overlapping in time series. Accordingly, since the photoelectric conversion unit is shared, the circuit scale can be prevented from increasing, and the layout size can be reduced.

  The read control unit reads a reset signal as a moving image signal from the second charge storage unit at a timing before a period in which the still image signal is read out in a plurality of times, while a plurality of still image signals are read out. It is preferable to perform control so that an optical signal as a moving image signal is read from the second charge storage unit at the timing after the period of reading in divided times. Thereby, noise can be suppressed by generating a moving image from the difference signal between the reset signal and the optical signal.

  The readout control unit reads out the still image signal and the moving image signal for each field, and the readout control unit reads out a specific field as a still image signal during the readout period of the still image signal. In this case, it is preferable to control to read out the video signal for the specific field at the timing before or after the period. As a result, since the still image signal and the moving image signal are read out in the same field, the read control circuit can be simplified and reduced.

  In addition, the read control unit, if the timing before the period for reading the still image signal divided into multiple times corresponds to the period from the end of the still image exposure period to the start of the still image signal read period, It is preferable to perform control so as to read a reset signal as a signal for use. Thereby, since the reset signal for making a difference in the global shutter method is read out before the optical signal, KTC noise can be suppressed.

  In addition, it is preferable that the read control unit performs control so as to read the reset signal and the optical signal as the moving image signal between the periods in which the still image signal is read. In addition, the read control unit is configured to provide a moving image optical signal in a first read cycle (moving image reset signal + moving image exposure period + moving image optical signal) between periods for reading still image signals. And a moving image reset signal in a second reading cycle (moving image reset signal + moving image exposure period + moving image optical signal) subsequent to the first reading cycle. Is preferred. As a result, since the reset signal and the optical signal as the moving image signal are read out during the reading period of the still image signal, both the still image signal and the moving image signal are global shuttered while maintaining the frame rate. It becomes feasible to perform photographing by a method.

  In addition, since both the still image signal and the moving image signal are captured by the global shutter method, the difference due to distortion between the moving image displayed on the monitor screen and the stored still image is eliminated. As a result, the camera system as a whole can ensure comfortable visibility for the user and photographing of a fast-moving subject.

  The readout control device according to an aspect of the present invention reads out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. Reading means for reading out a moving image signal from a second charge storage unit of the plurality of charge storage units, and the still image signal from the first charge storage unit n times (n is an integer of 2 or more) And reading control means for controlling to read the moving image signal from the second charge storage unit at a timing before or after the reading period of the still image signal. It may be a read control device.

  The readout control device according to an aspect of the present invention reads out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. Reading means for reading out a moving image signal from a second charge storage unit of the plurality of charge storage units, and the still image signal from the first charge storage unit n times (n is an integer of 2 or more) And a readout control unit that controls to perform exposure for a moving image during a period of reading separately.

  In addition, the readout control device according to an aspect of the present invention divides a plurality of pixels arranged on the image sensor into a plurality of groups, and outputs a still image signal from the pixels belonging to the group in the divided group unit. Readout means for reading out the moving image signal from the pixel in the interval between reading and further reading out the still image signal, and reading out the moving image reset signal at a timing before the reading period of the still image signal And a readout control unit that controls to read out the moving image optical signal at a timing later than the readout period of the still image signal.

  In addition, the readout control device according to an aspect of the present invention divides a plurality of pixels arranged on the image sensor into a plurality of groups, and outputs a still image signal from the pixels belonging to the group in the divided group unit. Read-out control for reading out the moving image signal from the pixel and reading out the moving image during the reading period of the still image signal during the period of reading and further reading out the still image signal And a reading control device characterized by comprising: means.

  An imaging device according to an aspect of the present invention includes a pixel unit including a plurality of pixels each including a plurality of charge storage units, and a first charge storage among the plurality of charge storage units provided in the pixels. A readout unit that reads out a still image signal from the first charge storage unit while reading out a moving image signal from a second charge storage unit of the plurality of charge storage units, and n outputs the still image signal from the first charge storage unit. Read control for controlling to read out the moving image signal from the second charge storage unit at a timing before or after the reading period of the still image signal when reading is divided into times (n is an integer of 2 or more). An imaging device (or a solid-state imaging device).

  An imaging device according to an aspect of the present invention includes a pixel unit including a plurality of pixels each including a plurality of charge storage units, and a first charge storage among the plurality of charge storage units provided in the pixels. A readout unit that reads out a still image signal from the first charge storage unit while reading out a moving image signal from a second charge storage unit of the plurality of charge storage units, and n outputs the still image signal from the first charge storage unit. Even with an image pickup apparatus (or a solid-state image pickup apparatus) comprising a read control means for controlling to perform exposure for moving images during a period of reading divided into times (n is an integer of 2 or more) Good.

  As described above, the present invention has been described based on the embodiment. However, any combination of each component, each processing process, and the expression of the present invention converted into a computer program product is also effective as an aspect of the present invention. It is. Here, the computer program product includes a recording medium (DVD medium, hard disk medium, memory medium, etc.) on which a program code is recorded, a computer on which the program code is recorded, and an Internet system (for example, a server and the like) on which the program code is recorded. A recording medium, apparatus, device or system in which a program code is incorporated, such as a system including a client terminal. In this case, each component and each processing process described above are mounted in each module, and a program code including the mounted module is recorded in a computer program product.

  A computer program product according to an aspect of the present invention reads a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. , A module for reading a moving image signal from a second charge accumulation unit among the plurality of charge accumulation units, and the still image signal from the first charge accumulation unit n times (n is an integer of 2 or more) And a module for controlling to read out the moving image signal from the second charge storage unit at a timing before or after the reading period of the still image signal when reading separately. It may be a product.

  A computer program product according to an aspect of the present invention reads a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on an image sensor. , A module for reading a moving image signal from a second charge accumulation unit among the plurality of charge accumulation units, and the still image signal from the first charge accumulation unit n times (n is an integer of 2 or more) The computer program product may include a module that controls to perform exposure for moving images during a period of reading separately.

  In addition, all or some of the functions of each unit included in the imaging apparatus 10 according to the present embodiment described above are recorded on a computer-readable recording medium and a program for realizing these functions is recorded on the recording medium. Alternatively, the program may be read by a computer system and executed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention. For example, in the present embodiment, the number of fields is described using three examples. However, the present invention is not limited to this, and the number of fields may be two or more.

  Accordingly, the scope of the invention should not be determined with reference to the above description, but should be determined by the claims, including the full scope of equivalents. Any of the features described in the above description may be combined with other features, whether preferred or not. Also, in the claims, each component is one or more quantities unless explicitly stated otherwise. In addition, the claims should not be construed as including means-plus-function limitations unless explicitly stated in the claims using words such as “means for”.

  DESCRIPTION OF SYMBOLS 1 ... Lens, 2 ... Imaging part, 3 ... Image processing part, 3a ... 1st image processing part, 3b ... 2nd image processing part, 4 ... Display part, 5. ..Memory card, 6 ... drive control unit, 7 ... lens control unit, 8 ... camera control unit, 9 ... camera operation unit, 10 ... imaging device, 21 ... imaging device 22 ... AD converter, 23 ... noise remover, 24 ... pixel unit, 25 ... column processing circuit, 26 ... vertical control circuit, 27 ... horizontal scanning circuit, 28. ..Pixels, 281, 282 ... In-pixel circuits

Claims (21)

While reading out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on the image sensor, a second charge among the plurality of charge storage units A readout unit for reading out a video signal from the storage unit;
When the still image signal is read out from the first charge accumulation unit n times (n is an integer of 2 or more), the second image signal is read at a timing before or after the still image signal read period. A read control unit that controls to read a video signal from the charge storage unit of
A reading control apparatus comprising: The readout control apparatus according to claim 1, wherein the readout control unit controls to perform exposure for reading out a moving image signal during each readout period of the still image signal. The timing before the still image signal readout period is a period adjacent in time series to the still image signal readout period, and is later than the still image signal readout period. The readout control apparatus according to claim 1, wherein the timing of is in a period adjacent to the readout period of the still image signal in time series. The moving image signal includes a moving image reset signal and a moving image optical signal,
The readout control unit reads out the moving image reset signal from the second charge storage unit at a timing before the readout period of the still image signal of each time, while 2. The readout control apparatus according to claim 1, wherein the moving image optical signal is controlled to be read out from the second charge storage unit at a timing after a readout period of the still image signal. The read control unit controls the read unit to read the still image signal for each field at each time, and further, the m-th still image (m is an integer of 1 to n). When the still image signal is read out from the first charge storage portion provided in the pixel in a specific field during the read signal period, the m th still image signal read period 2. The read control device according to claim 1, wherein the moving image signal is controlled to be read from the second charge accumulation unit provided in the pixel of the specific field at a timing before or after. 3. The still image signal includes a still image reset signal and an optical signal,
The moving image signal includes a moving image reset signal and a moving image optical signal,
2. The readout according to claim 1, wherein the readout control unit controls the readout of the moving image reset signal at a timing before a first readout period of the optical signal for the still image. Control device. The timing before the first read-out period of the still image signal is from the end of the exposure period of the still image signal to the start of the first read-out period of the still image signal. It is a period. The reading control apparatus according to claim 6 characterized by things. The readout control apparatus according to claim 1, further comprising: an exposure control unit configured to control the plurality of pixels to be collectively exposed when reading the still image signal and the moving image signal. The exposure control unit performs control so that all the pixels are collectively exposed when the still image signal is read, and fewer pixels than all the pixels are collectively exposed when the moving image signal is read. The read control apparatus according to claim 8. The moving image signal includes a moving image reset signal and a moving image optical signal,
The read control unit controls to read out the moving image reset signal and the moving image optical signal during the reading period of the still image signal divided into n times. 2. The read control device according to 1. The pixel includes a photoelectric conversion unit that generates the still image signal and the moving image signal.
The read control unit transfers the still image signal from the photoelectric conversion unit to the first charge storage unit, and transfers the moving image signal from the photoelectric conversion unit to the second charge storage unit. The read control device according to claim 1, wherein the control is performed so as to be performed in a time-series manner. While reading out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on the image sensor, a second charge among the plurality of charge storage units A readout unit for reading out a video signal from the storage unit;
A read control unit that controls to perform exposure for moving images during a period in which the still image signal is read n times (n is an integer of 2 or more) from the first charge accumulation unit;
A reading control apparatus comprising: The read control unit reads the still image signal from the first charge accumulation unit n times (n is an integer of 2 or more) and reads the moving image from the second charge accumulation unit between the periods. The readout control device according to claim 12, wherein the readout control device controls to read out a signal for use. While reading out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on the image sensor, a second charge among the plurality of charge storage units A reading step of reading out the video signal from the storage unit;
When the still image signal is read out from the first charge accumulation unit n times (n is an integer of 2 or more), the second image signal is read at a timing before or after the still image signal read period. A read control step for controlling to read a video signal from the charge storage unit of
A read control method comprising: While reading out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on the image sensor, a second charge among the plurality of charge storage units A reading step of reading out the video signal from the storage unit;
When the still image signal is read out from the first charge accumulation unit n times (n is an integer of 2 or more), the second image signal is read at a timing before or after the still image signal read period. A read control step for controlling to read a video signal from the charge storage unit of
A program that causes a computer to execute. While reading out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on the image sensor, a second charge among the plurality of charge storage units A reading step of reading out the video signal from the storage unit;
A read control step for controlling to perform exposure for a moving image during a period in which the still image signal is read n times (n is an integer of 2 or more) from the first charge storage unit;
A read control method comprising: While reading out a still image signal from a first charge storage unit among a plurality of charge storage units provided in each pixel arranged on the image sensor, a second charge among the plurality of charge storage units A reading step of reading out the video signal from the storage unit;
A read control step for controlling to perform exposure for a moving image during a period in which the still image signal is read n times (n is an integer of 2 or more) from the first charge storage unit;
A program that causes a computer to execute. A pixel portion having a plurality of pixels each having a plurality of charge storage portions;
A still image signal is read from a first charge storage unit among the plurality of charge storage units provided in the pixel, while a moving image signal is read from a second charge storage unit of the plurality of charge storage units. A reading unit for reading
When the still image signal is read out from the first charge accumulation unit n times (n is an integer of 2 or more), the second image signal is read at a timing before or after the still image signal read period. A read control unit that controls to read a video signal from the charge storage unit of
An imaging apparatus comprising: A pixel portion having a plurality of pixels each having a plurality of charge storage portions;
A still image signal is read from a first charge storage unit among the plurality of charge storage units provided in the pixel, while a moving image signal is read from a second charge storage unit of the plurality of charge storage units. A reading unit for reading
A read control unit that controls to perform exposure for moving images during a period in which the still image signal is read n times (n is an integer of 2 or more) from the first charge accumulation unit;
An imaging apparatus comprising: A pixel portion having a plurality of pixels each having a plurality of charge storage portions;
A still image signal is read from a first charge storage unit among the plurality of charge storage units provided in the pixel, while a moving image signal is read from a second charge storage unit of the plurality of charge storage units. A reading unit for reading
When the still image signal is read out from the first charge accumulation unit n times (n is an integer of 2 or more), the second image signal is read at a timing before or after the still image signal read period. A read control unit that controls to read a video signal from the charge storage unit of
A solid-state imaging device comprising: A pixel portion having a plurality of pixels each having a plurality of charge storage portions;
A still image signal is read from a first charge storage unit among the plurality of charge storage units provided in the pixel, while a moving image signal is read from a second charge storage unit of the plurality of charge storage units. A reading unit for reading
A read control unit that controls to perform exposure for moving images during a period in which the still image signal is read n times (n is an integer of 2 or more) from the first charge accumulation unit;
A solid-state imaging device comprising:

Images