JP4723347B2 - Solid-state imaging device - Google Patents

Description

  The present invention relates to a solid-state imaging device that continuously captures a plurality of images in a continuous shooting mode or a moving image mode.

  Conventionally, the solid-state imaging device is not only capable of capturing still images, but is set to a continuous shooting mode or a moving image mode and can continuously capture a plurality of images. However, in the continuous shooting mode and moving image mode of this device, the object scene image is captured by an image sensor such as a CCD (Charge Coupled Device) without releasing the mechanical shutter. , Smear occurs in the captured image. A solid-state imaging device is required to correct such smear.

For example, in the solid-state imaging device described in Patent Document 1, signal charge lines and smear lines are alternately read out and vertically transferred in a plurality of vertical lines in the imaging device, and thereafter, the signal charge lines are formed by a subtractor. A smear corrected image can be obtained by subtracting an image composed of smear lines from the image for each pixel.
JP 2002-57944 A Japanese Unexamined Patent Publication No. 11-17888

  However, since the solid-state imaging device described in Patent Document 1 reads out signal charge lines and smear lines separately, the vertical resolution may be deteriorated, and the number of vertical lines constituting an image is reduced. False colors may occur in the image.

  It is an object of the present invention to provide a solid-state imaging device that eliminates the disadvantages of the prior art and suppresses smearing and resolution deterioration and continuously captures a plurality of images.

  According to the present invention, the image processing apparatus includes an imaging unit that captures an image of the scene and generates an image frame indicating the scene image, and a signal processing unit that performs signal processing on the image frame. The solid-state imaging device for taking an image includes a frame control means for sequentially instructing the taking of the plurality of image frames. The frame control means takes a normal frame for taking a picture of the object scene image or a smear. The image pickup means selectively picks up a smear frame to be represented, and the image pickup means picks up a normal frame or a smear frame as the image frame according to an instruction of the frame control means, and the signal processing means picks up the smear frame. The normal frame is used for smear correction.

  As described above, according to the solid-state imaging device of the present invention, when continuously capturing a plurality of images, a smear frame is captured at a frame position that does not affect the generated image, and the other normal frames are captured as the smear frame. By using and performing smear correction, it is possible to obtain a good image while suppressing occurrence of smear and deterioration of resolution.

  Further, according to the solid-state imaging device of the present invention, when a normal frame is captured at a predetermined interval, the smear frame is captured at any timing within the interval period, thereby preventing the normal frame from being captured. A smear frame can be obtained.

  Further, according to the solid-state imaging device of the present invention, it is possible to obtain a smear frame without affecting camera shake by making smear frame shooting correspond to the limit time of camera shake correction.

  Further, according to the solid-state imaging device of the present invention, when shooting two or more smear frames, a better and lower noise smear frame is obtained by optimizing or averaging at least two smear frames. be able to.

  Next, an embodiment of a solid-state imaging device according to the present invention will be described in detail with reference to the accompanying drawings.

  As shown in FIG. 1, the solid-state imaging device 10 of the embodiment is controlled by a system control unit 14, a timing generator 16 and a drive unit 18 by operating an operation unit 12, and incident light from an object scene is This is captured by the optical system 20, and this object scene image is captured by the imaging unit 22. The captured image is processed by the preprocessing unit 24 and the analog / digital (A / D) conversion unit 26 to generate a digital image signal. The digital image signal is signal-processed by the signal processing unit 28, and particularly corrected by the smear correction unit 30. Note that portions not directly related to understanding the present invention are not shown and redundant description is avoided.

  In this embodiment, the device 10 operates in any one of a plurality of shooting modes such as a still image mode for normal shooting of still images, a continuous shooting mode for continuously shooting still images, and a moving image mode for shooting movies. And execute shooting. The apparatus 10 captures a plurality of image frames in the continuous shooting mode and the moving image mode, but corrects smears generated in the image by not operating the mechanical shutter 36 in the optical system 20, so that the plurality of image frames are corrected. Among them, in addition to a normal frame in which an object scene image is normally captured, a smear frame representing a smear is photographed, and the normal frame is smear corrected using the smear frame.

  The operation unit 12 is a manual operation device that inputs an operator's instruction, and supplies an operation signal 102 to the system control unit 14 in accordance with an operator's manual operation state, for example, a stroke operation of a shutter button (not shown). It has the function to do. In the following description, each signal is specified by the reference number of the connecting line in which it appears.

  The system control unit 14 is a control function unit that controls and controls the overall operation of the apparatus in response to the operation signal 102 supplied from the operation unit 12, and has a central processing unit (CPU). Configured. In the present embodiment, the system control unit 14 generates control signals 104 and 106 according to the operation signal 102, and supplies the control signals 104 and 106 to the timing generator 16 and the signal processing unit 28, respectively, for control.

  In the present embodiment, the system control unit 14 includes a frame control unit 38 that sequentially determines the shooting of a plurality of image frames when the shooting mode of the apparatus 10 is determined and the continuous shooting mode or the moving image mode is set. The frame control unit 38 selectively instructs shooting of a normal frame or a smear frame, and the system control unit 14 generates control signals 104 and 106 according to the frame shooting instruction in the frame selection control unit 38.

  For example, when instructing a plurality of frame photographing at predetermined intervals, the frame selection control unit 38 instructs smear frame photographing every predetermined number N. That is, the control unit 38 first instructs to take one smear frame, then continuously instructs to take a predetermined number of normal frames, returns to the instruction to take a smear frame again, and repeats these steps. .

  The timing generator 16 includes an oscillator that generates a basic clock (system clock) for operating the apparatus 10, and this basic clock may be supplied to each unit, although not shown in FIG. Further, the timing generator 16 of the present embodiment generates timing signals 108, 110, and 112 based on the control signal 104 supplied from the system control unit 14, and the driving unit 18, the preprocessing unit 24, and the A / D, respectively. It supplies to the conversion part 26 and controls it.

  In the present embodiment, the timing generator 16 generates a timing signal 108 indicating which of a normal frame and a smear frame is to be captured according to the control signal 104.

  The drive unit 18 has a function of driving the optical system 20 and the imaging unit 20. In the present embodiment, the drive unit 18 generates drive signals 114 and 116 according to the timing signal 108 from the timing generator 16, and the optical system 20 and The image is supplied to the imaging unit 22 to control driving.

  For example, the drive unit 18 generates a drive signal 114 including a lens drive signal and an electronic shutter pulse according to the timing signal 108 and supplies the drive signal 114 to the optical system 20 to control the drive of the lens 34 and the mechanical shutter 36. In addition, the drive unit 18 generates a drive signal 116 including a vertical drive signal, a horizontal drive signal, a readout pulse, and the like according to the timing signal 108, and supplies the drive signal 116 to the imaging unit 22 to supply the vertical transfer unit, the horizontal transfer unit, and the transfer gate. Control the drive of each part.

  In the present embodiment, the drive unit 18 outputs an electronic shutter pulse so that the mechanical shutter 36 is opened and closed when the apparatus 10 is in the still image mode, and the mechanical shutter 36 is opened when the apparatus 10 is in the continuous shooting mode or the moving image mode. Generate. Further, the drive unit 18 generates the drive signal 116 by turning on the readout pulse when the timing signal 108 indicates normal frame shooting and turning it off when indicating the smear frame shooting.

  The optical system 20 includes a lens 34 and a mechanical shutter 36, and is a light incident mechanism that captures a desired object scene image and enters the imaging unit 22. The optical system 12 operates in accordance with a drive signal 116 supplied from the drive unit 18, and for example, the mechanical shutter 36 operates in response to an electronic shutter pulse in the drive signal 116. The mechanical shutter 36 of this embodiment opens and closes when the device 10 is in the still image mode, and opens when the device 10 is in the continuous shooting mode or the moving image mode.

  Although not shown, the imaging unit 22 includes an imaging surface and a horizontal transfer path that form one screen of a captured image, and this imaging surface is formed by arranging each photosensitive unit corresponding to a plurality of pixels in the row and column directions. Each column is provided with a vertical transfer path. The imaging unit 22 is controlled by the drive signal 116 and has a function of photoelectrically converting an object scene image formed on the imaging surface into an electric signal 118. In this embodiment, for example, a charge coupled device (Charge) An image sensor such as a coupled device (CCD) may be used.

  In this embodiment, the imaging unit 22 reads the signal charge obtained by photoelectric conversion in each photosensitive unit in accordance with the readout pulse of the drive signal 116 to the vertical transfer path, and the vertical transfer path in accordance with the vertical drive signal of the drive signal 116. The signal charges in the horizontal shift path are transferred to the horizontal transfer path for each row, and the signal charges in each row in the horizontal transfer path 42 are shifted in the horizontal direction in accordance with the horizontal drive signal of the drive signal 116 to generate an analog electric signal. 118 is generated and output. For example, when the readout pulse of the drive signal 116 is on, the imaging unit 22 opens the transfer gate of each photosensitive unit and reads the signal charge to the vertical transfer path to generate an analog electrical signal 118 indicating a normal frame, and In this case, the analog electric signal 118 is generated without reading the signal charge while the transfer gate of each photosensitive portion is cut off.

  The pre-processing unit 22 is controlled by the timing signal 110 from the timing generator 16, and analog electrical signals are generated by a circuit such as a correlated double sampling circuit (CDS) and a gain control amplifier (GCA). Analog signal processing is performed on the signal 116 to generate an analog image signal 120.

  The A / D converter 24 quantizes the signal level of the analog image signal 120 input from the preprocessing unit 22 with a predetermined quantization level, converts the signal level into a digital image signal 122, and outputs the digital image signal 122.

  The signal processing unit 28 performs digital signal processing on the digital image signal 122 supplied from the A / D conversion unit 24 according to the control signal 106 supplied from the system control unit 14, and the digital image after the signal processing is processed. The signal is stored in the memory 32. The signal processing unit 28 may perform digital signal processing such as offset correction, white balance correction, gamma correction, and synchronization processing on the digital image signal 122, for example. Particularly in the present embodiment, the signal processing unit 28 includes a smear correction unit 30, and performs a smear correction process on the digital image signal 122 indicating a normal frame.

  The smear correction unit 30 is instructed to take a smear frame by the control signal 106 supplied from the system control unit 14, and temporarily stores a digital image signal indicating the smear frame in the memory 32. On the other hand, the smear correction unit 30 is instructed to perform normal frame shooting by the control signal 106, and subtracts the smear frame stored in the memory 32 from the digital image signal indicating the normal frame, that is, the signal of each pixel in the normal frame. The smear correction is performed by subtracting the signal level of the corresponding pixel in the smear frame from the level. The smear correction unit 30 stores a digital image signal indicating a normal frame after smear correction in the memory 32.

  Next, an operation related to smear correction processing of the solid-state imaging device 10 in this embodiment will be described with reference to the timing chart of FIG.

  In FIG. 2, the vertical synchronizing signal in the timing signal 108 output from the timing generator 16, the vertical transfer signal in the driving signal 116 output from the driving unit 18, the readout pulse in the driving signal 116 output from the driving unit 18, and the optical system 20. The exposure period during which the imaging unit 22 is exposed is indicated by. Further, FIG. 2 shows data corresponding to the signal charges accumulated in each exposure period, smear correction for this data, and data after smear correction.

  In the present apparatus 10, the shooting mode is the continuous shooting mode or the moving image mode, and shooting of a plurality of frames is sequentially executed, and a smear frame is shot every three frames, that is, one smear frame shooting and two frames are shot. Normal frame shooting is repeated. At this time, in the frame control unit 38, first, shooting of the smear frame is instructed, and the control signals 104 and 106 instructing the smear frame shooting are generated in the system control unit 14 to the timing generator 16 and the signal processing unit 28. Supplied.

  In particular, the timing generator 16 generates a timing signal 108 for instructing smear frame shooting including a vertical synchronization signal in accordance with the control signal 104 and supplies the timing signal 108 to the drive unit 18. Further, the drive unit 18 generates a drive signal 114 according to the vertical synchronization signal in the timing signal 108 and supplies the drive signal 114 to the optical system 20, and includes a vertical transfer signal and a read pulse indicating OFF in response to the timing signal 108. A signal 116 is generated and supplied to the imaging unit 22.

  At this time, in the imaging unit 22, the imaging surface is exposed during the exposure period 162 in accordance with the vertical synchronization signal and the vertical transfer signal. After that, even when the exposure is finished, at time t152, the readout pulse is turned off and the signal charge of each pixel is not read out, and the analog electrical signal 118 indicating the smear frame 172 corresponding to the exposure period 162 is generated.

  The analog electrical signal 118 indicating the smear frame 172 is processed by the preprocessing unit 24 and the A / D conversion unit 26 to generate a digital image signal 122. The digital image signal 122 indicating the smear frame 172 is converted into the signal processing unit 28. And temporarily stored in the memory 32 in response to the control signal 106 instructing smear frame shooting.

  Next, the frame control unit 38 is instructed to shoot a normal frame, and the system control unit 14 generates control signals 104 and 106 instructing the normal frame shooting and is supplied to the timing generator 16 and the signal processing unit 28. The In the following, differences between normal frame shooting and smear frame shooting will be described.

  In the timing generator 16, a timing signal 108 for instructing normal frame shooting is generated according to the control signal 104 and supplied to the drive unit 18. Further, in the drive unit 18, a drive signal 116 including a readout pulse indicating ON is generated according to the timing signal 108 and supplied to the imaging unit 22.

  At this time, in the imaging unit 22, the imaging surface is exposed during the exposure period 164. Thereafter, when the exposure ends, the signal charge of each pixel is read in response to the read pulse indicating ON at time t154, and an analog electrical signal 118 indicating the first normal frame 174 corresponding to the exposure period 164 is generated. Is done.

  The analog electrical signal 118 indicating the normal frame 174 is processed by the preprocessing unit 24 and the A / D conversion unit 26 to generate a digital image signal 122, and the digital image signal 122 indicating the normal frame 174 is converted into the signal processing unit 28. To be supplied.

  In the signal processing unit 28, the smear frame 172 stored in the memory 32 is subtracted from the normal frame 174 in the smear correction unit 30 in accordance with the control signal 106 instructing normal frame shooting, and as a result, the corrected data 182 is obtained. Is generated and stored in the memory 32.

  Next, in the frame control unit 38, normal frame shooting is similarly instructed, and normal frame shooting in the present apparatus 10 is repeated. In the imaging unit 22, the second normal frame corresponding to the exposure period 166 at time t156. 176 is generated, and the smear correction unit 30 subtracts the smear frame 172 from the normal frame 176, and as a result, corrected data 184 is generated and stored in the memory 32.

  Next, the frame control unit 38 is similarly instructed to perform smear frame shooting, and the apparatus 10 shifts to shooting of a new smear frame, and the above operation is repeated.

  As described above, in the continuous shooting mode and the moving image mode shooting, the present apparatus 10 of the present embodiment does not indicate all of the plurality of frames to be continuously shot to the user, and does not indicate the plurality of frames to be continuously shot. Of these, a smear frame is photographed every predetermined number N, and the subsequent normal frame can be smear corrected using this smear frame.

  In the present embodiment, the signal processing unit 28 stores the captured normal frame and smear frame in the memory 32, and then reads out the normal frame temporally before and after the smear frame from the memory 32 and performs interpolation processing. The result may be generated as a normal frame at the smear frame position.

  In this embodiment, the frame selection control unit 38 instructs smear frame shooting every predetermined number N in a plurality of frame shooting, but may instruct smear frame shooting every predetermined instruction interval. For example, smear frame shooting may be instructed at each instruction interval that is an instruction interval equal to or less than 1/30 second, which is the limit time for camera shake correction, and is synchronized with a predetermined interval in a plurality of frame imaging.

  In this embodiment, the signal processing unit 28 performs smear correction on the normal frame using the smear frame obtained temporally forward from the normal frame, but using the smear frame obtained by capturing the normal frame thereafter. Smear correction may be performed. At this time, the signal processing unit 28 first stores and stores the captured normal frame in the memory 32, and then captures the smear frame. Here, a normal frame is read from the memory 32, and this normal frame is subjected to smear correction using the latest smear frame. Therefore, the signal processing unit 28 can correct the smear using the smear frame that is closest in time regardless of whether the normal frame is forward or backward.

  In addition, the signal processing unit 28 captures the normal frame and the smear frame and stores them in the image memory 32. After capturing all of the plurality of frames, the signal processing unit 28 reads out the normal frame and the smear frame from the image memory 32. It may be corrected.

  As another embodiment, the frame control unit 38 in the solid-state imaging device 10 instructs normal frame shooting at predetermined intervals. For example, when an interval period between two consecutive normal frames is referred to as an interval period, there is an interval period of N−1 for photographing of N normal frames. Particularly in this embodiment, the frame control unit 38 instructs one smear frame shooting in any one of a plurality of interval periods. The signal processing unit 28 of this embodiment performs smear correction on all normal frames using the single smear frame.

  Next, an operation related to smear correction processing of the solid-state imaging device 10 in this embodiment will be described with reference to the timing chart of FIG.

  In the present apparatus 10, the shooting mode is the continuous shooting mode or the moving image mode, and shooting of a plurality of frames is sequentially performed, and shooting of a smear frame is performed in an interval period that is almost in the middle of shooting of a plurality of normal frames. To do. In FIG. 3, the smear frame is imaged at time t210 in the second interval period in contrast to the imaging of four normal frames performed at equal intervals at times t202, t204, t206, and t208.

  First, the frame control unit 38 of this embodiment is instructed to capture a normal frame, and the apparatus 10 captures the first normal frame at time t202 as in the embodiment shown in FIG. The first normal frame is stored in the memory 32.

  Next, in the present apparatus 10, the second normal frame is photographed and stored in the memory 32 at time t <b> 204 in the same manner as the first normal frame.

  After this time t204 and before time t206, the present apparatus 10 captures a smear frame at time t210 and stores it in the memory 32 in the same manner as the embodiment shown in FIG.

  Here, in the signal processing unit 28, the first normal frame is read from the memory 32, subjected to smear correction using the smear frame taken at time t210, and stored in the memory 32 again. Similarly, the second normal frame is also smear corrected and stored in the memory 32.

  Next, in the present apparatus 10, a third normal frame is captured at time t206, smear corrected using the smear frame captured at time t210, and stored in the memory 32. Further, at time t208, the fourth normal frame is photographed, similarly subjected to smear correction, and stored in the memory 32.

  In this way, in the present apparatus 10 of the present embodiment, shooting in the continuous shooting mode and the moving image mode ends.

  As another embodiment, the frame control unit 38 in the solid-state imaging device 10 instructs normal frame shooting at every predetermined interval, and further instructs smear frame shooting every predetermined number of interval periods. The signal processing unit 28 of this embodiment corrects smear using a smear frame obtained by capturing a normal frame thereafter.

  Next, an operation related to smear correction processing of the solid-state imaging device 10 in this embodiment will be described with reference to the timing chart of FIG.

  In the present apparatus 10, the shooting mode is the continuous shooting mode or the moving image mode, and shooting of a plurality of frames is sequentially executed. In FIG. 4, four normal images are performed at equal intervals at times t302, t304, t306, and t308. With respect to frame shooting, smear frames are shot at time t310 and time t312 every two interval periods.

  First, in the frame control unit 38 of this embodiment, normal frame shooting is instructed, and in this apparatus 10, the first normal frame is shot at time t302 in the same manner as in the embodiment shown in FIG. In addition, the second normal frame is photographed and stored in the memory 32 at time t304.

  After this time t304 and before time t306, in the present apparatus 10, a smear frame is captured and stored in the memory 32 at time t310, as in the embodiment shown in FIG.

  Here, in the signal processing unit 28, the first normal frame is read from the memory 32, subjected to smear correction using the smear frame taken at time t310, and stored in the memory 32 again. Similarly, the second normal frame is also smear corrected and stored in the memory 32.

  Next, in the present apparatus 10, the third normal frame is photographed and stored in the memory 32 at time t306, and further, the fourth normal frame is photographed and stored in the memory 32 at time t308.

  After this time t308, the device 10 captures a smear frame at time t312 and stores it in the memory 32 in the same manner as described above.

  Here, in the signal processing unit 28, the third normal frame is read from the memory 32, subjected to smear correction using the smear frame taken at time t312, and stored in the memory 32 again. Similarly, the fourth normal frame is also smear corrected and stored in the memory 32.

  In this way, in the present apparatus 10 of the present embodiment, shooting in the continuous shooting mode and the moving image mode ends.

  Further, in this embodiment, the frame selection control unit 38 instructs smear frame shooting every predetermined number of interval periods in a plurality of frame shootings, but also instructs smear frame shooting every predetermined instruction interval. For example, smear frame imaging may be instructed at each instruction interval that is an instruction interval of 1/30 seconds or less, which is the limit time for camera shake correction, and is synchronized with a plurality of interval periods.

  As another embodiment, when imaging two or more smear frames, the solid-state imaging device 10 performs smear processing on all normal frames using a smear frame obtained by averaging all these smear frames in the signal processing unit 28. To do.

  Next, the operation concerning the smear correction process of the solid-state imaging device 10 in this embodiment will be described with reference to the timing chart of FIG.

  In the present apparatus 10, the shooting mode is the continuous shooting mode or the moving image mode, and shooting of a plurality of frames is sequentially performed, and a smear frame is shot every three frames. In FIG. 5, a smear frame is photographed at time t522, a normal frame is photographed at times t502 and t504, and these are repeated to perform smear frame photography at time t524 and normal frame photography at times t506 and t508, and at time t526. Smear frame shooting and normal frame shooting at times t510 and t512 are performed.

  In the signal processing unit 28 of the present embodiment, smear frames taken at times t522, t524, and t526 are stored and stored in the memory 32, and read from the memory 32 when the last smear frame is confirmed to be taken. And averaged.

  In the signal processing unit 28, the normal frames taken at times t502, t504, t506, t508, t510, and t512 are smear corrected using the averaged smear frame and stored in the memory 32.

  As another example, when imaging two or more smear frames, the solid-state imaging device 10 uses a smear frame in which two smear frames are optimized, and smears a normal frame between the two smear frames.

  In this embodiment, for example, as shown in FIG. 6, the apparatus 10 takes five normal frames 402, 404, 406, 408, and 410, and smear frame 412 in front of them and smear frame in the rear. Shoot 414.

  In addition, the device 10 of this embodiment captures the smear frame 412 at time t432 and captures the smear frame 434 at time t434. That is, in the present apparatus 10, smear frame shooting is performed every period 426 from time t432 to time t434.

  Particularly in this embodiment, the signal processing unit 28 stores and holds in the memory 32 coefficients 432 and 434 that change over time during the period 426. As shown in FIG. 6, the coefficient 432 is a right-slope coefficient relating to the front smear frame, and the coefficient 434 is a right-shoulder coefficient relating to the rear smear frame.

  As shown in FIG. 7, the signal processing unit 28 multiplies the front smear frame 412 and the coefficient 432 by the multiplier 442, and multiplies the rear smear frame 414 and the coefficient 434 by the multiplier 444. The addition is performed by the adder 446 to generate an optimized smear frame. Further, the signal processing unit 28 performs smear correction by subtracting the optimized smear frame that is the addition result of the adder 446 from the normal frame 402, 404, 406, 408 or 410 by the subtractor 448, and the result Then, a frame after smear correction is generated.

  As another example, when the solid-state imaging device 10 performs shooting by selecting one of a plurality of sensitivity modes such as ISO sensitivity, the above various implementations are performed only when the selection results in high sensitivity. Perform smear correction by example.

  Next, the operation relating to the sensitivity mode determination of the solid-state imaging device 10 in this embodiment will be described with reference to the flowchart of FIG.

  First, in the present apparatus 10, one of a plurality of sensitivity modes is selected and shooting is performed. Here, shooting is performed in the continuous shooting mode or the moving image mode as the shooting mode (S602).

  Next, in the frame control unit 38 in this embodiment, for example, the sensitivity mode of the device 10 is determined, and as a result, it is determined whether or not the sensitivity is high. For example, whether or not the ISO sensitivity is 1600 or more. Is determined (S604).

  If the result of determination in step S604 is high sensitivity, the process proceeds to step S606, and otherwise, the process proceeds to step S608.

  In step S606, the frame control unit 38 is controlled to selectively instruct shooting of the normal frame or the smear frame, and the smear correction according to the various embodiments described above is performed. On the other hand, in step S608, the smear frame is performed. A plurality of frames are all captured as normal frames without shooting, and shooting in continuous shooting mode or moving image mode is performed.

It is a block diagram which shows one Example of the solid-state imaging device which concerns on this invention. It is a timing chart which shows the operation | movement procedure of the solid-state imaging device of the Example shown in FIG. It is a timing chart which shows the operation | movement procedure of the other Example of the solid-state imaging device concerning this invention. It is a timing chart which shows the operation | movement procedure of the other Example of the solid-state imaging device concerning this invention. It is a timing chart which shows the operation | movement procedure of the other Example of the solid-state imaging device concerning this invention. It is a figure which shows schematically the smear correction process in the solid-state imaging device of the Example shown in FIG. It is a timing chart which shows the operation | movement procedure of the other Example of the solid-state imaging device concerning this invention. It is a flowchart which shows the operation | movement procedure of the other Example of the solid-state imaging device concerning this invention.

Explanation of symbols

10 Solid-state imaging device
12 Operation unit
14 System controller
16 Timing generator
18 Drive unit
20 Optical system
22 Imaging unit
24 Pretreatment section
26 A / D converter
28 Signal processor
30 Smear correction part
32 memory
34 Lens
36 Mechanical shutter
38 Frame controller

Claims (12)

Imaging means for imaging the object scene and generating an image frame showing the object scene image;
Signal processing means for signal processing the image frame,
In a solid-state imaging device that continuously captures a plurality of the image frames, the device includes a frame control unit that sequentially instructs capturing of the plurality of image frames,
The frame control means selectively instructs shooting of a normal frame for normally capturing the object scene image, or shooting of a smear frame representing smear,
Instructing the photographing of the plurality of image frames at predetermined intervals,
At this time, in the plurality of image frames, an instruction interval equal to or less than a camera shake correction limit time is instructed to capture the smear frame at each instruction interval synchronized with the predetermined interval, and the other image frames are used as the other image frames. Instructs normal frame shooting,
The imaging means captures a normal frame or a smear frame as the image frame in accordance with an instruction from the frame control means,
The solid-state imaging device, wherein the signal processing means performs smear correction on the normal frame using the smear frame. Imaging means for imaging the object scene and generating an image frame showing the object scene image;
Signal processing means for signal processing the image frame,
In a solid-state imaging device that continuously captures a plurality of the image frames, the device includes a frame control unit that sequentially instructs capturing of the plurality of image frames,
The frame control means selectively instructs shooting of a normal frame that normally captures the object scene image, or shooting of a smear frame that represents smear,
Instructing the shooting of the normal frame at predetermined intervals,
At this time, the interval between two consecutive normal frames is set as an interval period, the instruction interval is equal to or less than the time limit for camera shake correction, and the shooting of the smear frame is instructed at each instruction interval synchronized with the interval period. Instructing the shooting of the normal frame as an image frame,
The imaging means captures a normal frame or a smear frame as the image frame in accordance with an instruction from the frame control means,
The solid-state imaging device, wherein the signal processing unit performs smear correction on the normal frame using the smear frame. 3. The solid-state imaging device according to claim 1 , wherein the signal processing unit stores the smear frame, and corrects the normal frame by using a smear frame obtained in front of the frame in time. A solid-state imaging device. 3. The solid-state imaging device according to claim 1 , wherein the signal processing unit stores the smear frame, and corrects the normal frame using a smear frame temporally closest to the frame. A solid-state imaging device. 3. The solid-state imaging device according to claim 1 , wherein the signal processing unit stores the normal frame and the smear frame, and interpolates a normal frame that is temporally before and after the predetermined smear frame. A solid-state imaging device generated as a normal frame at the position of the predetermined smear frame. 3. The solid-state imaging device according to claim 2 , wherein the signal processing unit stores the predetermined normal frame, obtains the predetermined smear frame later in time from the frame, and obtains the predetermined normal frame. , And smear correction is performed using the predetermined smear frame. Imaging means for imaging the object scene and generating an image frame showing the object scene image;
Signal processing means for signal processing the image frame,
In a solid-state imaging device that continuously captures a plurality of the image frames, the device includes a frame control unit that sequentially instructs capturing of the plurality of image frames,
The frame control means selectively instructs shooting of a normal frame that normally captures the object scene image, or shooting of a smear frame that represents smear,
Instruct to shoot at least two or more smear frames;
The imaging means captures a normal frame or a smear frame as the image frame in accordance with an instruction from the frame control means.
Taking at least two or more smear frames as the image frames,
The signal processing means performs smear correction on the normal frame using the smear frame,
A solid-state imaging device, wherein the at least two smear frames are averaged to obtain a fourth smear frame, and the normal frame is subjected to smear correction using the fourth smear frame. Imaging means for imaging the object scene and generating an image frame showing the object scene image;
Signal processing means for signal processing the image frame,
In a solid-state imaging device that continuously captures a plurality of the image frames, the device includes a frame control unit that sequentially instructs capturing of the plurality of image frames,
The frame control means selectively instructs shooting of a normal frame that normally captures the object scene image, or shooting of a smear frame that represents smear,
Instruct to shoot at least two or more smear frames;
The imaging means captures a normal frame or a smear frame as the image frame in accordance with an instruction from the frame control means.
Taking at least two or more smear frames as the image frames,
The signal processing means performs smear correction on the normal frame using the smear frame,
A smear correction is performed on the predetermined normal frame by using a first smear frame obtained at the front in time and a second smear frame obtained at the rear,
At this time, the first smear frame is multiplied by the first coefficient with the lower right-hand side according to the first smear frame to obtain the first multiplication result, and the second smear frame is temporally related. Multiplying the first smear frame by the second coefficient increasing in the right direction to obtain a second multiplication result, and adding the first multiplication result and the second multiplication result to obtain a third smear frame A solid-state imaging device, wherein the predetermined normal frame is subjected to smear correction using a third smear frame. 9. The solid-state imaging device according to claim 7, wherein the frame control unit instructs photographing of the plurality of image frames at predetermined intervals.
At this time, in the plurality of image frames, the solid-state imaging device is configured to instruct to capture the smear frame for every predetermined number of frames and to instruct to capture the normal frame as other image frames. The solid-state imaging device according to claim 9, wherein the signal processing unit stores the normal frame and the smear frame, and performs interpolation processing on the normal frame that is temporally before and after the predetermined smear frame to perform the predetermined process. A solid-state imaging device generated as a normal frame at the position of the smear frame. 9. The solid-state imaging device according to claim 7, wherein the frame control unit instructs photographing of the normal frame at predetermined intervals,
At this time, the interval between two consecutive normal frames is used as an interval period, and the shooting of the smear frame is instructed every predetermined number of the interval periods, and the shooting of the normal frame is instructed as other image frames. Solid-state imaging device. The solid-state imaging device according to claim 1 , 2, 7 or 8 , wherein the device selects one of a plurality of sensitivity modes and performs imaging.
The frame control means determines whether or not the sensitivity mode selected by the device is high sensitivity, and as a result, when the sensitivity mode is high sensitivity, the normal frame shooting or the smear frame shooting is performed. A solid-state image pickup apparatus characterized by selectively instructing, and instructing only photographing of the normal frame in other cases.