CN100566381C - Imaging apparatus and device thereof, image capture method, camera system and image processing apparatus - Google Patents

Abstract

The invention provides imaging apparatus and device thereof, image capture method, camera system and image processing apparatus.Camera head (1) constitutes and comprises: the corresponding shooting of sector scanning treatment system (10), it is between the exposure period of common time for exposure, read picture element signal in the burn-out zone (all scanning areas) to destroy playback mode, and by the various types of picture element signal of reading the exposure of the multiple time for exposure in the moving region, export the pixel data of these picture element signals of reading successively in the nondestructive read-out mode; And image processing system (12), its based on the pixel data in burn-out zone, the generation background image, and based on the corresponding respectively pixel data of exposure of time for exposure of a plurality of kinds of specific region, generate the image of moving region, the background image of these generations and moving region image is synthetic and generate photographed images.

Description

Imaging apparatus and device thereof, image capture method, camera system and image processing apparatus

Technical field

The present invention relates to use and destroy imaging apparatus, camera head, image capture method and the camera system that playback mode and nondestructive read-out mode are read electric charge from photo-electric conversion element, in addition can be based on by destroying the image processing apparatus that electric charge that playback mode and nondestructive read-out mode read generate the photographed images data.

Background technology

In the past, as the mode of reading electric charge, the playback mode of destruction and nondestructive read-out mode were arranged from the imageing sensor (photo-electric conversion element) of camera head.

Here, destroying playback mode is when reading electric charge (picture element signal) from photo-electric conversion element, follows the mode of the replacement processing of the electric charge removing that will accumulate in this photo-electric conversion element.

In addition, the nondestructive read-out mode is when reading electric charge (picture element signal) from photo-electric conversion element, the electric charge of accumulating in this photo-electric conversion element is not removed, and is being kept the mode of reading under the accumulated state.In other words, because processings of when electric charge is read, not resetting, therefore before the time for exposure that arrives setting,, carry out for the different time for exposure that reading of electric charge can several times at electric charge accumulation midway.Thereby the nondestructive read-out mode has the advantage that can easily realize multistage exposure (multistage exposure).

And in the past, in outdoor surveillance camera system, known following method promptly was provided with light source near camera for the supervision at night, by it to particular monitored area illumination light, thereby monitor whether enter thing in this zone.As its idea, approaching with the night scene is background, lights photoflash lamp and carries out personage's photography.That is,, carry out record to gazing at the subject image by the reverberation of camera reception near the subject of gazing at of light source.On the other hand, become the photography of the dark background of distant view, owing to flash light can not arrive, thus photograph by prolonging exposure time, thus the record background image.

In above-mentioned surveillance camera system, preferably can obtain both images of distant view and specific region (close shot), in order to take the high image of such contrast, use wide dynamic range camera (imaging apparatus) sometimes.As the imaging apparatus that is used to realize this wide dynamic range camera, the non-damage type imaging apparatus is proposed.As the patent documentation of the non-damage type imaging apparatus of relevant wide dynamic range camera, the solid-state imager of record in the camera head of record in the patent documentation 1 and the patent documentation 2 is for example arranged.

In the camera head of putting down in writing in the patent documentation 1, a plurality of pixels respectively have the photo-electric conversion element of scale-up version, wherein read different a plurality of picture element signals of time for exposure, a picture element signal long, detect under the situation of saturated pixel signal from the time for exposure, by with this saturated pixel signal and time for exposure the non-saturated pixel signal of this short pixel replace, thereby realize wide dynamic rangeization.

In addition, in the solid camera head of putting down in writing in the patent documentation 2, to with photo-electric conversion element as pixel and the light accepting part of rectangular ground two-dimensional arrangements is arranged on level is exported regularly the first and second different read output signals in the valid period vertical scanning circuit, and import the horizontal scanning circuit of twice commencing signal in the valid period in level, time of staggering in horizontal scan period carries out reading action twice, thereby a plurality of vertical signal lines are not set and realize wide dynamic rangeization by taking out independently.

[patent documentation 1] Japanese kokai publication hei 5-22670 communique

[patent documentation 2] Japanese kokai publication hei 7-38815 communique

But, in the prior art of above-mentioned patent documentation 1 and above-mentioned patent documentation 2, though can realize wide dynamic rangeization, but for example under the situation of monitored object nearby with respect to the background motion of dark, if make frame frequency (time for exposure) consistent, then may produce the problem that photographed images becomes blurred background and can not discern the image of background content with the motion of this monitored object.On the other hand, as cooperating exposure to make a video recording,, therefore produce the problem that photographed images becomes the image of the motion that can not judge monitored object then because frame frequency (time for exposure) is elongated to background.

Summary of the invention

Therefore, the present invention is conceived to the unsolved problem that has in such prior art and finishes, and its purpose is to provide that a kind of to be suitable for that background and the subject that is positioned at the motion nearby of this background are taken contrast high and discern imaging apparatus, camera head, image capture method, camera system and the image processing apparatus of image of both shooting contents easily.

[mode 1] in order to achieve the above object, the imaging apparatus of mode 1,

Comprise: photoelectric conversion part, it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this imaging apparatus is characterised in that described imaging apparatus comprises:

First sensing element in each pixel that described photo-electric conversion element constituted its burn-out zone from described photoelectric conversion part (entireexposure region), is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode; And

Second sensing element, its described first sensing element carry out from the burn-out zone electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode.

If such structure, then can be from each pixel that described photo-electric conversion element constituted the burn-out zone of described photoelectric conversion part by first sensing element, read the electric charge that obtains with the exposure of regulation time for exposure to destroy playback mode, by second sensing element can described first sensing element carry out from the burn-out zone electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode.

In other words, read by the destruction of carrying out electric charge in the pixel of first sensing element with the burn-out zone (all scanning areas) of exposure from photoelectric conversion part of regulation time for exposure, on the other hand, in during the exposure of carrying out the regulation time for exposure, by the specific region that second sensing element can be constituted a part of zone in described burn-out zone, carry out with described regulation below the time for exposure and the time for exposure of different respectively a plurality of kinds carried out the nondestructive read-out of electric charge of the pixel of exposure.

Thereby, for example, for the shooting object that constitutes by subject of moving and darker background, by first sensing element, for this dark background, by with the pixel of exposure area integral body for example being to expose long time for exposure of sufficient length for the photographed images that obtains discerning dark background content, and the electric charge of each pixel of this exposure area integral body read, thereby can access to grow the background image that the time for exposure exposure obtains.On the other hand, in between the exposure period of described long time for exposure, its neighboring area in zone of subject that will comprise described motion is as the specific region, pixel for this specific region, with non-failure mode from for example (for example with a plurality of kinds of being shorter than the described long time for exposure, 5 kinds etc.) time for exposure each pixel of exposing successively read electric charge successively, thereby can the frame frequency frame frequency at a high speed with than long time for exposure the time obtain image with the specific region of the time for exposure exposure of a plurality of kinds.Thus, owing to can access the background image (image of exposure area integral body) that fully exposed and by the image of the specific region of the subject that comprises motion of multistage exposure, so by synthetic these images, obtain can generation background and the contrast of subject high and clearly caught the effect of image of the subject of motion.In addition, owing in the specific region, catch the subject of motion, so in motion detection processing etc., also can reduce treating capacity.

Here, above-mentioned " photoelectric conversion part " for example uses the CMOS technology to constitute, as the imaging apparatus of the nondestructive read-out carried out that utilizes the CMOS technology, threshold value modulation type imaging apparatus (for example, VMIS (Threshold Voltage Modulation Image Sensor)) etc. is arranged.Below, in about the mode of camera head, image capture method, camera system and image processing apparatus too.

[mode 2] on the other hand, in order to achieve the above object, the camera head of mode 2,

Comprise: photoelectric conversion part, it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this camera head is characterised in that described camera head comprises:

First sensing element in its each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode;

Second sensing element, its described first sensing element carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode;

First image data creating unit, it generates first view data based on first pixel data, and the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first sensing element constitutes;

First image data memory cell, first view data that its storage is generated by described first image data creating unit;

Second image data creating unit, its second pixel data based on a plurality of kinds generates second view data, and second pixel data of these a plurality of kinds is by constituting for different respectively electric charge of the time for exposure of described specific region that described second sensing element is read;

Second image data memory cell, second view data that its storage is generated by described second image data creating unit; And

The photographed images data generating unit, it synthesizes second view data of described storage and first view data of described storage and generation photographed images data.

If such structure, then can be from each pixel that described photo-electric conversion element constituted the burn-out zone of described photoelectric conversion part by first sensing element, read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode, by second sensing element can described first sensing element from the burn-out zone, carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode.

In addition, can generate first view data based on first pixel data by first image data creating unit, the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first sensing element constitutes, can store first view data that generates by described first image data creating unit by first image data memory cell, can generate second view data based on second pixel data of a plurality of kinds by second image data creating unit, second pixel data of these a plurality of kinds can be stored second view data that is generated by described second image data creating unit by constituting for different respectively electric charge of the time for exposure of described specific region that described second sensing element is read by second image data memory cell.

In addition, can be by the photographed images data generating unit with second view data of described storage and the synthetic photographed images data that generate of first view data of described storage.

Thereby, for example, for the shooting object that constitutes by subject of moving and darker background, by first sensing element, for this dark background, by with the pixel of exposure area integral body for example being to expose long time for exposure of sufficient length for the photographed images that obtains discerning dark background content, and the electric charge of each pixel of this exposure area integral body read, thereby can access to grow the background image of time for exposure exposure.On the other hand, in between the exposure period of described long time for exposure, its neighboring area in zone of subject that will comprise described motion is as the specific region, pixel for this specific region, with non-failure mode from for example (for example with a plurality of kinds of being shorter than the described long time for exposure, 5 kinds etc.) time for exposure each pixel of exposing successively read electric charge successively, thereby can the frame frequency frame frequency at a high speed with than long time for exposure the time obtain image with the specific region of the time for exposure exposure of a plurality of kinds.And then, because the background image (image of exposure area integral body) that the quilt that obtains so fully can be exposed and synthesized by the image of the specific region of the subject that comprises motion of multistage exposure, thus obtain can generation background and the contrast of subject high and clearly caught the effect of image of the subject of motion.

[mode 3] and then, the camera head of mode 3 in the camera head of mode 2,

It is characterized in that this camera head comprises specific region reference signal generation unit, this specific region reference signal generation unit generates the reference signal of the scope that is used to specify the described specific region in the described burn-out zone.

If such structure, then can generate the reference signal of the scope that is used to specify the described specific region in the described burn-out zone by specific region reference signal generation unit.

Thereby, for example non-synchronously make camera head automatically generate the reference signal (vertical synchronizing signal 1) of the scope that is used to specify the specific region, so obtain the effect that easily to count from described vertical synchronizing signal 1 to the row of specific region number, pixel number with the reference signal that the burn-out zone is provided (vertical synchronizing signal 0).

[mode 4] and then, the camera head of mode 4 in the camera head of mode 2 or 3,

It is characterized in that, described second pixel data based in described second sensing element by the described pixel value of repeatedly reading the pixel data that electric charge was constituted that each time for exposure with in the time for exposure of a plurality of kinds of obtaining reads and in described second sensing element, to constitute with each difference value between the pixel value of the pixel data that electric charge was constituted read than the described short time for exposure of each time for exposure.

If such structure, owing to can constitute second pixel data, so can obtain the short time for exposure, be the image of high speed frame frequency based on the difference of the pixel datas of each two time for exposure in the time for exposure of a plurality of kinds.And then, can remove or alleviate the fixed pattern noise (fixed pattern noise) that becomes problem in the nondestructive read-out mode.

Thereby, obtain preventing or to alleviate the effect of the image quality deterioration that fixed pattern noise causes.

Here, " fixed pattern noise " has the noise that becomes the dark current of problem blackspot (Shading) or take place owing to the difference of the transducer sensitivity of each pixel when time exposure.

In addition, above-mentioned second pixel data can itself be made of described difference value, also can difference value carried out the value after the processing constitutes by difference value being proofreaied and correct etc.

[mode 5] and then, the camera head of mode 5 in the camera head of mode 4,

It is characterized in that the electric charge of reading with the time for exposure shorter than described each is the electric charge of reading the previous time for exposure of the electric charge of described each time for exposure time for exposure.

If such structure, because the difference value between the pixel data that can read based on the pixel data of reading with each time for exposure in the time for exposure of a plurality of kinds with their each previous time for exposure constitutes second pixel data, can access the image of frame frequency more at a high speed.

[mode 6] and then, the camera head of mode 6 mode 2 in any camera head of 5,

It is characterized in that, described second image data creating unit based on read by described second sensing element to the pixel value of each described second pixel data of described specific region and the comparative result of defined threshold, judge whether each second pixel data is effective, based on being judged as effective second pixel data, upgrade second view data of storing in described second image data memory cell simultaneously.

If such structure, then for example at night, for the shooting object that constitutes by subject of moving and background thereof, the represented brightness value of pairing second pixel data of the electric charge of from the pixel of specific region, reading by second sensing element for example for the situation more than the brightness value of regulation under, make this second pixel data effective, can upgrade second view data of storing in second image data memory cell based on this second pixel data.

In other words, except owing to be night,, therefore on subject and background, produce big luminance difference also because background is positioned at the position far away with subject.Therefore, because brightness value is the possibility height of the data of subject than the second higher pixel data, so based on this second view data, second pixel data of second view data of storing in formation second image data memory cell to the location of pixels identical with this second pixel data upgrades.

Thus, can generate the photographed images data of the subject of the motion in the specific region simply.In addition, defined threshold is by setting suitable value corresponding to luminance difference of subject and background etc., thereby can adapt to the shooting object under the various environment.

[mode 7] and then, the camera head of mode 7 in the camera head of mode 6,

It is characterized in that, described second image data creating unit is based on first pixel data of storing in described first image data memory cell, upgrade second view data of storing in described second image data memory cell, this first pixel data corresponding to be judged as the invalid identical location of pixels of second pixel data according to described comparative result.

If such structure, then for example at night, for the shooting object that constitutes by subject of moving and background thereof, for example be lower than under the situation of brightness value of regulation at the represented brightness value of pairing second pixel data of the electric charge of from the pixel of specific region, reading by second sensing element, make this second pixel data invalid, can upgrade second view data of storing in second image data memory cell based on first pixel data of storing in first image data memory cell corresponding to the location of pixels identical with this second pixel data.

In other words, except owing to be night,, therefore on subject and background, produce big luminance difference also because background is positioned at the position far away with subject.Therefore, because the second lower pixel data of brightness value is the possibility height of the data of background, so pass through to the second such pixel data, use first pixel data of storing in first image data memory cell of the location of pixels identical to upgrade and constitute second pixel data of second view data of storing in second image data memory cell with this second pixel data, thus obtain can generation background and the contrast of subject high and clearly caught the effect of specific region image of the subject of motion.

[mode 8] and then, the camera head of mode 8 in the camera head of mode 6 or 7,

It is characterized in that, be the represented brightness of described defined threshold when above in the represented brightness of the pixel value of described second pixel data, and described second image data creating unit is judged to be this second pixel data effectively.

If such structure, then for example at night, for the shooting object that constitutes by subject of moving and background thereof, under the situation more than the regulation brightness value, make this second pixel data effective at the represented brightness value of pairing second pixel data of the electric charge of from the pixel of specific region, reading by second sensing element.

In other words, except owing to be night,, therefore on subject and background, produce big luminance difference also because background is positioned at the position far away with subject.Therefore, because brightness value is the possibility height of the data of subject than the second higher pixel data, so upgrade by second pixel data that constitutes second view data of storing in second image data memory cell, thereby can generate the photographed images data of the subject of the motion in the specific region simply by this second pixel data pair location of pixels identical with this second pixel data.

[mode 9] and then, in the camera head of mode 9 any one camera head in mode 3 to 8,

It is characterized in that the number of times that described second image data creating unit is read electric charge corresponding to each pixel from described specific region in described second sensing element is proofreaied and correct the pixel value of described second pixel data.

If such structure, then second pixel data can be proofreaied and correct for intensity level equal when being same as the time for exposure exposure of first pixel data, obtain alleviating the effect of the image quality deterioration that the deficiency of intensity level causes.

For example, between exposure period for regulation time for exposure of first sensing element, obtain by second sensing element expose respectively with the time for exposure of a plurality of kinds and picture element signal the time, second sensing element repeatedly carries out the exposure that the time for exposure is shorter than the regulation time for exposure, so second pixel data that obtains like this is with respect to first pixel data, amount that the time for exposure shortens that intensity level is correspondingly low.Therefore, the intensity level of proofreading and correct second pixel data respectively corresponding to each time for exposure in the time for exposure of a plurality of kinds.In addition, as above-mentioned mode 5, generating as differential data under the situation of second pixel data, for example, difference value can be made as the kind several times and come the correcting luminance level.For example, under situation with the exposure of time for exposure of 5 kinds, only by difference value merely is made as 5 times just can proofread and correct into the equal intensity level of first pixel data.

[mode 10] and then, in the camera head of mode 10 any one camera head in mode 3 to 9,

It is characterized in that, described first image data creating unit is based on the pixel value of each described first view data in the described burn-out zone of being read by described first sensing element and the comparative result of defined threshold, judge whether each first pixel data is effective, based on being judged as effective first pixel data, upgrade first view data of storing in described first image data memory cell simultaneously.

If such structure, then for example at night, for the shooting object that constitutes by subject of moving and background thereof, at the represented brightness value of pairing first pixel data of the electric charge of being read from the pixel in burn-out zone by first sensing element for example is under the situation below the regulation brightness value, make this first pixel data effective, can upgrade first view data of storing in first image data memory cell based on this first pixel data.

In other words, except owing to be night,, therefore on subject and background, produce big luminance difference also because background is positioned at the position far away with subject.Therefore, because the first lower pixel data of brightness value is the possibility height of the data of background, so upgrade, thereby photographed images data of generation background simply by first pixel data that constitutes first view data of storing in first image data memory cell by this first pixel data pair location of pixels identical with this first pixel data.

[mode 11] and then, the camera head of mode 11 in the camera head of mode 10,

It is characterized in that, be the represented brightness of described defined threshold when following in the represented brightness of the pixel value of described first pixel data, and described first image data creating unit is judged to be this first pixel data effectively.

If such structure, then for example at night, for the shooting object that constitutes by subject of moving and background thereof, under the represented brightness value of pairing first pixel data of the electric charge of being read from the pixel in burn-out zone by first sensing element is situation below the regulation brightness value, can make this first pixel data effective.

In other words, except owing to be night,, therefore on subject and background, produce big luminance difference also because background is positioned at the position far away with subject.Therefore, because the first lower pixel data of brightness value is the possibility height of the data of background, so upgrade, thereby photographed images data of generation background simply by first pixel data that constitutes first view data of storing in first image data memory cell by this first pixel data pair location of pixels identical with this first pixel data.

[mode 12] and then, the camera head of mode 12 in the camera head of mode 11,

It is characterized in that, when the represented brightness of the described defined threshold of the represented brightness ratio of the pixel value of described first pixel data is high, it is invalid that described first image data creating unit is judged to be this first pixel data, and be judged to be when invalid at this, the renewal of first view data of storing in described first image data memory cell of not carrying out being realized by this first pixel data is handled.

If such structure, then for example at night, for the shooting object that constitutes by subject of moving and background thereof, be higher than under the situation of regulation brightness in the represented brightness of pairing first pixel data of the electric charge of from the pixel in burn-out zone, reading by first sensing element, can make this first pixel data invalid, not carry out renewal processing by first view data of this first pixel data realization.

In other words, except owing to be night,, therefore on subject and background, produce big luminance difference also because background is positioned at the position far away with subject.Therefore, because brightness value is the possibility height of the data of subject than the first higher pixel data, so under these circumstances, owing to the renewal of first view data of not carrying out storing in first image data memory cell is handled, therefore can access the effect of the generation processing that alleviates first view data.

[mode 13] and then, in the camera head of mode 13 any one camera head in mode 3 to 12,

It is characterized in that, described photographed images data generating unit is read second view data from described second image data memory cell, and from described first image data memory cell, read and described specific region beyond the first regional corresponding view data part, these second view data of reading and first view data partly synthesized and generate described photographed images data.

If such structure, for example, with synchronously read the view data of specific region from the various synchronizing signals of output devices such as display unit and from first view data, deduct the view data part of specific region after view data, thereby obtain generating simply the effect of the photographed images that they are synthetic.

[mode 14] on the other hand, in order to achieve the above object, the image capture method of mode 14,

Be used for imaging apparatus, this imaging apparatus comprises: photoelectric conversion part, and it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this image capture method is characterised in that described image capture method comprises:

First reading step in each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode; And

Second reading step, described first reading step carry out from the burn-out zone electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode.

Thus, obtain effect and the effect equal with the imaging apparatus of mode 1.

[mode 15] in addition, in order to achieve the above object, the image capture method of mode 15,

Be used for camera head, this camera head comprises: photoelectric conversion part, and it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this image capture method is characterised in that described image capture method comprises:

First reading step in each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode;

Second reading step, described first reading step carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode;

First view data generates step, generates first view data based on first pixel data, and the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first reading step constitutes;

The first image data storage step, storage generates first view data that step generates by described first view data;

Second view data generates step, generates second view data based on second pixel data of a plurality of kinds, and second pixel data of these a plurality of kinds is by constituting for different respectively electric charge of the time for exposure of described specific region that described second reading step is read;

The second image data storage step, storage generates second view data that step generates by described second view data; And

The photographed images data generate step, and second view data of described storage and first view data of described storage are synthesized and generation photographed images data.

Thus, obtain effect and the effect equal with the imaging apparatus of mode 2.

[mode 16] in addition, in order to achieve the above object, the camera system of mode 16,

Comprise: photoelectric conversion part, it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this camera system is characterised in that described camera system comprises:

First sensing element in its each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode;

Second sensing element, its described first sensing element carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge with non-failure mode;

First image data creating unit, it generates first view data based on first pixel data, and the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first sensing element constitutes;

First image data memory cell, first view data that its storage is generated by described first image data creating unit;

Second image data creating unit, its second pixel data based on a plurality of kinds generates second view data, and second pixel data of these a plurality of kinds is by constituting for different respectively electric charge of the time for exposure of described specific region that described second sensing element is read;

Second image data memory cell, second view data that its storage is generated by described second image data creating unit; And

The photographed images data generating unit, it synthesizes second view data of described storage and first view data of described storage and generation photographed images data.

Thus, obtain effect and the effect equal with the camera head of mode 2.

Here, native system can be used as single device, terminal and other equipment and realizes (in this case, equal with mode 1), also can be used as the network system that multiple arrangement, terminal and other equipment can have been carried out connecting communicatedly and realizes.In the latter case, if each composed component can be connected respectively communicatedly, then can belong to any one in a plurality of equipment etc.

[mode 17] in addition, in order to achieve the above object, the image processing apparatus of mode 17,

It is characterized in that, comprising:

First image data creating unit, it generates first view data based on first pixel data, described first pixel data is made of the electric charge of reading from each pixel with the destruction playback mode that gets with the exposure of regulation time for exposure, described each pixel is made of the photo-electric conversion element in the burn-out zone of photoelectric conversion part, described photoelectric conversion part disposes a plurality of described photo-electric conversion elements rectangularly and forms, and described photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge;

First image data memory cell, first view data that its storage is generated by described first image data creating unit;

Second image data creating unit, its second pixel data based on a plurality of kinds generates second view data, second pixel data of described a plurality of kinds by with destroy playback mode carry out electric charge read during, repeatedly constitute from the electric charge that each pixel is read in the nondestructive read-out mode, described each pixel is made of the described photo-electric conversion element in the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone;

Second image data memory cell, second view data that its storage is generated by described second image data creating unit; And

The photographed images data generating unit, it synthesizes second view data of described storage and first view data of described storage and generation photographed images data.

If such structure, then can generate first view data based on first pixel data by first image data creating unit, described first pixel data is made of the electric charge of reading from each pixel with the destruction playback mode that gets with the exposure of regulation time for exposure, described each pixel is made of the described photo-electric conversion element in the burn-out zone of photoelectric conversion part, described photoelectric conversion part disposes a plurality of photo-electric conversion elements rectangularly and forms, described photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge, can store first view data that is generated by described first image data creating unit by first image data memory cell.

In addition, can generate second view data based on second pixel data of a plurality of kinds that constitute by electric charge by second image data creating unit, this electric charge be described first sensing element carry out electric charge read during, each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read and obtain, can store second view data that generates by described second image data creating unit by second image data memory cell in the nondestructive read-out mode.

And then, can be by the photographed images data generating unit with second view data of described storage and the synthetic photographed images data that generate of first view data of described storage.

Thus, same with the camera head of mode 2, owing to can synthesize with the background image (image of exposure area integral body) that fully exposed with by the image of the specific region of the subject that comprises motion of multistage exposure, thus obtain can generation background and the contrast of subject high and clearly caught the effect of image of the subject of motion.

Description of drawings

Fig. 1 is the block diagram of the schematic configuration of expression camera head 1 of the present invention.

Fig. 2 is the block diagram of the internal structure of expression shooting treatment system 10.

Fig. 3 is the figure of the internal structure of expression the one AFE (Analog Front End, AFE (analog front end)) 102.

Fig. 4 is the block diagram that the internal structure of corresponding type imaging apparatus 100 is scanned in the expression subregion.

Fig. 5 is the figure of the internal structure of expression scan line scanner 54.

Fig. 6 is the figure of an example of reading action of the exposure of every row of each pixel in the sensor cell array 56 of expression imaging apparatus 100 and picture element signal.

Fig. 7 is the block diagram of the internal structure of presentation video treatment system 12.

Fig. 8 (a) is the figure of the internal structure of expression high-velocity scanning image composer 12c, and Fig. 8 (b) is the figure of the internal structure of expression moving region pixel judgement/renovator 12d, and Fig. 8 (c) is the figure of the internal structure of expression background pixel judgement/renovator 12e.

Fig. 9 (a) is the figure that expression destroys the passing of accumulating the quantity of electric charge of the high luminance pixel in the playback mode, and Fig. 9 (b) is the figure that expression destroys the passing of accumulating the quantity of electric charge of the low-light level pixel in the playback mode.

Figure 10 is the figure of an example of expression shooting object images.

Figure 11 is that expression is for the common scanning area (burn-out zone) of photographed images and the figure of high-velocity scanning zone (moving region).

Figure 12 is the figure of an example of the image of the common scanning area that obtains of the exposure of expression by the common time for exposure.

The figure of one example of the image in the high-velocity scanning zone that the exposure that Figure 13 is expression by the short time for exposure obtains.

Figure 14 (a)～Figure 14 (e) is the figure of an example of image of high-velocity scanning pixel data image, that obtain by difference processing of the time for exposure of a plurality of kinds in the expression high-velocity scanning zone.

Figure 15 is the figure that represents an example of the background image that finally obtains.

Embodiment

Below, based on the execution mode of description of drawings camera head of the present invention.Fig. 1～Figure 15 is the figure of the execution mode of expression camera head 1 of the present invention.

This camera head 1 comprises the shooting treatment system with imaging apparatus, this imaging apparatus has following function, promptly at the image of a shooting image duration (during the single exposure) for the exposure generation of the common time for exposure (by any times of setting such as users) in the burn-out zone (whole scanning area) of sensor cell array, the while is at the image of identical image duration shooting for the exposure generation of the multiple time for exposure of the specific region (part by the exposure area constitutes) of sensor cell array.In other words, for the specific region, the reading speed of the picture element signal during than the exposure of common time for exposure is carried out reading of picture element signal at high speed and repeatedly.Then, export the picture element signal that opto-electronic conversion produces successively by each pixel column.And, in the present embodiment, camera head 1 is made as moving region (for example, being set arbitrarily by the user) with zone and the neighboring area thereof that the subject of motion exists, and the zone of the sensor unit that will make a video recording to this moving region is set at described specific region.After, the specific region is called the moving region describes.

Below, the schematic configuration of camera head 1 of the present invention is described based on Fig. 1.Here, Fig. 1 is the block diagram of the schematic configuration of expression camera head 1 of the present invention.

As shown in Figure 1, camera head 1 constitutes and comprises: the corresponding shooting of sector scanning treatment system 10 (below be called shooting treatment system 10), it is between the exposure period of common time for exposure, read picture element signal to destroy in the row with each pixel of common time for exposure exposure of playback mode from the burn-out zone of sensor cell array 56 (aftermentioned), simultaneously with the nondestructive read-out mode from the moving region with time for exposure of a plurality of kinds (in the present embodiment, all be following time common time for exposure and do not repeat) read the picture element signal of various types of each in the row of each pixel of exposure, and export the pixel data (numerical data) of picture element signal of every row of these pixels of reading successively; Image processing system 12, its based on from 10 outputs of the corresponding shooting of sector scanning treatment system, from each pixel the corresponding pixel data in burn-out zone with the exposure common time for exposure, the generation background image, and based on from the corresponding respectively pixel data of the exposure of each pixel and time for exposure a plurality of kinds of specific region, generate the image (below be called the moving region image) of moving region, the background image of these generations and moving region image is synthetic and generate photographed images; And frame memory 14, various view data such as its storing moving area image data, moving region background image data, background image data.

And then, based on Fig. 2～Fig. 5 illustrate the shooting treatment system 10 internal structure.Here, Fig. 2 is the block diagram of the internal structure of expression shooting treatment system 10.In addition, Fig. 3 is the figure of internal structure of the AFE (Analog Front End) 102 of presentation graphs 1.In addition, Fig. 4 is the block diagram that the internal structure of corresponding type imaging apparatus 100 is scanned in the expression subregion.In addition, Fig. 5 is the figure of the internal structure of expression scan line scanner 54.

As shown in Figure 2, shooting treatment system 10 constitutes and comprises the subregion and scan corresponding type imaging apparatus 100, an AFE102, the 2nd AFE104.

Corresponding type imaging apparatus 100 (below be called imaging apparatus 100) is scanned in the subregion will be from the optical convergence of subject on sensor cell array 56 (aftermentioned) by pick-up lens (not shown), and electric charge accumulation that will be corresponding with this optically focused amount is in each pixel of sensor cell array 56.In addition, imaging apparatus 100 is based on the drive signal (pixel clock, horizontal-drive signal and vertical synchronizing signal) from the timing controller 12b (aftermentioned) of image processing system 12 output, and the electric charge group of accumulating in each pixel column with the burn-out zone of sensor cell array 56 is converted to the voltage group successively.In addition, the specific region _ vertical synchronizing signal that generates based on scan line scanner described later 54, the electric charge group of accumulating in each pixel column with the moving region of sensor cell array 56 is converted to the voltage group successively.Then, to be had via the first horizontal transmission portion 58 (aftermentioned) for the converted voltage group of exposing with the time for exposure of a plurality of kinds in the moving region of electric charge group, first output channel that comprises first line storage and constitute (below be called CH1) and output to an AFE102 successively will be had via the second horizontal transmission portion 60 (aftermentioned) with the converted voltage group of electric charge group of common time for exposure exposure for the opposing party's burn-out zone, second output channel that comprises the second line storage S and the second line storage N and constitute (below be called CH2) and output to the 2nd AFE104 successively.In addition, in the present embodiment, for the burn-out zone, carry out reading via CH2 to destroy playback mode from the electric charge of each pixel, for specific (motion) zone, carry out reading via CH1 in the nondestructive read-out mode from the electric charge of each pixel, thereby during the single exposure of electronic shutter function (time for exposure usually), the electric charge group when electric charge group when reading the exposure in the common time for exposure in the burn-out zone respectively independently and the exposure in the time for exposure of a plurality of kinds in the moving region.

Here, illustrate to destroy and read different with the action of nondestructive read-out.Destruction is read and is: the processing of after reading, resetting immediately (electric charge of accumulating in the sensor unit is removed), and read action once more.Read output signal (analogue data) before resetting is stored among the second line storage S, and the read output signal after the replacement is stored among the second line storage N.And, in differential amplifier circuit 62 (aftermentioned), carry out the subtraction process of corresponding picture element signal, and carry out signal level detection and noise is removed.On the other hand, the nondestructive read-out processing of after reading, not resetting.Signal after reading (analogue data) is respectively stored in first line storage.The picture element signal and the pixel clock of storage are synchronously outputed to an AFE102 and the 2nd AFE104 respectively respectively in first line storage and second line storage.

The one AFE102 and the 2nd AFE104 will be converted to numerical data (below be called pixel data) via the different pairing voltage signal of time for exposure (analogue data) of difference of the CH2 output of the CH1 of the first horizontal transmission portion 58 and the second horizontal transmission portion 60.Then, an AFE102 and the 2nd AFE104 pixel data that will generate outputs to the high-velocity scanning image composer 12c (aftermentioned) and the background pixel judgement/renovator 12e (aftermentioned) of image processing system 12 respectively.

And then, the internal structure of an AFE102 is described based on Fig. 3.

As shown in Figure 3, an AFE102 comprises clamp circuit 102a, amplifying circuit 102b, A/D change-over circuit 102c and constitutes.

Clamp circuit 102a receives the picture element signal from imaging apparatus 100, whether and to detect it be the signal of lightproof area, under detecting to the situation of lightproof area, for making this signal level become black (benchmark) level full-scale input is carried out the clamper processing, and the picture element signal after this clamper processing is outputed to amplifying circuit 102b.

The picture element signal of amplifying circuit 102b after with clamper amplifies, with the input range coupling of A/D converter, and the picture element signal after will amplifying outputs to A/D change-over circuit 102c.

A/D change-over circuit 102c will output to image processing system 12 after will being converted to pixel data (numerical data) from the picture element signal (analogue data) of amplifying circuit 102b.

In addition, because an AFE102 and the 2nd AFE104 are identical internal structure, so omit explanation for the internal structure of the 2nd AFE104.

And then, the internal structure of imaging apparatus 100 is described based on Fig. 4.

As shown in Figure 4, imaging apparatus 100 comprises benchmark timing generator 50, drive-pulse generator 52, scan line scanner 54, sensor cell array 56, the first horizontal transmission portion 58, the second horizontal transmission portion 60 and constitutes.

Reference timing signal takes place based on vertical synchronizing signal and horizontal-drive signal from the timing controller 12b (aftermentioned) of image processing system 12 in benchmark timing generator 50.

Driving pulse takes place, and offers sensor cell array 56 based on from the reference timing signal of benchmark timing generator 50, from the replacement row selection signal of scan line scanner 54 and read row selection signal in drive-pulse generator 52.

Scan line scanner 54 is based on the various drive control signal that are used to specify begin column number and scanning area width from the communicator 12a (aftermentioned) of image processing system 12, selection is for the position of the replacement row in burn-out zone, generate the replacement row selection signal, and select respectively for burn-out zone and specific (motion) regional read capable position, row selection signal (second row) is read in generation, and the selection signal of these generations is outputed to drive-pulse generator 52.

In the sensor cell array 56, each pixel uses the CMOS technology to constitute, based on the driving pulse that provides from drive-pulse generator 52, each pixel in the burn-out zone is exposed with the common time for exposure, read by this exposure and be accumulated in electric charge in each pixel to destroy playback mode by every row of each pixel simultaneously, output to the second horizontal transmission portion 60 successively.On the other hand, between the exposure period of this common time for exposure, by every row of each pixel and by each kind of each time for exposure, read the electric charge in each pixel of being accumulated in multiple time for exposure in specific (motion) zone successively in the nondestructive read-out mode, and output to the first horizontal transmission portion 58 successively.

The first horizontal transmission portion 58 is by every row of each pixel, with in specific (motion) zone of sensor cell array 56 with corresponding respectively picture element signal storage of multiple time for exposure in first line storage of CH1, and the picture element signal data that will store output to an AFE102.

The second horizontal transmission portion 60 is by every row of each pixel, the picture element signal data corresponding with the common time for exposure in the burn-out zone of sensor cell array 56 (data before resetting) and the picture element signal data afterwards of resetting are stored in respectively among the second line storage S and the second line storage N of CH2, and the picture element signal data after the common time for exposure that will store and the replacement output to the 2nd AFE104 via differential amplifier circuit 62.

And then, the internal structure of scan line scanner 54 is described based on Fig. 5.

As shown in Figure 5, scan line scanner 54 comprise burn-out sector scanning counter 54a, burn-out sector scanning address decoder 54b, specific (motion) sector scanning counter 54c, scan address, specific region decoder 54d, " or " logic 54e and constituting.

Burn-out sector scanning counter 54a repeats upwards counting (count up) action based on vertical synchronizing signal and horizontal-drive signal from benchmark timing generator 50.Here, the value of counter is corresponding to the row of the pixel in burn-out zone number, and this row number is output to burn-out sector scanning address decoder 54b.

Burn-out sector scanning address decoder 54b will make it effective as " reading row " from the row of the row of burn-out sector scanning counter 54a number, and make row in addition invalid.And then, to " or " logic 54e output expression becomes the capable control signal of reading of effective line position (address), simultaneously this is read capable control signal and output to drive-pulse generator 52 as the replacement row selection signal.

Specific (motion) sector scanning counter 54c non-synchronously repeats upwards counting action based on the information from the expression begin column of communicator 12a number and scanning area width with burn-out sector scanning counter 54a.Here, the value of counter is corresponding to the row number of the pixel in specific (motion) zone, and this row number is output to specific (motion) sector scanning address decoder 54d.In addition, specific (motion) sector scanning counter 54c generates the specific region _ vertical synchronizing signal as the vertical synchronizing signal in the specific region, and the specific region _ vertical synchronizing signal that will generate outputs to the timing controller 12b of image processing system 12.

Specific (motion) sector scanning address decoder 54d will make it effective as " reading row " from the row of the row of specific (motion) sector scanning counter 54a number, and make row in addition invalid.And then, to " or " logic 54e output expression becomes the capable control signal of reading of effective line position (address).

" or " logic 54e based on from burn-out sector scanning address decoder 54b read capable control signal and from the capable control signal of reading of specific (motion) sector scanning address decoder 54d, each row is carried out inclusive-OR operation, generation is for the final row selection signal of reading in burn-out zone, generates the final row selection signal of reading for specific (motion) zone simultaneously.The row selection signal of reading of these generations is output to drive-pulse generator 52.

And then, illustrate based on Fig. 6 imaging apparatus 100 time for exposure control method and from the method for reading picture element signal of sensor cell array 56.Here, Fig. 6 is the figure of an example of reading action of the exposure of every row of each pixel in the sensor cell array 56 of expression imaging apparatus 100 and picture element signal.

Here, the removing of accumulating electric charge (replacements) and common scan line (the reading row) L2 that reads of the picture element signal of time for exposure usually of the row of each pixel that is used for carrying out the burn-out zone set in the control of time for exposure of the present invention to the burn-out zone of sensor cell array 56 (all scanning areas), simultaneously specific (motion) regional (specific scanning area) setting of sensor cell array 56 is used to carry out high-velocity scanning row (the reading row) L1 of nondestructive read-out of picture element signal of the time for exposure of a plurality of kinds.Then, between exposure period once in (usually time for exposure), the nondestructive read-out of the picture element signal the during time for exposure of the reading of the picture element signal when carrying out common time for exposure respectively independently, replacement and a plurality of kinds.In other words, usually scan line L2 and high-velocity scanning row L1 are set at, as shown in Figure 6, the row of the pixel in the burn-out zone (for example, when accumulating the electric charge of common time for exposure successively the 1st～the 18th row), usually scan line L2 reads the picture element signal of the row of each pixel successively, simultaneously this is accumulated electric charge and removes successively.On the other hand, high-velocity scanning row L1 is set at respectively, at the row of the pixel of specific region (for example, the the 9th～the 12nd row) in, in during the electric charge of accumulating the common time for exposure, in each time for exposure of time for exposure of a plurality of kinds, read the picture element signal of the row of each pixel successively with non-failure mode.

In addition, in the present embodiment, as shown in Figure 6, the picture element signal (analogue data) during for common time for exposure in burn-out zone is read out the second line storage S of CH2, on the other hand, the picture element signal after the replacement is read out the second line storage N of CH2.Then, as shown in Figure 6, these picture element signals of reading are imported into the differential amplifier circuit 62 of the output that is arranged on the second horizontal transmission portion 60, in this differential amplifier circuit 62, subtraction process between the picture element signal of preceding and the back difference correspondence of resetting reset is carried out the detection and the noise of signal level and is removed.Then, the picture element signal after the subtraction process is output to the 2nd AFE104, and is converted into numerical data (pixel data) at this.On the other hand, the picture element signal during for time for exposure of a plurality of kinds in specific (motion) zone is read out first line storage of CH1 and is output to an AFE102, and is converted into numerical data (pixel data) at this.

In addition, the control of reading timing of the picture element signal of above-mentioned common scan line L2 and high-velocity scanning row L1, as shown in Figure 6, to the burn-out zone, by every row of each pixel, scan common scan line L2 (going up direction among Fig. 6) successively, in this common scan line L2, accumulate the removing (replacement) of electric charge, read out in the picture element signal of pixel that carries out the exposure of common time for exposure before and after the removing (replacement) of accumulating electric charge simultaneously.Then, in first row, carry out reading and resetting of picture element signal, picture element signal is all read into the outside from line storage after, carry out the scanning of common scan line L2 successively, when usually scan line L2 arrives first row once more, carry out the scanning of common scan line L2 in timing just in time through the common time for exposure.With the row of such order for the pixel of the Zone Full of sensor cell array, the removing of reading and accumulating electric charge (replacement) of the picture element signal when exposing usually successively by every row of each pixel.On the other hand, in specific (motion) zone, remove after (replacement) accumulate electric charge by common scan line L2, row for the pixel after this removing (replacement), in high-velocity scanning row L1, be carried out the nondestructive read-out of picture element signal of pixel of exposure of each time for exposure of a plurality of kinds successively by the order of time for exposure length.By such order, to the row of the pixel of the specific region of sensor cell array, the nondestructive read-out of the picture element signal the during exposure carrying out successively realizing by every row by the time for exposure of a plurality of kinds.

In addition, in the present embodiment, the picture element signal of common scan line L2 read with the picture element signal of high-velocity scanning row L1 read collision (batting) time (for example, when both sides carry out reading in the common time for exposure), for example be divided into during two between the reading duration that will set by horizontal-drive signal, during one, second line storage of CH2 is read picture element signal by common scan line L2, during another, first line storage of CH1 is read picture element signal, thereby avoid by high-velocity scanning row L1.

And then, the internal structure of image processing system 12 is described based on Fig. 7～Fig. 9.Here, Fig. 7 is the block diagram of the internal structure of presentation video treatment system 12.In addition, Fig. 8 (a) is the figure of the internal structure of expression high-velocity scanning image composer 12c, and Fig. 8 (b) is the figure of the internal structure of expression moving region pixel judgement/renovator 12d, and Fig. 8 (c) is the figure of the internal structure of expression background pixel judgement/renovator 12e.In addition, Fig. 9 (a) is the figure that expression destroys the passing of accumulating the quantity of electric charge of the high-brghtness picture images in the playback mode, and Fig. 9 (b) is the figure that expression destroys the passing of accumulating the quantity of electric charge of the low-light level pixel in the playback mode.

As shown in Figure 7, image processing system 12 comprises communicator 12a, timing controller 12b, high-velocity scanning image composer 12c, moving region pixel judgement/renovator 12d, background pixel judgement/renovator 12e, storage access moderator (memory access arbitrator) 12f, output reader 12g and constitutes.

Communicator 12a obtains the begin column number information relevant with the scanning area width for specific (motion) of sensor cell array 56 zone from external system controller (not shown), and will represent that this begin column obtained number and the drive control signal of scanning area width output to the scan line scanner 54 of the treatment system 10 of making a video recording.

Timing controller 12b generates the drive signal (pixel clock, horizontal-drive signal, vertical synchronizing signal) of imaging apparatus 100, and it is outputed to the benchmark timing generator 50 of imaging apparatus 100.In addition, timing controller 12b is owing to learn the location of pixels of picture element signal the sensor cell array 56 of imaging apparatus 100 of handling 10 CH2 output from shooting (pixel column (OK) number, pixel number) from horizontal-drive signal, vertical synchronizing signal, thus generate its pixel column (OK) number (below be also referred to as " address information ".), and this address information outputed to background pixel judgement/renovator 12e.In addition, timing controller 12b is owing to learn from the specific region vertical synchronizing signal from shooting treatment system 10 from the location of pixels of picture element signal the sensor cell array 56 of imaging apparatus 100 of the CH1 output of shooting treatment system 10, so generate its address information, and this address information outputed to moving region pixel judgement/renovator 12d.

Shown in Fig. 8 (a), high-velocity scanning image composer 12c comprises saturated spectral discrimination portion 70, difference image generating unit 72, grade correction unit 74 and constitutes.

Saturated spectral discrimination portion 70, the brightness value of the pixel data of the moving region of the former data that a former time for exposure is obtained before proofreading and correct as grade (below be called the benchmark pixel data) is under the above situation of specific threshold value, the image that is judged to be the moving region generates the invalid image that does not carry out the moving region and generates processing, on the other hand, under the situation less than specific threshold value, the image that is judged to be the moving region generates effectively and transfers to the image generation processing of moving region.Here, specific threshold value is meant saturation grade, and the pixel that surpasses saturation grade is made as invalid (back detailed description).In addition, benchmark image data (former data) storage of saturated spectral discrimination portion 70 moving region that will be made of the benchmark pixel data remains in the frame memory 14.

Difference image generating unit 72 obtains in shooting treatment system 10 by high-velocity scanning row L1 scanning and time for exposure that read and a plurality of kinds the pixel data of corresponding picture element signal respectively by CH1, obtains the benchmark pixel data of storing in the frame memory 14 corresponding with the positional information (address) of this pixel data of obtaining via storage access moderator 12f simultaneously.Then, according to the difference value of described pixel data of obtaining and benchmark pixel data, generate the pixel data (below be called the high-velocity scanning pixel data) of moving region.Like this, by generating the high-velocity scanning pixel data by difference value, thereby can remove because the former resulting fixed pattern noises such as characteristic deviation of pixel.

Below, for the action specification of difference image generating unit 72, the passing of accumulating the quantity of electric charge in each pixel of sensor cell array 56 is described based on Fig. 9.

Shown in Fig. 9 (a) and Fig. 9 (b), in the exposure of a frame (usually time for exposure), the quantity of electric charge of accumulating in each pixel of sensor cell array 56 in time process and increase simultaneously.In the moving region, owing to from each pixel, read electric charge, so no matter in exposure, carry out the quantity of electric charge of accumulating of all keeping each pixel of reading of electric charge several times by the nondestructive read-out mode.And, the increase of the pixel value of the high brightness of Fig. 9 (a) expression motion, on the other hand, the increase of the background area of Fig. 9 (b) expression low-light level.That is, in the example of Fig. 9 (a), the shooting object of the example of light amount ratio Fig. 9 (b) of shooting object is big, accumulates the example height of the increment rate of the quantity of electric charge than Fig. 9 (b).Judge the pixel or the background area of motion according to the difference of this increment rate.In addition, the replacement among Fig. 9 regularly is the timing that empties the electric charge of accumulating in the sensor cell array 56, and this regularly determines the common time for exposure.

In addition,, for example read electric charge, then, as previously mentioned, generate image according to difference in the timing of (1)～(5) shown in Fig. 9 (a) for the moving region.That is,, generate image according to quantity of electric charge of reading respectively in each later timing of (2) and each difference of the quantity of electric charge that each previous timing is regularly read at these.Therefore, will the move pixel value of view data in (high-velocity scanning) zone is stored in the frame memory (with it as the benchmark pixel data).The image formation sheet of realizing by this difference shows that the image of 5 times speed of common frame frequency generates, and its expression generation time for exposure is 1/5 image.

The brightness that the difference because of the time for exposure between the pixel data in grade correction unit 74 correction burn-out zones (background image) and the high-velocity scanning pixel data of moving region produces is differential.Promptly, as previously mentioned, because high-velocity scanning pixel data and time for exposure by the difference value formation of the pixel datas of each two continuous sampling (exposure) times are 1/5 image equivalence,, become 1/5 intensity level so the intensity level of the intensity level of each difference value during with common exposure compared.Thereby, carry out intensity level with the high-velocity scanning pixel data and be made as 5 times grade and proofread and correct.

Shown in Fig. 8 (b), moving region pixel judgement/renovator 12d comprises pixel data detection unit 80, pixel data selection portion 82, pixel data renewal portion 84 and constitutes.

Pixel data detection unit 80 is obtained the high-velocity scanning pixel data from high-velocity scanning image composer 12c, judges that whether the represented brightness value of this high-velocity scanning pixel data is more than the specific threshold value.Then, be under the situation more than the specific threshold value being judged to be, this high-velocity scanning pixel data is made as " effectively ", under situation about being judged to be, this high-velocity scanning pixel data is made as engineering noise less than specific threshold value.That is, when threshold value is following, be judged to be the background area.The label information that is somebody's turn to do " effectively " or engineering noise is transfused to pixel data selection portion 82.

Pixel data selection portion 82 via storage access moderator 12f obtain label information from " effectively " of pixel data detection unit 80 or engineering noise, from the pixel data of the background image data of storage in the high-velocity scanning pixel data of high-velocity scanning image composer 12c and (the same pixel position) frame memory 14 corresponding (below be called the background pixel data) with the address of this high speed pixel data.Then, be under the situation of " effectively " at label information, from described background pixel data that obtain and high-velocity scanning pixel data, select the high-velocity scanning pixel data, and generate more new data from the pixel data of this selection.On the other hand, be under the situation of engineering noise at label information, from described background pixel data that obtain and high-velocity scanning pixel data, select the background pixel data, and generate more new data from the pixel data of this selection.The more new data of this generation is transfused to pixel data renewal portion 84.

Pixel data renewal portion 84 pairs of storage access moderators 12f provide write command, to write the more new data of obtaining from pixel data selection portion 82, the pixel data with described more new data identical address position that is stored in the moving region view data in the frame memory 14 is upgraded.

Shown in Fig. 8 (c), background pixel judgement/renovator 12e comprises pixel data detection unit 90, pixel data selection portion 92, pixel data renewal portion 94 and constitutes.

Pixel data detection unit 90 is obtained background pixel data (pixel data of the picture element signal of being read by common scan line L2) from shooting treatment system 10 via CH2, judges that whether the represented brightness value of these background pixel data is below the specific threshold value.Then, under situation about being judged to be below the specific threshold value, these background pixel data are made as " effectively ", under situation about being judged to be, these background pixel data are made as engineering noise greater than specific threshold value.That is, when threshold value is above, be judged to be the moving region.The label information that is somebody's turn to do " effectively " or engineering noise is transfused to pixel data selection portion 92.

Pixel data selection portion 92 via storage access moderator 12f obtain label information from " effectively " of pixel data detection unit 90 or engineering noise, from the pixel data of the background image data of storing in the background pixel data (newly) of shooting treatment system 10 and (the same pixel position) frame memory 14 corresponding (below be called old background pixel data) with the address of these background pixel data.Then, be under the situation of " effectively " at label information, from the described background pixel data that obtain, select the background pixel data (newly) that obtain from shooting treatment system 10, and generate more new data from the pixel data of this selection.On the other hand, be under the situation of engineering noise at label information, from the described background pixel data that obtain, select the old background pixel data that obtain from described frame memory 14, and generate more new data from the pixel data of this selection.Thus, only continue to keep background image.The more new data of this generation is transfused to pixel data renewal portion 94.

Pixel data renewal portion 94 pairs of storage access moderators 12f provide write command, to write the more new data of obtaining from pixel data selection portion 92, the pixel data with described more new data identical address position that is stored in the background image data in the frame memory 14 is upgraded.

Return Fig. 7, storage access moderator 12f according to from background pixel judgements/renovator 12e, high-velocity scanning image composer 12c, moving region pixel judgement/renovator 12d and the four systems of exporting reader 12g to the reading in of frame memory 14, write command, the access request of the view data of the frame memory 14 of this four systems is arbitrated the line access of going forward side by side.

Output reader 12g with regularly synchronously read the interior view data of frame memory 14 from the output of output (demonstrations) device of outside via storage access moderator 12f, and the pixel data that this is read is outputed to output device.

As shown in Figure 7, frame memory 14 is memories of various view data such as storing moving zone benchmark image data, moving region view data, moving region background image data, background image data, when storage access moderator 12f reads request, read the represented pixel data of this request.In addition, when frame memory 14 writes request at storage access moderator 12f, write this and write the represented pixel data of request.

The action of reality of the camera head 1 of present embodiment then, is described based on Figure 10～Figure 15.Here, Figure 10 is the figure of an example of expression shooting object images.In addition, Figure 11 is that expression is for the common scanning area (burn-out zone) of photographed images and the figure of high-velocity scanning zone (moving region).In addition, Figure 12 is the figure of an example of the image of the common scanning area that obtains of the exposure of expression by the common time for exposure.In addition, the figure of an example of the image in the high-velocity scanning zone that obtains of Figure 13 exposure that is expression by the short time for exposure.In addition, Figure 14 (a)～Figure 14 (e) is the figure of an example of image of high-velocity scanning pixel data image, that obtain by difference processing of the time for exposure of a plurality of kinds in the expression high-velocity scanning zone.In addition, Figure 15 is the figure that represents an example of the background image that finally obtains.

Below, be the action that reference object illustrates camera head 1 with the tank of as shown in figure 10 packed into fish, pasture and water, gravel etc.In the example of Figure 10, fish becomes the subject of motion, becomes background beyond the fish.Thereby at first, its neighboring area that needs will comprise as the zone of the fish existence of subject is set at the moving region.For example shown in Figure 11, for the burn-out zone of sensor cell array 56, the rectangular area that zone and neighboring area thereof constituted that fish is existed is set at the moving region.In other words, as shown in figure 11, the burn-out zone of sensor cell array 56 becomes the common scanning area of the exposure of carrying out the common time for exposure, and the moving region of described setting becomes the high-velocity scanning zone.In addition, same with (1)～(5) shown in above-mentioned Fig. 9 (a) in the present embodiment, sampling time in high-velocity scanning zone is made as common time for exposure 5 five equilibrium and time.In addition, because the background beyond the fish in the shooting object is dark, therefore the time for exposure is set at reasonable time usually, so that can expose fully to the background beyond the fish.Like this, after the regional extent of moving region, the sampling time in the moving region, the common time for exposure decision, these information are sent to camera head 1 via external host system.

Camera head 1 is switched on power supply, in image processing system 12, from external host system obtain the information relevant with the time for exposure, for after the begin column of moving region number and the information relevant with the scanning area width, will be used to specify the begin column number of moving region and the drive control signal of scanning area width sends to shooting treatment system 10 by communicator 12a.And then in timing controller 12b, 10 outputs are used to drive the drive signal (pixel clock, vertical synchronizing signal and horizontal-drive signal) of imaging apparatus to the shooting treatment system, to obtain the picture element signal for the common time for exposure in burn-out zone.

Shooting is after treatment system 10 receives drive control signal, in scan line scanner 54, generates the replacement row selection signal synchronously with vertical synchronizing signal and horizontal-drive signal, for the capable control signal of reading of burn-out zone.In addition, based on begin column number, scanning area width and horizontal-drive signal, generate for the capable control signal of reading of moving region.And then, with these generations read control signal input " or " logic 54e, generate the row selection signal of reading respectively for burn-out zone and moving region.Then, to the replacement row selection signal of these generations of drive-pulse generator 52 output, read row selection signal (two kinds).Driving pulse takes place and also offers sensor cell array 56 based on from the reference timing signal of benchmark timing generator and from the various selection signals of scan line scanner 54 in drive-pulse generator 52.

Sensor cell array 56 is based on the driving pulse from drive-pulse generator 52, scan common scan line L2 and high-velocity scanning row L1, from advancing of each pixel in burn-out zone work the normal time for exposure exposure and the destruction of the electric charge accumulated is read (removing of accumulating electric charge), read action independently from advancing of each pixel of moving region the worked exposure of multiple time for exposure and the nondestructive read-out of the electric charge accumulated with this destruction.Then, the picture element signal that electric charge constituted that to read by the scanning of high-velocity scanning row L1 outputs to an AFE102 via the CH1 of the first horizontal transmission portion 58, and the picture element signal that electric charge constituted that will read by the scanning of common scan line L2 outputs to the 2nd AFE104 via the CH2 of the second horizontal transmission portion 60.

The one AFE102 generates pixel data and also outputs to image processing system 12, this pixel data be by will be via CH1 successively the picture element signal (analogue data) for the exposure of multiple time for exposure of output be converted to numerical data and form.On the other hand, the 2nd AFE104 generates pixel data and also outputs to image processing system 12, this pixel data be by will be via CH2 successively the picture element signal (analogue data) for the exposure of common time for exposure of output be converted to numerical data and form.

In image processing system 12, to the pixel data of high-velocity scanning image composer 12c input, to the pixel data of background pixel judgement/renovator 12e input from the burn-out zone of the 2nd AFE104 output from the moving region of AFE102 output.

After high-velocity scanning image composer 12c obtains the high-velocity scanning pixel data corresponding with multiple time for exposure difference via CH1, in saturated spectral discrimination portion 70, under the brightness value of this high-velocity scanning pixel data is situation more than the specific threshold value (saturation value), the image generation that is judged to be the moving region is invalid, the image that does not carry out the moving region generates to be handled, on the other hand, under situation less than certain threshold level, the image that is judged to be the moving region generates effectively, and the image of transferring to the moving region generates to be handled.

On the other hand, in frame memory 14, store under the represented situation of brightness value of the some benchmark pixel data in the multiple time for exposure and these benchmark pixel data less than specific threshold value, in difference image generating unit 72, obtain the benchmark pixel data of storage in the frame memory 14 corresponding with the positional information (address) of the described pixel data of obtaining, according to the difference value of the described pixel data of obtaining and these benchmark pixel data that obtain, generate the high-velocity scanning pixel data.

The high-velocity scanning pixel data of above-mentioned generation all carries out the correction of intensity level in grade correction unit 74.Here, cut apart and generate the high-velocity scanning pixel data, be made as 5 times grade and proofread and correct so carry out brightness value with the high-velocity scanning pixel data according to difference value because the common time for exposure is carried out 5.

High-velocity scanning pixel data after the grade that generates is proofreaied and correct like this is output to moving region pixel judgement/renovator 12d.

After moving region pixel judgement/renovator 12d obtains the high-velocity scanning pixel data from high-velocity scanning image composer 12c, in pixel data detection unit 80, judge that whether the represented brightness value of this high-velocity scanning pixel data of obtaining is more than the specific threshold value.Then, under situation about being judged to be more than the specific threshold value, this high-velocity scanning pixel data is made as " effectively ", under situation about being judged to be, this high-velocity scanning pixel data is made as engineering noise less than specific threshold value.On the other hand, in pixel data selection portion 82, via storage access moderator 12f obtain with corresponding (the identical location of pixels) frame memory 14 in the address of the high-velocity scanning pixel data of obtaining from high-velocity scanning image composer 12c background pixel data during the exposure of common time for exposure of storage.Then, under the situation that is judged to be the described high-velocity scanning pixel data of obtaining " effectively ", from described background pixel data that obtain and high-velocity scanning pixel data, select the high-velocity scanning pixel data, and generate more new data from the pixel data of this selection.As shown in figure 13, in the moving region, even the high subject short exposure time of brightness also becomes excellent exposure, but the low background parts of brightness is under short exposure time, and intensity level is not enough and fog.Thereby, the high-velocity scanning pixel data is under the above situation of specific threshold value, because this pixel data is the possibility height of the pixel data of subject, so at this moment, be judged to be " effectively " and use the high-velocity scanning pixel data to generate more new data, in pixel data renewal portion 84, use this more new data be updated in the frame memory 14 pixel data of the pairing location of pixels of moving region view data of storage.

In addition, in the moving region, generate the high-velocity scanning pixel data successively from the pixel datas of five kinds of time for exposure obtaining successively via CH1 by difference processing.Under the situation of subject motion, as shown in figure 14, the difference image of each time for exposure becomes the different image in position of subject respectively.In other words, in the present invention,, can obtain pixel data than common frame frequency speed at a high speed by exposing with the time for exposure below the common time for exposure.That is, can obtain the image of the motion of following subject at a high speed.

On the other hand, under the situation that is judged to be the described high-velocity scanning pixel data engineering noise of obtaining, from described background pixel data that obtain and high-velocity scanning pixel data, select the background pixel data, and generate more new data from the pixel data of this selection.As shown in figure 13, in the moving region, because the background parts beyond the subject is that low-light level and formation are fuzzy, so in such background parts, the possibility that the brightness value of high-velocity scanning pixel data is lower than specific brightness value raises.Thereby, at this moment, background pixel data when being judged to be engineering noise and using exposure under the common time for exposure generate more new data, in pixel data renewal portion 84, use this more new data be updated in the frame memory 14 pixel data of the pairing location of pixels of moving region view data of storage.

Like this, at the high-velocity scanning pixel data is under the situation of high brightness, use this high-velocity scanning pixel data to generate more new data, at the high-velocity scanning pixel data is under the situation of low-light level, use the background pixel data of the location of pixels identical to generate more new data, and use the more new data of these generations to upgrade each pixel data of moving region view data with this high-velocity scanning pixel data.Thus, the subject image is made of the pixel data of reading by high-velocity scanning from the moving region, and the image of the background parts beyond the subject can generate the moving region view data that is made of the pixel data of reading by common scanning from the burn-out zone.

On the other hand, after background pixel judgement/renovator 12e obtains the background pixel data via CH2, in pixel data detection unit 90, judge that whether the represented brightness value of these background pixel data that obtain is below the specific threshold value.Then, under situation about being judged to be below the specific threshold value, these background pixel data are made as " effectively ", under situation about being judged to be, these background pixel data are made as engineering noise greater than specific threshold value.On the other hand, in pixel data selection portion 92, obtain old background pixel data from storage in the background pixel data of shooting treatment system 10 and (the same pixel position) frame memory 14 corresponding with the address of these background pixel data via storage access moderator 12f.Then, be under the situation of " effectively " at label information from pixel data detection unit 90, select the background pixel data that obtain from shooting treatment system 10, and generate more new data from the pixel data of this selection.As shown in figure 12, in the burn-out zone, because the time for exposure is long, therefore bright subject (object) becomes high brightness, and on the other hand, background parts is compared with subject becomes low-light level.In other words, be lower than under the situation of specific brightness value at the brightness value of background pixel data, this pixel data is the possibility height of the pixel data of background parts.Thereby, at this moment, be judged to be " effectively " and use the background pixel data that obtain from shooting treatment system 10 to generate more new data, in pixel data renewal portion 94, use this more new data be updated in the pixel data of the pairing location of pixels of background image data of storage in the frame memory 14.

On the other hand, be under the situation of engineering noise at label information, the background pixel data of selecting the old background pixel data that obtain from described frame memory 14 rather than selecting to obtain from shooting treatment system 10, and generate more new data from the pixel data of this selection.In other words, as shown in figure 12, under the situation of brightness value greater than specific brightness value of background pixel data, this pixel data is the possibility height of the pixel data of subject (object).Thereby, at this moment, be judged to be engineering noise and use the background pixel data that obtain from shooting treatment system 10 to generate more new data, in pixel data renewal portion 94, use this more new data be updated in the pixel data of the pairing location of pixels of background image data of storage in the frame memory 14.

Like this, in the background pixel data is under the situation of low-light level, use these background pixel data to generate more new data, in the background pixel data is under the situation of high brightness, the old background image data of the background image data that use is stored in the frame memory 14 of the location of pixels identical with these background pixel data generates more new data, each pixel data of renewal Data Update background image data by using these generations, finally as shown in figure 15, can access the background image of taking with the exposure of common time for exposure that does not have subject.

Handle by the generation processing that repeats above-mentioned high-velocity scanning pixel data, the renewal processing of above-mentioned moving region view data, the renewal of above-mentioned background view data, in frame memory 14, constitute the pixel data and the background image data of the moving region of each frame.

Like this, output reader 12g is via storage access moderator 12f, regularly synchronously read out in moving region view data and the background image datas that constitute in the frame memory 14 with the output of installing, and the view data that this is read is outputed to output device from the output (demonstration) of outside.Specifically, based on pixel clock, horizontal-drive signal and vertical synchronizing signal from output device, address number to the pixel data read is counted, if address number be background image data number, then each row is according to pixels read the background image data in the frame memory 14 successively and is outputed to output device, if address number be the moving region view data number, then each row is according to pixels read the moving region view data in the frame memory 14 successively and is outputed to output device.Thus, can export the image that background image data and moving region view data are synthesized into, this background image data is made of the pixel data that obtains by scanning usually (exposure of time for exposure usually), and this moving region view data is made of the pixel data that obtains by high-velocity scanning (exposure of multiple time for exposure).

Like this, in the camera head 1 of present embodiment, in an imaging apparatus, read by destruction with the exposure of common time for exposure the background image of shooting object is taken, in between the exposure period of this common time for exposure, zone that the subject of shooting motion of objects is existed and neighboring area thereof are as the moving region, with the exposure of multiple time for exposure by nondestructive read-out respectively the image to this moving region take respectively, can the image of the background image of these shootings and moving region is synthetic and generate the photographed images of shooting object.In other words, obtain the pixel data of the motion of following subject by high-velocity scanning, obtain the pixel data of having guaranteed the enough exposures of dark background by common scanning, and the pixel data that these can be obtained synthesizes and the generation photographed images, so for the subject of moving in the dark background, the content of this subject and the content of this background can be discerned simultaneously, and the high clear and definite photographed images of contrast can be accessed.

In the above-described embodiment, benchmark timing generator 50 in the corresponding type imaging apparatus 100 is scanned in subregion by shooting treatment system 10, scan line scanner 54, drive-pulse generator 52, the processing of electric charge is read corresponding to mode 1 from the burn-out zone of sensor cell array 56 by the first horizontal transmission portion 58,2,9,10,11,12, first some sensing element in 16 and 17 or first reading step of mode 14 or 15, benchmark timing generator 50 in the corresponding type imaging apparatus 100 is scanned in subregion by shooting treatment system 10, scan line scanner 54, drive-pulse generator 52, the processing of electric charge is read corresponding to mode 1 from the burn-out zone of sensor cell array 56 by the second horizontal transmission portion 60,2,4,6,7,8, second some sensing element in 9 and 16 or second reading step of mode 14 or 15, the specific region reference signal generation unit corresponding to mode 3 is handled in the generation of the specific region vertical synchronizing signal in the scan line scanner 54.

In addition, in the above-described embodiment, sensor cell array 56 is corresponding to mode 1,2,14,15, some photoelectric conversion parts in 16 and 17, the moving region view data is corresponding to mode 2,5,6,7,13,15, the second some view data in 16 and 17, background image data is corresponding to mode 2,10,12,13,15, the first some view data in 16 and 17, timing controller 12b in the image processing system 12, background pixel judgement/renovator 12e, the generation of the background image data of storage access moderator 12f and frame memory 14 is handled (upgrade and handle) corresponding to mode 2,10,11,12, first some image data creating unit in 16 and 17 or first view data of mode 15 generate step, timing controller 12b in the image processing system 12, high-velocity scanning image composer 12c, moving region pixel judgement/renovator 12d, the generation of the moving region view data of storage access moderator 12f and frame memory 14 is handled (upgrade and handle) corresponding to mode 2,6,7,8,9, second some image data creating unit in 16 and 17 or second view data of mode 15 generate step, frame memory 14 is corresponding to mode 2,7,12,13, the first some image data memory cell in 16 and 17, the first image data storage step of mode 15, mode 2,6,7,13, the second some image data memory cell in 16 and 17, and second view data of mode 15 generates step, output reader 12g is corresponding to mode 2,13, some photographed images data generating unit in 16 and 17, or the photographed images data of mode 15 generate step.

In addition, in the above-described embodiment, adopted the treatment system 10 of to make a video recording, image processing system 12 and frame memory 14 to be contained in the interior structure of a device, but be not limited thereto, for example, also can be respectively constitute shooting treatment system 10, image processing system 12 and frame memory 14, also can adopt via communication network etc. both can be carried out the structure (corresponding to the camera system of mode 16) that data communication ground connects by different devices.Thus, can be with shooting treatment system, image processing system (comprising frame memory) be arranged on away from the structure of position.For example, the device of a plurality of shooting treatment systems and the device of an image processing system are connected by the Internet with can carrying out data communication, employing is handled structure from the camera data of a plurality of shooting treatment systems by being set at away from the device of an image processing system of the position of the device of these shooting treatment systems, thereby can carry out the unified management etc. of camera data.In addition, in this structure, comprise the image processing apparatus of the device of image processing system 12 and frame memory 14 corresponding to mode 17.

In addition, in the above-described embodiment, with the structure for whole scanning areas (burn-out zone) specific scanning areas of setting (specific region) is that example is illustrated, but be not limited thereto, also can adopt the structure of in the scope of the nondestructive read-out that can carry out normal electric charge, setting the specific scanning area more than 2.

In addition, in the above-described embodiment, when generating (renewal) moving region view data, based on brightness value and specific threshold value, select some in high-velocity scanning pixel data and the background pixel data to generate more new data, and use the more new data of this generation to carry out, but be not limited thereto, can not carry out determination processing yet and only use the high-velocity scanning pixel data to generate more new data, and carry out the generation (renewal) of moving region view data.

In addition, in the above-described embodiment, from reading regularly of view data the address number of the pixel data read is counted, if the address number of background pixel data, then from be stored in frame memory 14, read this pixel data and it is outputed to output device in the background image data of storage, on the other hand, if the address number of moving region view data, then by reading this pixel data in the moving region view data from be stored in frame memory 14 and it being outputed to output device, thereby read background image data and moving region view data and synthetic respectively, but be not limited thereto, also can be in advance in image processing system 12, background image data and moving region view data be outputed to output device after synthetic.

Claims (17)

1. camera head, this camera head comprises: photoelectric conversion part, it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, this camera head is characterised in that, described camera head comprises: first sensing element, in its each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode;

Second sensing element, its described first sensing element carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge in the nondestructive read-out mode;

First image data creating unit, it generates first view data based on first pixel data, and the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first sensing element constitutes;

First image data memory cell, first view data that its storage is generated by described first image data creating unit;

Second image data creating unit, its second pixel data based on a plurality of kinds generates second view data, and second pixel data of these a plurality of kinds is by constituting for different respectively electric charge of the time for exposure of described specific region that described second sensing element is read;

Second image data memory cell, second view data that its storage is generated by described second image data creating unit; And

The photographed images data generating unit, it synthesizes second view data of described storage and first view data of described storage and generation photographed images data.

2. camera head as claimed in claim 1, it is characterized in that, this camera head comprises specific region reference signal generation unit, and this specific region reference signal generation unit generates the reference signal of the scope that is used to specify the described specific region in the described burn-out zone.

3. camera head as claimed in claim 1, it is characterized in that described second pixel data is based on repeatedly reading the pixel value of the pixel data that electric charge was constituted that each time for exposure with in the time for exposure of a plurality of kinds of obtaining reads and constitute with each difference value between the pixel value of the pixel data that electric charge was constituted read than the described short time for exposure of each time for exposure by described in described second sensing element in described second sensing element.

4. camera head as claimed in claim 3 is characterized in that, the electric charge of reading with the time for exposure shorter than described each is the electric charge of reading the previous time for exposure of the electric charge of described each time for exposure time for exposure.

5. camera head as claimed in claim 1, it is characterized in that, described second image data creating unit based on read by described second sensing element to the pixel value of each described second pixel data of described specific region and the comparative result of defined threshold, judge whether each second pixel data is effective, based on being judged as effective second pixel data, upgrade second view data of storing in described second image data memory cell simultaneously.

6. camera head as claimed in claim 5, it is characterized in that, described second image data creating unit is based on first pixel data of storing in described first image data memory cell, upgrade second view data of storing in described second image data memory cell, this first pixel data corresponding to be judged as the invalid identical location of pixels of second pixel data according to described comparative result.

7. camera head as claimed in claim 5 is characterized in that,

In the represented brightness of the pixel value of described second pixel data is the represented brightness of described defined threshold when above, and described second image data creating unit is judged to be this second pixel data effectively.

8. camera head as claimed in claim 2 is characterized in that, the number of times that described second image data creating unit is read electric charge corresponding to each pixel from described specific region in described second sensing element is proofreaied and correct the pixel value of described second pixel data.

9. camera head as claimed in claim 2 is characterized in that,

Described first image data creating unit is based on the pixel value of each described first pixel data in the described burn-out zone of being read by described first sensing element and the comparative result of defined threshold, judge whether each first pixel data is effective, based on being judged as effective first pixel data, upgrade first view data of storing in described first image data memory cell simultaneously.

10. camera head as claimed in claim 9 is characterized in that,

In the represented brightness of the pixel value of described first pixel data is the represented brightness of described defined threshold when following, and described first image data creating unit is judged to be this first pixel data effectively.

11. camera head as claimed in claim 9 is characterized in that,

When the represented brightness of the described defined threshold of the represented brightness ratio of the pixel value of described first pixel data is high, it is invalid that described first image data creating unit is judged to be this first pixel data, do not carry out being judged to be by this renewal processing of first view data of storing in described first image data memory cell of invalid first pixel data realization simultaneously.

12. camera head as claimed in claim 2 is characterized in that,

Described photographed images data generating unit is read second view data from described second image data memory cell, and from described first image data memory cell, read and described specific region beyond the first regional corresponding view data part, these second view data of reading and first view data partly synthesized and generate described photographed images data.

13. an image capture method, this image capture method is used for imaging apparatus, and this imaging apparatus comprises: photoelectric conversion part, and it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this image capture method is characterised in that described image capture method comprises:

First reading step in each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode; And

Second reading step, described first reading step carry out from the burn-out zone electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge in the nondestructive read-out mode.

14. an image capture method, this image capture method is used for camera head, and this camera head comprises: photoelectric conversion part, and it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this image capture method is characterised in that described image capture method comprises:

First reading step in each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode;

Second reading step, described first reading step carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge in the nondestructive read-out mode;

First view data generates step, generates first view data based on first pixel data, and the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first reading step constitutes;

The first image data storage step, storage generates first view data that step generates by described first view data;

Second view data generates step, generates second view data based on second pixel data of a plurality of kinds, and second pixel data of these a plurality of kinds is by constituting for different respectively electric charge of the time for exposure of described specific region that described second reading step is read;

The second image data storage step, storage generates second view data that step generates by described second view data; And

The photographed images data generate step, and second view data of described storage and first view data of described storage are synthesized and generation photographed images data.

15. a camera system, this camera system comprises: photoelectric conversion part, and it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this camera system is characterised in that described camera system comprises:

First sensing element in its each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode;

Second sensing element, its described first sensing element carry out electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge in the nondestructive read-out mode;

First image data creating unit, it generates first view data based on first pixel data, and the electric charge for regulation time for exposure in described burn-out zone that this first pixel data is read by described first sensing element constitutes;

First image data memory cell, first view data that its storage is generated by described first image data creating unit;

Second image data creating unit, its second pixel data based on a plurality of kinds generates second view data, and second pixel data of these a plurality of kinds is by constituting for different respectively electric charge of the time for exposure of described specific region that described second sensing element is read;

Second image data memory cell, second view data that its storage is generated by described second image data creating unit; And

The photographed images data generating unit, it synthesizes second view data of described storage and first view data of described storage and generation photographed images data.

16. an image processing apparatus is characterized in that,

This image processing apparatus comprises:

First image data creating unit, it generates first view data based on first pixel data, described first pixel data is made of the electric charge of reading from each pixel with the destruction playback mode that gets with the exposure of regulation time for exposure, described each pixel is made of the photo-electric conversion element in the burn-out zone of photoelectric conversion part, described photoelectric conversion part disposes a plurality of described photo-electric conversion elements rectangularly and forms, and described photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge;

First image data memory cell, first view data that its storage is generated by described first image data creating unit;

Second image data creating unit, its second pixel data based on a plurality of kinds generates second view data, second pixel data of described a plurality of kinds by with destroy playback mode carry out electric charge read during, repeatedly constitute from the electric charge that each pixel is read in the nondestructive read-out mode, described each pixel is made of the described photo-electric conversion element in the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone;

Second image data memory cell, second view data that its storage is generated by described second image data creating unit; And

The photographed images data generating unit, it synthesizes second view data of described storage and first view data of described storage and generation photographed images data.

17. an imaging apparatus, this imaging apparatus comprises: photoelectric conversion part, and it disposes a plurality of photo-electric conversion elements rectangularly and forms, and this photo-electric conversion element is accumulated after the light that is exposed is converted to electric charge; And electronic shutter function, it controls the time for exposure of every frame, and this imaging apparatus is characterised in that described imaging apparatus comprises:

First sensing element in its each pixel that described photo-electric conversion element constituted from the burn-out zone of described photoelectric conversion part, is read the electric charge that gets with the exposure of regulation time for exposure to destroy playback mode; And

Second sensing element, its described first sensing element carry out from the burn-out zone electric charge read during, in each pixel that described photo-electric conversion element constituted from the specific region of the part in the described burn-out of the conduct of described photoelectric conversion part zone, repeatedly read electric charge in the nondestructive read-out mode.

Images