JP2002112121A - Imaging unit and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging unit for which different sensitivity can be set for each light-receiving element. SOLUTION: When a read pulse from a 2nd-phase power supply 2c and a 3rd-phase power supply 3a is applied to the CCD(charge coupled device) image sensor of an AND-type in first timing, stored electric charges are outputted to a vertical transfer CCD 7a from PD(photodiodes) 8b, 8d connected to 2nd- phase electrodes 5b, 5d and 3rd-phase electrodes 6b, 6d.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus and method, and more particularly, to an image pickup apparatus and method capable of variably controlling a dynamic range expansion ratio according to a situation and accurately picking up a dynamic scene. About.

[0002]

2. Description of the Related Art An imaging apparatus using a CCD (Charged Coupled Device) image sensor is becoming popular.

[0003] A CCD image sensor is a solid-state image sensor, and is used in an imaging device such as a video camera or a digital still camera. Imaging devices using this CCD image sensor are widely used in component inspection devices in factory automation (FA) and optical measurement devices such as electronic endoscopes in ME (Medical Electronics).

FIG. 1 is a diagram showing an electrical configuration of an interline CCD image sensor in a conventional image pickup apparatus.

The first phase power source 1, the second phase power source 2 and the third phase power source 3 are respectively provided with first phase electrodes 4a to 4d (hereinafter, when it is not necessary to distinguish them here, simply the first phase electrodes 4a to 4d). Phase electrode 4. The same applies to other devices.)
Phase electrodes 5a to 5d and third phase electrodes 6a to 6d
Via a vertical transfer CCD (vertical transfer register) 7a, 7
b to supply a transfer pulse (drive voltage). The second phase power supply 2 supplies PD (Photo Diod) to the vertical transfer CCDs 7a and 7b.
e: photodiodes) A read pulse (drive voltage) for instructing reading of charges stored in the photodiodes 8a to 8h is supplied.

[0006] The PD 8 generates and accumulates charges by photoelectrically converting light constituting an image. The charges stored in the PD 8 are read out to the vertical transfer CCDs 7a and 7b in accordance with a read pulse supplied from the second phase power supply 2. Although FIG. 1 shows a case where the PDs 8 are arranged in 4 rows × 2 columns for the sake of explanation, actually, the PDs 8 have a larger number in the horizontal and vertical directions. Only multiple are arranged.

In the vertical transfer CCDs 7a and 7b, three polysilicon electrodes are arranged for each PD 8, and this is
8 functions as a register for accumulating the charge read out. The polysilicon electrode is arranged on the vertical transfer CCD 9 so as to constitute a cell of a register connected in the vertical direction, and the first phase electrode 4, the second phase electrode 5, and the third phase electrode By the transfer pulse supplied from the electrode 6,
The charges accumulated in the register below the polysilicon electrode are sequentially transferred to the register connected in the downward direction in the figure, and output to the horizontal transfer CCD 9 connected to the end of the vertical transfer CCD 7. At this time, the vertical transfer CCD 7 controls the horizontal transfer CC while controlling the charges output from the PDs 8 not to be mixed.
Output to D9.

[0008] The first phase electrode 4, the second phase electrode 5, and the third phase electrode 6 are arranged in the horizontal direction in the figure. For this reason, for example, based on the read pulse supplied from the second phase electrode 5a, the charges accumulated in the PDs 8a and 8e arranged in the horizontal direction are synchronized with the vertical transfer CCD 7 at the synchronized timing.
a and 7b. That is, PD8
Are connected in common to the respective electrodes arranged so as to extend in the horizontal direction, so that the charges of the PDs 8 arranged in the horizontal direction are read out to the vertical transfer CCD 7 at the same time (at the same time) at the synchronized timing. The transfer pulses when the vertical transfer CCDs 7a and 7b transfer the electric charge output from each PD 8 to the horizontal transfer CCD 9 also include the first phase electrodes 4a to 4d and the second phase electrodes 5a to 5d.
d and the third phase electrodes 6a to 6d are supplied at timings synchronized in the horizontal direction.

The horizontal transfer CCD 9 includes driving power supplies 10a, 10
b, which is driven by the transfer pulse supplied from the vertical transfer CCDs 7a and 7b, and outputs the charge read from each PD 8 to the output terminal 11.

By the way, in order to improve the dynamic range using the above-mentioned CCD image sensor, there has been proposed a method of capturing and combining images using PDs 8 having different sensitivities.

As a first method, Japanese Patent Application Laid-Open No. Hei 8-223491 discloses a method in which incident light optically branched into a plurality of optical axes having different transmittances is measured by a CCD image sensor arranged on each optical axis. JP-A-7-254965, JP-A-7-254966, JP-A-8-340486, JP-A-1
0-069011, or US Patent 580177
3.

As a second method, the exposure time is divided using one CCD image sensor, and a plurality of images are captured at different times and with different time widths, and then synthesized. The method is disclosed in Japanese Patent Application Laid-Open No. 8-33146.
1, JP-A-7-254965, US Patent 54206
35, US Patent 5,455,621, JP-A-6-141
229, US Patent 5801773, US Patent 5
638118 or US Patent 5309243.

Further, as a third technique, after one CCD image sensor is used to capture an image with different sensitivities of the respective light receiving elements of the CCD image sensor, a signal measured by a plurality of light receiving elements having different sensitivities is obtained. The method of synthesizing
US Patent 5789737, JP-A-59-21735
8 or US Patent 5,420,635. In these, as a means for changing the sensitivity of the light receiving element in one CCD image sensor, a method of providing filters having different transmittances on each light receiving element has been proposed.

[0014]

However, the first method requires a plurality of CCD image sensors and a complicated optical system for splitting light, which leads to an increase in manufacturing cost and apparatus scale. There were challenges.

In the second method, since information measured with different sensitivities is obtained at different times and with different time widths, a dynamic scene (light image) in which the light intensity changes every moment. ) May not be able to be imaged correctly.

Further, the third method is different from the above two methods in that the problem that the apparatus becomes complicated and the problem that it may not be possible to accurately capture a dynamic scene may be solved. Can be. However, the third
In this method, the sensitivity is controlled by setting filters with different transmittances, so that the sensitivity of each light receiving element is fixed at the time of manufacturing a CCD image sensor. There is a problem that it is difficult to variably control the enlargement ratio according to the situation.

To solve the problem that it is difficult to variably control the dynamic range expansion rate according to the situation by fixing the sensitivity of each light receiving element, Japanese Patent Application Laid-Open No. After the accumulation time, the signal of the selected column is read out, and then the electronic shutter is applied.
It is described that after a subsequent second accumulation time, the dynamic range is expanded by reading out signals in columns other than the above-mentioned columns. However, in this method, the first accumulation time and the second accumulation time are temporally separated from each other by electric charge sweeping by the electronic shutter, and a column from which electric charge is read out during the first accumulation time and a second accumulation time The imaging timing differs between the column and the column from which the charge is read. for that reason,
There has been a problem that it is not possible to accurately capture a dynamic scene in which the light intensity changes every moment.

The present invention has been made in view of such a situation, and enables the dynamic range expansion rate of a CCD image sensor to be variably controlled in accordance with the situation, so that a dynamic scene can be accurately imaged. Things.

[0019]

According to the present invention, there is provided an imaging apparatus comprising: a reading unit for reading out a charge accumulated by a light receiving element;
And controlling means for controlling the reading means to read out the electric charge accumulated by the light receiving element at an arbitrary timing while the light receiving element is receiving light.

In the control means, during the period when the light receiving element is receiving light, out of the plurality of light receiving elements, the charges accumulated by the adjacent light receiving elements are read out at different arbitrary timings. The means can be controlled.

The control means may equally divide a period in which the light receiving element is receiving light into a plurality of parts, and, during the equally divided plurality of times, each of the plurality of light receiving elements may include a first light receiving element. In the second light receiving element adjacent to the first light receiving element at an arbitrary same timing, the charge accumulated in the light receiving element at the same arbitrary timing but different from the timing of the first light receiving element May be controlled so that the reading means is repeatedly read.

A vertical transfer means for transferring the electric charge read by the reading means in a vertical direction may be further provided. The transfer of the charge by the transfer means is stopped, and the reading means can be controlled so as to read the charge accumulated by the light receiving element at an arbitrary timing.

The control means stops the transfer of charges by the vertical transfer means during a period in which the light receiving element is receiving light, and charges the charges accumulated by the adjacent light receiving element among the plurality of light receiving elements. At any different timing,
The reading means can be controlled to read.

The control means stops the transfer of electric charges by the vertical transfer means during a period in which the light receiving element is receiving light, and equally divides a period in which the light receiving element is receiving light into a plurality of parts. In the period equally divided into a plurality of light receiving elements, the first light receiving elements are arbitrarily set at the same timing for each of the plurality of light receiving elements.
In the second light-receiving element adjacent to the first light-receiving element, reading means for repeatedly reading out the electric charge accumulated in the light-receiving element at an arbitrary same timing but at a timing different from the timing of the first light-receiving element. Can be controlled.

[0025] A sweeping means for sweeping out the electric charges accumulated by all the light receiving elements may be further provided. The read charge is controlled to read out at an arbitrary timing, and the sweeping means is controlled so as to sweep out the charge accumulated by all the light receiving elements at a timing immediately thereafter, or The reading means can be controlled so as to read out the charge accumulated by the light receiving element at an arbitrary timing.

The control means includes a reading means for reading out the electric charges accumulated by the adjacent light receiving elements among the plurality of light receiving elements at different arbitrary timings during a period when the light receiving elements are receiving light. Control and
The sweeping means is controlled so as to sweep out the charges accumulated by all the light receiving elements at a timing immediately after that, or the charges accumulated by the adjacent light receiving elements among the plurality of light receiving elements are respectively different from each other. At this timing, the reading means can be controlled to read.

[0027] The control means may equally divide a period in which the light receiving element is receiving light into a plurality of parts, and, during the equally divided period, the first light receiving element among the plurality of light receiving elements. In the second light receiving element adjacent to the first light receiving element at an arbitrary same timing, the charge accumulated in the light receiving element at the same arbitrary timing but different from the timing of the first light receiving element Or the sweeping means is controlled so as to sweep out the electric charges accumulated by all the light receiving elements at the timing immediately after that, or the light receiving element receives light. Is equally divided into a plurality of periods, and during the equally divided periods, the first light receiving element adjacent to the first light receiving element at the same timing for each first light receiving element among the plurality of light receiving elements Reception of 2 The elements, albeit at any same time, can be the timing of the first light receiving element at different timings, so as to control the reading means so repeatedly read out the charges accumulated in the light receiving element.

A vertical transfer means for vertically transferring the charge read by the reading means and a sweeping means for sweeping out the charge accumulated by all the light receiving elements can be further provided. In the means, during the period when the light receiving element is receiving light, the transfer of the electric charge by the vertical transfer means is stopped, and the electric charge accumulated by the light receiving element is
The reading means is controlled so as to read out at an arbitrary timing, and the sweeping means is controlled so as to sweep out the electric charges accumulated by all the light receiving elements at a timing immediately after that, or the light receiving elements emit light. During the period of receiving light, the transfer of charges by the vertical transfer means is stopped, and the reading means can be controlled so as to read the charges accumulated by the light receiving element at an arbitrary timing.

The control means stops the transfer of charges by the vertical transfer means during a period when the light receiving element is receiving light, and charges the charges accumulated by an adjacent light receiving element among the plurality of light receiving elements. The readout means is controlled so as to read out at different arbitrary timings, and the sweeping out means is controlled so as to sweep out the electric charges accumulated by all the light receiving elements at a timing immediately thereafter, or The reading means stops the transfer of charges by the vertical transfer means during a period of receiving light, and reads out the charges accumulated by the adjacent light receiving elements among the plurality of light receiving elements at arbitrary different timings. Can be controlled.

The control means stops the transfer of charges by the vertical transfer means during a period when the light receiving element is receiving light, and equally divides a period during which the light receiving element is receiving light, In the period equally divided into a plurality of light receiving elements, the first light receiving elements are arbitrarily set at the same timing for each of the plurality of light receiving elements.
In the second light-receiving element adjacent to the first light-receiving element, reading means for repeatedly reading out the electric charge accumulated in the light-receiving element at an arbitrary same timing but at a timing different from the timing of the first light-receiving element. And the sweeping means is controlled so as to sweep out the electric charges accumulated by the plurality of light receiving elements at the timing immediately after that, or the vertical transfer is performed while the light receiving elements are receiving light. The charge transfer by the means is stopped, and the period in which the light receiving element is receiving light is divided into a plurality of evenly divided periods. At the same timing, the second light receiving element adjacent to the first light receiving element has the same timing but at a different timing from the timing of the first light receiving element. It may be so as to control the reading means so out repeatedly reading the stored charge.

According to the imaging method of the present invention, there is provided a reading step of reading out the electric charge accumulated by the light receiving element, and reading out the electric charge accumulated by the light receiving element at an arbitrary timing while the light receiving element is receiving light. And a control step of performing control so as to read out in the step processing.

In the imaging apparatus and method according to the present invention,
Control is performed so that the charge accumulated by the light receiving element is read out at an arbitrary timing while the light receiving element is receiving light.

[0033]

FIG. 2 is a diagram showing the configuration of an embodiment of a digital still camera according to the present invention. Light L from a subject (not shown) passes through the shutter 21 and the lens 22, is adjusted by the diaphragm 23, and is incident on the CCD image sensor 24 with appropriate brightness. At this time,
The lens 22 adjusts the focal position so that an image composed of light L from a not-shown subject is formed on the CCD image sensor 24.

The CCD image sensor 24 is composed of a plurality of light receiving elements (PD 8 in FIG. 12 to be described later), photoelectrically converts light L incident through the lens 22 and the aperture 23, and converts an image into an electric signal. After conversion, the CDS circuit (C
orrelated Double Sampling (correlated double sampling circuit) 25.

The CDS circuit 25 compares a signal input from the CCD image sensor 24 with a reference signal, samples the difference voltage, and uses this as a video signal as an A / D conversion circuit (Analog converter).
log / Digital conversion circuit) 26. A / D conversion circuit 2
6 converts an analog signal input from the CDS circuit 25 into a digital signal, and converts the signal into a DSP (Digital Signal Processor).
27.

The DSP 27 has a CPU (Central Processing Uni
t) is controlled by 34, converts the signal input from the A / D conversion circuit 26 into predetermined video data, and converts the signal into a D / A conversion circuit (Dig
ital / Analog conversion circuit) 30 or CODEC (Coder De
coder) 28. Also, the DSP 27 has a CODEC 28
The input video data is output to the D / A conversion circuit 30. The CODEC 28 codes the video data input from the DSP 27 by a predetermined method, stores the video data in the memory 29, reads the data stored in the memory 29, decodes the data, and outputs the decoded data to the DSP 27.

The D / A conversion circuit 30 converts a digital signal of video data input from the DSP 27 into an analog signal,
Output to the video encoder 31. Video encoder 3
1 converts the analog signal video data input from the D / A conversion circuit 30 into a predetermined video signal, outputs the video signal to the video monitor 32, and displays the video.

The CPU 34 controls the DSP 27, the CODEC 28, the memory 29, the aperture controller 35, and the timing generator 36 connected to the bus 33 of the digital still camera.

The aperture controller 35 has its control value set by the CPU 34 so that the brightness of the image sent to the DSP 27 is maintained at an appropriate level, and controls the aperture 23 according to the control value. Specifically, the CPU 34 obtains an appropriate number of brightness value samples from the image held in the DSP 27, and controls the aperture 23 so that the average value falls within a predetermined appropriate brightness range. Set the value.

The timing generator 36 includes a CPU 34
CCD image sensor 24, CDS circuit 2
5. Generate and supply timing pulses required for the operation of the A / D conversion circuit 26 and the DSP 27. Operation unit 3
Reference numeral 7 is operated when the user operates the digital still camera, and has a configuration as shown in FIG.

As shown in FIG. 3, the capture button 41 of the operation unit 37 is constituted by a push button, and is pressed by a user when capturing a still image. The action mode changeover switch 42 is a changeover switch that slides up and down for setting the action mode. The characters “record”, “off”, and “play” are displayed from the upper part in the figure, and are set. Is set to the action mode of the position that was set. In this case, the action mode switch 42 is set to the “off” position. still,
The action mode will be described later.

The exposure mode changeover switch 43 is a switch for changing over the exposure mode.
tially Varying Exposure) "and" normal "are displayed, and the exposure mode is set to the position where the switch is set. In this case, the exposure mode changeover switch 43 is set to the" normal "position. Is set.
The exposure mode will be described later.

Next, each action mode and the operation of the digital still camera for each action mode will be described with reference to FIGS. As shown in FIG. 3, when the action mode changeover switch 42 is set to the “off” position, the action mode is “off state” in the state transition diagram of FIG. 4, and the digital still camera It has been stopped.

In this state, when the action mode changeover switch 42 is slid upward and set at the position of "record" as shown in FIG. 5, the action mode is changed to the one indicated by numeral 1 in FIG. Then, the state transits from the “off state” to the “monitor state”.

In the "monitor state", in the digital still camera, as shown in FIG. 6, the CPU 34 controls the timing generator 36 to output a timing pulse for draft reading. Based on this, the CCD image sensor 24, the CDS circuit 25, the A / D conversion circuit 26, the DSP 27
Reads out a draft composed of the light L transmitted through the shutter 21, the lens 22, and the aperture 23 as an image signal in a draft, and outputs the image signal to the D / A conversion circuit 30. D / A conversion circuit 30
Converts an input image signal from a digital signal to an analog signal and outputs the signal to the video encoder 31. Further, the video encoder 31 converts the input analog signal into a video signal and causes the video monitor 32 to display the video signal. Similarly, when the action mode changeover switch 42 is returned to the “off” position, the state returns from the “monitor state” to the “off state” as indicated by reference numeral 2 in FIG.

The draft reading will be described later. In FIG. 6, in the “monitor state”, circuits involved in the operation of the digital still camera are indicated by solid lines, and circuits not directly involved in the operation are indicated by dotted lines. In the following description, illustration is performed similarly.

The action mode changeover switch 42 is
When the capture button 41 is pressed as shown in FIG. 7 in a state where it is set at the position of “record”, that is, in the “monitor state” in FIG. 4, as shown in FIG. The state changes from the “monitor state” to the “capture state”.

In the "capture state", in the digital still camera, as shown in FIG. 8, the CPU 34 controls the timing generator 36 to output a timing pulse for reading all pixels. Based on this, the CCD image sensor 24, the CDS circuit 25, the A / D conversion circuit 26, the DSP 27
Reads out an image composed of the light L transmitted through the shutter 21, the lens 22, and the diaphragm 23 for all the pixels for one frame, performs a process such as gamma correction by the DSP 27, and outputs the processed image to the CODEC 28. The CODEC 28 compresses and encodes (codes) one frame of image data input from the DSP 27 in a predetermined format, and stores it in the memory 29. Further, the “capture state” ends when this image data is written to the memory 29, and the “capture state” is denoted by reference numeral 4 in FIG.
As shown in “Capture state” to “Monitor state”
Return to

In the “monitor state”, when the user operates the action mode changeover switch 42 and sets the position to “play” as shown in FIG. 9, the digital still camera changes to the number 5 in FIG. As shown, the state transits from the “monitor state” to the “reproduction state”. Similarly, "off state"
Therefore, even if the user operates the action mode changeover switch 42 to set the digital still camera to the “play” position, the digital still camera is in the “off state” as shown by the number 7 in FIG.
The state transitions from to "playback state".

In the "playback state", in the digital still camera, as shown in FIG. 10, the CPU 34 stops the timing generator 36 and stops reading from the CCD image sensor 24. Further, the CPU 34 executes the CODEC 2
8 is controlled so that the image data stored in the memory 29 is read out, decoded, and then output to the DSP 27. The DSP 27 is controlled by the CPU 34 to
8 is subjected to a down-sampling process to adjust the image data output to the format of the video signal, and the D / A
Output to the conversion circuit 30. The D / A conversion circuit 30 includes a DSP 27
Converts the input digital signal into an analog signal,
Output to the video encoder 31. Video encoder 3
1 converts an analog signal input from the D / A conversion circuit 30 into a video signal and causes the video monitor 32 to display the video signal.

Of course, in the "reproduction state", the user operates the action mode changeover switch 42 to
When the digital still camera is set at the “record” position, the digital still camera transitions from the “playback state” to the “monitor state” as indicated by reference numeral 6 in FIG. 4, and similarly, is set at the “off” position. For example, as shown by reference numeral 8 in FIG. 4, the state transits from the “reproduction state” to the “off state”.

Next, the exposure mode will be described with reference to FIG. The exposure mode is a mode for setting the exposure state of the CCD image sensor 24, which is effective in the above "capture state", and is set independently of the action mode. "Normal mode" for the exposure mode
And "SVE mode". The “Normal mode” is an exposure mode in which the exposure time of each light receiving element (the PD 8 in FIG. 12 described later) of the CCD image sensor 24 is all constant (the sensitivity of all the light receiving elements is constant). On the other hand, the “SVE mode” is an exposure mode in which the exposure time of each light receiving element is changed in several patterns for each light receiving element.

As shown in FIG. 3, when the user operates the exposure mode changeover switch 43 and sets the exposure mode to the "normal" position, the exposure mode is set to "Normal mode" in FIG. Also, when the exposure mode changeover switch 43 shown in FIG. 3 is slid upward in the figure and set to the “SVE” position, as shown by the numeral 21 in FIG.
The exposure mode transitions to “SVE mode”. Similarly, "SVE
Mode, the exposure mode changeover switch 43 is
When returned to the “normal” position as shown in FIG.
As shown in, the exposure mode changes from "SVE mode" to "Nor
transit to "mal mode".

Next, the details of the electrode configuration of the CCD image sensor 24 will be described with reference to FIG. FIG.
In the description of the drawings after 2, parts corresponding to those in the related art are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

The first phase electrode 4 (shown by a broken line in the figure) and the second phase electrode 5 (shown by a dotted line in the figure) are arranged so as to extend in the horizontal direction. Is
It is connected to the transfer gate 61. That is, in the figure, for example, the first phase electrode 4a and the second phase electrode 5a are connected to the PDs 8a, 8a.
e, 8i are arranged in the horizontal direction so as to sandwich them from above and below. Similarly, the first phase electrode 4b and the second phase electrode 5b are arranged horizontally so as to sandwich the PDs 8b, 8f, 8j from above and below.

The third phase electrodes 6 (indicated by solid lines in the figure) are arranged to extend in the vertical direction, and are connected to the transfer gates 61 of the PDs 8 arranged in the vertical direction. That is, for example, the third phase electrode 6a is connected to the PDs 8e, 8f, 8g,
8h are connected to the transfer gates 61a, 61b, 61c, 61d. The second phase electrode 5 is provided with an upwardly projecting protrusion at the intersection with the third phase electrode 6, and a portion thereof is configured to be in contact with the transfer gate 61 (connected). ).

FIG. 13 is a cross-sectional view of a portion indicated by line AA 'of the CCD image sensor 24 shown in FIG. 12 as viewed from the left side direction in FIG. As shown in FIG. 13, the second phase electrode 5 has a step-like shape when viewed from the side, and has a structure having a step in the vertical direction in FIG. 12 (in the horizontal direction in FIG. 13). I have. FIG. 1 of the second phase electrode 5
2 (rightward in FIG. 13), the first-phase electrode 4 is arranged below the second-phase electrode 5. Further, with respect to the vertical direction (thickness direction) in FIG.
A third phase electrode 6 is provided as an uppermost layer so as to cover phase electrode 6.

The transfer gate 61 controls the PD based on a read pulse applied from the second phase electrode 5 or the third phase electrode 6.
In step 8, the photoelectrically converted and accumulated charges are vertically transferred by CCD7.
To send out. As shown in FIG. 12, the transfer gate 61
In the direction perpendicular to the junction surface with the PD 8 (in the direction in which the charge output from the PD 8 is transferred (the horizontal direction in FIG. 12)), the second layer electrode 5 and the third phase electrode 6 The electrode 5 and the third phase electrode 6 are in contact with each other (in parallel with each other).
For this reason, the transfer gate 61 is connected to the second phase electrode 5 or
When a charge reading pulse is applied from one of the third phase electrodes 6, the charge of the PD 8 is transferred to the vertical transfer CCD 7.
As shown in FIG. 12, when a charge readout pulse is applied from either the second phase electrode 5 or the third phase electrode 6, the CCD image sensor 24 from which the charge of the PD 8 is output to the vertical transfer CCD 7 is In the following description, in particular, OR type CCD
It shall be called an image sensor.

On the other hand, as shown in FIG. 14, on the transfer gate 61, the direction parallel to the junction surface with the PD 8 (the direction perpendicular to the direction in which the charge output from the PD 8 is transferred (vertical direction in FIG. 14) 2), when the second phase electrode 5 and the third phase electrode 6 are in contact with each other, the transfer gate 61
Only when a read pulse is applied from both the phase electrode 5 and the third phase electrode 6, the charge of the PD 8 is transferred to the vertical transfer CCD 7. As shown in FIG. 14, the CCD image sensor that outputs the charge of the PD 8 when the charge readout pulse is applied from both the second phase electrode 5 and the third phase electrode 6 is an AND type. It shall be called a CCD image sensor.

Next, the draft read and all pixel read of the CCD image sensor 24 will be described. As described above, the method of reading the charge of each PD 8 of the CCD image sensor 24 includes the draft reading and the all-pixel reading, and the all-pixel reading is performed by receiving all the PDs 8 of the CCD image sensor 24,
This is to output the accumulated charges. On the other hand, in the draft reading, charges are output from a part of all PDs 8.

FIG. 15 shows the state of the CC when the draft is read.
3 shows an electrical configuration of the D image sensor 24. Basically, the configuration is the same as that shown in FIG. 1 except that the second-phase power source 2 is divided into two, ie, second-phase power sources 2a and 2b. 2a is a second phase electrode 5c
And the second phase power supply 2b is connected to the second phase electrodes 5a, 5a.
b, 5d. That is, the second phase power supply 2a
And the second phase power supply 2b are connected to the second phase electrode 5 at a ratio of 1: 3. It should be noted that in FIG.
Is physically divided into two, a second phase power supply 2a and a second phase power supply 2b.
The application timing of the read pulse to each electrode is controlled so as to have the above configuration.

When the CCD image sensor 24 is of the above-mentioned OR type (configuration as shown in FIG. 12), the second phase power supply 2a (second
When only phase electrode 5c) outputs a read pulse, all PDs
Of 8, the charge is output only from PDs 8c and 8g on the corresponding line. Accordingly, at this time, electric charges are output from 1/4 of the PD 8 of the CCD image sensor 24 as a whole, so that the transfer speed of the vertical transfer CCD 7 can be quadrupled, thereby realizing high-speed processing. be able to.

This draft reading is a mode used in the “monitor state” as described above. At this time, since the digital still camera only displays (does not record) the subject imaged by the CCD image sensor 24 on the video monitor 32, the digital still camera forms an image from the charge of 1/4 of the PD 8 of the entire CCD image sensor 24. By doing so, it is possible to display the image of the subject at high speed, although the image quality is reduced.

Further, the CCD image sensor 24 performs the above-described AND operation.
Type (the configuration as shown in FIG. 14), the second phase power supply 2a
When both the third phase power supply 3 and the third phase power supply 3 output a read pulse, the charge is output only from the PDs 8c and 8g on the corresponding line.

Next, all pixel reading will be described. All-pixel reading is performed in two modes: Normal mode and SVE mode.
The operation is divided into two exposure modes. The normal mode all pixel reading is a reading method similar to the reading method executed by the conventional CCD image sensor as described above. That is, in the “capture state” in FIG. 4, this method is a method of reading out charges accumulated in all the PDs 8 of the CCD image sensor 24 over a fixed exposure time.

On the other hand, in the all-pixel reading when the exposure mode is the SVE mode, the exposure time of each PD 8 is received in several patterns, and the charges received with different sensitivities are read.

FIG. 16 shows the electrical configuration of the CCD image sensor 24 in the SVE mode. The SVE mode is also basically the same as the configuration in FIG. 1, but is different from the conventional configuration in that the second phase power supply 2 is
a, 2b, and 2c.
The phase power source 3 is also divided into two phases of third phase power sources 3a and 3b.

As shown in FIG. 16, the second phase power supply 2a
The second phase power supply 2b is connected to the second phase electrode 5a.
The second phase power supply 2c is connected to the second phase electrodes 5b and 5d, respectively. The third phase power supply 3a is connected to the third phase electrodes 6a, 6b, 6c and 6d by the third phase power supply 3b.
Are the third phase electrodes 6a to which the third phase power supply 3a is connected,
The third phase electrodes 6a ', 6b', 6c ', and 6d' are connected to rows adjacent to the rows 6b, 6c, and 6d, respectively.

By connecting in this manner, the PD 8 connected to the second phase electrode 2 can be controlled every other row in the horizontal direction, and the PD 8 connected to the third phase electrode 3 can be controlled. It is possible to control every other column in the vertical direction. For this reason, the exposure time of the PD 8 is changed into several patterns, and the charges accumulated by the PD 8 are transferred to the vertical transfer CCD.
7 can be output.

Next, referring to the timing chart of FIG. 17, the action mode changeover switch 42
The operation of the CCD image sensor 24 when the capture button 41 is pressed in a state where the capture button 41 is set to the position “d” and the exposure mode changeover switch 43 is set to the position “normal” will be described.

FIG. 17A shows a state corresponding to FIG. 4, and FIG. 17B shows the operation of the CCD image sensor 24. FIG. 17C shows the timing when the capture button 41 is pressed. FIG. 17D shows a vertical synchronization pulse output from the timing generator 36. FIG. 17 (E)
Indicates a substrate voltage control signal (reset pulse), and High indicates a state in which the reset pulse is applied. FIG. 17F shows the opening / closing timing of the shutter 21. High indicates a state where the shutter is opened, and Lo indicates a state where the shutter is opened.
w indicates a state in which the shutter is closed. FIG. 17 (G)
17 (L) show a first phase power source 1, a second phase power source 2a,
2b and 2c, a read pulse output from the third phase power supply 3a and 3b, and a transfer pulse are shown. A signal higher than the reference position (a signal shown above) indicates a read pulse, and a signal lower than the reference position (a signal shown below) indicates a transfer pulse. FIG. 17 (M)
Indicates the timing at which image data is output from the CCD image sensor 24.

At time t ₀ , when the user operates the action mode changeover switch 42 to set it to the “record” position, the digital still camera enters the “monitor state” in FIG. Begin.
At this time, as shown in FIG. 17D, a vertical synchronization pulse is output from the timing generator 36 at times t ₀ , t ₁₂ , and t ₁₄ at timings corresponding to one frame of the image to be read. At the same time, FIG.
(G) to FIG. 17 (L), the first phase power supply 1,
Transfer pulses are output from the second phase power supplies 2a, 2b, 2c and the third phase power supplies 3a, 3b. FIG. 17 (E), FIG.
As shown in FIG. 7 (H), a substrate voltage control signal and a read pulse from the second phase electrode 2a are output in synchronization with the vertical synchronization pulse (the read pulse is, to be precise,
It is output at the timing immediately before the vertical sync pulse.) The substrate voltage control signal is output from the timing generator 3
6 is a signal output from the control unit 6. While the substrate voltage control signal is being output (for example, from time t _{0 to} t ₃₁ )
Is controlled so that the charge (photoelectrically converted) generated in the PD 8 is released in the direction of the substrate, so that the charge is not stored (the stored charge is reset). The PD 8 is controlled by the substrate voltage control signal so that the PD 8 accumulates electric charges only for a certain period for each frame of a captured image.

FIG. 18 shows the "monitor state" of FIG.
Is enlarged and displayed. Here, FIG.
(A) shows the state of the digital still camera corresponding to FIG. 4, and (B) of FIG.
4 shows the operation contents. FIG. 18C shows a vertical synchronization pulse output from the timing generator 36. FIG. 18D shows the timing generator 3
6 shows a horizontal synchronizing pulse output from FIG. FIG.
(E) shows a substrate voltage control signal. FIG.
(F) shows the opening / closing timing of the shutter 21. 18 (G) to 18 (L) show the first phase power supply 1,
The read pulse and the transfer pulse output from the second phase power supplies 2a, 2b, 2c and the third phase power supplies 3a, 3b are shown. FIG. 18M shows the timing at which image data is output from the CCD image sensor 24.

As shown in FIG. 18D, the horizontal synchronizing pulse is output from the time immediately after the vertical synchronizing pulse is output (for example, time t ₁₁ ), and the total of one frame (interval of the vertical synchronizing pulse) is output. The output is equal to 1/4 of the number of horizontal lines. In the present case, as one interval of the horizontal sync pulses, for example, between the time t ₁₁ to t _62,
There are four charge transfer pulses output from each electrode. That is, in the case of the draft reading, the CCD image sensor 24, since the configuration shown in FIG. 15, the second phase electrodes 2a, for example, the read pulse is supplied at the timing of time t _11, the total of the CCD image sensor 24 PD
An electric charge is output from the PD 8 which is 1/4 of 8.

As shown in FIG. 18M, the output of the signal from the CCD image sensor 24 is the PD of the first horizontal line.
Immediately after the transfer of No. 8 is completed (time t ₄₁ = time t ₆₂ ), it ends at the time immediately before the next vertical synchronization pulse (for example, time t ₁₂ ). By such processing, time t ₄₁
Or between t _12, the image data for one frame is thinned to 1/4 relative to the total number of pixels are output, further, the process is repeated.

Next, FIG. 19 is a timing chart in which the period of the “capture state” of FIG. 17 is enlarged and displayed. Here, FIG. 19A shows a state corresponding to FIG. 4, and FIG. 19B shows the operation contents of the CCD image sensor 24. FIG. 19C shows the timing when the capture button 41 is pressed. FIG.
(D) shows a vertical synchronization pulse output from the timing generator 36. FIG. 19E shows a horizontal synchronization pulse output from the timing generator 36. FIG. 19F shows a substrate voltage control signal. FIG. 19G shows the opening / closing timing of the shutter 21. FIG. 19H to FIG.
The read pulse and the transfer pulse output from the one-phase power supply 1, the second-phase power supplies 2a, 2b, 2c, and the third-phase power supplies 3a, 3b are shown. FIG. 19N shows the timing at which image data is output from the CCD image sensor 24.

[0077] "Capture state", as shown in FIG. 19 (C), starting from the time t ₂ when the pulse ends indicating that capture button 41 has been pressed. In the “capture state”, “sweep operation”, “exposure operation”, and “all-pixel reading operation” are sequentially executed. The “sweep operation” is based on the charge accumulated in the PD 8 and the vertical transfer CCD 7,
In addition, this is an operation of releasing all the charges (charges transferred during the draft reading) accumulated in the horizontal transfer CCD 9 and, as shown in FIG. 19F, at time t ₁₆ (= t ₂ ).
From t to _t33 , the substrate voltage control signal is applied and the PD
8 is released to the substrate, and FIG.
As shown in FIG. 19 (M), all charges being transferred by the vertical transfer CCD 7 and the horizontal transfer CCD 9 are swept out.

The "exposure operation" is performed as shown in FIG.
At the time t when the “sweeping operation” ends. ₃₃Started from.
At this time, when the substrate voltage control signal becomes low
Thus, the PD 8 starts accumulating electric charges. Timing Gene
The generator 36 outputs a pulse to the CCD image sensor 24.
Since the force is controlled to stop, FIG.
As shown in FIG. 19 (M), a first phase power source 1, a second phase power source
2a, 2b, and 2c, and read from the third phase power supplies 3a and 3b.
No pulse and no transfer pulse are output. For this reason,
The vertical transfer CCD 7 stops the charge transfer (see
The charge has been swept out in the "work", so on the vertical transfer CCD7
No charge). The “exposure operation” is shown in FIG.
As shown, the shutter closes at a preset timing.
It continues to the state where it hurts.

The “all pixel read operation” is shown in FIG.
As shown, it starts from the timing when the shutter is closed.
You. Also, according to the timing of the shutter closing,
Time t ₈₁, The read pulse of the PD 8 is applied to the second phase electrode 2
Output simultaneously to all PD8 from a, 2b, 2c
(For the OR type) (for the AND type, the third phase electrode 3
a, 3b also output read pulses). Receiving this
Then, PD 8 outputs the accumulated charge to vertical transfer CCD 7.
Power. Also, the substrate voltage control signal will be in the high state.
Thus, no charge is newly stored in the PD 8.

[0080] In this state, from the time t ₁₈ where the shutter is closed, the first phase power supply 1, the second-phase power supply 2a, 2b, 2c, 3
The phase power supplies 3a and 3b output transfer pulses as many as the number of horizontal lines of the PD 8, and cause the vertical transfer CCD 7 to sequentially transfer charges output from the PD 8 to the horizontal transfer CCD 9. The first phase electrode 1, the second phase electrodes 2a, 2b, 2c, the third phase power supply 3a,
Transfer pulse output from 3b, as shown in FIG. 19 (H), the first rising pulse of the first phase electrodes, rising at time t _71, FIG. 19 (I), 19 (J), 19 ( as shown in K), the second phase electrodes 2a, 2b, falling pulse 2c is falling at time t ₈₂ (= time t ₉₁ = time t _101),
As shown in FIG. 19 (L), the rising of the pulses of the third phase electrodes 3a and 3b rises at time _t111 (= time _t121 ). Transfer CCD
7 to transfer charges. The output of the CCD image sensor 24, as shown in FIG. 19 (N), is started at time t ₁₉ the shutter is closed.

Next, the action mode changeover switch 42
Is set to the “record” position, and the exposure mode changeover switch 43 is set to the “SVE” position.
The operation of the D image sensor 24 will be described.

The basic operation is the same as the operation when the exposure mode changeover switch 43 is set to "normal". However, since only the exposure operation is different, here, when the exposure mode is the SVE mode, Will be described.

Referring to FIG. 20, CCD image sensor 2
The “exposure operation” of the SVE mode when 4 is an OR type will be described. Here, FIG. 20A shows the operation contents of the CCD image sensor 24. FIG. 20 (B)
The vertical synchronization pulse output from the timing generator 36 is shown. FIG. 20C shows a horizontal synchronization pulse output from the timing generator 36. FIG. 20D shows the substrate voltage control signal.
FIG. 20E shows the opening / closing timing of the shutter 21. 20 (F) to 20 (K) show the first phase power supply 1, the second phase power supplies 2a, 2b, 2c, and the third phase power supplies 3a, 3
2 shows a read pulse and a transfer pulse output from b. In the following description, the period of the exposure operation is set to 16 horizontal synchronization pulses for convenience of description. The amount of charge that one PD 8 can accumulate during one interval of the horizontal synchronization pulse is represented by 1Q (however, the light intensity received during the exposure operation does not change).

[0084] exposure operation, at time t _33, when started, the accumulation of charge in all PD8 is started. FIG.
Indicates the charge amount for each PD 8. Here, FIG.
(A) shows the operation content of the CCD image sensor 24. FIG. 21B shows a vertical synchronization pulse output from the timing generator 36. FIG.
(C) shows the horizontal synchronizing pulse output from the timing generator 36. FIG. 21D illustrates a substrate voltage control signal. FIGS. 21E to 21
(H) shows PDs 8a, 8b, 8e, and 8f (FIG. 16)
The amount of charge stored in the upper 2 rows × 2 columns of PDs 8) is shown. The amount of charge indicated by the thick solid line in FIG.
Indicates the amount of charge output to the vertical transfer CCD 7.

As shown in FIGS. 20 (C) and 21 (C), time t immediately before the output of the first vertical synchronization pulse is output.
_{When the} read pulse is output from the second phase power supply 2c and the third phase power supply 3a to the 151, electric charges are output from PDs 8b, 8d, 8f and 8h connected to the second phase electrodes 5b and 5d, and Connected to the third phase electrodes 6a to 6d,
Charges are output from the PDs 8a to 8d. Therefore, FIG.
(E), (F) and (H) of FIG.
The charge amount of Q is read from the PDs 8a, 8b, 8f by the vertical transfer CCD 7. At this time, since the transfer pulse is not output, the charges output from the PDs 8a, 8b, and 8f are accumulated in the polysilicon electrodes corresponding to the respective PDs 8 on the vertical transfer CCD 7. That is, in this case, the time t
_{At 151} , the PDs 8a, 8b, 8
e and 8f are PD8a: PD, respectively.
8b: PD8e: PD8f = 1Q: 1Q: 0Q: 1Q.

Immediately thereafter, as shown in FIG.
Substrate voltage control signal is applied at time t _131. As a result, as shown in FIG. 21 (E) to FIG. 21 (H), each PD
The accumulated charges are released, and the accumulated charge amount returns to zero. Then, pulses of the substrate voltage control signal, from the time t ₁₃₂ to defunct, accumulation again charges as shown in FIG. 21 (E) to FIG. 21 (H) is started.

As shown in FIGS. 20 (G) and 20 (H), at time t just before the seventh horizontal synchronization pulse is output.
_{In 141} , as shown in FIGS. 21 (E) to 21 (H),
Each PD 8 stores 6Q of charge. At this time, when read pulses are output from the second phase power supplies 2a and 2b, as shown in FIGS. 21 (E) and 20 (G), the PDs 8a and 8e connected to the second phase electrodes 2a and 2b to 6Q The charges are output to the vertical transfer CCD 7. In this case, at time t _151, it is output from PD8a, vertical transfer CCD
The electric charge of 1Q accumulated in the polysilicon electrode on the register of No. 7 is not transferred, so it is further added,
The charge of Q will be accumulated. That is, in this case, at time t _141, on the vertical transfer CCD7 is, PD 8
The charges output from a, 8b, 8e, and 8f are PD8a: PD8b: PD8e: PD8f = 7Q: 1Q: 6, respectively.
Q: Accumulated like 1Q.

[0088] At time t ₁₃₃ immediately thereafter, as shown in FIG. 20 (D), pulse substrate voltage control signal, is input as shown in FIG. 21, the amount of charge accumulated in all the PD8 is Return to zero. And the pulse of the substrate voltage control signal is
From the time t ₁₃₄ when the light disappears, FIGS.
As shown in (H), charge accumulation is started again.

[0089] Further, at time t ₁₆₁ immediately before the period of exposure operation is completed, each PD 8, so that the charge amount of 9Q are accumulated. At this time, when the read pulse is output again from the third phase power supply 3a, FIG.
As shown in (F), the charge of 9Q is output from the PDs 8a and 8b connected to the third phase electrodes 6a and 6b. That is, in this case, at time t _161, on the vertical transfer CCD7 is, PD8a, 8b, 8e, output charge from 8f, respectively, PD8a: PD8b: PD8e: PD8
f = 16Q: 10Q: 6Q: 1Q.

Therefore, with the above-described configuration, it is possible to set different exposure times, that is, different sensitivities, for the adjacent 2 × 2 PDs 8. In this case, PD8
a: PD8b: PD8e: PD8f = 4 of 16: 10: 6: 1
It is possible to set different types of exposure time. FIG.
In the case of 1, the change in the charge amount is detected by the PDs 8a, 8b, 8e, 8
f, but a similar change in the amount of charge
This also occurs in c, 8d, 8g, and 8h. Therefore,
Four rows of exposure time (four types of sensitivities) patterns can be created by the blocks of PD8 of 2 rows × 2 columns. Of course, by changing the timing with the read pulse from the electrode, the setting of the four types of exposure time (sensitivity) can be changed in various ways, and further, by changing the timing of the substrate voltage control signal. This pattern can be varied.

In the above description, the exposure time has been described as being equal to 16 horizontal synchronization pulses. However, for example, the exposure time may be increased so that the pattern of the read pulse and the substrate voltage control signal as shown in FIG. May be repeated. Further, in the above example, the case where the pulse of the substrate voltage control signal is input at the timing immediately after the read pulse has been described, but only the read pulse may be used.

Further, as shown in FIG. 22, the frequency of the horizontal synchronization pulse is increased (the interval between the horizontal synchronization pulses is reduced), and the read pulse and the substrate voltage control as shown in FIG. The signal pattern may be temporally compressed and repeated a plurality of times.

[0093] That is, a read pulse in FIG. 20 (I), the time t ₁₅₁ in FIG. 20 (J), as shown in FIG. 22 (I), the read pulse time t _201, t _202, t ₂₀₃ of FIG. 22 (J) The pulses of the substrate voltage control signals at times t ₁₃₁ and t ₁₃₃ in FIG. _20D correspond to the pulses at times t ₁₇₁ , t ₁₇₂ , t ₁₇₄ , and t ₁₇₅ in FIG. The read pulse at time t ₁₄₁ in FIGS. 20 (G) and 20 (H) corresponds to the time t ₁₈₁ in FIGS. 22 (G) and 22 (H).
corresponding to the read pulse of t _182. As shown in the timing chart shown in FIG. 20 and the timing chart shown in FIG. 22, the control timing of the CCD image sensor 24 is different. By controlling the CCD image sensor 24 at the timing shown in FIG. 22, the timing shown in FIG. so
Rather than controlling the CCD image sensor 24, the electric charge output from each PD 8 can be dispersed and detected evenly in the time from the start to the end of the exposure time.
However, in each case, the exposure time (sensitivity) of each PD 8 during the exposure operation is the same.

Next, referring to the timing chart of FIG. 23, when the CCD image sensor 24 is of the AND type,
The exposure operation in the E mode will be described. Here, FIG.
(A) shows the operation content of the CCD image sensor 24. FIG. 23B shows a vertical synchronization pulse output from the timing generator 36. FIG.
(C) shows the horizontal synchronizing pulse output from the timing generator 36. FIG. 23D shows a substrate voltage control signal. FIG. 23E shows the shutter 2
1 shows the opening / closing timing. FIGS. 23F to 23K show the first phase power supply 1, the second phase power supplies 2a and 2b,
2c shows a read pulse and a transfer pulse output from the third phase power supplies 3a and 3b.

[0095] exposure operation, when it is started at time t _33, the charge accumulation in all PD8 is started. FIG.
The state of charge accumulation for each PD 8 is shown. Here, FIG.
FIG. 4A shows the operation content of the CCD image sensor. FIG. 24B shows a vertical synchronization pulse output from the timing generator 36. FIG. 24 (C)
Indicates a horizontal synchronization pulse output from the timing generator 36. FIG. 24D shows a substrate voltage control signal. FIG. 24E to FIG.
The amount of charge stored in PDs 8a, 8b, 8e, and 8f is shown.

As shown in FIGS. 23 (I) and 23 (J), the time t immediately before the first vertical synchronization pulse is output
_{When the 231} causes the second phase power supply 2c and the third phase power supply 3a to output read pulses, electric charges are output from the PD 8b connected to the second phase electrodes 5b and 5d and the third phase electrodes 6b and 6d. Therefore, as shown in FIG. 24 (F), the 1Q charge is read from the PD 8b to the vertical transfer CCD 7. That is, in this case, at time t _231, on the vertical transfer CCD7 is, PD8a, 8b, 8e, output charge from 8f,
PD8a: PD8b: PD8e: PD8f = 0Q: 1 respectively
It is accumulated like Q: 0Q: 0Q.

[0097] Consequently, PD8b Since the outputs accumulated charge, accumulated charge amount returns to zero, restarts the accumulation of charge from immediately after time t _231.

For example, as shown in FIG. 23 (G), FIG. 23 (H), and FIG. 23 (K), at time t ₂₂₁ immediately before the third horizontal synchronizing pulse is output, the PDs 8a, 8e, 8f 24, the charge amount of 3Q is stored as shown in FIGS. 24 (E), 24 (G), and 24 (H). At this time, when read pulses are output from the second phase power supplies 2a and 2b and the third phase power supply 3b, as shown in FIG.
3Q charges are output to the vertical transfer CCD 7 from the PD 8e connected to the second phase electrodes 5a, 5b and the third phase electrodes 6a ', 6b'. That is, in this case, at time t _221, on the vertical transfer CCD7 is, PD8a, 8b, 8e, 8f
PD8a: PD8b: PD
8e: PD8f = 0Q: 1Q: 3Q: 0Q.

[0099] Further, as shown in FIG. 23 (G), FIG. 23 (H), FIG. 23 (J), at time t ₂₂₃ immediately before the horizontal sync pulses of the ninth is output, PD8a, the 8f 24 (E) and FIG. 24 (H), the electric charge of 8Q is accumulated. At this time, the second phase power supply 2
When read pulses are output from the third phase power supply 3a, the second phase electrodes 5a and 5b as shown in FIG.
Then, the charge of 8Q is output from the PD 8a connected to the third phase electrodes 6a and 6b. That is, in this case, at time t _223, on the vertical transfer CCD7 is, PD8a, 8
b, 8e, and 8f are output from PD8
a: PD8b: PD8e: PD8f = 8Q: 1Q: 3Q: 0Q are accumulated.

As shown in FIGS. 23 (I) and 23 (K), at time _t233 immediately before the end of the period of the exposure operation,
As shown in FIG. 24H, a charge amount of 16Q is stored in the PD 8f. At this time, when the read pulse is output from the second phase power supply 2c and the third phase power supply 3b, as shown in FIG. 24H, the charge of 16Q is output from the PD 8f connected to the third phase electrode 3a. Will be. That is, in this case, at time t _233, on the vertical transfer CCD7 is, PD8a, 8b, 8e, output charge from 8f, respectively, PD8a: PD8b: PD8e: PD8
f = 8Q: 1Q: 3Q: 16Q.

In the period of this exposure operation, as described above,
Since the vertical transfer CCD 7 has stopped transferring charges,
The electric charge output from 8 is accumulated on the vertical transfer CCD 7. That is, with the above-described configuration, the adjacent PDs 8 can set different exposure times, that is, different sensitivities. In this case, PD8
a: PD8b: PD8e: PD8f = 8: 1: 3: 16 Four types of exposure time can be set. Note that FIG.
, The change in the charge amount is detected by the PDs 8a, 8b, 8e, and 8f.
Has been shown, but a similar change in the charge amount is PD8
This also occurs in c, 8d, 8g, and 8h. Therefore,
Four rows of exposure time (four types of sensitivities) patterns can be created by the blocks of PD8 of 2 rows × 2 columns. Of course, the setting of the four types of exposure time (sensitivity) can be changed in various ways by changing the timing of the read pulse from the electrode.

Further, in the above description, the exposure time is described as 16 horizontal synchronization pulses. However, for example, the exposure time is extended and the read pulse pattern shown in FIG. 23 is repeated. Is also good. In the above example, the sensitivity of the PD 8 is controlled only by the read pulse. However, the sensitivity may be controlled by a combination of the read pulse and the pulse of the substrate voltage control signal.

Further, as shown in FIG. 25, by increasing the frequency of the horizontal synchronizing pulse and compressing the pattern of the read pulse and the substrate voltage control signal as shown in FIG. It may be repeated a plurality of times.

That is, the read pulse at time t ₂₃₁ in FIGS. 23 (I) and 23 (J) is the read pulse at time t ₂₆₁ , t ₂₆₃ , t ₂₆₅ and t ₂₆₇ in FIGS. 25 (I) and (J). 23 (G), FIG. 23 (H), and FIG. 23 (K) show read pulses at time t ₂₂₁ shown in FIG.
(H), time t ₂₅₁ (= t ₂₈₁ ), t _{253 in FIG.}
(= T ₂₈₃ ). FIG.
(G), FIG. 23 (H) and FIG. 23 (J) show the read pulse at time t ₂₂₃ as shown in FIG. 25 (G), FIG. 25 (H) and FIG.
This corresponds to read pulses at times t ₂₅₂ (= t ₂₇₁ ) and t ₂₅₄ (= t ₂₇₂ ) in (J). As shown in the timing chart shown in FIG. 23 and the timing chart shown in FIG.
The control timing of the CCD image sensor 24 is different, and by controlling the CCD image sensor 24 at the timing shown in FIG. 24, the control of the CCD image sensor 24 at the timing shown in FIG. The electric charge output from each PD 8 can be dispersed over time, and can be detected evenly. However,
The exposure time (sensitivity) of each PD 8 during the exposure operation is the same.

As described above, in any of the OR type and AND type CCD image sensors 24, the sensitivity pattern of the adjacent PD 8 is changed electronically by the combination of the read pulse and the timing of the substrate voltage control signal. Can be varied in various ways. In particular, in this example, by controlling the second phase power supply 2 into three and the third phase electrode into two, the PD8 sets four kinds of sensitivity patterns in units of 2 rows × 2 columns. The second phase electrode 2 and the third phase electrode 3
May be further divided into a plurality of patterns, so that more patterns of the sensitivity of the PD 8 may be set.

Next, the CCD image sensor 2 as described above
The operation of the DSP 27 for processing the image signal generated by the DSP 4 will be described. In describing the operation of the DSP 27, a method of expressing coordinates indicating each pixel position of an image input to the DSP 27 will be defined with reference to FIG.

As shown in FIG. 26, an origin 71 is set at the lower left end of the image. Also, the upper right end is the coordinates (xSize, ySize). Here, xSize represents the width of the image, and ySize represents the height of the image. Each pixel 72 displays pixel data captured by each PD 8 described above, and is represented by a square in the figure. Also, the height and width of the pixel are assumed to be 1 on the coordinates. Accordingly, the center position of the pixel 72a at the lower left end shown in FIG. 26 is indicated by coordinates (0.5, 0.5). Similarly, the center position of the pixel 72a 'at the upper right end is indicated by coordinates (xSize-0.5, ySize-0.5).

The black circles in the figure indicate the intermediate pixels 7 of each pixel.
3 is shown, for example, in the lower left intermediate pixel position 73a.
Is indicated by coordinates (1, 1). The intermediate pixel 7
Reference numeral 3 denotes pixel data virtually existing between pixels (indicated by squares in the figure) of actual data obtained by the PD 8 and is introduced in the subsequent processing.

Next, the configuration of the DSP 27 will be described with reference to FIG.

The capture image data storage 81 of the DSP 27 is fetched by the CCD image sensor 24,
The pixel data Ic processed by the DS circuit 25 and the A / D conversion circuit 26 is stored. The position generator 82 is a DSP
27, a counter for the coordinates of the pixel data Ic read in the x and y directions is built in, thereby sequentially generating pixel positions. An LUT (Look-up table) 83 stores data for executing gamma correction processing in the pixel data Ic of the captured image data storage. Also, SV
Gamma correction data corresponding to the setting of the exposure time of each PD 8 is stored in correspondence with the E-mode imaging.

[0111] The luminance correction processing section 84 controls the pixel data I stored in the capture image data storage 81.
c is read out, and a pixel position (x, y) corresponding to the pixel data Ic input from the position generator 82 is read out.
, Generates gamma-corrected pixel data Io (x, y) (or pixel (Im (x, y)) with reference to the LUT 83, via the switch 86 which is controlled in conjunction with the exposure mode changeover switch 43. In the normal mode, the pixel data Io (x, y) is output to the output pixel data storage 93. In the SVE mode, the pixel data Im (x, y) is output.
Is output to the luminance correction pixel data storage 87.

In the sensitivity pattern data storage 85, the SV
Data of sensitivity of each pixel in the E mode (data of exposure time of each pixel, that is, exposure time of each PD 8) is stored.
For example, in the SVE mode, when a plain image (uniform pixel value) is captured, as shown in FIG. 28, a 2 × 2 pixel block 101 having four types of sensitivity patterns is provided.
Image 10 in which a is arranged by a predetermined number in the vertical and horizontal directions
1 is generated. Sensitivity pattern data storage 85
Stores data of four sensitivity patterns corresponding to each pixel of the pixel block 101a. The luminance correction pixel data storage 87 stores the pixel data Im (x, y) output from the luminance correction processing unit 84.

The pseudo inverse matrix processing section 88 stores the pixel data Im (x,
y) and the coordinate data generated by the position generator 89, intermediate pixel (luminance) data B (x, y) used in the interpolation processing in the interpolation processing unit 91 is generated using a predetermined interpolation filter, It is stored in the intermediate pixel data storage 90.

The interpolation processing section 91 calculates the intermediate pixel data B (x, y) stored in the intermediate pixel data storage 90,
The pixel data Io (x, y) of the output image is generated by interpolation using the above-mentioned predetermined interpolation filter from the coordinate position generated by the position generator 92, and stored in the output pixel data storage 93.

Next, the operation of the DSP 27 in the normal mode will be described with reference to the flowchart of FIG.

In step S1, when the exposure mode changeover switch 43 is set to the "normal" position,
Switch 86 is connected to terminal 86a.

In step S2, the position generator 82 initializes the built-in x and y counter values to 0.5. In step S3, the brightness correction processing unit 84 reads out the pixel data Ic from the captured image data storage.

In step S4, the luminance correction processing section 8
4 is the pixel data Ic read out with reference to the LUT 83.
The LUT data corresponding to the luminance value of is read.

In step S5, the brightness correction processing section 8
4 indicates pixel data I based on the read LUT data.
c to generate output pixel data Io and output it to the output pixel data storage 93. That is, for example, first output data is pixel data Io (0.5, 0.5)
It turns out that.

In step S6, the position generator 82 increments the built-in counter value of x by one. In step S7, the position generator 82 determines whether or not x> xSize−0.5. That is, it is determined whether or not the counter value of x exceeds the maximum value in the width direction of the image. If it is determined that x does not exceed xSize−0.5, the process returns to step S3.

If it is determined in step S7 that x has exceeded xSize-0.5, the position generator 82 returns the counter value of x to 0.5 in step S8. In step S9, the position generator 8
2 increments the counter value of y by one. In step S10, the position generator 82
Determines whether or not y> ySize−0.5, that is, whether or not the counter value of y has exceeded the maximum value in the height direction of the image. Returning to the process of step S3, the subsequent processes are repeated. If it is determined in step S7 that y has exceeded ySize-0.5, the process ends.

As described above, in the "normal mode"
In the DSP processing, gamma correction (luminance correction processing) is performed on each pixel using the LUT 83, and output.

Next, the operation of the DSP 27 in the SVE mode will be described with reference to the flowchart of FIG.

In step S21, when the exposure mode changeover switch 43 is set to the "SVE" position,
Switch 86 is connected to terminal 86b. Step S2
In 2, the brightness correction processing unit 84 of the DSP 27 executes a brightness correction process in the SVE mode.

Here, the brightness correction processing in the SVE mode will be described with reference to the flowchart in FIG.

In step S31, the position generator 82 counts the built-in x and y counter values.
Initialize to 0.5. In step S32, the position generator 82 reads the pixel data Ic from the capture image data storage 81, and reads the pixel data Ic from the coordinate data of the position generator 82.
Generate (x, y).

In step S33, the luminance correction processing unit 84 refers to the sensitivity pattern data storage 85, and picks up the PD 8
Is read, and the LUT data stored in the LUT 83 corresponding to the sensitivity is selected. In step S34,
The luminance correction processing unit 84 converts the selected LUT data into the LUT 84
Read from In step S35, the luminance correction processing unit 84 performs luminance correction processing on the pixel data Ic (x, y) based on the read data of the LUT 84, generates pixel data Im (x, y), Output to the data storage 87.

In step S36, the position generator 82 increments the counter value of x by one. In step S37, the position generator 82 determines whether or not the counter value of x exceeds xSize-0.5, and if not, returns to step S32 and repeats the subsequent processing. It is.

If it is determined in step S37 that the counter value of x has exceeded xSize-0.5, the process proceeds to step S37.
At 38, the position generator 82 returns the counter value of x to 0.5. In step S39, the position generator 82 increments the counter value of y by one. In step S40, the position generator 82 sets the counter value of y to ySize-0.
It is determined whether or not the number exceeds 5, and if it is determined that the number exceeds 5, the processing is terminated. If it is determined in step S40 that the counter value of y has not exceeded ySize-0.5, the process returns to step S32 and
Subsequent processing is repeated.

That is, in the luminance correction processing in the SVE mode, gamma correction processing according to the sensitivity of each pixel is performed.

Now, let us return to the description of the flowchart in FIG.

In step S23, the DSP 27 executes a pseudo inverse matrix process.

Here, the pseudo inverse matrix processing will be described with reference to the flowchart in FIG.

In step S51, the position generator 89 sets the x and y counter values indicating the coordinates of the intermediate pixel to 2. In step S52, S,
The counter value of W is set to 0. Note that the counter value S,
W will be described later.

In step S53, the position generator 89 sets the luminance correction pixel data (= Im (u, u,
v)) the counter values u and v indicating the pixel positions are expressed by u = x−
1.5 and v = y-1.5 are calculated and obtained. In this case, x = y =
Since it is 2, u = 0.5 and v = 0.5.

In step S54, the pseudo inverse matrix processing section 88 reads the pixel data Im (u, v) stored in the luminance correction pixel data storage 87. In this case, what is read is the pixel data Im (0.5, 0.5), and the image data of the pixel 72a shown in FIG. 33 is read. Note that FIG. 33 shows luminance-corrected image data.

In step S55, the pixel data Im
(U, v) (luminance value) is the noise level threshold θ of the PD 8
Greater than _L, determines whether the range smaller than the threshold value theta _H saturation level PD 8. That is, the pixel data I
It is determined whether or not the luminance value of m (0.5, 0.5) (= the luminance value of the pixel 72a) is within an appropriate range.

In step S56, the pseudo inverse matrix processing section 88 calculates the counter values i and j indicating the positions of the matrix elements of the interpolation filter φ as follows.

I = u- (x-1.5) j = v- (y-1.5)

Therefore, in this case, i = 0 (= 0.5− (2−
0.5)), j = 0 (= 0.5− (2−0.5)).

In step S57, the pseudo-inverse matrix processing section 88 calculates the following equations (1) and (2) and stores them in a built-in memory.

[0142]

(Equation 1)

[0143]

(Equation 2)

Here, φ _ij is a general interpolation filter as shown in FIG. That is, in this case, S, W
Is calculated as follows. In FIG. 34,
The horizontal coordinate is represented by i, and the vertical coordinate is j
Is represented by

[0145] _{^{S = 0 + (φ 2 00}} × φ 00 × Im (0.5,0.5)) / (φ 2 00 + φ 2 01 + ··· φ 2 32 + φ 2 33) = ((0.043) 2 × 0.043 × ^{Im (0.5,0.5)) /((0.043) 2} + (- 0.661) 2 + ··· (-0.661) 2 + (0.043) 2) W = φ 2 00 = (0.043) 2

At step S58, the position generator 89 increments the counter value of u by one. That is, in this case, u is 1.5. In step S59, the position generator 89
It is determined whether the counter value of u is greater than x + 1.5. In this case, since x + 1.5 = 3.5, u (= 1.5)
Is determined to be smaller than x + 1.5, and the process returns to step S54.

In step S54, the pseudo inverse matrix processing section 88 reads the pixel data Im (u, v) from the luminance correction pixel data storage 87. In this case, the pixel data Im (1.5, 0.5) of the pixel 72b shown in FIG. 33 is read.

Hereinafter, similarly to the above, steps S56, S
57 and S58 are repeated, and if it is determined in step S59 that u is greater than x + 1.5, that is, if it is determined that the processing of the pixels 72a to 72d in FIG. 33 has been completed, in step S60 , The position generator 89 increments v by one. That is, in this case, the counter value of v is 1.5. In step S61, the position generator 89 sets the counter value of u to x-1.5. Step S6
In 2, the position generator 89 determines whether or not the counter value of v exceeds y + 1.5, and if it determines that the counter value does not exceed y + 1.5, the process returns to step S54.

If it is determined in step S62 that the counter value of v is larger than y + 1.5, the process proceeds to step S62.
In 63, the pseudo inverse matrix processing unit 88 calculates S / W, and stores the calculation result in the intermediate pixel data storage 90 as intermediate pixel data B (x, y). That is, in this case, using the pixel data Im of the pixels 72a to 72p forming the block of 4 rows × 4 columns shown in FIG. 33, the pixel is positioned at the center of the block by the least squares method (= S / W). Pixel data B of the intermediate pixel 73f
(2, 2) will be required.

In step S64, the position generator 89 increments the counter value of x by one. In step S65, the pseudo inverse matrix processing unit 8
8 determines whether the counter value of x is larger than xSize−2, that is, whether the counter value of x exceeds the right end in the width direction of the image data, and determines that the counter value of x is larger than xSize−2. If not, the process proceeds to step S5.
2 and the subsequent processing is repeated. If it is determined in step S65 that the counter value of x is larger than xSize−2, the process proceeds to step S65.
Proceed to 66.

In step S66, the position generator 89 returns the counter value of x to 2. In step S67, the position generator 89 increments the counter value of y by one. Step S6
At 8, the position generator 89 determines whether the counter value of y has exceeded ySize−2, that is, whether it has exceeded the end of the image data in the height direction. If it is determined that −2 has been exceeded, the processing is terminated. Also, in step S68, y
Is determined not to exceed ySize−2, the process ends.

Therefore, in the pseudo inverse matrix processing, the image data Im (x, y) stored in the luminance correction pixel data storage 87 is used in units of 4 rows × 4 columns, and the intermediate pixel located at the center thereof is used. 73 intermediate pixel data B (x, y)
Seeking.

That is, the pixels 72a to 72p in FIG.
, The intermediate pixel data B (2,
2) is calculated by the least squares method (= S / W) from each pixel data Im of a block of pixels 72a to 72p in FIG. 33, which are pixels of 4 rows × 4 columns in the vicinity. next,
By shifting the block of the pixel data Im of 4 rows × 4 columns by one to the right (in the x direction), the intermediate pixels 7 are shifted in the same manner.
3 g of pixel data B (3, 2) is obtained, and this is sequentially repeated rightward. When this processing is performed up to the width direction of the image, the position of the block of the pixel data Im of 4 rows × 4 columns is returned to the original position in the x direction (x = 2), and the block is returned in the height direction (in the y direction). The pixel data B (2, 3) of the intermediate pixel 73j is obtained by shifting by one. Hereinafter, by repeating this operation, the pixel data B (x, y) of the intermediate pixel 73 of the entire image data is obtained and stored in the intermediate pixel data storage 90.

Now, let us return to the description of the flowchart in FIG.

In step S24, the DSP 27 performs an interpolation process.

Here, the interpolation processing will be described with reference to the flowchart in FIG.

In step S81, the position generator 92 sets the x and y counter values to 2.5. In step S82, the position generator 92 outputs the counter value i, j for setting the matrix position of the interpolation filter φ (FIG. 34) and the output pixel data Io (x−2, y).
-2) is set to 0.

In step S83, the interpolation processing section 91
Is the intermediate pixel data from the intermediate pixel data storage 90.
Read B (x-1.5 + i, y-1.5 + j) and execute the following operation.

Io (x-2, y-2) = Io (x-2, y-2)
y-2) + B (x-1.5 + i, y-1.5 + j) φ _ij

In this case, the operation is performed as follows.

Io (0.5,0.5) = 0 + B (1,1) × 0.0
43

In step S84, the position generator 92 increments the counter value of i by one. In step S85, the position generator 92 determines whether or not i is 3 or less. In this case, since i is 1, i is determined to be 3 or less, and the process returns to step S83.

In step S83, the interpolation processing section 91
Performs the following operation:

Io (0.5,0.5) = B (1,1) × 0.043 +
B (2,1) × (−0.661)

In step S84, the position generator 92 increments the counter value of i by one. In step S85, the interpolation processing unit 91
It is determined whether or not i is 3 or less. In this case, i is
Since it is 2, i is determined to be 3 or less, and the process returns to step S83.

Thereafter, steps S83 to S8 are repeated until it is determined in step S85 that i is not smaller than 3.
Step 5 is repeated.

If it is determined in step S85 that i is not equal to or less than 3, in step S86, the position generator 92 increments the counter value of j by 1 and returns the counter value of i to 0.

In step S87, it is determined whether the counter value of j is 3 or less. If it is determined that it is 3 or less, the process returns to step S83. If it is determined in step S87 that the counter value of j is not smaller than 3, in step S88, the interpolation processing unit 91 outputs the output image data Io (x−2, y) at that time.
-2) is output to the output pixel data storage 93 and stored.

In step S89, the position generator 92 increments the counter value of x by one. In step S90, the position generator 92 determines whether or not the counter value of x exceeds xSize-2.5. If it is determined that the counter value of x does not exceed xSize-2.5, the process proceeds to step S82. Return to

If it is determined in step S90 that the counter value of x exceeds xSize−2.5, in step S91, the position generator 92 increments the counter value of j by one. Step S9
In step 2, the position generator 92 determines whether or not the counter value of y exceeds ySize−2.5. If it is determined that the counter value does not exceed ySize−2.5, the process proceeds to step S8.
Returning to step 2, if it is determined that the value has been exceeded, the process is terminated.

That is, by repeating the processing of steps S83 to S86, for example, the processing by the interpolation filter φ shown in FIG. 34 is performed on the pixel data B of the intermediate pixels 73a to 73p shown in FIG. By this processing, in this case, the pixel data Io (2.5, 2.5) corresponding to the pixel 72k in FIG. 33 is output.
By repeating this, output pixel data Io of the entire screen is generated (here, the pixel 72 in FIG. 33 is an output pixel).

Since the output pixel data Io is calculated from the intermediate pixel data B, the output pixel data Io has an offset of 2 in each of the x direction and the y direction. As a result, I
The coordinate position of o is offset by 2 (for example, Io (2.5, 2.5) becomes Io (2.5−2, 2.5−
2) will be offset).

As described above, in the “SVE mode”, since the sensitivity of each pixel is different, it is necessary to standardize the luminance value (pixel data) of each pixel according to the sensitivity. Are non-uniform, the luminance value may be buried in the noise level or may be saturated.In some cases, the original luminance value cannot be restored by normalization alone. The pixel value is estimated using the pseudo inverse matrix.

According to the above, since the PD 8 (light receiving element) receives light and accumulates electric charge, the accumulated electric charge is read out at an arbitrary timing. Can be set, and the period for accumulating the charges between the light receiving elements can be made the same. As a result, it is possible to perform imaging in a wide dynamic range suitable for a dynamic scene.

[0175]

According to the imaging apparatus and method of the present invention,
During the period when the light receiving element is receiving light, the charge accumulated by the light receiving element is controlled to be read out at an arbitrary timing, so that different sensitivities can be set for each light receiving element. Imaging with a wide dynamic range suitable for a typical scene.

[Brief description of the drawings]

FIG. 1 is a diagram showing an electrical configuration of a conventional CCD image sensor.

FIG. 2 is a block diagram of a digital still camera to which the present invention is applied.

FIG. 3 is a diagram showing an operation unit of FIG. 2;

FIG. 4 is a state diagram illustrating an action mode of the digital still camera of FIG. 2;

FIG. 5 is a diagram showing an operation unit of FIG. 2;

FIG. 6 is a block diagram of a digital still camera to which the present invention has been applied.

FIG. 7 is a diagram showing an operation unit of FIG. 2;

FIG. 8 is a block diagram of a digital still camera to which the present invention is applied.

FIG. 9 is a diagram showing an operation unit of FIG. 2;

FIG. 10 is a block diagram of a digital still camera to which the present invention is applied.

11 is a state diagram illustrating an exposure mode of the digital still camera in FIG.

FIG. 12 is a diagram showing an electrode configuration of the CCD image sensor of FIG. 2;

FIG. 13 is a diagram illustrating an electrode configuration of the CCD image sensor of FIG. 2;

FIG. 14 is a diagram illustrating an electrode configuration of the CCD image sensor of FIG. 2;

FIG. 15 is a diagram illustrating an electrical configuration of the CCD image sensor of FIG. 2;

FIG. 16 is a diagram showing an electrical configuration of the CCD image sensor of FIG. 2;

FIG. 17 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 18 is a timing chart illustrating the operation of the CCD image sensor of FIG.

FIG. 19 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 20 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 21 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 22 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 23 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 24 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

FIG. 25 is a timing chart illustrating the operation of the CCD image sensor of FIG. 2;

26 is a diagram illustrating the coordinate positions of pixels and intermediate pixels of an image captured by the digital still camera in FIG. 2;

FIG. 27 is a block diagram showing a configuration of the DSP of FIG. 2;

FIG. 28 is a diagram illustrating a pattern of pixel sensitivity.

FIG. 29 is a flowchart illustrating DSP processing in Normal mode.

FIG. 30 is a flowchart illustrating DSP processing in the SVE mode.

FIG. 31 is a flowchart illustrating a luminance correction process in an SVE mode.

FIG. 32 is a flowchart illustrating processing of a pseudo inverse matrix.

FIG. 33 is a diagram illustrating the relationship between pixels and intermediate pixels.

FIG. 34 is a diagram illustrating an example of an interpolation filter.

FIG. 35 is a flowchart illustrating an interpolation process.

[Explanation of symbols]

1 first phase power supply, 2, 2a, 2b, 2c second phase power supply,
3, 3a, 3b third phase power supply, 4, 4a to 4d first
Phase electrode, 5, 5a to 5d second phase electrode, 6, 6a to 6d third phase electrode, 7, 7a, 7b vertical transfer CCD,
8, 8a to 8l PD, 9 horizontal transfer CCD, 21 lens, 22 aperture, 23 CCD image sensor, 24 CD
S, 26 DSP, 33 CPU, 35 timing generator, 41 capture button, 42 action mode switch, 43 exposure mode switch, 61,
61a to 61h transfer gate

Claims (13)

[Claims] 1. An image pickup apparatus using a plurality of light receiving elements for receiving light, photoelectrically converting the received light, and accumulating electric charges, wherein: a reading means for reading out electric charges accumulated by the light receiving elements; An imaging device comprising: a control unit that controls the reading unit to read out the charge accumulated by the light receiving element at an arbitrary timing during a period in which the light receiving unit receives light. 2. The control unit according to claim 2, wherein, during a period in which the light receiving element is receiving light, charges accumulated by the adjacent light receiving elements of the plurality of light receiving elements are respectively different at arbitrary timings. The imaging apparatus according to claim 1, wherein the reading unit is controlled to read. 3. The control unit divides a period during which the light receiving element receives light into a plurality of equal parts, and sets the first light receiving element of the plurality of light receiving elements into the plurality of equally divided periods.
At the same timing for each of the light receiving elements,
In the second light-receiving element adjacent to the light-receiving element, the read-out is performed such that the charge accumulated in the light-receiving element is repeatedly read out at the same timing but at a timing different from the timing of the first light-receiving element. The imaging device according to claim 1, wherein the control unit controls the means. 4. The apparatus according to claim 1, further comprising: a vertical transfer unit configured to transfer a charge read by the read unit in a vertical direction, wherein the control unit controls the vertical transfer unit during a period when the light receiving element is receiving light. 2. The image pickup apparatus according to claim 1, wherein the transfer of the electric charges by the control unit is stopped, and the reading unit is controlled so as to read out the electric charges accumulated by the light receiving element at an arbitrary timing. 5. The control means stops the transfer of electric charges by the vertical transfer means during a period when the light receiving element is receiving light, and stores the electric charge by an adjacent light receiving element among the plurality of light receiving elements. The imaging apparatus according to claim 4, wherein the reading unit is controlled so as to read the obtained charges at different arbitrary timings. 6. The control means stops the transfer of charges by the vertical transfer means during a period when the light receiving element is receiving light, and uniformly controls a plurality of periods during which the light receiving element is receiving light. And the second light receiving element adjacent to the first light receiving element at the same timing for each of the first light receiving elements among the plurality of light receiving elements during the equally divided plurality of light receiving elements. In the element, the reading means is controlled so as to repeatedly read out the electric charge accumulated in the light receiving element at an arbitrary timing different from the timing of the first light receiving element. Item 5. The imaging device according to Item 4. 7. A light-emitting device, further comprising: a sweeping unit for sweeping out charges accumulated by all of the light-receiving elements, wherein the control means controls a charge accumulated by the light-receiving elements during a period in which the light-receiving elements are receiving light. Controlling the readout means to read out at an arbitrary timing, and controlling the sweeping means to sweep out the charges accumulated by all the light receiving elements at a timing immediately thereafter, or 2. The image pickup apparatus according to claim 1, wherein the reading unit is controlled so as to read out the charge accumulated by the light receiving element at an arbitrary timing. 8. The control unit reads out the electric charges accumulated by the adjacent light receiving elements of the plurality of light receiving elements at different arbitrary timings while the light receiving elements are receiving light. Controlling the readout means, and controlling the sweeping means so as to sweep out the electric charges accumulated by all the light receiving elements at a timing immediately after that, or, among the plurality of light receiving elements, The charge accumulated by the adjacent light receiving element,
The imaging apparatus according to claim 7, wherein the reading unit is controlled so as to read at different arbitrary timings. 9. The control unit divides a period in which the light receiving element is receiving light into a plurality of equal parts, and sets the first light receiving element of the plurality of light receiving elements into the plurality of equally divided periods.
At the same timing for each of the light receiving elements,
In the second light-receiving element adjacent to the light-receiving element, the read-out is performed such that the charge accumulated in the light-receiving element is repeatedly read out at the same timing but at a timing different from the timing of the first light-receiving element. Controlling the means, and controlling the sweeping means so as to sweep out the electric charges accumulated by all the light receiving elements at a timing immediately thereafter, or a period during which the light receiving elements receive light. Is divided into a plurality of light-receiving elements, and the plurality of light-receiving elements are adjacent to the first light-receiving element at an arbitrary same timing for each of the first light-receiving elements during the equally divided plurality of light-receiving elements. In the second light receiving element, the charges accumulated in the light receiving element are repeatedly read out at the same arbitrary timing but at a timing different from the timing of the first light receiving element. The imaging apparatus according to claim 7, characterized in that to control the urchin said reading means. 10. The image processing apparatus according to claim 1, further comprising: a vertical transfer unit configured to transfer the charges read by the reading unit in a vertical direction; and a sweeping unit configured to sweep out charges accumulated by all of the light receiving elements. While the light receiving element is receiving light, the vertical transfer means stops transferring charges, and controls the reading means to read out the charges accumulated by the light receiving element at an arbitrary timing. And, controlling the sweeping means so as to sweep out the electric charges accumulated by all the light receiving elements at a timing immediately after that, or during the period when the light receiving elements are receiving light,
Stop the transfer of the electric charge by the vertical transfer means, the electric charge accumulated by the light receiving element, at an arbitrary timing,
The imaging apparatus according to claim 1, wherein the reading unit is controlled to read. 11. The control means stops the transfer of electric charges by the vertical transfer means during a period in which the light receiving element is receiving light, and accumulates the charges by an adjacent light receiving element among the plurality of light receiving elements. The readout means is controlled so as to read out the stored charges at different arbitrary timings, and the sweeping means is controlled so as to sweep out the charges accumulated by all the light receiving elements at a timing immediately thereafter. Or, during the period when the light receiving element is receiving light, stop the transfer of the electric charge by the vertical transfer means, of the plurality of light receiving elements, the electric charge accumulated by the adjacent light receiving element, The imaging apparatus according to claim 10, wherein the reading unit is controlled so as to read at different arbitrary timings. 12. The control means stops the transfer of charges by the vertical transfer means during a period when the light receiving element is receiving light, and uniformly controls a plurality of periods during which the light receiving element is receiving light. And the second light receiving element adjacent to the first light receiving element at the same timing for each of the first light receiving elements among the plurality of light receiving elements during the equally divided plurality of light receiving elements. In the element, the read means is controlled so as to repeatedly read out the electric charge accumulated in the light receiving element at an arbitrary timing different from the timing of the first light receiving element, and immediately thereafter. Controlling the sweeping means to sweep out the charges accumulated by the plurality of light receiving elements at the timing of
Alternatively, during the period in which the light receiving element is receiving light, the transfer of charges by the vertical transfer means is stopped, and the period in which the light receiving element is receiving light is divided into a plurality of parts, and In the divided period, the second light-receiving element adjacent to the first light-receiving element at any one of the plurality of light-receiving elements has the same timing at any one of the plurality of light-receiving elements. 11. The imaging apparatus according to claim 10, wherein the reading unit is controlled so as to repeatedly read out the charge accumulated in the light receiving element at a timing different from the timing of the first light receiving element. 13. An imaging method for an imaging device using a plurality of light receiving elements for receiving light and photoelectrically converting the received light to accumulate charges, wherein a reading step of reading the charges accumulated by the light receiving elements; A control step of controlling the electric charge accumulated by the light receiving element to be read in the processing of the reading step at an arbitrary timing during a period in which the light receiving element is receiving light. Imaging method.