JP2000023046A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a moving picture and a high-quality still picture with an image pickup device that reads all pixels. SOLUTION: In this image pickup device 109, a light receiving part 1a in which photoelectric transducers are two-dimensionally arranged is provided with a color filter that has color components of Ye, G, Ye, Mg,... in odd lines and with a color filter that has color components of Cy, Mg, Cy, G,... in even lines. A vertical transfer part 1b independently transfers signal charge outputted from these PDs in a vertical direction. A pixel mixture control horizontal transfer part 1 h mixes two horizontal pixels and transfers them in moving picture mode and independently transfers each pixel in a still picture mode. And, pixel pairs of odd and even lines are added and are converted into a luminance signal and the pixel pairs of the odd and even lines are subtracted and are converted into a color-difference signal. Thus, the drive frequency of the image pickup device can be reduced at the time of generating a pixel signal of progressive scanning in the moving picture mode.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image pickup apparatus relating to a method for generating moving images and still images.

[0002]

2. Description of the Related Art Conventionally, an imaging apparatus capable of shooting both a moving image and a high-quality still image is disclosed in Japanese Patent Application Laid-Open No. 9-327.
No. 025 is known. This has an image pickup device (CCD) configured to read out all pixels independently by sequential scanning, and is provided with a color filter of a type that mixes signals between two vertical lines to image. In the video mode, pseudo interlacing is performed by mixing signals between two vertical lines in the horizontal CCD.
A 2: 1 interlaced moving image is captured. In the still image mode, signals of two vertical lines are not mixed and read independently to capture a high-quality still image.

[0003] Further, as for an image pickup apparatus for performing efficient signal processing in the case of picking up a still image and a moving image using a CCD of the all-pixel readout system, there is known an image pickup device described in Japanese Patent Application Laid-Open No. 9-83874. Have been. Here, when the mode selection switch is set to the moving image mode, the CCD captures one frame image in one field period. Then, the video signal is processed by the camera signal processing circuit and then processed by the video signal processing circuit. At this time, a moving image is generated by the image memory, the memory address control circuit, and the memory input buffer control circuit provided in the imaging device, using pixel data of one line at a time from successive different frame images. In the still image mode, signal processing is performed to obtain a high quality still image using pixel data of the same frame.

FIG. 34A shows the structure of the above-mentioned interlace driving CCD, and FIG.
This is shown in FIG. In FIG. 34, each of the imaging devices includes a light receiving unit 1a, a vertical transfer unit 1b, a horizontal transfer unit 1c, a charge detection amplifier 1d, and an output circuit 1e.
In the interlaced drive CCD shown in FIG. 34A, the charge signal accumulated in all the pixels of the CCD during one field period of the television signal (about 1/60 second in the case of the video signal of the NTSC standard). In order to read out, charge signals of two pixels adjacent in the vertical direction are mixed, and this mixed pair is switched in a field. Next, in the all-pixel reading CCD shown in FIG. 34B, the number of stages of the vertical transfer unit 1b is doubled as compared with the CCD of FIG. 34A, so that pixels of one frame (one screen) are sequentially scanned. Are read independently without mixing.

[0005] When such an all-pixel readout CCD is used, a signal of one screen can be output without mixing signals of pixels adjacent in the vertical direction, so that a high vertical resolution can be obtained. However, when a signal is read out at the same frequency as the interlaced drive CCD, a 2: 1 interlaced field image cannot be output.

[0006]

In such an image pickup apparatus as described above, in order to obtain a still image, by sequentially scanning all pixel readout CCDs, signals between two vertical lines are read out independently without mixing. A high-quality still image can be obtained. Also, by pseudo-interlaced drive,
Moving images can be obtained. However, a high-quality moving image cannot be obtained by the sequential scanning signal.

On the other hand, in both the moving image mode and the still image mode,
There has also been proposed an imaging apparatus configured to capture one frame image from an all-pixel readout CCD in one field period. In this imaging apparatus, when pixel signals in the moving image mode are read out by sequential scanning, a reading frequency twice as high as that of interlaced reading is required, and there is a problem that the high-frequency characteristics of the CCD and the analog circuit must be improved. In addition, there is a problem that power consumption increases due to high frequency driving of the signal processing circuit.

As described above, in the conventional image pickup apparatus, even when the image pickup element of the all-pixel readout method is used, since the image pickup element is pseudo-interlacedly driven in the moving image mode, high image quality is obtained by the sequential scanning signal. Moving images cannot be obtained. Further, in the moving image mode, when signals are read out by sequential scanning using an image sensor of the all-pixels reading method, a read frequency twice as high as that of interlaced read is required. Also in this case, there is a problem that the high-frequency characteristics of the image sensor and the analog circuit must be improved. In addition, there is a problem that power consumption increases due to high frequency driving of the signal processing circuit.

SUMMARY OF THE INVENTION The present invention has been made in view of such a conventional problem, and realizes an imaging apparatus capable of outputting a video signal having a high vertical resolution by a progressive scanning signal in both a still image mode and a moving image mode. The purpose is to:

[0010]

According to a first aspect of the present invention, a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction for photoelectrically converting an image of a subject, and a plurality of photoelectric conversion elements arranged in a vertical direction are provided. Vertical charge transfer means for sequentially and independently transferring the charge information of the photoelectric conversion elements in the vertical direction; and outputting the pixel signals by mixing the charge information transferred by the vertical charge transfer means in units of a plurality of pixels in the horizontal direction. And a pixel mixing means.

According to a second aspect of the present invention, in the image pickup apparatus of the first aspect, the pixel mixing means comprises a pixel mixing signal processing circuit for mixing output signals of the photoelectric conversion elements in units of a plurality of pixels in a horizontal direction. It is characterized by being performed.

According to a third aspect of the present invention, in the image pickup apparatus according to the first aspect, the pixel mixing means mixes and transfers the charge information obtained by the vertical charge transfer means in units of a plurality of pixels in the horizontal direction. It is characterized by being constituted by horizontal charge transfer means.

The invention of claim 4 of the present application is the invention of claim 2 or 3
In the imaging apparatus of (1), the pixel mixing means is configured to include a pixel mixing control means for changing a combination of mixing in units of a plurality of pixels at regular intervals.

According to a fifth aspect of the present invention, in the imaging device of the fourth aspect, the pixel mixing control means changes a combination of a plurality of pixel units for each field.

According to the first to fifth aspects of the present invention,
In an imaging device in which at least one of the driving frequency of the image sensor and the signal processing frequency is reduced, it is possible to obtain a progressively scanned video signal.

According to a sixth aspect of the present invention, there is provided color separation optical means for separating image pickup light coming from a subject for each color component,
In order to photoelectrically convert the image of the subject obtained by the color separation optical means, a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction, and a vertical direction for sequentially transferring the charge information of the photoelectric conversion elements in the vertical direction. A plurality of imaging elements formed with charge transfer means, and a pixel mixing means for mixing the charge information transferred by the vertical charge transfer means of the imaging element in a plurality of pixels in the horizontal direction and outputting a pixel signal, A plurality of image pickup devices, wherein a combination of pixels is different for each of a plurality of pixels.

According to a seventh aspect of the present invention, in the imaging device of the sixth aspect, the vertical charge transfer means transfers charge information of the photoelectric conversion element independently in a vertical direction. is there.

According to the sixth and seventh aspects of the present invention,
In an image pickup apparatus having a plurality of image pickup devices, it is possible to obtain a progressively scanned video signal with a reduced drive frequency of the image pickup device, resulting in a high-resolution signal in the horizontal and vertical directions.

According to an eighth aspect of the present invention, in order to photoelectrically convert an image of a subject, a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction, and charge information of the photoelectric conversion elements arranged in a vertical direction. Vertical charge transfer means for sequentially and independently transferring in a vertical direction, charge information transferred by the vertical charge transfer means, a pixel mixing means for outputting one pixel unit or a plurality of pixel units in the horizontal direction, And a mode setting means for setting a moving image mode and a high image quality mode for the mixing means, wherein when the moving image mode is set by the mode setting means, the pixel mixing means sequentially outputs a plurality of pixel units. A scanning video signal is created, and when the high image quality mode is set by the mode setting unit, a scanning video signal is created sequentially from one pixel output by the pixel mixing unit. It is intended to.

According to a ninth aspect of the present invention, in the imaging apparatus of the eighth aspect, the pixel mixing means has a horizontal charge transfer means for transferring the charge information obtained by the vertical charge transfer means in a horizontal direction. In the moving image mode, the horizontal charge transfer means transfers the charge information by mixing a plurality of pixels in the horizontal direction, and transfers the charge information independently in the horizontal direction in the high image quality mode.

According to a tenth aspect of the present invention, in the imaging device of the eighth aspect, the pixel mixing means has a pixel mixing signal processing circuit for mixing output signals of the photoelectric conversion elements in a horizontal direction, The pixel mixing signal processing circuit is characterized in that in the moving image mode, the output signal of the photoelectric conversion element is mixed by a plurality of pixels in the horizontal direction.

According to the configuration of the present invention, a video signal of progressive scanning can be obtained in the moving image mode even if the driving frequency of the image pickup device is reduced. It is possible to obtain a high quality image.

According to the eleventh aspect of the present invention, there are provided four color filters C1, C2, C3, C3 having spectral characteristics different from each other.
4 is a color filter element two-dimensionally arranged in a predetermined order, and a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction for photoelectrically converting an image of a subject obtained through the color filter element. Vertical charge transfer means for sequentially and vertically independently transferring the charge information of the photoelectric conversion elements arranged in the vertical direction, and the charge information transferred by the vertical charge transfer means in a plurality of pixel units in the horizontal direction. Pixel mixing means for mixing and outputting horizontal charge information;
It is characterized by having.

According to a twelfth aspect of the present invention, in the imaging device of the eleventh aspect, the pixel mixing means includes a pixel mixing control means for changing a combination of a plurality of pixels for each field. It is characterized by the following.

According to the configuration described in claims 11 and 12 of the present application, it is possible to obtain a sequentially-scanned color signal in an imaging apparatus in which the driving frequency of an imaging element having a color filter is reduced.

According to a thirteenth aspect of the present invention, there are provided four color filters C1, C2, C3, C3 having different spectral characteristics.
4 is a color filter element two-dimensionally arranged in a predetermined order, and a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction for photoelectrically converting an image of a subject obtained through the color filter element. Vertical charge transfer means for sequentially transferring the charge information of the photoelectric conversion elements arranged in the vertical direction independently in the vertical direction, and the charge information transferred by the vertical charge transfer means in a plurality of pixel units in the horizontal direction. Pixel mixing means for mixing and outputting horizontal charge information;
Mixing pixel signal processing means for generating a progressive scanning video signal from the pixel signal output from the pixel mixing means, wherein the pixel mixing means converts the charge information obtained by the vertical charge transfer means in the horizontal direction. And a horizontal charge transfer means for mixing and transferring in a horizontal direction in units of a plurality of pixels.

According to the configuration described in claim 13 of the present application, in an image pickup apparatus in which the driving frequency of an image pickup device having a color filter is reduced, a color signal for progressive scanning can be obtained by simple signal processing.

According to the invention of claim 14 of the present application, four color filters C1, C2, C3, C3 having different spectral characteristics from each other are provided.
4 is a color filter element two-dimensionally arranged in a predetermined order, and a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction for photoelectrically converting an image of a subject obtained through the color filter element. Vertical charge transfer means for sequentially and vertically independently transferring the charge information of the photoelectric conversion elements arranged in the vertical direction, and one or more pixels in the horizontal direction for transferring the charge information obtained by the vertical charge transfer means. Horizontal charge transfer means for transferring pixels in a horizontal direction, mixed pixel signal processing means for generating a progressively scanned video signal from a plurality of pixel signals output from the horizontal charge transfer means, and output from the horizontal charge transfer means An independent pixel signal processing unit configured to generate a video signal of progressive scanning from each one pixel signal; and a mode setting unit configured to set a moving image mode and a high image quality mode. When the moving image mode is set by the setting means, a video signal of progressive scanning is created from the output pixels of the mixed pixel signal processing means, and when the high image quality mode is set by the mode setting means, the independent pixel signal processing means In which a video signal of progressive scanning is created from the output pixels of (1) and (2).

The invention of claim 15 of the present application is directed to claims 11 to
14. In the imaging device according to any one of items 14, the color filters C1, C2, C3, and C4 may be C1 and C3 and C2 and C3.
4 are vertically adjacent, C1 and C3 are arranged in a two-pixel cycle both in the vertical and horizontal directions, C2 and C4 are arranged in a two-pixel cycle in the vertical direction, and are vertically arranged in a two-pixel cycle in the horizontal direction. Is reversed.

The invention of claim 16 of the present application is directed to claims 11 to
15. In the imaging device according to any one of Items 15, the color filters C1, C2, C3, and C4 may be Ye, Mg, Cy,
G.

The invention of claim 17 of the present application is directed to claims 11 to
15. In the imaging device according to any one of Items 15, the color filters C1, C2, C3, and C4 are respectively Ye, Wh, Cy,
G.

The invention of claim 18 of the present application is directed to claims 13 to
18. The imaging device according to any one of items 17 to 17, wherein the mixed pixel signal processing means performs arithmetic processing on a pixel mixed output signal in a vertical direction.

The invention of claim 19 of the present application is directed to claims 13 to
17. The image pickup apparatus according to any one of claims 17, wherein the mixed pixel signal processing means generates a luminance signal by performing a low frequency pass filter process in the vertical direction of the pixel mixed output signal, and generates a high frequency signal in the vertical direction of the pixel mixed output signal. A color signal is created by frequency pass filter processing.

The invention of claim 20 of the present application is directed to claims 14 to
17. In the imaging device according to any one of items 17, the independent pixel signal processing means may output pixel signals continuous in the horizontal direction to S1,
.., Sn (n: natural number), adding means for adding two adjacent signals Si, Si + 1, and output signals S1 + S2, S2 + S3,.
An arithmetic processing circuit for calculating Sn-1 + Sn in the vertical direction;
It is characterized by having.

The invention of claim 21 of the present application is directed to claims 14 to
17. In the imaging device according to any one of items 17, the independent pixel signal processing means may output pixel signals continuous in the horizontal direction to S1,
.., Sn (n: natural number), there is an adding means for adding two adjacent signals Si and Si + 1, and the output signals S1 + S2, S2 + S3,.
A luminance signal is created by low-pass filter processing in the vertical direction of Sn-1, + Sn, and a chrominance signal is created by high-pass filter processing in the vertical direction of the output signal of the pixel mixing means. Is what you do.

According to the above construction, in the imaging apparatus in which the driving frequency of the imaging device having the color filter is reduced, in the moving image mode, even if the driving frequency of the imaging device is reduced, the video signal of the progressive scanning is reduced. In the high image quality mode, it is possible to obtain high quality images in both the horizontal and vertical directions.

The invention of claim 22 of the present application is directed to claims 1-2.
2. The imaging device according to claim 1, wherein the photoelectric conversion element photoelectrically converts 640 horizontal pixels and 480 vertical pixels.

The invention of claim 23 of the present application is directed to claims 1-2.
2. The imaging device according to any one of 1 to 3, wherein the photoelectric conversion element photoelectrically converts 1024 horizontal pixels and 768 vertical pixels.

The invention of claim 24 of the present application is directed to claims 1-2.
2. The imaging device according to claim 1, wherein the photoelectric conversion element photoelectrically converts 1280 horizontal pixels and 960 vertical pixels.

[0040]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an imaging device according to each embodiment of the present invention will be described with reference to the drawings. (Embodiment 1) An imaging apparatus according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 is an overall configuration diagram of an imaging device according to the present embodiment. This imaging apparatus includes a lens 101, an imaging element 102, an imaging element driving circuit 103, an analog signal processing circuit 104,
A digital conversion circuit (hereinafter simply referred to as A / D) 105;
The digital signal processing circuit 106 is included. FIG. 2 shows the configuration of the image sensor 102. In FIG. 2, the same portions as those of the image sensor shown in FIG. 34 are denoted by the same reference numerals.

The image sensor 102 has a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction as a light receiving section 1a in order to photoelectrically convert an image of a subject. Also, a vertical transfer section 1b is formed as a vertical charge transfer means for sequentially and independently transferring the charge information of the photoelectric conversion elements arranged in the vertical direction in the vertical direction. The difference from the image sensor 201 in FIG. 34B is that a pixel-mixing horizontal transfer section 1f is provided as horizontal charge transfer means. The pixel mixing horizontal transfer unit 1f has a function of a pixel mixing unit that mixes the charge information transferred by the vertical charge transfer unit in a plurality of pixels in the horizontal direction and outputs a pixel signal.

In the image pickup apparatus having such a configuration, an image of a subject that has passed through the lens 101 is formed on the image pickup device 102. The image sensor 102 performs photoelectric conversion by driving the image sensor driving circuit 103 and outputs an image signal. Next, the analog signal processing circuit 104 performs processing such as noise removal and amplification, and the A / D 105 converts the imaging signal into a digital signal. The digital signal processing circuit 106 receives a digital image pickup signal, creates and outputs a video signal such as a luminance signal.

Here, the operation of the image sensor 102 will be described. In the image sensor shown in FIG. 2, charge signals of vertically adjacent pixels (light receiving sections 1a) are not mixed, but are transferred to the pixel mixed horizontal transfer section 1f via the vertical transfer section 1b. At this time, the pixel mixing horizontal transfer unit 1f mixes signals of two pixels adjacent in the horizontal direction and transfers the signals in the horizontal direction.
Then, an imaging signal is output via the charge detection amplifier 1d and the output circuit 1e. The driving frequency of the image sensor at this time is as follows. That is, since the pixel signal is read out by the sequential scanning, the vertical transfer frequency (fvp) is twice as high as the vertical transfer frequency (fvi) at the time of the interlaced readout, but since the number of horizontal transfer stages is 、, The horizontal transfer frequency (fhp) is equal to the horizontal transfer frequency (fhi) at the time of interlaced reading.

As a specific example, VGA (640H × 480)
V), when the driving frequency (= horizontal transfer frequency) at the time of interlaced reading is about 12 MHz, the driving frequency at the time of ordinary sequential scanning reading is doubled to about 24M.
Hz. On the other hand, the driving frequency at the time of horizontal pixel mixed sequential scanning reading in this embodiment is about 12 MHz.
And driving at a frequency equal to the driving frequency at the time of interlaced reading is enabled. FIGS. 3 and 4 show such a relationship between driving frequencies.

FIG. 3A shows a vertical transfer reference signal, a horizontal transfer reference signal, and a pixel transfer clock in the case of the interlaced read drive, and the reference of the first line to the 262.5th line in the first one field period. A signal is output. The interval between the lines is approximately (1/15750) sec, and the frequency of the pixel transfer clock during this period is 12 MHz. On the other hand, FIG. 3B shows a vertical transfer reference signal, a horizontal transfer reference signal, and a pixel transfer clock in the case of horizontal pixel independent sequential scanning (all-pixel read driving). Here, the reference signals of the first line to the 525th line are output in each field period. And the interval between each line is about (1/31500) sec,
The frequency of the pixel transfer clock at this time is 24 MHz. FIG. 4C shows the operation of the present embodiment, and shows the relationship among a vertical transfer reference signal, a horizontal transfer reference signal, and a pixel transfer clock in the case of horizontal pixel mixed sequential scanning (all-pixel read driving). The reference signals of the first to 525th lines are output during each field period, and the frequency of the pixel transfer clock is 12 MHz.

The reduction of the driving frequency is more effective as the number of pixels of the image sensor increases, and SXGA (1280H × 960)
V), when the driving frequency (= horizontal transfer frequency) at the time of interlaced reading is about 48 MHz, the driving frequency at the time of ordinary sequential scanning reading is doubled to about 96 MHz.
On the other hand, the driving frequency at the time of horizontal pixel mixed sequential scanning reading of this embodiment is about 48 MHz. In this manner, a signal independent in the vertical direction of 60 frames (screen) per second, that is, a pixel signal having a high vertical resolution, is generated at the same driving frequency as that for generating a signal of 30 frames per second (= 60 fields). be able to.

As described above, in the present embodiment, the pixel signals of the image sensor are independently transferred in the vertical direction at the same driving frequency as in the case of interlaced reading, and two adjacent horizontal pixels are mixed and horizontally transferred. . When an NTSC standard video signal is generated, one field period (1/60 [se
c)), it is possible to output independent pixel signals in one frame (screen) in the vertical direction. Further, it is possible to generate a pixel signal having low power consumption and high vertical resolution by using an image sensor, an analog signal processing circuit, and an A / D having a conventional frequency characteristic. In this way, a progressive image of 60 frames per second can be obtained.

(Embodiment 2) Next, an image pickup apparatus according to Embodiment 2 of the present invention will be described. FIG. 5 is an overall configuration diagram showing the configuration of the imaging apparatus according to the present embodiment, and the same parts as those in the first embodiment are denoted by the same reference numerals. The feature of this imaging device is that the
That is, a normal all-pixel readout imaging device 201 shown in FIG. The image pickup signal of the image pickup device 201 is output to the horizontal two-pixel mixing circuit 202. The horizontal two-pixel mixing circuit 202 is a pixel mixing signal processing circuit that mixes signals of two pixels in the horizontal direction, has a function of the above-described pixel mixing unit, and has a configuration shown in FIG. The operation timing of the horizontal two-pixel mixing circuit 202 is shown in FIG.

As shown in FIG. 6A, the horizontal two-pixel mixing circuit 202 includes a one-pixel delay circuit 301 and an addition circuit 30.
2. It is composed of a sampling circuit 303. FIG.
As shown in (b), the output signal of the image sensor is supplied to the one-pixel delay circuit 301 and is delayed by one pixel period. Then, the output signal of the image sensor and the delay signal are added by the addition circuit 302. Next, in the sampling circuit 303, one of the continuous addition signals is thinned out periodically.

In the image pickup apparatus according to the present embodiment thus configured, the all-pixel readout image pickup device 201 shown in FIG.
Scans sequentially by driving the image sensor driving circuit 203 to generate an image signal. The horizontal two-pixel mixing circuit 202 receives the image signal and converts the signal amount in the horizontal direction to １ ／. Therefore, the frequency band of the pixel signal is also halved. The imaging signal whose frequency band has been reduced to さ れ is input to the analog signal processing circuit 104, where processing such as noise removal and amplification is performed. The A / D 105 converts an output signal of the analog signal processing circuit 104 into a digital signal and supplies the digital signal to the digital signal processing circuit 106. Digital signal processing circuit 10
Reference numeral 6 creates and outputs a video signal such as a luminance signal.

As described above, sequential scanning readout is performed by using a normal all-pixel readout image pickup element, and pixel signals independent in the vertical direction of 60 frames (screen) per second are created. Then, the output signal of this image sensor is converted to a horizontal two-pixel mixing circuit 20.
2 to mix two pixels in the horizontal direction. This makes it possible to create a video signal having low power consumption and high vertical resolution using the conventional analog signal processing circuit and A / D.

The imaging apparatus according to the second embodiment may be configured as follows. FIG. 7 is a block diagram illustrating another configuration example of the imaging device according to Embodiment 2.
Parts corresponding to those shown in FIG. 5 are denoted by the same reference numerals. The feature of this imaging device is that the imaging device 201
(B) a normal all-pixel readout imaging device shown in FIG.
The image signal of the image sensor 201 is supplied to the A / D 105 via the analog signal processing circuit 104, and two pixels are mixed in the horizontal direction in the state of a digital signal. Therefore, a horizontal two-pixel mixing block 402 is provided inside the digital signal processing circuit 401 as a pixel mixing signal processing circuit.

FIG. 8A shows an example of the configuration of the horizontal two-pixel mixing block 402.
FIG. 8 (b) shows the operation timing. As shown in FIG. 8A, the horizontal two-pixel mixing block 402 includes a one-pixel digital delay circuit 501, an addition circuit 502, and a sub-sampling circuit 503. Then, as shown in FIG. 8B, the A / D output signal is delayed by one pixel period in the one-pixel digital delay circuit 501, and the output signal of the image sensor and the delay signal are added in the addition circuit 502. Then, the sub-sampling circuit 503 samples the added signal every two pixels, and outputs a video signal.

As described above, in the image pickup apparatus shown in FIG.
Scanning is performed sequentially by the drive of No. 3 to generate an image pickup signal.
When this image pickup signal is given to the horizontal two-pixel mixing block 402, the signal amount in the horizontal direction becomes １ ／ and the frequency band of the signal also becomes ２. As described above, in the digital signal processing circuit 401, a video signal such as a luminance signal is created from a digital signal whose frequency band is reduced to half.

As described above, sequential scanning readout is performed by using a normal all-pixel readout image pickup device, and pixel signals independent in the vertical direction of 60 frames (screen) per second are created. The pixel signal is supplied to a horizontal two-pixel mixing block 402 in the digital signal processing circuit 401, and the two-pixel signal is mixed in the horizontal direction. Thus, the power consumption of the digital signal processing circuit 401 is reduced, and a video signal having a high vertical resolution can be created.

As described above, in the second embodiment, sequential scanning readout is performed using a normal all-pixel readout imaging device, and pixel signals of the imaging device are independently transferred in the vertical direction. When a video signal of the NTSC standard is generated, it is possible to obtain one frame (screen) of vertically independent pixel signals in one field period (1/60 [sec]). Thus, a video signal having low power consumption and high vertical resolution can be created. In addition, a progressive image of 60 frames can be obtained.

(Embodiment 3) Next, an image pickup apparatus according to Embodiment 3 of the present invention will be described. FIG. 9 is an overall configuration diagram showing the configuration of the imaging apparatus according to the present embodiment. The same parts as those in the first embodiment will be described with the same reference numerals. A feature of this imaging device is that the imaging device drive control circuit 107 is provided as pixel mixing control means or pixel mixing means in order to control the imaging device drive circuit 103. 10 and 11 show the configuration and operation of the image sensor 102. In this figure, the same parts as those in the first embodiment are denoted by the same reference numerals.
Unlike the imaging device of the first embodiment, a variable pixel horizontal transfer section 1g is provided as horizontal charge transfer means.

In the image pickup apparatus according to the present embodiment thus configured, an image of a subject that has passed through the lens 101 is formed by the image pickup device 102. The image sensor driving circuit 103 drives the image sensor 102 under the control of the drive control circuit 107. Then, the image sensor 102 performs photoelectric conversion and outputs an image signal. The analog signal processing circuit 104 receives the imaging signal and performs processing such as noise removal and amplification. A /
D105 converts the output signal of the analog signal processing circuit 104 into a digital signal and supplies the digital signal to the digital signal processing circuit 106. Then, the digital signal processing circuit 106 creates and outputs a video signal such as a luminance signal.

Here, the operation of the image sensor drive control circuit 107 will be described with reference to FIGS. In the image sensor 102, similarly to FIG. 2, the charge signals of the vertically adjacent pixels (light receiving section 1a) are not mixed, but are transferred to the pixel mixing variable horizontal transfer section 1g via the vertical transfer section 1b. At this time, the pixel-mixing variable horizontal transfer unit 1g mixes signals of two pixels adjacent in the horizontal direction and transfers the signals in the horizontal direction. This signal is output as an imaging signal via the charge detection amplifier 1d and the output circuit 1e. At this time, the image sensor drive control circuit 107 switches a pair of mixed signals of two pixels adjacent in the horizontal direction at a predetermined timing. For example, as shown in FIGS. 10 and 11, the mixed pair is switched between the first field and the second field every one field period.

As described above, by switching the mixed pair for each field, the spatial position of the pixel mixed signal is shifted by one pixel in the horizontal direction. In the interlacing process in the vertical direction, the resolution in the horizontal direction can be improved in the same manner as the vertical resolution is improved by the integration effect of the eyes.

As described above, in the present embodiment, the pixel signals of the image sensor are independently transferred in the vertical direction at the same driving frequency as that at the time of interlaced reading, and two adjacent horizontal pixels are mixed and horizontally transferred. . In this way, when an NTSC standard video signal is generated, one field period (1/60 [s]
ec]), it is possible to obtain pixel signals independent in one frame (screen) in the vertical direction. Then, a pixel signal having low power consumption and high vertical resolution can be created by using an image sensor, an analog signal processing circuit, and an A / D having a conventional frequency characteristic. Further, by switching the mixed pair of horizontal pixels for each field, the horizontal resolution can be improved.

(Embodiment 4) Next, an image pickup apparatus according to Embodiment 4 of the present invention will be described. FIG. 12 is an overall configuration diagram showing the configuration of an imaging apparatus according to the present embodiment, and the same parts as those in the second embodiment will be described with the same reference numerals.
The feature of this imaging apparatus is that a horizontal two-pixel mixing circuit 204 is provided, and a pixel mixing control circuit 205 for controlling this circuit is provided as pixel mixing control means. The other blocks are substantially the same as those shown in FIG. 5, and a description of those components will be omitted. A configuration example of the horizontal two-pixel mixing circuit 204 shown in FIG. 12 is shown in a block diagram of FIG. 14 and 15 show the operation timing of the horizontal two-pixel mixing circuit 204.

As shown in FIG. 13, the horizontal two-pixel mixing circuit 204 includes a one-pixel delay circuit 301, an addition circuit 302, and a variable sampling circuit 304. As shown in FIGS. 14 and 15, the one-pixel delay circuit 301 delays the output signals S1, S2, S3,. The addition circuit 302 outputs the output signal Si + 1 of the image sensor.
And the delay signal Si. Variable sampling circuit 3
Numeral 04 extracts the added signal by changing the sampling point every two pixels. At this time, a pair of addition signals of two pixels adjacent in the horizontal direction is switched at a predetermined timing under the control of the pixel mixing control circuit 205. For example, as shown in FIGS. 14 and 15, the mixed pair is switched between the first field and the second field every one field period.

In the image pickup apparatus configured as described above, the all-pixel readout image pickup element 201 sequentially scans by driving the image pickup element drive circuit 203 and outputs an image pickup signal. When this image pickup signal is input to the horizontal two-pixel mixing circuit 204, the signal amount in the horizontal direction becomes ２ and the frequency band of the signal also becomes １ ／. Thus, the frequency band is １ ／
Is input to the analog signal processing circuit 104, processing such as noise removal and amplification is performed. The output signal of the analog signal processing circuit 104 is converted into a digital signal by the A / D 105. Then, the digital signal processing circuit 106 receives the digital image pickup signal, creates and outputs a video signal such as a luminance signal.

As described above, the sequential scanning readout is performed by using the normal all-pixel readout image pickup device, and an output signal independent in the vertical direction of one frame (screen) is generated in one field period (1/60 [sec]). I do. Then, the output signal of the image pickup device is supplied to a horizontal two-pixel mixing circuit 202 to mix two pixels in the horizontal direction. By doing so, a video signal having low power consumption and high vertical resolution can be created using a conventional analog signal processing circuit and A / D.
Further, by switching the mixed pair for each field, the spatial position of the added signal can be shifted by one pixel in the horizontal direction, and the vertical resolution in the interlacing process in the vertical direction is improved by the eye integration effect. In addition, the resolution in the horizontal direction can be improved.

The imaging apparatus according to the present embodiment can be configured as shown in FIG. In the imaging device of FIG. 16, the same reference numerals are given to portions corresponding to the blocks shown in FIG. A feature of this imaging apparatus is that a horizontal two-pixel mixing block 404 is provided inside the digital signal processing circuit 403, and this block is controlled by a pixel mixing control circuit 405 as pixel mixing control means. The function of the block is substantially the same as in FIG.

FIG. 17 shows an example of the configuration of the horizontal two-pixel mixing block 404. As shown in the figure, the horizontal two-pixel mixing block 404 includes a one-pixel digital delay circuit 501, an addition circuit 502, and a variable sub-sampling circuit 504. The operation of this mixing block is as follows. In FIG. 14 and FIG. 15, the output signal of the image sensor is replaced with an A / D output signal, the horizontal two-pixel mixing circuit is replaced with a horizontal two-pixel mixing block, and the one-pixel delay circuit is replaced. The description can be replaced with a one-pixel digital delay circuit.

As shown in FIG. 17, the output signal of the A / D 105 is applied to a one-pixel digital delay circuit 501 to delay one pixel period. Then, the output signal of the image sensor and the delay signal are added by the addition circuit 502. Next, the variable sub-sampling circuit 504 performs sub-sampling for every two pixels of the addition signal, and outputs a pixel signal. At this time, a pair of addition signals of two pixels adjacent in the horizontal direction is switched at a predetermined timing under the control of the pixel mixing control circuit 405. For example, as shown in FIGS. 14 and 15, the mixed pair is switched between the first field and the second field every one field period.

In the imaging device having such a configuration, the all-pixel readout imaging device 201 is
Scanning is sequentially performed by driving of No. 3, and an image pickup signal is output.
This imaging signal is supplied to the analog signal processing circuit 104 and the A / D
When applied to the horizontal two-pixel mixing block 404 via 105, the signal amount in the horizontal direction is halved, and the frequency band of the signal is also halved. Thus, the frequency band is １ ／
Is input to the digital signal processing circuit 403, a video signal such as a luminance signal is created and output.

As described above, sequential scanning readout is performed by using a normal all-pixel readout imaging device, and pixel signals independent in the vertical direction of 60 frames (screen) per second are created.
The output signal of the image sensor is converted to a digital signal processing circuit 40.
3 is supplied to the horizontal two-pixel mixing block 404 to perform two-pixel mixing in the horizontal direction. By doing so, the power consumption of the digital signal processing circuit can be reduced, and a video signal having a high vertical resolution can be created.

As described above, in this embodiment, sequential scanning readout is performed using a normal all-pixel readout image pickup device, and pixel signals of the image pickup device are independently transferred in the vertical direction. When a video signal of the NTSC standard is generated, it is possible to obtain one frame (screen) of vertically independent pixel signals in one field period (1/60 [sec]). Thus, a video signal having low power consumption and high vertical resolution can be created. Further, the horizontal resolution can be improved by switching the mixed pair of horizontal pixels for each field.

(Embodiment 5) Next, an image pickup apparatus according to Embodiment 5 of the present invention will be described. FIG. 18 is an overall configuration diagram showing the configuration of the imaging apparatus according to the present embodiment. This imaging apparatus includes an imaging element unit 601 having a photoelectric conversion function,
A horizontal pixel shift unit 602 provided in the image sensor unit 601; an image sensor driver circuit 603 for driving the image sensor unit 601; a drive control circuit 604 for controlling the image sensor driver circuit 603;
An analog signal processing circuit 605 that performs processing such as sampling and amplification on an output signal of the imaging element unit 601, and an A / D 6 that converts an output signal of the analog signal processing circuit 605 into a digital signal.
06, a luminance signal from an A / D converted digital signal,
A digital signal processing circuit 607 for performing RGB signal processing such as a color signal or a color difference signal, a horizontal pixel shift processing circuit 608 provided in the digital signal processing circuit 607, and a drive control circuit 6
, And a system control circuit 609 that comprehensively controls the digital signal processing circuit 607.

The image pickup device section 601 has color separation optical means such as a prism and a plurality of image pickup devices, for example, three CCDs. In the image sensor unit 601, R, G, and B pixel signals output through the horizontal pixel shift unit 602 are converted into digital signals through the analog signal processing circuit 605 and the A / D 606. This digital signal is sent to the digital signal processing circuit 607 by the horizontal pixel shift processing circuit 60.
The luminance signal processing and the chrominance signal processing are performed through 8 to output a luminance signal (Y1) and a chrominance signal (C1).

Here, the horizontal pixel shift processing unique to the 3CCD signal processing will be described. First, the horizontal pixel shift unit 60
The image sensor unit 601 provided with 2 will be described with reference to FIG. In the case where the image pickup device section has a 3-CCD configuration and there is no horizontal pixel shift portion, as shown in FIG. 19A, the G-CCD, R-CCD, and B-CCD of the image pickup device portion are the same in the horizontal direction. Place in position. On the other hand, when a horizontal pixel shift unit is provided, as shown in FIG. 19 (b), the R-CCD and the B-CCD
Are shifted by 画素 pixel with respect to the horizontal direction. In this way, when obtaining a luminance signal, the G signal and other signals are added in equal amounts to remove aliasing components and obtain high resolution. Further, as another example of the configuration of the imaging element section having the horizontal pixel shift section, the imaging element section has a 4-CCD configuration, that is, G1-C
A CD, G2-CCD, R-CCD, B-CCD may be provided. In this case, the G1-CCD and the G2-CCD are spatially shifted by 1/2 pixel.

Next, the operation of the horizontal pixel shift unit 602 will be described with reference to FIG. In the case where the image pickup device has horizontal pixel shift of a three-CCD configuration, the optical filter provided in the CCD reduces the frequency component equal to or higher than fck when the driving frequency of the CCD is fck. As a result, high resolution can be obtained, but when considering each of R, G, and B, aliasing (moire) occurs. But,
The horizontal pixel shift unit 602 inverts the phases of the R and B moire components with respect to the G moire component. The moire can be removed by adding the R, G, and B components in the signal processing operation. Moiré does not completely disappear and remains to some extent. However, CCD of R, G, B
Are often identical to each other, and in practice, C
The time position of the signal extracted from the CD is at a timing like the RB signal and the G signal in FIG. Therefore,
To restore the spatial position of the G signal, the G signal is
(T: 2fck rate) After the delay, the Y matrix operation shown in the following equation (1) is performed. Y = 0.299R + 0.587G + 0.114B (1)

As described above, in the image pickup apparatus having the 3CCD configuration, the provision of the horizontal pixel shift unit 602 and the horizontal pixel shift processing circuit 608 makes it possible to realize a high-resolution luminance signal. In the imaging device according to the present embodiment, the horizontal pixel shift unit 602 can be configured with an imaging device similar to that shown in FIGS.

Here, the operation of the pixel shift unit 602 will be described in detail. A mixed pair of the pixel-mixing variable horizontal transfer unit 1g in the image sensor, which is a horizontal charge transfer unit, is connected to the drive control circuit 60.
G-CCD, R-CCD and B-CCD
And reverse with. In this case, the spatial position of the mixed signal of the G-CCD and the R-CCD and the B-CCD can be shifted by one pixel (1/2 pixel with respect to the mixed pixel).

As described above, in the present embodiment, in the image pickup apparatus having the 3CCD configuration, the pixel signals of the image pickup device are independently transferred in the vertical direction at the same driving frequency as that at the time of interlaced reading. In the case of generating a video signal of the NTSC standard in this manner, it is possible to obtain pixel signals independent in the vertical direction of a frame (screen) in one field period (1/60 [sec]). A video signal having low power consumption and high vertical resolution can be created using an image sensor, an analog signal processing circuit, and an A / D having conventional frequency characteristics.
Further, by inverting the mixed pair of the horizontal pixels of the G-CCD, the R-CCD, and the B-CCD,
1, horizontal pixel shift can be realized, and the horizontal resolution of the luminance signal can be improved.

Further, in the present embodiment, the following processing can be performed. That is, the system control circuit 609
, The drive control circuit 604 performs interlaced drive read scanning on the image sensor, and further performs horizontal two-pixel mixed transfer by the horizontal charge transfer unit. Thereby, the pixel signal of the image sensor can be transferred at a driving frequency of の at the time of interlaced reading. Alternatively, when transferring at the same driving frequency as in interlaced reading, 1 /
The pixel signal of the image sensor can be transferred in 120 [sec], twice as high-speed shooting can be performed, and the time resolution can be improved.

(Embodiment 6) Next, an image pickup apparatus according to Embodiment 6 of the present invention will be described. FIG. 21 is an overall configuration diagram showing the configuration of the imaging apparatus according to the present embodiment, and the same parts as those in the third embodiment are denoted by the same reference numerals.
The feature of this imaging apparatus is that a mode setting circuit 108 is provided as a mode setting means for the imaging element drive control circuit 107. The configuration of the other blocks is substantially the same as that of FIG. In this figure, the same parts as those of the third embodiment are denoted by the same reference numerals, and the description is omitted. FIG. 22 shows the configuration and operation of the image sensor 102. As shown in the figure, a pixel mixing control horizontal transfer section 1h is provided as pixel mixing means.

In FIG. 21, an image of a subject passing through the lens 101 is formed on the image sensor 102. Image sensor 1
Numeral 02 performs photoelectric conversion by driving the imaging element driving circuit 103 controlled by the imaging element driving control circuit 107, and outputs an imaging signal. The analog signal processing circuit 104 performs processing such as noise removal and amplification. The A / D 105 converts an output signal of the analog signal processing circuit 104 into a digital signal and supplies the digital signal to the digital signal processing circuit 106. The digital signal processing circuit 106 creates and outputs a video signal such as a luminance signal.

Here, the operation of the mode setting circuit 108 and the image pickup device drive control circuit 107 will be described with reference to FIGS.
This will be described with reference to FIG. In the image sensor according to the present embodiment, as in the case of the third embodiment, the vertical transfer unit 1b serving as the vertical charge transfer unit is not mixed with the charge signals of the vertically adjacent pixels (the light receiving unit 1a). To the pixel-mixing control horizontal transfer unit 1h. Mode setting circuit 108
Is set to the moving image mode, the pixel mixing control horizontal transfer unit 1h mixes signals of two pixels adjacent in the horizontal direction under the control of the image sensor driving control circuit 107, as shown in FIG. And transfer it horizontally. Then, an imaging signal is output via the charge detection amplifier 1d and the output circuit 1e. When the mode setting circuit 108 sets the still image mode, as shown in FIG. 22B, the pixel mixture control horizontal transfer unit 1h controls the two adjacent pixels in the horizontal direction under the control of the image sensor drive control circuit 107. Pixel signals are independently transferred in the horizontal direction without mixing. Then, an imaging signal is output via the charge detection amplifier 1d and the output circuit 1e.

As described above, in the moving image mode and the still image mode, the pixel mixture control horizontal transfer unit 1h switches between the mixed transfer of the horizontal pixels and the independent transfer, thereby reducing the driving frequency of the image sensor 102 in the moving image mode. In the still image mode, the resolution of the output signal of the image sensor 102 in the horizontal direction can be increased.

As described above, in the present embodiment, in the moving image mode, the pixel signals of the image sensor are independently transferred in the vertical direction at the same driving frequency as in interlaced reading, and two adjacent horizontal pixels are mixed. . When generating an NTSC standard video signal, one field period (1/60 [sec])
), It is possible to obtain pixel signals independent in one frame (screen) in the vertical direction. A video signal having low power consumption and high vertical resolution can be created using an image sensor, an analog signal processing circuit, and an A / D having conventional frequency characteristics. Also, in the still image mode, the pixel signal of the image sensor is independently transferred in the vertical and horizontal directions at a low driving frequency, for example, a driving frequency equal to or lower than that at the time of interlaced reading, by utilizing the fact that the frame rate can be freely set. Thus, independent pixel signals can be obtained in both directions. Thus, a video signal having high vertical and horizontal resolution can be created.

The imaging apparatus of the present embodiment is similar to that of the first embodiment.
Although the description has been given assuming that the imaging device of the second embodiment includes a unit for controlling the driving method of the imaging device by the mode setting circuit, the imaging devices of the second, third, fourth, and fifth embodiments are also described.
Similarly, the same effect can be obtained by providing a mode setting circuit and controlling the driving method of the image sensor.

(Embodiment 7) Next, an image pickup apparatus according to Embodiment 7 of the present invention will be described. FIG. 23 is an overall configuration diagram showing the configuration of the imaging apparatus according to the present embodiment, and the same parts as those in the first embodiment are denoted by the same reference numerals.
The feature of this imaging device is that the imaging element 109 has a color filter that transmits a specific color light, and the analog signal processing circuit 110 performs processing such as noise removal and amplification, as well as processing of the imaging element in which color signals are multiplexed. Analog processing, such as white balance processing and peak processing of color signal components, is performed on the output signal, and the digital signal processing circuit 111, which is a mixed pixel signal processing means, performs luminance signal processing and color signal processing.

FIG. 24 shows the structure and operation of the image sensor 109. As shown in the figure, the image sensor 109 includes a light receiving unit 1a, a vertical transfer unit 1b,
A charge detection amplifier 1d and an output circuit 1e are provided.
The difference from the image sensor 102 is that the light receiving section 1a is composed of a color filter and a photoelectric conversion element, and has three types of complementary color filters of Ye (yellow), Cy (cyan), and Mg (magenta). , G (green) primary color system 1
The same pattern is repeatedly arranged in the horizontal and vertical directions using a basic configuration of 4 horizontal pixels and 2 vertical pixels as a unit as shown in FIG. It is. In the second and fourth columns of the basic configuration of the color filter, the positions of the G and Mg pixels are inverted. Note that Mg is a color filter that transmits blue and red color light, and similarly G is green color light and Cy is
Is a color filter that transmits green and blue light, and Ye is a color filter that transmits green and red light, respectively. Generally, the color filters C1, C
Assuming that the arrangement of C2, C3 and C4 is 4 pixels horizontally and 2 pixels vertically is one unit, C1, C2, C1 and C4 are arranged in this order in the first row, and C3, C4 and C3 are arranged in the second row. , C2 are arranged in this order. In this case, C1 and C3 and C2 and C4 are adjacent to each other in the vertical direction, and C1 and C3 are arranged in a two-pixel cycle in both the vertical and horizontal directions. Then, C2 and C4 are arranged in a two-pixel cycle in the vertical direction, and are inverted in the vertical direction with a two-pixel cycle in the horizontal direction.

In the image pickup apparatus having such a configuration, an image of a subject passing through the lens 101 is formed on the image pickup element 109. The image sensor 109 performs photoelectric conversion and outputs an image signal. The output signal of the analog signal processing circuit 110 is A
The signal is converted into a digital signal at / D 105 and input to the digital signal processing circuit 111. Digital signal processing circuit 1
Reference numeral 11 creates and outputs video signals such as a luminance signal and a color signal.

Next, the operation of the image sensor 109 will be described. In the image sensor shown in FIG. 24, the charge signals of the pixels (light receiving section 1a) adjacent in the vertical direction are not mixed, but are transferred to the pixel mixed horizontal transfer section 1f via the vertical transfer section 1b.
At this time, the pixel mixing horizontal transfer unit 1f mixes signals of two pixels adjacent in the horizontal direction and transfers the signals in the horizontal direction. Then, an imaging signal is output via the charge detection amplifier 1d and the output circuit 1e. The imaging signal obtained by this operation is
The first row in the basic array of color filters is as follows. Ye + G = R + 2G, Ye + Mg = 2R + G + B The second row in the basic array of color filters is as follows. Cy + Mg = R + G + 2B Cy + G = 2G + B This signal is repeatedly output in the horizontal and vertical directions.

Next, the digital signal processing circuit 111 generates a luminance signal and a chrominance signal using the image pickup signal. An example of this generation method will be described with reference to FIG. First, the luminance signal Y is created by adding the imaging signals in the vertical direction. By adding the imaging signals of the first and second rows,
Ye + G + Cy + Mg = 2R + 3G + 2B, and this signal is repeatedly output in the horizontal direction. That is, the luminance signal Y can be obtained by the following equation (2). Y = Ye + G + Cy + Mg (2)

Next, color difference signals Cr and Cb as color signals
Can be obtained by subtracting the imaging signals of the first and second rows. The first subtraction line is Ye + G-
Cy−Mg = G−2B, and the subsequent subtraction line is Y
e + Mg-Cy-G = 2R-G. These signals are repeatedly output in the horizontal direction. That is, the color difference signal Cr
Is given by the following equation (3), and the color difference signal Cb is given by the following equation (4)
Given by the formula. Cr = Ye + Mg- (Cy + G) = 2R-G (3) Cb =-(Ye + G) + (Cy + Mg) = 2B-G (4)

The R, G, and B signals, which are color signals, are given by the following equations (5), (6), and (7), respectively. R = 1/20 ｛-2 (Mg + Cy) +6 (G + Ye) -4 (G + Cy) +8 (Mg + Ye)｝ (5) G = 1/10 ｛-(Mg + Cy) +3 (G + Ye) +3 (G + Cy)- (Mg + Ye)｝ (6) B = 1/20 ｛12 (Mg + Cy) -16 (G + Ye) -6 (G + Cy) +2 (Mg + Ye)｝ (7) The above (5) to (7) From the color signal obtained by the equation, a luminance signal Y is generated using the following equation (8). Y = 0.3R + 0.6G + 0.1B (8)

Also, the R signal and G obtained by the equations (5) to (8)
It is also possible to generate the color difference signal Cr = RY and the color difference signal Cb = BY from the signal, the B signal, and the Y signal. Note that, in the above generation method, the luminance signal and the chrominance signal are obtained by addition and subtraction. However, as equivalent processing, the addition processing can be realized by low-pass filter processing, and the subtraction processing can be realized by band-pass filter processing. it can.

As described above, using the image pickup device having the color filters of Ye, Cy, G, and Mg, the driving frequency is equivalent to the case of generating a signal of 30 frames per second (= 60 fields), and the driving frequency is 60 frames per second (= 60 fields). The pixel signals independent in the vertical direction of the screen can be generated. That is, it is possible to create a luminance signal and a chrominance signal having a high vertical resolution.

As described above, in the present embodiment, Ye, Cy,
Pixel signals of an image sensor having G, Mg color filters are
Transfer is performed independently in the vertical direction to mix adjacent two horizontal pixels. When a video signal of the NTSC standard is generated, it is possible to obtain one frame (screen) of vertically independent pixel signals in one field period (1/60 [sec]). As described above, a video signal having low power consumption and high vertical resolution can be created using the conventional image sensor, analog signal processing circuit, and A / D having frequency characteristics.
In addition, a progressive image of 60 frames per second can be obtained.

Further, the image sensor 109 used in the image pickup apparatus of the present embodiment can be configured as shown in FIG. The image sensor 109 illustrated in FIG. 26 is partially different in configuration and arrangement from the color filters used in the image sensor in FIG. Here, Ye (yellow), Cy (cyan), G (green), and G (green) are arranged as color filters C1, C3, C2, and C4, respectively.
Using a color filter called Wh (white), the same pattern is repeatedly arranged in the horizontal and vertical directions using a basic configuration of four horizontal pixels and two vertical pixels as one unit. In the second and fourth columns of the basic configuration of the color filter, the positions of the G and Wh pixels are inverted. Note that Wh is a filter that transmits all color light.

In the imaging device shown in FIG. 26, the charge signals of the pixels (light receiving portion 1a) adjacent in the vertical direction are not mixed,
The data is transferred to the pixel mixed horizontal transfer unit 1f via the vertical transfer unit 1b. At this time, the pixel mixing horizontal transfer unit 1f mixes signals of two pixels adjacent in the horizontal direction and transfers the signals in the horizontal direction. Then, an imaging signal is output through the charge detection amplifier 1d and the output circuit 1e. The imaging signal obtained by this operation is as follows: Ye + G = R + 2G Ye + Wh = 2R + 2G + B in the first row of the basic array of color filters. In the second row, Cy + Wh = R + 2G + 2B Cy + G = 2G + B. These signals are repeatedly output in the horizontal and vertical directions.

Next, the digital signal processing circuit 111 generates a luminance signal and a chrominance signal using these imaging signals.
This generation method will be described with reference to FIG. First, the luminance signal Y is created by adding the imaging signals in the vertical direction. A horizontal repetition signal of Ye + G + Cy + Wh = 2R + 4G + 2B can be obtained by adding the imaging signals of the first row and the second row. That is,
The luminance signal Y is expressed by the following equation (9). Y = Ye + G + Cy + Wh (9)

Next, the R signal and the B signal as the color signals
It is obtained by subtracting the imaging signal of the second row from the imaging signal of the second row. Ye + G-Cy-Wh = -2B Ye + Wh-Cy-G = 2R These signals are output repeatedly in the horizontal direction. Therefore, the color signals are as shown in the following equations (10) and (11). R = 1/2 {(Ye + Wh)-(Cy + G)} (10) B = 1/2 {-(Ye + Cy) + (Cy + Wh)} (11) Further, the G signal is represented by the following (12). ) G = 1/4 {Y-2 (R + B)} (12)

As described above, even in the case of using an image sensor having color filters of Ye, Cy, G, and Wh, the same driving as that of generating a signal of 30 frames per second (= 60 fields) by simple signal processing. It is possible to obtain a vertical independent pixel signal at a frequency of 60 frames (screen) per second. That is, a luminance signal and a chrominance signal having a high vertical resolution can be created.

As described above, in the present embodiment, Ye, Cy, Cy,
The pixel signals of the image sensor having the color filters of G and Wh are independently transferred in the vertical direction, and two adjacent horizontal pixels are mixed. When a video signal of the NTSC standard is generated, it is possible to obtain one frame (screen) of vertically independent pixel signals in one field period (1/60 [sec]). In addition, a video signal having low power consumption and high vertical resolution can be generated by using a conventional image sensor, analog signal processing circuit, and A / D having frequency characteristics. In addition, a progressive image of 60 frames can be obtained. In addition,
The method of generating a luminance signal and a color signal described in the present embodiment is not limited to this, and correction or the like may be required depending on the spectral sensitivity characteristics of a color filter.

(Embodiment 8) Next, an imaging apparatus according to Embodiment 8 of the present invention will be described. FIG. 28 is an overall configuration diagram showing a configuration of an imaging apparatus according to the present embodiment. The same parts as those in the seventh embodiment are denoted by the same reference numerals.
The feature of this imaging device is that an imaging device drive control circuit 107 for controlling the imaging device drive circuit 103 is provided in the imaging device of the seventh embodiment. The configuration and operation of the image sensor 109 are shown in FIGS. This image sensor 109
Has color filters of Ye, Cy, G, and Mg.
29 and 30, the difference from the image pickup device of the seventh embodiment is that a variable pixel horizontal transfer section 1g is provided as horizontal charge transfer means.

In the image pickup apparatus configured as described above, the image of the subject passing through the lens 101 is
9 is formed. The image pickup device 109 includes the drive control circuit 10
The photoelectric conversion is performed by the driving of the image sensor driving circuit 103 controlled by 7 to output an image signal. This imaging signal is input to the A / D 105 via the analog signal processing circuit 110, and is converted into a digital signal. The digital signal processing circuit 111, which is a mixed pixel signal processing unit, receives the digital signal, creates and outputs video signals such as a luminance signal and a color signal.

FIG. 2 shows the operation of the image sensor 109.
This will be described with reference to FIG. The imaging element 109 transfers the charge signals of the vertically adjacent pixels (light receiving section 1a) to the pixel mixing variable horizontal transfer section 1g via the vertical transfer section 1a without mixing. At this time, the pixel mixing variable horizontal transfer unit 1g mixes signals of two pixels adjacent in the horizontal direction and transfers the signals in the horizontal direction. Then, an imaging signal is output via the charge detection amplifier 1d and the output circuit 1e. At this time, a pair of mixing of signals of two pixels adjacent in the horizontal direction is switched at a predetermined timing under the control of the image sensor drive control circuit 107 which is a pixel mixing control unit. For example, a mixed pair is switched between the first field and the second field every one field period.

In the image pickup signal obtained by this operation, the basic arrangement of the color filters varies depending on the field as shown in FIG.
It changes in the arrangement shown in (a) and (b). That is, Ye + G = R + 2G Ye + Mg = 2R + G + B is generated in the first row in both fields. In the second line, Cy + Mg = R + G + 2B Cy + G = 2G + B is generated. These signals are repeatedly output in the horizontal and vertical directions. The digital signal processing circuit 111 also generates a luminance signal and a chrominance signal by the method described in Embodiment 7 using the imaging signal. Here, the description is omitted.

As described above, even when an image pickup device having Ye, Cy, G, and Mg color filters is used, the spatial position of the pixel mixed signal can be changed by one pixel in the horizontal direction by switching the mixed pair for each field. Can be shifted by minutes. In the interlacing process in the vertical direction, it is possible to create a luminance signal and a chrominance signal with improved resolution in the horizontal direction, in the same way that the vertical resolution is improved by the integration effect of the eyes.

As described above, in the present embodiment, the pixel signals of the image sensor having the color filter are independently transferred in the vertical direction at the same driving frequency as that at the time of interlaced reading, and two adjacent horizontal pixels are mixed. . When the video signal of the NTSC standard is generated in this manner, one field period (1/6)
0 [sec]), it is possible to obtain pixel signals independent of one frame (screen) in the vertical direction. Using an image sensor, analog signal processing circuit, and A / D having a conventional frequency characteristic,
A video signal having low power consumption and high vertical resolution can be created. Further, by switching the mixed pair of horizontal pixels for each field, it is possible to improve the horizontal resolution. In the present embodiment, Y
Although the case of the color filter arrangement of e, Cy, G, and Mg has been described, the present invention is not limited to this, and the color filter arrangement of Y,
The same effect can be obtained in the case of the color filter arrangement of e, Cy, G, and Wh.

(Embodiment 9) Next, an image pickup apparatus according to Embodiment 9 of the present invention will be described. FIG. 32 is an overall configuration diagram showing the configuration of an imaging apparatus according to the present embodiment. The same parts as those in the eighth embodiment are denoted by the same reference numerals.
The feature of this imaging apparatus is that a mode setting circuit 108 is provided as a mode setting means for the imaging element drive control circuit 107. FIG. 3 shows the configuration and operation of the image sensor 109.
3 is shown. This image sensor 109 is made of Ye, Cy, G, Mg
Color filters. The difference from the imaging device of the eighth embodiment is that a pixel mixture control horizontal transfer unit 1h is provided as a horizontal transfer unit as shown in FIG.

In the image pickup apparatus having such a configuration, the image of the subject that has passed through the lens 101 is formed on the image pickup element 109. The image sensor 109 is an image sensor drive control circuit 1
The photoelectric conversion is performed by driving the image sensor driving circuit 103 controlled in step 07, and an image signal is output. This imaging signal is input to the A / D 105 via the analog signal processing circuit 110, and is converted into a digital signal. The digital signal processing circuit 111 receives a digital signal, creates and outputs a video signal such as a luminance signal and a color signal. The digital signal processing circuit 111 according to the present embodiment includes a function of a mixed pixel signal processing unit that generates a video signal of progressive scanning from a plurality of pixel signals output by the horizontal charge transfer unit, and a function of each of the ones output by the horizontal charge transfer unit. A function of independent pixel signal processing means for generating a video signal of progressive scanning from the pixel signal.

Here, the operation of the mode setting circuit 108 and the image pickup device drive control circuit 107 will be described with reference to FIGS.
This will be described with reference to FIG. Image sensor 10 of the present embodiment
9, similarly to the imaging device of FIGS. 29 and 30,
The charge signals of the vertically adjacent pixels (light receiving section 1a) are transferred to the pixel mixing control horizontal transfer section 1h via the vertical transfer section 1b without mixing. At this time, the mode setting circuit 10
When the moving image mode 8 is set, the pixel mixing control horizontal transfer unit 1h mixes signals of two pixels adjacent in the horizontal direction and transfers the signals in the horizontal direction under the control of the image sensor drive control circuit 107. Thus, an imaging signal is output via the charge detection amplifier 1d and the output circuit 1e. Mode setting circuit 1
When 08 sets the still image mode, the pixel mixing control horizontal transfer unit 1h independently transfers signals of two pixels adjacent in the horizontal direction without mixing under the control of the image sensor drive control circuit 107 in the horizontal direction. I do. Thus, the charge detection amplifier 1d
Then, an imaging signal is output via the output circuit 1e.

As described above, in the moving image mode and the still image mode, the pixel mixing control horizontal transfer unit 1h switches between the mixed transfer of the horizontal pixels and the independent transfer, thereby reducing the driving frequency of the image sensor 102 in the moving image mode. In the still image mode, the resolution of the output signal of the image sensor 109 in the horizontal direction can be increased.

Next, the image pickup signal format obtained in each mode,
A method for generating a luminance signal and a chrominance signal will be described. The imaging signal format and the method of generating the luminance signal and the chrominance signal in the moving image mode are the same as those in the seventh embodiment, and the description is omitted here. Next, in the still image mode, the signal of each pixel is read out independently, and the Y, R, G, and B signals are generated from the pixel signals of Ye, Cy, G, and Mg. This generation method can be generated, for example, from the following equations (13) to (15). R = Ye + Mg-Cy (13) G = Cy + Ye-Mg (14) B = Cy + Mg-Ye (15) Further, the luminance signal Y is expressed by the above-described equation (2) or (8). It can be obtained by the formula.

As another generation method, there is the following method that can be shared with the moving image mode. The imaging signals obtained by the pixel-independent readout operation are Ye, G, Ye, and Mg in the first row and Cy, Mg, Cy, and G in the second row in the basic array of the color filters. These signals are repeatedly output in the horizontal and vertical directions.

Next, the digital signal processing circuit 111 performs an addition process on the image pickup signal with two consecutive horizontal pixels, so that Ye + G, G + Ye, Ye + M in the first row.
g, Mg + Ye, and in the second line, Cy + Mg, M
Create g + Cy, Cy + G, G + Cy. Thus, these signals are repeated in the horizontal and vertical directions. This is equivalent to outputting two consecutive image pickup signals in the moving image mode. The digital signal processing circuit 111 can also generate a luminance signal and a chrominance signal by using the imaging signal by the method described in Embodiment 7.

As described above, in the present embodiment, Ye, C
Even in the case of using an image sensor having color filters of y, G, and Mg, in the moving image mode, pixel signals of the image sensor are independently transferred in the vertical direction at the same driving frequency as in interlaced readout, and two adjacent horizontal pixels are transferred. Mix the pixels. NT
When an SC standard video signal is generated, one frame (screen) can be obtained as a vertical independent signal in one field period (1/60 [sec]). In addition, a conventional image sensor, analog signal processing circuit, and A /
Using D, a video signal having low power consumption and high vertical resolution can be created. Also, in the still image mode, the pixel signal of the image sensor is independently transferred in the vertical and horizontal directions at a low driving frequency, for example, a driving frequency equal to or lower than that at the time of interlaced reading, by utilizing the fact that the frame rate can be freely set. Thus, independent pixel signals can be obtained in both directions. Thus, it is possible to create a luminance signal and a chrominance signal having high vertical and horizontal resolution.

In the present embodiment, Ye, C
Although the case of the y, G, and Mg color filter arrangement has been described, the present invention is not limited to this, and the Ye, C, and
The same effect can be obtained in the case of the y, G, Wh color filter array. Further, in the present embodiment, a case has been described in which a mode setting circuit is provided in the seventh embodiment, and the driving method of the image sensor is controlled according to the mode. A similar effect can be obtained by providing a mode setting circuit similarly to the eighth embodiment and controlling the driving method of the image sensor according to the mode.

In the present embodiment, the description has been made assuming that in the image pickup apparatus having the color filters, the mixing of the pixel signals adjacent in the horizontal direction is performed by the horizontal transfer section in the image pickup element. However, besides this, as shown in the second or fourth embodiment, an analog signal processing unit or a digital signal processing unit can be mixed, and the same effect can be obtained.

In this embodiment, one pixel has two transfer stages as a vertical transfer unit of the image sensor, and one vertical transfer unit has two transfer stages as a horizontal transfer unit of the image sensor. However, they are all schematically described, and the present invention is not limited to them.

[0119]

As described above, according to the first to fifth aspects of the present invention, the pixel signals of the photoelectric conversion elements are independently transferred in the vertical direction, and two adjacent horizontal pixels are mixed and horizontally transferred. Therefore, when generating an interlaced video signal, it is possible to obtain a vertical independent pixel signal of one frame in one field period. Further, a video signal having low power consumption and high vertical resolution can be created. Further, a progressive image of 60 frames per second can be obtained.

According to the sixth and seventh aspects of the present invention, the 3CC
In the imaging device having the D configuration, the pixel signals of the photoelectric conversion elements are independently transferred in the vertical direction at the same driving frequency as that at the time of interlaced reading. Therefore, when generating an NTSC video signal, it is possible to obtain vertically independent pixel signals of one frame in one field period. Conventional image sensor having frequency characteristics, analog signal processing circuit, A / D
, A video signal having low power consumption and high vertical resolution can be created. G-CCD and RB-
By reversing the mixed pair of horizontal pixels with the CCD, horizontal pixel shift can be realized in the imaging element unit. Therefore, the horizontal resolution of the luminance signal can be improved.

According to the invention of claims 8 to 10, in the moving image mode, the pixel signals of the photoelectric conversion elements are independently transferred in the vertical direction at the same driving frequency as in interlaced reading. Therefore, when an NTSC video signal is generated, two horizontal pixels adjacent to each other are mixed and horizontally transferred, so that a vertical independent pixel signal of one frame can be obtained in one field period. Further, an image sensor having a conventional frequency characteristic,
A video signal having low power consumption and high vertical resolution can be created by using an analog signal processing circuit and an A / D. In the still image mode, since the frame rate can be freely set, the pixel signals are independently transferred in the vertical and horizontal directions at a low driving frequency, for example, at a driving frequency equal to or lower than that for interlaced reading. be able to. Therefore, a video signal having high vertical and horizontal resolution can be created.

According to the eleventh and twelfth aspects of the present invention, the pixel signals of the photoelectric conversion elements provided with the color filters are independently transferred in the vertical direction at the same driving frequency as that at the time of interlaced reading. Therefore, when an NTSC video signal is generated, two horizontal pixels adjacent to each other are mixed and horizontally transferred, so that a vertical independent pixel signal of one frame can be obtained in one field period. In addition, a video signal having low power consumption and high vertical resolution can be created using an image sensor, an analog signal processing circuit, and an A / D having conventional frequency characteristics. Further, a progressive image of 60 frames per second can be obtained.

According to the thirteenth aspect of the present invention, the pixel signal of the photoelectric conversion element provided with the color filter is independently transferred in the vertical direction at the same driving frequency as that at the time of interlaced reading. Therefore, when generating an NTSC video signal,
Two adjacent horizontal pixels are mixed and horizontally transferred, so that one frame period independent pixel signal can be obtained in one field period. In addition, a video signal having low power consumption and high vertical resolution can be created using an image sensor, an analog signal processing circuit, and an A / D having conventional frequency characteristics. Further, a progressive image of 60 frames per second can be obtained.

According to the invention of claims 14 to 21, 4
When using an image sensor provided with various types of color filters,
In the moving image mode, the pixel signals of the image sensor are independently transferred in the vertical direction at the same driving frequency as in interlaced reading. Therefore, when an NTSC video signal is generated, two horizontal pixels adjacent to each other are mixed and horizontally transferred, so that a vertical independent pixel signal of one frame can be obtained in one field period. Further, an image sensor having a conventional frequency characteristic,
A video signal having low power consumption and high vertical resolution can be created by using an analog signal processing circuit and an A / D. In the still image mode, the frame rate can be freely set, so that pixel signals are independently transferred in the vertical and horizontal directions at a low driving frequency, for example, a driving frequency equal to or lower than that for interlaced reading. can do. Therefore, a video signal having high vertical and horizontal resolution can be created.

Further, according to the inventions of claims 22 to 24, the above effect can be exerted regardless of the value of the number of pixels of the photoelectric conversion element.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of an imaging device according to a first embodiment of the present invention.

FIG. 2 is a configuration diagram of an imaging element in the imaging device according to the first embodiment.

FIG. 3 is an explanatory diagram (part 1) illustrating a relationship between driving frequencies of an imaging element in the imaging apparatus.

FIG. 4 is an explanatory diagram (part 2) illustrating a relationship between driving frequencies of an imaging element in the imaging apparatus.

FIG. 5 is an overall configuration diagram of an imaging device according to a second embodiment of the present invention.

FIG. 6 is a configuration diagram and an operation timing diagram of a horizontal two-pixel mixing circuit in the imaging device according to the second embodiment;

FIG. 7 is a block diagram illustrating another configuration example of the imaging device according to the second embodiment;

8 is a configuration diagram and an operation timing diagram of a horizontal two-pixel mixing block in the imaging device in FIG. 7;

FIG. 9 is an overall configuration diagram of an imaging device according to a third embodiment of the present invention.

FIG. 10 is an explanatory diagram (part 1) of the operation of the image sensor in the image pickup apparatus according to the third embodiment;

FIG. 11 is an explanatory diagram (part 2) of the operation of the imaging element in the imaging device according to the third embodiment;

FIG. 12 is an overall configuration diagram of an imaging device according to a fourth embodiment of the present invention.

FIG. 13 is a configuration diagram of a horizontal two-pixel mixing circuit in an imaging device according to a fourth embodiment.

FIG. 14 is an operation timing diagram (part 1) of the horizontal two-pixel mixing circuit in the imaging device according to the fourth embodiment;

FIG. 15 is an operation timing diagram (part 2) of the horizontal two-pixel mixing circuit in the imaging device according to the fourth embodiment;

FIG. 16 is a block diagram illustrating another configuration example of the imaging device according to the fourth embodiment;

FIG. 17 is a configuration diagram of a horizontal two-pixel mixing block in the imaging device in FIG. 16;

FIG. 18 is an overall configuration diagram of an imaging device according to a fifth embodiment of the present invention.

FIG. 19 is an operation explanatory view (part 1) of a horizontal pixel shift unit in the imaging device according to the fifth embodiment;

FIG. 20 is an operation explanatory diagram (part 2) of the horizontal pixel shift unit in the imaging device according to the fifth embodiment;

FIG. 21 is an overall configuration diagram of an imaging device according to a sixth embodiment of the present invention.

FIG. 22 is an explanatory diagram of the operation of the imaging element in the imaging device according to the sixth embodiment.

FIG. 23 is an overall configuration diagram of an imaging device according to a seventh embodiment of the present invention.

24A and 24B are a configuration diagram and an operation explanatory diagram of an imaging element in an imaging device according to a seventh embodiment.

FIG. 25 is an explanatory diagram illustrating a method for generating a luminance signal and a chrominance signal in the image sensor according to the seventh embodiment.

26A and 26B are a configuration diagram and an operation explanatory diagram of another imaging element in the imaging device according to the seventh embodiment.

FIG. 27 is an explanatory diagram illustrating a method for generating a luminance signal and a chrominance signal in another imaging device of the seventh embodiment.

FIG. 28 is an overall configuration diagram of an imaging device according to an eighth embodiment of the present invention.

FIG. 29 is an explanatory diagram (part 1) of the operation of the imaging element in the imaging device according to the eighth embodiment.

FIG. 30 is an explanatory diagram (part 2) of the operation of the imaging element in the imaging device of the eighth embodiment.

FIG. 31 is an explanatory diagram showing a basic arrangement of color filters in an image sensor according to an eighth embodiment.

FIG. 32 is an overall configuration diagram of an imaging device according to a ninth embodiment of the present invention.

FIG. 33 is an explanatory diagram of the operation of the imaging element in the imaging device according to the ninth embodiment.

FIG. 34 is a configuration diagram of an interlace driving CCD and an all-pixel reading CCD in a conventional imaging apparatus.

[Explanation of symbols]

101 Lens 102, 201 Image sensor 103, 203, 603 Image sensor drive circuit 104, 110 Analog signal processing circuit 105, 606 Analog / digital conversion circuit (A /
D) 106, 111, 401, 403, 607 Digital signal processing circuit 107, 604 Image sensor drive control circuit 108 Mode setting circuit 202, 204 Horizontal two-pixel mixing circuit 205, 405 Pixel mixing control circuit 301 One-pixel delay circuit 302, 502 Addition circuit 303, 502 Sampling circuit 304 Variable sampling circuit 402, 404 Horizontal two-pixel mixing block 501 One-pixel digital delay circuit 504 Variable sub-sampling circuit 601 Image sensor 602 Horizontal pixel shift 608 Horizontal pixel shift processing circuit 609 System control circuit 1a Light receiving section 1b Vertical transfer section 1c Horizontal transfer section 1d Charge detection amplifier 1e Output circuit 1f Pixel mixed horizontal transfer section 1g Pixel mixed variable horizontal transfer section 1h Pixel mixed control horizontal transfer section

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C024 AA01 CA11 CA16 CA25 DA01 DA05 EA08 FA01 FA11 FA13 FA14 GA11 GA48 GA49 HA01 HA06 HA17 JA21 JA32 5C065 AA01 AA03 BB34 CC01 CC07 CC08 DD02 EE03 GG01 GG11 GG21

Claims (24)

[Claims] 1. A photoelectric conversion device comprising: a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction for photoelectrically converting an image of a subject; and charge information of the photoelectric conversion elements arranged in a vertical direction are sequentially and vertically independent. Vertical charge transfer means for transferring the charge information transferred by the vertical charge transfer means, and a pixel mixing means for outputting a pixel signal by mixing the charge information in units of a plurality of pixels in the horizontal direction. Imaging device. 2. The image pickup apparatus according to claim 1, wherein said pixel mixing means comprises a pixel mixing signal processing circuit for mixing output signals of said photoelectric conversion elements in units of a plurality of pixels in a horizontal direction. 3. The pixel mixing means according to claim 1, wherein said pixel mixing means comprises horizontal charge transfer means for mixing and transferring the charge information obtained by said vertical charge transfer means in a plurality of pixels in a horizontal direction. Item 2. The imaging device according to Item 1. 4. The imaging apparatus according to claim 2, wherein said pixel mixing means includes a pixel mixing control means for changing a combination of mixing of a plurality of pixels at regular intervals. apparatus. 5. The image pickup apparatus according to claim 4, wherein said pixel mixing control means changes a combination of mixing in units of a plurality of pixels for each field. 6. A color separation optical means for separating imaging light coming from a subject for each color component, and arranged in a horizontal direction and a vertical direction for photoelectrically converting an image of the subject obtained by the color separation optical means. A plurality of photoelectric conversion elements, a plurality of imaging elements formed with vertical charge transfer means for sequentially transferring the charge information of the photoelectric conversion elements in the vertical direction, and the charge information transferred by the vertical charge transfer means of the imaging element And a pixel mixing unit that outputs a pixel signal by mixing in a plurality of pixels in the horizontal direction, wherein a combination of mixing of each pixel in the plurality of image sensors is made different in a plurality of pixels. Imaging device. 7. The imaging apparatus according to claim 6, wherein the vertical charge transfer unit transfers charge information of the photoelectric conversion element independently in a vertical direction. 8. In order to photoelectrically convert an image of a subject, a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction, and charge information of the photoelectric conversion elements arranged in a vertical direction are sequentially independent in a vertical direction. A vertical charge transfer unit that transfers the charge information transferred by the vertical charge transfer unit in a horizontal direction in units of one pixel or a plurality of pixels; And a mode setting unit for setting a high image quality mode. When the moving image mode is set by the mode setting unit, a video signal of sequentially scanning is created from a plurality of pixels output from the pixel mixing unit. When the high image quality mode is set by the mode setting means,
An image pickup apparatus for generating a video signal of progressive scanning from a pixel unit. 9. The pixel mixing means includes a horizontal charge transfer means for transferring the charge information obtained by the vertical charge transfer means in a horizontal direction, wherein the horizontal charge transfer means horizontally transfers the charge information in a moving image mode. 9. The image pickup apparatus according to claim 8, wherein a plurality of pixels are mixed and transferred in the direction, and in the high image quality mode, independent charge information is transferred in the horizontal direction. 10. The pixel mixing means includes a pixel mixing signal processing circuit for mixing output signals of the photoelectric conversion elements in a horizontal direction, wherein the pixel mixing signal processing circuit outputs an output of the photoelectric conversion elements in a moving image mode. 9. The image pickup apparatus according to claim 8, wherein a plurality of pixels are mixed in the horizontal direction. 11. A color filter element in which four color filters C1, C2, C3, and C4 having mutually different spectral characteristics are two-dimensionally arranged in a predetermined order, and an image of a subject obtained through the color filter element. A plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction, and a vertical charge transfer means for sequentially and vertically independently transferring charge information of the photoelectric conversion elements arranged in a vertical direction. And a pixel mixing unit that mixes the charge information transferred by the vertical charge transfer unit in units of a plurality of pixels in the horizontal direction and outputs charge information in the horizontal direction. 12. The image pickup apparatus according to claim 11, wherein said pixel mixing means includes a pixel mixing control means for changing a combination of a plurality of pixel units for each field. 13. A color filter element in which four color filters C1, C2, C3, and C4 having mutually different spectral characteristics are two-dimensionally arranged in a predetermined order, and an image of a subject obtained through the color filter element. And a plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction, and vertical charge transfer means for sequentially and vertically independently transferring charge information of the photoelectric conversion elements arranged in a vertical direction. A pixel mixing unit that mixes the charge information transferred by the vertical charge transfer unit in units of a plurality of pixels in the horizontal direction and outputs charge information in the horizontal direction; and a pixel signal output by the pixel mixing unit. And a mixed pixel signal processing unit that generates a scanning video signal. The pixel mixing unit converts the charge information obtained by the vertical charge transfer unit into a plurality of pixels in a horizontal direction. An imaging apparatus comprising horizontal charge transfer means for mixing and transferring in a horizontal direction. 14. A color filter element in which four color filters C1, C2, C3, and C4 having mutually different spectral characteristics are two-dimensionally arranged in a predetermined order, and an image of an object obtained through the color filter element. A plurality of photoelectric conversion elements arranged in a horizontal direction and a vertical direction, and a vertical charge transfer means for sequentially and vertically independently transferring charge information of the photoelectric conversion elements arranged in a vertical direction. Horizontal charge transfer means for transferring the charge information obtained by the vertical charge transfer means in the horizontal direction in units of one pixel or a plurality of pixels in the horizontal direction; and sequential scanning from a plurality of pixel signals output by the horizontal charge transfer means. A mixed pixel signal processing means for generating a video signal of the following; and an independent pixel signal processing means for generating a video signal of progressive scanning from each one pixel signal output from the horizontal charge transfer means. And a mode setting means for setting a moving image mode and a high image quality mode. When the moving image mode is set by the mode setting means, a video signal of sequential scanning is output from the output pixel of the mixed pixel signal processing means. An image pickup apparatus, wherein a video signal of progressive scanning is generated from an output pixel of the independent pixel signal processing unit when the high image quality mode is set by the mode setting unit. 15. The color filters C1, C2, C3, C
4 makes C1 and C3 and C2 and C4 vertically adjacent, C1
And C3 are arranged in a two-pixel cycle in both the vertical and horizontal directions, C2 and C4 are arranged in a two-pixel cycle in the vertical direction, and the arrangement is inverted in the vertical direction with a two-pixel cycle in the horizontal direction. The imaging device according to claim 11. 16. The color filters C1, C2, C3, C
The imaging device according to any one of claims 11 to 15, wherein 4 comprises Ye, Mg, Cy, and G, respectively. 17. The color filters C1, C2, C3, C
The imaging device according to any one of claims 11 to 15, wherein 4 includes Ye, Wh, Cy, and G, respectively. 18. The image pickup apparatus according to claim 13, wherein said mixed pixel signal processing means performs an arithmetic process on a pixel mixed output signal in a vertical direction. 19. The mixed pixel signal processing means generates a luminance signal by vertical low frequency pass filter processing of the pixel mixed output signal, and generates a luminance signal by vertical high frequency pass filter processing of the pixel mixed output signal. The imaging device according to claim 13, wherein the signal is generated. 20. The independent pixel signal processing means converts pixel signals continuous in the horizontal direction into S1, S2,.
n (n: natural number), two adjacent signals Si, S
adding means for adding i + 1, and output signals S1 + S2, S2 + S3,.
18. The image pickup apparatus according to claim 14, further comprising: an arithmetic processing circuit that calculates Sn-1 + Sn in a vertical direction. 21. The independent pixel signal processing means converts pixel signals continuous in the horizontal direction into S1, S2,.
n (n: natural number), two adjacent signals Si, S
an adding means for adding i + 1, and an output signal S1 + S2, S2 + S3,.
.., Generating a luminance signal by vertical low-pass filter processing of Sn-1 + Sn, and generating a color signal by vertical high-pass filter processing of an output signal of the pixel mixing means. The imaging device according to any one of claims 14 to 17, wherein 22. The imaging apparatus according to claim 1, wherein the photoelectric conversion element photoelectrically converts 640 horizontal pixels and 480 vertical pixels. 23. The imaging apparatus according to claim 1, wherein said photoelectric conversion element photoelectrically converts 1024 horizontal pixels and 768 vertical pixels. 24. The imaging device according to claim 1, wherein the photoelectric conversion element photoelectrically converts 1280 pixels horizontally and 960 pixels vertically.