JPH07240930A - Image pickup device - Google Patents

Abstract

PURPOSE:To improve the spatial resolution of the complementary colors of four colors by shifting spatial picture elements for the unit of one picture element and reconstituting them on respectively correspondent memories when the corrected mosaic filters of four colors are used for a color resolving filter array arranged on the photoelectric converting plane of a CCD element. CONSTITUTION:An image passed through a lens system 1 and an optical path changer 2 is converted to an optical path formed on a CCD 3, and a digital CCD signal is generated by an A/D converter 4 and inputted to memories 5-1-5-4. At such a time a controller 10 controls the device 2 so that a picture provided by the system 1 can be formed at a first position during a first photographic period expressed by 1(x, y)=(0, 0) or can be formed at a second position deviated from the first position just for one picture element in a prescribed horizontal direction during a second photographic period expressed by 2(x, y)=(1, 0). At the same time, the device 10 constitutes the respective complementary colors from the CCD signal to get respective complementary color values in the shape of mosaic for the respective memories 5-1-5-4 at the time of photograph end.

Description

Detailed Description of the Invention

[0001]

The present invention relates to a two-dimensional solid-state image pickup device (C
The present invention relates to an image pickup device using a CD or the like, and particularly to an image pickup device for obtaining a high resolution by displacing an imaging position of a subject in two directions in a spatial region.

[0002]

2. Description of the Related Art As a method most often used at present for reproducing a color by using one image pickup device, a complementary color filter is arranged in a mosaic pattern on the light receiving surface of the image pickup device to obtain a luminance signal component. On the pixel sampling frequency
There is a method of obtaining color information by extracting an image sensor output signal on which a color carrier having a frequency of 1/2 is superimposed and performing Y / C separation. This method is widely used in consumer video cameras and is effective in providing inexpensive cameras.

[0003]

SUMMARY OF THE INVENTION In the above conventional method,
In the first place, since the frequency of the color carrier representing the color information is only half of the pixel sampling frequency, it is theoretically impossible to reproduce high-definition color information. Therefore, while the single-plate type image pickup device is a small-sized and inexpensive device, the obtained color image cannot be used when an image quality higher than that of a conventional consumer video camera is required.

An object of the present invention is to provide an apparatus capable of performing high-resolution color image pickup of a still image with a simple structure without eliminating the advantages of a small-sized and inexpensive single-plate type image pickup apparatus.

[0005]

In order to achieve the above object, the present invention provides a color separation filter array arranged on the photoelectric conversion surface of a CCD element, for example, Ye arranged in a manner as shown in FIG. When using the four color complementary mosaic filters of Cy Mg, G, perform spatial pixel shift in units of 1 pixel and reconstruct on the memory corresponding to each of Ye, Cy, Mg, G as shown in Fig. 2. Thus, the spatial resolution is improved for each of the four complementary colors. Matrix calculation is performed on the complementary colors generated by using such means, and RGB
If converted into a signal or a luminance / color difference signal, a high resolution color image having the same pixel sampling frequency can be obtained.

[0006]

FIG. 1 shows the first embodiment of the present invention. In FIG. 1, reference numeral 1 is a lens system, and 2 is a displacement means for changing the optical path, which includes, for example, an optical system such as a variable apex angle prism or an image pickup element which is displaced in a plane perpendicular to the optical axis by a piezo element or the like. 3 is a CCD in which the complementary color mosaic filter shown in FIG. 3 is mounted on the light receiving surface, 4 is an A / D converter, 5 is a memory, 5-1 is a first memory, 5-2 is a second memory, 5-3 is a third memory, 5-4 is a fourth memory, 6
Is a camera signal processing circuit, 7 is a 3-channel D / A converter, 8 is a high-definition color display, 9 is a digital interface device, 10 is a control device, 11 is a CCD driver, and 12-1 to 12-4 are address write control lines. ,
13-1 to 13-4 are address read control lines.
Next, the operation of the first embodiment of the present invention will be described.

The image that has passed through the lens system 1 and the optical path changing means 2 is imaged on the CCD 3 and photoelectrically converted to A 4.
A digital CCD signal is generated by the / D converter. C digitized by 4 A / D converters
The CD signal is input to each memory 5-1 to 5-4.

At this time, the control device of 10 firstly displays the image obtained by the lens system of 1 for the optical path changing device of 2 on the light receiving surface of the CCD of 3 as 1 (x, y) = (0,
In the first imaging period represented by 0), the first position, 2 (x,
y) = (1, 0) In the second imaging period, a second position shifted by one pixel in the predetermined horizontal direction from the first position, 3 (x, y) = (1 , 1) in the third imaging period, a third position vertically deviated from the second position by one line, the third position represented by 4 (x, y) = (0, 1) in FIG. In the imaging period of 4, control is performed so that an image is formed at a fourth position, which is shifted by one pixel in the direction opposite to the predetermined horizontal direction with respect to the second position. At the same time, 10 control devices are CCDs in which Ye, Cy, Mg, and G complementary color values are obtained in a mosaic pattern through the address write control lines 12-1 to 12-4 to the memories 5-1 to 5-4. From the signal, Ye is 5-1 first memory, Cy is 5-2 second memory, Mg is 5-3 third memory, G
Is written in the fourth memory 5-4, and 1 + 2 + 3 in FIG.
An address write control signal is output so that one frame of each complementary color is obtained at the end of the first to fourth photographing periods indicated by +4. By taking the above steps, each complementary color value becomes 1
After being written in the memory for the number of frames, the control device 10 reads the complementary color value at the same position of the complementary color image of one frame through the address read control lines 13-1 to 13-4 and transmits it to the camera signal processing circuit 6 The address read control signal is output so that In the camera signal processing circuit 6 which has obtained the complementary color value at the same position of the complementary color image of one frame,
An RGB signal is generated by a matrix operation or the like and output to a 7-channel 3-channel D / A converter and a 9-digital interface device. The RGB image signal analog-converted by the 3-channel D / A converter of 7 can be viewed as a high-resolution color still image on the high-definition display of 8, and the digital RGB image signal of 9 is a digital interface device. Through an external digital information device.

Further, in the embodiment of the present invention, the CCD for frame reading is used. However, when the vertical shift amount of pixel shift in FIG. 2 is set to 2 lines, the CCD for field reading is also used. Can handle.

[0010]

As described above, according to the present invention,
The frequency of the color carrier representing the color information obtained from the single image sensor using the conventional complementary color mosaic filter is due to the half of the pixel sampling frequency, to the theoretical limit of color information reproduction, With respect to still images, a high-definition color still image can be realized with a simple structure using an inexpensive CCD, exceeding the limit.

[Brief description of drawings]

FIG. 1 is a diagram of a first embodiment of the present invention.

FIG. 2 is a pixel shift process diagram of the present invention.

FIG. 3 is a pixel layout diagram of a complementary color mosaic filter.

[Explanation of symbols]

 1 Lens System 2 Means for Changing Optical Path 3 CCD 4 A / D Converter 5-1 First Memory 5-2 Second Memory 5-3 Third Memory 5-4 Fourth Memory 6 Camera Signal Processing Circuit 7 3-channel D / A converter 8 High-definition color display 9 Digital interface device 10 Control device 11 CCD driver 12-1 to 12-4 Address write control line 13-1 to 13-4 Address read control line

Claims (1)

[Claims] 1. An image pickup lens, an image pickup device which is composed of n different kinds of complementary colors, and has a color separation filter formed on the surface thereof, with the basic arrangement of these as one unit, and between the image pickup lens and the image pickup device. Displacement means for displacing the relative position in the horizontal / vertical direction, means for storing each complementary color signal separated by each color separation filter output from the image pickup device in a corresponding memory, and the displacement means for sequentially storing the complementary color signals. Colors that sequentially output the outputs from the image sensor under the state of relative displacement to the memories corresponding to the complementary color signals described above and form color signals using the complementary color signals corresponding to the same position in each memory. Signal synthesizing means,
An image pickup apparatus comprising: