JPH09219867A - Still color picture image pickup device and its method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a moving image which obtains a picture of high quality equivalent to a three-CCD type at cost as low as a single-CCD type, prevents an inputting time from becoming redundant and is free from moire stripes. SOLUTION: This device uses what obtained by fixing a color filter with different color component areas corresponding to the arraying interval of photoelectric conversion element to the front face of the image picking-up face of a solid-state image pickup device 33 with the image picking-up face constituted by arraying many photoelectric conversion elements in the state of a matrix. Then the solid-state image pickup device and incident light to the solid-state image pickup device 33 are mutually displaced by the unit of the arraying interval of photoelectric conversion element along the image picking-up face to change the irradiating position of the incident light to the solid-state image pickup device 33 to image-compose image data of the solid-state image pickup device 33 picked up at the plural changed positions. In addition the dislocation is executed so as to invert moire phase to prevent moire stripes from being visualized in the moving image.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a color still image pickup device and method using a solid-state image pickup device.

[0002]

Conventionally, CCD (Cha
There are the following types of color image pickup apparatus systems using solid-state image pickup devices such as a large coupled device (charge coupled device).

1) Three-plate color camera: Incident light is separated into three primary colors using an optical system (prism), and each of the three components is received by three solid-state image pickup devices. According to this three-plate type color camera, three color components can be taken out at a time, and the processing system is independent for each component, so that ideal image pickup characteristics can be obtained. On the other hand, three solid-state image pickup devices are required, the color separation optical system is complicated, and the mounting precision of the three solid-state image pickup devices is also required, so that the system becomes expensive.

2) Single-plate type color camera This is a system in which a color filter is attached to each pixel (photoelectric conversion element) of the solid-state image pickup device to obtain color information from one solid-state image pickup device. As the color filter, a filter in which primary colors or complementary colors are arranged in a mosaic pattern or a stripe pattern corresponding to each pixel is used. Compared to the three-plate type, this single-plate type color camera does not require a special color separation optical system,
In addition, a single solid-state image pickup device is sufficient, so that the system is inexpensive. However, the information that can be taken out per pixel is a single color, and the lacking color information is supplemented by the information of the adjacent pixel, which causes the problem of generation of false colors and deterioration of resolution.

3) Color filter conversion single-plate color camera A solid-state image pickup device is used as a single plate, and color filters arranged in the optical path from the subject to the solid-state image pickup device are sequentially synchronized with the charge transfer timing of the solid-state image pickup device. The color information is extracted by this conversion. A color still image is obtained by accumulating and synthesizing them. In this case, there is an example in which the pixel shifting method is performed to improve the resolution (Japanese Patent Laid-Open No. 6-242242).
181546). This color filter conversion type has the advantage of obtaining the same image quality as the three-plate type with a single plate, but by rotating a relatively large color filter etc., the color of the light incident on the solid-state imaging device is changed sequentially. Therefore, there is a problem that it takes time to input an image and the size of the apparatus becomes large.

The present invention has been made in view of the above-mentioned circumstances, and it is possible to obtain a high image quality as high as that of a three-plate system at a cost of a single-plate system, and a color still image without input time redundancy. An object is to provide an imaging device and method.

[0007]

In order to achieve the above-mentioned object, a color still image pickup device according to the present invention comprises a solid-state image pickup device having an image pickup surface in which a large number of photoelectric conversion elements are arranged in a matrix. A color filter fixed to the front surface of the imaging surface of the solid-state imaging device and having different color component regions corresponding to the arrangement intervals of the photoelectric conversion elements; the solid-state imaging device and incident light to the solid-state imaging device; Drive means for relatively displacing the photoelectric conversion elements along the imaging surface in units of arrangement intervals and changing the irradiation position of the incident light with respect to the solid-state imaging device; and a plurality of positions where the irradiation position is changed by the driving means. Storage means for recording imaged image data of the solid-state imaging device, and image data obtained by reading out the image data stored in the storage means. Processing means for combining, and having a.

[0008] Preferably, the driving means has all kinds of color component areas in which the incident area of the incident light having a size corresponding to the size of the photoelectric conversion element is adjacent to the color filter of the solid-state image pickup device. The solid-state imaging device and the incident light are relatively displaced a plurality of times so as to move upward.

Further, in order to further improve the resolution, the driving means displaces the solid-state image pickup device and the incident light relative to each other by ½ of the arrangement interval of the photoelectric conversion elements, and further from there, the arrangement of the photoelectric conversion elements. The irradiation position of the incident light with respect to the solid-state imaging device is changed by performing relative displacement in intervals.

As a preferred structure, the drive means has a support device for movably supporting the solid-state image pickup device in a first direction and a second direction perpendicular to the first direction. The device comprises a support plate portion that constitutes a surface perpendicular to the optical axis of incident light, standing portions that are provided at right angles on both sides of the supporting plate portion, and the standing portions that are provided at the ends of the standing portions on both sides. The first and second plate members each have a mounting plate portion parallel to the support plate portion and are formed by bending a thin plate having elasticity. The bending strength of the first and second plate members is preferably reduced in bending.

The color still image pickup method according to the present invention for achieving the above-mentioned object has a solid-state image pickup device having a plurality of photoelectric conversion elements arranged in a matrix in front of the image pickup surface. Using a fixed color filter having different color component regions corresponding to the arrangement interval of the photoelectric conversion elements, and photoelectric conversion of the solid-state imaging device and incident light to the solid-state imaging device along the imaging surface. Characterized in that the irradiation position of the incident light with respect to the solid-state imaging device is changed by relatively displacing the elements in an array interval unit, and image data of the solid-state imaging device imaged at a plurality of changed positions is image-synthesized. To do.

[0012]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 4 is an explanatory view of the principle of the present invention. FIG.
Represents a part of the color filter 11, and each of a large number of squares shown in the drawing represents a color component region 12 of the color filter 11. Filters for the three primary colors RGB are arranged in a mosaic pattern in each color component region 12. In this example, the color arrangement of the filters is what is called a Bayer arrangement,
Rows in which GRs are arranged alternately and rows in which BGs are arranged alternately are arranged so that G is in a checkered pattern. It is known that the resolution is improved by increasing the G signal.

A solid-state image pickup device (not shown in FIG. 4) is located on the back surface of the color filter 11. The solid-state imaging device is, for example, a CCD, and has an imaging surface in which a large number of photodiodes, which are photoelectric conversion elements that become pixels, are arranged in a matrix (for example, 250,000 at an arrangement interval of 7 μm). The color filter 11 is fixed to the front surface. Each color component area 12 of the color filter 11 is provided so as to face each photoelectric conversion element of the solid-state image pickup device in a one-to-one manner, and each photoelectric conversion element receives the incident light transmitted through the filter of the color component area facing each other. It is supposed to be irradiated. Then, the color filter 11 and the solid-state imaging device are positioned and attached at the focal position of the lens system (not shown) of the camera.

In such a solid-state image pickup device, the color of the filter attached to each photoelectric conversion element is fixed, so that the color information that can be taken out from one photoelectric conversion element is single for each image pickup.

The incident light from the lens system of the camera is applied over the entire image pickup surface of the solid-state image pickup device. Here, as an example, consider a point W on the image pickup surface irradiated by the incident light. In FIG. 4A, the position coordinate of the point W on the solid-state imaging device is (0, 0). When the solid-state image pickup device together with the color filter 11 is accurately shifted downward by one pixel (the arrangement interval of photoelectric conversion elements) from the state of FIG. 4A on the XY coordinate in the image pickup plane, it is shown in FIG. 4B. Like W
The point moves to the position coordinate (0, 1) on the solid-state imaging device.

That is, the filter color at the position of the position coordinate (0, 0) of the solid-state image pickup device is G, but the filter color at the position of the position coordinate (0, 1) is B, and therefore the position coordinate (0, 0). By capturing images at two positions of 0) and (0, 1), information of two color components (G, B) can be extracted for the point W.

Similarly, if the solid-state image pickup device is shifted to the left and the point W is moved to the position coordinate (1,0), the filter color at that position becomes R, and if the image is picked up there, the information of R is obtained. be able to. After all, the three components (R, G, B) of all the necessary colors at the point W are position coordinates (0, 0),
It can be taken out by imaging at (0,1) and (1,0) respectively.

On the other hand, in the color filter 11, in order to obtain the three color components at the point V in FIG. 4A, for example, position coordinates (0,0), (0,1) in order to obtain the three color components. , (1,
Imaging in 1) is required.

Therefore, in this example of the color filter 11, the position coordinates (0,0), (0,1), (1,0), (1,1) are used.
By picking up each of the images in step 1, all color components can be obtained for all pixels by a total of four times of imaging.

The arrangement of the color filters of the solid-state imaging device shown here is merely an example for explanation, and the moving direction, distance, order, number of times, etc. of the solid-state imaging device correspond to the color arrangement of the color filters. By selecting appropriately, all color components can be obtained for all pixels.

As described above, by moving the solid-state image pickup device having the color filter relative to the incident light and synthesizing the image data picked up at a plurality of positions, even if the number of pixels of the solid-state image pickup device is relatively small. It is possible to obtain a color still image with good resolution.

Next, an example of the image pickup apparatus of the present invention will be described. FIG. 1 is an exploded perspective view of an essential part of an image pickup camera according to the present invention, and FIG. 2 is a perspective view showing a partially broken internal structure of the image pickup camera according to the present invention.

As shown in FIG. 2, the image pickup camera 21 has a lens system 23 on the front surface of a housing 22.
A base plate 24 that supports a CCD (not shown in FIG. 2) at the focal position is disposed in the housing 22.
The base plate 24 is fixed to the housing 22 with screws 25, and serves as a driving means for changing the irradiation position of incident light.
A CCD is mounted on the base plate 24 via the D drive device 26.

Further, the main circuit board 2 is provided in the housing 22.
7 is fixed, and the main circuit board 27 performs a predetermined control operation. On the back surface of the housing 22, a power switch 28, a mode selection switch 29, which is operated by a camera operator,
The external power supply jack 30, the signal input / output terminal 31 and the like are provided as in a normal image pickup camera.

As shown in FIG. 1, a rectangular window portion 32 is opened in the central portion of the base plate 24. The rectangular window portion 32 is positioned and fixed so that the incident light from the lens system 23 passes therethrough, and the CCD 33 is attached to the window portion 32. Are arranged so as to face each other and receive incident light. The CCD 33 is supported by the XY support device 34. The XY support device 34 has an X-axis plate member 35 and a Y-axis plate member 36 that are first and second plate members.

The X-axis plate member 35 has a support plate portion 37 which constitutes a plane perpendicular to the optical axis of the incident light, a standing portion 38 provided at right angles on both sides of the support plate portion 37, and both standing portions 38. It has a mounting plate part 39 parallel to the support plate part 37 provided at the end of the, and is formed integrally by bending a thin metal plate having elasticity such as stainless steel. A square window 40 through which the incident light from the lens system 23 passes is opened in the center of the support plate 37. Slits 41 and 42 are formed at the bent portion at the boundary between the support plate portion 37 and the rising portion 38 and at the bent portion at the boundary between the rising portion 38 and the mounting plate portion 39, respectively. Two screw mounting holes 43 are formed in each of the mounting plate portions 39 on both sides, and the X-axis plate member 35 has the screw mounting holes 43.
And is fixed to the base plate 24 with screws 44.

Incidentally, As means for reducing the rigidity against bending at the bent portion, a plurality of small holes may be formed in a row at the bent portion instead of providing the slit as described above.

Here, the mounting plate portion 39 is the base plate 2
4, the support plate 37 is fixed to the base plate 2
4 is separated by a predetermined distance and becomes parallel. By forming the slits 41 and 42 in the bent portion, the rigidity against bending at each bent portion is reduced, and by bending at the bent portion, the support plate portion 37 remains substantially parallel to the base plate 24. It is possible to elastically displace in the X-axis direction (lateral direction in the illustrated example), which is the first direction.

Similarly, the Y-axis plate member 36 of the XY support device 34.
Is a support plate portion 45, a standing portion 46, a mounting plate portion 47, a window portion 4
8 has slits 49 and 50, has a shape similar to the X-axis plate member 35, and is formed by bending a thin plate. As shown in FIG. 3 showing a state in which the X-axis plate member 35 and the Y-axis plate member 36 are combined, the Y-axis plate member 36 is a support plate for the X-axis plate member 35 in such a manner that the Y-axis plate member 36 enters inside by using the screw mounting holes 51. Part 3
7 fixed.

While the mounting plate portion 47 is fixed to the X-axis plate member 35, the support plate portion 45 of the Y-axis plate member 36 is attached to the X-axis plate member 3.
5 is separated from the support plate portion 37 of FIG.
By bending at the bent portion, the support plate portion 45 of the Y-axis plate member 36 is in the second direction that is perpendicular to the X-axis while maintaining a substantially parallel state to the support plate portion 37 of the X-axis plate member 35. Y
It is possible to elastically displace in the axial direction (vertical direction in the illustrated example). Therefore, by combining the movements of the support plate portions 37 and 45, the support plate portion 45 of the Y-axis plate member 36 moves in the XY plane (in the plane orthogonal to the incident light) with respect to the base plate 24. can do.

By thus constructing the XY support device 34 with the X-axis plate member 35 and the Y-axis plate member 36, it is possible to obtain a support device that operates accurately with a simple structure.

Screw mounting holes 52 are opened at the four corners of the support plate portion 45 of the Y-axis plate member 36, and the XY moving plate 53 is fixed to the support plate portion 45 by screws 54 using the screw mounting holes 52. The window 5 is provided at the center of the XY moving plate 53.
5 is opened, and the CCD 33 is fixed there. CCD
33 is a CCD positioning plate 57 between it and its circuit board 56.
Is attached to the circuit board 56 with the interposition of the XY moving plate 53 with screws 59 using the screw mounting holes 58 opened in the circuit board 56 and the CCD positioning plate 57.
Fixed to

Here, a CCD as a solid-state image pickup device
Reference numeral 33 has an image pickup surface in which a large number of photoelectric conversion elements are arranged in a matrix in the directions of the X axis and the Y axis, and the color filter 11 as shown in FIG. 4 is fixed to the image pickup surface.
With the CCD 33 fixed to the XY moving plate 53, the XY direction of the image pickup surface matches the XY direction of the XY support device 34 described above, and the image pickup surface of the CCD 33 is located at a predetermined position with respect to incident light. It is adjusted by the CCD positioning plate 57.

An X-axis engaging arm 60 and a Y-axis engaging arm 61 are formed on the side and bottom of the XY moving plate 53, respectively. Correspondingly, the base plate 24 is provided with an X-axis drive unit 62 and a Y-axis drive unit 63. The X-axis drive unit 62 includes the support member 6 fixed to the base plate 24.
4, a displacement amplification angle 65 made of a spring material, and an X-axis piezoelectric element 66 that is displaced in the X-axis direction.

The displacement amplification angle 65 includes a fulcrum portion 68 fixed to the support member 64 by screws 67 and an intermediate arm portion 69.
And an engaging portion 70 provided at the tip of the intermediate arm portion 69, and the X-axis engaging arm 60 of the XY moving plate 53 is fitted into a hole 71 opened at the tip of the engaging portion 70 for positioning. To be done.

The X-axis piezoelectric element 66 is clamped and attached between the support member 64 and the intermediate arm portion 69. A leaf spring 85 is formed at the tip of the fulcrum 68 of the displacement amplification angle 65, and
When the shaft piezoelectric element 66 is attached, the leaf spring 85 causes the intermediate arm portion 6 to move.
9 to press the X-axis piezoelectric element 66.

The X-axis piezoelectric element 66 is connected to a driver circuit device (not shown) and is displaced when a voltage is applied at a predetermined timing. When the X-axis piezoelectric element 66 is displaced, the movement is enlarged by the displacement amplification angle 65 and transmitted to the X-axis engaging arm 60, and the XY moving plate 53, that is, the CCD 33 is moved in the X-axis direction. The amount of movement of the CCD 33 can be adjusted by changing the applied voltage, and these controls can be performed using known means.

The Y-axis drive unit 63 also has the same structure as the X-axis drive unit 62, and includes a support member 72 and a displacement amplification angle 7.
3, the Y-axis piezoelectric element 74 which is displaced in the Y-axis direction, and when a voltage is applied to the Y-axis piezoelectric element 74 at a predetermined timing, the XY moving plate 53, that is, the CCD 33 is moved to the Y direction.
Move in the axial direction.

Here, it is necessary to move the CCD 33 at every arrangement interval of the photoelectric conversion elements by driving the piezoelectric elements 66 and 74, but the applied voltage (driving voltage) to the piezoelectric elements 66 and 74 and the moving distance of the CCD 33. The calibration can be easily performed by using the moire fringes that appear on the TV monitor when the test pattern is imaged.

As an example, in the resolution chart, black vertical stripe patterns and horizontal stripe patterns are drawn on a white background for measuring the resolution, and the thickness and interval of the stripes are gradually narrowed. Focusing on this chart while viewing the image captured by the image capture device on the video monitor, the false color, which is the drawback of the single-panel system described above, occurs at the boundary between white and black, so it overlaps with the stripe pattern. Another striped pattern with alternating red and blue appears at the position. This false-color striped pattern is thicker than the test pattern and has a larger interval, so that it is easy to see, and since the moving amount when the CCD is moved is also large, it is easy to confirm.

To adjust in the X direction, the drive voltage is adjusted while observing the position of the false color appearing on the vertical stripe pattern. The position of the false color is not precisely the position with respect to the monitor, but the relative position with respect to the vertical stripe pattern. If the colors of red and blue change before and after the movement, the amount of movement is just one pixel. The adjustment in the Y direction can be similarly performed using the horizontal stripe pattern.

The test chart that can be used here is not limited to the resolution chart, and may be any pattern that produces an appropriately easy-to-see false color.

FIG. 5 is a block diagram of the entire apparatus corresponding to the above-described image pickup apparatus, and FIG. 6 is a control flow chart thereof. As shown in FIG. 5, the CCD 33 photoelectrically converts the image incident light and outputs it to the AD converter 75. AD converter 75
Quantizes the signal from CCD 33 as image data,
The image data is sequentially stored in the data storage device 77 which is a storage means under the control of the system controller 76.
Digital signal process (DSP) 7 as processing means
Reference numeral 8 reads out the image data stored in the storage device 77, synthesizes the image data into one image, and outputs the image. On the other hand, CCD driving device 2
6 is an instruction of the system control 76, and the CCD 33 is appropriately used.
Are moved in units of pixel arrangement intervals.

The movement and image pickup of the CCD 33 are performed as shown in FIG. 6, for example. That is, first in step 79,
The image data captured at the XY coordinates (0,0) is stored in the first memory of the data storage device 77. Then step 80
Then, the image data captured at the XY coordinates (0, 1) is stored in the second memory of the data storage device 77. Next, at step 81, the image data captured at the XY coordinates (1, 0) is stored in the third memory of the data storage device 77. Next, at step 82, the image data taken at the XY coordinates (1, 1) is stored in the fourth memory of the data storage device 77. Finally, in step 83, the DSP 78 reads out the image data from the first to fourth memories, synthesizes it into one image, and outputs it.

As described above, by combining the image data picked up at a plurality of positions, it is possible to obtain a color still image with good resolution even if the solid-state image pickup device has a relatively small number of pixels. In the case of this example, since image data for each of the three primary colors is obtained for all pixels, a resolution three times higher than that of a conventional solid-state imaging device having a color filter can be achieved.

By the way, conventionally, there is a pixel shift method as a method for increasing the resolution of a solid-state image pickup device. The resolution of a solid-state imaging device such as a CCD is determined by the number of pixels, and in order to increase the resolution of the solid-state imaging device itself, it is necessary to arrange pixels in high density, and there is a limit to the improvement of resolution by improving the element itself. Therefore, the pixel shifting method has been considered as a conventional technique for increasing the resolution of a solid-state imaging device having a limited number of pixels. In addition to imaging at the original position of the solid-state imaging device, imaging is also performed at a position where the relative position between the solid-state imaging device and incident light is shifted by, for example, 1/2 of the pixel pitch (arrangement interval of photoelectric conversion elements). Is to improve the resolution by extracting information from a space where no pixels exist and inserting the information into the original image. The shift amount is 1/3, 1/4 of the pixel pitch,
.. If the sampling points are increased at intervals, it is possible to obtain even finer spatial information, depending on the relationship with the photosensitive area per pixel of the element.

By applying this pixel shift method to the present invention, an image having a higher resolution can be obtained. FIG. 7 is an explanatory diagram of an example in which the pixel shift method is applied to the present invention.

In FIG. 7, the squares represent the pixels 84 of the solid-state image pickup device. Now, the center point of the pixel 84 in the upper left corner is C, and the pixel pitch is 1 in the X direction.
1/2 the moved point is 1/2 of the pixel pitch in the C1 and Y directions
The moved point is 1 / of the pixel pitch in both C2, X, and Y directions.
The point moved by 2 is designated as C3.

In the image pickup according to the present invention to which the pixel shift is applied, first, when the center of the pixel 84 in the upper left corner is the point C, the solid-state image pickup device is moved by one pixel pitch with the point C as the center, as described above. Imaging is performed at each of four positions. Next, the solid-state imaging device is moved by half a pixel so that the center of the pixel 84 at the upper left corner comes to the point C1, and the solid-state imaging device is similarly moved by one pixel pitch with the position at the center as described above. Imaging is performed at each position. Similarly, the centers are points C2 and C3.
, And the solid-state imaging device is moved by 1 pixel pitch centering on each position as described above to perform imaging at each of four positions. Finally, a total of 16 pieces of image data thus captured are combined to obtain one color still image.

In this example, 16 times of imaging are performed to obtain one still image, but the operation time of the piezoelectric element required to move the solid-state imaging device by a small amount is short, and the operation time is extremely short. It is possible to take images 16 times.

A high resolution can be achieved by using the pixel shift together as described above. In the example described with reference to FIG.
It is possible to obtain a resolution equivalent to that obtained by using a 3-megapixel device having 1 million pixels by using a solid-state imaging device having 10 million pixels.

The high-definition still image camera of the present invention is intended for taking high-definition still images, but it is required that it can be used at a video signal level as a normal CCD camera. is there. At this time, the false color (moiré fringe) is regarded as a defect and becomes a problem. The present invention provides means for solving this problem as well, and will be described below.

Usually, the mosaic color CCD camera cannot accurately detect the hue of each dot, and therefore, in an image containing a high frequency component, a false color (moire fringe) is generated in the vicinity thereof.
Occurs. In order to prevent this, it is necessary to blur the image to some extent before the CCD, that is, to cut off high-frequency components, and an optical low-pass filter is generally used. However, since the moire cannot be completely erased, the moire elimination circuit is used by further combining the edge detection circuit and the color signal suppression circuit.

Since the high-definition still image camera of the present invention is intended to take a high-definition image, the high frequency component of the image is important, and an optical low pass filter cannot be used. Therefore, when the high-definition still image camera of the present invention is operated in the normal resolution mode, the above-mentioned problem of false color occurs.

As one solution, in the normal resolution mode, the XY fine movement table is vibrated at a rate of at least one cycle within one exposure time (for example, 1/60 seconds), and the optical low-pass filter is used. There is also a method of solving the problem of false color by cutting high frequency components without using. However, in this case, if you try to completely eliminate the moiré fringes, the image becomes too blurry, and if you try to suppress it to the same level of effect as an optical low-pass filter, it is difficult to control the vibration, and the moiré erasing circuit is the same as before. Is required.

The present invention provides means for solving this problem as well. That is, in the normal resolution mode,
The false color problem is solved by moving the XY fine movement table for each field so that the moiré phase is reversed between the first field and the second field so that the moiré cannot be visually recognized. The moving direction depends on how the colors of the color filters used are arranged, but in the case of the color filter (RGBG) shown in the embodiments of the present application,
It is appropriate to move both X and Y by one pixel at the same time and consequently move diagonally. That is, as can be seen from the above description of the adjustment method in the X direction and the Y direction, when the pixel is shifted by 1 pixel in the X direction, the red and blue moire stripes appearing on the fine vertical stripe pattern are replaced with each other, and by further shifting by 1 pixel in the Y direction. The red and blue moire fringes appearing on the fine horizontal stripe pattern are exchanged. When this is repeated for each field, the moire is completely invisible to the human eye, although red and blue are actually displayed alternately. At this time, by shifting the CCD read timing by one pixel for each field, a high-resolution image signal can be obtained.

As described above, the high-definition still image camera of the present invention is not limited to high-definition still images, and does not show moire at all.
Video signals with better image quality than ever before, without using optical low-pass filters or moire elimination circuits,
You can get it.

In the above description, the solid-state imaging device is moved in order to move the irradiation position of the incident light on the solid-state imaging device. However, in the present invention, the solid-state imaging device and the incident light can be relatively displaced. It is necessary, and the incident light may be moved instead of moving the solid-state imaging device. This can be done, for example, using a glass plate or the like.

That is, a transparent material such as a glass plate having a refractive index larger than that of air is supported so as to be slightly rotatable independently about the X axis and the Y axis, and the transparent material is arranged in front of the CCD on the optical path. By changing the inclination angle of the transparent material, incident light can be refracted and the irradiation position thereof can be changed. In this case, the thickness of the transparent material may be increased to largely deflect the incident light with a small inclination angle.

Further, although the color filters in which RGB are arranged on the mosaic are used in the above example, the color filter used in the present invention is not limited to this. There are various combinations in which RGB filters are arranged in a mosaic pattern, and the present invention can be applied to various color filter arrays (CFA) such as those to which complementary colors Cy, M, Ye or white W are added.

Further, a color filter in which RGB is sequentially arranged in a stripe pattern can be preferably used. In the case of the above-mentioned mosaic arrangement, it is necessary to move the irradiation position of the incident light in both the XY directions, but in the case of using the stripe arrangement, it is sufficient to move in one direction across the stripes. There is an advantage that can be simplified.

Further, in the above description, the CCD is mentioned as an example of the solid-state image pickup device, but the present invention is not limited to this.
Others, for example, a MOS type image pickup device, a CPD (Cha
The same can be applied to a raging priming device, a priming device, etc.).

Further, although the piezoelectric element is used as the driving source in the above example, a magnetostrictive element can also be suitably used,
Further, a linear motor such as a plunger solenoid, a rotary motor, or a simple electromagnet can be used.

In the above description, an example in which the image pickup surface is a flat surface has been shown, but the image pickup surface formed by the photoelectric conversion elements does not necessarily have to be a flat surface. In some cases, the image pickup surface is formed into a spherical shape, for example. At the same time, it is possible to make relative movement within the spherical surface.

[0066]

As described above, according to the present invention, the photoelectric conversion elements are arranged on the front surface of the imaging surface of the solid-state imaging device having the imaging surface in which a large number of photoelectric conversion elements are arranged in a matrix. , A solid-state imaging device in which the irradiation area of incident light to the solid-state imaging device is changed in units of arrangement intervals of photoelectric conversion elements, and images are captured at a plurality of changed positions. Since the image data of the above is combined to obtain one color still image, it is possible to obtain high image quality comparable to that of the three-panel system at the cost of a single-panel system without increasing the number of solid-state imaging devices and the number of pixels. The input time is not redundant. Furthermore, it is possible to create a moving image in which moire fringes cannot be seen at all.

[Brief description of drawings]

FIG. 1 is an exploded perspective view of a main part of an imaging camera according to the present invention.

FIG. 2 is a perspective view showing an internal structure of the image pickup camera according to the present invention with a part thereof cut away.

FIG. 3 is a perspective view of an XY support device showing a state in which an X-axis plate member and a Y-axis plate member according to the present invention are combined.

FIG. 4 is an explanatory diagram of the principle of the present invention.

FIG. 5 is a block diagram of an entire apparatus corresponding to the image pickup apparatus according to the present invention.

FIG. 6 is a control flow chart of the apparatus of FIG.

FIG. 7 is an explanatory diagram of an example in which the pixel shift method is applied to the present invention.

[Explanation of symbols]

 11 color filter 12 color component area 21 imaging camera 22 housing 23 lens system 24 base plate 26 driving device 27 main circuit board 28 power switch 29 mode change switch 30 external power jack 31 signal input / output terminal 33 CCD 34 XY support device 35 X axis plate Member 36 Y-axis plate member 37, 45 Support plate part 38, 46 Standing part 39, 47 Mounting plate part 41, 42, 49, 50 Slit 53 XY moving plate 56 Circuit board 57 CCD positioning plate 60 X-axis engaging arm 61 Y Shaft engagement arm 62 X-axis drive unit 63 Y-axis drive unit 64, 72 Support member 65, 73 Displacement amplification angle 66 X-axis piezoelectric element 74 Y-axis piezoelectric element 75 AD converter 76 System control 77 Data storage device 78 Digital signal process

Claims (11)

[Claims] 1. A solid-state imaging device having an imaging surface in which a large number of photoelectric conversion elements are arranged in a matrix, and fixed to the front surface of the imaging surface of the solid-state imaging device and corresponding to the arrangement interval of the photoelectric conversion elements. A color filter having different color component regions, relative displacement of the solid-state image pickup device and incident light to the solid-state image pickup device along the image pickup surface in units of arrangement intervals of the photoelectric conversion elements, and with respect to the solid-state image pickup device. Driving means for changing the irradiation position of the incident light, accumulating means for recording image data of the solid-state imaging device imaged at a plurality of positions where the irradiation position is changed by the driving means, and accumulating in the accumulating means. And a processing unit which reads the image data and synthesizes the image, and a color still image pickup device. 2. The drive means is configured such that the incident area of the incident light having a size corresponding to the size of the photoelectric conversion element is on all adjacent color component areas of the color filter of the solid-state imaging device. The color still image pickup device according to claim 1, wherein the solid-state image pickup device and the incident light are relatively displaced a plurality of times so as to move. 3. The color still image pickup device according to claim 1, wherein the color component regions of the color filter are arranged in a mosaic pattern having a size corresponding to the size of each photoelectric conversion element. 4. The color still image pickup device according to claim 1, wherein the color component regions of the color filter are arranged in a stripe shape with a width corresponding to the width of the photoelectric conversion element. 5. The color still image pickup device according to claim 1, wherein the driving unit moves the solid-state image pickup device with respect to the incident light. 6. The drive means divides the solid-state imaging device and the incident light by half the arrangement interval of the photoelectric conversion elements.
2. The relative displacement, and further relative displacement in units of arrangement intervals of the photoelectric conversion elements from there, change the irradiation position of the incident light with respect to the solid-state imaging device.
The described color still image pickup device. 7. The drive means includes a support device that supports the solid-state imaging device so as to be movable in a first direction and a second direction that is perpendicular to the first direction, and the support device includes: Support plate portions that form a plane perpendicular to the optical axis of the incident light, upright portions that are provided at right angles on both sides of the support plate portion, and the support plate portions that are provided at the ends of the upright portions on both sides. 2. The color still image pickup device according to claim 1, further comprising: first and second plate members integrally formed by bending elastic thin plates, each of which has a mounting plate portion parallel to the above. 8. The color still image pickup device according to claim 7, wherein the bending strength of the first and second plate members is reduced in bending. 9. The processing means, in addition to combining still images,
A video signal creating function for outputting a moving image is provided, wherein the video signal creating function relatively displaces the solid-state imaging device and the incident light in a horizontal direction or a vertical direction or both directions in an array interval unit of the solid-state imaging device. 2. The color according to claim 1, wherein two types of images captured by the camera are input, the first image is output at the timing of the first field, and the second image is output at the timing of the second field. Still image pickup device. 10. The color still image capturing apparatus according to claim 9, wherein the first image and the second image have a relationship in which the phases of the moire fringes appearing on both the images are inverted from each other. 11. A color having a different color component region corresponding to the arrangement interval of the photoelectric conversion elements on the front surface of the solid-state imaging device having an imaging surface in which a large number of photoelectric conversion elements are arranged in a matrix. Using a fixed filter, the solid-state image pickup device and incident light to the solid-state image pickup device are relatively displaced along the image pickup surface in units of arrangement intervals of the photoelectric conversion elements, and the incident light to the solid-state image pickup device is changed. A color still image capturing method, characterized in that the irradiation position is changed, and image data of the solid-state imaging device imaged at a plurality of changed positions is image-synthesized.