JPH06261243A - Highly precise still picture input device - Google Patents

Abstract

PURPOSE:To enable the input of a highly precise still picture without providing a special scanning mechanism and a very small displacement mechanism by performing an image interpolation according to the detection result of the motion of the still- picture signal recorded in an input memory and an output memory. CONSTITUTION:An A/D conversion part 5 performs an A/D conversion for the analog image signal outputted from a CCD 2 and outputs the signal as a digital image signal. In an input image memory part 6, the digital image signal corresponding to one frame which is outputted from the conversion part 5 is expanded to N times of the number of picture element and interpolated by an image processing part 10, and is recorded. In an output image memory part 7, a more highly precise still picture image for which a picture element interpolation is performed by the processing part 10 according to the detection result of a motion detection part 9 from the still-picture corresponding to one frame recorded in the memory part 6 and the still-picture before one frame which is preliminarily recorded in the memory part 7 is recorded. A finder 8 displays the still-picture image recorded in the memory part 7 and a photographer looks at the image displayed on the finder 8 and confirms an image to be fetched.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a high-definition still image input device for inputting a high-definition still image. A fine still image input device.

[0002]

2. Description of the Related Art Conventional techniques for inputting a high-definition still image include (1) a structure in which a line sensor is scanned in one direction to input an image, and (2) an area sensor in x, y directions. A structure for scanning and inputting an image (Japanese Patent Application Laid-Open No. HEI 3-
240372), (3) x,
A configuration in which a minute displacement is performed by 1 / N pixel pitch in the y direction, and the number of pixels is apparently increased by N times by pixel interpolation to achieve high definition (JP-A-58-197970 and JP-A-59).
-22485, JP-A-64-60072, etc.).

[0003]

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention (1)
In and (2), in the configuration in which the image is input by scanning the line sensor and the area sensor, the sensor is scanned by the size of the reading screen, so that the reading time becomes long and the device must be completely fixed during that time. There was a problem that it had to be. Further, in the above-mentioned conventional technique (3), in the configuration in which the area sensor is slightly displaced by 1 / N pixel pitch, it is necessary to incorporate a minute displacement mechanism using a piezoelectric element or the like in the input device or the image pickup element itself. There is a problem that the device is complicated and expensive.

In view of the above-mentioned problems in the conventional technique, an object of the present invention is to provide a high-definition still image input device capable of inputting a high-definition still image without providing a special scanning mechanism or a minute displacement mechanism. Especially.

[0005]

SUMMARY OF THE INVENTION An object of the present invention is to provide an image pickup means for continuously extracting a still image signal in frame units, a motion detection means between two consecutive frames, and a detection result of the motion detection means. Image processing means for performing pixel interpolation in accordance with the above, input memory means for recording one frame of still image signal obtained by the image capturing means, and output for recording one frame of still image signal obtained by the image processing means. The image processing means includes a still image signal for one frame captured by the image capturing means and recorded in the input memory means and a still image signal for one frame before recorded in the output memory means. This is achieved by a high-definition still image input device that outputs a still image signal that has undergone pixel interpolation and image interpolation according to the detection result of the motion detection means.

[0006]

In the high-definition still image input device of the present invention, a still image signal for one frame captured by the image pickup means and recorded in the input memory means, and a still image of one frame before recorded in the output memory means. The image signal is subjected to pixel interpolation by the image processing means in accordance with the detection result of the motion detection means, and is recorded again in the output memory means as a still image signal of higher definition.

[0007]

Embodiments of the high-definition still image input device of the present invention will be described in detail below with reference to the drawings.

In this embodiment, a still image obtained by the image pickup means is positively utilized by positively utilizing movements such as camera shake that occur during handheld photography, which has been an obstacle in handheld photography equipment such as video movies. A high-definition still image input device configured to perform high-definition processing with N times the number of pixels will be described.

FIG. 1 is a block diagram showing the configuration of an embodiment of a high-definition still image input device of the present invention.

The high-definition still image input device of FIG. 1 comprises an optical system section 1 which is an image pickup means, a charge coupled device (CCD) 2 and C.
CCD drive unit 3 connected to CD 2, signal processing unit 4 connected to CCD 2, analog / digital (A / D) conversion unit 5 connected to signal processing unit 4, and A / D conversion unit 5 An image processing unit 10, which is an image processing unit, a motion detection unit 9, which is a motion detection unit connected to the image processing unit 10, an image processing unit 10, and an input image memory unit, which is an input memory unit connected to the motion detection unit 9. 6, an image processing unit 10, a motion detection unit 9, and an output image memory unit 7 which is an output memory unit connected to the input image memory unit 6, and a finder 8 connected to the output image memory unit 7.

The optical system section 1 is composed of an optical lens, a shutter, a diaphragm, and the like, and forms an image of input light from a subject on the light receiving surface of the CCD 2.

The CCD 2 photoelectrically converts the input light from the object imaged by the optical system section 1 by a drive signal from the CCD drive section 3 and outputs it as an analog image signal.
At this time, the exposure time is sufficiently shortened by using the mechanical shutter of the optical system unit 1 or the electronic shutter of the CCD 2 so that the camera shake generated during hand-held photographing does not affect the analog image signal in the frame.

The signal processing unit 4 performs processing such as gamma correction, clamp, and auto gain control on the analog image signal output from the CCD 2 and outputs it to the A / D conversion unit 5. At this time, band limiting processing by a low-pass filter or the like for preventing aliasing distortion (moiré) that occurs during sampling is not performed because it has an adverse effect for high definition.

The A / D converter 5 A / D converts the analog image signal output from the CCD 2 and outputs it as a digital image signal.

The input image memory section 6 includes an A / D conversion section 5
The digital image signal for one frame output by
The image processing unit 10 enlarges and interpolates the number of pixels to N times and records it.

The output image memory unit 7 detects a motion from a still image of one frame recorded in the input image memory unit 6 and a still image of one frame before recorded in the output image memory unit 7 in advance. A higher-definition still image in which pixels are interpolated by the image processing unit 10 according to the detection result of the unit 9 is recorded.

The finder 8 displays the still image recorded in the output image memory section 7. The photographer checks the captured image by looking at the image displayed on the finder 8.

The motion detector 9 detects one frame of still image recorded in the input image memory 6 and one frame of still image recorded in the output image memory 7.
The amount of movement between two frames is detected with an accuracy of less than one pixel and output to the image processing unit 10.

The image processing section 10 is shown in FIGS.
The following two processes are performed.

As a method of detecting the amount of motion with an accuracy of less than one pixel, (a) correlation method (block matching), the correlation method is used for a still image enlarged and interpolated to N times the number of pixels by the image processing unit 10. Thus, the amount of movement of the original still image obtained by the image pickup unit in units of 1 / N pixel is detected.

(B) Gradient method (optical flow) The still image recorded in the input image memory unit 6 and the still image recorded in the output image memory unit 7 are regarded as continuous moving images, and the gradient method is used to detect the pixels. The movement vector is obtained as a real number and this is taken as the amount of movement.

(C) Gyro Attaching a small gyro such as a piezoelectric gyro to the input device itself, the input image memory section 6 and the output image memory section 7
The motion amount between two frames is directly detected with an accuracy of less than one pixel without input from.

Etc. are known.

In the enlargement interpolation processing shown in FIG. 2, the digital image signal for one frame output from the A / D conversion unit 5 is enlarged and interpolated to N times the number of pixels and output to the input image memory unit 6.

In the pixel interpolation processing shown in FIG. 3, the still image for one frame recorded in the input image memory unit 6 and the still image for one frame previously recorded in the output image memory unit 7 are used. The non-uniform sample point series shown in FIG. 4 is generated according to the detection result of the motion detecting section 9, and the non-uniform sample point series is converted into the uniform sample point series shown in FIG.
The still image having a higher definition is output to the output memory unit 8 again.

As a method for converting the nonuniform sample point series into the uniform sample point series, the coordinate conversion method is used in this embodiment.

In the coordinate conversion method, a uniform sampling point series f (n
When recovering the waveform f (t) from T), if the uniform sampling point sequence f (nT) is limited to the band −ω _{0 to} ω ₀ , using the sampling theorem,

[0028]

[Equation 1]

Can be restored by

The waveform f from the nonuniform sample point series f (t _n )
When (t) is restored, (t _n ) = nT and f (γ-1 (u)) by the one-to-one and continuous coordinate conversion function γ (t).
Is restricted to the band −ω _{0 to} ω ₀ , then

[0031]

[Equation 2]

Can be restored by

Therefore, as described above, the high-definition still image input apparatus of the present invention positively utilizes movements such as camera shake that occur during hand-held photography, which is an obstacle in hand-held photography equipment such as video movies. It is configured.

[0034]

According to the high-definition still image input device of the present invention, an image pickup means for continuously extracting still image signals in frame units, a motion detecting means between two consecutive frames, and a detection result of the motion detecting means. Image processing means for performing pixel interpolation according to the above, input memory means for recording one frame of still image signal obtained by the image pickup means, and one frame of still image signal obtained by the image processing means. The image processing means is provided with an output memory means, and the image processing means captures a still image signal for one frame captured by the image capturing means and recorded in the input memory means and a still image signal one frame before recorded in the output memory means. Since the image is interpolated in accordance with the detection result of the motion detection means and the image-interpolated still image signal is output, it is possible to perform high-resolution operation without completely fixing the device at the time of image acquisition. Input fine Do a still image is made possible. Further, since it is not necessary to provide a special scanning mechanism or a minute displacement mechanism, the structure is simple and the device can be downsized.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of an embodiment of a high-definition still image input device of the present invention.

FIG. 2 is a block diagram for explaining enlarged interpolation processing in the image processing unit 10 in FIG.

3 is a block diagram for explaining pixel interpolation processing in the image processing unit 10 in FIG.

4 is an explanatory diagram of an example of a non-uniform sample point series generated from the detection result of the motion detection unit 9 in FIG.

5 is an explanatory diagram of an example of a uniform sampling point series converted from the non-uniform sampling point series of FIG.

[Explanation of symbols]

 1 Optical System Section 2 Charge Coupled Device (CCD) 3 CCD Driving Section 4 Signal Processing Section 5 Analog / Digital Conversion Section 6 Input Image Memory Section 7 Output Image Memory Section 8 Finder 9 Motion Detection Section 10 Image Processing Section

Claims (1)

[Claims] 1. An image pickup means for continuously extracting a still image signal frame by frame, a motion detection means for detecting the presence or absence of motion between two consecutive frames, and a pixel according to the detection result of the motion detection means. Image processing means for performing interpolation, input memory means for recording one frame of still image signal obtained by the image capturing means, and output memory means for recording one frame of still image signal obtained by the image processing means The image processing means includes the still image signal of the one frame captured by the image capturing means and recorded in the input memory means, and one frame before the one frame recorded in the output memory means. A high-definition still image input device, characterized in that the still image signal is pixel-interpolated according to the detection result of the motion detection means, and the image-interpolated still image signal is output.