JPH1146333A - Image-pickup recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent the generation of camera-shake or deterioration in the vertical resolution, in the case of an image with a fast motion when processing an electronic zoom or slow motion being conducted at the reproducing time a camcorder. SOLUTION: An image-pickup device 10 having full pixel read image-pickup elements provides an output of two video signals (1), (2) having field images in a mutually interlacing relation for one field period simultaneously, and the video signals are separately recorded by recording and reproducing devices 11, 12 respectively. In the case of conducting electronic zoom processing or slow motion processing with an image-processing circuit 14 at reproduction, reproduction signals (1), (2) from the recording and reproducing devices 11, 12 are used. At this time, the reproduction signals (1), (2) have field images in a mutually interlacing relation which configure frame images photographed at the same time.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera-integrated VTR.
And the like.

[0002]

2. Description of the Related Art In a conventional imaging recording / reproducing apparatus such as a camera-integrated VTR, in the NTSC system, an interlaced image is captured at a rate of 60 fields / 30 frames per second and recorded / reproduced. In such an imaging recording / reproducing apparatus, when performing an electronic zoom process for enlarging a reproduced image of a captured image by image processing, if image processing is performed based on a frame image, one field image constituting one frame image is added to one field image. / 60 seconds time difference,
In an image in which a fast-moving subject is captured, a shift occurs between field images. This is the same when performing slow motion processing or still image processing. Therefore, a field image is used for performing these image processing. However, using a field image reduces the vertical resolution by half.

As a solution to this problem, for example, Japanese Patent Laid-Open No.
Japanese Patent Application Laid-Open No. 205205/1992 discloses an "image signal processing device" which detects a motion of an image, uses a frame image for a portion where there is no motion in the image (intra-frame interpolation), and uses a field image for a portion where there is motion ( A method of preventing a decrease in vertical resolution during image processing when there is no motion by performing intra-field interpolation is disclosed.

[0004]

However, since the method disclosed in the above-mentioned publication can deal only with a portion having no motion in an image, the above-mentioned problem is solved in the slow motion processing on the premise of a moving subject. I couldn't.

[0005] The present invention has been made in view of the above circumstances, and is capable of obtaining a high-quality reproduced image without blurring or reduction in vertical resolution even when electronic zoom processing or slow motion processing is performed. The purpose is to obtain a playback device.

[0006]

According to the present invention, there is provided an image pickup device capable of reading out all pixels on an image pickup surface during one field period, and the signals of all the read out pixels are interlaced with each other. Imaging means for generating first and second video signals and outputting them simultaneously, first recording and reproducing means for recording and reproducing the first video signal on a recording medium, and the second video signal Second recording / reproducing means for recording and reproducing signals on another recording medium, and image processing means for processing the first and second reproduced signals reproduced by the first and second recording / reproducing means, respectively. ing.

[0007]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, first to third embodiments of the present invention will be described. First, an imaging apparatus having an all-pixel readout imaging element used in the present invention will be described. The all-pixel readout imaging device is configured to read out and output all pixels on the imaging surface in one field period, and there are a type having one signal output and a type having two signal outputs.

FIG. 2 shows an image pickup apparatus 10 having an all pixel readout type image pickup device 20 having one signal output. In FIG. 2, the image sensor 20 sequentially outputs signals of all lines on the image sensor during one field period. The output signal is supplied to a sample and hold circuit 21 and an automatic gain adjustment amplifier 2.
After that, the data is digitized by the AD converter 23. The digitized signal undergoes processing such as gamma correction, color separation, white balance, and addition of a synchronization signal in a camera process processing circuit 24, and is output as a video signal.
This video signal is output as a non-interlaced signal at twice the speed of a normal video signal.

The video signal is input to a frame memory 25 and a frame memory 26. Two frame memories 2
The writing and reading of the reference numerals 5 and 26 are reversed every one field period. A two-port memory having two outputs is used for the frame memory 25 and the frame memory 26, respectively. Then, during the field period in which the frame memory 25 is writing, a field image composed of odd lines is read out as a video signal (1) from the first output of the frame memory 26 through the selector 27, and an even number is read from the second output. A field image constituted by lines is read out as a video signal (2) through the selector 28. When one field image is output as two video signals per one field period, one is output as an even field-odd field-even field, and the other is an odd field-even field-odd field and a field opposite to each other. Output an image.

FIG. 3 shows an image pickup apparatus 10 having an all pixel readout type image pickup device 20 having two signal outputs. In FIG. 3, the image pickup device 20 outputs signals of all lines on the image pickup device during one field period, but outputs a signal of every other line of the image pickup device 20 to a first signal output, and outputs a second signal.
The remaining signal is output to the signal output of. Each output signal passes through sample-and-hold circuits 21a and 21b, automatic gain adjustment amplifiers 22a and 22b,
a, and 23b. The digitized signal undergoes processing such as gamma correction, color separation, white balance, and addition of a synchronization signal in the camera process processing circuit 24, and is output as video signals (1) and (2).
When one field image is output as two video signals per one field period, one is output as an even field-odd field-even field, and the other is an odd field-even field-odd field and a field opposite to each other. Output an image.

FIG. 4 is a diagram showing two video signals (1) and (2) output from the image pickup device 10 shown in FIGS. From the first signal output of the imaging device 10, even-odd-
An even-odd field image (video signal (1)) is output, and an odd-even-odd-even field image (video signal (2)) is output from the second signal output in reverse to the above signal output. That is, the images of the fields opposite to each other are switched from even-odd to even every one field period and output. As shown in FIG. 4, each of the video signals (1) and (2) is a standard interlaced video signal of the opposite field.

FIG. 1 shows an imaging recording / reproducing apparatus according to a first embodiment of the present invention using the above-described imaging apparatus 10. In FIG. 1, the video signal (1) is recorded on a recording medium by a recording / reproducing device 11 and the video signal (2) is recorded on a recording / reproducing device 12.
To record on another recording medium. The recording / reproducing apparatus 12 has a mode in which recording and reproduction are performed only when requested by a photographer. In this mode, the recording / reproducing device control circuit 13 controls the recording / reproducing device 11 and the recording / reproducing device 12 only when the photographer intends, and records a captured image. If the recording / reproducing apparatus 12 always records a captured image, the recording medium is consumed by the same amount as the recording / reproducing apparatus 11. However, recording by the recording / reproducing apparatus 12 is performed only when the photographer intends. Consumption can be reduced.

Conventionally, when performing electronic zoom processing during reproduction, when performing double magnification, in order to avoid blurring due to movement of a subject, the interval between pixels is enlarged by a factor of two based on a field image. In a space where pixels are lost, interpolation is performed from surrounding pixels to synthesize the pixels. In the present embodiment, when there is a request for the electronic zoom process, the recording / reproducing device control circuit 13 controls the recording / reproducing device 11 and the recording / reproducing device 12 to perform reproduction in synchronization with each other. Is a reproduction signal (1) of a field image composed of even-numbered lines (or odd-numbered lines) in the imaging device 20 (see FIGS. 2 and 3) in the imaging device 10.
Is output from the recording / reproducing device 12 to the image pickup device 20 in the image capturing device 10 in the field constituted by odd lines (or even lines) captured at the same time as the field image signal reproduced from the recording / reproducing device 11. An image reproduction signal (2) is output.

The two field images output from the recording / reproducing devices 11 and 12 become frame images at substantially the same time, and the image processing circuit 14 performs an electronic zoom process based on the frame images to obtain a vertical resolution. It is possible to obtain a high-quality electronic zoom processed image without a decrease in the image quality.

Also, when performing the slow motion reproduction process, the image processing circuit 14 performs the slow motion reproduction process based on the frame image having no time difference between the two field images, so that the slow motion without the decrease in the vertical resolution is obtained. A reproduced image can be obtained.

If an image at the same time as the image recorded in the recording / reproducing device 11 is not recorded in the recording / reproducing device 12 when the image processing is requested, the image is recorded in the recording / reproducing device 11. The image processing is performed by intra-frame interpolation while allowing only intra-field interpolation or intra-field interpolation using only the image that has been blurred.

As a signal to an electronic viewfinder (hereinafter referred to as an EVF) 15 for viewing an image at the time of recording or reproduction, a video signal (1) from the imaging device 10 is used.
And the reproduced image signal from the output of the image processing circuit 14 are connected to the selector 16, and the video signal (1) from the imaging device 10 is connected at the time of imaging, and the output signal of the image processing circuit 14 is connected to the EVF at the time of reproduction. The selector 16 is controlled so as to perform the operation. Then, at the time of normal reproduction, the reproduction signal (1) from the recording / reproduction device 11 is output as it is without signal processing by the image processing circuit 14. In addition, during the electronic zoom processing or the slow motion processing, the image processing circuit 14 outputs a signal processed by the signal processing. In addition, a selector 16 for an external monitor is used.
More video signals are output.

FIG. 5 shows a second embodiment of the present invention.
In FIG. 5, a video signal (1) output from an imaging device 10 having an all-pixels readout type imaging device 20 is recorded by a recording / reproducing device 11. On the other hand, the video signal (2) is
7, the data is compressed. Then, the compressed signal is recorded by the recording / reproducing device 12.

When there is a request for image processing such as electronic zoom processing during reproduction, the recording / reproducing apparatus control circuit 13 controls the recording / reproducing apparatus 11 and the recording / reproducing apparatus 12 to perform reproduction in synchronization with each other. The imaging device 1 from the device 11
A reproduction signal (1) of a field image composed of even lines (or odd lines) in the image sensor 20 within 0 is output.
A compressed video signal constituting a field image composed of odd lines (or even lines) captured at the same time as the reproduction signal (1) is reproduced by the image pickup device 20 in the image pickup device. The reproduced compressed signal is supplied to a decompression circuit 18.
Is extended. At this time, the reproduction in the recording / reproducing device 11 is delayed from the recording / reproducing device 12 in consideration of the processing time in the decompression circuit 18 in advance.
The reproduction signal (1) at the same time as the reproduction signal (2) output from the device is output.

The two field images output from the recording / reproducing devices 11 and 12 become frame images at substantially the same time, and the image processing circuit 14 performs an electronic zoom process based on the frame images to obtain a vertical resolution. It is possible to obtain a high-quality electronic zoom processed image without a decrease in the image quality.

The compression / expansion means includes DPCM, DC
A configuration using T, wavelet transform, fractal compression, or the like is also conceivable.

FIG. 6 shows a third embodiment of the present invention.
6, among the two signal outputs output from the imaging device 10, the first signal output is a video signal (1) that represents a field image formed by the even-numbered lines of the all-pixel readout imaging device 20 in a certain field period. ), And in the next field period, a field image composed of odd lines of the all-pixel readout type imaging device 20 is output as a video signal (1).

The other second signal output is when the first signal output (video signal (1)) outputs a field image signal composed of even-numbered lines of the all-pixel readout type imaging device 20. The subtractor 19 outputs a difference value between a field image signal composed of odd lines and the first signal output as a difference signal. When the first signal output is outputting a field image signal composed of odd lines, the difference between the field image signal composed of even lines and the first signal output is subtracted by a subtractor 19. It is output as a difference signal.

Thus, the data amount of the second signal output can be reduced, and the difference signal output is further compressed by the compression circuit and recorded by the recording / reproducing device 12, thereby further reducing the consumption of the recording medium. Can be reduced.

[0025]

As described above, according to the present invention, 6
It is possible to reproduce an image of 0 frames / sec. Therefore, even if an electronic zoom process, a slow motion process, or the like is performed using the reproduced image, a high-quality processed image without blurring or reduction in vertical resolution is obtained. be able to.

Further, by compressing the signal to be recorded by the second recording / reproducing means or by selectively recording the signal, a recording / reproducing apparatus which is smaller and lighter than the first recording / reproducing means, for example, a more compact recording / reproducing apparatus. Tape media, magneto-optical disks, hard disks, semiconductor memories, and the like can be employed.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of the present invention.

FIG. 2 is a block diagram illustrating an imaging apparatus having an all-pixel readout imaging element having one signal output.

FIG. 3 is a block diagram illustrating an imaging device having an all-pixel readout imaging device having two signal outputs.

FIG. 4 is a configuration diagram showing two video signals output from an imaging device.

FIG. 5 is a block diagram showing a second embodiment of the present invention.

FIG. 6 is a block diagram illustrating an imaging device according to a third embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 10 imaging device 11, 12 recording / reproducing device 13 recording / reproducing device control circuit 14 image processing circuit 15 electronic viewfinder 16 selector 17 compression circuit 18 decompression circuit 19 subtractor 20 all-pixel readout imaging device 24 camera process processing circuit

Claims (10)

[Claims] 1. An image pickup device capable of reading out all pixels on an image pickup surface in one field period.
An imaging unit configured to generate and output a second video signal at the same time; a first recording and reproducing unit that records and reproduces the first video signal on a recording medium; Imaging and recording comprising: a second recording / reproducing means for recording / reproducing on / from a recording medium; and an image processing means for processing the first and second reproduced signals reproduced by the first and second recording / reproducing means, respectively. Playback device. 2. The apparatus according to claim 1, wherein the first and second recording / reproducing means output the first and second reproduction signals having field images which are imaged in the same field period and are interlaced with each other. The imaging recording / reproducing apparatus according to claim 1. 3. The method according to claim 2, wherein the second video signal is compressed and the second video signal is compressed.
2. An image pickup and recording apparatus according to claim 1, further comprising a compression unit for supplying the recording and reproduction unit and a decompression unit for expanding the reproduction signal of the second recording and reproduction unit and supplying the signal to the image processing unit. Playback device. 4. A subtraction means for obtaining a difference value between the first video signal and the second video signal and supplying the difference signal to the second recording / reproduction means. 2. The imaging recording / reproducing apparatus according to 1. 5. The image processing apparatus according to claim 1, further comprising: selecting means for selecting one of the first video signal and the output signal of the image processing means; and displaying means for displaying the selected signal. 2. The imaging recording / reproducing apparatus according to 1. 6. The method according to claim 1, wherein the selecting unit is configured to perform the first operation at the time of image recording.
6. The imaging recording / reproducing apparatus according to claim 5, wherein the video signal is selected. 7. An apparatus according to claim 5, wherein said selecting means selects an output signal of said image processing means during reproduction. 8. The apparatus according to claim 7, wherein said image processing means outputs said first reproduction signal during normal reproduction. 9. The imaging recording / reproducing apparatus according to claim 7, wherein when performing the electronic zoom processing or the slow motion processing at the time of reproduction, the image processing means outputs a processed signal. 10. The apparatus according to claim 1, further comprising control means for controlling use / non-use of said first and second recording / reproducing means.