JP2621469B2 - Video camera equipment - Google Patents

Description

Description: TECHNICAL FIELD The present invention relates to a video camera device that performs shake correction.

2. Description of the Related Art As a conventional shake correction device, for example, Japanese Unexamined Patent Publication No.
No. 0 publication and the technical report of the Institute of Television Engineers of Japan, Vo
l.II No.3 PP.43-48 PPOE'8712 (May.1987). These devices are composed of a motion detecting unit for shaking and the like and a motion compensating unit for compensating motion using the output signal.The former has a configuration having a sensor for detecting motion and directly detects a motion from a video signal. There are two types: a configuration using an electric circuit for detection, and the latter includes a configuration using a mechanically correcting motion and a configuration using an image processing circuit that directly corrects a video signal.

On the other hand, in recent years, video camera devices have become increasingly smaller and lighter in the consumer field and the like, and as a motion compensation device, a configuration using an image processing circuit that does not require a mechanical structure is expected to be promising.

A conventional example of a video camera device in which the motion correction unit of the shake correction device is configured by the image processing circuit will be described with reference to FIGS.

FIG. 3 is a block diagram of a conventional video camera apparatus. In FIG. 3, reference numeral 301 denotes a taking lens;
02 is an image sensor, 303 is a drive circuit of the image sensor 302, 304 is a synchronization signal generation circuit, 305 is a signal processing circuit that processes a signal output from the image sensor 302, 306 is a motion detection device, 307 is a motion detection device 306 308 is a mode selection circuit for selecting a normal mode and a motion correction mode, and 309 is a memory circuit for 311 and a interpolation circuit for 312 using the motion correction data. A motion compensation control circuit for controlling and performing motion compensation; 310, an A / D converter for A / D converting the output signal of the signal processing circuit 305; 313, a signal subjected to motion compensation processing by a memory circuit 311 and an interpolation operation circuit. Is a D / A converter for D / A conversion.

In the conventional video camera device configured as described above, when the motion correction mode is selected by the mode selection circuit 308, the motion detection device 306 and the motion correction data generation circuit 307
Detects motion and obtains motion correction data, and based on the motion correction data, the motion
And the interpolation arithmetic circuit 312 is controlled to obtain a video signal which has been subjected to motion correction without shaking.

The motion correction process at this time will be described with reference to FIG.
In the figure, the effective area of the signal of the image sensor output or the signal processing circuit output is V _{0 in the} vertical direction × H ₀ in the horizontal direction. The effective area of the video signal after motion compensation is the effective area of the original signal (V ₀ ×
H ₀ ) with respect to region (I) (V ₁ × H ₁ ) or region (II) (V ₂
× H ₂ ). This is a function that enlarges a part of the effective area of the original video signal using a memory and an interpolation arithmetic circuit, and a function that makes the area to be enlarged variable by controlling the memory read address based on the motion correction data. This is the result of realizing the motion correction by S,
S ₁ and S ₂ indicate the start position of each video signal effective area, and the output timing is at a position equivalent to the synchronization signal. The range in which the motion can be corrected is uniquely determined by the enlargement ratio of the video signal in the motion correction processing.

The motion correction control circuit includes a memory write address generation circuit, a read address generation circuit based on motion correction data, and the like. The configuration of the read address generation circuit will be described with reference to FIG. FIG. 5 is a block diagram of a read address generation circuit. In the figure, reference numeral 501 denotes an H start address generation circuit that generates a horizontal start address based on a horizontal component of motion data, 502 denotes an H address pitch generation circuit that generates a horizontal address pitch based on an enlargement factor, and 503 denotes a motion. V start address generation circuit for generating a vertical start address based on the vertical component of data, 504 is a V address pitch generation circuit for generating a vertical address pitch based on an enlargement factor, 505, 506, 507, 508 are latch circuits, and 509, 512 are selectable Circuits, 510 and 513 are latch circuits, and 511 and 514 are adders. The selection circuit 509 selects the H start address signal at the timing of the H synchronization pulse, and selects the adder at other timings.
Select 511 output signals. Latch circuit 510 latches the output signal of selection circuit 509 for each system clock. The latch output signal is added by the adder 511 to the H address pitch signal. Therefore, the output of the latch 510 is a signal obtained by adding one pitch to the H start address every clock. The integer part of the H read address signal thus obtained is used as a memory read address signal, and the decimal part is used as a weight coefficient of an interpolation circuit.

Similarly in the vertical direction, for each H synchronization pulse,
A V read address signal obtained by adding one pitch to the V start address is obtained, of which an integer part is used as a memory read address signal and a decimal part is used as a weight coefficient of an interpolation circuit.

Next, the processing in the interpolation operation circuit will be described with reference to FIG. Circles in the figure indicate data at each sampling point of the video signal read from the memory circuit. On the other hand, the sampling points required for enlarging the video signal and performing motion compensation do not always coincide with the sampling points of the memory circuit output signal, as indicated by the square marks. It is necessary to calculate by interpolation. In the figure, a method is shown in which the data of the sampling point z is obtained by linear interpolation from the surrounding four points A, B, C and D. In the figure, x and y are weight coefficients obtained from the decimal part of the H and V read address signals described in FIG. That is, the data at the sampling point z can be obtained by the following equation.

I (z) = (1-x) ｛(1-y) ・ I (A) + y ・
I (B)｝ + x ｛{(1-y) ・ I (C) + y ・ I (D)｝-
(1) Here, I (Z) and I (A) to I (D) indicate data of sampling points z and A to D.

FIG. 7 is a block diagram showing a configuration of an interpolation operation circuit for performing the operation of equation (1). 701,702,703,704,707,70 in the figure
8, a multiplier; and 705, 706, 709, adders.

However, in the configuration shown in the conventional example, the resolution of the output video signal is reduced in principle as the enlargement ratio of the video enlargement function in the motion compensation circuit is increased. However, the range in which the motion can be corrected is uniquely determined by the enlargement ratio. Therefore, if the enlargement ratio is increased in order to set the range in which the motion can be corrected in a wide range, there is a problem that the resolution of the output video is significantly deteriorated.

In view of the above, the present invention provides a video camera device that has a practically sufficient range of motion correction, has almost no fluctuation, and is capable of obtaining a beautiful image with little deterioration in image quality due to a decrease in resolution. The purpose is to do.

Means for Solving the Problems In order to solve the above problems, the present invention provides an image pickup device, a driving circuit for the image pickup device, a signal processing circuit for processing an output signal of the image pickup device to obtain a video signal, The device and the image sensor output signal or a part of the effective imaging area of the video signal obtained from the signal processing circuit is enlarged, and the area to be further enlarged is controlled based on the output signal of the motion detection device. The video camera device includes a motion compensation circuit for performing motion compensation, an aperture compensation circuit capable of controlling an aperture compensation amount, and a mode selection circuit for a normal mode and a motion compensation mode.

In the motion compensation mode, the present invention controls the aperture correction circuit to optimize the amount of aperture correction, so that the fluctuation is almost inconspicuous, and the image quality is extremely small due to deterioration in resolution. Get.

FIG. 1 is a block diagram showing a video camera apparatus according to an embodiment of the present invention. In FIG. 1, 101 is a taking lens, 102 is an image sensor, 103 is an image sensor 102
Drive circuit, 104 is a synchronization signal generation circuit, 105 is the imaging device 10
A signal processing circuit for processing the signal output from 2 to obtain a video signal; 106, a motion detection device; 107, a motion correction data generation circuit for obtaining motion correction data from the output signal of the motion detection device 106; A mode selection circuit for selecting a motion correction mode; and 114, a motion correction control signal that performs calculation and determination from the motion correction data output from the motion correction data generation circuit 107 and the mode selection signal output from the mode selection circuit 108. A system control circuit that outputs an aperture correction amount control signal; and 109 controls a memory circuit of 111 and an interpolation calculation circuit of 112 based on the motion correction control signal output from the system control circuit 114 to perform motion correction. A correction control circuit, 110 is an A / D converter, 113 is D / A conversion, and 115 is a motion correction process based on the aperture correction amount control signal output from the system control circuit 114. This is an aperture correction circuit that performs aperture correction of the performed video signal.

The operation of the video camera device according to the present embodiment configured as described above will be described below.

When the motion compensation mode is selected by the mode selection circuit 108, the system control circuit 114 calculates an image enlargement area based on the motion compensation data obtained from the motion detection device 106 and the motion compensation data generation circuit 107, and reads out the memory circuit 111. A start address and an address pitch are obtained and output to the motion correction control circuit 109. Based on this output data, the motion compensation control circuit 109
To perform motion compensation and obtain a video signal without fluctuation. Further, the system control circuit 114 controls the aperture correction circuit 115 in the motion correction mode so that the aperture correction amount is larger than in the normal mode. Further, even in the same motion correction mode, when the motion correction circuit 109 is controlled so as to increase the enlargement ratio, the aperture correction circuit is controlled so that the aperture correction amount increases accordingly. In this way, a video signal is obtained in which the deterioration of the image quality due to the increase in the magnification is extremely small.

FIG. 2 is a block diagram showing a configuration of a memory read address generation circuit in the motion compensation control circuit according to the present embodiment.
Shown in the figure. In the figure, 205, 206, 207, 208 are latch circuits, 209, 212
Is a selection circuit, 210 and 213 are latch circuits, and 211 and 214 are adders. Except for directly latching the start address and address pitch in the H and V directions output from the system control circuit as described above, it has the same function as the motion compensation circuit shown in FIG. 5 in the description of the conventional example. By changing the address pitch data, the system control circuit can enlarge the image at an arbitrary magnification. In addition, the displacement of the center of the enlarged image caused by the change of the magnification is corrected by changing the start address according to the magnification.

Further, the memory circuit and the interpolation arithmetic circuit in the present embodiment have the same functions as those described in the conventional example.

In the embodiment of the present invention, the aperture correction circuit is provided after the motion correction circuit. However, it is naturally possible to provide the same in the signal processing circuit. Further, although the motion correction circuit is provided behind the signal processing circuit, it may be provided behind the image sensor. Further, in the embodiment of the present invention, although the motion detecting device has not been described, it is possible to detect an angular velocity sensor, a vector component using a memory, and the like. However, it is natural that it is not limited to these.

Effects of the Invention As described above, according to the present invention, it is possible to extremely reduce deterioration in image quality due to enlargement of a video signal during motion correction, and to set a practically sufficient range of motion correction possible. , Its practical effect is great.

[Brief description of the drawings]

FIG. 1 is a block diagram of a video camera device according to an embodiment of the present invention, FIG. 2 is a block diagram of a memory read address generation circuit of a motion compensation control circuit according to the embodiment, and FIG. FIG. 4 is an explanatory diagram showing a motion compensation process in the conventional example, and FIG. 5 is a block diagram of a memory read address generation circuit in the motion compensation control circuit in the conventional example. FIG. 6 is an explanatory diagram showing the processing of the interpolation operation circuit in the conventional example, and FIG. 7 is a block diagram showing the main configuration of the interpolation operation circuit in the conventional example. 102 image pickup device 103 drive circuit 105 signal processing circuit 106 motion detection device 107 motion correction data generation circuit 108 mode selection circuit 109 motion correction control circuit 111: memory circuit, 112: interpolation operation circuit, 114
…… System control circuit, 115 …… Aperture correction circuit.

Claims (2)

(57) [Claims] 1. An optical unit for imaging light from a subject, an image sensor, a drive circuit of the image sensor, a signal processing circuit for processing an output signal of the image sensor to obtain a video signal, and a motion detecting device. And, a part of the effective imaging area of the video signal obtained from the image processing element output signal or the signal processing circuit is enlarged, and the further enlarged area is controlled based on the output signal of the motion detection device. A motion compensation circuit for performing motion compensation; an aperture compensation circuit capable of controlling the amount of aperture compensation; and a mode selection circuit for a normal mode and a motion compensation mode. In the motion compensation mode, the aperture compensation amount is increased. A video camera device characterized in that: 2. The video camera device according to claim 1, wherein in the motion correction mode, the amount of aperture correction is controlled based on the magnification of the video signal.