JP2825377B2 - Motion vector detection device and camera-integrated camera shake correction device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for detecting a motion vector of an image signal and to a camera-integrated image stabilizing apparatus provided with the motion vector detecting apparatus.

[0002]

2. Description of the Related Art In general, a motion vector indicates in which direction and how much a picture has moved due to a correlation between a previous field picture and a current field picture of a supplied picture.

Conventional motion vector extraction methods include a gradient method obtained from a spatial gradient and a temporal gradient of a luminance value, a phase correlation method obtained from a ratio of a phase term of a Fourier transform coefficient, one image representative point and another image representative point. There is a representative point matching method that is obtained from the accumulated value of the absolute value of the difference between fields with the image.

[0004] Among the above conventional motion vector extraction methods,
A relatively small scale of hardware is realized by a representative point matching method used in a MUSE encoder of a conversion method (MUSE method) for compressing a band into one satellite channel.

[0005] The representative point matching method will be described for a case where a motion vector is obtained for the entire supplied field image as shown in FIG.

B × c = p representative points are selected from the entire image, and the absolute value of the difference between the fields in the area of the search area pixels m × n pixels is selected.

[0007]

(Equation 1)

Is obtained in multiple values. Where β ⁿ _{d, e} (i,
j) is the luminance value of the current field image, β ^n-1 _{d, e} (0,
0) represents the luminance value of the previous field image.

For each representative point, the cumulative sum of α _{d, e} (i, j)

[0010]

(Equation 2)

, And the displacement (i, j) of the minimum value in the cumulative sum is defined as a motion vector.

FIG. 18 shows the concept. Cumulative function α
(I, j) has a shape on a “mortar” centered on the position (i, j) of the motion vector.

[0013]

However, in the above-described representative point matching method, when a motion vector of an input image is detected, an image that exists between two field images on a dark screen or a screen with a flat density gradient exists. It is easy to malfunction due to noise.

[0014] The reason is that the absolute difference value of the representative point at the place where the density gradient is low has little motion information, and the motion vector to be detected by random noise works so as to vary over the entire search range.

In particular, the technical report of the Institute of Television Engineers of Japan, "PPO
In the image stabilization control of the camera-integrated VTR having the configuration described in "E'87-12 Screen Shake Correction Device", if the detected motion vector contains a large error, the corrected image is Appears as an unsightly shaking.

Therefore, in the conventional motion vector detecting device, the reliability of the detected motion vector is determined by the minimum (MIN) value and the maximum (MA) of the cumulative function in order to prevent the image from fluctuating.
X) The judgment was made based on the value, and the control of the correction stop / start was performed. However, it is necessary to set the threshold value of the judgment sufficiently high to allow a margin for disturbances such as noises and flat images, especially under various conditions such as a camera-integrated VTR. There is a problem in that the types of images for which correction must be stopped increase for devices to be used.

The first aspect of the present invention provides a motion vector detecting device capable of detecting image disturbance even in the case of disturbance such as noise or a flat image in view of the above-mentioned problems in the conventional motion vector detecting device.

According to a second aspect of the present invention, there is provided a camera-integrated image stabilizing apparatus which is provided with the motion vector detecting apparatus according to the first aspect of the present invention and which can correct image swing.

[0019]

According to a first aspect the invention comprises a timing signal generating means for generating a timing signal, the timing
The current field image and the field image
Motion vector at a representative point between the previous field image
Predetermined motion vector detecting means, and the concentration gradient detecting means for detecting the concentration gradient values in the vicinity of the representative point in the current field image based on the timing signal, the concentration gradient value detected by the gradient detecting means for detecting the Le Comparing means for comparing with a threshold value, and a value generated based on a comparison result by the comparing means .
Comprising conversion means for converting the signal into a pulse signal, and counting means for counting the pulse signal outputted from the conversion means, a total of
Judgment of reliability of motion vector based on counting result of number means
This is achieved by a motion vector detection device.

According to a second aspect of the present invention, there is provided a timing signal generating means.
It generates Retiming signal, the motion vector detecting device
The current field image and the file
At a representative point between the field image and the previous field image.
Detecting a motion vector that, near the representative point of the current field image based on Rita Lee <br/> timing signal by the gradient detecting means
Of detecting the density gradient value, a concentration gradient value detected by the density gradient detection means by comparing means with a predetermined threshold value,
The signal that is generated based on the comparison result by the comparison means by conversion means into a pulse signal, and counts the pulse signal outputted from the conversion means by counting means, total count means
This is achieved by a camera-integrated image stabilization apparatus that includes a motion vector processing unit that determines the reliability of a motion vector based on the numerical results and performs processing based on the determination result.

[0021]

[Action] In the motion vector detection apparatus of the first invention, the timing signal generating means generates a timing signal, the motion vector
The torque detector detects the current field based on the timing signal.
Between the image and the field image before the field image
Detecting a motion vector at the representative point, the concentration gradient detecting means representative of the current field image based on the timing signal
Detecting a density gradient value around the point, comparing means the concentration gradient value detected by the density gradient detection means with a predetermined threshold value, the conversion means is generated based on the comparison result by the comparison means converts the signal into a pulse signal, counting means counts the pulse signal outputted from the conversion means, counting Yui counting means
The result is used to determine the reliability of the motion vector .

In the camera-integrated image stabilizer according to the second aspect of the present invention, the timing signal is generated by the timing signal generating means.
Based on the timing signal by the motion vector detection device.
The current field image and the field before the field image
The motion vector at the representative point between the
And concentration gradient to detect the concentration gradient values in the vicinity of the representative point in the current field image based on the by Retiming signal to the detection means, comparison means by a concentration gradient predetermined tooth detected concentration gradient value detection means compared to threshold, a signal which is generated based on the comparison result by the comparison means into a pulse signal by the conversion unit counts the pulse signal outputted from the conversion means by the counting means, the motion vector processing means counts means
And the reliability of the motion vector is determined based on the counting result, and processing is performed based on the determination result.

[0023]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of a motion vector detecting apparatus and a camera-integrated image stabilizing apparatus according to the present invention.

FIG. 1 shows a configuration of a main part of an embodiment of a motion vector detecting device according to the first invention, and FIG.
The surrounding configuration is also shown.

FIGS. 3 and 4 to 6 are explanatory views of the principle of the motion vector detecting device according to the first invention.

First, the principle of the motion vector detecting apparatus according to the present embodiment will be described with reference to FIG. 3 and FIGS. As shown in FIG. 3, one block of the screen is picked up, a representative point in b rows and c rows is selected vertically, and the search range is set to m pixels horizontally and n pixels vertically.

Now, the luminance value of the representative point in the d-th column and the e-th row is extracted from the previous field image, and the value is extracted as a ^n-1 _{d, e} (0,
0) is stored in a representative point memory (described later).
A ⁿ _d a search range of pixels around the representative point from the current field _image, as _e (i, j), the absolute value of the difference value (hereinafter, referred to as the absolute difference _{value) ρ d, e (i,} j )

[0028]

(Equation 3)

## EQU2 ##

When Equation (3) is conceptually illustrated, as shown in FIG. 18, the displacement (i, j) at which the absolute difference value ρ _{d, e} (i, j) = 0 is a motion vector candidate. , The displacement (i, j) is generally represented by a curve K.

However, when the density gradient near the representative point is small and random noise is superimposed between the two field images, the displacement amount (ρ _{d, e} (i, j) = 0) where the absolute difference value ρ _{d, e} (i, j) = 0 (i, j) becomes uncertain as shown in FIG. 19, and in particular, when the concentration gradient value = 0, the displacement amount (i, j) at which the absolute difference value ρ _{d, e} (i, j) = 0 ) Spreads over the entire search range m × n. So after accumulation

[0032]

(Equation 4)

Has a great effect on the

[0034]

(Equation 5)

The detection accuracy of this method is greatly deteriorated.

In order to solve this point, means for detecting a density gradient value near the representative point is provided. As shown in FIG. When the number of representative points whose gradient is equal to or larger than the predetermined threshold value BX or the threshold value BY becomes extremely small, the detected motion vector is determined to be unreliable and output.

A horizontal density gradient DX is defined by the following equation (6).

[0038]

(Equation 6)

The density gradient DY in the vertical direction is expressed by the following equation (7).

[0040]

(Equation 7)

Defined by

The number of representative points at which the density gradients DX and DY are larger than the threshold values BX and BY, respectively, is counted.

Next, the configuration of the main part in the motion vector detecting device of FIG. 1 will be described.

The main part of the motion vector detecting device shown in FIG.
Timing signal generator 1 which is a timing signal generator
0. It comprises a density gradient detecting section 11 as a density gradient detecting section, comparing sections 12 and 13 as a comparing section, gates 14 and 15 as a converting section, and counters 16 and 17 as a counting section.

The timing signal generator 10 counts a clock, a horizontal synchronizing signal, and a vertical synchronizing signal input from the outside, and generates a timing signal for controlling the entire apparatus.

The gradient detection unit 11 detects the concentration gradient values around the representative point from the current field image based on the timing signal output from the timing signal generator 10.

The comparing section 12 compares the density gradient value in the horizontal direction with the threshold value BX, and the comparing section 13 compares the density gradient value in the vertical direction with the threshold value BY.

The gates 14 and 15 convert the pulses into pulses for counting, and the counters 16 and 17 count the number of equivalent representative points.

FIG. 2 shows the configuration of one embodiment of the motion vector detecting device having the main part of FIG.

The parts other than the main part of the motion vector detecting device shown in FIG. 2 are analog / digital (A / D) converters 18,
Line interpolation unit 19, low-pass filter (LPF) 20, representative point memory 21, representative point line memory 22, subtraction unit 23, absolute value unit 24, comparison unit 25, mode switch 26, switch 27, addition unit 28, accumulation It comprises an addition memory 29, a motion vector detection unit 30, a density gradient memory 31, a density gradient line memory 32, and a comparison unit 33.

The A / D converter 18 converts the image signal input from the input terminal 31 from analog to digital.
The line interpolation unit 19 generates a line by performing a linear interpolation process on the field image of the image signal digitally converted by the A / D conversion unit 18 based on a field odd / even determination signal supplied from the outside.

The LPF 20 reduces the influence of noise on an input image signal.

The representative point memory 21 extracts and stores a representative point from the current field signal.
The representative point of the previous field is output, and the subtraction section 23 and the absolute value section
24 calculates the correlation between the two fields, and compares the
Binarizes the correlation value, and the mode switch 26 selects either multi-level or binary.

The addition unit 28 and the accumulation memory 29 store the accumulation sum ρ
_{The d, e} (i, j) is cumulatively added, and the detection unit 30 detects a motion vector from the data of the cumulative addition memory 29.

The density gradient memory 31 and the density gradient line memory 32 store the R / W output from the timing signal generator 10.
Based on the signals and the block address signals XBLK and YBLK, a signal (hereinafter, referred to as a density gradient signal) representing a density gradient output from a density gradient detection unit 11 (described later) is stored.

The comparator 33 compares the density gradient signal output from the density gradient line memory 32 with the signal B input from the outside, and outputs the comparison result.

Next, the operation of the motion vector detecting device shown in FIG. 2 will be described.

[0058] First, an analog image signal input from the image input terminal is A / D converter 18 Devi Tsu preparative quantization.

In the line interpolating unit 19, the positional relationship between the odd field and the even field is shifted by one line vertically, that is, by 0.5 pixel. 1 by linear interpolation
A line is generated. At this time, only one side field image needs to be interpolated, and whether or not to interpolate is determined by an externally supplied field odd / even judgment signal.

[0060] LPF20 outputs an image signal having aliasing distortion and unwanted noise by removing a luminance value a n d for generating, e a (i, j) when sampling a representative point. The image signal from which noise has been removed by the LPF 20 is
At the timing of the signal output from the timing signal generating section 10, a representative point of the current field image a n d, e (0,
0) is temporarily stored in the representative point memory 21. The luminance value of this representative point is stored in the representative point memory 22 during the next vertical synchronization period.
And the representative point an -1 d, e of the previous field image
It is output to the subtraction unit 23 as (0,0). At this time,
The designation of the address of the representative point memory 21 and the designation of the read / write of the representative point memory 21 are performed by the timing signal generator 10. Subtraction unit 23 in this way, the luminance signal a n d, e (i, j) and the luminance signal a
The difference from n−1 d, e (0,0) is calculated, and the absolute value part 2 is calculated.
Absolute difference value by 4 ρ d, e (i, j) = | a n d, e
(I, j) -an -1 d, e (0,0) | is calculated.
This signal passes through the switches 26 and 27 and is cumulatively added to the cumulative addition memory 29 by the adder 28.

For each representative point of the image for one field,
When these series of calculation processes are completed, the cumulative addition memory 29
Ρ ⁿ (i, j) corresponding to the address is obtained, and the detection unit 30 calculates the displacement (i, j) at which ρ ⁿ (i, j) becomes the maximum value or the minimum value during the vertical synchronization period. The corresponding address is detected and output as a motion vector.

At this time, the timing of the write and read control signals for the adder 28, the accumulative adder memory 29, and the detector 30 is controlled by the timing signal generator 10. The detecting unit 30 simultaneously detects and outputs the maximum value, the minimum value, and the average value of the accumulated values, and is used as a parameter for determining the reliability of the motion vector detected by a microcomputer or the like connected at a subsequent stage.

[0063] The output signal a ⁿ _d the LPF20, e (i, j)
, The density gradient in the horizontal direction and the density gradient in the vertical direction are calculated independently by the density gradient detection unit 11.

In this embodiment, the concentration gradient is expressed by software.
Bell (SOBEL) operator

[0065]

(Equation 8)

[0066]

(Equation 9)

FIG. 8 shows an example of the software.
PREWIT instead of Bell Operator
T) An operator or a ROBERTS operator may be used.

Next, the configuration of the density gradient detector 11 of FIG. 1 will be described in detail with reference to FIG.

The density gradient detector 11 shown in FIG. 9 includes line memories 65, 75, 85, 95 each having a capacity of the number of blocks in the horizontal direction, multiplying units 66, 76, 86, 96 of 1 or 2 times, and an adding unit. 67, 77, 8
7, 97, switches 68, 78, 88, 98, subtraction units 50, 51, absolute value units 52, 53, and an addition unit 54.

Next, the signals shown in FIG. 9 will be described. Reference numeral 60 denotes a filtered video signal at the output of the LPF 20, 61
Is a horizontal block address signal generated by the timing signal generator 10, and 62, 72, 82, and 92 are R / s for giving sampling timing generated by the timing signal generator 10.
The W signal, 63 indicates a double / single-time designation signal generated by the timing signal generator 10, and 64 indicates a reset timing signal generated by the timing signal generator 10 from the horizontal column address and the vertical row address. .

FIG. 10 shows addresses XADR and YA.
The timing of R / W generated from DR, the reset, and the double / single times are shown.

Next, the operation of the density gradient detector 11 shown in FIG. 9 will be described with reference to FIG.

First, the reset timing, the sample timing around the representative point, and the transfer timing to the density gradient line memory 32 will be described.

Each of the above-mentioned timings is generated by the above-mentioned timing signal generator 10 based on the horizontal address signal XADR and the vertical address signal YADR.

In the first block including the line memory 65, the multiplier 66, the adder 67, and the switch 68, the following equation (1)
0)

[0076]

(Equation 10)

Is calculated, and the line memory 75, the multiplication unit 76,
In the second block including the adder 77 and the switch 78, the following equation (11) is used.

[0078]

[Equation 11]

Is calculated.

In the third block including the line memory 85, the multiplying unit 86, the adding unit 87, and the switch 88, the following equation (1)
2)

[0081]

(Equation 12)

Is calculated, the line memory 95, the multiplier 96,
In the fourth block composed of the adder 97 and the switch 98, the following equation (13)

[0083]

(Equation 13)

Is calculated and stored in the density gradient calculation memories 65, 75, 85 and 95 corresponding to the respective block addresses.

The density gradient DX in the X direction is calculated by the calculation memory 6
By taking the absolute value of the difference from the data of 5 and 75 by the subtraction unit 50 and the absolute value unit 52, the density gradient DY in the Y direction can be obtained.
Is obtained by taking the absolute value of the difference from the data in the calculation memories 85 and 95 by the subtraction unit 51 and the absolute value unit 53, and is output as a density gradient value near the representative point.

In FIG. 1, the density gradient DX detected by the density gradient detector 11 is output to the comparator 12 and the
Compared with X.

In the case of this embodiment, the density gradient DX in the X direction>
If the threshold value BX is “1”, the density gradient DX in the X direction ≦≦
If the threshold value is BX, “0” is converted into a count pulse by the gate 14 and supplied to the counter 16.

When the number of “1” is counted for the block in which the representative point is set, a horizontal count reflecting the horizontal density gradient of the image is obtained. This horizontal count is used as a measure of the reliability of horizontal motion vector detection.

Similarly, the density gradient DY detected by the density gradient detector 11 is output via the comparator 13 and the gate 15
The counter 17 obtains a vertical count as a measure of the reliability of the detection of the motion vector in the vertical direction, and is used as a parameter for judging the reliability of the detected motion vector by a microcomputer or the like (not shown) connected at a subsequent stage. Used.

For example, in a camera shake correction device of a camera-integrated VTR having a camera shake correction function, control such as correction start / stop is performed based on the detected reliability.

Here, the two consecutive field images represent a combination of an odd field image and an even field image, or a combination of an even field image and an odd field image, and a motion vector is extracted by this combination.

Further, instead of two consecutive field images, a field image extracted from two consecutive frame images may be used. In this case, since a combination of an odd field image and an odd field image or a combination of an even field image and an even field image is used, the line interpolation unit 19 is unnecessary.

Next, the configuration of the timing signal generator 10 of FIG. 1 will be described in detail with reference to FIG.

The timing signal generator 10 receives a reference clock signal CK, a horizontal synchronizing signal HD and a vertical synchronizing signal VD generated by dividing the frequency of the clock signal CK.

The timing signal generator 10 uses the horizontal synchronizing signal HD as a reset signal, and generates a clock signal CK.
And the horizontal address signal X within the search range.
An ADR is generated, and the carry is further counted to generate a horizontal block address signal XBLK.

Similarly, a vertical address signal YADR within the search range is generated by counting the vertical synchronization signal VD as a reset signal with the horizontal synchronization signal HD, and the carry is further counted to generate the vertical block address signal YBLK. Generate.

Of these generated address signals and block address signals, address signal XA within the search range
Based on the DR and the address signal YADR, pixel timing signals such as R / W timing of representative point sampling, sampling timing near the representative point for calculating the density gradient, memory reset timing, transfer timing to the line memory, etc. are generated. .

In addition, various block timing signals such as an accumulated memory clear timing, an accumulated memory invalidation signal, and a motion vector detection timing are generated by the block address signal XBLD and the block address signal YBLD.

FIG. 12 shows the address mapping of the address signal XADR, the address signal YADR, the block address signal XBLD, and the block address signal YBLD.

FIG. 13 shows various block timings.

Hereinafter, an embodiment of the camera-integrated camera shake correction apparatus according to the second invention will be described.

FIG. 14 shows the structure of a first embodiment of the camera-integrated camera shake correction apparatus according to the second invention.

The camera-integrated camera shake correction device shown in FIG.
A CCDTV signal processing unit 101; a motion vector detecting device 102 according to the first invention; a field memory for storing an image one field before or a frame memory 103 for storing an image one frame before; a BPF for determining a correction frequency and motion vector detection. It is composed of a motion vector signal processing unit 104 for determining reliability, and an interpolation enlargement processing unit 105 for enlarging and interpolating a part of an image stored in a field or a frame memory.

Next, the operation of the camera-integrated camera shake correction apparatus of FIG. 14 will be described.

The luminance signal output from the CCDTV signal processing section 101 is input to a motion vector detecting device 102, and a motion vector is detected from two continuous field or frame image signals.

On the other hand, the luminance signal, chrominance signal RY, and chrominance signal BY output from the CCDTV signal processing section 101 are
The data is input to the field or frame memory 103, stored in the field or frame memory 103, and after a delay of one field or one frame later, the interpolation enlargement processing unit 10
It is partially enlarged by 5.

At this time, the motion vector detected by the motion vector detecting device 102 is
Is input to the control terminal of the interpolation / enlargement processing unit 105, and is corrected vertically and horizontally by the interpolation / enlargement processing unit 105 by the amount of the motion vector that is the detected hand-shake component. As a result, a TV image signal in which camera shake is suppressed is obtained. Can be

FIG. 15 shows the structure of a second embodiment of the camera-integrated camera shake correction apparatus according to the second invention.

The camera-integrated image stabilization apparatus shown in FIG.
CCDTV signal processing section 201, variable delay line 202, motion vector detecting device 203 of the first invention, motion vector signal processing section
204.

The CCD TV signal processing section 201 has a structure capable of controlling the number of high-speed discharge clocks for vertical charge transfer of the CCD. The variable delay line 202 can control the parallel movement of the image in the vertical and horizontal directions. C
The luminance signal of the image output from the CDTV signal processing unit 201 is passed through a variable delay line 202 to a motion vector detecting device 203.
, And a motion vector is detected from the image signal as in the first embodiment.

The detected motion vector is input to a BPF for determining a correction frequency and a motion vector signal processing unit 204 for determining the reliability of the motion vector detection. The vertical correction vector is input to a CCDTV signal processing unit 201. Further, the left and right direction correction vectors are respectively subjected to feedback correction to the variable delay line 202 to correct camera shake as a closed loop servo.

FIG. 16 shows the configuration of a third embodiment of the camera-integrated camera shake correction apparatus according to the second invention.

The camera-integrated image stabilization apparatus shown in FIG.
CCDTV signal processing unit 301, motion vector detection device 302 of the first invention, motion vector signal processing unit 303, driver 30
4, a lens 305, actuators 306, 307, and a gain correction unit 308.

Next, the operation of the camera-integrated camera shake correction apparatus of FIG. 16 will be described. The CCDTV signal processing unit 301 detects a motion vector from an image signal by the motion vector detection device 302 in the same manner as in the first embodiment. The detected motion vector is input to a BPF for determining a correction frequency and a motion vector signal processing unit 303 for determining the reliability of motion vector detection.

The lens 305 includes actuators 306, 307
In the direction perpendicular to the optical axis of the lens.
It has a structure that can be originally moved, and the lens moves two-dimensionally by applying a voltage to the vertical actuator and the horizontal actuator.

The correction vector output from the motion vector signal processing unit 303 is transmitted to the driver
By applying a correction voltage to the actuators 306 and 307 after being amplified by 304, the lens position is corrected to form a field-back loop as a whole. If the lens unit has a zoom variable function, the camera shake correction loop gain changes depending on the zoom magnification. Therefore, the zoom magnification information is input to the gain correction unit 308, and gain control is performed in inverse proportion to the zoom magnification.

[0117]

According to the motion vector detecting device of the first invention ,
And timing signal generating means for generating a timing signal,
Based on the timing signal, the current field image and the field
At a representative point between the field image and the previous field image
A motion vector detecting means for detecting a motion vector, and a vicinity of a representative point of the current field image based on the timing signal.
A gradient detecting means for detecting the concentration gradient values, gradient comparison means for comparing with a predetermined threshold value the detected concentration gradient value detection means, signal that is generated based on the comparison result by the comparison means the provided conversion means for converting the pulse signal, and counting means for counting the pulse signal outputted from the conversion means, reliability of the motion vector by the counting result of the counting means
Because determines sex, and determined the concentration gradient for each block can histograms determined quality itself of the image by the density gradient, as a result, it is finer correction start and stop control.

[0118] In camera-integrated shake correction device of the second invention generates by Retiming signal to the timing signal generating means, based on the timing signal by the motion vector detection device
The current field image and the field before the field image
The motion vector at the representative point between the
And concentration gradient to detect the concentration gradient values in the vicinity of the representative point in the current field image based on the by Retiming signal to the detection means, comparison means by a concentration gradient predetermined tooth detected concentration gradient value detection means The conversion unit converts the signal generated based on the comparison result by the comparison unit into a pulse signal, counts the pulse signal output from the conversion unit by the counting unit, and operates based on the counting result of the counting unit. Since there is provided a motion vector processing means for judging the reliability of the vector and performing processing based on the judgment result, it is possible to judge the reliability of the detected motion vector and accurately correct the shaking of the image.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a main part of an embodiment in a motion vector detection device of the first invention.

FIG. 2 is a block diagram showing a configuration of one embodiment of a motion vector detecting device including a main part of FIG. 1;

FIG. 3 is an explanatory diagram of the principle of the motion vector detection device in FIG. 1;

FIG. 4 is an explanatory diagram of the principle of the motion vector detection device in FIG. 1;

FIG. 5 is an explanatory diagram of the principle of the motion vector detection device in FIG. 1;

FIG. 6 is an explanatory diagram of the principle of the motion vector detection device in FIG. 1;

FIG. 7 is an explanatory diagram of a linear interpolation process of a field image.

FIG. 8 is an explanatory diagram of a Prewitt operator and a Roberts operator representing a density gradient.

FIG. 9 is a block diagram illustrating a configuration of a concentration gradient detection unit in FIG. 1;

10 is a characteristic diagram showing R / W, reset, and twice / one time timings generated from the address signal XADR and the address signal YADR of FIG. 9;

FIG. 11 is a block diagram showing a configuration of a timing signal generator of FIG. 1;

FIG. 12 shows an address signal XADR and an address signal YAD
FIG. 9 is a characteristic diagram showing address mapping of R, block address signal XBLD, and block address signal YBLD.

FIG. 13 is a characteristic diagram showing various block timings.

FIG. 14 is a block diagram showing the configuration of a first embodiment of the camera-integrated camera shake correction apparatus according to the second invention.

FIG. 15 is a block diagram showing a configuration of a second embodiment of the camera-integrated camera shake correction apparatus according to the second invention.

FIG. 16 is a block diagram showing a configuration of a third embodiment of the camera-integrated camera shake correction apparatus according to the second invention.

FIG. 17 is an explanatory diagram of a representative point matching method used in a conventional motion vector detection device.

FIG. 18 is another explanatory diagram of the representative point matching method.

FIG. 19 is an explanatory diagram of a representative point matching method when a density gradient near a representative point is small.

[Explanation of symbols]

 10 Timing signal generator 11 Concentration gradient detector 12, 13 Comparator 14, 15 Gate 16, 17 Counter

──────────────────────────────────────────────────続 き Continuation of the front page (72) Inventor Yasukun Yamane 22-22 Nagaikecho, Abeno-ku, Osaka-shi, Osaka Inside Sharp Corporation (56) References JP-A-2-280471 (JP, A) (58) Investigated Field (Int.Cl. ⁶ , DB name) H04N ^5/ 14-5/217

Claims (2)

(57) [Claims] 1. A timing signal generating means for generating a timing signal, the current fee based on said timing signal
Field image and the field image before the field image
Motion vectors to detect motion vectors at representative points between
And a density gradient detecting means for detecting a density gradient value near the representative point of the current field image based on the timing signal .
Comparing means for comparing the concentration gradient value with a predetermined threshold value, the conversion means and the output pulse signal from said converting means for converting the signals generated based on the comparison result by the comparison means into a pulse signal and a counting means for counting the said
The reliability of the motion vector is determined by the counting result of the counting means.
A motion vector detection device characterized by making a determination . 2. A generates Rita imine <br/> grayed signal by the timing signal generating means, said by the motion vector detecting apparatus Thailand
The current field image and the field
Motion at a representative point between the image and the previous field image
Detecting a vector, with the representative point of the current field image based on the previous northern Imi <br/> ring signal by the concentration gradient detecting means
Detecting near the gradient values, wherein the concentration gradient value detected by the density gradient detection means with a predetermined threshold value, is generated based on the comparison result by the comparison means by conversion means by comparing means It converts the signal into a pulse signal, counting means
Counting the pulse signal outputted from said conversion means by
A camera-integrated image stabilization device, comprising: a motion vector processing unit that determines the reliability of the motion vector based on the counting result of the counting unit and performs processing based on the determination result.