JP2595841B2 - Motion detection circuit - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a motion detecting circuit for detecting motion in a photographing apparatus such as a video camera.

[0002]

2. Description of the Related Art In recent years, in a photographing apparatus such as a video camera, a reduction in size, weight, and high magnification has been further advanced, and the number of users has been expanding from children to elderly people in addition to conventional mania. As a result, the screen shakes due to camera shake, and the image quality is degraded.

As a conventional motion detection circuit, for example, a TV
Conference Report VOL. 11, No. 3 (may. 198)
7) and the like.

[0004] A conventional motion detection circuit will be described below. FIG. 10 is a technical report VOL. 11, N
o. 3 is a block diagram of a camera shake correction apparatus including a conventional motion detection circuit shown in FIG. 3 (may. 1987). In the figure, reference numeral 1001 denotes an A / D conversion circuit;
002 is a motion vector detection circuit, 1003 is a memory control circuit, 1004 is a memory circuit, 1005 is an interpolation control circuit, 1006 is an interpolation circuit, and 1007 is a D / A conversion circuit.

The operation of the conventional camera shake correction apparatus including the above-described motion detection circuit will be described below.

[0006] The input signal is converted into a digital signal by the A / D conversion circuit 1001 and inputted to the motion vector detection circuit 1002 and the memory circuit 1004.
In 002, a motion vector is detected by comparing the video signals of the two fields, and the memory control circuit 1003 obtains a cutout signal corrected for camera shake from the memory circuit 1004 using the motion vector. The memory output signal is the interpolation control circuit 1
A normal video signal is generated by an interpolation circuit 1006 controlled by 005, and an analog signal is generated by a D / A conversion circuit 1007.

The operation of the motion vector detecting circuit 1002 at this time will be described with reference to FIGS. FIG. 11 is an example of an arrangement diagram of representative points in a representative point matching method as a method of detecting a motion vector, and FIG. 12 is an internal circuit configuration diagram of the motion vector detection circuit 1002. FIG. 11 shows a case in which 30 horizontal 6 × vertical 5 = 30 representative points are arranged in four regions. 12, reference numeral 1002 denotes a whole motion vector detection circuit; 1201, a representative point signal memory circuit for storing a signal at a representative point position; 1202, a representative point which is a video signal of the current field and a video signal at a representative point position of one field before. A subtraction circuit 1203 for subtracting the output signal of the signal memory circuit 1201 is an operation signal accumulation memory circuit for accumulating and adding a subtraction signal of a representative point with respect to all the representative points in each area and its surrounding signal. This is a vector detection circuit that obtains a necessary motion vector from the memory circuit 1203.

In this manner, the representative points are arranged, and the motion vector is detected from the video signal of two fields to perform the camera shake correction.

FIG. 13 is a block diagram of another conventional motion detection circuit. This motion detection circuit can detect a motion vector without error even when a part of a subject moves. In the figure, reference numeral 1301 denotes a motion vector detection circuit; 1302, a motion vector reliability determination circuit;
303 is a divergence counting circuit, 1304 is a divergence determination circuit, 13
Reference numeral 05 denotes a vector invalidation determination circuit, reference numeral 1306 denotes an entire screen vector determination circuit, and reference numeral 1307 denotes a temporal low-pass filter circuit.

The operation of the conventional motion detection circuit configured as described above will be described below.

A motion vector detecting circuit 1301 divides an input image signal into a plurality of areas and detects a motion vector of each area. Motion vector reliability determination circuit 130
2 judges the reliability of the motion vector detected by the motion vector detection circuit 1301. Divergence counting circuit 1303
Calculates the divergence from the motion vector of each region determined to be reliable. The divergence determination circuit 1304 determines the magnitude of the divergence calculated by the divergence counting circuit 1303.
When the divergence is large, the vector invalidation determination circuit 1305
A motion vector in a region where a motion vector different from an output signal of the low-pass filter circuit 1307, which is a motion vector of the past entire screen, is detected is invalidated. Then, the entire screen vector determination circuit 1306 determines the motion vector of the current entire screen using the motion vector of the remaining area.

In the determination based on the degree of divergence, the degree of divergence, that is, the degree of variation is small when the motion vector of each region accurately indicates the movement of the device (hand shaking, etc.). If the motion vector of the region indicates an erroneous motion due to the motion of the subject or the like, the degree of divergence, that is, the degree of variation is large, and thus the reliability of the motion vector can be determined based on the degree of divergence.

Next, the motion vector reliability determination circuit 130
2 will be described. When detecting a motion vector by the representative point matching method or the like, it is difficult to accurately detect a motion vector when the subject has no contrast or when the S / N ratio is low. For this reason, K. Uomori, e
t al.:Automatic image stabikizing system by full-d
igital signal processing.IEEE Trans.on Cons.Ele
c., 36, No. 3, p510 (1990)
Do not use a motion vector with a large difference for correction
To calculate the correlation result and the magnitude of the motion vector.
The motion vector obtained by detecting the subject condition using
It is necessary to determine the reliability for the torque . In particular
The correlation calculation value obtained in each motion detection area is usually sharp
Under conditions where the error increases while having a correlation and a high average
Indicates that the image features decrease and the average value decreases, or
Since the correlation has a low correlation and the slope of the correlation
Motion vector obtained in each motion detection area by using
Determine the reliability of the torque.

[0014]

However, with the above configuration, it is necessary to improve the accuracy of motion vector detection.
It is effective to increase the number of motion vector detection areas.
However, if the detection area is set in the center of the screen,
If the object is a stationary object, the accuracy of the desired motion vector detection is
improves. However, if the subject is not a stationary object (moving
Object)), especially on the screen in the motion vector detection area
The motion vector detected from the center detection area is a moving object.
Incorrect determination of motion vector for entire screen due to body effect
Has the potential. Specifically, when the degree of divergence increases due to movement of a part of the subject , it is detected from each detection area
In order to judge the reliability of the motion vector
A process of comparing the motion vector of the output area with the motion vector of the past screen (for example, one field before) and invalidating the reliability of the motion vector of the different detection area is conceivable.
However, in this case , the normal
If the motion vector is different from the past motion vector of the entire screen even though the motion vector has been detected , the divergence is large and the motion of the entire past screen is large.
Judging that it is different from the vector, the movement of the correct area
Disable vector and use motion vector in wrong area
It may be a problem of determining erroneous entire screen motion vector, and is likewise part of the subject Ugokuko
When the divergence increases due to
Screen to determine the reliability of the detected motion vector
The divergence of the motion vector in the entire detection area is detected, and the motion
Judge the reliability of the vector and calculate the motion vector of the current field.
This can be done by invalidating the reliability of the file.
In the case of, only a part of the detection area of the screen
Is large), the motion vector is erroneously detected under the influence of the motion of the subject, and the motion of another detection area (large in the case of the peripheral detection area)
The divergence is calculated from the motion vectors in the detection area of the entire screen, even if the motion vectors are accurately detected.
The divergence becomes large and the current
Field motion vector is judged to be unreliable and the current field
This makes it impossible to detect a motion vector from the data.

The present invention solves the above-mentioned conventional problems, and aims to improve the accuracy of detecting a motion vector at the time of a still subject.
It is another object of the present invention to provide a motion detection circuit capable of detecting a motion vector without error even when a part of a subject moves.

[0016]

In order to achieve this object, a motion detecting circuit according to the present invention comprises a peripheral motion vector for obtaining a motion vector for each motion detecting area in a plurality of motion detecting areas arranged at the periphery of a screen. A detection circuit, and each motion detection of the motion vector detected from the peripheral motion vector detection circuit.
The first reliability judgment in the output area and the
Peripheral motion vector processing circuit for performing a second reliability determination between a plurality of motion detection areas, and a motion vector for each motion detection area in at least one or more motion detection areas arranged at the center of the screen And a third reliability determination of the motion vector detected from the central motion vector detection circuit in each motion detection area.
The fourth between the motion detection areas arranged at the center of the screen
A central motion vector processing circuit for performing independently of the reliability determination the peripheral motion vector processing circuit, wherein the peripheral area及
And motion vectors of each motion detection area located in the center of the screen
And the first and third reliability judgments,
Fifth reliability between a plurality of arranged motion detection areas
An entire screen motion vector processing circuit for making a determination;
In the case where the reliability determination is reliable, the first and third
Each area of the entire screen for which the reliability determination was determined to be reliable
The motion vector of the whole screen is determined from the motion vector of
If the fifth reliability determination is unreliable, the second reliability
Reliability judgment is reliable and fourth reliability judgment is unreliable
Only when is the first reliability determination determined to be reliable
The motion vector of the entire screen is calculated from the motion vector of each area around the screen.
And the motion detected at the present
A vector determining circuit for determining a motion vector of the entire screen from a vector other than the vector.

[0017]

[0018]

[0019]

With the above arrangement, according to the present invention, the peripheral motion vector detecting circuit obtains a motion vector from a detection area provided at the periphery of the screen, and the central motion vector detection circuit obtains a motion vector from the detection area provided at the center of the screen. Get a vector. At this time, the peripheral motion detection circuit mainly detects the motion of the device,
Since the center motion detecting circuit detects the motion of the subject, the motion vector is determined by distinguishing the motion of the device and the motion of the subject from the peripheral motion, the central motion, and the motion of the entire screen.

[0020]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a motion detecting circuit according to a first embodiment of the present invention. In FIG. 1, a peripheral motion vector detection circuit 101 detects a peripheral motion vector of peripheral image data from image data located around an input image signal. Peripheral motion vector processing circuit 10
2 performs processing on the peripheral motion vector from the peripheral motion vector detection circuit 101. The center motion vector detection circuit 103 detects a center motion vector of the center image data from the image data located at the center of the input image signal.
The central motion vector processing circuit 104 performs processing on the central motion vector from the central motion vector detection circuit 103. The entire screen vector determination circuit 105 includes a peripheral motion vector from the peripheral motion vector detection circuit 101, a central motion vector from the central motion vector detection circuit 103, processing data of the peripheral motion vector processing circuit 102, and a central motion vector processing circuit 104. The entire screen vector is determined from the processing data of.

The operation of the motion detection circuit of the present embodiment configured as described above will be described below. The peripheral motion vector detection circuit 101 detects a peripheral motion vector of the peripheral image data from image data located around the input image signal by signal processing such as a representative point matching method.
The peripheral motion vector processing circuit 102 performs processing such as correction and reliability determination on the peripheral motion vector from the peripheral motion vector detection circuit 101. Similarly, the central motion vector detection circuit 103 detects the central motion vector of the central image data from the image data located at the center of the input image signal, and the central motion vector processing circuit 104 outputs the central motion vector from the central motion vector detection circuit 103. , Such as correction and reliability determination. Next, the entire screen vector determination circuit 105 determines the peripheral motion vector from the peripheral motion vector detection circuit 101, the central motion vector from the central motion vector detection circuit 103, and the peripheral motion vector processing circuit 10
The entire screen vector is determined from the determination data of No. 2 and the determination data of the central motion vector processing circuit 104.

Next, the peripheral and central motion vector detecting circuits 101 and 103 will be described with reference to FIG. In FIG. 2, reference numeral 201 denotes peripheral image data located at the periphery of the screen of the input image signal for detecting the peripheral motion vector, 202 denotes central image data located at the center of the screen of the input image signal for detecting the central motion vector, 203 denotes peripheral and This is a representative point for obtaining a central motion vector.

In each of the detection regions (four regions in FIG. 2) of the peripheral motion vector arranged in the peripheral image data 201, the peripheral motion vector is detected. In each of the detection regions (two regions in FIG. 2) of the central motion vector arranged in the central image data 202, the central motion vector is detected.

FIG. 3 shows a configuration example of the peripheral motion vector processing circuit 102 and the central motion vector processing circuit 104 in the motion detection circuit of FIG. 3, reference numeral 102 denotes a peripheral motion vector processing circuit; 104, a central motion vector processing circuit; 301 and 304, motion vector reliability determination circuits for determining the reliability of the obtained motion vectors; and 302, which is determined to be reliable. A divergence counting circuit 303 calculates the divergence of the motion vector of the region that has been set, and a divergence determination circuit 303 determines the calculated divergence. Here, the motion vector reliability determination circuits 301 and 304 determine whether the correlation operation result, the magnitude of the motion vector, and the like are obtained for the motion vector obtained in the same manner as the reliability determination circuit 1302 of FIG.
Judge reliability. Specifically, it is obtained in each motion detection area.
Normally, the correlation operation value has a sharp correlation and a high average.
On the other hand, when the error increases, the features of the image decrease.
Correlation calculation with lower average value or strong correlation in one direction
Since the gradient of the value decreases, the average value and the gradient value
This is to determine the reliability of the motion vector obtained in the motion detection area .

The peripheral motion vector for each motion detection area obtained by the peripheral motion vector detection circuit 101 is used by the motion vector reliability determination circuit 301 to calculate the average value of the correlation operation value and the average value.
By fine gradient value is determined its reliability, then the reliability determination data and the peripheral motion vector in divergent counting circuit 302, calculates the divergence of the peripheral motion vector detection region is determined that there reliability. Then, the divergence determination circuit 303 determines the obtained divergence. The degree of divergence can be obtained by accurately calculating the motion vector of each detection area.
, The divergence, that is, the degree of variation is small, and if the motion vector of each detection area obtained therefrom indicates an erroneous movement due to the movement of the subject or the like, the divergence, that is, the degree of variation, is Since it is large, the reliability of the motion vector can be determined based on the degree of divergence. In addition, the center motion vector detection circuit 103
The central motion vector for each motion detection area is calculated by the motion vector reliability determination circuit 304 as the average value of the correlation operation values and
The reliability is determined based on the gradient value or the like .

The determination of the divergence of the motion vector is performed in the peripheral portion.
With the peripheral motion vector detected from the detection area set in
The center movement detected from the detection area set in the center.
The divergence level determination is not performed with the motion vector because the main purpose is to determine whether a motion vector is erroneously detected due to the motion of the subject included in the image data . Often installed in the central part
Not the center motion vector detected from the
Inspections installed in the periphery that are unlikely to contain the movement of the object
This is because the divergence determination is performed from the peripheral motion vector detected from the output area, thereby performing the divergence determination accurately with a small number of circuits and a small number of processes.

Also, the entire screen vector determination circuit 1 shown in FIG.
Reference numeral 05 denotes a motion vector of each detection area set in the periphery , its reliability data, and a detection area determined to be reliable.
Divergence judgment data of the peripheral motion vector of the area , and the central part
The motion vector of the entire screen is determined from the motion vector of each detection area set in the image data and its reliability data. Next, this determination method will be described. First, when the reliability determination based on the divergence determination data obtained from the peripheral motion vector is reliable, the median (median) of the motion vector of each area of the entire screen determined to be reliable in the reliability data is obtained. , This is the motion vector of the entire screen.
On the other hand, when the reliability determination based on the divergence determination data obtained from the peripheral motion vector indicates no reliability, the motion vector is not used in order to prevent image deterioration due to incorrect motion vector detection. If the reliability of the motion vector detected in this way is not reliable, there is a method of selecting from a plurality of motion vectors detected in the past or predicting from a plurality of motion vectors detected in the past.

As described above, according to the present embodiment, the peripheral motion vector processing circuit and the central motion vector processing circuit are provided.
The peripheral motion vector processing circuit is composed of a divergence counting circuit and a divergence determination circuit, and each processing circuit performs its own processing. Thus, small circumference of being influenced by the movement of an object
Since the reliability determination using only divergence determination data of the motion vector detected from the detection region installed in the side portion, the dynamic
Detection area in the center of the screen to improve vector detection accuracy.
If the subject is a stationary object even after setting the area,
The accuracy of motion vector detection is improved by increasing the area,
Even when the object is not a stationary object (moving object),
In the motion vector detection area,
Is it a detection area in the center of the screen that is often affected by movement?
Since the motion vectors detected from the
Is not erroneously determined. So fixed
The reliability of the motion vector can be accurately determined by the divergence determination with a small number of circuits and a small number of processes using the motion vector from the detected detection area , and effective motion detection can be performed.

FIG. 4 is a block diagram of a motion detecting circuit according to a second embodiment of the present invention. In the figure, reference numeral 401 denotes a peripheral motion vector detection circuit, 403 denotes a center motion vector detection circuit, and the above is the same as the configuration of FIG. FIG.
The difference is that the peripheral motion vector processing circuit 402 performs processing on the peripheral motion vector from the peripheral motion vector detection circuit 401. The center motion vector processing circuit 404 performs processing on the center motion vector from the center motion vector detection circuit 403. Further, the entire screen motion vector processing circuit 405 receives the peripheral motion vector and the central motion vector detection circuit 403 from the peripheral motion vector detection circuit 401.
The process for the central motion vector from performing. The entire screen vector determination circuit 406 is a peripheral motion vector detection circuit 4
01, the central motion vector from the central motion vector detection circuit 403, the processing data of the peripheral motion vector processing circuit 402, the processing data of the central motion vector processing circuit 404, and the entire screen motion vector processing circuit 405. Is to determine the entire screen vector from the processing data of (1).

FIG. 5 shows a peripheral motion vector processing circuit 402, a central motion vector processing circuit 404, and an entire screen motion vector processing circuit 4 which constitute the motion detecting circuit of FIG.
5 shows an example of the configuration. 5, reference numeral 402 denotes a peripheral motion vector processing circuit, 404 denotes a central motion vector processing circuit, 405 denotes a whole screen motion vector processing circuit,
504, a motion vector reliability determination circuit for determining the reliability of the obtained motion vector; 502, 505, and 507, divergence counting circuits for calculating the divergence of the motion vector of the area determined to be reliable; 503, 506 , 508 are divergence determining circuits for determining the calculated divergence.

The peripheral motion vector obtained by the peripheral motion vector detection circuit 401 is
01 and the magnitude of the correlation operation result and motion vector
The reliability is determined from the above. Specifically, each motion detection area
Normally, the correlation operation value obtained by
However, when the error increases, the image features
Decreased, average value decreased, or strong correlation in one direction
Since the gradient of the related operation value decreases, the average value and the gradient value
Then, the reliability of the motion vector obtained in each motion detection area is determined. Next, the divergence counting circuit 502 uses the reliability determination data and the peripheral motion vector to determine the peripheral motion vector of the area determined to be reliable. Calculate the divergence of. Then, the divergence determination circuit 503 determines the obtained divergence. This divergence is small when the obtained motion vector of each region accurately indicates the motion of the device (such as hand shaking), whereas the divergence, that is, the degree of variation is small. When an erroneous movement is indicated by the movement of the subject or the like, the degree of divergence, that is, the degree of variation is large, so that the reliability of the motion vector can be determined from the degree of divergence.

Similarly, the central motion vector detection circuit 403
Are obtained by the motion vector reliability determination circuit 504 by the motion vector reliability determination circuit 50.
1 and it is determined that reliability in the same manner, then the divergent counting circuit around the motion vector and the reliability determination data in 505, to calculate the divergence of the peripheral motion vectors of region determined that there is reliability. Then, the divergence determination circuit 506 determines the obtained divergence.

The whole-screen motion vector processing circuit 40
5 uses the peripheral motion vector obtained by the peripheral motion vector detection circuit 401, the central motion vector obtained by the central motion vector detection circuit 403, and the reliability data determined by the motion vector reliability determination circuits 501 and 504. Then, the divergence counting circuit 507 calculates the divergence of the motion vector in the entire area of the screen determined to be reliable. Then, the divergence determination circuit 508 determines the obtained divergence.

Next, in the entire screen vector determination circuit 406, each area motion vector of the peripheral image data, its reliability data, the divergence determination data of the peripheral motion vector of the area determined to be reliable, and each of the central image data. Determine the motion vector of the entire screen from the area motion vector, its reliability data, the divergence determination data of the central motion vector of the area determined to be reliable, and the divergence determination data of the area determined to be reliable for the entire screen. I do. Next, this determination method will be described with reference to FIG.

First, the reliability judgment based on the divergence judgment data of the entire screen is confirmed. If the reliability is judged to be reliable, the entire screen determined as reliable in the reliability data, that is, the median (median) of the peripheral and central motion vectors is obtained, and this is set as the motion vector of the entire screen. On the other hand, if the reliability judgment based on the divergence judgment data of the entire screen is unreliable, the reliability judgment based on the divergence judgment data obtained from the peripheral motion vector and the reliability judgment based on the divergence judgment data obtained from the central motion vector are checked. . In the reliability determination by divergence determination data obtained from the peripheral motion vector there reliability, and reliability determination by divergence determination data obtained from the center motion vector for no reliability, O and there reliability in a reliability data The median of the determined peripheral motion vectors (median) is obtained, and this is set as the motion vector of the entire screen.

As described above, according to this embodiment, the peripheral motion vector processing circuit, the central motion vector processing circuit, and the entire screen motion vector processing circuit are provided, and each motion vector processing circuit is composed of a divergence counting circuit and a divergence determination circuit. With this configuration, even when the reliability determination based on the divergence determination data of the entire screen is unreliable, the reliability determination based on the divergence determination data of the motion vector detected from the central image data that is often affected by the motion of the subject can be performed. Without reliability and
If the reliability determination based on the divergence determination data of the motion vector detected from the peripheral image data less affected by the motion of the subject is reliable, it is determined that the influence of the motion of the subject is only the central motion vector, and the Since the motion vector of the entire screen is determined from the motion vector detected from the peripheral image data that is less affected by motion, it is located at the center of the screen to improve the accuracy of motion vector detection.
When the subject is a stationary object even if the detection area is set
The accuracy of motion vector detection is
When the subject is not a stationary object (moving object)
However, the movement judgment of the subject is performed in the motion vector detection area.
Around the screen that is less affected by the movement of the subject
The determination of the movement of the motion vector detected from the detection area and the
Affected by the movement of the subject in the vector detection area
The motion vector detected from the detection area
The movement of the entire screen is determined independently of the movement of the turtle.
Since the determination of the vector is not erroneous, the reliability of the motion vector can be accurately determined, and effective motion detection can be performed.

FIG. 7 shows another example of the configuration of the peripheral motion vector processing circuit 402, the central motion vector processing circuit 404, and the entire screen motion vector processing circuit 405 constituting the motion detection circuit of FIG. 7, 402 is a peripheral motion vector processing circuit, 404 is a central motion vector processing circuit,
405 is a motion vector processing circuit for the entire screen;
4 is a motion vector reliability determination circuit for determining the reliability of the obtained motion vector, 502, 505, and 507 are divergence counting circuits for calculating the divergence of the motion vector of the area determined to have reliability, 503 and 506. , 508 is a divergence determination circuit that determines the calculated divergence degree, and 701 is a comparison circuit that compares the peripheral motion vector of the area determined to be reliable with the central motion vector of the area determined to be reliable. is there.

The peripheral motion vector obtained by the peripheral motion vector detection circuit 401 is
01 and the magnitude of the correlation operation result and motion vector
The reliability is determined from the above. Specifically, each motion detection area
Normally, the correlation operation value obtained by
However, when the error increases, the image features
Decreased, average value decreased, or strong correlation in one direction
Since the gradient of the related operation value decreases, the average value and the gradient value
Then, the reliability of the motion vector obtained in each motion detection area is determined. Next, the divergence counting circuit 502 uses the reliability determination data and the peripheral motion vector to determine the peripheral motion vector of the area determined to be reliable. Calculate the divergence of. Then, the divergence determination circuit 503 determines the obtained divergence. This divergence is small when the obtained motion vector of each region accurately indicates the motion of the device (such as hand shaking), whereas the divergence, that is, the degree of variation is small. When an erroneous movement is indicated by the movement of the subject or the like, the degree of divergence, that is, the degree of variation is large, so that the reliability of the motion vector can be determined from the degree of divergence.

Similarly, the central motion vector detection circuit 103
Are obtained by the motion vector reliability determination circuit 504 by the motion vector reliability determination circuit 50.
1 and it is determined that reliability in the same manner, then the divergent counting circuit around the motion vector and the reliability determination data in 505, to calculate the divergence of the peripheral motion vectors of region determined that there is reliability. Then, the divergence determination circuit 506 determines the obtained divergence.

Also, the whole screen motion vector processing circuit 40
5 uses the peripheral motion vector obtained by the peripheral motion vector detection circuit 401, the central motion vector obtained by the central motion vector detection circuit 403, and the reliability data determined by the motion vector reliability determination circuits 501 and 504. Then, the divergence counting circuit 507 calculates the divergence of the motion vector in the entire area of the screen determined to be reliable. Then, the divergence determination circuit 508 determines the obtained divergence. Furthermore, the similarity is determined by comparing the peripheral motion vector of the area determined to be reliable with the central motion vector of the area determined to be reliable.

Next, in the entire screen vector determination circuit 406, each area motion vector of the peripheral image data, its reliability data, the divergence determination data of the peripheral motion vector of the area determined to have reliability, and each of the central image data Area motion vector and its reliability data, divergence determination data of the central motion vector of the area determined to be reliable, divergence determination data of the area determined to be reliable for the entire screen, and determined to be reliable A motion vector of the entire screen is determined from comparison data between a peripheral motion vector of the area and a central motion vector of the area determined to be reliable. Next, this determination method will be described with reference to FIG.

First, the reliability determination based on the divergence determination data of the entire screen is confirmed. When the reliability is judged to be reliable, the entire screen determined to be reliable in the reliability data, that is, the median (median) of the peripheral and central motion vectors is obtained, and this is set as the motion vector of the entire screen. . On the other hand, if the reliability judgment based on the divergence judgment data of the entire screen is unreliable, the reliability judgment based on the divergence judgment data obtained from the peripheral motion vector and the reliability judgment based on the divergence judgment data obtained from the central motion vector are checked. . If the reliability determination based on the divergence determination data obtained from the peripheral motion vector is reliable, and the reliability determination based on the divergence determination data obtained from the central motion vector is reliable, it is further determined that there is reliability. The peripheral motion vector of the area is compared with the central motion vector of the area determined to be reliable, and only when different, the median value (median) of the peripheral motion vector determined to be reliable in the reliability data is obtained. Is the motion vector of the entire screen.

As described above, according to this embodiment, the peripheral motion vector processing circuit, the central motion vector processing circuit, and the entire screen motion vector processing circuit are provided, and the peripheral motion vector processing circuit and the central motion vector processing circuit are connected to the divergence counting circuit. And a divergence determination circuit, and further comprising a divergence counting circuit, a divergence determination circuit, and a comparison circuit for comparing a peripheral motion vector and a central motion vector with the entire screen motion vector processing circuit, thereby obtaining divergence determination data for the entire screen. Even if the reliability judgment is not reliable, the reliability judgment based on the divergence judgment data of the motion vector detected from the central image data, which is often affected by the motion of the subject, is reliable, and Reliability judgment based on divergence data of motion vectors detected from peripheral image data that is less affected Is also reliable, and when the peripheral motion vector and the central motion vector are different, the reliability determination based on the divergence determination data of the entire screen is unreliable, and the divergence determination data of the peripheral motion vector and the central motion vector However, since the central motion vector and the peripheral motion vector are different, the central motion vector is affected by the motion of the subject, is different from the peripheral motion vector, and is different from the peripheral motion vector. Is determined to be unreliable by the divergence determination data, and the influence of the subject motion is determined to be only the central motion vector from this determination, and the motion detected from the peripheral image data less affected by the subject motion is determined. since determining the motion vector of the entire screen from the vector, the motion
Detection area in the center of the screen to improve vector detection accuracy
If the subject is a stationary object even if
The accuracy of motion vector detection is improved by increasing the
Even if the body is not a stationary object (moving object),
Judgment of body movement is performed by moving the subject in the motion vector detection area.
Is the detection area in the peripheral part of the screen less affected by motion?
Judgment of movement of motion vector detected from motion vector
Often affected by subject movement in the detection area
Movement of motion vectors detected from the detection area in the center of the screen
The motion determination can be performed independently. . Therefore, the reliability of an accurate motion vector can be determined, and effective motion detection can be performed.

In the second embodiment, as shown in FIG. 4, the entire screen motion vector processing circuit uses the motion vector detected by the peripheral motion vector detection circuit and the motion vector detected by the central motion vector detection circuit. Thus, the case where the motion vector processing of the whole screen is performed has been described. However, as in the third embodiment shown in FIG. 9, the whole screen motion vector processing circuit detects the motion vector detected by the whole screen motion vector detection circuit 907. The motion vector processing of the entire screen may be performed by using this. In this case, the arrangement of the representative points for the motion vector detection can be set independently for the whole screen motion vector detection, the peripheral motion vector detection, and the center motion vector detection, so that more effective motion vector detection and motion detection are performed. Is possible.

The method of detecting a motion vector is as follows.
One configuration example of the representative point matching method has been described as a conventional technique, but the present invention is not limited to this, such as the all-pixel matching method.

In the above-described embodiment, the case of reliability determination based on the degree of divergence has been described as processing of a motion vector. However, the present invention is not limited to this. For example, processing is performed using the history of motion vectors of a plurality of past fields. .

[0048]

[0049]

As described above, the present invention provides a peripheral motion vector detecting circuit and a peripheral motion vector processing circuit, a central motion vector detecting circuit and a central motion vector processing circuit, and a whole screen motion vector processing circuit to determine divergence. The peripheral motion vector processing circuit, the central motion vector processing circuit, and the entire screen motion vector processing circuit perform the reliability determination based on the data, and perform the motion vector processing according to the position of the screen. By setting the detection area in the center of the screen , if the subject is a stationary object, the accuracy of the motion vector detection is improved by increasing the detection area. If the subject is not a stationary object (in the case of a moving object) , The determination of the movement of the subject is made from the detection area in the peripheral portion of the screen, which is less affected by the movement of the subject in the motion vector detection area. A movement determination of the motion vector is issued, it is possible to independently perform the movement determination of a motion vector detected from the detection region of the large screen center part of being affected by the movement of the object. Therefore , motion vector detection
The accuracy of motion and the reliability of accurate motion vector determination .
Compatible and effective motion detection can be performed.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a motion detection circuit according to a first embodiment of the present invention.

FIG. 2 is a schematic diagram showing a screen for explaining the operation of the motion vector detection circuit in the first embodiment.

FIG. 3 is a peripheral motion vector processing circuit 101 in FIG. 1;
And block diagram showing the internal configuration of the central motion vector processing circuit 103.

FIG. 4 is a block diagram showing a configuration of a motion detection circuit according to a second embodiment of the present invention.

FIG. 5 is a block diagram showing an example of the internal configuration of each motion vector processing circuit in FIG. 4;

FIG. 6 is a flowchart for explaining a determination method by the entire screen determination circuit of the second embodiment when each motion vector processing circuit of FIG. 5 is used;

FIG. 7 is a block diagram showing another example of the internal configuration of each motion vector processing circuit in FIG. 4;

FIG. 8 is a flowchart for explaining a determination method by the entire screen determination circuit of the second embodiment when each motion vector processing circuit of FIG. 7 is used;

FIG. 9 is a block diagram illustrating a configuration of a motion detection circuit according to a third embodiment of the present invention.

FIG. 10 is a block diagram illustrating a configuration of a camera shake correction apparatus including a conventional motion detection circuit.

FIG. 11 is a schematic diagram showing an example of a screen arrangement of representative points in a representative point matching method which is a conventional motion vector detection method.

12 is a block diagram showing the internal configuration of the motion vector detection circuit in FIG.

FIG. 13 is a block diagram showing another configuration of a conventional motion detection circuit.

[Explanation of symbols]

101, 401 Peripheral motion vector detecting circuit 102, 402 Peripheral motion vector processing circuit 103, 403 Central motion vector detecting circuit 104, 404 Central motion vector processing circuit 105, 406 Entire screen vector determining circuit 201 Peripheral image data 202 Central image data 203 Peripheral And representative points 301, 304, 501, and 504 for obtaining a central motion vector Motion vector reliability determination circuits 302, 502, 505, and 507 Divergence counting circuits 303, 503, 506, and 508 Divergence determination circuits 405 Whole screen motion vector processing circuits 701 Comparison Circuit 907 Screen whole motion vector detection circuit

Claims (6)

(57) [Claims] 1. A peripheral motion vector detection circuit for obtaining a motion vector for each motion detection area in the plurality of motion detection areas arranged in the periphery of the screen, each of the motion detection of the motion vector detected from the peripheral motion vector detecting circuit First reliability judgment in the area and around the screen
Communication between the plurality of motion detection areas arranged in the section.
A peripheral motion vector processing circuit that performs reliability determination; a central motion vector detection circuit that obtains a motion vector for each motion detection area in at least one or more motion detection areas arranged in the center of the screen; Third reliability judgment of the motion vector detected from the detection circuit in each motion detection area and the center of the screen
Fourth reliability judgment between the motion detection areas arranged in the section
A central motion vector processing circuit for performing independent of the peripheral motion vector processing circuit and a constant, the peripheral portion of the screen and each of the motion detection arranged in the center of the screen
Region motion vector and said first and third reliability determinations
And a plurality of motion detection areas arranged over the entire screen
An entire-screen motion vector processing circuit for performing a fifth reliability determination between each other; and the first reliability determination unit when the fifth reliability determination is reliable.
Screen for which the third and third reliability determinations have been determined to be reliable
The motion vector of the whole screen is calculated from the motion vector of each area.
Is determined, and the fifth reliability judgment is no reliability
Indicates that the second reliability determination is reliable and the fourth reliability determination is
Only when the reliability judgment of the above is no reliability, the first reliability
Movement of each area around the screen where the judgment was judged to be reliable
And a vector determination circuit for determining a motion vector of the entire screen from the vector. (2) Multiple motion detections located around the screen
A cycle for obtaining a motion vector for each motion detection area in the area
An edge motion vector detection circuit; The motion vector detected from the peripheral motion vector detection circuit
First reliability judgment in each motion detection area and the screen periphery
Communication between the plurality of motion detection areas arranged in the section.
A peripheral motion vector processing circuit for performing reliability determination; At least one or more motion detections located in the center of the screen
Getting motion vectors for each motion detection area in the area
Central motion vector detection circuit, The motion vector detected from the central motion vector detection circuit
3rd reliability judgment in each motion detection area and the center of the screen
Fourth reliability judgment between the motion detection areas arranged in the section
Is performed independently of the peripheral motion vector processing circuit.
Central motion vector processing circuit, Each motion detection arranged at the peripheral part of the screen and the central part of the screen
Region motion vector and said first and third reliability determinations
And a plurality of motion detection areas arranged over the entire screen
Fifth reliability determination between each other and said peripheral motion vector
The motion vector detected from the detection circuit and the central motion vector
From the similarity with the motion vector detected by the
Sixth whole-frame motion vector processing circuit for performing reliability determination
When, If the fifth reliability determination is reliable, the first
Screen for which the third and third reliability determinations have been determined to be reliable
The motion vector of the whole screen is calculated from the motion vector of each area.
Is determined, and the fifth reliability judgment is no reliability
Indicates that the second reliability determination is reliable and the fourth reliability determination is
Is reliable and the sixth reliability determination is
Only when there is reliability, the first reliability judgment is reliable.
From the motion vector of each area around the screen
A vector determination circuit that determines a motion vector of the entire surface;
A motion detection circuit comprising: 3. A reliability determination circuit for determining a first reliability in each motion detection area of a motion vector obtained in each motion detection area arranged in a peripheral portion of a screen, A divergence counting circuit that calculates the divergence from the motion vector that the reliability determination circuit has determined to be reliable,
The configured size of the calculated divergence divergent counter circuit and a determining divergence determination circuit, the divergence determination circuit before
When the divergence is small, the second motion vector
It is judged that there is reliability, and when the divergence is large, the periphery of the screen
And determining that the second motion vector has no second reliability.
Or the motion detection circuit according to 2 . 4. A reliability determination circuit for determining a third reliability in each motion detection area of a motion vector obtained in each motion detection area arranged in the center of the screen, the central motion vector processing circuit; A divergence counting circuit that calculates the divergence from the motion vector that the reliability determination circuit has determined to be reliable,
The configured size of the calculated divergence divergent counter circuit and a determining divergence determination circuit, the divergence determination circuit before
When the divergence is small, the fourth motion vector
Judgment that there is reliability, and when the divergence is large, the center of the screen
And determining that the motion vector has no fourth reliability.
4. The motion detection circuit according to 1, 2, or 3. 5. The entire screen motion vector processing unit, the screen
A divergence counting circuit that calculates a divergence degree from a motion vector determined to be reliable in a detection region arranged in the whole, and a divergence determination circuit that determines the magnitude of the divergence degree calculated by the divergence counting circuit The divergence determination circuit is configured
When the divergence is small, the fifth confidence of the motion vector of the whole screen
And the divergence is large, the movement of the entire screen
4. The method according to claim 1, further comprising: determining that the vector has no fifth reliability.
Or the motion detection circuit according to 4 . 6. entire screen motion vector processing unit, the screen
A divergence counting circuit that calculates the degree of divergence from the motion vector determined to be reliable in the detection area arranged throughout, and a divergence determination circuit that determines the magnitude of the degree of divergence calculated by the divergence counting circuit, The motion vectors detected from the peripheral motion vector detection circuit and the motion vectors detected from the central motion vector detection circuit are compared, and the similarity of these two motion vectors is determined.
It is configured in degrees from the obtained Ru comparator, the divergence determination circuit before
When the divergence is small, the fifth signal of the motion vector of the entire screen is displayed.
When the divergence is large, the motion of the entire screen is determined.
Is determined to have no fifth reliability, and the similarity is
When small, the motion vector of the entire screen has the sixth reliability
When the similarity is large, the motion vector of the entire screen is determined.
5. The motion detection circuit according to claim 2, wherein it is determined that there is no sixth reliability .