JPH05176218A - Picture motion correcting device - Google Patents

Abstract

PURPOSE:To realize picture motion correction implemented by segmenting a required signal from a video signal stored in a field memory by directly segmenting the signal from a photoelectric conversion element through the use of an acceleration detection means detecting directly the motion of an image pickup device. CONSTITUTION:A conventional picture motion correction device is provided newly with an acceleration detection circuit 8, a conversion circuit 9, a picture motion prediction circuit 5 and a photoelectric conversion element control circuit 6, a picture motion detection circuit 4 detects the motion of a picture and the motion of a picture of a succeeding field is predicted by the predictive circuit 5 based on the motion of the picture to be detected and information resulting from acceleration information obtained by the acceleration detection circuit 8 and converted into required information by the conversion circuit 9, a signal read address of a photoelectric conversion element 1 is moved based on the prediction to correct the motion of the picture.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image motion correction device used for image stabilization of an image pickup device.

[0002]

2. Description of the Related Art When a subject is photographed by using the image pickup device, if the image pickup device is directly held by a hand or mounted on a moving body such as a vehicle, shaking occurs during image pickup on the screen. Therefore, a hand shake correction device that detects the shake of the screen and corrects the position of the image based on the shake information has been put into practical use.
Such a hand shake correction device requires an image motion detection device that detects image motion.

The operation principle of a conventional image motion detection device will be described. FIG. 8 is a block diagram showing the configuration of a conventional image motion detection device. In the figure, a photoelectric conversion element 1 is an image pickup element and converts an image through an optical system into an electric signal (hereinafter, referred to as an image signal). The analog signal processing circuit 2 performs signal processing on the video signal from the photoelectric conversion element 1, and the analog-digital conversion circuit 3 converts the video signal processed by the analog signal processing circuit 2 into a digital signal. Then, the converted signal is sent to the image motion detection circuit 4 and the field memory circuit 6. The image motion detection circuit 4 detects the image motion from the video signal from the analog-digital conversion circuit 4. The field memory circuit 6 stores the video signal from the analog-digital conversion circuit 4. The field memory control circuit 5 controls the read address of the field memory circuit 6 according to the motion information obtained by the image motion detection circuit 4, that is, the motion of the input image. The video signal read from the field memory circuit 6 is subjected to digital signal processing by the digital signal processing circuit 8.

FIG. 9 is a block diagram showing a specific structure of the image motion detection circuit 4 shown in FIG. In the figure,
The representative point storage circuit 1a divides the video signal of the current field input from the photoelectric conversion element 1 into a plurality of areas, and stores the video signal corresponding to a specific representative point of each area as a representative point signal. .. This circuit also supplies the representative point signal of the previous field scanned one field before the current field to the correlation calculation circuit 2a. The correlation calculation circuit 2a performs a correlation calculation between the previous representative point signal and the video signal of the current field, and compares the difference between the previous representative point signal and the video signal of the current field, and the output thereof is the motion vector detection circuit 3
given to a. The motion vector detection circuit 3a detects the image motion vector between the previous field and the current field from the calculation result of the correlation calculation circuit 2a.

In the conventional image motion detecting device configured as described above, the image signal of the current field obtained from the photoelectric conversion element 1 is the image motion detecting circuit 4 and the field memory circuit 6.
Sent to. The image motion detection circuit 4 detects the motion of the image from this video signal, and moves the data read address of the field memory circuit 6 in accordance with the detected motion, so that the image of the image in the current field due to hand shake or the like is detected. I have done shake removal.

[0006]

However, the above-mentioned structure has a problem that a field memory circuit is inevitably necessary for hand shake correction. The present invention solves the problems of the related art, and an object of the present invention is to provide a new camera shake correction device different from the conventional one.

Further, it is a technical object to improve the correction accuracy of hand shake correction by a new hand shake correction device.

[0008]

According to the present invention, instead of moving a signal read address of a field memory circuit to correct an image shake, a new acceleration detection circuit, conversion circuit, image motion prediction circuit, and photoelectric conversion element are newly added. By providing the control circuit, the shake of the image is corrected by moving the signal read address on the photoelectric conversion element without using the field memory circuit and the field memory control circuit.

Further, according to the present invention, an acceleration detection circuit, a conversion circuit, an image motion prediction circuit, and a photoelectric conversion element control circuit are newly provided instead of moving the signal read address of the field memory circuit to correct the image shake. Due to
The image fluctuation is corrected by moving the signal read address on the photoelectric conversion element without using the field memory circuit and the field memory control circuit, and the correction performance is improved by adding a coefficient calculation circuit to the image motion prediction circuit. Improve.

[0010]

With the above-mentioned structure, the image motion correction apparatus of the present invention corrects the image shake by moving the signal read address on the photoelectric conversion element without using the field memory circuit and the field memory control circuit. You can

Further, according to the present invention, the fluctuation of the image is corrected by moving the signal read address on the photoelectric conversion element without using the field memory circuit and the field memory control circuit, and the correction accuracy and the correction performance are improved. Can be made

[0012]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram of an image motion correction apparatus according to the first embodiment of the present invention. In the figure, a photoelectric conversion element 1 is an image sensor and converts an image through an optical system into an electric signal. The analog signal processing circuit 2 performs signal processing on the video signal from the photoelectric conversion element 1, and the analog-digital conversion circuit 3 converts the signal processed by the analog signal processing circuit 2 into a digital signal. The image motion detection circuit 4 detects the motion of the image from the video signal from the analog-digital conversion circuit 3 and outputs the motion information of the image to the image motion prediction circuit 5. Acceleration detection circuit 8
Detects the acceleration of movement of the image pickup device. The conversion circuit 9 converts the acceleration information detected by the acceleration detection circuit 8 into acceleration conversion information, and adjusts the gain of the acceleration conversion information. The image motion prediction circuit 5 predicts a motion vector of the image one field ahead from the motion information of the image obtained by the image motion detection circuit 4 and the acceleration conversion information obtained by the conversion circuit 9 (hereinafter, this motion vector will be referred to as (Referred to as motion prediction vector), and the integrated value of this motion prediction vector is output to the photoelectric conversion element control circuit 6. The photoelectric conversion element control circuit 6 controls the signal read address on the photoelectric conversion element 1 based on the integrated value of the motion prediction vector of the image obtained by the image motion prediction circuit 5. The photoelectric conversion element drive circuit 7 is a circuit for driving the photoelectric conversion element 1. Digital signal processing circuit 1
Reference numeral 0 is a circuit for performing digital signal processing on the video signal from the analog-digital conversion circuit 3.

Since the image motion detecting circuit 4 has the same structure and function as that of the conventional example shown in FIG. 9, detailed description thereof will be omitted. In the following description of the present embodiment, each circuit constituting the image motion detection circuit 4 is the same as each circuit in FIG.

FIG. 2 is a block diagram showing a specific structure of the image motion prediction circuit 5 shown in FIG. In the figure,
The prediction calculation circuit 2b is a circuit for predicting and calculating a motion vector one field ahead from the motion vector obtained in the current field and the acceleration conversion information obtained by the conversion circuit 9 shown in FIG. The motion vector used in is the motion prediction vector obtained in the image motion prediction circuit 5 one field before that field in each field,
It is obtained by adding (or subtracting) the image motion information obtained by the motion detection circuit 4 in each field, that is, the actual motion vector in each field. The motion vector calculation circuit 1b calculates the actual motion vector in each field. By the way, the vector calculation circuit 1b stores the motion prediction vector output from the prediction calculation circuit 2b in each field, and uses the motion prediction vector and the image motion information obtained by the image motion detection circuit 4 to determine the actual motion between fields. Find the motion vector of. The motion vector integration circuit 3b integrates the motion prediction vector from the prediction calculation circuit 2b for each field (hereinafter, referred to as motion prediction integration vector).

The operation of the image motion detecting device of the present embodiment having the above-described structure will be described below.

In the image motion detection circuit 4, the photoelectric conversion element 1
The correlation calculation circuit 2a performs the correlation calculation between the video signal of the current field obtained in step 1 and the representative point signal stored in the representative point storage circuit 1a of the video signal of the previous field. Detect motion. However, the obtained motion information of the image is the difference between the motion of the image predicted by the image motion prediction circuit 5 in the previous field and the actual motion of the image of the current field. That is, if the motion predicted by the image motion prediction circuit 5 is the same as the actual motion, the motion of the image obtained by the image motion detection circuit 4 becomes zero. The image motion information detected by the image motion detection circuit 4 is added (or subtracted) to the motion prediction vector in the previous field in the motion vector calculation circuit 1b, and the prediction calculation circuit 2b is used as the actual motion vector of the current field with respect to the previous field. Sent to. The prediction calculation circuit 2b obtains a motion vector predicted in the next field from the input from the motion vector calculation circuit 1b and the acceleration conversion information in which the gain of the motion of the imaging device obtained in the conversion circuit 9 is adjusted, and the motion vector is predicted. It is sent to the motion vector integration circuit 3b as a vector.

At this time, in the predictive calculation circuit 2b, the acceleration detection circuit 8 outputs from the acceleration detection circuit 8 within a time period from when the video signal of the current field is read from the photoelectric conversion element 1 to when the video signal of the next field is read. A value obtained by integrating the obtained acceleration information in the conversion circuit 9 and adjusting the gain, that is, the change in velocity during one field and the motion vector in the current field are added to obtain a motion prediction vector.

Using the motion vector predictor described above, the motion vector integrating circuit 3b calculates the integral value of the motion vector predictor obtained in each field. Then, this motion prediction integration vector is sent to the photoelectric conversion element control circuit 6, and the photoelectric conversion element control circuit 5 controls the video signal read address on the photoelectric conversion element 1 based on this motion prediction integration vector, and the motion of the video signal. The component is corrected on the photoelectric conversion element 1.

As described above, according to the present embodiment, the signal read address on the photoelectric conversion element 1 is moved by the image motion prediction data one field ahead predicted by the motion vector predicting circuit 5, so that the field memory circuit is moved. It is possible to correct the motion of an image without using.

Further, in the present embodiment, it is obvious that the functions of the circuits other than the acceleration detection circuit 8 can be realized by software.

Further, in this embodiment, when the photoelectric conversion element having the number of pixels for NTSC is used and the final output of the video signal is the signal of the NTSC system, the digital signal processing circuit is electronically processed. The digital signal processing circuit is electronically processed even when a PAL pixel number is used as the photoelectric conversion element and the final video signal output is a PAL system signal. It has a zoom function by PAL.
In the case where the number of pixels for use in NTSC is larger than that for NTSC and the final video signal output is an NTSC system signal, the digital signal processing circuit does not include a zoom function by electronic processing.

In the present embodiment, the motion information of the image detected by the image motion detection circuit 4, the motion prediction vector predicted by the image motion prediction circuit 5, and the motion prediction integration vector obtained by the motion vector integration circuit 3b. Although the accuracy is not specifically mentioned, it is possible to provide the accuracy of 1 pixel or less. In that case, the digital signal processing circuit is configured to have a function of interpolating the video signal, and based on the motion predictive integration vector, a correction signal that is motion-corrected with an accuracy of one pixel or less by this interpolation process. It is possible to generate.

Further, in this embodiment, the image motion detection circuit 4 is the same as that of the conventional example, but it is not limited to this.

Further, in the present embodiment, the detection of the motion of the image and the prediction of the motion of the image are all performed for each field. However, the present invention is not limited to this, and it may be performed, for example, not for each field but for each frame. ..

Next, a second embodiment of the present invention will be described. The configuration of the second embodiment of the present invention is the same as that of the first embodiment shown in FIG.
Although the configuration is the same as that of the first embodiment, there is a difference in the internal configuration of the image motion prediction circuit 5.

FIG. 3 is a block diagram showing a concrete structure of the image motion prediction circuit 5 in the second embodiment. In the figure, the prediction calculation circuit 2c is a circuit for predicting calculation of a motion vector one field ahead from the motion vector obtained in the current field and the acceleration conversion information of the imaging device obtained in the conversion circuit 9 similarly to the prediction calculation circuit 2b. The motion vector used here is obtained by adding the image motion information obtained by the motion detection circuit 4 in each field to the motion prediction vector obtained by the image motion prediction circuit 5 one field before that field in each field. (Or subtraction), which is the actual motion vector in each field. The vector calculation circuit 1c calculates the actual motion vector in each field. By the way, the vector calculation circuit 1c uses the prediction calculation circuit 2 in each field.
The motion prediction vector output by c is stored, and an actual motion vector between fields is obtained using this motion prediction vector and the image motion information obtained by the image motion detection circuit 4. The prediction calculation circuit 2c predicts the motion vector of the image one field ahead from the image motion vector obtained by the motion vector calculation circuit 1c. The motion vector integration circuit 3c integrates the motion prediction vector from the prediction calculation circuit 2c for each field to actually determine the video signal read address on the photoelectric conversion element 1. Integration vector correction circuit 4c
Uses the result of the motion vector calculation circuit 1c to correct the error associated with the prediction included in the value integrated by the motion vector integration circuit 3c.

The operation of the image motion detecting device of this embodiment having the above-described structure will be described below.

In the image motion detection circuit 4, the photoelectric conversion element 1
The correlation calculation circuit 2a performs the correlation calculation between the video signal of the current field obtained in step 1 and the representative point signal stored in the representative point storage circuit 1a of the video signal of the previous field. Detect motion. However, the obtained motion information of the image is the difference between the motion of the image predicted by the motion prediction circuit in the previous field and the actual motion of the image of the current field. That is, if the motion predicted by the image motion prediction circuit 5 is the same as the actual motion, the motion of the image obtained by the image motion detection circuit 4 becomes zero. The image motion information detected by the image motion detection circuit 4 is added (or subtracted) to the motion prediction vector in the previous field in the motion vector calculation circuit 1c, and the prediction calculation circuit 2c is used as an accurate motion vector value of the current field with respect to the previous field. Sent to. The prediction calculation circuit 2c obtains a motion vector predicted in the next field from the input from the motion vector calculation circuit 1c and the speed information of the imaging device obtained by the conversion circuit 9, and sends this to the motion vector integration circuit 3c. The motion vector integration circuit 3c calculates the integrated value of the motion vector. However, since the motion vector integrated here is a value predicted by the prediction calculation circuit 2c, it is considered that an error that occurs during prediction is naturally included. Therefore, by using the actual motion vector of the current field obtained by the motion vector calculation circuit 1c to correct the motion prediction integration vector for each field, more accurate motion correction can be performed. This is shown in FIG. 5 (where n is the current field, vector S _n is the integral value of the motion vector up to the current field, vector y _{n + 1} is the motion prediction vector of the next field obtained in the current field, and the previous field is the vector y _{n + 1)} . Let the actual motion vector of the current field be vector v _n .
Also, for simplicity, vectors are displayed in one dimension. ), The motion prediction vector integrated in the previous field (that is, the predicted value of the motion vector of the current field with respect to the previous field: vector y in FIG. 5).
Instead of _n ), the actual motion vector (vector v _{n in} FIG. 5) for the previous field of the current field obtained by the motion vector calculation circuit 1c in the current field is used for integration. Then, the integral value of the motion of the image up to the current field (vector S _n , vector S _n =
The vector S _n-1 + vector v _n ) is added to the motion prediction vector (vector y _{n + 1 in} FIG. 5) obtained by the prediction calculation circuit 2c in the current field to obtain the signal read address on the photoelectric conversion element 1. decide. Based on this determination, the photoelectric conversion element control circuit 6 controls the video signal read address on the photoelectric conversion element 1, and corrects the motion component of the video signal on the photoelectric conversion element 1.

As described above, according to the present embodiment, by adding the integral vector correction circuit 4c to the image motion prediction circuit 5, the signal read on the photoelectric conversion element 1 obtained by the image motion prediction circuit 5 can be more accurately performed. Therefore, it is possible to correct the motion of the image with higher accuracy.

Next, a third embodiment of the present invention will be described. The configuration of the third embodiment of the present invention is the same as that of the first embodiment shown in FIG.
Although the configuration is the same as that of the second embodiment, there is a difference in the internal configuration of the image motion prediction circuit 5 as in the second embodiment.

FIG. 4 is a block diagram showing a concrete configuration of the image motion prediction circuit 5 in the third embodiment. In the figure, the point that a decimal part error correction circuit 4d is newly provided is different from the configuration of the first embodiment. That is, the fractional part error correction circuit 4d receives the outputs of the image motion detection circuit 4 and the motion vector integration circuit 3d as input, and the output is the motion vector calculation circuit 1
It is configured to input to d.

The fractional part error correction circuit 4d is a circuit for correcting an error in the fractional part due to the fact that the video signal can be read out from the photoelectric conversion element 1 only in units of lines.
The motion information of the image in which the decimal part error correction circuit 4d has corrected the decimal part error is output to the motion vector calculation circuit 1d. Since the configuration and operation of the motion vector calculation circuit 1d and thereafter in the image motion prediction circuit 5 are the same as the configuration and operation of the first embodiment, detailed description thereof will be omitted.

The operation of the image motion detecting device of the present embodiment having the above-mentioned structure will be described below.

In the image motion detection circuit 4, the photoelectric conversion element 1
The correlation calculation circuit 2a performs the correlation calculation between the video signal of the current field obtained in step 1 and the representative point signal stored in the representative point storage circuit 1a of the video signal of the previous field. Detect motion. However, the obtained motion information of the image is the difference between the motion of the image predicted by the motion prediction circuit in the previous field and the actual motion of the image of the current field. That is, if the motion predicted by the image motion prediction circuit 5 is the same as the actual motion, the motion of the image obtained by the image motion detection circuit 4 becomes zero. But,
Regarding the accuracy of the motion information of the image detected by the image motion detection circuit 4, the motion prediction vector predicted by the prediction calculation circuit 2d, and the motion prediction integration vector obtained by the motion vector integration circuit 3d, the accuracy should be one pixel or less. However, in actuality, when the video signal is read from the photoelectric conversion element 1, since it is read line by line on the photoelectric conversion element 1, the image motion detection circuit 4 calculates it by the image motion prediction circuit 5. There is no problem if the motion prediction integration vector value takes an integer value, but if it takes a value that includes a decimal, that is, if correction for one pixel or less is taken into consideration, the value with the decimal part cut off is read. When the correlation calculation or the like is performed on the read video signals, an error due to the truncation of the decimal part is naturally included. This error will be specifically described with reference to FIG. 6. In FIG. 6, circles on the intersections of the solid-line gratings schematically represent the light-receiving portions on the photoelectric conversion element 1, and each light-receiving portion has a vertical direction. , And v1, v2, v3, ... from the top, and h1, h2, h3 ,. Frames A and B shown by dotted lines are cut-out frames including the fractional part determined by the motion vector prediction circuit 5, and the order is A first and B next field. First, when the frame A is designated by the image motion prediction circuit 5, it is actually impossible to read out a signal from between the light receiving portions on the photoelectric conversion element 1, so that in this case, the image The signal reading is started from the light receiving unit of (h4, v4). At this time, there is a difference between the readout frame on the photoelectric conversion element 1 and the correction frame indicated by the motion integration vector, which is indicated by the vector u in FIG.
Subsequently, in the next field, in order to cut out the correction frame indicated by the frame B, the reading of the video signal on the photoelectric conversion element 1 is started from the light receiving unit of (h2, v1). At this time, a vector v in FIG. 6 is provided between the read frame on the photoelectric conversion element 1 and the correction frame indicated by the motion integral vector.
The difference is as shown by. At this time, the motion detection circuit 4
Then, the detection of the motion between the two fields is performed by the photoelectric conversion element 1
Since the difference between the correction frame and the read-out frame and the vector u and the vector v are not taken into consideration because the video signal from FIG. False detection as movement between fields. By performing the correction of this erroneous detection by the decimal part error correction circuit 4d, the motion vector of the next field in the image motion prediction circuit 5 can be predicted more accurately. The image motion information detected by the image motion detection circuit 4 and corrected by the fractional part error correction circuit 4d is added (or subtracted) to the predicted motion vector value in the previous field in the motion vector calculation circuit 1d to obtain the current value for the previous field. It is sent to the prediction calculation circuit 2d as the actual motion vector value of the field. The prediction calculation circuit 2d calculates a motion vector predicted in the next field from the input from the motion vector calculation circuit 1d and the speed information of the imaging device obtained by the conversion circuit 9, and sends this to the motion vector integration circuit 3d. The motion vector integration circuit 3d calculates the integrated value of the motion vector (motion prediction integration vector). Then, the motion prediction integration vector of this image is sent to the photoelectric conversion element control circuit 6, and the photoelectric conversion element control circuit 5 controls the video signal read address on the photoelectric conversion element 1 based on this image motion prediction integration vector, The motion component of the signal is corrected on the photoelectric conversion element 1.

If the integration vector correction circuit 4c shown in the second embodiment is added to the image motion prediction circuit 5, the second
It goes without saying that the same effect as that of the embodiment can be realized.

As described above, according to the present embodiment, the correction of the error due to the fractional part truncation on the photoelectric conversion element 1 included in the image motion information between the two fields detected by the image motion detection circuit 4 is corrected. By using the error correction circuit 4d,
It is possible to further improve the accuracy of the prediction of the motion of the image one field ahead in the image motion prediction circuit 5.

Next, a fourth embodiment of the present invention will be described. The configuration of the fourth embodiment of the present invention is the same as that of the first embodiment shown in FIG.
Although the configuration is the same as that of the second embodiment, there is a difference in the internal configuration of the image motion prediction circuit 5 as in the second and third embodiments.

FIG. 7 is a block diagram showing a concrete structure of the image motion prediction circuit 5 in the fourth embodiment. In the figure, coefficient circuits 5b and 6b are circuits for weighting the output from the motion vector calculation circuit 1b and the output from the conversion circuit 9, respectively. The coefficient calculation circuit 4b uses the weighting coefficients of the coefficient circuits 5b and 6b as the motion vector calculation circuit 1b.
It is a circuit that calculates from the output from and the output from the conversion circuit 9. The prediction calculation circuit 2b is one field ahead of the value obtained by weighting the motion vector obtained in the current field by the coefficient circuit 5b and the value obtained by weighting the acceleration conversion information obtained by the conversion circuit 9 by the coefficient circuit 6b. It is a circuit that predicts the motion vector, and the motion vector used here is
It is obtained by adding (or subtracting) the image motion information obtained by the motion detection circuit 4 in each field to the motion prediction vector obtained by the image motion prediction circuit 5 one field before that field in each field. , Which is the actual motion vector in each field. The motion vector calculation circuit 1b calculates the actual motion vector in each field. That is, the vector calculation circuit 1b stores the motion prediction vector output from the prediction calculation circuit 2b in each field, and uses the motion prediction vector and the image motion information obtained by the image motion detection circuit 4 to switch between fields. Find the actual motion vector. The motion vector integration circuit 3b integrates the motion prediction vector from the prediction calculation circuit 2b for each field (hereinafter, referred to as motion prediction integration vector).

The operation of the image motion detecting apparatus of the present embodiment having the above-mentioned structure will be described below.

In the image motion detection circuit 4, the photoelectric conversion element 1
The correlation calculation circuit 2a performs the correlation calculation between the video signal of the current field obtained in step 1 and the representative point signal stored in the representative point storage circuit 1a of the video signal of the previous field. Detect motion. However, the obtained motion information of the image is the difference between the motion of the image predicted by the image motion prediction circuit 5 in the previous field and the actual motion of the image of the current field. That is, if the motion predicted by the image motion prediction circuit 5 is the same as the actual motion, the motion of the image obtained by the image motion detection circuit 5 is zero. The image motion information detected by the image motion detection circuit 4 is added (or subtracted) to the motion prediction vector in the previous field in the motion vector calculation circuit 1b to become the actual motion vector of the current field with respect to the previous field. This motion vector is weighted by the coefficient circuit 5b and sent to the prediction calculation circuit 2b. The prediction calculation circuit 2b obtains a motion vector predicted in the next field from the input of the coefficient circuit 5b and the acceleration conversion information of the motion of the image pickup device obtained by the conversion circuit 9 weighted by the coefficient circuit 6b, and the motion vector is calculated. It is sent to the motion vector integration circuit 3b as a vector.

At this time, in the predictive calculation circuit 2b, the video signal of the next field is read from the time when the video signal of the current field is read from the photoelectric conversion element 1, that is, from the time when the motion vector of the video of the current field is obtained. Acceleration, which is obtained from the difference between the motion vector of the current field and the motion vector of the next field at the time when the motion vector of the video of the next field is obtained The difference is considered to be acceleration.) The acceleration information obtained from the acceleration detection circuit 8 is integrated for one field period in this case by the conversion circuit 9 and weighted by the coefficient circuit 6b. Then, this value is added to the motion vector of the current field and the value weighted by the coefficient circuit 5b to add the motion prediction vector. We have to take.

At this time, in the coefficient calculation circuit 4b, in order to determine the weighting coefficient of the coefficient circuits 5b and 6b, the difference value for each field of the motion vector up to the present obtained by the motion vector calculation circuit 1b in each field is calculated. , The ratio between the acceleration information obtained by the acceleration detection circuit 8 corresponding to the difference value and the value obtained by integrating for one field period in this case is calculated by the conversion circuit 9, and is stored. The weighting coefficient of the coefficient circuits 5b and 6b is determined by using at least one of the above.

Using the motion vector predictor described above, the motion vector integration circuit 3b calculates the integral value of the motion vector predictor obtained in each field. Then, this motion prediction integration vector is sent to the photoelectric conversion element control circuit 6, and the photoelectric conversion element control circuit 6 controls the video signal read address on the photoelectric conversion element 1 based on this motion prediction integration vector, and the motion of the video signal. The component is corrected on the photoelectric conversion element 1.

Next, a configuration example of the method of determining the weighting coefficient in the coefficient calculating circuit 4b will be described. For example, a difference value A between fields of the motion vector described above and a value B obtained by integrating the acceleration information obtained by the acceleration detection circuit 8 corresponding to the difference value between the fields in this case by the conversion circuit 9 in this case. If the ratio value of A is set to A / B, and if only the ratio obtained from the difference value between the motion vector of the current field and the motion vector of the previous field is used for weighting factor determination, for example, For simplification, if the weighting coefficient of the coefficient circuit 5b is 1, the weighting coefficient of the coefficient circuit 6b is a ratio value obtained from the difference value between the motion vector of the current field and the motion vector of the previous field. At this time, the motion vector predictor quickly follows the change in the value of the ratio.

Further, for example, a plurality of values (for example, 10 values in 10 field periods) among the above A / B ratio values are used.
Therefore, for example, if the average of these plural ratios is used for determining the weighting coefficient, if the weighting coefficient of the coefficient circuit 5b is set to 1, the weighting coefficient of the coefficient circuit 6b becomes the average value of the plural ratios within the above-mentioned period. At this time, by using the average value of the ratio values, the error component included in the ratio values is reduced, and a stable motion prediction vector is obtained.

Further, as described above, the coefficient circuits 5b, 6
The difference value for each field of the motion vector up to the present time obtained by the motion vector calculation circuit 1b in each field when determining the coefficient in b and the acceleration information obtained by the acceleration detection circuit 8 corresponding to the difference value Is not based on the ratio with the value obtained by integrating for one field period in the conversion circuit 9, but the difference value of the motion vector at each frame or at time intervals longer than that and the acceleration detection corresponding to the difference value. In this case, the acceleration information obtained by the circuit 8 is calculated by the conversion circuit 9 in this case based on a value obtained by integrating each frame or a time period longer than that, and the above-mentioned ratio is obtained. The error component contained in the ratio value is reduced,
A stable motion vector predictor is obtained.

As described above, according to the present embodiment, the signal read address on the photoelectric conversion element 1 is moved by the image motion prediction data one field ahead predicted by the motion vector predicting circuit 5, so that the field memory circuit is moved. It is possible to correct the motion of an image without using.

Further, the difference value between the fields of the motion vector used when determining the coefficient and the acceleration information obtained by the acceleration detection circuit 8 corresponding to the difference value are integrated by the conversion circuit 9 for one field in this case. The temporal relationship with the obtained value (that is, the temporal relationship between one field period in which the difference value between the fields of the motion vector is obtained and the integration period in which the conversion circuit 9 performs the integration) is Since the obtained video signal and the acceleration information obtained by the acceleration detection circuit differ depending on the circuit configuration of the signal processing system and the acceleration detection circuit of the image pickup apparatus, they are not specified here.

Further, in the fourth embodiment, three methods of calculating the coefficient have been described, but the method is not limited to this, and it is also possible to use a plurality of ratio values of a plurality of fields.

Further, in the present embodiment, it is apparent that the functions of the circuits other than the acceleration detection circuit can be realized by software.

Further, in the present embodiment, when the photoelectric conversion element having the number of pixels for NTSC is used and the final output of the video signal is the signal of the NTSC system, the digital signal processing circuit is electronically processed. The digital signal processing circuit also has a zoom function, and the digital signal processing circuit is electronically processed even when a photoelectric conversion element having the number of pixels for PAL is used and the final video signal output is a PAL system signal. Although it has a zoom function, the digital signal processing circuit uses electronic processing when a pixel for PAL or the like having a larger number of pixels than that for NTSC is used and the final video signal output is an NTSC signal. The zoom function is not included.

Further, in the present embodiment, the motion information of the image detected by the image motion detection circuit 4, the motion prediction vector predicted by the image motion prediction circuit 5, and the motion prediction integration vector obtained by the motion vector integration circuit 3b. Although the accuracy is not specifically mentioned, it is possible to provide the accuracy of 1 pixel or less. In that case, the digital signal processing circuit is configured to have a function of interpolating the video signal, and based on the motion predictive integration vector, a correction signal that is motion-corrected with an accuracy of one pixel or less by this interpolation process. It is possible to generate.

Further, in this embodiment, the image motion detection circuit 4 is the same as that of the conventional example, but it is not limited to this.

Further, in the present embodiment, the detection of the motion of the image and the prediction of the motion of the image are all performed for each field. However, the present invention is not limited to this. For example, it may be performed not for each field but for each frame. ..

[0056]

As described above in detail, according to the present invention, when image motion correction is performed on a video signal,
By providing an acceleration detection circuit, a conversion circuit, and an image motion prediction circuit for predicting the motion of the image ahead of the current field, it is possible to reduce the field memory circuit for storing the video signal, which was conventionally necessary. You can

In addition, when the motion of the image is corrected for the video signal, it is possible to improve the correction accuracy when the motion of the image ahead of the current field is predicted and corrected.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an image motion correction device according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a specific configuration of an image motion prediction circuit 5 in the first embodiment.

FIG. 3 is a block diagram showing a specific configuration of an image motion prediction circuit 5 according to a second embodiment of the present invention.

FIG. 4 is a block diagram showing a specific configuration of an image motion prediction circuit 5 according to a third embodiment of the present invention.

FIG. 5 is an integral vector correction circuit 4 according to the second embodiment.
Explanatory diagram for explaining the operation of c

FIG. 6 is a decimal part error correction circuit 4d in the third embodiment.
Diagram for explaining the operation of

FIG. 7 is a block diagram showing a specific configuration of an image motion prediction circuit 5 according to a fourth embodiment of the present invention.

FIG. 8 is a block diagram showing the configuration of a conventional image motion correction device.

9 is a block diagram showing a specific configuration of an image motion detection circuit 4 in FIG.

[Explanation of symbols]

 1 photoelectric conversion element 2 analog signal processing circuit 3 analog-digital conversion circuit 4 image motion detection circuit 5 image motion prediction circuit 6 photoelectric conversion element control circuit 7 photoelectric conversion element drive circuit 8 acceleration detection circuit 9 conversion circuit 10 digital signal processing circuit 1b Motion vector calculation circuit 2b Prediction calculation circuit 3b Motion vector integration circuit 4c Integration vector correction circuit 4d Fractional part error correction circuit 4b Coefficient calculation circuit 5b, 6b Coefficient circuit

Claims (9)

[Claims] 1. An image motion detection circuit for detecting a motion vector between one field or one frame of an input image from a photoelectric conversion element, and an acceleration detection circuit for detecting acceleration of motion of an image pickup device and outputting acceleration information. A conversion circuit that obtains acceleration conversion information from the acceleration information, and an image motion that predicts a motion vector of an image at the time of the next field or frame at the time when the motion vector is detected from the motion vector and the acceleration conversion information. A prediction circuit and a photoelectric conversion element control circuit that controls a signal read address of the photoelectric conversion element by an image motion prediction vector obtained from the image motion prediction circuit, wherein the image motion prediction circuit is the image motion The motion vector obtained from the detection circuit and the image motion prediction vector predicted one field or one frame before A motion vector calculation circuit for calculating a motion vector between the previous field or previous frame and the current field or current frame from the cutout, and a motion vector obtained from the motion vector calculation circuit and acceleration conversion information obtained by the conversion circuit. An image motion correction device comprising: a prediction calculation circuit that obtains an image motion prediction vector; and a motion vector integration circuit that integrates the image motion prediction vector obtained from the prediction calculation circuit and outputs a prediction integration vector. 2. The image motion correction device according to claim 1, wherein the conversion circuit integrates acceleration information obtained from the acceleration detection circuit within a certain time. 3. The image motion correction device according to claim 1, wherein the conversion circuit adjusts the gain of the acceleration information obtained from the acceleration detection circuit. 4. An image motion prediction circuit is provided between the previous field or previous frame and the current field or current frame based on the motion vector obtained from the image motion detection circuit and the image motion prediction vector predicted one field or one frame before. A motion vector calculation circuit for calculating a motion vector, and a prediction calculation for obtaining an image motion prediction vector using the motion vector up to the current field or current frame obtained from the motion vector calculation circuit and the acceleration conversion information obtained by the conversion circuit A circuit, a motion vector integration circuit that integrates the image motion prediction vector obtained from the prediction calculation circuit, and outputs a prediction integration vector, and the prediction integration vector is corrected by the motion vector obtained from the motion vector calculation circuit. The image motion according to claim 1, comprising an integration vector correction circuit. Correction device. 5. The image motion prediction circuit includes a fractional part error correction circuit that corrects an error included in a motion vector obtained from the image motion detection circuit when a signal is read from a photoelectric conversion element, A motion vector calculation circuit that calculates a motion vector between the previous field or previous frame and the current field or current frame from the motion vector that has passed through the fractional error correction circuit and the image motion prediction vector predicted one field or one frame before; A prediction calculation circuit that obtains an image motion prediction vector using the motion vector obtained from the motion vector calculation circuit and the acceleration conversion information obtained by the conversion circuit, and integrates the image motion prediction vector obtained from the prediction calculation circuit, The image motion correction device according to claim 1, further comprising a motion vector integration circuit that outputs a predicted integration vector. . 6. An image motion detection circuit for detecting a motion vector between one field or one frame of an input image from a photoelectric conversion element, and an acceleration detection circuit for detecting acceleration of motion of an image pickup device and outputting acceleration information. A conversion circuit that obtains acceleration conversion information from the acceleration information, and an image motion that predicts a motion vector of an image at the time of the next field or frame at the time when the motion vector is detected from the motion vector and the acceleration conversion information. A prediction circuit and a photoelectric conversion element control circuit that controls a signal read address of the photoelectric conversion element by an image motion prediction vector obtained from the image motion prediction circuit, wherein the image motion prediction circuit is the image motion The motion vector obtained from the detection circuit and the image motion prediction vector predicted one field or one frame before A motion vector calculation circuit for calculating a motion vector between the previous field or previous frame and the current field or current frame from the cutout, and a motion vector obtained from the motion vector calculation circuit and acceleration conversion information obtained by the conversion circuit. A coefficient circuit for weighting, a prediction operation circuit for obtaining an image motion prediction vector from the output signal of the coefficient circuit, and a weighting coefficient for the coefficient circuit is obtained for the motion vector and the conversion circuit obtained by the motion vector calculation circuit. An image motion correction device comprising a coefficient calculation circuit for calculating from the obtained acceleration conversion information, and a motion vector integration circuit for integrating the image motion prediction vector obtained from the prediction calculation circuit and outputting the integrated value. 7. The coefficient calculation circuit determines a coefficient by using a motion vector obtained by the motion vector calculation circuit within a certain period and an output of the conversion circuit obtained within a time corresponding to the certain period. The image motion correction device according to claim 6. 8. The coefficient calculation circuit is a motion vector of the motion vector of each field or frame obtained by the motion vector calculation circuit and the motion vector of each field or one field of each frame or one frame before Difference and the above 1 field or 1
8. The image motion according to claim 6, wherein the coefficient is determined by at least one ratio of ratios with respective outputs of the conversion circuit obtained within a time corresponding to a time between frames. Correction device. 9. The coefficient calculation circuit is a motion vector of a motion vector of the current field or current frame obtained by the motion vector calculation circuit and a motion vector obtained in the current field or one field of the current frame or one frame before. Difference and the above 1 field or 1
The coefficient for the image motion prediction vector of the next field or the next frame obtained by the prediction calculation circuit is determined by the ratio with the output of the conversion circuit obtained within the time corresponding to the time between frames. Item 6. The image motion correction device according to item 7 or 8.