JPH0946574A - Image motion correction device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize motion correction with high accuracy by securing a prescribed correction field angle independently of a focal distance. SOLUTION: The device is provided with a motion detection means 11 detecting a motion of an image, an optical shake correction means 1 correcting a shake optically based on a detected motion of an image, a storage means 10 storing an image signal, and a means segmenting part of the image from the storage means 10 based on the detected motion of the image, most part of the motion of the image is corrected by the optical shake correction means 1 and the motion eliminated by the means only is eliminated by segmenting the part from the image stored once in the storage means 10.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image motion correction device used for image stabilization of an image pickup device.

[0002]

2. Description of the Related Art As an image motion compensating device of an imaging device,
For example, a method of correcting an image movement by supporting an image pickup unit including an image pickup optical system and a solid-state image pickup element by a gimbal mechanism and controlling the driving of the image pickup unit based on movement information of the image pickup apparatus itself obtained from an angular velocity sensor (" Development of image blur prevention technology for video cameras "Technical Report of the Television Society
Vol.11, No.28, pp19 to 24 (1987)) and a variable apex angle prism at the front of the imaging optical system, which is also driven by information from the angular velocity sensor to correct image movement. Method ("Optical Image Stabilization System" Technical Report of the Television Society of Japan Vol.17, No.5, pp15-20 (1993)) has been proposed.

As another example, a method of detecting image movement from an image signal and cutting out a part of the original image based on the detection result to correct the image movement ("pure electronic image shake"). A correction system "Technical Report of Television Society Vol.15, No.7, pp43-48 (1991)" has been proposed.
In this method, since all the motion correction is performed by signal processing, highly accurate motion correction can be realized.

[0004]

However, in the conventional image motion correction apparatus that optically corrects an image based on the information from the angular velocity sensor, the problem of the sensitivity of the sensor and the drive system of the image pickup unit or the variable value of the image pickup unit are variable. Due to the problem of the response characteristic of the apex angle prism, it is difficult to realize highly accurate motion correction.

Further, in the conventional image motion correction device that corrects the motion of an image by cutting out a part of the image, since the motion correction is entirely performed by signal processing, highly accurate motion correction can be realized. On the other hand, there is a problem that the correction angle of view decreases as the focal length of the imaging lens increases. SUMMARY OF THE INVENTION The present invention solves the above-mentioned conventional problems, and provides an image motion correction device capable of ensuring a substantially constant correction angle of view regardless of the focal length and realizing highly accurate motion correction. To aim.

[0006]

In order to achieve the above object, the present invention provides a motion detecting means for detecting a motion of an image from an image signal, and an image blurring optically based on the detected motion of the image. Or an image pickup system that corrects image shake by driving the image pickup system based on the movement of the image, a storage unit that stores the image signal, and a storage unit that stores the image signal based on the movement of the image detected from the image. Storage means drive control means for cutting out a part of the captured image.

[0007]

With the above-described structure, the image motion correction apparatus of the present invention optically corrects the image shake based on the detected image motion, or drives the image pickup system based on the detected image motion. Most of the movement of the image is corrected by the image pickup system that corrects the shake of the image, and the movement of the image that cannot be removed only by these means is cut out from the image once stored in the storage means. Remove. This ensures a substantially constant correction angle of view regardless of the focal length and realizes highly accurate motion correction.

[0008]

An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram of an image motion correction device according to the first embodiment of the present invention. In the figure, an optical shake correction unit 1 is a unit for optically correcting the movement of an image caused by the shake of the image pickup apparatus. Hereinafter, in the present embodiment, the case where the optical shake correction unit 1 is a variable apex angle prism will be described as an example. Since the details of the variable apex angle prism are disclosed in, for example, Japanese Patent Laid-Open No. 2-13901, detailed description thereof will be omitted.

The drive control means 2 is an optical shake correction means 1.
Is a means for driving and controlling the parallel plane plate of the optical shake correction means 1 with two axes orthogonal to each other in a plane orthogonal to the optical axis of the imaging optical system 4 described later as rotation axes. Drive to rotate. The angle detection means 3 is means for detecting and outputting the actual rotation angle of the plane-parallel plate of the optical shake correction means 1. In the present embodiment, the timing of angle detection is set to approximately the center of the image pickup period by the solid-state image pickup device 6.

The image pickup optical system 4 is a lens system of the image pickup apparatus, and the image pickup optical system drive control means 5 is means for driving and controlling the image pickup optical system 4 to perform an optical zoom operation and a focusing operation. Outputs information about focal length. The solid-state image pickup device 6 is an image pickup device that converts an image incident through the optical shake correction unit 1 and the image pickup optical system 4 into an electric signal, and the analog signal processing unit 7 is a gamma for the image signal obtained by the solid-state image pickup device 6. The means for performing analog signal processing such as processing, and the analog / digital conversion means 8 are means for converting an analog signal into a digital signal. analog/
The image signal converted into a digital signal by the digital conversion means 8 is subjected to digital signal processing such as noise removal and contour enhancement by the digital signal processing means 9, and is temporarily stored in the image memory 10 as a storage means.

The image signal converted into a digital signal by the analog / digital converting means 8 is also sent to the motion detecting means 11 at the same time, where a vector indicating the amount of positional displacement of the image between fields (hereinafter, referred to as a vector). The detection vector) is detected for each field. The motion detecting means 11 is a known means, and is described in, for example, the above-mentioned known literature ("Pure electronic image shake correction system", Television Society Technical Report Vol.15, No.7, pp43-48 (1991)). Since it is disclosed, details of its configuration, operation, etc. are omitted.

The system control means 12 is the motion detection means 1
1. Based on the information from the image pickup optical system drive control means 5 and the angle detection means 3, the information (drive signal) necessary for image movement correction is calculated, and this is calculated as the drive control means 2 and the image memory drive control means 13. Send to. The drive control means 2 drives the optical shake correction means 1 based on the information obtained from the system control means 12. Further, the image memory drive control means 13
Controls the reading of the image signal from the image memory 10 based on the information obtained from the system control means 12, reads a part of the image signal stored in the image memory 10, and outputs it.

Finally, the solid-state image sensor drive control means 14 is means for driving and controlling the solid-state image sensor 6.
FIG. 2 is a block diagram of an internal configuration example of the system control means 12. The integration means 121 is means for integrating the detection vector obtained by the motion detection means 11 for each field, and the integration result is sent to the image memory drive control means 13. The prediction error calculation unit 122 calculates the prediction error value included in the motion prediction result performed by the prediction unit 125 (described later) one field before from the detection vector obtained by the motion detection unit 11 and the output of the conversion unit 123 (described below). The motion vector calculation means 124 calculates the motion correction effect of the optical shake correction means 1 based on the output of the prediction error calculation means 122 and the output of the prediction means 125 one field before obtained from the one-field period delay device 126. In the case where there is no such a case, a means for calculating a positional shift amount of an image between fields (hereinafter, referred to as an actual motion vector) caused by a motion of the image pickup apparatus, and a prediction means 125 is a motion vector calculation means 12.
A means for predicting how much the image position shift will occur one field after the actual motion vector obtained in 4 (hereinafter,
The predicted value of this positional deviation amount is referred to as a prediction vector), and the drive angle calculation means 127 uses the prediction vector obtained by the prediction means 125 and the focal length of the imaging optical system 4 obtained from the imaging optical system drive control means 5. A means for converting the target value of the drive angle of the plane-parallel plate of the optical shake correction means 1 required for the shake correction to the drive control means 2 and the conversion means 1.
Reference numeral 23 denotes a target value of the drive angle of the plane parallel plate of the optical shake correction unit 1 obtained by the drive angle calculation unit 127 from the outputs of the angle detection unit 3, the imaging optical system drive control unit 5, and the drive angle calculation unit 127. It is a means for obtaining a difference from the actually driven angle and converting this to the amount of movement of the image (for example, the number of pixels) on the solid-state image sensor 6.

FIG. 3 is a block diagram showing a concrete example of the structure of the prediction means 125. In the figure, the delay means 12
501 is a delay device that delays a signal, and the delay time is
One field of a television signal, that is, 1/60 second in the NTSC system. The multiplication means 12502 is a multiplier, and in this embodiment, the input is multiplied by 2.
The multiplication means 12503 is a multiplier, and in this embodiment, the input is multiplied by -1. The adder 12504 adds the output of the multiplication means 12502 and the output of the multiplication means 12503 and outputs the result.

FIG. 4 is a block diagram showing another concrete structure of the predicting means 125. In the figure, delay means 1
Both 2505 and the delay means 12506 are delay devices for delaying the signal, and the delay time is one field of the television signal, that is, 1/60 second in the NTSC system. The multiplication means 12507 is a multiplier, and in this embodiment, the input is multiplied by 3. The multiplication means 12508 is a multiplier, and in this embodiment, the input is multiplied by -3. The multiplying means 12509 is a multiplier, and in this embodiment, the input is multiplied by 1. The adder 12510 adds the inputs from the multiplication means 12507 and the multiplication means 12508 and outputs the result. The adder 12511 adds the inputs from the multiplication means 12509 and the adder 12510 and outputs the result.

The operation of the image motion correction device of this embodiment having the above-described structure will be described below. In addition,
A series of operations such as motion detection from the image signal, motion prediction, and drive control of the optical shake correction means 1 are performed in both horizontal and vertical directions, but since the contents are the same in both horizontal and vertical directions, In order to simplify the description below, the description will be made without distinguishing between the horizontal and vertical directions.

The image signal obtained by the solid-state image pickup device 6 is converted into a digital signal by the analog / digital converting means 8 through the analog signal processing means 7, and is sent to the digital signal processing means 9 and the motion detecting means 11. The digital signal processing means 9 performs digital signal processing such as noise removal and contour enhancement, and then the image signal is stored in the image memory 10.
Is stored once. Further, the motion detecting means 11 detects the amount of positional deviation (detection vector) of the image between the fields and sends this to the system controlling means 12.

In the system control means 12, the detection vector obtained by the motion detection means 11 and the imaging optical system drive control means 5
From the focal length information of the imaging optical system 4 sent from the device and the actual rotation angle of the plane-parallel plate of the optical shake correcting means 1 detected by the angle detecting means 3, the target value of the drive angle of the optical shake correcting means 1 To calculate. Similarly, the system control means 12 calculates, based on the detection vector obtained by the motion detection means 11, information regarding a cutout position when a part of the image signal is cut out from the image memory 10 for image motion correction.

The specific operation of the system control means 12 will be described below. The detection vector obtained by the motion detecting means 11 is first sent to the integrating means 121 and the prediction error calculating means 122. Here, if the prediction of the motion by the prediction unit 125, which will be described later, is perfectly correct, and the drive of the optical shake correction unit 1 based on the predicted value is completely performed without delay or the like, the image motion Should be completely removed by the optical shake correction means 1, and the amount of positional deviation of the image between the fields detected by the motion detection means 11 should be zero. However, in reality, an error is unavoidable in the prediction, and there is a limit to the frequency response characteristic of the optical shake correction means 1 and the like. Therefore, the output (detection vector) of the motion detection unit 11 always includes a prediction error and a motion correction error (motion correction omission) caused by a problem in the operational characteristics of the optical shake correction unit 1. Therefore, the prediction error calculation means 122
Then, of these errors included in the detection vector, the error of the motion correction caused by the problem in the operation characteristic of the optical shake correction unit 1 or the like is removed. Specifically, the conversion means 123
, The target value of the drive angle of the parallel plane plate of the optical shake correction means 1 obtained by the drive angle calculation means 127 described later and the parallel plane plate of the optical shake correction means 1 detected by the angle detection means 3. The difference from the actual rotation angle is obtained, and the number of pixels on the solid-state image pickup device 6 corresponding to this angle difference is calculated from the focal length information of the image pickup optical system 4 sent from the image pickup optical system drive control means 5. The result of this calculation is an error in the motion correction caused by a problem in the operation characteristics of the optical shake correction unit 1 included in the detection vector. The means for removing this error component from the detection vector is the prediction error calculation means 12
2.

The prediction error calculated by the prediction error calculation means 122 is a prediction error included in the prediction vector predicted by the prediction means 125 one field before. Therefore, the above prediction error is removed from the prediction vector one field before. Thus, the amount of positional deviation (actual motion vector) of the image between the fields, which is caused purely by the movement of the image pickup apparatus when there is no movement correction by the optical shake correction unit 1, is obtained.
The means for calculating the actual motion vector in this current field is the motion vector calculating means 124.

Next, the predicting means 125 for obtaining the predictive vector from the actual motion vector will be described. Originally, when correcting the movement of an image, it is necessary to detect the movement prior to the correction. However, in the present embodiment, although the motion correction by the optical shake correction means 1 needs to be performed before or substantially at the same time as the image pickup by the solid-state image sensor 6, the motion detection can be performed only after the image pickup by the solid-state image sensor 6. . That is, it is impossible to detect motion before motion correction. Therefore, in this embodiment, the motion of the image one field ahead is predicted by the prediction unit 125, and the motion correction is performed by the optical shake correction unit 1 based on this predicted value, so that the motion correction can be performed before the motion detection. I am trying. Hereinafter, a method of obtaining the prediction vector from the actual motion vector by the prediction means 125 will be described.

Regarding the method of predicting the motion of the image in the predicting means 125, for example, the predicting means 125 may have the configuration shown in FIG. This is obtained by multiplying 2 by the multiplying means 12502 and the delay means 12501 and then multiplying means 1
An input obtained by multiplying -1 by 2503 is added by an adder 12504, and this is used as a predicted value of the movement amount. The operation of the prediction means 125 according to this configuration will be further described with reference to FIG. 5. In FIG. 5, the actual motion vector of each field input to the prediction means 125 is i (n) (n is a field number), and When the field is the nth field, for example, if the input i (n) of the current field is 2 and the input i (n-1) of the previous field is 1, the prediction unit 1
The output o (n) of 25 is 3. This means that the change of the image motion between fields can be approximated by a linear function, and the input is extrapolated by a linear function.

The multiplication means 12502 has the same configuration.
There may be a configuration in which the multiplication value of 1 is set to 1 instead of 2 and the multiplication value of the multiplication means 12503 is set to 0 instead of -1. In this case, as shown in FIG. 6, the same as the input (i (n)). The value becomes the output (o (n)). This configuration is the multiplication means 125.
Needless to say, it is equivalent to the configuration in which 02 and 12503 are deleted.

As another configuration, the prediction unit 125 may have the configuration shown in FIG. 4, in which case the input signal multiplied by 3 in the multiplication unit 12507 and the delay unit 1250.
The input signal multiplied by -3 by the multiplication means 12508 via 5 and added by the adder 12510, and the delay means 125
05 and delay means 12506 and then multiplication means 12509
The input signal multiplied by 1 is added by the adder 12511, and this is used as the predicted value of the motion of the image. The operation of the prediction means 125 according to this configuration will be further described with reference to FIG. 7. In the figure, the actual motion vector of each field input to the prediction means 125 is i (n) (n is a field number), and the current When the field is the nth field, for example,
Current field input i (n) = 4, 1 field previous input i (n-1) = 2, 2 field previous input i (n-
2) = 1, the output o (n) of the prediction means 125 is
It becomes 7. This means that, assuming that the change in the image motion between fields can be approximated by a quadratic function, the input is extrapolated by a quadratic function.

The prediction vector obtained by the prediction means 125 is
Since it is the amount of positional deviation on the image picked up by the solid-state image sensor 6, the target value of the drive angle of the plane parallel plate of the optical shake correction means 1 required to correct this amount of positional deviation is obtained next. There is a need. The target value of the drive angle is calculated by the drive angle calculation means 127 from the prediction vector obtained by the prediction means 125 and the focal length information of the image pickup optical system 4 obtained from the image pickup optical system drive control means 5, and the result is also calculated. In addition, the drive control means 2 drives and controls the optical shake correction means 1,
That is, the plane-parallel plate of the optical shake correction unit 1 is rotationally driven to correct the movement of the image. Further, the drive angle calculation means 12
The target value of the drive angle of the plane-parallel plate of the optical shake correction means 1 obtained in 7 is also sent to the conversion means 123, and as described above, the difference between this target value and the actually driven angle is calculated. Desired.

The image motion correction by the drive control of the optical shake correction means 1 is as described above in detail. Next, correction of image movement that cannot be removed only by the optical shake correction unit 1 will be described. As described above, the prediction means 12 is provisionally used.
If the motion prediction by 5 is perfectly correct, and the drive of the optical shake correction means 1 based on the predicted value is completely performed without delay or the like, the motion of the image is determined by the optical shake correction means 1. Completely removed. However, in practice, it is inevitable that an error will occur in the prediction, and the frequency response characteristics of the optical shake correction means 1 and the like are also limited. Therefore, although most of the movement of the image can be removed by the optical shake correction unit 1, the image picked up by the solid-state image pickup device 6 always has a prediction error and a problem in operating characteristics of the optical shake correction unit 1. The motion remains due to a motion correction error (motion correction omission) caused by. The means for correcting this residual movement is the integration means 121, the image memory 10, and the image memory drive control means 13. The operation will be described below.

The positional shift amount (detection vector) between the fields of the image detected by the motion detection means 11 is a relative motion of the image between the fields. Therefore, in order to convert this relative movement into an absolute amount of movement from a fixed point on the image picked up by the solid-state image pickup device 6, integration means 121 performs integration processing. Then, based on the result of this integration, the image memory drive control means 13 determines the image cutout position for motion correction, and actually cuts out the image signal from the image memory 10. As a result, the image signal read from the image memory 10 has the motion completely removed. Regarding the contents of correcting the motion of the image by cutting out the image from the image memory based on the integration result of the detection vector as described above, the above-mentioned known document ("Pure electronic image shake correction system", Television Society Technology) Report Vol.
15, No.7, pp43-48 (1991)), and therefore detailed description thereof will be omitted.

As described above, in this embodiment, by providing the means for optically correcting the movement of the image such as the optical shake correcting means 1, a substantially constant correction angle of view is secured regardless of the focal length. In addition, by compensating the image from the image memory based on the motion detection result, the motion of the remaining image that cannot be removed only by the optical shake correction means is corrected,
Highly accurate motion compensation can be realized for the entire system.

FIG. 8 is a block diagram of an image motion correction apparatus according to the second embodiment of the present invention. The configuration of the second embodiment of the present invention differs from the configuration of the first embodiment shown in FIG. 1 in the following points. First, the optical shake correction means 1 existing in the first embodiment is deleted, and instead, the image pickup optical system 4 and the solid-state image pickup element 6 are made movable with respect to the body of the image pickup apparatus, and this is set in the image pickup system. 21. Secondly, an image pickup system drive control means 22 is provided instead of the drive control means 2. Thirdly, instead of the angle detection means 3, the imaging system angle detection means 2
3 is provided.

The above points differ from the first embodiment. Less than,
In the description of the present embodiment, the same parts as those in the first embodiment are designated by the same reference numerals as those of the components in FIG. I will explain. A series of operations such as motion detection from the image signal, motion prediction, and drive control of the imaging system 21 are performed in both horizontal and vertical directions. However, since the contents are the same in both horizontal and vertical directions, In order to simplify the description, the description will be made without distinguishing between the horizontal and vertical directions.

The image pickup optical system 4 and the solid-state image pickup device 6 are rotatably installed in the pitching direction and the yawing direction with respect to the body of the image pickup apparatus (these are combined together to make an image pickup system 2).
1). The image pickup system drive control means 22 is an actuator that drives the image pickup system 21 about two rotation axes to correct the movement of the image, and the image pickup system angle detection means 23 is the image pickup system 21 actually used by the image pickup system drive control means 22. It is a means for detecting the angle driven by. In the present embodiment, the timing of angle detection is set to approximately the center of the image pickup period by the solid-state image pickup device 6. As described above, with respect to the means for rotatably supporting and driving the image pickup system 21 with respect to the body of the image pickup apparatus, there are known documents ("Development of technology for preventing image blur of video cameras", Television Society Technical Report Vol. 11, No. .28, pp19
24 (1987)), the detailed description is omitted.

In this embodiment, as in the first embodiment, the system control means 12 detects the detection vector detected by the motion detection means 11 and the image pickup optical system drive control means 5.
From the focal length information of the image pickup optical system 4 obtained from the above and the angle at which the image pickup system 21 detected by the image pickup system angle detection means 23 is actually driven, the target of the drive angle of the image pickup system 21 necessary for the motion correction. Value is required. Then, based on the target value of this drive angle, the imaging system drive control means 22 causes the imaging system 2
Driving 1 corrects the motion of the image. As for the movement of the image that cannot be removed by this series of operations, it is removed by clipping the image from the image memory means 10 as in the first embodiment.

As described above, in the present embodiment, the image pickup optical system 4 and the solid-state image pickup device 6 are made movable with respect to the body of the image pickup apparatus, so that the focal length is the same as in the first embodiment. By securing a substantially constant correction angle of view and providing a means for cutting out an image from the image memory based on the result of motion detection, the motion of the remaining image that cannot be removed only by the drive control of the imaging system 21 is corrected, and the entire system is corrected. Highly accurate motion compensation can be realized.

Although the final image signal output is the image signal read from the image memory 10 in the first and second embodiments, the present invention is not limited to this. For example, the image signal read from the image memory 10 is not limited to this. It is also conceivable to provide an interpolating means for performing an interpolating process on the. In this case, the motion correction accuracy of one pixel or less than one line can be realized by performing interpolation processing on the image signal read from the image memory 10 by the interpolation means based on the result of the integration processing of the detection vector by the integration means 121. Regarding the interpolation means for performing the interpolation processing on the image signal, for example, Japanese Patent Application No. 6-2612.
Since it is disclosed in Japanese Patent No. 39, the detailed description will be omitted.

Further, in the above first and second embodiments,
The size of the image read out for the motion correction from the image memory 10 is not particularly limited. For example, an image having the number of horizontal pixels and the number of vertical lines matching the broadcasting system or less is read out, and the enlargement process is performed by the interpolation means. Configuration,
It is also conceivable that the image memory 10 stores image signals having the number of horizontal pixels and the number of vertical lines that match the broadcasting system, and then reads out the image of the number of horizontal pixels and the number of vertical lines that matches the broadcasting system.

Further, in the above first and second embodiments,
Although three examples have been shown as the configuration of the prediction unit 125, the present invention is not limited to this, and a method of predicting a motion by a higher-order filter configuration may be considered, for example. Also,
In the first and second embodiments, among the three examples shown as the configuration of the prediction means 125, only one of them is not used, but these three are adaptively switched to predict the motion. Can also be considered. Further, in the configuration of the prediction means 125 shown in FIG. 4, the multiplication means 12507, 12508, 1
A configuration is also conceivable in which the multiplication value of 2509 is adaptively switched to predict motion.

Further, in the above first and second embodiments,
As for the broadcasting system, the NTSC system was assumed, but NT
It is obvious that the present invention is effective in an image pickup apparatus which adopts any broadcasting system such as SC, PAL, SECAM and the like. Further, in the first embodiment described above, the optical shake correction means 1 is explained as a variable apex angle prism, but the invention is not limited to this. It is obvious that any means for realizing the correction (for example, the means disclosed in Japanese Patent Application No. 63-201622) can be used as the optical shake correction means 1.

In the first and second embodiments,
Although the motion detection by the motion detection means 11 is described as being performed for each field, the present invention is not limited to this. For example, in a field in which motion detection is performed once in two fields and motion detection is not performed, it is obtained in the previous field. As shown in the embodiment, it is possible to predict the motion of the image and correct the motion of the image based on the motion detection result.

Further, in the above first and second embodiments,
It goes without saying that the system control means 12 can be realized by an electronic circuit or software processing on a microcomputer. In addition, the first,
In the second embodiment, the system control means 12 has been described as the same, but the relationship between the drive angle of the optical shake correction means 1 and the distance by which the captured image moves on the solid-state image sensor 6, and the imaging system. Since the relationship between the drive angle of 21 and the distance by which the captured image moves on the solid-state image sensor 6 varies depending on the design specifications of the optical shake correction means 1 and the image pickup system 21, the conversion means 123 in the system control means 12, In the drive angle calculation means 127, information regarding the drive angles of the optical shake correction means 1 and the image pickup system 21 is provided to the solid-state image pickup device 6.
It is obvious that the conversion rate for converting the information about the distance that the captured image moves or vice versa may be different between the first embodiment and the second embodiment.

Further, in the above first and second embodiments,
The conversion means 123 and the drive angle calculation means 127 in the system control means 12 convert the information on the drive angles of the optical shake correction means 1 and the imaging system 21 into information on the distance that the captured image moves on the solid-state image sensor 6. When the reverse conversion is performed, the information about the focal length of the image pickup optical system 4 obtained by the image pickup optical system drive control means 5 is used, but the present invention is not limited to this. For example, the distance measurement using infrared rays or the like. It is also conceivable that the means measures the distance between the imaging device and the subject and uses this distance information instead of the focal length information.

Further, in the above-mentioned embodiment, although the solid-state image pickup device of the image pickup device is not particularly mentioned, the present invention can be applied to any one of the single-plate type image pickup device, the two-plate type image pickup device and the three-plate type image pickup device. It is clear that it is effective. Further, it is clear that the present invention is similarly effective in an image pickup apparatus using an image pickup tube instead of the solid-state image pickup element.

In the second embodiment, the image pickup system is rotatably installed with respect to the housing of the image pickup apparatus, but the present invention is not limited to this. For example, a mechanism that can move linearly May be used. Although various proposals have been made as mechanical mechanisms for supporting and driving the image pickup system 21, it goes without saying that the present embodiment is effective in any method.

Further, in the above first and second embodiments,
The motion detecting means 11 uses an example of a known document, but the invention is not limited to this. As for means for detecting the amount of positional deviation of the image from the image signal, for example, the contour portion of the subject is detected and the image is calculated based on the amount of movement thereof. Various kinds of proposals have been made such as a method of detecting the amount of positional deviation of the object, a method of detecting the amount of positional deviation of the image from the amount of movement of the center of gravity of the subject, and this embodiment is effective even if any of these methods is used. Needless to say.

[0044]

As described above in detail, the image motion correction apparatus of the present invention is based on the means for optically correcting the shake of the image based on the detected motion of the image, or on the basis of the detected motion of the image. Most of the movement of the image is corrected by the image pickup system which is a means for correcting the shake of the image by driving the image pickup system, and the movement of the image which cannot be removed only by these means is temporarily stored in the storage means. It is removed by cutting out a part of the image. As a result, a substantially constant correction angle of view can be secured regardless of the focal length, and highly accurate motion correction can be realized.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an image motion correction device according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of system control means of the image motion correction apparatus.

FIG. 3 is a block diagram showing a specific configuration of a prediction unit of the system control unit.

FIG. 4 is a block diagram showing another specific configuration of the prediction means.

FIG. 5 is a schematic diagram for explaining the effect of the prediction means shown in FIG.

FIG. 6 is a schematic diagram for explaining the effect of the prediction means.

FIG. 7 is a schematic diagram for explaining the effect of the prediction means shown in FIG.

FIG. 8 is a block diagram showing a configuration of an image motion correction device according to a second embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Optical shake correction means 2 Drive control means 3 Angle detection means 4 Imaging optical system 5 Imaging optical system drive control means 6 Solid-state imaging device 7 Analog signal processing means 8 Analog / digital conversion means 9 Digital signal processing means 10 Image memory 11 Motion Detection means 12 System control means 13 Image memory drive control means 14 Solid-state image sensor drive control means

Claims (7)

[Claims] 1. An image pickup system comprising an optical shake correction means for correcting shake of a picked-up image, an image pickup optical system, and a solid-state image pickup device, and motion detection for detecting a movement of an image from an image signal obtained from the image pickup system. Means, storage means for storing image signals obtained from the image pickup system, and drive control means for drive-controlling the optical shake correction means by drive signals calculated based on the motion detection result by the motion detection means. And storage means drive control means for driving the storage means and controlling the reading of the image signal by another drive signal calculated based on the motion detection result by the motion detection means,
An image motion correction device, wherein the image signal read from the storage means is used as an output signal. 2. An image pickup optical system and a solid-state image pickup device are provided,
Further, an image pickup system movably supported with respect to the body of the image pickup apparatus, a motion detection means for detecting a movement of an image from an image signal obtained from the image pickup system, and an image signal obtained from the image pickup system are stored. By the storage means and the drive signal calculated based on the motion detection result by the motion detection means,
Drive control means for driving and controlling the image pickup system, and storage means drive control means for driving the storage means and controlling reading of image signals by another drive signal calculated based on the motion detection result by the motion detection means. And an image signal read from the storage means as an output signal. 3. The image motion correction device according to claim 1, wherein the optical shake correction unit is a variable apex angle prism. 4. The image motion correction device according to claim 1, wherein the optical shake correction unit deviates the optical axis of the image pickup optical system by being driven relative to the image pickup optical system. . 5. The optical shake correction means is composed of one or more lenses that decenter the optical axis of the imaging optical system by being individually driven in a direction orthogonal to the optical axis. The image motion correction device according to any one of 1, 3, or 4. 6. The image pickup system is rotationally driven about two axes orthogonal to the optical axis of the image pickup optical system.
The image motion correction device described. 7. The image motion correction device according to claim 1, further comprising an interpolating unit that interpolates an image signal read from the storage unit.