JPH02195780A - Motion corrected image pickup device - Google Patents

Abstract

PURPOSE:To obtain a picture signal without generating shaking by providing a motion correction circuit which corrects the output signal of a motion detection sensor circuit based on a zoom ratio signal obtained from a zoom position detection circuit and corrects control by a memory control circuit by an obtained motion correction signal. CONSTITUTION:A zoom mechanism 11 is set at a prescribed quantity of zoom by a zoom driving circuit 12, and the zooming position of the mechanism is detected by the zoom position detection circuit 13. Also, the amount of movement is detected from the motion detection sensor circuit 17, and the amount of movement is corrected by the output signal of the zoom position detection circuit 13, and a motion correction circuit 20 changes a readout address from a memory circuit 18 based on the above data by controlling a memory control circuit 19, and a video signal from which a shaking component is removed can be obtained. In other words, the circuit 20 obtains the amount of movement on the memory circuit 18 by using the output signals of the motion detection sensor circuit 17 and the zoom position detection circuit 13, and takes out a signal in which no shaking is generated and motion is corrected from the memory circuit 18 by controlling the memory control circuit 19.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of the Invention The present invention relates to a motion compensated imaging device that performs camera shake compensation.

2. Description of the Related Art Conventional motion compensation imaging devices include, for example, Japanese Patent Application Laid-open No.
There is one shown in Japanese Patent No.-143330.

FIG. 8 shows a block diagram of a conventional motion-compensated m-image device.
In FIG. 8, 81 is a lens, 82 is an image sensor, 83
84 is a drive control circuit that controls the drive circuit 83, 85 is a signal processing circuit including an image memory, and 86 is a lens 81. A motion detection circuit 87 detects sudden movement of the image sensor 82, and a motion compensation control circuit 87 receives a signal from the motion detection circuit 86 and performs motion compensation control.

In the conventional motion-compensated imaging device configured as described above, the motion detection circuit 86 detects the motion of the lens 81 and the image sensor 82, and the motion compensation control circuit 87 detects the motion of the signal processing circuit 85.
control to obtain a motion-corrected video signal without blur.

The operation of the signal processing circuit 85 at this time will be explained with reference to FIG. In FIG. 9, the total memory area indicated by the real root is the area of the image memory in the signal processing circuit 85 in the vertical direction VO x horizontal direction HQ, and this corresponds to the photoelectric conversion area of the image sensor 82. Further, the memory area read out as a video signal is, for example, a motion compensation memory area I (VlxHl
) or motion compensation memory area II (V2 XH2)
There are cases where In this way, motion components caused by camera shake are corrected by changing the read address from the memory, thereby obtaining a blur-free video signal.

Problems to be Solved by the Invention However, in the above configuration, in order to perform motion compensation, the imaging signal is once loaded into the memory, and then the motion compensation control circuit performs memory readout control using the signal from the motion detection circuit. We are obtaining a motion-compensated video signal, but if the lens is composed of a zoom lens and the motion detection circuit is composed of a sensor, the problem is that the actual amount of blur varies depending on the zoom amount even if the sensor output value is the same. It had

The present invention solves this problem, and aims to provide a motion-compensated imaging device that can satisfactorily perform motion compensation even when an imaging device with a zoom function is used.

Means for Solving the Problems In order to solve the above problems, the present invention provides an optical section including a zoom lens, a zoom position detection circuit that detects a zoom ratio from a zoom position signal obtained from the optical section, and an image sensor. , a driving circuit for the image sensor; a motion detection sensor circuit that detects movement of the optical section and the image sensor; a memory circuit to which signals from the image sensor are applied and which has a capacity of at least l fields; A memory control circuit that changes the read address of the circuit, and a zoom ratio signal obtained from the zoom position detection circuit, corrects the output signal of the motion detection sensor circuit, and uses the obtained motion correction signal to correct the output signal of the motion detection sensor circuit. It is equipped with a motion correction circuit that corrects control.

Furthermore, the present invention includes a signal processing motion detection circuit that detects motion of the optical section and the image sensor based on a change in image data at a specific representative point in the memory circuit, The motion amount obtained by correcting the output signal of the motion detection sensor circuit based on the zoom ratio signal obtained from the circuit is compared with the output of the signal processing motion detection circuit, and a motion correction amount is obtained by selecting one of these. This is what I did.

Further, the present invention includes an optical section that forms an image of light from a subject;
an image sensor, a drive circuit for the image sensor, a motion detection sensor circuit that detects movement of the optical section and the image sensor;
a memory circuit that is supplied with a signal from the image sensor and has a capacity of at least 61 fields; a memory control circuit that changes a readout address of the memory circuit in response to a motion signal; and an electronic zoom that changes a readout area of the memory control circuit. The apparatus includes a control circuit, and a motion correction circuit that uses a motion signal from the motion detection sensor circuit to correct control by the memory control circuit based on a readout area changed by the electronic zoom control circuit.

Effect With the above configuration, the image signal obtained from the optical section and the image sensor is held in the memory circuit, and the signal from the motion detection sensor circuit is corrected based on the zoom position signal obtained from the zoom position detection circuit. The motion compensation signal is given to the memory control circuit, and the memory control circuit changes the read address using this motion compensation signal, so even when a zoom mechanism is used, motion compensation can be performed accurately regardless of its zoom ratio. Can be done.

Furthermore, a signal processing motion detection circuit that detects motion by signal processing is used to detect the motion based on changes in image data at a specific representative point in the memory, and the output signal of this signal processing motion detection circuit and the motion detection sensor By comparing the output of the circuit with a motion compensation signal corrected based on the zoom ratio and selecting these signals to obtain a motion compensation amount, more accurate motion compensation can be performed.

Further, even when an electronic zoom is used instead of the zoom mechanism, a similar motion correction can be performed using the zoom ratio obtained from the electronic zoom control circuit, and an image signal without blur can be obtained.

Example An embodiment of the present invention will be described below based on the drawings.

FIG. 1 shows a block diagram of a motion compensation imaging device according to a first embodiment of the present invention. In FIG. 1, 11 is a zoom mechanism that is an optical section including a zoom lens, 12 is a zoom drive circuit, and 13 is a zoom A zoom position detection circuit that detects the zoom position of the mechanism 11, 14 an image sensor, 15 an element drive circuit for the image sensor, 16 an element drive control circuit that controls the element drive circuit 15, 17 the zoom mechanism 11, and the image sensor 14.
18 is a memory circuit, 19 is a memory control circuit that changes the read address from the memory circuit 18, and 20 is a motion detection sensor circuit that detects movement in the X direction and Y direction of the zoom position detection circuit. A motion correction circuit 31 corrects the motion signal of the detection sensor circuit 17 and corrects the control by the memory control circuit 19, and 31 is a signal processing circuit.

The operation of the motion correction Ji device of the first embodiment configured as described above will be described below. The zoom mechanism 11 is set to a predetermined zoom amount by the zoom drive circuit 12, and the zoom position is detected by the zoom position detection circuit 13. Further, the amount of movement is detected from the movement detection sensor circuit 17, this amount of movement is corrected by the output signal of the zoom position detection circuit 13, and based on the data, the movement correction circuit 20 controls the memory control circuit 19 to control the memory control circuit 19. By changing the readout address from 18, a video signal with blurred components removed can be obtained.

Next, the operation of the motion correction circuit 20 will be explained.

FIG. 2 is a diagram illustrating the operation of the memory circuit of the first embodiment. In FIG. 2, the size of the entire memory area AO is (Vo XHo), which corresponds to the photoelectric conversion area of the image sensor 14. Furthermore, the memory area that is read out as a video signal during motion compensation control is, for example, motion compensation memory area (I) A1 size (VIXHl) or motion compensation memory area (I [) A2 size (V2 XH2)
) na totiaro.

These A1 and A2 areas are smaller than the entire memory area AO, and thus motion components caused by camera shake are corrected in the memory area.

However, if the zoom amount is changed during motion compensation control and the zoom amount when shooting motion compensation area (I) A1 and motion compensation area (II) A2 is different, for example, when changing from position E to WIDE, the subject in area A1 A case may occur in which the area coincides with the AL2 area which is a part of the A2 area, and the amount of movement from the motion detection sensor circuit 17 and the amount of movement on the memory circuit 18 are different.

Therefore, the motion compensation circuit 20 uses the output signals of the motion detection sensor circuit 17 and the zoom position detection circuit 13 to obtain the amount of motion on the memory circuit 18, and controls the memory control circuit 19 to remove the blur from the memory circuit 18. Retrieve the signal without motion compensation.

At this time, the motion compensation data of the motion compensation circuit 20 is obtained by inputting motion amount data from the motion detection sensor circuit 17 to a variable amplification factor amplification circuit, and using the zoom position data as a signal to control the variable amplification factor amplification circuit. The zoom amount data from the detection circuit 13 is used.

Using x11 times the zoom amount data as a reference signal, the gain at this time is set to 1 times. Also, when the signal is x22 times, that is, from WIDE to H, the gain is doubled, and when it is x33 times, the gain is tripled. In this way, the motion amount data is corrected with the zoom amount data to obtain motion correction data.

As described above, according to the first embodiment, the zoom amount is determined by obtaining motion correction data from the motion amount data due to shake from the motion detection sensor circuit 17 and the zoom amount data from the zoom position detection circuit 13. Even when shooting with changes,
Good images without blur can be obtained.

FIG. 3 is a block diagram of a motion compensation imaging device showing a second embodiment of the present invention. In FIG. 3, blocks 31 to 41 are the same as blocks 11 to 21 in the first embodiment, and the difference is that the signal processing motion detection circuit 4
2. This signal processing motion detection circuit 42
Similar to the motion detection sensor circuit 37, the motion detection sensor circuit 37 detects the motion of the zoom mechanism 31 and the image sensor 34 from image information to obtain motion vectors in the x and y directions. This is, for example, a "screen shake correction device" (Television Society Technical Report Showa 6)
(Announced on May 28, 2017) and other documents. Further, as will be described later, the motion correction circuit 40 obtains a more accurate amount of motion based on signals from both the motion detection sensor circuit 37 and the signal processing motion detection circuit 42, and when the zoom ratio changes, the motion compensation circuit 40 detects motion. The output of the sensor circuit 37 is converted into an amount of movement that varies depending on the zoom ratio, and the amount of movement is corrected based on this signal and the output of the signal processing motion detection circuit 42, and then provided to the memory control circuit 69.

The following description focuses on the differences from the first embodiment.

FIG. 4 shows a configuration example of the signal processing motion detection circuit 42 in FIG. 3, and FIG. 5 is an explanatory diagram of input signals to the signal processing motion detection circuit 42. In Figures 4 and 5, 5
1 is the representative point (R, , R12, R, ,
), 52 is an arithmetic circuit that calculates the difference between the current input signal (311, SI2...) and the representative point signal a certain time ago, and 53 is a memory circuit for storing the arithmetic results. 54 is a motion amount calculation circuit that obtains the amount of motion from the output of the detection memory circuit 53.
Let Δx, yJ be the absolute value of the difference between signal S, □, j◆1, which is located at a distance of X in the horizontal direction and y in the vertical direction.

This difference is added for x and y that have the same positional relationship for each representative point. shall be.

D (F"Σ1 jA

The operation of the second embodiment configured in this manner will be described below. In the second embodiment, the amount of motion data can be obtained from the three motion detection sensor circuits (data E) and from the signal processing motion detection circuit 312 (data ■).

Therefore, the motion correction circuit 40 uses both data to obtain a more accurate motion amount. For example, (a) compare both data and use (data ■) when both data exist within a certain range, (b) obtain the direction from (data I), and use <data ■) to For example, only the amount of motion of the direction component is obtained from calculation.

However, when the zoom amount of the zoom mechanism 31 changes during this motion correction control, the (data I) from the motion detection sensor circuit 37 differs from the amount of motion on the memory circuit, as in the first embodiment. Therefore, the motion correction circuit 40 obtains zoom amount data from the zoom position detection circuit 33, and when the zoom amount changes, uses the zoom amount data to correct (data I), and from this corrected signal and (data ■). The motion correction data is obtained, and the memory control circuit 39 is controlled to take out a motion-corrected signal without blur from the memory circuit.

Next, a method of obtaining motion correction data from a signal obtained by correcting (data I) using zoom amount data and (data ■) will be described. Motion amount detection devices using signal processing methods tend to produce errors in motion detection in the case of special subject images. Therefore, the reliability of the motion detection data is evaluated by signal processing, for example, the distribution of the minimum value, the minimum value and the second Judging from the distribution with the small value of or the ratio between the minimum value and the average value,
When the reliability is below a certain reference value, the motion correction data is obtained from the signal corrected using the zoom amount data (data E) without using the signal processing method (data ■).
If the value exceeds the standard value, use the zoom amount data (data ■
) is obtained from the corrected signal and (data ■), the memory control circuit 39 is controlled, and the memory circuit 38
Extract motion-compensated signals without blur.

As described above, according to the second embodiment, the motion detection sensor circuit 37, the signal processing motion detection circuit 42, and the zoom position detection circuit 33 are provided, and when the zoom function is not in operation, the ( It uses (data ■) and (data ■) from the signal processing motion detection circuit 42 to obtain highly accurate and highly reliable motion amount data.Furthermore, when the zoom function is activated, (data I) and the zoom position The amount of movement corresponding to the amount of zoom is obtained using the amount of zoom from the detection circuit 33, and motion correction data is obtained from this amount of movement and (data ■) to detect special subject images that are likely to cause errors in the signal processing motion detection circuit. It is possible to obtain good images without blur even when

FIG. 6 is a block diagram of a motion compensation imaging device showing a third embodiment of the present invention. In FIG. 6, blocks 64 to 71 are blocks 14 to 21 of the first embodiment, respectively.
The difference is that a lens 72, which is an optical part, and an electronic zoom control circuit 73 are provided. The following will mainly explain the differences from the first and second embodiments. As shown in FIG. 6, in the case of a configuration in which the output signal of the image sensor 64 is once stored in the memory circuit 68 and read out as a video signal according to the memory control circuit 69, the memory control circuit 69 and the signal processing circuit H@71 A zoom function can be provided by using the 68-frame readout method and signal processing such as interpolation. This will be explained using FIG. 7.

In FIG. 7, the entire memory area AQ corresponds to the photoelectric conversion area of the image sensor. Motion correction memory areas A111 and A
o is smaller than the angle An for correcting camera shake components,
The memory area A□ when no motion correction is performed when the zoom function is not operating is located at the center of the entire memory area AQ. Also,
Zoom function using memory Memory area (I) and (
ff) denote AI and A2, in this case the zoom ratio is 2x. By setting the readout clock frequency to 172 in the horizontal direction of A1 and A2, and by performing line interpolation in the vertical direction and reading them out as NTSC signals, it essentially has a zoom function.

In this manner, the memory control circuit 69 uses the signal from the electronic zoom control circuit 73 to read out the signal in the zoom function memory area from the memory circuit 68 and obtains a zoomed video signal via the signal processing circuit 71. In this imaging device having a zoom function, motion compensation is performed by a motion compensation circuit 70 using motion amount data from a motion detection sensor circuit 67, and a zoom position obtained from this motion compensation data and an electronic zoom # circuit 73. The memory control circuit 69 reads out the data from the memory circuit 68 using the zoom ratio data, and obtains a zoomed and motion-compensated signal via the signal processing circuit 71.

For example, in FIG. 7, when the zoom m-function valve is operating, the motion compensation circuit 70 obtains motion compensation data using motion amount data from the motion detection sensor circuit 67, and the memory control circuit 69 determines the motion compensation data based on the motion compensation data. circuit 69
For example, the motion compensation memory area A□ or A'H whose readout start position is Pl or P2 is read out from the electronic zoom control circuit 73 when the 0th order zoom function is in operation and motion compensation is not performed. Using the zoom amount data of ff, the memory control circuit 69 determines the reading start position ff.
Qt, the read tally frequency and the interpolation method are determined, and the zoom function memory area A1 is read out from the memory circuit 68 and zoom is performed.If motion compensation is also performed at this time, the motion amount data from the motion detection circuit 7o is determined. Motion correction data obtained using the electronic zoom control circuit 73
The memory control circuit 69 adds the zoom amount data from
determines the readout clock frequency, the interpolation method, and the readout start position Q2 after motion compensation, and
The zoom function menu area A2 is read out from 8 and predetermined zoom and motion correction are performed.

As described above, according to the third embodiment, the memory control circuit 69 obtains the zoomed video signal from the memory circuit 68 using the zoom data of the electronic zoom control circuit 73, and also uses the zoom data and the motion detection sensor circuit. Using the motion amount data 67, the memory control circuit 69 obtains a good video signal that has undergone zooming and motion correction from the memory circuit 68.

Moreover, since there are many common parts in the circuit configuration, it is possible to implement the system with a small circuit scale.

Note that the motion detection sensor circuit 17, 37, 67 provided in the first, second and third embodiments may be a method of detecting the amount of motion in a mechanical gyro, but is not limited to this. Since there is no such thing, the explanation will be omitted.

Next, in the first embodiment, as a method for obtaining motion correction data from zoom amount data and motion amount data, a case was shown in which the motion amount data is corrected using zoom amount data from a variable amplification factor amplification circuit. However, if the zoom amount data changes, the motion compensation is stopped and the state is left uncorrected, or the previous motion compensation data is used again, or the average fixed data is used as the motion compensation data. However, in a broad sense, these can also be thought of as obtaining motion correction data from zoom amount data and motion amount data.

In addition, in the second embodiment, the motion detection signal processing circuit is not limited to this, and other methods and other configurations may be used as long as the circuit obtains the amount of motion using a signal processing method.
Further, the method of synthesizing two pieces of motion amount data and zoom amount data, and the method of determination performed by the motion correction circuit, are not limited to those described here.

Furthermore, in the first, second, and third embodiments, a method of controlling the drive control circuit of the image pickup device may be considered as a method of obtaining a blur-free video signal from the obtained motion correction data.

Further, in the third embodiment, a case has been described in which a motion detection sensor circuit is used to detect the movement of the optical section and the image sensor, but a motion detection signal processing circuit may be used as shown in the second embodiment. It is clear that the structure may be composed of both.

Furthermore, in the first and second embodiments, the case where the zoom circuit is driven by the zoom drive circuit has been described;
It is clear that a manual zoom circuit configuration may be used, or that the zoom drive circuit may be controlled by a zoom drive control circuit, and the zoom position detection circuit may use a signal from the zoom drive control circuit.

Effects of the Invention As described above, according to the present invention, a zoom circuit or an imaging device having a zoom function can perform motion correction even during zoom imaging and obtain a good video signal without blur. Further, even when the amount of motion cannot be determined from the image, a good video signal without blurring can be obtained, which has a great practical effect.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of a motion compensation imaging device according to a first embodiment of the present invention, FIG. 2 is an explanatory diagram of the operation of a memory circuit according to the first embodiment, and FIG. 3 is a block diagram of a motion compensation imaging device according to a first embodiment of the present invention. 4 is a block diagram of the signal processing motion detection circuit of the second embodiment, FIG. 5 is an operation explanatory diagram of the signal processing motion detection circuit of the second embodiment, and FIG. 6 is a block diagram of the signal processing motion detection circuit of the second embodiment. A block diagram of the third embodiment, FIG. 7 is an explanatory diagram of the operation of the memory circuit of the third embodiment, FIG. 8 is a block diagram of a conventional motion compensation imaging device, and FIG. 9 is an operation of the conventional memory circuit. It is an explanatory diagram. 11, 31...Zoom mechanism, 12.32...Zoom drive circuit, 13, 33...Zoom position detection circuit, 14
．． 34... Image sensor, 15, 35... Element drive circuit, 17.37... Motion detection sensor circuit, 18.38.
・・Memory circuit, 19.39 ・・Memory control circuit, 2
0.40...Motion correction circuit, 21.41...Signal processing circuit, 42...Signal processing motion detection circuit, 64...
Image sensor, 65... Element drive circuit, 67... Motion detection sensor circuit, 68... Memory circuit, 69... Memory control circuit, 70... Motion correction circuit, 71... Signal processing circuit , 72... Lens, 73... Electronic zoom control circuit. Agent Yoshihiro Morimoto Figure 4 Clearance data Figure 5 jzt 5tx ja o o o o---5st
Jn Rn ko o a
o o o o--,544,! ;
m δsuj Q Q OO-- ++lII ' 1 kite, jl I I lo -1 +1 + lR,. 1 bite

Claims (1)

[Claims] 1. An optical section including a zoom lens, a zoom position detection circuit that detects a zoom ratio from a zoom position signal obtained from the optical section, an image sensor, and a drive circuit for the image sensor;
a motion detection sensor circuit that detects movement of an optical section and an image sensor; a memory circuit that is supplied with a signal from the image sensor and has a capacity of at least one field; and a memory circuit that changes a read address of the memory circuit in accordance with the movement signal. a memory control circuit; and a motion correction circuit that corrects the output signal of the motion detection sensor circuit based on the zoom ratio signal obtained from the zoom position detection circuit, and corrects the control by the memory control circuit using the obtained motion correction signal. A motion compensation imaging device comprising: 2. It has a signal processing motion detection circuit that detects the movement of the optical section and the image sensor based on the change in image data of a specific representative point in the memory circuit, and the motion correction circuit adjusts the zoom ratio obtained from the zoom position detection circuit. 2. The motion detection circuit according to claim 1, wherein the amount of motion obtained by correcting the output signal of the motion detection sensor circuit based on the signal is compared with the output of the signal processing motion detection circuit, and the amount of motion correction is obtained by selecting the amount of motion. motion compensated imaging device. 3. An optical section that forms an image of light from a subject, an image sensor, a drive circuit for the image sensor, a motion detection sensor circuit that detects movement of the optical section and the image sensor, and a signal from the image sensor. a memory circuit having a capacity of at least one field; a memory control circuit that changes a read address of the memory circuit according to a motion signal; an electronic zoom control circuit that changes a read area of the memory control circuit; and the motion detection sensor. Using the circuit motion signal,
A motion compensation imaging device comprising: a motion compensation circuit that compensates for control by the memory control circuit based on a readout area changed by the electronic zoom control circuit.