JP3395186B2 - Video camera and video camera image vibration display method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video camera having a camera shake correction device and a vibration display device for displaying an image on the video camera .

[0002]

2. Description of the Related Art When shooting with a handy-type video camera, there is a problem that the playback screen shakes due to camera shake. To solve this problem, we detect the motion vector,
It has been proposed to correct video data stored in an image memory based on this motion vector (for example, Japanese Patent Laid-Open No. 63-166370). The motion vector is detected by block matching, for example. That is, the screen is divided into a number of areas (called blocks),
The absolute value of the frame difference between the representative point of the previous frame located at the center of each block and the pixel data in the block of the current frame is calculated, and the absolute value of this frame difference is integrated for one screen to obtain the integrated frame difference data. The motion vector is detected from the position of the minimum value. Further, as described in this document, in order to prevent the video data from being lost when motion compensation is performed, the image is read out and an interpolation circuit is used to enlarge the image by, for example, about 15%. ing. In such a camera shake correction device, it is necessary to detect the camera shake correctly.

[0003]

With a conventional video camera having a camera shake correction function, the photographer can only confirm the corrected image in the viewfinder and know what kind of camera shake correction has been performed. I couldn't. Therefore, it is impossible for the photographer to make a visual correction,
When the camera shake exceeds the correction range, there was a problem that the shooting screen suddenly moved. Therefore, an object of the present invention is to provide a video camera and a vibration display device for images of the video camera, which enables the photographer to know the direction and amount of camera shake or camera shake correction, and enables visual feedback correction of the camera operator. To do.

[0004]

The invention of claim 1 is a bidet.
An image composed of video signals captured by the camera
Motion vector detecting means for detecting the motion vector of the entire surface
And the image is compensated by the correction amount according to the motion vector of the entire screen.
Image of the missing part of the image caused by the correction
Peripheral memory that stores peripheral image data corresponding to data
And the image is compensated by the correction amount according to the motion vector of the entire screen.
Surround the missing part of the image caused by the correction
Generated by interpolating with peripheral image data from memory
And a correction unit for outputting the corrected image
, The boundary between the image moved by the correction amount and the peripheral image data
A marker indicating the edge of the
It is a video camera characterized by doing so. Contract
The invention of claim 2 is the image moved by the correction amount and the peripheral image data.
A marker that indicates the edge of the boundary with the data
This is a method for displaying the vibration of the video camera image displayed on the
It

[0005]

The video camera photographer can know the direction and amount of camera shake or camera shake correction in real time.
You can move the video camera in a direction to reduce camera shake. Therefore, it is possible to reduce the possibility that the captured image suddenly moves beyond the range of camera shake correction.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. In this example, since the camera shake is the motion of the video camera, the whole screen moves, while the motion of the object is that a certain part of the screen moves, that is, there is a stationary part in the screen. Focusing attention, the two are distinguished. In FIG. 1, reference numeral 1 is an input terminal for digital video data. This video data is, for example, captured by a CCD of a video camera, and is a sequence of interlaced scanning order.

Input video data is supplied to the field memory 2 and the representative point memory 3. Field memory 2
At the output of, the data in which the camera shake is corrected by the correction signal described below is read. When processing is performed for each frame, a frame memory is used instead of the field memory 2. The output of the representative point memory 3 is supplied to the subtraction circuit 4 and the representative point memory 5. The output of the representative point memory 5 is supplied to the subtraction circuit 6. Input video data is supplied to the subtraction circuits 4 and 6. The representative point memory 3 stores the data of the representative point one field before, and the representative point memory 5 stores 2
Data of the representative point before the field (that is, one frame) is stored.

As shown in FIG. 2, the screen of one field is subdivided into blocks of m pixels × n lines, and the pixel at the center of each block is used as a representative point. The representative point is on the screen,
It is evenly distributed. The subtraction circuit 4 detects a difference (that is, an inter-field difference) between each of the m × n pixel data of the block in the current field and the data of the representative point of the block at the same position in the previous field.
This field difference is supplied to the absolute value integrating circuit 7.
Similarly, the subtraction circuit 6 detects the frame difference between the block of the current field and the representative point two fields before. The frame difference is supplied to the absolute value integrating circuit 8 and the frequency table creating circuit 9.

The motion vector is detected by the absolute value integrating circuit 8
Is done using the frame difference. The movement between the fields obtained by the absolute value integrating circuit 7 from the difference between the fields is used as an auxiliary means. That is, the difference between fields has a characteristic that time accuracy is good but the position accuracy is poor, and the difference between frames has a characteristic that time accuracy is bad but the position accuracy is good. Therefore, when the motion vector is detected from the frame difference, the detection accuracy can be improved by using the difference between the fields.

As shown in FIG. 3, the motion search area has the same size as the block. For each block, the subtraction circuit 6 generates m × n differences between the representative point two fields before and the pixel data in the block of the current field. In the absolute value integration circuit 8, the absolute values of the frame differences at each position in the block are integrated over one frame period to form a distribution of m × n integrated frame difference data, and the minimum value in this distribution is the motion vector. Detected as. The detection of this motion vector is the same as the conventional one.

The frequency difference table creation circuit 9 is supplied with the frame difference from the subtraction circuit 6 and the input video data.
As shown in FIG. 4, the frequency distribution table creating circuit 9 includes eight pixels a, b, and eight pixels around the pixel x that coincides with the center of the block in FIG.
A memory having addresses corresponding to c, d, e, f, g and h is provided. Of these pixels, every time the frame difference becomes 0, the frequency of a position (memory address) having a spatial inclination is updated. For example, the frame difference is almost 0
At this time, when the absolute value of the difference between the value of the pixel x and the value of the pixel d is larger than the threshold value, the value of the memory address corresponding to the position of d is set to +1. The process for each block is 1
It is accumulated over the entire screen to form a frequency distribution table. The spatial inclination is, for example, in the horizontal direction (pixel x and pixel e or pixel d
And between), the horizontal movement always results in a frame difference. Therefore, when the above conditions are met, it means that the block is stationary in that direction.

The motion vector detected by the absolute value integrating circuit 8 and the output of the frequency distribution table creating circuit 9 are supplied to the motion amount determining circuit 10. The motion amount determination circuit 10 verifies whether or not the motion vector may be used as the camera shake vector. That is, when the frequency of the position corresponding to the motion vector, that is, when the ratio of still blocks is less than the threshold for determination, it is determined that this motion vector is derived from the motion of the entire screen, and the motion vector is set as the shake vector. judge. If not, it is determined that the number of still blocks in the screen is large, and it is determined that this motion vector is derived from the motion of the target object in the screen. For example, when the detected motion vector is in the upward vertical direction, the frequency of the position of the pixel b is examined. If this frequency is higher than the threshold value, it can be seen that there are many non-moving parts on the screen, and this motion vector is not considered to be a shake vector.

The inter-field motion vector from the absolute value integrating circuit 7 is supplied to the motion amount determining circuit 10 as described above by checking the steadiness of the detected motion vector to determine the accuracy of the motion vector. This is to improve. The output (camera shake vector) of the motion amount determination circuit 10 is supplied to the correction amount generation circuit 11. The camera shake vector is detected from the movement between frames and is not the same as the camera shake correction amount. For example, when camera shake in the same direction occurs in the periods of the second and third frames in the period of three consecutive frames, the shake vector V1 between the first frame and the next frame is detected. , The camera shake vector V2 between the second and third frames is detected. Second
The correction amount for the th frame may be V1, but the third
The correction amount for the second frame needs to be (V1 + V2). The correction amount generation circuit 11 generates a correction amount obtained by integrating the shake vector. Also, like this example,
When the camera shake correction is performed on a field-by-field basis, the motion vector is halved to correspond to the time difference between the field and the frame in order to convert the motion amount between the frames into the motion amount between the fields.

The camera shake correction signal from the correction amount generation circuit 11 is the address control circuit 12 and the select signal generation circuit 1.
3 is supplied. The address control circuit 12 generates an address signal for the field memory 2 and the peripheral memory 16. An image of one field is written in the field memory 2, and its read address is controlled according to the correction amount. Therefore, from the field memory 2, the video data obtained by moving the input video data of one field according to the correction amount can be obtained. The output of the field memory 2 is supplied to the selector 14, and the output of the selector 14 is taken out to the output terminal 15 and supplied to the peripheral memory 16. The peripheral data output from the peripheral memory 16 is supplied to the selector 14. In response to the select signal from the select signal generating circuit 13, the selector 14 selects the video data from the field memory 2 and the peripheral data stored in the peripheral memory 16 that have been shake-corrected.

As shown in FIG. 5A, the field memory 2
The peripheral portion (the area outside the dashed line) 22 of the one-field image (the frame of which is represented by 21) taken in is stored in the peripheral memory 16. The width of the peripheral portion 22 is set in consideration of the range of camera shake correction, and is set to a width of, for example, about 10 to 20%. In FIG. 5B, as shown by an image frame 21a, when the image that should be in the position of FIG. 5A is moved to the right, for example, by the camera shake, the entire image is moved to the position indicated by the broken line by the camera shake correction amount V. Will be corrected.
In such a case, since the captured image does not originally exist, the image of the portion 23 indicated by the diagonal lines on the left side of the image after the movement is missing. The missing portion 23 is replaced with the image at the corresponding position stored in the peripheral memory 16. This replacement is executed by the address control by the address control circuit 12 and the switching operation of the selector 14. Further, peripheral image data other than the missing portion 23 in the captured video data is written in the peripheral memory 16, and the content of the peripheral memory 16 is updated.

In the present invention, the shake correction of the image pickup output of the video camera is performed in real time, and a marker indicating that the shake has occurred is displayed on the screen of the viewfinder.

As shown in FIG. 6A, an image frame 21 indicated by a broken line
Is an image actually captured, and has been corrected by the above-described camera shake correction, such as an image 21b indicated by a solid line. In this case, as shown in FIG. 6B, a vertical line marker 25 is displayed at a position corresponding to the edge of the image frame 21 that is actually being captured on the screen of the viewfinder 24 of the video camera. The photographer looks at this marker 25 to know the direction and amount of camera shake or the direction and amount of camera shake correction, and moves the video camera in the direction to correct this camera shake. In addition to the above-described camera shake correction, feedback based on the visual sense of the photographer is applied, so that it is possible to considerably prevent the camera shake range from exceeding the correction range. If the camera shake is not displayed on the viewfinder, the screen may suddenly move at some point when the camera shake cannot be corrected. The marker 25 is not limited to a vertical line, but an arrow or the like may be used.

[0018]

According to the present invention, since the direction and amount of camera shake or camera shake correction are displayed on the viewfinder,
The photographer operates the video camera in a direction to reduce camera shake. Therefore, it is possible to reduce the possibility that the captured image suddenly moves due to the camera shake exceeding the correction range.

[Brief description of drawings]

FIG. 1 is a block diagram of an embodiment of the present invention.

FIG. 2 is a schematic diagram showing block division according to an embodiment of the present invention.

FIG. 3 is a schematic diagram showing a search range of a motion vector according to an embodiment of the present invention.

FIG. 4 is a schematic diagram used to explain how to create a frequency distribution table according to an embodiment of the present invention.

FIG. 5 is a schematic diagram used for explaining camera shake correction according to an embodiment of the present invention.

FIG. 6 is a schematic diagram used for explaining a shake display on a viewfinder screen of a video camera.

[Explanation of symbols]

1 Video data input terminal 2 Field memory 3 Representative point memory for storing representative point data 1 field before 5 Representative point memory for storing representative point data 2 field before 9 Frequency distribution table creation circuit 10 Motion amount determination circuit

Claims (2)

(57) [Claims] 1. A video signal captured by a video camera
A motion that detects the motion vector of the entire screen of the composed image.
Image detection means and the amount of correction based on the motion vector of the entire screen
Of the missing part of the image caused by
A peripheral memory that stores the peripheral image data corresponding to the image data.
Mori and the image with the correction amount according to the motion vector of the entire screen
The missing part of the image caused by
To interpolate with the peripheral image data from the peripheral memory
And a correction means for outputting a corrected image more produced, the corrected image, the moving image and the frequency by the correction amount
View the marker that indicates the edge of the boundary with the image data.
-The featured feature is that it is displayed in the finder.
Deo camera. 2. A video signal picked up by a video camera
A screen for detecting the motion vector of the entire screen of the composed image.
The image with the correction amount according to the step and the motion vector of the whole screen.
Of the missing part of the image caused by
A step that stores the peripheral image data corresponding to the image data.
And the amount of correction according to the motion vector of the entire screen
The missing part of the image caused by
To interpolate with the peripheral image data from the peripheral memory
And outputting the corrected image further generated, the corrected image, the moving image and the frequency by the correction amount
View the marker that indicates the edge of the boundary with the image data.
-Display video in the viewfinder
Vibration display method of the image of the camera.