JP2003078808A - Device and method for detecting motion vector, device and method for correcting camera shake and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect a motion vector and to correct camera shake even when a field with video signal omission exists. SOLUTION: An input video signal is supplied to a representative point storage circuit 43 and a subtracter 44 through a filter processing circuit 42, and a finite difference between a representative point of a previous field and a pixel of the present field is operated. An absolute value conversion circuit 45 converts the finite difference into an absolute value, a cumulative addition circuit 46 integrates the absolute value, and a motion vector generation circuit 47 generates a motion vector on the basis of an integral value. CAMERA shake is corrected with the motion vector. In a field in which a video signal is omitted with a representative point storage enabling signal from a terminal 48, a representative point is not stored. As a result that the representative point storage circuit 43 does not perform a storage operation previously stored representative point data are stored. Even if previous field is omitted, the subtracter 44 can operate a correlation value.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a motion vector detection apparatus and method, a camera shake correction apparatus and method, and an image pickup apparatus for detecting a motion vector due to, for example, camera shake.

[0002]

2. Description of the Related Art When a subject is photographed by a camera-integrated image pickup device, there is a problem that a picked-up image shakes due to camera shake. To correct this, a shake vector correction is performed to detect a motion vector and correct the shake of the picked-up image. Has been done.
The motion vector is obtained by detecting the correlation between the previous field (or frame) and the current field (or frame). The motion due to camera shake correction is the motion of the entire screen, and the motion vector of the entire screen is detected.

A conventional motion vector detecting device detects a motion vector by calculating the correlation between the representative point set in the previous field and the luminance level of the pixel in the current field. That is, the storage cycle of the representative points was one field.

[0004]

However, in a camera-integrated image pickup device, the exposure time of the image pickup device may be longer than one field in order to photograph a dark subject. In this case, a field in which the video signal is missing occurs. There is a problem that the motion vector cannot be detected because the representative point data of the comparison source cannot be stored.

Therefore, an object of the present invention is to solve such a problem and to store a representative point in a cycle corresponding to the exposure time, thereby making it possible to detect a motion vector and correct a camera shake even in an exposure time longer than one field. A motion vector detecting device and method, a camera shake correcting device and method, and an imaging device.

[0006]

In order to solve the above-mentioned problems, the invention of claim 1 is a motion vector detecting device for detecting a motion vector caused by camera shake of an image pickup device from an input video signal. The representative point storage means for extracting and storing a plurality of representative points from the field or frame, and a plurality of areas including pixels at the same position as each of the representative points in the current field or frame are set. On the basis of the correlation value calculating means for calculating the correlation value between the plurality of pixels and the representative point, the integrating means for integrating the correlation value from the correlation value calculating means within a predetermined range, and the integrated value of the correlation value from the integrating means. A motion vector determining means for determining a motion vector in a predetermined range, and as a result of the exposure time being longer than one field or one frame, In the case of frame occurs only in the field or frame video signal is present, the representative point storage means is a motion vector detection apparatus to perform the storage operation of the representative point. In the invention of claim 2, as a result that the exposure time is longer than one field or one frame,
When a field or frame in which a video signal is missing occurs, the representative vector storing step is performed only in the field or frame in which the video signal exists.

According to a third aspect of the present invention, in a camera shake correction device that detects a motion vector caused by camera shake of an image pickup device from an input video signal and corrects the camera shake by the detected motion vector, a memory that stores a video signal to be corrected. And a motion vector detection device, and a correction control means,
The motion vector detection device includes a representative point storage unit that extracts and stores a plurality of representative points from a temporally previous field or frame, and a plurality of pixels including a pixel at the same position as each representative point in the current field or frame. Area, the correlation value calculating means for calculating the correlation value between the plurality of pixels in each area and the representative point, the integrating means for integrating the correlation value from the correlation value calculating means within a predetermined range, and the integrating means. And a motion vector determining means for determining a motion vector within a predetermined range based on the integrated value of the correlation value from 1 to 2. As a result of the exposure time being longer than one field or one frame, a field or frame in which a video signal is missing occurs. In this case, the representative point storage means performs the storage operation of the representative point only in the field or frame in which the video signal is present. Is supplied motion vector from the motion vector determining means, based on the motion vector, so as to correct the camera shake, is configured to control the memory, the exposure time is longer than one field or one frame result,
The image stabilization apparatus is configured to perform the control operation only in the field or frame in which the video signal is present when the field or frame in which the video signal is missing occurs. According to a fourth aspect of the present invention, when a field or frame in which a video signal is missing occurs as a result of the exposure time being longer than one field or one frame, the representative point storage step is performed only in the field or frame in which the video signal exists. To do the processing,
When a field or frame in which a video signal is missing occurs as a result of the exposure time being longer than one field or one frame, the shake control process is performed only in the field or frame in which the video signal exists. This is a correction method.

According to a fifth aspect of the present invention, in the image pickup apparatus equipped with a camera shake correction apparatus for detecting a motion vector caused by camera shake of an image pickup apparatus from an input video signal and correcting the camera shake by the detected motion vector, the camera shake correction apparatus is ,
The motion vector detecting device includes a memory for accumulating a video signal to be corrected, a motion vector detecting device, and a correction control means, and the motion vector detecting device extracts and stores a plurality of representative points from a temporally previous field or frame. Correlation value calculation for setting a point storage means and a plurality of areas including pixels at the same positions as the representative points in the current field or frame, and calculating a correlation value between the plurality of pixels in each area and the representative point Means, integrating means for integrating the correlation value from the correlation value calculating means within a predetermined range, and motion vector determining means for determining a motion vector within a predetermined range based on the integrated value of the correlation values from the integrating means. , If the field or frame in which the video signal is missing is generated as a result of the exposure time being longer than 1 field or frame, the field or frame in which the video signal exists Only in the frame, the representative point storage means performs the storage operation of the representative point, and the correction control means is supplied with the motion vector from the motion vector determination means, and corrects the camera shake based on the motion vector. If the field or frame in which the video signal is missing is generated as a result of the exposure time being longer than one field or one frame, the control operation is performed only in the field or frame in which the video signal exists. The image pickup device is configured as described above.

According to the present invention, the operation of storing the representative point is performed only in the field or frame in which the video signal is present. Therefore, even when the exposure time exceeds one field, the motion vector can be detected and detected. It is possible to avoid the problem that camera shake correction becomes impossible.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described below with reference to the drawings. In order to facilitate understanding of the present invention, an example of a camera shake correction device will be described. Figure 1
Indicates such a camera shake correction device, and reference numeral 1 indicates an input terminal of a digital video signal to be a target for camera shake correction. The input video signal is picked up by the image pickup device. The input video signal is supplied to the motion vector detection device 2 and the field memory 4. The motion vector detection device 2 detects a motion vector, determines the reliability of the detected motion vector, and detects the motion vector of the entire screen from the highly reliable motion vector. The motion vector detected by the motion vector detection device 2 is supplied to the correction control unit 3.

The correction control unit 3 performs camera shake correction based on the detected motion vector. The motion vector from the correction controller 3 is supplied to the field memory 4. An input video signal (digital) from the image pickup unit is stored in the field memory 4. For example, the image pickup unit is configured to have a larger area than the output image area, and uses the surplus area generated thereby to perform camera shake correction. An image including such a surplus area is accumulated in the field memory 4, and the camera shake is corrected by changing the position to be cut out as the output image region based on the motion vector. The field memory 4 performs correction in units of integer pixels among the camera shake corrections. That is, the process of shifting the image in the direction opposite to the camera shake is performed. By using the surplus area when performing this shift processing, it is possible to prevent image loss. The reading of the image pickup unit may be controlled, or the picked-up image may be enlarged and stored in the field memory 4.

The video signal read from the field memory 4 is supplied to the interpolation section 5. In the interpolation unit 5, among the correction amounts based on the motion vector calculated by the correction control unit 3, the correction amount of an integer pixel or less is corrected by interpolation.
The interpolation is realized by weighted addition according to the correction amount of integer pixels or less. If the component of the horizontal motion vector is, for example, 0.5 pixel, an image shifted by 0.5 pixel in the horizontal direction is generated by the average value of two adjacent pixels. Similar interpolation is performed in the vertical direction.

In this description, one field is treated as one screen, but one frame may be treated as one screen. The video signal may be either an interlaced signal or a non-interlaced signal. Furthermore, the present invention can be applied to image stabilization of a color video signal. However, the motion vector is detected using the luminance signal, and camera shake correction is applied to both the luminance signal and the color component signal.

The motion vector detecting device 2 detects a motion vector by the representative point matching method. In the representative point matching method, a representative point is set in the previous field, the luminance level of the pixel in the search range of the current field is compared with the luminance level of the representative point in the previous field, and the pixel of the representative point is selected from the pixels in the search range. This is a method of detecting a motion vector from the closest pixel.

FIG. 2 shows a motion vector detecting method by the representative point matching method. A search range SRn including a plurality of pixels is set in the current field. At the same position as the search range SRn, for example, the value of the pixel at the center position of the area SRn-1 of the previous field having the same size is the representative point S.
t-1 (Xk, Yk). Representative point St-1 (Xk, Y
k) and the absolute value of the difference in brightness level between the plurality of pixels within the search range SRn. The absolute value of the difference generated in the search range is the correlation value. A plurality of search ranges are set in one field, and the correlation value obtained in each search range is integrated over one field to form an integrated value of the correlation values. A motion vector is detected from this integrated value.

As described above, the correlation value representing the correlation of the brightness levels is the absolute value of the difference between the brightness level of the representative point and the brightness level of each pixel in the search range SRn. The square of the difference may be used as the correlation value. A motion vector is detected from the integrated value obtained by integrating the correlation values. When the search range SRn is used as the integral value of the correlation value, the position a with the smallest integral value is detected. The motion vector Mv is detected from the deviation between the position of the representative point and the detected position a.

The shake of the image caused by the shake during photographing is the shake of the entire screen, and the shake correction uses the field memory 4 to shift the entire screen in the direction opposite to the motion vector generated by the shake. Is. An example of the method of obtaining the motion vector of the entire screen will be described more specifically.

FIG. 3 is an example of a detection area set in one imaged screen. Detection areas D0, D1, D2, D3 are set in each divided area obtained by dividing each field (each screen) into four. The motion vector of each detection area is obtained, and the motion vector of the entire screen is obtained from the motion vector of each detection area. It is not always necessary to set the detection area, and the integral value of the correlation value may be obtained in the entire screen and the motion vector of the entire screen may be detected from the integral value.

FIG. 4 shows the detection area Di (i = 0, 1, 2,
An example of 3) will be described in detail. The detection area of the previous field includes a plurality of 48 representative points, for example, 8 in the horizontal direction and 6 in the vertical direction. At the spatial position corresponding to each representative point, as many search ranges SRn (n = 0 to 4) as the representative points are provided.
7) is set in the current field. In the search range, the horizontal position is (0, 1, 2, ..., X) and the vertical position is (0, 1, 2, ..., Y). Both of these positions define the position of each pixel. The position of the representative point is, for example, the center position of the area at the same position as the search range. Then, the deviation x with respect to the position of the representative point,
The deviation y is defined. The deviations x and y are both 0 at the same position as the representative point.

In each of the detection areas Di, the correlation value, for example, the absolute value of the difference between the representative point and each pixel is obtained for each pixel in each search range. The correlation value is integrated for each detection area, and the motion vector of the detection area is obtained from the integrated value of the correlation value (hereinafter, appropriately referred to as the integration value of the detection area).
FIG. 5 shows a method of obtaining an integrated value of correlation values. In FIG. 5, Z + 1 search ranges SR0 to SR0 are included in one detection area.
In this example, SRz is included.

The correlation value found in the search range SR0 is shown at the top of FIG. Since the correlation value is generated corresponding to the position of each pixel, the position of each correlation value is shown. Correlation values in other search ranges also occur at the position of each pixel. Then, among the correlation values of all the search ranges in the detection area, those at the same position are added to obtain the integrated value SRd of the correlation value. For example (0,
The correlation value at the position of (0,0), the correlation value at the position of (0,0,1), ..., The sum of the correlation values at the positions of (0,0, Z) is the integrated value of the correlation values. It is the component at the position (0, 0) of SRd.

FIG. 6 shows the integrated value of the correlation values of one detection region thus obtained in three dimensions (shifts x and y and the magnitude of the correlation value). In FIG. 6, the motion vector is detected from the position a where the integrated value is the minimum.
That is, the values of the shifts x and y corresponding to the position a are set to the minimum value of the correlation value integral value of the detection area. Note that, as described above, by having a plurality of search ranges in one detection area, it is possible to prevent the detection accuracy from decreasing. Further, a plurality of search ranges set in one detection area may have overlapping portions with each other.

FIG. 7 shows an example of the configuration of the motion vector detecting section 20 in the motion vector detecting device 2. The video signal is input from the input terminal 21 and supplied to the filter processing circuit 22. The filter processing circuit 22 removes frequency components unnecessary for motion detection. The output signal of the filter processing circuit 22 is supplied to the representative point storage circuit 23 and one input terminal of the subtracter 24. The value of the representative point from the representative point storage circuit 23 is supplied to the other input terminal of the subtractor 24.

The representative point storage circuit 23 stores the value of the pixel at the center position of the two-dimensional area corresponding to the search range as a representative point. For example, the representative point storage circuit 23 includes a memory that selectively stores the representative point of the current field and a memory that holds the representative point of the previous field. The value of the representative point of the previous field is supplied from the representative point storage circuit 23 to the other input terminal of the subtractor 24.

The subtractor 24 subtracts each pixel value within the search range from the representative point. The difference data from the subtractor 24 is supplied to the absolute value conversion circuit 25 and converted into the absolute value of the difference. The absolute value of the difference is the correlation value. The correlation value is supplied to the cumulative addition circuit 26, and all the correlation values included in the detection area are integrated as described with reference to FIG. The cumulative addition circuit 26 obtains the integrated value of the correlation values of one detection area.

The integrated value of the correlation value from the cumulative addition circuit 26 is supplied to the motion vector generation circuit 27. The motion vector generation circuit 27 detects the minimum value of the integrated value, detects the motion vector from the deviations x and y, and outputs it. The output motion vector is one detected in one detection area.

FIG. 8 shows an example of the configuration of the motion vector detecting device 2. Regarding the motion vector detection unit 20 in the motion vector detection device 2, the portions corresponding to those in FIG. 7 are denoted by the same reference numerals, and the description thereof will be omitted to avoid duplication.
In addition to the motion vector detection unit 20, the motion vector detection device 2 includes a vector feature detection circuit 31 and a reliability determination circuit 32.
And a vector detection circuit 33. The integrated value of the correlation value output from the cumulative addition circuit 26 of the motion vector detection unit 20 is supplied to the vector feature detection circuit 31 together with the motion vector generation circuit 27.

The vector feature detection circuit 31 is a circuit for detecting the feature around the point a having the minimum value shown in FIG. 6 and the feature of the correlation value integral value. The features detected by the vector feature detection circuit 31 are supplied to the reliability determination circuit 32. The reliability determination circuit 32 generates reliability information indicating the degree of reliability based on the detected characteristics, and supplies the reliability information to the vector determination circuit 33. The vector determining circuit 33 uses the reliability information to determine a highly reliable motion vector.
The motion vector determination circuit 33 determines the motion vector of the entire screen using the reliability information and the motion vector of each detection area, and outputs the determined motion vector.

As described with reference to FIG. 3, four detection areas D1 to D4 are set on one screen. The motion vector detection unit 20 detects the motion vector of each detection area in order from D1, and the vector determination circuit 33 notifies the detection area D
The detected motion vector and the reliability information of each detection area are supplied in the order of 1, D2, D3, D4. The motion vector of each detection area may be obtained in parallel. Also,
All or part of the functions of the motion vector detection device 2 may be realized by software processing.

The reliability discriminating circuit 32 is provided because the motion vector output from the motion vector detecting device 2 may be different from the motion vector due to the original hand shake when the contrast of the object on the image pickup surface is low. ing. FIG. 9 illustrates the characteristics of the integrated value of the correlation value used for reliability determination. The reliability is determined based on the characteristics of the integrated value, for example, the minimum value and the average value of the integrated values. A large minimum value occurs when a moving object enters the screen, and a small average value occurs when the contrast is low. In many cases, the motion vector detected in these cases does not accurately reflect the camera shake, so it is determined that the reliability is low.

The vector determination circuit 33 detects the motion vector of the entire screen from the motion vector and reliability information obtained in each of the four detection areas. This algorithm can be various. As a simple example, the motion vector determined to have the highest reliability is selected as the motion vector for the entire screen. As another example, when there are a plurality of highly reliable motion vectors, the average value of them is adopted as the motion vector of the entire screen. Other methods are possible.

In the above-mentioned motion vector detecting device, since the representative point set in the previous field is compared with the pixel in the current field, one field is missing out of two fields which are temporally continuous. Then, there arises a problem that the motion vector cannot be detected.
This problem will be described with reference to FIG.

FIG. 10A shows a vertical synchronizing signal that defines a period of one field, FIG. 10B shows an exposure period, and FIG.
0C indicates a video signal input. A video signal is generated every other field due to the exposure time of one field or more.
In the example of FIG. 10, the video signals are present in the fields Fn-2, Fn, ... And the video signals are missing in the fields Fn-1, Fn + 1. In a camera-integrated recording / reproducing device in which a recording / reproducing device and a video camera are integrated, an operation mode for performing exposure of one field or more may be prepared in order to enable photographing of a dark subject.
In such an operation mode, an exposure period having a length of 1 field or more occurs.

According to the present invention, as shown in FIG. 11, when there is a field in which the video signal is missing, for example, Fn-1, the representative point data is not stored and the field Fn in which the video signal is actually input is not stored. By performing the correlation calculation between the representative point data stored in Fn-2 and the pixel in the field Fn, it is possible to detect the motion vector Mv changed from the field Fn-2 to the field Fn. In FIG. 11, SRn
Indicates the search range SRn set in the current field Fn, as in FIG. At the same position as the search range SRn,
The value of, for example, the pixel at the center position of the area SRn-2 of the field Fn-2 having the same size is used as the representative point Sn-2. The absolute value of the difference in brightness level between the representative point Sn-2 and a plurality of pixels within the search range SRn is calculated. The absolute value of the difference generated in the search range is the correlation value. A plurality of search ranges are set in one field, and the correlation value obtained in each search range is integrated over one field (or one detection region) to form an integrated value of the correlation value. 1 field (or 1 detection area) from this integrated value
Motion vector Mv is detected. However, in this case, the motion vector Mv indicates the motion amount in the two-field period.

In FIG. 12, reference numeral 40 is an embodiment of the motion vector detecting section to which the present invention is applied. Similar to the motion vector detecting unit 20 shown in FIG. 7 described above, the motion vector detecting unit 40 includes a filter processing circuit 42 to which a video signal from an input terminal 41 is input, a representative point storage circuit 43, a representative point and a pixel. Subtractor 4 for calculating the difference of
4, an absolute value conversion circuit 45 for converting the difference into an absolute value, a cumulative addition circuit 46, and a motion vector generation circuit 47. As in the case of FIG. 8, a motion vector detection device (reference numeral 2 ′) is configured by adding a configuration for reliability determination that determines the reliability of the detected motion vector.

A representative point storage permission signal is supplied from the terminal 48 to the representative point storage circuit 43. The representative point storage permission signal is a signal for controlling the storage operation so that the representative point is not stored in the field where the video signal is missing. As a result of the representative point storage circuit 43 not performing the storage operation,
The previously stored representative point data is saved as it is. Therefore, even if the previous field is missing, the subtractor 44 can calculate the correlation value.

FIG. 13 shows the structure of a camera shake correction device in one embodiment. The camera shake correction device includes a motion vector detection device 2 ′ that detects a motion vector from an input video signal from an input terminal 51, a correction control unit 53 to which the detected motion vector is supplied, and a correction control from the correction control unit 53. It is composed of a field memory 54 and an interpolator 55 for carrying out image stabilization by a signal, and outputs an image signal subjected to image stabilization. A representative point storage permission signal is supplied from the terminal 48 to the motion vector detection device 2 ′,
The representative point is stored in the field where the input video signal exists. A correction control permission signal synchronized with the representative point storage permission signal is supplied from the input terminal 56 to the correction control unit 53, and control is performed so that the correction operation is not performed in the field where the video signal is missing.

FIG. 14 is a timing chart showing the operation of the motion vector detecting device 2 '. 14A shows a vertical synchronizing signal, FIG. 14B shows an exposure operation, and FIG. 14C shows a video signal input. For example, the image signal of the field Fn is formed by the exposure for one field period or more that spans the field Fn-2 and the field Fn-1. A representative point storage permission signal (FIG. 14D) having a high level is formed corresponding to the field in which the video signal exists. Further, a correction control permission signal (FIG. 14E) synchronized with the representative point storage permission signal is generated. The representative point storage permission signal is generated according to the set operation mode in the case of a camera-integrated recording / reproducing apparatus, for example.

FIG. 15 shows a correlation calculation operation in one embodiment of the present invention, and FIG. 15A shows a vertical synchronizing signal.
FIG. 15B shows the exposure period. As shown in FIG. 15C, a representative point is extracted from the video signal existing in the field Fn-2 and stored in the representative point storage circuit 43. The representative point and the pixel value of the field Fn are subtracted by the subtractor 44 and converted into an absolute value, whereby a correlation value is generated.

The present invention is not limited to the above-described embodiment of the present invention and the like, and various modifications and applications are possible without departing from the gist of the present invention. For example, the present invention can be applied to the case where exposure is performed for more than 2 field periods. Further, the present invention can be applied to the case of obtaining both picked-up images of moving images and still images.

[0041]

According to the present invention, by controlling the storage permission of the representative point storage in a cycle according to the exposure time, it becomes possible to detect the motion vector even when the exposure time extends over several fields. It is possible to perform camera shake correction using the motion vector. Further, in the present invention, when the exposure time exceeds one field or one frame, the correction control is performed only in the field in which the video signal exists, so that the correction operation can be performed correctly.

[Brief description of drawings]

FIG. 1 is a block diagram illustrating an example of a camera shake correction device.

FIG. 2 is a schematic diagram used to describe a motion vector detection method.

FIG. 3 is a schematic diagram showing a detection area for detecting a motion vector.

FIG. 4 is a schematic diagram showing a relationship between a representative point for motion vector detection and a search range.

FIG. 5 is a schematic diagram for explaining an integrated value of correlation values.

FIG. 6 is a schematic diagram showing a three-dimensional integrated value of a correlation value.

FIG. 7 is a block diagram of an example of a motion vector detection device.

FIG. 8 is a block diagram of an example of a motion vector detection device.

FIG. 9 is a schematic diagram used for explaining reliability evaluation of a detected motion vector.

FIG. 10 is a timing chart for explaining a motion vector detecting operation.

FIG. 11 is a schematic diagram for explaining a motion vector detecting operation according to the present invention.

FIG. 12 is a block diagram of an embodiment of a motion vector detecting device according to the present invention.

FIG. 13 is a block diagram of an embodiment of an image stabilization apparatus according to the present invention.

FIG. 14 is a timing chart used for explaining the image stabilization according to the present invention.

FIG. 15 is a timing chart for explaining a motion vector detecting operation according to the present invention.

[Explanation of symbols]

2, 2 '... Motion vector detection device, 20, 40 ...
・ Motion vector detection unit, 43 ... Representative point storage circuit, 4
4 ... Subtractor, 46 ... Cumulative addition circuit, 48 ...
Representative point storage permission signal input terminal, 53 ... Correction control unit, 54 ... Field memory, 56 ... Correction control permission signal input terminal

Claims (5)

[Claims] 1. A motion vector detecting device for detecting a motion vector caused by camera shake of an imaging device from an input video signal, and a representative point storing means for extracting and storing a plurality of representative points from a field or frame temporally preceding. Correlation value calculation means for setting a plurality of regions including pixels at the same positions as the representative points in the current field or frame and calculating a correlation value between the plurality of pixels in each region and the representative points An integrating means for integrating the correlation value from the correlation value calculating means within a predetermined range, and a motion vector determining means for determining a motion vector within the predetermined range based on the integrated value of the correlation values from the integrating means. If a field or frame in which the video signal is missing occurs as a result of the exposure time being longer than one field or one frame, the video signal is present. In field or frame only, a motion vector detecting device in which the representative point storage means is to perform the storage operation of the representative points. 2. A representative point storing step for extracting and storing a plurality of representative points from a temporally previous field or frame in a motion vector detecting method for detecting a motion vector caused by camera shake of an imaging device from an input video signal. A correlation value calculating step of setting a plurality of regions including pixels at the same positions as the respective representative points in the current field or frame and calculating a correlation value between the plurality of pixels in each region and the representative point; , An integration step for integrating the calculated correlation value in a predetermined range, and a motion vector determination step for determining a motion vector in the predetermined range based on the obtained integrated value of the correlation value. If a field or frame in which the video signal is missing is generated as a result of longer than one field or one frame, the video signal is present. In field or frame only, a motion vector detection method to perform the processing of the representative point storing step. 3. A camera shake correction apparatus for detecting a motion vector caused by camera shake of an image pickup apparatus from an input video signal and correcting the camera shake by the detected motion vector, a memory for accumulating a video signal to be corrected, and a motion vector detection. The motion vector detecting device includes a device and a correction control unit, and the motion vector detecting device includes a representative point storage unit that extracts and stores a plurality of representative points from a temporally previous field or frame, and the representative point in the current field or frame. Correlation value calculating means for setting a plurality of areas including pixels at the same position as each of the points and calculating a correlation value between the plurality of pixels in each area and the representative point, and correlation from the correlation value calculating means An integrating means for integrating the value in a predetermined range, and a motion for determining the motion vector in the predetermined range based on the integrated value of the correlation value from the integrating means. When a field or frame in which a video signal is missing is generated as a result of the exposure time being longer than one field or one frame, the representative point storage means is provided only in the field or frame in which the video signal exists. The correction control means is supplied with the motion vector from the motion vector determination means, and controls the memory so as to correct camera shake based on the motion vector. In the case where a field or frame in which a video signal is missing is generated as a result of the exposure time being longer than one field or one frame, the camera shake is such that the control operation is performed only in the field or frame in which the video signal exists. Correction device. 4. A camera shake correction method for detecting a motion vector caused by a camera shake of an imaging device from an input video signal and correcting the camera shake by the detected motion vector, wherein a plurality of representative points are temporally preceding a field or frame. The representative point storing step of extracting and storing, and setting a plurality of areas including pixels at the same position as each of the representative points in the current field or frame, and setting a plurality of pixels in each area and the representative point Correlation value calculation step for calculating the correlation value, integration step for integrating the calculated correlation value in a predetermined range, and motion for determining the motion vector in the predetermined range based on the calculated integration value of the correlation value Based on the vector determination step and the motion vector obtained in the motion vector determination step, the input image signal is When the field or frame in which the video signal is lost occurs as a result of the exposure time being longer than one field or one frame, the field or frame in which the video signal exists The processing of the storage step of the representative point is performed only in the frame, and when the field or frame in which the video signal is missing is generated as a result of the exposure time being longer than 1 field or 1 frame, the field in which the video signal exists Alternatively, a camera shake correction method in which the process of the correction control step is performed only in a frame. 5. An image pickup apparatus equipped with a shake correction device for detecting a motion vector caused by a shake of an image pickup device from an input video signal and correcting the shake according to the detected motion vector, wherein the shake correction device is an image to be corrected. The motion vector detecting device includes a memory for accumulating signals, a motion vector detecting device, and a correction control means, and the motion vector detecting device extracts a plurality of representative points from a temporally previous field or frame and stores them. And a correlation value calculating means for setting a plurality of regions including pixels at the same position as each of the representative points in the current field or frame, and calculating a correlation value between the plurality of pixels in each region and the representative point. An integrating means for integrating the correlation value from the correlation value calculating means within a predetermined range, and the predetermined value based on the integrated value of the correlation values from the integrating means. When a field or frame in which a video signal is missing occurs as a result of the exposure time being longer than one field or one frame, the motion vector determining means for determining the motion vector in the range is included in the field or frame in which the video signal exists. Only, the representative point storage means performs the storage operation of the representative point, and the correction control means is supplied with the motion vector from the motion vector determination means, and corrects the camera shake based on the motion vector. When the field or frame in which the video signal is missing is generated as a result of the exposure time being longer than 1 field or 1 frame, the control is performed only in the field or frame in which the video signal exists. An imaging device adapted to perform an operation.