JP2004023673A - Motion vector detecting apparatus and method therefor movement compensation and method therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce a calculation volume and reduce circuit size maintaining required precision of a motion vector. <P>SOLUTION: The motion vector is specified between a pixel position of a searching block 53 where calculated difference absolute value sum is minimum and a pixel position of a standard pixel 58, by calculating in sequence the difference absolute value sum of the pixel value between a standard block 51 which makes the standard pixel 58 in a standard field 30 before 1 frame or 2 frames from a reference field 40 inputted as an original point and the searching block 53 moved the reference field 40 at least every other one pixel in vertical direction or/and at least every other one pixel in horizontal direction. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a motion vector detection device and method, and a motion correction device and method that can reduce the circuit scale while reducing the effect on image quality.
[0002]
[Prior art]
As a scanning method of television broadcasting, an interlaced scanning method of skipping every other horizontal scanning line and scanning has been most widely used. In this interlaced scanning method, one frame image is formed by a field image composed of odd-numbered scanning lines and a field image composed of even-numbered scanning lines, so that the entire screen appears flickering. And prevent deterioration of screen quality.
[0003]
This interlaced scanning system is adopted as a television standard system in various countries around the world. Among them, for example, in a PAL (Phase Alternation by Line) system in European television broadcasting, a field frequency is 50 [Hz] (frame image). Is 25 frames / sec, and the field image is 50 fields / sec).
[0004]
In particular, in this PAL system, in order to further suppress surface flicker interference, the input image signal is subjected to processing such as interpolation to convert the field frequency from 50 Hz to a doubled 100 Hz image signal. The method has been adopted conventionally.
[0005]
FIG. 14 shows a block configuration example of the field double speed conversion circuit 5 to which the field frequency double system is applied. The field double speed conversion circuit 5 is integrated in a television receiver 6 including an input terminal 61, a CRT 63, and a horizontal / vertical deflection circuit 62. The field double speed conversion circuit 5 includes a double speed conversion unit 51 and a frame memory 52.
[0006]
The double speed conversion unit 51 writes, for example, an image signal of 50 fields / second in the PAL system, input from the input terminal 61, to the frame memory 52. Further, the double speed conversion unit 51 reads out the image signal written in the frame memory 52 at twice the speed at the time of writing. As a result, the frequency of the image signal of 50 fields / second is doubled, and an image signal of 100 fields / second can be generated.
[0007]
The double speed conversion unit 51 outputs the double speed converted image signal to the CRT 63. The CRT 63 displays the input image signal on a screen. The horizontal and vertical deflection of the image signal in the CRT 63 is controlled based on a horizontal and vertical sawtooth wave generated by the horizontal and vertical deflection circuit 62 and having a frequency twice that of the input image signal.
[0008]
FIG. 15 shows the relationship between each field and the pixel position in each image signal before and after the double speed conversion. Here, the horizontal axis indicates time, and the vertical axis indicates the vertical position of the pixel. The image signal indicated by a white circle in FIG. 15A is an interlaced image signal of 50 fields / sec before double-speed conversion, and the image signal indicated by a black circle in FIG. This is an interlaced image signal of field / second.
[0009]
In the image signal shown in FIG. 15A, the field f1 and the field f2 are signals generated from the same frame of the film, and similarly, the field f3 and the field f4 also form the same frame. Since these image signals are interlaced image signals, pixel positions in the vertical direction differ between adjacent fields. For this reason, it is not possible to newly generate one field between each field while maintaining the interlace property.
[0010]
Therefore, as shown in FIG. 15B, two new fields f′2 and f′1 are generated between the field f1 and the field f2. Then, no field is generated between the field f2 and the field f3, and two new fields f'4 and f'3 are generated between the field f3 and the field f4. That is, one frame is formed by four fields and two frames.
[0011]
In each of the newly generated fields f′1, f′2,..., A pixel value may be obtained using a median filter or the like as an intermediate value of three pixels surrounding each pixel. The newly generated fields f′1, f′2,... Have the same contents as the fields f1, f2,.
[0012]
That is, the field double-speed conversion circuit 5 alternately arranges a part for newly generating two fields and a part for no generation between the fields of the image signal before the double-speed conversion, thereby reducing the number of screens per unit time. It is possible to suppress the above-mentioned surface flicker disturbance.
[0013]
By the way, in order to watch a movie film composed of 24 frames / second still images on a normal television, a television cinema conversion (hereinafter referred to as a telecine conversion) is performed in order to make an interlaced TV signal. FIG. 16 shows the relationship between each field and the image position when the image moves in the horizontal direction in the image signal after the telecine conversion. Here, the horizontal axis represents the position of the image in the horizontal direction, and the vertical axis represents time. In the image signal before the double-speed conversion shown in FIG. 16A, the fields f1 and f2 constitute the same frame, so that the image is displayed at the same position. This image moves in the horizontal direction (rightward) when shifting to the field f3. The field f4 is displayed at the same position as the field f3 because it constitutes the same frame as the field f3.
[0014]
When the image signal after the telecine conversion shown in FIG. 16A is double-speed-converted by the field frequency double method, as shown in FIG. 16B, the fields f1, f'2, and f'1 constituting the same frame , F2, the same image is displayed at the same position. Similarly, the same image is displayed at the same position in the fields f3, f'4, f'3, and f4 constituting the same frame.
[0015]
FIG. 17A shows a relationship between each field and an image position when an image moves in the horizontal direction in a television signal (hereinafter, referred to as a TV signal) before double-speed conversion. In FIG. 17A, since the fields f1, f2, f3,... Form independent frames, images are displayed at different positions. This image moves in the horizontal direction (rightward) every time the image f1 shifts from the field f1 to f2, f3.
[0016]
When the image signal of the TV signal shown in FIG. 17A is double-speed-converted by the field frequency double speed method, as shown in FIG. 17B, in the fields f1 and f'2 constituting the same frame, The same image is displayed. Similarly, the same image is displayed at the same position in the fields f'1 and f2 constituting the same frame.
[0017]
By the way, as shown in FIG. 16B, in the image signal subjected to the double speed conversion after the telecine conversion, the image is displayed at the same position in the fields f1 to f2, but largely in the horizontal direction when shifting to f2 to f3. Moving. Similarly, as for the image signal obtained by converting the TV signal at double speed, as shown in FIG. 17B, the image is displayed at the same position in the fields f1 to f′2, and shifts to f′2 to f′1. If you move heavily horizontally. In particular, since the output image signal regularly configures each field with a period of 1/100 second, the time zone in which the image operates is shorter than the time zone in which the image is stationary, and the output image signal is actually transmitted via the CRT. There has been a problem that when watching a program, the movement of the image looks discontinuous.
[0018]
For this reason, conventionally, in order to eliminate such a discontinuity of motion, a screen is divided into blocks of predetermined pixels based on, for example, a block matching method, and a motion vector is obtained by evaluating an approximation degree for each block. In addition, the motion is corrected by shifting the pixel position for each block according to the obtained motion vector.
[0019]
In this block matching method, as shown in FIG. 18, the reference field is divided into a plurality of reference blocks 101, and a block having the highest similarity with the reference block 101 in the reference field 80 is searched for in the search range 104 in the reference field 90. It is detected from the search block 103 moving inside. Then, the detected position shift (direction and magnitude of movement) between the search block 103 and the reference block 101 is used as a motion vector.
[0020]
In the above-described determination of the degree of approximation, first, a difference between each pixel value of the search block 103 and a corresponding pixel value of the reference block 101 is obtained, and an evaluation value indicated by the difference, for example, a sum of absolute difference values is obtained. Next, the above-described determination operation is performed on all the search blocks 103, and the minimum evaluation value is obtained from the obtained evaluation value sums, that is, the difference absolute value sums. The search block 103 giving the minimum sum of absolute differences is a block showing the highest similarity to the reference block 101, and a motion vector is specified according to the pixel position of the block.
[0021]
By performing motion correction on each pixel of the above-described double-speed-converted image signal so that the correction amount is within the range of the vector amount in the vector direction of the motion vector obtained in this manner, the above-described motion of the image is performed. Can be eliminated.
[0022]
FIG. 19A is a diagram showing a case where motion correction is performed for each pixel of the image signal subjected to the double speed conversion after the telecine conversion shown in FIG. 16B, and FIG. FIG. 9 is a diagram illustrating a case where motion correction is performed for each pixel of an image signal obtained by performing double-speed conversion on the TV signal shown.
[0023]
In the case of FIG. 19A, the motion vector a11 is obtained between the field f1 and the field f3, and the motion vector a11 is obtained in the vector direction of the obtained motion vector a11 and within the range of the vector amount. Each pixel is gradually shifted.
[0024]
In the case of FIG. 19B, a motion vector b11 is obtained between the field f1 and the field f′1, and the pixel of the field f′2 is set in the vector direction of the obtained motion vector b11 and within the range of the vector amount. Shift. Similarly, the motion vector b12 is obtained between the field f'1 and the field f3, and the pixels of the field f2 are shifted in the vector direction of the obtained motion vector b12 and within the range of the vector amount.
[0025]
As a result, each pixel of the field constituting the frame can be shifted to the position shown by the dotted line, and smooth motion can be realized as a whole. Therefore, the above-described discontinuity of the motion of the image can be improved. It becomes possible.
[0026]
[Problems to be solved by the invention]
However, the above-described reference block 101 and search block 103 are simply obtained by dividing the screen into a set of a predetermined number of pixels, and the blocks 101 and 103 are configured such that pixels are spread without gaps. When determining the above-described degree of similarity between the reference block 101 and the search block 103, the absolute difference values are obtained for all the pixels constituting each of the blocks 101 and 103, and the sum of the absolute difference values is calculated. Operation must be performed, and the circuit scale is significantly increased.
[0027]
Further, since the image signal generated by the double speed conversion after the telecine conversion is composed of four fields per frame, it is obtained by comparing with the image signal composed of two fields per frame obtained by double-converting the TV signal. The vector amount of the motion vector is large (see a11, b11, b12 in FIG. 19). For this reason, when motion-correcting the image signal after the telecine conversion, the search block 104 must be set wider and the search block 103 must be sequentially moved as compared with the case of the TV signal. The amount of calculation further increases the circuit scale.
[0028]
Further, even when both the image signal and the TV signal after the telecine conversion are input, it is necessary to efficiently eliminate the discontinuity of the image movement described above. In order to satisfy the above, it is necessary to unify the circuit scale by making the amount of operation equal to that when a TV signal is input, regardless of which signal is input.
[0029]
Therefore, the present invention has been proposed in view of the above-described problems, and a motion vector detection device and method capable of reducing the circuit size by reducing the amount of calculation of the absolute value of the difference while reducing the influence on the image quality. And a motion compensation device and method.
[0030]
[Means for Solving the Problems]
In order to solve the above-described problem, the present inventor has set a reference block whose origin is a reference pixel in a reference field one frame or two frames before an input reference field, and sets the reference field at least every other vertical pixel. And / or sequentially calculate the sum of absolute differences of pixel values between the search block shifted at least every other horizontal pixel, and the pixel position of the search block in which the calculated sum of absolute differences is minimum and the reference pixel A motion vector detecting apparatus and method capable of reducing the amount of calculation while maintaining the accuracy of the required motion vector by specifying the motion vector between the pixel positions of the motion vector and the circuit size. Invented.
[0031]
That is, in order to solve the above-described problem, the motion vector detection device according to the present invention detects a motion vector by a block matching method for each pixel of a reference field one frame or two frames before an input reference field. In the motion vector detecting device, a reference block having a reference pixel in the reference field as an origin is cut out, and a search block in the reference field is moved at least every vertical pixel and / or at least every horizontal pixel to cut out a block. Output means, vector calculating means for sequentially calculating the sum of absolute differences of pixel values between the reference block and the search block cut out by the block extracting means, and the sum of absolute differences calculated by the vector calculating means. Pixel position of minimum search block and the above reference Characterized in that it comprises a vector specifying means for specifying a motion vector between a pixel position of the element.
[0032]
In addition, in order to solve the above-mentioned problem, the motion vector detection method according to the present invention detects a motion vector by a block matching method for each pixel of a reference field one frame or two frames before an input reference field. In the motion vector detecting method, a reference block having a reference pixel as an origin in the reference field is cut out, and a search block in the reference field is cut out by moving at least every vertical pixel or / and at least every horizontal pixel. The difference absolute value sum of the pixel values is sequentially calculated between the cut-out reference block and the search block, and the sum of the calculated difference absolute value sum is minimized between the pixel position of the search block and the pixel position of the reference pixel. It is characterized in that a motion vector is specified.
[0033]
In addition, in order to solve the above-described problem, the inventor sets a reference block whose origin is a reference pixel in a reference field one frame or two frames before an input reference field, and sets a reference field at least every other vertical pixel. And / or sequentially calculating the sum of absolute differences of pixel values between the search block and the search block moved at least every other horizontal pixel to detect a motion vector, and determine the position of the reference pixel in the reference field based on the motion vector. We have invented a device and method for shifting motion compensation.
[0034]
That is, in order to solve the above-described problem, the motion compensation device according to the present invention includes a motion compensation device that performs motion compensation for each pixel of the reference field two frames before the input reference field. , And a search block in which the reference field is moved at least every other vertical pixel and / or at least every other horizontal pixel, to sequentially calculate the sum of absolute differences of pixel values. Vector specifying means for specifying a motion vector between the pixel position of the search block and the pixel position of the reference pixel in which the sum of absolute differences is minimized, and in the vector direction of the motion vector specified by the vector specifying means. The position of the reference pixel in the reference field is shifted so that the shift amount is within the range of the vector amount. Characterized in that it comprises a pixel shifting means for.
[0035]
Further, in order to solve the above-described problem, the motion compensation apparatus according to the present invention includes a motion compensation apparatus that performs motion compensation for each pixel of a reference field one frame before a reference field to be input. The sum of absolute differences of pixel values is sequentially calculated between the reference block that is the origin and the search block in which the reference field is moved at least every other pixel and / or at least every other pixel, and the calculated sum is calculated. A vector specifying unit that specifies a motion vector between the pixel position of the search block in which the sum of absolute differences is the minimum and the pixel position of the reference pixel, and a vector direction of the motion vector specified by the vector specifying unit. The position of the reference pixel in the reference field is shifted so that the shift amount is within the range of the vector amount. Characterized in that it comprises a pixel shift unit that.
[0036]
In addition, in order to solve the above-described problem, the motion compensation device according to the present invention is configured such that motion compensation is performed for each pixel of a reference field one frame before or two frames before an input reference field. Switching means for switching the reference field one frame before or two frames before; a reference block whose origin is a reference pixel in the reference field switched by the switching means; and the reference field at least every other vertical pixel and / or The difference absolute value sum of the pixel values is sequentially calculated between the search block shifted every other horizontal pixel and the pixel position of the search block in which the calculated difference absolute value sum is the minimum and the pixel position of the reference pixel. Vector specifying means for specifying a motion vector between The vector direction of a motion vector, shift amount to be within a range of the vector quantity, characterized in that it comprises a pixel shifting means for shifting the position of the reference pixel in the reference field.
[0037]
That is, in order to solve the above-described problem, the motion compensation method according to the present invention provides a motion compensation method for performing motion compensation for each pixel of the reference field two frames before the input reference field. , And a search block in which the reference field is moved at least every other pixel vertically and / or at least every other horizontal pixel, and sequentially calculates the sum of absolute differences of pixel values. A motion vector is specified between the pixel position of the search block in which the sum of absolute differences is the minimum and the pixel position of the reference pixel, and the shift amount is within the range of the vector amount in the vector direction of the specified motion vector. Pixel shift means for shifting the position of a reference pixel in the reference field. That.
[0038]
In order to solve the above-mentioned problem, the motion compensation method according to the present invention is a motion compensation method for performing motion compensation for each pixel of a reference field one frame before a reference field to be input. The difference absolute value sum of pixel values is sequentially calculated between the reference block as the origin and the search block in which the reference field is moved at least every other pixel and / or at least every other pixel, and the calculated difference absolute value is calculated. A motion vector is specified between the pixel position of the search block where the sum of the values is minimum and the pixel position of the reference pixel, and the shift amount in the vector direction of the specified motion vector is within the range of the vector amount. As described above, the position of the reference pixel in the reference field is shifted.
[0039]
Further, in order to solve the above-mentioned problem, the motion compensation method according to the present invention provides a motion compensation method for performing motion compensation for each pixel of a reference field one frame before or two frames before an input reference field. The reference field one frame before or two frames before is switched, and the reference block having the reference pixel as the origin in the switched reference field and the reference field are moved at least every other vertical pixel and / or at least every other horizontal pixel. The sum of the absolute values of the pixel values is sequentially calculated between the search block and the search block, and the motion vector is calculated between the pixel position of the search block where the calculated sum of the absolute differences is minimum and the pixel position of the reference pixel. And the shift amount in the vector direction of the specified motion vector is within the range of the vector amount. As, characterized in that shifting the position of the reference pixel in the reference field.
[0040]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a motion compensation device and method and a motion vector detection device and method to which the present invention is applied will be described in detail with reference to the drawings.
[0041]
FIG. 1 is a block diagram of a motion compensation device 1 according to the first embodiment of the present invention. The motion compensation device 1 is built in a television receiver of, for example, a PAL (Phase Alternation by Line) system, and includes a first image memory 11, a second image memory 12, a switch 13 as shown in FIG. , A motion vector detecting unit 14 and an image shifting unit 15.
[0042]
The first image memory 11 performs double-speed conversion on an interlaced image signal (hereinafter referred to as a TV signal) in which one frame is composed of two fields generated by performing double-speed conversion on a television signal, or an image obtained by performing telecine conversion. Thus, an interlaced image signal (hereinafter, referred to as a telecine conversion signal) in which one frame is composed of four fields is sequentially supplied.
[0043]
The first image memory 11 stores the supplied image signal for one frame for each field. That is, the image signal output from the first image memory 11 is one frame before the image signal supplied to the first image memory 11.
[0044]
The second image memory 12 has the same internal configuration as the first image memory 11, and stores one frame of the image signal supplied from the first image memory 11 in units of fields. That is, the image signal output from the second image memory 12 is one frame before the image signal supplied to the second image memory 12 and is two frames ahead of the image signal supplied to the first image memory 11. Before the frame. The image signal stored in the second image memory 12 is supplied to the image shift unit 15 and the motion vector detection unit 14. Hereinafter, the image signal transmitted from the second image memory 12 to the motion vector detection unit 14 is referred to as a reference field 30.
[0045]
The switch 13 sequentially switches an image signal supplied to the first image memory 11 and an image signal output from the first image memory 11, and transmits this to the motion vector detection unit 14. Hereinafter, the image signal transmitted from the switch 13 to the motion vector detecting unit 14 is referred to as a reference field 40. When a TV signal is input, the switch 13 is switched to the “normal” side in FIG. 1, and the reference field 40 transmitted to the motion vector detection unit 14 is one frame after the reference field 30. . On the other hand, when the telecine conversion signal is input, the switch unit 13 is switched to the “film” side in FIG. 1, and the reference field 40 transmitted to the motion vector detection unit 14 is two frames after the reference field 30. It becomes.
[0046]
The motion vector detection unit 14 detects a motion vector for each block or pixel based on the supplied reference field 30 and reference field 40, and outputs information on the detected motion vector or a shift amount and a shift direction based on the motion vector. Output to the image shift unit 15.
[0047]
The image shift unit 15 receives a motion vector detected by the motion vector detection unit 14 or information such as a shift amount based on the motion vector for each block or each pixel. Further, the image shift unit 15 shifts each pixel position or each block in the image signal supplied from the second image memory 12 in the vector direction within the range of the vector amount of the received motion vector. Note that the image shift unit 15 outputs the image signal shifted in the vector direction to the CRT 2. The CRT 2 displays the input image signal on a screen. The horizontal and vertical deflection of the image signal in the CRT 2 may be controlled based on a horizontal / vertical deflection circuit (not shown).
[0048]
In some cases, the motion correction device 1 is integrated with a field double speed conversion circuit 3 that doubles the field frequency of the image signal. The field double speed conversion circuit 3 is integrated so as to prevent surface flicker interference by improving the resolution. The image signal is converted into a double 100 Hz image signal.
[0049]
As shown in FIG. 1, the field frequency conversion circuit 3 includes an input terminal 31 connected to a television receiver, a double speed conversion unit 32, and a frame memory 33.
[0050]
The double-speed converter 32 writes the telecine-converted image signal input from the television receiver via the input terminal 31 to the frame memory 33. Further, the double speed conversion unit 32 reads out the image signal written in the frame memory 33 at twice the speed at the time of writing. Thus, for example, the frequency of an image signal of 50 fields / second in the PAL system can be doubled to generate an image signal of 100 fields / second. The double speed conversion unit 32 supplies the double speed converted image signal to the motion correction device 1.
[0051]
FIG. 2 shows the relationship between each field and the pixel position before and after the double speed conversion in the field double speed conversion circuit 3. Here, the horizontal axis indicates time, and the vertical axis indicates the vertical position of the pixel.
[0052]
The image signal before double-speed conversion is an interlaced image signal of 50 fields / second in the PAL system, and one frame is formed by two fields as shown in FIG.
[0053]
On the other hand, since the image signal after the double speed conversion is an interlaced image signal of 100 fields / second, as shown in FIG. 2B, two fields t 'are newly added between the fields t1 and t2. 2. Generate t′1. Then, no field is generated between the fields t2 and t3, and two new fields t'4 and t'3 are generated between the fields t3 and t4. That is, in the case of an image signal, for example, a telecine conversion signal, one frame is formed in four fields.
[0054]
In each of the newly generated fields t′1, t′2,..., Each pixel value may be obtained as an intermediate value of three pixels around each pixel. The newly generated fields t'1, t'2, ... have the same contents as the fields t1, t2, ..., respectively. As a result, for example, in the case of a telecine conversion signal, one frame is formed in four fields, the resolution can be improved by increasing the number of screens per unit time, and it is possible to suppress surface flicker interference. Become.
[0055]
Next, the operation of the motion compensating apparatus 1 to which the present invention is applied will be described by taking a case where a TV signal is input as an example.
[0056]
The motion compensation device 1 is supplied with a TV signal composed of two fields, one frame generated by performing a double speed conversion of a television signal, from the field double speed conversion circuit 3 sequentially. FIG. 3 shows the relationship between each field and the image position when the image moves in the horizontal direction of the TV signal. In FIG. 3, the horizontal axis represents the position of the image in the horizontal direction, and the vertical axis represents time. The same image is displayed at the same position in the fields t1 and t'2 constituting the same frame in the TV signal which has been double-speed converted by the field frequency double speed method. Similarly, the same image is displayed at the same position in the fields t'1 and t2 constituting the same frame.
[0057]
The switch 13 is switched to the “normal” side in FIG. 1 in response to the TV signal, and the reference field 30 and the reference field 40 one frame after the reference field 30 are supplied to the motion vector detection unit 14.
[0058]
The motion vector detection unit 14 detects a motion vector between the reference field 30 and the reference field 40 for each pixel or each block based on, for example, a block matching method.
[0059]
The motion vector detecting unit 14 divides the reference field 30 into a reference block 51 composed of m × n pixels centered on the reference pixel 58 as shown in FIG. Is detected from the search block 53 moving within the search range 54 in the reference field 40 shown in FIG. 4B. The search block 53 is composed of m × n pixels having the same size as the reference block 51 with the center pixel 59 at the center, and the search range 54 in which the search block 53 moves is composed of M × N pixels. The motion vector detection unit 14 specifies a motion vector between the reference block 51 and the center pixel 59 of the search block 53 having the highest similarity.
[0060]
In the above-described determination of the degree of similarity, first, a difference between each pixel value of the search block 53 and a corresponding pixel value of the reference block 51 is obtained, and an evaluation value indicated by the difference, for example, a sum of absolute differences is obtained. Next, the above-described determination operation is performed for all the search blocks 53, and the smallest evaluation value is obtained from the obtained evaluation values, that is, the sums of the difference absolute values. The search block 53 that gives the minimum sum of absolute differences is a block showing the highest similarity to the reference block 51, and a motion vector is specified according to the pixel position of the block.
[0061]
Incidentally, the search block 53 moves so that the center pixel 59 scans all the pixels constituting the search range 54 shown in FIG. 4B. In other words, the search block 53 moves so as to shift the search range 54 by one pixel. Thereby, the accuracy of the required motion vector can be improved.
[0062]
In the case of the example shown in FIG. 3, the vector direction of the motion vector is rightward with respect to the reference field 30, and the vector amount is C when the reference field is t'1. Similarly, when the reference field is t3, the reference field is t'1, and the vector amount of the motion vector is D. By repeating this procedure, the vector direction and vector amount of the motion vector based on the reference field 30 can be sequentially obtained. The motion vector detection unit 14 sequentially transmits the obtained vector amount and vector direction of the motion vector to the image shift unit 15.
[0063]
The image shift unit 15 shifts the position of the detection pixel in the vector direction of the image signal supplied from the first image memory 12 based on the context of each field. Here, of the two fields composing the frame, when the first input field is the first field and the second input field after the first field is the second field, the shift amount of each field is set. Are sequentially increased so that the first field <the second field, as shown in FIG. In order to determine whether each field corresponds to the first field or the second field, it is necessary to detect a sequence in units of two fields. Since the field corresponding to is determined, there is no need for such sequence detection.
[0064]
Also, when the image is shifted as described above, it can be indicated by a dotted line in FIG. 5, but the image is largely moved when shifting from the second field to the first field as compared with before the image is shifted. It is possible to smooth the movement of the image without causing the image to move.
[0065]
By integrating the field double speed conversion circuit 3 in the motion correction device 1 having such a configuration and incorporating it in the television receiver, it is possible to eliminate the sense of discontinuity of motion in the image obtained by double-speed converting the TV signal. it can. In other words, the image quality can be synergistically improved by improving the resolution by the field double speed conversion circuit 3 and further smoothing the movement of each image in which the flicker interference is suppressed.
[0066]
Therefore, not only the case where the motion compensating device 1 is implemented alone but also a remarkable effect can be obtained by implementing the motion compensating device 1 integrally with the field double speed conversion circuit 3. Further, even for a television receiver in which a field double speed conversion circuit is already integrated, it is possible to easily upgrade the version by incorporating the motion compensation device 1 later.
[0067]
The shift amount of the image in the image shift unit 15 is, for example, as shown in FIG. 6, the shift amount of the first field is set to 0, and the shift amount of the second field is 1 / the amount of the motion vector obtained by detecting the shift amount of the second field. It can be doubled. In the case of FIG. 6, the shift amount of the first field is set to 0, and when the vector amount is C, the second field is shifted by C × １ ／. When the vector amount is D, the second field is shifted by D × １ ／. Since one frame is composed of two fields, it is possible to increase the shift amount linearly with respect to time by increasing the vector amount by 倍 times, thereby further smoothing the motion of the image. Can be.
[0068]
Next, the operation of the motion compensating apparatus 1 to which the present invention is applied will be described using a case where a telecine conversion signal is input as an example.
[0069]
The motion correction device 1 is sequentially supplied from the field double speed conversion circuit 3 with a telecine conversion signal in which one frame generated by performing a double speed conversion of the telecine-converted image is composed of four fields. FIG. 7 shows the relationship between each field and the image position when the image moves in the horizontal direction of the telecine conversion signal. In FIG. 7, the horizontal axis represents the position of the image in the horizontal direction, and the vertical axis represents time. The telecine conversion signal double-speed converted by the field frequency conversion method is supplied to the first image memory 11 at fixed time intervals in the order of the fields t1, t'2, t'1, and t2, and the images are all the same. Displayed at the location. When the image shifts to the field t3, the image shifts in the horizontal direction (rightward), and is supplied to the first image memory 11 in the order of the fields t3, t'4, t'3, and t4.
[0070]
The switch 13 receives the telecine conversion signal and switches to the “film” side in FIG. 1. The reference field 30 and the reference field 40 two frames after the reference field 30 are supplied to the motion vector detection unit 14. .
[0071]
The motion vector detection unit 14 detects a motion vector between the reference field 30 and the reference field 40 for each pixel or each block based on, for example, a block matching method.
[0072]
The motion vector detection unit 14 divides the reference field 30 into reference blocks 51 each including m × n pixels centered on a reference pixel 58 as shown in FIG. Is detected from the search block 53 moving within the search range 54 in the reference field 40 shown in FIG. 8B. The search block 53 is composed of m × n pixels having the same size as the reference block 51 with the center pixel 59 at the center. The search range 54 in which the search block 53 moves is composed of 2M × 2N pixels, and Compared to the search range 54, the length and width are twice and the area is four times.
[0073]
That is, since the telecine conversion signal is composed of four fields per frame, the vector amount of the motion vector required is larger than that of a TV signal composed of two fields per frame. For example, when the moving speed of the image in the TV signal is the same as the moving speed of the image of the telecine conversion signal, it is necessary to set the search range of the telecine conversion signal to twice as large in the vertical and horizontal directions as described above. Incidentally, this search range is not limited to twice the length and width of the TV signal search range 54, and may be configured in any size.
[0074]
The motion vector detection unit 14 specifies a motion vector between the reference block 51 and the center pixel 59 of the search block 53 having the highest similarity.
[0075]
Note that the search block 53 moves so that the center pixel 59 scans only the pixels that constitute the search range 54 shown in FIG. In other words, the search block 53 moves so that the search range 54 is shifted every vertical and horizontal pixels. The search range 54 is composed of 2M × 2N pixels in the case of a telecine-converted signal, and is twice as long and wide (the area is four times) as compared with the search range 54 for TV signals. , The amount of calculation of the absolute difference value can be made equal to the search range 54 composed of M × N pixels of the TV signal.
[0076]
That is, according to the present invention, when a telecine-converted signal is input, a true motion vector can be obtained by making the search range 54 four times as large as the search range of the TV signal. Is scanned every other pixel in the vertical and horizontal directions, the amount of calculation of the absolute difference sum can be suppressed, and the circuit scale can be reduced.
[0077]
Further, in the motion compensating apparatus 1 that sequentially switches the image signal and the TV signal after the telecine conversion to perform the motion correction, particularly in the case of the telecine conversion signal in which the operation amount of the sum of absolute difference is enormous, the same as when the TV signal is input. By using the above calculation amount, the circuit scale can be unified, and the specifications of the television receiver can be satisfied.
[0078]
In the case of the example shown in FIG. 7, the vector direction of the motion vector obtained by the motion vector detecting unit 14 is rightward with respect to the reference field 30, and the vector amount is A when the reference field is t3. . Similarly, when the reference field is t5, the reference field is t3, and the vector amount of the motion vector is B. By repeating this procedure, the vector direction and vector amount of the motion vector based on the reference field 30 can be sequentially obtained. The motion vector detection unit 14 sequentially transmits the obtained vector amount and vector direction of the motion vector to the image shift unit 15.
[0079]
The image shift unit 15 shifts the position of the detection pixel in the vector direction in the image signal supplied from the second image memory 12 based on the context of each field. Here, of the four fields constituting the frame, the first field to be input is the first field, the field to be input next to the first field is the second field, and the third and fourth fields are the following fields. Subsequently, as shown in FIG. 9, the shift amount of each field is sequentially increased such that first field <second field <third field <fourth field.
[0080]
When the image is shifted as described above, as shown in FIG. 10, the image is not greatly moved when shifting from the fourth field to the first field as compared with before the image is shifted. Movement can be smooth.
[0081]
By integrating the field double speed conversion circuit 3 into the motion compensation device 1 having such a configuration and incorporating it in the television receiver, the circuit scale is almost the same as that of the TV signal even when a telecine conversion signal is input. It is possible to eliminate the sense of discontinuity in movement while suppressing the movement. In other words, the image quality can be synergistically improved by improving the resolution by the field double speed conversion circuit 3 and further smoothing the movement of each image in which the flicker interference is suppressed.
[0082]
This motion compensator 1 has a remarkable effect not only when implemented alone, but also when implemented integrally with the field double speed conversion circuit 3. In addition, the television receiver in which the field double speed conversion circuit is already integrated can easily be upgraded by incorporating the motion compensation device 1 later.
[0083]
The shift amount of the image in the image shift unit 15 is, for example, as shown in FIG. 11, the shift amount of the first field is set to 0, and the shift amount of the second field is １ ／ of the vector amount of the motion vector detected. It is also possible to increase the number by 1/4 times thereafter. At this time, the shift amount of the first field is set to 0, and when the vector amount is A, the second field is shifted by A × １ ／ and the third field is shifted by A ××. By shifting the fourth field by A × 3/4, the shift amount can be linearly increased with respect to time, and the motion of the image can be further smoothed.
[0084]
Incidentally, since the telecine conversion signal is searched by thinning out the search range 54 at every other pixel in the vertical and horizontal directions, there is a possibility that an error of one pixel is generated in the obtained motion vector. However, since the image shift unit 15 shifts the pixels by the number obtained by dividing the obtained motion vector by 4, such an error of one pixel is also divided by 4, which causes a visual inconvenience due to such pixels. Is almost completely eliminated. In the case of a telecine conversion signal composed of four fields per frame, image quality is significantly degraded due to discontinuous motion when no motion correction is performed. Since the motion vector can be greatly improved, even if the required accuracy of the motion vector is slightly low, there is almost no visual influence.
[0085]
Further, according to the present invention, when a telecine-converted signal is input, a low-pass filter (LPF) (not shown) can be applied in advance before the motion vector detecting unit 14 specifies a motion vector. By optimizing the LPF band, when the motion vector detection unit 14 searches the search range 54 every other pixel in the vertical and horizontal directions, even if the true motion vector exists at the pixel position where the motion vector is thinned out, it is completely different. It is possible to prevent a motion vector from being obtained.
[0086]
The example of detecting a motion vector when a telecine conversion signal is input is not limited to the above-described embodiment. For example, a motion vector may be detected by the following method.
[0087]
The motion vector detection unit 14 divides the reference field 30 into reference blocks 61 each having 2m × 2n pixels centered on the reference pixel 58 as shown in FIG. Is detected from the search block 63 moving within the search range 64 in the reference field 40 shown in FIG.
[0088]
The reference block 61 is twice as large in length and width and four times as large as the reference block 51 including m × n pixels. Further, since the reference block 61 is formed by thinning out every vertical and horizontal pixels, the number of pixels constituting the reference block 61 is the same as the number of pixels constituting the reference block 51. The search block 63 is composed of 2m × 2n pixels having the same size as the reference block 61, centered on the center pixel 59, and is thinned out every other pixel in the vertical and horizontal directions. The search range 64 in which the search block 63 moves is composed of 2M × 2N pixels. The search range 64 is twice as large as the search range 54 of the TV signal and the area is four times. The motion vector detection unit 14 specifies a motion vector between the reference block 51 and the center pixel 59 of the search block 63 having the highest similarity. The size of each of the blocks 61 and 63 and the search range 64 is not limited to the above, and may be any size.
[0089]
The search block 53 moves so that the center pixel 59 scans only the colored pixels every other vertical and horizontal pixels constituting the search range 54 shown in FIG. 9B. In other words, the search block 63 moves so as to shift the search range 64 shown in FIG. The search range 64 is composed of 2M × 2N pixels in the case of a telecine-converted signal, and is twice as large in the vertical and horizontal directions (the area is four times) as compared with the search range 64 for the TV signal. , The amount of calculation of the absolute difference value can be made equal to the search range 54 composed of M × N pixels of the TV signal.
[0090]
Note that, when the telecine-converted signal is input, the motion vector detection unit 14 sets the center pixel 59 over the search ranges 54 and 64 as shown in FIGS. 8B and 12B. The search is performed so as to scan over the pixels, in other words, the search blocks 53 and 63 are shifted every other pixel in the vertical and horizontal directions. However, the present invention is not limited to such a case. For example, as shown in FIG. 13 (a), the search may be performed by shifting only every horizontal pixel every other pixel, and may be performed without shifting every vertical pixel. Similarly, only the vertical search may be performed by shifting every other pixel, and the horizontal search may be performed without shifting by every other pixel. Further, the interval at which the pixels are shifted is not limited to one pixel, and it is sufficient that the pixels are shifted at least every one pixel, for example, every two pixels or every three pixels. FIG. 13B shows an example in which the search is performed by shifting the vertical by every other pixel and the horizontal by every three pixels. That is, in the present invention, any search method may be used as long as the search block is searched while being shifted at least every other pixel vertically and / or at least every other pixel horizontally. This makes it possible to reduce the circuit scale while making the search ranges 54 and 64 wide.
[0091]
The reference block 61 and the search block 63 shown in FIG. 12 need only be thinned out every other pixel in the vertical and horizontal directions, but need only be thinned out in every vertical and / or every other pixel. For this reason, it goes without saying that block matching may be performed using the reference block 61 and the search block 63 thinned out, for example, every two or three pixels.
[0092]
Further, the motion vector detecting section 14 is provided not only when a telecine conversion signal is input but also every other pixel in the vertical and horizontal directions as shown in FIGS. 8B and 12B when a TV signal is input. The search may be performed by moving the search block 53. The search may be performed by moving the search block 53 at least every other pixel vertically and / or at least every other horizontal pixel as shown in FIG. This makes it possible to further reduce the amount of calculation when a TV signal is input, and to maintain the accuracy of the required motion vector by optimizing the band of a low-pass filter (LPF) (not shown). It becomes possible.
[0093]
The motion correction device 1 to which the present invention is applied is not limited to the above-described embodiment. For example, in FIG. 1, the switch 13 can be constantly switched to the “normal” side. As a result, the reference field 40 transmitted to the motion vector detection unit 14 is always one frame later than the reference field 30. Therefore, the motion compensation device 1 employing such a configuration can perform motion compensation for only the TV signal. This constitutes a correction circuit. In this case, as in the case of the telecine conversion signal, the motion vector detection unit 14 searches the input TV signal every other pixel in the vertical and horizontal directions as shown in FIGS. 8B and 12B. Is searched by scanning. As a result, a motion vector can be obtained with a small amount of operation for the input TV signal, and the circuit scale can be reduced.
[0094]
Further, the motion compensating apparatus 1 to which the present invention is applied is not limited to the above-described embodiment. For example, in FIG. 1, the switch 13 can be constantly switched to the “film” side. As a result, the reference field 40 transmitted to the motion vector detection unit 14 is always two frames later than the reference field 30. Therefore, the motion compensation device 1 adopting such a configuration can perform motion compensation only on the telecine conversion signal. This constitutes a motion correction circuit. Thus, for a telecine conversion signal requiring a wider search range 54 than a TV signal, the amount of calculation of the absolute difference value can be reduced, and the circuit scale can be reduced.
[0095]
The present invention is not limited to the case where the present invention is applied to a television receiver based on the PAL system. For example, an interface of 60 field seconds (30 frames / second) of the NTSC (National TV System Committee) system is used. The present invention is also applicable to a television receiver to which a race image signal is input. Further, the present invention is also applicable to a television receiver based on the SECAM system.
[0096]
Further, the present invention can be incorporated not only in the case where the television receiver is built in, but also in a signal converter connected to the television receiver.
[0097]
The present invention can also be applied to a case where an image signal transmitted on the Internet is displayed on a PC or the like, or a case where a medium or an image format is converted.
[0098]
Further, although the present invention has been described in the form of being realized by hardware such as a circuit, it is needless to say that the present invention can also be realized by software on a processor.
[0099]
【The invention's effect】
As described in detail above, the apparatus and method for detecting a motion vector according to the present invention include a reference block whose origin is a reference pixel in a reference field one frame or two frames before an input reference field, and a search in a reference field. The sum of absolute differences of pixel values is sequentially calculated with a search block that moves within the range at least every vertical pixel and / or at least every horizontal pixel, and a search in which the calculated sum of differential absolute values is minimized. A motion vector is specified between the pixel position of the block and the pixel position of the reference pixel. As a result, the motion vector detection device and method according to the present invention can reduce the amount of calculation while maintaining the accuracy of the motion vector to be obtained, and can reduce the circuit scale.
[0100]
As described above in detail, the motion compensation apparatus and method according to the present invention provide a reference block having an origin at a reference pixel in a reference field one frame or two frames before an input reference field, and a search range in the reference field. The motion vector is detected by sequentially calculating the sum of absolute differences of the pixel values between the search block and the search block moving at least every other vertical pixel or / and at least every other horizontal pixel, and based on the motion vector, The position of the reference pixel in the reference field is shifted. Thus, the motion detection device according to the present invention can eliminate the discontinuity of motion while reducing the circuit size by reducing the amount of calculation.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a block configuration of a motion compensation device to which the present invention has been applied.
FIG. 2 is a diagram showing a relationship between each field and a pixel position before and after double-speed conversion in a field double-speed conversion circuit.
FIG. 3 is a diagram illustrating a relationship between each field and an image position when an image moves in a horizontal direction in a TV signal.
FIG. 4 is a diagram illustrating an operation when a TV signal is input in a motion vector detection unit.
FIG. 5 is a diagram illustrating an example in which a pixel position is shifted with respect to an input TV signal in an image shift unit.
FIG. 6 is a diagram illustrating an example in which the image shift unit sets the shift amount of the first field to 0 and sets the shift amount of the second field to 倍 times the vector amount of the detected motion vector.
FIG. 7 is a diagram showing a relationship between each field and an image position when an image moves in a horizontal direction in a telecine conversion signal.
FIG. 8 is a diagram for explaining an operation when a telecine conversion signal is input in a motion vector detection unit.
FIG. 9 is a diagram illustrating an example in which a pixel position is shifted with respect to an input telecine conversion signal in an image shift unit.
FIG. 10 is a diagram illustrating an example in which the movement of an image is smoothed as a result of shifting a pixel position in an image shift unit.
FIG. 11 is a diagram illustrating an example in which the shift amount of the first field is set to 0 in the image shift unit, and thereafter, the shift amount is increased by １ ／ times the vector amount of the motion vector.
FIG. 12 is a diagram showing an example in which a motion vector is detected based on each block formed by thinning out every other pixel in the vertical and horizontal directions.
FIG. 13 is a diagram showing an example in which a search block 53 is moved at least every other pixel vertically and / or at least every other horizontal pixel.
FIG. 14 is a block diagram of a field double speed conversion circuit to which a field frequency double speed system is applied.
FIG. 15 is a diagram showing a relationship between each field and a pixel position before and after double-speed conversion.
FIG. 16 is a diagram illustrating a relationship between each field and an image position when an image moves in a horizontal direction when a telecine conversion signal is input.
FIG. 17 is a diagram illustrating a relationship between each field and an image position when an image moves in a horizontal direction when a TV signal is input.
FIG. 18 is a diagram for describing a conventional block matching method.
FIG. 19 is a diagram illustrating an example of obtaining a motion vector for a telecine conversion signal and a TV signal.
[Explanation of symbols]
REFERENCE SIGNS LIST 1 motion compensation device, 2 CRT, 3 field double speed conversion circuit, 11 first image memory, 12 second image memory, 13 switch, 14 motion vector detection unit, 15 image shift unit, 31 input terminal, 32 double speed conversion unit , 33 frame memory

Claims (26)

In a motion vector detecting device for detecting a motion vector by a block matching method for each pixel of a reference field one frame or two frames before an input reference field,
Block extracting means for extracting a reference block having a reference pixel as an origin in the reference field and moving and extracting a search block in the reference field at least every other pixel and / or at least every other horizontal pixel; Vector calculating means for sequentially calculating the sum of absolute differences of pixel values between the reference block and the search block cut by the block cutting means,
A motion vector comprising: a vector specifying unit that specifies a motion vector between a pixel position of a search block in which the sum of absolute differences calculated by the vector calculating unit is minimum and a pixel position of the reference pixel. Detection device. The block extracting means includes the reference block including pixels arranged at least every other pixel or / and at least every other pixel, and arranged at least every other pixel or / and at least every other pixel. 2. The motion vector detecting apparatus according to claim 1, wherein the search block including the searched pixels is cut out. The above-mentioned block extracting means is formed by converting a telecine-converted image to double speed, and each frame is composed of four fields, or one frame is generated by performing double speed conversion of a television signal, and one frame is composed of two fields. From each field, the reference field and the reference field are specified, a reference block having the reference pixel in the specified reference field as an origin is cut out, and a search block in the specified reference field is placed at least every other vertical pixel. The motion vector detecting device according to claim 1, wherein the motion vector is extracted by moving and / or at least every other horizontal pixel. In a motion vector detection method for detecting a motion vector by a block matching method for each pixel of a reference field one frame or two frames before an input reference field,
Cutting out a reference block having the reference pixel as the origin in the reference field, and moving and cutting out the search block in the reference field at least every other vertical pixel and / or at least every other horizontal pixel;
The sum of the absolute values of the pixel values is sequentially calculated between the cut-out reference block and the search block,
A motion vector detection method comprising: specifying a motion vector between a pixel position of a search block in which the calculated sum of absolute differences is minimum and a pixel position of the reference pixel. The reference block composed of pixels arranged at least every other pixel and / or at least every other pixel and the search block composed of pixels arranged at least every other pixel and / or at least every other pixel 5. The motion vector detecting method according to claim 4, wherein From each field generated by converting the telecine-converted image at double speed and one frame consisting of four fields, or from each field generated by performing double speed conversion of a television signal and one frame consisting of two fields, The reference field and the reference field are specified, a reference block having the reference pixel in the specified reference field as an origin is cut out, and the search block in the specified reference field is arranged at least every other vertical pixel or / and at least horizontally 1. 5. The motion vector detecting method according to claim 4, wherein the moving vector is extracted by moving every pixel. In a motion compensator for motion compensating each pixel of a reference field two frames before an input reference field,
The absolute value of the pixel value difference between the reference block having the reference pixel in the reference field as the origin and the search block moved at least every other vertical pixel and / or at least every horizontal pixel. Vector calculation means for sequentially calculating the sum, and specifying a motion vector between the pixel position of the search block and the pixel position of the reference pixel where the calculated sum of absolute differences is minimum,
Pixel shift means for shifting the position of a reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the motion vector specified by the vector specifying means. Motion correction device. 8. The motion compensating apparatus according to claim 7, wherein said vector specifying means receives each field generated by converting the telecine-converted image at a double speed and having one frame composed of four fields. 9. The motion compensating apparatus according to claim 8, wherein said pixel shift means changes a shift amount of said reference pixel in accordance with a position of said reference field in said frame. The vector specifying unit is configured such that the reference block including pixels arranged at least every other pixel or / and at least every other pixel, and arranged at least every other pixel or / and at least every other pixel. The difference absolute value sum of the pixel values is sequentially calculated with the search block composed of pixels, and the motion between the pixel position of the search block and the pixel position of the reference pixel where the calculated difference absolute value sum is minimum is calculated. The motion compensator according to claim 7, wherein the vector is specified. In a motion compensator for performing motion compensation for each pixel of a reference field one frame before the input reference field,
The absolute value of the pixel value difference between the reference block having the reference pixel in the reference field as the origin and the search block moved at least every other vertical pixel and / or at least every horizontal pixel. Vector calculation means for sequentially calculating the sum, and specifying a motion vector between the pixel position of the search block and the pixel position of the reference pixel where the calculated sum of absolute differences is minimum,
Pixel shift means for shifting the position of a reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the motion vector specified by the vector specifying means. Motion correction device. 12. The motion compensating apparatus according to claim 11, wherein said vector specifying means inputs each field generated by converting a television signal at double speed and one frame is composed of two fields. 13. The motion compensator according to claim 12, wherein the pixel shift means changes a shift amount of the reference pixel in accordance with a position of the reference field in the frame. The vector specifying means includes a reference block including pixels arranged at least every other pixel or / and at least every other pixel, and a pixel arranged at least every other pixel or / and at least every other pixel. Between the search block and the search block consisting of, the motion vector is calculated between the pixel position of the search block and the pixel position of the reference pixel where the calculated sum of the difference absolute values is the minimum. The motion compensator according to claim 11, wherein the motion compensator is specified. In a motion compensator for performing motion compensation for each pixel of a reference field one frame before or two frames before an input reference field,
Switching means for switching the input reference field one frame before or two frames before;
A pixel value between a reference block whose origin is a reference pixel in the reference field switched by the switching means and a search block in which the reference field is moved at least every other vertical pixel and / or at least every other horizontal pixel. Vector calculation means for sequentially calculating the sum of absolute differences, and specifying a motion vector between the pixel position of the search block where the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel,
Pixel shift means for shifting the position of a reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the motion vector specified by the vector specifying means. Motion correction device. The vector specifying unit is configured such that the reference block including pixels arranged at least every other pixel or / and at least every other pixel, and arranged at least every other pixel or / and at least every other pixel. The difference absolute value sum of the pixel values is sequentially calculated with the search block composed of pixels, and the motion between the pixel position of the search block and the pixel position of the reference pixel where the calculated difference absolute value sum is minimum is calculated. 16. The motion compensator according to claim 15, wherein the vector is specified. In a motion correction method for performing motion correction for each pixel of a reference field two frames before an input reference field,
The sum of absolute differences of pixel values between a reference block whose origin is a reference pixel in the reference field and a search block in which the reference field is moved at least every other vertical pixel and / or at least every horizontal pixel is calculated. Operate sequentially,
Identify a motion vector between the pixel position of the search block where the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel,
A pixel shift unit that shifts the position of a reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the specified motion vector. . 18. The motion correction method according to claim 17, wherein the motion vector is specified for each field, which is generated by performing double-speed conversion on the telecine-converted image and one frame includes four fields. 19. The motion correction method according to claim 18, wherein a shift amount of the reference pixel is changed according to a position of the reference field in the frame. The reference block composed of pixels arranged at least every other pixel and / or at least every other pixel and the search block composed of pixels arranged at least every other pixel and / or at least every other pixel And sequentially calculate the sum of absolute differences of pixel values between
18. The motion correction method according to claim 17, wherein a motion vector is specified between the pixel position of the search block in which the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel. In a motion compensation method for performing motion compensation for each pixel of a reference field one frame before the input reference field,
The sum of absolute differences of pixel values between a reference block whose origin is a reference pixel from the reference field and a search block in which the reference field is moved at least every other pixel and / or at least every other horizontal pixel. Operate sequentially,
Identify a motion vector between the pixel position of the search block where the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel,
A motion correction method, wherein a position of a reference pixel in the reference field is shifted in a vector direction of the specified motion vector such that a shift amount is within a range of the vector amount. 22. The motion compensation method according to claim 21, wherein the motion vector is specified for each field in which one frame is generated by converting a television signal at double speed and one frame is composed of two fields. 23. The motion correction method according to claim 22, wherein a shift amount of the reference pixel is changed according to a position of the reference field in the frame. A reference block consisting of pixels arranged at least every other pixel and / or at least every other pixel and a search block consisting of pixels arranged at least every other pixel and / or at least every other pixel Calculate the sum of absolute differences of pixel values between
22. The motion correction method according to claim 21, wherein a motion vector is specified between a pixel position of a search block in which the calculated sum of absolute differences is minimum and a pixel position of the reference pixel. In the motion compensation method for performing motion compensation for each pixel of the reference field one frame before or two frames before the input reference field,
Switching the input reference field one frame before or two frames before,
The absolute value of the pixel value difference between a reference block whose origin is the reference pixel in the switched reference field and a search block in which the reference field is moved at least every other pixel vertically and / or at least every other pixel horizontally. Calculate the sum sequentially,
A motion vector is specified between the pixel position of the search block in which the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel,
A motion correction method, wherein a position of a reference pixel in the reference field is shifted in a vector direction of the specified motion vector such that a shift amount is within a range of the vector amount. The reference block composed of pixels arranged at least every other pixel and / or at least every other pixel and the search block composed of pixels arranged at least every other pixel and / or at least every other pixel And sequentially calculate the sum of absolute differences of pixel values between
26. The motion correction method according to claim 25, wherein a motion vector is specified between a pixel position of the search block in which the calculated sum of absolute differences is minimum and a pixel position of the reference pixel.

Images