WO2004002148A1

WO2004002148A1 - Motion vector detection device, detection method, motion compensation device, and motion compensation method

Info

Publication number: WO2004002148A1
Application number: PCT/JP2003/007438
Authority: WO
Inventors: Takaya Hoshino; Toshio Sarugaku; Makoto Kondo; Kazuhiko Nishibori; Koji Aoyama; Yukihiko Mogi
Original assignee: Sony Corporation
Priority date: 2002-06-19
Filing date: 2003-06-11
Publication date: 2003-12-31
Also published as: JP2004023673A

Abstract

A motion vector detection device for detecting a motion vector by the block matching method according to each pixel of the basic field by one or two frames before the input reference field. A sum of difference absolute values of pixel values is successively calculated between a basic block (51) having as an origin a reference pixel (58) in a basic field (30) by one or two frames before an input reference field (40) and a search block (53) in which the reference field (40) is shifted at least every other pixel in the longitudinal direction or/and every other pixel in the lateral direction, thereby specifying a motion vector between the pixel position of the lookup block (53) and the pixel position of the basic pixel (58) where the sum of the difference absolute values is minimum.

Description

TECHNICAL FIELD The present invention relates to a motion vector detection device and a detection method capable of reducing a circuit scale while reducing an influence on image quality, and a motion vector detection device and a detection method. The present invention relates to a motion correction device and a motion correction method.

This application claims priority on the basis of Japanese Patent Application No. 200-217-949, filed in Japan on June 19, 2022. The application is incorporated herein by reference. 2. Related Art Conventionally, as a scanning method for television broadcasting, an interlaced scanning method that scans every other horizontal scanning line has been most widely adopted. In this in-line scan method, a single frame image is formed by a field image composed of odd-numbered scanning lines and a field image composed of even-numbered scanning lines, and the entire screen appears to flicker. It suppresses flicker interference and prevents screen quality from deteriorating.

This interlaced scanning system is adopted as a television standard system in various countries around the world. For example, in the PAL (Phase Alternation by Line) system in European television broadcasting, the field frequency is 50%. [Hz] (frame image is 25 frames / second, field image is 50 fields Z seconds).

In particular, in this PAL system, the input image signal is subjected to processing such as internal processing in order to further suppress the interference of the plane frit, so that the field frequency is doubled from 50 Hz to 100 Hz. The field frequency double speed method, which converts the image signal into an image signal, has conventionally been adopted.

FIG. 1 shows a block diagram of a field double speed conversion circuit 7 to which the field frequency double system is applied. This field double speed conversion circuit 7 has input terminals 81 and The CRT 83 and the horizontal / vertical deflection circuit 82 are integrated in a television receiver 8. The field double speed conversion circuit 7 includes a double speed conversion unit 71 and a frame memory 72.

The double-speed conversion unit 71 writes, for example, an image signal of 50 fields / second of the PAL system input from the input terminal 81 to the frame memory 72. The double-speed conversion section 71 reads out the image signal written in the frame memory 72 at twice the speed of writing. This makes it possible to double the frequency of the image signal of 50 fields / second and generate an image signal of 100 field seconds.

The double speed conversion section 71 outputs the double speed converted image signal to the CRT 83. The CRT 83 displays the input image signal on the screen. The horizontal and vertical deflection of the image signal in the CRT 83 is controlled based on a horizontal / vertical sawtooth wave generated by the horizontal / vertical deflection circuit 82 and having twice the frequency of the input image signal.

2A and 2B show the relationship between each field and the pixel position in each image signal before and after the double-speed conversion. Here, the horizontal axis indicates time, and the vertical axis indicates the vertical position of the pixel. The image signal indicated by a white circle in FIG. 2A is an interlaced image signal of 50 fields Z seconds before double-speed conversion, and the image signal indicated by a black circle in FIG. This is a field / second interval image signal.

In the image signal shown in Fig. 2A, field f1 and field f2 are signals created from the same frame of the film, and similarly, field f3 and field f4 also form the same frame. I do. Since these image signals are interlaced image signals, pixel positions in the vertical direction differ between adjacent fields. For this reason, it is not possible to create one new field between each field while maintaining the interlacing property.

Thus, as shown in FIG. 2B, two new fields f′2 and f′1 are generated between the field f1 and the field f2. No field is generated between field f2 and field f3, and two new fields f'4 and f'3 are generated between field f3 and field f4. That is, one frame is formed by four fields and two frames.

The newly generated fields f'1, f'2, ... May be obtained as a median value of three pixels around each pixel using a median filter or the like. The newly created fields: f'1, f'2, ... have the same contents as the fields fl, f2, ..., respectively.

In other words, the field double-speed conversion circuit 5 alternately arranges a part for newly generating two fields and a part for no generation between the fields of the image signal before the double-speed conversion, thereby obtaining the number of screens per unit time. Can be increased, and it is possible to suppress the above-described surface frit force disturbance.

By the way, in order to watch a movie film composed of 24 frames / second still images on a normal television, a TV cinema conversion (hereinafter referred to as “telecine conversion”) is required to obtain a TV signal for an in-night race. I do. FIG. 16 shows the relationship between each field and the image position when the image moves in the horizontal direction in the image signal after the telecine conversion. Here, the horizontal axis indicates the position of the image in the horizontal direction, and the vertical axis indicates time. In the image signal before the double-speed conversion shown in FIG. 3A, the fields fl and f2 constitute the same frame, so that the image is displayed at the same position. This image moves horizontally (to the right in Fig. 3) when moving to field 3. Field f4 is displayed at the same position as field f3 because it constitutes the same frame as field f3.

When the image signal after the telecine conversion shown in FIG. 3A is double-speed-converted by the field frequency double-speed method, as shown in FIG. 3B, the fields f1, f'2, and f 'constituting the same frame are obtained. The same image is displayed at the same position with 1, f2. Similarly, the same image is displayed at the same position in the fields f3, f'4, f'3, and f4 that form the same frame.

Figure 4A shows the relationship between each field and the image position when the image moves in the horizontal direction in the television signal before double-speed conversion (hereinafter referred to as TV signal). In FIG. 4A, since the fields # 1, f2, f3,... Form independent frames, images are displayed at different positions. This image moves in the horizontal direction (rightward in Fig. 4A) every time it moves from the field ί と to f 2, f 3 ···.

The image signal of the TV signal shown in Fig. 4A is doubled by the field frequency double speed method. After the conversion, as shown in FIG. 4B, the same image is displayed at the same position in the fields f 1 and f ′ 2 constituting the same frame. Similarly, the same image is displayed at the same position in the fields f ′ 1 and f 2 constituting the same frame.

By the way, as shown in Fig. 3B, after the telecine conversion, in the double-speed-converted image signal, the image is displayed at the same position up to the fields f1 to f2, while shifting to f2 to f3 If you want to move greatly in the horizontal direction. Similarly, as for the image signal obtained by converting the TV signal at double speed, as shown in FIG. 4B, the image is displayed at the same position in the fields fl to f′2, but shifts to ί′2 to f′1 Move in the horizontal direction. In particular, since the output image signal regularly configures each field with a period of 1/1100 second, the time period during which the image operates is shorter than the time period during which the image is stationary. There is a problem in that when viewing a program via a TV, the motion of the image looks discontinuous.

For this reason, in order to eliminate such discontinuity in motion, the motion vector is obtained by dividing the screen into blocks of predetermined pixels based on, for example, a block matching method, and evaluating the similarity for each block. The motion was corrected by shifting the pixel position for each block according to the obtained motion vector.

In this block matching method, as shown in FIG. 5, a reference field is divided into a plurality of reference blocks 101, and a block having the highest similarity to the reference block 101 in the reference field 80 is calculated as follows: It is detected from the search block 103 moving in the search range 104 in the reference field 90. The displacement between the detected search block 103 and the reference block 101, that is, the direction and magnitude of the movement is defined as the moving vector.

The above-described determination of the degree of approximation is performed by first taking the difference between each pixel value of the search block 103 and the corresponding pixel value of the reference block 101, and evaluating the difference indicated by the difference, for example, the sum of absolute differences. Ask for. Next, the above-described determination operation is performed for all search blocks 103, and the smallest evaluation value is obtained from the sum of evaluation values obtained, that is, the sum of absolute differences. The search block 103 giving the minimum sum of absolute differences is a block showing the highest similarity to the reference block 101, and a motion vector is specified according to the pixel position of the block. By performing motion correction on each pixel of the above-described double-speed-converted image signal so that the correction amount is within the range of the vector amount in the vector direction of the motion vector thus obtained, It is possible to eliminate the discontinuity of the motion of the image. FIG. 6A is a diagram illustrating a case where motion compensation is performed on each pixel of the image signal subjected to the double speed conversion after the telecine conversion illustrated in FIG. 3A, and FIG. 6B is a diagram illustrating a case where the TV signal illustrated in FIG. 4B is double speed converted. FIG. 3 is a diagram illustrating a case where motion correction is performed for each pixel of an image signal.

In the case of FIG. 6A, the motion vector a 1 1 is obtained between the field f 1 and the field f 3, and in the vector direction of the obtained motion vector a 11 1 and within the range of the vector amount, the field f ′ 2 to field; each pixel of f2 is gradually shifted. In the case of FIG. 6B, the motion vector b 11 is obtained between the field f 1 and the field f ′ 1, and the field f is set in the vector direction of the obtained motion vector b 11 1 and within the range of the vector amount. 'Shift 2 pixels. Similarly, a motion vector b 1 2 is obtained between the field f ′ 1 and the field f 3, and in the vector direction of the obtained motion vector b 1 2 and within the range of the vector amount, the field f Shift 2 pixels.

This makes it possible to shift each pixel of the field composing the frame to the position shown by the dotted line, thereby achieving smooth motion as a whole, thereby improving the above-described discontinuity of the motion of the image. It becomes possible.

The above-described reference block 101 and search block 103 are simply obtained by dividing the screen into a set of a predetermined number of pixels, and in these blocks 101 and 103, pixels are spread without gaps. It is configured. When determining the above-mentioned degree of approximation between the reference block 101 and the search block 103, an absolute difference value is calculated for all pixels constituting each block 101, 103. However, it is necessary to calculate the sum of the absolute values of the differences, which significantly increases the circuit scale.

The image signal generated by telecine conversion and double speed conversion is composed of 4 fields per frame, so the motion vector obtained by comparing with the image signal composed of 2 fields per frame obtained by converting the TV signal to double speed Is large (see all in Fig. 6A, bll in head 6B, b12). For this reason, when motion-correcting an image signal after telecine conversion, the search range 104 is wider than that of a TV signal. The search block 103 must be sequentially moved after setting, and the circuit scale is further increased due to the huge amount of calculation of the absolute difference value.

Further, even when both the image signal after the telecine conversion and the TV signal are input, it is necessary to efficiently eliminate the above-described discontinuity of the motion of the image. In order to satisfy the specifications, it is necessary to standardize the circuit scale by making the amount of operation equivalent to the TV signal input regardless of which signal is input. DISCLOSURE OF THE INVENTION The present invention is to provide a novel motion vector detecting device and method, and a motion correcting device and a motion correcting method that can solve the problems of the conventional technology as described above. .

Another object of the present invention is to provide a motion vector detecting apparatus and a detecting method, and a motion correcting apparatus and a motion correcting method capable of reducing the amount of calculation of the absolute difference value while reducing the influence on the image quality. Is to provide.

The motion vector detection device and detection method according to the present invention proposed to achieve the above-described object include a reference pixel in a reference field one frame or two frames before an input reference field. The sum of absolute differences of the pixel values is sequentially calculated between the reference block having the origin as the origin and the search block in which the reference field is moved at least every other pixel vertically or at least every other pixel horizontally, By specifying the motion vector between the pixel position of the search block and the pixel position of the reference pixel that minimizes the calculated sum of absolute differences, the amount of calculation while maintaining the required accuracy of the motion vector And reduce the circuit size.

The motion vector detection device according to the present invention is a motion vector detection device that detects a motion vector by a block matching method for each pixel of a reference field one frame or two frames before an input reference field. A reference block starting from the reference pixel in the reference field is cut out, and a search block in the reference field is placed at least every other vertical pixel and / or at least one horizontal picture. Block extracting means for moving and cutting out every other; vector calculating means for sequentially calculating the sum of absolute differences of pixel values between a reference block and a search block cut out by the block extracting means; A vector specifying unit that specifies a motion vector between the pixel position of the search block and the pixel position of the reference pixel in which the sum of absolute differences calculated by the vector calculating unit is a minimum.

The motion vector detection method according to the present invention is a motion vector detection method for detecting a motion vector by a block matching method for each pixel of a reference field one frame or two frames before an input reference field. A reference block having the reference pixel in the field as the origin is cut out, and the search block in the reference field is cut out by moving at least every other pixel vertically and / or at least every other pixel horizontally, and the cut out reference block and The sum of the absolute values of the pixel values is sequentially calculated between the search block and, and the motion vector is specified between the pixel position of the search block and the pixel position of the reference pixel where the calculated sum of the absolute differences is minimum- In addition, the motion compensation device and method according to the present invention may be configured such that one frame Or, the pixel value between the reference block whose origin is the reference pixel in the reference field two frames before, and the search block in which the reference field is moved at least every other pixel vertically and / or at least every other horizontal pixel The motion vector is detected by sequentially calculating the sum of the absolute values of the differences, and the position of the reference pixel in the reference field is shifted based on the motion vector.

More specifically, the motion compensation device according to the present invention is a motion compensation device that performs motion compensation for each pixel of a reference field two frames before a reference field to be input. The sum of the absolute differences of the pixel values is sequentially calculated between the block and the search block in which the reference field is moved at least every other pixel or at least every other pixel, and the calculated sum of the absolute differences is calculated. Vector specifying means for specifying the motion vector between the pixel position of the search block and the pixel position of the reference pixel, which is the minimum, and the amount of shift in the vector direction of the motion vector specified by the vector specifying means Pixel shift means for shifting the position of the reference pixel in the reference field so that the value falls within the range of the vector amount.

Another motion compensating device according to the present invention uses one frame from an input reference field. In a motion compensator for motion compensating each pixel of a previous reference field, a reference block whose origin is the reference pixel in the reference field and a reference field at least every other vertical pixel or Z and at least horizontal The sum of the absolute values of the pixel values is sequentially calculated with the search block shifted every other pixel, and the pixel position of the search block and the pixel position of the reference pixel at which the calculated sum of the absolute differences is minimized A vector specifying means for specifying a motion vector between the reference field and a reference field such that a shift amount in the vector direction of the motion vector specified by the vector specifying means is within the range of the vector amount. And a pixel shifting means for shifting the position of the reference pixel.

Still another motion compensating apparatus according to the present invention is a motion compensating apparatus which performs motion compensation for each pixel of a reference field one frame before or two frames before an input reference field. Switching means for switching the reference field one frame before or two frames before, and a reference block and a reference field whose origin is the reference pixel in the reference field switched by this switching means at least every other vertical pixel And / or sequentially calculate the sum of absolute differences of pixel values between the search block and the search block shifted at least every other horizontal pixel, and calculate the sum of the calculated absolute difference values of the pixels at the pixel position of the search block and the reference pixel. A vector specifying means for specifying a motion vector between pixel positions, and a vector in a vector direction of the motion vector specified by the vector specifying means. As bets amount is in the range of a vector quantity, the position of the reference pixels definitive based field and a pixel shifting means for shifting Bok.

A motion compensation method according to the present invention is a motion compensation method for performing motion compensation for each pixel of a reference field two frames before an input reference field, comprising: a reference block having a reference pixel in a reference field as an origin; The sum of the absolute differences of the pixel values is sequentially calculated between the search block in which the field is moved at least every other pixel or at least every Z and at least every other horizontal pixel, and the calculated sum of the absolute differences is minimized. The motion vector is specified between the pixel position of the search block to be searched and the pixel position of the reference pixel. The reference is set so that the shift amount in the vector direction of the specified motion vector is within the range of the vector amount. Shift the position of the reference pixel in the field.

Another motion compensation method according to the present invention is a motion compensation method for performing motion compensation for each pixel of a reference field one frame before a reference field to be inputted. The sum of the absolute differences of the pixel values is sequentially calculated between the reference block whose origin is the reference pixel from the field and the search block in which the reference field is moved at least every other pixel vertically or at least every other pixel horizontally, A motion vector is specified between the pixel position of the search block and the pixel position of the reference pixel, at which the calculated sum of absolute differences is minimized, and the shift amount in the vector direction of the specified motion vector is the vector amount. The position of the reference pixel in the reference field is shifted so as to fall within the range.

Still another motion compensation method according to the present invention is a motion compensation method for performing motion compensation for each pixel of a reference field one frame before or two frames before an input reference field. The reference field of the previous or two frames before is switched, and the reference block having the reference pixel as the origin in the switched reference field and the reference field are moved at least every other pixel vertically and / or at least every other pixel horizontally. The sum of the absolute values of the pixel values is sequentially calculated with the search block, and the motion vector between the pixel position of the search block where the calculated sum of the absolute differences is the minimum and the pixel position of the reference pixel is calculated. In the reference field so that the shift amount is within the range of the vector amount in the vector direction of the specified motion vector. Shifting the position of the original.

Still other objects of the present invention and specific advantages obtained by the present invention will be more apparent from the description of the embodiments described below with reference to the drawings. FIG. 1 is a block diagram of a field double speed conversion circuit to which the field frequency double speed method is applied.

2A and 2B are diagrams showing the relationship between each field and the pixel position before and after the double-speed conversion.

FIGS. 3A and 3B are diagrams showing the relationship between each field and the image position when the image moves in the horizontal direction when the telecine conversion signal is input <FIG. 4A and FIG. B means that when a TV signal is input, the image FIG. 4 is a diagram illustrating a relationship between each field and an image position when moving.

FIG. 5 is a diagram for explaining a conventional block matching method. FIG. 6A and FIG. 6B are diagrams showing an example of obtaining a motion vector for a telecine conversion signal and a TV signal.

FIG. 7 is a block diagram showing a motion correction device according to the present invention.

8A and 8B are diagrams showing the relationship between each field and the pixel position before and after the double speed conversion in the field double speed conversion circuit.

FIG. 9 is a diagram showing the relationship between each field and the image position when the image moves in the horizontal direction in the TV signal.

FIGS. 10A and 10B are diagrams for explaining an operation when a TV signal is input in the motion vector detection unit.

FIG. 11 is a diagram showing an example in which the pixel position is shifted with respect to the input TV signal in the image shift unit.

Fig. 12 shows an example where the shift amount of the first field is set to 0 and the shift amount of the second field is set to 1Z2 times the vector amount of the detected motion vector in the image shift unit. It is.

FIG. 13 is a diagram showing the relationship between each field and the image position when the image moves in the horizontal direction in the telecine conversion signal.

FIGS. 14A and 14B are diagrams for explaining the operation when a telecine conversion signal is input to the motion vector detection unit.

FIG. 15 is a diagram illustrating an example in which the image shift unit shifts the pixel position of the input telecine conversion signal.

FIG. 16 is a diagram showing an example in which the pixel position is shifted in the image shift unit, so that the image moves smoothly.

FIG. 17 is a diagram showing an example in which the shift amount of the first field is set to 0 in the image shift unit, and thereafter, the amount of the motion vector is increased by 倍 times. FIG. 18A and FIG. 18B are diagrams showing an example of detecting a motion vector based on each block formed by thinning out every vertical and horizontal pixels.

Figures 19A and 19B show at least every other pixel vertically and / or at least FIG. 9 is a diagram showing an example in which a search block 53 is moved every other pixel. BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, a motion correction device and method thereof, and a motion vector detection device and detection method to which the present invention is applied will be described in detail with reference to the drawings.

The motion compensation apparatus 1 according to the present invention is built in a television receiver of, for example, a PAL (Phase Alternation by Line) method, and as shown in FIG. 7, a first image memory 11 and a second An image memory 12, a switch 13, a motion vector detection unit 14, and an image shift unit 15 are provided.

The first image memory 11 stores an interlaced image signal (hereinafter referred to as a TV signal) in which one frame generated by converting a television signal at double speed into two fields, or an image obtained by telecine conversion. An in-lace image signal (hereinafter referred to as a telecine conversion signal) in which one frame generated by double-speed conversion is composed of four fields is sequentially supplied.

The first image memory 11 stores the supplied image signal for one frame in each field unit. That is, the image signal output from the first image memory 11 is one frame before the image signal supplied to the first image memory 11.

The second image memory 12 has the same internal configuration as the first image memory 11, and stores the image signal supplied from the first image memory 11 for each field in units of one frame. I do. That is, the image signal output from the second image memory 12 is one frame earlier than the image signal supplied to the second image memory 12 and is supplied to the first image memory 11 Two frames before the image signal. The image signal stored in the second image memory 12 is supplied to an image shift unit 15 and a motion vector detection unit 14. Hereinafter, the image signal transmitted from the second image memory 12 to the motion vector detection unit 14 is referred to as a reference field 30.

The switch 13 sequentially switches between the image signal supplied to the first image memory 11 and the image signal output from the first image memory 11, and transmits this to the motion vector detection unit 14. Hereinafter, this switch 13 sends a signal to the motion vector detector 14. The image signal to be referred to is referred to as a reference field 40. When a TV signal is input, the switch 13 is switched to the “Normal” (N) side in FIG. 7, and the reference field 40 transmitted to the motion vector detector 14 is a reference field. One frame after 30. On the other hand, when the telecine conversion signal is input, the switch section 13 is switched to the “film” (F) side in FIG. 7, and the reference field 40 transmitted to the motion vector detection section 14 is Two frames after the reference field 30.

The motion vector detector 14 detects the motion vector for each block or pixel based on the supplied reference field 30 and reference field 40, and detects the detected motion vector or shift based on the motion vector. The information about the amount and the shift direction is output to the image shift unit 15.

The image shift unit 15 receives the motion vector detected by the motion vector detection unit 14 or information such as a shift amount based on the motion vector for each block or each pixel. The image shift unit 15 shifts each pixel position or each block in the image signal supplied from the second image memory 12 in the vector direction within the range of the vector amount of the received motion vector. The image shift unit 15 outputs the image signal shifted in the vector direction to CRT2. The CRT 2 displays the input image signal on the screen. The horizontal and vertical deflection of the image signal in the CRT2 may be controlled based on a horizontal / vertical deflection circuit (not shown).

The motion correction device 1 according to the present invention may integrate a field double-speed conversion circuit 3 that double-converts the field frequency of an image signal. The field double speed conversion circuit 3 is integrated to improve the resolution and prevent the disturbance of the plane flit force. For example, by performing processing such as interpolation in the PAL method, the field frequency is reduced to 50H. The image signal of z is converted into an image signal of 100 Hz twice. As shown in FIG. 7, the field frequency conversion circuit 3 includes an input terminal 31 connected to a television receiver, a double speed conversion unit 32, and a frame memory 33. The double-speed converter 32 writes the telecine-converted image signal input from the television receiver via the input terminal 31 to the frame memory 33. The double-speed conversion unit 32 converts the image signal written in the frame memory 33 into a signal twice as large as that in the writing. Read at speed. As a result, for example, the frequency of an image signal of 50 fields / second in the PAL system can be doubled, and an image signal of 100 fields / second can be generated. The double-speed conversion unit 32 supplies the double-speed-converted image signal to the motion correction device 1.

8A and 8B show the relationship between each field and the pixel position before and after the double speed conversion in the field double speed conversion circuit 3. FIG. Here, the horizontal axis indicates time, and the vertical axis indicates the vertical position of the pixel.

The image signal before the double-speed conversion is a PAL-type interlace image signal of 50 fields / sec. As shown in FIG. 8A, one frame is formed by two fields. On the other hand, since the image signal after double-speed conversion is an in-race image signal of 100 fields // second, as shown in FIG. 8B, a new signal between field t1 and field t2 is newly added. Generate two fields t 2, t '1. Then, no field is generated between the field t2 and the field t3, and two new fields t'4 and t'3 are generated between the field t3 and the field t4. That is, in the case of an image signal, for example, a telecine conversion signal, one frame is formed in four fields.

In the newly generated fields t'1, t'2,..., Each pixel value may be obtained as an intermediate value of three pixels around each pixel. The newly generated fields t'1, t'2,... Have the same contents as the fields tl, t2,. Thus, for example, in the case of a telecine conversion signal, one frame is formed in four fields, and the resolution can be improved by increasing the number of screens per unit time, and it is possible to suppress surface flicker interference Becomes

Next, the operation of the motion compensator 1 to which the present invention is applied will be described, first taking an example where a TV signal is input.

In the motion compensation device 1 according to the present invention, a field double speed conversion circuit 3 sequentially supplies a TV signal in which one frame generated by performing double speed conversion of a television signal is composed of two fields. Figure 9 shows the relationship between each field and the image position when the image moves in the horizontal direction of the TV signal. In FIG. 9, the horizontal axis represents the position of the image in the horizontal direction, and the vertical axis represents time. Field frequency double speed method The same image is displayed at the same position in the fields t 1 and t ′ 2 constituting the same frame in the TV signal that has been double-speed converted by the formula. Similarly, the same image is displayed at the same position in the fields t'l and t2 constituting the same frame. Switch 13 receives the TV signal and switches to the “Normal” (N) side in FIG. 7, and the reference field 30 and the reference field 40 one frame after the reference field 30 move. It is supplied to the vector detector 14.

The motion vector detection unit 14 detects a motion vector between the reference field 30 and the reference field 40 for each pixel or each block based on, for example, a block matching method.

The motion vector detector 14 divides the reference field 30 into a reference block 51 composed of m × n pixels centered on a reference pixel 58 as shown in FIG. The block having the highest degree of approximation of 1 is detected from the search block 53 moving in the search range 54 in the reference field 40 shown in FIG. 10B. The search block 53 is composed of m × n pixels having the same size as the reference block 51 centered on the center pixel 59, and the search range 54 in which the search block 53 moves is composed of M × N pixels. The motion vector detection unit 14 specifies a motion vector between the reference block 51 and the center pixel 59 of the search block 53 having the highest similarity. The above-described determination of the degree of approximation is performed by first taking the difference between each pixel value of the search block 53 and the corresponding pixel value of the reference block 51, and evaluating the difference indicated by the difference, for example, the sum of absolute differences. Ask for. Next, the above-described determination operation is performed for all the search blocks 53, and the evaluation value obtained for each of the search blocks 53, that is, the smallest one from the sum of absolute differences is obtained. The search block 53 that gives the minimum sum of absolute differences is a block showing the highest similarity to the reference block 51, and a moving vector is specified according to the pixel position of the block.

By the way, the search block 53 moves so that the center pixel 59 scans all the pixels constituting the search range 54 shown in FIG. 10B. In other words, the search block 53 moves the search range 54 so as to be shifted by one pixel. As a result, the required accuracy of the motion vector can be improved.

In the case of the example shown in FIG. 9, the vector direction of the motion vector is the reference field 3 When 0 is used as the reference, the direction becomes rightward in the figure. When the reference field is t'1, the vector amount becomes C. Similarly, when the reference field is t3, the reference field is t'1, and the vector amount of the motion vector is D. By repeating this procedure, the vector direction and vector amount of the motion vector based on the reference field 30 can be sequentially obtained. The motion vector detection unit 14 sequentially transmits the obtained vector amount and vector direction of the motion vector to the image shift unit 15.

The image shift unit 15 shifts the position of the detection pixel in the vector direction of the image signal supplied from the first image memory 12 based on the context of each field. Here, of the two fields composing the frame, the first field to be entered is the first field, and the second field to be entered after the first field is the second field. As shown in FIG. 11, the shift amount is sequentially increased so as to be equal to the first field and the second field. In order to determine whether each field corresponds to the first field or the second field, it is necessary to detect a sequence in units of two fields. Therefore, there is no need to detect such a sequence because the corresponding field is identified when performing double-speed conversion.

When the image is shifted as described above, it can be indicated by the dotted line in FIG. 11, but the image is shifted from the second field to the first field as compared with before the image is shifted. This makes it easier to move the image without making large movements.

By integrating the field double speed conversion circuit 3 into the motion compensation device 1 having such a configuration and incorporating it in the television receiver, it is possible to eliminate the discontinuity of motion in the image obtained by converting the TV signal at double speed. it can. In other words, the image quality can be synergistically improved by improving the resolution by the field double speed conversion circuit 3 and smoothing the movement of each image in which the surface flicker interference is suppressed.

A remarkable effect can be obtained by implementing the motion compensation device 1 according to the present invention not only when implemented alone, but also when implemented integrally with the field double speed conversion circuit 3. Even a television receiver having a field double-speed conversion circuit already integrated therein can be easily upgraded by incorporating the motion compensation device 1 later. Monkey

The shift amount of the image in the image shift unit 15 is, for example, as shown in FIG. 12, the shift amount of the first field is set to 0, and the shift amount of the motion vector detected by It is also possible to make the amount of vector 1 to 2 times. In the case of FIG. 12, the shift amount of the first field is set to 0, and when the vector amount is C, the second field is shifted by C X 1/2. If the vector quantity is D, the second field is shifted by D X 1 Z 2. Since one frame is composed of two fields, it is possible to increase the shift amount linearly with time by increasing the vector amount by 1/2 times, making the image movement even smoother. can do.

Next, the operation of the motion compensator 1 to which the present invention is applied will be described using a case where a telecine conversion signal is input as an example.

The motion compensation device 1 sequentially receives from the field double speed conversion circuit 3 a telecine conversion signal in which one frame generated by performing double speed conversion of the telecine-converted image is composed of four fields. Figure 13 shows the relationship between each field and the image position when the image moves in the horizontal direction of the telecine conversion signal. In FIG. 13, the horizontal axis represents the position of the image in the horizontal direction, and the vertical axis represents time. The telecine conversion signal double-speed converted by the field frequency conversion method is supplied to the first image memory 11 at fixed time intervals in the order of fields tl, t'2, t'1, and t2, and all the images are It is displayed at the same position. When shifting to the field t3, the image shifts in the horizontal direction (rightward), and is supplied to the first image memory 11 in the order of the fields t3, t'4, t'3, and t4.

The switch 13 receives the telecine conversion signal and switches to the “film” (F) side in FIG. 7, and sets the reference field 30 and the reference field two frames after the reference field 30. 40 is supplied to the motion vector detection unit 14.

The motion vector detection unit 14 uses a reference field 30 as shown in FIG. The reference block 51 is divided into a reference block 51 composed of m × n pixels centered on the reference pixel 58, and a block having the highest similarity to the reference block 51 is referred to as a reference field 40 shown in FIG. 14B. Are detected from the search block 53 moving in the search range 54 in. The search block 53 is composed of m × n pixels of the same size as the reference block 51, centered on the center pixel 59, and the search range 54 in which the search block 53 moves is 2 MX 2 N It is composed of pixels and is twice as long and wide in area and four times as large as the TV signal search range 54.

That is, since the telecine conversion signal is composed of four fields per frame, the required vector amount of the motion vector is larger than that of the TV signal composed of two fields per frame. For example, when the moving speed of the image in the TV signal is the same as the moving speed of the image of the telecine conversion signal, the search range of the telecine conversion signal needs to be set to twice as large in the vertical and horizontal directions as described above. . Incidentally, the search range is not limited to twice the vertical and horizontal lengths of the TV signal search range 54, and may be configured with any size.

The motion vector detection unit 14 specifies a motion vector between the reference block 51 and the center pixel 59 of the search block 53 having the highest similarity.

It should be noted that the search block 53 moves such that the center pixel 59 scans only the colored pixels every other vertical and horizontal pixels constituting the search range 54 shown in FIG. 14B. In other words, the search block 53 moves in such a way that the search range 54 is shifted every other pixel vertically and horizontally. The search range 54 consists of 2 MX 2 N pixels in the case of a telecine conversion signal, which is twice as long and wide (the area is 4 times) as compared to the search range 54 for a TV signal. By thinning out every other pixel in the vertical and horizontal directions, the amount of calculation of the absolute difference can be made equal to the search range 54 composed of the MXN pixels of the TV signal.

According to the present invention, when a telecine conversion signal is input, a true motion vector can be obtained by making the search range 54 four times as large as the search range of the TV signal. By scanning 53 every other pixel in the vertical and horizontal directions, the calculation amount of the absolute difference can be reduced, and the circuit scale can be reduced.

In the present invention, the motion compensation is performed by sequentially switching the image signal after conversion and the TV signal. In the motion compensator 1, the circuit scale can be unified by using the same amount of calculation as when a TV signal is input, especially for a telecine conversion signal in which the calculation amount of the sum of absolute differences is enormous. Therefore, the specifications of the television receiver can be satisfied.

In the example shown in FIG. 13, the vector direction of the motion vector obtained by the motion vector detection unit 14 is rightward with respect to the reference field 30, and when the reference field is t 3. The vector quantity is A. Similarly, when the reference field is t5, the reference field is t3, and the vector amount of the motion vector is B. By repeating this procedure, the vector direction and vector amount of the motion vector based on the reference field 30 can be sequentially obtained. The motion vector detection unit 14 sequentially transmits the obtained vector amount and vector direction of the motion vector to the image shift unit 15.

The image shift unit 15 shifts the position of the detection pixel in the vector direction in the image signal supplied from the second image memory 12 based on the context of each field. Here, of the four fields that make up the frame, the first field to be entered is the first field, the next field to be entered after the first field is the second field, and so on. When the third and fourth fields follow, the shift amount of each field is as follows: the first field <the second field followed by the third field <the fourth field, as shown in Figure 15 And so on.

When the image is shifted as described above, the image moves significantly when moving from the fourth field to the first field as compared to before the image is shifted, as shown in FIG. Without moving the image, the motion of the image can be smoothed.

By integrating the field double speed conversion circuit 3 in the motion compensation device 1 having such a configuration and incorporating it in the television receiver, the circuit scale can be reduced to the TV signal even when the telecine conversion signal is input. It is possible to eliminate the inconsistency of movement while keeping it at the same level. That is, the resolution is improved by the field double-speed conversion circuit 3, and the movement of each image in which the surface fringe disturbance is suppressed is further smoothed, so that the image quality can be synergistically improved.

This motion compensator 1 can be used not only when implemented alone, A remarkable effect can be obtained by implementing the method integrally with the circuit 3. Even a television receiver having a field double-speed conversion circuit already integrated therein can easily be upgraded by incorporating the motion compensation device 1 later. Note that the image shift amount in the image shift unit 15 is, for example, as shown in FIG. 17, the shift amount of the first field is set to 0, and the shift amount of the second field is detected. It is possible to increase the amount by 1/4 times the vector amount of the vector, and then increase it by 1/4 times. At this time, the shift amount of the first field is set to 0, and if the vector amount is A, the second field is shifted by AX 1 Z 4 and the third field is shifted by AX 2 Z 4 By shifting the fourth field by AX3 / 4, the shift amount can be linearly increased with time, and the motion of the image can be further smoothed.

Incidentally, since the telecine conversion signal is searched by thinning out the search range 54 every other pixel in the vertical and horizontal directions, the motion vector required may have an error of one pixel ₍ however, this image shift unit 15 Since the pixels are shifted by the number obtained by dividing the obtained motion vector by 4, the error for one pixel is also divided by 4, and the visual inconvenience caused by such pixels is almost eliminated. In the case of a telecine conversion signal composed of four fields per frame, image quality is significantly degraded due to discontinuous motion when no motion correction is performed, but by performing motion correction using the motion correction device 1 according to the present invention. Since the image quality can be significantly improved, even if the required accuracy of the motion vector is slightly lower, there is almost no visual effect.

According to the present invention, when a telecine conversion signal is input, a low-pass filter (L PF) (not shown) can be applied in advance before the motion vector detecting section 14 specifies a motion vector. By optimizing the band of this LPF, when the motion vector detector 14 searches the search range 54 every other pixel in the vertical and horizontal directions, the true motion vector exists at the pixel position where it was thinned out. In this case, a completely different motion vector can be prevented.

The example of detecting a motion vector when a telecine conversion signal is input is not limited to the above-described embodiment. For example, a motion vector may be detected by the following method. The motion vector detector 14 divides the reference field 30 into a reference block 61 composed of 2 mx 2 n pixels centered on the reference pixel 58 as shown in FIG. the block exhibiting the highest degree of approximation to the block 61, FIG. 1 8 _c the reference proc 6 1 detected from the search block 6 3 moving the search range 6 4 in the reference field 4 0 shown in B, the above-described Compared to the reference block 51 composed of m X n pixels, the height and width are twice as large and the area is four times. Further, since the reference block 61 is formed by thinning out every other pixel in the vertical and horizontal directions, the number of pixels constituting the reference block 61 is the same as the number of pixels constituting the reference block 51. The search block 63 is composed of 2 mx 2 n pixels of the same size as the reference block 61 with the center pixel 59 at the center, and is thinned out every other pixel in the vertical and horizontal directions. The search range 64 in which the search block 63 moves is composed of 2 MX 2 N pixels, and is twice as long and wide in area and four times as large as the search range 54 for TV signals. The motion vector detection unit 14 specifies a motion vector between the reference block 51 and the center pixel 59 of the search block 63 exhibiting the highest degree of approximation. The size of each of the blocks 61 and 63 and the search range 64 may be any size without being limited to the above.

The search block 53 moves such that the center pixel 59 scans only the colored pixels every other vertical and horizontal pixels constituting the search range 54 shown in FIG. 14B. In other words, the search block 63 moves so that the search range 64 shown in FIG. 18B is shifted every other pixel vertically and horizontally. The search range 6 4 is composed of 2 MX 2 N pixels in the case of a telecine conversion signal, and is twice as long and wide (the area is 4 times) as compared with the search range 6 4 for a TV signal. By performing the search by thinning out every other pixel in the vertical and horizontal directions, the calculation amount of the absolute difference value can be made equal to the search range 54 composed of the MXN pixels of the TV signal.

When the telecine conversion signal is input, the motion vector detection unit 14 sets the center pixel 59 on the search ranges 54 and 64 as shown in FIGS. 14B and 18B. The search is performed so as to scan over the colored pixels, in other words, the search blocks 53 and 63 are shifted every other pixel in the vertical and horizontal directions, but this is not a limitation. For example, as shown in FIG. 19A, a search may be performed by shifting only the horizontal at every other pixel, and a search may be performed without shifting the vertical at every other pixel. Similarly, shift only vertical by every other pixel The search may be performed without changing the horizontal position every other pixel. The interval at which the pixels are shifted is not limited to one pixel, but it is sufficient if at least one pixel is shifted, for example, every two pixels or every third pixel. FIG. 19B shows an example in which a search is performed by shifting the vertical by every other pixel and the horizontal by every three pixels. That is, in the present invention, any search method may be used as long as the search is performed by shifting the search block at least every other pixel or at least every other horizontal pixel. This makes it possible to reduce the circuit scale while making the search ranges 54 and 64 wide.

In addition, the reference block 61 and the search block 63 shown in Fig. 18A are not limited to the case where they are thinned out every other vertical and horizontal pixels, but also at least every other vertical pixels and / or at least every other horizontal pixels. It is enough if it is thinned out. Therefore, it is a matter of course that block matching may be performed using the reference block 61 and the search block 63 thinned out, for example, every two or three pixels.

The motion vector detection unit 14 searches not only when a telecine conversion signal is input but also every other vertical and horizontal pixels as shown in FIGS. 14B and 18B described above when a TV signal is input. The search may be performed by moving block 53. The search may be performed by moving the search block 53 at least every other vertical pixel and / or at least every other horizontal pixel as shown in FIG. 19B described above. As a result, when a TV signal is input, the amount of calculation can be further reduced, and the required motion vector accuracy is maintained by optimizing the bandwidth of a not-shown single pass filter (LPF). It is also possible to do.

The motion compensator 1 according to the present invention is not limited to the above-described embodiment. For example, in FIG. 7, the switch 13 can be always switched to the “normal” (N) side. . As a result, the reference field 40 transmitted to the motion vector detection unit 14 is always one frame later than the reference field 30. Therefore, the motion compensator 1 employing such a configuration performs motion compensation only for the TV signal. Thus, a motion compensation circuit can be configured. In this case, as in the case of the telecine conversion signal, the motion vector detection unit 14 performs a search block 5 every other pixel in the vertical and horizontal directions as shown in FIG. 14B and FIG. The search is performed by scanning 3. As a result, the motion vector can be And the circuit scale can be reduced.

The motion compensator 1 according to the present invention is not limited to the above-described embodiment. For example, in FIG. 7, the switch 13 can be always switched to the “film” (F) side. is there. As a result, the reference field 40 transmitted to the motion vector detecting unit 14 is always two frames later than the reference field 30. Thus, a motion compensation circuit that can perform motion compensation only is configured. As a result, for a telecine conversion signal requiring a wider search range 54 compared to a TV signal, the amount of operation of the absolute difference value can be reduced, and the circuit scale can be reduced.

Note that the present invention is not limited to the case where the present invention is applied to a television receiver based on the PAL system. For example, the present invention is applied to the NTSC (National TV System Co. i.e. The present invention is also applicable to a television receiver to which an interlaced image signal of field seconds (30 frames / second) is input. It is also applicable to television receivers using the SECAM system.

The present invention can be incorporated not only into a television receiver but also into a signal converter connected to the television receiver.

The present invention can be applied to a case where an image signal transmitted on an Internet network is displayed on a PC or the like, or a case where a media image format is converted.

Further, although the present invention has been described in the form of being realized by hardware such as a circuit, it is needless to say that the present invention can also be realized by software on a processor.

It will be apparent to those skilled in the art that various changes, substitutions, or equivalents can be made to the present invention without departing from the scope and spirit of the appended claims. INDUSTRIAL APPLICABILITY As described above, the motion vector detecting apparatus and method according to the present invention can be used in the reference field one frame or two frames before the input reference field. The absolute value of the difference in pixel value between the reference block whose origin is the reference pixel of interest and the search block that moves within the search range of the reference field at least every other vertical pixel or at least every Z and every horizontal pixel Since the motion vector is specified between the pixel position of the search block and the pixel position of the reference pixel where the calculated sum of absolute differences is minimized, the accuracy of the motion vector to be obtained is maintained. In addition, the amount of calculation can be reduced, and the circuit scale can be reduced.

The motion compensation device and method according to the present invention provide a reference block having an origin at a reference pixel in a reference field one frame or two frames before an input reference field, and at least a search range in the reference field. The motion vector is detected by sequentially calculating the absolute sum of the difference between the pixel value and the search block that moves every other vertical pixel or Z and at least every other horizontal pixel, and the motion vector is detected based on the motion vector. Since the position of the reference pixel in the reference field is shifted, the discontinuity of motion can be eliminated while reducing the amount of calculation and the circuit scale.

Claims

The scope of the claims

1. A motion vector detection device that detects a motion vector by a block matching method for each pixel of the reference field one frame or two frames before the input reference field,

Block extracting means for extracting a reference block having the reference pixel as an origin in the reference field, and moving and extracting the search block in the reference field at least every other pixel and / or at least every horizontal pixel. A vector calculation means for sequentially calculating the sum of absolute differences of pixel values between the reference block and the search block cut by the block separation means,

A vector specifying means for specifying a motion vector between the pixel position of the search block in which the sum of absolute differences calculated by the vector calculating means is minimum and the pixel position of the reference pixel;

A motion vector detection device, comprising:

2. The block extracting means includes: the reference block having pixels arranged at least every other pixel and / or at least every other pixel; and at least every other pixel and / or at least every other pixel. 2. The motion vector detection device according to claim 1, wherein the search block including the arranged pixels is cut out.

3. The above-mentioned block extracting means is generated by converting a telecine-converted image at double speed, and each frame composed of 4 fields or a television signal is generated by double speed conversion. From each field where the frame is composed of two fields, the above-mentioned reference field and the above-mentioned reference field are specified, and a reference block starting from the reference pixel in the specified reference field is cut out. 2. The motion vector detection device according to claim 1, wherein the search block in the specified reference field is moved and cut out at least every vertical pixel or every Z and every horizontal pixel.

4. Motion for detecting motion vector by block matching method for each pixel in the reference field one frame or two frames before the input reference field In the vector detection method,

A reference block whose origin is the reference pixel in the reference field is cut out, and a search block in the reference field is moved and cut out at least every vertical pixel and / or at least every horizontal pixel, and cut out.

The sum of absolute differences of pixel values between the extracted reference block and search block is sequentially calculated,

Specifying a motion vector between the pixel position of the search block in which the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel;

A motion vector detection method.

5. The reference block consisting of pixels arranged at least every other pixel or every Z and at least every other pixel, and the pixels arranged at least every other pixel and / or at least every other pixel 5. The motion vector detection method according to claim 4, wherein the search block is cut out.

6. Each field consisting of 4 fields, generated by converting the telecine-converted image to double speed, or 1 frame consisting of 2 fields, generated by converting the television signal to double speed From each field, the above-mentioned reference field and the above-mentioned reference field are specified, and a reference block starting from the reference pixel in the specified reference field is cut out. 5. The motion vector detection method according to claim 4, wherein the search block is moved and cut out at least every other pixel and / or at least every other horizontal pixel.

7. In a motion compensator that performs motion compensation for each pixel of the reference field two frames before the input reference field,

The absolute value of the difference in pixel value between the reference block whose origin is the reference pixel in the reference field and the search block in which the reference field is moved at least every other vertical pixel and / or at least every other horizontal pixel Vector calculation means for sequentially calculating the sum, and specifying a motion vector between a pixel position of the search block in which the calculated sum of absolute differences is a minimum and a pixel position of the reference pixel;

In the vector direction of the moving vector specified by the vector specifying means, Pixel shift means for shifting the position of a reference pixel in the reference field so that the shift amount falls within the range of the vector amount.

A motion compensator characterized by the above-mentioned.

8. The vector specifying means according to claim 7, wherein each of the fields generated by converting the telecine-converted image at double speed and each frame being composed of four fields is input. The motion compensator according to the item.

9. The motion detection device according to claim 8, wherein the pixel shift means changes a shift amount of the reference pixel in accordance with a position of the reference field in the frame.

10. The vector specifying means includes: the reference block including pixels arranged at least every other pixel and / or at least every other pixel; and at least every other pixel and / or at least one pixel. The sum of the absolute values of the pixel values is sequentially calculated with the search block composed of every other pixels, and the pixel position of the search block where the calculated sum of the absolute differences is the minimum and the pixel of the reference pixel 8. The motion compensating device according to claim 7, wherein a motion vector is specified between the position and the position.

1 1. In a motion compensator that performs motion compensation for each pixel in the reference field one frame before the input reference field,

The absolute value of the pixel value difference between the reference block whose origin is the reference pixel in the reference field and the search block in which the reference field is moved at least every other vertical pixel and / or at least every horizontal pixel Vector calculation means for sequentially calculating the sum, and specifying a motion vector between a pixel position of the search block in which the calculated sum of absolute differences is a minimum and a pixel position of the reference pixel;

Pixel shifting means for shifting the position of a reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the motion vector identified by the vector identification means. Prepare

A motion compensator characterized by the above-mentioned.

12. The method according to claim 11, wherein said vector specifying means is configured to input each field which is generated by converting a television signal at double speed, and one frame is composed of two fields. Motion compensator.

13. The motion correction device according to claim 12, wherein the pixel shift means changes a shift amount of the reference pixel according to a position of the reference field in the frame. .

14. The above-mentioned vector specifying means comprises: a reference block composed of pixels arranged at least every other pixel or at least every other pixel and at least every other pixel at least every other pixel or at least every other pixel The sum of the absolute values of the pixel values is sequentially calculated between the search block consisting of the pixels arranged in the matrix and the pixel position of the search block in which the calculated sum of the absolute differences is the minimum and the pixel position of the reference pixel. 11. The motion compensating device according to claim 11, wherein a motion vector is specified between.

15 5. In a motion compensator that performs motion compensation for each pixel in the reference field one frame before or two frames before the input reference field,

Switching means for switching the input reference field one frame before or two frames before;

The pixel value between the reference block whose origin is the reference pixel in the reference field switched by the switching means and the search block in which the reference field has been moved at least every other pixel vertically and / or at least every other pixel horizontally. Vector specifying means for sequentially calculating the sum of absolute differences of the search block, and specifying a motion vector between the pixel position of the search block in which the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel.

Pixel shifting means for shifting the position of a reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the motion vector specified by the vector specifying means; Have

A motion compensator characterized by the above-mentioned.

16. The vector specifying means includes: the reference block including pixels arranged at least every other pixel or / and at least every other horizontal pixel; and at least every other vertical pixel or at least one horizontal pixel. The sum of the absolute values of the pixel values is sequentially calculated between the search block consisting of the pixels arranged every other pixel, and the pixel position of the search block where the calculated sum of the absolute differences is the minimum and the pixel of the reference pixel 16. The motion correction device according to claim 15, wherein a motion vector is specified between the position and the position.

1 7. In the motion compensation method for compensating the motion of each pixel of the reference field two frames before the input reference field,

Sum of absolute differences in pixel values between a reference block whose origin is the reference pixel in the reference field and a search block in which the reference field is moved at least every other vertical pixel or Z and at least every horizontal pixel Are sequentially calculated,

The motion vector is specified between the pixel position of the search block where the calculated sum of absolute differences is the minimum and the pixel position of the reference pixel,

Pixel shifting means for shifting the position of the reference pixel in the reference field so that the shift amount is within the range of the vector amount in the vector direction of the specified motion vector.

A motion compensation method characterized in that:

18. The moving vector according to claim 17, wherein the motion vector is specified in each field which is generated by converting the telecine-converted image at double speed and one frame is composed of four fields. Motion compensation method.

19. The motion correction method according to claim 18, wherein the shift amount of the reference pixel is changed according to the position of the reference field in the frame.

20. The reference block consisting of pixels arranged at least every other pixel or Z and at least every other pixel, and pixels arranged at least every other pixel and / or at least every other pixel The sum of the absolute values of the pixel values is sequentially calculated with the search block consisting of 18. The motion compensation method according to claim 17, wherein the method is characterized by specifying

2 1. In the motion compensation method for motion compensation for each pixel of the reference field one frame before the input reference field,

Absolute pixel value difference between a reference block whose origin is the reference pixel from the reference field and a search block in which the reference field is moved at least every other vertical pixel and / or at least every horizontal pixel Calculate the sum of values sequentially,

The pixel position of the search block where the calculated sum of absolute differences is minimum and the reference pixel Specify the motion vector between the pixel position and

The position of the reference pixel in the reference field is shifted in the vector direction of the specified motion vector so that the shift amount is within the range of the vector amount.

A motion compensation method characterized in that:

22. The method according to claim 21, wherein the motion vector is specified in each field where one frame is generated by converting a television signal at double speed and one frame is composed of two fields. Motion compensation method.

23. The motion correction method according to claim 22, wherein a shift amount of the reference pixel is changed according to a position of the reference field in the frame.

24. From a reference block consisting of pixels arranged at least every other pixel and / or at least every other pixel, and from pixels arranged at least every other pixel or at least Z and at least every other pixel The absolute value sum of the pixel values is sequentially calculated between the search block and the search block, and the motion vector is calculated between the pixel position of the search block where the calculated sum of the absolute differences is the minimum and the pixel position of the reference pixel. 21. The motion correction method according to claim 21, wherein the method is specified.

25. In the motion compensation method for motion compensation for each pixel of the reference field one frame before or two frames before the input reference field,

Switching the reference field one frame before or two frames before the input, switching the reference field with the reference pixel as the origin in the switched reference field, and the reference field at least every other vertical pixel and / or at least one horizontal pixel The sum of the absolute values of the pixel values is sequentially calculated with respect to the search block shifted every other pixel, and between the pixel position of the search block where the calculated sum of the absolute differences is the minimum and the pixel position of the reference pixel. To identify the motion vector,

A motion compensation method characterized in that:

26. The reference block consisting of pixels arranged at least every other pixel or / and at least every other pixel, and arranged at least every other pixel or at least every other pixel The difference absolute value sum of the pixel values is sequentially calculated with the search block consisting of pixels, and the motion between the pixel position of the search block where the calculated difference absolute value sum is the minimum and the pixel position of the reference pixel is calculated. The motion compensation method according to claim 25, wherein the method is characterized by specifying a vector.