JP2868457B2 - Motion vector search device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a motion vector search apparatus applied to information compression of digital moving images,
In particular, a motion vector is searched for by each distortion calculated based on pixel data of a current image block constituting a part of the current image and pixel data of a plurality of reference image blocks in a search window on the previous encoded image. To a motion vector search device.

[0002]

2. Description of the Related Art In recent years, multimedia which expresses different information such as characters, figures, voices, and images by digital data, and integrates these media and handles them in a unified manner has attracted attention in recent years. One of the key technologies to realize this multimedia more effectively is information compression technology.
Information compression technology is a technology that focuses on information redundancy and reduces the amount of information by reducing the information in redundant parts, thereby efficiently processing, storing, and transmitting a large amount of information. It becomes possible.

[0003] There is a large difference in the amount of information of various media. In particular, since a moving image has a huge amount of information, a large amount of information compression is required. There are various methods for compressing information, and by combining these methods,
Significant compression has been achieved. Generally, these compression functions are provided as an LSI (Large scale integrated circuit).

As one of the compression methods for moving image information, there is known a method for compressing information based on a temporal correlation between two screens constituting a part of a moving image. This compression method includes, for example, a simple inter-frame prediction coding method and a motion compensation inter-frame prediction coding method. Here, the frame represents one screen constituting a moving image. Hereinafter, the simple inter-frame prediction coding method and the motion compensation inter-frame prediction coding method will be described.

FIG. 71 is a diagram showing a simple inter-frame predictive coding method. In the simple inter-frame predictive encoding method, a difference value between each pixel data of the current image 600 and each pixel data of the previous encoded image 300 corresponding to each other is calculated, and the difference value is compared with an appropriate threshold value. Then, it is distinguished between significant pixel data and insignificant pixel data. The significant pixel data corresponds to a case where the difference value is larger than the threshold value, and is data that cannot be omitted when predicting the current image 600 from the previous encoded image 300. On the other hand, the insignificant pixel data corresponds to a case where the difference value is equal to or smaller than the threshold value, and is data that can be reduced when the current image 600 is predicted from the pre-encoded image 300.

[0006] Note that the pre-encoded image 300 is
Although the image may be a past image or a future image than 0, it is an image that is encoded earlier than the current image 600 in time. For example, as shown in FIG. 71, when the human image 1 in the pre-encoded image 300 moves rightward in the current image 600, the area indicating significant pixel data is 2
Are indicated by two significant pixel areas 2 and 3. Pixel data on the current image 600 corresponding to the significant pixel area 2 can be represented by a difference value between the pixel data and the significant pixel area 2 and the significant pixel area 2. The corresponding pixel data on the current image 600 can be represented by a difference value between the pixel data and the significant pixel area 3 and the significant pixel area 3. The remaining non-significant pixel area can be represented by the pixel data itself of the pre-encoded image 300 corresponding to the non-significant pixel area.

In the simple inter-frame predictive coding method, the smaller the number of significant pixels, the smaller the data amount of the difference value required for prediction, so that the compression efficiency can be improved. Also, by setting a high threshold, the number of significant pixels can be reduced to further improve the compression efficiency.However, if the threshold is set too high, the image becomes jerky and unnatural, May appear as an afterimage, causing a problem that the image quality is significantly deteriorated.

As described above, in the simple inter-frame predictive coding method, the current image 600 is predicted based on the pixel data at the same position of the previous coded image 300. When the change on the image is small, a high compression efficiency can be realized. However, as shown in FIG. 72, when a part of the image moves significantly on the image, the simple inter-frame prediction code can be used. The compression efficiency is higher when the motion-compensated inter-frame prediction coding method described below is used than in the coding method.

In the motion compensation inter-frame prediction coding method,
When the human image 1 moves as shown in FIG. 72, the motion vector MV shown in FIG. 72 is calculated. The motion vector MV indicates the moving direction and the moving distance of the human image 1, and the human image 1 on the current image 600 is predicted by the motion vector MV and the pixel data forming the human image 1 of the pre-encoded image 300. . Human image 1 of pre-encoded image 300
When the background behind the image can be predicted from the background of the pre-encoded image 300, for example, when a tree or the like is not hidden behind the human image 1, there is no significant pixel area. Also, the pre-encoded image 300
When the background behind the human image 1 cannot be predicted from the background of the pre-encoded image 300, for example, when a tree or the like is hidden behind the human image 1, the number of significant pixel regions is only 2. Therefore, the motion-compensated inter-frame prediction coding method can significantly reduce the number of significant pixels, and can greatly improve the compression efficiency of image information.

Incidentally, the ITU-T which is an international standard system
(International telecommunication Union-Telecommun
ication Standardization Sector) H. In the motion-compensated inter-frame prediction method according to H.261, first, as shown in FIG. 73, the current image 610 is divided into a plurality of blocks, and the same size similar to one block (hereinafter, referred to as a current image block) 710 is used. Search window 410 including a plurality of blocks 510 (hereinafter, referred to as reference image blocks)
Is specified on the pre-encoded image 310, and the search window 41
The distortion between the plurality of reference image blocks 510 included in 0 and the current image block 710 is calculated.

Here, the distortion indicates the similarity between each reference image block 510 and the current image block 710, and obtains the difference value of the pixel data corresponding to the position in each reference image block. The difference value is represented by a value obtained by converting the difference value into positive data by an absolute value operation or a square operation or the like so that the difference value is not canceled out.

Next, the distortion having the minimum value is specified from the calculated distortions, and the motion vector MV is calculated based on the position of the reference image block 510 having the minimum distortion and the position of the current image block 710. Is done. Further, the current image block 71
0, search window 410, reference image block 510
Will be described. As shown in FIG.
The current image block 710 is composed of N rows and M columns of pixels,
As shown in FIG. 74A, assuming that the search window 410 is composed of pixels in H rows and L columns, a reference image block 510 similar to the current image block 710 is included in the search window 410 by (H−N + 1). × (L−M + 1)
Exists.

If the pixel data at the upper left corner of the current image block 710 extracted from the current image 610 is represented by a (0,0), the pixel data a (0,0) is located The range of the pixels of each reference image block 510 corresponding to, that is, the search area is indicated by the shaded area in FIG. Where a
(0,0) does not indicate absolute coordinates indicating the coordinates of the upper left corner of the current image 610, but indicates relative coordinates indicating the coordinates of the upper left corner in the current image block.

FIG. 75 shows the positional relationship between the pixel data in the current image block 710 and the pixel data in each reference image block 510. As shown in FIG. 75, the pixel data in each reference image block 510 corresponding to the pixel data a (m, n) in the current image block 710 is the pixel data b (l + m, h +) in the search window 410.
n). Here, h and l are values that specify each reference image block 510 in the search window 410, and pixel data b in the search window 410
(L, h) is the pixel data at the upper left corner of the reference image block 510, and corresponds in position to the pixel data a (0, 0) at the upper left corner of the current image block 710.

In the current image block 710, the search window 410 and the plurality of reference image blocks 510 shown in FIGS. 74 and 75, the distortion between the current image block 710 and each reference image block 510 is represented by D.
Assuming that (l, h), D (l, h) is represented by the following equation.

[0016]

(Equation 1)

Here, ‖‖ indicates a norm for calculating the distortion, and d (m, n) is represented by d (m, n) = b (l + m, h + n) -a (m, n). A local distortion which is a difference value between the pixel data of the current image block 710 and the pixel data of each reference image block 510 corresponding to the position is shown.
The norm operation generally uses an absolute value operation and a square operation, but the absolute value operation is most frequently used in terms of computational complexity and efficiency.

In the motion-compensated inter-frame prediction method, a method of comparing the current image and the previous coded image on a block basis is called a block matching method. When comparing an image block with the current image block, it is called a full search block matching method (all-point search method).

As a method and an apparatus for obtaining a motion vector using the all-points search method, for example, Japanese Patent Laid-Open No. Hei 2-213
No. 291 is known a method and a circuit for processing a data signal representing a continuous image of a two-dimensional animated image. In this method and circuit, in order to reduce the operation time, the processor elements are arranged by the number of reference image blocks, and the data of the search window supplied to the processor elements is switched upward, downward, and left as a whole. Searching for distortion by scanning.

That is, as shown in FIGS. 76 and 77, if l and h are represented by l = 0,1,2 and h = 0,1,2, first, the pixel data of the search window is stored in each processor element. In cycle 0, when the pixel data a (0,0) of the current image block is input as well as in the processor element, each processor element calculates the local distortion | b (l, h) -a (0,0) | Store is done.

In the next cycle 1, each pixel data of the search window is moved upward as a whole, and the pixel data a (0, 1) of the current image block is inputted, so that the local distortion | b (l, h + 1) ) −a (0, 1) | is further added to the local distortion calculated in cycle 0 and stored.

Next, in cycle 2, each pixel data of the search window is moved to the left as a whole,
By inputting the pixel data a (1,1) of the current image block, the local distortion | b (l + 1, h + 1) -a (1,1) | is calculated. It is added and stored.

Next, in cycle 3, while moving each pixel data of the search window as a whole,
| B (l + 1, h) -a (1,0) | is calculated by inputting pixel data a (1,0) of the current image block, and further added to the operation result in cycle 2. The distortion between each reference image block and the current image block corresponding to the same number of nine reference image blocks as the processor elements arranged as a result is calculated.

Next, a motion vector is obtained based on the minimum distortion detected from the nine distortions. In general, most of the processing for searching for a motion vector is performed by calculating a distortion and accessing an image memory.
SI is required. On the other hand, the motion vector search device adopts a two-dimensional systolic array structure,
By arranging a plurality of processor elements in the SI chip and performing a parallel operation, a high-speed motion vector search process is realized.

[0025]

However, in the conventional motion vector search apparatus, as shown in FIG. 2, for example, from the left end to the right end of the reference image (that is, slices 111, 112 and When the search window 120E that searched for 113) searches from the left end to the right end of the reference image one slice below (that is, slices 112, 113, and 114), the slices 112 and 113 are common reference image data. First, it is necessary to access the slices 112 and 113 from the frame memory 10 again. As described above, since the reference image data used last time needs to be accessed again from the frame memory 10 in which the reference image data is stored every time the slice goes down by one slice, the search window to be input should be shorter than the time for calculating the distortion by the processor element. Pixel data of frame memory 1
There is a problem that the time for accessing 0 is longer, and the access speed of the pixel data of the reference image to the frame memory 10 prevents improvement in the overall processing speed.

Therefore, the present invention provides a buffer 23 (4000) for storing reference image data of a slice which is common when a motion vector search is performed in a search window one slice below, when it is used for calculating a distortion.
Is provided, the input unit is again in the frame memory 1
It is an object of the present invention to provide a motion vector search device capable of outputting reference image data of a common slice without accessing from 0.

[0027]

According to the first aspect of the present invention,
In order to solve the above-mentioned problem, a current image includes a plurality of current image blocks, and a reference image includes a plurality of search windows which are shifted from each other by a size of the current image block and partially overlap with each other, and each search window includes the current image. The slice includes a plurality of reference image blocks of the same size as the block, and a slice is formed by reference image blocks arranged in a horizontal direction on a reference image of the plurality of reference image blocks, and I is a natural number or a real number greater than 1. The vertical width of the search window is I times the vertical width of the slice, and by selecting a reference image block most similar to each current image block from the reference image blocks included in each search window, each current image block is selected. Motion vector specified by the position of the selected reference image block on the current image and the position of each selected reference image block on the reference image. A motion vector search device for searching for a search vector, which vertically repeats the operation of sequentially shifting the current image block in the horizontal direction on the current image, and performs the operation of sequentially shifting the search window sequentially in the horizontal direction on the reference image. A motion vector search device that searches for a motion vector for all current image blocks included in the current image by repeating in the direction, and an image data storage unit that stores reference image data included in the reference image; Is a natural number or a real number smaller than I, and search means for sequentially inputting reference image data for each of J slices from the image data storage means and searching for a motion vector, wherein the search means An input unit for inputting reference image data from the means, and an operation for calculating a motion vector based on the reference image data input to the input unit. And the part, (I-J)
And a buffer for temporarily storing reference image data of the number of slices from the operation unit and simultaneously storing the reference image data of J slices from the image data storage unit. The stored reference image data for (IJ) slices is input to the input unit.

According to a second aspect of the present invention, in order to solve the above-mentioned problem, the motion vector search device according to the first aspect is characterized in that J is 1. According to a third aspect of the present invention, in the motion vector search apparatus according to the first aspect, the input unit inputs reference image data for the first I slices at the start of the motion vector search. And an input selector for selecting all the reference pixel data of the I slices from the image data storage means only when the input data is stored.

According to a fourth aspect of the present invention, there is provided a motion vector search apparatus as set forth in the first aspect of the present invention, wherein the first (IJ) slices of the first (IJ) slice in the reference image are set before starting the motion vector search. An input selector for inputting the reference image data from the image data storage means and selecting to temporarily store the reference image data in a buffer is provided.

According to a fifth aspect of the present invention, in order to solve the above problem, in the motion vector search apparatus according to the first aspect, a buffer is constituted by a RAM, and the buffer uses reference image data of a slice in an arithmetic unit. And inputting reference image data of temporarily stored slices to the input unit for each slice.

[0031]

1 to 70 are drawings related to the present invention. FIG. 1 is a functional block diagram of a motion vector search device according to the present invention. The present invention relates to a frame memory 1
0, and a search unit 20. The search unit 20 includes an input unit 21, an arithmetic unit 22, and a buffer 23.

FIG. 2 shows a reference image 100, a reference image block 130, search windows 121, 122 and 120.
E, 121NS1, slices 110, 111, 112,
It is a figure which shows 113 and 114. FIG. 3 shows search windows 121, 122 and 123, reference image block 1
31, 132, 136 and the current image blocks 141, 1
It is a figure explaining 42,143. The reference image 100 is shifted by the size of the reference image blocks 131, 132, and 136 and partially overlaps the search window 12.
1, 122, 123 and 121 NS1.
Further, each of the search windows 121, 122, 123 and 121NS1 includes a reference image block, and the slice 110 of FIG.
111, 112, 113 and 114 are configured.

FIG. 4 is a diagram for explaining an entire embodiment of the motion vector search apparatus according to the present invention. The motion vector search device according to the present invention comprises: an image data storage unit 10 for storing and outputting current image data included in the current image;
A search means 20 for sequentially inputting reference image data from the image data storage means and searching for a motion vector, wherein the image data storage means 10 is a frame memory in the present embodiment, An image block data output unit 1000, a reference image data output unit 2000 that outputs reference image data included in the reference image, a distortion calculation unit 3000 that calculates distortion based on the input reference image data, and calculates a motion vector And a signal output unit 6000 for outputting a control signal. The buffer 4000 (23) for temporarily storing reference image data for a plurality of slices from the distortion calculating unit 3000 and temporarily storing the same. And The input register IR and the first pixel transfer holding unit 300
1 and the side register SR forming the second pixel transfer holding means 3002
May be arranged as shown in FIGS. 36 (a) and 36 (b).

First, an outline of each means will be described. The current image block data output unit 1000 outputs pixel data of one current image block partially forming the current image to the distortion calculation unit 3000. The current image block may have an arbitrary block size, but in the following description, as shown in FIG. 3, pixel data a (0,0),
2 consisting of a (0,1), a (1,0), a (1,1)
It is a block of × 2 pixel size.

The reference image data output means 2000 stores the pixel data in the search window for output to the distortion calculation means 3000. The size of the search window may be any size as long as it is larger than the current image block, but in the following description, as shown in FIG. 3, as the search window 121, the pixel data b (0,0), b (0,1) ), B (0, 2), b (0,
3), b (0, 4), b (0, 5), b (1, 0), b
(1,1), b (1,2), b (1,3), b (1,
4), b (1, 4), b (2, 0), b (2, 1), b
(2,2), b (2,3), b (2,4), b (2,
4), b (3, 0), b (3, 1), b (3, 2), b
(3,3), b (3,4), b (3,4), b (4,
0), b (4, 1), b (4, 2), b (4, 3), b
(4,4), b (4,4), b (5,0), b (5
1), b (5, 2), b (5, 3), b (5, 4) and b (5, 4) have a 6 × 6 pixel size.

Here, the distortion calculating means 300
0, the processor element PE forming the first pixel transfer and holding means 3001 and the side register SR forming the second pixel transfer and holding means 3002 convert the input pixel data into each register and each processor. The data is repeatedly transferred between the elements PE and held in each register and each processor element PE.

FIGS. 17A and 17B show the processor elements PE in the even-numbered and odd-numbered columns in FIG. 4, respectively. Further, as shown in FIG. 18, the processor element P constituting the first pixel transfer holding unit 3001
E includes an input unit 3100, a distortion calculation unit 3500, and a distortion output transfer unit 3600, and subtracts each pixel data in the current image block from each positionally corresponding pixel data in each candidate block of the search window. By converting the data into positive number data and adding the distortion of each pixel after the positive number conversion, that is, the local distortion, in block units, a difference between the current image block on the current image and each candidate block in the search window on the reference image is obtained. Are calculated by the distortion calculating means 3000 and output to the distortion specifying means 5000.

After calculating the distortion, the buffer 4000 stores the processor elements PE (0,1), PE
(0,2), PE (0,3) and PE (0,4), input and temporarily hold reference image data discharged after calculating distortion, and use the data again to lower one slice. Is output to the reference image data output means 2000 when the motion vector search is performed.

The distortion specifying means 5000 detects a minimum distortion among the distortions calculated by the distortion calculating means 3000, specifies a candidate block in a search window corresponding to the detected minimum distortion, and specifies a motion vector. It is to be calculated. The signal output unit 6000 includes a current image block data output unit 1000, a reference image data output unit 2000, and a distortion calculation unit 300.
0, the buffer 4000 and the operation of the distortion specifying means 5000.

As shown in FIG. 5, the signal output unit 6000 has first to eighth signal output terminals P1 to P8, and each signal output from each signal output terminal P1 to P8 As shown in FIGS. 6 to 16, the current image block data output unit 1000, the reference image data output unit 2000, the first pixel data transfer and holding unit 3001, the second pixel data transfer and holding unit 3002,
Buffer 4000, distortion calculating means 3000
And a signal for controlling the operation of each means of the distortion specifying means 5000, which is output to each means.
Clock pulse signals are used as the control signals, and these signals are binary pulse signals. Below signal output unit 6
000 will be described based on FIGS. 6 to 16.

The signal output from the first signal output terminal P1 is a clock pulse signal CK1, which is a basic clock pulse signal of the present apparatus.
All signals are controlled based on K1, and the operation of each signal is controlled. Second signal output terminal P
2 is a clock pulse signal CK2 having the same pulse width and the same cycle as the clock pulse signal CK1. This signal is used as a distortion calculating means 3000 and a distortion specifying means 5000, respectively.
Are signals for controlling the distortion calculation operation and the motion vector specific operation.

The signal output from the third signal output terminal P3 is a clock pulse signal SL, which has a pulse width and a cycle twice that of the clock pulse signal CK1, is output before the rising of the first clock, and is an even number. Is output in synchronization with the falling edge of each clock pulse signal CK1. This signal is used for setting the timing for transferring the pixel data from right to left in the first pixel data transfer holding unit and the second pixel data transfer holding unit. Also, this is for branching the transfer direction of the pixel data in the current image data output means 1000.

The signal output from the fourth signal output terminal P4 is a clock pulse signal SS, which is output in synchronization with the falling edge of the twentieth clock pulse signal CK1. The value signal keeps the value of "1". This signal is output from the reference image data output means 2000
, The output terminal of the selector is for selecting the input of the reference image data from the frame memory or the buffer 4000.

The signal output from the fifth signal output terminal P5 is a clock pulse signal LD1, which has a pulse width twice that of the clock pulse signal CK1 and is synchronized with the falling edge of the pulse signal CK1 at the tenth clock. It is output and has a period five times as long as the clock pulse signal CK1, and is output until the 23rd clock pulse signal CK1 falls. The signal is similarly output in synchronization with the falling edge of the 34th clock pulse signal CK1. This signal is used by the third selector 3610 in FIG. 18 to select whether to output the calculated distortion or to transfer the distortion calculated by another adjacent distortion calculating unit 3000.

The signal output from the sixth signal output terminal P6 is the clock pulse signal LD2, which has a pulse width twice that of the clock pulse signal CK1, and is synchronized with the falling edge of the twelfth clock pulse signal CK1. It is output and has a period five times as long as the clock pulse signal CK1, and is output until the falling edge of the pulse signal CK1 at the 25th clock. Also, it is similarly output in synchronization with the fall of the pulse signal CK1 of the 32nd clock. This signal is used to determine the operation timing of each device for obtaining a motion vector in the distortion specifying means 5000.

The signal output from the seventh signal output terminal P7 is a clock pulse signal CL having a pulse width twice that of the clock pulse signal CK1 and in synchronization with the falling edge of the pulse signal CK1 at the tenth clock. It is output and has a period five times as long as the clock pulse signal CK1, and is output until the 23rd clock pulse signal CK1 falls.
The signal is similarly output in synchronization with the falling edge of the 34th clock pulse signal CK1. This signal is used to set the timing for clearing the integrated value when calculating the distortion in the distortion calculating means 3000.

The signal output from the eighth signal output terminal P8 is a clock pulse signal SMV1, which has a pulse width twice that of the clock pulse signal CK1, and is synchronized with the falling edge of the 17th clock pulse signal CK1. Output
It has five times the cycle of the clock pulse signal CK1, and is output until the falling edge of the 26th clock pulse signal CK1. The signal is similarly output in synchronization with the falling edge of the 34th clock pulse signal CK1. This signal is used by the distortion specifying means 5000 to calculate and output a motion vector.

The respective means of the motion vector search device will be described below. First, the configuration of each means will be described. FIG. 22 shows a block diagram of the current image block data output means 1000 in FIG. As shown in FIG. 22, the current image block data output means 1000 is a flip-flop 1
110, 1120, 1210 and 1220 and a selector 1230. Flip-flops 1110, 11
Reference numerals 20, 1210, and 1220 each include a D flip-flop, have a data input terminal A, a signal input terminal S, and a data output terminal Y, and synchronize with a pulse of a signal input to the signal input terminal S to generate a data input terminal. The data input to A is latched at the data output terminal Y. The selector 1230 has a first data input terminal A, a second
It has a data input terminal B, a signal input terminal S, and a data output terminal Y. When the signal input to the signal input terminal S is 0, the data input to the first data input terminal A is output from the data output terminal Y. When the signal input to the signal input terminal S is "1", the data input to the second data input terminal B is output from the data output terminal Y.

Reference image data output means 20 in FIG.
00 is connected to the buffer 4000 and the frame memory as shown in FIG. 35, and has a frame memory for storing and holding the reference image data and a selector for selecting the reference image data from the buffer 4000. The distortion calculating unit 3000 includes a first pixel data transfer holding unit 3001 and a second pixel data transfer holding unit 3002, and as shown in FIG. 4, 25 processor elements PE (0,0), PE ( 0, 1), PE (0, 2), P
E (0,3), PE (0,4), PE (1,0), PE
(1, 1), PE (1, 2), PE (1, 3), PE
(1,4), PE (2,0), PE (2,1), PE
(2,2), PE (2,3), PE (2,4), PE
(3,0), PE (3,1), PE (3,2), PE
(3,3), PE (3,4), PE (4,0), PE
(4,1), PE (4,2), PE (4,3), PE
(4,4) 10 side registers SR (0, -1), SR (1, -1), SR (2,-
1), SR (3, -1), SR (4, -1), SR
(0,5), SR (1,5), SR (2,5), SR
(3,5), SR (4,5) 6 input registers IR (5,0), IR (5,1), IR (5,2), I
R (5,3), IR (5,4) and IR (5,5). x = 0, 1, 2, 3, 4, 5 y = -1, 0, 1, 2, 3, 4, 5
(X, y), each side register SR is represented by SR (x, y),
Let each input register IR be represented as IR (x, y).

FIG. 17A shows the input / output terminals of the even-numbered processor elements, and FIG. 17B shows the input / output terminals of the odd-numbered processor elements. As shown in FIG. 17A, each processor element PE in an even-numbered column
(X, y) are input terminals X, YDi, YLi and D
i, and output terminals YDo, YLo, and Do, and an input terminal connected to each signal (CK1, CK2, CL, LD1, SL) output terminal of the signal output unit 6000 (not shown). . FIG. 17 (b)
As shown in FIG.
(X, y) is output terminal YU instead of YDi, YDo
o and an input terminal YUi.

FIG. 18 is a detailed block diagram showing the configuration of each processor element PE (x, y) constituting the first pixel data transfer holding means 3001. As shown in the figure, each processor element PE (x, y) is provided with a selector 31
10, a flip-flop 3120, a subtractor 3510, a positive number converter 3520, an adder 3530, a flip-flop 3540, an inverter 3550, an AND operator 3560, a selector 3610, and a flip-flop 3620.

FIGS. 19 and 20 show examples of the configuration of each of the side registers SR (x, y) constituting the second pixel data transfer holding means 3002. FIG. 19 is a diagram illustrating each of the odd-numbered column side registers SR (x, y), and FIG. 20 is a diagram illustrating each of the even-numbered column side registers SR (x, y). As shown in FIG. 19A, each side register SR (x, y) in an odd-numbered column has an input terminal YUi, Y
Li and output terminals YUo and YLo, and each signal (CK1, CK1,
SL) has an input terminal connected to the output terminal. As shown in FIG. 20A, each side register SR (x, y) in an even-numbered column has input terminals YDi, YLi and output terminals YDo, YLo, and further includes a signal output unit 6000 (not shown). It has an input terminal connected to the signal (CK1, SL) output terminal.

Each side register SR (x, y) is shown in FIG.
9 (b) and FIG. 20 (b), the selector 3
310 and a flip-flop 3320. The selector 3310 has a first data input terminal A, a second data input terminal B, a signal input terminal S, and a data output terminal Y,
The connection between the first data input terminal A, the second data input terminal B and the data output terminal Y is switched according to the state of the input signal at the signal input terminal S.

When the signal input to the signal input terminal S is "1", the selector 3310 outputs the second data input terminal B
Is output from the data output terminal Y, and the signal input to the signal input terminal S0 is "0".
In this case, the data input to the first data input terminal A is output from the data output terminal Y.
The flip-flop 3320 is formed of a D flip-flop, has a data input terminal A, a signal input terminal S, and a data output terminal Y, and is connected to the data input terminal A in synchronization with a pulse of a signal input to the signal input terminal S. The input data is latched at the data output terminal Y.

In this embodiment, the side register SR
Since (x, y) has no input from above or below since the current image block data has 2 rows and 2 columns, (x, y) in FIG.
9 (b) and selector 3310 in FIG. 20 (b)
Becomes unnecessary. This selector 3310 is required when the current image block data has three or more rows. The reference image data output unit 2000 in FIG. 4 has the following functions. The reference image data output unit 2000 is connected to the input register IR of the second pixel data transfer holding unit 3002.
(5,1), IR (5,3) and IR (5,5) respectively input pixel data of the search window to the input terminals S1, S2, S3 by b (0,0), b (0,
1), b (1, 0), b (1, 1), b (0,
2), b (0, 3), b (1, 2), b (1, 3)
. And b (0,4), b (0,5), b (1,4),
The clock pulse signal CK, such as b (1,5).
The data is output in the order described in each one clock. A detailed diagram of the input register IR is shown in FIG.

The distortion calculating means 3000 transfers reference image data, calculates distortion for each processor element, and transfers each distortion to the distortion specifying means 5000. The transfer order of the reference image data will be described later. FIG. 23 is a block diagram showing the detailed configuration of the distortion specifying means 5000. As shown in the figure, the distortion specifying means 5000 includes a minimum distortion detection unit 5100, a motion vector vertical component detection unit 5200, and a motion vector horizontal component detection unit 53.
00, the minimum distortion detection unit 51
00 denotes a comparator 5110, a comparator 5120, a selector 5
130, flip-flop 5140, OR operator 51
The motion vector vertical component detection unit 5200 includes a selector 5220, a flip-flop 5230, a conversion table 5240, and a flip-flop 52 with a selector.
80, and a motion vector horizontal component detection unit 530.
0 includes a counter 5310, a selector 5320, a flip-flop 5330, a conversion table 5340, and a flip-flop 5380 with a selector. FIG.
Shows a detailed circuit configuration diagram of the flip-flop with selector 5180.

FIG. 25 shows the configuration of the buffer 4000. The buffer 4000 includes a two-row shift register for storing reference image data. Note that the buffer 4000 is a FIFO (First In Fi) that first outputs the first input reference image data.
rst Out) Memory or a RAM (Rando) that operates by controlling write and read addresses.
m Access Memory).

FIG. 35 shows reference image data output means 2000.
FIG. The reference image data output from the buffer 4000 is input from the input terminal B of the input selector in FIG. The input selector has an input terminal A for inputting reference image data from the frame memory. The input selector selects the input terminal A or the input terminal B for the reference image data according to the input signal SS. That is, the input of the reference image data can be selected between the frame memory and the buffer.

The flip-flop circuit shown in FIG. 35 newly supplies reference image data from a frame memory to a signal CK.
This is for inputting in synchronization with 1. Reference image data output from the two input selectors and the flip-flop circuit are input terminals SO and S in FIG.
1 and S2 to input registers IR (5,
1), IR (5, 3) and IR (5, 5).

Next, the operation will be described. First, the current image data output unit 1000 and the reference image data output unit 2
In addition to the description of the flow of pixel data input from the first pixel data transfer unit 000 to the distortion calculation unit 3000, the data holding state of the first pixel data transfer holding unit 3001 and the second pixel data transfer holding unit 3002, and the arithmetic processing in the distortion calculation unit 3000 Will be described.

First, the transfer order of the reference image data will be briefly described. When a motion vector search is performed using the reference image data for the first slice, since the distortion has not been calculated in the buffer 4000, the reference image data of the slice is not kept. Therefore, when calculating the distortion, the two input selectors of the input unit 2000 both select the input terminal A by setting the value of the control signal SS to “0”, and select three pixels from the frame memory via the input unit 21. The reference image data is input to the distortion calculating unit 3000 at a time.

The transfer state of the reference image data for the first slice in the distortion calculating means 3000 is as follows.
The state of transfer of the reference image data in the distortion calculating means 3000 and the current image block data of the current image block data output means 1000 in FIGS. 37 to 66 is shown for each clock. The distortion calculation means 3000 is located at the center of FIGS. 37 to 66, and the current image block data output means 1000 is located at the upper right. For convenience, the current image block data a (x,
Only the coordinates of y) and the reference image data b (x, y) are extracted and entered.

After the reference image data held in PE (0,1) and PE (0,3) in the leftmost column of the distortion calculation means 3000 has been calculated, the data is buffered via input terminals BI1 and BI2, respectively. 23 and temporarily stored. In this way, every time the distortion calculation is completed, PE (0,1),
And the reference image data held in PE (0,3) are input to buffer 23 via input terminals BI and BI2, respectively. 26 to 34 show the transfer states of the reference image data at the 13th clock to the 21st clock in the buffer 23, respectively.

When a motion vector for the next slice of the current image block is searched, that is, when the search window is lowered by one slice in the vertical direction of the reference image, the distortion calculation is first initialized to 23 to 30 clocks. FIGS. 59 to 66 show the state of transfer of the reference image data in the distortion calculating means 3000 and the current image block data of the current image block data output means 1000. Here, the buffer 23
Are output to the search window data output means 2000 and input to the distortion calculation means 3000 via the input terminals S0 and S1 for each slice. The search window data output means 2000 accesses and reads the next one slice of reference image data from the frame memory, and inputs the read image data to the distortion calculation means 3000 via the input terminal S2.

FIGS. 67 to 70 show the transfer state of the reference image data at the 31st to 34th clocks, respectively, and the distortion is calculated in the same manner by the next one slice of the reference image data. In this way, only one slice is accessed from the frame memory to read out the reference image data, and similarly, the entire current image is searched for the motion vector of the reference image.

Next, the distortion specifying means 5000 will be specifically described. FIG. 23 is a detailed block diagram of the distortion specifying means 5000. In FIG. 23, the distortion specifying means 5000 includes a minimum distortion detecting unit 5100, a motion vector vertical component detecting unit 5200, and a motion vector horizontal component detecting unit 5300. , The minimum distortion detection unit 5100 includes a comparator 5110 and a comparator 51.
20, selector 5130, flip-flop 5140,
An OR operation unit 5150 and a flip-flop with selector 5180 are provided.

The motion vector vertical component detection unit 5200 includes a selector 5220 and a flip-flop 52
30, a conversion table 5240, and a flip-flop with a selector 5280. The motion vector horizontal component detection unit 5300 includes a counter 5310, a selector 532
0, flip-flop 5330, conversion table 534
0, a flip-flop 5380 with a selector.

The comparator 5110 has a data input terminal A0,
A1, A2, A3, A4, data output terminals M and Y, and data having the smallest value among the data input to the data input terminals A0, A1, A2, A3, A4 are output from the output terminal Y. Then, if the input terminal to which the data having the minimum value is input is A0, "0", if A1, "1", A1
"2" for 2; "3" for A3; "4" for A4.
4 "is output from the data output terminal M.

Comparator 5120 has a first data input terminal A, a second data input terminal B, and a signal output terminal Y, and the data input to data input terminal A is equal to or greater than the data input to data input terminal B. When the size is
A signal representing "0" is output from the signal output terminal Y. When the data input to the data input terminal A is smaller than the data input to the data input terminal B, a signal representing "1" is output from the signal output terminal Y. Is what you do.

Selector 5130 has a first data input terminal A, a second data input terminal B, a signal input terminal S, and a data output terminal Y, and a signal input to signal input terminal S represents "0". In this case, the data input to the data input terminal B is output from the data output terminal Y. When the signal input to the signal input terminal S is a signal representing "1", the data is input to the data input terminal A. Data is output from the data output terminal Y.

The flip-flop 5140 is composed of a D flip-flop, and has a data input terminal A and a signal input terminal S.
And a data output terminal Y, and latches data input to the data input terminal A to the data output terminal Y in synchronization with a pulse of a signal input to the signal input terminal S. The OR operation unit 5150 includes a signal input terminal S,
It has a data input terminal B and a data output terminal Y, and one of the signal input terminal S and the data input terminal B has a "
When a signal or data representing 1 "is input,
Data representing "1" is output to the data output terminal Y, and "1" is input to both the signal input terminal S and the data input terminal B.
Only when a signal and data representing "0" are input,
It outputs data representing "0" to the data output terminal Y. In other words, when the signal input to the signal input terminal S is a signal representing "1", a signal representing "1" is output to the data output terminal Y, and the signal input to the signal input terminal S is "1". If it is "0", the data input to the data input terminal B is output to the data output terminal Y.

Flip-flop with selector 5180
Has a data input terminal I, signal input terminals E and F, and a data output terminal O, and as shown in FIG. 24, comprises a selector 5182 and a flip-flop 5181.
The selector 5182 includes a first data input terminal A, a second data input terminal B, a signal input terminal S, and a data output terminal Y
When the signal input to the signal input terminal S is a signal representing “0”, the data input to the data input terminal A is output from the data output terminal Y, and is input to the signal input terminal S. When the signal is a signal representing "1", the data input to the data input terminal B is output from the data output terminal Y.

The flip-flop 5181 is composed of a D flip-flop, and has a data input terminal A and a signal input terminal S.
And a data output terminal Y, and latches data input to the data input terminal A to the data output terminal Y in synchronization with a pulse of a signal input to the signal input terminal S. Selector 5220 has a first data input terminal A, a second data input terminal B, a signal input terminal S, and a data output terminal Y. When a signal input to signal input terminal S is a signal representing “0”, The data input to the data input terminal A is output from the data output terminal Y. When the signal input to the signal input terminal S is a signal representing "1", the data input to the data input terminal B is converted to the data. This is output from the output terminal Y.

The flip-flop 5230 is composed of a D flip-flop, and has a data input terminal A and a signal input terminal S.
And a data output terminal Y, and latches data input to the data input terminal A to the data output terminal Y in synchronization with a pulse of a signal input to the signal input terminal S. Conversion table 5240 has data input terminal A
And a data output terminal Y, which converts data input to the data input terminal A into motion vector data and outputs the data to the data output terminal Y.

Flip-flop with selector 5280
Has a data input terminal I, signal input terminals E and F, and a data output terminal O, and has the same configuration as the first selector-equipped flip-flop 5180 as shown in FIG. The counter 5310 has signal input terminals CK and CL and a count output terminal Qn. The count output terminal Qn is synchronized with a pulse of a signal input to the signal input terminal CL.
Is reset to “0” and the signal input terminals CK and EN
When both the pulses of the signal input to the counter are signals representing "1", the output count of the count output terminal Qn is counted up and output in synchronization with the pulse of the signal input to the signal input terminal CK. is there.

Selector 5320 has a first data input terminal A, a second data input terminal B, a signal input terminal S, and a data output terminal Y, and a signal input to signal input terminal S represents "0". At this time, the data input to the data input terminal A is output from the data output terminal Y, and when the signal input to the signal input terminal S is a signal representing "1", the data is input to the data input terminal B. Data is output from the data output terminal Y.

The flip-flop 5330 comprises a D flip-flop, and has a data input terminal A and a signal input terminal S.
And a data output terminal Y, and latches data input to the data input terminal A to the data output terminal Y in synchronization with a pulse of a signal input to the signal input terminal S. Conversion table 5340 has data input terminal A
And a data output terminal Y, which converts data input to the data input terminal A into motion vector data and outputs the data to the data output terminal Y.

Flip-flop with selector 5380
Has a data input terminal I, signal input terminals E and F, and a data output terminal O, and has the same configuration as the flip-flop with selector 5180 as shown in FIG.
Further, the data input terminal A0 of the comparator 5110 is connected to the flip-flop 3 of the processor element PE (0, 0).
620, a processor element P
E (0,0) is electrically connected via an output terminal Do, and the data input terminal A1 is connected to the processor element PE
The data input terminal A2 is electrically connected to the data output terminal Y of the (0, 1) flip-flop 3620 via the output terminal Do of the processor element PE (0, 1).
Is electrically connected to the data output terminal Y of the flip-flop 3620 of the processor element PE (0, 2) via the output terminal Do of the processor element PE (0, 2), and the data input terminal A3 is connected to the processor element PE (0, 2). The data output terminal Y of the flip-flop 3620 of PE (0,3) is electrically connected via the output terminal Do of the processor element PE (0,3), and the data input terminal A4 is connected to the processor element PE (0,3). 4) is electrically connected to the data output terminal Y of the flip-flop 3620 via the output terminal Do of the processor element PE (0, 4).

Next, the distortion specifying means 5000
Will be described with reference to FIGS. In the distortion specifying means 5000, the respective distortions obtained by the distortion calculating means 3000 are input to the comparator 5110 via the respective data input terminals A0, A1, A2, A3, A4.

First, in the period c12, the pulse signal L
Since the signal “1” is input to the OR operator 5150 via the signal input terminal S in synchronization with D2, all signals are output via the data output terminal Y regardless of the value input to the data input terminal S. Is the data of which bit is 1, that is, the maximum value is output. The output count output from the counter 5310 via the count output terminal Qn is reset to "0" by a signal input to the counter 5310 via the signal input terminal CL in synchronization with the pulse signal LD2.

Next, in synchronization with the thirteenth clock of the pulse signal CK2, Dis (0,0), Dis (0,1), D
is (0,2), Dis (0,3), Dis (0,4)
Are input to the comparator 5110 at the data input terminals A0, A1, A
2, A3, and A4, respectively. Comparator 5
At 110, the data input terminals A0, A1, A2, A3,
The data input through A4 are compared, the smallest distortion is selected from the data, the minimum distortion is output through the data output terminal Y, and the data input terminal corresponding to the minimum distortion is set to LMVy. , “0”, “1”, “2”, “3” or “4” are output via the data output terminal M. In the present embodiment, as shown in FIG. 9, the minimum distortion is Dis (0,0), and LMVy is 0.

The flip-flop 5140 outputs the held data through the data output terminal Y in synchronization with the pulse of the pulse signal CK2.
In 150, since “1” is input through the signal input terminal S, all the bits are 1 through the data output terminal Y regardless of the data input through the data input terminal B. That is, the data of the maximum value is output.

The comparator 5120 compares Dis (0,0) input via the first data input terminal A with the data of the maximum value input via the second data input terminal B, and Since (0, 0) is smaller, “1” is output via the signal output terminal Y. Since “1” is input to the selector 5130 via the signal input terminal S,
Dis (0,
0) is output via the data output terminal Y and input to the flip-flop 5140.

In the selector 5220, the signal “1” input via the signal input terminal S causes the data input terminal B
And input the input data LMVy, that is, “0”, and the flip-flop 523 via the data output terminal Y.
Output to 0. In the counter 5310, data “0” reset by the signal LD2 input to the signal input terminal CL is output as CTx via the count output terminal Qn in synchronization with the pulse signal of CK2.

Next, in synchronism with the 14th clock of the pulse signal CK2, the flip-flop 5230 outputs the input data “0” as My through the data output terminal Y, and the flip-flop 5330 outputs the input data Mx as Mx. “0” is output via the data output terminal Y. Next, in synchronization with the 14th clock of the pulse signal CK2, D
is (1,0), Dis (1,1), Dis (1,
2), Dis (1,3), Dis (1,4) are supplied to comparator 5110 at data input terminals A0, A1, A2, A3, A
4 respectively. In the comparator 5110,
The data input through the data input terminals A0, A1, A2, A3, and A4 are compared, and the smallest distortion Dis (1, 2) is output through the data output terminal Y, and Dis (1) is output. , 2) is output via the data output terminal M, indicating "2" representing the data input terminal A2.

In the flip-flop 5140, Dis (0,0) is output via the data output terminal Y in synchronization with the pulse of the pulse signal CK2.
Then, the signal input through the signal input terminal S is "
Since it is 0 ", the data Dis (0,0) input via the data input terminal B is output via the data output terminal Y as it is.

The comparator 5120 compares Dis (1,2) input via the first data input terminal A with Dis (0,0) input via the second data input terminal B, Since Dis (0,0) is smaller, the signal output terminal Y
"0" is output via the. In the selector 5130,
Since “0” is input through the signal input terminal S, Dis (0,0) input through the data input terminal B
Is output through the data output terminal Y and input to the flip-flop 5140.

In the selector 5220, the signal “0” input through the signal input terminal S causes the data input terminal A
And input data “0” is input to the flip-flop 5230 via the data output terminal Y. In the counter 5310, in synchronization with the pulse signal of CK2,
Data counted up by pulse signal CTE "
1 "is output as CTx via the count output terminal Qn.

Next, in synchronization with the fifteenth clock of the pulse signal CK2, the flip-flop 5230 outputs the input data “0” as My through the data output terminal Y, and the flip-flop 5330 outputs the input data as Mx. “0” is output via the data output terminal Y. Next, in synchronization with the fifteenth clock of the pulse signal CK2, D
is (2,0), Dis (2,1), Dis (2,
2), Dis (2,3), Dis (2,4) are supplied to comparator 5110 by data input terminals A0, A1, A2, A3, A
4 respectively. In the comparator 5110,
The data input through the data input terminals A0, A1, A2, A3, and A4 are compared, and the smallest distortion Dis (2, 1) among them is output through the data output terminal Y, and Dis (2 , 1) is output via the data output terminal M, indicating "1" representing the data input terminal A1.

In the flip-flop 5140, Dis (0,0) is output via the data output terminal Y in synchronization with the pulse of the pulse signal CK2.
Then, the signal input through the signal input terminal S is "
Since it is 0 ", the data Dis (0,0) input via the data input terminal B is output via the data output terminal Y as it is.

The comparator 5120 compares Dis (2,1) input through the first data input terminal A with Dis (0,0) input through the second data input terminal B, Since Dis (2, 1) is smaller, the signal output terminal Y
"1" is output via the. In the selector 5130,
Since “1” is input through the signal input terminal S, Dis (2, 1) input through the data input terminal A
Is output through the data output terminal Y and input to the flip-flop 5140.

In the selector 5220, the signal "1" input via the signal input terminal S causes the data input terminal B
And input the input data LMVy, that is, “1”, and the flip-flop 523 via the data output terminal Y.
Output to 0. In the counter 5310, the data “2” counted up by the pulse signal CTE is output as CTx via the count output terminal Qn in synchronization with the pulse signal of CK2.

Next, in synchronization with the 16th clock of the pulse signal CK2, the flip-flop 5230 outputs the input data “1” as My through the data output terminal Y, and the flip-flop 5330 outputs the input data as Mx. “2” is output via the data output terminal Y. Next, in synchronization with the 16th clock of the pulse signal CK2, D
is (3,0), Dis (3,1), Dis (3,
2), Dis (3,3), Dis (3,4) are supplied to comparator 5110 at data input terminals A0, A1, A2, A3, A
4 respectively. In the comparator 5110,
The data input through the data input terminals A0, A1, A2, A3, and A4 are compared, and the smallest distortion Dis (3, 4) among them is output through the data output terminal Y, and Dis (3 , 4) indicating the data input terminal A4 to which the data has been input is output via the data output terminal M.

In the flip-flop 5140, Dis (2,1) is output via the data output terminal Y in synchronization with the pulse of the pulse signal CK2.
Then, the signal input through the signal input terminal S is "
Since it is 0 ", the data Dis (2, 1) input via the data input terminal B is output via the data output terminal Y as it is.

The comparator 5120 compares Dis (3, 4) input through the first data input terminal A with Dis (2, 1) input through the second data input terminal B. Since Dis (2, 1) is smaller, the signal output terminal Y
"0" is output via the. In the selector 5130,
Since “0” is input through the signal input terminal S, Dis (2, 1) input through the data input terminal A
Is output through the data output terminal Y and input to the flip-flop 5140.

In the selector 5220, the signal "0" input via the signal input terminal S causes the data input terminal A
And input the input data LMVy, that is, “1”, and the flip-flop 523 via the data output terminal Y.
Output to 0. In the counter 5310, the data “3” counted up by the pulse signal CTE is output as CTx via the count output terminal Qn in synchronization with the pulse signal of CK2.

Next, in synchronization with the 17th clock of the pulse signal CK2, the flip-flop 5230 outputs the input data “1” as My through the data output terminal Y, and the flip-flop 5330 outputs the input data as Mx. “2” is output via the data output terminal Y. Next, in synchronization with the seventeenth clock of the pulse signal CK2, the flip-flop 5140 causes the input data Dis (2,
1) is output via the data output terminal Y, and in the flip-flop 5230, the input data "1" is output via the data output terminal Y as My, and the conversion table 524
0, the data input via the data input terminal A "
1 "is converted to a motion vector, and converted data" 1 "is output via a data output terminal Y.
At 330, the input data “2” is output as Mx via the data output terminal Y, and in the conversion table 5340,
The data "2" input through the data input terminal A is converted into a motion vector, and the converted data "0" is output through the data output terminal Y.

Next, in synchronization with the 18th clock of the pulse signal CK2, the input signal SMV1 is input to the flip-flop 5180 with the selector.
Dis (2, 1) selected by N is output from the flip-flop 5181 and the distortion M
Dis (2, 1) is output as inDisFr via the data output terminal O, and the input signal SMV1 is input to the flip-flop with selector 5280, so that the data “1” selected by the selector 5282 is
The data is output from the flip-flop 5281, data “1” is output as the frame motion vector vertical component MVFry via the data output terminal O, and the input signal SMV1 is input to the flip-flop 5380 with the selector, so that the selector 5281 selects the input signal SMV1. Data "
2 ”is output from the flip-flop 5281 and the data“ as the frame motion vector horizontal component MVFrx ”
0 ”is output via the data output terminal O.

As described above, the current image frame block 11
Minimum frame block distortion D corresponding to 0
is (2, 1) and a frame motion vector (0, 1) are obtained. Therefore, the distortion specifying means 5000
Accordingly, the minimum distortion MinDisFr between all the frame candidate blocks in the search window 121 and the current image frame block 141 and the frame motion vector MVFr corresponding to the minimum distortion
(X, y) is calculated.

Similarly, as shown in FIGS. 9 to 16, the minimum distortion MinDisFr and the minimum distortion between all the frame candidate blocks in each search window and the current image frame block are obtained, and the next three slices are obtained. Minutes are similarly calculated.
As an embodiment of the present invention, if I and J are natural numbers or real numbers larger than 1, the vertical width of the search window is I times the vertical width of the slice, and the buffer is a reference image for (IJ) slices. Data distortion calculating means 3
000, and temporarily stores the reference image data for J slices from the frame memory and the reference image data for (IJ) slices stored in the buffer to the input unit 21 at the same time. You may make it input.

[Brief description of the drawings]

FIG. 1 is a functional block diagram of a motion vector search device according to the present invention.

FIG. 2 is a diagram illustrating a slice of a reference image, a search window, and a reference image block.

FIG. 3 is a diagram illustrating a search window, a reference image block, and a current image block.

FIG. 4 is a diagram for explaining an entire embodiment of a motion vector search device according to the present invention.

5 is a diagram showing a signal path for each means in a signal output unit of the motion vector search device shown in FIG.

FIG. 6 is a time chart of the motion vector search device according to the present invention.

FIG. 7 is a time chart of the motion vector search device according to the present invention.

FIG. 8 is a time chart of the motion vector search device according to the present invention.

FIG. 9 is a time chart of the motion vector search device according to the present invention.

FIG. 10 is a time chart of the motion vector search device according to the present invention.

FIG. 11 is a time chart of the motion vector search device according to the present invention.

FIG. 12 is a time chart of the motion vector search device according to the present invention.

FIG. 13 is a time chart of the motion vector search device according to the present invention.

FIG. 14 is a time chart of the motion vector search device according to the present invention.

FIG. 15 is a time chart of the motion vector search device according to the present invention.

FIG. 16 is a time chart of the motion vector search device according to the present invention.

17 is a diagram showing an arrangement of input / output terminals of each processor element shown in FIG. 4;

FIG. 18 is a detailed circuit diagram of each processor element shown in FIG. 4;

FIG. 19 is a diagram showing an arrangement of input / output terminals of side registers in odd columns shown in FIG. 4 and a detailed circuit diagram thereof.

20 is a diagram showing an arrangement of input / output terminals of a side register in an even-numbered column shown in FIG. 4 and a detailed circuit diagram thereof.

21 is a diagram showing an arrangement of input / output terminals of the input register shown in FIG. 4 and a detailed circuit diagram thereof.

FIG. 22 is a diagram showing a detailed circuit diagram of a current image block data output unit shown in FIG. 4;

FIG. 23 is a detailed circuit diagram of the distortion specifying unit shown in FIG.

24 is a detailed circuit diagram of the flip-flop with a selector shown in FIG.

FIG. 25 is a detailed circuit diagram of the buffer shown in FIG. 4;

FIG. 26 is a diagram showing data temporarily stored in a buffer at the 13th clock.

FIG. 27 is a diagram showing data temporarily stored in a buffer at the 14th clock.

FIG. 28 is a diagram showing data temporarily held in a buffer at the 15th clock.

FIG. 29 is a diagram showing data temporarily stored in a buffer at the 16th clock.

FIG. 30 is a diagram showing data temporarily stored in a buffer at the 17th clock.

FIG. 31 is a diagram showing data temporarily stored in a buffer at the 18th clock.

FIG. 32 is a diagram showing data temporarily stored in a buffer at the 19th clock.

FIG. 33 is a diagram showing data temporarily stored in a buffer at the 20th clock.

FIG. 34 is a diagram showing data temporarily stored in a buffer at the 21st clock.

FIG. 35 is a circuit diagram showing an input unit of the reference image output unit shown in FIG.

FIG. 36 is a diagram showing an arrangement of an input register, a processor element, and a side register of the motion vector search device shown in FIG. 4;

FIG. 37 is a diagram showing a data transfer position in each register of pixel data of a search window at the first pulse of the clock pulse signal CK1.

FIG. 38 is a diagram showing a data transfer position in each register of pixel data of a search window in a second pulse of the clock pulse signal CK1.

FIG. 39 is a diagram showing a data transfer position in each register of pixel data of a search window at the third pulse of the clock pulse signal CK1.

FIG. 40 is a diagram showing a data transfer position in each register of pixel data of a search window at the fourth pulse of the clock pulse signal CK1.

FIG. 41 is a diagram showing a data transfer position in each register of pixel data of a search window at the fifth pulse of the clock pulse signal CK1.

FIG. 42 is a diagram showing a data transfer position in each register of pixel data of a search window at the sixth pulse of the clock pulse signal CK1.

FIG. 43 is a diagram showing a data transfer position in each register of pixel data of a search window at the seventh pulse of the clock pulse signal CK1.

FIG. 44 is a diagram showing a data transfer position in each register of pixel data of a search window at the eighth pulse of the clock pulse signal CK1.

FIG. 45 is a diagram showing a data transfer position in each register of pixel data of a search window at a ninth pulse of the clock pulse signal CK1.

FIG. 46 is a diagram showing a data transfer position in each register of pixel data of a search window at the tenth pulse of the clock pulse signal CK1.

FIG. 47 is a diagram showing a data transfer position in each register of pixel data of a search window at the eleventh pulse of the clock pulse signal CK1.

FIG. 48 is a diagram showing a data transfer position in each register of pixel data of a search window at the 12th pulse of the clock pulse signal CK1.

FIG. 49 is a diagram showing a data transfer position in each register of pixel data of a search window at the thirteenth pulse of the clock pulse signal CK1.

FIG. 50 is a diagram showing a data transfer position in each register of pixel data of a search window at the 14th pulse of the clock pulse signal CK1.

FIG. 51 is a diagram showing a data transfer position in each register of pixel data of the search window at the 15th pulse of the clock pulse signal CK1.

FIG. 52 is a diagram showing a data transfer position in each register of pixel data of a search window at the 16th pulse of the clock pulse signal CK1.

FIG. 53 is a diagram showing a data transfer position in each register of pixel data of a search window at the 17th pulse of the clock pulse signal CK1.

FIG. 54 is a diagram showing a data transfer position in each register of pixel data of a search window at the 18th pulse of the clock pulse signal CK1.

FIG. 55 is a diagram showing a data transfer position in each register of pixel data of a search window at the 19th pulse of the clock pulse signal CK1.

FIG. 56 is a diagram showing a data transfer position in each register of pixel data of a search window at the 20th pulse of the clock pulse signal CK1.

FIG. 57 is a diagram showing a data transfer position in each register of pixel data of a search window at the 21st pulse of the clock pulse signal CK1.

FIG. 58 is a diagram showing a data transfer position in each register of pixel data of a search window at the 22nd pulse of the clock pulse signal CK1.

FIG. 59 is a diagram showing a data transfer position in each register of pixel data of a search window at the 23rd pulse of the clock pulse signal CK1.

FIG. 60 is a diagram showing a data transfer position in each register of pixel data of a search window at the 24th pulse of the clock pulse signal CK1.

FIG. 61 is a diagram showing a data transfer position in each register of pixel data of a search window at the 25th pulse of the clock pulse signal CK1.

FIG. 62 is a diagram showing a data transfer position in each register of pixel data of a search window at the 26th pulse of the clock pulse signal CK1.

FIG. 63 is a diagram showing a data transfer position in each register of pixel data of a search window at the 27th pulse of the clock pulse signal CK1.

FIG. 64 is a diagram showing a data transfer position in each register of pixel data of a search window at the 28th pulse of the clock pulse signal CK1.

FIG. 65 is a diagram showing a data transfer position in each register of pixel data of a search window at the 29th pulse of the clock pulse signal CK1.

FIG. 66 is a diagram showing a data transfer position in each register of pixel data of a search window at the 30th pulse of the clock pulse signal CK1.

FIG. 67 is a diagram showing a data transfer position in each register of pixel data of a search window at the 31st pulse of the clock pulse signal CK1.

FIG. 68 is a diagram showing a data transfer position in each register of pixel data of a search window at the 32nd pulse of the clock pulse signal CK1.

FIG. 69 is a diagram showing a data transfer position in each register of pixel data of a search window at the 33rd pulse of the clock pulse signal CK1.

FIG. 70 is a diagram showing a data transfer position in each register of pixel data of a search window at the 34th pulse of the clock pulse signal CK1.

FIG. 71 is a diagram for explaining conventional simple inter-frame prediction.

FIG. 72 is a diagram illustrating conventional motion-compensated inter-frame prediction.

FIG. 73 is a diagram illustrating a conventional current image block and a search window.

FIG. 74 is a diagram illustrating a conventional current image block and a search area.

FIG. 75 is a diagram illustrating a conventional positional relationship between pixels in a current image block and pixels in a reference image block.

FIG. 76 is a diagram illustrating a conventional distortion calculation method and a transfer process of reference image data.

FIG. 77 is a diagram illustrating a conventional distortion calculation method and a transfer process of reference image data.

[Explanation of symbols]

 Reference Signs List 1 person image 2 person image 3 person image 10 image data storage means 20 search means 21 input unit 22 operation unit 23 buffer 100 reference image 110 slice 111 slice 112 slice 113 113 slice 114 slice 120E search window 121 search window 121NS1 search window 122 search window 123 search window 130 reference image block 131 reference image block 132 reference image block 136 reference image block 141 current image block 142 current image block 143 current image block 300 pre-encoded image 310 pre-encoded image 410 search window 510 reference image block 600 current Coded image 610 Current image 710 Current image block 1000 Current image block data output means 1100 Odd column Image block data output means 1110 Flip-flop 1120 Flip-flop 1200 Even-numbered column current image block data output means 1210 Flip-flop 1220 Flip-flop 1230 Selector 2000 Reference image data output means 3000 Distortion calculation means 3001 First pixel data transfer holding means 3002 Second Pixel data transfer and holding unit 3100 pixel data input transfer unit 3110 first selector 3120 first flip-flop 3310 selector 3320 flip-flop 3500 distortion calculation unit 3510 subtractor 3520 positive number converter 3530 adder 3540 second flip-flop 3550 inverter 3560 AND operator 3600 distortion output transfer unit 3610 3rd Lector 3620 Third flip-flop 4000 Buffer 4010 D flip-flop 4020 D flip-flop with selector 5000 Distortion specifying means 5100 Minimum distortion detection unit 5110 Comparator 5120 Comparator 5130 Selector 5140 Flip-flop 5150 Logical sum operator 5180 Flip-flop with selector 5181 Flip-flop 5182 selector 5200 motion vector vertical component detection unit 5220 selector 5230 flip-flop 5240 conversion table 5280 flip-flop with selector 5300 motion vector horizontal component detection unit 5310 counter 5320 selector 5330 flip-flop 5340 conversion table 5380 flip-flop with selector -Up 6000 signal output unit

────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP-A-64-244985 (JP, A) JP-A-5-14870 (JP, A) JP-A-7-184214 (JP, A) (58) Field (Int.Cl. ⁶ , DB name) H04N ^7/ 24-7/68

Claims (5)

(57) [Claims] 1. A current image includes a plurality of current image blocks, and a reference image includes a plurality of search windows which are shifted from each other by a size of the current image block and partially overlap each other, and each search window includes a plurality of search windows. If the slice includes a plurality of reference image blocks of the same size, and the reference image blocks of the plurality of reference image blocks are arranged in a horizontal direction on the reference image, and I is a natural number or a real number larger than 1, the search The vertical width of the window is I times the vertical width of the slice, and by selecting a reference image block most similar to each current image block from the reference image blocks included in each search window, the current width of each current image block is selected. A motion vector specified by the position on the image and the position of each selected reference image block on the reference image is searched. A motion vector search device, wherein the operation of sequentially shifting the current image block in the horizontal direction on the current image is repeated in the vertical direction, and the operation of sequentially shifting the search window in the horizontal direction on the reference image is repeated in the vertical direction. A motion vector search device that searches for a motion vector for all current image blocks included in the current image, wherein J is smaller than I Search means for sequentially inputting reference image data for each of J slices from the image data storage means to search for a motion vector, wherein the search means is a natural number or a real number. An input unit for inputting image data, an operation unit for calculating a motion vector based on reference image data input to the input unit, A buffer for inputting reference image data for IJ) slices from the calculation unit and temporarily storing the reference image data for J slices from the image data storage unit. , Held in the buffer (I-
J) A motion vector search apparatus, wherein reference image data for slices are input to the input unit. 2. The motion vector search device according to claim 1, wherein J is 1. 3. The motion vector search device according to claim 1, wherein the input unit inputs reference image data of I slices only when inputting reference image data of the first I slices at the start of the motion vector search. A motion vector search device characterized by having an input selector for selecting all of them from the image data storage means. 4. The motion vector search device according to claim 1, wherein the reference image data of the first (IJ) slices in the reference image is inputted from the image data storage means in advance before the start of the motion vector search and is stored in the buffer. A motion vector search device having an input selector for selecting to temporarily hold the motion vector. 5. The motion vector search device according to claim 1, wherein the buffer is formed of a RAM, and the buffer inputs the reference image data of the slice in the order of columns used in the operation unit and temporarily holds the slice image data. A motion vector search device characterized in that reference image data of a slice is input to an input unit for each slice.