JP2003179936A - Moving image encoding/decoding device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving image encoding/decoding device in which encoding efficiency and image quality are improved. <P>SOLUTION: This device comprises a motion vector calculating means (EDT) 11 that calculates a motion vector between images of past two frames, a motion compensation predicting means (PRE) 12 that calculates a difference signal between a current frame image and a reference image after motion compensation as a prediction error, a compressing/encoding means (COD) 16 that compresses/encodes the difference signal, a decoding means (DCD) 17 that decodes the compressed/encoded difference signal, a motion compensation interpolating means (INP) 13 that interpolates the decoded difference signal by using the reference image after motion compensation, and first and second memories (FRM) 14 and 15 in which images of past two frames are stored. The motion of a moving image between frames is detected. When image information is compressed/encoded to transfer based on the reference image whose motion is compensated, there is no necessity to transfer the motion vector. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is used for a low bit rate / high efficiency encoding / decoding device for images, an image transmitting device, an image processing device, etc., and is capable of high efficiency encoding / decoding for images The present invention relates to a moving picture coding / decoding device.

[0002]

2. Description of the Related Art Conventionally, there have been techniques for encoding and decoding moving images, for example, those described in the following documents.

"Hiro Yasuda:" International standard for PEG / multimedia encoding "" (Maruzen Co., Ltd., pp.60-75.) In this document, motion between frames of a moving image is detected and further moved. There is described a method of realizing high-efficiency coding of a moving image by coding a differential signal between frames in which the motion compensation is performed. Hereinafter, a frame is one unit of information structure in information transmission and is a unit that can be reproduced as an image of a predetermined size.

FIG. 3 is a block diagram of a conventional moving picture coding apparatus described in the above document, and FIG. 4 is a block diagram of a moving picture decoding apparatus described in the above document.

This conventional moving picture coding apparatus uses two
Motion vector calculation means (EDT) 31 for calculating a motion vector between frames in units of blocks, motion compensation prediction means (PRE) 32 for calculating a differential signal with motion compensation between two frames of an image, and compression of the difference signal. A compression coding means (COD) 36 for coding, a mixing means (MPX) 38 for variable-length coding and mixing the information such as the compressed differential signal and motion vector, and decoding for restoring the compressed differential signal. Means (DCD) 37 and motion compensation interpolating means (INP) 33 for compensating the image signal of the previous frame by this restored difference signal to generate a restored image.
And a memory (FRM) 34 for storing the generated image.

Input image signal s to this moving image encoding apparatus
30 is supplied to the motion vector calculation means 31 and the motion compensation prediction means 32. The output s31 of the motion vector calculation means 31 is the motion compensation prediction means 32 and the motion compensation interpolation means 3
3 and the mixing means 38. Motion compensation prediction means 3
The output s32 of 2 is connected to the compression encoding means 36, and the output s36 of the compression encoding means 36 is connected to the mixing means 38 and the decoding means 37. Also, the output s of the decoding means 37
37 is connected to the motion compensation interpolation means 33, and its output s3
3 is connected to the memory 34. The memory 34 has three output terminals, the first output s34-1 of which is connected to the motion vector calculation means 31, and the second output s34-
2 is connected to the motion compensation prediction means 32, and the third output s3
4-3 is connected to the motion compensation interpolation means 33. further,
An output signal s38 is obtained from the mixing means 38.

Further, the moving picture decoding apparatus of FIG. 4 decodes the coded image signal and divides it into a difference signal and information such as a motion vector, and a division means (DMPX) 41, and restores the difference signal. The decoding means (DCD) 42 and the motion compensation interpolation means (INP) 43 which performs motion compensation on the image signal of the previous frame by the restored difference signal to generate a restored image.
And a memory (FRM) 44 for storing the generated image.

In this moving picture decoding apparatus, an external input s40 which is a coded image signal is supplied to the dividing means 41. The dividing means 41 comprises two output terminals, the first of which
The output s41-1 of the above is connected to the decoding means 42, and the second output s41-2 is connected to the motion compensation interpolation means 43. The output s42 of the decoding means 42 is the motion compensation interpolation means 43.
The output s43 is connected to the memory 44 and the output terminal. Further, the output s44 of the memory 44 is connected to the motion compensation interpolation means 43.

In the moving picture coding apparatus shown in FIG. 3, the motion vector calculating means 31 is provided with respect to the image signal s30 of the current frame inputted from the outside and the image signal s34-1 of the previous frame inputted from the memory 34. The current frame image is divided into n × n small blocks, and for each block, a moving distance (hereinafter, this moving distance is referred to as “moving distance A motion vector ") is calculated and output as motion vector information s31.

In the motion compensation prediction means 32, based on the block position of the image signal s30 of the current frame and the motion vector information s31 of the block, the image signal of the block moved by the motion vector from the block position of the previous frame. Read s34-2 from the memory 34,
The difference value of the image data between the block of the current frame and the block of the previous frame is obtained, and this is output as the difference signal s32 to the compression encoding means 36.

In the compression encoding means 36, for example, the discrete cosine transform (DC) is applied to the input difference signal s32.
The image information is compressed by T) and linear quantization, and the compressed difference signal s36 is output to the mixing means 38 and the decoding means 37.

The mixing means 38 performs variable length coding on the compressed differential signal s36 and the motion vector information s31, mixes them according to a predetermined rule, and outputs the mixed signal s38 to the output terminal. To do.

The decoding means 37 restores the image information of the compressed differential signal s36 by, for example, linear inverse quantization and inverse discrete cosine transform (IDCT), and the restored differential signal s37 is motion compensated interpolating means. To 33.

The motion compensation interpolating means 33 uses the image block position of the input image signal s30 of the current frame and the motion vector information s31 of the block to correspond to the previous frame at the position moved by the motion vector from the block position. The image signal s34-3 to be read is read from the memory 34, the sum of the difference signal s37 of the current frame and the image signal s34-3 of the previous frame is calculated to restore the current frame image, and the restored image signal s33 is stored in the memory 34. Is output to.

In the moving picture decoding apparatus shown in FIG. 4, the dividing means 41 decodes the coded image signal s40 inputted from the outside by the decoding method corresponding to the mixing means 38, and at the same time, the difference signal. It is divided into s41-1 and motion vector information s41-2, and the difference signal is decoded by the decoding means 4
2, the motion vector information is output to the motion compensation interpolation means 43.

In the decoding means 42, the difference signal s41-
On the other hand, for example, linear inverse quantization and inverse discrete cosine transform (IDC), which is the reverse of the compression encoding means of the above encoding device, are used.
The image information is restored by T), and the restored difference signal s
42 is output to the motion compensation interpolation means 43.

The motion compensation interpolation means 43 uses the block position of the input image signal s40 of the current frame and the motion vector information s41-2 of the block to detect the motion vector of the previous frame from the block position. The corresponding image signal s44 is read from the memory 44, the current frame image is restored by obtaining the sum of the difference signal s42 of the current frame and the image signal s44 of the previous frame, and the restored image signal s43 is output to the external terminal and the memory 4.
It is output to 4.

[0018]

However, the conventional image coding / decoding device has the following problems.

First, in the conventional image coding apparatus, since it is necessary to send the motion vector information together with the image difference signal to the decoding side, the amount of information is a great burden in image transfer by low bit rate coding. Is to be. Further, when the motion vector information is sent to the decoding side, the motion vector information can be encoded only in a predetermined block unit, so that the motion detection accuracy of the image can be easily enhanced in the image transfer of the limited capacity. There was a problem that I could not do it.

The present invention has been made to solve the above problems, and an object thereof is to provide a moving picture coding / decoding apparatus capable of improving coding efficiency and picture quality. Especially.

[0021]

According to a first aspect of the present invention, a moving picture coding apparatus detects a motion between frames of a moving picture, predicts image information based on a motion-compensated reference picture, and codes the moving picture. In the moving picture coding apparatus, the P frame located at the back of the frame group is inserted before the other B frames of the frame group for each frame group consisting of a plurality of consecutive frames of the input image. ,
When the P frame is output from the order conversion unit and the order conversion unit that changes the frame order of the input image, the motion compensated interpolated image of the P frame of the previous frame group is stored, and the order conversion unit B When a frame is output, a first storage unit that stores a motion-compensated and interpolated image of the P frame of the frame group, and one image before the image stored in the first storage unit. P
When the frame output from the order conversion means is a P frame, the second storage means for storing the motion compensated interpolated image of the frame is stored in the P frame and the first storage means. When the motion vector calculation means for calculating motion vectors between P frames and the frame output from the order conversion means are B frames, the scale of the motion vector is converted to the B frame and the first frame. And a scale conversion unit that generates a motion vector between both P frames stored in the second storage unit, and the calculated motion vector when the frame output from the order conversion unit is a P frame. And the frame output from the order conversion means is a B frame, the scale-converted motion vector is selected. Selecting means, motion compensation prediction means for calculating a prediction error of the frame output from the order conversion means using the reference image after motion compensation by the selected motion vector, and compression coding from the prediction error. A compression encoding unit for generating an image signal, a decoding unit for decoding image information from the compression encoded image signal, and a variable length encoding for the compression encoded image signal and the calculated motion vector. Motion compensation for interpolating the decoded image information using a mixing means for mixing and a reference image after motion compensation by the selected motion vector, and storing an interpolated image of P frame in the first storage means. And an interpolating means.

A moving picture decoding apparatus according to a second aspect of the present invention is a moving picture decoding apparatus which restores image information from an input compression-coded image signal, for each frame group consisting of a plurality of consecutive frames. The P frame located at the rearmost of the frame group is inserted in front of the other B frames of the frame group, and the image signal including the image information whose frame order has been changed and the motion vector between the P frames is converted into the motion. Dividing means for decoding and dividing a vector, decoding means for restoring image information from the compression-coded image signal, and when the restored image information is for a P frame, the movement of the P frame of the previous frame group When the compensated and interpolated image is stored and the restored image information is for a B frame, the P frame of the frame group is stored. First storage means for storing the motion compensated interpolated image of the frame, and the motion compensated interpolated image of the P frame preceding the image stored in the first storage means. Second storage means, and when the restored image information is of a B frame, the scale of the motion vector is converted and stored in the B frame and the first and second storage means. Scale conversion means for generating a motion vector between both P frames;
When the restored image information is for a P frame, the decoded and divided motion vector is selected, and when the restored image information is for a B frame, the scale-converted motion vector is selected. And the reference image after the motion compensation by the selected motion vector is used to interpolate the restored image information, and the P frame interpolated image is stored in the first storage unit. Interpolation means and order inverse transformation means for returning the frame order of the interpolated image information are provided.

A moving picture coding / decoding apparatus according to a third aspect includes the coding apparatus according to the first aspect and the decoding apparatus according to the second aspect.

A moving picture coding apparatus according to a fourth aspect is the moving picture coding apparatus according to the first aspect, wherein the scale converting means is replaced by
When the frame output from the order conversion unit is a B frame, the motion vector prediction unit that interpolates and predicts the motion vector of the B frame using the calculated motion vector, and the motion vector prediction unit performs motion. A motion vector interpolating means for interpolating a motion vector at a pixel position where the motion vector is not predicted using a motion vector at a peripheral pixel position where the vector is predicted, and the selecting means is characterized in that the frame output from the order converting means is P
If the frame is a frame, the calculated motion vector is selected, and the frame output from the order conversion means is B
If the frame is a frame, the interpolation predicted motion vector and the interpolated motion vector are selected.

A moving picture decoding apparatus according to a fifth aspect is the moving picture decoding apparatus according to the second aspect, wherein the scale converting means is replaced by
When the restored image information is of a B frame, a motion vector predicting means for interpolating and predicting a motion vector of the B frame using the decoded and divided motion vector, and a motion by the motion vector predicting means. A motion vector interpolating means for interpolating a motion vector at a pixel position where the motion vector is not predicted using a motion vector at a peripheral pixel position where the vector is predicted, wherein the selecting means has the restored image information of a P frame. , The decoding-divided motion vector is selected, and when the restored image information is for a B frame, the interpolation predicted motion vector and the interpolated motion vector are selected. It is characterized by doing.

A moving picture coding / decoding apparatus according to a sixth aspect includes the coding apparatus according to the fourth aspect and the decoding apparatus according to the fifth aspect.

According to a seventh aspect of the present invention, in the moving image encoding apparatus according to the first aspect, when the frame output from the order conversion means is a B frame, the B vector is calculated using the calculated motion vector. A motion vector predicting unit that interpolates and predicts a motion vector of a frame is provided, and the selecting unit selects the calculated motion vector when the frame output from the order converting unit is a P frame, and selects the order. When the frame output from the conversion unit is a B frame, the motion vector predicted by interpolation is selected, and the motion vector of the image stored in the first storage unit by the motion vector prediction unit is A first image data interpolating means for interpolating a pixel whose motion vector is not predicted using the predicted peripheral pixels to generate a motion-compensated reference image; A second image for generating a motion-compensation reference image by interpolating a pixel whose motion vector is not predicted using the peripheral pixels whose motion vector of the image stored in the second storage unit has been predicted by the motion vector prediction unit. Data interpolating means.

A moving picture decoding apparatus according to an eighth aspect is the moving image decoding apparatus according to the second aspect, wherein the scale converting means is replaced by
When the restored image information is of a B frame, a motion vector prediction unit that interpolates and predicts the motion vector of the B frame using the decoded and divided motion vector is provided, and the selection unit is the When the restored image information is for a P frame, the decoding-divided motion vector is selected, and when the restored image information is for a B frame, the interpolation predicted motion vector is selected. Further, the pixel whose motion vector is not predicted is interpolated by using the peripheral pixels whose motion vector of the image stored in the first storage means has been predicted by the motion vector prediction means, and the motion compensation reference image is obtained. The first image data interpolating means to be generated and the motion vector predicting means predict the motion vector of the image stored in the second storage means. Motion vector by interpolating pixels that are not predicted by using the peripheral pixels, and a second image data interpolation means for generating a motion compensation reference image.

A moving picture coding / decoding apparatus according to a ninth aspect includes the coding apparatus according to the seventh aspect and the decoding apparatus according to the eighth aspect.

A moving picture coding apparatus according to a tenth aspect detects a motion between frames of a moving picture, predicts image information based on a motion-compensated reference picture, and codes the moving picture coding apparatus. For each frame group consisting of a plurality of consecutive frames of the input image, the P frame located at the rearmost of the frame group is replaced with the other B frames of the frame group.
An order conversion means for changing the frame order of an input image by inserting before a frame, and a P frame of the previous frame group when a P frame is output from the order conversion means.
The frame motion-compensated and interpolated image is stored, and when the order conversion means outputs a B frame,
A first storage unit that stores the P frame motion-compensated and interpolated image of the frame group and the P frame motion-compensated and interpolated one before the image stored in the first storage unit. Second storage means for storing an image, a motion vector calculation means for calculating a motion vector between two frames stored in the storage means, and a frame output from the order conversion means is a B frame. In some cases, scale conversion means for converting the scale of the motion vector to generate a motion vector between the B frame and both P frames stored in the storage means, and a frame output from the order conversion means. Is a P frame, the calculated motion vector is selected, and if the frame output from the order conversion means is a B frame, the scale change is performed. Selecting means for selecting the selected motion vector, motion compensation prediction means for calculating the prediction error of the frame output from the order conversion means using the reference image after motion compensation by the selected motion vector, and the prediction A compression encoding unit that generates a compression encoded image signal from an error, a decoding unit that decodes image information from the compression encoded image signal, and a reference image after motion compensation by the selected motion vector The decoded image information is interpolated using the P-frame interpolated image by the first
And a motion compensation interpolating means for storing in the storage means.

A moving picture decoding apparatus according to an eleventh aspect of the present invention is a moving picture decoding apparatus which restores image information from an input compression-coded image signal, for each frame group consisting of a plurality of consecutive frames. Decoding means for restoring the image information whose frame order has been changed by inserting the P frame located at the rearmost of the frame group before the other B frames of the frame group from the compression-coded image signal. , When the restored image information is of a P frame, the motion compensated interpolated image of the P frame of the previous frame group is stored, and when the restored image information is of a B frame, First storage means for storing a motion-compensated and interpolated image of a P frame of the frame group, and an image stored in the first storage means Second storage means for storing the motion compensated interpolated image of the immediately preceding P frame; and motion vector calculation means for calculating the motion vector between the two frames stored in the storage means. When the restored image information is of a B frame, the scale of the motion vector is converted and a motion between the B frame and both P frames stored in the first and second storage means is performed. Scale conversion means for generating a vector, and when the restored image information is for a P frame, the calculated motion vector is selected, and the restored image information is for a B frame. , Selecting means for selecting the scale-converted motion vector, and interpolating the decoded image information using a reference image after motion compensation by the selected motion vector, Comprising a motion compensated interpolation means for storing the interpolated image frame in the first storage means, and the order inverse transform means for returning the frame order of the interpolated image information.

A moving picture coding / decoding apparatus according to a twelfth aspect includes the coding apparatus according to the tenth aspect and the decoding apparatus according to the eleventh aspect.

The moving picture coding apparatus according to a thirteenth aspect is the moving picture coding apparatus according to the tenth aspect, in which the motion vector calculated by the motion vector calculating means is used in place of the scale converting means, and is output from the order converting means. Using the first motion vector predicting means for interpolating and predicting the motion vector of the current frame which has not been subjected to the order conversion, and the motion vector of the peripheral pixel position where the motion vector is predicted by the first motion vector predicting means. First motion vector interpolating means for interpolating a motion vector at a pixel position where a motion vector is not predicted, and the current unconverted order output from the order converting means using the motion vector calculated by the motion vector calculating means. Second motion vector predicting means for extrapolating and predicting the motion vector of the frame, and the second motion vector predicting means Therefore a second motion vector interpolation means for interpolating the motion vectors of the pixel position motion vector is not estimated using the motion vector of the peripheral pixel position motion vector is predicted, the said selection means,
It is characterized in that either the motion vector predicted by interpolation or the motion vector predicted by extrapolation is selected.

A moving picture decoding apparatus according to a fourteenth aspect is the moving picture decoding apparatus according to the eleventh aspect, in which the motion vector calculated by the motion vector calculating means is used in place of the scale converting means and the order conversion is not performed. A first motion vector predicting unit that interpolates and predicts a motion vector of a frame, and a pixel position where a motion vector is not predicted using a motion vector of a peripheral pixel position where the motion vector is predicted by the first motion vector predicting unit. A first motion vector interpolating means for interpolating the motion vector, and a second motion vector predicting means for extrapolating and predicting the motion vector of the current frame whose order is converted using the motion vector calculated by the motion vector calculating means. , Using the motion vectors at the peripheral pixel positions whose motion vectors have been predicted by the second motion vector prediction means A second motion vector interpolating means for interpolating a motion vector at a pixel position whose prediction vector is not predicted, wherein the selecting means selects either the interpolated predicted motion vector or the extrapolated predicted motion vector. It is characterized by selecting.

A moving picture coding / decoding apparatus according to a fifteenth aspect includes the coding apparatus according to the thirteenth aspect and the decoding apparatus according to the fourteenth aspect.

According to a sixteenth aspect of the present invention, in the moving image encoding apparatus according to the tenth aspect, the motion vector calculated by the motion vector calculating means is used instead of the scale converting means, and the order converting means outputs the motion vector. The first motion vector predicting means for interpolating and predicting the motion vector of the current frame which has not been subjected to the order conversion, and the current vector subjected to the order conversion by the order converting means using the motion vector calculated by the motion vector calculating means. A second motion vector predicting unit that extrapolates and predicts a motion vector of the frame, wherein the selecting unit selects either the interpolated predicted motion vector or the extrapolated predicted motion vector; Furthermore, the motion vector of the image stored in the first storage means by the first or second motion vector prediction means. A first image data interpolating unit that interpolates a pixel whose motion vector is not predicted by using a peripheral pixel whose predicted torque is predicted, and generates a motion-compensated reference image; and the first or second motion vector predicting unit. Two
Second image data interpolating means for interpolating pixels whose motion vectors are not predicted using peripheral pixels whose motion vectors are predicted stored in the storage means, and generating a motion compensation reference image.

A moving picture decoding apparatus according to a seventeenth aspect is the moving picture decoding apparatus according to the eleventh aspect, in which the order conversion is not performed by using the motion vector calculated by the motion vector calculation means instead of the scale conversion means. A first motion vector predicting means for interpolating and predicting a motion vector of a frame, and a second motion for extrapolating and predicting a motion vector of the current frame whose order is converted using the motion vector calculated by the motion vector calculating means. A vector predicting unit, wherein the selecting unit selects either the interpolated predicted motion vector or the extrapolated predicted motion vector, and further, the first or second motion vector predicting unit. The motion vector is predicted using the peripheral pixels whose motion vector of the image stored in the first storage means is predicted by A first image data interpolating means for interpolating non-existing pixels to generate a motion-compensated reference image, and a motion vector of an image stored in the second storage means by the first or second motion vector predicting means. A second image data interpolating unit for interpolating a pixel whose motion vector is not predicted using the predicted neighboring pixels to generate a motion-compensated reference image.

A moving picture coding / decoding apparatus according to a eighteenth aspect includes the coding apparatus according to the sixteenth aspect and the decoding apparatus according to the seventeenth aspect.

A moving picture coding apparatus according to claim 19 detects a motion between frames of a moving picture, predicts image information based on a motion-compensated reference picture, and codes the moving picture coding apparatus. For each frame group consisting of a plurality of consecutive frames of the input image, the P frame located at the rearmost of the frame group is replaced with the other B frames of the frame group.
An order conversion means for changing the frame order of an input image by inserting before a frame, and an image output from the order conversion means, a low frequency band image signal including direct current and other high frequency band image signals. A band dividing unit for dividing the band into two, a band combining unit for combining two images that have been band-divided and individually motion-compensated and interpolated, and a combined image storage unit for storing the band combined images of two consecutive P frames. A motion vector calculation means for calculating a motion vector between two P frame images stored in the composite image storage means; and a scale of the calculated motion vector according to the image size of the low frequency band image signal. And converting the scale of the calculated motion vector according to the image size of the image signal in the high frequency band, the low frequency Scale conversion means for outputting a low-frequency image motion vector scale-converted according to the image size of the high-frequency band image signal and a high-frequency image motion vector scale-converted according to the image size of the high-frequency band image signal, and the band division A low-frequency motion compensation prediction means for calculating a prediction error of a low-frequency band image signal output from the means using a low-frequency motion compensation reference image, and outputting as a low-frequency image prediction error signal; The prediction error of the output image signal in the high frequency band is calculated using the high-frequency motion compensation reference image based on the interpolated or extrapolated motion vector and interpolated, and is output as a high-frequency image prediction error signal. High-frequency motion compensation predicting means, low-frequency compression encoding means for compression-encoding the low-frequency image prediction error signal, and high-frequency compression encoding for the high-frequency image prediction error signal. Compression encoding means, a low frequency decoding means for decoding the signal compressed and encoded by the low frequency compression encoding means, and a signal compression encoded by the high frequency compression encoding means. High frequency decoding means, low frequency motion compensation interpolation means for interpolating the signal decoded by the low frequency decoding means using the low frequency motion compensation reference image, and high frequency decoding means A high-frequency motion-compensated interpolation means for interpolating a signal using the high-frequency motion-compensated reference image and two-frame P-frame interpolated images output from the low-frequency motion-compensated interpolating means are stored. Of these two frames of images, the image of the frame stored later is output to the band synthesizing means, and the low-frequency storage means is output from the high-frequency motion compensation interpolation means. Interpolation of An image is stored, and high-frequency storage means for outputting the image of the frame stored after these two frames of images to the band synthesizing means, and the low-frequency band output from the band dividing means. When the image signal of B frame is of B frame, the low band interpolation motion vector predicting means for interpolating and predicting the motion vector of the image signal using the scaled low band image motion vector, and the band division. When the image signal in the low frequency band output from the means is for a P frame, the motion for low-frequency extrapolation for extrapolating and predicting the motion vector of the image signal using the scale-converted low-frequency image motion vector The image signal in the low frequency band output from the vector predicting means and the band dividing means is B
The motion vector predicted for interpolation is selected for a frame, and the motion predicted for extrapolation is selected when the image signal in the low frequency band output from the band division is for a P frame. A low band selecting unit for selecting a vector, and a pixel for which a motion vector is not predicted by the low band interpolation motion vector predicting unit or the low band extrapolating motion vector predicting unit are stored in the low band storing unit. The low-frequency motion-compensated prediction means and the low-frequency motion-compensated prediction means are generated by interpolating the motion vector of the image of the frame stored later in the image for the frame using the predicted peripheral pixels to generate the low-frequency motion-compensated reference image. Pixels whose motion vector is not predicted by the first low-frequency image data interpolating means for outputting to the low-frequency motion compensation interpolating means and the low-frequency interpolation motion vector predicting means The low-frequency motion compensation reference image is interpolated by using the peripheral pixels in which the motion vector of the image of the previously stored frame of the two-frame images stored in the low-frequency storage unit is predicted. The second low-frequency image data interpolating means for generating and outputting to the low-frequency motion compensation predicting means and the low-frequency motion compensation interpolating means, and the high-frequency band image signal output from the band dividing means are B High-frame interpolation motion vector prediction means for interpolating and predicting the motion vector of the image signal using the scale-converted high-frequency image motion vector, and the high-frequency interpolation motion vector prediction Means for interpolating a motion vector at a pixel position where the motion vector is not predicted by means using the motion vector at a peripheral pixel position where the motion vector is predicted And when the image signal in the high frequency band output from the band dividing means is of a B frame, the motion vector of the image signal is extrapolated and predicted using the scaled high band image motion vector. High-frequency extrapolation motion vector predicting means and high-frequency extrapolation for interpolating a motion vector of a pixel position whose motion vector is not predicted by the high-frequency extrapolation motion vector predicting means using motion vectors of peripheral pixel positions where the motion vector is predicted. If the image signal in the high frequency band output from the motion vector interpolating means and the band dividing means is for a B frame, the interpolation predicted and interpolated motion vector is selected, and the band dividing means outputs the motion vector. When the output high frequency band image signal is of P frame,
Selecting a motion vector that has been extrapolated and interpolated, and outputting the selected motion vector to the high-frequency motion compensation prediction means and the high-frequency motion compensation interpolation means; A compression encoding means and a mixing means for mixing the signals of the respective bands compressed and encoded by the high frequency compression encoding means are provided.

A moving picture decoding apparatus according to a twentieth aspect of the invention is a moving picture decoding apparatus for restoring image information from an input compression-coded image signal, for each frame group consisting of a plurality of consecutive frames. By inserting the P frame located at the back of the frame group in front of the other B frames of the frame group, the frame order can be changed, and the compression-encoded input image signal can be input into a low frequency band including direct current. No. image signal and another high-frequency band image signal, a band synthesizing unit for synthesizing two images individually restored and motion-compensated and interpolated, and band synthesizing for two consecutive P frames. Image storage means for storing the stored image, and a motion vector for calculating a motion vector between the two P frame images stored in the composite image storage means. Calculating means, converting the scale of the calculated motion vector according to the image size of the image signal of the low frequency band and converting the scale of the calculated motion vector according to the image size of the image signal of the high frequency band, Scale conversion means for outputting a low-frequency image motion vector scale-converted according to the image size of the low-frequency band image signal and a high-frequency image motion vector scale-converted according to the image size of the high-frequency band image signal; Low-band decoding means for restoring image information from the compression-coded low-frequency band image signal output from the dividing means, and image information from the compression-coded high-frequency band image signal output from the dividing means And the image information restored by the low-frequency decoding means is used as a low-frequency motion compensation reference image. A low-frequency motion-compensated interpolation means for interpolating using the high-frequency motion compensation reference image, and a high-frequency motion-compensated interpolation means for interpolating the image information restored by the high-frequency decoding means using a high-frequency motion-compensated reference image; 2 frames of P-frame interpolated images output from the motion compensation interpolation means are stored, and a low-order image of the frame stored later from these 2 frames is output to the band synthesis means. Area storage means and two frames of P-frame interpolated images output from the high-frequency motion compensation interpolation means are stored, and the image of the frame stored after these two frames of images is stored. When the image information restored by the low band decoding means is for a B frame, the scale converted low band image motion vector is output. If the image information restored by the low band decoding motion vector predicting unit for interpolating and predicting the motion vector of the B frame by using a video signal is a P frame, the scale conversion is performed. The low-frequency extrapolation motion vector predicting means for extrapolating and predicting the motion vector of the P frame using the low-frequency image motion vector thus generated, and the image information restored by the low-frequency decoding means are for the P frame. In this case, the interpolation predicted motion vector is selected, and when the image information restored by the low band decoding means is of a P frame, the extrapolated predicted motion vector is selected in the low band. Selection means, and a pixel for which a motion vector is not predicted by the low-frequency interpolation motion vector prediction means or the low-frequency extrapolation motion vector prediction means is stored in the low-frequency storage area. The low-frequency motion-compensated reference image is generated by interpolating the motion vector of the image of the frame stored later from the image of the two frames stored in the row using the predicted peripheral pixels. First low-frequency image data interpolating means for outputting to the low-frequency motion compensation predicting means and the low-frequency motion compensation interpolating means, and pixels whose motion vector is not predicted by the low-frequency interpolation motion vector predicting means are the low-frequency areas. Of the two frames of images stored in the storage unit for interpolation, the motion vector of the image of the frame stored earlier is interpolated using the predicted peripheral pixels to generate the low-frequency motion-compensation reference image. The second low frequency image data interpolating means for outputting to the low frequency motion compensation predicting means and the low frequency motion compensation interpolating means, and the image information restored by the high frequency decoding means are B frames. If it is the,
A high-frequency interpolation motion vector prediction unit that interpolates and predicts the motion vector of the B frame using the scale-converted high-frequency image motion vector, and a pixel whose motion vector is not predicted by the high-frequency interpolation motion vector prediction unit. The high-frequency interpolation motion vector interpolating means for interpolating the motion vector of the position using the motion vector of the peripheral pixel position where the motion vector is predicted, and the image information restored by the high-frequency decoding means are of P frames. In some cases, using the scaled high frequency image motion vector, the P
A high-frequency extrapolation motion vector predicting means for extrapolating a motion vector of a frame, and a motion vector of a pixel position for which a motion vector is not predicted by the high-frequency extrapolation motion vector predicting means of a peripheral pixel position where the motion vector is predicted. High-frequency extrapolation motion vector interpolating means for interpolating using motion vectors, and the motion vector interpolated and interpolated when the image information restored by the high-frequency decoding means is of a B frame Is selected, and when the image information restored by the decoding means for the high frequency band is for the P frame, the motion vector interpolated and interpolated is selected, and the selected motion vector is used for the high frequency band. Compensation predicting means and high-frequency selecting means for outputting to the high-frequency motion compensating and interpolating means, and reverse order transform for restoring the order of the band-combined signals. And a stage.

A moving picture coding / decoding apparatus according to a twenty-first aspect includes the coding apparatus according to the nineteenth aspect and the decoding apparatus according to the twentieth aspect.

[0042]

DETAILED DESCRIPTION OF THE INVENTION Referring to the accompanying drawings,
An embodiment of the present invention will be described.

Embodiment 1 FIG. 1 is a block diagram of a first moving picture coding apparatus according to the present invention.

The first moving picture coding apparatus includes a motion vector calculation means (EDT) 11 for calculating a motion vector between images of the past two frames, and a differential signal between the current frame picture and the reference picture after motion compensation. Motion compensation prediction means (PRE) 12 for calculating as a prediction error, compression coding means (COD) 16 for compressing and coding the difference signal, and decoding means (DCD) for decoding the compression-coded difference signal. 17
A motion compensation interpolating means (INP) 13 for interpolating the decoded differential signal using a reference image after motion compensation, and first and second memories (FRM) for storing images of the past two frames. 14 and 15.

Input image signal s to this moving image encoder
10 is supplied to the motion compensation prediction means 12. The output s12 of the motion compensation prediction means 12 is connected to the compression encoding means 16 and the output signal s from the compression encoding means 16 to the outside.
16 is obtained. Also, this output signal s16 is connected to the decoding means 17, and its output s17 is the motion compensation interpolation means 1
Connected to 3. The motion compensation interpolation means 13 is connected to the first memory 14 and the motion vector calculation means 11,
The first memory 14 has four output terminals.
The first output s14-1 is connected to the second memory 15, and the second output s14-2 is the motion vector calculation means 11
, The third output s14-3 is connected to the motion compensation prediction means 12, and the fourth output s14-4 is connected to the motion compensation interpolation means 13. The output s15 of the second memory 15 is connected to the motion vector calculation means 11, and its output s11 is connected to the motion compensation prediction means 12 and the motion compensation interpolation means 13.

FIG. 2 is a block diagram of the first moving picture decoding apparatus according to the present invention.

This moving picture decoding apparatus includes a decoding means (DCD) 22 for decoding a compression-encoded differential signal, and a motion compensation interpolation for interpolating the decoded differential signal with a reference image after motion compensation. Means (INP) 23 and first and second memories (FR) for storing images of the past two frames
M) 24, 25 and a motion vector calculation means (EDT) 26 for calculating a motion vector between the images of the past two frames.
It has and.

In this moving picture decoding apparatus, the compression-coded picture signal s20 is supplied to the decoding means 22. The output s22 of the decoding means 22 is connected to the motion compensation interpolation means 23, and its output s23 is the first memory 24 and the output terminal 2.
Connected to 7. This first memory 24 has three output terminals, and its first output s24-1 is the second memory 2
5, the second output s24-2 is connected to the motion vector calculation means 26, and the third output s24-3 is connected to the motion compensation interpolation means 23. The output s25 of the second memory 25 is connected to the motion vector calculation means 26, and the output s26 is connected to the motion compensation interpolation means 23.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 1, the motion compensation predicting means 12 is based on the block position of the image signal s10 of the current frame inputted from the outside and the motion vector information s11 inputted from the motion vector calculating means 11. Then, the image signal s14-3 of the previous frame, which has been moved by the motion vector from the block position of the image signal s10 of the current frame, is read from the memory 14, and the error information, for example, the image signal of the current frame and the image signal of the previous frame is read. The difference value is obtained and is output to the compression encoding means 16 as the difference signal s12.

In the compression coding means 16, for example, discrete cosine transform (DCT), linear quantization, and variable length coding are performed on the differential signal s12 input in block units, and the compression-coded image information is The difference signal s16 is output to the outside. The difference signal s16 is also output to the decoding means 17.

In the decoding means 17, for example, the compression encoding means 16 is applied to the compression encoded difference signal s16.
, And the image information is restored by linear inverse quantization and inverse discrete cosine transform (IDCT). The restored image information is output to the motion compensation interpolation means 13 as a difference signal s17.

The motion compensation interpolation means 13 moves from the block position by the motion vector by the image block position of the difference signal s17 of the current frame and the motion vector information s11 at the block position input from the motion vector calculation means 11. The corresponding image signal s14-4 of the last frame is read from the first memory 14, and the sum of the difference signal s17 of the current frame and the image signal s14-4 of the previous frame is calculated to obtain the current frame image. To restore. The restored image signal s13 is output to the first memory 14 as a reference image after motion compensation.

In the first memory 14, when the processing of the image signal of one frame is completed, the stored image signal s14-1 for one frame is output to the second memory 15.

In the second memory 15, the first memory 14
The image signal s14-1 of one frame further input is stored as the previous previous frame.

In the motion vector calculating means 11, the image signal s14- of the previous frame inputted from the first memory 14 is inputted.
2 and the image signal s15 of the previous frame input from the second memory 15, a motion vector between these two frames is calculated and used as motion vector information s11. Output to. The motion vector calculation means 11 can be configured by any motion vector calculation method. For example, a block-by-block motion vector calculation method, a variable block size by hierarchization, a region motion vector calculation method of an arbitrary shape, or a pixel-based motion vector calculation method may be used. .

In the moving picture decoding apparatus shown in FIG. 2, the decoding means 22 decodes the compression-encoded differential signal s20 inputted from the outside by the decoding means 17 of the above-mentioned encoding apparatus.
The image information is restored by performing the same processing as in step (a), and the restored difference signal s22 is output to the motion compensation interpolation means 23.

In the motion compensation interpolation means 23, the decoding means 22
From the block position of the differential signal s22 of the current frame input from the above and the motion vector information s26 at the block position input from the motion vector calculation unit 26, as in the case of the motion compensation interpolation unit 13 of the above-described encoding device, The corresponding image signal s24-3 of the frame is read from the first memory 24, and the difference signal s22 of the current frame is read.
And the image signal s24-3 of the preceding frame is calculated to restore the current frame image. The restored image information s23 is output to the output terminal 27 and the first memory 24.

The first memory 24 outputs the image signal s24-1 for the previous frame stored therein to the second memory 25 when the processing of the image signal of the current frame is completed.

In the second memory 25, the first memory 24
The image signal s24-1 input from is stored as the image signal of the previous frame.

In the motion vector calculating means 26, the image signal s24- of the previous frame input from the first memory 24
2 and the image signal s25 of the previous frame input from the second memory 25, a motion vector between these two frames is calculated and output to the motion compensation interpolation means 23 as motion vector information s26. This motion vector calculation means 26 is the motion vector calculation means 1 of the above-mentioned encoding device.
It has the same motion vector calculation method as 1.

As described above, according to the first moving picture coding / decoding apparatus of the present invention, the same motion vector calculating means (EDT) is provided in each of the coding apparatus and the decoding apparatus, and the motion vector is calculated. By using a compressed / decompressed image that can be shared by the encoding side and the decoding side for the calculation of, it becomes unnecessary to transfer the motion vector. Therefore, improvement in coding efficiency can be expected.

Further, since it is not necessary to transfer the motion vector, it is possible to apply a high-performance motion vector calculation method which is not suitable for transfer. Therefore, if the motion vector detection accuracy is improved by an appropriate motion vector calculation method, further improvement in coding efficiency and improvement in image quality can be expected.

Embodiment 2 FIG. 5 is a block diagram of a second moving picture coding apparatus according to the present invention. This second moving image encoding apparatus is the same as the first encoding apparatus (FIG. 1) except that the motion vector calculating means (ED
T) 11 followed by motion vector prediction means (EPRE) 51
And an image data interpolating means (DINP) 52 are added. In FIG. 5, the same components as those of the first encoding device are given the same numbers and their explanations are omitted.

In this moving picture coding apparatus, the output s11 of the motion vector calculating means 11 is the motion vector predicting means 51.
The output s51 of the motion vector predicting means 51 and the third output s14-3 of the first memory 14 are connected to the image data interpolating means 52. The first output s52-1 of the image data interpolation means 52 is connected to the motion compensation prediction means 12, and the second output s52-2 thereof is connected to the motion compensation interpolation means 13.

FIG. 6 is a block diagram of a second moving picture decoding apparatus according to the present invention. In this second moving picture decoding apparatus, in the first decoding apparatus (FIG. 2), the motion vector calculating means (EDT) 26 is followed by the motion vector predicting means (EPRE) 61 and the image data interpolating means (DINP).
62 is added. Also in FIG. 6, the same components as those of the first decoding device are assigned the same numbers as in FIG. 5, and description thereof will be omitted.

In this moving picture decoding apparatus, the output s26 of the motion vector calculating means 26 is the motion vector predicting means 6
Output s61 of the motion vector predicting means 61
And the third output s24-3 of the first memory is connected to the image data interpolation means 62, and the output s62 of the image data interpolation means 62 is connected to the motion compensation interpolation means 23.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 5, the motion compensation prediction means 12, the compression coding means 16, the decoding means 17,
Since the motion compensation interpolating means 13, the first memory 14, the second memory 15, and the motion vector calculating means 11 all operate in the same manner as the corresponding means of the first encoding device,
The description is omitted.

The motion vector predicting means 51 predicts the motion vector of the corresponding block of the current frame based on the motion vector information s11 between the images of the previous frame and the previous previous frame input from the motion vector calculating means 11. , And outputs the motion vector information s51 to the image data interpolating means 52. As a motion vector prediction method, for example, there is a linear extrapolation method shown in FIG. FIG. 23
In, t-2 indicates the previous frame, t-1 indicates the previous frame, and t indicates the current frame. When Vab is the motion vector from the point a (pixel position) of the previous frame calculated by the motion vector calculation unit 11 to the point b of the previous frame, the motion vector prediction unit 51 sets this motion vector Vab to the current frame t. By linearly extending, the motion vector Vbc at the corresponding point c (pixel position) of the current frame can be predicted, and the predicted motion vector information s51 is output to the image data interpolation means 52.

In the image data interpolating means 52, the image data s14-3 of the corresponding previous frame is read from the first memory 14 in accordance with the predicted motion vector information s51, and the motion-compensated reference image (hereinafter, motion-compensated) is read. Create a reference image). The motion vector prediction unit 51 cannot always predict motion vectors at all pixel positions in the current frame. Therefore, for the pixel position where the motion vector is not predicted, it is possible to complete the motion compensation reference image by, for example, linear interpolation using the image data s14-3 of the peripheral pixel position where the motion vector is predicted. Therefore, the reference images s52-1 and s52-2 are output from the image data interpolating means 52 to the motion compensation predicting means 12 and the motion compensation interpolating means 13, respectively, and the motion compensation predicting means 12 generates the image signals of the current frame and the previous frame. The difference value can be obtained and output to the compression encoding means 16.

In the moving picture decoding device of FIG. 6, the motion vector predicting means 61 and the image data interpolating means 62 perform the same operation as the corresponding means of the second coding device (FIG. 5), and other means. , Operates in the same way as the corresponding means of the first decoding device of the invention (FIG. 2).

As a result, the image data interpolation means 62
According to the motion vector predicted by the motion vector prediction means 61, the corresponding image data is read from the memory 24 and supplied to the motion compensation interpolation means 23.

As described above, according to the second moving picture coding / decoding apparatus of the present invention, the motion vector detection accuracy is improved by predicting the motion vector of the current frame from the motion vector of the previous frame. be able to. Therefore, improvement in coding efficiency and improvement in image quality can be expected.

Also, for pixels for which motion vectors are not predicted, a smooth reference image can be created by interpolating image data using peripheral pixels. Therefore, it is possible to prevent a reduction in coding efficiency due to a gap between pixels.

Embodiment 3 FIG. 7 is a block diagram of a third moving picture coding apparatus according to the present invention.

The third moving picture coding apparatus is the same as the first coding apparatus (FIG. 1) except that the motion vector calculating means (ED) is used.
T) 11 followed by motion vector prediction means (EPRE) 71
And a motion vector interpolation means (EINP) 72 is added. In FIG. 7, the same components as those of the first encoding device are given the same numbers and their explanations are omitted.

In this moving picture coding apparatus, the output s11 of the motion vector calculating means 11 is sent to the motion vector predicting means 71.
Is connected to the output s71 of the motion vector predicting means 71.
Is connected to the motion vector interpolation means 72, and its output s
72 is a motion compensation prediction means 12 and a motion compensation interpolation means 13
Connected to. Also, the third output s of the first memory 14
14-3 is also connected to the motion compensation prediction means 12 and the motion compensation interpolation means 13.

FIG. 8 is a block diagram of a third moving picture decoding apparatus according to the present invention.

In this third moving picture decoding apparatus, in the first decoding apparatus (FIG. 2), the motion vector calculating means (EDT) 26 is followed by the motion vector predicting means (EPR).
E) 81 and motion vector interpolation means (EINP) 82 are added. In FIG. 8 as well, the same components as those in the first decoding device are assigned the same numbers as in FIG. 7, and description thereof will be omitted.

In this moving picture decoding device, the output s2 of the motion vector calculating means 26 is sent to the motion vector predicting means 81.
6 is connected, and its output s81 is connected to the motion vector interpolation means 82, and the output s8 of the motion vector interpolation means 82.
2 is connected to the motion compensation interpolation means 23.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 7, the motion compensation prediction means 12, the compression coding means 16, the decoding means 17,
Since the motion compensation interpolating means 13, the first memory 14, the second memory 15, and the motion vector calculating means 11 all operate in the same manner as the corresponding means of the first encoding device,
The description is omitted.

The motion vector predicting means 71 is the same as that of the second encoding device, based on the motion vector information s11 between the images of the previous frame and the previous previous frame input from the motion vector calculating means 11. The motion vector of the corresponding block of the frame is predicted, and the motion vector information s71 is output to the motion vector interpolation means 72.

In addition, the motion vector interpolation means 72 calculates the motion vector of an unpredicted pixel based on the motion vector information s71 of the predicted pixel by linear interpolation of the predicted motion vector of the peripheral pixel positions. There is. Therefore, the motion vector information s72 for all the pixels of the input image can be output to the motion compensation prediction unit 12 and the motion compensation interpolation unit 13.

In the moving picture decoding apparatus shown in FIG. 8, the motion vector predicting means 81 performs the same operation as the motion vector predicting means 61 of the second decoding apparatus (FIG. 6), and the motion vector interpolating means 82 uses the third code. The same operation as that of the rectification device (FIG. 7) is performed. All other means operate in the same manner as the corresponding means of the first decoding device (FIG. 2) of the present invention.

As a result, the motion vector interpolation means 82
Supplies the predicted motion vector information s82 from the motion vector prediction unit 81 to the motion compensation interpolation unit 23.

As described above, according to the third moving picture coding / decoding apparatus of the present invention, the motion vector detection accuracy is improved by predicting the motion vector of the current frame from the motion vector of the previous frame. You can Therefore, improvement in coding efficiency and improvement in image quality can be expected.

Further, with respect to the pixel position where the motion vector is not predicted, the motion vector can be predicted smoothly by interpolating using the motion vector of the peripheral pixel position. Therefore, it is possible to prevent a reduction in coding efficiency due to a motion vector prediction error.

Embodiment 4 FIG. 9 is a block diagram of a fourth moving picture coding apparatus according to the present invention.

The fourth moving picture coding apparatus includes an order conversion means (ORD) 911 for changing the frame order of an input image,
The first memory (FRM) 94 for storing the restored image of the frame subjected to the order conversion, the second memory (FRM) 95 for storing the restored image generated previously, and the motion vector between two frames of the image are stored. Motion vector calculation means (EDT) 91 for calculating in block units, scale conversion means (ESCD) 99 for converting the scale of motion vectors, selection means 910 for selecting motion vectors, and difference with motion compensation between frames of images. A motion compensation prediction unit (PRE) 92 for calculating a signal, a compression encoding unit (COD) 96 for compressing and encoding a differential signal, a decoding unit (DCD) 97 for restoring a compressed differential signal, and a compressed Mixing means (ΜPX) 98 for variable-length coding and mixing information such as a differential signal and a motion vector, and a front or rear frame depending on the restored differential signal. Motion compensated interpolation means for generating a restoration image uncompressed image signal over beam with motion compensation (I
NP) 93.

Input image signal s to this moving image encoder
90 is first supplied to the order conversion means 911, and the output s911 of the order conversion means 911 is connected to the motion compensation prediction means 92 and the motion vector calculation means 91. The output s91 of the motion vector calculation means 91 is the scale conversion means 99,
The output s92 of the motion compensation prediction unit 92 is connected to the selection unit 910 and the mixing unit 98, and is connected to the compression encoding unit 96. The output s96 of this compression encoding means 96
Is connected to the mixing means 98 and the decoding means 97, and an output signal s98 to the outside is obtained from the mixing means 98. The output s97 of the decoding means 97 is the motion compensation interpolation means 93.
The output s93 of the motion compensation interpolation means 93 is connected to the first memory 94. This first memory 94 has four output terminals, and its first output s94-
1 is connected to the second memory 95, and the second output s94-
2 is connected to the motion compensation prediction means 92, and the third output s9
4-3 is connected to the motion compensation interpolation means 93, and the fourth output s94-4 is connected to the motion vector calculation means 91.
The second memory 95 has two output terminals, the first output s95-1 is connected to the motion compensation prediction means 92, and the second output s95-2 is connected to the motion compensation interpolation means 93.

FIG. 10 is a block diagram of a fourth moving picture decoding apparatus according to the present invention.

A compression-encoded image signal in which motion vectors are mixed is input to this moving image decoding apparatus as in the conventional apparatus. Here, a division unit (DMPX) 101 that decodes the encoded image signal and divides it into a differential signal and information such as a motion vector, a decoding unit (DCD) 102 that restores the differential signal, and the order conversion is performed. Memory (FRM) 1 for storing the restored image of the selected frame
04, a second memory (FRM) 105 for storing the previously generated image, a scale conversion unit (ESCD) 106 for changing the scale of the motion vector, a selection unit 107 for selecting the motion vector, and a restored unit. A motion compensation interpolating means (INP) 103 for interpolating a difference signal by using a reference image after motion compensation of a preceding or subsequent frame, and an order reverse transforming means (ROR) for returning the order of generated image frames.
D) 108.

In this moving picture decoding apparatus, the compression-coded input image signal s100 is connected to the dividing means 101, the first output s101-1 of the dividing means 101 is connected to the decoding means 102, and the second output s101-1 is connected to the decoding means 102. The output s101-2 is connected to the scale conversion means 106 and the selection means 107. The output s102 of the decoding means 102 is the motion compensation interpolation means 103.
And the output s103 is connected to
And the first memory 24. The output s106 of the scale conversion means 106 is connected to the selection means 107, and the output s107 of the selection means 107 is connected to the motion compensation interpolation means 103. Then, the order reverse conversion means 10
The eight outputs s108 are connected to the output terminal 109.
Further, the first memory 104 has two output terminals, the first output s104-1 is connected to the second memory 105, and the second output s104-2 is the motion compensation interpolation means 10.
3 is connected. Further, the output s of the second memory 105
Reference numeral 105 is connected to the motion compensation interpolation means 103.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 9, the order conversion means 911 converts the input image frames into a predetermined order and outputs those image frames as image information s911. Here, the predetermined order is a frame order in which, for example, when the order variable m = 3, as shown in FIG. Figure 2
In FIG. 4, the image frames whose order is changed like 3, 6, 9 are referred to as P frames below, 1, 2, 4,
A frame such as 5 is called a B frame.

When the P frame is input as the image information s911, the motion vector calculating means 91 uses the block matching method or the like to calculate the motion vector information s as in the conventional case.
91, and outputs them to the scale converting means 99, the selecting means 910, and the mixing means 98, respectively. But,
When the B frame is input as the image information s911, the vector operation and output are not performed.

In the scale conversion means 99, the input P
The motion vector information s911 between frames is scale-converted so that it can be applied to the B frame, and the scale-converted motion vector s99 is output to the selection unit 910. As a scale conversion method, for example, when a distance from a front P frame to a certain B frame is n and a distance to a rear P frame is (mn), the forward motion vector predictor of the B frame is , (N / m) of the motion vector between the P frames before and after input here
It is possible to output the backward predicted motion vector of the B frame as ((m−n) / m) times the motion vector between the preceding and following P frames input here.

In the selecting means 910, when the P frame is processed by this moving picture decoding apparatus, the motion vector information s91 between P frames from the motion vector calculating means 91.
Is selected and output as motion vector information s910. When the B frame is processed, the scale vector 99 converts the scale-converted motion vector information s99 and outputs it as the B frame motion vector information s910.

In the motion compensation predicting means 92, when the image signal of the P frame and the motion vector information are inputted, the motion vector information s91 calculated through the selecting means 910 is used to calculate the P frame of the preceding P frame. The image signal s95-1 corresponding to the motion vector is read from the second memory 95, and error information, for example, the difference image signal s92 is output as in the conventional device. When the B frame image signal is input, based on the forward and backward motion vector information s99 converted by the scale conversion unit 99, the image signals s95-1 and s95-1 corresponding to the forward P frame motion vector, respectively. The image signal s94-2 corresponding to the motion vector of the rear P frame is read from the second memory and the first memory, and error information of the front image signal, the rear image signal, or the front / rear average image signal is obtained. Calculate Then, of any of the error information, for example, one having the smallest mean square error of the difference signal is selected as the difference image s92, and is output to the compression encoding unit 96.

Here, compression encoding means 96 and decoding means 9
7 and the mixing means 98 respectively operate in the same manner as in the conventional device (FIG. 3).

In the motion compensating interpolation means 93, the decoding means 97
When the image information s97 of the P frame is input from the second memory 95, the image signal s95-1 corresponding to the motion vector of the preceding P frame is output from the second memory 95 based on the motion vector information s91 input from the selecting means 910. The read image is added and added to the differential image signal as in the case of the conventional apparatus to output the restored image signal s93. Also, the decryption means 97 to B
When the frame image information s97 is input, based on the forward and backward motion vector information s99 converted by the scale conversion means 99, the image signal s95-2 and the backward image signal s95-2 corresponding to the forward P frame motion vector, respectively. Image signal s94-corresponding to the motion vector of P frame
3 is read from the second memory 95 and the first memory 94, and a front image signal, a rear image signal, or a front / rear average image signal is calculated. Then, any one of these image information is selected according to the transferred information and added to the difference signal to output the restored image s93.

The first memory 94 stores only the P frame image signal, and immediately before the next P frame is processed, the one frame image signal s9 stored therein is stored.
4-1 is output to the second memory 95.

In the second memory 95, the first memory 94
The one-frame image signal s94-1 that is input further is stored.

In the moving picture decoding apparatus of FIG. 10, the dividing means 101 and the decoding means 102 perform the same operations as those of the conventional apparatus (FIG. 2), and the scale converting means 106, the selecting means 107, and the motion compensation interpolating means 103. , First memory 1
04 and the second memory 105 perform the same operation as that of the fourth encoding device (FIG. 9), and thus the description thereof will be omitted.

In the order inverse transforming means 108, with respect to the restored image s103 input from the motion compensation interpolating means 103,
The image frames whose order has been changed by the order conversion unit 911 of the encoding device are returned to the original order and output to the output terminal 109.

As described above, according to the fourth moving picture coding / decoding apparatus of the present invention, the order of images is converted and the motion vector of the B frame is generated by the scale conversion of the motion vector. Calculate motion vector by m
It is sufficient to perform it only for P-frames at every other frame. Therefore, the amount of processing can be reduced, and the amount of codes for transferring motion vectors can also be reduced, and improvement in encoding efficiency can be expected.

As for the B frame, by interpolating using the P frames before and after the B frame, the image quality can be coded with almost no deterioration even if the motion vector is not transferred. Therefore, the device on the encoding side and the decoding side can be configured only by adding a simple scale converting means, a selecting means, and a memory for one frame.
The burden on the device is also reduced.

Embodiment 5 FIG. 11 is a block diagram of a fifth moving picture coding apparatus according to the present invention. This fifth moving image encoding apparatus is the same as the fourth encoding apparatus (FIG. 9) except that the scale conversion means (ESC) is used.
Instead of D), motion vector predictor (EPRE) 1
11 and a motion vector interpolation means (EINP) 112 are provided.

In FIG. 11, the order conversion means (ORD)
911, a motion vector calculation means (EDT) 91, a selection means 910, a motion compensation prediction means (PRE) 92,
Compression encoding means (COD) 96 and mixing means (MPX)
98, a decoding means (DCD) 97, a motion compensation interpolation means (INP) 93, a first memory (FRM) 94, and a second memory (FRM) 95 are similar to those of the fourth encoding device. Since they have a function and are connected in the same manner, the same numbers are given and their explanations are omitted.

Here, the output s91 of the motion vector calculation means 91 is connected to the motion vector prediction means 111, and the output s111 of the motion vector prediction means 111 is connected to the motion vector interpolation means 112 and the motion vector interpolation means 112. The output s112 is connected to the selection means 910.

FIG. 12 is a block diagram of a fifth moving picture decoding apparatus according to the present invention. This fifth moving image decoding device is the same as the fourth decoding device (FIG. 10) except that the scale conversion means (ESCD) is replaced by a motion vector prediction means (EPRE) 111 and a motion vector interpolation means (EIN).
P) 112 is provided.

In FIG. 12, the dividing means (DMPX) 1
01, a decoding means (DCD) 102, a motion compensation interpolation means (INP) 103, and a reverse order transformation means (RORD) 1
08, the first memory (FRM) 104, the second memory (FRM) 105, and the selection means 107 have the same functions as the fourth decoding device and are connected in the same manner.
The same numbers are given and explanations are omitted.

Here, the output s101- of the dividing means 101
2 is connected to the motion vector predicting means 121, the output s121 of the motion vector predicting means 121 is connected to the motion vector interpolating means 122, and the motion vector interpolating means 12 is connected.
The second output s122 is connected to the selection means 107.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 11, the order conversion means 911, the motion vector calculation means 91, the selection means 910, the motion compensation prediction means 92, the compression coding means 96,
Mixing means 98, decoding means 97, motion compensation interpolation means 93,
Since the first memory 94 and the second memory 95 both operate in the same way as the corresponding means of the fourth encoding device, their explanations are omitted.

In the motion vector predicting means 111, the forward predictive motion vector of the image data at the corresponding position of the current B frame is calculated from the motion vector information s91 of the previous P frame and the subsequent P frame input from the motion vector calculating means 91. And the backward motion vector predictor, and outputs the motion vector information s111 to the motion vector interpolation means 112. As a motion vector prediction method, for example, FIG.
There is a method of linear interpolation prediction shown in. In FIG. 25, t
-M indicates the previous P frame, t + n indicates the subsequent P frame, and t indicates the current B frame. When Vab is a motion vector calculated by the motion vector calculation means 91 from point a of the previous frame (P frame) to point b of the subsequent frame (P frame), the motion vector prediction means 11
In 1, the motion vector Vac between the previous frame and the motion vector Vac between the previous frame and the point c passing through the current frame (B frame) of this motion vector Vab.
cb is linearly interpolated and predicted as in equations (1) and (2), respectively. Therefore, these motion vector predictors Vac, V
The cb is output to the motion vector interpolation means 112 as the motion vector predictor information s111.

Vac = Vabm / (m + n) (1) Vcb = -Vabn / (m + n) (2) In the motion vector interpolating unit 112, a pixel that is not predicted based on the predicted motion vector information s111. Is calculated by linearly interpolating the motion vector predicted at the peripheral pixel position. Therefore, the motion vector information s910 for all the pixels of the input image can be output from the selection unit 910 to the motion compensation prediction unit 92 and the motion compensation interpolation unit 93.

In the moving picture decoding apparatus of FIG. 12, the dividing means 101, the decoding means 102, and the motion compensation interpolation means 10
3, order reverse conversion means 108, first memory 104, second
The memory 105 and the selection means 107 are both the fourth
The same operation as the corresponding means of the decoding apparatus of FIG. 10 (FIG. 10) is performed. The same operation as the vector interpolation means 112 is performed.

As a result, the motion vector interpolation means 122
Supplies the predicted motion vector information s122 from the motion vector prediction means 121 to the motion compensation interpolation means 103 via the selection means 107.

As described above, according to the fifth moving picture coding / decoding apparatus of the present invention, by converting the order of the pictures, the motion vector of the B frame is generated by prediction and interpolation, It suffices to calculate the motion vector only for P frames every m frames. Therefore, the amount of processing can be reduced, and the amount of codes for transferring motion vectors can also be reduced, and improvement in encoding efficiency can be expected.

Further, with respect to the B frame, the interpolation can be performed by using the P frames before and after the B frame, without substantially reducing the image quality without transferring the motion vector. Therefore, the device on the encoding side and the device on the decoding side can be configured only by adding the simple motion vector predicting means and the motion vector interpolating means, and the load on the device is lightened.

Further, the motion vector of the B frame is linearly interpolated and predicted from the motion vector of the P frame, and interpolation is performed using the motion vector of the predicted peripheral pixel position even for the unpredicted pixel. You can eliminate the gap. Therefore, improvement in image quality can be expected.

Sixth Embodiment FIG. 13 is a block diagram of a sixth moving picture coding apparatus according to the present invention. This sixth moving picture coding apparatus is the same as the fourth moving picture coding apparatus (FIG. 9), but instead of the scale converting means (ESCD) 99, a motion vector predicting means (EPRE) 131 and a first image data. Interpolation means (DI
NP1) 133 and a second image data interpolating means (DI
NP2) 134 is provided.

In FIG. 13, the order conversion means (ORD)
911, motion vector calculation means (EDT) 91, motion compensation prediction means (PRE) 92, and compression coding means (C).
OD) 96, mixing means (MPX) 98, decoding means (DCD) 97, motion compensation interpolation means (INP) 93
Has the same function as that of the fourth encoding device and is connected in the same manner.

In this moving picture coding apparatus, the output s91 of the motion vector calculation means 91 is the motion vector prediction means 1
31 and output s of the motion vector predictor 131
131 is connected to the selection means 910. The output s910 of the selecting means 910 is connected to the first image data interpolating means 133 and the second image data interpolating means 134, and the outputs s of the image data interpolating means 133 and 134 are connected to each other.
Both 133 and s134 are connected to the motion compensation prediction means 92 and the motion compensation interpolation means 93. Further, the third output s94-3 of the first memory 94 is connected to the first image data interpolating means 133, and the output s95 of the second memory 95 is connected to the second image data interpolating means 134. ing.

FIG. 14 is a block diagram of a sixth moving picture decoding apparatus according to the present invention. This sixth moving image decoding apparatus is the same as the fourth decoding apparatus (FIG. 10) except that the scale conversion means (ESCD) 106 is replaced by a motion vector prediction means (EPRE) 141 and a first image data interpolation means. A (DINP1) 143 and a second image data interpolating means (DINP2) 144 are provided.

In FIG. 14, the dividing means (DMPX) 1
01, a decoding means (DCD) 102, a motion compensation interpolation means (INP) 103, and a reverse order transformation means (RORD) 1
08 has the same function as that of the fourth decoding device and is connected in the same manner, and therefore, the same number is assigned and description thereof is omitted.

In this decoding device, the second output s101-2 of the dividing means 101 is the motion vector predicting means 141.
Connected to the output s14 of the motion vector predicting means 141
1 is output to the selection means 107, and the output s107 of the selection means 107 is output to the first image data interpolation means 143 and the second image data interpolation means 144. Also, the output s of the first and second image data interpolating means 143, 144
143 and s144 are both motion compensation interpolation means 103.
It is connected to the. In addition, the second memory of the first memory 104
Output s104-2 is the first image data interpolating means 14
3, the output s105 of the second memory 105 is
It is connected to the second image data interpolation means 144.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 13, the order conversion means 911, the motion vector calculation means 91, the selection means 910, the motion compensation prediction means 92, the compression coding means 96,
Mixing means 98, decoding means 97, motion compensation interpolation means 93,
The first memory 94 and the second memory 95 both perform the same operation as the corresponding means of the fourth coding apparatus, and the motion vector prediction means 131 is the motion vector prediction means of the fifth coding apparatus. Since the operation is the same as 111, the description is omitted.

In the first image data interpolating means 133, the first image data interpolating means 133 operates in accordance with the input forward motion vector predictor s910.
The corresponding image data s94-3 of the previous frame (P frame) is read from the memory 94 to create a motion compensation reference image. For pixels of the current B frame that are not predicted by the motion vector predicting unit 131, it is possible to complete a motion compensation reference image by using, for example, linear interpolation, using the image data s94-3 at the peripheral pixel position where the motion vector is predicted. is there. Therefore, the reference image s133 of the previous frame can be output from the image data interpolation unit 133 to the motion compensation prediction unit 92 and the motion compensation interpolation unit 93, respectively.

In the second image data interpolating means 134, the second image data interpolating means 134 follows the second backward motion vector s910.
The corresponding image data s95 of the subsequent frame (P frame) is read from the memory 95 to create a motion compensation reference image. For the pixels of the current B frame that are not predicted by the motion vector predicting means, it is possible to complete the motion compensation reference image by using, for example, linear interpolation, using the image data s95 at the peripheral pixel position where the motion vector is predicted. Therefore, the reference image s134 of the subsequent frame can be output from the image data interpolation unit 134 to the motion compensation prediction unit 92 and the motion compensation interpolation unit 93, respectively.

In the moving picture decoding apparatus of FIG. 14, the dividing means 101, the decoding means 102, and the motion compensation interpolation means 10
3, order reverse conversion means 108, first memory 104, second
The memory 105 and the selection means 107 are both the fourth
The same operation as that of the corresponding decoding apparatus (FIG. 10) is performed, and the motion vector prediction unit 141, the first image data interpolation unit 143, and the second image data interpolation unit 144 are performed.
Performs the same operation as the corresponding means of the sixth encoding device (FIG. 13).

As a result, the first image data interpolating means 1
43 and the second image data interpolating means 144, in accordance with the forward or backward motion vector information s107 respectively supplied from the selecting means 107, the corresponding image data of the previous frame in the first memory 104 and the second memory 104, respectively. Of the reference images s143 and s14
4 is supplied to the motion compensation interpolation means 103.

As described above, according to the sixth moving picture coding / decoding apparatus of the present invention, after the order of the pictures is converted, the motion vector of the B frame is predicted and the picture data thereof is generated. By doing so, it is only necessary to calculate the motion vector for every m frames of Ρ frames. Therefore, the amount of processing can be reduced, and the amount of codes for transferring motion vectors can also be reduced, and improvement in encoding efficiency can be expected.

Further, the B frame can be encoded by interpolating using the P frames before and after it, without substantially reducing the image quality without transferring the motion vector. Therefore, the device on the encoding side and the device on the decoding side can be configured only by adding the simple motion vector predicting means and the motion vector interpolating means, and the load on the device is lightened.

Furthermore, since the motion vector of the B frame is linearly interpolated and predicted from the motion vector of the P frame, and the pixel of which the motion vector is not predicted is interpolated using the motion vector of the predicted peripheral pixel position, The gap between the motion vector predictors can be eliminated. Therefore, improvement in image quality can be expected.

Embodiment 7 FIG. 15 is a block diagram of a seventh moving picture coding apparatus according to the present invention.

The seventh moving picture coding apparatus includes an order conversion means (ORD) 150 for changing the frame order of an input image,
First and second memories (FRM) 154 and 155, and a motion vector calculation means (EDT) 151 for calculating a motion vector between images of two frames stored in these memories;
Scale conversion means (ESCD) 15 for converting the scale of the motion vector into the motion vector of the image between the two frames stored in the first and second memories 154 and 155.
8 and selection means 159 for selecting either the calculated motion vector or the scale-converted motion vector.
, A motion compensation prediction means (PRE) 152 for obtaining a prediction error between the image of the current frame and the reference image after motion compensation, and a compression coding means (CO) for compression coding this prediction error signal.
D) 156, a decoding means (DCD) 157 for decoding the compression-encoded signal, and a motion compensation interpolation means (INP) for interpolating the decoded signal using the reference image after motion compensation.
153 and.

Input image signal s to this moving image encoding apparatus
150 is first supplied to the order conversion means 150, and the output s150-1 of the order conversion means 150 is the motion compensation prediction means 1
Connected to 52. The output s152 of the motion compensation prediction means 152 is connected to the compression encoding means 156, and the output signal s156 to the outside is obtained from the compression encoding means 156. Further, the signal s156 of the compression coding means 156 is connected to the decoding means 157, and the output s15 of the decoding means 157.
7 is connected to the motion compensation interpolation means 153, and the output s153 of the motion compensation interpolation means 153 is connected to the first memory 154. The first memory 154 has three output terminals, the first output s154-1 is connected to the second memory 155, and the second output s154-2 is connected to the motion vector calculation means 151. , The third output s154
-3 is a motion compensation prediction means 152 and a motion compensation interpolation means 1
Connected to 53. The second memory 155 has two output terminals, the first output s155-1 of which is connected to the motion vector calculation means 151, and the second output s155.
-2 is the motion compensation prediction means 152 and the motion compensation interpolation means 1
It is connected to 53. Further, the output s151 of the motion vector calculating means 151 is connected to the scale converting means 158 and the selecting means 159, and the output s15 of the selecting means 159.
9 is a motion compensation prediction means 152 and a motion compensation interpolation means 15
Connected to 3.

FIG. 16 is a block diagram of the seventh moving picture decoding apparatus according to the present invention.

This moving picture decoding apparatus includes a decoding means (DCD) 161 for decoding a compression-encoded differential signal, and a first and a second memory (for storing two frames of images whose order has been converted). FRM) 164 and 165, a motion vector calculation means (EDT) 163 for calculating a motion vector between the two frames of images stored therein, and a scale of the motion vector to convert the stored two frames. Conversion means (ESC
D) 166, selection means 167 for selecting either the calculated motion vector or the scale-converted motion vector, and motion compensation interpolation means (INP) for interpolating the decoded signal using the motion-compensated reference image. ) 162,
And an order reversing means (RORD) 168.

In this moving image decoding apparatus, the compression-coded image signal s160 is supplied to the decoding means 161.
The output signal s161 of the decoding means 161 is connected to the motion compensation interpolation means 162, the output s162 thereof is connected to the order inverse transformation means 168 and the first memory 164, and the output s168 of the order inverse transformation means 168 is connected to the output terminal 169. To be done. Further, the first memory 164 has three output terminals, and the first output s164-1 thereof is the second memory 165.
, The second output s164-2 is connected to the motion vector calculation means 163, and the third output s164-3 is connected to the motion compensation interpolation means 162. The second memory 165 has two output terminals, the first output s165-1 is connected to the motion vector calculation means 163, and the second output s165-2 is the motion compensation interpolation means 1
It is connected to 62. Furthermore, the output s163 of the motion vector calculation means 163 is connected to the scale conversion means 166 and the selection means 167, and the output s16 of the selection means 167 is connected.
7 is connected to the motion compensation interpolation means 162.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus shown in FIG. 15, the order conversion means 150, in the same way as the fourth coding apparatus of the present invention (FIG. 9), has a predetermined order for input image frames. The converted image frames are output as image information s150-1.

In the motion compensation predicting means 152, when the P frame is input as the image frame from the order converting means 150, the calculated motion input through the selecting means 159, as in the fourth encoding device. Based on the vector s158, the image signal s155-2 corresponding to the motion vector of the front P frame is read from the second memory 155, and error information, for example, the difference image signal s152 is output. When the B frame image signal is input,
Based on the forward and backward motion vector information s158 converted by the scale conversion means 158, the forward P
Image signal s155-corresponding to the motion vector of the frame
2 and the image signal s154-3 corresponding to the rear P frame motion vector are read from the second memory and the first memory, and the error of the front image signal, the rear image signal, or the front and rear average image signal is read. Compute information. And
Among these pieces of error information, for example, one having the smallest mean square error of the difference signal is selected as the difference image s152 and output to the compression encoding unit 156.

The compression encoding means 156 is the first of the present invention.
Similarly to the encoding device of the above, for example, a discrete cosine transform (DC
T), linear quantization, and variable-length coding are performed, and the compression-coded image information is output to the outside as a difference signal s156. The difference signal s156 is also output to the decoding means 157.

In the decoding means 157, similarly to the first encoding device of the present invention, the compression-encoded difference signal s156 is subjected to variable length decoding corresponding to the compression-encoding means 156, and the linear inverse is performed. Quantization and inverse discrete cosine transform (ID
Image information is restored by CT). The restored image information is used as a differential signal s157 for motion compensation interpolation means 153.
Is output to.

In the motion compensation interpolation means 153, when the P frame image information s157 is input from the decoding means 157, the selection means 159 is used, as in the fourth encoding apparatus of the present invention.
The image signal s15 corresponding to the motion vector of the preceding P frame based on the motion vector s159 input from
5-2 is read from the second memory 155, added to the difference signal, and the restored image signal s153 is output. Also,
When the B frame image information s157 is input from the decoding means 157, based on the forward and backward motion vector information s159 converted by the scale conversion means 158,
The image signal s154-2 corresponding to the motion vector of the front P frame and the image signal s154-3 corresponding to the motion vector of the rear P frame are read from the second memory 155 and the first memory 154, respectively, The image signal of, the image signal of the rear, or the average image signal of the front and the rear is calculated. Then, any one of these pieces of image information is selected according to the transferred information, added to the difference signal, and the restored image s153 is output.

In the first memory 154, only the P frame image signal is stored, and immediately before the next P frame is processed, the one frame image signal s1 stored therein is stored.
54-1 is output to the second frame 155.

In the second memory 155, the first memory 1
1-frame image signal s154-1 input from S54
To store.

In the motion vector calculation means 151, from the rearward P frame image signal s154-2 input from the first memory 154 and the frontward P frame image signal s155-1 input from the second memory 155. , A motion vector between two frames is calculated, and motion vector information s1
The scale conversion means 158 and the selection means 159 are designated as 51.
Output to.

Similar to the fourth encoding apparatus of the present invention, the scale conversion means 158 performs scale conversion on the input motion vector s151 between P frames so that it can be applied to the B frame, and the scale is converted. The converted motion vector s158 is output to the selection unit 159.

In the selecting means 159, when the P frame is processed by this moving picture decoding apparatus, the motion vector s151 between P frames from the motion vector calculating means 151.
Is output as the motion vector information s159, and when the B frame is processed, the scale conversion means 159 selects the motion vector information s158 scale-converted for the B frame, and the motion vector information s159 of the B frame. Output as.

In the moving picture decoding apparatus of FIG. 16, a decoding means 161, a motion compensation interpolation means 162, a first memory 1
44, second memory 165, motion vector calculation means 16
3, scale conversion means 166, and selection means 167,
Each of them operates in the same way as the corresponding means of the seventh encoding device (FIG. 15), and the explanation thereof is omitted.

The order inversion transforming means 168 applies to the restored image s162 input from the motion compensation interpolating means 162,
The image frames whose order has been changed by the order conversion unit 150 of the encoding device are returned to the original order and output to the output terminal 169.

As described above, according to the seventh moving picture coding / decoding apparatus of the present invention, the same motion vector calculating means (EDT) is provided in each of the coding apparatus and the decoding apparatus, and the motion vector is calculated. By using a compressed / decompressed image that can be shared by the encoding side and the decoding side for the calculation of, it becomes unnecessary to transfer the motion vector. Therefore, improvement in coding efficiency can be expected.

Since it is not necessary to transfer the motion vector, it is possible to apply a high-performance motion vector calculation method, which is not suitable for transfer. Therefore, if the motion vector detection accuracy is improved by an appropriate motion vector calculation method, further improvement in coding efficiency and improvement in image quality can be expected.

Furthermore, by converting the order of the images and generating the motion vector of the B frame by the scale conversion of the motion vector, it is only necessary to calculate the motion vector for every P frames every m frames. Therefore, the processing amount can be reduced, and the encoding / decoding speed can be increased.

Eighth Embodiment FIG. 17 is a block diagram of an eighth moving picture coding apparatus according to the present invention.

The eighth moving picture coding apparatus, in the seventh coding apparatus (FIG. 15), eliminates the scale conversion means (ESCD) for converting the scale of the motion vector, and predicts the motion vector for the B frame. First motion vector predicting means (EPRE1) 171 and second motion vector predicting means (EPR) for predicting a motion vector between P frames.
E2) 172 and first motion vector interpolation means (EINP1) 173 for interpolating the motion vector for B frame
And a second motion vector interpolation means (EINP2) 174 for interpolating the motion vector between P frames.

In FIG. 17, the order conversion means 150, the motion compensation prediction means 152, the compression encoding means 156, the decoding means 157, the motion compensation interpolation means 153, and the first memory 15
4, second memory 155, motion vector calculation means 15
Since 1 and the selecting means 159 both have the same function as the corresponding means of the seventh encoding device and are connected in the same manner, the same numbers are given and description thereof is omitted.

Here, the first motion vector predicting means 17
The output s151 of the motion vector calculation means 151 is connected to the first and second motion vector prediction means 172, and
The output s171 of the motion vector prediction means 171 of
Output s172 of the second motion vector predicting means 172 is connected to the second motion vector interpolating means 174, and the output s173 of the first motion vector interpolating means 173 and the second s173 The outputs s174 of the motion vector interpolation means 174 are connected to the selection means 159, respectively.

FIG. 18 is a block diagram of an eighth moving picture decoding apparatus according to the present invention.

In the eighth moving picture decoding apparatus, the scale converting means (ESCD) for converting the scale of the motion vector is eliminated in the seventh decoding apparatus (FIG. 16),
First motion vector predicting means (EPRE1) 181 for predicting a B frame motion vector, second motion vector predicting means (EPRE2) 182 for predicting a motion vector between P frames, and B frame motion vector Motion vector interpolation means (EINP1) for interpolating
183 and a second interpolating motion vector between P frames
Motion vector interpolation means (EINP2) 184 of FIG.

Also in FIG. 18, the decoding means 161, the motion compensation interpolation means 162, the order inverse transformation means 168, the first memory 164, the second memory 165, the motion vector calculation means 163, and the selection means 167 are all provided. Since it has the same function as the corresponding means of the seventh decoding device of the present invention and is connected in the same manner, the same numbers are given and the description thereof is omitted.

In this moving picture decoding apparatus, the output s16 of the motion vector calculating means 163 is supplied to the first motion vector predicting means 181 and the second motion vector predicting means 182.
3 is connected, the output s181 of the first motion vector predicting means 181 is connected to the first motion vector interpolating means 183, and the output s1 of the second motion vector predicting means 182.
82 is connected to the second motion vector interpolation means 184, and the output s183 of the first motion vector interpolation means 183.
And the output s184 of the second motion vector interpolation means 184.
Are respectively connected to the selection means 167.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 17, the order conversion means 150, the motion compensation prediction means 152, the compression coding means 156, the decoding means 157, the motion compensation interpolation means 15
3, the first memory 154, the second memory 155, the motion vector calculation means 151, and the selection means 159 all operate in the same way as the corresponding means of the seventh encoding device, and therefore their explanations are omitted.

In the second motion vector predicting means 172,
Based on the motion vector information s151 between the P frame that is the previous frame and the P frame of the previous frame that is input from the motion vector calculation unit 151, the same external information as the motion vector prediction unit 51 of the second encoding device. By the insertion prediction, the motion vector of the image signal at the corresponding position of the current P frame is predicted, and it is output to the second motion vector interpolating means 174 as the motion vector information s172.

Also, the second motion vector interpolation means 174
Then, based on the predicted pixel motion vector information s172, the motion vector of the unpredicted pixel is calculated by linear interpolation of the predicted motion vector of the peripheral pixel positions. Therefore, the motion vector information s174 for all pixels of the P frame of the input image can be output to the motion compensation prediction unit 152 and the motion compensation interpolation unit 153 via the selection unit 159.

In the first motion vector predicting means 171,
From the motion vector information of the front P frame and the rear P frame input from the motion vector calculation means 151,
The motion vector predicting unit 111 of the fifth encoding device performs the same interpolation prediction to predict the motion vector of the image signal at the corresponding position of the current B frame, and the motion vector information s171 is used as the first motion vector. Interpolation means 173
Output to.

Also, the first motion vector interpolation means 173.
Then, based on the predicted pixel motion vector s171, the motion vector of the unpredicted pixel is calculated by linear interpolation from the predicted motion vector of the peripheral pixel positions. Therefore, the motion vector information s173 for all pixels of the B frame of the input image can be output to the motion compensation prediction unit 152 and the motion compensation interpolation unit 153 via the selection unit 159.

In the moving picture decoding apparatus of FIG. 18, the decoding means 161, the motion compensation interpolation means 162, the order inverse transformation means 168, the first memory 164, the second memory 165, the motion vector calculation means 163, and the selection means. 167 all perform the same operation as the corresponding means of the seventh decoding apparatus (FIG. 16) of the present invention, and the first motion vector prediction means 1
81, the second motion vector predicting means 182, the first motion vector interpolating means 183, and the second motion vector interpolating means 184 are the same as the corresponding means of the eighth encoding device (FIG. 17) described above. To work.

As a result, the first motion vector interpolating means 183 receives the predicted motion vector information s183 of all the pixels of the B frame from the motion vector predicting means 181.
The second motion vector interpolation means 184 selects the predicted motion vector information s184 of all the pixels of the P frame from the motion vector prediction means 182, respectively.
It is supplied to the motion compensation interpolation means 162 via 67.

As described above, according to the eighth moving picture coding / decoding apparatus of the present invention, the same motion vector calculating means (EDT) is provided in each of the coding apparatus and the decoding apparatus, and the motion vector is calculated. By using a compressed / decompressed image that can be shared by the encoding side and the decoding side for the calculation of, it becomes unnecessary to transfer the motion vector. Therefore, improvement in coding efficiency can be expected.

Since it is not necessary to transfer the motion vector, it is possible to apply a high-performance motion vector calculation method, which is not suitable for transfer. Therefore, if the motion vector detection accuracy is improved by an appropriate motion vector calculation method, further improvement in coding efficiency and improvement in image quality can be expected.

Furthermore, by converting the order of the images and generating B frames, the motion vector need only be calculated for P frames at intervals of m frames. Therefore, the processing amount is reduced, and the encoding / decoding speed can be increased.

Furthermore, since the motion vector of the P frame is extrapolated from the motion vector of the previous P frame,
It is possible to interpolate even unpredicted pixels by using the peripheral motion vector, and the motion vector of the B frame is interpolated and predicted from the motion vectors of the preceding and following P frames, and similarly, B
Interpolation can be performed using a peripheral motion vector even for an unpredicted pixel of a frame. Therefore, the gap between the motion vector predictors is eliminated, and improvement in image quality can be expected.

Ninth Embodiment FIG. 19 is a block diagram of a ninth moving picture coding apparatus according to the present invention.

The ninth moving picture coding apparatus, in the seventh coding apparatus (FIG. 15), eliminates the scale conversion means (ESCD) for converting the scale of the motion vector, and predicts the motion vector for B frame. First motion vector predicting means (EPRE1) 191 and second motion vector predicting means (EPR) for predicting a motion vector between P frames.
E2) 192, a first image data interpolating means (DINP1) 193 for interpolating a pixel signal for which a B frame motion vector is not predicted, and a second image for interpolating a pixel signal for which a motion vector between P frames is not predicted A data interpolating means (DINP2) 194 is added.

In FIG. 19, the order conversion means 150, motion compensation prediction means 152, compression encoding means 156, decoding means 157, motion compensation interpolation means 153, first memory 15
4, second memory 155, motion vector calculation means 15
1 and the selection means 159 are the seventh encoding device (see FIG. 1).
Since it has the same function as the corresponding means of 5) and is connected in the same manner, the same numbers are given and the description thereof is omitted.

Here, the first motion vector predicting means 19
The output s151 of the motion vector calculation means 151 is connected to the first and second motion vector prediction means 192, and
Output s191 of the motion vector prediction means 191 and the second
The output s172 of the motion vector predicting means 192 is connected to the selecting means 159, and the output s159 of the selecting means 159.
Is connected to the first image data interpolating means 193 and the second image data interpolating means 194, and the third output s154-3 of the first memory is the first image data interpolating means 193.
Connected to the second output of the second memory s155-2
Is connected to the second image data interpolating means 194,
The output s193 of the image data interpolation unit 193 and the output s194 of the second image data interpolation unit 194 are connected to the motion compensation prediction unit 152 and the motion compensation interpolation unit 153, respectively.

FIG. 20 is a block diagram of the ninth moving picture decoding apparatus according to the present invention.

In the ninth moving picture decoding apparatus, the scale conversion means (ESCD) for converting the scale of the motion vector is eliminated in the seventh decoding apparatus (FIG. 16),
Second motion vector predicting means (EPRE2) 202 for predicting a motion vector between P frames, first motion vector predicting means (EPRE1) 201 for predicting a motion vector for B frame, and motion vector between P frames A second image data interpolating means (DINP2) 204 for interpolating a pixel signal whose prediction is not predicted, and a first image data interpolating means (DINP1) 203 for interpolating a pixel signal for which a motion vector for a B frame is unpredictable. It is a thing.

Also in FIG. 20, the decoding means 161, the motion compensation interpolation means 162, the order inverse transformation means 168, the first memory 164, the second memory 165, the motion vector calculation means 163, and the selection means 167 are the same as those of the present invention. Since it has the same function as that of the corresponding means of the seventh decoding device (FIG. 16) and is connected in the same manner, the same numbers are given and the description thereof is omitted.

In this moving picture decoding apparatus, the output s163 of the motion vector calculating means 163 is output to the first motion vector predicting means 201 and the second motion vector predicting means 202.
The output s201 of the first motion vector predicting means 201 and the output s202 of the second motion vector predicting means 202 are connected to the selecting means 167, and the selecting means 16 is connected.
The output s167 of No. 7 is the first image data interpolation means 203.
And the second image data interpolating means 204,
The third output s164-3 of the second memory is connected to the first image data interpolating means 203, and the second output s165-2 of the second memory is connected to the second image data interpolating means 204. Output s2 of the first image data interpolation means 203
03 and the output s20 of the second image data interpolation means 204
4 are connected to the motion compensation interpolation means 162, respectively.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 19, the order conversion means 150, the motion compensation prediction means 152, the compression coding means 156, the decoding means 157, and the motion compensation interpolation means 15
3, the first memory 154, the second memory 155, the motion vector calculation means 151, and the selection means 159 all operate in the same way as the corresponding means of the seventh encoding device (FIG. 15), and therefore will be described. Is omitted.

The first motion vector predicting means 191 and the second motion vector predicting means 192 are respectively the first motion vector predicting means 171 and the second motion vector predicting means 171 of the eighth encoding apparatus (FIG. 17) of the present invention. It operates in the same manner as the vector predicting means 172.

In the first image data interpolating means 193, the backward predictive motion vector s159 for the input B frame is inputted.
In accordance with the above, the image data s154-3 of the corresponding rear P frame is read from the first memory 154 to create a motion compensation reference image. For pixel positions that are not predicted by the motion vector predicting means 191, it is possible to complete the motion compensation reference image by using, for example, linear interpolation, using the image data s154-3 of the peripheral pixel positions for which the motion vector was predicted. Therefore, the reference image s193 of the previous frame can be output from the image data interpolation unit 133 to the motion compensation prediction unit 152 and the motion compensation interpolation unit 153, respectively.

In the second image data interpolating means 194, the image data of the corresponding forward Ρ frame is output from the second memory 155 in accordance with the input predictive motion vector between P frames or the forward predictive motion vector s159 for B frame. s155-2 is read to create a motion compensation reference image. For the pixels of the current B frame that are not predicted by the motion vector predicting unit 192, it is possible to complete the motion compensation reference image by using, for example, linear interpolation, using the image data s155-2 of the peripheral pixel position where the motion vector is predicted. is there. Therefore, the reference image s194 of the subsequent frame is supplied from the image data interpolation unit 194 to the motion compensation prediction unit 152 and the motion compensation interpolation unit 15, respectively.
Can be output to 3.

In the moving picture decoding apparatus of FIG. 20, the decoding means 161, the motion compensation interpolation means 162, the order inverse transformation means 168, the first memory 164, the second memory 165, the motion vector calculation means 163, and the selection means. 167 both perform the same operation as the corresponding means of the seventh decoding apparatus (FIG. 16) of the present invention, and the first motion vector predicting means 2
01, the second motion vector predicting means 202, the first image data interpolating means 203, and the second image data interpolating means 204 respectively perform the same operations as the corresponding means of the ninth encoding device (FIG. 19). To do.

Thereby, the first image data interpolating means 2
03, and the second image data interpolating means 204, according to the forward or backward motion vector information s167 respectively supplied from the selecting means 167, stores all the image data of P frame and B frame respectively in the first memory. 164 is read from the second memory 165, and the reference images s203 and s204 are supplied to the motion compensation interpolation means 162.

As described above, according to the ninth moving picture coding / decoding apparatus of the present invention, the same motion vector calculating means (EDT) is provided in each of the coding apparatus and the decoding apparatus, and the motion vector is calculated. By using a compressed / decompressed image that can be shared by the encoding side and the decoding side for the calculation of, it becomes unnecessary to transfer the motion vector. Therefore, improvement in coding efficiency can be expected.

Since it is not necessary to transfer the motion vector, it is possible to apply a high-performance motion vector calculation method, which is not suitable for transfer. Therefore, if the motion vector detection accuracy is improved by an appropriate motion vector calculation method, further improvement in coding efficiency and improvement in image quality can be expected.

Furthermore, by converting the order of the images and generating the B frames, it is only necessary to calculate the motion vector only for P frames every m frames. Therefore, the processing amount is reduced, and the encoding / decoding speed can be increased.

Furthermore, since the motion vector of the P frame is extrapolated from the motion vector of the previous P frame,
Even for unpredicted pixels, it is possible to interpolate using pixels whose peripheral motion vectors have been predicted, and interpolate the motion vector of the B frame from the motion vectors of the preceding and following P frames to similarly predict the B frame. It is possible to interpolate even the pixels that have not been predicted, by using the pixels for which the surrounding motion vectors have been predicted. Therefore, the gap between the predicted image data pixels is eliminated, and improvement in image quality can be expected.

[Embodiment 10] FIG. 21 is a block diagram of a tenth moving picture coding apparatus according to the present invention.

The tenth encoding apparatus of the present invention is adapted to the hierarchical division encoding method. Therefore, in this moving image encoding apparatus, the order conversion means (ORD) 211
, Band dividing means (A NAL) 212, and mixing means (M
PX) 215, and a band synthesizing means (SYNC) 245,
An order reverse transformation means (RORD) 250, a first memory (FRM1) 246 and a second memory (FRM2) 247 which are first storage means for storing consecutive two frames of which the order transformation has been performed, and movement. Vector calculation means (ED
T) 248 and scale conversion means (SCLD) 249
And a first for compressing and encoding a low frequency band including direct current
Motion compensation prediction means (PRE1) 233, compression coding means (COD1) 234, and decoding means (DCD1) 23
6, the motion compensation interpolation means (INP1) 237, the third memory (FRM3) 238 which is the second storage means for storing the images of the two frames subjected to the order conversion from the first motion compensation prediction means 233, and Fourth memory (FRM4) 23
9 and first motion vector predicting means (EPRE1) 24
0 and the second motion vector prediction means (EPRE2) 24
1, a selection means 244, a first image data interpolation means (DINP1) 242, a second image data interpolation means (DINP2) 243, and second motion compensation for compression-encoding other high frequency bands. Prediction means (PRE2) 2
13, a compression encoding means (COD2) 214, a decoding means (DCD2) 216, and a motion compensation interpolation means (INP).
2) 217, and a fifth memory (FRM5) 218 and a sixth memory (FRM6) 219, which are third storage means for storing the images of the two frames subjected to the order conversion from the second motion compensation prediction means 213. A third motion vector predicting means (EPRE3) 220, a fourth motion vector predicting means (EPRE4) 221, a first motion vector interpolating means (EINP1) 222, and a second motion vector interpolating means (EINP2). ) 223 and selection means 224.

An input image s210 from an external input terminal is supplied to the order conversion means 211 in this moving image coding apparatus. Also, the output s211 of the order conversion means 211
Are connected to the band dividing means 212. The output s245 of the band synthesizing means 245 is connected to the order inverse transforming means 250 and the first memory 246, and the order inverse transforming means 250 is connected.
Output signal s250 is output from the output terminal 250-1 as an image signal for monitoring, for example. In addition, the first output s246-1 of the first memory is the second memory 24
7 is connected to the second output of the first memory s246-2
Is connected to the motion vector calculation means 248, and the output s247 of the second memory 247 is changed to the motion vector calculation means 2
48, and the output s of the motion vector calculation means 248
248 is connected to the scale converting means 249, the first output s249-1 of the scale converting means 249 is connected to the third motion vector predicting means 220 and the fourth motion vector predicting means 221, and the scale converting means 249. Second output s249-2 is connected to the first motion vector predicting means 240 and the second motion vector predicting means 241. The output s215 of the mixing means 215 is taken out as a compression-coded output signal to the outside.

The output s212-2 of the low frequency band including the direct current of the band division means 212 is connected to the first motion compensation prediction means 233, and the output s of the motion compensation prediction means 233.
233 is connected to the compression encoding means 234, the output s234 of the compression encoding means 234 is connected to the mixing means 215 and the decoding means 236, and the output s23 of the decoding means 236.
6 is connected to the motion compensation interpolation means 237, the output s237 of the motion compensation interpolation means 237 is connected to the third memory 238, and the first output s238- of the third memory 238-
1 is connected to the fourth memory 239.

Second output s238 of third memory 238
-2 is connected to the band synthesizing means 245, and the third output s
238-3 is connected to the first image data interpolation means 242, the output s239 of the fourth memory 239 is connected to the second image data interpolation means 243, and the second output s249- of the scale conversion means 249 is connected. 2 is a first motion vector predicting means 240 and a second motion vector predicting means 24.
1, the output s240 of the first motion vector predicting means 240 and the output s241 of the second motion vector predicting means 241 are connected to the selecting means 244, and the selecting means 2
The output s244 of 44 is the first image data interpolating means 24.
2 and the second image data interpolating means 243, and the output s242 and the second output 242 of the first image data interpolating means 242.
The output s243 of the image data interpolating means 243 is connected to the first motion compensation predicting means 233 and the motion compensation interpolating means 237, respectively.

Furthermore, the output s212-1 of the other high frequency band of the band division means 212 is connected to the second motion compensation prediction means 213, and the output s213 of the second motion compensation prediction means 213 is the compression coding means. The output s214 of the compression coding means 214 is connected to the mixing means 215.
And the decoding means 216, the output s216 of the decoding means 216 is connected to the motion compensation interpolation means 217, and the output s217 of the motion compensation interpolation means 217 is connected to the fifth memory 2.
18 and a first output s2 of the fifth memory 218
18-1 is connected to the sixth memory 219.

Second output s218 of fifth memory 218
-2 is connected to the band synthesizing means 245, its third output s218-3 is connected to the second motion compensation prediction means 213 and the motion compensation interpolation means 217, and the sixth memory 21 is connected.
9 output s219 is connected to the second motion compensation prediction means 213 and motion compensation interpolation means 217, and the second output s249-2 of the scale conversion means 249 is the first motion vector prediction means 220 and the second motion vector prediction means 220. Motion vector prediction means 2
21, the output s220 of the third motion vector predicting means 220 is connected to the first motion vector interpolating means 222, and the output s of the fourth motion vector predicting means 221.
221 is connected to the second motion vector interpolation means 223, and the output s222 of the first motion vector interpolation means 222
And the output s223 of the second motion vector interpolation means 223.
Are respectively connected to the selection means 224, and the selection means 22
The output s224 of 4 is connected to the motion compensation prediction means 213 and the motion compensation interpolation means 217.

FIG. 22 is a block diagram of a tenth moving image decoding apparatus according to the present invention.

This moving picture decoding apparatus is composed of a dividing means (DM
PX) 251, a band synthesizing means (SYNC) 271,
An order reverse conversion means (RORD) 280, a first memory (FRM1) 272 and a second memory (FRM2) 273 which are first storage means for storing the continuous two frames of the order-converted images, and movement. Vector calculation means (ED
T) 274 and scale conversion means (SCLD) 275
A first decoding means (DCD1) 262 for decoding a low frequency band including direct current, a first motion compensation interpolation means (INP1) 263, and a first motion compensation interpolation means 263.
A second frame for storing two frames of images that have undergone order conversion from
A third memory (FRM3) 264 and a fourth memory (FRM4) 265, which are storage means of the above, a first motion vector prediction means (EPRE1) 266, a second motion vector prediction means (EPRE2) 267, Selecting means 270
And a first image data interpolating means (DINP1) 268
And second image data interpolating means (DINP2) 269
, Second decoding means (DCD2) 252 for decoding other high frequency bands, and second motion compensation interpolation means (I
NP2) 253, and a fifth memory (FRM5) 254 and a sixth memory (FRM5) 254 which are the third storage means for storing the images of the two frames subjected to the order conversion from the second motion compensation interpolation means 253.
Memory (FRM6) 255, third motion vector predicting means (EPRE3) 256, fourth motion vector predicting means (EPRE4) 257, first motion vector interpolating means (EINP1) 258, and second The motion vector interpolation means (EINP2) 259 and the selection means 260 are provided.

In this moving picture decoding apparatus, the compression-coded input picture s251 is supplied to the dividing means 251. The output s271 of the band synthesizing unit 271 is connected to the order inverse transforming unit 280 and the first memory 272,
The output signal s280 of the order inversion conversion means 280 is the output terminal 2
It is output from 81 as an image signal. Further, the output s2 in the low frequency band including the direct current divided by the dividing means 251.
51-2 is connected to the first decoding means 262, and the divided output s251-1 of the other high frequency band is connected to the second decoding means 252. Other means are
Connection is made in the same manner as the corresponding means of the tenth encoding device (FIG. 21) described above.

Next, the operation of the above moving picture coding / decoding apparatus will be described.

In the moving picture coding apparatus of FIG. 21, the order conversion means 211 predetermines the frame order of the input image signal s210, as in the fourth coding apparatus of the present invention (FIG. 9). The image frames are converted into the given order and the image frames are output as the image information s211. Here, the image information s211 is 3 as shown in FIG.
Every other frame, the order of one frame is exchanged and output.

The band dividing means 212 divides the inputted one-frame image signal s211 into m frequency bands, and the low frequency band image signal s212-2 including direct current is compression-encoded into the low frequency band signal. Is output to the second motion compensation prediction means 213. The image signal s212-1 in the other high frequency band is output to the first motion compensation prediction unit 233 for compressing and encoding the high frequency band signal. As a dividing method in the band dividing means 212, for example, a method by wavelet transform can be used.

The first motion compensation predicting means 233, the compression encoding means 234, the decoding means 236, and the motion compensation interpolation means 237 connected after the image signal s212-2 of the low frequency band including the direct current of the band dividing means 212. , The third memory 2
38, the fourth memory 239, the first motion vector predicting means 240, the second motion vector predicting means 241, the selecting means 244, the first image data interpolating means 242, and the second.
Since the image data interpolating means 243 of No. 2 operates in the same way as the corresponding means of the ninth encoding device (FIG. 19) of the present invention,
The description is omitted.

A second motion compensation predicting means 213, a compression coding means 214, a decoding means 216, a motion compensation interpolation means 217, and a second motion compensation predicting means 213 connected after the image signal s212-1 of the other high frequency band of the band dividing means 212. 5 memory 21
8, the sixth memory 219, the third motion vector predicting means 220, the fourth motion vector predicting means 221, the first motion vector interpolating means 222, the second motion vector interpolating means 223, and the selecting means 224, Each of them operates in the same way as the corresponding means of the eighth encoding device (FIG. 17) of the present invention, and therefore the description thereof is omitted.

In the band synthesizing means 245, the image signals s218-2, which are divided into m frequency bands to be inputted,
For s238-2, the bands are combined by a method reverse to that of the band dividing means 212 to restore the image signal s245 of one frame. As a method of synthesizing the image signals in the band synthesizing means 245, for example, a method by wavelet inverse transform corresponding to the wavelet transform in the band dividing means 212 can be used.

In the first memory 246, the band synthesizing means 2
Only the P-frame image from the image signal s245 synthesized by S.45 is stored, and the P-frame image already stored immediately before the new P-frame image is stored here.
The frame image signal s245 is output to the second memory 247.

In the second memory 247, the first memory 2
The P frame image before being input from 46 is stored.

The order inverse transforming means 250 performs the same operation as the order inverse transforming means in the fourth coding apparatus (FIG. 9) of the present invention, and the output signal s250 is a monitor of a compression-coded image. It can be used as a signal.

The motion vector calculation means 248 performs the same operation as the motion vector calculation means in the fourth encoding apparatus of the present invention, and outputs the calculated motion vector information s248 between P frames to the scale conversion means 249. .

In the scale conversion means 249, the band division means 21 is applied to the input motion vector information s248.
The motion vector information s2 about the image signal of the low frequency band including direct current is scale-converted into the motion vector corresponding to the image size of each band divided by 2.
49-2 as the first motion vector predictor 240 and the second
Output to the motion vector predicting means 241. Motion vector information s24 for image signals in other high frequency bands
9-1 is output to the third motion vector predicting means 220 and the fourth motion vector predicting means 221. As a motion vector scale conversion method, for example, when the vertical and horizontal sizes of an image in a low frequency band including direct current are reduced to one fourth of the vertical and horizontal sizes of the original image, the scale conversion means 249 , The input motion vector information s248 is 4
It is converted to one-half the size and new motion vector information is output.

The mixing means 215 mixes the input compression-coded image signals s234 and s214 in a predetermined order and outputs the mixed image signal s215 from an external terminal. Alternatively, it is also possible to output the compression-coded image signal of each band to each predetermined channel without using the mixing means.

In the moving picture decoding apparatus of FIG. 22, the dividing means 251 divides the input compression-coded and mixed image signal s251 by a method reverse to that of the mixing means 215 of the above-mentioned encoding device. To do. Then, the low frequency band image signal s251-2 including direct current is output to the decoding unit 262 that decodes the low frequency band signal, and the other high frequency band image signal s251-1 is output to the decoding unit 252 that decodes the high frequency band signal. Is output.

Decoding means 2 connected after the image signal s251-2 in the low frequency band including DC of the dividing means 251
62, first motion compensation interpolation means 263, third memory 2
64, a fourth memory 265, a first motion vector predicting means 266, a second motion vector predicting means 267, a selecting means 270, a first image data interpolating means 268, and a second.
Since the image data interpolating means 269 of No. 6 operates in the same way as the corresponding means of the ninth decoding apparatus (FIG. 20) of the present invention,
The description is omitted.

Decoding means 25 connected after the image signal s251-1 in the other high frequency band of the dividing means 251.
2, second motion compensation interpolation means 253, fifth memory 25
4, the sixth memory 255, the third motion vector predicting means 256, the fourth motion vector predicting means 257, the first motion vector interpolating means 258, the second motion vector interpolating means 259, and the selecting means 260 are Since it operates the same as the corresponding means of the eighth decoding device (FIG. 18) of the invention,
The description is omitted.

Further, the band synthesizing means 271, the first memory 272, the second memory 273, the motion vector calculating means 2
74, scale conversion means 275, and reverse order conversion means 2
80 operates in the same way as the corresponding means of the tenth encoding device (FIG. 21).

As described above, according to the tenth video encoding / decoding apparatus of the present invention, the band division processing and the eighth division of the present invention are performed on the images divided into the respective bands.
Also, the ninth embodiment can be applied. Therefore, further improvement in compression coding efficiency can be expected.

Further, the image signal in the low frequency band including direct current is interpolated by the image data interpolating means so that the reference image signal becomes smooth, and the image signal in the high frequency band is subjected to contouring or the like. Interpolation is performed according to the band-divided image characteristics, such as interpolation by a motion vector interpolating unit so that high-frequency components are not interrupted. Therefore, it can be expected that the quality of the image is further improved.

[0229]

The moving picture coding / decoding apparatus of the present invention comprises:
Since the motion vector is configured as described above and the motion vector can be calculated from the images of the past two frames, there is no need to transfer the motion vector, and improvement in coding efficiency can be expected.
In addition, since the motion vector detection accuracy can be increased by an appropriate motion vector calculation method and / or by predicting the motion vector of the current frame from the motion vector of the previous frame, improvement in image quality can be expected. Furthermore, by converting the order of the images and scale-converting the motion vector, the code amount can be reduced even when the motion vector is transferred, and improvement in coding efficiency can be expected.

[Brief description of drawings]

FIG. 1 is a block diagram of a first moving image coding apparatus according to the present invention.

FIG. 2 is a block diagram of a first moving picture decoding apparatus according to the present invention.

FIG. 3 is a block diagram of a conventional moving image encoding device.

FIG. 4 is a block diagram of a conventional moving picture decoding apparatus.

FIG. 5 is a block diagram of a second moving image coding apparatus according to the present invention.

FIG. 6 is a block diagram of a second moving image decoding apparatus according to the present invention.

FIG. 7 is a block diagram of a third moving image encoding apparatus.

FIG. 8 is a block diagram of a third moving image decoding apparatus.

FIG. 9 is a block diagram of a fourth moving image coding apparatus.

FIG. 10 is a block diagram of a fourth moving image decoding apparatus.

FIG. 11 is a block diagram of a fifth moving image encoding device.

FIG. 12 is a block diagram of a fifth moving image decoding apparatus.

FIG. 13 is a block diagram of a sixth moving image encoding apparatus.

FIG. 14 is a block diagram of a sixth moving image decoding apparatus.

FIG. 15 is a block diagram of a seventh moving image encoding device.

FIG. 16 is a block diagram of a seventh moving image decoding apparatus.

FIG. 17 is a block diagram of an eighth moving image encoding device.

FIG. 18 is a block diagram of an eighth moving image decoding apparatus.

FIG. 19 is a block diagram of a ninth moving image encoding device.

FIG. 20 is a block diagram of a ninth moving image decoding apparatus.

FIG. 21 is a block diagram of a tenth video encoding device.

FIG. 22 is a block diagram of a tenth moving image decoding apparatus.

FIG. 23 is an explanatory diagram of a motion vector prediction method by linear extrapolation prediction.

FIG. 24 is an explanatory diagram of an order conversion method for changing the order of frames.

FIG. 25 is an explanatory diagram of a motion vector prediction method by linear interpolation prediction.

[Explanation of symbols]

11 motion vector calculation means (EDT), 12 motion compensation prediction means (PRE), 13 motion compensation interpolation means (IN
P), 14 first memory (FRM), 15 second memory (FRM), 16 compression coding means (COD), 17
Decoding means (DCD).

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5C059 KK19 LB18 MA01 MA23 MC11                       ME01 NN01 NN28 PP06 PP07                       TA03 TA25 TB07 TC12 UA02                       UA05                 5J064 AA00 AA02 BA04 BA16 BB03                       BB04 BC01 BC02 BC25 BD01

Claims (21)

[Claims] 1. A method for detecting motion between frames of a moving image,
Predict image information based on motion-compensated reference image,
In a moving picture coding apparatus for coding, for each frame group consisting of a plurality of consecutive frames of an input image, a P frame located at the rearmost of the frame group is inserted before another B frame of the frame group. Thus, the order conversion means for changing the frame order of the input image, and the P-frame output from the order conversion means stores the motion-compensated and interpolated image of the P frame of the preceding frame group. When the B-frame is output from the means, the first storage means stores the motion-compensated and interpolated image of the P-frame of the frame group, and 1 more than the image stored in the first storage means. Second for storing motion compensated interpolated image of previous P frame
And a motion vector for calculating a motion vector between the P frame stored in the first storage unit and the P frame stored in the first storage unit when the frame output from the order conversion unit is a P frame. When the frame output from the calculation means and the order conversion means is a B frame, the scale of the motion vector is converted and the B frame and both P's stored in the first and second storage means are converted. Scale conversion means for generating a motion vector between frames, and when the frame output from the order conversion means is a P frame, the calculated motion vector is selected,
When the frame output from the order conversion unit is a B frame, the order conversion is performed using a selection unit selecting the scale-converted motion vector, and a reference image after motion compensation by the selected motion vector. Motion compensation prediction means for calculating the prediction error of the frame output from the means, compression coding means for generating a compression coded image signal from the prediction error, and image information from the compression coded image signal Decoding means for decoding, mixing means for variable-length coding and mixing the compression-coded image signal and the calculated motion vector, and using a reference image after motion compensation by the selected motion vector, Motion compensation interpolation means for interpolating the decoded image information and storing an interpolation image of a P frame in the first storage means. Moving picture coding apparatus for. 2. A moving image decoding apparatus for restoring image information from an input compression-coded image signal, wherein for each frame group consisting of a plurality of consecutive frames, the P frame located at the rearmost position of the frame group. , Before the other B-frames of the frame group, and the dividing means for decoding and dividing the motion vector from the image signal including the image information whose frame order has been changed and the motion vector between the P-frames, Decoding means for restoring image information from the compression-encoded image signal, and when the restored image information is of a P frame, stores a motion compensated interpolated image of a P frame of the previous frame group. , When the restored image information is of a B frame, the motion compensated interpolated image of the P frame of the frame group is recorded. A first storage unit that is remembered; and a second storage unit that stores a motion-compensated and interpolated image of a P frame preceding the image stored in the first storage unit.
Storage means for converting the scale of the motion vector when the restored image information is for a B frame and both P frames stored in the first and second storage means. Scale conversion means for generating a motion vector between frames, and when the restored image information is for a P frame, the decoded and divided motion vector is selected, and the restored image information is for a B frame. In the case of the P frame, the selecting means for selecting the scale-converted motion vector and the reference image after motion compensation by the selected motion vector are used to interpolate the restored image information, It is provided with a motion compensation interpolating means for storing the interpolated image in the first storage means, and an order inverse transforming means for returning the frame order of the interpolated image information. Video decoding device as a feature. 3. A moving picture coding / decoding apparatus including the coding apparatus according to the first aspect and the decoding apparatus according to the second term. 4. In place of the scale conversion means, when the frame output from the order conversion means is a B frame, the motion vector of the B frame is interpolated and predicted by using the calculated motion vector. A motion vector predicting unit; and a motion vector interpolating unit that interpolates a motion vector at a pixel position where the motion vector is not predicted using a motion vector at a peripheral pixel position where the motion vector is predicted by the motion vector predicting unit, The means selects the calculated motion vector when the frame output from the order conversion means is a P frame, and the interpolation is performed when the frame output from the order conversion means is a B frame. The method according to claim 1, wherein the predicted motion vector and the interpolated motion vector are selected. On-board video coding device. 5. In place of the scale conversion means, when the restored image information is of a B frame, the motion vector of the B frame is interpolated and predicted by using the decoded and divided motion vector. A motion vector predicting unit; and a motion vector interpolating unit that interpolates a motion vector at a pixel position where the motion vector is not predicted using a motion vector at a peripheral pixel position where the motion vector is predicted by the motion vector predicting unit, The means selects the decoding-divided motion vector when the restored image information is for a P frame, and the interpolation prediction when the restored image information is for a B frame The moving picture decoding apparatus according to claim 2, wherein the selected motion vector and the interpolated motion vector are selected. 6. A moving picture coding / decoding apparatus including the coding apparatus according to claim 4 and the decoding apparatus according to claim 5. 7. When the frame output from the order conversion unit is a B frame instead of the scale conversion unit, the motion vector of the B frame is interpolated and predicted using the calculated motion vector. Motion vector predicting means, wherein the selecting means selects the calculated motion vector when the frame output from the order conversion means is a P frame, and the frame output from the order conversion means is B In the case of a frame, the interpolation predicted motion vector is selected, and the motion vector predicting means performs motion using peripheral pixels for which the motion vector of the image stored in the first storage means is predicted. First image data interpolating means for interpolating a pixel whose vector is not predicted to generate a motion-compensated reference image; And a second image data interpolating means for generating a motion-compensated reference image by interpolating pixels whose motion vector is not predicted by using peripheral pixels whose motion vector of the image is predicted stored by the second storage means. The moving picture coding apparatus according to claim 1, further comprising: 8. In place of the scale conversion means, when the restored image information is of a B frame, the motion vector of the B frame is interpolated and predicted by using the decoded and divided motion vector. Motion vector predicting means, wherein when the restored image information is for a P frame, the selecting means selects the decoded and split motion vector, and the restored image information is for a B frame , The interpolation predicted motion vector is selected, and the motion vector is predicted using the peripheral pixels for which the motion vector of the image stored in the first storage unit is predicted by the motion vector prediction unit. A first image data interpolating means for interpolating a pixel whose prediction is not predicted to generate a motion-compensated reference image, and a second memory by the motion vector predicting means. Second image data interpolating means for interpolating a pixel whose motion vector is not predicted using peripheral pixels whose motion vector is predicted in the image stored in, and generating a motion compensation reference image. The moving picture decoding apparatus according to claim 2. 9. A moving picture coding / decoding apparatus including the coding apparatus according to the seventh aspect and the decoding apparatus according to the eighth aspect. 10. A moving picture coding apparatus for detecting a motion between frames of a moving picture and predicting and coding image information based on a motion-compensated reference picture, wherein a plurality of consecutive frames of an input picture are provided. For each frame group consisting of, the P frame located at the rearmost of the frame group is inserted before the other B frames of the frame group to change the frame order of the input image; When the P frame is output from the means, the motion-compensated image of the P frame of the preceding frame group is stored, and when the B frame is output from the order conversion means, the motion of the P frame of the frame group is stored. A first storage unit that stores the compensated and interpolated image; and a P-frame motion that is immediately before the image stored in the first storage unit. Second, storing the compensated and interpolated image
Storage unit, a motion vector calculation unit for calculating a motion vector between two frames stored in the storage unit, and the motion vector when the frame output from the order conversion unit is a B frame. Scale conversion means for converting the scale of B to generate a motion vector between the B frame and both P frames stored in the storage means, and when the frame output from the order conversion means is a P frame. , Select the calculated motion vector,
When the frame output from the order conversion unit is a B frame, the order conversion is performed using a selection unit selecting the scale-converted motion vector, and a reference image after motion compensation by the selected motion vector. Motion compensation prediction means for calculating the prediction error of the frame output from the means, compression coding means for generating a compression coded image signal from the prediction error, and image information from the compression coded image signal Decoding means for decoding and interpolation of the decoded image information using the reference image after motion compensation by the selected motion vector, and motion compensation interpolation for storing the interpolated image of P frame in the first storage means. And a moving picture coding apparatus. 11. A moving picture decoding apparatus for recovering image information from an input compression-coded image signal, and for each frame group consisting of a plurality of consecutive frames, a P frame located at the rearmost position of the frame group. Is inserted before the other B frames of the frame group, the decoding means restores the image information whose frame order is changed from the compression-coded image signal, and the restored image information is P frames. If the restored image information is for a B frame, the motion compensated interpolation for the P frame of the previous frame group is stored. If the restored image information is for a B frame, the motion compensated interpolation for the P frame of the frame group is stored. A first storage means for storing the captured image, and motion compensation for the P frame immediately preceding the image stored in the first storage means. Second storing the compensated image
Storage means, a motion vector calculation means for calculating a motion vector between the two frames stored in the storage means, and when the restored image information is for a B frame, Scale conversion means for converting a scale to generate a motion vector between the B frame and both P frames stored in the first and second storage means; and the restored image information having P frames The selected motion vector is selected, the selecting unit selects the scale-converted motion vector when the restored image information is for a B frame, and the selected motion. The motion-compensated image interpolation device interpolates the decoded image information using a reference image after motion compensation by a vector and stores an interpolated image of P frame in the first storage means. An interlacing means and an order inverse transforming means for returning the frame order of the interpolated image information, the moving picture decoding apparatus. 12. The encoding device according to claim 10 and the first device.
A moving picture coding / decoding apparatus including the decoding apparatus according to item 1. 13. A motion vector of the B frame is interpolated and predicted using the calculated motion vector when the frame output from the order conversion unit is a B frame instead of the scale conversion unit. A first motion vector predicting means, and a first motion for interpolating a motion vector at a pixel position where the motion vector is not predicted using the motion vector at the peripheral pixel position where the motion vector is predicted by the first motion vector predicting means. Vector interpolation means, and second motion vector prediction means for extrapolating and predicting the motion vector of the P frame using the calculated motion vector when the frame output from the order conversion means is a P frame , Using the motion vector at the peripheral pixel position where the motion vector is predicted by the second motion vector prediction means A second motion vector interpolating means for interpolating a motion vector at a pixel position for which a motion vector is not predicted; and the selecting means, when the frame output from the order conversion means is a B frame, the interpolation prediction The selected motion vector and the motion vector interpolated by the first motion vector interpolation means, and the frame output from the order conversion means is a P frame,
11. The moving picture coding apparatus according to claim 10, wherein the extrapolated motion vector and the motion vector interpolated by the second motion vector interpolating means are selected. 14. In place of the scale conversion means, when the restored image information is of a B frame, the motion vector of the B frame is interpolated and predicted using the calculated motion vector. One motion vector predicting means, and a first motion vector for interpolating a motion vector at a pixel position where the motion vector is not predicted using the motion vector at the peripheral pixel position where the motion vector is predicted by the first motion vector predicting means. Interpolating means, second motion vector predicting means for extrapolating and predicting a motion vector of the P frame using the calculated motion vector when the restored image information is of a P frame, The motion vector is predicted using the motion vectors at the peripheral pixel positions where the motion vector was predicted by the second motion vector prediction means. Second motion vector interpolating means for interpolating a motion vector of a pixel position that is not present, the selecting means, when the restored image information is for a B frame, the interpolation predicted motion vector. And and and when the motion vector interpolated by the first motion vector interpolating means is selected and the restored image information is of a P frame, the extrapolated predicted motion vector and the second motion The moving picture decoding apparatus according to claim 11, wherein the motion vector interpolated by the vector interpolating means is selected. 15. The encoding device according to claim 13 and the first device.
A moving picture coding / decoding apparatus including the decoding apparatus according to item 4. 16. In place of the scale conversion means, when the frame output from the order conversion means is a B frame, the motion vector of the B frame is interpolated and predicted using the calculated motion vector. When the frame output from the first motion vector prediction unit and the order conversion unit is a P frame, a second motion that extrapolates and predicts the motion vector of the P frame using the calculated motion vector. A vector predicting unit, and the selecting unit selects the interpolation predicted motion vector when the frame output from the order conversion unit is a B frame, and outputs the frame output from the order conversion unit. Is a P frame, the extrapolated motion vector is selected, and the first or second motion vector prediction means is further selected. Therefore, the first image data interpolating means for interpolating the pixels for which the motion vector is not predicted by using the peripheral pixels for which the motion vector of the image stored in the first storage means is interpolated, and generating the motion compensation reference image, , A pixel for which a motion vector is not predicted is interpolated using peripheral pixels for which the motion vector of the image stored in the second storage unit is predicted by the first motion vector prediction unit, and a motion compensation reference image is generated. The moving image encoding apparatus according to claim 10, further comprising a second image data interpolating unit that performs the operation. 17. In place of the scale conversion means, when the frame output from the order conversion means is a B frame, the motion vector of the B frame is interpolated and predicted using the calculated motion vector. When the frame output from the first motion vector prediction unit and the order conversion unit is a P frame, a second motion that extrapolates and predicts the motion vector of the P frame using the calculated motion vector. A vector predicting unit, and the selecting unit selects the interpolation predicted motion vector when the frame output from the order conversion unit is a B frame, and outputs the frame output from the order conversion unit. Is a P frame, the extrapolated motion vector is selected, and the first or second motion vector prediction means is further selected. Therefore, the first image data interpolating means for interpolating the pixels for which the motion vector is not predicted by using the peripheral pixels for which the motion vector of the image stored in the first storage means is interpolated, and generating the motion compensation reference image, , A pixel for which a motion vector is not predicted is interpolated using peripheral pixels for which the motion vector of the image stored in the second storage unit is predicted by the first motion vector prediction unit, and a motion compensation reference image is generated. The moving image decoding apparatus according to claim 11, further comprising a second image data interpolating unit that performs the above. 18. The encoding device according to claim 16 and the first device.
A moving picture coding / decoding apparatus including the decoding apparatus according to item 7. 19. A moving picture coding apparatus for detecting a motion between frames of a moving picture, predicting and coding picture information based on a motion-compensated reference picture, in a plurality of consecutive frames of an input picture. For each frame group consisting of, the P frame located at the rearmost of the frame group is inserted before the other B frames of the frame group to change the frame order of the input image; A band division means for dividing the image output from the means into an image signal in a low frequency band including direct current and an image signal in another high frequency band, and two images which are band-divided and individually motion-compensated and interpolated. A band synthesizing unit for synthesizing, a synthetic image storing unit for storing a band-synthesized image of two consecutive P frames, and a synthetic image storing unit for storing the synthesized image. A motion vector calculating means for calculating a motion vector between images of one P frame; and a scale of the calculated motion vector according to the image size of the image signal in the low frequency band, and an image size of the image signal in the high frequency band. The scale of the calculated motion vector is converted according to, and the scale conversion is performed according to the image size of the low-frequency image motion vector and the high-frequency band image signal scale-converted according to the image size of the low-frequency band image signal. Scale conversion means for outputting a high-frequency image motion vector, and a prediction error of the low-frequency band image signal output from the band division means is calculated using a low-frequency motion compensation reference image, as a low-frequency image prediction error signal Low-frequency motion compensation predicting means for outputting, and high-frequency band image signal output from the band dividing means A high-frequency motion-compensated prediction unit that calculates a prediction error using a high-frequency motion-compensated reference image based on an interpolated prediction or an extrapolated-predicted and interpolated motion vector, and outputs a high-frequency image prediction error signal, By the low band compression coding means for compressing and coding the low band image prediction error signal, the high band compression coding means for compressing and coding the high band image prediction error signal, and the low band compression coding means. A low-band decoding unit that decodes a compression-encoded signal, a high-band decoding unit that decodes a signal that has been compression-encoded by the high-band compression encoding unit, and a low-band decoding unit that decodes the low-band decoding unit. Motion compensation interpolating means for interpolating the signal using the low frequency motion compensation reference image, and high frequency for interpolating the signal decoded by the high frequency decoding means using the high frequency motion compensation reference image For motion compensation interpolation hand And two frames of P-frame interpolated images output from the low-frequency motion compensation interpolating means are stored.
Low-frequency storage means for outputting to the band synthesis means an image of a frame stored later in the image for frames, and interpolation of P frames for two frames output from the high-frequency motion compensation interpolation means. Images are stored and these 2
The high frequency storage means for outputting the image of the frame stored after the image for the frame to the band synthesizing means, and the image signal of the low frequency band output from the band dividing means are of the B frame. In some cases, a low-frequency interpolation motion vector predicting unit that interpolates and predicts a motion vector of this image signal using the scale-converted low-frequency image motion vector, and a low-frequency band output from the band dividing unit. When the image signal is of a P frame, a low-frequency extrapolation motion vector predicting unit that extrapolates and predicts a motion vector of the image signal by using the scale-converted low-frequency image motion vector, and the band dividing unit. When the image signal in the low frequency band output from the B-frame is of the B frame, the motion vector predicted for interpolation is selected, and the low frequency output from the band division is selected. When the image signal of the band is of P-frame,
Low-frequency selection means for selecting the extrapolated motion vector, and pixels for which a motion vector is not predicted by the low-frequency interpolation motion vector prediction means or the low-frequency extrapolation motion vector prediction means are stored in the low-frequency memory. Stored in means 2
The low-frequency motion-compensated prediction means and the low-frequency motion-compensated prediction means are generated by interpolating the motion vector of the image of the frame stored later in the frame image by using the predicted peripheral pixels, A first low-frequency image data interpolating means for outputting to the low-frequency motion compensation interpolating means, and a pixel whose motion vector is not predicted by the low-frequency interpolation motion vector predicting means are stored in the low-frequency storing means. The motion vector of the image of the previously stored frame of the two frames of images is interpolated using the predicted peripheral pixels to generate the low-frequency motion-compensated reference image to generate the low-frequency motion-compensated prediction. Means and the second low-frequency image data interpolating means to be output to the low-frequency motion compensation interpolating means, and the high-frequency band image signal output from the band dividing means is of the B frame. , A high-frequency interpolation motion vector prediction unit that interpolates and predicts a motion vector of this image signal using the scale-converted high-frequency image motion vector, and a motion vector is not predicted by the high-frequency interpolation motion vector prediction unit A high-frequency interpolation motion vector interpolating unit that interpolates a motion vector at a pixel position using a motion vector at a peripheral pixel position where the motion vector is predicted, and a high-frequency band image signal output from the band dividing unit is a B frame image. If it is a high-frequency extrapolation motion vector prediction means for extrapolating the motion vector of this image signal using the scale-converted high-frequency image motion vector, by the high-frequency extrapolation motion vector prediction means The motion vector of the pixel position where the motion vector is not predicted is set to the motion vector of the peripheral pixel position where the motion vector is predicted. A high-frequency extrapolation motion vector interpolating means for interpolating using a video signal, and a motion vector interpolated and interpolated when the high-frequency band image signal output from the band dividing means is of a B frame. When the image signal in the high frequency band output from the band dividing means is of the P frame, the motion vector interpolated and interpolated is selected, and the selected motion vector is used for the high frequency band. A high-frequency band selection unit that outputs the motion-compensated prediction unit and the high-frequency motion-compensated interpolation unit, and a signal in each band that is compression-coded by the low-band compression coding unit and the high-band compression coding unit. And a mixing means for mixing the moving picture coding device. 20. In a moving picture decoding apparatus for restoring image information from an input compression-coded image signal, for each frame group consisting of a plurality of consecutive frames, a P frame located at the back of the frame group. Is inserted before the other B-frames in the frame group, the frame order is changed, and the image signal input after being compression-encoded is the image signal of the low frequency band including DC and the image of the other high frequency band. Dividing means for dividing into two signals, a band synthesizing means for synthesizing the two images individually restored and motion-compensated and interpolated, and a synthetic image storing means for storing the band-synthesized images of two consecutive P frames, Motion vector calculation means for calculating a motion vector between two P frame images stored in the composite image storage means, and an image in the low frequency band. The scale of the calculated motion vector is converted according to the image size of the signal and the scale of the calculated motion vector is converted according to the image size of the image signal of the high frequency band, and the image size of the image signal of the low frequency band is converted. Scale conversion means for outputting a low-frequency image motion vector scale-converted according to the above and a high-frequency image motion vector scale-converted according to the image size of the image signal in the high-frequency band, and compression-encoded output from the dividing means. A low-band decoding unit that restores image information from the low-frequency band image signal, and a high-band decoding unit that restores image information from the compression-encoded high-frequency band image signal output from the dividing unit, Low-frequency motion compensation for interpolating image information restored by the low-frequency decoding means using a low-frequency motion compensation reference image 2 is output from the interpolation means, the high-frequency motion compensation interpolation means for interpolating the image information restored by the high-frequency decoding means using the high-frequency motion compensation reference image, and the low-frequency motion compensation interpolation means. Interpolated images of P frames for frames are stored.
Low-frequency storage means for outputting to the band synthesis means an image of a frame stored later in the image for frames, and interpolation of P frames for two frames output from the high-frequency motion compensation interpolation means. Images are stored and these 2
In the case where the image information restored by the low-frequency decoding means and the high-frequency storage means for outputting the image of the frame stored after the image for the frame to the band synthesizing means is of the B frame In addition, the low-frequency interpolation motion vector predicting means for interpolating and predicting the motion vector of the B frame using the scale-converted low-frequency image motion vector, and the image information restored by the low-frequency decoding means are P When it is a frame, the low-frequency extrapolation motion vector predicting means for extrapolating and predicting the motion vector of the P frame using the scale-converted low-frequency image motion vector, and the reconstruction by the low-frequency decoding means The image information restored by the low frequency decoding means by selecting the motion vector predicted for interpolation when the obtained image information is for a P frame In the case of a P frame, the low-frequency selecting unit that selects the extrapolated-predicted motion vector, and the low-frequency extrapolating motion vector predicting unit or the low-frequency extrapolating motion vector predicting unit determines a motion vector. Unpredicted pixels are stored in the low band storage means 2
The low-frequency motion-compensated prediction means and the low-frequency motion-compensated prediction means are generated by interpolating the motion vector of the image of the frame stored later in the frame image by using the predicted peripheral pixels, A first low-frequency image data interpolating means for outputting to the low-frequency motion compensation interpolating means, and a pixel whose motion vector is not predicted by the low-frequency interpolation motion vector predicting means are stored in the low-frequency storing means. The motion vector of the image of the previously stored frame of the two frames of images is interpolated using the predicted peripheral pixels to generate the low-frequency motion-compensated reference image to generate the low-frequency motion-compensated prediction. Means and a second low-frequency image data interpolating means for outputting to the low-frequency motion compensation interpolating means, and the image information restored by the high-frequency decoding means is of a B frame, A high-frequency interpolation motion vector predicting unit that interpolates and predicts the motion vector of the B frame using the scale-converted high-frequency image motion vector, and a pixel position where the motion vector is not predicted by the high-frequency interpolation motion vector predicting unit. Motion vector interpolating means for interpolating the above motion vector using the motion vector of the peripheral pixel position where the motion vector is predicted, and the image information restored by the above high frequency decoding means is of P frame. In this case, a motion vector predicting unit for high band extrapolation for extrapolating and predicting the motion vector of the P frame using the scale-converted high band image motion vector, and a motion vector by the motion vector predicting unit for high band extrapolation Use the motion vector of the unpredicted pixel position by using the motion vector of the peripheral pixel position where the motion vector was predicted A high-frequency extrapolation motion vector interpolating means for interpolating, and when the image information restored by the high-frequency decoding means is for a B frame, the interpolation predicted and interpolated motion vector is selected, When the image information restored by the high frequency decoding means is for a P frame, the motion vector interpolated and interpolated is selected, and the selected motion vector is used for the high frequency compensation prediction means and A moving image decoding apparatus comprising: a high band selecting unit for outputting to the high band motion compensating and interpolating unit; and an order inverse transforming unit for restoring the order of the band-combined signals. 21. The encoding device according to claim 19, and the second device.
A moving picture coding / decoding apparatus including a 0-order decoding apparatus.