JPH05244585A - Prediction coder and decoder - Google Patents

Prediction coder and decoder

Info

Publication number
JPH05244585A
JPH05244585A JP7846792A JP7846792A JPH05244585A JP H05244585 A JPH05244585 A JP H05244585A JP 7846792 A JP7846792 A JP 7846792A JP 7846792 A JP7846792 A JP 7846792A JP H05244585 A JPH05244585 A JP H05244585A
Authority
JP
Japan
Prior art keywords
lpf
prediction
signal
resampler
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP7846792A
Other languages
Japanese (ja)
Other versions
JP2606523B2 (en
Inventor
Kenji Sugiyama
賢二 杉山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Victor Company of Japan Ltd
Original Assignee
Victor Company of Japan Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Victor Company of Japan Ltd filed Critical Victor Company of Japan Ltd
Priority to JP7846792A priority Critical patent/JP2606523B2/en
Publication of JPH05244585A publication Critical patent/JPH05244585A/en
Application granted granted Critical
Publication of JP2606523B2 publication Critical patent/JP2606523B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Image Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

PURPOSE:To converge picture quality deterioration on the occurrence of an error and to reduce a residual error by passing a picture signal through an LPF in place of a resampling filter when number of motion vectors is an integral number. CONSTITUTION:A reproduced picture signal delayed by one frame outputted from a frame memory 10 is moved in the unit of picture elements based on a value of an integral part of an MV (motion vector) by a picture element moving device 9. A picture signal subject to motion compensation in the unit of picture elements is inputted to a resampler 3 and an LPF (low pass filter) 8 and the picture signal is moved with accuracy of a picture element through the resampling processing by the resampler 3. Moreover, no movement is implemented in the LPF 8 but a high frequency component is suppressed. Then each output is led to a switch 7 and the switch 7 selects an output of the LPF 8 when the MV is an integral number and selects an output of the resampler 3 when not and the selected signal is given to a prediction subtractor 2.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は、ディジタル画像信号の
記録・伝送・表示を行うために、動画像の高能率符号復
号化をする装置に係り、特に動きベクトルにより1画素
以下の精度で動き補償してフレーム間またはフィールド
間予測する符号復号化装置に関するものである。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for performing high-efficiency coding / decoding of a moving image in order to record / transmit / display a digital image signal, and more particularly to a moving vector with a precision of 1 pixel or less. The present invention relates to a code decoding apparatus that compensates and predicts between frames or between fields.

【0002】[0002]

【従来の技術】動画像の高能率符号化において、画像信
号のフレーム間の相関を利用し、符号化されるフレーム
を符号化の済んだフレームで予測して、予測誤差のみを
符号化するフレーム間予測符号化がある。その場合、画
像を動きに合わせて移動させて予測する動き補償フレー
ム間予測が一般的になっている。
2. Description of the Related Art In high-efficiency coding of a moving image, a frame in which a frame to be coded is predicted by utilizing a correlation between frames of an image signal and only a prediction error is coded There is inter prediction coding. In that case, motion-compensated inter-frame prediction in which an image is moved and predicted in accordance with motion is generally used.

【0003】<リーク予測>フレーム間符号化では、伝
送路での符号誤りやATM回線でのセルロスが生じる
と、それによっておこる画質劣化が次のフレームに波及
し、長い時間画像劣化が発生する。この画質劣化を早く
収束させるためには、予測係数を完全に1とせず、例え
ば0.9として、前のフレームの画像が完全には残らな
いようにする。この手法はリーク予測と呼ばれ、その符
号化装置の構成例は図5のようになる。図5は基本的な
動き補償フレーム間予測符号化装置に乗算器31が追加
され、予測信号に予測係数kが掛けられるものである。
<Leakage Prediction> In the inter-frame coding, when a code error in the transmission path or a cell loss in the ATM line occurs, the image quality deterioration caused by the error spreads to the next frame and the image deterioration occurs for a long time. In order to quickly converge this image quality deterioration, the prediction coefficient is not set to 1 completely, but is set to 0.9 so that the image of the previous frame does not completely remain. This technique is called leak prediction, and an example of the configuration of the encoding device is as shown in FIG. In FIG. 5, a multiplier 31 is added to the basic motion-compensated interframe predictive coding apparatus, and the prediction signal is multiplied by the prediction coefficient k.

【0004】図5で画像入力1より入力された入力画像
信号は、予測減算器2の被減算入力に入力される。予測
減算器2は減算入力に乗算器31より予測信号が入力さ
れ、それが入力画像信号から減算され、残差信号が出力
される。残差信号はフレーム内符号化器4に入力され、
DCTなどの手段で空間的な冗長成分が除かれた圧縮デ
ータとなる。圧縮データはデータ出力5から出力される
共に、フレーム内復号器12に導かれる。フレーム内復
号器12では圧縮データが復号され、再生された残差信
号は加算器11で予測信号が加算されて再生画像信号に
なる。再生画像信号はフレームメモリ10に蓄えられ、
1フレーム遅延させられ動き補償器33に入力される。
動き補償器33は動きベクトル(MV)検出器6より
与えられるMV情報により、再生画像信号をMVの分だ
け移動させ、動き補償信号として乗算器31に与える。
乗算器31では動き補償信号をk倍して予測信号を得
て、予測減算器2および加算器11に与える。
The input image signal input from the image input 1 in FIG. 5 is input to the subtracted input of the predictive subtractor 2. The prediction subtractor 2 receives the prediction signal from the multiplier 31 at the subtraction input, subtracts the prediction signal from the input image signal, and outputs the residual signal. The residual signal is input to the intraframe encoder 4,
The compressed data is obtained by removing spatially redundant components by means such as DCT. The compressed data is output from the data output 5 and also guided to the intraframe decoder 12. The intra-frame decoder 12 decodes the compressed data, and the reproduced residual signal is added with the prediction signal by the adder 11 to become a reproduced image signal. The reproduced image signal is stored in the frame memory 10,
It is delayed by one frame and input to the motion compensator 33.
The motion compensator 33 moves the reproduced image signal by MV according to the MV information supplied from the motion vector (MV) detector 6, and supplies it to the multiplier 31 as a motion compensation signal.
The multiplier 31 multiplies the motion compensation signal by k to obtain a prediction signal, and supplies the prediction signal to the prediction subtractor 2 and the adder 11.

【0005】ここで、フレーム間予測の予測係数はkに
なり、kは0.9程度の値とする。この場合、あるフレ
ームで発生した画質劣化の影響は、1秒後には(0.
9)30すなわち約0.04程度になる。kの値は小さい
方が収束は早くなるが、予測効率は1に近いほうが高い
ので、あまり小さくはしない。MV検出器6は入力画像
信号と予測に使われるフレームの画像信号との間の動き
ベクトル(MV)をブロック単位で求め、そのMV情報
を動き補償器33に与えると共に、MV出力13より復
号化装置に向けて出力する。
Here, the prediction coefficient for inter-frame prediction is k, and k is a value of about 0.9. In this case, the influence of the image quality deterioration occurring in a certain frame is (0.
9) 30 or about 0.04. The smaller the value of k, the faster the convergence, but the prediction efficiency is higher as it is closer to 1, so it is not too small. The MV detector 6 obtains a motion vector (MV) between the input image signal and the image signal of the frame used for prediction in block units, supplies the MV information to the motion compensator 33, and decodes it from the MV output 13. Output to the device.

【0006】図5に対応する復号化装置の構成例を図6
に示す。復号化装置の動作は符号化装置の局部復号部分
と基本的に同じである。データ入力20から入力される
圧縮データはフレーム内復号器12で復号され、再生さ
れた残差信号は加算器11で予測信号が加算され、再生
画像信号となる。再生画像信号は画像出力21から出力
されると共にフレームメモリ10に与えられ、1フレー
ム遅延させられた後、動き補償器33に入力される。動
き補償器33では、MV入力22を通って符号化装置よ
り与えられるMV情報により、再生画像信号をMVの分
だけ移動させ、動き補償信号として乗算器31に与え
る。乗算器31では動き補償信号をk倍して予測信号を
得て加算器11に与える。
An example of the configuration of the decoding device corresponding to FIG. 5 is shown in FIG.
Shown in. The operation of the decoding device is basically the same as the local decoding part of the encoding device. The compressed data input from the data input 20 is decoded by the intra-frame decoder 12, and the reproduced residual signal is added with the prediction signal by the adder 11 to become a reproduced image signal. The reproduced image signal is output from the image output 21 and also applied to the frame memory 10, delayed by one frame, and then input to the motion compensator 33. In the motion compensator 33, the reproduced image signal is moved by the amount of MV according to the MV information given from the encoding device through the MV input 22, and given to the multiplier 31 as a motion compensation signal. The multiplier 31 multiplies the motion compensation signal by k to obtain a prediction signal, which is given to the adder 11.

【0007】<ループフィルタ>符号誤りによる影響を
考慮する必要がない場合でも、量子化誤差の残留を防ぐ
ため、ループフィルタと呼ばれるローパスフィルタ(L
PF)を、予測信号に適用することがある。この場合の
符号化装置の構成例を図7に示す。図7は乗算器31が
LPF32に変えられている以外は図5と同じで、基本
的な動作は同じである。LPF32により、図5でのk
が予測信号の空間周波数によって変わることになる。ま
たLPF32はブロック単位の処理で、ブロックの端で
はフィルタのタップが、ブロックの外に出ないようにす
る。復号化装置の構成例を図8に示す。図8も乗算器3
1がLPF32に変えられている以外は図6と同じで、
基本的な動作は同じである。
<Loop Filter> A low-pass filter (L filter) called a loop filter is used in order to prevent the quantization error from remaining even when it is not necessary to consider the influence of a code error.
PF) may be applied to the prediction signal. FIG. 7 shows a configuration example of the encoding device in this case. 7 is the same as FIG. 5 except that the multiplier 31 is replaced by an LPF 32, and the basic operation is the same. By the LPF 32, k in FIG.
Depends on the spatial frequency of the predicted signal. Further, the LPF 32 is a process in units of blocks, and the taps of the filter are prevented from going out of the blocks at the ends of the blocks. A configuration example of the decoding device is shown in FIG. FIG. 8 also shows the multiplier 3
Same as FIG. 6 except that 1 is changed to LPF 32,
The basic operation is the same.

【0008】このようなループフィルタを用いた処理に
より、高い周波数の量子化誤差が残留し難くなるため、
平坦な背景の前にあるものが動いた場合などで、視覚的
に有効となる。また、動き補償予測は高い周波数であま
り良い予測とならず、誤差が多いため基本的な効率も下
がらない。予測信号の高い周波数成分については、予測
係数kが1より小さくなっており、リーク予測と同様に
符号誤りに対しても効果がある。また符号化装置の局部
復号部と復号化装置の処理が微妙に異なるために発生す
る誤差の累積も防ぐことができる。
The processing using such a loop filter makes it difficult for a high-frequency quantization error to remain.
This is visually effective when something in front of a flat background moves. In addition, the motion-compensated prediction is not very good prediction at high frequencies, and since there are many errors, the basic efficiency does not decrease. For the high frequency component of the prediction signal, the prediction coefficient k is smaller than 1, and it is effective for code error as in the leak prediction. It is also possible to prevent the accumulation of errors that occur due to subtle differences between the processes of the local decoding unit of the encoding device and the decoding device.

【0009】<画素以下MV(動きベクトル)>動き補
償の精度を画素以下にする場合、画素を空間的に移動さ
せるだけではなく、リサンプリングフィルタ(リサンプ
ラ)により予測信号を作りだす必要がある。このような
処理で作られる予測信号の周波数特性は、MVの値が整
数かどうかで異なる。MVが整数の場合は画素精度の処
理と同じで、リサンプラは素通りとなり、したがって周
波数特性も変化しない。一方、MVが整数でない場合
は、リサンプラによって信号の位相(位置)が動かされ
ることになる。リサンプラは有限長タップのFIR型フ
ィルタなので、処理によって高い周波数成分が抑圧され
る。これにより、ループフィルタに類似する効果があ
る。
<Sub-pixel MV (Motion Vector)> When the accuracy of motion compensation is set to be less than the pixel, it is necessary not only to spatially move the pixel but also to generate a prediction signal by a resampling filter (resampler). The frequency characteristics of the prediction signal created by such processing differ depending on whether the value of MV is an integer. When the MV is an integer, the process is the same as the pixel precision process, and the resampler does not pass, and therefore the frequency characteristic does not change. On the other hand, when MV is not an integer, the resampler moves the phase (position) of the signal. Since the resampler is a FIR filter with a finite length tap, high frequency components are suppressed by the processing. This has an effect similar to a loop filter.

【0010】[0010]

【発明が解決しようとする課題】リーク予測やループフ
ィルタと、画素以下の精度の動き補償とを組み合わせて
用いた場合、動き補償で動きベクトルが整数でないとき
はリサンプリングフィルタでのフィルタリングが作用す
るので、予測信号の高い周波数成分の予測係数が必要以
上に下がり、符号化効率の低下を生じる。一方、リーク
予測やループフィルタを用いない場合は、画素以下の精
度で動き補償をしても、動き補償で動きベクトルが整数
のとき、例えば静止状態のときは、リサンプリングフィ
ルタでフィルタリングが作用しないので、予測係数は1
のままであり、符号誤りによる画質劣化や量子化誤差は
残留したままになる。
When a leak prediction or loop filter is used in combination with motion compensation with sub-pixel accuracy, when the motion vector is not an integer in motion compensation, the filtering by the resampling filter works. Therefore, the prediction coefficient of the high frequency component of the prediction signal is reduced more than necessary, and the coding efficiency is reduced. On the other hand, when the leak prediction or the loop filter is not used, even if the motion compensation is performed with an accuracy of a pixel or less, when the motion vector is an integer in the motion compensation, for example, when the motion vector is still, the resampling filter does not work. Therefore, the prediction coefficient is 1
The image quality deterioration due to the code error and the quantization error remain.

【0011】本発明は以上の点に着目してなされたもの
で、動きベクトルが整数の場合には、予測信号をリサン
プリングフィルタの代わりに、LPFを通過させること
で高い周波数成分を常にほぼ一定量抑圧する予測符号化
装置及び、復号装置を提供することを目的とするもので
ある。
The present invention has been made by paying attention to the above points. When the motion vector is an integer, the prediction signal is passed through the LPF instead of the resampling filter so that the high frequency component is almost constant. An object of the present invention is to provide a predictive coding device and a decoding device that suppress the amount.

【0012】[0012]

【課題を解決するための手段】本発明は上記課題を解決
するために、動きベクトルにより1画素以下の精度で動
き補償してフレーム間またはフィールド間予測する予測
符号化装置において、動きベクトルが整数の場合にのみ
予測信号に作用するLPFを有することを特徴とする予
測符号化装置を提供すると共に、動きベクトルにより1
画素以下の精度で動き補償してフレーム間またはフィー
ルド間予測する予測復号化装予測置において、動きベク
トルが整数の場合にのみ予測信号に作用するLPFを有
することを特徴とする予測復号化装置を提供するもので
ある。
In order to solve the above-mentioned problems, the present invention provides a predictive coding apparatus for predicting an inter-frame or an inter-field by motion-compensating with an accuracy of one pixel or less by a motion vector. A predictive coding apparatus having an LPF that operates on a prediction signal only in the case of
A predictive decoding apparatus for predicting an inter-frame or inter-field that performs motion compensation with accuracy of less than a pixel and has an LPF that acts on a prediction signal only when a motion vector is an integer. To do.

【0013】[0013]

【作用】上記のような予測符号復号化装置によれば、予
測信号は、動きベクトルが整数以外の場合にはリサンプ
リングフィルタを通過し、動きベクトルが整数の場合に
はリサンプリングフィルタの代わりに、LPFを通過す
るので、動きベクトルの値に関係なく常にほぼ一定のフ
ィルタリングが作用し、高い周波数成分が抑圧される。
この結果、不必要な効率の損失無く、高い周波数での予
測係数を安定に下げることができ、高い精度の動き補償
とエラー時の画質劣化の収束や残留誤差の軽減が可能に
なる。
According to the predictive coding / decoding apparatus as described above, the prediction signal passes through the resampling filter when the motion vector is not an integer, and instead of the resampling filter when the motion vector is an integer. , LPF, so that almost constant filtering always works regardless of the value of the motion vector, and high frequency components are suppressed.
As a result, it is possible to stably reduce the prediction coefficient at high frequencies without unnecessary loss of efficiency, and it is possible to perform highly accurate motion compensation, converge image quality deterioration at the time of error, and reduce residual error.

【0014】[0014]

【実施例】<実施例1>図1は本発明の予測符号化装置
の実施例を示すブロック図である。従来の装置とは予測
信号の作り方が異なり、基本動作のほか、フレーム内処
理や動きベクトルの検出方法は同じである。動き補償は
画素以下の精度で、画素単位の移動処理と画素以下の精
度の処理部に分けられ、後者はさらに動きベクトルが整
数かそうでないかで、処理が異なる。以下、従来例と動
作が異なる部分のみ説明する。
Embodiment 1 FIG. 1 is a block diagram showing an embodiment of a predictive coding apparatus according to the present invention. The method of generating the prediction signal is different from that of the conventional apparatus, and in addition to the basic operation, the intraframe processing and the motion vector detection method are the same. Motion compensation is divided into a pixel-based movement process and a pixel-below-precision process unit with a precision of less than a pixel. The latter process differs depending on whether the motion vector is an integer or not. Hereinafter, only a part different in operation from the conventional example will be described.

【0015】フレームメモリ10から出力される1フレ
ーム遅延させられた再生画像信号は、画素移動器9でM
Vの整数部の値によって画素単位で移動させられる。画
素単位での動き補償が行われた画像信号は、リサンプラ
3とLPF(ローパスフィルタ)8に入力される。リサ
ンプラ3ではリサンプリング処理により、画像信号は画
素以下の精度で移動させられる。LPF8では移動は行
われなく、高い周波数成分が抑圧される。それぞれの出
力はスイッチ7に導かれ、スイッチ7ではMVが整数の
場合はLPF8の出力が選択され、そうでない場合はリ
サンプラ3の出力が選択され、予測信号として予測減算
器2に与えられる。
The reproduced image signal delayed by one frame output from the frame memory 10 is M
It is moved pixel by pixel depending on the value of the integer part of V. The image signal that has been subjected to motion compensation in pixel units is input to the resampler 3 and the LPF (low pass filter) 8. In the resampler 3, the image signal is moved with an accuracy of a pixel or less by the resampling process. The LPF 8 does not move and suppresses high frequency components. The respective outputs are guided to the switch 7, and when the MV is an integer, the output of the LPF 8 is selected in the switch 7, and the output of the resampler 3 is selected in the case where the MV is not an integer, and the output is given to the prediction subtractor 2 as a prediction signal.

【0016】LPF8とリサンプラ3は共にFIRフィ
ルタであり、MVの精度を0.5画素とした場合、LP
F8は表1のような係数の3タップ、リサンプラ3は以
下のような係数の4タップとなる。
Both the LPF 8 and the resampler 3 are FIR filters, and if the MV accuracy is 0.5 pixel, the LP
F8 has 3 taps with the coefficients shown in Table 1, and resampler 3 has 4 taps with the following coefficients.

【0017】[0017]

【表1】 [Table 1]

【0018】このときのLPF8とリサンプラ3の周波
数特性を図10に示す。LPFとリサンプラで特性は異
なるが、高い周波数成分が同程度抑圧される。
FIG. 10 shows the frequency characteristics of the LPF 8 and the resampler 3 at this time. Although the LPF and the resampler have different characteristics, high frequency components are suppressed to the same degree.

【0019】図1に対応する復号化装置2の構成例を図
2に示す。従来例とは予測信号の作り方だけが異なり、
リサンプラ3,LPF8,スイッチ7による予測信号の
作り方は符号化装置1と同じである。
FIG. 2 shows a configuration example of the decoding device 2 corresponding to FIG. Only the method of making the prediction signal is different from the conventional example,
The method of producing the prediction signal by the resampler 3, the LPF 8 and the switch 7 is the same as that of the encoder 1.

【0020】<実施例2>図1においてリサンプラ3と
LPF8は、共に同様なFIRフィルタなので一体化す
ることができ、フィルタのタップ係数をMVの画素以下
の端数によって変えるのみで実現できる。この場合の符
号化装置の構成を図3に示すが、スイッチ7とLPF8
とリサンプラ3が、汎用フィルタ24と係数表23に代
わっている以外は図1と同じである。
<Embodiment 2> In FIG. 1, the resampler 3 and the LPF 8 can be integrated because they are both similar FIR filters, and can be realized only by changing the tap coefficient of the filter by a fraction less than the pixel of MV. The structure of the encoding device in this case is shown in FIG.
The resampler 3 is the same as FIG. 1 except that the general-purpose filter 24 and the coefficient table 23 are replaced.

【0021】画素移動器9で画素単位での動き補償が行
われた画像信号は、汎用フィルタ24に入力される。一
方、係数表23ではMV検出器6より与えられるMVの
画素以下の端数により、ブロック毎に異なった係数を汎
用フィルタ24に対して出力する。汎用フィルタ24は
各タップの係数が切り替えられるFIRフィルタで、図
9に示されるようなものである。図9において、遅延器
40〜42は垂直または水平の1画素の遅延を与えるも
のである。汎用フィルタ24では、係数表23より入力
されるタップ係数(s0〜s3)が乗算器43〜46で
各画素値に乗算され、その結果が加算器47で加算され
予測信号が形成される。
The image signal subjected to the motion compensation in pixel units by the pixel mover 9 is input to the general-purpose filter 24. On the other hand, in the coefficient table 23, different coefficients for each block are output to the general-purpose filter 24 depending on the fraction of MV pixels or less given by the MV detector 6. The general-purpose filter 24 is an FIR filter in which the coefficient of each tap can be switched, and is as shown in FIG. In FIG. 9, delay devices 40 to 42 add a delay of one pixel vertically or horizontally. In the general-purpose filter 24, the tap coefficients (s0 to s3) input from the coefficient table 23 are multiplied by the pixel values in the multipliers 43 to 46, and the results are added in the adder 47 to form a prediction signal.

【0022】係数の値はMVが整数の場合は汎用フィル
タがLPFとなり、そうでない場合はリサンプラとなる
ようなもので表2のようになる。
The value of the coefficient is such that the general-purpose filter becomes the LPF when MV is an integer, and becomes the resampler otherwise, as shown in Table 2.

【0023】[0023]

【表2】 [Table 2]

【0024】一方、MVは2次元なので、垂直水平とも
整数のときのみLPF処理にすると係数は表2のように
なる。垂直方向処理用フィルタのタップ係数がv0〜v
3、水平方向処理用フィルタのタップ係数がh0〜h3
で、表3の値に1/16が乗じられる。
On the other hand, since the MV is two-dimensional, the coefficients are as shown in Table 2 when the LPF processing is performed only when both vertical and horizontal are integers. The tap coefficients of the vertical processing filter are v0 to v
3, the tap coefficient of the horizontal processing filter is h0 to h3
Then, the values in Table 3 are multiplied by 1/16.

【0025】[0025]

【表3】 [Table 3]

【0026】図3に対応する復号化装置4の構成例を図
4に示す。従来例とは予測信号の作り方が異なり、汎用
フィルタ24と係数表23による予測信号の作り方は符
号化装置3と同じである。
FIG. 4 shows a configuration example of the decoding device 4 corresponding to FIG. The method of generating the prediction signal is different from that of the conventional example, and the method of generating the prediction signal using the general-purpose filter 24 and the coefficient table 23 is the same as that of the encoding device 3.

【0027】[0027]

【発明の効果】本発明の予測符号化装置および復号化装
置は、予測信号が、動きベクトルが整数以外の場合には
リサンプリングフィルタでフィルタリングされ、動きベ
クトルが整数の場合にはリサンプリングフィルタの代わ
りに、LPFを通過させることで、動きベクトルの値に
関係なく常にほぼ一定のフィルタリングが作用し、高い
周波数成分が抑圧されるので、不必要な効率の損失無
く、高い周波数での予測係数を安定に下げることがで
き、エラー時の画質劣化の収束や残留誤差の軽減が可能
になる。これによりエラーが起こりやすいシステムにも
フレーム間予測符号化が適用可能となり、再生画質も向
上する。DCTの演算精度などを下げても演算誤差が蓄
積しないので、装置化もしやすくなる。以上説明の如
く、本発明の予測符号化装置及び復号化装置は、実用上
極めて優れた効果を有するものである。
According to the predictive coding apparatus and the decoding apparatus of the present invention, the prediction signal is filtered by the resampling filter when the motion vector is not an integer, and by the resampling filter when the motion vector is an integer. Instead, by passing the LPF, almost constant filtering acts regardless of the value of the motion vector, and the high frequency component is suppressed, so that the prediction coefficient at the high frequency can be obtained without unnecessary loss of efficiency. It can be lowered stably, and it is possible to converge image quality deterioration at the time of error and reduce residual error. As a result, the interframe predictive coding can be applied to a system in which an error easily occurs, and the reproduction image quality is improved. Since the calculation error does not accumulate even if the calculation accuracy of the DCT is lowered, the device can be easily implemented. As described above, the predictive encoding device and the decoding device of the present invention have extremely excellent practical effects.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明の予測符号化装置の第1の実施例の構成
を示すブロック図である。
FIG. 1 is a block diagram showing a configuration of a first embodiment of a predictive coding apparatus according to the present invention.

【図2】本発明の予測復号化装置の第1の実施例の構成
を示すブロック図である。
FIG. 2 is a block diagram showing the configuration of a first embodiment of the predictive decoding device according to the present invention.

【図3】本発明の予測符号化装置の第2の実施例の構成
を示すブロック図である。
FIG. 3 is a block diagram showing the configuration of a second embodiment of the predictive coding device according to the present invention.

【図4】本発明の予測復号化装置の第2の実施例の構成
を示すブロック図である。
FIG. 4 is a block diagram showing the configuration of a second embodiment of the predictive decoding device according to the present invention.

【図5】予測符号化装置の第1の従来例の構成を示すブ
ロック図である。
FIG. 5 is a block diagram showing a configuration of a first conventional example of a predictive coding device.

【図6】予測復号化装置の第1の従来例の構成を示すブ
ロック図である。
FIG. 6 is a block diagram showing a configuration of a first conventional example of a predictive decoding device.

【図7】予測符号化装置の第2の従来例の構成を示すブ
ロック図である。
FIG. 7 is a block diagram showing a configuration of a second conventional example of a predictive coding device.

【図8】予測復号化装置の第2の従来例の構成を示すブ
ロック図である。
FIG. 8 is a block diagram showing a configuration of a second conventional example of the predictive decoding device.

【図9】本発明の実施例の汎用フィルタの構成を示すブ
ロック図である。
FIG. 9 is a block diagram showing a configuration of a general-purpose filter according to an embodiment of the present invention.

【図10】本発明の実施例のリサンプラとLPFの周波
数特性を示す図である。
FIG. 10 is a diagram showing frequency characteristics of the resampler and the LPF according to the embodiment of the present invention.

【符号の説明】[Explanation of symbols]

1…画像入力、2…予測減算器、3…リサンプラ、4…
フレーム内符号化器、5…データ出力、6…MV検出
器、7…スイッチ、8,32…LPF、9…画素移動
器、10…フレームメモリ、11,47…加算器、12
…フレーム内復号器、13…MV出力、20…データ入
力、21…画像出力、22…MV入力、23…係数表、
24…汎用フィルタ、31,43,44,45,46…
乗算器、33…動き補償器、40,41,42…遅延
器。
1 ... Image input, 2 ... Predictive subtractor, 3 ... Resampler, 4 ...
Intra-frame encoder, 5 ... Data output, 6 ... MV detector, 7 ... Switch, 8, 32 ... LPF, 9 ... Pixel mover, 10 ... Frame memory, 11, 47 ... Adder, 12
... in-frame decoder, 13 ... MV output, 20 ... data input, 21 ... image output, 22 ... MV input, 23 ... coefficient table,
24 ... General-purpose filter, 31, 43, 44, 45, 46 ...
Multiplier, 33 ... Motion compensator, 40, 41, 42 ... Delay device.

Claims (2)

【特許請求の範囲】[Claims] 【請求項1】動きベクトルにより1画素以下の精度で動
き補償してフレーム間またはフィールド間予測する予測
符号化装置において、 動きベクトルが整数の場合にのみ予測信号に作用するL
PF(ローパスフィルタ)を有することを特徴とする予
測符号化装置。
1. A predictive coding apparatus for predicting an inter-frame or an inter-field by compensating a motion with an accuracy of one pixel or less by a motion vector, and L acting on a prediction signal only when the motion vector is an integer.
A predictive coding device having a PF (low-pass filter).
【請求項2】動きベクトルにより1画素以下の精度で動
き補償してフレーム間またはフィールド間予測する予測
復号化装予測置において、 動きベクトルが整数の場合にのみ予測信号に作用するL
PF(ローパスフィルタ)を有することを特徴とする予
測復号化装置。
2. In a predictive decoding device prediction apparatus for predicting an inter-frame or an inter-field by motion-compensating with an accuracy of one pixel or less by a motion vector, L acting on a prediction signal only when the motion vector is an integer.
A predictive decoding device having a PF (low-pass filter).
JP7846792A 1992-02-28 1992-02-28 Predictive encoding device and decoding device Expired - Fee Related JP2606523B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP7846792A JP2606523B2 (en) 1992-02-28 1992-02-28 Predictive encoding device and decoding device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP7846792A JP2606523B2 (en) 1992-02-28 1992-02-28 Predictive encoding device and decoding device

Publications (2)

Publication Number Publication Date
JPH05244585A true JPH05244585A (en) 1993-09-21
JP2606523B2 JP2606523B2 (en) 1997-05-07

Family

ID=13662830

Family Applications (1)

Application Number Title Priority Date Filing Date
JP7846792A Expired - Fee Related JP2606523B2 (en) 1992-02-28 1992-02-28 Predictive encoding device and decoding device

Country Status (1)

Country Link
JP (1) JP2606523B2 (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998042134A1 (en) * 1997-03-17 1998-09-24 Mitsubishi Denki Kabushiki Kaisha Image encoder, image decoder, image encoding method, image decoding method and image encoding/decoding system
JP2001510966A (en) * 1997-07-15 2001-08-07 ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツング Improved image signal generation method under motion estimation of image sequence
WO2003047270A1 (en) * 2001-11-30 2003-06-05 Ntt Docomo, Inc. Moving picture coding apparatus, moving picture decoding apparatus, moving picture coding method, moving picture decoding method, program, and computer-readable recording medium containing the program
JP2008508801A (en) * 2004-07-30 2008-03-21 ユークリッド・ディスカバリーズ・エルエルシー Apparatus and method for processing video data
JP2010507286A (en) * 2006-10-13 2010-03-04 クゥアルコム・インコーポレイテッド Video coding with adaptive filtering for motion compensated prediction
WO2010038857A1 (en) * 2008-10-02 2010-04-08 ソニー株式会社 Image processing apparatus and method
WO2012063604A1 (en) * 2010-11-08 2012-05-18 ソニー株式会社 Image processing device, and image processing method
US8243118B2 (en) 2007-01-23 2012-08-14 Euclid Discoveries, Llc Systems and methods for providing personal video services
JP2014187700A (en) * 2009-02-19 2014-10-02 Sony Corp Decoding device and method
US8902971B2 (en) 2004-07-30 2014-12-02 Euclid Discoveries, Llc Video compression repository and model reuse
US8908766B2 (en) 2005-03-31 2014-12-09 Euclid Discoveries, Llc Computer method and apparatus for processing image data
US8942283B2 (en) 2005-03-31 2015-01-27 Euclid Discoveries, Llc Feature-based hybrid video codec comparing compression efficiency of encodings
US9106977B2 (en) 2006-06-08 2015-08-11 Euclid Discoveries, Llc Object archival systems and methods
US9532069B2 (en) 2004-07-30 2016-12-27 Euclid Discoveries, Llc Video compression repository and model reuse
US9578345B2 (en) 2005-03-31 2017-02-21 Euclid Discoveries, Llc Model-based video encoding and decoding
US9621917B2 (en) 2014-03-10 2017-04-11 Euclid Discoveries, Llc Continuous block tracking for temporal prediction in video encoding
US9743078B2 (en) 2004-07-30 2017-08-22 Euclid Discoveries, Llc Standards-compliant model-based video encoding and decoding
US10091507B2 (en) 2014-03-10 2018-10-02 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding
US10097851B2 (en) 2014-03-10 2018-10-09 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4102973B2 (en) * 2002-04-24 2008-06-18 日本電気株式会社 Encoding method and decoding method of moving image, apparatus and program using the same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6239920A (en) * 1985-08-15 1987-02-20 Nec Corp Method and apparatus for forecast coding and decoding of dynamic compensation inter-frame of picture signal
JPH05219498A (en) * 1992-02-06 1993-08-27 Fujitsu Ltd Moving picture encoder

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6239920A (en) * 1985-08-15 1987-02-20 Nec Corp Method and apparatus for forecast coding and decoding of dynamic compensation inter-frame of picture signal
JPH05219498A (en) * 1992-02-06 1993-08-27 Fujitsu Ltd Moving picture encoder

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8098734B2 (en) 1997-03-17 2012-01-17 Mitsubishi Denki Kabushiki Kaisha Video encoder, video decoder, video encoding method, video decoding method, and video encoding and decoding system
WO1998042135A1 (en) * 1997-03-17 1998-09-24 Mitsubishi Denki Kabushiki Kaisha Image encoder, image decoder, image encoding method, image decoding method and image encoding/decoding system
US6404815B1 (en) 1997-03-17 2002-06-11 Mitsubishi Denki Kabushiki Kaisha Image encoder, image decoder, image encoding method, image decoding method and image encoding/decoding system
WO1998042134A1 (en) * 1997-03-17 1998-09-24 Mitsubishi Denki Kabushiki Kaisha Image encoder, image decoder, image encoding method, image decoding method and image encoding/decoding system
US7110456B2 (en) 1997-03-17 2006-09-19 Mitsubishi Denki Kabushiki Kaisha Video encoder, video decoder, video encoding method, video decoding method, and video encoding and decoding system
US8194742B2 (en) 1997-03-17 2012-06-05 Mitsubishi Denki Kabushiki Kaisha Video decoder
US8170105B2 (en) 1997-03-17 2012-05-01 Mitsubishi Denki Kabushiki Kaisha Video decoder and video decoding method
JP2001510966A (en) * 1997-07-15 2001-08-07 ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツング Improved image signal generation method under motion estimation of image sequence
US8488671B2 (en) 2001-11-30 2013-07-16 Ntt Docomo, Inc. Moving picture encoding device, moving picture decoding device, moving picture encoding method, moving picture decoding method, program, and computer readable recording medium storing program
US8243803B2 (en) 2001-11-30 2012-08-14 Ntt Docomo, Inc. Moving picture coding apparatus, moving picture decoding apparatus, moving picture coding method, moving picture decoding method, program, and computer-readable recording medium containing the program
WO2003047270A1 (en) * 2001-11-30 2003-06-05 Ntt Docomo, Inc. Moving picture coding apparatus, moving picture decoding apparatus, moving picture coding method, moving picture decoding method, program, and computer-readable recording medium containing the program
US8391364B2 (en) 2001-11-30 2013-03-05 Ntt Docomo, Inc. Moving picture encoding device, moving picture decoding device, moving picture encoding method, moving picture decoding method, program, and computer readable recording medium storing program
US8275036B2 (en) 2001-11-30 2012-09-25 Ntt Docomo, Inc. Moving picture encoding device, moving picture decoding device, moving picture encoding method, moving picture decoding method, program, and computer readable recording medium storing program
US8902971B2 (en) 2004-07-30 2014-12-02 Euclid Discoveries, Llc Video compression repository and model reuse
JP2008508801A (en) * 2004-07-30 2008-03-21 ユークリッド・ディスカバリーズ・エルエルシー Apparatus and method for processing video data
US9743078B2 (en) 2004-07-30 2017-08-22 Euclid Discoveries, Llc Standards-compliant model-based video encoding and decoding
US9532069B2 (en) 2004-07-30 2016-12-27 Euclid Discoveries, Llc Video compression repository and model reuse
US8964835B2 (en) 2005-03-31 2015-02-24 Euclid Discoveries, Llc Feature-based video compression
US9578345B2 (en) 2005-03-31 2017-02-21 Euclid Discoveries, Llc Model-based video encoding and decoding
US8908766B2 (en) 2005-03-31 2014-12-09 Euclid Discoveries, Llc Computer method and apparatus for processing image data
US8942283B2 (en) 2005-03-31 2015-01-27 Euclid Discoveries, Llc Feature-based hybrid video codec comparing compression efficiency of encodings
US9106977B2 (en) 2006-06-08 2015-08-11 Euclid Discoveries, Llc Object archival systems and methods
JP2010507286A (en) * 2006-10-13 2010-03-04 クゥアルコム・インコーポレイテッド Video coding with adaptive filtering for motion compensated prediction
US9014280B2 (en) 2006-10-13 2015-04-21 Qualcomm Incorporated Video coding with adaptive filtering for motion compensated prediction
US8243118B2 (en) 2007-01-23 2012-08-14 Euclid Discoveries, Llc Systems and methods for providing personal video services
US8842154B2 (en) 2007-01-23 2014-09-23 Euclid Discoveries, Llc Systems and methods for providing personal video services
US8831103B2 (en) 2008-10-02 2014-09-09 Sony Corporation Image processing apparatus and method
WO2010038857A1 (en) * 2008-10-02 2010-04-08 ソニー株式会社 Image processing apparatus and method
JP5240530B2 (en) * 2008-10-02 2013-07-17 ソニー株式会社 Image processing apparatus and method
JP2014187700A (en) * 2009-02-19 2014-10-02 Sony Corp Decoding device and method
US9282345B2 (en) 2009-02-19 2016-03-08 Sony Corporation Image processing apparatus and method
US10321136B2 (en) 2009-02-19 2019-06-11 Sony Corporation Image processing apparatus and method
US10721480B2 (en) 2009-02-19 2020-07-21 Sony Corporation Image processing apparatus and method
CN103190148A (en) * 2010-11-08 2013-07-03 索尼公司 Image processing device, and image processing method
WO2012063604A1 (en) * 2010-11-08 2012-05-18 ソニー株式会社 Image processing device, and image processing method
US9621917B2 (en) 2014-03-10 2017-04-11 Euclid Discoveries, Llc Continuous block tracking for temporal prediction in video encoding
US10091507B2 (en) 2014-03-10 2018-10-02 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding
US10097851B2 (en) 2014-03-10 2018-10-09 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding

Also Published As

Publication number Publication date
JP2606523B2 (en) 1997-05-07

Similar Documents

Publication Publication Date Title
JP2606523B2 (en) Predictive encoding device and decoding device
US7146056B2 (en) Efficient spatial scalable compression schemes
US7630566B2 (en) Method and apparatus for improved estimation and compensation in digital video compression and decompression
US20060133475A1 (en) Video coding
JPH0870460A (en) Movement compensation type coding method adapted to magnitude of movement,and its device
JP2004048552A (en) Image encoder, image encoding method, image decoder, image decoding method and communication equipment
JPH02288788A (en) Inter-frame forecasting encoder
JPH10304383A (en) Movement compensated encoding device/method and encoding recording medium
US7050500B2 (en) Method and apparatus for motion vector coding with global motion parameters
JPH09154137A (en) Method and apparatus for compressing video information usingmovement-dependent estimation
JPH04328982A (en) High efficiency encoding device and decoding device
US6141379A (en) Apparatus and method of coding/decoding moving picture and storage medium storing moving picture
KR20050084396A (en) Digital filter with spatial scalability
JP2006511164A (en) Elastic memory
KR101601848B1 (en) Apparatus and method for generating inter prediction frame and reference frame interpolation apparatus and method therefor
JPH06133297A (en) Method and device for compensating motion of picture whose resolution is converted
JPH09322175A (en) Method and device for decoding time varying image
KR100240620B1 (en) Method and apparatus to form symmetric search windows for bidirectional half pel motion estimation
JP2004349756A (en) Motion image coding apparatus, method, and motion image coding program
JP2925046B2 (en) Motion compensation prediction method for moving images
Shen et al. Benefits of adaptive motion accuracy in H. 26L video coding
EP3984228A1 (en) Sample value clipping on mip reduced prediction
JPH0851630A (en) Movement compensation predicting encoder
JPH0614312A (en) Coding device
JPH0591496A (en) Movement compensation device

Legal Events

Date Code Title Description
FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090213

Year of fee payment: 12

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090213

Year of fee payment: 12

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100213

Year of fee payment: 13

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110213

Year of fee payment: 14

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120213

Year of fee payment: 15

LAPS Cancellation because of no payment of annual fees