EP1800488A1 - Vorrichtung und verfahren zum erzeugen einer codierten videosequenz und zum decodieren einer codierten videosequenz unter verwendung einer zwischen-schicht-restwerte-praediktion - Google Patents

Vorrichtung und verfahren zum erzeugen einer codierten videosequenz und zum decodieren einer codierten videosequenz unter verwendung einer zwischen-schicht-restwerte-praediktion

Info

Publication number
EP1800488A1
EP1800488A1 EP05784915A EP05784915A EP1800488A1 EP 1800488 A1 EP1800488 A1 EP 1800488A1 EP 05784915 A EP05784915 A EP 05784915A EP 05784915 A EP05784915 A EP 05784915A EP 1800488 A1 EP1800488 A1 EP 1800488A1
Authority
EP
European Patent Office
Prior art keywords
motion
images
sequence
basic
residual error
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP05784915A
Other languages
German (de)
English (en)
French (fr)
Inventor
Heiko Schwarz
Detlev Marpe
Thomas Wiegand
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE102004059978A external-priority patent/DE102004059978B4/de
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority to EP12180680A priority Critical patent/EP2538677A1/de
Publication of EP1800488A1 publication Critical patent/EP1800488A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H04N19/615Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding using motion compensated temporal filtering [MCTF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/31Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/36Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/13Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]

Definitions

  • the SI-slice is also called a switching-I-slice, which describes an exact adaptation of the M.acroblock in a an SP slice for direct access and error recovery purposes.
  • the I_4 X 4 coding type allows the encoder to simply skip the prediction as well as the transform coding and instead directly transmit the values of coded samples.
  • the I-pc M mode serves the following purposes: It allows the encoder to accurately represent the values of the samples. ER provides a way to accurately represent the values of very abnormal image content without data magnification. It also makes it possible to specify a hard limit for the number of bits that a macroblock handling coder must have without suffering the coding efficiency.
  • each 4x4 block is predicted from spatially neighboring samples. Sixteen samples of the 4x4 block are predicted using previously decoded samples in adjacent blocks. One of 9 prediction modes can be used for each 4x4 block. In addition to the DC prediction (where a value is used to predict the entire 4x4 block), 8 directional prediction modes are specified. These modes are suitable for predicting directional structures in an image, such as edges at different angles.
  • the given signal s [k] can be represented by l (k) and h (k), but each signal has the half sample rate. Since both the update step and the prediction step are completely invertible, the corresponding transformation can be interpreted as a critically sampled perfect reconstruction filter bank. In fact, it can be shown that any biorthogonal family of wavelet filters can be realized by a sequence of one or more prediction steps and one or more update steps.
  • the normers 47 and 48 are supplied with suitably chosen scaling factors Fi and Fj 1 .
  • the inverse-lifting scheme which corresponds to the synthesis filter bank, is shown in FIG. 4, on the right-hand side.
  • the scalability concept should provide a high degree of flexibility for all scalability types, ie a high degree of flexibility both in terms of time as well as in terms of space and in terms of SNR.
  • the present invention is based on the finding that bit rate reductions can not only be achieved with a motion-compensated prediction carried out within a scaling layer, but that further bit rate reductions are obtained with constant image quality by virtue of an intermediate scaling layer prediction of the residual images after the motion-compensated prediction from a lower layer, for example the base layer, to a higher layer, such as the extension layer, Maschinen ⁇ is performed.
  • the encoder according to the invention further comprises an expansion-motion compensator or expansion-motion estimator 1014 for determining extension motion data.
  • This extension movement data is then supplied to an expansion movement predictor 1016, which has on the output side an extension sequence of residual error codes. images and fed to a downstream interlayer predictor 1018.
  • the expansion motion predictor thus performs the motion compensation that has been somewhat prepared by the motion compensator or motion estimator.
  • the corresponding data is supplied via an extension motion data line 1080 to the motion data determiner 1078. If, however, the movement data flag 1070 indicates that no additional extension movement data has been transmitted for the extension layer, then necessary movement data are fetched via a line 1082 from the base layer, depending on the scalability used, either directly (line 1084) or after a high key by a 1087 push-button.
  • the same reference indices are used as for the corresponding macroblock / sub-macroblock partitionings of the base layer block.
  • the associated motion vectors are multiplied by a factor of 2. This factor applies to the situation shown in FIG. 6b, in which a base layer 1102 comprises half the area or number in pixels as the enhancement layer 1104. If the ratio of the spatial resolution of the base layer to the spatial resolution of the enhancement layer is not equal to 1 / 2, corresponding scaling factors are used for the motion vectors.
  • the macroblock mode Qpel_Refinement_Mode is signaled.
  • the flag 1100 is preferably present only if the base layer represents a layer with half the spatial resolution of the current layer. Otherwise, the macroblock mode (Qpel_Refinement_Mode) is not included in the set of possible macroblock modes.
  • This macroblock mode is similar to the base layer mode.
  • the macroblock partitioning as well as the reference indices and the motion vectors are derived as in the base layer mode. However, there is one for each motion vector additional quarter sample motion vector refinement -1.0 or +1 for each motion vector component which is additionally transmitted and added to the derived motion vector.
  • the base-layer macroblock / sub-macroblock partitioning covering the upper left sample of the present macroblock / sub-macroblock partitioning uses the List X or a bi-prediction;
  • the L ⁇ X reference index of the base layer macroblood / sub-macroblock partitioning, which includes the upper left sample of the current macroblock / sub-macroblock partitioning, is equal to the list X reference index of the current macro - block / suto macroblock partitioning.
  • the method according to the invention can be implemented in hardware or in software.
  • the implementation can take place on a digital storage medium, in particular a floppy disk or CD with electronically readable control signals, which can cooperate with a programmable computer system such that the method is carried out.
  • the invention thus also exists in a computer program product with a program code stored on a machine-readable carrier for carrying out the method according to the invention, when the computer program product runs on a computer.
  • the invention can thus be realized as a computer program with a program code for carrying out the method when the computer program runs on a computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
EP05784915A 2004-10-15 2005-09-21 Vorrichtung und verfahren zum erzeugen einer codierten videosequenz und zum decodieren einer codierten videosequenz unter verwendung einer zwischen-schicht-restwerte-praediktion Withdrawn EP1800488A1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP12180680A EP2538677A1 (de) 2004-10-15 2005-09-21 Vorrichtung und Verfahren zum Erzeugen einer kodierten Videosequenz und zum Dekodieren einer kodierten Videosequenz unter Verwendung einer Zwischen-Schicht-Restwerte-Prädiktion

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US61945704P 2004-10-15 2004-10-15
DE102004059978A DE102004059978B4 (de) 2004-10-15 2004-12-13 Vorrichtung und Verfahren zum Erzeugen einer codierten Videosequenz und zum Decodieren einer codierten Videosequenz unter Verwendung einer Zwischen-Schicht-Restwerte-Prädiktion sowie ein Computerprogramm und ein computerlesbares Medium
PCT/EP2005/010227 WO2006042612A1 (de) 2004-10-15 2005-09-21 Vorrichtung und verfahren zum erzeugen einer codierten videosequenz und zum decodieren einer codierten videosequenz unter verwendung einer zwischen-schicht-restwerte-praediktion

Publications (1)

Publication Number Publication Date
EP1800488A1 true EP1800488A1 (de) 2007-06-27

Family

ID=35431439

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05784915A Withdrawn EP1800488A1 (de) 2004-10-15 2005-09-21 Vorrichtung und verfahren zum erzeugen einer codierten videosequenz und zum decodieren einer codierten videosequenz unter verwendung einer zwischen-schicht-restwerte-praediktion

Country Status (3)

Country Link
EP (1) EP1800488A1 (ja)
JP (1) JP5122288B2 (ja)
WO (1) WO2006042612A1 (ja)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060153295A1 (en) * 2005-01-12 2006-07-13 Nokia Corporation Method and system for inter-layer prediction mode coding in scalable video coding
WO2006129184A1 (en) * 2005-06-03 2006-12-07 Nokia Corporation Residual prediction mode in scalable video coding
DE102007022955A1 (de) * 2007-05-16 2008-11-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Qualitätsskalierbares Videosignal, Verfahren zu dessen Erzeugung, Codierer und Decodierer
ES2681526T3 (es) 2010-01-11 2018-09-13 Telefonaktiebolaget Lm Ericsson (Publ) Técnica para estimación de calidad del vídeo
US10764604B2 (en) 2011-09-22 2020-09-01 Sun Patent Trust Moving picture encoding method, moving picture encoding apparatus, moving picture decoding method, and moving picture decoding apparatus
US20150181232A1 (en) * 2012-07-18 2015-06-25 Sony Corporation Image processing device and method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL9200499A (nl) * 1992-03-17 1993-10-18 Nederland Ptt Systeem omvattende ten minste een encoder voor het coderen van een digitaal signaal en ten minste een decoder voor het decoderen van een gecodeerd digitaal signaal, alsmede encoder en decoder voor toepassing in het systeem.
US6023301A (en) * 1995-07-14 2000-02-08 Sharp Kabushiki Kaisha Video coding device and video decoding device
JP3263807B2 (ja) * 1996-09-09 2002-03-11 ソニー株式会社 画像符号化装置および画像符号化方法
US6233356B1 (en) * 1997-07-08 2001-05-15 At&T Corp. Generalized scalability for video coder based on video objects
DE10121259C2 (de) * 2001-01-08 2003-07-24 Siemens Ag Optimale SNR-skalierbare Videocodierung

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2006042612A1 *

Also Published As

Publication number Publication date
JP2008517499A (ja) 2008-05-22
WO2006042612A1 (de) 2006-04-27
JP5122288B2 (ja) 2013-01-16

Similar Documents

Publication Publication Date Title
DE102004059993B4 (de) Vorrichtung und Verfahren zum Erzeugen einer codierten Videosequenz unter Verwendung einer Zwischen-Schicht-Bewegungsdaten-Prädiktion sowie Computerprogramm und computerlesbares Medium
DE60031230T2 (de) Skalierbares videokodierungssystem und verfahren
DE60027955T2 (de) Verfahren und Vorrichtung zur kontextbasierten Inter/Intra Kodierungsmodeauswahl
CN1926876B (zh) 空间和时间可扩展编码的图像序列的编码和解码方法
WO2006056531A1 (de) Verfahren zur transcodierung sowie transcodiervorrichtung
DE60317670T2 (de) Verfahren und Vorrichtung zur 3D-Teilbandvideokodierung
DE69915843T2 (de) Teilbandkodierung/-dekodierung
WO2006042612A1 (de) Vorrichtung und verfahren zum erzeugen einer codierten videosequenz und zum decodieren einer codierten videosequenz unter verwendung einer zwischen-schicht-restwerte-praediktion
EP1800490A1 (de) Vorrichtung und verfahren zum erzeugen einer codierten videosequenz unter verwendung einer zwischen-schicht-bewegungsdaten-prädiktion
DE10022520A1 (de) Verfahren zur örtlichen skalierbaren Bewegtbildcodierung
EP1737240A2 (en) Method for scalable image coding or decoding
DE102004063902B4 (de) Computerprogramm mit einem Verfahren zum Verarbeiten einer Gruppe von Bildern und mit einem Verfahren zum Verarbeiten eines Basisbildes und eines oder mehrerer Erweiterungsbilder
DE102004011422B4 (de) Vorrichtung und Verfahren zum Verarbeiten einer Gruppe von Bildern und Vorrichtung und Verfahren zum Verarbeiten eines Basisbildes und eines oder mehrerer Erweiterungsbilder
DE102004011421B4 (de) Vorrichtung und Verfahren zum Erzeugen eines skalierten Datenstroms
DE10340407A1 (de) Vorrichtung und Verfahren zum Codieren einer Gruppe von aufeinanderfolgenden Bildern und Vorrichtung und Verfahren zum Decodieren eines codierten Bildsignals
DE10121259C2 (de) Optimale SNR-skalierbare Videocodierung
Sawada et al. Subband-based scalable coding schemes with motion-compensated prediction
Shahid et al. An adaptive scan of high frequency subbands for dyadic intra frame in MPEG4-AVC/H. 264 scalable video coding
WO2000046998A1 (de) Verfahren und anordnung zur transformation eines bildbereichs
GANGULY et al. FAST MODE DECISION ALGORITHM FOR INTRA ONLY SCALABLE VIDEO CODING USING COMBINED SUBBAND/DCT CODING
WO2008006806A2 (de) Skalierbare videokodierung
DE10243568A1 (de) Verfahren zur skalierbaren Videocodierung eines Videobildsignals sowie ein zugehöriger Codec

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070327

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MARPE, DETLEV

Inventor name: SCHWARZ, HEIKO

Inventor name: WIEGAND, THOMAS

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1105264

Country of ref document: HK

17Q First examination report despatched

Effective date: 20101011

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20121106

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1105264

Country of ref document: HK