WO2011127628A1 - Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement - Google Patents

Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement Download PDF

Info

Publication number
WO2011127628A1
WO2011127628A1 PCT/CN2010/000501 CN2010000501W WO2011127628A1 WO 2011127628 A1 WO2011127628 A1 WO 2011127628A1 CN 2010000501 W CN2010000501 W CN 2010000501W WO 2011127628 A1 WO2011127628 A1 WO 2011127628A1
Authority
WO
WIPO (PCT)
Prior art keywords
lower layer
macroblock
frame
layer frame
layer
Prior art date
Application number
PCT/CN2010/000501
Other languages
English (en)
Inventor
Yu Wen Wu
Original Assignee
Thomson Licensing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing filed Critical Thomson Licensing
Priority to PCT/CN2010/000501 priority Critical patent/WO2011127628A1/fr
Publication of WO2011127628A1 publication Critical patent/WO2011127628A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H04N19/895—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment

Definitions

  • the invention is made in the field of error concealment.
  • the invention relates to recovering of a lost enhancement layer macro block encoded in a spatial-scalable video coding signal.
  • Scalable video coding is an approach towards
  • the difference in quality may be related to temporal resolution, to spatial resolution or to signal-to-noise resolution.
  • image frames of a video are encoded in a spatial lower layer and one or more enhanced spatial layers. While the lower layer provides a low resolution version of the video frames, the enhanced spatial layers carry higher resolution versions of the same content .
  • Each UDP packet contains Cyclic " Redundancy Check (CRC) allowing error detection. If a CRC fails, the whole UDP packet is discarded.
  • CRC Redundancy Check
  • RU upsampling
  • each pixel value of the concealed frame is copied from the corresponding pixel of the first frame in Reference Picture List 0 (RefPicListO ) .
  • This algorithm can be invoked for any layer.
  • TD temporary direct motion vector generation
  • the MVs and reference indices of each subblocks of the missing frame are calculated as if they were coded using the "temporal direct mode”.
  • This algorithm can be invoked for any layer.
  • Motion and Residual Upsampling is an inter layer error concealment method wherein information from a lower layer which may be the lower layer are used for error concealment in an enhanced layer.
  • motion and residual upsampling (BLSkip) algorithm, SVC tools are used and the BLSkip mode is set in the enhancement layer.
  • Residual upsampling is also used to upsample the residual of the lower layer for enhanced layer.
  • the motion compensation is done at the enhanced layer using the upsampled motion fields. This algorithm can directly be used for the enhanced layer if there is no packet loss in the lower layer. If the lower layer is also lost, it needs to generate lower layer motion vectors using TD method in lower layer before BLSkip can use motion field upsampling.
  • Another inter layer error concealment method is
  • the lower layer picture is reconstructed and upsampled using the H.264/AVC 6-tap filter for the lost enhanced layer picture. If lower layer packet is also lost, the FC method is used for the enhancement layer, rather than using an upsampled concealed lower layer picture.
  • Lower Layer Upsampling as known from prior art is the availability of a lower layer frame corresponding to the enhancement layer frame for which a macroblock is lost or defect.
  • a method and device for recovering a lost macroblock of an enhancement layer frame of a spatial- scalable video coding signal are proposed, the method comprising the features of claim 1 and the device being adapted fro performing said method.
  • Said method comprises using reconstruction lower layer upsampling for recovering said lost macroblock, wherein a generated lower layer macroblock is upsampled, said
  • Fig. 1 exemplarily depicts SVC coding structure with two dependency layers with different frame rate and Fig. 2 exemplarily depicts the proposed solution of temporal interpolation lowerd SVC error concealment .
  • the invention can be realized on any electronic device comprising a processing device correspondingly adapted.
  • the invention can be realized in a set-top-box, a television, a DVD- and/or BD-player, a mobile phone, a personal computer, a navigation system or a car video system.
  • FIG. 1 The figure shows an enhanced layer EL comprising the image frames El, E2, E3, E4 and E5 and a lower layer LL which comprises the images frames Bl, B3 and B5.
  • the enhanced layer EL is spatially as well as temporarily enhanced. That is, frames El, E3 and E5 comprise the same content as frames Bl, B3 and B5 but at a higher spatial resolution as indicated by the number of quadrangles comprised in the frames. Furthermore, the enhanced layer EL provides the same content with a higher temporal resolution as it comprises the frames E2 and E4 for which no
  • picture E5 may be replaced by an up-scaled version of picture B5.
  • RU can be the packet recovery method which promises the lowest overall visual degradation resulting from concealment error and error propagation.
  • the current invention proposes generating a
  • corresponding lower layer macroblock can be due to the lower layer's lower frame rate or due to packet loss.
  • enhancement layer frame which suffered a macroblock loss is E2(loss).
  • E2(loss) As a collocated lower layer macroblock does not exist, the corresponding lower layer macroblock is
  • a preceding lower layer frame Bl and a subsequent lower layer frame B3 are used for determining optical flow OF to get corresponding pixel motion directions between the preceding lower layer frame Bl and the subsequent lower layer frame B3. Then, the pixel motion directions are clustered.
  • a least squares minimization method is used to get pixel values of said corresponding lower layer macroblock.
  • the clustered pixel motion is used for segmentation of the frame to-be-generated.
  • the corresponding lower layer macroblock is then upsampled to enhancement layer resolution and used as recovery of the lost enhancement layer block.
  • the current invention proposes a temporal interpolation based method to conceal the transmission error of SVC bit stream to keep the continuity of the rendered video. It can be applied to SVC bit streams having different layers with different frame rate but is not restricted to such bit streams.
  • the invention allows for reconstructing the signal of the higher spatial layer by a lower spatial layer signal.
  • the invention can be applied to higher layer frames of any SVC signal of two or more layers.
  • the invention proposes adopting image processing methods to generate non-existing lower layer frames. In doing said image processing on lower layer frames, time cost of image processing can be controlled.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne le domaine de dissimulation des erreurs. En particulier, l'invention concerne la récupération d'un macrobloc perdu de couche d'extension d'une trame de couche d'extension (E2) codée dans un signal de codage vidéo variable spatialement. Un procédé de dissimulation d'erreurs entre couches, connu dans l'art antérieur, est l'Upsampling de couche inférieure de reconstruction (RU). Une condition préalable à l'Upsampling de couche inférieure de reconstruction (RU) de l'art antérieur est la disponibilité d'une trame de couche inférieure correspondant à la trame de couche d'extension (E2) dont un macrobloc est perdu. Pour supprimer cette condition préalable, l'invention propose de générer un macrobloc de couche inférieure en utilisant des macroblocs compris dans des trames de couche inférieure (B1, B3) ne coïncidant pas avec ladite trame de couche d'extension (E2). Le macrobloc de couche inférieure généré est ensuite « upsamplé » à une résolution de couche étendue et utilisé comme dissimulation après l'upsampling.
PCT/CN2010/000501 2010-04-15 2010-04-15 Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement WO2011127628A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2010/000501 WO2011127628A1 (fr) 2010-04-15 2010-04-15 Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2010/000501 WO2011127628A1 (fr) 2010-04-15 2010-04-15 Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement

Publications (1)

Publication Number Publication Date
WO2011127628A1 true WO2011127628A1 (fr) 2011-10-20

Family

ID=44798244

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/000501 WO2011127628A1 (fr) 2010-04-15 2010-04-15 Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement

Country Status (1)

Country Link
WO (1) WO2011127628A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007080480A2 (fr) * 2006-01-09 2007-07-19 Nokia Corporation Décision de mode tolérante aux erreurs en codage vidéo hiérarchique
WO2007080408A2 (fr) * 2006-01-11 2007-07-19 Mitsubishi Electric Information Technology Centre Europe B.V. Masquage d'erreur pour codage video echelonnable
CN101242540A (zh) * 2007-02-09 2008-08-13 安凯（广州）软件技术有限公司 用于视频解码器芯片的差错控制方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007080480A2 (fr) * 2006-01-09 2007-07-19 Nokia Corporation Décision de mode tolérante aux erreurs en codage vidéo hiérarchique
WO2007080408A2 (fr) * 2006-01-11 2007-07-19 Mitsubishi Electric Information Technology Centre Europe B.V. Masquage d'erreur pour codage video echelonnable
CN101242540A (zh) * 2007-02-09 2008-08-13 安凯（广州）软件技术有限公司 用于视频解码器芯片的差错控制方法

Similar Documents

Publication Publication Date Title
EP1809041A1 (fr) Masquage d'erreur pour le codage vidéo échelonnable
US7787540B2 (en) Method for scalably encoding and decoding video signal
US7835452B2 (en) Method for encoding and decoding video signal
US8831102B2 (en) Method for predicting a lost or damaged block of an enhanced spatial layer frame and SVC-decoder adapted therefore
US20060133503A1 (en) Method for scalably encoding and decoding video signal
US8290058B2 (en) Method and device for coding and decoding
US20060133482A1 (en) Method for scalably encoding and decoding video signal
EP1900217A1 (fr) Procede et systeme de codage-decodage d'un signal video au moyen de donnees de prediction en blocs
GB2480224A (en) Decoding a Sequence of Digital Images with Error Concealment
CN108924568B (zh) 一种基于3d-hevc框架的深度视频错误隐藏方法
WO2006104366A1 (fr) Procede de codage et de decodage susceptibles d'etre mis a l'echelle d'un signal video
EP1878248A1 (fr) Procede pour le codage et decodage a echelle variable de signal video
Dufaux et al. Recent advances in multiview distributed video coding
WO2011127628A1 (fr) Procédé et dispositif permettant de récupérer un macrobloc perdu d'une trame de couche d'extension d'un signal de codage vidéo variable spatialement
CN101583045B (zh) 基于obmc的svc层间错误隐藏方法
WO2006104363A1 (fr) Procede de codage et de decodage echelonnable de signal video
Yeh et al. Inter-embedding error-resilient mechanism in scalable video coding
Huu et al. A frame loss concealment solution for spatial scalable hevc using base layer motion
Bajic et al. Error concealment for scalable motion-compensated subband/wavelet video coders
Song et al. Error concealment of H. 264/AVC video frames for mobile video broadcasting
KR101507243B1 (ko) 오류 은닉 기법의 선택적 적용을 이용하는 svc의 복호화 방법 및 이를 이용한 svc의 복호화 시스템
Shelotkar et al. Video error concealment using H. 264/AVC
Nguyen et al. A Frame Loss Concealment Solution for Spatial Scalable HEVC using Base Layer Motion
Kao et al. Motion vector field manipulation for complexity reduction in scalable video coding
KR100938553B1 (ko) 스케일러블 영상 부/복호화기에서 주변 블록 정보를 이용한바운더리 처리 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10849638

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10849638

Country of ref document: EP

Kind code of ref document: A1