WO2016115733A1 - Améliorations de la prédiction de résidus intra-composante - Google Patents

Améliorations de la prédiction de résidus intra-composante Download PDF

Info

Publication number
WO2016115733A1
WO2016115733A1 PCT/CN2015/071440 CN2015071440W WO2016115733A1 WO 2016115733 A1 WO2016115733 A1 WO 2016115733A1 CN 2015071440 W CN2015071440 W CN 2015071440W WO 2016115733 A1 WO2016115733 A1 WO 2016115733A1
Authority
WO
WIPO (PCT)
Prior art keywords
samples
chroma
component
luma
reconstructed
Prior art date
Application number
PCT/CN2015/071440
Other languages
English (en)
Inventor
Xianguo Zhang
Han HUANG
Original Assignee
Mediatek Singapore Pte. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mediatek Singapore Pte. Ltd. filed Critical Mediatek Singapore Pte. Ltd.
Priority to PCT/CN2015/071440 priority Critical patent/WO2016115733A1/fr
Priority to EP15855903.9A priority patent/EP3198874A4/fr
Priority to KR1020207012648A priority patent/KR20200051831A/ko
Priority to CN201580058756.4A priority patent/CN107079166A/zh
Priority to KR1020177013692A priority patent/KR20170071594A/ko
Priority to SG11201703014RA priority patent/SG11201703014RA/en
Priority to US15/519,181 priority patent/US20170244975A1/en
Priority to CA2964324A priority patent/CA2964324C/fr
Priority to PCT/CN2015/092168 priority patent/WO2016066028A1/fr
Publication of WO2016115733A1 publication Critical patent/WO2016115733A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Definitions

  • the invention relates generally to video coding process, including general video, Screen Content (SC) video, multi-view video and Three-Dimensional (3D) video processing.
  • SC Screen Content
  • 3D Three-Dimensional
  • the present invention relates to methods for the improvements of inter-component residual prediction, such as parameter derivation and predictor calculation.
  • the HEVC extensions include range extensions (RExt) which target at non-4: 2: 0 color formats, such as 4: 2: 2 and 4: 4: 4, and higher bit-depths video such as 12, 14 and 16 bits per sample.
  • RExt range extensions
  • a coding tool developed for RExt is inter-component prediction that improves coding efficiency particularly for multiple color components with high bit-depths. Inter-component prediction can exploit the redundancy among multiple color components and improves coding efficiency accordingly.
  • a form of inter-component prediction being developed for RExt is Inter-component Residual Prediction (IRP) as disclosed by Pu et al.
  • IRP Inter-component Residual Prediction
  • JCTVC-N0266 Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Vienna, AT, 25 July –2 Aug. 2013 Document: JCTVC-N0266) .
  • the chroma residual is predicted at the encoder side as:
  • r C (x, y) denotes the final chroma reconstructed residual sample at position (x, y)
  • r c ′ (x, y) denotes the reconstructed chroma residual sample from the bit-stream at position (x, y)
  • r L (x, y) denotes the reconstructed residual sample in the luma component at position (x, y)
  • ⁇ is a scaling parameter (also called alpha parameter, or scaling factor) .
  • Scaling parameter ⁇ is calculated at the encoder side and signaled.
  • the final chroma reconstructed residual sample is derived according to:
  • RGB format may be used. If R component is encoded first, R component is treated the same way as the luma component in the above example. Similarly, if G component is encoded first, the G component is treated the same way as the luma component.
  • FIG. 1 An exemplary decoding process the IRP in the current HEVC-REXT is illustrated in Fig. 1 for transform units (TUs) of the current unit (CU) .
  • the decoded coefficients of all TUs of a current CU are provided to processors for respective components.
  • the first component e.g., Y component
  • the decoded transform coefficients are inverse transformed (block 110) to recover the Intra/Inter coded residual of the first color component.
  • the Inter/Intra coded first color component is then processed by First Component Inter/Intra Compensation 120 to produce the final reconstructed first component.
  • the needed Inter/Intra reference samples for First Component Inter/Intra Compensation 120 are provided from buffers or memories.
  • the first color component is Inter/Intra coded so that the Inter/Intra compensation is used to reconstruct the first component from the reconstructed residual.
  • other coding process e.g., inter-view prediction
  • the decoded transform coefficients are decoded using second component decoding process (block 112) to recover inter-component coded second component. Since the second component is inter-component residual predicted based on the first component residual, Inter-component Prediction for second Component (block 122) is used to reconstruct the second component residual based on outputs from block 110 and block 112. As mentioned before, the inter-component residual prediction needs the scaling parameter coded.
  • decoded alpha parameter between the first color component and the second color component is provided to block 122.
  • the output from block 122 corresponds to Inter/Intra prediction residual of the second component. Therefore, second Component Inter/Intra Compensation (block 132) is used to reconstruct the final second component. Similar to the first color component, other coding process (e.g., inter-view prediction) may also be included in the coding/prediction process to generate the second color residual.
  • similar processing can be used (i.e., blocks 114, 124 and 134) to reconstruct the final third component. According to the decoding process, the encoding process can be easily derived.
  • the alpha parameters can be either transmitted in video stream or derived from samples including the reconstructed neighboring samples and predicted samples.
  • HEVC design selects the former one without parameter derivation.
  • HEVC just adopts such method for 4: 4: 4 format videos. However, such method can also achieve bit-savings on 4: 2: 0 videos. When it is extended for 4: 2: 0 videos, how to determine the correspondence between luma and the current chroma samples, derive parameters and get predictors should be designed.
  • (4)Such method only utilizes reconstructed luma residuals to predict the current chroma residuals, but it is also feasible to utilize reconstructed non-first chroma residuals to predict the current chroma residuals.
  • Fig. 1 is a diagram illustrating generalized inter-component residual prediction procedures for HEVC.
  • Fig. 2 (a) -Fig. 2 (c) is a diagram illustrating one down-sampling method used for non-444 format inter-component residual prediction.
  • Improvements are proposed for the inter-component residual prediction, including at least one of the following improvements.
  • r (x, y) includes r L (x, y) but not limited to it.
  • r (x, y) can also be the reconstructed chroma residual block.
  • the parameter beta can be transmitted in bit stream when inter-component residual prediction is utilized.
  • the parameter beta can be transmitted in video stream by some additional flags at the condition of inter-component residual prediction is utilized.
  • the 2nd improvement the required parameters are derived from the reconstructed neighboring samplesk, the reconstructed residuals of the neighboring samples or the predicted samples of the current block.
  • Fig. 2 (a) presents this parameter derivation example.
  • Fig. 2 (b) presents this parameter derivation example.
  • the 3rd improvement, method is applied to non-4: 4: 4 videos.
  • the luma component is down sampled, to have the same resolution with chroma components, for parameters derivation and predictor generation.
  • a first embodiment of this improvement in the parameter derivation process for cases when there are N luma samples but M (M ⁇ N) corresponding chroma samples, one down-sampling operation is conducted to select or generate M luma samples for the parameter derivation.
  • a third embodiment of this improvement in the parameter derivation process for cases when down-sampling N luma neighboring samples to generate M samples, typically M being equal to N/2, the average values of every two luma neighboring samples are selected.
  • the example is shown in Fig. 2 (a) .
  • Another embodiment of this improvement for either parameter derivation or predictor generation process, while down-sampling N luma samples to generate M samples, methods including but not limited to 4-point-average, corner-point selection, horizontal-average, as shown in Fig. 2 (c) , can be utilized.
  • the utilized down-sampling algorithms are the same, i.e., the same averaging or point selection method.
  • the 4th improvement, parameters and predictors are calculated for the current chroma block at PU or CU level.
  • the inter-component prediction mode signaling flag is transmitted in PU or CU level.
  • a second embodiment of this improvement the utilized parameters are transmitted in PU or CU level.
  • the residual prediction for intra CU is still conducted at TU level, but conducted at CU or PU level for Inter CU.
  • the residual prediction for intra CU is still conducted at TU level, but conducted at CU or PU level for Intra block Copy CU.
  • the parameter transmission for intra CU is still conducted at TU level, but conducted at CU or PU level for Inter or Intra block Copy CU.
  • the mode flag signaling for intra CU is still conducted at TU level, but conducted at CU or PU level for Inter or Intra block Copy CU.
  • an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
  • An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
  • DSP Digital Signal Processor
  • the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) .
  • processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
  • the software code or firmware codes may be developed in different programming languages and different format or style.
  • the software code may also be compiled for different target platform.
  • different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne des procédés de prédiction inter-chrominance pour des vidéos générales. L'invention concerne plusieurs procédés de codage des composantes de chrominance, ayant leur propre mode de prédiction et même leur propre contexte.
PCT/CN2015/071440 2014-10-28 2015-01-23 Améliorations de la prédiction de résidus intra-composante WO2016115733A1 (fr)

Priority Applications (9)

Application Number Priority Date Filing Date Title
PCT/CN2015/071440 WO2016115733A1 (fr) 2015-01-23 2015-01-23 Améliorations de la prédiction de résidus intra-composante
EP15855903.9A EP3198874A4 (fr) 2014-10-28 2015-10-19 Procédé de prédiction de composant transversal guidé pour codage vidéo
KR1020207012648A KR20200051831A (ko) 2014-10-28 2015-10-19 비디오 코딩을 위한 가이드된 크로스-컴포넌트 예측 방법
CN201580058756.4A CN107079166A (zh) 2014-10-28 2015-10-19 用于视频编码的引导交叉分量预测的方法
KR1020177013692A KR20170071594A (ko) 2014-10-28 2015-10-19 비디오 코딩을 위한 가이드된 크로스-컴포넌트 예측 방법
SG11201703014RA SG11201703014RA (en) 2014-10-28 2015-10-19 Method of guided cross-component prediction for video coding
US15/519,181 US20170244975A1 (en) 2014-10-28 2015-10-19 Method of Guided Cross-Component Prediction for Video Coding
CA2964324A CA2964324C (fr) 2014-10-28 2015-10-19 Procede de prediction de composant transversal guide pour codage video
PCT/CN2015/092168 WO2016066028A1 (fr) 2014-10-28 2015-10-19 Procédé de prédiction de composant transversal guidé pour codage vidéo

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/071440 WO2016115733A1 (fr) 2015-01-23 2015-01-23 Améliorations de la prédiction de résidus intra-composante

Publications (1)

Publication Number Publication Date
WO2016115733A1 true WO2016115733A1 (fr) 2016-07-28

Family

ID=56416313

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/071440 WO2016115733A1 (fr) 2014-10-28 2015-01-23 Améliorations de la prédiction de résidus intra-composante

Country Status (1)

Country Link
WO (1) WO2016115733A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2567249A (en) * 2017-10-09 2019-04-10 Canon Kk New sample sets and new down-sampling schemes for linear component sample prediction

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050013370A1 (en) * 2003-07-16 2005-01-20 Samsung Electronics Co., Ltd. Lossless image encoding/decoding method and apparatus using inter-color plane prediction
US20080304759A1 (en) * 2007-06-11 2008-12-11 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding image by using inter color compensation
WO2012160797A1 (fr) * 2011-05-20 2012-11-29 Panasonic Corporation Procédés et appareils de codage et de décodage de vidéo à l'aide d'une prédiction inter-plans colorés
WO2014190171A1 (fr) * 2013-05-22 2014-11-27 Qualcomm Incorporated Vidéocodage utilisant une prédiction d'échantillon parmi des composantes de couleur
WO2015009732A1 (fr) * 2013-07-15 2015-01-22 Qualcomm Incorporated Prédiction de composante résiduelle de couleur intermédiaire

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050013370A1 (en) * 2003-07-16 2005-01-20 Samsung Electronics Co., Ltd. Lossless image encoding/decoding method and apparatus using inter-color plane prediction
US20080304759A1 (en) * 2007-06-11 2008-12-11 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding image by using inter color compensation
WO2012160797A1 (fr) * 2011-05-20 2012-11-29 Panasonic Corporation Procédés et appareils de codage et de décodage de vidéo à l'aide d'une prédiction inter-plans colorés
WO2014190171A1 (fr) * 2013-05-22 2014-11-27 Qualcomm Incorporated Vidéocodage utilisant une prédiction d'échantillon parmi des composantes de couleur
WO2015009732A1 (fr) * 2013-07-15 2015-01-22 Qualcomm Incorporated Prédiction de composante résiduelle de couleur intermédiaire

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MINEZAWA, AKIRA ET AL.: "SCCE5 3.1.1: Extended inter-component prediction (JCTVC- Q0036", JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG 16 WP 3 AND ISOLIEC JT( 1/SC 29/WG 11, 9 July 2014 (2014-07-09) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2567249A (en) * 2017-10-09 2019-04-10 Canon Kk New sample sets and new down-sampling schemes for linear component sample prediction

Similar Documents

Publication Publication Date Title
CA2964324C (fr) Procede de prediction de composant transversal guide pour codage video
US10812806B2 (en) Method and apparatus of localized luma prediction mode inheritance for chroma prediction in video coding
US10554979B2 (en) Methods of handling escape pixel as a predictor in index map coding
US10750169B2 (en) Method and apparatus for intra chroma coding in image and video coding
AU2019202043B2 (en) Method and apparatus for palette coding of monochrome contents in video and image compression
US10477214B2 (en) Method and apparatus for scaling parameter coding for inter-component residual prediction
EP3058740B1 (fr) Fonctions de mode carte d'index de couleur de base pour codage et décodage de vidéo et d'image
US10057580B2 (en) Method and apparatus for entropy coding of source samples with large alphabet
WO2016115981A1 (fr) Procédé de codage vidéo destiné à des composants de chrominance
GB2567249A (en) New sample sets and new down-sampling schemes for linear component sample prediction
US10237557B2 (en) Method of run-length coding for palette predictor
WO2015176685A1 (fr) Procédés de signalisation de taille de palette et signalisation conditionnelle de drapeau d'échappement de palette
JP2017512026A (ja) イントラブロックコピー予測におけるブロック反転及びスキップモード
CA2950818A1 (fr) Procede et appareil de binarisation et de codage adaptatif selon le contexte pour une syntaxe dans un codage video
WO2017008679A1 (fr) Procédé et appareil d'intraprédiction avancée pour des composantes de chrominance dans un codage d'image et vidéo
US10652555B2 (en) Method and apparatus of palette index map coding for screen content coding
WO2021004153A1 (fr) Procédé de prédiction d'image, codeur, décodeur, et support d'informations
US20240107044A1 (en) Moving picture decoding device, moving picture decoding method, and program obtaining chrominance values from corresponding luminance values
WO2016115728A1 (fr) Procédés de codage de valeur d'échappement améliorés
US10244258B2 (en) Method of segmental prediction for depth and texture data in 3D and multi-view coding systems
WO2016146076A1 (fr) Procédé et appareil de codage de carte-index au cours d'une compression vidéo et d'image
CN113950837A (zh) 图像解码装置、图像解码方法及程序
WO2016115733A1 (fr) Améliorations de la prédiction de résidus intra-composante
US10110892B2 (en) Video encoding device, video decoding device, video encoding method, video decoding method, and program
WO2016044974A1 (fr) Signalisation de tableau palette

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15878410

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15878410

Country of ref document: EP

Kind code of ref document: A1