WO2021054037A1 - Image decoding device, image decoding method, and program - Google Patents

Image decoding device, image decoding method, and program Download PDF

Info

Publication number
WO2021054037A1
WO2021054037A1 PCT/JP2020/031561 JP2020031561W WO2021054037A1 WO 2021054037 A1 WO2021054037 A1 WO 2021054037A1 JP 2020031561 W JP2020031561 W JP 2020031561W WO 2021054037 A1 WO2021054037 A1 WO 2021054037A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
color difference
inter
residual signal
coding
Prior art date
Application number
PCT/JP2020/031561
Other languages
French (fr)
Japanese (ja)
Inventor
圭 河村
内藤 整
Original Assignee
Kddi株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kddi株式会社 filed Critical Kddi株式会社
Priority to CN202080057655.6A priority Critical patent/CN114270818A/en
Publication of WO2021054037A1 publication Critical patent/WO2021054037A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present invention relates to an image decoding device, an image decoding method, and a program.
  • Non-Patent Document 1 An image coding method using intra-prediction or inter-prediction, conversion / quantization of a prediction residual signal, and entropy coding has been proposed (see, for example, Non-Patent Document 1).
  • the coding unit in both equations is configured to be recursively divided using quadtrees, binary trees and ternary trees.
  • the same division pattern may be selected between the luminance component and the color difference component (single tree), or different division patterns may be selected (dual tree).
  • the color difference intra prediction method includes CCLM (linear prediction between components) that linearly predicts the color difference component from the reconstructed brightness component in addition to the intra-color component prediction method similar to the brightness intra prediction method.
  • CCLM linear prediction between components
  • Non-Patent Document 2 has a combined color difference coding method for combining two color difference components into one as a method for encoding the color difference component.
  • Non-Patent Document 1 discloses an inter-component residual signal prediction method for predicting a color difference residual signal from a luminance prediction residual signal.
  • the inter-component residual signal prediction method is a method in which a value obtained by multiplying the inversely converted luminance residual signal by a coefficient is added to the inversely converted color difference residual signal.
  • the inter-component residual signal prediction method is used only when the color format is 4: 4: 4, that is, the number of pixels between components is the same. It is valid only when. Further, in the inter-component residual signal prediction method, the absolute value of the coefficient including the presence or absence of application and the code of the coefficient are sent for each conversion unit.
  • VVC which is a next-generation moving image coding method
  • HEVC High Efficiency Video Coding
  • the present invention has been made in view of the above-mentioned problems, and in the application of the inter-component residual signal prediction method, an image decoding device and an image capable of suppressing an increase in side information and improving coding performance. It is an object of the present invention to provide a decoding method and a program.
  • the first feature of the present invention is an image decoding device, which is a unit structure decoding configured to decode coded data and acquire brightness coding unit division information and color difference coding unit division information.
  • a unit and a determination unit configured to determine whether or not the inter-component residual signal prediction method can be applied based on the brightness coding unit division information and the color difference coding unit division information. It is a gist to include a prediction method coefficient decoding unit configured to decode the coefficient and whether or not the inter-component residual signal prediction method is applied according to the determination result.
  • the second feature of the present invention is an image decoding method, in which a step of decoding coded data to obtain brightness coding unit division information and color difference coding unit division information, and the brightness coding unit division.
  • the gist is to have a step of decoding the coefficient and whether or not the above is applied.
  • a third feature of the present invention is a program that causes a computer to function as an image decoding device, in which the image decoding device decodes coded data to obtain brightness coding unit division information and color difference coding unit division information. Whether or not the inter-component residual signal prediction method can be applied based on the unit structure decoding unit configured to acquire the above, the brightness coding unit division information, and the color difference coding unit division information.
  • a determination unit configured to determine whether or not the information is applied, and a prediction method coefficient decoding unit configured to decode the presence / absence of the application of the inter-component residual signal prediction method and the coefficient according to the determination result. The gist is to prepare.
  • the present invention in applying the inter-component residual signal prediction method, it is possible to provide an image decoding device, an image decoding method and a program capable of suppressing an increase in side information and improving coding performance.
  • FIG. 1 is a diagram showing an example of a functional block of the image processing system 1 according to the first embodiment of the present invention.
  • the image processing system 1 includes an image coding device 100 that encodes a moving image and generates coded data, and an image decoding device 200 that decodes the coded data generated by the image coding device 100.
  • the above-mentioned coded data is transmitted and received between the image coding device 100 and the image decoding device 200, for example, via a transmission line.
  • FIG. 2 is a diagram showing an example of a functional block of the image coding device 100.
  • the image coding device 100 includes an inter-prediction unit 101, an intra-prediction unit 102, a conversion / quantization unit 103, an entropy coding unit 104, and an inverse conversion / inverse quantization unit 105.
  • the unit division unit 110 is configured to divide the entire screen of the input image into the same square and output an image (divided image) recursively divided by a quadtree or the like.
  • the inter-prediction unit 101 performs inter-prediction using the divided image input by the unit division unit 110 and the filtered local decoding image (described later) input from the frame buffer 109, generates an inter-prediction image, and outputs the inter-prediction image. It is configured as follows.
  • the intra prediction unit 102 performs intra prediction and generates an intra prediction image by using the divided image input by the unit dividing unit 110, the locally decoded image before the filter, and the color difference intra prediction method determined by the control unit (not shown). Is configured to output.
  • the conversion / quantization unit 103 performs an orthogonal conversion process on the residual signal input from the subtraction unit 106, performs a quantization process on the conversion coefficient obtained by the orthogonal conversion process, and performs the quantization process. It is configured to output the resulting quantized level value.
  • the entropy encoding unit 104 includes quantized level values and side information (determined by a control unit (not shown), which is necessary for reconstructing pixel values, such as a prediction mode and a motion vector, which are input from the conversion / quantization unit 103. (Related information) is entropy-encoded and output as encoded data.
  • the inverse conversion / inverse quantization unit 105 performs an inverse quantization process on the quantized level value input from the conversion / quantization unit 103, and with respect to the conversion coefficient obtained by the inverse quantization process. It is configured to perform the inverse orthogonal conversion process and output the inverse orthogonal converted residual signal obtained by the inverse orthogonal conversion process.
  • the subtraction unit 106 is configured to output a residual signal which is a difference between the divided image input by the unit division unit 110 and the intra prediction image or the inter prediction image.
  • the addition unit 107 is configured to output a divided image obtained by adding the inverse orthogonally converted residual signal input from the inverse conversion / inverse quantization unit 105 to the intra-prediction image or the inter-prediction image. There is.
  • the unit integration unit 111 is configured to output a pre-filter locally decoded image obtained by integrating the divided images input from the addition unit 107.
  • the in-loop filter unit 108 applies in-loop filter processing such as deblocking filter processing to the pre-filter local decoding image input from the unit integration unit 111 to generate and output the post-filter local decoding image. It is configured in.
  • the frame buffer 109 accumulates the filtered locally decoded image and appropriately supplies it to the inter-prediction unit 101 as the filtered locally decoded image.
  • FIG. 3 is a diagram showing an example of a part of the functional blocks of the entropy coding unit 104 of the image coding device 100 according to the present embodiment.
  • the entropy coding unit 104 of the image coding device 100 includes a determination unit 104A and a prediction method coefficient coding unit 104B.
  • the determination unit 104A is configured to input the luminance coding unit division information and the color difference coding unit division information, determine whether or not the inter-component residual signal prediction method can be applied, and output the determination result. There is.
  • the prediction method coefficient coding unit 104B inputs such a determination result and a coefficient (inter-component residual signal prediction coefficient) determined by a control unit (not shown), and based on the determination result, an inter-component residual signal prediction method. Is applied or not, the absolute value of the coefficient and the coding of the coefficient are encoded, and the encoded data is output.
  • FIG. 4 is a block diagram of the image decoding device 200 according to the present embodiment.
  • the image decoding apparatus 200 includes an entropy decoding unit 201, an inverse conversion / inverse quantization unit 202, an inter prediction unit 203, an intra prediction unit 204, and an addition unit 205.
  • the in-loop filter unit 206, the frame buffer 207, and the unit integration unit 208 are provided.
  • the entropy decoding unit 201 is configured to entropy decode the encoded data and output the quantized level value and side information.
  • the inverse conversion / inverse quantization unit 202 performs an inverse quantization process on the quantized level value input from the entropy decoding unit 201, and an inverse orthogonal conversion on the result obtained by the inverse quantization process. It is configured to perform processing and output as a residual signal.
  • the inter-prediction unit 203 is configured to perform inter-prediction using the filtered locally decoded image input from the frame buffer 207 to generate and output the inter-prediction image.
  • the intra prediction unit 204 is configured to perform intra prediction using the pre-filter locally decoded image input from the addition unit 205 to generate and output an intra prediction image.
  • the pre-filter locally decoded image is a signal obtained by adding the residual signal and the predicted image
  • the addition unit 205 is the residual signal and the predicted image (remaining signal) input from the inverse conversion / inverse quantization unit 202. It is configured to output a divided image obtained by adding an inter prediction image input from the inter prediction unit 203 or an intra prediction image input from the intra prediction unit 204).
  • the prediction image is a prediction image calculated by a prediction method obtained by entropy decoding among the inter prediction image input from the inter prediction unit 203 and the intra prediction image input from the intra prediction unit 204. Is.
  • the unit integration unit 208 is configured to output a pre-filter locally decoded image obtained by integrating the divided images input from the addition unit 205.
  • the in-loop filter unit 206 applies in-loop filter processing such as deunit filter processing to the pre-filter local decoding image input from the unit integration unit 208 to generate and output the post-filter local decoding image. It is configured.
  • the frame buffer 207 is configured to accumulate the filtered locally decoded image input from the in-loop filter 206, appropriately supply it to the inter-prediction unit 203 as a filtered locally decoded image, and output it as a decoded image. There is.
  • FIG. 5 is a diagram showing an example of a part of the functional blocks of the entropy decoding unit 201 of the image decoding apparatus 200 according to the present embodiment.
  • the entropy decoding unit 201 of the image decoding device 200 includes a unit structure decoding unit 201A, a determination unit 201B, and a prediction method coefficient decoding unit 201C.
  • the unit structure decoding unit 201A is configured to decode the coded data output by the image coding device 100 to acquire the unit structure including the luminance coding unit division information and the color difference coding unit division information. ..
  • the determination unit 201B is configured to determine whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information.
  • the prediction method coefficient decoding unit 201C inputs the determination result and the coded data, and based on the determination result, whether or not the inter-component residual signal prediction method is applied and the coefficient (absolute value of the coefficient and the code of the coefficient). Is configured to output.
  • step S101 the entropy decoding unit 201 decodes the coded data to acquire the luminance coding unit division information and the color difference coding unit division information.
  • step S102 the entropy decoding unit 201 determines whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information.
  • step S103 the entropy decoding unit 201 decodes whether or not the inter-component residual signal prediction method is applied and the coefficient (absolute value of the coefficient and the code of the coefficient) according to the determination result.
  • the image processing system 1 in the application of the inter-component residual signal prediction method, it is possible to suppress an increase in side information and improve the coding performance.
  • the determination unit 201B is configured to determine whether or not the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match. Has been done.
  • the determination unit 201B is configured to determine that the inter-component residual signal prediction method can be applied when it is determined that the two match.
  • the determination unit 201B is configured to determine that the inter-component residual signal prediction method cannot be applied when it is determined that the two do not match.
  • the determination unit 201B inputs the luminance coding unit division information and the color difference coding unit division information determined by the control unit (not shown), and the luminance conversion unit and the luminance conversion having the same position and the same size between the components. It is configured to determine that the inter-component residual signal prediction scheme can be applied when the unit is present.
  • the determination unit 201B inputs the luminance coding unit division information and the color difference coding unit division information determined by the control unit (not shown), and the luminance conversion unit and the luminance conversion unit having the same position and the same size between the components. Is configured to determine that the inter-component residual signal prediction method cannot be applied when is absent.
  • the image processing system 2 it is possible to simplify the determination condition and reduce the mounting complexity in the determination as to whether or not the inter-component residual signal prediction method can be applied.
  • the determination unit 201B is configured to determine that the inter-component residual signal prediction method can be applied when the tree type determined by the control unit (not shown) is a single tree. ..
  • it may be configured to determine that the inter-component residual signal prediction method can be applied only when the predicted residual signal of the luminance conversion unit exists.
  • the determination unit 201B is configured to determine that the inter-component residual signal prediction method cannot be applied when the tree type determined by the control unit (not shown) is a dual tree.
  • the prediction mode determined by the control unit is inter-prediction, it may be determined that the tree type is a single tree.
  • the image processing system 3 it is possible to simplify the determination condition and reduce the mounting complexity in the determination as to whether or not the inter-component residual signal prediction method can be applied.
  • the determination unit 201B performs the color difference conversion when the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match.
  • the coding method determined in the unit is non-coupling color difference coding, it may be configured to determine that the inter-component residual signal prediction method can be applied.
  • the determination unit 201B determines when the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match, and the color difference conversion unit determines.
  • the encoded method is coupled color difference coding, it may be configured to determine that the inter-component residual signal prediction method cannot be applied.
  • the fixed portion 201B is determined by the color difference conversion unit. It may be configured to determine that the inter-component residual signal prediction method cannot be applied regardless of the coding method.
  • the determination unit 201B is used when the tree type determined by the control unit (not shown) is a single tree and the coding method determined by the color difference conversion unit is non-coupling color difference coding. It may be configured to determine that the residual signal prediction method can be applied.
  • the determination unit 201B retains between components when the tree type determined by the control unit (not shown) is a single tree and the coding method determined by the color difference conversion unit is combined color difference coding. It may be configured to determine that the difference signal prediction method cannot be applied.
  • the determination unit 201B applies the inter-component residual signal prediction method regardless of the coding method determined by the color difference conversion unit. It may be configured to determine that it cannot be done.
  • FIG. 7 shows a syntax table showing an example of the operation of the entropy decoding unit 201 of the image decoding apparatus 200 according to the present embodiment.
  • transform_unit (x0, y0, tbWith, tbHigh.treeType, subTuIndex, chType) indicates a conversion unit.
  • x0 indicates the horizontal position of the conversion unit from the origin
  • y0 indicates the vertical position of the conversion unit from the origin
  • tbWith indicates the width of the conversion unit.
  • tbHigh indicates the height of the conversion unit
  • treeType indicates the tree type (single tree or dual tree)
  • subTuIndex indicates the minor conversion unit number
  • chType indicates the color. Indicates the component number.
  • sps_joint_cbcr_enable_flag indicates whether or not the combined color difference coding in the sequence is applicable
  • tu_kbf_cc [x0] [y0] indicates whether or not a residual signal of the Cb color difference component of the conversion unit exists
  • tu_cbf_cr [x0] [y0] indicates the Cr color difference component of the conversion unit. Indicates whether the residual signal of is present.
  • tu_cbf_luma [x0] [y0] indicates whether there is a residual signal of the luminance component of the conversion unit.
  • the image processing system 4 in the application of the inter-component residual signal prediction method, it is possible to suppress an increase in side information when the combined color difference coding method is applied and improve the coding performance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

An image decoding device 200 comprises: a unit structure decoding unit 201A configured to decode encoded data to acquire brightness coding unit segmentation information and color difference coding unit segmentation information; a determination unit 201B configured to determine, on the basis of the brightness coding unit segmentation information and the color difference coding unit segmentation information, whether an inter-component residual signal prediction system can be applied; and a prediction system coefficient decoding unit 201C configured to, in accordance with the determination results, decode whether the inter-component residual signal prediction system was applied, and decode a coefficient thereof.

Description

画像復号装置、画像復号方法及びプログラムImage decoding device, image decoding method and program
 本発明は、画像復号装置、画像復号方法及びプログラムに関する。 The present invention relates to an image decoding device, an image decoding method, and a program.
 従来、イントラ予測又はインター予測、予測残差信号の変換・量子化、エントロピー符号化を用いた画像符号化方式が提案されている(例えば、非特許文献1参照)。 Conventionally, an image coding method using intra-prediction or inter-prediction, conversion / quantization of a prediction residual signal, and entropy coding has been proposed (see, for example, Non-Patent Document 1).
 以下、次世代動画像符号化方式であるVVC(Versatile Video Coding)における符号化ユニットの分割方式及びイントラ予測のうちの色差イントラ予測方式について述べる(非特許文献2参照)。 Hereinafter, the color difference intra-prediction method among the coding unit division method and the intra-prediction in VVC (Versatile Video Coding), which is the next-generation video coding method, will be described (see Non-Patent Document 2).
 図8に示すように、両方式における符号化ユニットは、四分木、二分木及び三分木を用いて再帰的に分割されるように構成されている。ここで、輝度成分と色差成分との間で、同一の分割パターンを選択してもよいし(シングルツリー)、異なる分割パターンを選択してもよい(デュアルツリー)。 As shown in FIG. 8, the coding unit in both equations is configured to be recursively divided using quadtrees, binary trees and ternary trees. Here, the same division pattern may be selected between the luminance component and the color difference component (single tree), or different division patterns may be selected (dual tree).
 非特許文献2に示すように、色差イントラ予測方式には、輝度イントラ予測方式と同様の色成分内予測方式の他に、再構成した輝度成分から色差成分を線形予測するCCLM(成分間線形予測:Cross-Component Linear Model)方式がある。 As shown in Non-Patent Document 2, the color difference intra prediction method includes CCLM (linear prediction between components) that linearly predicts the color difference component from the reconstructed brightness component in addition to the intra-color component prediction method similar to the brightness intra prediction method. : There is a Cross-Component Linear Model) method.
 また、非特許文献2には、色差成分を符号化する方式として、2つの色差成分を1つにまとめる結合色差符号化方式がある。 Further, Non-Patent Document 2 has a combined color difference coding method for combining two color difference components into one as a method for encoding the color difference component.
 さらに、非特許文献1には、輝度予測残差信号から色差残差信号を予測する成分間残差信号予測方式が開示されている。かかる成分間残差信号予測方式は、逆変換した輝度残差信号に係数を掛けた値を、逆変換した色差残差信号に加算する方式である。 Further, Non-Patent Document 1 discloses an inter-component residual signal prediction method for predicting a color difference residual signal from a luminance prediction residual signal. The inter-component residual signal prediction method is a method in which a value obtained by multiplying the inversely converted luminance residual signal by a coefficient is added to the inversely converted color difference residual signal.
 ただし、処理の簡素化を実現するため、非特許文献1では、かかる成分間残差信号予測方式は、色形式が4:4:4である場合にのみ、すなわち、成分間の画素数が同一である場合にのみ有効である。また、かかる成分間残差信号予測方式では、変換ユニットごとに、適用の有無を含む係数の絶対値や係数の符号が、それぞれ送られる。 However, in order to realize simplification of processing, in Non-Patent Document 1, the inter-component residual signal prediction method is used only when the color format is 4: 4: 4, that is, the number of pixels between components is the same. It is valid only when. Further, in the inter-component residual signal prediction method, the absolute value of the coefficient including the presence or absence of application and the code of the coefficient are sent for each conversion unit.
 しかしながら、次世代動画像符号化方式であるVVCでは、符号化ユニット分割が、最新動画像符号化方式HEVC(High Efficiency Video Coding)よりも拡張されているため、従来技術では、色差変換ユニットごとに、成分間残差信号予測方式の適用の有無を送ることにより、符号化性能が低下してしまうという問題点があった。 However, in VVC, which is a next-generation moving image coding method, the coding unit division is expanded as compared with the latest moving image coding method HEVC (High Efficiency Video Coding). Therefore, in the prior art, each color difference conversion unit is used. , There is a problem that the coding performance is deteriorated by sending whether or not the residual signal prediction method between components is applied.
 具体的には、従来技術では、輝度成分と色差成分とで異なる分割形式が適用されており、成分間残差信号予測方式が適用できない場合等について考慮されていない。 Specifically, in the prior art, different division formats are applied for the luminance component and the color difference component, and the case where the inter-component residual signal prediction method cannot be applied is not considered.
 そこで、本発明は、上述の課題に鑑みてなされたものであり、成分間残差信号予測方式の適用において、サイド情報の増加を抑えて符号化性能を改善することができる画像復号装置、画像復号方法及びプログラムを提供することを目的とする。 Therefore, the present invention has been made in view of the above-mentioned problems, and in the application of the inter-component residual signal prediction method, an image decoding device and an image capable of suppressing an increase in side information and improving coding performance. It is an object of the present invention to provide a decoding method and a program.
 本発明の第1の特徴は、画像復号装置であって、符号化データを復号して、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを取得するように構成されているユニット構造復号部と、前記輝度符号化ユニット分割情報及び前記色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定するように構成されている判定部と、前記判定結果に応じて、前記成分間残差信号予測方式の適用の有無及び係数を復号するように構成されている予測方式係数復号部とを備えることを要旨とする。 The first feature of the present invention is an image decoding device, which is a unit structure decoding configured to decode coded data and acquire brightness coding unit division information and color difference coding unit division information. A unit and a determination unit configured to determine whether or not the inter-component residual signal prediction method can be applied based on the brightness coding unit division information and the color difference coding unit division information. It is a gist to include a prediction method coefficient decoding unit configured to decode the coefficient and whether or not the inter-component residual signal prediction method is applied according to the determination result.
 本発明の第2の特徴は、画像復号方法であって、符号化データを復号して、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを取得する工程と、前記輝度符号化ユニット分割情報及び前記色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定する工程と、前記判定結果に応じて、前記成分間残差信号予測方式の適用の有無及び係数を復号する工程とを有することを要旨とする。 The second feature of the present invention is an image decoding method, in which a step of decoding coded data to obtain brightness coding unit division information and color difference coding unit division information, and the brightness coding unit division. A step of determining whether or not the inter-component residual signal prediction method can be applied based on the information and the color difference coding unit division information, and the inter-component residual signal prediction method according to the determination result. The gist is to have a step of decoding the coefficient and whether or not the above is applied.
 本発明の第3の特徴は、コンピュータを、画像復号装置として機能させるプログラムであって、前記画像復号装置は、符号化データを復号して、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを取得するように構成されているユニット構造復号部と、前記輝度符号化ユニット分割情報及び前記色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定するように構成されている判定部と、前記判定結果に応じて、前記成分間残差信号予測方式の適用の有無及び係数を復号するように構成されている予測方式係数復号部とを備えることを要旨とする。 A third feature of the present invention is a program that causes a computer to function as an image decoding device, in which the image decoding device decodes coded data to obtain brightness coding unit division information and color difference coding unit division information. Whether or not the inter-component residual signal prediction method can be applied based on the unit structure decoding unit configured to acquire the above, the brightness coding unit division information, and the color difference coding unit division information. A determination unit configured to determine whether or not the information is applied, and a prediction method coefficient decoding unit configured to decode the presence / absence of the application of the inter-component residual signal prediction method and the coefficient according to the determination result. The gist is to prepare.
 本発明によれば、成分間残差信号予測方式の適用において、サイド情報の増加を抑えて符号化性能を改善することができる画像復号装置、画像復号方法及びプログラムを提供することができる。 According to the present invention, in applying the inter-component residual signal prediction method, it is possible to provide an image decoding device, an image decoding method and a program capable of suppressing an increase in side information and improving coding performance.
一実施形態に係る画像処理システム1の構成の一例を示す図である。It is a figure which shows an example of the structure of the image processing system 1 which concerns on one Embodiment. 一実施形態に係る画像符号化装置100の機能ブロックの一例を示す図である。It is a figure which shows an example of the functional block of the image coding apparatus 100 which concerns on one Embodiment. 一実施形態に係る画像符号化装置100のエントロピー符号化部104の一部の機能ブロックの一例を示す図である。It is a figure which shows an example of a part of the functional blocks of the entropy coding part 104 of the image coding apparatus 100 which concerns on one Embodiment. 一実施形態に係る画像復号装置200の機能ブロックの一例を示す図である。It is a figure which shows an example of the functional block of the image decoding apparatus 200 which concerns on one Embodiment. 一実施形態に係る画像復号装置200のエントロピー復号部201の一部の機能ブロックの一例を示す図である。It is a figure which shows an example of a part of the functional blocks of the entropy decoding part 201 of the image decoding apparatus 200 which concerns on one Embodiment. 一実施形態に係る画像復号装置200のエントロピー復号部201の動作の一例を示すフローチャートである。It is a flowchart which shows an example of the operation of the entropy decoding unit 201 of the image decoding apparatus 200 which concerns on one Embodiment. 一実施形態に係る画像復号装置200のエントロピー復号部201の動作の一例を示すシンタックス表である。It is a syntax table which shows an example of the operation of the entropy decoding unit 201 of the image decoding apparatus 200 which concerns on one Embodiment. 従来技術を説明するための図である。It is a figure for demonstrating the prior art.
 以下、本発明の実施の形態について図面を参照しながら、説明する。なお、以下の実施形態における構成要素は適宜、既存の構成要素などとの置き換えが可能であり、また、他の既存の構成要素との組み合わせを含む様々なバリエーションが可能である。したがって、以下の実施形態の記載をもって、特許請求の範囲に記載された発明の内容を限定するものではない。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. The components in the following embodiments can be replaced with existing components as appropriate, and various variations including combinations with other existing components are possible. Therefore, the description of the following embodiments does not limit the content of the invention described in the claims.
(第1実施形態)
 図1は、本発明の第1実施形態に係る画像処理システム1の機能ブロックの一例を示す図である。画像処理システム1は、動画像を符号化して符号化データを生成する画像符号化装置100と、画像符号化装置100により生成された符号化データを復号する画像復号装置200とを備える。画像符号化装置100と画像復号装置200との間では、上述の符号化データが、例えば、伝送路を介して送受信される。
(First Embodiment)
FIG. 1 is a diagram showing an example of a functional block of the image processing system 1 according to the first embodiment of the present invention. The image processing system 1 includes an image coding device 100 that encodes a moving image and generates coded data, and an image decoding device 200 that decodes the coded data generated by the image coding device 100. The above-mentioned coded data is transmitted and received between the image coding device 100 and the image decoding device 200, for example, via a transmission line.
<画像符号化装置100>
 図2は、画像符号化装置100の機能ブロックの一例を示す図である。図2に示すように、画像符号化装置100は、インター予測部101と、イントラ予測部102と、変換・量子化部103と、エントロピー符号化部104と、逆変換・逆量子化部105と、減算部106と、加算部107と、インループフィルタ部108と、フレームバッファ109と、ユニット分割部110と、ユニット統合部111とを備える。
<Image coding device 100>
FIG. 2 is a diagram showing an example of a functional block of the image coding device 100. As shown in FIG. 2, the image coding device 100 includes an inter-prediction unit 101, an intra-prediction unit 102, a conversion / quantization unit 103, an entropy coding unit 104, and an inverse conversion / inverse quantization unit 105. , The subtraction unit 106, the addition unit 107, the in-loop filter unit 108, the frame buffer 109, the unit division unit 110, and the unit integration unit 111.
 ユニット分割部110は、入力画像の画面全体を同一正方形に分割し、更に四分木等により再帰的に分割した画像(分割画像)を出力するように構成されている。 The unit division unit 110 is configured to divide the entire screen of the input image into the same square and output an image (divided image) recursively divided by a quadtree or the like.
 インター予測部101は、ユニット分割部110によって入力された分割画像及びフレームバッファ109から入力されるフィルタ後局所復号画像(後述)を用いて、インター予測を行ってインター予測画像を生成して出力するように構成されている。 The inter-prediction unit 101 performs inter-prediction using the divided image input by the unit division unit 110 and the filtered local decoding image (described later) input from the frame buffer 109, generates an inter-prediction image, and outputs the inter-prediction image. It is configured as follows.
 イントラ予測部102は、ユニット分割部110によって入力された分割画像、フィルタ前局所復号画像及び図示しない制御部により決定された色差イントラ予測方式を用いて、イントラ予測を行ってイントラ予測画像を生成して出力するように構成されている。 The intra prediction unit 102 performs intra prediction and generates an intra prediction image by using the divided image input by the unit dividing unit 110, the locally decoded image before the filter, and the color difference intra prediction method determined by the control unit (not shown). Is configured to output.
 変換・量子化部103は、減算部106から入力される残差信号に対して直交変換処理を行い、かかる直交変換処理により得られる変換係数に対して量子化処理を行い、かかる量子化処理により得られる量子化されたレベル値を出力するように構成されている。 The conversion / quantization unit 103 performs an orthogonal conversion process on the residual signal input from the subtraction unit 106, performs a quantization process on the conversion coefficient obtained by the orthogonal conversion process, and performs the quantization process. It is configured to output the resulting quantized level value.
 エントロピー符号化部104は、変換・量子化部103から入力される量子化されたレベル値及びサイド情報(図示しない制御部により決定された、画素値の再構成に必要な予測モードや動きベクトル等の関連情報)をエントロピー符号化して符号化データとして出力するように構成されている。 The entropy encoding unit 104 includes quantized level values and side information (determined by a control unit (not shown), which is necessary for reconstructing pixel values, such as a prediction mode and a motion vector, which are input from the conversion / quantization unit 103. (Related information) is entropy-encoded and output as encoded data.
 逆変換・逆量子化部105は、変換・量子化部103から入力される量子化されたレベル値に対して逆量子化処理を行い、かかる逆量子化処理により得られた変換係数に対して逆直交変換処理を行い、かかる逆直交変換処理により得られる逆直交変換された残差信号を出力するように構成されている。 The inverse conversion / inverse quantization unit 105 performs an inverse quantization process on the quantized level value input from the conversion / quantization unit 103, and with respect to the conversion coefficient obtained by the inverse quantization process. It is configured to perform the inverse orthogonal conversion process and output the inverse orthogonal converted residual signal obtained by the inverse orthogonal conversion process.
 減算部106は、ユニット分割部110によって入力された分割画像とイントラ予測画像或いはインター予測画像との差分である残差信号を出力するように構成されている。 The subtraction unit 106 is configured to output a residual signal which is a difference between the divided image input by the unit division unit 110 and the intra prediction image or the inter prediction image.
 加算部107は、逆変換・逆量子化部105から入力される逆直交変換された残差信号とイントラ予測画像或いはインター予測画像とを加算して得られる分割画像を出力するように構成されている。 The addition unit 107 is configured to output a divided image obtained by adding the inverse orthogonally converted residual signal input from the inverse conversion / inverse quantization unit 105 to the intra-prediction image or the inter-prediction image. There is.
 ユニット統合部111は、加算部107から入力される分割画像を統合することで得られたフィルタ前局所復号画像を出力するように構成されている。 The unit integration unit 111 is configured to output a pre-filter locally decoded image obtained by integrating the divided images input from the addition unit 107.
 インループフィルタ部108は、ユニット統合部111から入力されるフィルタ前局所復号画像に対して、デブロッキングフィルタ処理等のインループフィルタ処理を適用してフィルタ後局所復号画像を生成して出力するように構成されている。 The in-loop filter unit 108 applies in-loop filter processing such as deblocking filter processing to the pre-filter local decoding image input from the unit integration unit 111 to generate and output the post-filter local decoding image. It is configured in.
 フレームバッファ109は、フィルタ後局所復号画像を蓄積し、適宜、フィルタ後局所復号画像としてインター予測部101に供給する。 The frame buffer 109 accumulates the filtered locally decoded image and appropriately supplies it to the inter-prediction unit 101 as the filtered locally decoded image.
 以下、図3を参照して、本実施形態に係る画像符号化装置100のエントロピー符号化部104について説明する。図3は、本実施形態に係る画像符号化装置100のエントロピー符号化部104の一部の機能ブロックの一例を示す図である。 Hereinafter, the entropy coding unit 104 of the image coding device 100 according to the present embodiment will be described with reference to FIG. FIG. 3 is a diagram showing an example of a part of the functional blocks of the entropy coding unit 104 of the image coding device 100 according to the present embodiment.
 図3に示すように、本実施形態に係る画像符号化装置100のエントロピー符号化部104は、判定部104Aと、予測方式係数符号化部104Bとを備える。 As shown in FIG. 3, the entropy coding unit 104 of the image coding device 100 according to the present embodiment includes a determination unit 104A and a prediction method coefficient coding unit 104B.
 判定部104Aは、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを入力し、成分間残差信号予測方式が適用できるかどうかについて判定し、かかる判定結果を出力するように構成されている。 The determination unit 104A is configured to input the luminance coding unit division information and the color difference coding unit division information, determine whether or not the inter-component residual signal prediction method can be applied, and output the determination result. There is.
 予測方式係数符号化部104Bは、かかる判定結果と図示しない制御部により決定された係数(成分間残差信号予測係数)とを入力し、かかる判定結果に基づいて、成分間残差信号予測方式の適用の有無、係数の絶対値及び係数の符号化を符号化して、符号化データを出力するように構成されている。 The prediction method coefficient coding unit 104B inputs such a determination result and a coefficient (inter-component residual signal prediction coefficient) determined by a control unit (not shown), and based on the determination result, an inter-component residual signal prediction method. Is applied or not, the absolute value of the coefficient and the coding of the coefficient are encoded, and the encoded data is output.
<画像復号装置200>
 図4は、本実施形態に係る画像復号装置200のブロック図である。図3に示すように、本実施形態に係る画像復号装置200は、エントロピー復号部201と、逆変換・逆量子化部202と、インター予測部203と、イントラ予測部204と、加算部205と、インループフィルタ部206と、フレームバッファ207と、ユニット統合部208とを備える。
<Image Decoding Device 200>
FIG. 4 is a block diagram of the image decoding device 200 according to the present embodiment. As shown in FIG. 3, the image decoding apparatus 200 according to the present embodiment includes an entropy decoding unit 201, an inverse conversion / inverse quantization unit 202, an inter prediction unit 203, an intra prediction unit 204, and an addition unit 205. , The in-loop filter unit 206, the frame buffer 207, and the unit integration unit 208 are provided.
 エントロピー復号部201は、符号化データをエントロピー復号し、量子化されたレベル値や、サイド情報を出力するように構成されている。 The entropy decoding unit 201 is configured to entropy decode the encoded data and output the quantized level value and side information.
 逆変換・逆量子化部202は、エントロピー復号部201から入力される量子化されたレベル値に対して逆量子化処理を行い、かかる逆量子化処理により得られた結果に対して逆直交変換処理を行って残差信号として出力するように構成されている。 The inverse conversion / inverse quantization unit 202 performs an inverse quantization process on the quantized level value input from the entropy decoding unit 201, and an inverse orthogonal conversion on the result obtained by the inverse quantization process. It is configured to perform processing and output as a residual signal.
 インター予測部203は、フレームバッファ207から入力されるフィルタ後局所復号画像を用いて、インター予測を行ってインター予測画像を生成して出力するように構成されている。 The inter-prediction unit 203 is configured to perform inter-prediction using the filtered locally decoded image input from the frame buffer 207 to generate and output the inter-prediction image.
 イントラ予測部204は、加算部205から入力されるフィルタ前局所復号画像を用いて、イントラ予測を行ってイントラ予測画像を生成して出力するように構成されている。ここで、フィルタ前局所復号画像とは、残差信号と予測画像とを合算した信号のことである
 加算部205は、逆変換・逆量子化部202から入力される残差信号と予測画像(インター予測部203から入力されるインター予測画像或いはイントラ予測部204から入力されるイントラ予測画像)とを加算して得られる分割画像を出力するように構成されている。
The intra prediction unit 204 is configured to perform intra prediction using the pre-filter locally decoded image input from the addition unit 205 to generate and output an intra prediction image. Here, the pre-filter locally decoded image is a signal obtained by adding the residual signal and the predicted image, and the addition unit 205 is the residual signal and the predicted image (remaining signal) input from the inverse conversion / inverse quantization unit 202. It is configured to output a divided image obtained by adding an inter prediction image input from the inter prediction unit 203 or an intra prediction image input from the intra prediction unit 204).
 ここで、予測画像とは、インター予測部203から入力されるインター予測画像及びイントラ予測部204から入力されるイントラ予測画像のうち、エントロピー復号により得られた予測方法により算出された予測画像のことである。 Here, the prediction image is a prediction image calculated by a prediction method obtained by entropy decoding among the inter prediction image input from the inter prediction unit 203 and the intra prediction image input from the intra prediction unit 204. Is.
 ユニット統合部208は、加算部205から入力される分割画像を統合することで得られたフィルタ前局所復号画像を出力するように構成されている。 The unit integration unit 208 is configured to output a pre-filter locally decoded image obtained by integrating the divided images input from the addition unit 205.
 インループフィルタ部206は、ユニット統合部208から入力されるフィルタ前局所復号画像に対してデユニットフィルタ処理等のインループフィルタ処理を適用してフィルタ後局所復号画像を生成して出力するように構成されている。 The in-loop filter unit 206 applies in-loop filter processing such as deunit filter processing to the pre-filter local decoding image input from the unit integration unit 208 to generate and output the post-filter local decoding image. It is configured.
 フレームバッファ207は、インループフィルタ206から入力されるフィルタ後局所復号画像を蓄積し、適宜、フィルタ後局所復号画像としてインター予測部203に供給するとともに、復号済み画像として出力するように構成されている。 The frame buffer 207 is configured to accumulate the filtered locally decoded image input from the in-loop filter 206, appropriately supply it to the inter-prediction unit 203 as a filtered locally decoded image, and output it as a decoded image. There is.
 以下、図5を参照して、本実施形態に係る画像復号装置200のエントロピー復号部201について説明する。図5は、本実施形態に係る画像復号装置200のエントロピー復号部201の一部の機能ブロックの一例を示す図である。 Hereinafter, the entropy decoding unit 201 of the image decoding apparatus 200 according to the present embodiment will be described with reference to FIG. FIG. 5 is a diagram showing an example of a part of the functional blocks of the entropy decoding unit 201 of the image decoding apparatus 200 according to the present embodiment.
 図5に示すように、本実施形態に係る画像復号装置200のエントロピー復号部201は、ユニット構造復号部201Aと、判定部201Bと、予測方式係数復号部201Cとを備える。 As shown in FIG. 5, the entropy decoding unit 201 of the image decoding device 200 according to the present embodiment includes a unit structure decoding unit 201A, a determination unit 201B, and a prediction method coefficient decoding unit 201C.
 ユニット構造復号部201Aは、画像符号化装置100によって出力された符号化データを復号して、輝度符号化ユニット分割情報及び色差符号化ユニット分割情報を含むユニット構造を取得するように構成されている。 The unit structure decoding unit 201A is configured to decode the coded data output by the image coding device 100 to acquire the unit structure including the luminance coding unit division information and the color difference coding unit division information. ..
 判定部201Bは、輝度符号化ユニット分割情報及び色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定するように構成されている。 The determination unit 201B is configured to determine whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information.
 予測方式係数復号部201Cは、かかる判定結果と符号化データとを入力し、かかる判定結果に基づいて、成分間残差信号予測方式の適用の有無及び係数(係数の絶対値及び係数の符号)を出力するように構成されている。 The prediction method coefficient decoding unit 201C inputs the determination result and the coded data, and based on the determination result, whether or not the inter-component residual signal prediction method is applied and the coefficient (absolute value of the coefficient and the code of the coefficient). Is configured to output.
 以下、図6を参照して、本実施形態に係るエントロピー復号部201の動作の一例について説明する。 Hereinafter, an example of the operation of the entropy decoding unit 201 according to the present embodiment will be described with reference to FIG.
 図6に示すように、ステップS101において、エントロピー復号部201は、符号化データを復号して、輝度符号化ユニット分割情報及び色差符号化ユニット分割情報を取得する。 As shown in FIG. 6, in step S101, the entropy decoding unit 201 decodes the coded data to acquire the luminance coding unit division information and the color difference coding unit division information.
 ステップS102において、エントロピー復号部201は、輝度符号化ユニット分割情報及び色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定する。 In step S102, the entropy decoding unit 201 determines whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information.
 ステップS103において、エントロピー復号部201は、かかる判定結果に応じて、成分間残差信号予測方式の適用の有無及び係数(係数の絶対値及び係数の符号)を復号する。 In step S103, the entropy decoding unit 201 decodes whether or not the inter-component residual signal prediction method is applied and the coefficient (absolute value of the coefficient and the code of the coefficient) according to the determination result.
 本実施形態に係る画像処理システム1によれば、成分間残差信号予測方式の適用において、サイド情報の増加を抑えて符号化性能を改善することができる。 According to the image processing system 1 according to the present embodiment, in the application of the inter-component residual signal prediction method, it is possible to suppress an increase in side information and improve the coding performance.
(第2実施形態)
 以下、本発明の第2実施形態に係る画像処理システム1について、上述の第1実施形態に係る画像処理システム1との相違点に着目して説明する。
(Second Embodiment)
Hereinafter, the image processing system 1 according to the second embodiment of the present invention will be described focusing on the differences from the image processing system 1 according to the first embodiment described above.
 本実施形態において、判定部201Bは、色差変換ユニットの位置及び大きさと、かかる色差変換ユニットに対応する輝度成分における輝度変換ユニットの位置及び大きさとが一致しているか否かについて判定するように構成されている。 In the present embodiment, the determination unit 201B is configured to determine whether or not the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match. Has been done.
 ここで、判定部201Bは、両者が一致していると判定した場合、成分間残差信号予測方式を適用することができると判定するように構成されている。 Here, the determination unit 201B is configured to determine that the inter-component residual signal prediction method can be applied when it is determined that the two match.
 一方、判定部201Bは、両者が一致していないと判定した場合、成分間残差信号予測方式を適用することができないと判定するように構成されている。 On the other hand, the determination unit 201B is configured to determine that the inter-component residual signal prediction method cannot be applied when it is determined that the two do not match.
 換言すると、判定部201Bは、図示しない制御部により決定された輝度符号化ユニット分割情報と色差符号化ユニット分割情報を入力し、色差変換ユニットと、成分間で同一位置かつ同一サイズである輝度変換ユニットが存在する場合に、成分間残差信号予測方式を適用することができると判定するように構成されている。 In other words, the determination unit 201B inputs the luminance coding unit division information and the color difference coding unit division information determined by the control unit (not shown), and the luminance conversion unit and the luminance conversion having the same position and the same size between the components. It is configured to determine that the inter-component residual signal prediction scheme can be applied when the unit is present.
 一方、判定部201Bは、図示しない制御部により決定された輝度符号化ユニット分割情報と色差符号化ユニット分割情報を入力し、色差変換ユニットと、成分間で同一位置かつ同一サイズである輝度変換ユニットが存在しない場合に、成分間残差信号予測方式を適用することができないと判定するように構成されている。 On the other hand, the determination unit 201B inputs the luminance coding unit division information and the color difference coding unit division information determined by the control unit (not shown), and the luminance conversion unit and the luminance conversion unit having the same position and the same size between the components. Is configured to determine that the inter-component residual signal prediction method cannot be applied when is absent.
 本実施形態に係る画像処理システム2によれば、成分間残差信号予測方式を適用することができるか否かについて判定において、判定条件を簡素化して実装複雑度を低減することができる。 According to the image processing system 2 according to the present embodiment, it is possible to simplify the determination condition and reduce the mounting complexity in the determination as to whether or not the inter-component residual signal prediction method can be applied.
(第3実施形態)
 以下、本発明の第3実施形態に係る画像処理システム1について、上述の第1実施形態及び第2実施形態に係る画像処理システム1との相違点に着目して説明する。
(Third Embodiment)
Hereinafter, the image processing system 1 according to the third embodiment of the present invention will be described focusing on the differences from the image processing system 1 according to the first embodiment and the second embodiment described above.
 本実施形態において、判定部201Bは、図示しない制御部により決定されたツリー種別がシングルツリーである場合に、成分間残差信号予測方式を適用することができると判定するように構成されている。 In the present embodiment, the determination unit 201B is configured to determine that the inter-component residual signal prediction method can be applied when the tree type determined by the control unit (not shown) is a single tree. ..
 ここで、輝度変換ユニットの予測残差信号が存在する場合にのみ、成分間残差信号予測方式を適用することができると判定するように構成されていてもよい。 Here, it may be configured to determine that the inter-component residual signal prediction method can be applied only when the predicted residual signal of the luminance conversion unit exists.
 一方、判定部201Bは、図示しない制御部により決定されたツリー種別がデュアルツリーである場合に、成分間残差信号予測方式を適用することができないと判定するように構成されている。 On the other hand, the determination unit 201B is configured to determine that the inter-component residual signal prediction method cannot be applied when the tree type determined by the control unit (not shown) is a dual tree.
 なお、図示しない制御部により決定された予測モードがインター予測である場合に、ツリー種別がシングルツリーであると判定してもよい。 Note that if the prediction mode determined by the control unit (not shown) is inter-prediction, it may be determined that the tree type is a single tree.
 本実施形態に係る画像処理システム3によれば、成分間残差信号予測方式を適用することができるか否かについて判定において、判定条件を簡素化して実装複雑度を低減することができる。 According to the image processing system 3 according to the present embodiment, it is possible to simplify the determination condition and reduce the mounting complexity in the determination as to whether or not the inter-component residual signal prediction method can be applied.
(第4実施形態)
 以下、図7を参照して、本発明の第4実施形態に係る画像処理システム1について、上述の第3実施形態に係る画像処理システム1との相違点に着目して説明する。
(Fourth Embodiment)
Hereinafter, the image processing system 1 according to the fourth embodiment of the present invention will be described with reference to FIG. 7, focusing on the differences from the image processing system 1 according to the third embodiment described above.
 本実施形態において、判定部201Bは、色差変換ユニットの位置及び大きさと、かかる色差変換ユニットに対応する輝度成分における輝度変換ユニットの位置及び大きさとが一致している場合で、且つ、かかる色差変換ユニットにおいて決定された符号化方式が非結合色差符号化である場合に、成分間残差信号予測方式を適用することができると判定するように構成されていてもよい。 In the present embodiment, the determination unit 201B performs the color difference conversion when the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match. When the coding method determined in the unit is non-coupling color difference coding, it may be configured to determine that the inter-component residual signal prediction method can be applied.
 一方、判定部201Bは、色差変換ユニットの位置及び大きさと、かかる色差変換ユニットに対応する輝度成分における輝度変換ユニットの位置及び大きさとが一致している場合で、且つ、かかる色差変換ユニットにおいて決定された符号化方式が結合色差符号化である場合に、成分間残差信号予測方式を適用することができないと判定するように構成されていてもよい。 On the other hand, the determination unit 201B determines when the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match, and the color difference conversion unit determines. When the encoded method is coupled color difference coding, it may be configured to determine that the inter-component residual signal prediction method cannot be applied.
 なお、定部201Bは、色差変換ユニットの位置及び大きさと、かかる色差変換ユニットに対応する輝度成分における輝度変換ユニットの位置及び大きさとが一致していない場合には、かかる色差変換ユニットにおいて決定された符号化方式によらず、成分間残差信号予測方式を適用することができないと判定するように構成されていてもよい。 If the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit do not match, the fixed portion 201B is determined by the color difference conversion unit. It may be configured to determine that the inter-component residual signal prediction method cannot be applied regardless of the coding method.
 また、判定部201Bは、図示しない制御部により決定されたツリー種別がシングルツリーである場合で、且つ、色差変換ユニットにおいて決定された符号化方式が非結合色差符号化である場合に、成分間残差信号予測方式を適用することができると判定するように構成されていてもよい。 Further, the determination unit 201B is used when the tree type determined by the control unit (not shown) is a single tree and the coding method determined by the color difference conversion unit is non-coupling color difference coding. It may be configured to determine that the residual signal prediction method can be applied.
 一方、判定部201Bは、図示しない制御部により決定されたツリー種別がシングルツリーである場合で、且つ、色差変換ユニットにおいて決定された符号化方式が結合色差符号化である場合に、成分間残差信号予測方式を適用することができないと判定するように構成されていてもよい。 On the other hand, the determination unit 201B retains between components when the tree type determined by the control unit (not shown) is a single tree and the coding method determined by the color difference conversion unit is combined color difference coding. It may be configured to determine that the difference signal prediction method cannot be applied.
 なお、判定部201Bは、図示しない制御部により決定されたツリー種別がデュアルツリーである場合には、かかる色差変換ユニットにおいて決定された符号化方式によらず、成分間残差信号予測方式を適用することができないと判定するように構成されていてもよい。 When the tree type determined by the control unit (not shown) is dual tree, the determination unit 201B applies the inter-component residual signal prediction method regardless of the coding method determined by the color difference conversion unit. It may be configured to determine that it cannot be done.
 以下、図7に、本実施形態に係る画像復号装置200のエントロピー復号部201の動作の一例を示すシンタックス表を示す。 Hereinafter, FIG. 7 shows a syntax table showing an example of the operation of the entropy decoding unit 201 of the image decoding apparatus 200 according to the present embodiment.
 図7において、「transform_unit(x0,y0,tbWidth,tbHight.treeType,subTuIndex,chType)」は、変換ユニットを示す。 In FIG. 7, "transform_unit (x0, y0, tbWith, tbHigh.treeType, subTuIndex, chType)" indicates a conversion unit.
 ここで、かかる変換ユニットにおいて、「x0」は、原点からの変換ユニットの水平位置を示し、「y0」は、原点からの変換ユニットの垂直位置を示し、「tbWidth」は、変換ユニットの幅を示し、「tbHight」は、変換ユニットの高さを示し、「treeType」は、ツリー種別(シングルツリー又はデュアルツリー)を示し、「subTuIndex」は、小変換ユニット番号を示し、「chType」は、色成分番号を示す。 Here, in such a conversion unit, "x0" indicates the horizontal position of the conversion unit from the origin, "y0" indicates the vertical position of the conversion unit from the origin, and "tbWith" indicates the width of the conversion unit. Shown, "tbHigh" indicates the height of the conversion unit, "treeType" indicates the tree type (single tree or dual tree), "subTuIndex" indicates the minor conversion unit number, and "chType" indicates the color. Indicates the component number.
 また、「sps_joint_cbcr_enabled_flag」は、シーケンスにおける結合色差符号化が適用可能であるかどうかを示し、「CuPredMode[chType][x0][y0]==MODE_INTRA」は、当該変換ユニットに対応する符号化ユニットの予測モードがイントラモードであることを示す。 Further, "sps_joint_cbcr_enable_flag" indicates whether or not the combined color difference coding in the sequence is applicable, and "CuPredModel [chType] [x0] [y0] == MODE_INTRA" indicates the coding unit corresponding to the conversion unit. Indicates that the prediction mode is the intra mode.
 また、「tu_cbf_cb[x0][y0]」は、当該変換ユニットのCb色差成分の残差信号が存在するかどうかを示し、「tu_cbf_cr[x0][y0]」は、当該変換ユニットのCr色差成分の残差信号が存在するかどうかを示す。 Further, "tu_kbf_cc [x0] [y0]" indicates whether or not a residual signal of the Cb color difference component of the conversion unit exists, and "tu_cbf_cr [x0] [y0]" indicates the Cr color difference component of the conversion unit. Indicates whether the residual signal of is present.
 また、「tu_joint_cbcr_residual_flag[x0][y0]」は、当該変換ユニットが結合色差予測方式を適用するかどうかを示す。 Further, "tu_joint_cbcr_residual_flag [x0] [y0]" indicates whether or not the conversion unit applies the combined color difference prediction method.
 また、「ChromaTypeArray==3」は、色形式は4:4:4形式であることを示し、「tu_cbf_luma[x0][y0]」は、当該変換ユニットの輝度成分の残差信号が存在するかどうかを示し、「treeType==SINGLE_TREE」は、ツリー種別がシングルツリーであることを示す。 Further, "ChromaTypeArray == 3" indicates that the color format is 4: 4: 4, and "tu_cbf_luma [x0] [y0]" indicates whether there is a residual signal of the luminance component of the conversion unit. Whether or not, "treeType == SINGLE_TREE" indicates that the tree type is a single tree.
 さらに、「intra_chroma_pred_mode==4」は、色差イントラ予測モードが輝度イントラ予測モードと同一であることを示し、「CuPredMode[chType][x0][y0]==MODE_INTER」は、当該変換ユニットに対応する符号化ユニットの予測モードがインターモードであることを示し、「cross_comp_pred(x0,y0,chType)」は、成分間残差信号予測方式の適用の有無及び係数を符号化することを示す。 Further, "intra_chroma_pred_mode == 4" indicates that the color difference intra prediction mode is the same as the luminance intra prediction mode, and "CuPredMode [chType] [x0] [y0] == MODE_INTER" corresponds to the conversion unit. It indicates that the prediction mode of the coding unit is the intermode, and "cross_comp_pred (x0, y0, chType)" indicates whether or not the inter-component residual signal prediction method is applied and the coefficient is encoded.
 本実施形態に係る画像処理システム4によれば、成分間残差信号予測方式の適用において、結合色差符号化方式適用時のサイド情報の増加を抑えて符号化性能を改善することができる。 According to the image processing system 4 according to the present embodiment, in the application of the inter-component residual signal prediction method, it is possible to suppress an increase in side information when the combined color difference coding method is applied and improve the coding performance.
1…画像処理システム
100…画像符号化装置
101、203…インター予測部
102、204…イントラ予測部
103…変換・量子化部
104…エントロピー符号化部
104A、201B…判定部
104B…予測方式係数符号化部
105、202…逆変換・逆量子化部
106…減算部
107、205…加算部
108、206…インループフィルタ部
109、207…フレームバッファ
110…ユニット分割部
111、208…ユニット統合部
200…画像復号装置
201…エントロピー復号部
201A…ユニット構造復号部
201C…予測方式係数復号部
1 ... Image processing system 100 ... Image coding device 101, 203 ... Inter prediction unit 102, 204 ... Intra prediction unit 103 ... Conversion / quantization unit 104 ... Entropy coding unit 104A, 201B ... Judgment unit 104B ... Prediction method coefficient code Conversion unit 105, 202 ... Inverse conversion / inverse quantization unit 106 ... Subtraction unit 107, 205 ... Addition unit 108, 206 ... In- loop filter unit 109, 207 ... Frame buffer 110 ... Unit division unit 111, 208 ... Unit integration unit 200 ... Image decoding device 201 ... Entropy decoding unit 201A ... Unit structure decoding unit 201C ... Prediction method coefficient decoding unit

Claims (7)

  1.  画像復号装置であって、
     符号化データを復号して、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを取得するように構成されているユニット構造復号部と、
     前記輝度符号化ユニット分割情報及び前記色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定するように構成されている判定部と、
     前記判定結果に応じて、前記成分間残差信号予測方式の適用の有無及び係数を復号するように構成されている予測方式係数復号部とを備えることを特徴とする画像復号装置。
    It is an image decoding device
    A unit structure decoding unit configured to decode the coded data and acquire the luminance coding unit division information and the color difference coding unit division information.
    A determination unit configured to determine whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information.
    An image decoding device comprising a prediction method coefficient decoding unit configured to decode the coefficient and whether or not the inter-component residual signal prediction method is applied according to the determination result.
  2.  前記判定部は、
      色差変換ユニットの位置及び大きさと前記色差変換ユニットに対応する輝度成分における輝度変換ユニットの位置及び大きさとが一致している場合に、前記成分間残差信号予測方式を適用することができると判定するように構成されており、
      前記色差変換ユニットの位置及び大きさと前記色差変換ユニットに対応する前記輝度成分における前記輝度変換ユニットの位置及び大きさとが一致していない場合に、前記成分間残差信号予測方式を適用することができないと判定するように構成されていることを特徴とする請求項1に記載の画像復号装置。
    The determination unit
    When the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match, it is determined that the inter-component residual signal prediction method can be applied. Is configured to
    When the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit do not match, the inter-component residual signal prediction method can be applied. The image decoding apparatus according to claim 1, wherein the image decoding device is configured to determine that the image cannot be obtained.
  3.  前記判定部は、
      ツリー種別がシングルツリーである場合に、前記成分間残差信号予測方式を適用することができると判定するように構成されており、
      前記ツリー種別がデュアルツリーである場合に、前記成分間残差信号予測方式を適用することができないと判定するように構成されていることを特徴とする請求項1に記載の画像復号装置。
    The determination unit
    When the tree type is a single tree, it is configured to determine that the inter-component residual signal prediction method can be applied.
    The image decoding apparatus according to claim 1, wherein when the tree type is a dual tree, it is determined that the inter-component residual signal prediction method cannot be applied.
  4.  前記判定部は、
      色差変換ユニットの位置及び大きさと前記色差変換ユニットに対応する輝度成分における輝度変換ユニットの位置及び大きさとが一致している場合で、且つ、前記色差変換ユニットにおいて決定された符号化方式が非結合色差符号化である場合に、前記成分間残差信号予測方式を適用することができると判定するように構成されており、
      前記色差変換ユニットの位置及び大きさと前記色差変換ユニットに対応する前記輝度成分における前記輝度変換ユニットの位置及び大きさとが一致している場合で、且つ、前記色差変換ユニットにおいて決定された符号化方式が結合色差符号化である場合に、前記成分間残差信号予測方式を適用することができないと判定するように構成されていることを特徴とする請求項1に記載の画像復号装置。
    The determination unit
    When the position and size of the color difference conversion unit and the position and size of the luminance conversion unit in the luminance component corresponding to the color difference conversion unit match, and the coding method determined by the color difference conversion unit is not combined. In the case of color difference coding, it is configured to determine that the inter-component residual signal prediction method can be applied.
    A coding method determined in the case where the position and size of the color difference conversion unit and the position and size of the brightness conversion unit in the luminance component corresponding to the color difference conversion unit match. The image decoding apparatus according to claim 1, wherein is configured to determine that the inter-component residual signal prediction method cannot be applied when is a combined color difference coding.
  5.  前記判定部は、
      ツリー種別がシングルツリーである場合で、且つ、前記色差変換ユニットにおいて決定された符号化方式が非結合色差符号化である場合に、前記成分間残差信号予測方式を適用することができると判定するように構成されており、
      前記ツリー種別がシングルツリーである場合で、且つ、前記色差変換ユニットにおいて決定された符号化方式が結合色差符号化である場合に、前記成分間残差信号予測方式を適用することができないと判定するように構成されていることを特徴とする請求項1に記載の画像復号装置。
    The determination unit
    It is determined that the inter-component residual signal prediction method can be applied when the tree type is a single tree and the coding method determined by the color difference conversion unit is non-coupling color difference coding. Is configured to
    When the tree type is a single tree and the coding method determined by the color difference conversion unit is combined color difference coding, it is determined that the inter-component residual signal prediction method cannot be applied. The image decoding apparatus according to claim 1, wherein the image decoding device is configured to perform the same.
  6.  符号化データを復号して、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを取得する工程と、
     前記輝度符号化ユニット分割情報及び前記色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定する工程と、
     前記判定結果に応じて、前記成分間残差信号予測方式の適用の有無及び係数を復号する工程とを有することを特徴とする画像復号方法。
    The process of decoding the coded data to acquire the luminance coding unit division information and the color difference coding unit division information, and
    A step of determining whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information, and
    An image decoding method comprising: whether or not the inter-component residual signal prediction method is applied and a step of decoding a coefficient according to the determination result.
  7.  コンピュータを、画像復号装置として機能させるプログラムであって、
     前記画像復号装置は、
     符号化データを復号して、輝度符号化ユニット分割情報と色差符号化ユニット分割情報とを取得するように構成されているユニット構造復号部と、
     前記輝度符号化ユニット分割情報及び前記色差符号化ユニット分割情報に基づいて、成分間残差信号予測方式を適用することができるか否かについて判定するように構成されている判定部と、
     前記判定結果に応じて、前記成分間残差信号予測方式の適用の有無及び係数を復号するように構成されている予測方式係数復号部とを備えることを特徴とするプログラム。 
    A program that makes a computer function as an image decoding device.
    The image decoding device is
    A unit structure decoding unit configured to decode the coded data and acquire the luminance coding unit division information and the color difference coding unit division information.
    A determination unit configured to determine whether or not the inter-component residual signal prediction method can be applied based on the luminance coding unit division information and the color difference coding unit division information.
    A program characterized by comprising a prediction method coefficient decoding unit configured to decode the coefficient and whether or not the inter-component residual signal prediction method is applied according to the determination result.
PCT/JP2020/031561 2019-09-19 2020-08-21 Image decoding device, image decoding method, and program WO2021054037A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202080057655.6A CN114270818A (en) 2019-09-19 2020-08-21 Image decoding device, image decoding method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019170787A JP7189854B2 (en) 2019-09-19 2019-09-19 Image decoding device, image decoding method and program
JP2019-170787 2019-09-19

Publications (1)

Publication Number Publication Date
WO2021054037A1 true WO2021054037A1 (en) 2021-03-25

Family

ID=74878817

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/031561 WO2021054037A1 (en) 2019-09-19 2020-08-21 Image decoding device, image decoding method, and program

Country Status (3)

Country Link
JP (1) JP7189854B2 (en)
CN (1) CN114270818A (en)
WO (1) WO2021054037A1 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019069950A1 (en) * 2017-10-06 2019-04-11 シャープ株式会社 Image coding device and image decoding device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8885711B2 (en) * 2009-12-17 2014-11-11 Sk Telecom Co., Ltd. Image encoding/decoding method and device
EP2685718B1 (en) * 2011-03-10 2018-08-29 Sharp Kabushiki Kaisha Image decoding apparatus
GB2503875B (en) * 2012-06-29 2015-06-10 Canon Kk Method and device for encoding or decoding an image
JP5841670B2 (en) * 2012-09-28 2016-01-13 日本電信電話株式会社 Intra-prediction encoding method, intra-prediction decoding method, intra-prediction encoding device, intra-prediction decoding device, their program, and recording medium recording the program
WO2014106878A1 (en) * 2013-01-07 2014-07-10 日本電気株式会社 Video encoding device, video decoding device, video encoding method, video decoding method, and program
KR102167350B1 (en) * 2013-07-22 2020-10-19 르네사스 일렉트로닉스 가부시키가이샤 Moving image encoding apparatus and operation method thereof
JP2015050738A (en) * 2013-09-04 2015-03-16 ソニー株式会社 Decoder and decoding method, encoder and encoding method
US10397607B2 (en) * 2013-11-01 2019-08-27 Qualcomm Incorporated Color residual prediction for video coding
JP2019525577A (en) * 2016-07-18 2019-09-05 エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute Image encoding / decoding method, apparatus, and recording medium storing bitstream
US10638126B2 (en) * 2017-05-05 2020-04-28 Qualcomm Incorporated Intra reference filter for video coding
KR20190083959A (en) * 2018-01-05 2019-07-15 에스케이텔레콤 주식회사 Method for partitioning chroma block and apparatus using the same
KR101997604B1 (en) * 2019-01-22 2019-07-08 에스케이 텔레콤주식회사 Method and Apparatus for Video Encoding/Decoding
JP6743225B2 (en) * 2019-03-20 2020-08-19 キヤノン株式会社 Image decoding apparatus, image decoding method and program

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019069950A1 (en) * 2017-10-06 2019-04-11 シャープ株式会社 Image coding device and image decoding device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HELMRICH, CHRISTIAN ET AL.: "CE7-related: Alternative configuration of CE7-2.2 joint chroma residual coding", JOINT VIDEO EXPERTS TEAM [JVET-00935-V1] (VERSION 1), 2 July 2019 (2019-07-02), XP030207785 *

Also Published As

Publication number Publication date
JP7189854B2 (en) 2022-12-14
JP2021048531A (en) 2021-03-25
CN114270818A (en) 2022-04-01

Similar Documents

Publication Publication Date Title
US11539956B2 (en) Robust encoding/decoding of escape-coded pixels in palette mode
KR102165340B1 (en) Methods of determination for chroma quantization parameter and apparatuses for using the same
CN107211151B (en) Cross-component predictive clipping and adaptive color transform for video coding
US11438590B2 (en) Methods and apparatuses of chroma quantization parameter derivation in video processing system
US20150245021A1 (en) Intra-prediction encoding method, intra-prediction decoding method, intra-prediction encoding apparatus, intra-prediction decoding apparatus, program therefor and recording medium having program recorded thereon
KR20160070771A (en) Features of base color index map mode for video and image coding and decoding
WO2021170036A1 (en) Methods and apparatuses of loop filter parameter signaling in image or video processing system
JP7399928B2 (en) Image decoding device, image decoding method and program
KR20160068288A (en) Video encoding and decoding method using deblocking fitering with transform skip and apparatus using the same
WO2021054037A1 (en) Image decoding device, image decoding method, and program
US20220174302A1 (en) Image decoding device, image decoding method, and program
US20240056585A1 (en) Coding method, encoder, and decoder
WO2021199780A1 (en) Image decoding device, image decoding method, and program
WO2022070470A1 (en) Image decoding device, image decoding method, and program
KR20160059513A (en) Method and apparatus for fast intra coding mode decision for screen contents coding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20864379

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20864379

Country of ref document: EP

Kind code of ref document: A1