WO2021251398A1 - デブロッキングフィルタ装置、復号装置、及びプログラム - Google Patents

デブロッキングフィルタ装置、復号装置、及びプログラム Download PDF

Info

Publication number
WO2021251398A1
WO2021251398A1 PCT/JP2021/021814 JP2021021814W WO2021251398A1 WO 2021251398 A1 WO2021251398 A1 WO 2021251398A1 JP 2021021814 W JP2021021814 W JP 2021021814W WO 2021251398 A1 WO2021251398 A1 WO 2021251398A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
filter
unit
deblocking filter
conversion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/021814
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
俊輔 岩村
慎平 根本
雄一 近藤
和久 井口
敦郎 市ヶ谷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Japan Broadcasting Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Hoso Kyokai NHK, Japan Broadcasting Corp filed Critical Nippon Hoso Kyokai NHK
Priority to CN202180005451.2A priority Critical patent/CN114450964A/zh
Priority to JP2022530590A priority patent/JP7343702B2/ja
Publication of WO2021251398A1 publication Critical patent/WO2021251398A1/ja
Priority to US17/655,948 priority patent/US12212744B2/en
Anticipated expiration legal-status Critical
Priority to JP2023141346A priority patent/JP7695310B2/ja
Priority to US18/987,899 priority patent/US20250119542A1/en
Priority to JP2025094809A priority patent/JP2025124883A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/18—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Definitions

  • the present invention relates to a deblocking filter device, a decoding device, and a program.
  • HEVC High Efficiency Video Coding
  • VVC Very Video Coding
  • Deblocking filter is adopted.
  • the boundary filter strength (boundary filtering strength) of the deblocking filter is controlled according to whether or not a non-zero conversion coefficient exists in at least one of the two adjacent blocks. This is because the energy of the predicted residual is distributed over the entire block due to the inverse transformation of the non-zero transformation coefficient, so that there is a high possibility that a discontinuity will occur at the boundary between the two blocks.
  • the deblocking filter device includes a deblocking filter that filters the boundary between the first reconstruction block and the second reconstruction block adjacent to the first reconstruction block, and the first reconstruction. At least one of the block and the second reconstructed block is encoded using a JCCR (Joint coding of chroma resin) that generates one joint predicted residual from each predicted residual of the Cb color difference component and the Cr color difference component.
  • a filter control unit for controlling the boundary filter strength of the deblocking filter is provided based on whether or not the deblocking filter is used.
  • the decoding device has the deblocking filter device according to the first aspect and the first reconstruction block and the second reconstruction with a flag indicating whether or not the coding is performed using the JCCR.
  • the filter control unit includes an entropy decoding unit that acquires each of the blocks, and the filter control unit is a boundary filter of the deblocking filter based on the flags for each of the first reconstruction block and the second reconstruction block. Control the strength.
  • the program according to the third aspect causes the computer to function as the deblocking filter device according to the first aspect.
  • the color space (RGB space) of the predicted residual is converted to the YCgCo space, and the predicted residual after the color space conversion is converted.
  • -A technique called adaptive color conversion (ACT: Adaptive Color Transfer) that performs coding processing such as entropy coding processing is adopted (see Non-Patent Document 1).
  • the coding device can control whether or not to apply the ACT for each coded block, and outputs the ACT application flag for each coded block as a stream.
  • the decoding device restores the predicted residual by performing entropy decoding / inverse conversion processing, etc. on the block encoded using ACT, and reverses the restored color space (YCgCo space) of the predicted residual to the RGB space. Convert.
  • the decoding device when the decoding device has a non-zero conversion coefficient in at least one of two adjacent blocks, the decoding device applies a deblocking filter to the boundary between the two blocks. On the other hand, if there is no non-zero conversion coefficient in both blocks of two adjacent blocks, it is possible not to apply the deblocking filter to the boundary between the two blocks.
  • the predicted residual is restored from the conversion coefficient by the inverse conversion process, and then the color space of the predicted residual is inversely converted from the YCgCo space to the RGB space by the color space inverse conversion. Therefore, when a non-zero conversion coefficient exists in a block of a certain color component, the non-zero conversion coefficient affects the block of another color component at the time of color space inverse transformation.
  • an object of the present disclosure is to provide a deblocking filter device, a decoding device, and a program that suppress deterioration of image quality.
  • the coding device and the decoding device according to the embodiment will be described with reference to the drawings.
  • the coding device and the decoding device according to the embodiment encode and decode a moving image represented by MPEG, respectively.
  • MPEG moving image represented by MPEG
  • the same or similar parts are designated by the same or similar reference numerals.
  • FIG. 1 is a diagram showing a configuration of a coding device 1 according to the present embodiment.
  • the coding apparatus 1 includes a block dividing unit 100, a residual generation unit 110, a switching unit 111, a color space conversion unit 112, a conversion / quantization unit 120, and an entropy coding unit. It has 130, an inverse quantization / inverse conversion unit 140, a switching unit 143, a color space inverse conversion unit 144, a synthesis unit 150, a deblocking filter 160, a memory 170, and a prediction unit 180.
  • the block division unit 100 divides the original image, which is an input image for each frame (or picture) constituting the moving image, into a plurality of image blocks, and outputs the image block obtained by the division to the residual generation unit 110.
  • the size of the image block is, for example, 32 ⁇ 32 pixels, 16 ⁇ 16 pixels, 8 ⁇ 8 pixels, 4 ⁇ 4 pixels, or the like.
  • the shape of the image block is not limited to a square and may be a rectangle (non-square).
  • the image block is a unit in which the coding device 1 performs a coding process (that is, a block to be coded) and a unit in which the decoding device performs a decoding process (that is, a block to be decoded).
  • Such an image block may be called a CU (Coding Unit).
  • the input image may be an RGB signal and the chroma format may be 4: 4: 4.
  • the RGB space is an example of the first color space.
  • the "R” component corresponds to the first component
  • the "G” component corresponds to the second component
  • the "B” component corresponds to the third component.
  • the block division unit 100 outputs a block by performing block division for each of the R component, the G component, and the B component constituting the image. In the following description of the coding device, when each color component is not distinguished, it is simply referred to as a coded block.
  • the residual generation unit 110 calculates a predicted residual representing a difference (error) between the coded block output by the block dividing unit 100 and the predicted block obtained by predicting the coded block by the prediction unit 180. .. Specifically, the residual generation unit 110 calculates the predicted residual by subtracting each pixel value of the predicted block from each pixel value of the coded block, and outputs the calculated predicted residual to the switching unit 111. do. In the present embodiment, the residual generation unit 110 generates a predicted residual of each color component by the difference between the coded block of each color component and the predicted block of each color component.
  • the switching unit 111 outputs the predicted residual of each color component output by the residual generation unit 110 to either the conversion / quantization unit 120 or the color space conversion unit 112.
  • the switching unit 111 outputs the predicted residual to the conversion / quantization unit 120 when the color space conversion processing (ACT processing) is not performed, and outputs the predicted residual to the color space conversion unit 112 when the ACT processing is performed. ..
  • the color space conversion unit 112 performs ACT processing on the predicted residuals of each color component, and outputs the predicted residuals after the ACT processing to the conversion / quantization unit 120.
  • the color space conversion unit 112 generates a new predicted residual by performing the following conversion calculation on the R component, the G component, and the B component of the predicted residual of the coded block.
  • YCgCo space is an example of a second color space.
  • the switching unit 111 and the color space conversion unit 112 can control whether or not to perform color conversion processing for each coded block.
  • the entropy coding unit 130 signals in the bit stream a flag (ACT application flag) indicating whether or not the color conversion process has been performed on the coded block.
  • the ACT process in the color space conversion unit 112 may generate a predicted residual composed of new color components by addition / subtraction / multiplication / division / shift processing for each color component. Also, the ACT process does not have to be a transformation that affects all color components. For example, the color space conversion unit 112 maintains the first component unchanged, sets the average value of the second component and the third component as the new second component, and sets the difference between the second component and the third component. An ACT process of using a new third component may be applied.
  • the conversion / quantization unit 120 performs conversion processing and quantization processing in block units.
  • the conversion / quantization unit 120 includes a conversion unit 121 and a quantization unit 122.
  • the conversion unit 121 performs conversion processing on the predicted residual (referred to as predicted residual regardless of whether or not the ACT processing is applied) output by the switching unit 111 or the color space conversion unit 112, and calculates the conversion coefficient.
  • the calculated conversion coefficient is output to the quantization unit 122.
  • the conversion unit 121 generates a conversion coefficient for each color component by performing a conversion process on the predicted residual of each color component in block units.
  • the conversion process may be frequency conversion such as DCT, DST, and discrete wavelet conversion. Further, the conversion unit 121 outputs information regarding the conversion process to the entropy coding unit 130.
  • the conversion process includes conversion skip without conversion process, which is adopted in HEVC and VVC standard draft.
  • the conversion coefficient is set by scaling the predicted residual without performing the horizontal and vertical conversion processing, but the conversion skip according to the present embodiment is a conversion to which the conversion processing is applied only to the horizontal. Also includes conversions that apply conversion processing only to vertical and vertical.
  • the conversion unit 121 may perform a secondary conversion process in which the conversion process is further applied to the conversion coefficient obtained by the conversion process. Further, the secondary conversion process may be applied only to a part of the area of the conversion coefficient.
  • the quantization unit 122 quantizes the conversion coefficient output from the conversion unit 121 using the quantization parameter and the scaling list, and outputs the quantized conversion coefficient to the entropy coding unit 130 and the inverse quantization / inverse conversion unit 140. do. Further, the quantization unit 122 outputs information regarding the quantization process (specifically, information on the quantization parameters and the scaling list used in the quantization process) to the entropy coding unit 130 and the inverse quantization unit 141. ..
  • the entropy coding unit 130 performs entropy coding on the quantization conversion coefficient output by the quantization unit 122, performs data compression to generate a bit stream (encoded data), and outputs the bit stream to the decoding side. do.
  • a Huffman code Context-based Adaptive Binary Arithmetic Coding
  • CABAC Context-based Adaptive Binary Arithmetic Coding
  • the entropy coding unit 130 includes information on the conversion process input from the conversion unit 121 in the bitstream and signals it to the decoding side, and includes information on the prediction process input from the prediction unit 180 in the bitstream. Signaling to the decryption side.
  • the entropy coding unit 130 includes a color space conversion flag indicating whether or not ACT is applied in the bit stream for each coded block and signals it to the decoding side.
  • a color space conversion flag is also called an ACT application flag.
  • the ACT application flag When the ACT application flag is on (“1”), it indicates that the ACT is applied to the corresponding coded block.
  • the ACT application flag When the ACT application flag is off (“0”), it indicates that ACT is not applied to the corresponding coded block.
  • the ACT non-applicable flag may be used instead of the ACT application flag. In that case, when the ACT non-application flag is on (“1”), it indicates that ACT is not applied to the corresponding coded block.
  • the ACT non-application flag When the ACT non-application flag is off (“0”), it indicates that ACT is applied to the corresponding coded block.
  • the inverse quantization / inverse transformation unit 140 performs inverse quantization processing and inverse transformation processing in block units.
  • the inverse quantization / inverse transformation unit 140 has an inverse quantization unit 141 and an inverse transformation unit 142.
  • the inverse quantization unit 141 performs an inverse quantization process corresponding to the quantization process performed by the quantization unit 122. Specifically, the inverse quantization unit 141 restores and restores the conversion coefficient by inversely quantizing the quantization conversion coefficient output by the quantization unit 122 using the quantization parameter (Qp) and the scaling list. The converted conversion coefficient is output to the inverse conversion unit 142.
  • the reverse conversion unit 142 performs the reverse conversion process corresponding to the conversion process performed by the conversion unit 121. For example, when the conversion unit 121 performs the discrete cosine transform, the inverse transform unit 142 performs the inverse discrete cosine transform.
  • the inverse transformation unit 142 performs an inverse transformation process on the conversion coefficient output by the inverse quantization unit 141 to restore the predicted residual, and outputs the restored predicted residual, which is the restored predicted residual, to the switching unit 143. ..
  • the switching unit 143 outputs the restoration prediction residual of each color component output by the inverse conversion unit 142 to either the synthesis unit 150 or the color space inverse conversion unit 144.
  • the switching unit 143 outputs the restored predicted residual to the synthesis unit 150 for the block to which the ACT is applied, and outputs the restored predicted residual to the color space inverse conversion unit 144 for the block to which the ACT is not applied.
  • the color space reverse conversion unit 144 performs color space reverse conversion processing (reverse ACT processing), which is the reverse processing of the ACT processing performed by the color space conversion unit 112, and outputs the predicted residual after the reverse ACT processing to the synthesis unit 150. .. Specifically, the inverse transformation from the YCgCo space to the RGB space is performed by performing the following inverse transformation calculation using the Y component, the Cg component, and the Co component of the predicted residual after restoration.
  • the synthesizing unit 150 synthesizes the restored prediction residual output by the inverse transformation unit 142 or the color space inverse transformation unit 144 with the prediction block output by the prediction unit 180 in pixel units.
  • the synthesizing unit 150 adds each pixel value of the restoration prediction residual and each pixel value of the prediction block to restore (reconstruct) the coded block, and outputs the restored block to the deblocking filter 160.
  • the restored block may be called a reconstructed block.
  • the deblocking filter 160 performs a filter process on the restored block output by the synthesis unit 150, and outputs the restored block after the filter process to the memory 170.
  • the filter control unit 161 controls the deblocking filter 160. Details of the deblocking filter 160 and the filter control unit 161 will be described later.
  • the memory 170 stores the restored blocks after the filtering process output by the deblocking filter 160, and stores the restored blocks as restored images in frame units.
  • the memory 170 outputs the stored restored block or restored image to the prediction unit 180.
  • the prediction unit 180 performs prediction processing in block units.
  • the prediction unit 180 generates a prediction block for each color component by performing prediction processing such as intra prediction and inter prediction for the coded block.
  • the prediction unit 180 includes an inter prediction unit 181, an intra prediction unit 182, and a switching unit 183.
  • the inter-prediction unit 181 performs inter-prediction using the correlation between frames. Specifically, the inter-prediction unit 181 uses the restored image stored in the memory 170 as a reference image, calculates a motion vector by a method such as block matching, predicts the block to be encoded, and predicts the inter-prediction block. Is generated, and the generated inter-prediction block is output to the switching unit 183.
  • the inter-prediction unit 181 selects the optimum inter-prediction method from among inter-prediction using a plurality of reference images (typically bi-prediction) and inter-prediction using one reference image (one-way prediction). Select and perform inter-prediction using the selected inter-prediction method.
  • the inter-prediction unit 181 outputs information (motion vector and the like) related to the inter-prediction to the entropy coding unit 130.
  • the intra prediction unit 182 performs intra prediction using the spatial correlation in the frame. Specifically, the intra prediction unit 182 generates an intra prediction block by referring to the restored pixels in the vicinity of the coded target block among the restored images stored in the memory 170, and the generated intra prediction block. Is output to the switching unit 183. The intra prediction unit 182 selects an intra prediction mode to be applied to the coded target block from the plurality of intra prediction modes, and predicts the coded target block using the selected intra prediction mode.
  • the switching unit 183 switches between the inter prediction block output by the inter prediction unit 181 and the intra prediction block output by the intra prediction unit 182, and outputs one of the prediction blocks to the residual generation unit 110 and the synthesis unit 150.
  • the deblocking filter 160 performs filtering processing on the block boundary of two blocks consisting of a restored block (first block) and a restored block (second block) adjacent to the restored block, and each after filtering processing is performed.
  • the restored block is output to the memory 170.
  • the filter processing is a processing for reducing signal deterioration caused by processing in block units, and is a filtering processing for smoothing a signal gap at a block boundary between two adjacent blocks.
  • the filter control unit 161 controls the deblocking filter 160. Specifically, the filter control unit 161 controls the boundary filter strength (Bs: Boundary strength) indicating whether or not to perform the filter processing on the block boundary of the block pair, and the filter strength of the deblocking filter 160.
  • the boundary filter strength Bs refers to a parameter for determining whether or not to apply the filtering process and the type of the filtering process.
  • the control of whether or not the filter processing is performed can be regarded as the control of whether the boundary filter strength Bs is 1 or more or zero.
  • FIG. 2 is a diagram for explaining the operation of the deblocking filter 160 according to the present embodiment.
  • the deblocking filter 160 performs filter processing on the block boundary of each block of 8 ⁇ 8 pixels. Further, the deblocking filter 160 performs filter processing in units of 4 rows or 4 columns.
  • the block P (first reconstructed block) and the block Q (second reconstructed block) shown in FIG. 2 are one unit of the filter processing of the deblocking filter 160, and show an example in which the block size is 4 ⁇ 4 pixels. ing.
  • Each of the blocks P and Q may be referred to as a subblock.
  • the block Q is a restored block corresponding to the coded block
  • the block P is a restored block adjacent to the block Q.
  • the filter control unit 161 determines the boundary filter strength Bs based on Table 1 below.
  • the value of the boundary filter strength Bs is either 0, 1, or 2.
  • the filter control unit 161 sets the Bs value to 2 when the intra prediction is applied to at least one of the blocks P and Q.
  • the filter control unit 161 Bs.
  • the value is 1, and in other cases, the Bs value is 0.
  • the absolute value of the difference between the motion vectors of blocks P and Q is equal to or greater than the threshold value (for example, 1 pixel).
  • At least one of blocks P and Q contains a significant conversion factor (ie, a non-zero conversion factor).
  • the filter control unit 161 controls the deblocking filter 160 so that the deblocking filter processing is not performed when the value of the boundary filter strength Bs is 0.
  • the vertical block boundary shown in FIG. 2 will be described as an example.
  • the filter control unit 161 may control the deblocking filter 160 so as to perform the deblocking filter processing when the following equation (1) is satisfied.
  • the filter control unit 161 may apply a strong filter when all of the following conditional expressions (2) to (7) are satisfied, and may apply a weak filter in other cases. good.
  • the values of the threshold values ⁇ and t C change according to the average value Q av of the quantization parameters of the adjacent blocks P and Q.
  • FIG. 3 is a diagram showing a configuration of a decoding device 2 according to the present embodiment.
  • the decoding device 2 includes an entropy decoding unit 200, an inverse quantization / inverse conversion unit 210, a switching unit 215, a color space inverse conversion unit 216, a synthesis unit 220, and a deblocking filter 230. And a memory 240 and a prediction unit 250.
  • the entropy decoding unit 200 decodes the coded data (bitstream), acquires the quantization conversion coefficient corresponding to the decoding target block, and outputs the acquired quantization conversion coefficient to the inverse quantization / inverse conversion unit 210. Further, the entropy decoding unit 200 acquires information on the conversion process and the quantization process, and outputs the information on the conversion process and the quantization process to the inverse quantization / inverse conversion unit 210. Further, the entropy decoding unit 200 acquires information on the prediction process and outputs the information on the prediction process to the prediction unit 250. The entropy decoding unit 200 acquires the color space conversion flag for each decoding target block, and outputs the acquired color space conversion flag to the switching unit 215 and the filter control unit 231.
  • the inverse quantization / inverse transformation unit 210 performs inverse quantization processing and inverse transformation processing in block units.
  • the inverse quantization / inverse conversion unit 210 has an inverse quantization unit 211 and an inverse conversion unit 212.
  • the inverse quantization unit 211 performs an inverse quantization process corresponding to the quantization process performed by the quantization unit 122 of the coding apparatus 1.
  • the dequantization unit 211 restores and restores the conversion coefficient of the block to be decoded by dequantizing the quantization conversion coefficient output by the entropy decoding unit 200 using the quantization parameter (Qp) and the scaling list.
  • the converted conversion coefficient is output to the inverse conversion unit 212.
  • the reverse conversion unit 212 performs reverse conversion processing corresponding to the conversion processing performed by the conversion unit 121 of the coding device 1.
  • the inverse transformation unit 212 performs an inverse transformation process on the conversion coefficient output by the inverse quantization unit 211 to restore the predicted residual, and outputs the restored predicted residual to the switching unit 215.
  • the switching unit 215 outputs the predicted residual of each color component output by the inverse conversion unit 212 to either the synthesis unit 220 or the color space inverse conversion unit 216 based on the color space conversion flag.
  • the switching unit 111 outputs the predicted residual to the conversion / quantization unit 120 for the block to which the color space inverse transformation processing (ACT) is applied, and the color space inverse transformation of the predicted residual for the block to which the ACT is applied. Output to unit 216.
  • ACT color space inverse transformation processing
  • the color space reverse conversion unit 216 performs color space reverse conversion processing (reverse ACT processing), which is the reverse processing of the ACT processing performed by the color space conversion unit 112 of the coding apparatus 1, and synthesizes the predicted residual after the reverse ACT processing. Output to unit 220. Specifically, the color space inverse transformation unit 216 performs the following inverse transformation calculation using the Y component, Cg component, and Co component of the predicted residual after restoration.
  • reverse ACT processing color space reverse conversion processing
  • the color space inverse transformation unit 216 performs the following inverse transformation calculation using the Y component, Cg component, and Co component of the predicted residual after restoration.
  • the synthesizing unit 220 decodes (reconstructs) the original block by synthesizing the prediction residual output by the switching unit 215 or the color space inverse conversion unit 216 and the prediction block output by the prediction unit 250 on a pixel-by-pixel basis. Then, the restored block is output to the deblocking filter 230.
  • the deblocking filter 230 performs a filter process on the restored block output by the synthesis unit 220, and outputs the restored block after the filter process to the memory 240. Specifically, the deblocking filter 230 filters the block boundary of two blocks including the restored block (first block) and the restored block (second block) adjacent to the restored block. Each restored block after filtering is output to the memory 240.
  • the function of the deblocking filter 230 is the same as the function of the deblocking filter 160 of the coding device 1.
  • the filter control unit 231 controls the deblocking filter 230.
  • the filter control unit 231 controls the deblocking filter 230.
  • the filter control unit 231 controls the boundary filter strength (Bs: Boundary strength) indicating whether or not to perform the filter processing on the block boundary of the block pair, and the filter strength of the deblocking filter 230.
  • the function of the filter control unit 231 is the same as the function of the filter control unit 161 of the coding device 1.
  • the function of the filter control unit 231 determines the boundary filter strength Bs based on Table 1 above.
  • the filter control unit 231 is a boundary of the deblocking filter 230 based on whether or not at least one of the adjacent blocks P and Q is encoded by using adaptive color conversion (ACT).
  • ACT adaptive color conversion
  • the entropy decoding unit 200 acquires a flag (color space conversion flag) indicating whether or not the code is encoded by using the adaptive color conversion for each of the block P and the block Q.
  • the filter control unit 231 controls the boundary filter intensity Bs of the deblocking filter 230 based on the color space conversion flags for each of the block P and the block Q.
  • the filter control unit 231 controls the boundary filter intensity Bs so as to perform the filtering process by the deblocking filter 230 (that is, the boundary).
  • Filter strength Bs 1 is set).
  • the filter control unit 231 encodes at least one of the block P and the block Q using the adaptive color conversion even when the non-zero conversion coefficient does not exist in both the block P and the block Q. If so, the boundary filter strength Bs is controlled so as to perform the filtering process by the deblocking filter 230.
  • the memory 240 stores the restored blocks output by the compositing unit 220, and stores the restored blocks as restored images in frame units.
  • the memory 240 outputs the restored block or the restored image to the prediction unit 250. Further, the memory 240 outputs the restored image in frame units to the outside of the decoding device 2.
  • the prediction unit 250 makes predictions for each color component in block units.
  • the prediction unit 250 includes an inter-prediction unit 251, an intra-prediction unit 252, and a switching unit 253.
  • the inter-prediction unit 251 performs inter-prediction using the correlation between frames. Specifically, the inter-prediction unit 251 encodes the restored image stored in the memory 240 as a reference image based on the information related to the inter-prediction (for example, motion vector information) output by the entropy decoding unit 200. The target block is predicted to generate an inter-prediction block, and the generated inter-prediction block is output to the switching unit 253.
  • the inter-prediction unit 251 performs inter-prediction using the correlation between frames. Specifically, the inter-prediction unit 251 encodes the restored image stored in the memory 240 as a reference image based on the information related to the inter-prediction (for example, motion vector information) output by the entropy decoding unit 200.
  • the target block is predicted to generate an inter-prediction block, and the generated inter-prediction block is output to the switching unit 253.
  • the intra prediction unit 252 performs intra prediction using the spatial correlation in the frame. Specifically, the intra prediction unit 252 uses an intra prediction mode corresponding to information related to the intra prediction output by the entropy decoding unit 200 (for example, intra prediction mode information), and the restored image stored in the memory 240. An intra prediction block is generated with reference to the restored pixels around the coded block, and the generated intra prediction block is output to the switching unit 253.
  • an intra prediction mode corresponding to information related to the intra prediction output by the entropy decoding unit 200 (for example, intra prediction mode information)
  • An intra prediction block is generated with reference to the restored pixels around the coded block, and the generated intra prediction block is output to the switching unit 253.
  • the switching unit 253 switches between the inter prediction block output by the inter prediction unit 251 and the intra prediction block output by the intra prediction unit 252, and outputs one of the prediction blocks to the synthesis unit 220.
  • the decoding device 2 has the entropy decoding unit 200 that outputs the conversion coefficient corresponding to the block P by decoding the coded stream, and the conversion coefficient output by the entropy decoding unit 200.
  • the inverse quantization / inverse transformation unit 210 that restores the predicted residual corresponding to the block P (first block) by performing the inverse quantization processing and the inverse transformation processing, and the restored predicted residual and the block P are predicted. Filtering is performed on the boundary between the synthesizing unit 220 that restores the block P by synthesizing the predicted blocks obtained in the above process, the restored block P, and the restored block Q (second block) adjacent to the block P.
  • Filter control that controls the boundary filter strength Bs of the deblocking filter 230 based on whether at least one of the deblocking filter 230 and the block P and the block Q is encoded by the adaptive color transformation (ACT). It has a portion 231 and.
  • the predicted residual is restored from the conversion coefficient by the inverse conversion process, and then the color space of the predicted residual is inversely converted from the YCgCo space to the RGB space by the color space inverse conversion (inverse ACT).
  • inverse ACT color space inverse conversion
  • the filter control unit 231 not only controls the boundary filter strength Bs of the deblocking filter 230 based on the presence or absence of a non-zero conversion coefficient, but also considers whether or not the ACT is applied to the deblocking filter 230. Boundary filter strength Bs is controlled. As a result, the boundary filter strength Bs of the deblocking filter 230 can be appropriately controlled, so that deterioration of image quality can be suppressed even when ACT is applied.
  • FIG. 4 is a diagram showing an operation example of the filter control unit 231 according to the present embodiment. The order of determination shown in FIG. 4 is an example, and the order of determination may be changed.
  • step S1 the filter control unit 231 determines whether or not the intra prediction is applied to at least one of the block pairs consisting of the blocks P and Q.
  • step S3 the filter control unit 231 determines whether or not the difference between the motion vectors of the target block pairs is equal to or greater than the threshold value.
  • step S5 the filter control unit 231 determines whether the number of motion vectors of the block pairs or the reference image is different.
  • the filter control unit 231 on the decoding side determines whether or not at least one block of the block pair (block P and block Q) contains a non-zero conversion coefficient based on the flag signaled from the coding device 1. You may.
  • the entropy coding unit 130 of the coding device 1 includes a flag (tu_coded_flag) indicating whether or not a non-zero conversion coefficient is included in the coding stream for each block. For example, the entropy coding unit 130 sets the flag (tu_coded_flag) to "1" for a block containing a non-zero conversion coefficient, and sets the flag (tu_coded_flag) to "0" for a block containing no non-zero conversion coefficient. ..
  • the entropy decoding unit 200 of the decoding device 2 acquires a flag (tu_coded_flag) for each block, and outputs the acquired flag (tu_coded_flag) to the filter control unit 231.
  • the filter control unit 231 interprets that the block whose flag (tu_coded_flag) is "1" does not include the non-zero conversion coefficient. Then, the filter control unit 231 sets the boundary filter strength Bs of the deblocking filter 230 as shown in Table 2 below.
  • the boundary filter strength Bs of the deblocking filter 230 is controlled based on the predicted residual after the inverse transformation processing, not on the conversion coefficient.
  • the boundary filter intensity Bs of the deblocking filter 230 is set based on the predicted residual after the effect. Can be controlled appropriately.
  • the filter control unit 161 and the filter control unit 231 set the boundary filter strength Bs of the deblocking filter 230 based on Table 3 below.
  • FIG. 5 is a diagram showing a configuration of a coding device 1 according to this modified example.
  • the filter control unit 161 is input with the same predicted residual as the predicted residual (restored predicted residual) input to the synthesis unit 150.
  • the predicted residual after the inverse ACT is input to the filter control unit 161.
  • FIG. 6 is a diagram showing the configuration of the decoding device 2 according to this modified example.
  • the same predicted residual as the predicted residual (restored predicted residual) input to the synthesis unit 220 is input to the filter control unit 231.
  • the predicted residual after the inverse ACT is input to the filter control unit 231.
  • JCCR is a coefficient coding mode for color difference components (see Non-Patent Document 1).
  • the coding apparatus 1 utilizes the correlation of the predicted residuals of the first color difference component (Cb component) and the second color difference component (Cr component) to obtain the predicted residual of the first color difference component and the second.
  • One joint predicted residual is generated from the predicted residual of the color difference component.
  • the coding apparatus 1 generates a joint predicted residual by synthesizing the predicted residual of the second color difference component with the predicted residual of the first color difference component. Then, the coding apparatus 1 performs conversion processing, quantization processing, and entropy coding processing on the generated joint predicted residuals and transmits the generated joint prediction residuals.
  • the decoding device 2 reconstructs the predicted residual of the first color difference component and the predicted residual of the second color difference component from the transmitted joint predicted residual. In this way, the coding efficiency is improved by transmitting only one congruent predicted residual for the two color difference components.
  • the deblocking filter device is a deblocking filter (160, 230) that performs a filtering process on the boundary between the first reconstructed block (block P) and the second reconstructed block (block Q). And JCCR in which at least one of the first reconstructed block (block P) and the second reconstructed block (block Q) generates one congruent predicted residual from the respective predicted residuals of the Cb color difference component and the Cr color difference component. It is provided with a filter control unit (161, 231) for controlling the boundary filter strength Bs of the deblocking filter (160, 230) based on whether or not it is encoded using (Joint coding of chroma residual).
  • the filter control unit (161, 231) is a deblocking filter (160,) when at least one of the first reconstruction block (block P) and the second reconstruction block (block Q) is encoded using JCCR.
  • the boundary filter strength Bs may be controlled so as to perform the filtering process according to 230).
  • the filter control unit (161, 231) performs the first reconstruction even when the non-zero conversion coefficient does not exist in both the first reconstruction block (block P) and the second reconstruction block (block Q). If at least one of the block (block P) and the second reconstructed block (block Q) is encoded using JCCR, the boundary filter strength is to be filtered by the deblocking filter (160, 230). Bs may be controlled.
  • the entropy decoding unit 200 of the decoding device 2 sets a flag indicating whether or not it is encoded by using JCCR in the first reconstruction block (block P) and the second reconstruction block (block Q). You may get each one.
  • the filter control unit 231 may control the boundary filter strength Bs of the deblocking filter 230 based on the flags for each of the first reconstruction block (block P) and the second reconstruction block (block Q). For example, the filter control unit 231 filters the deblocking filter 230 when the flag of at least one of the first reconstruction block (block P) and the second reconstruction block (block Q) is “1”.
  • the boundary filter strength Bs may be controlled so as to perform the above.
  • the entropy decoding unit 200 of the decoding device 2 has tu_coded_flag indicating whether or not it includes a non-zero conversion coefficient in the first reconstruction block (block P) and the second reconstruction block (block Q), respectively. You may get more about.
  • the filter control unit 231 may further control the boundary filter strength Bs of the deblocking filter 230 based on the tu_coded_flag for each of the first reconstruction block (block P) and the second reconstruction block (block Q). ..
  • the filter control unit 231 performs the filter processing by the deblocking filter 230.
  • the boundary filter strength Bs may be controlled as such.
  • a program for causing a computer to execute each process performed by the above-mentioned coding device 1 may be provided. Further, a program for causing the computer to execute each process performed by the decoding device 2 may be provided.
  • the program may be recorded on a computer-readable medium.
  • Computer-readable media can be used to install programs on a computer.
  • the computer-readable medium on which the program is recorded may be a non-transient recording medium.
  • the non-transient recording medium is not particularly limited, but may be, for example, a recording medium such as a CD-ROM or a DVD-ROM.
  • a circuit that executes each process performed by the coding device 1 may be integrated, and the coding device 1 may be configured by a semiconductor integrated circuit (chipset, SoC).
  • a circuit that executes each process performed by the decoding device 2 may be integrated, and the decoding device 2 may be configured by a semiconductor integrated circuit (chipset, SoC).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/JP2021/021814 2020-06-10 2021-06-08 デブロッキングフィルタ装置、復号装置、及びプログラム Ceased WO2021251398A1 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN202180005451.2A CN114450964A (zh) 2020-06-10 2021-06-08 去块滤波装置、解码装置及程序
JP2022530590A JP7343702B2 (ja) 2020-06-10 2021-06-08 デブロッキングフィルタ装置、復号装置、及びプログラム
US17/655,948 US12212744B2 (en) 2020-06-10 2022-03-22 Deblocking filter device, decoding device and program
JP2023141346A JP7695310B2 (ja) 2020-06-10 2023-08-31 デブロッキングフィルタ装置、復号装置、及びプログラム
US18/987,899 US20250119542A1 (en) 2020-06-10 2024-12-19 Deblocking filter device, decoding device and program
JP2025094809A JP2025124883A (ja) 2020-06-10 2025-06-06 デブロッキングフィルタ装置、復号装置、及びプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-101293 2020-06-10
JP2020101293 2020-06-10

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/655,948 Continuation US12212744B2 (en) 2020-06-10 2022-03-22 Deblocking filter device, decoding device and program

Publications (1)

Publication Number Publication Date
WO2021251398A1 true WO2021251398A1 (ja) 2021-12-16

Family

ID=78845791

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/021814 Ceased WO2021251398A1 (ja) 2020-06-10 2021-06-08 デブロッキングフィルタ装置、復号装置、及びプログラム

Country Status (4)

Country Link
US (2) US12212744B2 (https=)
JP (3) JP7343702B2 (https=)
CN (1) CN114450964A (https=)
WO (1) WO2021251398A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114450964A (zh) * 2020-06-10 2022-05-06 日本放送协会 去块滤波装置、解码装置及程序

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105227958B (zh) * 2010-07-20 2019-06-25 Sk电信有限公司 用于解码视频信号的解码装置
CN106941608B (zh) * 2011-06-30 2021-01-15 三菱电机株式会社 图像编码装置及方法、图像解码装置及方法
US10182241B2 (en) * 2014-03-04 2019-01-15 Microsoft Technology Licensing, Llc Encoding strategies for adaptive switching of color spaces, color sampling rates and/or bit depths
BR112017004886A2 (pt) * 2014-09-12 2017-12-05 Vid Scale Inc dispositivo de codificação de vídeo e método de codificação de vídeo
CN113906749B (zh) * 2019-04-30 2023-05-23 北京达佳互联信息技术有限公司 色度残差联合编码方法和装置
JP7343596B6 (ja) * 2019-08-23 2024-02-26 華為技術有限公司 合同クロマ符号化を使用するブロックについてクロマ・ブロッキング解除を実行するためのエンコーダ、デコーダおよび対応する方法
WO2021086021A1 (ko) * 2019-10-28 2021-05-06 엘지전자 주식회사 적응적 변환을 이용한 영상 부호화/복호화 방법, 장치 및 비트스트림을 전송하는 방법
CN114902657B (zh) * 2019-12-31 2025-06-13 字节跳动有限公司 视频编解码中的自适应颜色变换
CN114450964A (zh) * 2020-06-10 2022-05-06 日本放送协会 去块滤波装置、解码装置及程序

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
C. HELMRICH (FRAUNHOFER), H. SCHWARZ, T. NGUYEN, C. RUDAT, D. MARPE, T. WIEGAND (FRAUNHOFER HHI, B. RAY, G. VAN DER AUWERA, A. K. : "CE7-related: Alternative configuration of CE7-2.2 joint chroma residual coding", 15. JVET MEETING; 20190703 - 20190712; GOTHENBURG; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), no. JVET 00935-V1, 2 July 2019 (2019-07-02), XP030220566 *

Also Published As

Publication number Publication date
JP2023162377A (ja) 2023-11-08
US20250119542A1 (en) 2025-04-10
US20220217339A1 (en) 2022-07-07
US12212744B2 (en) 2025-01-28
CN114450964A (zh) 2022-05-06
JPWO2021251398A1 (https=) 2021-12-16
JP7343702B2 (ja) 2023-09-12
JP7695310B2 (ja) 2025-06-18
JP2025124883A (ja) 2025-08-26

Similar Documents

Publication Publication Date Title
US11695955B2 (en) Image encoding device, image decoding device and program
JP7142180B2 (ja) 符号化装置、復号装置、及びプログラム
US12137254B2 (en) Encoding device, decoding device and program
US20250373835A1 (en) Decoding device, program, and decoding method
JP2025124883A (ja) デブロッキングフィルタ装置、復号装置、及びプログラム
JP7636493B2 (ja) 符号化装置、復号装置、及びプログラム
CN114830641A (zh) 图像编码方法和图像解码方法
JP7080424B2 (ja) デブロッキングフィルタ制御装置及びプログラム
JP2021129148A (ja) 予測装置、符号化装置、復号装置、及びプログラム
JP7483725B2 (ja) 符号化装置、復号装置、及びプログラム
WO2021251400A1 (ja) 復号装置及びプログラム
JP7621975B2 (ja) 符号化装置、復号装置、及びプログラム
WO2021054380A1 (ja) 符号化装置、復号装置、及びプログラム
WO2021045059A1 (ja) 符号化装置、復号装置、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21821107

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022530590

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21821107

Country of ref document: EP

Kind code of ref document: A1