WO2021040036A1 - 符号化装置、復号装置、及びプログラム - Google Patents

符号化装置、復号装置、及びプログラム Download PDF

Info

Publication number
WO2021040036A1
WO2021040036A1 PCT/JP2020/032782 JP2020032782W WO2021040036A1 WO 2021040036 A1 WO2021040036 A1 WO 2021040036A1 JP 2020032782 W JP2020032782 W JP 2020032782W WO 2021040036 A1 WO2021040036 A1 WO 2021040036A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
unit
blocks
prediction
conversion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/032782
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
俊輔 岩村
市ヶ谷　敦郎
慎平 根本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Japan Broadcasting Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Hoso Kyokai NHK, Japan Broadcasting Corp filed Critical Nippon Hoso Kyokai NHK
Priority to JP2021543092A priority Critical patent/JP7483725B2/ja
Priority to CN202080060957.9A priority patent/CN114342383B/zh
Publication of WO2021040036A1 publication Critical patent/WO2021040036A1/ja
Priority to US17/680,945 priority patent/US12192453B2/en
Anticipated expiration legal-status Critical
Priority to JP2024074538A priority patent/JP7656120B2/ja
Priority to US18/965,386 priority patent/US20250097419A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Definitions

  • the present invention relates to a coding device, a decoding device, and a program.
  • a deblocking filter is adopted as a filter in a coding loop (see, for example, Non-Patent Document 1).
  • the deblocking filter is an in-loop filter for suppressing distortion at the boundary portion of a block when encoding processing is performed in block units.
  • the filter control unit that controls the deblocking filter sets a deblocking filter for the boundary between the two blocks when the intra prediction is applied to at least one of the two blocks consisting of the coded block and its adjacent blocks. Apply. When the inter-prediction is applied to both of the two blocks adjacent to each other, the filter control unit performs the two blocks according to the value of the motion vector of each of the two blocks and the degree of matching of the reference destination (reference image). Decide whether to apply the deblocking filter to the boundary of the block.
  • VVC is planning to adopt a weighted bi-prediction technology called BCW (Bi-prescription with CU-level Weight).
  • BCW Bi-prescription with CU-level Weight.
  • the conventional double prediction simply generates a prediction image by averaging two reference images, while the weighted double prediction generates a prediction image by weighted averaging (weighted average) of two reference images.
  • the weighting coefficient used for this weighted average is selected from a plurality of predetermined weighting coefficient sets.
  • the inter-prediction When the inter-prediction is applied to both of the two blocks adjacent to each other, the following problems may occur even if the motion vector value of each block and the degree of agreement of the reference destination are high. Specifically, when the weighted bi-prediction is applied to each block and the weighting coefficients applied to each block are different from each other, the discontinuity between the blocks becomes high, so that the visual deterioration is caused. There is a problem that arises.
  • the present invention provides a coding device, a decoding device, and a program that improve image quality and coding efficiency by appropriately controlling the deblocking filter.
  • the coding device is a coding device that performs coding in block units obtained by dividing an image, and uses a plurality of weighting coefficients selected from a weighting coefficient set consisting of a plurality of weighting coefficients.
  • the prediction unit that generates the prediction block of the coded target block by performing weighted averaging on the reference image of, and the conversion process and the prediction residual representing the difference between the coded target block and the prediction block.
  • a conversion / quantization unit that performs quantization processing, and an inverse quantization / inverse conversion that restores the predicted residual by performing dequantization processing and deconversion processing on the conversion coefficient obtained by the conversion / quantization unit.
  • the composite unit that restores the coded target block by synthesizing the restored predicted residual and the predicted block, and the restored coded target block and the adjacent block. It is a gist to include a deblocking filter that performs filtering processing and a filter control unit that controls the deblocking filter based on the weighting coefficient applied to each of the two blocks by the prediction unit.
  • the decoding device is a decoding device that decodes in block units obtained by dividing an image, and outputs a quantization conversion coefficient corresponding to the block to be decoded by decoding the encoded stream. It consists of an entropy decoding unit that performs dequantization, an inverse quantization / inverse conversion unit that performs dequantization processing and deconversion processing on the conversion coefficient output by the entropy decoding unit to restore the predicted residual, and a plurality of weighting coefficients.
  • a prediction unit that generates a prediction block of the decoding target block by performing weighted averaging on a plurality of reference images using a weighting coefficient selected from the weighting coefficient set, and the restored prediction residual and the prediction block.
  • a deblocking filter that performs filtering on the boundary between two blocks including the restored block to be decoded and an adjacent block, and the prediction unit is the two. It is a gist to include a filter control unit that controls the deblocking filter based on the weighting coefficient applied to each of the blocks.
  • the gist of the program according to the third aspect is to make the computer function as a coding device according to the first aspect.
  • the gist of the program according to the fourth aspect is to make the computer function as a decoding device according to the second aspect.
  • the present invention it is possible to provide a coding device, a decoding device, and a program that improve image quality and coding efficiency by appropriately controlling the deblocking filter.
  • the coding device and the decoding device according to the embodiment will be described with reference to the drawings.
  • the coding device and the decoding device according to the embodiment respectively perform coding and decoding of a moving image represented by MPEG.
  • the same or similar parts are designated by the same or similar reference numerals.
  • FIG. 1 is a diagram showing a configuration of a coding device 1 according to the present embodiment.
  • the coding device 1 is a device that performs coding in block units obtained by dividing an image.
  • the coding apparatus 1 synthesizes a block dividing unit 100, a subtracting unit 110, a conversion / quantization unit 120, an entropy coding unit 130, and an inverse quantization / inverse conversion unit 140. It has a unit 150, a deblocking filter 160, a filter control unit 161, a memory 170, and a prediction unit 180.
  • the block division unit 100 divides the input image in units of frames (or pictures) constituting the moving image into a plurality of image blocks, and outputs the image block obtained by the division to the subtraction unit 110.
  • the size of the image block is, for example, 32 ⁇ 32 pixels, 16 ⁇ 16 pixels, 8 ⁇ 8 pixels, 4 ⁇ 4 pixels, or the like.
  • the shape of the image block is not limited to a square and may be a rectangle (non-square).
  • the image block is a unit for coding by the coding device 1 (encoding target block) and a unit for decoding by the decoding device (decoding target block). Such an image block is sometimes called a CU (Coding Unit).
  • the block division unit 100 divides the luminance signal and the color difference signal into blocks.
  • the case where the shape of the block division is the same for the luminance signal and the color difference signal will be mainly described, but the division may be controlled independently for the luminance signal and the color difference signal.
  • the luminance block and the color difference block are not particularly distinguished, they are simply called a coded block.
  • the subtraction unit 110 calculates a prediction residual representing a difference (error) between the coding target block output from the block division unit 100 and the prediction block obtained by predicting the coding target block by the prediction unit 180.
  • the subtraction unit 110 calculates the prediction residual by subtracting each pixel value of the prediction block from each pixel value of the block, and outputs the calculated prediction residual to the conversion / quantization unit 120.
  • the conversion / quantization unit 120 performs conversion processing and quantization processing in block units.
  • the conversion / quantization unit 120 includes a conversion unit 121 and a quantization unit 122.
  • the conversion unit 121 performs conversion processing on the predicted residual output from the subtraction unit 110, calculates a conversion coefficient for each frequency component, and outputs the calculated conversion coefficient to the quantization unit 122.
  • the conversion process (conversion) is a process of converting a signal in the pixel region into a signal in the frequency domain, for example, discrete cosine transform (DCT), discrete sine transform (DST), carunen-reve transform (KLT), and the like. Is an integer transform of.
  • the quantization unit 122 quantizes the conversion coefficient output from the conversion unit 121 using the quantization parameter (Qp) and the quantization matrix, and the quantized conversion coefficient is the entropy coding unit 130 and the inverse quantization / inverse conversion. Output to unit 140.
  • the quantization parameter (Qp) is a parameter commonly applied to each conversion coefficient in the block, and is a parameter that determines the roughness of quantization.
  • the quantization matrix is a matrix having a quantization value as an element when quantizing each conversion coefficient.
  • the entropy coding unit 130 performs entropy coding on the conversion coefficient output from the quantization unit 122, performs data compression to generate a coded stream (bit stream), and encodes the coded stream into the coding device 1. Output to the outside of.
  • a Huffman code Context-based Adaptive Binary Arithmetic Coding; context-adaptive binary arithmetic coding
  • CABAC Context-based Adaptive Binary Arithmetic Coding; context-adaptive binary arithmetic coding
  • the entropy encoding unit 130 acquires information such as the size and shape of each coded block from the block dividing unit 100, and acquires information related to prediction (for example, information on the prediction mode and motion vector) from the prediction unit 180. It also encodes this information.
  • Inverse quantization / inverse conversion unit 140 performs inverse quantization processing and inverse conversion processing in block units.
  • the inverse quantization / inverse conversion unit 140 includes an inverse quantization unit 141 and an inverse conversion unit 142.
  • the inverse quantization unit 141 performs the inverse quantization process corresponding to the quantization process performed by the quantization unit 122. Specifically, the inverse quantization unit 141 restores and restores the conversion coefficient by inversely quantizing the conversion coefficient output from the quantization unit 122 using the quantization parameter (Qp) and the quantization matrix. The converted conversion coefficient is output to the inverse conversion unit 142.
  • the inverse conversion unit 142 performs an inverse conversion process corresponding to the conversion process performed by the conversion unit 121. For example, when the conversion unit 121 performs the DCT, the inverse conversion unit 142 performs the inverse DCT. The inverse conversion unit 142 performs an inverse conversion process on the conversion coefficient output from the inverse quantization unit 141 to restore the predicted residual, and outputs the restored predicted residual, which is the restored predicted residual, to the synthesis unit 150. To do.
  • the synthesis unit 150 synthesizes the restoration prediction residual output from the inverse conversion unit 142 with the prediction block output from the prediction unit 180 in pixel units.
  • the synthesizing unit 150 adds each pixel value of the restoration prediction residual and each pixel value of the prediction block to restore (decode) the coded block, and deblocks the decoded image (restoration block) of the restored block unit. Output to 160.
  • the deblocking filter 160 performs filter processing on the boundary portion of two blocks (hereinafter, referred to as "target block pair") composed of a restoration block and an adjacent block adjacent to the restoration block, and restores after filtering.
  • the block is output to the memory 170.
  • the filter processing is a processing for reducing signal deterioration caused by processing in block units, and is a filtering processing for smoothing a signal gap at a boundary portion of a target block pair.
  • the deblocking filter 160 is generally configured as a low-pass filter that moderates signal fluctuations.
  • the filter control unit 161 controls the deblocking filter 160. Specifically, the filter control unit 161 controls whether or not the target block pair is filtered, and the boundary strength (Bs: Boundary strength) of the deblocking filter 160.
  • the boundary strength Bs refers to a parameter for determining whether or not to apply the filtering process and the type of the filtering process.
  • the control of whether or not the filtering process is performed can be regarded as the control of whether the boundary strength Bs is 1 or more or zero.
  • the filter control unit 161 controls the deblocking filter 160 based on the fluctuation of the pixel value in the region near the boundary of the target block pair, the prediction mode, the quantization parameter, and the motion vector value used for the motion compensation prediction (inter-prediction). To do. The details of the operation of the filter control unit 161 will be described later.
  • the memory 170 stores the restoration block output from the deblocking filter 160 as a decoded image in frame units.
  • the memory 170 outputs the stored decoded image to the prediction unit 180.
  • the prediction unit 180 generates a prediction block corresponding to the coded target block by performing prediction processing in block units, and outputs the generated prediction block to the subtraction unit 110 and the synthesis unit 150.
  • the prediction unit 180 has an inter prediction unit 181, an intra prediction unit 182, and a switching unit 183.
  • the inter-prediction unit 181 uses the decoded image stored in the memory 170 as a reference image, calculates a motion vector by a method such as block matching, predicts a block to be encoded, and generates an inter-prediction block.
  • the inter-prediction block is output to the switching unit 183.
  • the inter-prediction unit 181 selects the optimum inter-prediction method from inter-prediction using a plurality of reference images (typically bi-prediction) and inter-prediction using one reference image (one-way prediction). Inter-prediction is performed using the selected inter-prediction method.
  • the inter-prediction unit 181 outputs information (motion vector, etc.) related to the inter-prediction to the entropy coding unit 130 and the filter control unit 161.
  • the inter-prediction unit 181 has a weighted bi-prediction unit 181a that generates an inter-prediction block by weighted averaging (weighted averaging) two reference images.
  • the weighting coefficient used for this weighted average is selected from a plurality of predetermined weighting coefficient sets.
  • the weighted twin prediction unit 181a is based on the following equation (1) when one reference image is “P 0 ”, the other reference image is “P 1 ”, and the weighting coefficient is “w”. Generate an inter-prediction block.
  • the weighting coefficient "w" is selected from a set consisting of -2, 2, 4, 6, and 10. According to such a weighted twin prediction, the prediction accuracy can be improved as compared with the conventional double prediction in which two reference images are simply averaged to generate an inter prediction block.
  • the intra prediction unit 182 selects the optimum intra prediction mode to be applied to the coded target block from the plurality of intra prediction modes, and predicts the coded target block using the selected intra prediction mode.
  • the intra prediction unit 182 generates an intra prediction block by referring to the decoded pixel value adjacent to the coded target block among the decoded images stored in the memory 170, and outputs the generated intra prediction block to the switching unit 183. To do. Further, the intra prediction unit 182 outputs information regarding the selected intra prediction mode to the entropy encoding unit 130 and the filter control unit 161.
  • the switching unit 183 switches between the inter prediction block output from the inter prediction unit 181 and the intra prediction block output from the intra prediction unit 182, and outputs one of the prediction blocks to the subtraction unit 110 and the synthesis unit 150.
  • the coding apparatus 1 performs weighted averaging on a plurality of reference images using weight coefficients selected from a weight coefficient set composed of a plurality of weight coefficients, and performs a weighted averaging on a plurality of reference images to be encoded.
  • the weighted bi-prediction unit 181a that generates the prediction block of the above, the conversion / quantization unit 120 that performs conversion processing and quantization processing on the prediction residual that represents the difference between the coded block and the prediction block, and the conversion /
  • the inverse quantization / inverse conversion unit 140 that restores the predicted residual by performing the inverse quantization processing and the inverse conversion processing on the conversion coefficient obtained by the quantization unit 120, and the restored predicted residual and the prediction block are combined. It has a compositing unit 150 for restoring the coded target block, and a deblocking filter 160 for performing a filtering process on the boundary portion between the restored coded target block and the adjacent block.
  • FIG. 2 is a diagram showing an operation example of the deblocking filter 160 according to the present embodiment.
  • the block Q is a restoration block corresponding to the coded block
  • the block P is a restoration block adjacent to the block Q.
  • the block size that the deblocking filter 160 filters is 8 ⁇ 8 pixels.
  • the filter control unit 161 obtains the boundary strength Bs based on, for example, Table 1 below. In the present embodiment, the value of the boundary strength Bs is one of 0, 1, and 2.
  • the filter control unit 161 sets the value of Bs to 2 when the intra prediction is applied to at least one of the blocks P and Q.
  • the filter control unit 161 satisfies the condition.
  • the Bs value is set to 1, and in other cases, the Bs value is set to 0.
  • At least one of blocks P and Q contains a significant conversion coefficient (that is, a non-zero conversion coefficient).
  • past or future decoded frames can be used as a reference image with reference to the frame to be encoded.
  • P0 and Q0 refer to the past decoded frame
  • P1 and Q1 may refer to a future decoded frame.
  • the Bs value is determined based on the above degree of coincidence and whether the weighting coefficients used to generate Pbi-pred and Qbi-pred match.
  • the filter control unit 161 controls the deblocking filter 160 so that the filter processing is not performed when the value of the boundary strength Bs is 0.
  • the vertical block boundary shown in FIG. 2 will be described as an example.
  • the filter control unit 161 may control the deblocking filter 160 so as to perform the filter processing only when the following equation (1) is satisfied.
  • the filter control unit 161 may apply a strong filter when all of the following conditional expressions (2) to (7) are satisfied, and may apply a weak filter in other cases.
  • the values of the threshold values ⁇ and t C change according to the average value Qav of the quantization parameters of the adjacent blocks P and Q.
  • the filter control unit 161 according to the present embodiment is based on the fact that the weighting coefficient applied to one of the blocks P and Q and the weighting coefficient applied to the other are the same as described in (d) above. Therefore, the deblocking filter 160 is controlled so that the filtering process is not performed. On the other hand, the filter control unit 161 according to the present embodiment performs the deblocking filter 160 so as to perform filter processing based on the difference between the weighting coefficient applied to one of the blocks P and Q and the weighting coefficient applied to the other. To control.
  • FIG. 3 is a diagram for explaining a specific example of the operation of the filter control unit 161 according to the present embodiment.
  • the two motion vectors used by block P for bi-prediction are P0 and P1.
  • the two motion vectors that block Q uses for bi-prediction are Q0 and Q1.
  • the reference destinations of P0 and Q0 are the same frame, and the reference destinations of P1 and Q1 are the same frame. Further, the difference between the motion vector values of P0 and Q0 is equal to or less than the threshold value, and the difference between the motion vector values of P1 and Q1 is equal to or less than the threshold value.
  • condition (d) above is newly introduced. Therefore, even if none of the above conditions (a) to (c) is satisfied, if the above condition (d) is satisfied, the Bs value can be set to 1, and the result can be determined.
  • the blocking filter 160 can be controlled to be filtered.
  • FIG. 4 is a diagram showing a configuration of a decoding device 2 according to the present embodiment.
  • the decoding device 2 is a device that decodes the decoding target block from the coded stream.
  • the decoding device 2 predicts the entropy decoding unit 200, the inverse quantization / inverse conversion unit 210, the synthesis unit 220, the deblocking filter 230, the filter control unit 231 and the memory 240. It has a part 250.
  • the entropy decoding unit 200 decodes the coded stream generated by the coding device 1 and decodes various signaling information. Specifically, the entropy decoding unit 200 acquires information related to the prediction applied to the decoding target block (for example, prediction type information, motion vector information), and outputs the acquired information to the prediction unit 250 and the filter control unit 231. To do.
  • information related to the prediction applied to the decoding target block for example, prediction type information, motion vector information
  • the entropy decoding unit 200 decodes the coded stream, acquires the quantized conversion coefficient, and outputs the acquired conversion coefficient to the inverse quantization / inverse conversion unit 210 (inverse quantization unit 211).
  • the inverse quantization / inverse conversion unit 210 performs the inverse quantization process and the inverse conversion process on a block-by-block basis.
  • the inverse quantization / inverse conversion unit 210 includes an inverse quantization unit 211 and an inverse conversion unit 212.
  • the inverse quantization unit 211 performs the inverse quantization process corresponding to the quantization process performed by the quantization unit 122 of the coding device 1.
  • the inverse quantization unit 211 restores the conversion coefficient of the decoding target block by inversely quantizing the quantization conversion coefficient output from the entropy decoding unit 200 using the quantization parameter (Qp) and the quantization matrix. , The restored conversion coefficient is output to the inverse conversion unit 212.
  • the inverse conversion unit 212 performs an inverse conversion process corresponding to the conversion process performed by the conversion unit 121 of the coding device 1.
  • the inverse conversion unit 212 performs inverse conversion processing on the conversion coefficient output from the inverse quantization unit 211 to restore the predicted residual, and outputs the restored predicted residual (restored predicted residual) to the synthesis unit 220. To do.
  • the synthesizing unit 220 restores (decodes) the decoding target block by synthesizing the prediction residual output from the inverse conversion unit 212 and the prediction block output from the prediction unit 250 on a pixel-by-pixel basis, and restores (decodes) the restoration block. Output to the deblocking filter 230.
  • the deblocking filter 230 operates in the same manner as the deblocking filter 160 of the coding device 1.
  • the deblocking filter 230 performs filter processing on the boundary of the target block pair consisting of the restoration block output from the synthesis unit 220 and the block adjacent to the restoration block, and outputs the restored block after the filtering processing to the memory 240.
  • the filter control unit 231 performs the same operation as the filter control unit 161 of the coding device 1 based on the information output from the entropy decoding unit 200.
  • the filter control unit 231 selects the boundary strength Bs by the method shown in Table 1, for example, and controls the deblocking filter 230 according to the selected boundary strength Bs.
  • the memory 240 stores the restoration block output from the deblocking filter 230 as a decoded image in frame units.
  • the memory 240 outputs a frame-by-frame decoded image to the outside of the decoding device 2.
  • the prediction unit 250 makes a prediction in block units.
  • the prediction unit 250 includes an inter-prediction unit 251, an intra-prediction unit 252, and a switching unit 253.
  • the inter-prediction unit 251 predicts the decoding target block by inter-prediction using the decoded image stored in the memory 240 as a reference image.
  • the inter-prediction unit 251 generates an inter-prediction block by performing inter-prediction using the motion vector information output from the entropy decoding unit 200, and outputs the generated inter-prediction block to the switching unit 253.
  • the inter-prediction unit 251 has a weighted bi-prediction unit 251a that generates an inter-prediction block by weighted averaging (weighted averaging) two reference images.
  • the weighted bi-prediction unit 251a generates an inter-prediction block by the above equation (1).
  • the intra prediction unit 252 refers to the reference pixel adjacent to the decoding target block among the decoded images stored in the memory 240, and predicts the decoding target block by intra prediction based on the information output from the entropy decoding unit 200. .. Then, the intra prediction unit 252 generates an intra prediction block, and outputs the generated intra prediction block to the switching unit 253.
  • the switching unit 253 switches between the inter prediction block output from the inter prediction unit 251 and the intra prediction block output from the intra prediction unit 252, and outputs one of the prediction blocks to the synthesis unit 220.
  • the decoding device 2 has an entropy decoding unit 200 that outputs a quantization conversion coefficient corresponding to the block to be decoded by decoding the coded stream, and a conversion unit 200 that outputs the entropy decoding unit 200.
  • a plurality of weight coefficients selected from a weight coefficient set consisting of a plurality of weight coefficients and an inverse quantization / inverse conversion unit 210 that performs dequantization processing and deconversion processing on the coefficients to restore the predicted residuals.
  • a weighted bi-prediction unit 251a that performs weighted averaging on the reference image to generate a prediction block of the decoding target block, and a synthesis unit that restores the decoding target block by synthesizing the restored prediction residuals and the prediction block. It has 220 and a deblocking filter 230 that performs filtering on the boundary portion between two blocks including the restored block to be decoded and the adjacent block.
  • the filter control unit 231 performs the operation as shown in FIG. That is, even if none of the above conditions (a) to (c) is satisfied, the filter control unit 231 sets the Bs value to 1 when the above condition (d) is satisfied. To do. As a result, when the weighting coefficients of the weighted double predictions of the blocks P and Q are different, it is possible to control the deblocking filter 160 to perform the filtering process.
  • FIG. 5 is a diagram showing an example of an operation flow of the filter control unit 231 according to the present embodiment.
  • step S1 the filter control unit 231 determines whether or not the intra prediction is applied to at least one of the target block pairs composed of the blocks P and Q.
  • step S3 the filter control unit 231 sets the target block. Determine if at least one of the pairs contains a non-zero conversion factor.
  • step S6 the filter control unit 231 determines whether or not the difference between the motion vectors of the target block pair is equal to or greater than the threshold value. judge.
  • a program may be provided that causes a computer to execute each process performed by the coding device 1.
  • a program may be provided that causes the computer to execute each process performed by the decoding device 2.
  • the program may be recorded on a computer-readable medium.
  • Computer-readable media can be used to install programs on a computer.
  • the computer-readable medium on which the program is recorded may be a non-transient recording medium.
  • the non-transient recording medium is not particularly limited, but may be, for example, a recording medium such as a CD-ROM or a DVD-ROM.
  • a circuit that executes each process performed by the coding device 1 may be integrated, and the coding device 1 may be configured by a semiconductor integrated circuit (chipset, SoC).
  • a circuit that executes each process performed by the decoding device 2 may be integrated, and the decoding device 2 may be configured by a semiconductor integrated circuit (chipset, SoC).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/JP2020/032782 2019-08-29 2020-08-28 符号化装置、復号装置、及びプログラム Ceased WO2021040036A1 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2021543092A JP7483725B2 (ja) 2019-08-29 2020-08-28 符号化装置、復号装置、及びプログラム
CN202080060957.9A CN114342383B (zh) 2019-08-29 2020-08-28 编码装置、解码装置及程序
US17/680,945 US12192453B2 (en) 2019-08-29 2022-02-25 Encoding device, decoding device and program
JP2024074538A JP7656120B2 (ja) 2019-08-29 2024-05-01 符号化装置、復号装置、及びプログラム
US18/965,386 US20250097419A1 (en) 2019-08-29 2024-12-02 Encoding device, decoding device and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019157240 2019-08-29
JP2019-157240 2019-08-29

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/680,945 Continuation US12192453B2 (en) 2019-08-29 2022-02-25 Encoding device, decoding device and program

Publications (1)

Publication Number Publication Date
WO2021040036A1 true WO2021040036A1 (ja) 2021-03-04

Family

ID=74683507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/032782 Ceased WO2021040036A1 (ja) 2019-08-29 2020-08-28 符号化装置、復号装置、及びプログラム

Country Status (4)

Country Link
US (2) US12192453B2 (https=)
JP (2) JP7483725B2 (https=)
CN (1) CN114342383B (https=)
WO (1) WO2021040036A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12368883B2 (en) * 2022-04-11 2025-07-22 Qualcomm Incorporated Block vector difference binarization and coding in video coding

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018123444A1 (ja) * 2016-12-28 2018-07-05 ソニー株式会社 画像処理装置及び画像処理方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008193627A (ja) * 2007-01-12 2008-08-21 Mitsubishi Electric Corp 画像符号化装置、画像復号装置、および画像符号化方法、画像復号方法
WO2011089865A1 (ja) * 2010-01-21 2011-07-28 パナソニック株式会社 画像符号化方法、画像復号方法、それらの装置、プログラムおよび集積回路
US8805100B2 (en) * 2010-06-03 2014-08-12 Sharp Kabushiki Kaisha Filter device, image decoding device, image encoding device, and filter parameter data structure
US10713805B2 (en) * 2015-07-31 2020-07-14 Versitech Limited Depth discontinuity-based method for efficient intra coding for depth videos
JP6115968B2 (ja) * 2015-08-04 2017-04-19 日本電信電話株式会社 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法、画像符号化プログラム及び画像復号プログラム
WO2017030199A1 (ja) * 2015-08-20 2017-02-23 日本放送協会 画像符号化装置、画像復号化装置、及びこれらのプログラム
JP6985287B2 (ja) * 2016-11-28 2021-12-22 日本放送協会 符号化装置、復号装置、符号化方法、及び復号方法
CN117041557A (zh) * 2016-12-07 2023-11-10 株式会社Kt 对图像信号进行解码或编码的方法和存储视频数据的设备
KR102541882B1 (ko) * 2016-12-27 2023-06-13 파나소닉 인텔렉츄얼 프로퍼티 코포레이션 오브 아메리카 부호화 장치, 복호 장치, 부호화 방법 및 복호 방법

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018123444A1 (ja) * 2016-12-28 2018-07-05 ソニー株式会社 画像処理装置及び画像処理方法

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
ANAND MEHER KOTRA ET AL.: "AHG18/Non-CE5: Boundary strength fix for coding units using BCW", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, 16TH MEETING, no. JVET-P0109-v2, 4 October 2019 (2019-10-04), pages 1 - 6, XP030216266 *
C HIA-MING TSAI ET AL.: "CE5-related: Deblocking considering prediction weights in BCW and TPM", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, 16TH MEETING, no. JVET-P0161-v2, 1 October 2019 (2019-10-01), Geneva, CH, pages 1 - 6, XP030216424 *
SHUNSUKE IWAMURA ET AL.: "[AHG18][Non-CE5] Proposed cleanup of deblocking filter process", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/ IEC JTC 1/SC 29/WG 11, 16TH MEETING, no. JVET-P0586-v2, 2 October 2019 (2019-10-02), Geneva, CH, pages 1 - 12, XP030217778 *
SHUNSUKE IWAMURA ET AL.: "Non-CE5: Boundary strength derivation of deblocking filter for transform-skipped block", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, 15TH MEETING, no. JVET-O0656, 26 June 2019 (2019-06-26), Gothenburg, SE, pages 1 - 6, XP030220181 *
XUEWEI MENG ET AL.: "AHG18 / non-CE5: Deblocking for TPM and BCW", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, 16TH MEETING, no. JVET- P0269-v2, 3 October 2019 (2019-10-03), Geneva, CH, pages 1 - 7, XP030216761 *

Also Published As

Publication number Publication date
CN114342383B (zh) 2024-05-03
US20250097419A1 (en) 2025-03-20
US12192453B2 (en) 2025-01-07
JPWO2021040036A1 (https=) 2021-03-04
JP7483725B2 (ja) 2024-05-15
JP2024087085A (ja) 2024-06-28
JP7656120B2 (ja) 2025-04-02
CN114342383A (zh) 2022-04-12
US20220182621A1 (en) 2022-06-09

Similar Documents

Publication Publication Date Title
CN105409221B (zh) 用于样本自适应偏移滤波的编码器侧决策
US12137254B2 (en) Encoding device, decoding device and program
US12015773B2 (en) Image encoding apparatus, image encoding method, image decoding apparatus, image decoding method, and non-transitory computer-readable storage medium
JP7656120B2 (ja) 符号化装置、復号装置、及びプログラム
JP7796810B2 (ja) 復号装置及び復号方法
JP7357721B2 (ja) デブロッキングフィルタ制御装置及びプログラム
JP7474772B2 (ja) 符号化装置、復号装置、及びプログラム
JP2023162377A (ja) デブロッキングフィルタ装置、復号装置、及びプログラム
JP7444599B2 (ja) イントラ予測装置、画像符号化装置、画像復号装置、及びプログラム
JP7449690B2 (ja) インター予測装置、画像符号化装置、画像復号装置、及びプログラム
WO2021045059A1 (ja) 符号化装置、復号装置、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20856873

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021543092

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20856873

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 202217010186

Country of ref document: IN