WO2020262409A1 - 符号化装置、復号装置、及びプログラム - Google Patents

符号化装置、復号装置、及びプログラム Download PDF

Info

Publication number
WO2020262409A1
WO2020262409A1 PCT/JP2020/024676 JP2020024676W WO2020262409A1 WO 2020262409 A1 WO2020262409 A1 WO 2020262409A1 JP 2020024676 W JP2020024676 W JP 2020024676W WO 2020262409 A1 WO2020262409 A1 WO 2020262409A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
conversion
unit
blocks
filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/024676
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
俊輔 岩村
市ヶ谷　敦郎
慎平 根本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Japan Broadcasting Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to KR1020217041741A priority Critical patent/KR102550503B1/ko
Priority to EP20831976.4A priority patent/EP3993415A4/en
Priority to CN202080046459.9A priority patent/CN114051727B/zh
Priority to CN202410271712.0A priority patent/CN118018731A/zh
Priority to KR1020237021738A priority patent/KR102845645B1/ko
Priority to JP2021527662A priority patent/JP7069421B2/ja
Application filed by Nippon Hoso Kyokai NHK, Japan Broadcasting Corp filed Critical Nippon Hoso Kyokai NHK
Publication of WO2020262409A1 publication Critical patent/WO2020262409A1/ja
Priority to US17/560,890 priority patent/US11647233B2/en
Anticipated expiration legal-status Critical
Priority to JP2022076156A priority patent/JP7130890B2/ja
Priority to US18/192,525 priority patent/US12137254B2/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/18—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Definitions

  • the present disclosure relates to a coding device, a decoding device, and a program.
  • HEVC High Efficiency Video Coding
  • VVC Very Video Coding
  • a deblocking filter for this purpose is adopted (see, for example, Non-Patent Document 1).
  • the filter control unit that controls the deblocking filter applies the deblocking filter to the boundary between the two blocks when the intra prediction is applied to at least one of the two blocks consisting of the coded block and its adjacent blocks. To do.
  • the filter control unit applies inter-prediction to both of the two blocks, and when the difference between the motion vectors applied to the two blocks is equal to or greater than a predetermined threshold value, the two blocks are concerned. Controls to apply a deblocking filter to the boundaries of. This is because there is a high possibility that discontinuity will occur at the block boundary when the motion vectors are different.
  • the filter control unit applies the deblocking filter to the boundary between the two blocks even if the difference between the motion vectors is less than the threshold value. To control. This is because the energy of the residual signal is distributed throughout the block due to the inverse transformation of the non-zero coefficient, so even if the motion vectors are the same, there is a high possibility that a discontinuity will occur at the boundary between the two blocks. ..
  • conversion skip that does not apply conversion to the residual signal is introduced.
  • the residual signal is scaled to obtain a conversion coefficient without performing conversion such as DCT (Discrete Cosine Transform) or DST (Discrete Sine Transform). Therefore, the increase in entropy can be suppressed by selecting the conversion skip for the residual signal including a steep edge or the residual signal having high energy only in the local region.
  • DCT Discrete Cosine Transform
  • DST Discrete Sine Transform
  • the coding device is a coding device that encodes a block obtained by dividing an image, and is a residual representing the difference between the block and the predicted block obtained by predicting the block.
  • the residual signal is obtained by performing dequantization processing and inverse conversion processing on the conversion / quantization unit that performs conversion processing and quantization processing on the signal and the conversion coefficient obtained by the conversion / quantization unit.
  • the gist is to include a deblocking filter that performs filtering on the boundary between two blocks, and a filter control unit that controls the deblocking filter based on the type of conversion processing applied to the two blocks. To do.
  • the decoding device is a decoding device that decodes a block obtained by dividing an image, and is an entropy decoding device that outputs a quantization conversion coefficient corresponding to the block by decoding a coded stream.
  • Filtering is performed on the boundary between two blocks consisting of a synthesis unit that restores the block by synthesizing the predicted block obtained by predicting the block, and a block that is adjacent to the restored block and the restored block. It is a gist to include a deblocking filter and a filter control unit that controls the deblocking filter based on the type of the inverse conversion process applied to the two blocks.
  • the gist of the program according to the third aspect is to make the computer function as a coding device according to the first aspect.
  • the gist of the program according to the fourth aspect is to make the computer function as a decoding device according to the second aspect.
  • the deblocking filter is not controlled in consideration of the conversion type including conversion skip, so that the deblocking filter is used even when the discontinuity between blocks does not occur as described above. Applicable. Therefore, there is a concern that the decoded image will be blurred, resulting in deterioration of image quality and coding efficiency.
  • the purpose of the present disclosure is to improve the image quality and coding efficiency by appropriately controlling the deblocking filter.
  • the coding device and the decoding device according to the embodiment will be described with reference to the drawings.
  • the coding device and the decoding device according to the embodiment encode and decode moving images represented by MPEG, respectively.
  • MPEG moving images represented by MPEG
  • the same or similar parts are designated by the same or similar reference numerals.
  • FIG. 1 is a diagram showing a configuration of a coding device 1 according to the present embodiment.
  • the coding device 1 is a device that encodes a coded target block obtained by dividing an image.
  • the coding apparatus 1 synthesizes a block dividing unit 100, a subtracting unit 110, a conversion / quantization unit 120, an entropy coding unit 130, an inverse quantization / inverse conversion unit 140, and the like. It has a unit 150, a deblocking filter 160, a filter control unit 161, a memory 170, and a prediction unit 180.
  • the block division unit 100 divides the input image in units of frames (or pictures) constituting the moving image into a plurality of image blocks, and outputs the image block obtained by the division to the subtraction unit 110.
  • the size of the image block is, for example, 32 ⁇ 32 pixels, 16 ⁇ 16 pixels, 8 ⁇ 8 pixels, 4 ⁇ 4 pixels, or the like.
  • the shape of the image block is not limited to a square and may be a rectangle (non-square).
  • the image block is a unit for encoding by the coding device 1 (encoding target block) and a unit for decoding by the decoding device (decoding target block). Such an image block is sometimes called a CU (Coding Unit).
  • the block division unit 100 divides the luminance signal and the color difference signal into blocks.
  • the case where the shape of the block division is the same for the luminance signal and the color difference signal will be mainly described, but the division may be controlled independently for the luminance signal and the color difference signal.
  • the luminance block and the color difference block are not particularly distinguished, they are simply called the encoding target block.
  • the subtraction unit 110 calculates a prediction residual representing a difference (error) between the coding target block output from the block division unit 100 and the prediction block obtained by predicting the coding target block by the prediction unit 180.
  • the subtraction unit 110 calculates the prediction residual by subtracting each pixel value of the prediction block from each pixel value of the block, and outputs the calculated prediction residual to the conversion / quantization unit 120.
  • a signal consisting of predicted residuals in block units will be referred to as a residual signal.
  • the conversion / quantization unit 120 performs conversion processing and quantization processing in block units.
  • the conversion / quantization unit 120 includes a conversion unit 121 and a quantization unit 122.
  • the conversion unit 121 performs conversion processing on the residual signal output from the subtraction unit 110, calculates a conversion coefficient for each frequency component, and outputs the calculated conversion coefficient to the quantization unit 122.
  • the conversion process (conversion) is a process of converting a signal in the pixel region into a signal in the frequency domain. Reve conversion (KLT: Karhunen-Loeve Transform), conversion of them into integers, etc.
  • the conversion unit 121 performs conversion processing of a type selected from a plurality of types of conversion processing including conversion skip that does not perform conversion on the residual signal. Specifically, the conversion unit 121 selects the type of conversion processing to be applied to the residual signal in each of the horizontal direction and the vertical direction. For example, among the candidates for conversions such as DCT2, DST7, and DCT8 (including conversions obtained by converting them into integers), which conversion is to be applied is selected. The conversion unit 121 outputs conversion type information indicating the selected conversion processing type to the entropy coding unit 130 and the filter control unit 161.
  • the conversion unit 121 can select conversion skip. For example, the conversion unit 121 selects conversion skip for a residual signal including a steep edge or a residual signal having high energy only in a local region. When conversion skip is selected, the conversion unit 121 outputs a residual signal adjusted by scaling processing or the like as a conversion coefficient without performing conversion such as DCT or DST.
  • the conversion unit 121 may be able to apply the conversion skip to only one of the horizontal direction and the vertical direction, or may be able to apply the conversion skip to both. In the following, the case where the conversion skip is applied to both the horizontal direction and the vertical direction will be mainly described.
  • the conversion unit 121 selects the type of conversion processing by, for example, optimizing (that is, RD optimization) so that the linear combination of the amount of generated information and the signal distortion for each coded block is minimized.
  • optimizing that is, RD optimization
  • the conversion processing type may be selected based on the block size, division shape, and prediction processing type of the coded block.
  • the quantization unit 122 quantizes the conversion coefficient output from the conversion unit 121 using the quantization parameter (Qp) and the quantization matrix, and the quantization unit is the entropy coding unit 130 and the inverse quantization / inverse conversion. Output to unit 140.
  • the quantization parameter (Qp) is a parameter commonly applied to each conversion coefficient in the block, and is a parameter that determines the roughness of quantization.
  • the quantization matrix is a matrix having a quantization value as an element when quantizing each conversion coefficient.
  • the entropy coding unit 130 performs entropy coding on the conversion coefficient output from the quantization unit 122, performs data compression to generate a coded stream (bit stream), and encodes the coded stream in the coding device 1. Output to the outside of.
  • a Huffman code a CABAC (Context-based Adaptive Binary Alternative Coding; context-adaptive binary arithmetic code) or the like can be used.
  • the entropy coding unit 130 acquires information such as the size and shape of each coded block from the block dividing unit 100, obtains conversion type information from the conversion unit 121, and obtains information related to prediction from the prediction unit 180 (for example, prediction). Information on the mode and motion vector) is acquired, and this information is also encoded.
  • Inverse quantization / inverse conversion unit 140 performs inverse quantization processing and inverse conversion processing in block units.
  • the inverse quantization / inverse conversion unit 140 includes an inverse quantization unit 141 and an inverse conversion unit 142.
  • the inverse quantization unit 141 performs the inverse quantization process corresponding to the quantization process performed by the quantization unit 122. Specifically, the inverse quantization unit 141 restores and restores the conversion coefficient by inversely quantizing the conversion coefficient output from the quantization unit 122 using the quantization parameter (Qp) and the quantization matrix. The converted conversion coefficient is output to the inverse conversion unit 142.
  • the inverse conversion unit 142 performs an inverse conversion process corresponding to the conversion process performed by the conversion unit 121. For example, when the conversion unit 121 performs the DCT, the inverse conversion unit 142 performs the inverse DCT. The inverse conversion unit 142 performs an inverse conversion process on the conversion coefficient output from the inverse quantization unit 141 to restore the residual signal, and outputs the restored residual signal, which is the restored residual signal, to the synthesis unit 150. To do. However, when the conversion unit 121 applies the conversion skip, the inverse conversion unit 142 performs the reverse processing of the coefficient adjustment performed by the conversion unit 121 without performing the reverse conversion processing.
  • the synthesizing unit 150 synthesizes the restored residual signal output from the inverse conversion unit 142 with the prediction block output from the prediction unit 180 in pixel units.
  • the synthesizing unit 150 adds each pixel value of the restored residual signal and each pixel value of the predicted block to restore (decode) the coded block, and deblocks the decoded image (restored block) of the restored block unit. Output to 160.
  • the deblocking filter 160 performs a deblocking filter process that is a filter process on the boundary between two blocks (hereinafter, referred to as "filtered block pair") composed of a restore block and a block adjacent to the restore block, and deblocking.
  • the restored block after filtering is output to the memory 170.
  • the deblocking filter process is a process for reducing signal deterioration caused by block-based processing, and is a filter process for smoothing a signal gap at the boundary of a pair of blocks to be filtered.
  • the deblocking filter 160 is generally configured as a low-pass filter that moderates signal fluctuations.
  • the filter control unit 161 controls the deblocking filter 160. Specifically, the filter control unit 161 controls whether or not the deblocking filter processing is performed on the block target block pair, and the filter strength (BS: Boundary Strength) of the deblocking filter 160.
  • the filter strength BS refers to a parameter of how much pixel correction is allowed by the deblocking filter processing.
  • the control of whether or not the deblocking filter processing is performed can be regarded as the control of whether the filter intensity BS is 1 or more or zero.
  • the filter control unit 161 is based on the fluctuation of the pixel value in the region near the boundary of the block target block pair, the prediction mode, the quantization parameter, and the motion vector value used for the motion compensation prediction (inter-prediction). Controls the deblocking filter 160. In the present embodiment, the filter control unit 161 further controls the deblocking filter 160 based on whether or not the type of conversion processing applied to the filter target block pair is conversion skip.
  • FIG. 2 is a diagram showing an operation example of the deblocking filter 160 according to the present embodiment.
  • the block Q is a restoration block corresponding to the block to be encoded
  • the block P is a restoration block adjacent to the block Q.
  • the block size for which the deblocking filter 160 performs the deblocking filter processing is 8 ⁇ 8 pixels.
  • the filter control unit 161 obtains the filter strength BS based on, for example, Table 1 below. In the present embodiment, the value of the filter strength BS is one of 0, 1, and 2.
  • the filter control unit 161 sets the BS value to 2 when the intra prediction is applied to at least one of the blocks P and Q.
  • the filter control unit 161 applies motion compensation prediction (inter prediction) to both blocks P and Q, and at least one of the following conditions (a), (b), and (c) is satisfied. If it is satisfied, the BS value is set to 1, and in other cases, the BS value is set to 0.
  • inter prediction motion compensation prediction
  • the absolute value of the difference between the motion vectors of blocks P and Q is equal to or greater than the threshold value (for example, 1 pixel).
  • At least one of blocks P and Q contains a significant conversion coefficient (that is, a non-zero coefficient), and the block containing the non-zero coefficient is not a conversion skip block.
  • the filter control unit 161 controls the deblocking filter 160 so that the deblocking filter processing is not performed when the value of the filter strength BS is 0.
  • the vertical block boundary shown in FIG. 2 will be described as an example.
  • the filter control unit 161 may control the deblocking filter 160 so as to perform the deblocking filter processing only when the following equation (1) is satisfied.
  • the filter control unit 161 may apply a strong filter when all of the following conditional expressions (2) to (7) are satisfied, and apply a weak filter in other cases. Good.
  • the values of the threshold values ⁇ and t C change according to the mean value Qav of the quantization parameters of the adjacent blocks P and Q.
  • the memory 170 stores the restoration block output from the deblocking filter 160 as a decoded image in frame units.
  • the memory 170 outputs the stored decoded image to the prediction unit 180.
  • the prediction unit 180 generates a prediction block corresponding to the coded target block by performing prediction processing in block units, and outputs the generated prediction block to the subtraction unit 110 and the synthesis unit 150.
  • the prediction unit 180 includes an inter-prediction unit 181, an intra-prediction unit 182, and a switching unit 183.
  • the inter-prediction unit 181 uses the decoded image stored in the memory 170 as a reference image, calculates a motion vector by a method such as block matching, predicts a block to be encoded, and generates an inter-prediction block.
  • the inter-prediction block is output to the switching unit 183.
  • the inter-prediction unit 181 selects the optimum inter-prediction method from inter-prediction using a plurality of reference images (typically bi-prediction) and inter-prediction using one reference image (one-way prediction). Inter-prediction is performed using the selected inter-prediction method.
  • the inter-prediction unit 181 outputs information (motion vector, etc.) related to the inter-prediction to the entropy coding unit 130 and the filter control unit 161.
  • the intra prediction unit 182 selects the optimum intra prediction mode to be applied to the coded target block from a plurality of intra prediction modes, and predicts the coded target block using the selected intra prediction mode.
  • the intra prediction unit 182 generates an intra prediction block by referring to the decoded pixel value adjacent to the coded target block among the decoded images stored in the memory 170, and outputs the generated intra prediction block to the switching unit 183. To do. Further, the intra prediction unit 182 outputs information regarding the selected intra prediction mode to the entropy coding unit 130 and the filter control unit 161.
  • the switching unit 183 switches between the inter prediction block output from the inter prediction unit 181 and the intra prediction block output from the intra prediction unit 182, and outputs one of the prediction blocks to the subtraction unit 110 and the synthesis unit 150.
  • the coding apparatus 1 performs conversion processing and quantization processing on the residual signal representing the difference between the coding target block and the prediction block obtained by predicting the coding target block.
  • Two blocks (filtered block pair) consisting of a compositing unit 150 that restores the coded block by synthesizing the restored residual signal and the predicted block, and a block that is adjacent to the restored block and the restored block.
  • Has a deblocking filter 160 that performs filtering on the boundary.
  • the filter control unit 161 filters the filter target when the intra prediction is applied to at least one of the filter target block pairs consisting of the restore block corresponding to the coded target block and the block adjacent to the restore block. Apply a deblocking filter to the boundaries of block pairs. This is because there is a high possibility of discontinuity at the block boundaries when intra-prediction is applied.
  • the filter control unit 161 is in the case where the inter-prediction is applied to all the filter target block pairs and the difference of the motion vectors applied to the filter target block pairs is equal to or more than a predetermined threshold value.
  • the deblocking filter is applied to the boundary of the block target block pair. This is because there is a high possibility that discontinuity will occur at the block boundary when the motion vectors are different.
  • the filter control unit 161 deblocks the boundary of the filter target block pair even if the difference between the motion vectors is less than the threshold value. Apply a blocking filter. This is because the energy of the residual signal is distributed throughout the block due to the inverse transformation of the non-zero coefficient, so even if the motion vectors are the same, there is a high possibility that a discontinuity will occur at the boundary between the two blocks. ..
  • the non-zero coefficient is scaled if the conversion skip is applied to the block in which the non-zero coefficient exists. After adjusting such as, it is output as it is. Therefore, energy is not distributed throughout the blocks, and discontinuity between blocks does not occur.
  • the filter control unit 161 applies the conversion skip to the block in which the non-zero coefficient exists in at least one of the filter target block pairs and the non-zero coefficient exists in the filter target block pair. If so, the deblocking filter 160 is controlled so that the deblocking filter processing is not applied. This eliminates the need for deblocking filter processing when discontinuity between blocks does not occur, which causes blurring of the decoded image, deterioration of image quality, and deterioration of coding efficiency. Can be prevented.
  • FIG. 3 is a diagram showing a specific example of the operation of the filter control unit 161 according to the present embodiment.
  • the block P and the block Q form a block target block pair, and the inter-prediction is applied to each block.
  • the arrow in the block in FIG. 3 represents a motion vector, and it is assumed that the motion vector of the block P and the motion vector of the block Q are the same.
  • the filter control unit 161 does not apply the deblocking filter processing to the boundary of the filter target block pair when there is no nonzero coefficient in any of the filter target block pairs.
  • the filter control unit 161 has a non-zero coefficient in at least one of the blocked block pairs to be filtered, and the conversion skip is not applied to the block in which the non-zero coefficient exists. , Apply deblocking filtering to the boundaries of filtered block pairs. Specifically, since the filter control unit 161 has a non-zero coefficient in the block P and the conversion skip is not applied to the block P, the filter control unit 161 applies a deblocking filter process to the boundary of the block target block pair.
  • the filter control unit 161 has a non-zero coefficient in at least one of the blocked block pairs to be filtered, and conversion skip is applied to the block in which the non-zero coefficient exists. , Do not apply deblocking filtering to the boundaries of filtered block pairs. Specifically, since the filter control unit 161 has a non-zero coefficient in the block P and a conversion skip (TranSkip) is applied to the block P, the filter control unit 161 performs a deblocking filter process on the boundary of the block pair to be filtered. Apply.
  • the filter control unit 161 when the filter control unit 161 has a non-zero coefficient in both of the blocked block pairs to be filtered and the conversion skip is not applied to the block in which the non-zero coefficient exists.
  • Apply deblocking filtering to the boundaries of filtered block pairs Specifically, the filter control unit 161 has a non-zero coefficient in both blocks P and Q, a conversion skip (TranSkip) is applied to the block P, and a conversion skip (TranSkip) is applied to the block Q. Therefore, the deblocking filter processing is applied to the boundary of the block target block pair to be filtered.
  • FIG. 4 is a diagram showing a configuration of a decoding device 2 according to the present embodiment.
  • the decoding device 2 is a device that decodes the decoding target block from the coded stream.
  • the decoding device 2 predicts the entropy decoding unit 200, the inverse quantization / inverse conversion unit 210, the synthesis unit 220, the deblocking filter 230, the filter control unit 231 and the memory 240. It has a part 250.
  • the entropy decoding unit 200 decodes the coded stream generated by the coding device 1 and decodes various signaling information. Specifically, the entropy decoding unit 200 acquires information related to the conversion process applied to the decoding target block (for example, conversion type information), and outputs the acquired information to the inverse conversion unit 212 and the filter control unit 231. Further, the entropy decoding unit 200 acquires information related to the prediction applied to the decoding target block (for example, prediction type information, motion vector information), and outputs the acquired information to the prediction unit 250 and the filter control unit 231.
  • the entropy decoding unit 200 decodes the coded stream, acquires the quantized conversion coefficient, and outputs the acquired conversion coefficient to the inverse quantization / inverse conversion unit 210 (inverse quantization unit 211).
  • the inverse quantization / inverse conversion unit 210 performs the inverse quantization process and the inverse conversion process in block units.
  • the inverse quantization / inverse conversion unit 210 includes an inverse quantization unit 211 and an inverse conversion unit 212.
  • the inverse quantization unit 211 performs the inverse quantization process corresponding to the quantization process performed by the quantization unit 122 of the coding apparatus 1.
  • the inverse quantization unit 211 restores the conversion coefficient of the decoding target block by inversely quantizing the quantization conversion coefficient output from the entropy decoding unit 200 using the quantization parameter (Qp) and the quantization matrix. , The restored conversion coefficient is output to the inverse conversion unit 212.
  • the inverse conversion unit 212 performs an inverse conversion process corresponding to the conversion process performed by the conversion unit 121 of the encoding device 1.
  • the inverse conversion unit 212 performs inverse conversion processing on the conversion coefficient output from the inverse quantization unit 211 to restore the residual signal, and outputs the restored residual signal (restored residual signal) to the synthesis unit 220.
  • the inverse conversion unit 212 is the inverse of a type selected from a plurality of types of inverse conversion processing including conversion skip that does not perform inverse conversion based on the conversion type information output from the entropy decoding unit 200. Perform conversion processing. In the case of conversion skip, the inverse conversion unit 212 does not perform the inverse conversion processing, but performs the inverse processing of the coefficient adjustment performed by the conversion unit 121 of the coding apparatus 1.
  • the synthesis unit 220 restores (decodes) the decoding target block by synthesizing the residual signal output from the inverse conversion unit 212 and the prediction block output from the prediction unit 250 on a pixel-by-pixel basis, and restores (decodes) the restored block. Output to the deblocking filter 230.
  • the deblocking filter 230 operates in the same manner as the deblocking filter 160 of the coding device 1.
  • the deblocking filter 230 performs deblocking filter processing on the boundary of the filter target block pair consisting of the restoration block output from the synthesis unit 220 and the block adjacent to the restoration block, and stores the restoration block after the deblocking filter processing in memory. Output to 240.
  • the filter control unit 231 performs the same operation as the filter control unit 161 of the coding device 1 based on the information output from the entropy decoding unit 200.
  • the filter control unit 231 selects the filter intensity BS by the method shown in Table 1, for example, and controls the deblocking filter 230 according to the selected filter intensity BS.
  • the memory 240 stores the restoration block output from the deblocking filter 230 as a decoded image in frame units.
  • the memory 240 outputs a frame-by-frame decoded image to the outside of the decoding device 2.
  • the prediction unit 250 makes a prediction in block units.
  • the prediction unit 250 includes an inter-prediction unit 251, an intra-prediction unit 252, and a switching unit 253.
  • the inter-prediction unit 251 uses the decoded image stored in the memory 240 as a reference image to predict the decoding target block by inter-prediction.
  • the inter-prediction unit 251 generates an inter-prediction block by performing inter-prediction using the motion vector information output from the entropy decoding unit 200, and outputs the generated inter-prediction block to the switching unit 253.
  • the intra prediction unit 252 refers to the reference pixel adjacent to the decoding target block among the decoded images stored in the memory 240, and predicts the decoding target block by intra prediction based on the information output from the entropy decoding unit 200. .. Then, the intra prediction unit 252 generates an intra prediction block, and outputs the generated intra prediction block to the switching unit 253.
  • the switching unit 253 switches between the inter prediction block output from the inter prediction unit 251 and the intra prediction block output from the intra prediction unit 252, and outputs one of the prediction blocks to the synthesis unit 220.
  • the decoding device 2 has an entropy decoding unit 200 that outputs a quantization conversion coefficient corresponding to the block to be decoded by decoding the coded stream, and a conversion unit 200 that outputs the entropy decoding unit 200.
  • the inverse quantization / inverse conversion unit 210 that restores the residual signal by performing the inverse quantization processing and the inverse conversion processing on the coefficient, and the prediction block obtained by predicting the restored residual signal and the block to be decoded.
  • a synthesizing unit 220 that restores a block by synthesizing a block, a deblocking filter 230 that filters the boundary of a filter target block pair consisting of the restored block and a block adjacent to the restored block, and a filter target block pair. It has a filter control unit 231 that controls the deblocking filter 230 based on the type of inverse conversion processing applied to.
  • the filter control unit 231 performs the operation as shown in FIG. Specifically, when the filter control unit 231 has a non-zero coefficient in at least one of the filter target block pairs and the conversion skip is not applied to the block in which the non-zero coefficient exists among the filter target block pairs. , The deblocking filter 230 is controlled so as to perform the deblocking filter processing.
  • the filter control unit 231 deblocks when the conversion skip is applied to the block in which the non-zero coefficient exists in at least one of the filter target block pairs and the non-zero coefficient exists in the filter target block pair.
  • the deblocking filter 230 is controlled so that the filtering process is not performed. This eliminates the need for deblocking filter processing when discontinuity between blocks does not occur, which causes blurring of the decoded image, deterioration of image quality, and deterioration of coding efficiency. Can be prevented.
  • FIG. 5 is a diagram showing an operation example of the filter control unit 231 according to the present embodiment.
  • step S1 the filter control unit 231 determines whether or not the intra prediction is applied to at least one of the filtered target block pairs consisting of blocks P and Q.
  • step S3 the filter control unit 231 determines whether or not the difference between the motion vectors of the target block pairs is equal to or greater than the threshold value. To do.
  • a program may be provided that causes a computer to execute each process performed by the coding apparatus 1.
  • a program may be provided that causes the computer to execute each process performed by the decoding device 2.
  • the program may be recorded on a computer-readable medium.
  • Computer-readable media can be used to install programs on a computer.
  • the computer-readable medium on which the program is recorded may be a non-transient recording medium.
  • the non-transient recording medium is not particularly limited, but may be, for example, a recording medium such as a CD-ROM or a DVD-ROM.
  • a circuit that executes each process performed by the coding device 1 may be integrated, and the coding device 1 may be configured by a semiconductor integrated circuit (chipset, SoC).
  • a circuit that executes each process performed by the decoding device 2 may be integrated, and the decoding device 2 may be configured by a semiconductor integrated circuit (chipset, SoC).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Vehicle Body Suspensions (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
PCT/JP2020/024676 2019-06-25 2020-06-23 符号化装置、復号装置、及びプログラム Ceased WO2020262409A1 (ja)

Priority Applications (9)

Application Number Priority Date Filing Date Title
EP20831976.4A EP3993415A4 (en) 2019-06-25 2020-06-23 Encoding device, decoding device, and program
CN202080046459.9A CN114051727B (zh) 2019-06-25 2020-06-23 编码装置、解码装置和计算机可读存储介质
CN202410271712.0A CN118018731A (zh) 2019-06-25 2020-06-23 编码装置、解码装置和计算机可读存储介质
KR1020237021738A KR102845645B1 (ko) 2019-06-25 2020-06-23 부호화 장치, 복호 장치, 및 프로그램
JP2021527662A JP7069421B2 (ja) 2019-06-25 2020-06-23 符号化装置、復号装置、及びプログラム
KR1020217041741A KR102550503B1 (ko) 2019-06-25 2020-06-23 부호화 장치, 복호 장치, 및 프로그램
US17/560,890 US11647233B2 (en) 2019-06-25 2021-12-23 Encoding device, decoding device and program
JP2022076156A JP7130890B2 (ja) 2019-06-25 2022-05-02 符号化装置、復号装置、及びプログラム
US18/192,525 US12137254B2 (en) 2019-06-25 2023-03-29 Encoding device, decoding device and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019117924 2019-06-25
JP2019-117924 2019-06-25

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/560,890 Continuation US11647233B2 (en) 2019-06-25 2021-12-23 Encoding device, decoding device and program

Publications (1)

Publication Number Publication Date
WO2020262409A1 true WO2020262409A1 (ja) 2020-12-30

Family

ID=74060609

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/024676 Ceased WO2020262409A1 (ja) 2019-06-25 2020-06-23 符号化装置、復号装置、及びプログラム

Country Status (6)

Country Link
US (2) US11647233B2 (https=)
EP (1) EP3993415A4 (https=)
JP (2) JP7069421B2 (https=)
KR (2) KR102550503B1 (https=)
CN (2) CN118018731A (https=)
WO (1) WO2020262409A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017030199A1 (ja) * 2015-08-20 2017-02-23 日本放送協会 画像符号化装置、画像復号化装置、及びこれらのプログラム
KR101716270B1 (ko) * 2015-12-03 2017-03-14 한국과학기술원 전방 지면 상태 추정 장치 및 방법
KR102550503B1 (ko) * 2019-06-25 2023-06-30 닛폰 호소 교카이 부호화 장치, 복호 장치, 및 프로그램

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014002897A1 (ja) * 2012-06-29 2014-01-03 ソニー株式会社 画像処理装置および方法
WO2018123444A1 (ja) * 2016-12-28 2018-07-05 ソニー株式会社 画像処理装置及び画像処理方法
JP2019117924A (ja) 2017-12-27 2019-07-18 キヤノントッキ株式会社 静電チャック、成膜装置、基板吸着方法、成膜方法、及び電子デバイスの製造方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110125153A (ko) * 2010-05-12 2011-11-18 에스케이 텔레콤주식회사 영상의 필터링 방법 및 장치와 그를 이용한 부호화/복호화를 위한 방법 및 장치
KR20140005296A (ko) * 2011-06-10 2014-01-14 미디어텍 인크. 스케일러블 비디오 코딩의 방법 및 장치
WO2012167711A1 (en) * 2011-06-10 2012-12-13 Mediatek Inc. Method and apparatus of scalable video coding
AU2014202921B2 (en) * 2014-05-29 2017-02-02 Canon Kabushiki Kaisha Method, apparatus and system for de-blocking a block of video samples
KR102294016B1 (ko) * 2014-12-05 2021-08-25 성균관대학교산학협력단 변환생략을 참조하는 디블록킹 필터링을 이용한 영상의 부호화/복호화 방법 및 이를 이용하는 장치
TW201642655A (zh) * 2015-04-21 2016-12-01 Ｖｉｄ衡器股份有限公司 基於藝術意向之視訊編碼
US9967577B2 (en) * 2015-08-31 2018-05-08 Microsoft Technology Licensing, Llc Acceleration interface for video decoding
US11902510B2 (en) * 2019-05-30 2024-02-13 Hfi Innovation Inc. Video processing methods and apparatuses for determining deblocking filter decision in video coding systems
KR102550503B1 (ko) * 2019-06-25 2023-06-30 닛폰 호소 교카이 부호화 장치, 복호 장치, 및 프로그램

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014002897A1 (ja) * 2012-06-29 2014-01-03 ソニー株式会社 画像処理装置および方法
WO2018123444A1 (ja) * 2016-12-28 2018-07-05 ソニー株式会社 画像処理装置及び画像処理方法
JP2019117924A (ja) 2017-12-27 2019-07-18 キヤノントッキ株式会社 静電チャック、成膜装置、基板吸着方法、成膜方法、及び電子デバイスの製造方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BENJAMIN BROSS ET AL.: "Versatile Video Coding (Draft 5)", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/ WG 11, (VERSION 7), 14TH MEETING, no. JVET-N1001-v7, 29 May 2019 (2019-05-29), Geneva, CH, pages 265 - 266, XP030205196 *
SHUNSUKE IWAMURA ET AL.: "Non-CE5: Boundary strength derivation of deblocking filter for transform-skipped block", JOINT VIDEO EXPERTS TEAM (JVET) OF ITU-T SG 16 WP 3 AND ISO/IEC JTC 1/SC 29/WG 11, 15TH MEETING, no. JVET-O0656, 26 June 2019 (2019-06-26), Gothenburg, SE, pages 1 - 6, XP030220179 *

Also Published As

Publication number Publication date
US20230239514A1 (en) 2023-07-27
CN114051727B (zh) 2024-03-29
US11647233B2 (en) 2023-05-09
JP7069421B2 (ja) 2022-05-17
EP3993415A4 (en) 2023-05-31
CN114051727A (zh) 2022-02-15
KR102550503B1 (ko) 2023-06-30
KR20230098729A (ko) 2023-07-04
EP3993415A1 (en) 2022-05-04
JP2022093657A (ja) 2022-06-23
US20220116665A1 (en) 2022-04-14
KR102845645B1 (ko) 2025-08-12
KR20220024120A (ko) 2022-03-03
JPWO2020262409A1 (https=) 2020-12-30
JP7130890B2 (ja) 2022-09-05
US12137254B2 (en) 2024-11-05
CN118018731A (zh) 2024-05-10

Similar Documents

Publication Publication Date Title
JP7130890B2 (ja) 符号化装置、復号装置、及びプログラム
JP7656120B2 (ja) 符号化装置、復号装置、及びプログラム
JP7796810B2 (ja) 復号装置及び復号方法
JP2025124883A (ja) デブロッキングフィルタ装置、復号装置、及びプログラム
JP7080424B2 (ja) デブロッキングフィルタ制御装置及びプログラム
JP7474772B2 (ja) 符号化装置、復号装置、及びプログラム
JP7444599B2 (ja) イントラ予測装置、画像符号化装置、画像復号装置、及びプログラム
JP7449690B2 (ja) インター予測装置、画像符号化装置、画像復号装置、及びプログラム
WO2021045059A1 (ja) 符号化装置、復号装置、及びプログラム
WO2021251400A1 (ja) 復号装置及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20831976

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021527662

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020831976

Country of ref document: EP

Effective date: 20220125