WO2015070772A1 - Method of filter control for block-based adaptive loop filtering - Google Patents
Method of filter control for block-based adaptive loop filtering Download PDFInfo
- Publication number
- WO2015070772A1 WO2015070772A1 PCT/CN2014/090978 CN2014090978W WO2015070772A1 WO 2015070772 A1 WO2015070772 A1 WO 2015070772A1 CN 2014090978 W CN2014090978 W CN 2014090978W WO 2015070772 A1 WO2015070772 A1 WO 2015070772A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- alf
- mode
- current image
- image unit
- video data
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/18—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
- H04N19/68—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience involving the insertion of resynchronisation markers into the bitstream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Definitions
- the present invention relates to video coding.
- the present invention relates to filter On/Off control for block-based Adaptive Loop Filtering (ALF) for video coding.
- ALF Adaptive Loop Filtering
- High efficiency video coding is a new-generation international video coding standard developed by the Joint Collaborative Team on Video Coding (JCT-VC) .
- JCT-VC Joint Collaborative Team on Video Coding
- the standard is based on the conventional hybrid coding approach.
- a picture is divided into multiple non-overlapped Largest Coding Units (LCUs) , also called Coding Tree Blocks (CTBs) .
- LCUs Largest Coding Unit
- CTBs Coding Tree Blocks
- the pixel values of a Coding Unit (CU) are predicted spatially or temporally.
- the resulting residual signal is transformed for further redundancy removal.
- the transform coefficients are then quantized and entropy coded.
- the reconstructed picture is recovered from the decoded residual signal and the prediction signal. After reconstruction, the reconstructed picture is further processed by in-loop filtering to reduce coding artifacts.
- Adaptive Loop Filter Prior to the adoption of HEVC Test Model 7 (HM-7) , an in-loop filtering technique, named Adaptive Loop Filter (ALF) , was included in the test model.
- ALF uses Wiener filtering techniques to derive filter coefficients.
- multiple filters may be used for different picture regions.
- the coefficients are coded in Adaptation Parameter Set (APS) , and On/Off control flags are coded in CTU level syntax elements.
- the filter shape is 9x7 cross with a 3x3 square in the center as shown in Fig. 1. Due to the symmetry property of this 9x7 filter, only half of the coefficients need to be coded.
- Fig. 2 illustrates an exemplary adaptive Inter/Intra video coding system incorporating in-loop processing.
- the input picture is coded by either Intra Prediction (210) or Inter Prediction (i.e., Motion Estimation/Motion Compensation 212) .
- Motion Estimation (ME) /Motion Compensation (MC) 212 is used to provide prediction data based on video data from other picture or pictures.
- Switch 214 selects Intra Prediction 210 or inter-prediction data and the selected prediction data is supplied to Adder 216 to form prediction errors, also called residues.
- the prediction error is then processed by Transform/Quantization (T/Q) 218.
- T/Q Transform/Quantization
- the transformed and quantized residues are then coded by Entropy Encoder 222 to form a video bitstream corresponding to the compressed video data.
- the bitstream associated with the residues is then packed with side information such as motion, mode, and other information associated with the image area.
- the side information may also be subject to entropy coding to reduce required bandwidth.
- a reconstructed block may be used to form Intra prediction of spatial neighboring block. Therefore, a reconstructed block from REC 228 may be provided to Intra Prediction 210.
- an inter-prediction mode is used, a reference picture or pictures have to be reconstructed at the encoder end as well.
- IQ/IT Inverse Quantization/Inverse Transform
- REC Reconstruction
- the reconstructed video data can be stored in Reference Picture Buffer 234 and used for prediction of other frames.
- incoming video data undergoes a series of processing in the encoding system.
- the reconstructed video data from REC 228 may be subject to various impairments due to a series of processing. Accordingly, various in-loop processing is applied to the reconstructed video data before the reconstructed video data are stored in the Reference Picture Buffer 234 in order to improve video quality.
- In-loop filtering including deblocking (DF) processing module 230, Sample Adaptive Offset (SAO) processing module 231, and Adaptive Loop Filter (ALF) 232 have been developed to enhance picture quality.
- the in-loop filter information may have to be incorporated in the bitstream so that a decoder can properly recover the required information.
- DF deblocking
- SAO Sample Adaptive Offset
- ALF Adaptive Loop Filter
- ALF 232 is applied after the reconstructed video from REC 228 is processed by DF 230 and SAO 231. Nevertheless, ALF 232 may also be applied to the reconstructed video from REC 228 or ALF 232 is applied after the reconstructed video from REC 228 is processed by DF 230.
- each pixel of the video data associated with the reconstructed current image unit is classified into a first group and a second group. ALF is then applied to these pixels belonging to the first group. For pixels in the second group, ALF is not applied.
- the image unit may correspond to one coding tree block (CTB) or one coding tree unit (CTU) .
- Classification is applied to the video data associated with the reconstructed current image unit on a pixel by pixel basis. Furthermore, the classification utilizes reconstruction video data available to both the encoder side and the decoder side so that the sample-based On/Off control can be achieved implicitly without the need to signal the On/Off control for each pixel.
- the classification process can be selected from a group consisting of linear filtering, non-linear filtering, edge detection, difference or similarity between the to-be-classified pixel and neighboring pixels, intensity, edge offset (EO) classifications, band offset (BO) classification, magnitude of residual, and any combination thereof.
- the classification process selected can be signaled in the sequence level, picture level, slice level or block level of the coded bitstream. Side information associated with the classification can be signaled explicitly or determined implicitly.
- the adaptive loop filtering with implicit sample-based On/Off control can also be incorporated into a video coding system that utilizes block ALF On/Off control.
- an ALF mode may be used to indicate the ALF mode used for the block or blocks in a corresponding sequence, picture, slice or block.
- the ALF mode is selected from a group consisting of an ALF-On mode, an ALF-Off mode and an ALF Implicit On/Off mode.
- the adaptive loop filtering with implicit sample-based On/Off control is applied only if the ALF implicit On/Off mode is selected. If the ALF-Off mode is selected, the adaptive loop filter is skipped for all pixels of the video data associated with the reconstructed current image unit. If the ALF-On mode is selected, applying the adaptive loop filter to all samples in the video data associated with the reconstructed current image unit.
- Fig. 1 illustrates the filter shape corresponding to a 9x7 cross with a 3x3 square in the center.
- Fig. 2 illustrates an example of an Inter/Intra video coding system incorporating in-loop processing.
- Fig. 3A illustrates an example of high-pass linear filter used for classification.
- Fig. 3B illustrates an example of low-pass linear filter used for classification.
- Fig. 3C and Fig. 3D illustrate two examples of Sobel filter used for classification.
- Figs. 3E-3F illustrate two examples of one-dimensional filter corresponding to similarity between to-be-classified pixel and neighboring pixels by comparing the to-be-classified pixel and two neighboring pixels for classification.
- Fig. 3G illustrates an example of two-dimensional filter corresponding to similarity between to-be-classified pixel and neighboring pixels by comparing the to-be-classified pixel and four neighboring pixels for classification.
- Figs. 4A-D illustrates edge offset (EO) pixel classification based on a 3x3 window, with four configurations corresponding to 0°, 90°, 135°, and 45° respectively.
- EO edge offset
- Fig. 5 illustrates an exemplary flowchart of video coding system incorporating adaptive loop filtering with implicit sample-based On/Off control for reconstructed video to improve the performance according to an embodiment of the present invention.
- On/Off control flags are coded in CTU level to indicate whether ALF is enabled (i.e., ALF-enabled) or disabled (i.e., ALF-disabled) for each CTU.
- On/Off control flag is enabled (i.e., ALF-enabled being selected)
- all of pixels in one CTB are filtered by ALF.
- On/Off control flag is disabled (i.e., ALF-disabled being used) , all of the pixels are not filtered.
- an implicit pixel-level On/Off control means is disclosed when ALF is enabled.
- the decision regarding whether to apply the adaptive loop filter is made for individual pixels of the block instead of all pixels in the block.
- the decision is made implicitly based on reconstructed data commonly available to both the encoder side and the decoder side. Therefore, there is no need to signal the On/Off decision for individual pixels.
- a classification means when ALF is enabled for a current CTB, classifies pixels in a CTB into two groups, a filter-On group and a filter-Off group based on reconstructed samples or processed reconstructed samples available at both the encoder and the decoder. Only pixels in the filter-On group will be filtered by ALF, and pixels in the filter-Off group are not filtered.
- the processed reconstructed samples may correspond to the output data after applying deblocking to the reconstructed samples.
- the processed reconstructed samples may also correspond to the output data after applying deblocking followed by SAO (Sample Adaptive Offset) to the reconstructed samples.
- SAO Sample Adaptive Offset
- the classification is derived based on reconstructed samples available at both the encoder and the decoder, there is no need to transmit information associated with the pixel-based On/Off control. Accordingly, the pixel-based On/Off control is determined implicitly.
- This implicit pixel On/Off method can be integrated into the case for ALF-enabled. That is, if ALF-enabled is used, then implicit pixel On/Off is always applied.
- the implicit pixel On/Off can be added as a new mode (e.g., ALF-implicit On/Off) to the system supporting block based ALF, where the whole block is process by ALF or the whole block is not processed by ALF.
- the implicit pixel On/Off mode is applied only when ALF-implicit On/Off mode is selected for current CTB.
- ALF-enabled mode all of pixels are filtered by ALF. In this case, there are a total of three modes, i.e., ALF-enabled, ALF-implicit On/Off, and ALF-disabled modes for each CTB.
- an implicit pixel On/Off classification is integrated into ALF process.
- the classification method can be any of the following methods, including linear filter, edge detection, difference or similarity between to-be-classified pixel and neighboring pixels, intensity, the classifications in SAO, the magnitude of residual, and so on. Any combination of the classification methods may also be used.
- Some exemplary filters are shown as follows. A high-pass linear filter as shown in Fig. 3A or a low-pass linear filter as shown in Fig. 3B can be used.
- Fig. 3C and Fig. 3D show two examples of Sobel filter.
- Figs. 3E-3G show three examples of similarity between to-be-classified pixel and neighboring pixels.
- 3F correspond to one-dimensional filters comparing the to-be-classified pixel (i.e., the pixel in the center) and two neighboring pixels.
- Fig. 3G corresponds to a two-dimensional filter comparing the to-be-classified pixel (i.e., the pixel in the center) and four neighboring pixels.
- Figs. 4A-D illustrates edge offset (EO) pixel classification based on a 3x3 window, with four configurations corresponding to 0°, 90°, 135°, and 45° respectively.
- the classifications used for SAO include four kinds of Edge Offset (EO) in the High Efficient Video Coding (HEVC) standard.
- the EO-based classification for SAO can also be used for pixel classification for the present invention.
- the pixel values at the three locations as highlighted in three lined boxed are compared to determine whether the underlying pixel is to be ALF processed.
- the Band Offset (BO) used for SAO classification may also be used for pixel classification for the present invention.
- the intensity is used for pixel classification.
- the side information can be signaled explicitly at the sequence level, picture level, slice level or block level, or be pre-defined implicitly according to the classification method.
- the side information may correspond to a threshold used to compare the high-pass filter output for classification.
- classification methods can be applied adaptively at the sequence level, picture level, slice level or block level. In this case, one or more indices are needed at the corresponding level or levels to indicate which kind of classification methods should be used in ALF process.
- Fig. 5 illustrates an exemplary flowchart of video coding system incorporating adaptive loop filtering with implicit sample-based On/Off control for reconstructed video to improve the performance according to an embodiment of the present invention.
- the system receives video data associated with a reconstructed current image unit as shown in step 510.
- the video data may be retrieved from storage such as a computer memory, buffer (RAM or DRAM) or other media.
- the input data may also be received from a processor such as a controller, a central processing unit, a digital signal processor or electronic circuits that produce the input data.
- Each pixel of the video data associated with the reconstructed current image unit is classified into a first group or a second group based on reconstructed video commonly available to both an encoder side and a decoder side as shown in step 520.
- the adaptive loop filter is applied to the pixels of the video data associated with the reconstructed current image unit belonging to the first group as shown in step 530.
- the adaptive loop filter is skipped for the pixels of the video data associated with the reconstructed current image unit belonging to the second group as shown in step 540.
- Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both.
- an embodiment of the present invention can be a circuit integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein.
- An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
- DSP Digital Signal Processor
- the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) .
- These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
- the software code or firmware code may be developed in different programming languages and different formats or styles.
- the software code may also be compiled for different target platforms.
- different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (16)
- A method of adaptive loop filtering for reconstructed video in a video encoding system or video decoding system, wherein each picture of the reconstructed video is partitioned into image units, the method comprising:receiving video data associated with a reconstructed current image unit; andapplying Implicit Sample-based On/Off ALF (adaptive loop filter) to the video data, wherein said applying Implicit Sample-based On/Off ALF comprises:classifying each pixel of the video data associated with the reconstructed current image unit into a first group or a second group based on reconstructed video commonly available to both an encoder side and a decoder side;applying adaptive loop filter to the pixels of the video data associated with the reconstructed current image unit belonging to the first group; andskipping the adaptive loop filter for the pixels of the video data associated with the reconstructed current image unit belonging to the second group.
- The method of Claim 1, wherein the image unit corresponds to one coding tree block (CTB) or one coding tree unit (CTU) .
- The method of Claim 1, wherein said classifying each pixel of the video data associated with the reconstructed current image unit applies a classification process to the video data associated with the reconstructed current image unit, wherein the classification process is selected from a filter group consisting of linear filtering, non-linear filtering, edge detection, difference or similarity between to-be-classified pixel and neighboring pixels, intensity, edge offset (EO) classifications, band offset (BO) classification, magnitude of residual, and any combination thereof.
- The method of Claim 1, wherein said classifying each pixel of the video data associated with the reconstructed current image unit applies a classification process to the video data associated with the reconstructed current image unit, wherein the classification process is selected from a filter group adaptively at a sequence level, picture level, slice level or block level of a bitstream.
- The method of Claim 4, wherein the block level corresponds to a coding tree block (CTB) level or a coding tree unit (CTU) level.
- The method of Claim 1, wherein the video data associated with the reconstructed current image unit corresponds to the reconstructed current image unit, a first output data resulted from applying deblocking process to the reconstructed current image unit, or a second output data resulted from said applying deblocking process and sample adaptive offset (SAO) process to the reconstructed current image unit.
- The method of Claim 1, further comprising incorporating side information associated with said classifying each pixel of the video data associated with the reconstructed current image unit in at a sequence level, picture level, slice level or block level of a bitstream.
- The method of Claim 1, wherein side information associated with said classifying each pixel of the video data associated with the reconstructed current image unit is determined implicitly.
- The method of Claim 1, for the video encoding system, further comprising:selecting an ALF mode for the reconstructed current image unit from a filter mode group consisting of ALF-Off mode, ALF-On mode, and ALF Implicit On/Off mode, wherein said applying Implicit Sample-based On/Off ALF is performed only if the ALF Implicit On/Off mode is selected;if the ALF-Off mode is selected, skipping the adaptive loop filter for all pixels of the video data associated with the reconstructed current image unit;if the ALF-On mode is selected, applying the adaptive loop filter all samples in the video data associated with the reconstructed current image unit; andincorporating one or more syntax elements in a coded bitstream to signal the ALF mode selected for the reconstructed current image unit.
- The method of Claim 9, wherein said one or more syntax elements is incorporated in a sequence level, picture level, slice level or block level of the coded bitstream to signal the ALF mode.
- The method of Claim 1, for the video decoding system, further comprising:parsing an ALF mode (adaptive loop filter mode) for the reconstructed current image unit from a coded bitstream, wherein the ALF mode belongs to a filter mode group consisting of ALF-Off mode, ALF-On mode, and ALF Implicit On/Off mode and said applying Implicit Sample-based On/Off ALF is performed only if the ALF Implicit On/Off mode is selected;if the ALF-Off mode is selected, skipping the adaptive loop filter for all pixels of the video data associated with the reconstructed current image unit; andif the ALF-On mode is selected, applying the adaptive loop filter to all samples in the video data associated with the reconstructed current image unit.
- The method of Claim 11, wherein the ALF mode is parsed from a sequence level, picture level, slice level or block level of the coded bitstream.
- An apparatus for applying adaptive loop filtering for reconstructed video in a video encoding system or video decoding system, wherein each picture of the reconstructed video is partitioned into image units, the apparatus comprising one or more electronic circuits configured to:receive video data associated with a reconstructed current image unit from storage or from a processor; andapply Implicit Sample-based On/Off ALF (adaptive loop filter) to the video data, wherein said apply Implicit Sample-based On/Off ALF comprises:classifying each pixel of the video data associated with the reconstructed current image unit into a first group or a second group based on reconstructed video commonly available to both an encoder side and a decoder side;applying adaptive loop filter to the pixels of the video data associated with the reconstructed current image unit belonging to the first group; andskipping the adaptive loop filter for the pixels of the video data associated with the reconstructed current image unit belonging to the second group.
- The apparatus of Claim 13, wherein said classifying each pixel of the video data associated with the reconstructed current image unit applies a classification process to the video data associated with the reconstructed current image unit, wherein the classification process is selected from a filter group consisting of linear filtering, non-linear filtering, edge detection, difference or similarity between to-be-classified pixel and neighboring pixels, intensity, edge offset (EO) classifications, band offset (BO) classification, magnitude of residual, and any combination thereof.
- The apparatus of Claim 13, for the video encoding system, the apparatus comprising one or more electronic circuits further configured to:select an ALF mode for the reconstructed current image unit from a filter mode group consisting of ALF-Off mode, ALF-On mode, and ALF Implicit On/Off mode, wherein said apply Implicit Sample-based On/Off ALF is performed only if the ALF Implicit On/Off mode is selected;if the ALF-Off mode is selected, skip the adaptive loop filter for all pixels of the video data associated with the reconstructed current image unit;if the ALF-On mode is selected, apply the adaptive loop filter all samples in the video data associated with the reconstructed current image unit; andincorporate one or more syntax elements in a coded bitstream to signal the ALF mode selected for the reconstructed current image unit.
- The apparatus of Claim 13, for the video decoding system, the apparatus comprising one or more electronic circuits further configured to:parse an ALF mode (adaptive loop filter mode) for the reconstructed current image unit from a coded bitstream, wherein the ALF mode belongs to a filter mode group consisting of ALF-Off mode, ALF-On mode, and ALF Implicit On/Off mode and said apply Implicit Sample-based On/Off ALF is performed only if the ALF Implicit On/Off mode is selected;if the ALF-Off mode is selected, skip the adaptive loop filter for all pixels of the video data associated with the reconstructed current image unit; andif the ALF-On mode is selected, apply the adaptive loop filter to all samples in the video data associated with the reconstructed current image unit.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA2929894A CA2929894A1 (en) | 2013-11-15 | 2014-11-13 | Method of filter control for block-based adaptive loop filtering |
EP14862074.3A EP3069512A4 (en) | 2013-11-15 | 2014-11-13 | Method of filter control for block-based adaptive loop filtering |
CN201480060385.9A CN105850121B (en) | 2013-11-15 | 2014-11-13 | The method of FILTER TO CONTROL for block-based adaptive loop filter |
US15/034,125 US10123048B2 (en) | 2013-11-15 | 2014-11-13 | Method of filter control for block-based adaptive loop filtering |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361904511P | 2013-11-15 | 2013-11-15 | |
US61/904,511 | 2013-11-15 | ||
US201461948183P | 2014-03-05 | 2014-03-05 | |
US61/948,183 | 2014-03-05 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015070772A1 true WO2015070772A1 (en) | 2015-05-21 |
Family
ID=53056766
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2014/090683 WO2015070739A1 (en) | 2013-11-15 | 2014-11-10 | Method of block-based adaptive loop filtering |
PCT/CN2014/090978 WO2015070772A1 (en) | 2013-11-15 | 2014-11-13 | Method of filter control for block-based adaptive loop filtering |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2014/090683 WO2015070739A1 (en) | 2013-11-15 | 2014-11-10 | Method of block-based adaptive loop filtering |
Country Status (6)
Country | Link |
---|---|
US (2) | US10567806B2 (en) |
EP (3) | EP3761641A1 (en) |
CN (2) | CN105794206B (en) |
BR (1) | BR112016011075B1 (en) |
CA (1) | CA2929894A1 (en) |
WO (2) | WO2015070739A1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021057946A1 (en) * | 2019-09-27 | 2021-04-01 | Beijing Bytedance Network Technology Co., Ltd. | Adaptive loop filtering between different video units |
US11310495B2 (en) | 2016-10-03 | 2022-04-19 | Sharp Kabushiki Kaisha | Systems and methods for applying deblocking filters to reconstructed video data |
US11490082B2 (en) | 2019-06-14 | 2022-11-01 | Beijing Bytedance Network Technology Co., Ltd. | Handling video unit boundaries and virtual boundaries based on color format |
US11553179B2 (en) | 2019-07-09 | 2023-01-10 | Beijing Bytedance Network Technology Co., Ltd. | Sample determination for adaptive loop filtering |
US11589042B2 (en) | 2019-07-11 | 2023-02-21 | Beijing Bytedance Network Technology Co., Ltd. | Sample padding in adaptive loop filtering |
US11652998B2 (en) | 2019-09-22 | 2023-05-16 | Beijing Bytedance Network Technology Co., Ltd. | Padding process in adaptive loop filtering |
US11700368B2 (en) | 2019-07-15 | 2023-07-11 | Beijing Bytedance Network Technology Co., Ltd. | Classification in adaptive loop filtering |
US11706462B2 (en) | 2019-10-10 | 2023-07-18 | Beijing Bytedance Network Technology Co., Ltd | Padding process at unavailable sample locations in adaptive loop filtering |
US12003712B2 (en) | 2019-06-14 | 2024-06-04 | Beijing Bytedance Network Technology Co., Ltd | Handling video unit boundaries and virtual boundaries |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3206403A4 (en) * | 2014-11-04 | 2017-11-01 | Samsung Electronics Co., Ltd. | Video encoding method and apparatus therefor, and video decoding method and apparatus therefor, in which edge type offset is applied |
EP3310058B1 (en) * | 2015-06-12 | 2023-02-22 | Panasonic Intellectual Property Management Co., Ltd. | Image coding method, image decoding method, image coding device and image decoding device |
US10382766B2 (en) * | 2016-05-09 | 2019-08-13 | Qualcomm Incorporated | Signalling of filtering information |
WO2020083108A1 (en) * | 2018-10-23 | 2020-04-30 | Mediatek Inc. | Method and apparatus for reduction of in-loop filter buffer |
WO2020094154A1 (en) * | 2018-11-09 | 2020-05-14 | Beijing Bytedance Network Technology Co., Ltd. | Improvements for region based adaptive loop filter |
GB2580173B (en) * | 2018-12-21 | 2022-07-27 | Canon Kk | A filter |
KR20220016839A (en) | 2019-06-04 | 2022-02-10 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Motion candidate list with geometric segmentation mode coding |
EP3963890A4 (en) | 2019-06-04 | 2022-11-02 | Beijing Bytedance Network Technology Co., Ltd. | Motion candidate list construction using neighboring block information |
EP3984215A4 (en) | 2019-07-14 | 2022-08-24 | Beijing Bytedance Network Technology Co., Ltd. | Transform block size restriction in video coding |
US11616962B2 (en) * | 2019-07-15 | 2023-03-28 | Tencent America LLC | Method and apparatus for video coding |
WO2021057996A1 (en) | 2019-09-28 | 2021-04-01 | Beijing Bytedance Network Technology Co., Ltd. | Geometric partitioning mode in video coding |
CA3129687A1 (en) * | 2019-12-24 | 2021-07-01 | Telefonaktiebolaget Lm Ericsson (Publ) | Virtual boundary processing for adaptive loop filtering |
US11716469B2 (en) * | 2020-12-10 | 2023-08-01 | Lemon Inc. | Model selection in neural network-based in-loop filter for video coding |
CN112927311B (en) * | 2021-02-24 | 2022-06-03 | 上海哔哩哔哩科技有限公司 | Data processing method and device of sideband compensation mode of sample point adaptive compensation |
CN113259669B (en) * | 2021-03-25 | 2023-07-07 | 浙江大华技术股份有限公司 | Encoding method, encoding device, electronic device and computer readable storage medium |
CN115842914A (en) * | 2021-12-14 | 2023-03-24 | 中兴通讯股份有限公司 | Loop filtering, video encoding method, video decoding method, electronic device, and medium |
WO2024073145A1 (en) * | 2022-09-30 | 2024-04-04 | Beijing Dajia Internet Information Technology Co., Ltd. | Methods and devices for adaptive loop filtering and cross-component adaptive loop filter |
WO2024147679A1 (en) * | 2023-01-04 | 2024-07-11 | 한국전자통신연구원 | Method, apparatus, and recording medium for image encoding/decoding |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130003871A1 (en) * | 2011-06-29 | 2013-01-03 | Cisco Technology Inc. | Video compression using an adaptive loop filter |
US20130058421A1 (en) * | 2010-05-17 | 2013-03-07 | Thomson Licensing | Methods and apparatus for adaptive directional filter for video restoration |
US20130142251A1 (en) * | 2011-12-06 | 2013-06-06 | Sony Corporation | Syntax extension of adaptive loop filter in hevc |
US20130272624A1 (en) * | 2012-04-11 | 2013-10-17 | Texas Instruments Incorporated | Virtual Boundary Processing Simplification for Adaptive Loop Filtering (ALF) in Video Coding |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7042946B2 (en) * | 2002-04-29 | 2006-05-09 | Koninklijke Philips Electronics N.V. | Wavelet based coding using motion compensated filtering based on both single and multiple reference frames |
US20040076333A1 (en) | 2002-10-22 | 2004-04-22 | Huipin Zhang | Adaptive interpolation filter system for motion compensated predictive video coding |
CN1571515A (en) * | 2004-05-13 | 2005-01-26 | 中国科学院计算技术研究所 | A loop filter and filtering method |
WO2007116551A1 (en) | 2006-03-30 | 2007-10-18 | Kabushiki Kaisha Toshiba | Image coding apparatus and image coding method, and image decoding apparatus and image decoding method |
US9094658B2 (en) * | 2010-05-10 | 2015-07-28 | Mediatek Inc. | Method and apparatus of adaptive loop filtering |
US8861617B2 (en) * | 2010-10-05 | 2014-10-14 | Mediatek Inc | Method and apparatus of region-based adaptive loop filtering |
US20120189064A1 (en) | 2011-01-14 | 2012-07-26 | Ebrisk Video Inc. | Adaptive loop filtering using multiple filter shapes |
ES2715782T3 (en) * | 2011-04-21 | 2019-06-06 | Hfi Innovation Inc | Procedure and apparatus for improved loop filtering |
US8908979B2 (en) * | 2011-06-16 | 2014-12-09 | Samsung Electronics Co., Ltd. | Shape and symmetry design for filters in video/image coding |
US9485521B2 (en) * | 2011-09-19 | 2016-11-01 | Lg Electronics Inc. | Encoding and decoding image using sample adaptive offset with start band indicator |
WO2013063784A1 (en) * | 2011-11-03 | 2013-05-10 | Thomson Licensing | Video encoding and decoding based on image refinement |
-
2014
- 2014-11-10 US US15/034,115 patent/US10567806B2/en active Active
- 2014-11-10 EP EP20193462.7A patent/EP3761641A1/en active Pending
- 2014-11-10 WO PCT/CN2014/090683 patent/WO2015070739A1/en active Application Filing
- 2014-11-10 CN CN201480060386.3A patent/CN105794206B/en active Active
- 2014-11-10 EP EP14862061.0A patent/EP3069511A4/en not_active Withdrawn
- 2014-11-10 BR BR112016011075-7A patent/BR112016011075B1/en active IP Right Grant
- 2014-11-13 CA CA2929894A patent/CA2929894A1/en not_active Abandoned
- 2014-11-13 CN CN201480060385.9A patent/CN105850121B/en active Active
- 2014-11-13 US US15/034,125 patent/US10123048B2/en active Active
- 2014-11-13 WO PCT/CN2014/090978 patent/WO2015070772A1/en active Application Filing
- 2014-11-13 EP EP14862074.3A patent/EP3069512A4/en not_active Withdrawn
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130058421A1 (en) * | 2010-05-17 | 2013-03-07 | Thomson Licensing | Methods and apparatus for adaptive directional filter for video restoration |
US20130003871A1 (en) * | 2011-06-29 | 2013-01-03 | Cisco Technology Inc. | Video compression using an adaptive loop filter |
US20130142251A1 (en) * | 2011-12-06 | 2013-06-06 | Sony Corporation | Syntax extension of adaptive loop filter in hevc |
US20130272624A1 (en) * | 2012-04-11 | 2013-10-17 | Texas Instruments Incorporated | Virtual Boundary Processing Simplification for Adaptive Loop Filtering (ALF) in Video Coding |
Non-Patent Citations (2)
Title |
---|
C-Y CHEN ET AL.: "CE8 Subset2: A Joint Proposal on Improving the Adaptive Loop Filter in TMuC0.9 by MediaTek, Qualcomm, and Toshiba", JCT-VC MEETING; 95. MPEG MEETING, vol. 4, 15 January 2011 (2011-01-15), Retrieved from the Internet <URL:HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE> |
See also references of EP3069512A4 |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11310495B2 (en) | 2016-10-03 | 2022-04-19 | Sharp Kabushiki Kaisha | Systems and methods for applying deblocking filters to reconstructed video data |
US11490082B2 (en) | 2019-06-14 | 2022-11-01 | Beijing Bytedance Network Technology Co., Ltd. | Handling video unit boundaries and virtual boundaries based on color format |
US12003712B2 (en) | 2019-06-14 | 2024-06-04 | Beijing Bytedance Network Technology Co., Ltd | Handling video unit boundaries and virtual boundaries |
US11553179B2 (en) | 2019-07-09 | 2023-01-10 | Beijing Bytedance Network Technology Co., Ltd. | Sample determination for adaptive loop filtering |
US11831869B2 (en) | 2019-07-09 | 2023-11-28 | Beijing Bytedance Network Technology Co., Ltd. | Sample determination for adaptive loop filtering |
US11589042B2 (en) | 2019-07-11 | 2023-02-21 | Beijing Bytedance Network Technology Co., Ltd. | Sample padding in adaptive loop filtering |
US11700368B2 (en) | 2019-07-15 | 2023-07-11 | Beijing Bytedance Network Technology Co., Ltd. | Classification in adaptive loop filtering |
US11652998B2 (en) | 2019-09-22 | 2023-05-16 | Beijing Bytedance Network Technology Co., Ltd. | Padding process in adaptive loop filtering |
US11671594B2 (en) | 2019-09-22 | 2023-06-06 | Beijing Bytedance Network Technology Co., Ltd. | Selective application of sample padding in adaptive loop filtering |
WO2021057946A1 (en) * | 2019-09-27 | 2021-04-01 | Beijing Bytedance Network Technology Co., Ltd. | Adaptive loop filtering between different video units |
US11683488B2 (en) | 2019-09-27 | 2023-06-20 | Beijing Bytedance Network Technology Co., Ltd. | Adaptive loop filtering between different video units |
US11706462B2 (en) | 2019-10-10 | 2023-07-18 | Beijing Bytedance Network Technology Co., Ltd | Padding process at unavailable sample locations in adaptive loop filtering |
Also Published As
Publication number | Publication date |
---|---|
EP3761641A1 (en) | 2021-01-06 |
BR112016011075A2 (en) | 2017-08-08 |
BR112016011075B1 (en) | 2023-04-04 |
US10567806B2 (en) | 2020-02-18 |
US20160269753A1 (en) | 2016-09-15 |
CN105794206A (en) | 2016-07-20 |
CA2929894A1 (en) | 2015-05-21 |
CN105850121A (en) | 2016-08-10 |
EP3069511A4 (en) | 2017-09-27 |
EP3069511A1 (en) | 2016-09-21 |
EP3069512A1 (en) | 2016-09-21 |
CN105794206B (en) | 2018-12-28 |
WO2015070739A1 (en) | 2015-05-21 |
EP3069512A4 (en) | 2017-06-14 |
US20160261863A1 (en) | 2016-09-08 |
CN105850121B (en) | 2018-10-12 |
US10123048B2 (en) | 2018-11-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10123048B2 (en) | Method of filter control for block-based adaptive loop filtering | |
US20240121407A1 (en) | Sample adaptive offset parameter estimation for image and video coding | |
US10116967B2 (en) | Method and apparatus for coding of sample adaptive offset information | |
US10306246B2 (en) | Method and apparatus of loop filters for efficient hardware implementation | |
US10511843B2 (en) | Method and apparatus for loop filtering across slice or tile boundaries | |
EP2708027B1 (en) | Method and apparatus for reduction of in-loop filter buffer | |
US9967563B2 (en) | Method and apparatus for loop filtering cross tile or slice boundaries | |
US9872015B2 (en) | Method and apparatus for improved in-loop filtering | |
EP2777255B1 (en) | Method and device for optimizing encoding/decoding of compensation offsets for a set of reconstructed samples of an image | |
US20160241881A1 (en) | Method and Apparatus of Loop Filters for Efficient Hardware Implementation | |
US10116933B2 (en) | Method of lossless mode signaling for video system with lossless and lossy coding | |
KR20160019531A (en) | Method of sample adaptive offset processing for video coding | |
US20150195533A1 (en) | Method And Apparatus For Sample Adaptive Offset Processing | |
US11632574B2 (en) | Video processing methods and apparatuses having BDPCM size constraint considering color format sampling structure | |
KR20130070195A (en) | Method and apparatus for context-based adaptive sao direction selection in video codec |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14862074 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15034125 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 2929894 Country of ref document: CA |
|
REEP | Request for entry into the european phase |
Ref document number: 2014862074 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014862074 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |