CN103155557A - Method and apparatus of region-based adaptive loop filtering - Google Patents

Method and apparatus of region-based adaptive loop filtering Download PDF

Info

Publication number
CN103155557A
CN103155557A CN2011800482460A CN201180048246A CN103155557A CN 103155557 A CN103155557 A CN 103155557A CN 2011800482460 A CN2011800482460 A CN 2011800482460A CN 201180048246 A CN201180048246 A CN 201180048246A CN 103155557 A CN103155557 A CN 103155557A
Authority
CN
China
Prior art keywords
subregion
alf
filter
relevant
design
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011800482460A
Other languages
Chinese (zh)
Other versions
CN103155557B (en
Inventor
陈庆晔
傅智铭
蔡家扬
黄毓文
雷少民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HFI Innovation Inc
Original Assignee
MediaTek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/093,068 external-priority patent/US9094658B2/en
Priority claimed from US13/158,427 external-priority patent/US9055305B2/en
Priority claimed from US13/177,343 external-priority patent/US8861617B2/en
Application filed by MediaTek Inc filed Critical MediaTek Inc
Priority to CN201710063705.1A priority Critical patent/CN106878729B/en
Priority to CN201710063716.XA priority patent/CN107087180B/en
Publication of CN103155557A publication Critical patent/CN103155557A/en
Application granted granted Critical
Publication of CN103155557B publication Critical patent/CN103155557B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/19—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding using optimisation based on Lagrange multipliers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

In a block-based motion compensated system, coding noises may arise due to lossy operations. Adaptive loop filter (ALF) is a technique used to improve the quality. A pixel adaptive (PA) ALF method was developed that uses the Sum-modified Laplacian Measure (SLM) to classify pixels and applies a respective ALF filter to each pixel according to the SLM. While the PA ALF achieves better performance over a conventional single filter (SF) based ALF, the PA ALF causes higher complexity and consumes more power due to the high complexity and per-pixel filter switching. Accordingly region based ALF scheme is disclosed which allows adaptive filter selection on a region by region basis and does not require per-pixel filter switching. In one embodiment according to the present invention, a picture is divided into MxN regions. The region based ALF also allows region merging for the MxN regions to improve performance. In another aspect of the present invention, the optimal ALF design also takes into consideration of the system complexity by using rate-distortion-complexity optimization (RDCO). The RDCO technique is also applied to sample adaptive offset (SAO) design.

Description

Adaptive loop filter method and apparatus based on the subregion basis
Cross reference
The application requires the priority of following application: on October 5th, 2010 submitted, and denomination of invention is the U.S. Provisional Application case No.61/390 of " improved auto-adaptive loop filter ", and 068; On December 10th, 2010 submitted, and denomination of invention is the U.S. Provisional Application case No.61/421 of " the complexity optimized method of the rate distortion of auto-adaptive loop filter ", and 729; On July 6th, 2011 submitted, and denomination of invention is the U. S. application case No.13/177 of " based on the adaptive loop filter method and apparatus on subregion basis ", and 343; On March 21st, 2011 submitted, and denomination of invention is the U.S. Provisional Application case No.61/454 of " based on the auto-adaptive loop filter on subregion basis ", and 829.The present invention also submits with on April 25th, 2011, and denomination of invention is " adaptive loop filter method and apparatus " U.S. patent application case No.13/093, and 068 is relevant; On June 12nd, 2011 submitted, and denomination of invention is " demonstration that is used for Video coding adapts to offset method and device " U.S. patent application case No.13/158, and 427 is relevant; With on January 3rd, 2011 submitted, denomination of invention is the U.S. Provisional Application case No.61/429 of " Lian Fake adaptive loop filter device ", 313 is relevant.The application with above-mentioned U.S. Provisional Application case and patent application case as a reference.
Technical field
The present invention is relevant for Video coding (video coding), and especially relevant for the coding techniques relevant with adaptive loop filter (Adaptive Loop Filtering).
Background technology
Motion compensation (motion compensation) interframe encode (inter-frame coding) extensive use in the Multi-encoding standard, as MPEG-1/2/4 and H.261/H.263/H.264/AVC.Estimation in above-mentioned coded system, motion compensation and subsequent treatment all are based on piece (block basis) and carry out.In compression procedure, diminish operation (lossy operation) owing to having adopted as what quantize (quantization), coding noise (coding noise) may appear.In rebuilding (reconstructed) video data, particularly near block edge or edge, have the pseudo-shadow of obvious coding (coding artifact).For the explicitly of the pseudo-shadow that reduces to encode, the coded system of renewal for example H.264/AVC and high-performance video coding (High Efficiency Video Coding, HEVC) begin to adopt a kind of technology that is called as deblock (deblock).The process of deblocking is used filtering adaptively at block edge, the edge that brings with level and smooth coding noise or near the sudden change the edge, and keep the definition of image.In addition, according to the characteristic of interframe encode, the process of deblocking can be integrated in loop and operate.In nearest HEVC exploitation, the employing adaptive loop filter is processed the reconstruction frames after deblocking.Self-adaption loop filtering often is used to do use after the processing of further loop and the reconstruction video data of deblocking through being everlasting.
Tradition auto-adaptive loop filter (Adaptive Loop Filter, ALF) only is applied to filtering and can carries high performance.Use self-adaption loop filtering can not help to carry high performance for those, generally do not carry out self-adaption loop filtering.When using ALF, a single filter (single filter, SF) is applied to the piece in a slice (slice).This single filter is the performance that chooses to reach the best from one group of candidate, as minimum distortion, minimum rate or R-D(Rate-distortion) performance.Such ALF scheme is called as single sef-adapting filter scheme (SF ALF).Another kind of ALF scheme is called as the QC_ALF scheme, to be proposed (in 15-23 day in April, 2010 by Qualcomm (Qualcomm), in the first session about the ITU-T SG16WP3 of the integration and cooperation group (JCT-VC) of Video coding and ISO/IEC JTC1/SC29/WG11 that Dresden, Germany (Dresden) is held, the people such as Karczewicz are entitled as: propose in " Qualcomm is about the recommendation of Video coding ", be recorded in document: JCTVC-A121).According to this QC_ALF, this ALF filter is the video data that deblocks on based on the piece base application.Corresponding each piece calculates the improvement Laplacian (i, j) (Sum-modified Laplacian Measure (i, j), SLM (i, j)) of each pixel (i, j) in this piece.This SLM value of each pixel basis on this piece is classified in these a plurality of ranks or classification.Although the performance of this QC_ALF scheme can be better than the performance of this SF ALF, the calculating two of each this SLM of pixel and the conversion from a pixel to the filter of another pixel will cause higher computation complexity and consume more usefulness.Therefore, need development that the ALF scheme of filter conversion between computational complexity highly and pixel is not provided simultaneously with the advantage that can provide each subregion to have a plurality of filters selections.
In the ALF design that the zone is divided and pattern determines a, rate-distortion optimization (rate-distortion optimization, RDO) by name) during optimisation technique is often used in that the zone is divided and pattern determines.Although this RDO technology can realize best rate distortion performance, it does not consider system complexity, and this will consume valuable system resource.Therefore, need to use a kind of new prioritization scheme (rate, distortion and complexity) in this three to reach optimization.Therefore, a kind of rate distortion complexity optimization (rate-distortion-complexity optimization, RDCO) technology is used in the ALF design.This RDCO technology also is used in the SAO design to realize the performance of best rate distortion complexity.
Summary of the invention
The present invention has disclosed and has adopted adaptive loop filter to process the method and apparatus of encoded video.In one embodiment of this invention, the method and the device that adopt adaptive loop filter to process encoded video comprise from processing unit reception reconstruction video data corresponding with coding video frequency data; To this reconstruction video market demand adaptive-filtering to produce the filtering video data; This filtering video data are provided.The operation of this adaptive-filtering can adapt to the sign selection based on ALF or the non-ALF based on subregion of subregion for the foundation subregion.If selected this based on the ALF of subregion, these reconstruction video data are divided into MxN subregion, and wherein M and N are integer.The subregion of this MxN subregion can merge based on 1-D or 2-D representation.Further, one merges sign for representing whether a subregion merges with one or more adjacent sectors.When using the 1-D representation, be each appointment one packet index in this MxN subregion according to the one scan figure.This scanning patter can be selected from one group of scanning patter, and this group scanning patter comprises distortion hibert curve, the scanning of horizontal snake, vertical snake scanning, the scanning of Z-type snake, helical scanning, the scanning of four minutes tree scanner uni grids.According to another embodiment of the present invention, the border of each subregion between any two subregions in this MxN subregion is the border of a maximum coding unit or the border of a plurality of maximum coding units.Also according to another embodiment of the present invention, use this subregion of merging sign expression whether to be allowed to merge.
The present invention discloses method for designing and the device of a sef-adapting filter or exemplary adaptation offset filter.According to one embodiment of the invention, the method for designing of this sef-adapting filter or exemplary adaptation offset filter and device comprise the steps: to be sef-adapting filter or the exemplary adaptation offset filter decision candidate item relevant to design feature; Reach and select the candidate item an of the best according to RDCO from these a plurality of these candidate item.This design feature may determine with pattern or divide Division relevant.For this ALF design, the combination of the quantity of the quantity of the complexity of this RDCO and the number of parameters of the filter that is used for the ALF design, filtered pixel, the number of parameters of filter and filtered pixel is relevant, perhaps also with the quantity of filter parameter, with the quantity of filtered pixel and design the combination of quantity of operation of candidate pattern of the model selection of carrying out for ALF relevant.For SAO design, the operation amount of the complexity pixel sorting technique type of this RDCO is relevant, perhaps with the operation amount of pixel sorting technique type and to have a combination with the pixel quantity that compensated of a deviant relevant.
Description of drawings
Fig. 1 discloses the exemplary block schematic diagram of the video coding system of based on motion compensation prediction, and wherein auto-adaptive loop filter is applied to the reconstruction video data.
Fig. 2 discloses the example based on the sef-adapting filter of pixel, and wherein the pixel that is used to one 6 * 4 of SLM is divided to three classifications.
Fig. 3 discloses the picture that will comprise 416 * 240 pixels and is divided to 4 * 4 maximum coding units (Largest Coding Unit, LCU) example of alignment subregion, wherein each square comprises 2 * 1 LCU for comprising a LCU of 64 * 64 pixels and a non-rightmost and non-bottom subregion.
Fig. 4 discloses the grammer design based on the ALF of subregion of supporting with sign, and this subregion adaptive labeling indicates whether to use the ALF based on subregion.
Fig. 5 discloses according to the scanning sequency of distortion hibert curve (deformed Hilbert curve) by 4 * 4 subregions.
Fig. 6 discloses according to the scanning sequency of horizontal snake scanning (horizontal snake scan) by 4 * 4 subregions.
Fig. 7 discloses according to the scanning sequency of vertical snake scanning (vertical snake scan) by 4 * 4 subregions.
Fig. 8 discloses according to the scanning sequency of Z-type snake scanning (zig-zag scan) by 4 * 4 subregions.
Fig. 9 discloses according to the scanning sequency of helical scanning (spiral scan) by 4 * 4 subregions.
Figure 10 discloses according to four minutes trees and scans (quad-tree scan) by the scanning sequency of 4 * 4 subregions.
Figure 11 discloses according to the scanning sequency of grid scanning (raster scan) by 4 * 4 subregions.
Figure 12 discloses the example of a fractionation subregion, and wherein a subregion is split into 5 subregions, as: F 0, F 1, F 2, F 3An and reactive filter subregion.
Figure 13 discloses one with 5 examples that filtered subregion (to-be-filtered regions) are merged into 3 subregions, and these 3 are respectively F 0', F 1' and a reactive filter subregion.
Figure 14 discloses one and supports the grammer design that the 2-D subregion merges.
Embodiment
As MPEG-1/2/4 and H.261/H.263/H.264/AVC for compression of digital video, motion compensation interframe coding is a kind of effective compress technique, has been widely used in the Multi-encoding standard.In motion compensating system, motion estimation/compensation and subsequent compression are carried out in piece based on piece usually.In compression procedure, coding noise may appear in the operation that diminishes owing to having adopted as quantizing.In the reconstruction video data, particularly near block edge or edge, have the pseudo-shadow of obvious coding.For the explicitly of the pseudo-shadow that reduces to encode, the coded system of renewal for example in said system H.264/AVC and the HEVC system begin to adopt a kind of technology of deblocking that is called as.The process of deblocking is used filtering adaptively at block edge, the edge that brings with level and smooth coding noise or near the sudden change the edge, and keep the definition of image.In addition, according to the characteristic of interframe encode, the process of deblocking can be integrated in loop and operate.
In the HEVC system, except deblocking filter, also use another to be called as the loop filter of self-adaption loop filter (ALF).Deblocking filter is only used and block boundary, and sef-adapting filter can be applied to all pixels in a frame (frame), a territory (field), a slice (slice) or a picture region.Traditional ALF only is applied to use filter can carry high performance.Use ALF can not carry high performance for those and do not use ALF.When ALF is used, a single filter SF is applied in piece in a slice.This single filter is the performance that chooses to reach the best from one group of candidate, as minimum distortion, minimum rate or R-D performance.Such ALF scheme is called as single sef-adapting filter scheme (SF ALF).Be transferred to decoder in this information of being correlated with by selecting filter.To be transmitted or canned data in order to save this, this group ALF filter can be by pre-defined, and this filter is selected to use an index to represent.As an alternative, this filter can obtain in the time delay arrangement based on reconstruction video data.Therefore, need not additional information (side information) or only need seldom additional information.In addition, the instrument that can reduce the relevant information of the filter that is used also can be used, as: utilize this filter coefficient of entropy fgs encoder and or transmit the difference of this coefficient.
Fig. 1 has disclosed one and has used self-adaption loop filtering and the system block diagrams of the coded system of deblocking.Fig. 1 has disclosed system's square 100 of the video encoder of the based on motion compensation prediction with the function of deblocking.Compressibility 100 shown in typical video encoder and frame/interframe (intra/inter-prediction) prediction, transform/quantization (transformation/quantization) and entropy coding (entropy coding) carry out combination, with the generation compressed video data.These input data enter this encoder via this inputting interface 112, and in this frame/110 pairs of these input data of inter prediction mould predict.Piece is at intra prediction mode, and the data of this input use the image of having encoded in same frame or same territory to predict.At inter-frame forecast mode, this prediction can be based on the previous data reconstruction 142 on sequential, and wherein, this data reconstruction 142 is stored in reference picture buffers 140.This inter prediction can be list 0 predictive mode, and wherein, this prediction is based on decoding order before present image and the image in the first list at reference picture.This inter prediction can be also list 1 predictive mode, is a B-sheet (B-slice) if deserve anter (current slice), and this inter prediction is based on decoding order before present image and the image in the second list at reference picture.This inter prediction can be also bi-directional predicted (bi-prediction) pattern, is the B-sheet if work as anter, and this inter prediction is based on list 0 reference picture and list 1 reference picture.In this inter-frame forecast mode, in this frame/inter prediction module 110 provides this prediction data to adder 115, and deduct this prediction data from this primary signal 112.The output signal 117 of this adder is called as predicated error, and this predicated error is provided to DCT/Q module 120 and further carries out transform/quantization process.This transform/quantization module 120 of piece is converted to coded identification with this predicated error 117, and further processing to produce compression output bit flow 132(by entropy coding module 130 is compression bit stream) for storage or transmission.Inverse transformation/quantification (inverse DCT and inverse quantization can be expressed as IDCT/IQ) module 160 predicated error 117 that is provided by this transform/quantization module 120 is provided is rebuild predicated error (reconstructed prediction error) 162 to form.At this inter-frame forecast mode, rebuild predicated error 162 and 119 combinations of reconstruction video data to form this current reconstruction frames 152.At this intra prediction mode, this rebuilds the previous reconstruction perimeter data stack in predicated error 162 and same image.In this inter-frame forecast mode, in this frame/inter prediction module 110 these prediction signal 119 of transmission are to rebuilding module 150, wherein, this data reconstruction 119 is to depend on inter-frame forecast mode or intra prediction mode according to the previous reconstruction frames on sequential or according to the previous reconstruction perimeter data in same image.
After being processed by deblock module 170 and ALF180, this data reconstruction is stored in reference picture buffers 140 reference video data as the processing subsequent image.Original ALF in HEVC is based on the application of piece.If this ALF can improve performance (more low distortion, lower bit rate, better R-D performance), this piece is opened ALF.Otherwise this piece is closed ALF.A kind of ALF specification is called as the QC_ALF scheme, to be proposed (in 15-23 day in April, 2010 by Qualcomm (Qualcomm), in the first session about the ITU-T SG16WP3 of the integration and cooperation group (JCT-VC) of Video coding and ISO/IEC JTC1/SC29/WG11 that Dresden, Germany (Dresden) is held, the people such as Karczewicz are entitled as: propose in " Qualcomm is about the recommendation of Video coding ", be recorded in document: JCTVC-A121).According to this QC_ALF, this ALF is applied to the video data that deblocks based on pixel basis.Corresponding each piece, the improvement Laplacian (i, j) (Sum-modified Laplacian Measure (i, j), SLM (i, j)) of calculating each pixel (i, j) in this piece is as follows:
SML ( i , j ) = Σ k = - K L Σ l = - L L | 2 R ( i + k , j + l ) - R ( i + k - 1 , j + l ) - R ( i + k + 1 , j + l ) | +
|2R(i+k,j+l)-R(i+k,j+l-1)-R(i+k,j+l+1)|,
Wherein, this R (i, j) is the video data that deblocks.Calculate this SLM based on (2K+1) x (2L+1) adjacent windows centered by (i, j).This adjacent windows size can be 9x9,7x7,5x5or3x3.In order to reduce complexity, use the adjacent windows that is of a size of 3x3.Calculate the SLM of each pixel of this piece, this pixel is sorted out one of them in organizing to M.See also Fig. 2, it has disclosed according to this SLM value sorts out this pixel to three groups.In this QC_ALF scheme, according to each group selection one filter, the relevant pixel of this group is carried out filtering.In order to reduce computational complexity, this ALF filter is level or vertical symmetry normally.For instance, use as 9x9 7x7, the brilliant filter that or5x5 is such, perhaps the box filter device as 5x5,3x3.ALF based on SLM is applied to each pixel, and different pixels will be used different filters.Therefore QC_ALF is called as pixel-self adaptation (pixel-adaptive or pixel-adaptation, PA) ALF equally.Above-mentioned SF ALF can be considered to a kind of special PAALF, and it adopts one group of filter.
Although PA ALF can be adaptive based on pixel selection one filter, it still need to calculate the group information that SLM obtains each pixel by decoder, because the important information of demand additional information (side information) for having encoded.Therefore, need a kind of ALF scheme of development can realize better performance and or reduction computational complexity.Therefore, the present invention discloses the ALF specification on a kind of subregion basis (region based).According to the present invention's ALF scheme, use this ALF basic based on subregion to this video data that deblocks.To divide a picture or image-region be a plurality of fixed blocks or form a plurality of subregions with the fixed block group.As an alternative, can with an image or image-region be cut apart or recursively cut apart and form a plurality of subregions.For instance, can be recursively divide a picture or image-region to form these a plurality of subregions with four minutes trees.One sign can be set in grammer be used to indicate whether adopt subregion basis ALF or case of non-partitioned basis ALF.For instance, a sign is used for selecting between subregion basis ALF and piece basis (block based) ALF.The derivation of piece basis filter can be used the similar method of pixel basis ALF.For instance, the people such as Chong have described the method for a basic ALF, with the Laplacian of all pixels in 4 * 4 calculate the mean value of activity value as the single activity indicators of this 4x4 piece.In 16-23 day in March, 2011, in the 5th meeting about the ITU-T SG16WP3 of the integration and cooperation group (JCT-VC) of Video coding and ISO/IEC JTC1/SC29/WG11 that Geneva, Switzerland (Geneva) is held, the people such as Chong are entitled as: propose in " CE8 subject under discussion 2: based on the piece of auto-adaptive loop filter (ALF) ", be recorded in document: JCTVC-E323.The method need to be calculated the activity value of the Laplacian of these 4 * 4 each pixels.Compared to pixel basis ALF, although the method there is no the saving operand, piece basis ALF can reduce the frequency of the different filters of switching of pixel basis ALF.Also can replace the activity value of Laplacian as criteria for classification with other metering systems, as: band skew (band offset, BO) or edge offset (edge offset, EO) be used for exemplary self adaptation skew (sample adaptive offset as criteria for classification, SAO), also can substitute with the disclosed SLM computing method of the people such as Karczewicz.BO and EO need amount of calculation still less with respect to SLM.
One uses the example based on the ALF on subregion basis of piece group, and an image can be divided into the subregion that 16 sizes equate substantially.For instance, minute sector width of a non-rightmost subregion can be (PicWidth/4), and wherein PicWidth is picture traverse.For the rightmost subregion, this minute sector width be (PicWidth – (PicWidth/4) * 3).The height of non-bottommost subregion is (PicHeight/4), and wherein PicHeight is picture altitude.Height for the bottommost subregion is (PicHeight – (PicHeight/4) * 3).In this example, this rightmost subregion and bottommost subregion may be greater than other subregions.Another example as shown in Figure 3, becomes 16 sizes substantially to equate subregion based on LCU alignment (LCU--aligned) one image segmentation.Wherein, the border of this subregion must be the border of maximum coding unit (LCU).The size of this image is 416x240, and comprises 7x4 LCU, and wherein, each LCU comprises 64x64 pixel.Minute sector width of this non-rightmost subregion is (((PicWidthInLCUs+1)/4) * 64), wherein the LCU quantity of PicWidthInLCUs presentation graphs image width.The height of non-bottom subregion is (((PicHeightInLCUs+1)/4) * 64), wherein, and the LCU quantity of PicHeightInLCUs presentation graphs image height.This size that parts district and bottommost subregion most on the right side can be derived and be drawn by picture traverse (PicWidth), picture altitude (PicHeight), the non-size that parts district and non-bottom subregion most on the right side.One index is assigned to each 4x4 subregion.Use the 4x4 subregion as an example, the present invention is not limited to the example of this 4x4 subregion.In fact, the present invention can use the MxN subregion.Wherein, M and N are integer.Its picture traverse of one image is that PicWidthInSamples and picture altitude are PicHeightInSamples.The coordinate of the subregion index in its upper left corner of each subregion is that the subregion index of (x, y) can be learnt in following derivation.(1＜＜Log2MaxCUSize) be the size of maximum coding unit, and xMaxIndex and yMaxIndex are the maximum subregion index in level and vertical direction.Corresponding, the horizontal interval x_interval of subregion and the perpendicular separation y_interval of by stages can be learnt by the following derivation of equation.
x_interval=((((PicWidthInSamples+(1<<Log2MaxCUSize)–1)>>
/ (xMaxIndex+1)), and (1) Log2MaxCUSize)+x_round)
y_interval=((((PicHeightInSamples+(1<<Log2MaxCUSize)–1)>>
Log2MaxCUSize)+y_round)/(yMaxIndex+1)), (2)
X_round=max (0, (xMaxIndex+1)/2 – 1) and y_round=max (0, (yMaxIndex+1)/2 – 1) wherein.
This horizontal index x_idx and this vertical index y_idx can be derived as follows:
X_idx=min (xMaxIndex, x/ (x_interval＜＜Log2MaxCUSize)), and (3)
y_idx=min(yMaxIndex,y/(y_interval<<Log2MaxCUSize)) (4)
This subregion index region_idx is determined according to following formula:
region_idx=y_idx*(xMaxIndex+1)+x_idx. (5)
When this 4x4 subregion is used by the ALF based on subregion, this subregion index can be derived as follows.The horizontal interval x_interval of this subregion and the perpendicular separation y_interval of by stages can be learnt by the following derivation of equation:
x_interval=((((PicWidthInSamples+(1<<Log2MaxCUSize)–1)>>
Log2MaxCUSize)+1)〉〉 2), and (6)
y_interval=((((PicHeightInSamples+(1<<Log2MaxCUSize)–1)>>
Log2MaxCUSize)+1)>>2). (7)
This horizontal index x_idx and this vertical index y_idx can be derived as follows:
X_idx=min (3, x/ (x_interval＜＜Log2MaxCUSize)), and (8)
y_idx=min(3,y/(y_interval<<Log2MaxCUSize)). (9)
This subregion index region_idx is determined according to following formula:
region_idx=(y_idx<<2)+x_idx. (10)
This filter index filter_idx (x, y) is determined according to following formula:
filter_idx(x,y)=region_tab[region_idx], (11)
Wherein, region_tab[16]=0, Isosorbide-5-Nitrae, 5,15,2,3,6,14,1,10,7,13,12,9,8}.
Two adjacent subregions, as have the subregion of continuity index can be merged.After subregion merged, the subregion after each merges was used a filter.This image can use the ALF based on pixel, block-based ALF or process based on the ALF of subregion.Compared to ALF and the block-based ALF based on pixel, based on the ALF of subregion can save that the self adaptation pixel carries out based on the classified calculating of pixel and the block-based calculating of carrying out based on adaptive block, accordingly, when the ALF that uses based on subregion, the also corresponding minimizing of the average computation amount of decoder.Further, the minimizing that is showing based on the ALF of subregion the conversion times of image median filter, therefore the conversion power consumption is still less.Fig. 4 discloses and to be supported in based on selecting between the ALF of subregion and the ALF based on pixel, the grammer design of perhaps selecting between based on the ALF of subregion and block-based ALF.Unique grammer change in the head parameter devices alf_param () of ALF increase by a sign (region_adaptation_flag) or at image parameter device (PPS) to select between based on the ALF of subregion and block-based ALF.
Carry out the subregion merging and can further improve coding usefulness.Adjacent sectors may have similar feature and can share same filter to reduce indication ALF filter information needed.A kind of method of carrying out the subregion merging is, and 2-D is regional and regional to 1-D.For instance, this 4x4 subregion can be converted into the 1-D subregion that uses packet index 0-15.Execution converts this 2-D to 1-D can be according to a special scan pattern.There are many known scan patterns can be used to convert the 2-D subregion to the 1-D subregion.Distortion hibert curve as shown in Figure 5 (deformed Hilbert curve), horizontal snake scanning (horizontal snake scan) shown in Figure 6, vertical snake scanning (vertical snake scan) shown in Figure 7, Z-type snake scanning (zig-zag scan) shown in Figure 8, helical scanning shown in Figure 9 (spiral scan), tree scanning (quad-tree scan) in shown in Figure 10 four minutes and grid scanning (raster scan) shown in Figure 11.When changing this 2-D subregion to this 1-D subregion, adjacent subregion can be merged to share same filter as merging the indicated subregion with continuity index of representation.For instance, use merging sign one a sign group index whether to merge with the subregion of group index for (n-1) as the subregion of n.
Also can use 2-D to merge representation and carry out subregion and merge, wherein a subregion can with one near subregion merge.Further, at first, whether use one first identifies to indicate this subregion merged, if this this subregion of the first sign indication is merged, a merging candidate identification will be used.Under certain conditions, near part subregion can not be used as and merge the candidate.As, can not have the merging qualifications for being elected at image or at the borderline subregion of 4x4.Therefore, this merging candidate identification can be done based on the availability of adjacent sectors the variation of adaptivity.For instance, this merges candidate's subregion can be a left side or top subregion, and the sign that uses one 1 bits is as merging candidate identification.Yet if left side and top subregion are not simultaneously, this merging candidate identification can be omitted.Therefore, this merge candidate identification can be based on the variation of the availability adaptivity of this adjacent sectors.When some adjacent sectors are invalid, this merging candidate identification shows as less bit.This subregion merges self adaptation and is applied to each 4x4 partition group.Whether use a subregion to merge to enable sign (enable flag) to indicate this 4x4 subregion allows subregion to merge.
The subregion that is used for ALF filtering also can be considered to a filter unit (filter unit, FU).Can realize better performance if cut apart, an image or image-region can be by the less filter units of being divided into of recurrence, as lower rate distortion (rate-distortion, R-D) cost.Can calculate this R-D cost of a subregion that this R-D cost of filtered subregion is become with computed segmentation.Can realize low R-D cost if cut apart, should be with filtered subregion with divided.Otherwise do not cut apart this subregion.As an alternative, at first an image or image-region also can be divided into less subregion.If adjacent sectors can merged merging can realize better performance, as lower R-D cost.If the R-D cost of the subregion after merging is lower than the R-D cost of independent partitions, this subregion merges, otherwise nonjoinder.According to embodiments of the invention, can merge several with the bit rate of filtered subregion formation one filter unit with the minimizing filter information.
Seeing also Figure 12, is the example that a subregion is cut apart.One subregion (filter unit FU1210) is divided into 5 subregions (FUs1220), as F 0, F 1, F 2, F 3With without the filtering subregion.Can carry out cutting apart of this subregion according to low R-D cost.Figure 13 is that the present invention carries out the example that subregion merges.Becoming filtered subregion 1310 to be considered according to low R-D is merged into 3 subregions 1320, is respectively F 0', F 1' and a reactive filter subregion.Subregion F 0And F 2Be merged into F 0', subregion F 1And F 3Be merged into F 1'.
Figure 14 discloses the example of the grammer design of supporting that the 2-D subregion merges.Subregion merges the message that alf_fs_selection_param (r, c) function representation subregion merges.Whether this ALF merges sign (alf_merge_flag) this current subregion of expression (as the FU in the present embodiment) and merges with other subregions.Its intermediate value 1 this current subregion of expression merges, and value 0 this current subregion of sign does not merge with left side or top subregion.This current subregion adds the filter of this current subregion that index (alf_fu_filter_set_idx) is set when not merged.The first general filter index of subregion of this image is preset as 0, and need not to send to decoder end.This syntactic element alf_merge_up_flag represents that whether this subregion merges with the subregion of its top-direction, and its intermediate value 0 current subregion of expression merges with the FU in left side, the value 1 current subregion of expression with its above the subregion merging.
Another aspect of the present invention relates to the design of an ALF filter.Rate-distortion optimization (Rate-distortion optimization, RDO) be applied to Video coding with the code efficiency that obtains by known to extensively.RDO is applied in model selection: macro block or select (as filter size, filter shape, On/Off etc.), SAO to select (as selecting different pixel sorting techniques) from macro block or coding unit, inter prediction, motion prediction, sef-adapting filter.It is to minimize a rate distortion cost function (rate-distortion cost function) J=D+ λ R that best RDO selects, wherein D is the predicted distortion (estimated distortion) between original pixels and reconstruction (perhaps prediction) pixel, R is the required prediction rate (estimated rate) of this additional information of transmission, and λ is Lagrange multiplier (Lagrange multiplier).
The rate distortion complexity is optimized (rate-distortion-complexity optimization, RDCO) technology and is used for Video coding to obtain good balance at video efficient and encoder complexity also by known to extensive.RDCO is applied in model selection: macro block or from macro block or coding unit, inter prediction, motion prediction.It is to minimize a rate distortion complexity cost function J=D+ λ that best RDCO selects 1R+ λ 2C, wherein D is the predicted distortion between original pixels and reconstruction (perhaps prediction) pixel, R is coding or the required prediction complexity of decoding (according to clock cycle, memory body access or other Complexity Assessment standards), λ for the required prediction rate of this additional information of transmission, C 1And λ 2 areLagrange multiplier.
One embodiment of the invention relate to the ALF/SAO design that coordinates with RDCO.Wherein, determine the optimal candidate item relevant to a design feature according to RDCO.This design feature can one be that pattern determines or minute Division.Carry out model selection and can depend on the ratio of the type of sheet such as I/B/P-sheet or interframe/intraframe coding unit in different ALF patterns.Another embodiment of the present invention is selected for carry out the ALF filter according to RDCO.Be applied to the selection of ALF filter as RDCO, the complexity in RDCO is relevant with the quantity of filter parameter.As an alternative, this RDCO can be used for the selection of ALF filter, and the quantity (A) of the complexity of this RDCO (C) and filter parameter and filtered pixel quantity (B) is relevant is as C=A*B.According to another embodiment of the present invention, this RDCO can be used for the selection of ALF filter, the quantity (A) of the complexity of this RDCO (C) and filter parameter, the quantity of action required in filtered pixel quantity (B) and a pattern (TableOfNumOperations[Mode]) is relevant, as: C=A*B*TableOfNumOperations[Mode].
On June 12nd, 2011 submitted, denomination of invention is " demonstration that is used for Video coding adapts to offset method and device " U.S. patent application case No.13/158,427 have disclosed a kind of SAO scheme, use a plurality of pixel criteria for classification types that each pixel is classified in this scheme, and each classification type is classified to this pixel in a plurality of classifications.According to the kind of this pixel classification type and this pixel, determine with deviant to compensate this skew.This SAO scheme uses band skew (band offset, BO) environment or limit skew (edge offset, EO) classified pixels to classification.The complexity of different pixel classification types is different.Therefore, the RDCO technology can be used to SAO and make one's options the decision of a pixel classification type to realize best RDCO performance.U. S. application case No.13/177,343 have disclosed subregion on the other hand cuts apart.This RDCO technology also can be used to SAO to be cut apart to determine subregion, and the RDCO cost is with relevant with processed pixel quantity and the required operation amount of this pattern (TableOfNumOperations[Mode]), as: the type that the pixel of selection is classified.
Above-mentioned sef-adapting filter can be used in video encoder and/or Video Decoder.In this Video coding or Video Decoder, these reconstruction video data are subjected to the impact of coding noise.Above-mentioned sef-adapting filter scheme can help to improve the visual quality of reconstruction video.The above-mentioned coded system that has an advanced ALF according to embodiments of the invention can be passed through multiple hardwares, software code or above-mentioned in conjunction with realizing.For instance, one embodiment of the invention can be circuit and are integrated into the video compression chip, and perhaps procedure code is integrated into video compression system, to carry out respective handling.One embodiment of the invention also can be procedure code and upward carry out to carry out respective handling at digital signal processor (Digital Signal Processor, DSP).The present invention also can comprise a series of functions, and is carried out by computer processor, digital signal processor, microprocessor, field programmable gate array (Field Programmable Gate Array, FPGA).Define machine readable software code or the firmware code of the embodiment of the present invention by execution, above-mentioned processor can be carried out according to the present invention particular task.Software code or firmware code can carry out in distinct program language and different-format or mode.Software code can be compiled into different target platforms.But, different coded formats, mode and software code language, and relevant with the present invention all spirit according to the invention of other method that code executes the task that makes fall into protection scope of the present invention.
Although the present invention discloses as above with regard to preferred embodiment, so it is not intended to limiting the invention.The persons of ordinary skill in the technical field of the present invention, without departing from the spirit and scope of the present invention, when being used for a variety of modifications and variations.Therefore, protection scope of the present invention is as the criterion when the claims before looking define.

Claims (30)

1. a method that adopts loop filter to process coding, is characterized in that, comprising:
Receive reconstruction video data corresponding with coding video frequency data from a processing unit;
This reconstruction video market demand adaptive-filtering to produce the filtering video data, is wherein adapted to the sign selection based on ALF or the non-operation of carrying out above-mentioned adaptive-filtering based on the ALF of subregion of subregion according to subregion; And
This filtering video data are provided.
2. the method for claim 1, is characterized in that, if selected this based on the ALF of subregion, these reconstruction video data are divided into MxN subregion, and wherein M and N are integer.
3. method as claimed in claim 2, it is characterized in that, be that each subregion in this MxN subregion is specified a packet index according to the one scan figure, wherein use a 1-D to merge the first subregion that representation comprises one first packet index i and merge (i-1) with the second subregion that comprises one second packet index.
4. method as claimed in claim 3, it is characterized in that, this scanning patter can be selected from one group of scanning patter, and this group scanning patter comprises distortion hibert curve, the scanning of horizontal snake, vertical snake scanning, the scanning of Z-type snake, helical scanning, the scanning of four minutes tree scanner uni grids.
5. method as claimed in claim 2, is characterized in that, uses a 2-D to merge representation to allow one first subregion and the adjacent or a plurality of adjacent sectors merging in this MxN subregion, and wherein this one or more adjacent sectors also belongs to this MxN subregion.
6. method as claimed in claim 5, it is characterized in that, this 2-D merges representation and comprises this first subregion of expression whether with one or one first sign that merges of a plurality of adjacent sectors, and this 2-D algorithm further comprises one and merges candidate's sign, if as shown in this first sign this first subregion and one or the merging of a plurality of adjacent sectors.
7. method as claimed in claim 6, it is characterized in that this merging candidate identification according to one or the availability of a plurality of adjacent sectors do adaptive change.
8. whether method as claimed in claim 2, is characterized in that, use this subregion of merging sign expression to be allowed to merge.
9. method as claimed in claim 2, is characterized in that, the border of each subregion between any two subregions in this MxN subregion is the border of a maximum coding unit or the border of a plurality of maximum coding units.
10. the method for designing of a sef-adapting filter or exemplary adaptation offset filter, the method comprises:
Be sef-adapting filter or the exemplary adaptation offset filter decision candidate item relevant to design feature; And
Select the candidate item an of the best from these a plurality of these candidate item according to RDCO.
11. method as claimed in claim 10 is characterized in that, this design feature determines relevant to pattern.
12. method as claimed in claim 11 is characterized in that, this pattern determines the percentage of the interframe that depends on the sheet type or be used for the ALF design/intraframe coding unit.
13. method as claimed in claim 10 is characterized in that, this design feature is relevant from the filtering parameter of the different filters that are used for the ALF design.
14. method as claimed in claim 10 is characterized in that, this design feature is relevant to minute Division.
15. method as claimed in claim 10 is characterized in that, the complexity of this RDCO is relevant with the number of parameters of the filter that is used for the ALF design.
16. method as claimed in claim 10 is characterized in that, one first quantity of the complexity of this RDCO and filter parameter, one second quantity of filtered pixel that is used for the ALF design is relevant.
17. method as claimed in claim 10, it is characterized in that one first quantity of the complexity of this RDCO and filter parameter, with one second quantity of filtered pixel and design one the 3rd quantity of operation of candidate pattern of the model selection of carrying out for ALF relevant.
18. method as claimed in claim 10 is characterized in that, the complexity of this RDCO is relevant with the operation amount of a pixel sorting technique type that designs for AO.
19. method as claimed in claim 10 is characterized in that, the complexity of this RDCO is for one first quantity of the operation of a pixel sorting technique type of AO design and to have second quantity with the pixel that compensated of a deviant relevant.
20. a device that uses a loop filter to process encoded video is characterized in that, comprising:
One first module is used for receiving reconstruction video data corresponding with coding video frequency data from a processing unit;
One second module is used for this reconstruction video market demand adaptive-filtering to produce the filtering video data, wherein according to ALF or the non-operation of based on the ALF of subregion carrying out above-mentioned adaptive-filtering of subregion adaptation sign selection based on subregion; And
One the 3rd module is used for providing this filtering video data.
21. device as claimed in claim 20 is characterized in that, if selected this based on the ALF of subregion, these reconstruction video data are divided into MxN subregion, and wherein M and N are integer.
22. device as claimed in claim 21, it is characterized in that, be that each subregion in this MxN subregion is specified a packet index according to the one scan figure, wherein a 1-D merges representation and is used to indicate the first subregion that comprises one first packet index i and the second subregion that comprises one second packet index and merges (i-1).
23. device as claimed in claim 21, it is characterized in that, one 2-D merges representation and is used to allow one first subregion and adjacent or a plurality of adjacent sectors merging in this MxN subregion, and wherein this one or more adjacent sectors also belongs to this MxN subregion.
24. device as claimed in claim 21 is characterized in that, whether a merging sign is used to indicate this subregion and is allowed to merge.
25. device as claimed in claim 21 is characterized in that, the border of each subregion between any two subregions in this MxN subregion is the border of a maximum coding unit or the border of a plurality of maximum coding units.
26. a device that carries out the design of sef-adapting filter or exemplary adaptation offset filter is characterized in that, this device comprises:
One first module is used to sef-adapting filter or exemplary adaptation offset filter to determine the candidate item relevant to design feature;
One second module is used for selecting from these a plurality of these candidate item according to RDCO the candidate item an of the best.
27. device as claimed in claim 26 is characterized in that, this design feature determines relevant to pattern.
28. device as claimed in claim 27 is characterized in that, this pattern determines the percentage of the interframe that depends on the sheet type or be used for the ALF design/intraframe coding unit.
29. device as claimed in claim 26 is characterized in that, this design feature is relevant to minute Division.
30. device as claimed in claim 26 is characterized in that, this design feature is relevant from the filtering parameter of the different filters that are used for the ALF design.
CN201180048246.0A 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis Active CN103155557B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710063705.1A CN106878729B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis
CN201710063716.XA CN107087180B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis

Applications Claiming Priority (15)

Application Number Priority Date Filing Date Title
US39006810P 2010-10-05 2010-10-05
US61/390,068 2010-10-05
US42172910P 2010-12-10 2010-12-10
US61/421,729 2010-12-10
US201161429313P 2011-01-03 2011-01-03
US61/429,313 2011-01-03
US201161454829P 2011-03-21 2011-03-21
US61/454,829 2011-03-21
US13/093,068 US9094658B2 (en) 2010-05-10 2011-04-25 Method and apparatus of adaptive loop filtering
US13/093,068 2011-04-25
US13/158,427 US9055305B2 (en) 2011-01-09 2011-06-12 Apparatus and method of sample adaptive offset for video coding
US13/158,427 2011-06-12
US13/177,343 2011-07-06
US13/177,343 US8861617B2 (en) 2010-10-05 2011-07-06 Method and apparatus of region-based adaptive loop filtering
PCT/CN2011/080408 WO2012045269A1 (en) 2010-10-05 2011-09-30 Method and apparatus of region-based adaptive loop filtering

Related Child Applications (2)

Application Number Title Priority Date Filing Date
CN201710063716.XA Division CN107087180B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis
CN201710063705.1A Division CN106878729B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis

Publications (2)

Publication Number Publication Date
CN103155557A true CN103155557A (en) 2013-06-12
CN103155557B CN103155557B (en) 2017-03-01

Family

ID=45927217

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201180048246.0A Active CN103155557B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis
CN201710063705.1A Active CN106878729B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis
CN201710063716.XA Active CN107087180B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN201710063705.1A Active CN106878729B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis
CN201710063716.XA Active CN107087180B (en) 2010-10-05 2011-09-30 Adaptive loop filter method and apparatus based on subregion basis

Country Status (5)

Country Link
EP (1) EP2625859A4 (en)
KR (1) KR101526349B1 (en)
CN (3) CN103155557B (en)
CA (1) CA2805722C (en)
WO (1) WO2012045269A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103338374A (en) * 2013-06-21 2013-10-02 华为技术有限公司 Image processing method and device
WO2015007200A1 (en) * 2013-07-15 2015-01-22 Mediatek Inc. Method of sample adaptive offset processing for video coding
CN104486630A (en) * 2014-12-16 2015-04-01 南京仟壹视讯信息技术有限公司 Statistical method for offset of SAO (Session-At-Once) mode in H.265 video coding
CN105357538A (en) * 2015-11-26 2016-02-24 广东中星电子有限公司 Adaptive loop filtering method and apparatus
CN107736026A (en) * 2015-06-12 2018-02-23 英特尔公司 Sample adaptively offsets coding
CN114368150A (en) * 2021-12-22 2022-04-19 鑫精合激光科技发展（北京）有限公司 Three-dimensional printing method and computer storage medium
CN114503578A (en) * 2020-06-03 2022-05-13 腾讯美国有限责任公司 Region adaptive loop filter for video coding and decoding
CN114615494A (en) * 2020-12-04 2022-06-10 咪咕文化科技有限公司 Image processing method, device and equipment

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB201119206D0 (en) * 2011-11-07 2011-12-21 Canon Kk Method and device for providing compensation offsets for a set of reconstructed samples of an image
CN104221383B (en) * 2012-04-13 2018-09-11 三菱电机株式会社 Picture coding device, picture decoding apparatus, image encoding method and picture decoding method
SI2697973T1 (en) * 2012-04-16 2017-11-30 Hfi Innovation Inc. Method and apparatus for loop filtering across slice or tile boundaries
WO2013175698A1 (en) * 2012-05-25 2013-11-28 パナソニック株式会社 Image encoding method, image encoding device, image decoding method, image decoding device, and image encoding/decoding device
WO2013177975A1 (en) * 2012-05-29 2013-12-05 Mediatek Inc. Method and apparatus for coding of sample adaptive offset information
SG10201605050RA (en) 2012-06-11 2016-08-30 Samsung Electronics Co Ltd Method and apparatus for encoding videos sharing sao parameter according to color component
US9386307B2 (en) * 2012-06-14 2016-07-05 Qualcomm Incorporated Grouping of bypass-coded bins for SAO syntax elements
CN104602026B (en) * 2015-01-22 2017-12-01 复旦大学 A kind of reconstruction loop structure being multiplexed entirely encoder under HEVC standard
US11146788B2 (en) 2015-06-12 2021-10-12 Qualcomm Incorporated Grouping palette bypass bins for video coding
WO2016204374A1 (en) * 2015-06-18 2016-12-22 엘지전자 주식회사 Image filtering method and device in image coding system
CN113994671A (en) 2019-06-14 2022-01-28 北京字节跳动网络技术有限公司 Processing video unit boundaries and virtual boundaries based on color format
JP7291846B2 (en) 2019-07-09 2023-06-15 北京字節跳動網絡技術有限公司 Sample decision for adaptive loop filtering
AU2020309130B2 (en) 2019-07-11 2023-06-08 Beijing Bytedance Network Technology Co., Ltd. Sample padding in adaptive loop filtering
MX2022000120A (en) 2019-07-15 2022-02-16 Beijing Bytedance Network Tech Co Ltd Classification in adaptive loop filtering.
CN114503594B (en) 2019-09-22 2024-04-05 北京字节跳动网络技术有限公司 Selective application of sample filling in adaptive loop filtering
JP7326600B2 (en) 2019-09-27 2023-08-15 北京字節跳動網絡技術有限公司 Adaptive loop filtering between different video units
JP7454042B2 (en) 2019-10-10 2024-03-21 北京字節跳動網絡技術有限公司 Padding process at unavailable sample positions in adaptive loop filtering
CN110809158B (en) * 2019-11-12 2021-06-01 腾讯科技（深圳）有限公司 Image loop filtering processing method and device
CN111314711B (en) * 2020-03-31 2021-05-14 电子科技大学 Loop filtering method based on self-adaptive self-guided filtering
WO2022191525A1 (en) * 2021-03-08 2022-09-15 현대자동차주식회사 Video coding method and apparatus using spiral scan order
WO2023225854A1 (en) * 2022-05-24 2023-11-30 Oppo广东移动通信有限公司 Loop filtering method and device, and video coding/decoding method, device and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101543076A (en) * 2006-11-08 2009-09-23 汤姆逊许可证公司 Methods and apparatus for in-loop de-artifact filtering
WO2010030744A2 (en) * 2008-09-11 2010-03-18 On2 Technologies, Inc. System and method for video encoding using adaptive loop filter
WO2010034206A1 (en) * 2008-09-25 2010-04-01 Mediatek Inc. Adaptive filter

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2894856A1 (en) * 2002-01-31 2015-07-15 Samsung Electronics Co., Ltd Filtering method and apparatus for reducing block artifacts or ringing noise
US8498336B2 (en) * 2006-02-02 2013-07-30 Thomson Licensing Method and apparatus for adaptive weight selection for motion compensated prediction
CN101321277A (en) * 2007-06-09 2008-12-10 华为技术有限公司 Method and apparatus for removing block effect
US9967590B2 (en) * 2008-04-10 2018-05-08 Qualcomm Incorporated Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter
US9924184B2 (en) * 2008-06-30 2018-03-20 Microsoft Technology Licensing, Llc Error detection, protection and recovery for video decoding
CN101635849B (en) * 2008-07-24 2011-11-16 青岛海信信芯科技有限公司 Loop filtering method and loop filter
CN101742292B (en) * 2008-11-14 2013-03-27 北京中星微电子有限公司 Image content information-based loop filtering method and filter
CN201345710Y (en) * 2008-12-31 2009-11-11 暨南大学 Loop filter applicable to video decoding
CN101651829A (en) * 2009-06-29 2010-02-17 北京中星微电子有限公司 Loop wave filtering method and device and mobile multi-medium terminal chip
JP5359657B2 (en) * 2009-07-31 2013-12-04 ソニー株式会社 Image encoding apparatus and method, recording medium, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101543076A (en) * 2006-11-08 2009-09-23 汤姆逊许可证公司 Methods and apparatus for in-loop de-artifact filtering
WO2010030744A2 (en) * 2008-09-11 2010-03-18 On2 Technologies, Inc. System and method for video encoding using adaptive loop filter
WO2010034206A1 (en) * 2008-09-25 2010-04-01 Mediatek Inc. Adaptive filter

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
CHIA-YANG TSAI ET AL: "TE10 Subtest2: Coding Unit Synchronous Picture Quadtree-based Adaptive Loop Filter", 《JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG16 WP3 AND ISO/IEC JTC1/SC29/WG11 3RD MEETING》 *
CHING-YEH CHEN ETAL: "CE8 Subtest 2: Adaptation between Pixel-based and Region-based Filter Selection", 《JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG16 WP3 AND ISO/IEC JTC1/SC29/WG11 5TH MEETING》 *
CHING-YEH CHEN ETAL: "CE8 Subtest2: A Joint Proposal on Improving the Adaptive Loop Filter in TMuC0.9 by MediaTek, Qualcomm, and Toshiba", 《JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG16 WP3 AND ISO/IEC JTC1/SC29/WG11 4TH MEETING》 *
KEN MCCANN ET AL: "Samsung’s Response to the Call for Proposals on Video Compression Technology", 《JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG16 WP3 AND ISO/IEC JTC1/SC29/WG11 1ST MEETING》 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10021427B2 (en) 2013-06-21 2018-07-10 Huawei Technologies Co., Ltd. Image processing method and apparatus
CN103338374B (en) * 2013-06-21 2016-07-06 华为技术有限公司 Image processing method and device
CN103338374A (en) * 2013-06-21 2013-10-02 华为技术有限公司 Image processing method and device
WO2015007200A1 (en) * 2013-07-15 2015-01-22 Mediatek Inc. Method of sample adaptive offset processing for video coding
US10659817B2 (en) 2013-07-15 2020-05-19 Hfi Innovation Inc. Method of sample adaptive offset processing for video coding
CN104486630A (en) * 2014-12-16 2015-04-01 南京仟壹视讯信息技术有限公司 Statistical method for offset of SAO (Session-At-Once) mode in H.265 video coding
CN104486630B (en) * 2014-12-16 2017-10-20 北京金山云网络技术有限公司 H.265 in Video coding under SAO patterns offset statistical method
CN107736026A (en) * 2015-06-12 2018-02-23 英特尔公司 Sample adaptively offsets coding
CN107736026B (en) * 2015-06-12 2021-12-07 英特尔公司 Sample adaptive offset coding
CN105357538B (en) * 2015-11-26 2020-01-03 广东中星微电子有限公司 Adaptive loop filtering method and apparatus
CN105357538A (en) * 2015-11-26 2016-02-24 广东中星电子有限公司 Adaptive loop filtering method and apparatus
CN114503578A (en) * 2020-06-03 2022-05-13 腾讯美国有限责任公司 Region adaptive loop filter for video coding and decoding
CN114615494A (en) * 2020-12-04 2022-06-10 咪咕文化科技有限公司 Image processing method, device and equipment
CN114368150A (en) * 2021-12-22 2022-04-19 鑫精合激光科技发展（北京）有限公司 Three-dimensional printing method and computer storage medium

Also Published As

Publication number Publication date
CN107087180A (en) 2017-08-22
CN106878729A (en) 2017-06-20
KR101526349B1 (en) 2015-06-05
EP2625859A4 (en) 2016-03-02
WO2012045269A1 (en) 2012-04-12
CA2805722A1 (en) 2012-04-12
EP2625859A1 (en) 2013-08-14
CN103155557B (en) 2017-03-01
CN107087180B (en) 2019-10-29
CN106878729B (en) 2019-09-24
KR20130030294A (en) 2013-03-26
CA2805722C (en) 2016-03-29

Similar Documents

Publication Publication Date Title
CN103155557A (en) Method and apparatus of region-based adaptive loop filtering
US8861617B2 (en) Method and apparatus of region-based adaptive loop filtering
CN103200402B (en) The method for removing deblocking man-made noise
CN105959692B (en) Method for video coding for being encoded to segmentation block
AU2011313735B2 (en) Method and apparatus of adaptive loop filtering
CN104602004B (en) The coding/decoding method of intra prediction mode
CN103404137B (en) The method and apparatus of effective sample adaptive equalization
CN103209324B (en) A kind of method for applying edge compensation
CN109792519A (en) Image processing method and its device based on intra prediction mode
CN102804776A (en) Method and apparatus for adaptive loop filtering
CN102754442A (en) Method and apparatus for processing a video signal
CN104811736A (en) Method and apparatus for processing a video signal
CN107197258A (en) Loop circuit filtering method and its equipment
CN110366850A (en) Method and apparatus for the method based on intra prediction mode processing image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20160920

Address after: Hsinchu County, Taiwan, China

Applicant after: Atlas Limited by Share Ltd

Address before: China Taiwan Hsinchu Science Park Hsinchu city Dusing a road No.

Applicant before: MediaTek.Inc

GR01 Patent grant
GR01 Patent grant