CN103155557B - Adaptive loop filter method and apparatus based on subregion basis - Google Patents
Adaptive loop filter method and apparatus based on subregion basis Download PDFInfo
- Publication number
- CN103155557B CN103155557B CN201180048246.0A CN201180048246A CN103155557B CN 103155557 B CN103155557 B CN 103155557B CN 201180048246 A CN201180048246 A CN 201180048246A CN 103155557 B CN103155557 B CN 103155557B
- Authority
- CN
- China
- Prior art keywords
- subregion
- alf
- mxn
- pixel
- filter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/19—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding using optimisation based on Lagrange multipliers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
Abstract
It is based in block motion compensation system one, because loss operation, coding noise will increase.ALF is a kind of technology improving this quality.One pixel self adaptation（Pixel adaptive or pixel adaptation, PA）ALF is developed, and using SLM classified pixels, and applies a corresponding ALF wave filter to each pixel according to this SLM.Although this PA ALF enables better performance compared to tradition based on the ALF of single filter, this PA ALF is because high complexity and the switching of the wave filter with pixel as unit bring higher complexity and bigger power consumption.Therefore, it is disclosed for based on the ALF scheme of subregion, device allows to carry out sef-adapting filter selection based on each subregion, and need not change the wave filter with pixel as unit.One embodiment of the invention, an image is divided into MxN subregion.The subregion in MxN subregion should be allowed to merge to improve performance by ALF based on subregion.Another aspect of the present invention, optimal ALF design can also consider system complexity using RDCO.This RDCO technology is also applied to SAO design.
Description
Cross reference
This application claims the priority of following applications：On October 5th, 2010 submits, invention entitled " improved adaptive
Answer loop filter " U.S. Provisional Application case No.61/390,068；On December 10th, 2010 submits, invention entitled " from
U.S. Provisional Application case No.61/421,729 of the complexity optimized method of rate distortion of adaptation loop filter "；July 6 in 2011
Day submits, U. S. application case No.13/ of invention entitled " the adaptive loop filter method and apparatus based on subregion basis "
177,343；On March 21st, 2011 submits, the U.S. of invention entitled " auto-adaptive loop filter based on subregion basis "
Provisional Application No.61/454,829.The present invention is also submitted with April 25th, 2011, and invention entitled " adaptive loop circuit is filtered
Wave method and device " U.S. patent application case No.13/093,068 is relevant；On June 12nd, 2011 submits, invention entitled
" demonstration for Video coding adapts to offset method and device " U.S. patent application case No.13/158,427 is relevant；With 2011
On January 3, in submits, U.S. Provisional Application case No.61/429 of invention entitled " Lian Fake adaptive loop filter device ",
313 is relevant.The application is using above-mentioned U.S. Provisional Application case and patent application case as reference.
Technical field
The present invention is related to Video coding (video coding), and more particularly in adaptive loop filter
(Adaptive Loop Filtering) relevant coding techniques.
Background technology
Motion compensation (motion compensation) interframe encode (inter-frame coding) is in multiple codings
Extensively apply in standard, such as MPEG-1/2/4 and H.261/H.263/H.264/AVC.Motion in above-mentioned coding system is estimated
Meter, motion compensation and subsequent treatment are all based on what block (block basis) was carried out.In compression procedure, due to employ as
Quantify (quantization) damages operation (lossy operation), it is possible that coding noise (coding
noise).In rebuilding (reconstructed) video data, particularly in block edge or adjacent edges, have obvious volume
Code artifact (coding artifact).In order to reduce the explicitly of coding artifact, the coding system of renewal is for example H.264/AVC
And high-performance video coding (High Efficiency Video Coding, HEVC) begins with one kind and is referred to as deblocking
(deblock) technology.Process of deblocking adaptively is applied filtering in block edge, the edge being brought with smoothed code noise
Or the mutation of adjacent edges, and maintain the definition of image.Additionally, according to the characteristic of interframe encode, the process of deblocking can be integrated
Operated in loop.In nearest HEVC develops, to process the reconstruction frames after deblocking using adaptive loop filter.From
Adapt to loop filtering to be commonly used for making further loop processed and often using after the reconstruction video data that deblocks.
Being only applied to filtering can raising property for traditional auto-adaptive loop filter (Adaptive Loop Filter, ALF)
The block of energy.Can not help carry high performance piece using adaptive loop filter for those, typically not carry out adaptive loop circuit
Filtering.As application ALF, a single filter (single filter, SF) is applied to the block in a piece of (slice).This is single
Wave filter is to choose to reach optimal performance from one group of candidate, such as minimum distortion, minimum rate or R-D
(Rate-distortion) performance.Such ALF scheme is referred to as single sef-adapting filter scheme (SF ALF).Another kind of ALF
Scheme is referred to as QC_ALF scheme, is to propose (in day in April, 2010 15-23, to tire out in German moral by Qualcomm (Qualcomm)
ITU-T SG16 WP3 and ISO/ of the integration and cooperation group (JCT-VC) with regard to Video coding that Si Dun (Dresden) holds
In the first session of IEC JTC1/SC29/WG11, Karczewicz's et al. is entitled：" Qualcomm is with regard to Video coding
Propose in recommendation ", be recorded in document：JCTVC-A121).According to this QC_ALF, this ALF wave filter be based on block base application in
The video data that deblocks on one piece.Corresponding each piece, calculate the improvement Laplace operator of each pixel (i, j) in this block
(i, j) (Sum-modified Laplacian Measure (i, j), SLM (i, j)).This SLM of each pixel basis on this block
Value is classified in the plurality of rank or classification.Although the performance of this QC_ALF scheme can be better than the performance of this SF ALF,
It is the calculating two of each this SLM of pixel and the conversion from pixel to the wave filter of another pixel will lead to higher calculating multiple
Miscellaneous degree and the more efficiency of consumption.Accordingly, it would be desirable to development is same to be provided that each subregion has the advantages that multiple wave filter select
When there is no the ALF scheme of the conversion of wave filter between the computational complexity of height and pixel.
In the ALF design that region division and pattern determine, an entitled rate-distortion optimization (rate-distortion
Optimization, RDO)) optimisation technique be often used in during region division and pattern determine.Although this RDO technology can
Realize optimal rate distortion performance, but it does not consider system complexity, this will consume valuable system resource.Cause
This, need using a kind of new prioritization scheme in this three (rate, distortion and complexity) to reach optimization.Therefore, a kind of rate
Distortion complexity optimizes (rate-distortion-complexity optimization, RDCO) technology and is used in ALF and sets
In meter.This RDCO technology is also applicable in SAO design to realize the performance of optimal rate distortion complexity.
Content of the invention
Disclosed herein the method and apparatus that encoded video is processed using adaptive loop filter.In the present invention one is real
Apply in example, include regarding with coding from a processing unit reception using the method and device that adaptive loop filter processes encoded video
Frequency is according to a corresponding reconstruction video data；To this reconstruction video data application adaptive-filtering to produce filtering video number
According to；This filtering video data is provided.The operation of this adaptive-filtering can be to adapt to mark according to subregion to select based on subregion
The ALF or ALF being not based on subregion.If having selected this ALF based on subregion, this reconstruction video data is divided into MxN point
Area, wherein M and N are integer.The subregion of this MxN subregion can be merged based on 1-D or 2-D representation.Further, one
Merge mark for representing whether a subregion is merged with one or more adjacent sectors.When using 1-D representation, foundation sweeps
Tracing shape is that each of this MxN subregion specifies a packet index.This scanning patter can enter from one group of scanning patter
Row selects, and this group scanning patter includes deforming hibert curve, the scanning of horizontal Serpentiss, the scanning of vertical Serpentiss, the scanning of Z-type Serpentiss, spiral
Scanning, four points of tree scanner uni grid scannings.According to another embodiment of the present invention, any two subregion in this MxN subregion
Between the border of each subregion be the border of a maximum coding unit or the border of multiple maximum coding unit.Also foundation
Another embodiment of the present invention, merges mark using one and represents whether this subregion is allowed to merge.
The invention discloses the method for designing of a sef-adapting filter or exemplary adaptation offset filter and device.Foundation
One embodiment of the invention, the method for designing of this sef-adapting filter or exemplary adaptation offset filter and device include as
Lower step：It is that sef-adapting filter or exemplary adaptation offset filter determine the candidate item related to design feature；And according to
Select an optimal candidate item according to RDCO from this candidate item the plurality of.This design feature may determine with pattern or subregion divides
Relevant.For this ALF design, the complexity of this RDCO with for ALF design wave filter number of parameters, by filtered pixel
Quantity, the number of parameters of wave filter are relevant with by the combination of the quantity of filtered pixel, or quantity, the general also with filter parameter
The combination designing the quantity of the operation of the candidate pattern of the model selection carrying out by the quantity of filtered pixel and for ALF is relevant.Right
In SAO design, the operation amount of the complexity pixel classifications Method type of this RDCO is relevant, or with pixel classifications Method type
Operation amount and have a deviant the combination by the pixel quantity being compensated relevant.
Brief description
Fig. 1 discloses the exemplary block schematic diagram of the video coding system based on motion compensated prediction, wherein self adaptation ring
Path filter is applied to rebuild video data.
Fig. 2 discloses the example of the sef-adapting filter based on pixel, and wherein SLM is used for dividing one 6 × 4 pieces of pixel
To three classifications.
Fig. 3 discloses and for the picture comprising 416 × 240 pixels to be divided to 4 × 4 maximum coding unit (Largest
Coding Unit, LCU) alignment subregion example, each of which square is to comprise a LCU of 64 × 64 pixels and non-
Rightmost and non-bottom subregion comprise 2 × 1 LCU.
Fig. 4 discloses and supports the grammar design with the tagged ALF based on subregion, and this subregion adaptive labeling indicates whether
Using the ALF based on subregion.
Fig. 5 discloses the scanning passing through 4 × 4 subregions according to deformation hibert curve (deformed Hilbert curve)
Sequentially.
Fig. 6 discloses the scanning sequency passing through 4 × 4 subregions according to horizontal Serpentiss scanning (horizontal snake scan).
Fig. 7 discloses the scanning sequency passing through 4 × 4 subregions according to vertical Serpentiss scanning (vertical snake scan).
Fig. 8 discloses the scanning sequency passing through 4 × 4 subregions according to Z-type Serpentiss scanning (zig-zag scan).
Fig. 9 discloses the scanning sequency passing through 4 × 4 subregions according to helical scanning (spiral scan).
Figure 10 discloses the scanning sequency passing through 4 × 4 subregions according to four points of trees scanning (quad-tree scan).
Figure 11 discloses the scanning sequency passing through 4 × 4 subregions according to grid scanning (raster scan).
Figure 12 discloses the example of a fractionation subregion, and wherein one subregion is split into 5 subregions, such as：F0, F1, F2, F3And one
Reactive filter subregion.
Figure 13 discloses one and will be merged into the models of 3 subregions by filtering subregion (to-be-filtered regions) by 5
Example, this 3 are respectively F0’、F1' and a reactive filter subregion.
Figure 14 discloses a grammar design supporting the merging of 2-D subregion.
Specific embodiment
For compression of digital video, motion compensation interframe coding is a kind of effective compress technique, widely uses
In multiple coding standards, such as MPEG-1/2/4 and H.261/H.263/H.264/AVC.In motion compensating system, motion is estimated
Meter/compensation and subsequent compression are typically based on block and carry out in block.In compression procedure, damage behaviour due to employing as quantify
Make, it is possible that coding noise.In rebuilding video data, particularly in block edge or adjacent edges, have obvious volume
Code artifact.In order to reduce the explicitly of coding artifact, in the coding system such as said system of renewal H.264/AVC and
HEVC system begins with a kind of technology being referred to as and deblocking.Process of deblocking adaptively is applied filtering in block edge, with
Edge or the mutation of adjacent edges that smoothed code noise brings, and maintain the definition of image.Additionally, according to interframe encode
Characteristic, the process of deblocking can be integrated in loop and be operated.
In HEVC system, in addition to deblocking filter, also it is referred to as auto-adaptive loop filter (ALF) using another
Loop filter.Deblocking filter is only applied and block boundary, and sef-adapting filter then can apply to a frame (frame),
All pixels in one domain (field), a piece of (slice) or a picture region.Traditional ALF is only applied to use wave filter
High performance piece can be carried.High performance piece can not be carried for those using ALF and then not use ALF.When ALF is used, one
Single filter SF is applied in a piece of interior block.This single filter is to choose to reach from one group of candidate
To optimal performance, such as minimum distortion, minimum rate or R-D performance.Such ALF scheme is referred to as single sef-adapting filter side
Case (SF ALF).In this, decoder is transferred to by the related information of selecting filter.To be transmitted or store to save this
Information, this group ALF wave filter can be predefined, and this wave filter selects to represent using an index.As an alternative
, this filter can be obtained in based on the time delay arrangement rebuilding video data.It is therefore not necessary to additional information
(side information) or only need little additional information.Additionally, the relevant information of the wave filter being used can be reduced
Instrument can also be used, such as：Encode this filter coefficient using entropy code and or transmit the difference of this coefficient.
Fig. 1 disclose one using adaptive loop filter and the coding system deblocked system block diagrams.Fig. 1 discloses tool
There is the system square of the video encoder based on motion compensated prediction of function of deblocking.Compressibility 100 shows and typically regards
Frequency encoder and (intra/inter-prediction) within the frame/frames prediction, transform/quantization (transformation/
Quantization) it is combined with entropy code (entropy coding), to produce compressed video data.Inputting video data
(i.e. primary signal 112) enter encoder by input interface, and this primary signal 112 is entered by prediction module 110 within the frame/frames
Row is processed.In intra prediction mode, the data of this input is predicted using encoded image in same frame or same domain.
In inter-frame forecast mode, this prediction can be based on the previous reconstruction data 142 in sequential, wherein, this reconstruction data 142 quilt
It is stored in reference picture buffers 140.This inter prediction can be a list 0 predictive mode, and wherein, this prediction is based on solution
Image before the present image and in the first list of reference picture for the code order.This inter prediction can also be a list 1
Predictive mode, if this current slice (current slice) is a B- piece (B-slice), this inter prediction is suitable based on decoding
Image before the present image and in the second list of reference picture for the sequence.This inter prediction can also be bi-directional predicted (bi-
Prediction) pattern, if current slice is B- piece, this inter prediction is with reference to figure based on list 0 reference picture and list 1
Picture.In this inter-frame forecast mode, this within the frame/frames prediction module 110 this prediction data is provided to adder 115, and from
This prediction data is deducted in this primary signal 112.The output of this adder 115 is referred to as forecast error 117, transform/quantization mould
Block 120 carries out transform/quantization process to this forecast error 117 further.This transform/quantization module 120 is by this forecast error 117
Be converted to coded identification, processed further to produce compression output bit flow 132 (i.e. compression bit stream) by entropy code module 130
For storing or transmitting.(inverse DCT and inverse quantization, is represented by for inverse transformation/quantization
IDCT/IQ) at module 160 forecast error 117 of this transform/quantization module 120 offer of reason to form reconstruction forecast error
(reconstructed prediction error)162.In this inter-frame forecast mode, rebuild forecast error 162 and regard with reconstruction
Frequency combines according to 119 to form this current reconstructed frame 152.In this intra prediction mode, this reconstruction forecast error 162 and same figure
Previous reconstruction perimeter data superposition in picture.In this inter-frame forecast mode, this within the frame/frames prediction module 110 transmission this is pre-
Survey signal 119 to rebuilding module 150, wherein, this reconstruction data 119 is according to the previous reconstructed frame in sequential or according to same
It is inter-frame forecast mode or intra prediction mode that previous reconstruction perimeter data in image depends on.
This reconstruction data is stored in conduct in reference picture buffers 140 by deblocking module 170 and ALF180 after being processed
The reference video data of reason subsequent picture.Original ALF in HEVC is block-based application.If it is (lower that this ALF can improve performance
Distortion, lower bit rate, more preferable R-D performance), then this block opens ALF.Otherwise, this block closes ALF.A kind of ALF specification quilt
Referred to as QC_ALF scheme, is to be proposed (in day in April, 2010 15-23, in Dresden, Germany by Qualcomm (Qualcomm)
(Dresden) ITU-T SG16WP3 and ISO/IEC of the integration and cooperation group (JCT-VC) with regard to Video coding holding
In the first session of JTC1/SC29/WG11, Karczewicz's et al. is entitled：" Qualcomm is with regard to the suggestion of Video coding
Propose in book ", be recorded in document：JCTVC-A121).According to this QC_ALF, this ALF is applied to the video data that deblocks and is based on picture
Element basis.Corresponding each piece, calculate improvement Laplace operator (i, the j) (Sum- of each pixel (i, j) in this block
Modified Laplacian Measure (i, j), SLM (i, j)) as follows：
Wherein, this R (i, j) is the video data that deblocks.Calculate this SLM and be based on (2K+1) x (2L+1) centered on (i, j)
Adjacent windows.This adjacent windows size can be 9x9,7x7,5x5or 3x3.In order to reduce complexity, using a size of 3x3's
Adjacent windows.Calculate the SLM of each pixel of this block, this pixel is sorted out one of to M group.Refer to Fig. 2,
It discloses sorts out this pixel to three groups according to this SLM value.In this QC_ALF scheme, filter according to each group selection one
The device pixel related to this group is filtered.In order to reduce computational complexity, this ALF wave filter is typically horizontally or vertically right
Claim.For example, using such as 9x9,7x7, or 5x5 such diamond mode filter, or as such in 5x5,3x3 square
Wave filter.Each pixel is applied to based on the ALF of SLM, and different pixels will apply different wave filter.Therefore QC_ALF is same
Sample is referred to as pixel-self adaptation (pixel-adaptive or pixel-adaptation, PA) ALF.Above-mentioned SF ALF
It is considered a kind of special PAALF, it is only with one group of wave filter.
Although PAALF can adaptive based on pixel selection one wave filter, its remain a need for by decoder calculate SLM come
Obtain the group information of each pixel, because demand additional information (side information) is encoded important information.
Accordingly, it would be desirable to developing a kind of ALF scheme better performance can be realized and or reduces computational complexity.Therefore, the present invention takes off
Reveal a kind of ALF specification of subregion basis (region based).According to the ALF scheme of the present invention, apply this ALF to deblock to this and regard
Frequency is according to based on subregion basis.Divide a picture or image-region is multiple fixed blocks or forms multiple points with fixed block group
Area.As replace, an image or image-region can be split or recurrence Ground Split is formed multiple subregions.Citing comes
Say, recursively can divide a picture using four points of trees or image-region forms the plurality of subregion.Can set in grammer
Put a mark to be used to indicate whether using subregion basis ALF or case of non-partitioned basis ALF.For example, one identify for
Selected between subregion basis ALF and block basis (block based) ALF.The derivation of block basis filters can use picture
The similar method of element basis ALF.For example, the method that Chong et al. describes one piece of basic ALF, will be all in 4 × 4 pieces
The meansigma methodss of the activity value that the Laplace operator of pixel is calculated are as the single activity indicators of this 4x4 block.In in March, 2011
16-23 day, the ITU-T of the integration and cooperation group (JCT-VC) with regard to Video coding holding in Geneva, Switzerland (Geneva)
In 5th meeting of SG16WP3 and ISO/IEC JTC1/SC29/WG11, Chong's et al. is entitled：" CE8 subject under discussion 2：It is based on
Propose in the block of auto-adaptive loop filter (ALF) ", be recorded in document：JCTVC-E323.The method needs to calculate this 4 × 4 pieces
The activity value of the Laplace operator of each pixel.Compared to pixel basis ALF although the method has no saving operand, but
Block basis ALF can reduce the frequency of the different wave filter of switching of pixel basis ALF.Can also be replaced using other metering systems
The activity value of Laplace operator as criteria for classification, such as：Band skew (band offset, BO) or edge offset (edge
Offset, EO) it is used for exemplary adaptation skew (sample adaptive offset, SAO) it is also possible to make as criteria for classification
Substituted with the disclosed SLM calculating method of Karczewicz et al..BO and EO, for SLM, needs less amount of calculation.
The example of one ALF based on subregion basis using block group, an image can be divided into the basic phase of 16 sizes
Deng subregion.For example, the zoned width of a non-rightmost subregion can be (PicWidth/4), and wherein PicWidth is figure
Image width degree.For rightmost subregion, this zoned width is then (PicWidth- (PicWidth/4) * 3).Non- bottommost subregion
Height is then (PicHeight/4), and wherein PicHeight is picture altitude.Height for bottommost subregion is then
(PicHeight-(PicHeight/4)*3).In this example, this rightmost subregion and bottommost subregion are likely larger than other
Subregion.Another example, as shown in figure 3, an image segmentation is become 16 sizes of substantially equal based on LCU alignment (LCU--
Aligned subregion).Wherein, the border of this subregion must be then the border of maximum coding unit (LCU).The size of this image
For 416x240, and comprise 7x4 LCU, wherein, each LCU comprises 64x64 pixel.The subregion width of this non-rightmost subregion
Spend for (((PicWidthInLCUs+1)/4) * 64), wherein PicWidthInLCUs represents the wide LCU quantity of image.Non- bottom
The height of subregion is (((PicHeightInLCUs+1)/4) * 64), and wherein, PicHeightInLCUs represents the high LCU of image
Quantity.The size of this rightest subregion and bottommost subregion can be by picture traverse (PicWidth), picture altitude
(PicHeight), the size of non-the rightest subregion and non-bottom subregion is derived from.One index is assigned to every 4x4 subregion.Make
With 4x4 subregion as an example, the present invention is not limited to the example of this 4x4 subregion.In fact, the present invention can be divided using MxN
Area.Wherein, M and N is integer.Its picture traverse of one image is PicWidthInSamples and picture altitude is
PicHeightInSamples.Then the coordinate of the subregion index in each its upper left corner of subregion is that the subregion index of (x, y) can be as
Lower derivation is learnt.(1 ＜ ＜ Log2MaxCUSize) is the size of maximum coding unit, and xMaxIndex and yMaxIndex is
In maximum subregion index both horizontally and vertically.Corresponding, the horizontal interval x_interval of subregion and by stages vertical
Interval y_interval can be learnt by following derivations of equation.
X_interval=((((PicWidthInSamples+ (1 ＜ ＜ Log2MaxCUSize) -1) ＞ ＞
Log2MaxCUSize)+x_round)/(xMaxIndex+1)), and (1)
Y_interval=((((PicHeightInSamples+ (1 ＜ ＜ Log2MaxCUSize) -1) ＞ ＞
Log2MaxCUSize)+y_round)/(yMaxIndex+1)), (2)
Wherein x_round=max (0, (xMaxIndex+1)/2-1) andy_round=max (0, (yMaxIndex+1)/
2-1).
This horizontal index x_idx and this vertical index y_idx can be derived as follows：
X_idx=min (xMaxIndex, x/ (x_interval ＜ ＜ Log2MaxCUSize)), and (3)
Y_idx=min (yMaxIndex, y/ (y_interval ＜ ＜ Log2MaxCUSize)) (4)
This subregion index region_idx is determined according to below equation：
Region_idx=y_idx* (xMaxIndex+1)+x_idx. (5)
When this 4x4 subregion is used by the ALF based on subregion, this subregion index can be derived as follows.The water of this subregion
Perpendicular separation y_interval of flat interval x_interval and by stages can be learnt by following derivations of equation：
X_interval=((((PicWidthInSamples+ (1 ＜ ＜ Log2MaxCUSize) -1) ＞ ＞
Log2MaxCUSize)+1) ＞ ＞ 2), and (6)
Y_interval=((((PicHeightInSamples+ (1 ＜ ＜ Log2MaxCUSize) -1) ＞ ＞
Log2MaxCUSize)+1) ＞ ＞ 2). (7)
This horizontal index x_idx and this vertical index y_idx can be derived as follows：
X_idx=min (3, x/ (x_interval ＜ ＜ Log2MaxCUSize)), and (8)
Y_idx=min (3, y/ (y_interval ＜ ＜ Log2MaxCUSize)). (9)
This subregion index region_idx is determined according to below equation：
Region_idx=(y_idx ＜ ＜ 2)+x_idx. (10)
This filter index filter_idx (x, y) is determined according to below equation：
Filter_idx (x, y)=region_tab [region_idx], (11)
Wherein, region_tab [16]={ 0, Isosorbide-5-Nitrae, 5,15,2,3,6,14,1,10,7,13,12,9,8 }.
Two adjacent sectors, the subregion such as with continuity index can be merged.After subregion merges, dividing after each merging
Area applies a wave filter.This image can use ALF, block-based ALF based on pixel or based on the ALF of subregion at
Reason.Compared to the ALF based on pixel and block-based ALF, the ALF based on subregion can save that self adaptation pixel carries out based on
The classified counting of pixel and the block-based calculating being carried out based on adaptive block, accordingly, when using the ALF based on subregion, solution
That average computational load of code device also accordingly reduces.Further, what the ALF based on subregion was significant decreases turning of image median filter
Change number of times, therefore conversion power consumption is less.Fig. 4 discloses between supporting in the ALF based on subregion with based on the ALF of pixel and is selected
Select, or carry out the grammar design of selection between the ALF based on subregion and block-based ALF.Unique grammer is changed into
Increase by a mark (region_adaptation_flag) in head parameter devices alf_param () of ALF or in image ginseng
Counting apparatus (PPS) are to be selected between the ALF based on subregion and block-based ALF.
Carry out subregion merging and can improve coding efficiency further.Adjacent sectors are likely to be of similar feature and can share
Same wave filter is to reduce instruction ALF wave filter information needed.A kind of method that execution subregion merges be by 2-D region and extremely
1-D region.For example, this 4x4 subregion can be converted into the 1-D subregion using packet index 0-15.Execute this 2-D
Being converted into 1-D can be according to a special scan pattern.There is scan pattern known to many can be used for changing 2-D subregion
Become 1-D subregion.Deformation hibert curve (deformed Hilbert curve) as shown in Figure 5, the horizontal Serpentiss shown in Fig. 6
Scanning (horizontal snake scan), vertical Serpentiss scanning (vertical snake scan) shown in Fig. 7, shown in Fig. 8
Z-type Serpentiss scanning (zig-zag scan), the helical scanning (spiral scan) shown in Fig. 9, four shown in Figure 10 point tree scanning
Grid scanning (raster scan) shown in (quad-tree scan) and Figure 11.Changing this 2-D subregion to this 1-D subregion
When, adjacent subregion, can be combined to share same filtering as merged the subregion with continuity index indicated by representation
Device.For example, merge, using one, the subregion whether subregion that mark one sign group index is n is (n-1) with group index to merge.
Representation execution subregion can also be merged using 2-D to merge, wherein one subregion can be merged with the subregion near.
Further, first, whether merged indicate this subregion using one first, if this first mark indicates that this subregion is closed
And, then a merging candidate identification will be used.Under certain conditions, partial-partition nearby can not be by as merging candidate.
As having merging qualifications for being elected in image or in the borderline subregion of 4x4.Therefore, this merging candidate identification is permissible
Make the change of adaptivity based on the availability of adjacent sectors.For example, this merging candidate's subregion can for one left side or
Top subregion, and the mark of one 1 bits is used as merging candidate identification.If however, left side and top subregion are not simultaneously
Exist, then this merging candidate identification can be omitted.Therefore, this merging candidate identification can availability based on this adjacent sectors from
Adaptive change.When some adjacent sectors are invalid, this merging candidate identification then shows as less bit.This subregion closes
And self adaptation is applied to every 4x4 partition group.Merge enable mark (enable flag) using a subregion and indicate this 4x4 subregion
Subregion whether is allowed to merge.
Subregion for ALF filtering can also be considered as a filter unit (filterunit, FU).If segmentation enables
Better performance, then an image or image-region less filter unit can be divided into by recurrence, such as lower rate is lost
Very (rate-distortion, R-D) cost.One can be calculated and will be filtered this R-D cost of subregion and dividing that calculating is divided into
This R-D cost in area.If segmentation can realize low R-D cost, this will be filtered subregion will be divided.Otherwise do not split this
Subregion.As an alternative, an image or image-region can also be first separated into less subregion.Adjacent sectors can be by
If merge enabling better performance, as lower R-D cost.If the R-D cost of the subregion after merging is less than solely
The R-D cost of vertical subregion, then this subregion merge, otherwise nonjoinder.According to embodiments of the invention, several general can be merged
One filter unit is formed to reduce the bit rate of filter information by filtering subregion.
Refer to Figure 12, be the example of a subregion segmentation.One subregion (filter unit FU1210) is divided into 5 subregions
(FUs1220), as F0, F1, F2, F3No filter subregion.The segmentation of this subregion can be carried out according to low R-D cost.Figure 13 is this
Invention carries out the example of subregion merging.Become and should will be considered to merge into 3 subregions by filtering subregion 1310 according to low R-D
1320, respectively F0’、F1' and a reactive filter subregion.Subregion F0And F2It is merged into F0', subregion F1And F3It is merged into F1’.
Figure 14 discloses the example of the grammar design supporting 2-D subregion to merge.Subregion merges alf_fs_selection_
Param (r, c) function describes the message of subregion merging.This ALF merges mark (alf_merge_flag) and represents this current bay
Whether (FU as in the present embodiment) is merged with other subregions.Its intermediate value 1 represents that this current bay merges, and value 0 mark should
Current bay is not merged with left side or top subregion.The filtering of this current bay is then added when this current bay is merged
Device setting index (alf_fu_filter_set_idx).The general filter index of first subregion of this image is preset as 0, and nothing
Decoder end need to be sent to.This syntactic element alf_merge_up_flag represents the subregion whether with its top-direction for this subregion
Merge, its intermediate value 0 represents that current bay is merged with the FU in left side, value 1 represents that current bay is merged with the subregion above it.
Another aspect of the present invention is related to the design of an ALF wave filter.Rate-distortion optimization (Rate-distortion
Optimization, RDO) be applied to Video coding to obtain code efficiency well known.RDO applies in pattern choosing
Select：Macro block or select (as wave filter is big from macro block or coding unit, inter prediction, motion prediction, sef-adapting filter
Little, filter shape, unlatching/closing etc.), SAO select (such as selecting different pixel classifications methods).Best RDO selects
Minimize a rate distortion cost function (rate-distortion cost function) J=D+ λ R, wherein D is original pixels
And rebuild the predicted distortion (estimated distortion) between (or prediction) pixel, R is this additional information institute of transmission
The prediction rate (estimated rate) needing, λ is Lagrange multiplier (Lagrange multiplier).
Rate distortion complexity optimizes (rate-distortion-complexity optimization, RDCO) technology and uses
Also well known with the balance obtaining in video efficiency with encoder complexity in Video coding.RDCO applies in pattern choosing
Select：Macro block or from macro block or coding unit, inter prediction, motion prediction.Optimal RDCO selects to be to minimize a rate to lose
True complexity cost function J=D+ λ1R+λ2C, wherein D are original pixels and rebuild the pre- dendrometry between (or prediction) pixel
Very, R is the prediction rate transmitting needed for this additional information, and C is prediction complexity (the foundation clock week needed for coding or decoding
Phase, memory body access or other Complexity Assessment standards), λ1And λ2For Lagrange multiplier.
One embodiment of the invention is related to the ALF/SAO design with RDCO cooperation.Wherein, determine and a design according to RDCO
The related optimal candidate item of feature.This design feature can one be pattern determine or subregion divide.Different ALF patterns is entered
Row mode selects can be depending on the ratio of type such as the I/B/P- piece or interframe of piece/intraframe coding unit.The present invention is another
Embodiment is to carry out ALF wave filter selection according to RDCO.When RDCO is applied to the selection of ALF wave filter, the complexity in RDCO
Property is relevant with the quantity of filter parameter.As an alternative, this RDCO can be used for the selection of ALF wave filter, and this RDCO answers
The quantity (A) of polygamy (C) and filter parameter and will be relevant for the pixel quantity being filtered (B), such as C=A*B.According to the present invention's
Another embodiment, this RDCO can be used for the selection of ALF wave filter, the complexity (C) of this RDCO and the quantity of filter parameter
(A), by the quantity of action required in the pixel quantity being filtered (B) and a pattern (TableOfNumOperations [Mode])
Relevant, such as：C=A*B*TableOfNumOperations [Mode].
On June 12nd, 2011 submits, invention entitled " demonstration for Video coding adapts to offset method and device "
U.S. patent application case No.13/158,427 disclose a kind of SAO scheme, using multiple pixel classifications types in the program
Each pixel is classified, and each classification type is by this pixel classifications to multiple classifications.According to this pixel classifications type
And the species of this pixel, determine with deviant to compensate this skew.This SAO scheme is using band skew (band offset, BO) ring
Border or side skew (edgeoffset, EO) classified pixels are to classification.The complexity of different pixel classifications types is different.Cause
This, RDCO technology can be used for SAO make a choice a pixel classifications type decision to realize optimal RDCO performance.The U.S.
Application case No.13/177,343 another aspect discloses subregion segmentation.This RDCO technology can also be used for SAO to determine subregion
Segmentation, RDCO cost and the operation amount (TableOfNumOperations needed for the pixel quantity that will be processed and this pattern
[Mode]) related, such as：The type of the pixel classifications selecting.
Above-mentioned sef-adapting filter can be used in video encoder and/or Video Decoder.In this Video coding
Or in Video Decoder, this reconstruction video data is affected by coding noise.Above-mentioned sef-adapting filter scheme can help carry
The high visual quality rebuilding video.Above-mentioned according to embodiments of the invention, there is the coding system of advanced ALF can be by multiple hard
Part, software code or above-mentioned be implemented in combination with.For example, one embodiment of the invention can be integrated into video compress chip for circuit,
Or procedure code is integrated into video compression system, to carry out respective handling.One embodiment of the invention is alternatively procedure code and is counting
The upper execution of word signal processor (Digital Signal Processor, DSP) is to carry out respective handling.The present invention also can comprise
A series of functions, and by computer processor, digital signal processor, microprocessor, field programmable gate array
(FieldProgrammable Gate Array, FPGA) executes.The machine readable defining the embodiment of the present invention by execution is soft
Part code or firmware code, above-mentioned processor can execute particular task according to the present invention.Software code or firmware code can be in distinct program languages
Carry out in different-format or the mode of making peace.Software code can be compiled into different target platforms.But, different coded formats, side
Formula and software code language, and the spirit that makes other methods that code execute task all to meet the present invention relevant with the present invention, fall
Enter protection scope of the present invention.
Although the present invention is disclosed above with regard to preferred embodiment, so it is not intended to limiting the invention.The affiliated skill of the present invention
Those of ordinary skill in art field, without departing from the spirit and scope of the present invention, when can be used for a variety of modifications and variations.Cause
This, protection scope of the present invention ought be defined depending on claims before and is defined.
Claims (13)
1. a kind of employing auto-adaptive loop filter processes the method for coding it is characterised in that including：
Receive the reconstruction video data corresponding with coding video frequency data from a processing unit；
To this reconstruction video data application loop processed to produce filtering video data, the step of wherein this application loop processed it is
Based on the auto-adaptive loop filter of subregion, and this reconstruction video data is divided into MxN subregion, wherein, this MxN subregion
In at least two subregions be combined to apply identical wave filter, and M and N be integer；And
This filtering video data is provided.
2. the method for claim 1 is it is characterised in that be each of this MxN subregion according to one scan figure
Subregion specifies a packet index, wherein merges, using a 1-D, the first subregion and the bag that syntactic representation comprises one first packet index i
The second subregion indexing (i-1) containing a second packet merges to apply identical wave filter.
3. method as claimed in claim 2 is it is characterised in that this scanning patter can be selected from one group of scanning patter
Select, this group scanning patter include deform hibert curve, the scanning of horizontal Serpentiss, the scanning of vertical Serpentiss, the scanning of Z-type Serpentiss, helical scanning,
Four points of tree scanner uni grid scannings.
4. the method for claim 1 allows this MxN subregion it is characterised in that merging syntactic representation using a 2-D
In one first subregion adjacent with one or multiple adjacent sectors merge to apply identical wave filter, wherein this or many
Individual adjacent sectors fall within this MxN subregion.
5. method as claimed in claim 4 it is characterised in that this 2-D merge grammer comprise to represent this first subregion whether with
One or one first mark that merges of multiple adjacent sectors, and if this this first subregion and one or multiple phase shown in the first mark
Adjacent subregion merges, and this 2-D merges grammer and comprises a merging candidate identification further.
6. method as claimed in claim 5 is it is characterised in that this merging candidate identification is according to one or multiple adjacent sectors
Availability makees adaptive change.
7. it is characterised in that merging mark using one, the method for claim 1 represents whether this subregion is allowed to merge
To apply identical wave filter.
8. the method for claim 1 is it is characterised in that each between any two subregion in this MxN subregion
The border of subregion is the border of a maximum coding unit or the border of multiple maximum coding unit.
9. a kind of device using an auto-adaptive loop filter to process encoded video is it is characterised in that include：
One first module, for receiving a reconstruction video data corresponding with coding video frequency data from a processing unit；
One second module, for the auto-adaptive loop filter based on subregion to this reconstruction video data application loop processed to produce
Raw filtering video data, wherein this reconstruction video data is divided into MxN subregion, at least two points in this MxN subregion
Area is combined to apply identical wave filter, and M and N is integer；And
One three module, for providing this filtering video data.
10. device as claimed in claim 9 is it is characterised in that be each of this MxN subregion according to one scan figure
Subregion specifies a packet index, wherein one 1-D merge grammer be used to indicate the first subregion comprising one first packet index i with
The second subregion comprising second packet index (i-1) merges to apply identical wave filter.
11. devices as claimed in claim 9 are it is characterised in that a 2-D merging grammer is used in this MxN subregion
One first subregion adjacent with one or multiple adjacent sectors merge to apply identical wave filter, wherein this one or more
Adjacent sectors fall within this MxN subregion.
12. devices as claimed in claim 9 are it is characterised in that a merging mark is used to indicate whether this subregion is allowed to
Merge to apply identical wave filter.
13. devices as claimed in claim 9 are it is characterised in that each between any two subregion in this MxN subregion
The border of subregion is the border of a maximum coding unit or the border of multiple maximum coding unit.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710063705.1A CN106878729B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201710063716.XA CN107087180B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Applications Claiming Priority (15)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US39006810P | 2010-10-05 | 2010-10-05 | |
| US61/390,068 | 2010-10-05 | ||
| US42172910P | 2010-12-10 | 2010-12-10 | |
| US61/421,729 | 2010-12-10 | ||
| US201161429313P | 2011-01-03 | 2011-01-03 | |
| US61/429,313 | 2011-01-03 | ||
| US201161454829P | 2011-03-21 | 2011-03-21 | |
| US61/454,829 | 2011-03-21 | ||
| US13/093,068 US9094658B2 (en) | 2010-05-10 | 2011-04-25 | Method and apparatus of adaptive loop filtering |
| US13/093,068 | 2011-04-25 | ||
| US13/158,427 US9055305B2 (en) | 2011-01-09 | 2011-06-12 | Apparatus and method of sample adaptive offset for video coding |
| US13/158,427 | 2011-06-12 | ||
| US13/177,343 | 2011-07-06 | ||
| US13/177,343 US8861617B2 (en) | 2010-10-05 | 2011-07-06 | Method and apparatus of region-based adaptive loop filtering |
| PCT/CN2011/080408 WO2012045269A1 (en) | 2010-10-05 | 2011-09-30 | Method and apparatus of region-based adaptive loop filtering |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710063716.XA Division CN107087180B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201710063705.1A Division CN106878729B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103155557A CN103155557A (en) | 2013-06-12 |
| CN103155557B true CN103155557B (en) | 2017-03-01 |
Family
ID=45927217
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180048246.0A Active CN103155557B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201710063705.1A Active CN106878729B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201710063716.XA Active CN107087180B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710063705.1A Active CN106878729B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201710063716.XA Active CN107087180B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Country Status (5)
| Country | Link |
|---|---|
| EP (1) | EP2625859A4 (en) |
| KR (1) | KR101526349B1 (en) |
| CN (3) | CN103155557B (en) |
| CA (1) | CA2805722C (en) |
| WO (1) | WO2012045269A1 (en) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201119206D0 (en) * | 2011-11-07 | 2011-12-21 | Canon Kk | Method and device for providing compensation offsets for a set of reconstructed samples of an image |
| CN104221383B (en) * | 2012-04-13 | 2018-09-11 | 三菱电机株式会社 | Picture coding device, picture decoding apparatus, image encoding method and picture decoding method |
| SI2697973T1 (en) * | 2012-04-16 | 2017-11-30 | Hfi Innovation Inc. | Method and apparatus for loop filtering across slice or tile boundaries |
| WO2013175698A1 (en) * | 2012-05-25 | 2013-11-28 | パナソニック株式会社 | Image encoding method, image encoding device, image decoding method, image decoding device, and image encoding/decoding device |
| WO2013177975A1 (en) * | 2012-05-29 | 2013-12-05 | Mediatek Inc. | Method and apparatus for coding of sample adaptive offset information |
| SG10201605050RA (en) | 2012-06-11 | 2016-08-30 | Samsung Electronics Co Ltd | Method and apparatus for encoding videos sharing sao parameter according to color component |
| US9386307B2 (en) * | 2012-06-14 | 2016-07-05 | Qualcomm Incorporated | Grouping of bypass-coded bins for SAO syntax elements |
| CN103338374B (en) | 2013-06-21 | 2016-07-06 | 华为技术有限公司 | Image processing method and device |
| CA2908323C (en) | 2013-07-15 | 2021-07-06 | Mediatek Inc. | Method of sample adaptive offset processing for video coding |
| CN104486630B (en) * | 2014-12-16 | 2017-10-20 | 北京金山云网络技术有限公司 | H.265 in Video coding under SAO patterns offset statistical method |
| CN104602026B (en) * | 2015-01-22 | 2017-12-01 | 复旦大学 | A kind of reconstruction loop structure being multiplexed entirely encoder under HEVC standard |
| US9872026B2 (en) * | 2015-06-12 | 2018-01-16 | Intel Corporation | Sample adaptive offset coding |
| US11146788B2 (en) | 2015-06-12 | 2021-10-12 | Qualcomm Incorporated | Grouping palette bypass bins for video coding |
| WO2016204374A1 (en) * | 2015-06-18 | 2016-12-22 | 엘지전자 주식회사 | Image filtering method and device in image coding system |
| CN105357538B (en) * | 2015-11-26 | 2020-01-03 | 广东中星微电子有限公司 | Adaptive loop filtering method and apparatus |
| CN113994671A (en) | 2019-06-14 | 2022-01-28 | 北京字节跳动网络技术有限公司 | Processing video unit boundaries and virtual boundaries based on color format |
| JP7291846B2 (en) | 2019-07-09 | 2023-06-15 | 北京字節跳動網絡技術有限公司 | Sample decision for adaptive loop filtering |
| AU2020309130B2 (en) | 2019-07-11 | 2023-06-08 | Beijing Bytedance Network Technology Co., Ltd. | Sample padding in adaptive loop filtering |
| MX2022000120A (en) | 2019-07-15 | 2022-02-16 | Beijing Bytedance Network Tech Co Ltd | Classification in adaptive loop filtering. |
| CN114503594B (en) | 2019-09-22 | 2024-04-05 | 北京字节跳动网络技术有限公司 | Selective application of sample filling in adaptive loop filtering |
| JP7326600B2 (en) | 2019-09-27 | 2023-08-15 | 北京字節跳動網絡技術有限公司 | Adaptive loop filtering between different video units |
| JP7454042B2 (en) | 2019-10-10 | 2024-03-21 | 北京字節跳動網絡技術有限公司 | Padding process at unavailable sample positions in adaptive loop filtering |
| CN110809158B (en) * | 2019-11-12 | 2021-06-01 | 腾讯科技（深圳）有限公司 | Image loop filtering processing method and device |
| CN111314711B (en) * | 2020-03-31 | 2021-05-14 | 电子科技大学 | Loop filtering method based on self-adaptive self-guided filtering |
| US11463691B2 (en) * | 2020-06-03 | 2022-10-04 | Tencent America LLC | Region adaptive loop filter for video coding |
| CN114615494A (en) * | 2020-12-04 | 2022-06-10 | 咪咕文化科技有限公司 | Image processing method, device and equipment |
| WO2022191525A1 (en) * | 2021-03-08 | 2022-09-15 | 현대자동차주식회사 | Video coding method and apparatus using spiral scan order |
| CN114368150B (en) * | 2021-12-22 | 2022-11-11 | 鑫精合激光科技发展（北京）有限公司 | Three-dimensional printing method and computer storage medium |
| WO2023225854A1 (en) * | 2022-05-24 | 2023-11-30 | Oppo广东移动通信有限公司 | Loop filtering method and device, and video coding/decoding method, device and system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101543076A (en) * | 2006-11-08 | 2009-09-23 | 汤姆逊许可证公司 | Methods and apparatus for in-loop de-artifact filtering |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2894856A1 (en) * | 2002-01-31 | 2015-07-15 | Samsung Electronics Co., Ltd | Filtering method and apparatus for reducing block artifacts or ringing noise |
| US8498336B2 (en) * | 2006-02-02 | 2013-07-30 | Thomson Licensing | Method and apparatus for adaptive weight selection for motion compensated prediction |
| CN101321277A (en) * | 2007-06-09 | 2008-12-10 | 华为技术有限公司 | Method and apparatus for removing block effect |
| US9967590B2 (en) * | 2008-04-10 | 2018-05-08 | Qualcomm Incorporated | Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter |
| US9924184B2 (en) * | 2008-06-30 | 2018-03-20 | Microsoft Technology Licensing, Llc | Error detection, protection and recovery for video decoding |
| CN101635849B (en) * | 2008-07-24 | 2011-11-16 | 青岛海信信芯科技有限公司 | Loop filtering method and loop filter |
| US8326075B2 (en) * | 2008-09-11 | 2012-12-04 | Google Inc. | System and method for video encoding using adaptive loop filter |
| US8548041B2 (en) * | 2008-09-25 | 2013-10-01 | Mediatek Inc. | Adaptive filter |
| CN101742292B (en) * | 2008-11-14 | 2013-03-27 | 北京中星微电子有限公司 | Image content information-based loop filtering method and filter |
| CN201345710Y (en) * | 2008-12-31 | 2009-11-11 | 暨南大学 | Loop filter applicable to video decoding |
| CN101651829A (en) * | 2009-06-29 | 2010-02-17 | 北京中星微电子有限公司 | Loop wave filtering method and device and mobile multi-medium terminal chip |
| JP5359657B2 (en) * | 2009-07-31 | 2013-12-04 | ソニー株式会社 | Image encoding apparatus and method, recording medium, and program |
-
2011
- 2011-09-30 KR KR1020137001815A patent/KR101526349B1/en active IP Right Grant
- 2011-09-30 CA CA2805722A patent/CA2805722C/en active Active
- 2011-09-30 CN CN201180048246.0A patent/CN103155557B/en active Active
- 2011-09-30 WO PCT/CN2011/080408 patent/WO2012045269A1/en active Application Filing
- 2011-09-30 EP EP11830225.6A patent/EP2625859A4/en not_active Withdrawn
- 2011-09-30 CN CN201710063705.1A patent/CN106878729B/en active Active
- 2011-09-30 CN CN201710063716.XA patent/CN107087180B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101543076A (en) * | 2006-11-08 | 2009-09-23 | 汤姆逊许可证公司 | Methods and apparatus for in-loop de-artifact filtering |
Non-Patent Citations (2)
| Title |
|---|
| CE8 Subtest 2: Adaptation between Pixel-based and Region-based Filter Selection;Ching-Yeh Chen etal;《Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 5th Meeting》;20110310;第1页至第2页 * |
| CE8 Subtest2: A Joint Proposal on Improving the Adaptive Loop Filter in TMuC0.9 by MediaTek, Qualcomm, and Toshiba;Ching-Yeh Chen etal;《Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 4th Meeting》;20110128;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107087180A (en) | 2017-08-22 |
| CN106878729A (en) | 2017-06-20 |
| KR101526349B1 (en) | 2015-06-05 |
| EP2625859A4 (en) | 2016-03-02 |
| WO2012045269A1 (en) | 2012-04-12 |
| CA2805722A1 (en) | 2012-04-12 |
| EP2625859A1 (en) | 2013-08-14 |
| CN107087180B (en) | 2019-10-29 |
| CN106878729B (en) | 2019-09-24 |
| KR20130030294A (en) | 2013-03-26 |
| CN103155557A (en) | 2013-06-12 |
| CA2805722C (en) | 2016-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103155557B (en) | Adaptive loop filter method and apparatus based on subregion basis | |
| RU2694012C1 (en) | Improved intra prediction encoding using planar views | |
| CN104883571B (en) | Image decoding apparatus | |
| CN104935942B (en) | The method that intra prediction mode is decoded | |
| CN103200402B (en) | The method for removing deblocking man-made noise | |
| CN103141094B (en) | Adaptive loop filter method and apparatus | |
| CN110024399A (en) | The recording medium of method and apparatus and stored bits stream to encoding/decoding image | |
| CN103460699B (en) | Loop circuit filtering method and its equipment | |
| CN109479138A (en) | Image coding/decoding method and device | |
| CN109417617A (en) | Intra-frame prediction method and device | |
| CN109804625A (en) | The recording medium of method and apparatus and stored bits stream to encoding/decoding image | |
| TR201815529T4 (en) | APPARATUS FOR CODING AN IMAGE. | |
| CN103209324A (en) | Method of applying edge offset | |
| CN103051892B (en) | Embedded loop filter method and embedded loop filter | |
| Erfurt et al. | Multiple feature-based classifications adaptive loop filter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160920 Address after: Hsinchu County, Taiwan, China Applicant after: Atlas Limited by Share Ltd Address before: China Taiwan Hsinchu Science Park Hsinchu city Dusing a road No. Applicant before: MediaTek.Inc |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |