CN106878729B - Adaptive loop filter method and apparatus based on subregion basis - Google Patents
Adaptive loop filter method and apparatus based on subregion basis Download PDFInfo
- Publication number
- CN106878729B CN106878729B CN201710063705.1A CN201710063705A CN106878729B CN 106878729 B CN106878729 B CN 106878729B CN 201710063705 A CN201710063705 A CN 201710063705A CN 106878729 B CN106878729 B CN 106878729B
- Authority
- CN
- China
- Prior art keywords
- subregion
- adjacent sectors
- alf
- filter
- current partition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/19—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding using optimisation based on Lagrange multipliers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
One based in block motion compensation system, because of loss operation, coding noise will increase.ALF is a kind of technology for improving the quality.Adaptive (pixel-adaptive or pixel-adaptation, the PA) ALF of one pixel-is developed, using SLM classified pixels, and according to the SLM using a corresponding ALF filter to each pixel.PA ALF brings higher complexity and bigger energy consumption because of high complexity and by the switching of the filter of unit of pixel.Therefore, the ALF scheme based on subregion is disclosed for, and allows to carry out sef-adapting filter selection based on each subregion, and without converting by the filter of unit of pixel.One embodiment of the invention, an image are divided into MxN subregion.The ALF based on subregion allows the subregion in MxN subregion to merge to improve performance.RDCO can be used also to consider system complexity in another aspect of the present invention, optimal ALF design.The RDCO technology is also applied to SAO design.
Description
Cross reference
This application claims the priority of following applications: what on October 5th, 2010 submitted, it is entitled " improved adaptive
Answer loop filter " United States provisional application No.61/390,068；What on December 10th, 2010 submitted, it is entitled
The United States provisional application No.61/421,729 of " rate of auto-adaptive loop filter is distorted complexity optimized method "；2011 7
What the moon was submitted on the 6th, the US application case of entitled " the adaptive loop filter method and apparatus based on subregion basis "
No.13/177,343；What on March 21st, 2011 submitted, entitled " auto-adaptive loop filter based on subregion basis "
United States provisional application No.61/454,829.What the present invention was also submitted on April 25th, 2011, it is entitled " adaptive
Loop circuit filtering method and device " U.S. patent application case No.13/093,068 is related；What on June 12nd, 2011 submitted, invention
Entitled " demonstration for Video coding adapts to offset method and device " U.S. patent application case No.13/158,427 is related；
It is submitted on January 3rd, 2011, the United States provisional application of entitled " Lian Fake adaptive loop filter device "
No.61/429,313 is related.The application is using above-mentioned United States provisional application and patent application case as reference.
Technical field
The present invention about Video coding (video coding), and more particularly in adaptive loop filter
(Adaptive Loop Filtering) related coding techniques.
Background technique
Motion compensation (motion compensation) interframe encode (inter-frame coding) is in a variety of codings
It is widely applied in standard, such as MPEG-1/2/4 and H.261/H.263/H.264/AVC.Movement in above-mentioned coded system is estimated
Meter, motion compensation and subsequent processing are all based on block (block basis) progress.In compression procedure, due to using such as
Quantization (quantization) damages operation (lossy operation), it is possible that coding noise (coding
noise).In reconstruction (reconstructed) video data, especially in block edge or adjacent edges, apparent volume is had
Code artifact (coding artifact).In order to reduce the explicitly of coding artifact, the coded system of update is for example H.264/AVC
And high-performance video coding (High Efficiency Video Coding, HEVC) starts to be referred to as deblocking using a kind of
(deblock) technology.Deblocking process carries out adaptively application filtering in block edge, with smoothed code noise bring edge
Or the mutation of adjacent edges, and maintain the clarity of image.In addition, deblocking process can be integrated according to the characteristic of interframe encode
It is operated in loop.Reconstructed frame in nearest HEVC exploitation, after deblocking is handled using adaptive loop filter.From
Loop filtering is adapted to be commonly used for making further loop processed and often use after video data is rebuild in deblocking.
Traditional auto-adaptive loop filter (Adaptive Loop Filter, ALF) is only applied to filtering can raising property
The block of energy.Those can not be helped to mention high performance piece using adaptive loop filter, generally without adaptive loop circuit
Filtering.When applying ALF, a single filter (single filter, SF) is applied to the block in a piece of (slice).This is single
Filter is to choose from one group of candidate to reach optimal performance, such as minimum distortion, minimum rate or R-D
(Rate-distortion) performance.Such ALF scheme is referred to as single sef-adapting filter scheme (SF ALF).Another ALF
Scheme is referred to as QC_ALF scheme, is to be proposed by Qualcomm (Qualcomm) (15-23 days in April, 2010, in German moral
Tire out the ITU-T SG16WP3 and ISO/ of the integration and cooperation group (JCT-VC) about Video coding that this (Dresden) is held
In the first session of IEC JTC1/SC29/WG11, Karczewicz's et al. is entitled: " Qualcomm is about Video coding
Recommendation " in propose, be recorded in document: JCTVC-A121).According to the QC_ALF, which is based on block base application
In the deblocking video data on one piece.It is each piece corresponding, calculate the improvement Laplace operator of each pixel (i, j) in the block
(i, j) (Sum-modified Laplacian Measure (i, j), SLM (i, j)).Each pixel basis SLM on the block
Value is classified in multiple rank or classification.Although the performance of the QC_ALF scheme can be better than the performance of the SF ALF,
It is that the calculating two of each pixel SLM and the conversion of the filter from a pixel to another pixel will lead to higher calculate again
It is miscellaneous to spend and consume more efficiency.Therefore, it is necessary to develop can provide each subregion and have the advantages that multiple filter selections are same
When there is no filter between the computational complexity of height and pixel to convert ALF scheme.
In the ALF design that region division and mode determine, an entitled rate-distortion optimization (rate-distortion
Optimization, RDO)) optimisation technique be often used in during region division and mode determine.Although the RDO technology can
Realize optimal rate distortion performance, but it does not consider system complexity, this will consume valuable system resource.Cause
This, needs to reach optimization using a kind of new prioritization scheme (rate, distortion and complexity) in this three.Therefore, a kind of rate
Distortion complexity optimization (rate-distortion-complexity optimization, RDCO) technology is used in ALF
In design.The RDCO technology is also applicable in the performance that optimal rate distortion complexity is realized in SAO design.
Summary of the invention
Disclosed herein the method and apparatus using adaptive loop filter processing encoded video.It is real of the invention one
It applies in example, the method and device using adaptive loop filter processing encoded video includes receiving from a processing unit and encoding view
Frequency rebuilds video data according to corresponding one；To the reconstruction video data application adaptive-filtering to generate filtering video number
According to；The filtering video data are provided.The operation of the adaptive-filtering can adapt to mark selection based on subregion for foundation subregion
The ALF or ALF for being not based on subregion.If selected the ALF based on subregion, which is divided into MxN points
Area, wherein M and N is integer.The subregion of the MxN subregion can be merged based on 1-D 2-D representation.Further,
One merges mark for indicating whether a subregion merges with one or more adjacent sectors.When use 1-D representation, foundation
One scanning patter is the specified packet index of each of the MxN subregion.The scanning patter can be from one group of scanning patter
In selected, this group of scanning patter include deformation hibert curve, the scanning of horizontal snake, the scanning of vertical snake, the scanning of Z-type snake,
Helical scanning, quarter tree scanning and grid scanning.Another embodiment according to the present invention, any two in the MxN subregion
The boundary of each subregion between subregion is the boundary of boundary either multiple maximum coding units of a maximum coding unit.Also
Another embodiment according to the present invention, merging mark using one indicates whether the subregion is allowed to merge.
The invention discloses a sef-adapting filter or the exemplary design methods and device for adapting to offset filter.Foundation
One embodiment of the invention, the sef-adapting filter or the exemplary design method for adapting to offset filter and device include such as
Lower step: candidate item relevant to design feature is determined for sef-adapting filter or exemplary adaptation offset filter；And according to
An optimal candidate item is selected from multiple candidate item according to RDCO.The design feature may be determined with mode or subregion divides
It is related.For the ALF design, the complexity of the RDCO with for ALF design filter number of parameters, by filtered pixel
Quantity, the number of parameters of filter it is related with by the combination of the quantity of filtered pixel, or also with the quantity of filter parameter,
The combination that the quantity of the operation of the candidate pattern of the model selection carried out will be designed by the quantity of filtered pixel and for ALF is related.
For SAO design, the operation amount of the complexity pixel classifications Method type of the RDCO is related, or with pixel classifications method class
The operation amount of type and the combination by the pixel quantity compensated with a deviant are related.
Detailed description of the invention
Fig. 1 discloses the exemplary block schematic diagram of the video coding system based on motion compensated prediction, wherein adaptive ring
Path filter is applied to rebuild video data.
Fig. 2 discloses the example of sef-adapting filter pixel-based, and wherein SLM be used to divide one 6 × 4 pieces of pixel
To three classifications.
Fig. 3, which is disclosed, is divided to 4 × 4 maximum coding unit (Largest for the picture comprising 416 × 240 pixels
Coding Unit, LCU) it is aligned the example of subregion, wherein each square is the LCU comprising 64 × 64 pixels and one is non-
Rightmost and non-bottom subregion include 2 × 1 LCU.
Fig. 4, which is disclosed, supports the grammar design with the tagged ALF based on subregion, the subregion adaptive labeling to indicate whether
Use the ALF based on subregion.
Fig. 5 discloses the scanning for passing through 4 × 4 subregions according to deformation hibert curve (deformed Hilbert curve)
Sequentially.
Fig. 6 discloses the scanning sequency for passing through 4 × 4 subregions according to horizontal snake scanning (horizontal snake scan).
Fig. 7 discloses the scanning sequency for passing through 4 × 4 subregions according to vertical snake scanning (vertical snake scan).
Fig. 8 discloses the scanning sequency for passing through 4 × 4 subregions according to Z-type snake scanning (zig-zag scan).
Fig. 9 discloses the scanning sequency for passing through 4 × 4 subregions according to helical scanning (spiral scan).
Figure 10 discloses the scanning sequency for passing through 4 × 4 subregions according to quarter tree scanning (quad-tree scan).
Figure 11 discloses the scanning sequency for passing through 4 × 4 subregions according to grid scanning (raster scan).
Figure 12 discloses an example for splitting subregion, wherein a subregion is split into 5 subregions, such as: F0,F1,F2, F3And one
Reactive filter subregion.
Figure 13, which discloses one, will be merged into the model of 3 subregions by filtering subregion (to-be-filtered regions) for 5
Example, this 3 are respectively F0’、F1' and a reactive filter subregion.
Figure 14 discloses a grammar design for supporting 2-D subregion to merge.
Specific embodiment
For compression of digital video, motion compensation interframe coding is a kind of effective compress technique, is widely used
In a variety of coding standards, such as MPEG-1/2/4 and H.261/H.263/H.264/AVC.In motion compensating system, movement is estimated
Meter/compensation and subsequent compression are typically based on block and carry out in block.In compression procedure, behaviour is damaged such as quantization due to using
Make, it is possible that coding noise.In rebuilding video data, especially in block edge or adjacent edges, apparent volume is had
Code artifact.In order to reduce the explicitly of coding artifact, in the coded system of update such as above system H.264/AVC and
HEVC system starts using a kind of technology for being referred to as deblocking, and deblocking process carries out adaptively application filtering in block edge, with
The mutation at smoothed code noise bring edge or adjacent edges, and maintain the clarity of image.In addition, according to interframe encode
Characteristic, deblocking process can be integrated into loop and be operated.
In HEVC system, other than deblocking filter, also it is referred to as auto-adaptive loop filter (ALF) using another
Loop filter.Deblocking filter is only applied and block boundary, and sef-adapting filter can then be applied to a frame (frame),
All pixels in one domain (field), a piece of (slice) or a picture region.Traditional ALF is only applied to using filter
It can be improved the block of performance.High performance piece can not be mentioned then without using ALF using ALF for those.When ALF is used, one
Single filter SF is applied in the block in a piece of.The single filter is to choose from one group of candidate to reach
To optimal performance, such as minimum distortion, minimum rate or R-D performance.Such ALF scheme is referred to as single sef-adapting filter side
Case (SF ALF).Decoder is transferred to by the relevant information of selecting filter in this.It will be transmitted or be stored to save this
Information, this group of ALF filter can be predefined, and index expression can be used in filter selection.As substitution
, which can obtain in based on the time delay arrangement for having rebuild video data.It is therefore not necessary to additional information
(side information) or only need seldom additional information.In addition, can be reduced the relevant information of the filter used
Tool can also be used, such as: encoding the filter coefficient using entropy coding and transmit the difference of the coefficient.
Fig. 1 discloses one using adaptive loop filter and the system block diagrams of the coded system of deblocking.Fig. 1 is disclosed
The system square of the video encoder based on motion compensated prediction with deblocking function.Compressibility 100 is shown typically
Video encoder and (intra/inter-prediction) within the frame/frames prediction, transform/quantization (transformation/
Quantization it) is combined with entropy coding (entropy coding), to generate compressed video data.Inputting video data
(i.e. original signal 112) enters encoder by input interface, and the original signal 112 by prediction module 110 within the frame/frames into
Row processing.It is predicted in the data of intra prediction mode, the input using image encoded in same frame or same domain.
In inter-frame forecast mode, which can be based on the previous reconstruction data 142 in timing, wherein 142 quilt of reconstruction data
It is stored in reference picture buffers 140.The inter-prediction can be 0 prediction mode of a list, wherein the prediction is based on solution
Code sequence is before the present image and the image in the first list of reference picture.The inter-prediction is also possible to a list 1
Prediction mode, if the current slice (current slice) is a B- piece (B-slice), which is suitable based on decoding
Sequence is before the present image and the image in the second list of reference picture.The inter-prediction is also possible to bi-directional predicted (bi-
Prediction) mode, if current slice is B- piece, which is based on 0 reference picture of list and list 1 with reference to figure
Picture.In the inter-frame forecast mode, the prediction data is provided to adder 115 by prediction module 110 within the frame/frames for this, and from
The prediction data is subtracted in the original signal 112.The output of the adder 115, which is referred to as, predicts error 117, transform/quantization mould
Block 120 further carries out transform/quantization process to the prediction error 117.The transform/quantization module 120 is by the prediction error 117
Coded identification is converted to, is further processed by entropy code module 130 to generate and compress 132 (i.e. compression bit of output bit flow
Stream) for storing or transmitting.(inverse DCT and inverse quantization, is represented by for inverse transformation/quantization
IDCT/IQ) processing of module 160 rebuilds prediction error by the prediction error 117 that the transform/quantization module 120 provides to be formed
(reconstructed prediction error)162.In the inter-frame forecast mode, rebuilds prediction error 162 and rebuild view
Frequency is combined according to 119 to form the current reconstructed frame 152.In the intra prediction mode, which predicts error 162 and same figure
Previous reconstruction perimeter data superposition as in.In the inter-frame forecast mode, prediction module 110 transmits that this is pre- within the frame/frames for this
Signal 119 is surveyed to reconstruction module 150, wherein the reconstruction data 119 are according to the previous reconstructed frame in timing or according to same
Previous reconstruction perimeter data in image depends on being inter-frame forecast mode or intra prediction mode.
The reconstruction data are used as by being stored in reference picture buffers 140 after deblocking module 170 and ALF180 processing
Manage the reference video data of subsequent picture.Original ALF in HEVC is block-based application.If it is (lower that the ALF can improve performance
Distortion, lower bit rate, better R-D performance), then the block opens ALF.Otherwise, which closes ALF.A kind of ALF specification quilt
Referred to as QC_ALF scheme is to be proposed by Qualcomm (Qualcomm) (15-23 days in April, 2010, in Dresden, Germany
(Dresden) ITU-T the SG16 WP3 and ISO/IEC of the integration and cooperation group (JCT-VC) about Video coding held
In the first session of JTC1/SC29/WG11, Karczewicz's et al. is entitled: " suggestion of the Qualcomm about Video coding
It is proposed in book ", is recorded in document: JCTVC-A121).Deblocking video data, which is applied to, according to the QC_ALF, the ALF is based on picture
Plain basis.It is each piece corresponding, calculate improvement Laplace operator (i, j) (Sum- of each pixel (i, j) in the block
Modified Laplacian Measure (i, j), SLM (i, j)) as follows:
Wherein, which is deblocking video data.Calculate (2K+1) x (2L+1) that the SLM is based on centered on (i, j)
Adjacent windows.The adjacent windows size can be 9x9,7x7,5x5or 3x3.In order to reduce complexity, using having a size of 3x3's
Adjacent windows.The pixel is sorted out one of them into M group by the SLM for calculating each pixel of the block.Refer to figure
2, it discloses and sorts out the pixel into three groups according to the SLM value.In the QC_ALF scheme, filtered according to each group selection one
Wave device is filtered the relevant pixel of the group.In order to reduce computational complexity, which is usually horizontally or vertically
Symmetrically.For example, using such as 9x9, diamond mode filter as 7x7, or 5x5, or the side as 5x5,3x3
Mode filter.ALF based on SLM is applied to each pixel, and different pixels will apply different filters.Therefore QC_ALF
Also referred to as adaptive (pixel-adaptive or pixel-adaptation, PA) ALF of pixel-.Above-mentioned SF
ALF is considered a kind of special PA ALF, only with one group of filter.
Although PA ALF can be adaptive based on one filter of pixel selection, there is still a need for calculate SLM by decoder for it
The group information of each pixel is obtained, because demand additional information (side information) is encoded important letter
Breath.Therefore, it is necessary to develop a kind of ALF scheme better performance may be implemented and to reduce computational complexity.Therefore, of the invention
Disclose a kind of ALF specification of subregion basic (region based).ALF scheme according to the present invention, using the ALF to the solution
Block video data is based on subregion basis.It divides a picture or image-region is multiple fixed blocks or is formed with fixed block group more
A subregion.As replacement, an image or image-region can be split or recurrence Ground Split forms multiple subregions.It lifts
For example, a picture or image-region can be recursively divided using quarter tree to form multiple subregion.It can be in grammer
Middle one mark of setting is used to indicate whether using subregion basis ALF or case of non-partitioned basis ALF.For example, a mark is used
In being selected between subregion basis ALF and block basis (block based) ALF.The derivation of block basis filters can make
With the similar method of pixel basis ALF.For example, Chong et al. describes the method for one piece of basis ALF, will be in 4 × 4 pieces
Single activity indicators of the average value for the activity value that the Laplace operator of all pixels is calculated as the 4x4 block.In 2011
16-23 days March, in the integration and cooperation group (JCT-VC) about Video coding that Geneva, Switzerland (Geneva) is held
In the 5th meeting of ITU-T SG16WP3 and ISO/IEC JTC1/SC29/WG11, Chong's et al. is entitled: " CE8 subject under discussion
2: being based on the block of auto-adaptive loop filter (ALF) " it is proposed in, is recorded in document: JCTVC-E323.This method needs to calculate should
The activity value of the Laplace operator of 4 × 4 pieces of each pixels.Compared to pixel basis ALF, although this method has no saving operation
Amount, but block basis ALF can reduce the frequency of the different filters of switching of pixel basis ALF.Also other measurement methods can be used
Replace the activity value of Laplace operator as classification standard, such as: band offset (band offset, BO) or edge offset
(edge offset, EO) adaptively deviates (sample adaptive offset, SAO) for exemplary as classification standard,
Also SLM calculating method disclosed in Karczewicz et al. can be used to substitute.BO and EO need less for SLM
Calculation amount.
One uses the example of the ALF based on subregion basis of block group, and an image can be divided into 16 basic phases of size
Deng subregion.For example, the zoned width of a non-rightmost subregion can be (PicWidth/4), and wherein PicWidth is
Picture traverse.For rightmost subregion, which is then (PicWidth-(PicWidth/4) * 3).Non- bottommost subregion
Height be then (PicHeight/4), wherein PicHeight be picture altitude.Height for bottommost subregion is then
(PicHeight– (PicHeight/4)*3).In this example, the rightmost subregion and bottommost subregion are likely larger than it
His subregion.Another example a, as shown in figure 3, image segmentation is aligned (LCU-- based on LCU at 16 sizes are of substantially equal
Aligned subregion).Wherein, the boundary of the subregion then must be the boundary of maximum coding unit (LCU).The size of the image
It for 416x240, and include 7x4 LCU, wherein each LCU includes 64x64 pixel.The subregion of the non-rightmost subregion is wide
Degree is (((PicWidthInLCUs+1)/4) * 64), and wherein PicWidthInLCUs indicates the wide LCU quantity of image.Non- bottom
The height of subregion is (((PicHeightInLCUs+1)/4) * 64), wherein PicHeightInLCUs indicates the high LCU of image
Quantity.The size of the most right subregion and bottommost subregion can be by picture traverse (PicWidth), picture altitude
(PicHeight), the size of non-most right subregion and non-bottom subregion is derived from.One index is assigned to every 4x4 subregion.Make
Use 4x4 subregion as an example, the present invention is not limited to the examples of the 4x4 subregion.In fact, the present invention can be used MxN points
Area.Wherein, M and N is integer.Its picture traverse of one image is PicWidthInSamples and picture altitude is
PicHeightInSamples.Then the coordinate of the subregion index in each its upper left corner of subregion is that the subregion index of (x, y) can be as
Lower derivation is learnt.(1 < < Log2MaxCUSize) be maximum coding unit size, and xMaxIndex and yMaxIndex be
Maximum subregion index both horizontally and vertically.It is corresponding, between the horizontal interval x_interval of subregion and the vertical of by stages
It can be learnt by following derivations of equation every y_interval.
X_interval=((((PicWidthInSamples+ (1<<Log2MaxCUSize) -1)>>
Log2MaxCUSize)+x_round)/(xMaxIndex+1)), and (1)
Y_interval=((((PicHeightInSamples+ (1<<Log2MaxCUSize) -1)>>
Log2MaxCUSize)+y_round)/(yMaxIndex+1)), (2)
Wherein x_round=max (0, (xMaxIndex+1)/2-1) and y_round=max (0, (yMaxIndex+
1)/2–1).
Horizontal index x_idx and vertical index y_idx can be derived as follows:
X_idx=min (xMaxIndex, x/ (x_interval < < Log2MaxCUSize)), and (3)
Y_idx=min (yMaxIndex, y/ (y_interval < < Log2MaxCUSize)) (4)
Subregion index region_idx is determined according to following formula:
Region_idx=y_idx* (xMaxIndex+1)+x_idx. (5)
When the 4x4 subregion is used by the ALF based on subregion, subregion index can be derived as follows.The water of the subregion
Flat interval x_interval and the perpendicular separation y_interval of by stages can be learnt by following derivations of equation:
X_interval=((((PicWidthInSamples+ (1<<Log2MaxCUSize) -1)>>
Log2MaxCUSize)+1) > > 2), and (6)
Y_interval=((((PicHeightInSamples+ (1<<Log2MaxCUSize) -1)>>
Log2MaxCUSize)+1)>>2). (7)
Horizontal index x_idx and vertical index y_idx can be derived as follows:
X_idx=min (3, x/ (x_interval < < Log2MaxCUSize)), and (8)
Y_idx=min (3, y/ (y_interval < < Log2MaxCUSize)) (9)
Subregion index region_idx is determined according to following formula:
Region_idx=(y_idx < < 2)+x_idx. (10)
Filter index filter_idx (x, y) is determined according to following formula:
Filter_idx (x, y)=region_tab [region_idx], (11)
Wherein, region_tab [16]={ 0, Isosorbide-5-Nitrae, 5,15,2,3,6,14,1,10,7,13,12,9,8 }
Two adjacent sectors, such as subregion with continuity index can be merged.Point after subregion merges, after each merging
Apply a filter in area.The image can be used ALF, block-based ALF or the ALF based on subregion pixel-based and carry out
Processing.Compared to ALF pixel-based and block-based ALF, the ALF based on subregion can save the base that adaptive pixel carries out
In pixel classified calculating and based on adaptive block carry out block-based calculating, correspondingly, when use the ALF based on subregion,
That average computational load of decoder is also accordingly reduced.Further, what the ALF based on subregion was significant reduces filter in image
Conversion times, therefore it is less to convert energy consumption.Fig. 4, which is disclosed, to be supported to be selected between the ALF and ALF pixel-based based on subregion
It selects, or carries out the grammar design of selection between the ALF and block-based ALF based on subregion.Unique grammer is changed into
Increase by a mark (region_adaptation_flag) in the head parameter devices alf_param () of ALF or joins in image
Counting apparatus (PPS) between the ALF and block-based ALF based on subregion to be selected.
Carrying out subregion merging can be further improved coding efficiency.Adjacent sectors may have similar feature and can share
Same filter is to reduce instruction ALF filter information needed.It is a kind of execute that the method that subregion merges is by the region 2-D and extremely
The region 1-D.For example, which can be converted into the 1-D subregion using packet index 0-15.It executes the 2-D
It is converted into the scan pattern that 1-D can be special according to one.It can be used to convert 2-D subregion there are many known scan pattern
At 1-D subregion.Deformation hibert curve (deformed Hilbert curve) as shown in Figure 5, horizontal snake shown in fig. 6
It scans (horizontal snake scan), vertical snake scanning (vertical snake scan) shown in Fig. 7, shown in Fig. 8
Z-type snake scan (zig-zag scan), helical scanning (spiral scan) shown in Fig. 9, quarter tree shown in Fig. 10 scanning
Grid shown in (quad-tree scan) and Figure 11 scans (raster scan).The 2-D subregion is being converted to the 1-D subregion
When, adjacent subregion can be combined to share same filtering as merged the subregion indicated by representation with continuity index
Device.For example, merge using one and identify whether the subregion that a mark group index is n merges with the subregion that group index is (n-1).
Also 2-D can be used and merge representation execution subregion merging, wherein a subregion can merge with the subregion near one.
Further, firstly, using a first identifier to indicate whether the subregion is merged, if the first identifier indicates that the subregion is closed
And then a merging candidate identification will be used.Under certain conditions, neighbouring partial-partition cannot be by candidate as merging.
Such as, there cannot be merging qualifications for being elected in image or in the borderline subregion of 4x4.Therefore, which can be with
Availability based on adjacent sectors makees the variation of adaptivity.For example, merging candidate subregion can for one left side or
Top subregion, and use the mark of one 1 bits as merging candidate identification.However, if left side and top subregion are without simultaneously
In the presence of then the merging candidate identification can be omitted.Therefore, the merging candidate identification can the availability based on the adjacent sectors from
The variation of adaptability.When some adjacent sectors be it is invalid, which then shows as smaller bit.The subregion closes
And adaptively it is applied to every 4x4 partition group.Merge enabled mark (enable flag) using a subregion and indicates the 4x4 subregion
Whether subregion is allowed to merge.
Subregion for ALF filtering is also considered a filter unit (filter unit, FU).If segmentation can be real
Existing better performance, then an image or image-region can be divided into smaller filter unit by recursive, such as lower rate
It is distorted (rate-distortion, R-D) cost.One, which can be calculated, to be divided by the R-D cost of filtering subregion and calculating
The R-D cost of subregion.If low R-D cost may be implemented in segmentation, this will will be divided by filtering subregion.Otherwise regardless of
Cut the subregion.As substitution, an image or image-region can also be first separated into smaller subregion.It adjacent sectors can
If being able to achieve better performance to be merged to merge, such as lower R-D cost.If the R-D of the subregion after merging is at low cost
R-D cost in independent partitions, then the subregion merges, otherwise nonjoinder.Embodiment according to the present invention can merge several
It is a a filter unit to be formed to reduce the bit rate of filter information by filtering subregion.
Figure 12 is please referred to, for the example of subregion segmentation.One subregion (filter unit FU1210) is divided into 5 subregions
(FUs1220), such as F0,F1,F2,F3With without filtering subregion.The segmentation of the subregion can be carried out according to low R-D cost.Figure 13 is this
Invention carries out the example of subregion merging.3 subregions are merged at that should will be considered by filtering subregion 1310 according to low R-D
1320, respectively F0’、F1' and a reactive filter subregion.Subregion F0And F2It is merged into F0', subregion F1And F3It is merged into F1’。
Figure 14 discloses the example for the grammar design for supporting 2-D subregion to merge.Subregion merges alf_fs_selection_
Param (r, c) function describes the message of subregion merging.The ALF, which merges mark (alf_merge_flag), indicates the current partition
Whether (FU in such as the present embodiment) has merged with other subregions.Its intermediate value 1 indicates that the current partition has merged, and the mark of value 0 should
Current partition does not merge with left side or top subregion.The filtering of the current partition is then added when the current partition is not merged
Device setting index (alf_fu_filter_set_idx).The general filter index of the first subregion of the image is preset as 0, and nothing
Decoder end need to be sent to.Syntactic element alf_merge_up_flag indicate the subregion whether the subregion with its top-direction
Merge, intermediate value 0 indicates that current partition merges with the FU in left side, and value 1 indicates that current partition merges with the subregion above it.
Another aspect of the present invention relates to the designs of an ALF filter.Rate-distortion optimization (Rate-distortion
Optimization, RDO) it is well known with the code efficiency obtained applied to Video coding.RDO is applied to be selected in mode
Select: macro block or from macro block or coding unit, inter-prediction, motion prediction, (such as filter is big for sef-adapting filter selection
Small, filter shape, unlatching/closing etc.), SAO selection (such as selecting different pixel classifications methods).Best RDO is selected
Rate distortion cost function (rate-distortion cost function) J=D+ λ R is minimized, wherein D is original pixels
With the predicted distortion (estimated distortion) between reconstruction (or prediction) pixel, R is the transmission additional information institute
The prediction rate (estimated rate) needed, λ are Lagrange multiplier (Lagrange multiplier).
Rate is distorted complexity optimization (rate-distortion-complexity optimization, RDCO) technology and uses
It is also well known with the balance obtained in video efficiency and encoder complexity in Video coding.RDCO is applied in mode
Selection: macro block or from macro block or coding unit, inter-prediction, motion prediction.Optimal RDCO selection is the rate that minimizes
It is distorted complexity cost function J=D+ λ1R+λ2C, wherein D is original pixels and rebuilds the pre- dendrometry between (or prediction) pixel
Very, R is prediction rate needed for transmitting the additional information, and C is prediction complexity needed for encoding or decoding (according to clock week
Phase, memory body access or other Complexity Assessment standards), λ1And λ2 areLagrange multiplier.
One embodiment of the invention is related to designing with the ALF/SAO that RDCO cooperates.Wherein, it is set according to RDCO decision with one
Count the relevant optimal candidate item of feature.The design feature can be first is that mode determines or subregion divides.In different ALF modes
Type such as I/B/P- piece or interframe/intraframe coding unit ratio of piece can be depended on by carrying out model selection.The present invention is another
One embodiment is to carry out the selection of ALF filter according to RDCO.When RDCO is applied to the selection of ALF filter, answering in RDCO
Polygamy is related with the quantity of filter parameter.As substitution, which can be used for the selection of ALF filter, the RDCO's
Complexity (C) is related with the quantity (A) of filter parameter and by the pixel quantity filtered (B), such as C=A*B.According to this hair
Bright another embodiment, the RDCO can be used for the selection of ALF filter, complexity (C) and the filter parameter of the RDCO
Quantity (A), by operation (TableOfNumOperations [Mode]) required in the pixel quantity filtered (B) and a mode
Quantity is related, such as: C=A*B*TableOfNumOperations [Mode].
What on June 12nd, 2011 submitted, it is entitled " demonstration for Video coding adapts to offset method and device "
U.S. patent application case No.13/158,427 disclose a kind of SAO scheme, use multiple pixel classifications types in the program
Classify to each pixel, and each classification type by the pixel classifications into multiple classifications.According to the pixel classifications type
And the type of the pixel, it determines with deviant to compensate the offset.The SAO scheme uses band offset (band offset, BO) ring
Border or side offset (edge offset, EO) classified pixels are into classification.The complexity of different pixel classifications types is different.
Therefore, RDCO technology can be used for SAO make a choice a pixel classifications type decision to realize optimal RDCO performance.
On the other hand US application case No.13/177,343 discloses subregion segmentation.The RDCO technology can also be used for SAO with certainly
Determine subregion segmentation, RDCO cost with by operation amount needed for processed pixel quantity and the mode
(TableOfNumOperations [Mode]) is related, such as: the type of the pixel classifications of selection.
Above-mentioned sef-adapting filter can be used in video encoder and/or Video Decoder.In the Video coding
Or in Video Decoder, which is influenced by coding noise.Above-mentioned sef-adapting filter scheme can help to mention
Height rebuilds the visual quality of video.Coded system of the above-mentioned embodiment according to the present invention with advanced ALF can be by a variety of hard
Part, software code above-mentioned are implemented in combination with.For example, one embodiment of the invention can be circuit integration to video compress chip,
Or procedure code is integrated into video compression system, to carry out respective handling.One embodiment of the invention can also be procedure code in number
It executes on word signal processor (Digital Signal Processor, DSP) to carry out respective handling.The present invention also may include
A series of functions, and by computer processor, digital signal processor, microprocessor, field programmable gate array (Field
Programmable Gate Array, FPGA) it executes.By execute define the embodiment of the present invention machine-readable software code or
Firmware code, above-mentioned processor can execute particular task according to the present invention.Software code or firmware code can in distinct program language and not
With being carried out in format or mode.Different target platforms can be compiled into software code.But, different coded formats, mode and soft
Part code language and the other methods related to the present invention for making code execute task meet spirit of the invention, fall into this hair
Bright protection scope.
Although the present invention is disclosed above with regard to preferred embodiment, so it is not intended to limiting the invention.Skill belonging to the present invention
Those of ordinary skill in art field, without departing from the spirit and scope of the present invention, when can be used for a variety of modifications and variations.Cause
This, protection scope of the present invention is subject to claims depending on before define.
Claims (12)
1. a kind of method for handling coding using loop filter characterized by comprising
Corresponding with encoded video data one is received from a processing unit and rebuilds video data, wherein the reconstruction video data quilt
Be divided into multiple subregions, and wherein merge grammer be used to indicate current partition whether share the current partition adjacent sectors it is same
One loop filter, wherein the adjacent sectors include upper subregion and left subregion；
To the current partition application loop processed to generate subregion after filtering, wherein if the merging grammer indicates the current partition
Share the same loop filter of the adjacent sectors, this uses the same loop of the adjacent sectors using loop processed step
Filter and the current partition share the filter parameter of the same loop filter of the adjacent sectors, wherein the merging language
Method includes that 1 bit merges mark to indicate whether the current partition shares the same loop of the adjacent sectors of the current partition
Filter, wherein multiple subregion is rectangle, multiple subregions height having the same and the image in same a line of image
Same row in multiple subregions width having the same, wherein in the image not each subregion of coboundary and left margin have
There are a left adjacent sectors and a upper adjacent sectors, which further includes 1 bit and merge sign, 1 ratio
Spy merges sign in each subregion of coboundary and left margin, not deserving to indicate the adjacent sectors merged
One left adjacent sectors of preceding subregion or a upper adjacent sectors；And
Subregion after the filtering is provided.
2. the method as described in claim 1, which is characterized in that each partition boundaries are maximum coding unit boundary or image side
Boundary.
3. method according to claim 2, which is characterized in that one point specified for each multiple subregion according to a scanning patter
Group index, wherein 1-D merges grammer and is used to indicate the first subregion comprising the first packet index i and indexes comprising second packet
(i-1) the second subregion merges.
4. method as claimed in claim 3, which is characterized in that the scanning patter can be selected from one group of scanning patter
Select, this group of scanning patter include deformation hibert curve, the scanning of horizontal snake, the scanning of vertical snake, the scanning of Z-type snake, helical scanning,
Quarter tree scanning and grid scanning.
5. the method as described in claim 1, which is characterized in that for multiple in the coboundary of the image or left margin
Subregion, 1 bit merge the adjacent sectors that sign omits and merged and are derived.
6. the method as described in claim 1, which is characterized in that one, which merges mark, is used to indicate whether that subregion is allowed to merge.
7. the method as described in claim 1, which is characterized in that each subregion side of any two by stages of multiple subregion
Boundary is maximum coding unit boundary.
8. a kind of device using loop filter processing encoded video characterized by comprising
Receiving module rebuilds video data for receiving corresponding with encoded video data one from a processing unit, wherein should
It rebuilds video data and is divided into multiple subregions, and wherein merge grammer and be used to indicate whether current partition shares the current partition
Adjacent sectors same loop filter, wherein the adjacent sectors include upper subregion and left subregion；
Application module, for the current partition application loop processed is generated filtering after subregion, wherein if the merging grammer
Indicate that the current partition shares the same loop filter of the adjacent sectors, this uses this adjacent point using loop processed step
The same loop filter in area and the current partition share the filter ginseng of the same loop filter of the adjacent sectors
Number, wherein the merging grammer include 1 bit merge mark indicate the current partition whether share the current partition this is adjacent
The same loop filter of subregion, wherein multiple subregion is rectangle, having with multiple subregions in a line for image is identical
Height and the image same row in multiple subregions width having the same, wherein not in coboundary and a left side in the image
Each subregion on boundary has a left adjacent sectors and a upper adjacent sectors, which further includes the conjunction of 1 bit
And sign, 1 bit merge sign in each subregion of coboundary and left margin, not merged with instruction
The adjacent sectors are a left adjacent sectors or a upper adjacent sectors for the current partition；And
Module is provided, for providing subregion after the filtering.
9. device as claimed in claim 8, which is characterized in that each partition boundaries are maximum coding unit boundary or image side
Boundary.
10. device as claimed in claim 9, which is characterized in that specify one according to a scanning patter for each multiple subregion
Packet index, wherein 1-D merges grammer and is used to indicate the first subregion comprising the first packet index i and indexes comprising second packet
(i-1) the second subregion merges.
11. device as claimed in claim 8, which is characterized in that one, which merges mark, is used to indicate whether that subregion is allowed to merge.
12. device as claimed in claim 8, which is characterized in that each subregion of any two by stages of multiple subregion
Boundary is maximum coding unit boundary.
Applications Claiming Priority (15)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US39006810P | 2010-10-05 | 2010-10-05 | |
| US61/390,068 | 2010-10-05 | ||
| US42172910P | 2010-12-10 | 2010-12-10 | |
| US61/421,729 | 2010-12-10 | ||
| US201161429313P | 2011-01-03 | 2011-01-03 | |
| US61/429,313 | 2011-01-03 | ||
| US201161454829P | 2011-03-21 | 2011-03-21 | |
| US61/454,829 | 2011-03-21 | ||
| US13/093,068 | 2011-04-25 | ||
| US13/093,068 US9094658B2 (en) | 2010-05-10 | 2011-04-25 | Method and apparatus of adaptive loop filtering |
| US13/158,427 | 2011-06-12 | ||
| US13/158,427 US9055305B2 (en) | 2011-01-09 | 2011-06-12 | Apparatus and method of sample adaptive offset for video coding |
| US13/177,343 US8861617B2 (en) | 2010-10-05 | 2011-07-06 | Method and apparatus of region-based adaptive loop filtering |
| US13/177,343 | 2011-07-06 | ||
| CN201180048246.0A CN103155557B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180048246.0A Division CN103155557B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106878729A CN106878729A (en) | 2017-06-20 |
| CN106878729B true CN106878729B (en) | 2019-09-24 |
Family
ID=45927217
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710063716.XA Active CN107087180B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201710063705.1A Active CN106878729B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
| CN201180048246.0A Active CN103155557B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710063716.XA Active CN107087180B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180048246.0A Active CN103155557B (en) | 2010-10-05 | 2011-09-30 | Adaptive loop filter method and apparatus based on subregion basis |
Country Status (5)
| Country | Link |
|---|---|
| EP (1) | EP2625859A4 (en) |
| KR (1) | KR101526349B1 (en) |
| CN (3) | CN107087180B (en) |
| CA (1) | CA2805722C (en) |
| WO (1) | WO2012045269A1 (en) |
Families Citing this family (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201119206D0 (en) | 2011-11-07 | 2011-12-21 | Canon Kk | Method and device for providing compensation offsets for a set of reconstructed samples of an image |
| JP6226863B2 (en) * | 2012-04-13 | 2017-11-08 | 三菱電機株式会社 | Image encoding device, image decoding device, image encoding method, and image decoding method |
| SI2697973T1 (en) * | 2012-04-16 | 2017-11-30 | Hfi Innovation Inc. | Method and apparatus for loop filtering across slice or tile boundaries |
| CA3217710A1 (en) * | 2012-05-25 | 2013-11-28 | Sun Patent Trust | Image encoding and decoding using context adaptive binary arithmetic coding with a bypass mode |
| CN106851275A (en) * | 2012-05-29 | 2017-06-13 | 寰发股份有限公司 | The processing unit and method of the adaptively sampled point skew of video data |
| SG10201510803WA (en) * | 2012-06-11 | 2016-01-28 | Samsung Electronics Co Ltd | Method and Apparatus for Encoding Videos Sharing SAO Parameter According to Color Component |
| US9386307B2 (en) * | 2012-06-14 | 2016-07-05 | Qualcomm Incorporated | Grouping of bypass-coded bins for SAO syntax elements |
| CN103338374B (en) | 2013-06-21 | 2016-07-06 | 华为技术有限公司 | Image processing method and device |
| JP6328759B2 (en) | 2013-07-15 | 2018-05-23 | 寰發股▲ふん▼有限公司ＨＦＩ Ｉｎｎｏｖａｔｉｏｎ Ｉｎｃ． | Method of sample adaptive offset processing for video coding |
| CN104486630B (en) * | 2014-12-16 | 2017-10-20 | 北京金山云网络技术有限公司 | H.265 in Video coding under SAO patterns offset statistical method |
| CN104602026B (en) * | 2015-01-22 | 2017-12-01 | 复旦大学 | A kind of reconstruction loop structure being multiplexed entirely encoder under HEVC standard |
| US9872026B2 (en) * | 2015-06-12 | 2018-01-16 | Intel Corporation | Sample adaptive offset coding |
| US11146788B2 (en) | 2015-06-12 | 2021-10-12 | Qualcomm Incorporated | Grouping palette bypass bins for video coding |
| KR20180019549A (en) | 2015-06-18 | 2018-02-26 | 엘지전자 주식회사 | Image filtering method and apparatus in video coding system |
| CN105357538B (en) * | 2015-11-26 | 2020-01-03 | 广东中星微电子有限公司 | Adaptive loop filtering method and apparatus |
| CN113994671B (en) | 2019-06-14 | 2024-05-10 | 北京字节跳动网络技术有限公司 | Processing video cell boundaries and virtual boundaries based on color formats |
| CN114424539A (en) | 2019-06-14 | 2022-04-29 | 北京字节跳动网络技术有限公司 | Processing video unit boundaries and virtual boundaries |
| CN117478878A (en) | 2019-07-09 | 2024-01-30 | 北京字节跳动网络技术有限公司 | Sample determination for adaptive loop filtering |
| JP7291845B2 (en) | 2019-07-11 | 2023-06-15 | 北京字節跳動網絡技術有限公司 | Sample padding in adaptive loop filtering |
| WO2021008546A1 (en) | 2019-07-15 | 2021-01-21 | Beijing Bytedance Network Technology Co., Ltd. | Accessing samples across video unit boundaries in adaptive loop filtering |
| KR20220061980A (en) | 2019-09-22 | 2022-05-13 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Padding process in adaptive loop filtering |
| KR20220063177A (en) | 2019-09-27 | 2022-05-17 | 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 | Adaptive loop filtering between different video units |
| JP7454042B2 (en) | 2019-10-10 | 2024-03-21 | 北京字節跳動網絡技術有限公司 | Padding process at unavailable sample positions in adaptive loop filtering |
| CN110809158B (en) * | 2019-11-12 | 2021-06-01 | 腾讯科技（深圳）有限公司 | Image loop filtering processing method and device |
| CN111314711B (en) * | 2020-03-31 | 2021-05-14 | 电子科技大学 | Loop filtering method based on self-adaptive self-guided filtering |
| US11463691B2 (en) * | 2020-06-03 | 2022-10-04 | Tencent America LLC | Region adaptive loop filter for video coding |
| CN114615494A (en) * | 2020-12-04 | 2022-06-10 | 咪咕文化科技有限公司 | Image processing method, device and equipment |
| WO2022191525A1 (en) * | 2021-03-08 | 2022-09-15 | 현대자동차주식회사 | Video coding method and apparatus using spiral scan order |
| CN114368150B (en) * | 2021-12-22 | 2022-11-11 | 鑫精合激光科技发展（北京）有限公司 | Three-dimensional printing method and computer storage medium |
| WO2023225854A1 (en) * | 2022-05-24 | 2023-11-30 | Oppo广东移动通信有限公司 | Loop filtering method and device, and video coding/decoding method, device and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101543076A (en) * | 2006-11-08 | 2009-09-23 | 汤姆逊许可证公司 | Methods and apparatus for in-loop de-artifact filtering |
| WO2010030744A2 (en) * | 2008-09-11 | 2010-03-18 | On2 Technologies, Inc. | System and method for video encoding using adaptive loop filter |
| WO2010034206A1 (en) * | 2008-09-25 | 2010-04-01 | Mediatek Inc. | Adaptive filter |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2899977A1 (en) * | 2002-01-31 | 2015-07-29 | Samsung Electronics Co., Ltd | Filtering method and apparatus for reducing block artifacts or ringing noise |
| EP1980112B1 (en) * | 2006-02-02 | 2012-10-24 | Thomson Licensing | Method and apparatus for adaptive weight selection for motion compensated prediction |
| CN101321277A (en) * | 2007-06-09 | 2008-12-10 | 华为技术有限公司 | Method and apparatus for removing block effect |
| US9967590B2 (en) * | 2008-04-10 | 2018-05-08 | Qualcomm Incorporated | Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter |
| US9924184B2 (en) * | 2008-06-30 | 2018-03-20 | Microsoft Technology Licensing, Llc | Error detection, protection and recovery for video decoding |
| CN101635849B (en) * | 2008-07-24 | 2011-11-16 | 青岛海信信芯科技有限公司 | Loop filtering method and loop filter |
| CN101742292B (en) * | 2008-11-14 | 2013-03-27 | 北京中星微电子有限公司 | Image content information-based loop filtering method and filter |
| CN201345710Y (en) * | 2008-12-31 | 2009-11-11 | 暨南大学 | Loop filter applicable to video decoding |
| CN101651829A (en) * | 2009-06-29 | 2010-02-17 | 北京中星微电子有限公司 | Loop wave filtering method and device and mobile multi-medium terminal chip |
| JP5359657B2 (en) * | 2009-07-31 | 2013-12-04 | ソニー株式会社 | Image encoding apparatus and method, recording medium, and program |
-
2011
- 2011-09-30 CN CN201710063716.XA patent/CN107087180B/en active Active
- 2011-09-30 CN CN201710063705.1A patent/CN106878729B/en active Active
- 2011-09-30 WO PCT/CN2011/080408 patent/WO2012045269A1/en active Application Filing
- 2011-09-30 KR KR1020137001815A patent/KR101526349B1/en active IP Right Grant
- 2011-09-30 EP EP11830225.6A patent/EP2625859A4/en not_active Withdrawn
- 2011-09-30 CA CA2805722A patent/CA2805722C/en active Active
- 2011-09-30 CN CN201180048246.0A patent/CN103155557B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101543076A (en) * | 2006-11-08 | 2009-09-23 | 汤姆逊许可证公司 | Methods and apparatus for in-loop de-artifact filtering |
| WO2010030744A2 (en) * | 2008-09-11 | 2010-03-18 | On2 Technologies, Inc. | System and method for video encoding using adaptive loop filter |
| WO2010034206A1 (en) * | 2008-09-25 | 2010-04-01 | Mediatek Inc. | Adaptive filter |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2625859A4 (en) | 2016-03-02 |
| CN103155557B (en) | 2017-03-01 |
| CN103155557A (en) | 2013-06-12 |
| CN107087180A (en) | 2017-08-22 |
| CA2805722C (en) | 2016-03-29 |
| EP2625859A1 (en) | 2013-08-14 |
| WO2012045269A1 (en) | 2012-04-12 |
| CA2805722A1 (en) | 2012-04-12 |
| KR20130030294A (en) | 2013-03-26 |
| CN106878729A (en) | 2017-06-20 |
| KR101526349B1 (en) | 2015-06-05 |
| CN107087180B (en) | 2019-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106878729B (en) | Adaptive loop filter method and apparatus based on subregion basis | |
| KR102398643B1 (en) | Method and apparatus for encoding intra prediction information | |
| CN112088533B (en) | Image encoding/decoding method and apparatus, and recording medium storing bit stream | |
| EP3590256B1 (en) | Method and apparatus of implicit intra coding tool settings with intra directional prediction modes for video coding | |
| CN103200402B (en) | The method for removing deblocking man-made noise | |
| US8861617B2 (en) | Method and apparatus of region-based adaptive loop filtering | |
| JP2022078048A (en) | Method for decoding image and method for encoding image | |
| CN109076237A (en) | The method and apparatus of the intra prediction mode of intra-frame prediction filtering device are used in video and compression of images | |
| CN107197258A (en) | Loop circuit filtering method and its equipment | |
| CN103209324A (en) | Method of applying edge offset | |
| CN103051892B (en) | Embedded loop filter method and embedded loop filter | |
| CN116647679A (en) | Video encoding/decoding method, apparatus, and recording medium storing bit stream | |
| EP3884667B1 (en) | Video coding with triangular shape prediction units | |
| CN114143548B (en) | Coding and decoding of transform coefficients in video coding and decoding | |
| Erfurt et al. | Multiple feature-based classifications adaptive loop filter | |
| RU2805056C2 (en) | Method and device for encoding/decoding image signals | |
| RU2817331C2 (en) | Method and device for encoding/decoding image signal | |
| CN110720216B (en) | Apparatus and method for video encoding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |