CN103220529B - A kind of implementation method of coding and decoding video loop filtering - Google Patents
A kind of implementation method of coding and decoding video loop filtering Download PDFInfo
- Publication number
- CN103220529B CN103220529B CN201310128415.2A CN201310128415A CN103220529B CN 103220529 B CN103220529 B CN 103220529B CN 201310128415 A CN201310128415 A CN 201310128415A CN 103220529 B CN103220529 B CN 103220529B
- Authority
- CN
- China
- Prior art keywords
- filtering
- block
- boundary
- border
- encoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention relates to multimedia video encoding and decoding technique field, particularly relate to a kind of method of loop filtering of coding and decoding video end, described method comprises and utilizes encoding and decoding end block division information to obtain image block partition structure, and loop filtering then carries out at block boundary, if border comprises encoding block, prediction block and transform blocks boundaries, then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision, finally perform Pixel-level filtering, filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border, technique effect of the present invention is: this programme effectively can improve the subjective and objective quality of Video coding, on AVS2.0 embodiment reference software RD2.0-ADI, this programme and device can improve the code efficiency of 0.9%, encoding and decoding end filtering boundary number and complexity can be reduced simultaneously.
Description
Technical field
The present invention relates to multimedia video encoding and decoding technique field, particularly relate to a kind of method of loop filtering of coding and decoding video end.
Background technology
In current block-based hybrid encoding frame, Video coding is with the optimization model of this block of the rate-distortion optimization of each piece (RDO) Tactic selection thus obtain the approximate of current encoded frame coding efficiency optimum.But because consider the correlation of spatial domain and time domain in Video coding, the optimum of such current block can not ensure the optimum of whole sequential coding performance, the impact of the subjective and objective quality that the optimum that some coding toolses can improve this local as loop filtering brings to the overall situation.By improving present frame when encoding because of the blocking effect that piecemeal brings, decrease subjective ringing effect and blocking effect, filtered frame as next code frame reference frame, thus will improve the subjective and objective coding quality of subsequent frame simultaneously.Therefore loop filtering technology has very consequence in Video coding.
In existing announced video encoding standard, as H.264 its loop filtering is at 4X4 block boundary, in AVS, then carry out on 8X8 border, this is because in these standards, the size of transform block is fixing, and be not more than the size of coding unit block (macro block) and prediction block, so the border of transform block comprises coding unit block and prediction block boundary certainly.But in efficient video coding standard and AVS standard A VS2.0 of future generation, coding unit (CodingUnit, CU) is the elementary cell of Video coding.Recurrence partition mode is pitched in the employing four of coding unit, and coding unit is maximum reaches 64X64 (as shown in Figure 1), and is no longer 16X16.To in each coding unit, carry out block forecast by coding toolses such as prediction, change quantization, entropy code, reprocessings.Wherein coding unit is when giving a forecast, and coding unit can be divided into the predicting unit (PredictionUnit, PU) of different size, and predicting unit is the elementary cell of prediction.In coding unit, the division of infra-frame prediction and inter prediction unit respectively as shown in Figures 2 and 3, and the size of prediction block, from 64X64,64X32,32X64,32X32 until 8X8, even also comprises asymmetric prediction block (AMP).The size of transform block is no longer fixed as 4X4 or 8X8 simultaneously, and relevant with the size of CU, and the size of such transform block comprises from 32X32,16X16 to 8X8.The original like this mode of carrying out filtering in all 4X4 or 8X8 borders that is fixed on will no longer meet the object of loop filtering deblocking effect.
Summary of the invention
The embodiment of the present invention provides a kind of loop filtering technology, Apparatus and system, to reduce blocking effect, improves subjective and objective coded video quality and code efficiency, reduces coding and decoding end complexity simultaneously.
For achieving the above object, the invention provides a kind of implementation method scheme of coding and decoding video loop filtering, specific implementation step comprises:
Described loop circuit filtering method comprises the steps:
Step 1) utilize encoding and decoding end block division information to obtain image block (comprising encoding block, prediction block and transform block) partition structure, loop filtering then carries out on block (as encoding block, prediction block and transform block) border, if the coded residual of encoding block is 0 (i.e. CBP=0), then only carry out filtering at encoding block and prediction block boundary; Filtering flow process is predefine filtering block, image is divided into filtering cutting unit block (as 16X16 block size, also can be maximum coding unit block or picture frame etc.), can predefine or the size of filtering block is described in code stream, in order to uniform filters design, filter sequence is for carry out each filtering block successively, horizontal boundary after first vertical boundary, namely first carries out filtering to all vertical boundaries in filtering block and carries out filtering to horizontal boundary again; The minimum filter unit of predefine (as 8X8 block size) simultaneously, the block boundary that yardstick is less than minimum filter unit skips filtering;
Step 2) if border comprises encoding block, prediction block and transform blocks boundaries, then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision,
If 2.1 decision-makings need this border of filtering, then carry out ensuing Pixel-level filtering;
2.2 otherwise skip this boundary filtering; Pixel-level filtering decision is carried out to determine the filtering strength (BS) of each pixel column the need of filtering and employing to needing the block boundary place carrying out filtering;
Step 3) finally perform Pixel-level filtering, filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border, wherein participates in the block structure of image filtering, includes but not limited to encoding block, prediction block and transform block; Filtering block for convenience of operations such as filtering, and carries out the dividing mode of uniform sizes, as divided according to 16X16 size filter block image to image.
Described step 1) also comprise: the border that loop filtering occurs is on block (as encoding block, prediction block and transform block) border, when the coded residual of encoding block is zero (i.e. CBP=0), then only carry out filtering at encoding block and prediction block boundary, define the minimum dimension of filtering as 8X8 block size simultaneously.Such as AVS2 embodiment, the size of encoding block contains the size from 64X64 to 8X8, selects according to RDO, and adopting quaternary tree iterative recursive to divide, is the elementary cell of coded treatment; Prediction block be on the basis of encoding block further according to the Further Division of prediction characteristic; Transform block is also the Further Division according to the distribution character of residual error on the basis of encoding block.
Described step 1) also comprise: filtering cutting unit block (as 16X16 size or maximum coding unit block) is divided into for whole two field picture, can predefine or the size of filtering block is described in code stream, successively filtering is carried out to each filtering block according to scanning, first to vertical boundary, at horizontal boundary, whether detection boundaries comprises encoding block, prediction block and transform blocks boundaries, if comprise, then this border of filtering, otherwise skip this border of filtering.
Described step 2) also comprise: decide current block border the need of filtering according to the pattern of filtering boundary both sides block, movable information, quantization parameter and residual error etc., if boundary levels decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering, if block boundary both sides block P and Q has intra prediction mode, then need to perform filtering; If P, Q block is the interframe prediction block of P frame, its residual error is 0, and reference frame is identical and each component of motion vector is less than a pixel, then this block boundary of decision-making does not need filtering, otherwise all needs filtering.
Described step 2) also comprise: filtering decision needs the block boundary often row pixel of filtering, and the threshold value table respective value corresponding to index utilizing the saltus step of both sides, border pixel and block average qp value to obtain compares, and carrys out Choose filtering intensity; Pixel-level filtering strength span 0-4, BS=0 represents does not need filtering, BS=4, represents comparatively flat site, needs to carry out stronger smothing filtering.
Described step 3) also comprise: corresponding FIR filter is selected in the position of pixel, and filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border; Different filtering strength and the FIR filter corresponding to different pixels position use; Can utilize simultaneously the pattern information of the texture features of topography and both sides, border block determine the mode of filtering be perpendicular to border or and border angled
Technique effect of the present invention is: this programme effectively can improve the subjective and objective quality of Video coding, on AVS2.0 embodiment reference software RD2.0-ADI, this programme and device can improve the code efficiency of 0.9%, can reduce encoding and decoding end filtering boundary number and complexity simultaneously.
Accompanying drawing explanation
When considered in conjunction with the accompanying drawings, by referring to detailed description below, more completely can understand the present invention better and easily learn wherein many adjoint advantages, but accompanying drawing described herein is used to provide a further understanding of the present invention, form a part of the present invention, schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention, as schemed wherein:
Fig. 1 is that AVS2 prior art coding unit divides schematic diagram;
Fig. 2 is AVS2 prior art transform block dividing elements schematic diagram;
Fig. 3 is that AVS2 prior art prediction module unit divides schematic diagram;
Fig. 4 is dotted line is that AVS1 adopts, and carries out filtering to all 8X8 of comprising transform blocks boundaries, then this programme only carries out filtering on solid line (encoding block, prediction block and transform block) border;
Fig. 5 is the pixel that filtering boundary place participates in filtering;
Fig. 6 is filtering block (get 16X16 and be of a size of example) interior filter sequence, first vertical boundary, rear horizontal boundary;
Fig. 7 is a kind of filtering example flow chart that the present invention supports;
Fig. 8 is block boundary pixel filter flow chart of the present invention.
Below in conjunction with drawings and Examples, the present invention is further described.
Embodiment
Obviously, the many modifications and variations that those skilled in the art do based on aim of the present invention belong to protection scope of the present invention.
Coding side:
As shown in Figure 1 to Figure 3, embodiment of the present invention AVS2, at coding side, when a two field picture is after the coding completing prediction, change quantization and entropy code and pattern information, then can obtain reconstructed frame of encoding after inverse quantization inverse transformation.Utilize the pattern information of encoding and decoding end and block comminute block of information to obtain the dividing mode of current restructuring graph picture frame, the minimum filter unit of present frame is set, image is divided into filtering block.Frame level filtering flow process is to each filtering block, according to the flow process shown in Fig. 7, first to all vertical boundaries in filtering block, whether be encoding block, prediction block or transform blocks boundaries, if then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision if detecting it successively.If boundary levels filtering decision needs this vertical boundary of filtering, then to this vertical boundary according to performing the decision-making of Pixel-level filtering strength and Pixel-level filtering shown in Fig. 8, the filtering under concrete filtering strength BS decision process and different B S is as previously mentioned.After executing all vertical boundary filtering in a filtering block, similar mode executive level boundary filtering.After being filtered a filtering block, judge whether to be filtered a frame, if do not have, then prepare the filtering of next filtering block according to the scanning sequency of setting, repetitive cycling is until traveled through the whole filtering block of present frame.
Decoding end:
For decoding end, also be successively to each filtering block, add that residual error after inverse quantization inverse transformation obtains decoding and reconstituting block and performs filtering decision and filtering that similar coding side carries out thus obtain the filtered image of decoding end reconstructed image through predictive compensation, for display, store or be supplied to other frame references.
Embodiment of the present invention said method, Apparatus and system technical scheme have following beneficial effect: this patent proposes a set of loop filtering technology.When loop filtering is carried out in encoding and decoding, image block (comprising encoding block, prediction block and transform block) partition structure is obtained by utilizing encoding and decoding end block division information, loop filtering then carries out on block (as encoding block, prediction block and transform block) border, if the coded residual of encoding block is zero (i.e. CBP=0), then only carry out filtering at encoding block and prediction block boundary; Filtering flow process is predefine filtering block, image is divided into filtering cutting unit block (as 16X16 block size, also can be maximum coding unit block or picture frame etc.), can predefine or the size of filtering block is described in code stream, in order to uniform filters design, filter sequence is for carry out each filtering block successively, horizontal boundary after first vertical boundary, namely first carries out filtering to all vertical boundaries in filtering block and carries out filtering to horizontal boundary again; The minimum filter unit of predefine simultaneously, the block boundary that yardstick is less than minimum filter unit skips filtering; If border comprises encoding block, prediction block and transform blocks boundaries, then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision, if decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering; Pixel-level filtering decision is carried out to determine the filtering strength (BS) of each pixel column the need of filtering and employing to the block boundary place threshold value (as shown in appendix 1) and pixel Local textural feature that need to carry out filtering; Filter (subordinate list 2 or subordinate list 3 shown in) design is finally utilized to perform Pixel-level filtering, filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border, thus self adaptation can better remove blocking effect and improve code efficiency.This programme is on AVS2.0 embodiment RD2.0, and this programme and device can improve the code efficiency of 0.9%, can reduce encoding and decoding end filtering boundary number and complexity simultaneously.
Experimental result:
The embodiment of the present invention realizes at the upper completing technology of RD2.0 (reference software of AVS2 standard).In an experiment, adopt the universal test condition of AVS2, RA configures.Experiment porch is Intel (R) Xeon (R) CPUX56602.80GHZ2.79GHZ23.9G internal memory.Table 2 represents the loop circuit filtering method adopted in the present invention, compares the Performance comparision of the loop circuit filtering method in anchor (AVS2RD2.0-ADI).4kX2k, 1080p, WVGA, WQVGA, 720p represent that resolution is the cycle tests of 3840X2160,1920X1080,832X480,416X240,1280X720 respectively.The tolerance of coding efficiency adopts BD-rate, and the code check namely when same-code quality is saved.From experimental result, adopt embodiment of the present invention such scheme, when same-code quality, the code check obtaining average 0.9% is saved.
Table 2. Performance comparision (the design of filter vsRD2-ADI of proposition)
When loop filtering is carried out in encoding and decoding, image block (comprising encoding block, prediction block and transform block) partition structure is obtained by utilizing encoding and decoding end block division information, loop filtering then carries out on block (as encoding block, prediction block and transform block) border, if the coded residual of encoding block is 0 (i.e. CBP=0), then only carry out filtering at encoding block and prediction block boundary; Filtering flow process is predefine filtering block, image is divided into filtering cutting unit block (as 16X16 block size, maximum coding unit block size or picture frame), can predefine or the size of filtering block is described in code stream, in order to uniform filters design, filter sequence is for carry out each filtering block successively, horizontal boundary after first vertical boundary, namely first carries out filtering to all vertical boundaries in filtering block and carries out filtering to horizontal boundary again; If border comprises encoding block, prediction block and transform blocks boundaries, then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision, if decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering; Threshold value and pixel Local textural feature is utilized to carry out Pixel-level filtering decision to determine the filtering strength (BS) of each pixel column the need of filtering and employing to needing the block boundary place carrying out filtering; Finally utilize the filter of design to perform Pixel-level filtering, filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border.
When block boundary loop filtering is carried out in encoding and decoding, described method comprises encoding and decoding when carrying out loop filtering after obtaining reconstructed image, and as Fig. 7, to give a kind of its step of filtering flow process that patent of the present invention supports as follows:
Initialization: utilize the pattern information of encoding and decoding end and block comminute block of information to obtain the block dividing mode of current restructuring graph picture frame, arrange the minimum filter unit of present frame, image is divided into filtering block, arranges initial filtering block sequence number N=0.
Successively boundary filtering is carried out to filtering block N each in image according to scanning sequency;
2.1. whether first to all vertical boundaries of filtering block, detecting it is successively encoding block, prediction block or transform blocks boundaries, and whether if CBP=0, then detecting is encoding block, prediction block boundary; If then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision.
2.2. to all vertical boundaries, if boundary levels filtering decision needs this vertical boundary of filtering, then Pixel-level filtering strength decision-making and Pixel-level filtering are performed to this vertical boundary.
2.3. whether again to all horizontal boundaries of filtering block, detecting it is successively encoding block, prediction block or transform blocks boundaries, and whether if CBP=0, then detecting is encoding block, prediction block boundary; If then Land use models, movable information, quantization parameter and residual error etc. carry out boundary levels filtering decision.
2.4. to all horizontal boundaries, if boundary levels filtering decision needs this horizontal boundary of filtering, then Pixel-level filtering strength decision-making and Pixel-level filtering are performed to this horizontal boundary.
2.5. judge whether that whole frame filtering is complete, if not, filtering block sequence number N increases, and jumps to the filtering that 2.1 continuation perform next filtering block.
3. whole frame filtering is complete;
Filtering block size is that 16X16 (only illustrates here, concrete size can preset value or illustrate in code stream), minimum filter unit is 8X8 block (as shown in Figure 6), needs to utilize the alphabeta in boundary pixel jump and threshold value table and pixel local jump feature to carry out (BS) decision-making of Pixel-level filtering strength and the FIR filter (as shown in subordinate list 2 or subordinate list 3) of different pixels position under selecting different filtering strength.For a concrete block boundary filtering as shown in Figure 8.
Filtering strength decision process is specific as follows:
If abs (p0 – q0) <Alpha & & is abs (p0 – q0) >1, then carry out step below; Otherwise, Bs=0.
Setting left and right flatness variable FL and FR, and both initial values are all set to 0.
If abs (p0 – p1) <Beta, then FL+=2;
If abs (p0 – p2) <Beta, then FL++;
If abs (q0 – q1) <Beta, then FR+=2;
If abs (q0 – q2) <Beta, then FR++;
Left and right flatness sum FS=FL+FR.
According to the value of FS, do following judgement:
As FS=6, if p0=p1, and q0=q1, then boundary intensity Bs=4.Otherwise Bs=3;
As FS=5, if p0=p1, and q0=q1, then boundary intensity Bs=3.Otherwise Bs=2;
As FS=4, if FL=2, then Bs=2.Otherwise, Bs=1.
As FS=3, and abs (p1 – q1) <Beta, then Bs=1.Otherwise, Bs=0.
When FS is other value, Bs=0.
To revise the boundary intensity according to coding situation;
If encode according to frame pattern, and carry out filtering to chromatic component, Bs subtracts 1:
If encode according to field mode, and meet one of following condition, Bs subtracts 1:
In vertical direction filtering is carried out to luminance component;
Filtering is carried out to chromatic component;
As BS>0, perform the Pixel-level filtering of pixel column, filter adopts shown in subordinate list 2:
Bs equals boundary filtering process when 4;
When the value of boundary filtering strength Bs is 4, the computational process following (P0, P1, P2 and Q0, Q1, Q2 are filtered values) to p0, p1, p2, p3 and q0, q1, q2, q3 filtering:
P0＝((p0<<3)+p0+(p2<<2)+p2+(p1<<2)+(q0<<3)-q0+(q1<<2)+(q2<<1)+q2+16)>>5；
P1＝((p0<<2)+(p0<<1)+(p1<<1)+p1+(p2<<2)+q0+(q0<<1)+8)>>4；
P2＝(p0+(p1<<1)+p2+(p2<<1)+p3+q0+4)>>3；
Q0＝((q0<<3)+q0+(q2<<2)+q2+(q1<<2)+(p0<<3)-p0+(p1<<2)+(p2<<1)+p2+16)>>5；
Q1＝((q0<<2)+(q0<<1)+(q1<<1)+q1+(q2<<2)+p0+(p0<<1)+8)>>4；
Q2＝(q0+(q1<<1)+q2+(q2<<1)+q3+p0+4)>>3；
Bs equals boundary filtering process when 3;
When the value of boundary filtering strength Bs is 3, the computational process following (P0, P1 and Q0, Q1 are filtered values) to p0, p1 and q0, q1 filtering:
P0＝(p2+(p1<<2)+(p0<<2)+(p0<<1)+(q0<<2)+q1+8)>>4；
Q0＝(p1+(p0<<2)+(q0<<2)+(q0<<1)+(q1<<2)+q2+8)>>4；
P1＝((p2<<1)+p2+(p1<<3)+(p0<<2)+q0+8)>>4；
Q1＝((q2<<1)+q2+(q1<<3)+(q0<<2)+p0+8)>>4；
Bs equals boundary filtering process when 2;
When the value of boundary filtering strength Bs is 2, the computational process following (P0 and Q0 is filtered value) to p0 and q0 filtering:
P0＝((p1<<1)+p1+(p0<<3)+(p0<<1)+(q0<<1)+q0+8)>>4；
Q0＝((p0<<1)+p0+(q0<<3)+(q0<<1)+(q1<<1)+q1+8)>>4；
Bs equals boundary filtering process when 1;
When the value of boundary filtering strength Bs is 1, the computational process following (P0 and Q0 is filtered value) to p0 and q0 filtering:
P0＝((p0<<1)+p0+q0+2)>>2；
Q0＝((q0<<1)+q0+p0+2)>>2。
The present invention, owing to have employed technique scheme, compares with method in existing AVS standard, has following innovation and beneficial effect:
The first, image block (comprising encoding block, prediction block and transform block) partition structure is obtained by reusing encoding and decoding end block division information, loop filtering then carries out in encoding block, prediction block and transform blocks boundaries, if the CBP=0 of encoding block, then only carry out filtering at encoding block and prediction block boundary.Code efficiency can be improve like this, and decrease the border number of filtering, thus reduce coding and decoding end complexity, the original filters solutions of Fig. 4 dotted line display AVS1 carries out filtering in all 8X8 transform blocks boundaries, solid line represents actual encoding block, the dividing mode of prediction block and transform block, this programme only needs in the filtering of solid line place, thus the number of boundary of filtering greatly reduces, such as to the block of 32X32, at all 8X8 block boundary filterings, then filtering boundary number is 32 8 pixel boundaries, only then only need 88 pixel boundary filtering at block boundary filtering, save 4 times.Need filtering boundary number and block size relation as shown in table 1.So in high-resolution video, when bulk select probability is more, adopting this method significantly to reduce needs filtering boundary number, thus reduces encoding and decoding end complexity.
Table 1. needs filtering boundary number to save and block size relation
| Block size | The several sections of province in filtering boundary limit |
| 64X64 | 8 times |
| 32X32 | 4 times |
| 16X16 | 2 times |
| 8X8 | 1 times |
the second, this programme preset value filtering block is (as 16X16 block size, maximum coding unit block size or picture frame, can illustrate in code stream), before filtering, first image divides according to filtering block, then according to scanning sequency successively to the Order Filtering of horizontal boundary after the first vertical boundary of each filtering block, such can convenient and uniform filters design, improve the design complexities of adaptivity and reduction hardware circuit.
Three, new filtering threshold coefficient table such as subordinate list 1 and the filter of the present invention program use shown in subordinate list 2, filtering direction can be chosen according to pattern information and block boundary local image characteristics simultaneously, and be no longer fixed as vertical block boundary, can better improve code efficiency and subjective quality.
Those skilled in the art can also recognize the various illustrative components, blocks (illustrativelogicalblock) that the embodiment of the present invention is listed, unit, and step can pass through electronic hardware, computer software, or both combinations realize.For the replaceability (interchangeability) of clear displaying hardware and software, above-mentioned various illustrative components (illustrativecomponents), unit and step have universally described their function.Such function is the designing requirement realizing depending on specific application and whole system by hardware or software.Those skilled in the art for often kind of specifically application, can use the function described in the realization of various method, but this realization can should not be understood to the scope exceeding embodiment of the present invention protection.
Various illustrative logical block described in the embodiment of the present invention, or unit can pass through general processor, digital signal processor, application-specific integrated circuit (ASIC) (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the design of above-mentioned any combination realizes or operates described function.General processor can be microprocessor, and alternatively, this general processor also can be any traditional processor, controller, microcontroller or state machine.Processor also can be realized by the combination of calculation element, such as digital signal processor and microprocessor, multi-microprocessor, and a Digital Signal Processor Core combined by one or more microprocessor, or other similar configuration any realizes.
The software module that method described in the embodiment of the present invention or the step of algorithm directly can embed hardware, processor performs or the combination of both.Software module can be stored in the storage medium of other arbitrary form in RAM memory, flash memory, ROM memory, eprom memory, eeprom memory, register, hard disk, moveable magnetic disc, CD-ROM or this area.Exemplarily, storage medium can be connected with processor, with make processor can from storage medium reading information, and write information can be deposited to storage medium.Alternatively, storage medium can also be integrated in processor.Processor and storage medium can be arranged in ASIC, and ASIC can be arranged in user terminal.Alternatively, processor and storage medium also can be arranged in the different parts in user terminal.
In one or more exemplary design, the above-mentioned functions described by the embodiment of the present invention can realize in the combination in any of hardware, software, firmware or this three.If realized in software, these functions can store on the medium with computer-readable, or are transmitted on the medium of computer-readable with one or more instruction or code form.Computer readable medium comprises computer storage medium and is convenient to make to allow computer program transfer to the communication medium in other place from a place.Storage medium can be that any general or special computer can the useable medium of access.Such as, such computer readable media can include but not limited to RAM, ROM, EEPROM, CD-ROM or other optical disc storage, disk storage or other magnetic storage device, or other anyly may be used for carrying or store the medium that can be read the program code of form with instruction or data structure and other by general or special computer or general or special processor.In addition, any connection can be properly termed computer readable medium, such as, if software is by a coaxial cable, optical fiber computer, twisted-pair feeder, Digital Subscriber Line (DSL) or being also comprised in defined computer readable medium with wireless way for transmittings such as such as infrared, wireless and microwaves from a web-site, server or other remote resource.Described video disc (disk) and disk (disc) comprise Zip disk, radium-shine dish, CD, DVD, floppy disk and Blu-ray Disc, and disk is usually with magnetic duplication data, and video disc carries out optical reproduction data with laser usually.Above-mentioned combination also can be included in computer readable medium.
The relation of subordinate list 1 block boundary threshold alpha of the present invention and β and Index
| Index | α | β | Index | α | β | Index | α | β | Index | α | β |
| 0 | 0 | 0 | 16 | 5 | 3 | 32 | 26 | 7 | 48 | 50 | 17 |
| 1 | 0 | 0 | 17 | 5 | 3 | 33 | 28 | 7 | 49 | 52 | 18 |
| 2 | 0 | 0 | 18 | 6 | 3 | 34 | 30 | 8 | 50 | 53 | 19 |
| 3 | 0 | 0 | 19 | 7 | 3 | 35 | 33 | 8 | 51 | 54 | 20 |
| 4 | 1 | 1 | 20 | 8 | 4 | 36 | 33 | 8 | 52 | 55 | 21 |
| 5 | 1 | 1 | 21 | 9 | 4 | 37 | 35 | 9 | 53 | 56 | 22 |
| 6 | 1 | 1 | 22 | 10 | 4 | 38 | 35 | 9 | 54 | 57 | 23 |
| 7 | 1 | 1 | 23 | 11 | 4 | 39 | 36 | 10 | 55 | 58 | 23 |
| 8 | 1 | 1 | 24 | 12 | 5 | 40 | 37 | 10 | 56 | 59 | 24 |
| 9 | 2 | 1 | 25 | 13 | 5 | 41 | 37 | 11 | 57 | 60 | 24 |
| 10 | 2 | 1 | 26 | 15 | 5 | 42 | 39 | 11 | 58 | 61 | 25 |
| 11 | 2 | 2 | 27 | 16 | 5 | 43 | 39 | 12 | 59 | 62 | 25 |
| 12 | 3 | 2 | 28 | 18 | 6 | 44 | 42 | 13 | 60 | 63 | 26 |
| 13 | 3 | 2 | 29 | 20 | 6 | 45 | 44 | 14 | 61 | 64 | 27 |
| 14 | 4 | 2 | 30 | 22 | 6 | 46 | 46 | 15 | 62 | 64 | 27 |
| 15 | 4 | 2 | 31 | 24 | 7 | 47 | 48 | 16 | 63 | 64 | 27 |
The filter parameter design that subordinate list 2. the present invention uses
| L3 | L2 | L1 | L0 | R0 | R1 | R2 | R3 | ||
| BS＝4 | L0 | 5 | 4 | 9 | 7 | 4 | 3 | ||
| L1 | 4 | 3 | 6 | 3 | |||||
| L2 | 1 | 3 | 2 | 1 | 1 | ||||
| BS＝3 | L0 | 1 | 4 | 6 | 4 | 1 | |||
| L1 | 3 | 8 | 4 | 1 | |||||
| BS＝2 | L0 | 3 | 10 | 3 | |||||
| BS＝1 | L0 | 3 | 1 |
The original filter parameter design of subordinate list 3.AVS
| L3 | L2 | L1 | L0 | R0 | R1 | R2 | R3 | ||
| BS＝4 | L0 | 9 | 9 | 8 | 6 | ||||
| L1 | 6 | 7 | 3 | ||||||
| L2 | 3 | 4 | 1 | ||||||
| BS＝3 | L0 | 1 | 4 | 6 | 4 | 1 | |||
| L1 | 3 | 8 | 4 | 1 | |||||
| BS＝2 | L0 | 3 | 10 | 3 | |||||
| BS＝1 | L0 | 3 | 1 |
apply specific embodiment herein to set forth principle of the present invention and execution mode, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications.In sum, this description should not be construed as limitation of the present invention.
Claims (7)
1. a method for the loop filtering of coding and decoding video end, is characterized in that comprising the steps:
Step 1), utilize encoding and decoding end block division information to obtain image block partition structure, loop filtering then carries out at described image block boundaries, if the coded residual of encoding block is 0 (i.e. CBP=0), then only encoding block and prediction block boundary carry out filtering; Filtering flow process is predefine filtering block, image is divided into filtering cutting unit block, can predefine or the size of filtering block is described in code stream, in order to uniform filters design, filter sequence is for carry out each filtering block successively, horizontal boundary after first vertical boundary, namely first carries out filtering to all vertical boundaries in filtering block and carries out filtering to horizontal boundary again;
Step 2) if border comprises encoding block, prediction block and transform blocks boundaries, then Land use models, movable information, quantization parameter and residual error carry out boundary levels filtering decision,
If 2.1 decision-makings need this border of filtering, then carry out ensuing Pixel-level filtering;
2.2 otherwise skip this boundary filtering; Pixel-level filtering decision is carried out to determine the filtering strength (BS) of each pixel column the need of filtering and employing to needing the block boundary place carrying out filtering;
Step 3), finally perform Pixel-level filtering, filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border, wherein participate in the block structure of image filtering, include but not limited to encoding block, prediction block and transform block; Filtering block for convenience of filtering operation, and carries out the dividing mode of uniform sizes to image, can divide image according to 16X16 size filter block.
2. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, is characterized in that, described step 1) also comprise: image block comprises encoding block, prediction block and transform block.
3. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 1) also comprise: the border that loop filtering occurs is at described image block boundaries, when the coded residual of encoding block is zero, i.e. CBP=0, then only carry out filtering at encoding block and prediction block boundary, define the minimum dimension 8X8 block size of filtering simultaneously; The size of encoding block contains the size from 64X64 to 8X8, selects according to RDO, and adopting quaternary tree iterative recursive to divide, is the elementary cell of coded treatment; Prediction block be on the basis of encoding block further according to the Further Division of prediction characteristic; Transform block is also the Further Division according to the distribution character of residual error on the basis of encoding block.
4. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 1) also comprise: filtering cutting unit block is divided into for whole two field picture, can predefine or the size of filtering block is described in code stream, successively filtering is carried out to each filtering block according to scanning, first to vertical boundary, horizontal boundary again, whether detection boundaries comprises encoding block, prediction block and transform blocks boundaries, if comprise, then this border of filtering, otherwise skip this border of filtering.
5. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 2) also comprise: decide current block border the need of filtering according to the pattern of filtering boundary both sides block, movable information, quantization parameter and residual error, if boundary levels decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering, if block boundary both sides block P and Q has intra prediction mode, then need to perform filtering; If P, Q block is the interframe prediction block of P frame, its residual error is 0, and reference frame is identical and each component of motion vector is less than a pixel, then this block boundary of decision-making does not need filtering, otherwise all needs filtering.
6. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 2) also comprise: filtering decision needs the block boundary often row pixel of filtering, the threshold value table respective value corresponding to index utilizing the saltus step of both sides, border pixel and two block average qp value to obtain compares, and carrys out Choose filtering intensity; Pixel-level filtering strength span 0-4, BS=0 represents does not need filtering, BS=4, represents comparatively flat site, needs to carry out stronger smothing filtering.
7. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, is characterized in that, described step 3) also comprise: filtering direction also can become other angles according to local pixel characteristic or block mode with border perpendicular to border; The FIR filter of different pixels position under different filtering strength is selected to carry out filtering; Can utilize simultaneously the pattern information of the texture features of topography and both sides, border block determine the mode of filtering be perpendicular to border or and border angled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310128415.2A CN103220529B (en) | 2013-04-15 | 2013-04-15 | A kind of implementation method of coding and decoding video loop filtering |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310128415.2A CN103220529B (en) | 2013-04-15 | 2013-04-15 | A kind of implementation method of coding and decoding video loop filtering |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103220529A CN103220529A (en) | 2013-07-24 |
| CN103220529B true CN103220529B (en) | 2016-02-24 |
Family
ID=48817933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310128415.2A Active CN103220529B (en) | 2013-04-15 | 2013-04-15 | A kind of implementation method of coding and decoding video loop filtering |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103220529B (en) |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754363B (en) * | 2013-12-31 | 2017-08-08 | 展讯通信（上海）有限公司 | Loop circuit filtering method and device, encoder and decoder for HEVC |
| CN103888764B (en) * | 2014-03-14 | 2017-02-15 | 西安交通大学 | Self-adaptation compensation system and method for video compression distortion |
| CN104113765A (en) * | 2014-07-28 | 2014-10-22 | 北京大学深圳研究生院 | Video coding and decoding method and device |
| WO2016015198A1 (en) * | 2014-07-28 | 2016-02-04 | 北京大学深圳研究生院 | Video coding/decoding method and apparatus |
| CN105791865B (en) * | 2014-12-22 | 2020-01-17 | 江苏省电力公司南京供电公司 | Intra-frame prediction and deblocking filtering method |
| CN104683820B (en) * | 2015-02-28 | 2018-03-06 | 华为技术有限公司 | A kind of loop circuit filtering method and loop filter |
| US9998739B2 (en) * | 2015-03-06 | 2018-06-12 | Qualcomm Incorporated | Optimization for encoding video data using non-square partitions |
| EP3289762A4 (en) | 2015-03-31 | 2018-12-19 | RealNetworks, Inc. | Residual transformation and inverse transformation in video coding systems and methods |
| US20170302965A1 (en) * | 2016-04-15 | 2017-10-19 | Google Inc. | Adaptive directional loop filter |
| TWI669942B (en) * | 2016-10-14 | 2019-08-21 | 聯發科技股份有限公司 | Method and apparatus of smoothing filter for ringing artefact removal |
| CN107172423B (en) * | 2017-03-31 | 2018-08-21 | 武汉斗鱼网络科技有限公司 | A kind of method and device that video frame is filtered |
| CN107809638B (en) * | 2017-11-09 | 2020-03-17 | 广东技术师范学院 | Filtering processing method and system based on camera image video mixed subject |
| CN107801024B (en) * | 2017-11-09 | 2019-07-12 | 北京大学深圳研究生院 | A kind of boundary filtering method for intra prediction |
| US11153607B2 (en) * | 2018-01-29 | 2021-10-19 | Mediatek Inc. | Length-adaptive deblocking filtering in video coding |
| KR102539110B1 (en) | 2018-03-28 | 2023-06-01 | 후아웨이 테크놀러지 컴퍼니 리미티드 | Image processing device and method for performing efficient deblocking |
| WO2019243498A1 (en) | 2018-06-21 | 2019-12-26 | Telefonaktiebolaget Lm Ericsson (Publ) | Deblocking of video picture boundaries |
| CN111355951B (en) * | 2018-12-24 | 2023-11-10 | 华为技术有限公司 | Video decoding method, device and decoding equipment |
| CN109889853A (en) * | 2019-02-26 | 2019-06-14 | 北京大学深圳研究生院 | A kind of block-eliminating effect filtering method, system, equipment and computer-readable medium |
| EP3930323A4 (en) * | 2019-03-07 | 2022-03-30 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Loop filter implementation method and apparatus, and computer storage medium |
| CN111698504B (en) * | 2019-03-11 | 2022-05-20 | 杭州海康威视数字技术股份有限公司 | Encoding method, decoding method and device |
| CN111770337B (en) * | 2019-03-30 | 2022-08-19 | 华为技术有限公司 | Video encoding method, video decoding method and related equipment |
| CN112449183B (en) * | 2019-09-03 | 2023-05-09 | 联咏科技股份有限公司 | Video encoder, video decoder, and video system |
| CN112136329A (en) * | 2019-09-24 | 2020-12-25 | 北京大学 | Video coding and decoding method and device |
| CN114615494A (en) * | 2020-12-04 | 2022-06-10 | 咪咕文化科技有限公司 | Image processing method, device and equipment |
| CN114584790B (en) * | 2022-01-21 | 2024-05-17 | 百果园技术(新加坡)有限公司 | Video brightness filtering method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1652610A (en) * | 2005-01-31 | 2005-08-10 | 浙江大学 | Deblocking filtering method and apparatus of video frequency or image |
| CN101841722A (en) * | 2010-06-08 | 2010-09-22 | 上海交通大学 | Detection device of filtering boundary strength and detection method thereof |
| CN102387366A (en) * | 2005-03-18 | 2012-03-21 | 夏普株式会社 | Methods and systems for extended spatial scalability with picture-level adaptation |
| CN102577377A (en) * | 2009-08-04 | 2012-07-11 | 三星电子株式会社 | Apparatus and method for deblocking filtering image data and video decoding apparatus and method using the same |
| CN102792692A (en) * | 2010-01-14 | 2012-11-21 | 三星电子株式会社 | Method and apparatus for encoding video by using deblocking filtering, and method and apparatus for decoding video by using deblocking filtering |
| CN102934429A (en) * | 2010-05-18 | 2013-02-13 | 索尼公司 | Image processor and image processing method |
| CN102948146A (en) * | 2010-04-13 | 2013-02-27 | 三星电子株式会社 | Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units |
| CN103004197A (en) * | 2010-04-23 | 2013-03-27 | 吴秀美 | Image encoding device and method |
-
2013
- 2013-04-15 CN CN201310128415.2A patent/CN103220529B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1652610A (en) * | 2005-01-31 | 2005-08-10 | 浙江大学 | Deblocking filtering method and apparatus of video frequency or image |
| CN102387366A (en) * | 2005-03-18 | 2012-03-21 | 夏普株式会社 | Methods and systems for extended spatial scalability with picture-level adaptation |
| CN102577377A (en) * | 2009-08-04 | 2012-07-11 | 三星电子株式会社 | Apparatus and method for deblocking filtering image data and video decoding apparatus and method using the same |
| CN102792692A (en) * | 2010-01-14 | 2012-11-21 | 三星电子株式会社 | Method and apparatus for encoding video by using deblocking filtering, and method and apparatus for decoding video by using deblocking filtering |
| CN102948146A (en) * | 2010-04-13 | 2013-02-27 | 三星电子株式会社 | Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units |
| CN103004197A (en) * | 2010-04-23 | 2013-03-27 | 吴秀美 | Image encoding device and method |
| CN102934429A (en) * | 2010-05-18 | 2013-02-13 | 索尼公司 | Image processor and image processing method |
| CN101841722A (en) * | 2010-06-08 | 2010-09-22 | 上海交通大学 | Detection device of filtering boundary strength and detection method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103220529A (en) | 2013-07-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103220529B (en) | A kind of implementation method of coding and decoding video loop filtering | |
| Fu et al. | Sample adaptive offset in the HEVC standard | |
| CN105981385B (en) | Intra-frame prediction coding method and device thereof | |
| KR20180113527A (en) | The geometric transforms for filters for video coding | |
| CN102984523B (en) | A kind of multidirectional infra-frame prediction decoding method and device | |
| CN106454359A (en) | Image processing device and image processing method | |
| CN104754361A (en) | Image encoding and decoding method and device | |
| US10834395B2 (en) | Method and a device for decoding an intra predicted block of a picture and corresponding coding method and coding device | |
| WO2012096623A1 (en) | Deblocking filtering | |
| US11812060B2 (en) | Method and device for deblocking filtering a boundary within an intra predicted block | |
| CN104662902A (en) | Restricted intra deblocking filtering for video coding | |
| EP3714599A1 (en) | Encoding and decoding methods and corresponding devices | |
| CN105306957A (en) | Adaptive loop filtering method and device | |
| CN103051892A (en) | Method and apparatus for in-loop filtering | |
| CN101453651B (en) | A deblocking filtering method and apparatus | |
| JP2022544159A (en) | Adaptive resolution management using subframes | |
| Lin et al. | Nr-cnn: Nested-residual guided cnn in-loop filtering for video coding | |
| CN114257810A (en) | Context model selection method, device, equipment and storage medium | |
| JP7321345B2 (en) | video encoding and decoding | |
| CN110249630B (en) | Deblocking filter apparatus, method and storage medium | |
| Kthiri et al. | A parallel hardware architecture of deblocking filter in H264/AVC | |
| JP7216811B2 (en) | video encoding and decoding | |
| WO2023197433A1 (en) | Video encoding method, apparatus and device, video decoding method, apparatus and device, video encoding and decoding system, and storage medium | |
| WO2021061748A1 (en) | Video compression with in-loop sub-image level controllable noise generation | |
| WO2024039803A1 (en) | Methods and devices for adaptive loop filter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |