CN103220529A - Method for achieving video coding and decoding loop filtering - Google Patents

Method for achieving video coding and decoding loop filtering Download PDF

Info

Publication number
CN103220529A
CN103220529A CN2013101284152A CN201310128415A CN103220529A CN 103220529 A CN103220529 A CN 103220529A CN 2013101284152 A CN2013101284152 A CN 2013101284152A CN 201310128415 A CN201310128415 A CN 201310128415A CN 103220529 A CN103220529 A CN 103220529A
Authority
CN
China
Prior art keywords
filtering
block
boundary
border
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013101284152A
Other languages
Chinese (zh)
Other versions
CN103220529B (en
Inventor
马思伟
贺坚强
高文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Original Assignee
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University filed Critical Peking University
Priority to CN201310128415.2A priority Critical patent/CN103220529B/en
Publication of CN103220529A publication Critical patent/CN103220529A/en
Application granted granted Critical
Publication of CN103220529B publication Critical patent/CN103220529B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention relates to the technical field of multi-media video coding and decoding, in particular to a method for achieving video coding and decoding loop filtering. The method for achieving the video coding and decoding loop filtering includes the following steps that a division structure of image blocks is obtained through division of information through a coding and decoding end block, the loop filtering is conducted on block borders, if the block borders comprise the borders of a coding block, a forecasting block and a transforming block, border-level filtering decision-making is conducted through a mode, motion information, quantization parameters and residues, pixel-level filter is conducted at last, and the filtering direction can be perpendicular to the borders or can form other angels with the borders according to partial pixel characteristics or block modes. The method for achieving the video coding and decoding loop filtering has the advantages of being capable of improving subjective and objective quality of video coding, improving coding efficiency by 0.9% on reference software RD2.0-ADI of an implementation example AVS2.0, and meanwhile reducing the amount of filtering borders and complexity of a coding and decoding end.

Description

A kind of implementation method of coding and decoding video loop filtering
Technical field
The present invention relates to multimedia video encoding and decoding technique field, relate in particular to a kind of method of loop filtering of coding and decoding video end.
Background technology
In current block-based hybrid encoding frame, video coding with the rate-distortion optimization (RDO) of each piece thus decision-making selects the optimization model of this piece to obtain the approximate of current encoded frame coding efficiency optimum.But in the video coding because considered the correlation of spatial domain and time domain, the optimum of current block can not guarantee the optimum of whole sequence coding efficiency like this, the influence of the subjective and objective quality that the optimum that some coding toolses such as loop filtering can improve this part brings to the overall situation.By improve present frame in when coding because the blocking effect that piecemeal brings has reduced subjective ringing effect and blocking effect, filtered frame will be as next code frame reference frame simultaneously, thereby improves the subjective and objective coding quality of subsequent frame.So the loop filtering technology has crucial status in video coding.
In existing announced video encoding standard, as its loop filtering H.264 is at the 4x4 block boundary, in AVS, then carry out on the 8x8 border, this is because in these standards, the size of transform block is fixed, and be not more than the size of coding unit piece (macro block) and prediction piece, so the border of transform block comprises coding unit piece and prediction block boundary certainly.Yet in efficient video coding standard and AVS standard A VS2.0 of future generation, (Coding Unit CU) is the elementary cell of video coding to coding unit.The employing four fork recurrence partition modes of coding unit, the coding unit maximum can reach 64x64(as shown in Figure 1), and no longer be 16x16.In each coding unit, carry out block encoding by coding toolses such as prediction, change quantization, entropy coding, reprocessings.Wherein coding unit is when giving a forecast, and coding unit can be divided into different big or small predicting unit, and (Prediction Unit, PU), predicting unit is the elementary cell of prediction.In the coding unit division of infra-frame prediction and inter prediction unit respectively as shown in Figures 2 and 3, the size of prediction piece until 8x8, even also comprises asymmetric prediction piece (AMP) from 64x64,64x32,32x64,32x32.The size of transform block no longer is fixed as 4x4 or 8x8 simultaneously, and relevant with the size of CU, and the size of transform block comprises from 32x32,16x16 to 8x8 like this.Original so all 4x4 or the 8x8 border of being fixed on carried out the mode of filtering and will no longer be met the purpose of loop filtering deblocking effect.
Summary of the invention
The embodiment of the invention provides a kind of loop filtering technology, Apparatus and system, to reduce blocking effect, improves subjective and objective encoded video quality and code efficiency, reduces coding and decoding end complexity simultaneously.
For achieving the above object, the invention provides a kind of implementation method scheme of coding and decoding video loop filtering, the specific implementation step comprises:
Described loop circuit filtering method comprises the steps:
Step 1) utilizes encoding and decoding end block division information to obtain image block (comprising encoding block, prediction piece and transform block) partition structure, loop filtering then carries out on piece (as encoding block, prediction piece and transform block) border, if the coded residual of encoding block is that 0(is CBP=0), then only carry out filtering at encoding block and prediction block boundary; The filtering flow process is a predefine filtering block, is image division filtering cutting unit piece (as the 16x16 block size, also can be maximum coding unit piece or picture frame etc.), can predefine or in code stream the size of explanation filtering block, for the design of uniform filtering device, filter sequence is for carrying out each filtering block successively, horizontal boundary behind elder generation's vertical boundary promptly earlier carries out filtering to all vertical boundaries in the filtering block and again horizontal boundary is carried out filtering; The minimum filter unit (as the 8x8 block size) of while predefine, yardstick is skipped filtering less than the block boundary of minimum filter unit;
Step 2) if the border comprises encoding block, prediction piece and transform blocks boundaries, then utilize pattern, movable information, quantization parameter and residual error etc. to carry out boundary levels filtering decision-making,
2.1, if the decision-making need this border of filtering, then carry out ensuing Pixel-level filtering;
2.2 otherwise skip this boundary filtering; The block boundary place that needs is carried out filtering carries out Pixel-level filtering decision-making to determine whether each pixel column needs the filtering strength of filtering and employing (BS);
Step 3) is carried out Pixel-level filtering at last, and the filtering direction can also can become other angles according to local pixel characteristic or block mode perpendicular to the border with the border, wherein participate in the block structure of image filtering, includes but not limited to encoding block, prediction piece and transform block; The filtering block is for making things convenient for operations such as filtering, and image is unified the dividing mode of size, as dividing according to 16x16 size filtering block image.
Described step 1) also comprises: the border that loop filtering takes place is on piece (as encoding block, prediction piece and transform block) border, when the coded residual of encoding block is zero (being CBP=0), then only carry out filtering, define the minimum dimension such as the 8x8 block size of filtering simultaneously at encoding block and prediction block boundary.For example for AVS2 embodiment, the size of encoding block has comprised from 64x64 to the 8x8 size, selects according to RDO, adopts the quaternary tree iterative recursive to divide, and is the elementary cell of encoding process; The prediction piece be on the basis of encoding block further according to the further division of prediction characteristic; Transform block also is according to the further division of the distribution character of residual error on the basis of encoding block.
Described step 1) also comprises: be divided into filtering cutting unit piece (as 16x16 size or maximum coding unit piece) for whole two field picture, can predefine or in code stream the size of explanation filtering block, successively each filtering block is carried out filtering according to scanning, earlier to vertical boundary, at horizontal boundary, whether detection boundaries comprises encoding block, prediction piece and transform blocks boundaries, if comprise, this border of filtering then, otherwise skip this border of filtering.
Described step 2) also comprises: decide the whether needs filtering of current block border according to pattern, movable information, quantization parameter and the residual error etc. of filtering boundary both sides piece, if the boundary levels decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering, if block boundary both sides piece P and Q have intra prediction mode, then need to carry out filtering; If P, Q piece are the inter prediction piece of P frame, its residual error is 0, and identical and each component of motion vector of reference frame is less than a pixel, and this block boundary of then making a strategic decision does not need filtering, otherwise all needs filtering.
Described step 2) also comprise: filtering decision-making needs the every capable pixel of block boundary of filtering, utilizes the saltus step of both sides, border pixel and the pairing threshold value table respective value comparison of index that the average QP value of piece obtains, selects filtering strength; Pixel-level filtering strength span 0-4, BS=0 do not need to represent filtering, and BS=4 represents comparatively flat site, need carry out stronger smothing filtering.
Described step 3) also comprises: locations of pixels is selected corresponding FIR filter, and the filtering direction can also can become other angles according to local pixel characteristic or block mode perpendicular to the border with the border; The pairing FIR filter of different filtering strengths and different pixels position uses; Can utilize simultaneously the texture features of topography and the pattern information of both sides, border piece to determine the mode of filtering to be perpendicular to border or angled with the border
Technique effect of the present invention is: this programme can effectively improve the subjective and objective quality of video coding, on AVS2.0 embodiment reference software RD2.0-ADI, this programme and device can improve 0.9% code efficiency, can reduce encoding and decoding end filtering boundary number and complexity simultaneously.
Description of drawings
When considered in conjunction with the accompanying drawings, by the reference following detailed, can more completely understand the present invention better and learn wherein many attendant advantages easily, but accompanying drawing described herein is used to provide further understanding of the present invention, constitute a part of the present invention, illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute to improper qualification of the present invention, wherein:
Fig. 1 is that AVS2 prior art coding unit is divided schematic diagram;
Fig. 2 is an AVS2 prior art transform block dividing elements schematic diagram;
Fig. 3 divides schematic diagram for AVS2 prior art prediction module unit;
Fig. 4 is that AVS1 adopts for dotted line, and all are comprised that the 8x8 transform blocks boundaries carries out filtering, and then this programme only carries out filtering on solid line (encoding block, prediction piece and transform block) border;
Fig. 5 participates in the pixel of filtering for the filtering boundary place;
Fig. 6 is the interior filter sequence of filtering block (get 16x16 and be of a size of example), first vertical boundary, back horizontal boundary;
A kind of filtering example flow chart that Fig. 7 supports for the present invention;
Fig. 8 is a block boundary pixel filter flow chart of the present invention.
Embodiment
Coding side
As shown in Figure 1 to Figure 3, embodiment of the invention AVS2, at coding side, finish the coding of prediction, change quantization and entropy coding and pattern information when a two field picture after, can obtain the reconstructed frame of encoding through after the inverse quantization inverse transformation again.Utilizing the pattern information of encoding and decoding end and the dividing mode that piece carve information piece obtains current restructuring graph picture frame, the minimum filter unit of present frame is set, is the filtering block with image division.Frame level filtering flow process is to each filtering block, according to flow process shown in Figure 7, earlier to all vertical boundaries in the filtering block, whether be encoding block, prediction piece or transform blocks boundaries, if then utilize pattern, movable information, quantization parameter and residual error etc. to carry out boundary levels filtering decision-making if detecting it successively.If boundary levels filtering decision-making needs this vertical boundary of filtering, then this vertical boundary to be made a strategic decision and Pixel-level filtering according to execution Pixel-level filtering strength shown in Figure 8, concrete filtering strength BS decision process and the filtering under the different B S are as previously mentioned.After executing all the vertical boundary filtering in the filtering block, similar again mode executive level boundary filtering.Behind the intact filtering block of filtering, judge whether that filtering finishes a frame, if do not have, then prepare the filtering of next filtering block according to the scanning sequency of setting, repetitive cycling is until having traveled through the whole filtering blocks of present frame.
Decoding end
For decoding end, also be successively to each filtering block, add that through predictive compensation thereby residual error after the inverse quantization inverse transformation obtains the decoding and reconstituting piece and carries out filtering decision-making and the filtering that similar coding side carries out and obtain the filtered image of decoding end reconstructed image, be used for showing, store or offer other frame references.
Embodiment of the invention said method, Apparatus and system technical scheme have following beneficial effect: this patent has proposed a cover loop filtering technique.When loop filtering is carried out in encoding and decoding, by utilizing encoding and decoding end block division information to obtain image block (comprising encoding block, prediction piece and transform block) partition structure, loop filtering then carries out on piece (as encoding block, prediction piece and transform block) border, if the coded residual of encoding block is zero (being CBP=0), then only carry out filtering at encoding block and prediction block boundary; The filtering flow process is a predefine filtering block, is image division filtering cutting unit piece (as the 16x16 block size, also can be maximum coding unit piece or picture frame etc.), can predefine or in code stream the size of explanation filtering block, for the design of uniform filtering device, filter sequence is for carrying out each filtering block successively, horizontal boundary behind elder generation's vertical boundary promptly earlier carries out filtering to all vertical boundaries in the filtering block and again horizontal boundary is carried out filtering; The minimum filter unit of while predefine, yardstick is skipped filtering less than the block boundary of minimum filter unit; If the border comprises encoding block, prediction piece and transform blocks boundaries, then utilize pattern, movable information, quantization parameter and residual error etc. to carry out boundary levels filtering decision-making, if decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering; Needs are carried out the block boundary place threshold value (shown in subordinate list 1) and the pixel local grain feature of filtering and carry out Pixel-level filtering decision-making to determine whether each pixel column needs the filtering strength of filtering and employing (BS); Utilize filter (shown in subordinate list 2 or the subordinate list 3) design to carry out Pixel-level filtering at last, the filtering direction can also can become other angles according to local pixel characteristic or block mode perpendicular to the border with the border, thereby can better self adaptation remove blocking effect and improve code efficiency.This programme is on AVS2.0 embodiment RD2.0, and this programme and device can improve 0.9% code efficiency, can reduce encoding and decoding end filtering boundary number and complexity simultaneously.
Experimental result:
The embodiment of the invention is in the reference software of RD2.0(AVS2 standard) on finish technology and realize.In experiment, adopt the universal test condition of AVS2, the RA configuration.Experiment porch is Intel (R) Xeon (R) CPU X56602.80GHZ2.79GHZ23.9G internal memory.The loop circuit filtering method among the present invention is adopted in table 2 expression, compares anchor(AVS2RD2.0-ADI) in loop circuit filtering method performance relatively.4kx2k, 1080p, WVGA, WQVGA, 720p represent that respectively resolution is the cycle tests of 3840x2160,1920x1080,832x480,416x240,1280x720.The tolerance of coding efficiency adopts BD-rate, and promptly the code check under the situation of same-code quality is saved.From experimental result, adopt embodiment of the invention such scheme, when the same-code quality, obtain average 0.9% code check saving.
Table 2. performance is (the Design of Filter vs RD2-ADI of proposition) relatively
Figure BDA00003047463600081
When loop filtering is carried out in encoding and decoding, by utilizing encoding and decoding end block division information to obtain image block (comprising encoding block, prediction piece and transform block) partition structure, loop filtering then carries out on piece (as encoding block, prediction piece and transform block) border, if the coded residual of encoding block is that 0(is CBP=0), then only carry out filtering at encoding block and prediction block boundary; The filtering flow process is a predefine filtering block, is image division filtering cutting unit piece (as 16x16 block size, maximum coding unit block size or picture frame), can predefine or in code stream the size of explanation filtering block, for the design of uniform filtering device, filter sequence is for carrying out each filtering block successively, horizontal boundary behind elder generation's vertical boundary promptly earlier carries out filtering to all vertical boundaries in the filtering block and again horizontal boundary is carried out filtering; If the border comprises encoding block, prediction piece and transform blocks boundaries, then utilize pattern, movable information, quantization parameter and residual error etc. to carry out boundary levels filtering decision-making, if decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering; The block boundary place that needs is carried out filtering utilizes threshold value and pixel local grain feature to carry out Pixel-level filtering decision-making to determine whether each pixel column needs the filtering strength of filtering and employing (BS); Utilize the filter of design to carry out Pixel-level filtering at last, the filtering direction can also can become other angles according to local pixel characteristic or block mode perpendicular to the border with the border.
When the block boundary loop filtering was carried out in encoding and decoding, described method comprised when encoding and decoding are carried out loop filtering after obtaining reconstructed image that a kind of its step of filtering flow process that has provided patent support of the present invention as Fig. 7 is as follows:
1. initialization: utilizing the pattern information of encoding and decoding end and the piece dividing mode that piece carve information piece obtains current restructuring graph picture frame, the minimum filter unit of present frame is set, is the filtering block with image division, and initial filtering block sequence number N=0 is set.
2. successively each filtering block N in the image is carried out boundary filtering according to scanning sequency
2.1. whether earlier to all vertical boundaries of filtering block, detecting it successively is encoding block, prediction piece or transform blocks boundaries, whether if CBP=0, then detecting is encoding block, prediction block boundary; Carry out boundary levels filtering decision-making if then utilize pattern, movable information, quantization parameter and residual error etc.
2.2.,, then this vertical boundary is carried out decision-making of Pixel-level filtering strength and Pixel-level filtering if boundary levels filtering decision-making needs this vertical boundary of filtering to all vertical boundaries.
2.3. whether again to all horizontal boundaries of filtering block, detecting it successively is encoding block, prediction piece or transform blocks boundaries, whether if CBP=0, then detecting is encoding block, prediction block boundary; Carry out boundary levels filtering decision-making if then utilize pattern, movable information, quantization parameter and residual error etc.
2.4.,, then this horizontal boundary is carried out decision-making of Pixel-level filtering strength and Pixel-level filtering if boundary levels filtering decision-making needs this horizontal boundary of filtering to all horizontal boundaries.
Finish 2.5. judge whether whole frame filtering, if the filtering that next filtering block is carried out in 2.1 continuation is jumped in not then filtering block sequence number N increase.
3. whole frame filtering finishes
Filtering block size (only illustrates here for 16x16, concrete size can preset value or is illustrated in code stream), minimum filter unit is 8x8 piece (as shown in Figure 6), need utilize the boundary pixel jump to carry out the FIR filter (shown in subordinate list 2 or subordinate list 3) that Pixel-level filtering strength (BS) is made a strategic decision and selected different pixels position under the different filtering strengths with alpha beta and the local saltus step feature of pixel in the threshold value table.For the filtering of a concrete block boundary as shown in Figure 8.
The filtering strength decision process is specific as follows:
If abs (p0 – q0)<Alpha﹠﹠abs (p0 – q0)〉1, then carry out following step; Otherwise, Bs=0.
Set left and right sides flatness variable FL and FR, and both initial values all are made as 0.
If abs (p0 – p1)<Beta, then FL+=2;
If abs (p0 – p2)<Beta, then FL++;
If abs (q0 – q1)<Beta, then FR+=2;
If abs (q0 – q2)<Beta, then FR++;
Left and right sides flatness sum FS=FL+FR.
According to the value of FS, do as judging:
When FS=6, if p0=p1, and q0=q1, then boundary intensity Bs=4.Otherwise Bs=3;
When FS=5, if p0=p1, and q0=q1, then boundary intensity Bs=3.Otherwise Bs=2;
When FS=4, if FL=2, then Bs=2.Otherwise, Bs=1.
When FS=3, and abs (p1 – q1)<Beta, then Bs=1.Otherwise, Bs=0.
When FS is worth for other, Bs=0.
According to the coding situation intensity that revises the boundary
If encode according to frame pattern, and chromatic component is carried out filtering, Bs subtracts 1:
If encode according to field mode, and satisfy one of following condition, Bs subtracts 1:
Luminance component is carried out filtering in vertical direction;
Chromatic component is carried out filtering;
As BS〉0 the time, carry out the Pixel-level filtering of pixel column, filter adopts shown in the subordinate list 2:
The boundary filtering process that Bs equals at 4 o'clock
The value of boundary filtering strength Bs is 4 o'clock, to the computational process following (P0, P1, P2 and Q0, Q1, Q2 are filtered values) of p0, p1, p2, p3 and q0, q1, q2, q3 filtering:
P0=((p0<<3)+p0+(p2<<2)+p2+(p1<<2)+(q0<<3)-q0+(q1<<2)+(q2<<1)+q2+16)>>5
P1=((p0<<2)+(p0<<1)+(p1<<1)+p1+(p2<<2)+q0+(q0<<1)+8)>>4
P2=(p0+(p1<<1)+p2+(p2<<1)+p3+q0+4)>>3
Q0=((q0<<3)+q0+(q2<<2)+q2+(q1<<2)+(p0<<3)-p0+(p1<<2)+(p2<<1)+p2+16)>>5Q1=((q0<<2)+(q0<<1)+(q1<<1)+q1+(q2<<2)+p0+(p0<<1)+8)>>4
Q2=(q0+(q1<<1)+q2+(q2<<1)+q3+p0+4)>>3
The boundary filtering process that Bs equals at 3 o'clock
The value of boundary filtering strength Bs is 3 o'clock, to the computational process following (P0, P1 and Q0, Q1 are filtered values) of p0, p1 and q0, q1 filtering:
P0=(p2+(p1<<2)+(p0<<2)+(p0<<1)+(q0<<2)+q1+8)>>4
Q0=(p1+(p0<<2)+(q0<<2)+(q0<<1)+(q1<<2)+q2+8)>>4
P1=((p2<<1)+p2+(p1<<3)+(p0<<2)+q0+8)>>4
Q1=((q2<<1)+q2+(q1<<3)+(q0<<2)+p0+8)>>4
The boundary filtering process that Bs equals at 2 o'clock
The value of boundary filtering strength Bs is 2 o'clock, to the computational process following (P0 and Q0 are filtered values) of p0 and q0 filtering:
P0=((p1<<1)+p1+(p0<<3)+(p0<<1)+(q0<<1)+q0+8)>>4
Q0=((p0<<1)+p0+(q0<<3)+(q0<<1)+(q1<<1)+q1+8)>>4
The boundary filtering process that Bs equals at 1 o'clock
The value of boundary filtering strength Bs is 1 o'clock, to the computational process following (P0 and Q0 are filtered values) of p0 and q0 filtering:
P0=((p0<<1)+p0+q0+2)>>2
Q0=((q0<<1)+q0+p0+2)>>2
The present invention compares with method in the existing AVS standard owing to adopted technique scheme, has following innovation and beneficial effect:
The first, obtain image block (comprising encoding block, prediction piece and transform block) partition structure by reusing encoding and decoding end block division information, loop filtering then carries out in encoding block, prediction piece and transform blocks boundaries, if the CBP=0 of encoding block then only carries out filtering at encoding block and prediction block boundary.Can improve code efficiency like this, and reduced the border number of filtering, thereby reduced coding and decoding end complexity, the original filters solutions of Fig. 4 dotted line demonstration AVS1 is carried out filtering in all 8x8 transform blocks boundaries, solid line is represented actual encoding block, the dividing mode of prediction piece and transform block, this programme only need be in the filtering of solid line place, thereby the number of boundary of filtering significantly reduces, for example to the piece of 32x32, in all 8x8 block boundary filtering, then the filtering boundary number is 32 8 pixel boundaries, only then only need save 4 times 88 pixel boundary filtering in block boundary filtering.Need filtering boundary number and piece size relation as shown in table 1.So in high-resolution video, select probability more for a long time when bulk, adopting this method significantly to reduce needs the filtering boundary number, thereby reduce encoding and decoding end complexity.
Table 1. needs the filtering boundary number to save and piece size relation
The piece size Filtering boundary limit number is saved
64x64 8 times
32x32 4 times
16x16 2 times
8x8
1 times
The second, this programme preset value filtering block is (as 16x16 block size, maximum coding unit block size or picture frame, can in code stream, illustrate), before filtering, at first image is divided according to the filtering block, then according to scanning sequency successively to the order filtering of horizontal boundary behind each filtering block elder generation vertical boundary, like this can convenient and the design of uniform filtering device, raising adaptivity and the design complexities that reduces hardware circuit.
Three, the present invention program's new filtering threshold coefficient table uses shown in the subordinate list 2 as subordinate list 1 and filter, the direction of filtering simultaneously can be chosen according to pattern information and block boundary topography feature, and no longer be fixed as vertical block boundary, can better improve code efficiency and subjective quality.
Those skilled in the art can also recognize the various illustrative components, blocks (illustrative logical block) that the embodiment of the invention is listed, and unit and step can be passed through electronic hardware, computer software, or both combinations realize.Be the clear replaceability (interchangeability) of showing hardware and software, above-mentioned various illustrative components (illustrativecomponents), unit and step have been described their function generally.Such function is to realize depending on the specific application and the designing requirement of whole system by hardware or software.Those skilled in the art can be for every kind of specific application, and can make ins all sorts of ways realizes described function, but this realization should not be understood that to exceed the scope of embodiment of the invention protection.
Various illustrative logical block described in the embodiment of the invention, or the unit can pass through general processor, digital signal processor, application-specific integrated circuit (ASIC) (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the design of above-mentioned any combination realizes or operates described function.General processor can be microprocessor, and alternatively, this general processor also can be any traditional processor, controller, microcontroller or state machine.Processor also can realize by the combination of calculation element, for example digital signal processor and microprocessor, a plurality of microprocessors, Digital Signal Processor Core of one or more microprocessors associatings, or any other similarly configuration realize.
The method described in the embodiment of the invention or the step of algorithm can directly embed hardware, the software module of processor execution or the two combination.Software module can be stored in the storage medium of other arbitrary form in RAM memory, flash memory, ROM memory, eprom memory, eeprom memory, register, hard disk, moveable magnetic disc, CD-ROM or this area.Exemplarily, storage medium can be connected with processor, so that processor can read information from storage medium, and can deposit write information to storage medium.Alternatively, storage medium can also be integrated in the processor.Processor and storage medium can be arranged among the ASIC, and ASIC can be arranged in the user terminal.Alternatively, processor and storage medium also can be arranged in the different parts in the user terminal.
In one or more exemplary designs, the described above-mentioned functions of the embodiment of the invention can realize in hardware, software, firmware or this three's combination in any.If realize in software, these functions can be stored on the media with computer-readable, or are transmitted on the media of computer-readable with one or more instructions or code form.The computer-readable media comprises the computer storage medium and is convenient to make allows computer program transfer to other local communication medium from a place.Storage medium can be the useable medium that any general or special computer can access.For example, such computer readable media can include but not limited to RAM, ROM, EEPROM, CD-ROM or other optical disc storage, disk storage or other magnetic storage device, or other anyly can be used to carry or store the media that can be read the program code of form with instruction or data structure and other by general or special computer or general or special processor.In addition, any connection can suitably be defined as the computer-readable media, for example, if software is by a coaxial cable, optical fiber computer, twisted-pair feeder, Digital Subscriber Line (DSL) or also being comprised in the defined computer-readable media with wireless mode transmission such as for example infrared, wireless and microwaves from a web-site, server or other remote resource.Described video disc (disk) and disk (disc) comprise Zip disk, radium-shine dish, CD, DVD, floppy disk and Blu-ray Disc, and disk is usually with the magnetic duplication data, and video disc carries out the optical reproduction data with laser usually.Above-mentioned combination also can be included in the computer-readable media.
The relation of subordinate list 1 block boundary threshold alpha of the present invention and β and Index
The filter parameter design that subordinate list 2. the present invention use
? ? L3 L2 L1 L0 R0 R1 R2 R3
BS=4 L0 ? 5 4 9 7 4 3 ?
? L1 ? 4 3 6 3 ? ? ?
? L2 1 3 2 1 1 ? ? ?
BS=3 L0 ? 1 4 6 4 1 ? ?
? L1 ? 3 8 4 1 ? ? ?
BS=2 L0 ? ? 3 10 3 ? ? ?
BS=1 L0 ? ? ? 3 1 ? ? ?
The original filter parameter design of subordinate list 3.AVS
? ? L3 L2 L1 L0 R0 R1 R2 R3
BS=4 L0 ? 9 ? 9 8 ? 6 ?
? L1 ? 6 ? 7 3 ? ? ?
? L2 ? 3 ? 4 1 ? ? ?
BS=3 L0 ? 1 4 6 4 1 ? ?
? L1 ? 3 8 4 1 ? ? ?
BS=2 L0 ? ? 3 10 3 ? ? ?
BS=1 L0 ? ? ? 3 1 ? ? ?
Used specific embodiment herein principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, part in specific embodiments and applications all can change.In sum, this description should not be construed as limitation of the present invention.

Claims (7)

1. the method for the loop filtering of a coding and decoding video end is characterized in that:
Described loop circuit filtering method comprises the steps:
Step 1) utilizes encoding and decoding end block division information to obtain the image block partition structure, and loop filtering then carries out on described image block border, if the coded residual of encoding block is 0, (being CBP=0) then only carries out filtering at encoding block and prediction block boundary; The filtering flow process is a predefine filtering block, is image division filtering cutting unit piece, can predefine or in code stream the size of explanation filtering block, for the design of uniform filtering device, filter sequence is for carrying out each filtering block successively, horizontal boundary behind elder generation's vertical boundary promptly earlier carries out filtering to all vertical boundaries in the filtering block and again horizontal boundary is carried out filtering;
Step 2) if the border comprises encoding block, prediction piece and transform blocks boundaries, then utilize pattern, movable information, quantization parameter and residual error etc. to carry out boundary levels filtering decision-making,
2.1, if the decision-making need this border of filtering, then carry out ensuing Pixel-level filtering;
2.2 otherwise skip this boundary filtering; The block boundary place that needs is carried out filtering carries out Pixel-level filtering decision-making to determine whether each pixel column needs the filtering strength of filtering and employing (BS);
Step 3) is carried out Pixel-level filtering at last, and the filtering direction can also can become other angles according to local pixel characteristic or block mode perpendicular to the border with the border, wherein participate in the block structure of image filtering, includes but not limited to encoding block, prediction piece and transform block; The filtering block is for making things convenient for operations such as filtering, and image is unified the dividing mode of size, as dividing according to 16x16 size filtering block image.
2. the method for the loop filtering of a kind of coding and decoding video end according to claim 1 is characterized in that, described step 1) also comprises: image block comprises encoding block, prediction piece and transform block.
3. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 1) also comprises: the border that loop filtering takes place is on described image block border, when the coded residual of encoding block is zero (CBP=0), then only carry out filtering, define the minimum dimension (as the 8x8 block size) of filtering simultaneously at encoding block and prediction block boundary; The size of encoding block has comprised from 64x64 to the 8x8 size, selects according to RDO, adopts the quaternary tree iterative recursive to divide, and is the elementary cell of encoding process; The prediction piece be on the basis of encoding block further according to the further division of prediction characteristic; Transform block also is according to the further division of the distribution character of residual error on the basis of encoding block.
4. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 1) also comprises: be divided into filtering cutting unit piece for whole two field picture, can predefine or in code stream the size of explanation filtering block, successively each filtering block is carried out filtering according to scanning, earlier to vertical boundary, horizontal boundary again, whether detection boundaries comprises encoding block, prediction piece and transform blocks boundaries, if comprise, this border of filtering then, otherwise skip this border of filtering.
5. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 2) also comprises: decide the whether needs filtering of current block border according to pattern, movable information, quantization parameter and the residual error etc. of filtering boundary both sides piece, if the boundary levels decision-making needs this border of filtering, then carry out ensuing Pixel-level filtering, otherwise skip this boundary filtering,, then need to carry out filtering if block boundary both sides piece P and Q have intra prediction mode; If P, Q piece are the inter prediction piece of P frame, its residual error is 0, and identical and each component of motion vector of reference frame is less than a pixel, and this block boundary of then making a strategic decision does not need filtering, otherwise all needs filtering.
6. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 2) also comprise: the filtering decision-making needs the every capable pixel of block boundary of filtering, utilize saltus step and two pairing threshold value table respective value comparisons of index that the average QP value of piece obtains of both sides, border pixel, select filtering strength; Pixel-level filtering strength span 0-4, BS=0 do not need to represent filtering, and BS=4 represents comparatively flat site, need carry out stronger smothing filtering.
7. the method for the loop filtering of a kind of coding and decoding video end according to claim 1, it is characterized in that, described step 3) also comprises: locations of pixels is selected corresponding FIR filter, and the filtering direction can also can become other angles according to local pixel characteristic or block mode perpendicular to the border with the border; The pairing FIR filter of different filtering strengths and different pixels position uses; Can utilize simultaneously the texture features of topography and the pattern information of both sides, border piece to determine the mode of filtering to be perpendicular to border or angled with the border.
CN201310128415.2A 2013-04-15 2013-04-15 A kind of implementation method of coding and decoding video loop filtering Active CN103220529B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310128415.2A CN103220529B (en) 2013-04-15 2013-04-15 A kind of implementation method of coding and decoding video loop filtering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310128415.2A CN103220529B (en) 2013-04-15 2013-04-15 A kind of implementation method of coding and decoding video loop filtering

Publications (2)

Publication Number Publication Date
CN103220529A true CN103220529A (en) 2013-07-24
CN103220529B CN103220529B (en) 2016-02-24

Family

ID=48817933

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310128415.2A Active CN103220529B (en) 2013-04-15 2013-04-15 A kind of implementation method of coding and decoding video loop filtering

Country Status (1)

Country Link
CN (1) CN103220529B (en)

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104113765A (en) * 2014-07-28 2014-10-22 北京大学深圳研究生院 Video coding and decoding method and device
CN104683820A (en) * 2015-02-28 2015-06-03 华为技术有限公司 Loop filtering method and loop filter
CN104754363A (en) * 2013-12-31 2015-07-01 展讯通信(上海)有限公司 Loop filtering method and device for high efficiency video coding, coder and decoder
WO2016015198A1 (en) * 2014-07-28 2016-02-04 北京大学深圳研究生院 Video coding/decoding method and apparatus
CN105791865A (en) * 2014-12-22 2016-07-20 江苏省电力公司南京供电公司 Intra-frame prediction and deblocking filtering method
CN103888764B (en) * 2014-03-14 2017-02-15 西安交通大学 Self-adaptation compensation system and method for video compression distortion
CN107258081A (en) * 2015-03-06 2017-10-17 高通股份有限公司 To the optimization using non-square partition encoding video data
CN107302700A (en) * 2016-04-15 2017-10-27 谷歌公司 Adaptive direction loop filter
CN107637078A (en) * 2015-03-31 2018-01-26 瑞尔数码有限公司 Real transform and transformation by reciprocal direction in video decoding system and method
CN107801024A (en) * 2017-11-09 2018-03-13 北京大学深圳研究生院 A kind of boundary filtering method for infra-frame prediction
CN107809638A (en) * 2017-11-09 2018-03-16 广东技术师范学院 Filter processing method and system based on camera image video mix subject matter
WO2018068744A1 (en) * 2016-10-14 2018-04-19 Mediatek Inc. Method and apparatus of smoothing filter for ringing artefact removal
WO2018177395A1 (en) * 2017-03-31 2018-10-04 武汉斗鱼网络科技有限公司 Method and apparatus for filtering video frames
CN109889853A (en) * 2019-02-26 2019-06-14 北京大学深圳研究生院 A kind of block-eliminating effect filtering method, system, equipment and computer-readable medium
CN110267036A (en) * 2019-03-11 2019-09-20 杭州海康威视数字技术股份有限公司 A kind of filtering method and equipment
CN111355951A (en) * 2018-12-24 2020-06-30 华为技术有限公司 Video decoding method, device and decoding equipment
CN111630857A (en) * 2018-01-29 2020-09-04 联发科技股份有限公司 Length adaptive deblocking filtering in video coding and decoding
WO2020177133A1 (en) * 2019-03-07 2020-09-10 Oppo广东移动通信有限公司 Loop filter implementation method and apparatus, and computer storage medium
CN111770337A (en) * 2019-03-30 2020-10-13 华为技术有限公司 Video encoding method, video decoding method and related equipment
CN111819847A (en) * 2018-06-21 2020-10-23 瑞典爱立信有限公司 Deblocking of video picture boundaries
CN112136329A (en) * 2019-09-24 2020-12-25 北京大学 Video coding and decoding method and device
CN112449183A (en) * 2019-09-03 2021-03-05 联咏科技股份有限公司 Video encoder, video decoder and video system
CN112822498A (en) * 2018-03-28 2021-05-18 华为技术有限公司 Image processing apparatus and method of performing efficient deblocking
CN114584790A (en) * 2022-01-21 2022-06-03 百果园技术(新加坡)有限公司 Video brightness filtering method, device, equipment and storage medium
CN114615494A (en) * 2020-12-04 2022-06-10 咪咕文化科技有限公司 Image processing method, device and equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1652610A (en) * 2005-01-31 2005-08-10 浙江大学 Deblocking filtering method and apparatus of video frequency or image
CN101841722A (en) * 2010-06-08 2010-09-22 上海交通大学 Detection device of filtering boundary strength and detection method thereof
CN102387366A (en) * 2005-03-18 2012-03-21 夏普株式会社 Methods and systems for extended spatial scalability with picture-level adaptation
CN102577377A (en) * 2009-08-04 2012-07-11 三星电子株式会社 Apparatus and method for deblocking filtering image data and video decoding apparatus and method using the same
CN102792692A (en) * 2010-01-14 2012-11-21 三星电子株式会社 Method and apparatus for encoding video by using deblocking filtering, and method and apparatus for decoding video by using deblocking filtering
CN102934429A (en) * 2010-05-18 2013-02-13 索尼公司 Image processor and image processing method
CN102948146A (en) * 2010-04-13 2013-02-27 三星电子株式会社 Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units
CN103004197A (en) * 2010-04-23 2013-03-27 吴秀美 Image encoding device and method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1652610A (en) * 2005-01-31 2005-08-10 浙江大学 Deblocking filtering method and apparatus of video frequency or image
CN102387366A (en) * 2005-03-18 2012-03-21 夏普株式会社 Methods and systems for extended spatial scalability with picture-level adaptation
CN102577377A (en) * 2009-08-04 2012-07-11 三星电子株式会社 Apparatus and method for deblocking filtering image data and video decoding apparatus and method using the same
CN102792692A (en) * 2010-01-14 2012-11-21 三星电子株式会社 Method and apparatus for encoding video by using deblocking filtering, and method and apparatus for decoding video by using deblocking filtering
CN102948146A (en) * 2010-04-13 2013-02-27 三星电子株式会社 Video encoding method and video encoding apparatus and video decoding method and video decoding apparatus, which perform deblocking filtering based on tree-structure encoding units
CN103004197A (en) * 2010-04-23 2013-03-27 吴秀美 Image encoding device and method
CN102934429A (en) * 2010-05-18 2013-02-13 索尼公司 Image processor and image processing method
CN101841722A (en) * 2010-06-08 2010-09-22 上海交通大学 Detection device of filtering boundary strength and detection method thereof

Cited By (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754363A (en) * 2013-12-31 2015-07-01 展讯通信(上海)有限公司 Loop filtering method and device for high efficiency video coding, coder and decoder
CN104754363B (en) * 2013-12-31 2017-08-08 展讯通信(上海)有限公司 Loop circuit filtering method and device, encoder and decoder for HEVC
CN103888764B (en) * 2014-03-14 2017-02-15 西安交通大学 Self-adaptation compensation system and method for video compression distortion
US9706209B2 (en) 2014-03-14 2017-07-11 Xi'an Jiaotong University System and method for adaptively compensating distortion caused by video compression
WO2016015198A1 (en) * 2014-07-28 2016-02-04 北京大学深圳研究生院 Video coding/decoding method and apparatus
CN104113765A (en) * 2014-07-28 2014-10-22 北京大学深圳研究生院 Video coding and decoding method and device
CN105791865B (en) * 2014-12-22 2020-01-17 江苏省电力公司南京供电公司 Intra-frame prediction and deblocking filtering method
CN105791865A (en) * 2014-12-22 2016-07-20 江苏省电力公司南京供电公司 Intra-frame prediction and deblocking filtering method
CN104683820A (en) * 2015-02-28 2015-06-03 华为技术有限公司 Loop filtering method and loop filter
CN104683820B (en) * 2015-02-28 2018-03-06 华为技术有限公司 A kind of loop circuit filtering method and loop filter
CN107258081A (en) * 2015-03-06 2017-10-17 高通股份有限公司 To the optimization using non-square partition encoding video data
CN107258081B (en) * 2015-03-06 2020-07-03 高通股份有限公司 Optimization of video data encoded using non-square partitions
CN107637078B (en) * 2015-03-31 2020-05-26 瑞尔数码有限公司 Video coding system and method for integer transform coefficients
US10531086B2 (en) 2015-03-31 2020-01-07 Realnetworks, Inc. Residual transformation and inverse transformation in video coding systems and methods
CN107637078A (en) * 2015-03-31 2018-01-26 瑞尔数码有限公司 Real transform and transformation by reciprocal direction in video decoding system and method
CN107302700A (en) * 2016-04-15 2017-10-27 谷歌公司 Adaptive direction loop filter
WO2018068744A1 (en) * 2016-10-14 2018-04-19 Mediatek Inc. Method and apparatus of smoothing filter for ringing artefact removal
US10931974B2 (en) 2016-10-14 2021-02-23 Mediatek Inc. Method and apparatus of smoothing filter for ringing artefact removal
WO2018177395A1 (en) * 2017-03-31 2018-10-04 武汉斗鱼网络科技有限公司 Method and apparatus for filtering video frames
CN107809638B (en) * 2017-11-09 2020-03-17 广东技术师范学院 Filtering processing method and system based on camera image video mixed subject
CN107801024A (en) * 2017-11-09 2018-03-13 北京大学深圳研究生院 A kind of boundary filtering method for infra-frame prediction
CN107801024B (en) * 2017-11-09 2019-07-12 北京大学深圳研究生院 A kind of boundary filtering method for intra prediction
CN107809638A (en) * 2017-11-09 2018-03-16 广东技术师范学院 Filter processing method and system based on camera image video mix subject matter
CN111630857A (en) * 2018-01-29 2020-09-04 联发科技股份有限公司 Length adaptive deblocking filtering in video coding and decoding
CN111630857B (en) * 2018-01-29 2022-04-15 联发科技股份有限公司 Video encoding and decoding method/device and corresponding non-volatile computer readable medium
CN112822498B (en) * 2018-03-28 2022-10-11 华为技术有限公司 Image processing apparatus and method of performing efficient deblocking
US11909978B2 (en) 2018-03-28 2024-02-20 Huawei Technologies Co., Ltd. Image processing device and method for performing efficient deblocking
US11290721B2 (en) 2018-03-28 2022-03-29 Huawei Technologies Co., Ltd. Image processing device and method for performing efficient deblocking
CN112822498A (en) * 2018-03-28 2021-05-18 华为技术有限公司 Image processing apparatus and method of performing efficient deblocking
US11388400B2 (en) 2018-06-21 2022-07-12 Telefonaktiebolaget Lm Ericsson (Publ) Deblocking of video picture boundaries
CN111819847B (en) * 2018-06-21 2022-08-09 瑞典爱立信有限公司 Video picture boundary encoding method, video picture boundary decoding method, codec and storage medium
US12108038B2 (en) 2018-06-21 2024-10-01 Telefonaktiebolaget Lm Ericsson (Publ) Deblocking of video picture boundaries
CN111819847A (en) * 2018-06-21 2020-10-23 瑞典爱立信有限公司 Deblocking of video picture boundaries
US11758131B2 (en) 2018-06-21 2023-09-12 Telefonaktiebolaget Lm Ericsson (Publ) Deblocking of video picture boundaries
CN111355951B (en) * 2018-12-24 2023-11-10 华为技术有限公司 Video decoding method, device and decoding equipment
CN111355951A (en) * 2018-12-24 2020-06-30 华为技术有限公司 Video decoding method, device and decoding equipment
CN109889853A (en) * 2019-02-26 2019-06-14 北京大学深圳研究生院 A kind of block-eliminating effect filtering method, system, equipment and computer-readable medium
WO2020177133A1 (en) * 2019-03-07 2020-09-10 Oppo广东移动通信有限公司 Loop filter implementation method and apparatus, and computer storage medium
CN110267036A (en) * 2019-03-11 2019-09-20 杭州海康威视数字技术股份有限公司 A kind of filtering method and equipment
CN111770337B (en) * 2019-03-30 2022-08-19 华为技术有限公司 Video encoding method, video decoding method and related equipment
CN111770337A (en) * 2019-03-30 2020-10-13 华为技术有限公司 Video encoding method, video decoding method and related equipment
CN112449183A (en) * 2019-09-03 2021-03-05 联咏科技股份有限公司 Video encoder, video decoder and video system
CN112136329A (en) * 2019-09-24 2020-12-25 北京大学 Video coding and decoding method and device
CN114615494A (en) * 2020-12-04 2022-06-10 咪咕文化科技有限公司 Image processing method, device and equipment
CN114584790A (en) * 2022-01-21 2022-06-03 百果园技术(新加坡)有限公司 Video brightness filtering method, device, equipment and storage medium
CN114584790B (en) * 2022-01-21 2024-05-17 百果园技术(新加坡)有限公司 Video brightness filtering method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN103220529B (en) 2016-02-24

Similar Documents

Publication Publication Date Title
CN103220529B (en) A kind of implementation method of coding and decoding video loop filtering
US11070819B2 (en) Method and apparatus of HEVC de-blocking filter
CN103229506B (en) Image processing equipment and image processing method
Fu et al. Sample adaptive offset in the HEVC standard
CN103051892B (en) Embedded loop filter method and embedded loop filter
US20240098248A1 (en) Video predictive coding method and apparatus
US10834395B2 (en) Method and a device for decoding an intra predicted block of a picture and corresponding coding method and coding device
US11812060B2 (en) Method and device for deblocking filtering a boundary within an intra predicted block
CN104363453A (en) Codeword space reduction for intra chroma mode signaling for hevc
WO2019103845A1 (en) Encoding and decoding methods and corresponding devices
CN113170135A (en) Method and apparatus for picture encoding and decoding
CN101453651B (en) A deblocking filtering method and apparatus
CN104284199A (en) Video decoding method and device through deblocking effect operation for reducing complexity
JP2024514294A (en) Multimedia data processing methods, devices, equipment, computer readable storage media and computer programs
CN110249630B (en) Deblocking filter apparatus, method and storage medium
CN111770338B (en) Method, device and equipment for determining index value of coding unit and storage medium
CN101895757A (en) Method and system for reordering and inversely reordering predicted residual blocks
KR20230162988A (en) Multimedia data processing methods and apparatus, computer devices, and computer-readable storage media
Bariani et al. An optimized software implementation of the HEVC/H. 265 video decoder
CN102595128B (en) Codeword space reduction for intra chroma mode signaling for HEVC
WO2024215914A1 (en) Neural network-based in loop filter architectures with separable convolution and multi-scale enhancement for video coding
CN103974073A (en) Image data processing method and image processing device
CN115190302A (en) Method, device and system for processing image in video decoding device
Torabi et al. A fast architecture for Deblocking filter in H. 264/AVC using clock cycles saving process

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant