CN103647969B - A kind of object-based Fast Fractal video compress and decompression method - Google Patents

A kind of object-based Fast Fractal video compress and decompression method Download PDF

Info

Publication number
CN103647969B
CN103647969B CN201310296181.2A CN201310296181A CN103647969B CN 103647969 B CN103647969 B CN 103647969B CN 201310296181 A CN201310296181 A CN 201310296181A CN 103647969 B CN103647969 B CN 103647969B
Authority
CN
China
Prior art keywords
block
pixel
frame
video
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310296181.2A
Other languages
Chinese (zh)
Other versions
CN103647969A (en
Inventor
祝世平
李丽芸
赵冬玉
陈菊嫱
王再阔
侯仰拴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHENGDU VISION-ZENITH TECHNOLOGY DEVELOPMENT CO., LTD.
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN201310296181.2A priority Critical patent/CN103647969B/en
Priority claimed from CN201110188771.4A external-priority patent/CN102263954B/en
Publication of CN103647969A publication Critical patent/CN103647969A/en
Application granted granted Critical
Publication of CN103647969B publication Critical patent/CN103647969B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The present invention proposes a kind of object-based Fast Fractal video compress and decompression method, video object segmentation plane i.e. Alpha plane is obtained first with methods of video segmentation, start frame is used block dct transform coding, non-I frame is carried out block motion estimation/compensation coding, calculate to the pixel of the relevant sub-block in sub-block territory and father's block territory and with pixel quadratic sum, the pixel of fractional pixel interpolation value corresponding blocks and, pixel quadratic sum, carry out pre-search restrictive condition judgement, and utilize the asymmetric cross multi-level hexagonal point search algorithm of fraction pixel Block-matching and improvement to find most like match block in former frame search window, utilize Huffman compression coding iterated function system coefficient.Homographic solution compression process is: non-I frame carries out Huffman decoding and obtains iterated function system coefficient, carry out decoding based on macro block, calculate father's block territory be correlated with sub-block pixel and with pixel quadratic sum, the most successively each macro block in present frame is decoded, and square loop circuit filtering method is removed in utilization.

Description

A kind of object-based Fast Fractal video compress and decompression method
The application is invention entitled " a kind of object-based Fast Fractal video compress and decompression method " (application Number: 201110188771.4, applying date: on 07 06th, 2011) divisional application of application for a patent for invention.
Technical field
The invention belongs to the video compression coding field in signal processing, propose particular for a new generation's field of video encoding A kind of object-based Fast Fractal video compressing and encoding method, on the premise of ensureing picture quality, is greatly accelerated fractal The speed of Video coding and compression ratio.
Background technology
The concept encoded based on object (Object-Based, be called for short OB) is proposed by MPEG-4 standard the earliest, use based on The video compressing and encoding method of object makes the foreground object of each frame video and background object be able to independent carrying out and encode, can To improve compression ratio further, some new functions can be realized in decoding end, such as each object video simultaneously Independent transmission and the replacement of decoding, object and background, object-based video frequency searching, coding staff especially with respect to standard Method, can obtain better image quality on the border of object, because the border of object is mutually the most overlapping with the edge in image Closing, it is the part of coding difficulty.MPEG-4 proposes object-based video coding technical standard, in video analysis, with Object video is ultimate unit, and each Video Events and scene can be seen as by the static genus of semantic objects all in video Property (such as shape, color, texture) and dynamic attribute (exercise intensity, direction, rhythm) thereof combine.It is being basic with object The video analysis method of unit of analysis, meets mode of thinking and the visual characteristic of the mankind, eliminates unessential part in video Interference to video analysis (sees Liang Zhang.Object-based Method of important video clips Extraction[J].Journal of Beijing Information Science and Technology University, 2009,24 (4): 83-86), (see Bo Huang, Yujian Huang.A Scalable Object- Based Wavelet Coder [J] .Radio Communications Technology, 2009,35 (1): 35-38), (ginseng See Kassim Ashraf a, Zhao L F.Rate-scalable object-based wavelet codec with implicit shape coding[J].IEEE Transactions on Circuits and Systems for Video Technology, 2000,10 (7): 1,068 1079).Object-based video coding method can improve video compression coding Performance also makes it have more motility.
Fractal theory initially is proposed (to see the seventies in last century by MandelbrotB.Mandelbrot.The Fractal Geometry of Nature [M] .New York:W.H.Freeman and Company, 1982.).Fractal volume The Fundamentals of Mathematics of code are that iterated function system (IFS) is theoretical.First fractal image is used for interactive image compression by Barnsley (see Michael F.Barnsley, Alan D.Sloan.A better way to compress image [J] .Byte Magazine, 1988,13 (1): 215-233.).Jacqain proposes full automatic Fractal Image Compression Approach and (sees Arnaud E.Jacquin.A novel fractal blocking-coding technique for digital image [C].IEEE International Conference on Acoustics,Speech and Signal Processing, 1990,4:2225-2228.), (Arnaud E.Jacquin.Fractal image coding:a review [J] is seen .Proceeding of the IEEE, 1993,81 (10): 1451-1465.), the method uses mode based on image block Affine transformation with local replaces the affine transformation of the overall situation.Afterwards, Fisher utilizes quaternary tree to improve this method (to see Y.Fisher.Fractal Image Compression [J] .Fractals, 1994,2 (3): 347-361.), (see Y.Fisher,E.W.Jacobs.Image compression:A study the iterated transform method [J] .Signal Processing, 1992,29 (3), 251-263.), (see Y.Fisher.Fractal Image Compression:Theory and application to digital images[M].New York:Spring- Verlag, 1995,55-77.), substantially increase code efficiency, and become the main stream approach in current fractal image coding.
On this basis, some scholars and research worker are applied to the pressure of video sequence the method for Fractal Image Compression In contracting.Meiqing Wang etc. proposes and comprehensively (sees based on data cube and fractal image compression system based on frame Meiqing Wang,Choi-Hong Lai.A hybrid fractal video compression method[J] .Computers&Mathematics with Applications, 2005,50 (3-4): 611-621.), (see Meiqing Wang,Zhehuang Huang,Choi-Hong Lai.Matching search in fractal video compression and its parallel implementation in distributed computing Environments [J] .Applied Mathematical Modeling, 2006,30 (8): 677-687.), (see Meiqing Wang,Rong Liu,Choi-Hong Lai.Adaptive partition and hybrid method in fractal video compression[J].Computers&Mathematics with Applications,2006,51 (11): 1715-1726.).What the most classical and impact was bigger sees (C.S.Kim, R.C.Kim, S.U.Lee.Fractal coding of video sequence using circular prediction mapping and noncontractive interframe mapping[J].IEEE Transactions on Image Processing,1998,7(4):601- 605.).The method uses and is similar to the motion estimation/compensation technology that standard video coder method is used, and this process employs Time strong correlation between consecutive frame, achieves preferable effect to compression of video sequence.In CPM and NCIM, sub-block territory In each image block obtained by motion compensation by the father's block territory from consecutive frame formed objects.CPM and NCIM is between the two Maximum difference is that CPM needs possess convergence during decoding, and NCIM need not.But encode at circular prediction (CPM) in method, in order to ensure start frame through self iterative decoding can approximate convergence to original image, compression process Needing through complex transformations, search and iteration etc., compression time and picture quality are difficult to reach requirement.The most typical graftal The operand of picture and video-frequency compression method is very big, and coding rate is relatively slow, and the quality decoded has much room for improvement so that fractal pattern Also need to further improve with video-frequency compression method.
Applicant has applied for two patents about fractal image in April, 2010: a kind of based on fractal Video compression coding-decoding method (201010167243.6CN101860753A) and the compression of one object-based fractal video are compiled Coding/decoding method (201010167235.1CN101827268A).The present invention is different from document disclosed above to be: 1) make use of pre- Search qualifications;2) make use of fraction pixel Block-matching;3) make use of the multi-level hexagonal of asymmetric cross of improvement Point search algorithm;4), in decoding, make use of square loop filtering.Therefore, coding efficiency has had the biggest improving.
Summary of the invention
The present invention proposes a kind of object-based Fast Fractal video compress and decompression method, divides first with video Segmentation method obtains video object segmentation plane i.e. Alpha plane, start frame uses block dct transform coding, non-I frame is carried out block Motion estimation/compensation encodes, calculate to the pixel of the relevant sub-block in sub-block territory and father's block territory and with pixel quadratic sum, in fraction pixel The pixel of interpolation corresponding blocks and, pixel quadratic sum, carry out pre-search restrictive condition judgement, and utilize in former frame search window point Number block of pixels coupling and the asymmetric cross multi-level hexagonal point search algorithm improved find most like match block, profit With Huffman compression coding iterated function system coefficient.Homographic solution compression process is: non-I frame carries out Huffman decoding and obtains Iterated function system coefficient, carries out decoding based on macro block, calculate father's block territory be correlated with sub-block pixel and with pixel quadratic sum, so After successively each macro block in present frame is decoded, and utilize remove square loop circuit filtering method.
A kind of object-based Fast Fractal video-frequency compression method, comprises the following steps:
Step one: utilize automatic video object segmentation algorithm automatically to split video sequence, obtains regarding of each frame Frequently Object Segmentation plane i.e. Alpha plane, determines object video region to be encoded according to the video object segmentation plane obtained; The frame being compressed is called present frame, the most encoded former frame built of laying equal stress on of present frame is called reference frame;
Step 2: first determine whether whether start frame is I frame, if I frame, first carries out non-overlapping copies to this I frame and consolidates The block of sizing divides, and each image block is respectively adopted I frame intraimage method based on block dct transform, to this Two field picture carries out separately encoded and decoding, forwards step 10 to;Otherwise, step 3 is forwarded to;Described I frame be video sequence start frame or Person's video sequence only carries out the picture frame of intraframe coding;Block in described piece of dct transform uses fixed size pattern;
Step 3: if present frame is non-I frame, before carrying out Block-matching, first present frame is divided into fixed size The macro block of non-overlapping copies, then calculate these macro blocks and the pixel of fritter obtained through tree-shaped division and, pixel quadratic sum, with And the most encoded of present frame lay equal stress in the former frame built i.e. reference frame, according to setting all macro blocks that step-length divides and through tree Shape divide the pixel of fritter obtained and, pixel quadratic sum, calculate simultaneously fractional pixel interpolation value corresponding blocks pixel and, pixel Quadratic sum, to reduce the double counting during Block-matching;Forward step 4 to;The collection that described present frame is all pieces is collectively referred to as sub-block Territory;The collection of all pieces of described former frame is collectively referred to as father's block territory;
Step 4: to the image block being presently processing i.e. current block, utilizes Alpha plane to differentiate the region of this image block Attribute;If this block is not in the object video region of present encoding, this block is not processed;If this block is all within currently In the object video region of coding, proceed to step 5;If the partial pixel of this block is in the object video region of present encoding, Partial pixel in the object video region of present encoding, does not needs individual processing, proceeds to step 9;If all of macro block all Processed complete, then forward step 10 to;The described not block in the object video region of present encoding is referred to as external block, described entirely Portion's all blocks in the object video region of present encoding are referred to as internal block, and described partial pixel is not at the video pair of present encoding As the block in region is boundary block;
Step 5: successively all macro blocks of present frame are encoded, first grand to this in the search window in father's block territory Block carries out Block-matching;In carrying out the sub-block matching process with father's block, the position of sub-block is as the initiating searches point of father's block, father's block Size identical with the size of sub-block, forward step 6 to;
Step 6: utilize the asymmetric cross multi-level hexagonal point search algorithm and fraction pixel block improved Join, search out optimal matching error: utilize the asymmetry search algorithm search improved, then search fractional pixel interpolation value pair Answer the RMS point at fritter, find the RMS point of minimum, forward step 7 to;
Step 7: pre-search restrictive condition judges: for specific sub-block, limits if meeting pre-search with father's block respective value Condition, then forward step 8 to;The most directly preserve current iterated function system coefficient i.e. IFS coefficient, proceed to step 4 coding Next macro block;
Step 8: if matching error RMS is less than the threshold gamma starting to set, preserve current iterated function system coefficient I.e. IFS coefficient, proceeds to step 4 and encodes next macro block;Otherwise, according to tree, this block is divided successively, and to each Divide the fritter obtained, utilize the asymmetric cross multi-level hexagonal point search of fraction pixel Block-matching and improvement to calculate Method, calculates matching error RMS respectively, if RMS is less than setting threshold gamma, then stops dividing and recording this fritter IFS coefficient, turns Enter step 4 and encode next macro block;Otherwise continuing to divide, until current block to be divided into smallest blocks set in advance, recording IFS Coefficient;Proceed to step 4 and encode next macro block;Described search window is the rectangular search region in reference frame;Described IFS coefficient Including father's block position, (x, y) with scale factor s, displacement factor o;If all of macro block of present frame is the most encoded complete, then turn To step 10;
Step 9: individual processing boundary block, the boundary block of present frame only belonging in boundary block and internal block in father's block Search coupling, the pixel Criterion of Selecting of current block and father's block is: only calculate the object video being positioned at present encoding in current block Pixel value in region, only carries out Block-matching in the same video subject area of reference frame;For in father's block, if with currently A certain pixel in father's block of the opposite position of block falls within this object video region, then use original pixel value, otherwise, use it It belongs to the meansigma methods of this object video area pixel and replaces;Return step 5 to process;
Step 10: all IFS coefficients carry out Huffman coding, reduces the statistical redundancy of IFS coefficient data;Judge to work as Whether front frame is last frame, if last frame terminates coding;Otherwise, return step 2 and continue with next frame image.
Described one object-based Fast Fractal video-frequency compression method, the video sequence of process is yuv format, the most right Above-mentioned ten steps of each employing in 3 components process.
Described step 6 mid score block of pixels is mated, including three below step:
1) pixel in region of search in reference frame is carried out interpolation and forms one relative to the pixel in integer position more High-resolution region;
2) carry out integer pixel in interpolation region and optimal coupling is found in half-pixel position search;
3) current block is substituted by the affine transformation of match block.
The asymmetric cross multi-level hexagonal point search algorithm improved in described step 6, in H.264 Asymmetrical hexagonal-shaped algorithm, the improvement of this algorithm is mainly reflected in following three points:
1) starting point prediction:
It is not involved with multi-reference frame based on fractal video coding algorithm, and macro block and sub-block have different big Little, therefore utilize three kinds of modes to carry out starting point prediction:
A) spatial domain median prediction: take a left side for current sub-block, upper, the motion vector intermediate value of right adjacent block is that predicted motion is vowed Amount;
B) initial point prediction: according to temporal correlation, makes motion vector value for (0,0);
C) neighboring reference frame prediction: utilize the MV of correspondence position block in previous reference frame to be predicted in proportion;
2) threshold value jump condition during asymmetric cross template search:
The sub-block of fractal image and error matching criterior R of father's block are formula (3), (4), (5).The choosing that varies in size according to block Selecting different threshold values, asymmetric cross template search is complete, selects optimal match point and carries out follow-up masterplate as new starting point Coupling;
3) end condition is shifted to an earlier date:
Feature according to fractal coding algorithm will terminate being divided into two kinds of situations in advance: one is at non-homogeneous multi-level hexagon In lattice point whole pixel motion search procedure, in addition to the end condition in advance of this algorithm itself, in order to reduce search complexity such as Really optimum point is positioned at hexagonal centre, can stop search;Two is to use tree-shaped partition structure based on fractal video coding algorithm.
In described step 7 pre-search restrictive condition be following form wherein, biFor the pixel value of sub-block, aiPicture for father's block Element value, s is the scale factor in fractal image, and o is displacement factor, and | | a | | represents two-dimentional norm, i.e. | | a | |=(| a1|2+|a2 |2+···+|an|2)1/2:
RMS = Σ i = 1 n ( s · a i + o - b i ) 2
= Σ i = 1 n ( s · a i + 1 n [ Σ i = 1 n b i - s Σ i = 1 n a i ] - b i ) 2
= Σ i = 1 n ( ( a i - Σ i = 1 n a i n ) · [ n Σ i = 1 n a i b i - Σ i = 1 n a i Σ i = 1 n b i ] [ n Σ i = 1 n a i 2 - ( Σ i = 1 n a i ) 2 ] + Σ i = 1 n b i n - b i ) 2
= Σ i = 1 n ( ( a i - a ‾ ) · [ Σ i = 1 n a i b i - n a ‾ b ‾ ] [ Σ i = 1 n a i 2 - n a ‾ 2 ] + b ‾ - b i ) 2
= Σ i = 1 n ( ( a i - a ‾ ) · Σ i = 1 n ( b i - b ‾ ) ( a i - a ‾ ) | | a i - a ‾ | | 2 + b ‾ - b i ) 2
= | | b i - b ‾ | | 2 Σ i = 1 n ( ( a i - a ‾ ) | | a i - a ‾ | | · Σ i = 1 n ( b i - b ‾ ) ( a i - a ‾ ) | | b i - b ‾ | | | | a i - a ‾ | | - b i - b ‾ | | b i - b ‾ | | ) 2 - - - ( 1 )
Allow a ^ = ( a i - a ‾ ) | | a i - a ‾ | | , b ^ = b i - b ‾ | | b i - b ‾ | | , And understand | | a ^ | | 2 = 1 , | | b ^ | | 2 = 1 , Then R can derive as follows:
RMS = | | b i - b ‾ | | 2 Σ i = 1 n ( a ^ · Σ i = 1 n b ^ a ^ - b ^ ) 2
= | | b i - b ‾ | | 2 ( 1 - ( Σ i = 1 n b ^ a ^ ) 2 ) - - - ( 2 )
Wherein for each sub-block determined,It is known, in order to obtain minimum match error RMS,Value require the smaller the better, in the matching process of each sub-block, pre-search restrictive condition is: 0.9 < m <1。
In described step 8, Block-matching being used matching error criterion, sub-block with matching error RMS of father's block is:
RMS = 1 N [ &Sigma; i = 1 N r i 2 + s ( s &Sigma; i = 1 N d i 2 - 2 &Sigma; i = 1 N r i d i + 2 o &Sigma; i = 1 N d i 2 ) + o ( N &CenterDot; o - 2 &Sigma; i = 1 N r i ) ] - - - ( 3 )
Wherein parameter s and o are respectively as follows:
s = [ N &Sigma; i = 1 N r i d i - &Sigma; i = 1 N r i &Sigma; i = 1 N d i ] [ N &Sigma; i = 1 N d i 2 - ( &Sigma; i = 1 N d i ) 2 ] - - - ( 4 )
o = 1 N [ &Sigma; i = 1 N r i - s &Sigma; i = 1 N d i ] - - - ( 5 )
Wherein, N is sub-block and the number of father's block pixel, riFor the pixel value of sub-block, diPixel value for father's block.
Calculate current macro block-matching error RMS in reference frame, wherein riIt is the pixel value of sub-block, diIt it is father's block Pixel value;If RMS is less than threshold gamma set in advance, record IFS coefficient, IFS coefficient include match block displacement vector (x, Y) with formula (4), s and o in (5), process next macro block;Otherwise, current macro is carried out tree-shaped division, little after computation partition The RMS of block, if less than threshold gamma, then stops dividing, otherwise continues to divide, until sub-block reaches smallest blocks set in advance and is Only.
A kind of object-based Fast Fractal video decompression method, it is characterised in that comprise the steps of
Step I: first read in compression information, including compression frame number, the width of every two field picture and height, I frame compression quality is with slotting Enter the quality of I frame;
Step II: judge to decode whether frame is I frame, if I frame proceeds to step III, otherwise proceed to step IV;
Step III: for I frame, reads in code stream from compressed file, and the Alpha plane reading in this frame is decoded, and solves File after Ma includes video file based on different objects and complete video file, at object-based video file In, according to Alpha plane, the pixel belonging to this object retains, and is not belonging to the pixel zero setting of this object, and frame number adds one and proceeds to step Ⅵ;
Step IV: for non-I frame, first calculates in reference frame according to setting all macro blocks of step-length division and through tree-shaped Divide the pixel of fritter obtained and, pixel quadratic sum, from compressed file, then read in division information and the Huffman code of block Stream and the Alpha plane of this frame, thus obtain the dividing mode of the non-all macro blocks of I frame and the iterated function series of each fritter System coefficient, forwards step V to;Described reference frame is the most encoded former frame built of laying equal stress on of present frame;
Step V: use and remove square loop circuit filtering method: first the type on border is judged, defined parameters block edge Intensity, the most different, if frame for the block edge of varying strength, the wave filter of selection and the pixel number of required filtering Interior coding and be macroblock boundaries, then use strong filtering;If not intraframe coding and be not macroblock boundaries, affine block boundary uses one Level filtering, nonaffine block boundary need not filtering;Other situations use secondary filter;Finally it is decoded according to each macro block; Described affine piece is the block obtained by affine transformation, and described nonaffine block is not to be the block obtained by affine transformation;
Step VI: judge that the most all frames decode the most, if all decoding complete, terminating decoding process, otherwise proceeding to Step II.
When each macro block is decompressed, first determine whether this macro block dividing mode when coding, for each Individual sub-block, first finds the region corresponding with this sub-block in father's block territory, then utilizes equation below to obtain the picture of this sub-block Element value:
ri=s di+o (6)
Wherein riFor the pixel value of sub-block to be decoded, diFor the pixel value in father's block territory, S is scale factor, O for skew because of Son.
During object-based decoding, the pixel only belonging to this subject area in current block is just decoded, with Sample, only utilizes the pixel belonging to same target region to be decoded in father's block territory, if in the middle part of certain sub-block in father's block territory Point pixel is not belonging to this object video, then the value of this partial pixel is with pixel average belonging to this subject area in this sub-block Value replaces.
Block edge intensity BS in described step V represents;Wherein, P0',Q0',P1',Q1' represent filtered pixel Value, P0,P1,Q0,Q1Represent that original pixel value, different BS and corresponding wave filter are as follows:
During BS=3, needing to filter by force, wave filter is expressed as:
P0'=(P1+P0+Q0)/3
Q0'=(P0+Q0+Q1)/3
P1'=(2 P1+P0')/3 (7)
Q1'=(2 Q1+Q0')/3
During BS=2, two-stage filter is expressed as:
P0'=(P1+2·P0+Q0)/4
Q0'=(P0+2·Q0+Q1)/4 (8)
During BS=1, one-level wave filter is expressed as:
P0'=(P1+3·P0+Q0)/5
Q0'=(P0+3·Q0+Q1)/5 (9)
As BS=0, it is not filtered.
The video sequence processed is yuv format, respectively at six steps above-mentioned to each employing in 3 components Reason.
One proposed by the invention object-based Fast Fractal video-frequency compression method advantage is:
(1) this method introduces fraction pixel block-matching technique in fractal coding algorithm, for a lot of blocks, in one It is inserted into the region of half-pixel accuracy and scans for finding preferably coupling, in order to obtain more accurate motion vector and more High compression ratio.
(2) this method is in the matching process of each sub-block, makes full use of fractal image feature, have employed pre-search and limits Condition, removes the father's block less mated in advance, improves coding efficiency and speed.
(3) this method is before carrying out the Block-matching of sub-block, calculates the macro block of present frame non-overlapping copies and through tree-shaped stroke The pixel of the fritter obtained after/and with pixel quadratic sum.In reference frame, according to coupling step-length calculate respectively each macro block with And the pixel of the fritter obtained after tree-shaped division and with pixel quadratic sum, calculate fractional pixel interpolation value correspondence fritter simultaneously Pixel and, pixel quadratic sum.Thus avoid the drawback duplicating calculating during Block-matching, be greatly saved son The match time of block.
(4) this method utilizes the asymmetric cross multi-level hexagon lattice point of improvement in the matching process of each sub-block Searching algorithm, fully combines characteristics of image and fractal compression, substantially increases coding rate.
(5) method introduces object-based video coding method, object-based coded method is being not based on object Further improve the performance of fractal compression on the basis of method, not only add compression ratio and Y-PSNR, and Compression is made to have greater flexibility.
(6) this method is when decoding, utilizes and removes square loop circuit filtering method, improves decoded image quality, for follow-up Subblock coding more preferably reference frame is provided.
Accompanying drawing explanation
Fig. 1 (a) is the compression process figure of a kind of object-based Fast Fractal video compress of the present invention and decompression method;
Fig. 1 (b) is the decompression flow process of a kind of object-based Fast Fractal video compress of the present invention and decompression method Figure;
Fig. 2 (a) is the 3rd frame of standard testing video sequence " mother-daughter.cif ";
Fig. 2 (b) is that a kind of object-based Fast Fractal video compress of the present invention is surveyed with the standard that decompression method obtains The Alpha segmentation plane of the 3rd frame of examination video sequence " mother-daughter.cif ";
Fig. 2 (c) is that a kind of object-based Fast Fractal video compress of the present invention individually decodes through this with decompression method The foreground video of the 3rd frame of the standard testing video sequence " mother-daughter.cif " that inventive method compressed encoding is later The result images of object;
Fig. 2 (d) is that a kind of object-based Fast Fractal video compress of the present invention individually decodes through this with decompression method The background video of the 3rd frame of the standard testing video sequence " mother-daughter.cif " that inventive method compressed encoding is later The result images of object;
Fig. 2 (e) is that a kind of object-based Fast Fractal video compress of the present invention individually decodes through this with decompression method 3rd frame result images of the standard testing video sequence " mother-daughter.cif " that inventive method compressed encoding is later;
Fig. 2 (f) is that a kind of object-based Fast Fractal video compress of the present invention individually decodes warp with decompression method 3rd frame result images of the standard testing video sequence " mother-daughter.cif " that CPM/NCIM method is later;
Fig. 3 (a) is in a kind of object-based Fast Fractal video compress of the present invention and decompression method UMHexagonS algorithm search route map;
Fig. 3 (b) is in a kind of object-based Fast Fractal video compress of the present invention and decompression method The starting point prognostic chart of UMHexagonS algorithm;
Fig. 4 (a) is a kind of object-based Fast Fractal video compress of the present invention and the fraction pixel in decompression method The half pixel interpolation schematic diagram of Block-matching;
Fig. 4 (b) is a kind of object-based Fast Fractal video compress of the present invention and the fraction pixel in decompression method The integral point fractional matching schematic diagram of Block-matching;
Fig. 5 (a) is a kind of object-based Fast Fractal video compress of the present invention and to macro block four kinds of decompression method Partition mode figure;
Fig. 5 (b) is a kind of object-based Fast Fractal video compress of the present invention and the decompression method division to macro block Pattern four carries out the four kinds of partition mode figures divided further;
Fig. 6 (a) be a kind of object-based Fast Fractal video compress of the present invention with decompression method to object-based The labelling figure of three kinds of image blocks;
Fig. 6 (b) is that boundary block is belonged to by a kind of object-based Fast Fractal video compress of the present invention with decompression method The labelling figure of the pixel of different video subject area;
Fig. 7 (a) is a kind of object-based Fast Fractal video compress of the present invention and remove square ring in decompression method The vertical boundary of road filtering faces the sampling schematic diagram in territory;
Fig. 7 (b) is a kind of object-based Fast Fractal video compress of the present invention and remove square ring in decompression method The block edge intensity decision tree schematic diagram of road filtering;
Fig. 8 (a) is a kind of object-based Fast Fractal video compress of the present invention and decompression method and tradition CPM/ NCIM method is to the Y-PSNR that 3~9 frames of standard testing video sequence " mother-daughter.cif " are compressed Comparison diagram;
Fig. 8 (b) is a kind of object-based Fast Fractal video compress of the present invention and decompression method and tradition CPM/ The contrast to the compression ratio that 3~9 frames of standard testing video sequence " mother-daughter.cif " are compressed of the NCIM method Figure;
Fig. 8 (c) is a kind of object-based Fast Fractal video compress of the present invention and decompression method and tradition CPM/ NCIM method is right to the compression time that 3~9 frames of standard testing video sequence " mother-daughter.cif " are compressed Than figure.
Detailed description of the invention
Being described in further detail the inventive method below in conjunction with accompanying drawing, only as a example by luminance component Y, aberration divides The compression step of amount U with V is identical with luminance component.
The present invention proposes a kind of object-based Fast Fractal video compress and decompression method, divides first with video Segmentation method obtains video object segmentation plane i.e. Alpha plane, start frame uses block dct transform coding, non-I frame is carried out block Motion estimation/compensation encodes, calculate to the pixel of the relevant sub-block in sub-block territory and father's block territory and with pixel quadratic sum, in fraction pixel The pixel of interpolation corresponding blocks and, pixel quadratic sum, carry out pre-search restrictive condition judgement, and utilize in former frame search window point Number block of pixels coupling and the asymmetric cross multi-level hexagonal point search algorithm improved find most like match block, profit With Huffman compression coding iterated function system coefficient.Homographic solution compression process is: non-I frame carries out Huffman decoding and obtains Iterated function system coefficient, carries out decoding based on macro block, calculate father's block territory be correlated with sub-block pixel and with pixel quadratic sum, so After successively each macro block in present frame is decoded, and utilize remove square loop circuit filtering method.
As shown in accompanying drawing 1 (a), a kind of object-based Fast Fractal video-frequency compression method, comprise the following steps:
Step one: as a example by front 10 frames of standard testing video sequence " mother-daughter.cif ".Utilize and automatically regard Frequently video sequence is split by object segmentation methods automatically, obtains Alpha plane.Object in video can pass through Alpha Plane is defined, and can independently be compressed coding.Accompanying drawing 2 (a) is standard testing video sequence " mother- Daughter.cif " the 3rd frame, accompanying drawing 2 (b) is the Alpha plane of this frame, and prospect white represents, background black represents. As shown in accompanying drawing 2 (a), image has two object videos, then Alpha plane can be just a bianry image, by white Representing prospect, black represents background.Each object can be compressed independently so that each object one code stream of composition. So when decompressing, it is not necessary to obtain entire image, but can individually recover and control each object.Before individually decompressing The result of scape object video is accompanying drawing 2 (c), and the result individually decompressing background video object is accompanying drawing 2 (d), and whole frame decompresses Result be accompanying drawing 2 (e), utilizing the decompressing image after CPM/NCIM is accompanying drawing 2 (f).Introduce object-based coding not But improve compression performance, and add the motility of method for video coding.
Step 2: to video sequence " mother-daughter.cif " start frame, it is first determined whether be I frame, if I frame, uses I frame intraimage method based on block dct transform, start frame is divided into the son of the non-overlapping copies of 8 × 8 Block, carries out dct transform respectively to each sub-block.Described I frame is only to carry out in frame in video sequence start frame or video sequence The picture frame of coding;Block in described piece of dct transform uses fixed size pattern.Discrete cosine transform by 8 × 8 image pattern X, is transformed into the coefficient matrix Y of 8 × 8.Conversion process (including inverse transformation) can represent with transformation matrix A.
The forward DCT(FDCT of 8 × 8 sample block) conversion as follows:
Y=AXAT (10)
Reversely DCT(IDCT) as follows:
X=ATYA (11)
Wherein A is the transformation matrix of 8 × 8.Each element in A is as follows:
A ij = C i cos ( 2 j + 1 ) i&pi; 16 - - - ( 12 )
Wherein
C i = 1 8 ( i = 0 ) C i = 1 2 ( i > 0 ) - - - ( 13 )
I, j are respectively the row and column of matrix A.
Conversion coefficient quantified and encodes, proceeding to step 10;Otherwise, step 3 is forwarded to;
Step 3: 16 × 16 macro blocks of the non-overlapping copies that current non-I two field picture is fixed size divide, and calculate respectively The 16 × 16 of present frame non-overlapping copies, the pixel of the fritter of 16 × 8,8 × 16,8 × 8,8 × 4,4 × 8,4 × 4 and with pixel Quadratic sum.Calculate the most respectively in the decompressing image of reference frame i.e. former frame the size with 1 as step-length be respectively 16 × The pixel of the fritter of 16,16 × 8,8 × 16,8 × 8,8 × 4,4 × 8,4 × 4 and the quadratic sum with pixel, calculate mark picture simultaneously Element interpolated value correspondence 16 × 16,16 × 8,8 × 16,8 × 8,8 × 4,4 × 8,4 × 4 fritter pixel and, pixel quadratic sum, With the double counting during minimizing Block-matching.Start to process from first macro block, successively all 16 × 16 grand to present frame Block encodes, and proceeds to step 4;The image block of the described non-overlapping copies that present frame is divided into fixed size is referred to as macro block;Institute State and current macro is carried out the block that tree-shaped division obtains be referred to as fritter;Described present frame is the frame being compressed;Described ginseng Examine the most encoded former frame built of laying equal stress on that frame is present frame;The collection that described present frame is all pieces is collectively referred to as sub-block territory;Before described The collection of all pieces of one frame is collectively referred to as father's block territory;
Step 4: in the current frame according to non-overlapping copies 16 × 16 macro block carry out Block-matching, according to the class of this macro block Type, makes following selection, if this macro block is not in Alpha plane, does not processes this block, continues with next macro block; If this macro block is entirely located in Alpha plane, proceed to step 5;If this macro-block partitions is positioned at Alpha plane, proceed to step Rapid nine.If after present frame macro block all mates, proceeding to step 10.Described not in the object video region of present encoding Block be referred to as external block, described in be all within the object video region of present encoding block be referred to as internal block, described part picture The element not block in the object video region of present encoding is boundary block.
Step 5: successively all 16 × 16 macro blocks of present frame are encoded, to whole in the search window in father's block territory Individual macro block carries out block motion estimation/compensation;In carrying out the sub-block matching process with father's block, the position of sub-block rising as father's block Beginning Searching point, the size of father's block is identical with the size of sub-block, forwards step 6 to;
Step 6: utilize the asymmetric cross multi-level hexagonal point search algorithm and fraction pixel block improved Join, search out optimal matching error.The asymmetric cross multi-level hexagonal point search algorithm improved, its initial search Shown in route such as Fig. 3 (a), compared to the asymmetrical hexagonal-shaped algorithm in H.264, the improvement of this method is mainly reflected in following three Point:
1) starting point prediction:
It is not involved with multi-reference frame based on fractal video coding algorithm, and macro block and sub-block have different big Little, therefore three kinds of modes as shown in Fig. 3 (b) of utilization carry out starting point prediction:
A) spatial domain median prediction: take a left side for current sub-block, upper, the motion vector intermediate value of right adjacent block is that predicted motion is vowed Amount;
B) initial point prediction: according to temporal correlation, makes motion vector value for (0,0);
C) neighboring reference frame prediction: utilize the MV of correspondence position block in previous reference frame to be predicted in proportion;
2) threshold value jump condition during asymmetric cross template search:
The sub-block of fractal image and error matching criterior R of father's block are formula (3), (4), (5).The choosing that varies in size according to block Selecting different threshold values, asymmetric cross template search is complete, selects optimal match point and carries out follow-up masterplate as new starting point Coupling;
3) end condition is shifted to an earlier date:
Feature according to fractal coding algorithm will terminate being divided into two kinds of situations in advance: one is at non-homogeneous multi-level hexagon In lattice point whole pixel motion search procedure, in addition to the end condition in advance of this algorithm itself, in order to reduce search complexity such as Really optimum point is positioned at hexagonal centre, can stop search;Two is to use tree-shaped partition structure based on fractal video coding algorithm. As shown in Fig. 5 (a), it is first according to pattern 1 and carries out non-uniform multilayer hexaploid pixel motion searching method, if full Foot threshold condition, then terminate the coding of this macro block, carry out the coding of next macro block, otherwise according to pattern 2 by the macro block of pattern 1 Divide, each sub-block is carried out the estimation of non-uniform multilayer hexaploid pixel motion searching method, and By that analogy.
Then the RMS point at search fractional pixel interpolation value correspondence fritter, step is as follows:
1) pixel in region of search in reference frame is carried out interpolation and forms one relative to the pixel in integer position more High-resolution region;
2) carry out integer pixel in interpolation region and optimal coupling is found in half-pixel position search;
3) current block is substituted by the affine transformation of match block.
As shown in Fig. 4 (a), a represents original integer pixel, after b and c represents by a pair integer pixel a linear interpolation Pixel value, d represent by the pixel value after around four integer pixel a linear interpolations, arrow represents interior direction interpolation.Until looking for To minimum RMS point, as shown in Fig. 4 (b), it is assumed that A point is integer-pixel search optimum point, carrying out fraction pixel about Motion search, such as point 1,2,3,4,5,6,7,8, although amount of calculation increased, but half pel motion is estimated and motion compensation Performance significantly better than the Motion estimation and compensation of integer pixel, forward step 7 to;
Step 7: pre-search restrictive condition judges: for specific sub-block, has following derivation, wherein, biPicture for sub-block Element value, aiFor the pixel value of father's block, s is the scale factor in fractal image, and o is displacement factor, and | | a | | represents two dimension norm, That is:
| | a | |=(| a1|2+|a2|2+···+|an|2)1/2:
RMS = &Sigma; i = 1 n ( s &CenterDot; a i + o - b i ) 2
= &Sigma; i = 1 n ( s &CenterDot; a i + 1 n [ &Sigma; i = 1 n b i - s &Sigma; i = 1 n a i ] - b i ) 2
= &Sigma; i = 1 n ( ( a i - &Sigma; i = 1 n a i n ) &CenterDot; [ n &Sigma; i = 1 n a i b i - &Sigma; i = 1 n a i &Sigma; i = 1 n b i ] [ n &Sigma; i = 1 n a i 2 - ( &Sigma; i = 1 n a i ) 2 ] + &Sigma; i = 1 n b i n - b i ) 2
= &Sigma; i = 1 n ( ( a i - a &OverBar; ) &CenterDot; [ &Sigma; i = 1 n a i b i - n a &OverBar; b &OverBar; ] [ &Sigma; i = 1 n a i 2 - n a &OverBar; 2 ] + b &OverBar; - b i ) 2
= &Sigma; i = 1 n ( ( a i - a &OverBar; ) &CenterDot; &Sigma; i = 1 n ( b i - b &OverBar; ) ( a i - a &OverBar; ) | | a i - a &OverBar; | | 2 + b &OverBar; - b i ) 2
= | | b i - b &OverBar; | | 2 &Sigma; i = 1 n ( ( a i - a &OverBar; ) | | a i - a &OverBar; | | &CenterDot; &Sigma; i = 1 n ( b i - b &OverBar; ) ( a i - a &OverBar; ) | | b i - b &OverBar; | | | | a i - a &OverBar; | | - b i - b &OverBar; | | b i - b &OverBar; | | ) 2 - - - ( 14 )
Allow a ^ = ( a i - a &OverBar; ) | | a i - a &OverBar; | | , b ^ = b i - b &OverBar; | | b i - b &OverBar; | | , And understand | | a ^ | | 2 = 1 , | | b ^ | | 2 = 1 , Then R can derive as follows:
RMS = | | b i - b &OverBar; | | 2 &Sigma; i = 1 n ( a ^ &CenterDot; &Sigma; i = 1 n b ^ a ^ - b ^ ) 2
= | | b i - b &OverBar; | | 2 ( 1 - ( &Sigma; i = 1 n b ^ a ^ ) 2 ) - - - ( 15 )
Wherein for each sub-block determined,It is known, therefore to obtain minimum match error RMS;Value require the smaller the better, in the matching process of each sub-block, pre-search restrictive condition is: 0.9<m<1.If meeting pre-search restrictive condition with father's block respective value, then forward step 8 to;The most directly preserve current iteration Function system coefficient i.e. IFS coefficient, proceeds to step 4 and encodes next macro block;
Step 8: tree-shaped division is mated further: the foundation of coupling is fractal iteration function system principle, briefly introduces one The Fundamentals of Mathematics iterated function system (IFS:Iterative Function System) of lower Fractal Image Compression is theoretical.If D It is RnThe subset of Euclidean space, ω is the mapping of D → D, if there is a real number C, 0≤C < 1 so that for RnOn tolerance D, meets any x, y ∈ D, and (d (x, y)), then ω is called that compression maps, and real number C is referred to as ω's d (ω (x), ω (y))≤C Compressibility factor.Complete metric space (X, d) and n compression maps ωi: its compressibility factor of X → X(is respectively C1, C2,···Cn) together, just one iterated function system (Iterated Function System) of composition, it is called for short IFS, is denoted as {X:ω12,···,ωn}.C=max (C1,C2,···,Cn) be referred to as IFS compressibility factor.Therefore { R212, ω3It is exactly an IFS.
In Fractal Image Compression, general matching criterior is RMS, it may be assumed that
RMS = 1 N [ &Sigma; i = 1 N r i 2 + s ( s &Sigma; i = 1 N d i 2 - 2 &Sigma; i = 1 N r i d i + 2 o &Sigma; i = 1 N d i 2 ) + o ( N &CenterDot; o - 2 &Sigma; i = 1 N r i ) ] - - - ( 16 )
Wherein s, o are respectively as follows:
s = [ N &Sigma; i = 1 N r i d i - &Sigma; i = 1 N r i &Sigma; i = 1 N d i ] [ N &Sigma; i = 1 N d i 2 - ( &Sigma; i = 1 N d i ) 2 ] - - - ( 17 )
o = 1 N [ &Sigma; i = 1 N r i - s &Sigma; i = 1 N d i ] - - - ( 18 )
Wherein, N is sub-block and the number of father's block pixel, riFor the pixel value of sub-block, diPixel value for father's block.
First setting the match error threshold γ=tol × tol × no of sub-block, wherein tol is according to different sub-block sizes Changing, big sub-block tol is the biggest, and little sub-block tol is the least.In this example, we take the tol of 16 × 16 macro blocks is 10.0,8 The tol of × 8 sub-blocks be the tol of 8.0,4 × 4 sub-blocks be 6.0, no is the pixel that current sub-block belongs to this object video region Number.
First match error threshold γ of 16 × 16 macro blocks is set16=10.0 × 10.0 × no, in father's block territory of reference frame Start in the search window of 15 × 15, whole macro block to be carried out Block-matching, if matching error RMS is little with the position of current sub-block In the threshold gamma starting setting16, then preserving current IFS coefficient and include scale factor s, offset o, father's block is relative to current sub-block Coordinate offset x, y, return step 4, continue the coupling of next macro block.
Otherwise, dividing this macro block according to tree, the division to macro block has four kinds of patterns, such as accompanying drawing 5 (a), Pattern one is 16 × 16 fritters, and pattern two is the fritter of two 8 × 16, and pattern three is the fritter of two 16 × 8, pattern four It it is the fritter of four 8 × 8.
1, first calculate by the division of pattern two, utilize the asymmetric cross multi-level hexagonal point search improved to calculate Method and fraction pixel Block-matching, if two fritters all meet RMS < γ in pattern two16, then preserve current IFS coefficient and include ratio Example factor s, offsets o, and father's block is relative to coordinate offset x, the y of current sub-block, and the division of stop piece, forwards 5 to;
2, otherwise divide by pattern three, utilize the asymmetric cross multi-level hexagonal point search algorithm improved and divide Number block of pixels coupling, if two fritters all meet RMS < γ in pattern three16, then preserve current IFS coefficient and include scale factor S, offsets o, and father's block is relative to coordinate offset x, the y of current sub-block, and the division of stop piece, forwards 5 to;
3, otherwise according to pattern four, current macro is divided, utilize the multi-level hexagon of asymmetric cross improved Grid search algorithm and fraction pixel Block-matching, now match error threshold is set to γ8=8.0 × 8.0 × no, if pattern 4 fritters in four all meet RMS < γ8, then preserve current IFS coefficient and include scale factor s, offset o, and father's block phase For coordinate offset x, the y of current sub-block, and the division of stop piece, forward 5 to;
4, otherwise each fritter in pattern four is divided according to the mode division order in accompanying drawing 5 (b), can depend on The secondary fritter being divided into 18 × 8, the fritter of 24 × 8, the fritter of 28 × 4, the fritter of 44 × 4.Here only to first The matching process of individual 8 × 8 fritters is illustrated, the matching process of other 38 × 8 fritters and first identical, repeat no more. It is first according to the fritter division of 24 × 8, carries out Block-matching, if matching error RMS of two sub-blocks is all less than γ8Time, Then preserve current IFS coefficient and include scale factor s, offset o, and father's block is relative to coordinate offset x, the y of current sub-block, and The division of stop piece.Otherwise, carry out the division of block according to the dividing mode of 28 × 4, the two sub-block is carried out Block-matching, as Really matching error RMS of two sub-blocks is all less than γ8Time, then preserve current IFS coefficient and include scale factor s, offset o, And father's block is relative to coordinate offset x, the y of current sub-block, and the division of stop piece.Otherwise, it it is 44 × 4 to this partition Fritter, match error threshold is set to γ simultaneously4Four fritters are carried out Block-matching, and remember respectively by=6.0 × 6.0 × no respectively The IFS coefficient recording each sub-block includes scale factor s, offsets o, and father's block is relative to coordinate offset x, the y of current sub-block, and The division of stop piece, forwards 5 to;
5, return step 4, continue the coding of next macro block.
The most encoded complete if all of macro block, then forward step 10 to;
Step 9: in order to when matched sub-block is with father's block, it is to avoid the pixel belonging to different object is obscured, mutually to each Pixel does a labelling in Alpha plane, indicates which object is labeled pixel be belonging to, as shown in accompanying drawing 6 (a), The pixel of this boundary block is marked as two parts of S1 and S2.
The concrete compression method of boundary block: assume current compression be object 1(compressed object 2 time, method is identical), i.e. S1 The object at place.For the amount relevant to sub-block, only calculate the pixel value in S1 region, and the pixel in S2 region does not gives Consider;For the amount relevant with father's block, if a certain pixel d in father's block of the position corresponding with sub-blockiFall within S1 region, Then use diOriginal pixel value, otherwise, replace d according to specific value of calculationi, the present invention uses in father's block and belongs to S1 The pixel average in region replaces di.Coupling maps shown in effect such as accompanying drawing 6 (b).It should be noted that coupling maps only same Carry out between class block, i.e. sub-block and father's block must be boundary block simultaneously or be internal block (external block) simultaneously, returns step 5 Process;
Step 10: all IFS coefficients carry out Huffman coding, Huffman coding is by each according to the probability occurred Symbol is mapped in the set (VLC) of an avriable length codes, reduces the statistical redundancy of IFS coefficient data.Whether judge present frame For last frame, if last frame terminates coding, otherwise, proceed to step 2 and continue with next frame image.
As shown in figure ib, a kind of object-based Fast Fractal video decompression method, comprise the following steps:
Step I: first read in compression information, including compression frame number, the width of every frame and height, I frame reconstruction quality, inserts I frame Interval etc.;
Step II: judge to decode whether frame is I frame, if I frame proceeds to step III, otherwise proceed to step IV;
Step III: for I frame, reads in code stream from compressed file, and the Alpha plane reading in this frame is decoded, and enters Row inverse DCT converts, and obtains the pixel value of each block of 8 × 8, and the file after decoding includes video literary composition based on different objects Part and complete video file, in object-based video file, according to Alpha plane, the pixel belonging to this object retains, Being not belonging to the pixel zero setting of this object, frame number adds one and proceeds to step VI;
Step IV: for non-I frame, first calculates in reference frame according to setting all macro blocks of step-length division and through tree-shaped Divide the pixel of fritter obtained and, pixel quadratic sum, from compressed file, then read in division information and the Huffman code of block Stream and the Alpha plane of this frame, thus obtain the dividing mode of the non-all macro blocks of I frame and the iterated function series of each fritter System coefficient, is decoded according to each macro block, when decompressing for each macro block, first determines whether that this macro block is when coding Dividing mode, for each sub-block, first find the region corresponding with this sub-block in father's block territory, then utilize following Formula obtains the pixel value of this sub-block:
ri=s di+o
Wherein riFor the pixel value of sub-block to be decoded, diFor the pixel value in father's block territory, S is scale factor, O for skew because of Son.
During object-based decoding, the pixel only belonging to this subject area in current block is just decoded, with Sample, only utilizes the pixel belonging to same target region to be decoded in father's block territory, if in the middle part of certain sub-block in father's block territory Point pixel is not belonging to this object video, then the value of this partial pixel is with pixel average belonging to this subject area in this sub-block Value replaces, and described reference frame is the most encoded former frame built of laying equal stress on of present frame, proceeds to step V;
Step V: use and remove square loop circuit filtering method: first the type on border is judged, defined parameters block edge Intensity, the most different for the block edge of varying strength, the wave filter of selection and the pixel number of required filtering, such as Fig. 7 A shown in (), vertical boundary faces the sampling schematic diagram in territory, if intraframe coding and be macroblock boundaries, then use and filter by force;If no Being intraframe coding and be not macroblock boundaries, affine block boundary uses one-level filtering, and nonaffine block boundary need not filtering;Other feelings Condition uses secondary filter;Finally it is decoded according to each macro block;Specifically chosen as shown in Fig. 7 (b), block edge intensity BS table Show, wherein, P0',Q0',P1',Q1' represent filtered pixel value, P0,P1,Q0,Q1Represent original pixel value, different BS and Corresponding wave filter is as follows, and described affine piece is the block obtained by affine transformation, and described nonaffine block is not is by affine transformation The block obtained:
During BS=3, needing to filter by force, wave filter is expressed as:
P0'=(P1+P0+Q0)/3
Q0'=(P0+Q0+Q1)/3 (19)
P1'=(2 P1+P0')/3
Q1'=(2 Q1+Q0')/3
During BS=2, two-stage filter is expressed as:
P0'=(P1+2·P0+Q0)/4 (20)
Q0'=(P0+2·Q0+Q1)/4
During BS=1, one-level wave filter is expressed as:
P0'=(P1+3·P0+Q0)/5 (21)
Q0'=(P0+3·Q0+Q1)/5
As BS=0, it is not filtered.
It is decoded according to each macro block, when each macro block is decompressed, first determines whether that this macro block is at coding Time dividing mode, for each sub-block, first find the region corresponding with this sub-block in father's block territory, then utilize following Formula obtain the pixel value of this sub-block:
ri=s di+o (22)
Wherein riFor the pixel value of sub-block to be decoded, diFor the pixel value in father's block territory, S is scale factor, O for skew because of Son.
Step VI: judge that the most all frames decode the most, if all decoding complete, terminating decoding process, otherwise proceeding to Step II.
The video sequence processed is yuv format, respectively at six steps above-mentioned to each employing in 3 components Reason.
This method selects visual c++ 6.0 as the language that realizes of described method, and CPU is CoreTM2DuoT8300,2.4GHz dominant frequency, memory size is 2G, to standard testing video sequence " mother- Daughter.cif " carry out quick fractal video coding experiments.
The compression performance average contrast of table 1 video sequence
It is respectively adopted traditional CPM/NCIM method and the inventive method 3~9 frames to " mother-daughter.cif " Shown in the comparison diagram such as accompanying drawing 8 (a) of the Y-PSNR being compressed coding;It is respectively adopted traditional CPM/NCIM method and basis Inventive method is compressed the comparison diagram such as accompanying drawing 8 of the compression ratio of coding to front 3~9 frames of " mother-daughter.cif " Shown in (b);It is respectively adopted traditional CPM/NCIM method and the inventive method front 3~9 to " mother-daughter.cif " Shown in the comparison diagram of the time that frame is compressed such as accompanying drawing 8 (c);From accompanying drawing 8 and table 1 it can be seen that the inventive method is with traditional CPM/NCIM method compare, not only compression time is kept to 0.087 times, and Y-PSNR PSNR adds about 8dB, pressure Contracting ratio adds about about 120.

Claims (4)

1. an object-based Fast Fractal video decompression method, it is characterised in that comprise the steps of
Step I: first read in compression information, including compression frame number, the width of every two field picture and height, I frame compression quality and insertion I frame Quality;
Step II: judge to decode whether frame is I frame, if I frame proceeds to step III, otherwise proceed to step IV;
Step III: for I frame, reads in code stream from compressed file, and the Alpha plane reading in this frame is decoded, and decodes it After file include video file based on different objects and complete video file, in object-based video file, root According to Alpha plane, the pixel belonging to this object retains, and is not belonging to the pixel zero setting of this object, and frame number adds one and proceeds to step VI;
Step IV: for non-I frame, first calculates in reference frame according to setting all macro blocks of step-length division and through tree-shaped division The pixel of the fritter obtained and, pixel quadratic sum, then read in from compressed file the division information of block and Huffman code stream with And the Alpha plane of this frame, thus obtain the dividing mode of the non-all macro blocks of I frame and the iterated function system system of each fritter Number, forwards step V to;Described reference frame is the most encoded former frame built of laying equal stress on of present frame;
Step V: use and remove square loop circuit filtering method: first judging the type on border, defined parameters block edge is strong Degree, the most different, if in frame for the block edge of varying strength, the wave filter of selection and the pixel number of required filtering Coding and be macroblock boundaries, then use and filter by force;If not intraframe coding and be not macroblock boundaries, affine block boundary uses one-level Filtering, nonaffine block boundary need not filtering;Other situations use secondary filter;Finally it is decoded according to each macro block;Institute Stating affine piece is the block obtained by affine transformation, and described nonaffine block is not to be the block obtained by affine transformation;
Step VI: judge that the most all frames decode the most, if all decoding complete, terminating decoding process, otherwise proceeding to step Ⅱ;
Block edge intensity BS in described step V represents;Wherein, P0',Q0',P1',Q1' represent filtered pixel value, P0, P1,Q0,Q1Representing original pixel value, its distributing order is followed successively by P from left to right1, P0, Q0, Q1, different BS and corresponding filter Ripple device is as follows:
During BS=3, needing to filter by force, wave filter is expressed as:
P 0 &prime; = ( P 1 + P 0 + Q 0 ) / 3 Q 0 &prime; = ( P 0 + Q 0 + Q 1 ) / 3 P 1 &prime; = ( 2 &CenterDot; P 1 + P 0 &prime; ) / 3 Q 1 &prime; = ( 2 &CenterDot; Q 1 + Q 0 &prime; ) / 3 - - - ( 2 )
During BS=2, two-stage filter is expressed as:
P 0 &prime; = ( P 1 + 2 &CenterDot; P 0 + Q 0 ) / 4 Q 0 &prime; = ( P 0 + 2 &CenterDot; Q 0 + Q 1 ) / 4 - - - ( 3 )
During BS=1, one-level wave filter is expressed as:
P 0 &prime; = ( P 1 + 3 &CenterDot; P 0 + Q 0 ) / 5 Q 0 &prime; = ( P 0 + 3 &CenterDot; Q 0 + Q 1 ) / 5 - - - ( 4 )
As BS=0, it is not filtered.
One the most according to claim 1 object-based Fast Fractal video decompression method, it is characterised in that: for When each macro block decompresses, first determine whether this macro block dividing mode when coding, for each sub-block, first exist The region corresponding with this sub-block is found in father's block territory, then utilizes equation below to obtain the pixel value of this sub-block:
ri=s di+o (1)
Wherein riFor the pixel value of sub-block to be decoded, diFor the pixel value in father's block territory, S is scale factor, and O is displacement factor.
One the most according to claim 1 object-based Fast Fractal video decompression method, it is characterised in that: at base During the decoding of object, the pixel only belonging to this subject area in current block is just decoded, the most sharp in father's block territory It is decoded by the pixel belonging to same target region, if partial pixel is not belonging to this video in certain sub-block in father's block territory Object, then the value of this partial pixel meansigma methods of the pixel belonging to this subject area in this sub-block replaces.
One the most according to claim 1 object-based Fast Fractal video decompression method, it is characterised in that: process Video sequence be yuv format, six steps above-mentioned to each employing in 3 components process respectively.
CN201310296181.2A 2011-07-06 2011-07-06 A kind of object-based Fast Fractal video compress and decompression method Active CN103647969B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310296181.2A CN103647969B (en) 2011-07-06 2011-07-06 A kind of object-based Fast Fractal video compress and decompression method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310296181.2A CN103647969B (en) 2011-07-06 2011-07-06 A kind of object-based Fast Fractal video compress and decompression method
CN201110188771.4A CN102263954B (en) 2011-07-06 2011-07-06 Quick fractal video compression and decompression method based on object

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201110188771.4A Division CN102263954B (en) 2011-07-06 2011-07-06 Quick fractal video compression and decompression method based on object

Publications (2)

Publication Number Publication Date
CN103647969A CN103647969A (en) 2014-03-19
CN103647969B true CN103647969B (en) 2016-09-14

Family

ID=50253113

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310296181.2A Active CN103647969B (en) 2011-07-06 2011-07-06 A kind of object-based Fast Fractal video compress and decompression method

Country Status (1)

Country Link
CN (1) CN103647969B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754357B (en) * 2015-03-24 2017-08-11 清华大学 Intraframe coding optimization method and device based on convolutional neural networks
CN108419086B (en) * 2018-05-08 2019-04-05 北京理工大学 A kind of method for compressing image based on huffman coding
CN109963152B (en) * 2019-03-27 2021-09-21 华南理工大学 Fractal theory-based rapid image compression method
CN118101937B (en) * 2024-04-19 2024-07-16 深圳对对科技有限公司 Efficient material transmission method and system for multimedia intelligent social platform

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7324687B2 (en) * 2004-06-28 2008-01-29 Microsoft Corporation Color segmentation-based stereo 3D reconstruction system and process
KR100679035B1 (en) * 2005-01-04 2007-02-06 삼성전자주식회사 Deblocking filtering method considering intra BL mode, and video encoder/decoder based on multi-layer using the method
JP4643437B2 (en) * 2005-12-27 2011-03-02 株式会社東芝 Information processing device
CN101827268B (en) * 2010-04-30 2012-04-18 北京航空航天大学 Object-based fractal video compression and decompression method
CN101980537B (en) * 2010-10-21 2012-08-01 北京航空航天大学 Object and fractal-based binocular three-dimensional video compression coding and decoding method
CN101980536B (en) * 2010-10-21 2012-08-01 北京航空航天大学 Object and fractal-based multi-ocular three-dimensional video compression encoding and decoding method

Also Published As

Publication number Publication date
CN103647969A (en) 2014-03-19

Similar Documents

Publication Publication Date Title
CN102263951B (en) Quick fractal video compression and decompression method
CN101980537B (en) Object and fractal-based binocular three-dimensional video compression coding and decoding method
WO2019213986A1 (en) Multi-angle adaptive intra-frame prediction-based point cloud attribute compression method
CN103220528B (en) Method and apparatus by using large-scale converter unit coding and decoding image
CN102970529B (en) A kind of object-based multi-view point video fractal image compression &amp; decompression method
CN102291579B (en) Rapid fractal compression and decompression method for multi-cast stereo video
CN103037219B (en) A kind of based on fractal and video compress H.264 and decompression method
CN102905150B (en) Novel multi-view video fractal coding, compressing and decompressing method
CN100469142C (en) Video encoding and decoding methods and corresponding devices
CN101980538B (en) Fractal-based binocular stereoscopic video compression coding/decoding method
CN103959776A (en) Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
CN102137263A (en) Distributed video coding and decoding methods based on classification of key frames of correlation noise model (CNM)
US9883200B2 (en) Method of acquiring neighboring disparity vectors for multi-texture and multi-depth video
CN101827268B (en) Object-based fractal video compression and decompression method
CN101860753B (en) Fractal-based video compression and decompression method
CN103647969B (en) A kind of object-based Fast Fractal video compress and decompression method
CN101980536B (en) Object and fractal-based multi-ocular three-dimensional video compression encoding and decoding method
CN103051894B (en) A kind of based on fractal and H.264 binocular tri-dimensional video compression &amp; decompression method
CN102316323B (en) Rapid binocular stereo-video fractal compressing and uncompressing method
CN105933711A (en) Partition-based video steganography analysis method and system having neighbourhood optimal probability
CN102595132A (en) Distributed video encoding and decoding method applied to wireless sensor network
CN101980539B (en) Fractal-based multi-view three-dimensional video compression coding and decoding method
CN102263954B (en) Quick fractal video compression and decompression method based on object
CN101389032A (en) Intra-frame predictive encoding method based on image value interposing
CN101783956B (en) Backward-prediction method based on spatio-temporal neighbor information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20191016

Address after: 610000 Chengdu Free Trade Experimental Zone, Sichuan Province, No. 300 Jiaozi Avenue, Chengdu High-tech Zone, No. 3 Building, 22 Floor 5

Patentee after: CHENGDU VISION-ZENITH TECHNOLOGY DEVELOPMENT CO., LTD.

Address before: 100191 Haidian District, Xueyuan Road, No. 37,

Patentee before: Beijing University of Aeronautics and Astronautics

TR01 Transfer of patent right