CN100466741C - A method and device for carrying out coding using correlation between video signal frames in video code processing - Google Patents

Abstract

The provided coding method employing video signal frame correlation comprises: deciding the correlation of near frames with preset matching rule; then taking interframe coding. It also provides a relative coding device. This invention has high compression ratio without motion compensation.

Description

Utilize vision signal interframe correlation to carry out Methods for Coding and device

Technical field

Present invention relates in general to video coding and compression field, utilize vision signal interframe correlation to carry out Methods for Coding and device in handling more specifically to video coding.

Background technology

Existing video coding is realized many algorithms based on frequency domain, and for example those use the encoder algorithm of cosine transform in frequency domain.But there are some defectives in these encoder algorithms.For example, the semiconductor of real-time frequency domain encoder is realized, needs to surpass 800 ten thousand transistor usually.The Frequency Domain Coding device uses quantized frequency component to reduce coding information quantity.This may cause losing of some high fdrequency component, thereby reduces the definition and the resolution of video.VICOMP (video coding and compressibility and device) be one based on the digital video coding scheme under the demand of high-quality, real-time, high efficiency video coding (high compression rate).Its utilization is based on time domain but not the algorithm of frequency domain.Compare with above-mentioned Frequency Domain Coding device, VICOMP is for realizing that being less than 700,000 transistorized real-time encoders provides possibility.Simultaneously, compare with the Frequency Domain Coding device, VICOMP can provide same or better video quality and outstanding overall compression rate.The simplification of VICOMP on logic and complexity compared with Frequency Domain Coding, equally also makes the software of video coding system realize more effective.

For example, mpeg decoder all is based on the frequency domain information that uses discrete cosine transform (DCT) algorithm, and DCT is used for time-domain information is transformed into frequency domain.VICOMP is a kind of time domain coding device, is unnecessary with information from the step that time domain is transformed into frequency domain therefore.Save this step significant benefits is provided, because this shift step needs a large amount of calculating very at a high speed.

For example, for the block of pixels with 8 X 8 is transformed into frequency domain from time domain, needs to use the DCT algorithm to carry out 64 X and multiply each other for 64=4096 time.When tangible in the video coding, distribute to the time quantum that multiplies each other for 4096 times less than 5 microseconds.So single multiplier must be to be higher than the frequencies operations of 800MHz, perhaps 8 multipliers must be simultaneously to be higher than the frequencies operations of 100MHz, so that carry out this switch process in real time with each.

And the VICOMP decoder can utilize the clock frequency of 2X pixel rate to operate, and this clock is 27MHz typically, and by comparison, the DCT encoder is operated under the clock frequency of 100MHz.The difference of this clock frequency causes the less power consumption of semiconductor decoder.

Be based on a scheme of redundancy concept as above-mentioned VICOMP efficient coding scheme.The purpose of any one encoding scheme all is to find and portray redundant elements, generates an effective sets of signals then the nonredundancy signal is encoded.If in information, there is not redundant elements, also just have no chance to compress.The redundancy of digital video signal results from the following aspects.

1. to the over-sampling of low frequency component---in the sampled digital vision signal, through regular meeting because sampling causes bulk redundancy.The sampling redundancy that part is such be because have to for the high-frequency response that guarantees sufficient resolution and digital sample to carry out video signal sampling in the frequency of 2 times of the maximum operating frequencies of analog video signal.But because contain the low-frequency component that accounts for main quantity in the real video signal, 2 times sample frequency can cause the over-sampling to low frequency component.The redundancy that therefore, in sampled signal, can have considerable quantity.

2. to the over-sampling of bit resolution---the redundant over-sampling that also can result from resolution (figure place) to each sample.Such as, if being digitized as 8 bit resolutions, each pixel multiply by 3 color coordinatess (as YUV) sampling resolution of 24 of each pixels just.24 that is to say have enough resolution to represent 1,670 ten thousand kinds of possible colors here.Sample for the pixel resolution with 640H X 480V in each independent frame of video, can produce 307,200 pixels (sample).Even can also only need 19 and represent 307,200 all colors with 307,200 all in frame pixels as different colors.Because picture is to form with the object of continuous relatively color, so in fact be less than 307,200 kinds of colors far away in a frame of video, the information that therefore also just need be less than 19 is illustrated in colors all in the frame.Furtherly, because the limited dynamic range of imageing sensor, 24/sample provides than the common dynamic range that is applied in the imageing sensor in the video camera (9) and has wanted the high dynamic range that manys (144 decibels) for 54 decibels.

3. the interframe redundancy---the another kind of redundancy in the sport video is exactly that interframe repeats.More a series of video frame images, we can find that the difference of common interframe is in very little scope.Not that all elements in video all changes along with the variation of frame.A lot of elements move very for a short time.For the rest image of successive frame, get rid of the factor of random noise, have 100% redundancy.Though the interframe redundancy can estimate that generally it generally is decided by the actual video situation, simultaneously the interframe redundancy range can from 0 to 100%.

4. noise filtering---because the limited dynamic range of video image sensors includes a large number of white noise in the video.This white noise is a completely random, that is to say that it has reduced redundancy and also reduced compression ratio.VICOMP is used for improving the senior filter of signal to noise ratio, since improve redundant and improve compression ratio.

5. redundant between line---each bar is given in video horizontal line exist a lot of with on element just the same or about the same in or next bar.Can by utilize specific algorithm find those with adjacent lines on different element and be its coding.

6. frequency of occurrences redundancy---some video elementary can be had the higher frequency of occurrences than other elements by expection.Can use the long code of variable bit is various element codings.For more frequent element occurring, those distribute minimum figure place.By using the long code of variable bit, the data bit sum that coding needs has reduced.

The above 6 kinds of elements that find, portray and encode can make information not lose or lose less.Except redundancy listed above, in digital video, still there is unnecessary information.That is to say the information that those do not have contribution to the quality and the key data of video.In order to improve compression ratio, need to eliminate or reduce these unnecessary information.

Summary of the invention

The problem that need solve in view of VICOMP in the prior art, the invention provides and a kind ofly in video coding is handled, utilize vision signal interframe correlation to carry out Methods for Coding, comprise step: utilize predefined matched rule to judge the correlation circumstance of the consecutive frame of vision signal; Carry out the interframe correlative coding based on the correlation circumstance of being judged;

Wherein, the step of the consecutive frame correlation circumstance of described judgement vision signal comprises step:

Described consecutive frame is divided into the block of pixels of equal number respectively, and judges respectively whether the luminance Y component of corresponding block of pixels in these two frames and color UV component mate; Obtain the correlation situation of each block of pixels according to above-mentioned matching judgment result, and, determine the correlation circumstance of consecutive frame based on block of pixels correlation situation;

Wherein, describedly judge that the luminance Y component of corresponding block of pixels in these two frames and the step whether color UV component mates comprise:

Each frame is divided into 9 block of pixels, and comprise 6 Y components in each block of pixels, 1 U component and 1 V component, for each block of pixels is provided with Y component match flag and U respectively, V component match flag, and setting is respectively applied for the coefficient correlation and the U of Y component, the coefficient correlation of V component, and coupling count value T and correlated variables Pmtch about the pixel quantity of the coupling of Y component be set in each block of pixels of expression, for each block of pixels in the frame, calculate in described each block of pixels and the previous frame in the corresponding block of pixels 6 Y components and U respectively, the difference of V component;

Carry out following operation according to result of calculation:

For the Y component, when corresponding to certain difference of the Y component of certain block of pixels less than Y component coefficient correlation, then the T value is increased progressively 1, if the end value of T more than or equal to correlated variables and the maximum Y value of maximum value that equals each Y component difference less than 2 times of Y component coefficient correlation, then the Y component match flag corresponding to this block of pixels is set to coupling

For the UV component, if distinguish all less than U, V component coefficient correlation corresponding to the U of certain block of pixels, the difference of V component, then U, the V component match flag corresponding to this block of pixels is set to coupling.

The present invention also provides a kind of code device that utilizes above-mentioned interframe correlative coding method to realize video information coding.

Description of drawings

By in conjunction with the detailed description of this accompanying drawing to the embodiment of video coding filtering method of the present invention and device thereof, purpose of the present invention, feature and benefit will be clearer.In the drawings:

Fig. 1 is the schematic block diagram that the typical case of VICOMP encoder of the present invention realizes;

Fig. 2 is according to the schematic diagram of the frame that uses in the interframe correlative coding of the present invention to the frame correlation piece;

Fig. 3 is according to the Y correlation piece selection of interframe correlative coding of the present invention and the schematic flow sheet of authentication code;

Fig. 4 is the schematic flow sheet according to interframe correlative coding UV correlation piece selection according to the present invention and authentication code;

Fig. 5 is the schematic diagram according to the Bit-Rate Control Algorithm register in the interframe correlative coding of the present invention.

Embodiment

For the ease of understanding concrete technical scheme of the present invention, at first related concrete technological concept is defined.

Definition:

Quantization---information translation is become the discrete form different with original form.Can be become 2,4,6 by quantization with following algorithm such as 0,1,2,3,4,5,6.

If(input?value)<4?then(output?value)＝2：GoTo?End

If(input?value)>3?AND(input?value)<6?then(output?value)＝4?Else

(output?value)＝6

End

Quantizer---the instrument or the algorithm of a kind of formation quantization (discrete form) information.

The result who differs from or subtract each other of residual quantity---two numerical value.

Such as, A=(B-C) expression A is the residual quantity of B and C.If B is greater than C, the residual quantity value is a positive number so.If C is greater than B, the residual quantity value is for negative.

Correlation---passing threshold or side-play amount are to the comparison of two numerical value.If two numerical value are by increasing or reducing certain threshold value and consistent, they can be called as relevant.

Coefficient correlation---be used for the threshold value or the deviate that compare in correlation.

Redundancy value---certain data in one group of information that is expressed as special value are called as redundancy, if it constantly repeats in these group data.

Such as, information sets={ 1,2,3,0,0,0,0,0,0,0,2}: numerical value 0 is a high redundancy value, and 2 are one slight redundancy is arranged.Can the be pressed row principle compression of this redundant information:

Numerical value Binary code The long code of variable bit

0 00 0

1 01 011

2 10 01

3 11 111

Need use 2 X 11=22 positions in order to use binary code recorded information group.

Variable code will be (1 X 7)+(2 X 2)+(2 X 3)=17.Because the existence of redundant elements in information sets is collapsed into possibility.

YUV-Y is brightness, and UV is a color component.YUV also can represent by Y, Cr, three variablees of Cb.

YUV color coordinates---(being also referred to as Y, Cr, Cb) VICOMP uses the YUV color coordinates, so that utilize color component (U﹠amp by with respect to the Y sample U and V sample being carried out double sampling; V) intrinsic low frequency.Human eye also has different to the susceptibility of Y (brightness) and UV (color) component.

Frequency domain---most of information comprise video information, are in time domain, that is to say that the amplitude of information changed according to the time.Frequency is the inverse of time: F=1/T, T=1/F.Information can be transformed into frequency domain from time domain by Fourier transform (FFT).Fast fourier transform is used in video coding, is exactly discrete cosine transform (DCT) such as the MPEG technology.In time domain, given one group of information (within a certain period of time) can obtain the amplitude of some.In frequency domain, given one group of information (in specific frequency domain bandwidth) can obtain the frequency of some.Because some vision signals contain a large amount of low frequency components more, a large amount of redundancies is arranged in frequency domain so can know information.

Fig. 1 realizes block diagram for the typical case of VICOMP encoder.The lower part of Fig. 1 shows common logic and memory unit (General Logic), they be in video coding and decoding usually and the parts that adopted as usual.To these common and adopted as usual parts, no longer be described such as memory, buffer (memory of another kind of form), counter, register and interface.The structure of these General Logic parts and function are known to the those of ordinary skill in logical design field.

Slightly different ordinary parts of this General Logic are " position wrapper (BitPacker).A position wrapper is the device that is used for will vary bit length coded combination to a bit stream that adjoins.Usually computer data comprises fixed bit length composition, byte (8), word (16) and double word (32).Because the output that the variable bit coding produces all lengths, so these codings must be by " packing " in the stream that adjoins.Carrying out the device " position wrapper " of this function does not describe at this as part of the present invention.

The going up of this block diagram (mainly) partly (arthmetic statement) shows video stream by the various processing of forming this video coding system.These parts are parts of the present invention and describe in detail in this article.These detailed descriptions comprise literal, logic flow diagram and logical statement.The algorithm of VICOMP can utilize suitable computer to be realized by software, this computer have the interface of input side and digitized video and at outlet side to the appropriate display device.The algorithm of this VICOMP also can specific hardware logic blocks realize, for example will be used in application-specific integrated circuit (ASIC) (ASIC) semiconductor like that.

The purpose of Y and UV filter is to reduce noise and improves signal to noise ratio.Any improvement to signal to noise ratio all will cause better coding result (more compression), because the noise that is included in the video is asynchronous (at random) with respect to video, the noise in being included in video can not be effectively incompressible.

The following describes the embodiment of frame of the present invention to the correlative coding of frame.

In common real-time video, the video of a frame and the next one have very high correlation.That is to say that some elements in the frame are identical or very close with the respective element in the former frame.The interframe redundancy that this mentioned just.As shown in Figure 2, VICOMP of the present invention compares all fritters of the wide * 2 pixel height of 3 pixels (6 pixel) in the present frame and these block of pixels in the former frame.The frame-to-frame correlation information that is used for Y is what to be separated with the frame-to-frame correlation information that is used for UV.Even using these small pixel pieces has guaranteed when correlated error occurs, relatively other coding methods, such as use 8 X 8 (64 pixel) or even the employed bigger block of pixels relatively of DCT system of 16 X 16 (256 pixels), also to almost not influence of visual effect.

Frame can be by following algorithmic descriptions to the correlation of frame.Wherein, CB represents current piece, and PB represents the piece of former frame, and CC represents the coefficient correlation of Y, and UVerr is the coefficient correlation of U and V.In 9 block of pixels of former frame each all compares with current block, begins with PB0, compares.If find in preceding frame any one coupling in 9 pieces, then a sign (PB0flg-PB8flg), an and sign (PB0UVflg-PB8UVflg) is set for UV mates is set for the Y coupling.The meaning of Abs () is for getting the absolute value (no symbol) of () interpolation.T represents that is recorded in the counter how many pixel couplings are arranged in the block of pixels.Pmtch is one and is complementary even without pixel and still can sets variable to allow to be correlated with.Such as, if Pmtch is configured to 5,, allow coupling if then have 5 to coincide in 6 pixels.If Pmtch is configured to 6, all 6 pixels must be mated so.Each pixel Y and CC comparison, the value of hiYi are represented the maximum Y value in the piece and are used for and (CC*2) comparison.

PB0 Y is relevant

Yi0＝abs(CBP0-PB0P0)

Yi1＝abs(CBP1-PB0P1)

Yi2＝abs(CBP2-PB0P2)

Yi3＝abs(CBP3-PB0P3)

Yi4＝abs(CBP4-PB0P4)

Yi5＝abs(CBP5-PB0P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)then?PB0Yflg＝1?else?PB0Yflg＝0

PB1Y is relevant

Yi0＝abs(CBP0-PB1P0)

Yi1＝abs(CBP1-PB1P1)

Yi2＝abs(CBP2-PB1P2)

Yi3＝abs(CBP3-PB1P3)

Yi4＝abs(CBP4-PB1P4)

Yi5＝abs(CBP5-PB1P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKrow>0?AND?BLKcnt>0?then?PB1Yflg＝1

else?PB1Yflg＝0

PB2 Y is relevant

Yi0＝abs(CBP0-PB2P0)

Yi1＝abs(CBP1-PB2P1)

Yi2＝abs(CBP2-PB2P2)

Yi3＝abs(CBP3-PB2P3)

Yi4＝abs(CBP4-PB2P4)

Yi5＝abs(CBP5-PB2P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKrow>0?then?PB2Yflg＝1?else?PB2Yflg＝0

PB3Y is relevant

Yi0＝abs(CBP0-PB3P0)

Yi1＝abs(CBP1-PB3P1)

Yi2＝abs(CBP2-PB3P2)

Yi3＝abs(CBP3-PB3P3)

Yi4＝a?bs(CBP4-PB3P4)

Yi5＝abs(CBP5-PB3P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKrow>0?AND?BLKcnt<BLKmax?then

PB3Yflg＝1?else?PB3Yflg＝0

PB4Y is relevant

Yi0＝abs(CBP0-PB4P0)

Yi1＝abs(CBP1-PB4P1)

Yi2＝abs(CBP2-PB4P2)

Yi3＝abs(CBP3-PB4P3)

Yi4＝abs(CBP4-PB4P4)

Yi5＝abs(CBP5-PB4P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKcnt>0?then?PB4Yflg＝1?else?PB4Yflg＝0

PB5Y is relevant

Yi0＝abs(CBP0-PB5P0)

Yi1＝abs(CBP1-PB5P1)

Yi2＝abs(CBP2-PB5P2)

Yi3＝abs(CBP3-PB5P3)

Yi4＝abs(CBP4-PB5P4)

Yi5＝abs(CBP5-PB5P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKcnt<BLKmax?then?PB5Yflg＝1?else

PB5Yflg＝0

PB6Y is relevant

Yi0＝abs(CBP0-PB6P0)

Yi1＝abs(CBP1-PB6P1)

Yi2＝abs(CBP2-PB6P2)

Yi3＝abs(CBP3-PB6P3)

Yi4＝abs(CBP4-PB6P4)

Yi5＝abs(CBP5-PB6P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKcnt>0?and?BLKrow<ROWmax?then

PB6Yflg＝1?else?PB6Yflg＝0

PB7Y is relevant

Yi0＝abs(CBP0-PB7P0)

Yi1＝abs(CBP1-PB7P1)

Yi2＝abs(CBP2-PB7P2)

Yi3＝abs(CBP3-PB7P3)

Yi4＝abs(CBP4-PB7P4)

Yi5＝abs(CBP5-PB7P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKrow<ROWmax?then?PB7Yflg＝1?else

PB7Yflg＝0

PB8 is relevant

Yi0＝abs(CBP0-PB8P0)

Yi1＝abs(CBP1-PB8P1)

Yi2＝abs(CBP2-PB8P2)

Yi3＝abs(CBP3-PB8P3)

Yi4＝abs(CBP4-PB8P4)

Yi5＝abs(CBP5-PB8P5)

T＝0

hiYi＝0

If?Yi0>hiYi?then?hiYi＝Yi0

If?Yi0<CC?then?T＝T+1

If?Yi1>hiYi?then?hiYi＝Yi1

If?Yi1<CC?then?T＝T+1

If?Yi2>hiYi?then?hiYi＝Yi2

If?Yi2<CC?then?T＝T+1

If?Yi3>hiYi?then?hiYi＝Yi3

If?Yi3<CC?then?T＝T+1

If?Yi4>hiYi?then?hiYi＝Yi4

If?Yi4<CC?then?T＝T+1

If?Yi5>hiYi?then?hiYi＝Yi5

If?Yi5<CC?then?T＝T+1

If?T＝>Pmtch?AND?hYi<(CC＊2)AND?BLKcnt<BLKmax?AND?BLKrow<ROWmax

then?PB8Yflg＝1?else?PB8Yflg＝0

PB0UV is relevant

Uerr＝abs(CBU-PB0U)

Verr＝abs(CBV-PB0V)

If?Uerr<UVerr?AND?Verr<UVerr?then?PB0UVflg＝1else?PB0UVflg＝0

PB1UV is relevant

Uerr＝abs(CBU-PB1U)

Verr＝abs(CBV-PB1V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKrow>0?AND?BLKcnt>0?then

PB1UVflg＝1?else?PB1UVflg＝0

PB2 UV is relevant

Uerr＝abs(CBU-PB2U)

Verr＝abs(CBV-PB2V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKrow>0?then?PB2UVflg＝1?else

PB2UVflg＝0

PB3 UV is relevant

Uerr＝abs(CBU-PB3U)

Verr＝abs(CBV-PB3V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKrow>0?AND?BLKcnt<BLKmax?then

PB3UVflg＝1?else?PB3UVflg＝0

PB4 UV is relevant

Uerr＝abs(CBU-PB4U)

Verr＝abs(CBV-PB4V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKcnt>0?then?PB4UVflg＝1?else

PB4UVflg＝0

PB5 UV is relevant

Uerr＝abs(CBU-PB5U)

Verr＝abs(CBV-PB5V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKcnt<BLKmax?then?PB5UVflg＝1?else

PB5UVflg＝0

PB6 UV is relevant

Uerr＝abs(CBU-PB6U)

Verr＝abs(CBV-PB6V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKcnt>0?and?BLKrow<ROWmax?then

PB6UVflg＝1?else?PB6UVflg＝0

PB7 UV is relevant

Uerr＝abs(CBU-PB7U)

Verr＝abs(CBV-PB7V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKrow<ROWmax?then?PB7UVflg＝1?else

PB7UVflg＝0

PB8 UV is relevant

Uerr＝abs(CBU-PB8U)

Verr＝abs(CBV-PB8V)

If?Uerr<UVerr?AND?Verr<UVerr?AND?BLKcnt<BLKmax?AND?BLKrow<

ROWmax?then?PB8UVflg＝1?else?PB8UVflg＝0

Above-mentioned parameter " BlkRow ", " BlkCnt ", " BlkMax ", " RowMax " etc. be used to delimiter is checked, so that guarantee that checked is in esse and not beyond the border of associated frame.

Referring to Fig. 2, for example, as the PB1 that checks in moving ahead (row), PB2, or during the correlation of PB3, should guarantee that current line is not first row, is moving ahead otherwise will not have this.Similarly, PB6 in checking next line, PB7, or during the correlation of PB8, should guarantee that current line is not the last column in the respective frame, otherwise not have this next line.

In like manner, when checking PB1, PB4, the or during correlation of PB6, should guarantee that PB0 is not the primary importance of respective frame starting end, perhaps when checking PB3, PB5, or during the correlation of PB8, should guarantee that PB0 is not the rearmost position that respective frame finishes end.

More particularly, the numbering of " BlkRow " expression current line, the numbering of current block in " BlkCnt " expression row, the numbering of last piece in " BlkMax " expression row, and, the numbering of last column in " RowMax " expression respective frame.

After Y and UV correlation have been set up corresponding sign (PB0flg-PB8flg and PB0UVflg-PB8UVflg), the related pixel piece is selected and further utilizes intermediate code (Code) to discern, as Fig. 3 (Y relevant) and Fig. 4 (UV is relevant) always shown in the logical flow chart.

As the part of interframe correlated process, VICOMP uses a kind of reponse system that is called Bit-Rate Control Algorithm.This reponse system keeps following the tracks of the intermediate code result and increases automatically or reduce coefficient correlation (CC and the UVerr that is used for UV that are used for Y) influencing coding result.

The Bit-Rate Control Algorithm reponse system is the feature that design is used for utilizing some human vision response system.The human needs makes the vision response system focus on the regular hour.Therefore, the vision response system can not focus on the object of high-speed mobile.A kind of method that this phenomenon is described spreads one's fingers exactly, brandishes your hand in the presence of fast.The vision response system can obtain enough information and pick out your finger, but can not see when static with hand or the slow details of the same clearly some hands when mobile.Cause this phenomenon to be because the continuity (inertia) of naked eyes optics sense organ.This continuity has caused the smudgy of details.When hand stops, naked eyes progressively see all details.

In sport video, when frame-to-frame correlation is very low, mean at present frame and former frame to have very significant variation.This usually occurs in a) object in high-speed motion, or b) unexpected scene in editing process changes.When fast moving, just as the above example of brandishing hand fast, the details that shows all mobile objects is (even not being considered in interlaced scan tv) that there is no need fully.When existing unexpected scene to change in video flowing, unnecessary first frame that changes in scene just shows all details simultaneously, because there is time-lag action (continuity) in the human vision reaction system.On the contrary, for the human vision reaction system, it is complete acceptable that the details of new scene is taken in the picture step by step by several frames.

This phenomenon is very familiar for video (and film) editor, uses and gradually to withdraw from previous scene, and progressively cutting new scene simultaneously, to edit that scene changes be very general.The technology of this " progressive " usually will be through 5 to 7 frames.Simultaneously well-known, thisly progressively do not discovered for spectators.In some cases, such as entering into very bright scene from dim scene, " progressive " technology of use is very necessary, makes spectators more comfortable because handle like this than flip-flop brightness.This is because provide the more sufficient adjustment time to iris.

Therefore, temporarily lose some details (in several frames) no matter sudden change all is an acceptable to the object in the high-speed motion or the scene that happens suddenly.When frame-to-frame correlation is lower in some picture region, the Bit-Rate Control Algorithm reponse system can interim increase coefficient correlation to reduce the accuracy of correlation, can reduce bits of coded like this.When frame-to-frame correlation than higher, the Bit-Rate Control Algorithm reponse system can reduce coefficient correlation to improve the accuracy of correlation.Its purpose is to keep a constant coding bit rate, and can not lose any perceivable information.

Coefficient correlation can be adjusted (increase or reduce) many times in the cataloged procedure of a frame.The actual frequency of adjusting is the function of setting of the control register of a kind of AlphaRow of being called as (ALR).Can be configured to 1,2 or 4 row (each row comprises two row pixels).Suppose the picture of the VGA size of one 640 X 480 pixels, delegation's (2 pixel columns) comprises 1280 pixels or accounts for 0.416% of entire frame, and four lines (8 pixel columns) comprises 5120 pixels or accounts for 1.66% of entire frame simultaneously.Be used to measure the size of bits of coded by change, according to the setting of AlphaRow, when each frame coding can be from 240 times/framing control to 60 time/frame, adjusting number of times can be determined.

Another control register that is applied to Bit-Rate Control Algorithm is called AlphaSize (Asz).AlphaSize multiply by 32, corresponding to being used for the one-row pixels desirable figure place of encoding.Such as, if wish the picture of one 640 X 480 sizes is kept the compression ratio (about 0.5/pixel) of 30:1, that is to say that hope obtains the coding of the position of every row about 640.In this case, AlphaSize can be set to 640/32=20.

For fear of undesirable vibration takes place in feedback loop, used another to be called the control register of AlphaStep (Astp).AlphaStep also is 1/32 of an actual value.Take seriously actual coding position and AlphaSize relatively, and this deviation of AlphaStep is used to guarantee to exist between actual coding position and the AlphaSize difference of this quantity of AlphaStep.In fact, before comparison, AlphaStep is added to AlphaSize and goes up or therefrom deduct.Such as, if AlphaSize be set to 20 and AlphaStep be set at 4, before any adjustment to coefficient correlation took place, the quantity of actual coding position must surpass 640+128 (=768), perhaps less than 640-128 (=512).

Coefficient correlation is set to two values: maximum (CoeffMAX) and minimum value (CoeffMIN).Coefficient correlation can be adjusted upward to CoeffMAX by Bit-Rate Control Algorithm, perhaps adjusts to CoeffMIN downwards.Be adjusted at each sampling (setting) back and take place, and CoeffStep determines each amount of adjusting by AlphaRow.In fact, CoeffStep is a gain or an amplification coefficient that acts on feedback loop.If CoeffStep is configured to 0, will cancel feedback loop.Simultaneously, if CoeffMAX and CoeffMIN are configured to same value, feedback loop is with inoperative.Actual coefficient correlation (CC) is always determined by the Bit-Rate Control Algorithm system.

Fig. 5 shows various Bit-Rate Control Algorithm register of the present invention.

Provide QdY below, some object lessons of QdU and QdV coding about frame-to-frame correlation.

(variable bit long code)

The block identification sign indicating number

(Y and UV)

If UVcorr=1 AND Ycorr=1 then CorHdr=0 is correlated with

If UVcorr=1 AND Ycorr=0 then CorHdr=01 only UV is relevant

If UVcorr=0 AND Ycorr=1 then CorHdr=011 only Y is relevant

If UVcorr=0 AND Ycorr=0 then CorHdr=111 is uncorrelated

NoCorr QdU and V code NoCorr QdY (3 pixel) code QdY code

The block encoding that provides associated row (Row) is below given an example:

(in the example shown, press the MSB.......LSB order: in bit stream, LSB at first arrives)

NoCorr?Y，NoCorr?UV

QdV，QdU，Map?Code(Bot?3?Pix)，Map?Code(Top?3?Pix)， 111

x0，x01，x?xxxx01，x0，111 (14)

Corr?Y，NoCorr?UV

QdV，QdU，Y＝PB0， 011

x0，x01，0，011 (6)

NoCorr?Y，Corr?UV

UV＝PB4，Map?Code(Bot?3?Pix)，Map?Code(Top?3?Pix)， 01

100，x0，x?xxxx01，01(12)

Corr?Y，Corr?UV

UV＝PB0，Y＝PB0， 0

0，0，0(3)(min)

NoCorr?Y，NoCorr?UV

QdV，QdU，NoMap(Bot?3?Pix)，NoMap(Top?3?Pix)， 111

ax1111，ax1111，yyyy?yyyy?yyyy11111，yyyy?yyyy?yyyy11111，111?(46)?(max)

The useful technique effect of the interframe correlative coding method and apparatus among the explained later VICOMP of the present invention.

Every group of information all has average information theoretical in certain.That is to say that one group of given information has the position that some need represent the irreducible quantity of this information sets, or average information.Frame of video, or block of pixels are not unified information sets.Always there is to a certain degree changeability in information sets with respect to another information sets.(in a frame) and interframe in the frame (from a frame to another frame) all have this changeability.The coding result of DCT (discrete cosine coding) and VICOMP all is variable.For the low video of information content amount, the DCT coding is more effective, but for the big video of information content amount, VICOMP is much effective.

An example of low amount of video information is the TV gamma camera that focuses on bright, white paper blank.An example of high amount of video information is the colored grove with little tree page or leaf.

The DCT coding is based on a kind of like this hypothesis, that is: small pixel piece (for example 8 X 8) will mainly comprise low frequency component and therefore have the redundancy of a great deal of at frequency domain, so created the chance of effective compression scheme.When this is assumed to be true time (low amount of video information), then DCT is effective.When this hypothesis is not true time (a high amount of video information), then DCT is invalid.For example, the test that utilizes the DCT encoder that still picture (single frames) is carried out shows that compression ratio is changed to: high 95.7:1, low 3.2:1.And the compression ratio that the VICOMP encoder obtains is that 37.8:1 (height) is to 17.4:1 (low).

Because system design considers that (for example bandwidth chahnel that is distributed) must be based on " worst-case " (referring to high amount of video information), so the VICOMP encoder is more effective.

And in sport video, there is the interframe redundancy in expectation.But,, for example cause that by the scene change that switches maybe when carrying out quick convergent-divergent, the interframe redundancy is low when existing unexpected scene to interrupt.Use (for example DVD) for prerecord, unexpected scene is interrupted and can be edited, and can improve the interframe redundancy.But not all video can both be by editor to improve the interframe redundancy.VICOMP utilizes just relevant at present frame and the interframe between preceding frame.This compression that usually only produces about 2:1 increases, but coding is consistent, and interrupts and/or the high amount of video information of quick convergent-divergent or other types does not produce passage and overflows for the scene of not edited.VICOMP keeps high compression ratio to all types of videos (especially high amount of video information), and does not use motion compensation.

Though above-mentioned frame-to-frame correlation coding carries out exemplary illustration in conjunction with program step, but, those skilled in the art understand, and can realize each feature operation in the above-mentioned frame-to-frame correlation coding with various hardware capability modules known in this field and commonly used.For example, can realize the calculating of pixel value, use the memory cell such as register to store each pixel value and parameter value etc., and realize various compare operations with comparator with various suitable computing hardware capability unit.In other words, the above-mentioned frame-to-frame correlation coding method of uniqueness of the present invention can realize with software, hardware or both combinations.Therefore, the present invention also provides a kind of code device that can be used for realizing the frame-to-frame correlation coding among the above-mentioned VICOMP.

The present invention is described in detail in conjunction with embodiment; but those skilled in the art understand, and protection scope of the present invention is not limited to the details in the above-mentioned execution mode; under the prerequisite that does not deviate from principle of the present invention and spirit, also there are various distortion and change.Therefore, protection scope of the present invention is limited by following claim.

Claims (7)

1. one kind is utilized vision signal interframe correlation to carry out Methods for Coding in video coding is handled, and comprises step:

Utilize predefined matched rule to judge the correlation circumstance of the consecutive frame of vision signal, carry out the interframe correlative coding based on the correlation circumstance of being judged;

Wherein, the step of the consecutive frame correlation circumstance of described judgement vision signal comprises step:

Described consecutive frame is divided into the block of pixels of equal number respectively, and judges respectively whether the luminance Y component of corresponding block of pixels in these two frames and color UV component mate; Obtain the correlation situation of each block of pixels according to above-mentioned matching judgment result, and, determine the correlation circumstance of consecutive frame based on block of pixels correlation situation;

Wherein, describedly judge that the luminance Y component of corresponding block of pixels in these two frames and the step whether color UV component mates comprise:

Each frame is divided into 9 block of pixels, and comprise 6 Y components in each block of pixels, 1 U component and 1 V component, for each block of pixels is provided with Y component match flag and U respectively, V component match flag, and setting is respectively applied for the coefficient correlation and the U of Y component, the coefficient correlation of V component, and coupling count value T and correlated variables Pmtch about the pixel quantity of the coupling of Y component be set in each block of pixels of expression, for each block of pixels in the frame, calculate in described each block of pixels and the previous frame in the corresponding block of pixels 6 Y components and U respectively, the difference of V component;

Carry out following operation according to result of calculation:

For the Y component, when corresponding to certain difference of the Y component of certain block of pixels less than Y component coefficient correlation, then the T value is increased progressively 1, if the end value of T more than or equal to correlated variables and the maximum Y value of maximum value that equals each Y component difference less than 2 times of Y component coefficient correlation, then the Y component match flag corresponding to this block of pixels is set to coupling

For the UV component, if distinguish all less than U, V component coefficient correlation corresponding to the U of certain block of pixels, the difference of V component, then U, the V component match flag corresponding to this block of pixels is set to coupling.

2. the method for claim 1 also comprises step:

If the Y component of certain block of pixels of former frame and present frame and/or UV component mate respectively, then replace the Y component and/or the UV component of present frame respectively with the value of the Y component of the corresponding block of pixels of previous frame and/or UV component.

3. as each described method among the claim 1-2, wherein, adjust Y component coefficient correlation and UV component coefficient correlation, thereby realize bit rate FEEDBACK CONTROL described interframe correlative coding according to interframe correlation circumstance judged result.

4. method as claimed in claim 3 wherein, when judging that frame-to-frame correlation is low, increases described coefficient correlation, and, when judging that frame-to-frame correlation is high, reduce described coefficient correlation.

5. method as claimed in claim 3, wherein, be provided with expression described Y component and UV component coefficient correlation controlled number of times in the cataloged procedure of single frame first Control Parameter, be used to represent one-row pixels encode desirable figure place second Control Parameter and represent the figure place of described hope and the 3rd Control Parameter of the difference between the actual number of bits so that realize described bit rate FEEDBACK CONTROL.

6. method as claimed in claim 5, wherein, described first Control Parameter is set to 1,2 or 4, and described second Control Parameter is set to 20, and described the 3rd Control Parameter is set to 4.

7. code device, its utilize as above-mentioned claim 1-6 in the method described in each realize the frame-to-frame correlation coding of video information.

Images