CN100433835C - Method and system for dynamically adjusting motion estimation - Google Patents

Method and system for dynamically adjusting motion estimation Download PDF

Info

Publication number
CN100433835C
CN100433835C CNB2005100087006A CN200510008700A CN100433835C CN 100433835 C CN100433835 C CN 100433835C CN B2005100087006 A CNB2005100087006 A CN B2005100087006A CN 200510008700 A CN200510008700 A CN 200510008700A CN 100433835 C CN100433835 C CN 100433835C
Authority
CN
China
Prior art keywords
motion vector
search area
scope
mode
default
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2005100087006A
Other languages
Chinese (zh)
Other versions
CN1829325A (en
Inventor
林俊宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sunplus Technology Co Ltd
Original Assignee
Sunplus Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sunplus Technology Co Ltd filed Critical Sunplus Technology Co Ltd
Priority to CNB2005100087006A priority Critical patent/CN100433835C/en
Publication of CN1829325A publication Critical patent/CN1829325A/en
Application granted granted Critical
Publication of CN100433835C publication Critical patent/CN100433835C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention relates to a dynamic adjustment movement estimated method and a system. A search range is arranged in a previous frame. The motion vector of a current frame is determined by finding a corresponding macroblock in the search range according to each macroblock of the current frame. Motion vector is determined by a target macroblock of the current frame and a reference macroblock in the search range of the previous frame. A compression mode of the target macroblock is determined by the target macroblock, the reference macroblock and the motion vector. A search range is determined by stored mode data and the motion vector to obtain high efficiency image compression under a state that calculation quantity is saved and frequency bandwidth is used.

Description

Dynamically adjust the method and system of estimation
Technical field
The present invention relates to a kind of method for estimating and system, particularly relate to a kind of method and system of dynamic adjustment estimation.
Background technology
At international video compression standards (MPEGx, H.26x) in, interframe (inter-frame) Predicting Technique of the estimation (motion estimation) of use piece coupling (blockmatching) has been widely used for reaching the high efficiency coding to moving image data, the process of interframe encode as shown in Figure 1 (inter-frame coding), wherein, mpeg system is many macro block (MacroBlock with the frame cutting, MB), suppose that previous frame 11 (Previous Frame) is I-Frame or P-Frame, present frame 12 is P-Frame, the mode of coding is that each macro block 101 ' of previous frame 11 is obtained its motion vector (Motion Vector, MV), in view of the above previous frame 11 is carried out estimation and obtains a predictive frame 13, again predictive frame 13 is compared with present frame 12 and obtain a difference frame 14, in view of the above, when transmission or storage, only need possess motion vector and difference frame 14 can be reached the purpose of effective compression, and when decompressing, send motion vector and difference frame 14 to the MPEG decoder, can in previous frame 11, read corresponding macro block according to motion vector, add the macro block of difference frame 14, the macro block of promptly reducible present frame 12.
With reference to shown in Figure 2, aforesaid estimation is according to each macro block 101 of present frame 12 and formerly to find corresponding macro block 101 ' in the search area 111 in the frame 11, and can learn the mobile behavior of this macro block 101 ', and then determines its motion vector.Because estimation need be carried out the comparison of macro block, therefore, it accounts for operand and the very big ratio of frequency range in video compression, and wherein the setting of search area 111 promptly is main factor, when search area 111 is excessive, will cause wasting amount of calculation and make compression usefulness not remarkable, otherwise, when search area 111 is too small, will cause to search corresponding macro block and the decline that causes compression factor.Therefore, how to determine a suitable search area 111 to be actually an epochmaking problem.
For correctly determining a search area, Fig. 3 shows a kind of known way, wherein before be temporarily stored in the motion vector internal memory 31 through the motion vector MV that estimation determined by the reference macroblock 101 ' in input target macroblock 101 and the search area 111, when carrying out estimation, to select a search area (1 ~ N) according to the previous motion vector MV that is stored in motion vector internal memory 31 by input target macroblock 101 and reference macroblock 101 ' in the search area 111 current.This way is owing to only use motion vector rice to adjust search area, therefore, when running into scene for example and change background that (Scene change) or last scene covered etc. than complex video, because the difference of previous frame and present frame is excessive, can't effectively predict correct search area, on the other hand, when only adjusting search area with motion vector, easily because of the inaccurate instability that causes search area to adjust of estimation, thereby cause the instability of squeezed quality.
Summary of the invention
Main purpose of the present invention is to provide a kind of method and system of dynamic adjustment estimation, thereby can reach high efficiency image compression saving operand (saving consumed power) and using under the situation of frequency range.
According to an aspect of the present invention, a kind of system of dynamic adjustment estimation is proposed, in order in former frame, to set a search area, in this search area, to find corresponding macro block to decide its motion vector according to each macro block of a present frame, this system comprises: a motion estimation unit, and it is in order to decide a motion vector by the reference macroblock in the search area of target macroblock of present frame and former frame; One pattern decision unit, it decides the compact model of this target macroblock by this target macroblock, reference macroblock and motion vector, and exports corresponding mode data; One mode memory cell, it is in order to store the mode data that this pattern decision unit is exported; One motion vector memory cell, it is in order to store the motion vector that this motion estimation unit determines; And a search area decision unit, it is in order to decide a search area according to this mode memory cell stored mode data and the stored motion vector of motion vector memory cell.
According to a further aspect in the invention, a kind of method of dynamic adjustment estimation is proposed, in order in former frame, to set a search area, to find corresponding macro block to decide its motion vector in this search area according to each macro block of a present frame, the method comprising the steps of: (A) decide a motion vector by the reference macroblock in the search area of target macroblock of present frame and former frame; (B) decide the compact model of this target macroblock by this target macroblock, reference macroblock and motion vector, and export corresponding mode data; (C) store the mode data that this pattern decision unit is exported; (D) motion vector that stores this motion estimation unit and determined; And (E) determine a search area according to these mode of storage data and motion vector.
Description of drawings
Fig. 1 shows the process of known interframe encode.
Fig. 2 shows the process of known estimation.
Fig. 3 is for determining the schematic diagram of a search area in known estimation.
Fig. 4 is the Organization Chart of the system of dynamic adjustment estimation of the present invention.
Fig. 5 carries out the schematic diagram of estimation for motion estimation unit.
Fig. 6 shows an operation workflow of search area decision unit.
Fig. 7 shows another operation workflow of search area decision unit.
Embodiment
The method and system of relevant dynamic adjustment estimation of the present invention, please be earlier with reference to system architecture diagram shown in Figure 4, it comprises a motion estimation unit 41, pattern decision unit 42, a mode memory cell 43, a motion vector memory cell 44 and search area decision unit 45.Wherein, motion estimation unit 41 is in order to decide a motion vector MV by the reference macroblock (Reference MBs) in the search area of the target macroblock (Target MB) of present frame and former frame, and please refer to shown in Figure 5, the difference value of brightness the Y1 ' ~ Yn ' of the reference macroblock in the brightness Y that motion estimation unit 41 is calculated target macroblock earlier and the corresponding search area, wherein the calculating of difference value can be adopted known absolute difference and (Summed Absolute Difference, SAD), (compare among the Y1-SAD ~ Yn-SAD) in the luminance difference value of being calculated again, and, obtain its motion vector (MV) according to this by wherein finding out minimum difference value.And when determining the motion vector MV of a macro block, previous mode decision unit 42 has also determined that by target macroblock, reference macroblock and motion vector MV this target macroblock is with which kind of pattern to compress, and the corresponding mode data of output, in the middle of, possible pattern comprises: (intra), Zero-code piece pattern (zero codedblock pattern, zero cbp) in the frame, skip (skipped), directly (direct mode), absolute difference and (SAD), (intra variance), macro block position (MB bits) etc. in the difference.The mode data that previous mode memory cell 43 is exported in order to storage mode decision unit 42,44 motion vector MV that determined in order to storage motion estimation unit 41 of aforementioned movement vector memory cell.
Aforementioned search area decision unit 45 is in order to dynamically to determine a search area according to the stored mode data of this mode memory cell 43 and motion vector memory cell 44 stored motion vector MV, carry out estimation for this motion estimation unit 41, Fig. 6 shows an operation workflow of this search area decision unit 45, it is at first calculated the mean value MV_AVG of the motion vector of former frame by this motion vector memory cell 44 stored motion vector MV, and calculate number N _ Intra (step S61) by these mode memory cell 43 stored mode datas with the macro block of intra mode compression, because the mean value of motion vector can be represented the displacement of video data, and can't find corresponding macro block and compress with internal data in search area with the representative of the macro block of intra mode compression, therefore, at the mean value MV_AVG of motion vector greater than a search area critical value TH_LSR, or with the number N _ Intra of the macro block of intra mode compression greater than on the motion vector during critical value TH_MVHIGH (step S62), the displacement of expression video data is big, or search area is too small and be difficult to find corresponding macro block, therefore need search area is strengthened (step S64), if not above-mentioned situation and with the number N _ Intra of the macro block of intra mode compression during less than a motion vector lower critical value TH_MVLOW (step S63), the displacement of expression video data is little and be that search area is excessive, therefore search area need be reduced (step S66), otherwise, search area remain unchanged (step S605).In view of the above, this search area decision unit 45 can dynamically determine a suitable search area according to the compression scenario of reality, carries out estimation for this motion estimation unit 41.
Fig. 7 shows another example of the operation workflow of aforementioned search area decision unit 45, it mainly decides a suitable search area according to the motion vector and the employed compact model of former frame in regular turn, as shown in the figure, its at first calculate by this motion vector memory cell 44 stored motion vector MV former frame motion vector mean value MV_AVG and at this mean value MV_AVG during greater than one first critical value TH_1, setting search area is default first scope (step S71); Otherwise calculate by this motion vector memory cell 44 stored motion vector MV former frame motion vector mean difference value SAD_AVG and at this mean difference value SAD_AVG during greater than one second critical value TH_2, setting search area is default second scope (step S72); Otherwise calculated by these mode memory cell 43 stored mode datas with the number N _ Intra of the macro block of intra mode compression and at this number N _ Intra during greater than one the 3rd critical value TH_3, setting search area is default the 3rd scope (step S73); Otherwise calculated by these mode memory cell 43 stored mode datas with the average cbp value of the macro block of zero cbp mode compression and in this average cbp value during greater than one the 4th critical value TH_4, setting search area is default the 4th scope (step S74); Last calculating by these mode memory cell 43 stored mode datas with the number N _ Skip of the macro block of skipped mode compression and at this number N _ Skip during greater than a N critical value TH_N, setting search area is a default N scope (step S75), otherwise set search area is a default N+1 scope (step S76), wherein aforementioned first to the N scope be designed to first scope>second scope>the 3rd scope>...>the N scope>N+1 scope.
By above explanation as can be known, the present invention utilizes a simple and effective processing judgment mechanism, directly the mobile search range size at entire frame adjusts, according to the mean value of the motion vector of previous predictive coding scene and in total number of macro block or the compact model of former frame, judge the mobile search scope of present image scene, and can save operand (saving consumed power) and use under the situation of frequency range, reach high efficiency image compression.
The foregoing description is only given an example for convenience of description, and the interest field that the present invention advocated should be as the criterion so that claim is described certainly, but not only limits to the foregoing description.

Claims (16)

1. system that dynamically adjusts estimation, in order to setting a search area in former frame, to find corresponding macro block to decide its motion vector in this search area according to each macro block of a present frame, this system comprises:
One motion estimation unit, it is in order to decide a motion vector by the reference macroblock in the search area of target macroblock of present frame and former frame;
One pattern decision unit, it is determined the compact model of this target macroblock by this target macroblock, reference macroblock and motion vector, and the corresponding mode data of output;
One mode memory cell, it is in order to store the mode data that this pattern decision unit is exported;
One motion vector memory cell, it is in order to store the motion vector that this motion estimation unit determines; And
One search area decision unit, it is in order to determine a search area according to this mode memory cell stored mode data and the stored motion vector of motion vector memory cell.
2. the system of dynamic adjustment estimation as claimed in claim 1, wherein, this search area determines unit to be calculated the mean value of the motion vector of former frame by the stored motion vector of this motion vector memory cell, reaches the number that is calculated the macro block that compresses with frame mode by the stored mode data of this mode memory cell, with the mean value of this motion vector greater than a default search area critical value or with the number of the macro block of frame mode compression greater than a default motion vector on during critical value, this search area is strengthened.
3. the system of dynamic adjustment estimation as claimed in claim 2, wherein, this search area decision unit is not more than this search area critical value and, this search area is reduced during less than a default motion vector lower critical value with the number of the macro block of frame mode compression at the mean value of this motion vector.
4. the system of dynamic adjustment estimation as claimed in claim 1, wherein, this search area decision unit calculate by the stored motion vector of this motion vector memory cell former frame motion vector mean value and at this mean value during greater than default first critical value, setting search area is first a default scope.
5. the system of dynamic adjustment estimation as claimed in claim 4, wherein, if the mean value of this motion vector is not more than this first critical value, then this search area decision unit calculate by the stored motion vector of this motion vector memory cell former frame motion vector the mean difference value and in this mean difference value during greater than default second critical value, setting search area is second a default scope, and central first scope is greater than second scope.
6. the system of dynamic adjustment estimation as claimed in claim 5, wherein, if this mean difference value is not more than this second critical value, then this search area decision unit is calculated by the stored mode data of this mode memory cell with the number of the macro block of frame mode compression and at this number during greater than default the 3rd critical value, setting search area is the 3rd a default scope, and central second scope is greater than the 3rd scope.
7. the system of dynamic adjustment estimation as claimed in claim 6, wherein, be not more than the 3rd critical value if be somebody's turn to do the number of the macro block that compresses with frame mode, then this search area decision unit is calculated by the stored mode data of this mode memory cell with the average coded block pattern value of the macro block of Zero-code piece pattern mode compression and in this average coded block pattern value during greater than default the 4th critical value, setting search area is the 4th a default scope, and central the 3rd scope is greater than the 4th scope.
8. the system of dynamic adjustment estimation as claimed in claim 7, wherein, if this average coded block pattern value with the macro block of Zero-code piece pattern mode compression is not more than the 4th critical value, then this search area decision unit is calculated the number with the macro block of skip mode compression by the stored mode data of this mode memory cell, and at this number during greater than one the 5th critical value, setting search area is the 5th a default scope, otherwise set search area is the 6th a default scope, central the 4th scope is greater than the 5th scope, and the 5th scope is greater than the 6th scope.
9. method of dynamically adjusting estimation, in order to setting a search area in former frame, to find corresponding macro block to decide its motion vector in this search area according to each macro block of a present frame, the method comprising the steps of:
(A) decide a motion vector by the reference macroblock in the search area of target macroblock of present frame and former frame;
(B) determine the compact model of this target macroblock by this target macroblock, reference macroblock and motion vector, and export corresponding mode data;
(C) store the mode data that this pattern decision unit is exported;
(D) motion vector that stores this motion estimation unit and determined; And
(E) determine a search area according to these mode of storage data and motion vector.
10. the method for dynamic adjustment estimation as claimed in claim 9, wherein, step (E) is the mean value that calculated the motion vector of former frame by the motion vector of this storage, and calculated number with the macro block of frame mode compression by these mode of storage data, with the mean value of this motion vector greater than a default search area critical value or with the number of the macro block of frame mode compression greater than a default motion vector on during critical value, this search area is strengthened.
11. the method for dynamic adjustment estimation as claimed in claim 10, wherein, step (E) is that the mean value at this motion vector is not more than this search area critical value and, this search area is reduced during less than a default motion vector lower critical value with the number of the macro block of frame mode compression.
12. the method for dynamic adjustment estimation as claimed in claim 9, wherein, step (E) be calculate by the motion vector of this storage former frame motion vector mean value and at this mean value during greater than default first critical value, setting search area is first a default scope.
13. the method for dynamic adjustment estimation as claimed in claim 12, wherein, if the mean value of this motion vector is not more than this first critical value, then step (E) calculate by the stored motion vector of this motion vector memory cell former frame motion vector the mean difference value and in this mean difference value during greater than default second critical value, setting search area is second a default scope, and central first scope is greater than second scope.
14. the method for dynamic adjustment estimation as claimed in claim 13, wherein, if this mean difference value is not more than this second critical value, then step (E) is calculated by the stored mode data of this mode memory cell with the number of the macro block of frame mode compression and at this number during greater than default the 3rd critical value, setting search area is the 3rd a default scope, and central second scope is greater than the 3rd scope.
15. the method for dynamic adjustment estimation as claimed in claim 14, wherein, be not more than the 3rd critical value if be somebody's turn to do the number of the macro block that compresses with frame mode, then step (E) is calculated by the stored mode data of this mode memory cell with the average coded block pattern value of the macro block of Zero-code piece pattern mode compression and in this average coded block pattern value during greater than default the 4th critical value, setting search area is the 4th a default scope, and central the 3rd scope is greater than the 4th scope.
16. the method for dynamic adjustment estimation as claimed in claim 15, wherein, if this average coded block pattern value with the macro block of Zero-code piece pattern mode compression is not more than the 4th critical value, then step (E) is calculated by the stored mode data of this mode memory cell with the number of the macro block of skip mode compression and at this number during greater than one the 5th critical value, setting search area is the 5th a default scope, otherwise set search area is the 6th a default scope, central the 4th scope is greater than the 5th scope, and the 5th scope is greater than the 6th scope.
CNB2005100087006A 2005-03-01 2005-03-01 Method and system for dynamically adjusting motion estimation Expired - Fee Related CN100433835C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005100087006A CN100433835C (en) 2005-03-01 2005-03-01 Method and system for dynamically adjusting motion estimation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100087006A CN100433835C (en) 2005-03-01 2005-03-01 Method and system for dynamically adjusting motion estimation

Publications (2)

Publication Number Publication Date
CN1829325A CN1829325A (en) 2006-09-06
CN100433835C true CN100433835C (en) 2008-11-12

Family

ID=36947407

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100087006A Expired - Fee Related CN100433835C (en) 2005-03-01 2005-03-01 Method and system for dynamically adjusting motion estimation

Country Status (1)

Country Link
CN (1) CN100433835C (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101860746B (en) * 2009-04-08 2012-05-23 晨星软件研发(深圳)有限公司 Motion estimation method
CN102263944B (en) * 2010-05-27 2014-07-02 晨星软件研发(深圳)有限公司 Video coding system, mobile estimation device and calculation method for mobile estimation
TWI499283B (en) * 2012-07-05 2015-09-01 Ind Tech Res Inst Video compression method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010004385A1 (en) * 1999-07-29 2001-06-21 Seiji Okumura Motion vector detection system
CN1436002A (en) * 2002-01-26 2003-08-13 Lg电子株式会社 Adaptive motion vector search range determining method
US20030190059A1 (en) * 2000-03-17 2003-10-09 Stmicroelectronics S.R.L. Automatic setting of optimal search window dimensions for motion estimation
CN1496128A (en) * 1998-10-22 2004-05-12 索尼株式会社 Method and device for checking motion vector

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1496128A (en) * 1998-10-22 2004-05-12 索尼株式会社 Method and device for checking motion vector
US20010004385A1 (en) * 1999-07-29 2001-06-21 Seiji Okumura Motion vector detection system
US20030190059A1 (en) * 2000-03-17 2003-10-09 Stmicroelectronics S.R.L. Automatic setting of optimal search window dimensions for motion estimation
CN1436002A (en) * 2002-01-26 2003-08-13 Lg电子株式会社 Adaptive motion vector search range determining method

Also Published As

Publication number Publication date
CN1829325A (en) 2006-09-06

Similar Documents

Publication Publication Date Title
TWI274509B (en) Method and system for dynamically adjusting motion estimation
WO2021244341A1 (en) Picture coding method and apparatus, electronic device and computer readable storage medium
CN102986211B (en) Speed control in Video coding
CN101919255B (en) Reference selection for video interpolation or extrapolation
CN101534440B (en) Video signal encoding method
CN100380982C (en) Image encoding method and apparatus and image encoding program
CN111479115B (en) Video image processing method and device and computer readable storage medium
CN106060539B (en) A kind of method for video coding of low transmission bandwidth
EP1642464B1 (en) Method of encoding for handheld apparatuses
US20230042575A1 (en) Methods and systems for estimating motion in multimedia pictures
CN101909211A (en) H.264/AVC high-efficiency transcoder based on fast mode judgment
CN100433835C (en) Method and system for dynamically adjusting motion estimation
US20240040127A1 (en) Video encoding method and apparatus and electronic device
KR101200924B1 (en) Fast motion estimation for multiple reference pictures
CN101631242A (en) Video weighted prediction system and coding and decoding method thereof
CN102300091B (en) Code device, electronic equipment, imaging device and imaging system
CN102196255B (en) Formation method of video encoding complexity control model
CN101031082B (en) Motion vector decoding method and motion vector decoding device
RU2587412C2 (en) Video rate control based on transform-coefficients histogram
CN100473173C (en) Mobile estimating method and system applying color information
CN102318203B (en) Method and equipment used for encoding video frame containing light change
CN100405847C (en) Moving image system and method for coded mobile communication terminal
WO2022206199A1 (en) Method and apparatus for performing image processing in video decoding apparatus, and system
Esmaeeli et al. Methods and Criteria for Evaluating Controllability of Video Bit Rate in HEVC-SCC
JP2003009156A (en) Moving picture coding apparatus, method therefor, storing medium and moving picture decoding method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20081112

Termination date: 20160301

CF01 Termination of patent right due to non-payment of annual fee