CN104811723A - Local motion vector correcting method in MEMC (Motion Estimation and Motion Compensation) technology - Google Patents
Local motion vector correcting method in MEMC (Motion Estimation and Motion Compensation) technology Download PDFInfo
- Publication number
- CN104811723A CN104811723A CN201510203610.6A CN201510203610A CN104811723A CN 104811723 A CN104811723 A CN 104811723A CN 201510203610 A CN201510203610 A CN 201510203610A CN 104811723 A CN104811723 A CN 104811723A
- Authority
- CN
- China
- Prior art keywords
- motion vector
- block
- local
- motion
- modification method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a local motion vector correcting method in MEMC (Motion Estimation and Motion Compensation) technology. The local motion vector correcting method comprises the steps of: 1, assigning the range of a certain fixed area around each block; 2, obtaining the motion vectors of all blocks and accuracy of the motion vectors within the range; 3, selecting and working out a reliable motion vector from the motion vectors to serve as a substituted motion vector; 4, analyzing and judging that whether the motion vector of the current block is reliable, and working out a weighted average coefficient; 5, weighting the original motion vector and the substituted motion vector of the block by using the weighted average coefficient to obtain a new motion vector, to serve as the final motion vector of the current block. According to the local motion vector correcting method provided by the invention, when the local part of motion search is not good enough, the better peripheral motion vector can be adopted to substitute the poor motion vector, the interpolation frame generated by the smooth motion vector is utilized, the visual effect is good, and the disjointed images and other phenomena are easy to cover.
Description
Technical field
The present invention relates to image processing techniques, more specifically, relate to local motion vector modification method in a kind of MEMC technology.
Background technology
Motion estimation motion compensates (Motion estimation and motion compensation, MEMC) technology is a kind of frame rate conversion generally adopted at present, be applied in the video systems such as television equipment, shake and the tailing problem of motion picture can effectively be eliminated or improve to this technology.Estimation is one of its key technology, and the interpolated frame that correct motion estimation result generates can give good visual experience, and the motion estimation result of mistake can affect viewing effect on the contrary, brings even worse viewing effect than original dither.The effect of estimation associates greatly with the scene content of primitive frame, has a lot of scene can not obtain correct motion search result under general MEMC technology, such as compound movement, and wisp moves, scene etc. of being fade-in fade-out.
Prior art realizes, according to the result that motion estimation motion compensates, under judging this scene by various index, whether estimation lost efficacy, the motion vector obtained is also unreliable, then interpolated frame no longer adopts the result of motion compensation, but selects primitive frame or primitive frame weighted blend (blending) result.But some scene only has local motion estimation effect bad, whole frame fallback (moves back as original input frame or primitive frame weighted results, but not the interpolation result that compensates of motion estimation motion) although avoid the fragmentation that wrong motion estimation may bring afterwards, visual experience is still good not.
Summary of the invention
The present invention is directed to the technical problem existed in above-mentioned prior art, local motion vector modification method in a kind of MEMC technology is provided, can when motion search local be good not, bad motion vector is replaced by adopting the reasonable motion vector of periphery, even if although the motion vector replaced also may not be correct motion vector, but utilize the interpolated frame that level and smooth motion vector generates, visual effect is better, easily cover the phenomenons such as picture fragmentation.
For achieving the above object, the technical solution adopted in the present invention is as follows:
Local motion vector modification method in a kind of MEMC technology, comprises step as follows:
1) certain fixed area scope around it is specified to each block;
2) motion vector of all block and the accuracy of this motion vector within the scope of this is obtained;
3) from those motion vectors seletion calculation go out one accurately and reliably motion vector as replacement motion vector;
4) whether accurately and reliably analysis judges the motion vector of current block, calculates a weighted average coefficients;
5) block motion vector originally and its replaced motion vector weighting with this weighted average coefficients and go out the final motion vector of a new motion vector as current block.
Described step 1), MEMC technology carries out estimation based on block, and image is split by block, to specify around current computing block a region containing N × M block, this region should also contains current block, N, M is integer, requires to select according to hardware implementing, algorithm.
Described piece of Similarity matching degree judges according to the index of the similarity degree of the corresponding blocks that can show motion vector.
Described index comprises absolute difference and criterion, mean-square error criteria, or according to position, candidate motion vector type, adds a penalty coefficient, the basis for estimation index obtained to the result of calculation of absolute difference sum criterion or mean-square error criteria.
Described absolute difference and criterion, i.e. sad value, sad value is less, and represent motion vector more accurately and reliably, sad value is larger, and Block-matching is poorer, and the accuracy of this motion vector is poorer, and its computing formula is as follows:
SAD＝Σ(|p
a(i)-p
b(i)|)
P
a(i) and P
bi () refers to i-th pixel in the block a that compares and block b.
Motion vector refers in the scope represented by N × M block accurately and reliably, and block Similarity matching degree is relatively good, can the vector of this range motion of approximate representation.
One or several motion vectors selecting Block-matching degree best from N × M motion vector, final weighted calculation goes out a motion vector as replacement motion vector.
In N × M vector, compare the value calculated by above-mentioned error criterion, select the smaller X of a value vector, motion vector refers to the vector that X vector weighting obtains accurately and reliably, and X can be the integer being less than arbitrarily N × M, X=1,2,3 ....
Described step 4) whether reliable, be that this region can be the scope of the Z × Z-block comprised centered by current block with reference to the convergence situation decision comprised in the territory, local cell of current block if analyzing the motion vector judging current block; Weighted average coefficients reaction be exactly the convergence situation of this zonule.
Matching criterior error meets the number of the block of certain condition, or often row minimum match error cumulative sum can represent the convergence situation in region, obtains weighted average coefficients with these Index Mappings.
Described step 5) in, the Index Mappings that weighted average coefficients can restrain situation by conversion zone is obtained (such as being mapped by one-dimensional linear curve), gained coefficient should be an integer, be convenient to two motion vectors be weighted and be averaging, when mapping relations are determined, the scope of coefficient is also determined;
Final motion vector=(Vec × (Range-alpha)+FB_Vec × alpha)/Range
Vec refers to block motion vector originally, and FB_Vec refers to the reliable motion vector of above-mentioned calculating, and namely replace motion vector, alpha refers to weighted average coefficients, and Range refers to the effective range of coefficient;
During alpha=0, illustrated block vector is originally better credible, without the need to changing; Alpha is larger, and originally vector is more insincere to show block, goes weighting to obtain a new good vector with another vector.
The present invention adopts above-mentioned technical scheme, and the beneficial effect brought is as follows:
MEMC technology has limitation under a lot of scene, the motion vector faulty convergence of indivedual block can cause the problems such as local fragmentation, shake, affect viewing experience, technical solution of the present invention, to those motion vectors that effect is bad always, the motion vector finding perimeter convergence correct goes to replace it, although replacing vector also may not be accurate, but the interpolated frame that level and smooth motion vector obtains, can avoid the phenomenons such as obvious interpolation fragmentation, improve visual experience.This technology can classify as a kind of regional degeneration strategy, when partial result is bad, does not need whole frame picture to degenerate to primitive frame, avoids local broken with shake, but reduces the broken problem in local by level and smooth vector field.
Accompanying drawing explanation
By reading the detailed description done non-limiting example with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:
Fig. 1 is the flow chart of method provided by the present invention.
Embodiment
Below in conjunction with specific embodiment, the present invention is described in detail.Following examples will contribute to those skilled in the art and understand the present invention further, but not limit the present invention in any form.It should be pointed out that to those skilled in the art, without departing from the inventive concept of the premise, some distortion and improvement can also be made.These all belong to protection scope of the present invention.
As shown in Figure 1, local motion vector modification method in MEMC technology provided by the present invention, comprises step as follows:
1) each block specifies certain fixed area scope around it;
2) obtain the motion vector of all block and the accuracy of this vector within the scope of this, the SAD of such as motion vector, the SAD of motion vector shows the matching degree of block, and SAD is larger, and Block-matching is poorer, illustrates that this MV is not enough good motion vector;
3) relatively reliable motion vector in this region is found out, such as the motion vector that minimum SAD is corresponding, or the motion vector that every minimum SAD of a line is corresponding;
4) will think that reliable motion vector is as replacement motion vector, if reliable motion vectors has multiple, their weighted value can be calculated as replacement motion vector;
5) analysis judges that whether the motion vector of this block is reliable, obtain a weighted average coefficients, weighted average coefficients is larger, show that this motion vector is more unreliable, block motion vector originally and its replaced motion vector weighting with this weighted average coefficients and go out the final motion vector of a new motion vector as current block.
Embodiment:
1) select a fixed area, centered by current block, comprise the scope of 5x5 block;
2) obtain motion vector and the SAD thereof of these 25 blocks, in this example, weigh the accuracy of motion vector with SAD;
3) these 25 motion vectors are screened, select reliable motion vector; Can arrange a threshold value, the motion vector that sad value is little can think reliable motion vector; Selection mode is not limited to method cited in the present embodiment;
4) by step 3) in obtain motion vector can be weighted according to reliability, obtain final replacement vector;
5) judge that whether the motion vector of current block is reliable, this judgement determines with reference to the convergence situation comprised in the territory, local cell of current block;
6) suppose that this territory, local cell is 7x7, add up the convergence situation of these 49 blocks, such as statistics SAD is less than the number of the block of a thresholding, by the convergence situation in this number reflection 7x7 region; The judgement of this convergence situation is not limited thereto the example enumerated in place;
7) by 6) in the convergence situation in 7x7 region map out a weighted average coefficients, i.e. fallback level;
8) with 7) in weighted average coefficients fallback level, the original vector of block and 4) in the replacement vector that obtains be weighted, namely obtain the motion vector that block is final.
Above specific embodiments of the invention are described.It is to be appreciated that the present invention is not limited to above-mentioned particular implementation, those skilled in the art can make various distortion or amendment within the scope of the claims, and this does not affect flesh and blood of the present invention.
Claims (10)
1. a local motion vector modification method in MEMC technology, is characterized in that, comprise step as follows:
1) certain fixed area scope around it is specified to each block;
2) motion vector of all block and the accuracy of this motion vector within the scope of this is obtained;
3) from those motion vectors seletion calculation go out one accurately and reliably motion vector as replacement motion vector;
4) whether accurately and reliably analysis judges the motion vector of current block, calculates a weighted average coefficients;
5) block motion vector originally and its replaced motion vector weighting with this weighted average coefficients and go out the final motion vector of a new motion vector as current block.
2. local motion vector modification method in MEMC technology according to claim 1, it is characterized in that, described step 1) in fixed area scope be the regional extent that around current block, contains N × M block, this regional extent contains current block, N and M is integer.
3. local motion vector modification method in MEMC technology according to claim 2, it is characterized in that, described step 2) in, the accuracy of motion vector refers to: in the scope represented by N × M block, the Similarity matching degree of block better, can the vector of this range of motion of approximate representation.
4. local motion vector modification method in MEMC technology according to claim 3, is characterized in that, described piece of Similarity matching degree judges according to the index of the similarity degree of the corresponding blocks that can show motion vector.
5. local motion vector modification method in MEMC technology according to claim 4, it is characterized in that, described index comprises absolute difference and criterion, mean-square error criteria, or according to position, candidate motion vector type, a penalty coefficient is added, the basis for estimation index obtained to the result of calculation of absolute difference sum criterion or mean-square error criteria.
6. local motion vector modification method in MEMC technology according to claim 5, it is characterized in that, described absolute difference and criterion, i.e. sad value, sad value is less, represents motion vector more accurately and reliably, sad value is larger, Block-matching is poorer, and the accuracy of this motion vector is poorer, and its computing formula is as follows:
SAD＝Σ(|p
a(i)-p
b(i)|)
P
a(i) and P
bi () refers to i-th pixel in the block a that compares and block b.
7. local motion vector modification method in MEMC technology according to claim 3, it is characterized in that, described step 3) in, one or several motion vectors selecting Block-matching degree best from N × M motion vector, final weighting goes out a motion vector as replacement motion vector.
8. local motion vector modification method in MEMC technology according to claim 3, it is characterized in that, described step 4) in, whether accurately and reliably analysis judges the motion vector of current block, determine with reference to the convergence situation comprised in the territory, local cell of current block, weighted average coefficients is the convergence situation in this territory, local cell of reaction, is obtained by the Index Mappings of the convergence situation in this territory, local cell.
9. local motion vector modification method in MEMC technology according to claim 8, is characterized in that, the index of described convergence situation is the number that matching error meets the block of certain condition, or often row minimum match error cumulative sum represents.
10. local motion vector modification method in MEMC technology according to claim 9, is characterized in that, described step 5) in, final motion vector=(Vec × (Range-alpha)+FB_Vec × alpha)/Range,
Vec refers to block motion vector originally, and FB_Vec refers to replace motion vector, and alpha refers to weighted average coefficients, and Range refers to the effective range of coefficient.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510203610.6A CN104811723B (en) | 2015-04-24 | 2015-04-24 | Local motion vector modification method in MEMC technologies |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510203610.6A CN104811723B (en) | 2015-04-24 | 2015-04-24 | Local motion vector modification method in MEMC technologies |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104811723A true CN104811723A (en) | 2015-07-29 |
| CN104811723B CN104811723B (en) | 2018-03-16 |
Family
ID=53696152
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510203610.6A Active CN104811723B (en) | 2015-04-24 | 2015-04-24 | Local motion vector modification method in MEMC technologies |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104811723B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106851047A (en) * | 2016-12-30 | 2017-06-13 | 中国科学院自动化研究所 | Static pixel detection method and system in a kind of video image |
| CN107124572A (en) * | 2017-03-08 | 2017-09-01 | 宏祐图像科技(上海)有限公司 | The method and system of partial result amendment in motion estimation motion compensation |
| CN113508595A (en) * | 2019-03-08 | 2021-10-15 | 华为技术有限公司 | Motion vector refined search area |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1328405A (en) * | 2000-06-13 | 2001-12-26 | 三星电子株式会社 | Format converter using bidirectional motion vector and its method |
| US20070211801A1 (en) * | 2006-03-09 | 2007-09-13 | Kei Matsubayashi | Frame rate conversion system, method of converting frame rate, transmitter, and receiver |
| CN101416523A (en) * | 2006-04-03 | 2009-04-22 | 英特尔公司 | Motion compensated frame rate conversion with protection against compensation artifacts |
| CN101883278A (en) * | 2009-05-08 | 2010-11-10 | 联发科技股份有限公司 | Motion vector correction apparatus and method thereof |
| CN102123283A (en) * | 2011-03-11 | 2011-07-13 | 杭州海康威视软件有限公司 | Interpolated frame acquisition method and device in video frame rate conversion |
| CN102131058A (en) * | 2011-04-12 | 2011-07-20 | 上海理滋芯片设计有限公司 | Speed conversion processing module and method of high definition digital video frame |
| CN102868879A (en) * | 2011-07-05 | 2013-01-09 | 北京大学 | Method and system for converting video frame rate |
-
2015
- 2015-04-24 CN CN201510203610.6A patent/CN104811723B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1328405A (en) * | 2000-06-13 | 2001-12-26 | 三星电子株式会社 | Format converter using bidirectional motion vector and its method |
| US20070211801A1 (en) * | 2006-03-09 | 2007-09-13 | Kei Matsubayashi | Frame rate conversion system, method of converting frame rate, transmitter, and receiver |
| CN101416523A (en) * | 2006-04-03 | 2009-04-22 | 英特尔公司 | Motion compensated frame rate conversion with protection against compensation artifacts |
| CN101883278A (en) * | 2009-05-08 | 2010-11-10 | 联发科技股份有限公司 | Motion vector correction apparatus and method thereof |
| CN102123283A (en) * | 2011-03-11 | 2011-07-13 | 杭州海康威视软件有限公司 | Interpolated frame acquisition method and device in video frame rate conversion |
| CN102131058A (en) * | 2011-04-12 | 2011-07-20 | 上海理滋芯片设计有限公司 | Speed conversion processing module and method of high definition digital video frame |
| CN102868879A (en) * | 2011-07-05 | 2013-01-09 | 北京大学 | Method and system for converting video frame rate |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106851047A (en) * | 2016-12-30 | 2017-06-13 | 中国科学院自动化研究所 | Static pixel detection method and system in a kind of video image |
| CN106851047B (en) * | 2016-12-30 | 2020-02-07 | 中国科学院自动化研究所 | Method and system for detecting static pixel points in video image |
| CN107124572A (en) * | 2017-03-08 | 2017-09-01 | 宏祐图像科技(上海)有限公司 | The method and system of partial result amendment in motion estimation motion compensation |
| CN113508595A (en) * | 2019-03-08 | 2021-10-15 | 华为技术有限公司 | Motion vector refined search area |
| CN113508595B (en) * | 2019-03-08 | 2023-11-28 | 华为技术有限公司 | Motion vector refined search area |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104811723B (en) | 2018-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9940719B2 (en) | Alignment of an ordered stack of images from a specimen | |
| US8446524B2 (en) | Apparatus and method for frame rate conversion | |
| US11539976B2 (en) | Motion estimation using collocated blocks | |
| US8018998B2 (en) | Low complexity motion compensated frame interpolation method | |
| WO2017156669A1 (en) | Methods for motion vector storage in video coding | |
| Yoo et al. | Direction-select motion estimation for motion-compensated frame rate up-conversion | |
| KR100676704B1 (en) | Motion Estimator and Motion Estimating Method Thereof | |
| US20090278991A1 (en) | Method for interpolating a previous and subsequent image of an input image sequence | |
| KR20030070278A (en) | Apparatus and method of adaptive motion estimation | |
| KR102074555B1 (en) | Block-based static region detection for video processing | |
| WO2010073177A1 (en) | Image processing | |
| US20110293015A1 (en) | Method and device for image interpolation systems based on motion estimation and compensation | |
| KR20130023644A (en) | Method and apparatus for image frame interpolation | |
| US10225587B1 (en) | Motion estimation method for frame rate converter and video processor using the same | |
| CN104811723A (en) | Local motion vector correcting method in MEMC (Motion Estimation and Motion Compensation) technology | |
| CN111754429A (en) | Motion vector post-processing method and device, electronic device and storage medium | |
| KR100855976B1 (en) | Frame interpolate device for estimating motion by separating static object and moving object and frame interpolate method using the device | |
| US8670073B2 (en) | Method and system for video noise filtering | |
| US20090310679A1 (en) | Video processing apparatus and methods | |
| US20080144716A1 (en) | Method For Motion Vector Determination | |
| JP2002223374A (en) | Device and method for removing noise | |
| US9106926B1 (en) | Using double confirmation of motion vectors to determine occluded regions in images | |
| EP1606952A1 (en) | Method for motion vector determination | |
| KR100969420B1 (en) | Frame rate conversion method | |
| US9894367B2 (en) | Multimedia device and motion estimation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200115 Address after: 266101 No. 399, Laoshan District Pine Ridge Road, Qingdao of Shandong province Patentee after: Qingdao Xinxin Microelectronics Technology Co., Ltd. Address before: 201203 Shanghai City Chenhui Road, Zhangjiang High Tech Park of Pudong New Area No. 88 Building 1, 312, 316, 318. Patentee before: Hongyou Image Technology (Shanghai) Co., Ltd. |
|
| TR01 | Transfer of patent right |