CN103379303A - Image processing circuit and image processing method - Google Patents
Image processing circuit and image processing method Download PDFInfo
- Publication number
- CN103379303A CN103379303A CN2012101248630A CN201210124863A CN103379303A CN 103379303 A CN103379303 A CN 103379303A CN 2012101248630 A CN2012101248630 A CN 2012101248630A CN 201210124863 A CN201210124863 A CN 201210124863A CN 103379303 A CN103379303 A CN 103379303A
- Authority
- CN
- China
- Prior art keywords
- scene
- present picture
- image
- sampling rate
- absolute
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an image processing circuit and an image processing method. The image processing circuit comprises a universal search engine and a picture rate conversion engine. Universal search is conducted by the universal search engine according to a reference picture and a current picture so that an absolute error and distribution can be generated. The scene characteristics of the current picture are analyzed by the picture rate conversion engine according to the absolute error and the distribution. At least one of control parameters is adjusted by the picture rate conversion engine according to the scene characteristics. An interpolation image is generated through the picture rate conversion engine according to the reference picture, the current picture and the control parameter.
Description
Technical field
The present invention relates to a kind of image-processing circuit and image treatment method, particularly relate to a kind of image-processing circuit and the image treatment method of sampling rate conversion (Frame Rate Conversion, FRC).
Background technology
Sampling rate conversion (Frame Rate Conversion, FRC) is to come interpolation to go out a compensation picture by Motion estimation and compensation (Motion Estimate and Motion Compensation, MEMC).For interpolation goes out correct compensation picture, the sampling rate conversion must be estimated first correct motion vector.Interpolation goes out correct compensation picture according to motion vector more afterwards.
Yet the conventional visual rate transition often can't be learnt the integral status of present picture when calculation of motion vectors.Therefore, when occurring fast mobile or changing violent picture, namely can't come by correct prediction interpolation to go out correct compensation picture.
Summary of the invention
The invention relates to a kind of image-processing circuit and image treatment method.
According to the present invention, a kind of image-processing circuit is proposed.Image-processing circuit comprises universe search (Full Search) engine and sampling rate conversion (Frame Rate Conversion, FRC) engine.The universe search engine carries out universe search according to reference picture and present picture and produces absolute error and distribution, and absolute error and distribution comprise a plurality of absolute errors and.The sampling rate transform engine is according to reference picture, present picture and control parameter generating interpolation image.During when the part absolute error with less than lowest threshold, the sampling rate transform engine judges whether absolute error and the number greater than lowest threshold equals 1.When absolute error and number equal 1, picture has comprised scene at present.When absolute error and number greater than 1, picture comprises periodically (periodic) scene at present.When absolute error with when being not less than this lowest threshold, the sampling rate transform engine is judged absolute error and whether greater than mean pixel level (Average Pixel Level, APL).When absolute error with greater than the mean pixel level, picture comprises flicker (flash) scene at present.When absolute error be not more than the mean pixel level, picture comprises bad scene at present.The sampling rate transform engine according to good scene, periodically scene, flicker scene or bad scene adjustment control parameter at least one of them.
According to the present invention, a kind of image-processing circuit is proposed.Image-processing circuit comprises universe search (Full Search) engine and sampling rate conversion (Frame Rate Conversion, FRC) engine.The universe search engine carries out universe search according to reference picture and present picture and produces absolute error and distribution.The sampling rate transform engine is according to reference picture, present picture and control parameter generating interpolation image, and according to absolute error with distribute to adjust three-dimensional pull over renewal vector, absolute error and sensitivity value or candidate motion vector (Candidate) quantity of search (Three-Dimensional Recursive Search, 3DRS).
According to the present invention, a kind of image treatment method is proposed.Image treatment method comprises: carry out universe search according to reference picture and present picture and produce absolute error and distribution, absolute error and distribution comprise several absolute errors and; Scene characteristics according to absolute error and the present picture of distributional analysis; According to scene characteristics adjust several control parameters at least one of them; And according to reference picture, present picture and control parameter generating interpolation image.
For there is better understanding above-mentioned and other aspect of the present invention, preferred embodiment cited below particularly, and be described with reference to the accompanying drawings as follows.
Description of drawings
Fig. 1 shows a kind of image-processing circuit according to embodiment.
Fig. 2 shows a kind of image treatment method according to embodiment.
Fig. 3 shows the schematic diagram of universe search.
Fig. 4 shows the thin section flow chart of abovementioned steps 22.
The reference numeral explanation
1: image-processing circuit
11: the universe search engine
12: the sampling rate transform engine
21～24,221～227: step
F (k-1): reference picture
F (k): present picture
Bx: region of search
S: motion vector
X: block
Embodiment
Please be simultaneously with reference to Fig. 1, Fig. 2 and Fig. 3, Fig. 1 shows a kind of image-processing circuit according to embodiment, and Fig. 2 shows a kind of image treatment method according to embodiment, and Fig. 3 shows the schematic diagram of universe search.Image-processing circuit 1 comprises universe search (Full Search) engine 11 and sampling rate conversion (Frame Rate Conversion, FRC) engine 12, the sampling rate conversion is called again Motion estimation and compensation (Motion Estimate and Motion Compensation, MEMC).Image treatment method can be applied to image-processing circuit 1, and comprises at least step 21～24.
At first shown in step 21, universe search (Full Search) engine 11 carries out a universe search according to reference picture F (k-1) and present picture F (k) and produces absolute error and distribution, absolute error and distribution comprise several absolute errors and.The universe search is to cut into the identical block of size with reference to picture F (k-1) and present picture F (k).Suppose the block of block X for just wanting to compare that Fig. 3 illustrates, and region of search Bx wants the region of search compared with block X among the reference picture F (k-1).S set represent the set that might motion vector consists of, and for arbitrary motion vector s ∈ S.Universe search engine 11 is searched for all blocks in the Bx of region of search, with find out with block X recently like block.Universe search engine 11 by absolute error and (Sum of Absolute Difference, SAD) find out with block X recently like block.Absolute error and
I
kM is listed as the capable pixel value of n in the block X of (m, n) the present picture F of representative (k), and I
K-1(m+dx, n+dy) represents that m+dx is listed as the capable pixel value of n+dy among the Bx of region of search.
Then shown in step 22, sampling rate transform engine 12 is according to the scene characteristics of absolute error and the present picture F of distributional analysis (k).And then shown in step 23, sampling rate transform engine 12 according to this scene characteristics adjust several control parameters at least one of them.Then shown in step 24, sampling rate transform engine 12 is according to reference picture F (k-1), present picture F (K) and control parameter generating interpolation image.
Please be simultaneously with reference to Fig. 1, Fig. 3 and Fig. 4, Fig. 4 shows the thin section flow chart of abovementioned steps 22.Abovementioned steps 22 further comprises step 221～227.Shown in step 221, sampling rate transform engine 12 is judged the part absolute errors and whether less than a lowest threshold.During when the part absolute error with less than lowest threshold, there are block and block X approximate among the expression region of search Bx, so execution in step 222.Shown in step 222, sampling rate transform engine 12 judges further whether absolute error and number greater than lowest threshold equal 1.
When absolute error and number equal 1, then shown in step 223, sampling rate transform engine 12 is analyzed present picture F (k) and is comprised a good scene.On the contrary, when greater than lowest threshold absolute error and number greater than 1, then shown in step 224, sampling rate transform engine 12 is analyzed present picture F (k) and is comprised periodically (periodic) scene.
When all absolute errors with when all being not less than lowest threshold, then shown in step 225, sampling rate transform engine 12 is further judged all absolute errors and whether all greater than a mean pixel level (Average Pixel Level, APL).When all absolute errors with all greater than the mean pixel level, then shown in step 226, sampling rate transform engine 12 is analyzed present picture F (k) and is comprised flicker (flash) scene.On the contrary, when all absolute errors with all be not more than the mean pixel level, then shown in step 227, sampling rate transform engine 12 is analyzed present picture F (k) and is comprised a bad scene.
Aforementioned control parameter for example comprises that three-dimensional one of the search (Three-Dimensional Recursive Search, 3DRS) of pulling over upgrades vector, an absolute error and responsive value (SAD coring) or a candidate motion vector (Candidate) quantity.The reference vector that block is calculating for the i time
c
i=d (x+p
i, the k) reference on the representation space, p
iRepresent a relative position, and k represents that k opens picture.c
i=d (x+p
i, k-1) represent temporal reference, and k-1 represents that k-1 opens picture.The vector representation of region of search is c
i=c
j+ u, j ≠ i, u ∈ US.Upgrade vectorial u and be selected from renewal set US.So when upgrading vectorial u increase, the expression renewal speed can increase.On the contrary, when upgrading vectorial u reduction, the expression renewal speed can reduce.
When present picture has comprised scene, sampling rate transform engine 12 keeps that to upgrade vectorial u constant.When present picture comprises periodically scene or flicker scene, sampling rate transform engine 12 reduces and upgrades vectorial u to reduce renewal speed.On the contrary, when present picture comprises bad scene, sampling rate transform engine 12 increases and upgrades vectorial u to accelerate renewal speed.
Similarly, aforementioned sampling rate transform engine 12 also can be adjusted candidate motion vector (Candidate) quantity according to scene characteristics.For instance, when present picture has comprised scene, it is constant that sampling rate transform engine 12 is kept candidate motion vector quantity.When present picture comprises periodically scene, flicker scene or bad scene, sampling rate transform engine 12 reduces the candidate motion vector quantity.
In addition, seem more level and smooth in order to make motion vector, generally can and deduct absolute error and responsive value with absolute error, find the possibility of same motion vector with increase.Aforementioned sampling rate transform engine 12 also can be adjusted absolute error and responsive value according to scene characteristics.For instance, when present picture has comprised scene, sampling rate transform engine 12 keeps absolute error and responsive value is constant.When present picture comprises the flicker scene, sampling rate transform engine 12 reduces absolute errors and responsive value.On the contrary, when present picture comprises periodically scene or bad scene, sampling rate transform engine 12 increases absolute errors and responsive value.
In sum, although the present invention discloses as above with preferred embodiment, so it is not to limit the present invention.Those skilled in the art under the premise without departing from the spirit and scope of the present invention, can be used for a variety of modifications and variations.Therefore, protection scope of the present invention is to be as the criterion with claim of the present invention.
Claims (31)
1. image-processing circuit comprises:
One universe search engine carries out a universe search according to a reference picture and a present picture and produces an absolute error and distribution, this absolute error and distribution comprise a plurality of absolute errors and; And
One sampling rate transform engine, according to this reference picture, this present picture and a plurality of control parameter generating one interpolation image, during when these absolute errors of part with less than a lowest threshold, this sampling rate transform engine judges whether an absolute error and the number greater than this lowest threshold equals 1, when this absolute error and number equal 1, this present picture comprises a good scene, when this absolute error and number greater than 1, this present picture comprises a periodicity scene, when these absolute errors with when being not less than this lowest threshold, this sampling rate transform engine is judged these absolute errors and whether greater than a mean pixel level, when these absolute errors with greater than this mean pixel level, this present picture comprises a flicker scene, when these absolute errors be not more than this mean pixel level, this present picture comprises a bad scene, and this sampling rate transform engine is according to this good scene, this is scene periodically, this flicker scene maybe this bad scene adjust these control parameters at least one of them.
2. image-processing circuit as claimed in claim 1, wherein these control parameters comprise that three-dimensional one of the search of pulling over upgrades vector.
3. image-processing circuit as claimed in claim 2, wherein work as this present picture and comprise this bad scene, this sampling rate transducer increases this renewal vector, and this present picture comprises this flicker scene or this periodicity scene, and then this sampling rate transducer reduces this renewal vector.
4. image-processing circuit as claimed in claim 1, wherein these control parameters comprise an absolute error and responsive value.
5. image-processing circuit as claimed in claim 4, wherein work as this present picture and comprise this bad scene or this periodicity scene, this sampling rate transducer increases this renewal vector, and this present picture comprises this flicker scene, and then this sampling rate transducer reduces this renewal vector.
6. image-processing circuit as claimed in claim 1, wherein these control parameters comprise a candidate motion vector quantity.
7. image-processing circuit as claimed in claim 6 is wherein worked as this present picture and is comprised this bad scene, this flicker scene or this periodicity scene, and this sampling rate transducer reduces this renewal vector.
8. image-processing circuit comprises:
One universe search engine carries out a universe search according to a reference picture and a present picture and produces an absolute error and distribution; And
One sampling rate transform engine, according to this reference picture, this present picture and a plurality of control parameter generating one interpolation image, and according to a three-dimensional renewal vector, an absolute error and sensitivity value or the candidate motion vector quantity of pulling over and searching for of this absolute error and the adjustment that distributes.
9. image-processing circuit as claimed in claim 8, during wherein when these absolute errors of part with less than a lowest threshold, this sampling rate transform engine judges whether an absolute error and the number greater than this lowest threshold equals 1, when this absolute error and number equal 1, this present picture comprises a good scene, when this absolute error and number greater than 1, this present picture comprises a scene periodically.
10. image-processing circuit as claimed in claim 9 is wherein worked as this present picture and is comprised this periodicity scene, and this sampling rate transducer reduces this renewal vector.
11. image-processing circuit as claimed in claim 9 is wherein worked as this present picture and comprised this periodicity scene, this sampling rate transducer increases this absolute error and responsive value.
12. image-processing circuit as claimed in claim 9 is wherein worked as this present picture and comprised this periodicity scene, this sampling rate transducer reduces this candidate motion vector quantity.
13. image-processing circuit as claimed in claim 8, wherein when these absolute errors with when being not less than this lowest threshold, this sampling rate transform engine is judged these absolute errors and whether greater than a mean pixel level, when these absolute errors with greater than this mean pixel level, this present picture comprises a flicker scene.
14. image-processing circuit as claimed in claim 13 is wherein worked as this present picture and comprised this flicker scene, this sampling rate transducer reduces this renewal vector.
15. image-processing circuit as claimed in claim 13 is wherein worked as this present picture and comprised this flicker scene, this sampling rate transducer reduces this absolute error and responsive value.
16. image-processing circuit as claimed in claim 13 is wherein worked as this present picture and comprised this flicker scene, this sampling rate transducer reduces this candidate motion vector quantity.
17. image-processing circuit as claimed in claim 8, wherein when these absolute errors with when being not less than this lowest threshold, this sampling rate transform engine is judged these absolute errors and whether greater than a mean pixel level, when these absolute errors be not more than this mean pixel level, this sampling rate transform engine judges that this present picture comprises a bad scene.
18. image-processing circuit as claimed in claim 17 is wherein worked as this present picture and comprised this bad scene, this sampling rate transducer increases this renewal vector.
19. image-processing circuit as claimed in claim 17 is wherein worked as this present picture and comprised this bad scene, this sampling rate transducer increases this absolute error and responsive value.
20. image-processing circuit as claimed in claim 17 is wherein worked as this present picture and comprised this flicker scene, this sampling rate transducer reduces this candidate motion vector quantity.
21. an image treatment method comprises:
Carry out a universe search according to a reference picture and a present picture and produce an absolute error and distribution, this absolute error and distribution comprise a plurality of absolute errors and;
Scene characteristics according to this absolute error and this present picture of distributional analysis;
According to this scene characteristics adjust a plurality of control parameters at least one of them; And
According to this reference picture, this present picture and these control parameter generating one interpolation images.
22. image treatment method as claimed in claim 21, wherein this analytical procedure comprises:
Judge these absolute errors of part and whether less than a lowest threshold;
During when these absolute errors of part with less than this lowest threshold, judge whether an absolute error and the number greater than this lowest threshold equals 1;
When this absolute error and number equal 1, then this present picture comprises a good scene;
When this absolute error and number greater than 1, then this present picture comprises a scene periodically;
When these absolute errors with when being not less than this lowest threshold, judge these absolute errors and whether greater than a mean pixel level;
When these absolute errors with greater than this mean pixel level, this present picture comprises flicker (flash) scene; And
When these absolute errors and be not more than this mean pixel level, this present picture comprises a bad scene.
23. image treatment method as claimed in claim 21, wherein these control parameters comprise the renewal vector that three-dimensional is pulled over and searched for, and when this present picture comprises this periodicity scene, reduce this renewal vector.
24. image treatment method as claimed in claim 21, wherein these control parameters comprise an absolute error and responsive value, when this present picture comprises this periodicity scene, increase this absolute error and responsive value.
25. image treatment method as claimed in claim 21, wherein these control parameters comprise a candidate motion vector quantity, when this present picture comprises this periodicity scene, reduce this candidate motion vector quantity.
26. image treatment method as claimed in claim 21, wherein these control parameters comprise the renewal vector that three-dimensional is pulled over and searched for, and when this present picture comprises this flicker scene, reduce this renewal vector.
27. image treatment method as claimed in claim 21, wherein these control parameters comprise an absolute error and responsive value, when this present picture comprises this flicker scene, reduce this absolute error and responsive value.
28. image treatment method as claimed in claim 21, wherein these control parameters comprise a candidate motion vector quantity, when this present picture comprises this flicker scene, reduce this candidate motion vector quantity.
29. image treatment method as claimed in claim 21, wherein these control parameters comprise the renewal vector that three-dimensional is pulled over and searched for, and when this present picture comprises this bad scene, increase this renewal vector.
30. image treatment method as claimed in claim 21, wherein these control parameters comprise an absolute error and responsive value, when this present picture comprises this bad scene, increase this absolute error and responsive value.
31. image treatment method as claimed in claim 21, wherein these control parameters comprise a candidate motion vector quantity, when this present picture comprises this flicker scene, reduce this candidate motion vector quantity.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101248630A CN103379303A (en) | 2012-04-25 | 2012-04-25 | Image processing circuit and image processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101248630A CN103379303A (en) | 2012-04-25 | 2012-04-25 | Image processing circuit and image processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103379303A true CN103379303A (en) | 2013-10-30 |
Family
ID=49463802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101248630A Pending CN103379303A (en) | 2012-04-25 | 2012-04-25 | Image processing circuit and image processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103379303A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1180276A (en) * | 1996-09-27 | 1998-04-29 | 次级系统有限公司 | Scene change detector for digital video |
| US20050243927A1 (en) * | 2004-04-30 | 2005-11-03 | Ralf Hubrich | Motion estimation employing adaptive spatial update vectors |
| CN101494780A (en) * | 2008-01-25 | 2009-07-29 | 联发科技股份有限公司 | Method and integrated circuit for video processing |
-
2012
- 2012-04-25 CN CN2012101248630A patent/CN103379303A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1180276A (en) * | 1996-09-27 | 1998-04-29 | 次级系统有限公司 | Scene change detector for digital video |
| US20050243927A1 (en) * | 2004-04-30 | 2005-11-03 | Ralf Hubrich | Motion estimation employing adaptive spatial update vectors |
| CN101494780A (en) * | 2008-01-25 | 2009-07-29 | 联发科技股份有限公司 | Method and integrated circuit for video processing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230077355A1 (en) | Tracker assisted image capture | |
| US9852511B2 (en) | Systems and methods for tracking and detecting a target object | |
| US9646389B2 (en) | Systems and methods for image scanning | |
| US8204124B2 (en) | Image processing apparatus, method thereof, and program | |
| US7596243B2 (en) | Extracting a moving object boundary | |
| JP4564564B2 (en) | Moving picture reproducing apparatus, moving picture reproducing method, and moving picture reproducing program | |
| US20190215518A1 (en) | Histogram of gradient based optical flow | |
| US9525873B2 (en) | Image processing circuit and image processing method for generating interpolated image | |
| CN101465955B (en) | Method and apparatus for updating background | |
| CN101366279A (en) | Adaptive motion search range | |
| US10051274B2 (en) | Image processing apparatus, method of calculating information according to motion of frame, and storage medium | |
| KR101756842B1 (en) | Method and apparatus for image frame interpolation | |
| CN110363748B (en) | Method, device, medium and electronic equipment for processing dithering of key points | |
| US8159605B2 (en) | Frame interpolating apparatus and method | |
| US20220122297A1 (en) | Generation apparatus and computer program | |
| JP2010103654A (en) | Method, device and program for converting frame rate, and computer readable recording medium with the program recorded therein | |
| US9167132B2 (en) | System and method of estimating motion of image using block sampling | |
| JP4695015B2 (en) | Code amount estimation method, frame rate estimation method, code amount estimation device, frame rate estimation device, code amount estimation program, frame rate estimation program, and computer-readable recording medium recording those programs | |
| JP2007201975A (en) | Code amount estimating method, frame rate estimating method, code amount estimating apparatus, frame rate estimating apparatus, code amount estimating program, frame rate estimating program, and computer readable storage medium for storing program | |
| CN113870302A (en) | Motion estimation method, chip, electronic device, and storage medium | |
| CN103379303A (en) | Image processing circuit and image processing method | |
| CN202931463U (en) | Characteristic block based video image stabilization device | |
| CN111008305B (en) | Visual search method and device and electronic equipment | |
| US8391365B2 (en) | Motion estimator and a motion estimation method | |
| US20210150723A1 (en) | Image processing device, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20131030 |