CN101420606A - Image processing method and apparatus - Google Patents
Image processing method and apparatus Download PDFInfo
- Publication number
- CN101420606A CN101420606A CN 200710164282 CN200710164282A CN101420606A CN 101420606 A CN101420606 A CN 101420606A CN 200710164282 CN200710164282 CN 200710164282 CN 200710164282 A CN200710164282 A CN 200710164282A CN 101420606 A CN101420606 A CN 101420606A
- Authority
- CN
- China
- Prior art keywords
- frame
- moving object
- pixel
- image processing
- displacement vector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses an image processing method and an image processing device and relates to the image processing field, solving the problems of jitter and pause when a television presents a moving picture. The method comprises: an inbetween is generated by adopting an inbetween prediction coding method with motion compensation; and the inbetween is inserted in a current frame image. The device comprises an inbetween generation module and an insertion module. The use of the image processing method and the device can eliminate the phenomena of jitter and pause when the television and other display devices present the moving picture, thereby leading the presenting of the image to be smoother.
Description
Technical field
The present invention relates to image processing field, be specifically related to a kind of image processing method and device when being used for the television for play motion picture.
Background technology
Film generally is to make with the acquisition mode of per second 24 two field pictures, and the film of making by this production method is when playing, and it plays frequency also is per second 24 frames.But because the broadcast frequency of television set is 50Hz (Phase Alternation Line system) or 60Hz (TSC-system), just per second is play 50 frames or 60 two field pictures, so the film that described television set can't normal play be made with the acquisition mode of per second 24 two field pictures.
For addressing the above problem, prior art provides a kind of method of interleave, can make the described film made from the acquisition mode of per second 24 two field pictures of television set normal play.This method is specially: insert intermediate frame regularly in film image (abbreviation film image) frame made from the acquisition mode of per second 24 two field pictures, and this intermediate frame is identical with the movies signal frame that is adjacent, thereby makes the broadcast frequency change per second 50/60 frame into by per second 24 frames originally.
Because the intermediate frame that inserts is identical with the movies signal frame that is adjacent, thereby with the television for play moving image time, tend to occur the phenomenon of flating, pause, watch effect thereby influenced greatly.
Summary of the invention
The invention provides a kind of image processing method and device, to eliminate flating, the break of television set when playing motion picture.
Image processing method of the present invention is by the following technical solutions:
A kind of image processing method may further comprise the steps:
The inter prediction encoding method that employing has motion compensation generates intermediate frame;
Described intermediate frame is inserted in the current frame image.
Wherein, the inter prediction encoding method of described employing with motion compensation step that generates intermediate frame is specially:
Picture breakdown is become stationary object and moving object;
Obtain the displacement vector of each moving object by the estimating motion method;
The pixel predictors of each moving object after utilizing described moving object displacement vector calculating motion-compensated;
Described pixel predictors row is quantized, encodes, transmits, simultaneously described displacement vector and picture breakdown mode information are sent to decoder end, generate intermediate frame.
Wherein, all pixels in the described block of pixels have identical displacement.
Wherein, described estimating motion method comprises BMA and PRA.
Wherein, described block matching method may further comprise the steps:
Moving object in each frame is divided into more than one block of pixels, and the displacement of described block of pixels is identical;
To each block of pixels of moving object in the present frame, in former frame adjacent or back one frame, find and the corresponding match block of described block of pixels with described present frame;
The displacement vector of described block of pixels is the distance that described match block departs from its origin-location.
Wherein, described pixel-recursive method may further comprise the steps:
To the pixel in the moving object, utilize the described pixel left side or directly over the displacement vector of pixel as the displacement vector of this pixel;
With the predicted value of the pixel value after the described displacement vector of displacement on the former frame correspondence position as this pixel in the present frame.
Image processing method of the present invention inserts the relation that machinery repeats between frame and the original frame owing to adopted the inter prediction encoding method with motion compensation to generate intermediate frame thereby changed, and makes between insertion frame and the original frame more coherent.This has just eliminated display devices such as television set and has play phenomenons such as the shake of motion picture or pause, makes broadcasting pictures smooth more.
Image processing apparatus of the present invention is by the following technical solutions:
A kind of image processing apparatus comprises:
The intermediate frame generation module is used to adopt the inter prediction encoding method with motion compensation to generate intermediate frame;
Insert module is used for described intermediate frame is inserted into current frame image.
Wherein, described intermediate frame generation module comprises:
Cutting unit is used for picture breakdown is become stationary object and moving object;
Evaluation block is used for obtaining by the estimating motion method displacement vector of each moving object;
Compensating unit, the pixel predictors of each moving object after being used to utilize described moving object displacement vector calculating motion-compensated;
Generation unit is used for described pixel predictors row is quantized, encodes, transmits, and simultaneously described displacement vector and picture breakdown mode information is sent to decoder end, generates intermediate frame.
Image processing apparatus of the present invention, the inter prediction encoding method that has motion compensation by the utilization of intermediate frame generation module generates intermediate frame, is not that machinery repeats between the feasible intermediate frame that inserts and the original frame, and picture shows more coherent.Like this, utilize image processing apparatus of the present invention just to eliminate the shake or the break of display devices such as television set broadcast motion picture, make broadcasting pictures smooth more.
Description of drawings
Fig. 1 is the flow chart of image processing method embodiment of the present invention;
Fig. 2 is the schematic diagram of image processing apparatus embodiment of the present invention.
Embodiment
For the advantage that makes technical solution of the present invention is clearer, be described in detail below in conjunction with the preferred embodiment of accompanying drawing to image processing method of the present invention and device.
Inter prediction encoding is to realize by the correlation between the video image consecutive frame (temporal correlation).In image transmission technology, the main object that moving image, particularly television image are paid close attention to.It is the temporal image sequence that successive image frame is at interval formed that moving image was gone up with the frame period by the time, and it is in time than spatially having bigger correlation.Variations in detail is very little between most of television image consecutive frames, that is to say that video image interframe has very strong correlation.When existing moving object in the image, simple prediction can not be received good effect.If the background of present frame and former frame is just the same, just an object translation in the frame position, if simple with the predicted value of former frame pixel value as present frame, then predicated error is very big.If the direction of motion of known object and speed just can be extrapolated its position present frame from object in the position of former frame, and background image (do not consider be blocked part) still replaces with the background of former frame.So like this, the predicted value of Huo Deing is more accurately than the resulting predicted value of aforementioned simple forecast in this way.This Forecasting Methodology is called as the inter prediction with motion compensation.
Therefore, image processing method of the present invention, owing in present image, insert the intermediate frame that utilizes inter prediction encoding method generation, thereby eliminated flating, the break of television set when playing motion picture, make that the demonstration of dynamic menu is more coherent with motion compensation.
As shown in Figure 1, the described image processing method of the embodiment of the invention may further comprise the steps:
S1: cut apart module picture breakdown is become stationary object and moving object, to be used for more effective motion estimation.
Have different displacements though it is pointed out that each object here, the displacement of pixel that constitutes each object is identical.
S2: estimator module obtains the displacement vector of each moving object by the estimating motion method.Described estimating motion method comprises BMA and PRA.
Wherein, it is as follows to utilize BMA to obtain the process of displacement vector of each moving object:
S21: the moving object in each frame of image is divided into more than one block of pixels, and described block of pixels has identical displacement;
S22: to each block of pixels of moving object in the present frame, in former frame adjacent or back one frame, find the sub-piece the most similar, described sub-piece is called match block to described block of pixels to described present frame;
The most frequently used criterion of judging two sub-piece couplings is to ask the average MAD of the absolute value of interframe luminance difference.When MAD hour, represent two block of pixels couplings.The computing formula of MAD is as follows:
Wherein, b
kAnd b
K-1Represent the pixel brightness value of k and k-1 frame respectively, M, N are the level and the Vertical number of pixels of block of pixels, d
MLevel and Vertical number of pixels for the maximum possible translation.
S23: calculate the distance that described match block departs from its origin-location, obtain the displacement vector of described block of pixels.
The displacement vector of described block of pixels is by the coordinate decision of respective pixel piece in these adjacent two frames.That is: the coordinate of respective pixel piece subtracts each other in will these adjacent two frames, just obtains the displacement vector of described block of pixels.Note, be considered as the displacement vector of all pixels in the same block of pixels identical here.
By above-mentioned BMA, just obtained the displacement vector of each moving object.
It is as follows to utilize PRA to obtain the process of displacement vector of each moving object:
T21:, thereby it is not carried out recursive operation because the displacement of the pixel of stationary object is zero; To the pixel in the moving object, utilize this pixel left side or directly over the displacement vector D of pixel as the displacement vector of this pixel;
T22: with on the former frame correspondence position the pixel value behind the displacement D as the predicted value of this pixel in the present frame.If predicated error, thinks then that this pixel is measurable less than a certain threshold value, need not transmission information; If predicated error is greater than this threshold value, encoder then need transmit the predicated error after the quantification and the address of this pixel, and the sending and receiving both sides upgrade displacement vector according to the predicated error after quantizing separately.
This shows that PRA is that each pixel is recursively provided the displacement vector of an estimation according to predicated error, thereby do not need to transmit separately displacement vector to receiving terminal.
S3: compensating unit utilizes the displacement vector of described moving object, calculates the pixel predictors of each moving object after motion-compensated.
S4: generation unit quantizes, encodes, transmits described pixel predictors row, simultaneously described displacement vector and picture breakdown mode information is sent to the image receiving terminal, generates intermediate frame.
S5: insert module is inserted into described intermediate frame in the current frame image.
Above-mentioned image processing method inserts the relation that machinery repeats between frame and the original frame owing to having adopted the inter prediction encoding method with motion compensation to generate intermediate frame thereby changed in the prior art, make between insertion frame and the original frame more coherent.Thereby, utilize the described method of the embodiment of the invention to eliminate the shake or the break of display device movie pictures such as television set, make broadcasting pictures smooth more.
Corresponding with the described image processing method of the embodiment of the invention, the present invention also provides a kind of embodiment of image processing apparatus.
The embodiment of image processing apparatus of the present invention comprises intermediate frame generation module and insert module as shown in Figure 2.Described insert module is used for described intermediate frame is inserted into current frame image.
Wherein, described intermediate frame generation module comprises again as the unit:
Cutting unit is used for picture breakdown is become stationary object and moving object;
Evaluation block is used for obtaining by the estimating motion method displacement vector of each moving object;
Compensating unit, the pixel predictors of each moving object after being used to utilize described moving object displacement vector calculating motion-compensated;
Generation unit is used for described pixel predictors row is quantized, encodes, transmits, and simultaneously described displacement vector and picture breakdown mode information is sent to decoder end, generates intermediate frame.
After cutting unit became stationary object and moving object with picture breakdown, evaluation block was calculated the displacement vector of each moving object by the estimating motion method.Described estimating motion method comprises BMA and PRA.Adopt these two kinds of methods to calculate the process of the displacement vector of each moving object, identical with process in image processing method, do not repeat them here.The pixel predictors of each moving object after then utilizing described moving object displacement vector calculating motion-compensated by compensating unit.Afterwards, described pixel predictors row is quantized, encodes, transmits, simultaneously described displacement vector and picture breakdown mode information are sent to decoder end, generate intermediate frame by generation unit.At last, by described insertion unit the intermediate frame that generates is inserted in the present image.
By above-mentioned image processing apparatus, adopt inter prediction encoding method to generate intermediate frame with motion compensation.So just changed and inserted the relation that machinery repeats between frame and the original frame in the prior art, made between insertion frame and the original frame more coherent.Thereby, utilize the described image-processing system of the embodiment of the invention to eliminate the shake or the break of display device movie pictures such as television set, make broadcasting pictures smooth more.
Certainly; embodiments of the invention also can have a variety of; under the situation that does not deviate from embodiments of the invention spirit and essence thereof; those skilled in the art work as can make various corresponding changes and distortion according to embodiments of the invention, but these corresponding changes and distortion all should belong to the protection range of the appended claim of embodiments of the invention.
Claims (8)
1, a kind of image processing method is characterized in that, said method comprising the steps of:
The inter prediction encoding method that employing has motion compensation generates intermediate frame;
Described intermediate frame is inserted in the current frame image.
2, image processing method according to claim 1 is characterized in that, the step that described employing has the inter prediction encoding method generation intermediate frame of motion compensation is specially:
Picture breakdown is become stationary object and moving object;
Obtain the displacement vector of each moving object by the estimating motion method;
Utilize the displacement vector of described moving object, calculate the pixel predictors of each moving object after motion-compensated;
Described pixel predictors row is quantized, encodes, transmits, simultaneously described displacement vector and picture breakdown mode information are sent to the image receiving terminal, generate intermediate frame.
3, image processing method according to claim 2 is characterized in that, all pixels in the described block of pixels have identical displacement.
4, image processing method according to claim 2 is characterized in that, described estimating motion method comprises BMA and PRA.
5, image processing method according to claim 4 is characterized in that, described block matching method may further comprise the steps:
Moving object in each frame is divided into more than one block of pixels, and the displacement of described block of pixels is identical;
To each block of pixels of moving object in the present frame, in former frame adjacent or back one frame, find and the corresponding match block of described block of pixels with described present frame;
The coordinate of respective pixel piece in these adjacent two frames is subtracted each other, obtain the displacement vector of described block of pixels.
6, image processing method according to claim 4 is characterized in that, described pixel-recursive method may further comprise the steps:
To the pixel in the moving object, utilize the described pixel left side or directly over the displacement vector of pixel as the displacement vector of this pixel;
With the predicted value of the pixel value after the described displacement vector of displacement on the former frame correspondence position as this pixel in the present frame.
7, a kind of image processing apparatus is characterized in that comprising:
The intermediate frame generation module is used to adopt the inter prediction encoding method with motion compensation to generate intermediate frame;
Insert module is used for described intermediate frame is inserted into current frame image.
8, image processing apparatus according to claim 7 is characterized in that, described intermediate frame generation module comprises:
Cutting unit is used for picture breakdown is become stationary object and moving object;
Evaluation block is used for obtaining by the estimating motion method displacement vector of each moving object;
Compensating unit, the pixel predictors of each moving object after being used to utilize described moving object displacement vector calculating motion-compensated;
Generation unit is used for described pixel predictors row is quantized, encodes, transmits, and simultaneously described displacement vector and picture breakdown mode information is sent to decoder end, generates intermediate frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710164282 CN101420606A (en) | 2007-10-23 | 2007-10-23 | Image processing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710164282 CN101420606A (en) | 2007-10-23 | 2007-10-23 | Image processing method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101420606A true CN101420606A (en) | 2009-04-29 |
Family
ID=40631167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710164282 Pending CN101420606A (en) | 2007-10-23 | 2007-10-23 | Image processing method and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101420606A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102223552A (en) * | 2010-04-14 | 2011-10-19 | 佳能株式会社 | Image processing apparatus and image processing method |
| CN102496353A (en) * | 2011-11-30 | 2012-06-13 | 深圳市万兴软件有限公司 | Method for removing frame jitter and image display control |
| CN104079950A (en) * | 2014-07-04 | 2014-10-01 | 福建天晴数码有限公司 | Video output processing method, device and system and video receiving processing method, device and system |
| WO2015131304A1 (en) * | 2014-03-04 | 2015-09-11 | Microsoft Technology Licensing, Llc | Dictionary encoding and decoding of screen content |
| CN107742303A (en) * | 2017-09-29 | 2018-02-27 | 南京阿凡达机器人科技有限公司 | A kind of target image display processing method and system based on robot |
| CN107924667A (en) * | 2015-08-20 | 2018-04-17 | 高通股份有限公司 | The refresh rate to match with predictive time shift compensation |
| US10390034B2 (en) | 2014-01-03 | 2019-08-20 | Microsoft Technology Licensing, Llc | Innovations in block vector prediction and estimation of reconstructed sample values within an overlap area |
| US10469863B2 (en) | 2014-01-03 | 2019-11-05 | Microsoft Technology Licensing, Llc | Block vector prediction in video and image coding/decoding |
| US10506254B2 (en) | 2013-10-14 | 2019-12-10 | Microsoft Technology Licensing, Llc | Features of base color index map mode for video and image coding and decoding |
| US10542274B2 (en) | 2014-02-21 | 2020-01-21 | Microsoft Technology Licensing, Llc | Dictionary encoding and decoding of screen content |
| US10582213B2 (en) | 2013-10-14 | 2020-03-03 | Microsoft Technology Licensing, Llc | Features of intra block copy prediction mode for video and image coding and decoding |
| CN110913260A (en) * | 2018-09-18 | 2020-03-24 | 优酷网络技术（北京）有限公司 | Display control method, display control device and electronic equipment |
| US10659783B2 (en) | 2015-06-09 | 2020-05-19 | Microsoft Technology Licensing, Llc | Robust encoding/decoding of escape-coded pixels in palette mode |
| US10785486B2 (en) | 2014-06-19 | 2020-09-22 | Microsoft Technology Licensing, Llc | Unified intra block copy and inter prediction modes |
| US10812817B2 (en) | 2014-09-30 | 2020-10-20 | Microsoft Technology Licensing, Llc | Rules for intra-picture prediction modes when wavefront parallel processing is enabled |
| US10986349B2 (en) | 2017-12-29 | 2021-04-20 | Microsoft Technology Licensing, Llc | Constraints on locations of reference blocks for intra block copy prediction |
| US11109036B2 (en) | 2013-10-14 | 2021-08-31 | Microsoft Technology Licensing, Llc | Encoder-side options for intra block copy prediction mode for video and image coding |
| US11284103B2 (en) | 2014-01-17 | 2022-03-22 | Microsoft Technology Licensing, Llc | Intra block copy prediction with asymmetric partitions and encoder-side search patterns, search ranges and approaches to partitioning |
-
2007
- 2007-10-23 CN CN 200710164282 patent/CN101420606A/en active Pending
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8675051B2 (en) | 2010-04-14 | 2014-03-18 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
| CN102223552B (en) * | 2010-04-14 | 2014-08-27 | 佳能株式会社 | Image processing apparatus and image processing method |
| CN102223552A (en) * | 2010-04-14 | 2011-10-19 | 佳能株式会社 | Image processing apparatus and image processing method |
| CN102496353A (en) * | 2011-11-30 | 2012-06-13 | 深圳市万兴软件有限公司 | Method for removing frame jitter and image display control |
| CN102496353B (en) * | 2011-11-30 | 2014-04-30 | 深圳万兴信息科技股份有限公司 | Method for removing frame jitter and image display control |
| US11109036B2 (en) | 2013-10-14 | 2021-08-31 | Microsoft Technology Licensing, Llc | Encoder-side options for intra block copy prediction mode for video and image coding |
| US10582213B2 (en) | 2013-10-14 | 2020-03-03 | Microsoft Technology Licensing, Llc | Features of intra block copy prediction mode for video and image coding and decoding |
| US10506254B2 (en) | 2013-10-14 | 2019-12-10 | Microsoft Technology Licensing, Llc | Features of base color index map mode for video and image coding and decoding |
| US10390034B2 (en) | 2014-01-03 | 2019-08-20 | Microsoft Technology Licensing, Llc | Innovations in block vector prediction and estimation of reconstructed sample values within an overlap area |
| US10469863B2 (en) | 2014-01-03 | 2019-11-05 | Microsoft Technology Licensing, Llc | Block vector prediction in video and image coding/decoding |
| US11284103B2 (en) | 2014-01-17 | 2022-03-22 | Microsoft Technology Licensing, Llc | Intra block copy prediction with asymmetric partitions and encoder-side search patterns, search ranges and approaches to partitioning |
| US10542274B2 (en) | 2014-02-21 | 2020-01-21 | Microsoft Technology Licensing, Llc | Dictionary encoding and decoding of screen content |
| WO2015131304A1 (en) * | 2014-03-04 | 2015-09-11 | Microsoft Technology Licensing, Llc | Dictionary encoding and decoding of screen content |
| US10785486B2 (en) | 2014-06-19 | 2020-09-22 | Microsoft Technology Licensing, Llc | Unified intra block copy and inter prediction modes |
| CN104079950A (en) * | 2014-07-04 | 2014-10-01 | 福建天晴数码有限公司 | Video output processing method, device and system and video receiving processing method, device and system |
| US10812817B2 (en) | 2014-09-30 | 2020-10-20 | Microsoft Technology Licensing, Llc | Rules for intra-picture prediction modes when wavefront parallel processing is enabled |
| US10659783B2 (en) | 2015-06-09 | 2020-05-19 | Microsoft Technology Licensing, Llc | Robust encoding/decoding of escape-coded pixels in palette mode |
| CN107924667A (en) * | 2015-08-20 | 2018-04-17 | 高通股份有限公司 | The refresh rate to match with predictive time shift compensation |
| CN107742303B (en) * | 2017-09-29 | 2021-05-25 | 南京阿凡达机器人科技有限公司 | Target image display processing method and system based on robot |
| CN107742303A (en) * | 2017-09-29 | 2018-02-27 | 南京阿凡达机器人科技有限公司 | A kind of target image display processing method and system based on robot |
| US10986349B2 (en) | 2017-12-29 | 2021-04-20 | Microsoft Technology Licensing, Llc | Constraints on locations of reference blocks for intra block copy prediction |
| CN110913260A (en) * | 2018-09-18 | 2020-03-24 | 优酷网络技术（北京）有限公司 | Display control method, display control device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101420606A (en) | Image processing method and apparatus | |
| CN1694501B (en) | Motion estimation employing adaptive spatial update vectors | |
| KR101675555B1 (en) | Coding of depth maps | |
| US8718143B2 (en) | Optical flow based motion vector estimation systems and methods | |
| EP1592248B1 (en) | Motion vector estimation employing adaptive temporal prediction | |
| US8625675B2 (en) | Block error compensating apparatus of image frame and method thereof | |
| JP4083265B2 (en) | Method and apparatus for converting image signal system | |
| US7693218B2 (en) | Motion vector estimation with improved motion vector selection | |
| JP5099371B2 (en) | Image quality evaluation method, image quality evaluation apparatus, and image quality evaluation program | |
| JP2000512091A (en) | Motion vector processing | |
| CN102378010A (en) | Frame interpolation method for video data restoration | |
| JP2005318622A (en) | Reverse film mode extrapolation method | |
| KR20040049214A (en) | Apparatus and Method for searching motion vector with high speed | |
| JPH11298861A (en) | Method and device for converting frame number of image signal | |
| CN103096083A (en) | Method and device of moving image compensation | |
| EP1754376A1 (en) | Motion estimation in interlaced video images | |
| US8767831B2 (en) | Method and system for motion compensated picture rate up-conversion using information extracted from a compressed video stream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20090429 |