JP2014045338A5

JP2014045338A5 -

Info

Publication number: JP2014045338A5
Application number: JP2012186484A
Authority: JP
Filing date: 2012-08-27
Publication date: 2015-07-09
Anticipated expiration: 2032-08-27

Description

第２の縮小遅延フレームＳＦ２内の第ｍのブロックＦ２Ｂｍ（ｍ＝１〜Ｍ）と現縮小フレームＳＦ０内の第ｍのブロックＦ０Ｂｍとは、第１の縮小遅延フレームＳＦ１内の処理対象ブロックＦ１Ｂａ（厳密にはその中心の画素）を中心として点対称の位置にあるので、ブロックＦ２Ｂｍの処理対象ブロックＦ１Ｂａに対する横方向のずれをｈ（ｈ＝−ＨＳ〜＋ＨＳ）、縦方向のずれをｖ（ｖ＝−ＶＳ〜＋ＶＳ）とすると、ブロックＦ０Ｂｍの処理対象ブロックＦ１Ｂａに対する横方向のずれは−ｈ、縦方向のずれは−ｖである。 The m-th block F2Bm (m = 1 to M) in the second reduced delay frame SF2 and the m-th block F0Bm in the current reduced frame SF0 are the processing target block F1Ba (in the first reduced delay frame SF1). Strictly speaking, since it is in a point-symmetrical position with respect to the center pixel), the horizontal shift of the block F2Bm with respect to the processing target block F1Ba is h (h = −HS to + HS), and the vertical shift is v (v = −VS to + VS), the horizontal shift of the block F0Bm with respect to the processing target block F1Ba is −h, and the vertical shift is −v.

評価データＥＤＡ１〜ＥＤＣＭのうち値が最小のものが第３群の評価データＥＤＢ１〜ＥＤＣＭのいずれかである場合には、動きベクトル決定部６は、第１の縮小遅延フレームＳＦ１の処理対象ブロックＦ１Ｂａの位置に対する、当該最小値の評価データに対応する、第２の縮小遅延フレームＳＦ２内のブロックの相対位置（位置の差）を第１の縮小動きベクトルＳＭＶ１として出力し、第２の縮小動きベクトルＳＭＶ２の代わりに対応するブロックがない（差分絶対値和が十分に小さいブロックがない）こと、即ち有効データがないことを示す信号を出力する。 When the evaluation data EDA1 to EDCM having the smallest value is any one of the third group of evaluation data EDB1 to EDCM, the motion vector determination unit 6 performs the processing target block F1Ba of the first reduced delay frame SF1. The relative position (positional difference) of the block in the second reduced delay frame SF2 corresponding to the evaluation data of the minimum value with respect to the position of is output as the first reduced motion vector SMV1, and the second reduced motion vector Instead of SMV2, a signal indicating that there is no corresponding block (no block having a sufficiently small difference absolute value sum), that is, no valid data is output.

動きベクトル検出部１２では、上記のように実在のデータである第１の縮小遅延フレームＳＦ１内のデータを用いて第２の縮小遅延フレームＳＦ２内のブロック及び現縮小フレームＳＦ０内のブロックから成るブロック対に対応するベクトルの候補を評価することにより動きベクトルを決定しているので第２の縮小遅延フレームＳＦ２及び現縮小フレームＳＦ０から第１の縮小遅延フレームＳＦ１への動きベクトルを精度良く算出することができる。
さらに、第２の縮小遅延フレームＳＦ２内のデータのみ、或いは現縮小フレームＳＦ０内のデータのみを、ベクトル候補に対応するテスト補間データとして用いているので、第２の縮小遅延フレームから現縮小フレームの間で物体が隠れたり、出現したりしても動きベクトルを精度良く算出することができる。 The motion vector detection unit 12 uses the data in the first reduced delay frame SF1, which is actual data as described above, to make up a block consisting of a block in the second reduced delay frame SF2 and a block in the current reduced frame SF0. Since the motion vector is determined by evaluating the vector candidates corresponding to the pair, the motion vector from the second reduced delay frame SF2 and the current reduced frame SF0 to the first reduced delay frame SF1 is accurately calculated. Can do.
Furthermore, since only the data in the second reduced delay frame SF2 or only the data in the current reduced frame SF0 is used as test interpolation data corresponding to the vector candidate, the second reduced delay frame to the current reduced frame are changed. Even if an object is hidden or appears in between, a motion vector can be calculated with high accuracy.

Claims

In an image processing apparatus for inserting an interpolation frame between a current frame of an image and a first delay frame which is a frame one frame before the current frame,
The first movement from the second delay frame to the first delay frame with reference to the data of the first delay frame and the data of the second delay frame which is a frame two frames before the current frame A motion vector detector that calculates a vector and calculates a second motion vector from the current frame to the first delay frame by referring to the data of the current frame and the data of the first delay frame;
The first motion vector is converted into a third motion vector from the first delay frame to the interpolation frame, and the second motion vector is converted into a fourth motion vector from the current frame to the interpolation frame. A motion vector conversion unit to convert,
The interpolation frame data is generated from the third motion vector, the fourth motion vector, the first delay frame data, and the current frame data, and the interpolation frame data is converted into the current frame data. An interpolation frame generator for outputting image data inserted between the data and the data of the first delay frame,
The motion vector detection unit
The current frame is reduced by shifting the phase at random for each pixel, and the current reduced frame is output. The first delayed frame is reduced by shifting the phase at every pixel, and the first reduced delay frame is output. A dither reduction unit that outputs the second reduced delay frame by reducing the phase of the second delayed frame at random for each pixel, and
An image processing apparatus comprising: a motion vector expansion unit that expands and outputs a motion vector detected from the current reduced frame, the first reduced delay frame, and the second reduced delay frame.

The motion vector detection unit
A block in the first reduced delay frame corresponding to the interpolation target block of the interpolation frame is set as a processing target block, and data of a block forming a part of the second reduced delay frame and the current reduced frame A first group of test interpolation data composed of an average value for each pixel of block data forming a part; a second group of test interpolation data composed of block data forming part of the current frame; A test interpolation unit that outputs a plurality of test interpolation data including a third group of test interpolation data composed of block data of the second reduced delay frame;
Interpolation data that evaluates the strength of correlation of each test interpolation data with respect to the data of the processing target block among the first to third groups of test interpolation data and outputs a plurality of evaluation data indicating the results of the evaluation An evaluation unit;
A motion vector corresponding to the test interpolation data that has generated the evaluation data indicating the strongest correlation among the plurality of evaluation data is output as at least one of the first reduced motion vector and the second reduced motion vector. A motion vector determination unit;
The motion vector expansion unit expands at least one of the first reduced motion vector and the second reduced motion vector and outputs it as at least one of the first and second motion vectors;
The first group of test interpolation data is obtained from a plurality of blocks of the second reduced delay frame and a plurality of blocks of the current reduced frame;
The second group of test interpolation data is obtained from a plurality of blocks of the current reduced frame;
The image processing apparatus according to claim 1, wherein the third group of test interpolation data is obtained from a plurality of blocks of the second reduced delay frame.

The test interpolation unit includes:
A plurality of blocks each consisting of a plurality of pixels in each of the first reduced delay frames are sequentially selected as processing target blocks, and the processing target block is the center.
A block in the second reduced delay frame and a block in the current reduced frame, which are located symmetrically with respect to each other, are extracted, and data of the extracted block of the second reduced delay frame and the extracted current block are extracted. the average value of each pixel data of the block of the reduced small frame, determined as test interpolation data of the first group,
Outputting the data of the block in the extracted current reduced frame as the second group of test interpolation data;
The image processing apparatus according to claim 2, wherein the extracted data of the block in the second reduced delay frame is output as the third group of test interpolation data.

The test interpolation unit has a plurality of test interpolation data generation units,
Each of the plurality of test interpolation data generation units averages the data of different position blocks in the current reduced frame and the data of blocks in different positions in the second reduced delay frame for each pixel. The image processing apparatus according to claim 3, wherein the obtained data is calculated as the first group of test interpolation data.

The interpolation data evaluation unit
Each of the plurality of test interpolation data output from the test interpolation unit,
Calculating a correlation value indicating a correlation with the data of the processing target block;
The image processing apparatus according to any one of claims 2 to 4, wherein the plurality of evaluation data are generated based on a plurality of correlation values respectively obtained for the plurality of test interpolation data.

The interpolation data evaluation unit
The difference absolute value sum that is a sum of absolute values of differences between the plurality of test interpolation data output from the test interpolation unit and data of the processing target block is calculated as the correlation value. Item 6. The image processing apparatus according to Item 5 .

The interpolation data evaluation unit
The image processing apparatus according to claim 6, further comprising a plurality of correlation value calculation units that calculate a sum of absolute differences between the data of the processing target block and the plurality of test interpolation data.

An image processing apparatus according to any one of claims 1 to 7,
An image display device comprising: an image display unit that displays an image based on the image data output from the interpolation frame generation unit.

In an image processing method of inserting an interpolation frame between a current frame of an image and a first delay frame that is a frame one frame before the current frame,
The first movement from the second delay frame to the first delay frame with reference to the data of the first delay frame and the data of the second delay frame which is a frame two frames before the current frame A motion vector detecting step of calculating a vector and calculating a second motion vector from the current frame to the first delay frame with reference to the data of the current frame and the data of the first delay frame;
Converting the first motion vector into a third motion vector from the first delay frame to the interpolation frame, and converting the second motion vector into a fourth motion vector from the current frame to the interpolation frame; A motion vector conversion step to convert,
The interpolation frame data is generated from the third motion vector, the fourth motion vector, the first delay frame data, and the current frame data, and the interpolation frame data is converted into the current frame data. An interpolation frame generating step of outputting image data inserted between the data and the data of the first delay frame,
The motion vector detection step includes
The current frame is reduced by shifting the phase at random for each pixel, and the current reduced frame is output. The first delayed frame is reduced by shifting the phase at every pixel, and the first reduced delay frame is output. A dither reduction step of reducing the second delay frame by shifting the phase at random for each pixel and outputting a second reduced delay frame;
An image processing method comprising: a motion vector expansion step of expanding and outputting a motion vector detected from the current reduced frame, the first reduced delay frame, and the second reduced delay frame.

The motion vector detection step includes
A block in the first reduced delay frame corresponding to the interpolation target block of the interpolation frame is set as a processing target block, and data of a block forming a part of the second reduced delay frame and the current reduced frame A first group of test interpolation data composed of an average value for each pixel of block data forming a part; a second group of test interpolation data composed of block data forming part of the current frame; A test interpolation step of outputting a plurality of test interpolation data including a third group of test interpolation data composed of block data of the second reduced delay frame;
Interpolation data that evaluates the strength of correlation of each test interpolation data with respect to the data of the processing target block among the first to third groups of test interpolation data and outputs a plurality of evaluation data indicating the results of the evaluation An evaluation step;
A motion vector corresponding to the test interpolation data that has generated the evaluation data indicating the strongest correlation among the plurality of evaluation data is output as at least one of the first reduced motion vector and the second reduced motion vector. A motion vector determination step,
The motion vector expansion step expands at least one of the first reduced motion vector and the second reduced motion vector and outputs it as at least one of the first and second motion vectors;
The first group of test interpolation data is obtained from a plurality of blocks of the second reduced delay frame and a plurality of blocks of the current reduced frame;
The second group of test interpolation data is obtained from a plurality of blocks of the current reduced frame;
10. The image processing method according to claim 9, wherein the third group of test interpolation data is obtained from a plurality of blocks of the second reduced delay frame.

The test interpolation step includes:
A plurality of blocks each consisting of a plurality of pixels in each of the first reduced delay frames are sequentially selected as processing target blocks, and the processing target block is the center.
A block in the second reduced delay frame and a block in the current reduced frame, which are located symmetrically with respect to each other, are extracted, and data of the extracted block of the second reduced delay frame and the extracted current block are extracted. the average value of each pixel data of the block of the reduced small frame, determined as test interpolation data of the first group,
Outputting the data of the block in the extracted current reduced frame as the second group of test interpolation data;
11. The image processing method according to claim 10, wherein data of the block in the extracted second reduced delay frame is output as the third group of test interpolation data.

The test interpolation step includes a plurality of test interpolation data generation steps,
In the plurality of test interpolation data generation steps, data of blocks in different positions in the current reduced frame and data of blocks in different positions in the second reduced delay frame are averaged for each pixel. The image processing method according to claim 11, wherein the obtained data is calculated as the first group of test interpolation data.

The interpolation data evaluation step includes
Each of the plurality of test interpolation data output from the test interpolation step;
Calculating a correlation value indicating a correlation with the data of the processing target block;
The image processing method according to any one of claims 10 to 12, wherein the plurality of evaluation data are generated based on a plurality of correlation values respectively obtained for the plurality of test interpolation data.

The interpolation data evaluation step includes
The difference absolute value sum that is a sum of absolute values of differences between the plurality of test interpolation data output from the test interpolation step and the data of the processing target block is calculated as the correlation value. Item 14. The image processing method according to Item 13 .

The interpolation data evaluation step includes
The image processing method according to claim 14 , further comprising a plurality of correlation value calculation steps for calculating a sum of absolute differences between the data of the processing target block and the plurality of test interpolation data.

An image processing method according to any one of claims 9 to 15,
An image display method comprising: an image display step for displaying an image based on the image data output from the interpolation frame generation step.