JP2011009847A - Image processor, display device, and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent that unnatural motion occurs and a viewer feels a sense of incongruity in frame interpolation of interlaced video converted from progressive video.SOLUTION: An image processor performs frame interpolation for progressive video of the first number of frames, in relation to video converted into an interlaced format with the second numbers of frames more than the first number of frames. The image processor includes a motion vector estimator 31, a motion estimator 32, a motion vector determiner 33, and an interpolated image generator 34. The motion vector estimator 31 estimates a motion vector V(t) in an arbitrary part of the inputted interlaced video and computes the motion vector. The motion estimator 32 estimates motion of the arbitrary part according to the motion vector and computes an estimated motion vector Va(t). The motion vector determiner 33 determines an interpolation determining value DV according to the motion vector and the estimated motion vector. The interpolated image generator 34 generates an interpolated image according to the interpolation determining value.

Description

  The embodiments referred to in this application relate to an image processing device, a display device, and an image processing method.

  2. Description of the Related Art Conventionally, a technique for increasing the number of frames to be displayed using a frame interpolation device (image processing device) in order to improve motion blur of a motion judder or a liquid crystal panel is known.

  Video such as CG and animation is often created with 30 frames / second progressive video (30p) due to its characteristics. For example, when transmitting 30p video in television broadcasting, the format is converted to a 60i signal. ing.

  In recent years, with the development of computer technology, CG video has been actively used. For example, video data for television broadcasting includes a large number of 30p video data converted into 60i signals.

  By the way, conventionally, various frame interpolation apparatuses have been proposed, and various techniques for generating an interpolation frame have been proposed.

JP 2005-268912 A JP 2008-135980 A JP 2008-160793 A JP 2004-297719 A

  As described above, there are a large number of 30p video data that has been converted into 60i signals in video data for television broadcasting. If frame interpolation is performed on such video data, an unnatural motion will occur. May give a sense of incongruity.

  This applies not only to 30p video data format-converted to 60i signals, but also to, for example, 24p video data format-converted to 60i signals.

  In view of the above-described problems, this application is directed to an image processing device, a display device, and an image processing method that can prevent an unnatural motion and an uncomfortable feeling in frame interpolation of interlaced video obtained by converting progressive video. For the purpose of provision.

  According to an embodiment, there is provided an image processing apparatus that performs frame interpolation on a video obtained by converting a progressive video having a first number of frames into an interlace format having a second number of frames larger than the first number of frames.

  The image processing apparatus includes a motion vector estimation unit, a motion estimation unit, a motion vector determination unit, and an interpolated image generation unit.

  The motion vector estimation unit calculates a motion vector by estimating a motion vector of an arbitrary part in the input interlaced video, and the motion estimation unit estimates the motion of an arbitrary part according to the motion vector and estimates the motion vector Is calculated.

  Further, the motion vector determination unit determines an interpolation determination value according to the motion vector and the estimated motion vector, and the interpolation image generation unit generates an interpolation image according to the interpolation determination value.

  The disclosed image processing device, display device, and image processing method have an effect of preventing an unnatural motion and an uncomfortable feeling in frame interpolation of an interlaced video obtained by converting a progressive video.

It is a block diagram which shows schematically the liquid crystal television as an example to which an image processing apparatus is applied. It is a figure for demonstrating an example of format conversion. It is a block diagram which shows an example of an image processing apparatus. It is a figure for demonstrating the problem in the image processing apparatus of FIG. It is a block diagram which shows one Example of an image processing apparatus. It is a figure for demonstrating an example of operation | movement of the motion vector estimation part in the image processing apparatus of FIG. It is a block diagram which shows an example of the motion estimation part in the image processing apparatus of FIG. It is a figure for demonstrating an example of operation | movement of the interpolation image generation part in the image processing apparatus of FIG. It is a block diagram which shows the example of the interpolation image generation part of FIG. It is a figure for demonstrating an example of operation | movement of an image processing apparatus. It is a figure for demonstrating the example of the medium which recorded the image processing program to which a present Example is applied, and an image processing program.

  First, before describing embodiments of an image processing apparatus and an image processing method in detail, an image processing apparatus and its problems will be described with reference to FIGS.

  FIG. 1 is a block diagram schematically showing a liquid crystal television (display device) as an example to which an image processing device (frame interpolation device) is applied.

  As shown in FIG. 1, the liquid crystal television 100 includes a tuner / decoder 1, a video converter 2, a frame interpolation device 3, a delay device 4, a switch (third switch) 5, and a liquid crystal panel 6.

  The tuner / decoder 1 converts, for example, a broadcast wave supplied via the antenna ANT into moving image data and supplies it to the video converter 2. The video converter 2 performs video conversion processing such as scaling and IP conversion processing on the supplied moving image data.

  The frame interpolator 3 receives, for example, the moving image data of the current frame directly given from the video converter 2 and the moving image data delayed by one frame (of the immediately preceding frame) given via the delay unit 4, Interpolated image data is generated.

  The switch 5 switches, for example, the interpolated image data from the frame interpolating device 3 and the delayed moving image data from the delay unit 4 and supplies them to the liquid crystal panel 6, for example, a frame such as 2 × or 3 ×. Display received data at rate. As a result, motion blur and motion judder can be reduced.

  By the way, a television broadcast is generally broadcasted by 60 fields / second interlaced video (60i) in which one frame is displayed in two fields of an even number and an odd number.

  However, video such as CG and animation is often created with 30 frames / second progressive video (30p) in which one frame is displayed in one field because of its characteristics.

  Therefore, when transmitting a video such as CG or animation in a television broadcast, it is necessary to convert the format of the 30p video into a 60i signal.

  Note that the 30p video data that has been converted to a 60i signal may be a part of the screen, not the entire screen (one frame).

  In recent years, CG video has been actively used due to the development of computer technology, and there are many such video data.

  FIG. 2 is a diagram for explaining an example of format conversion, and shows a state in which a 30p video is converted into a 60i signal when a video such as CG or animation is transmitted in a television broadcast.

  That is, generally, a frame of 30p progressive video is divided into two field images of a top field (an image composed of only odd lines) and a bottom field (an image composed of only even lines), Format conversion to 60i signal.

  Here, as shown in FIG. 2, in the fields (frames) f1 to f8 converted into 60i signals, the frames f1, f2; f3, f4; f5, f6; f7, f8 are temporally the same. It has the characteristic of becoming an image of time.

  Therefore, a case is considered in which frame interpolation processing is performed on the 30p video converted to 60i (30p video multiplexed on 60i; hereinafter, this video is also simply referred to as 30p video).

  At this time, in the frame interpolation process, motion blur cannot be improved by simply inserting the same frame. Therefore, motion estimation is performed and an image suitable for the estimated motion is inserted. Various frame interpolation processes have been proposed.

FIG. 3 is a block diagram illustrating an example of an image processing apparatus (frame interpolation apparatus).
As illustrated in FIG. 3, the frame interpolation device 3 includes a motion vector estimation unit 131, a 30p video detection unit 132, and an interpolation image generation unit 133.

  The motion vector estimation unit 131 performs a motion vector search using, for example, a block matching method and calculates a motion vector V (t). The 30p video detection unit 132 detects a 30p video (a 30p video whose format has been converted to 60i), and supplies the detection result to the interpolation image generation unit 133.

  Here, the 30p video detection unit 132 detects the 30p video, for example, by calculating the match / mismatch of the input images and detecting the 30p video when matching and mismatching appear alternately.

  The interpolation image generation unit 133 receives the input image, the detection result from the 30p video detection unit 132, and the motion vector from the motion vector estimation unit 131, and generates and outputs an interpolation image.

  Note that the interpolation image generation unit 133 does not generate an interpolation image using a motion vector when a 30p video is detected.

  FIG. 4 is a diagram for explaining problems in the image processing apparatus of FIG. Here, FIG. 4A shows a 30p video multiplexed on 60i, and FIG. 4B shows a video converted to 120p using the motion vector estimated by the motion vector estimation unit 131. is there.

  FIG. 4C shows an image converted into 120p without using the motion vector estimated by the motion vector estimation unit 131.

  First, frames (fields) f1, f2, f3, and f4 shown in FIG. 4A show the 30p video described with reference to FIG. 2 converted to a 60i video.

  As shown in FIG. 4B, in the video converted to 120p using the estimated motion vector V (t), frames f1 and f2 having no motion between the frames, and the same frame between f3 and f4 f11 and f13 are interpolated. On the other hand, a frame f12 corresponding to the motion is interpolated between the frames f2 and f3 in which there is motion between the frames.

  As shown in FIG. 4C, in the video converted to 120p without using the estimated motion vector V (t), the same between frames f1 and f2 where there is no motion between frames, and between f3 and f4 Frames f21 and f23 are interpolated. Also, for example, the same frame f22 as the frame 2 is interpolated between the frames f2 and f3 in which there is movement between the frames.

  By the way, in the case of a normal moving image, it can be said that the image converted into 120p using the motion vector V (t) shown in FIG. 4B is preferable because the motion becomes smooth.

  However, for example, in a video obtained by converting a 30p video such as CG or animation into a 60i signal, if the frame f12 is inserted between the frames f2 and f3 having the motion of FIG. 4B, the motion is uncomfortable. A certain moving image is generated.

  That is, in a video obtained by converting a 30p video such as CG or animation into a 60i signal, a video converted to 120p without using the motion vector V (t) as shown in FIG. Moreover, since it becomes an image as the author intended, it is preferable. Therefore, it is more appropriate not to perform frame interpolation processing by motion compensation for 30p video.

  Therefore, in the frame interpolation apparatus 3 shown in FIG. 3, the 30p video detection unit 132 detects 30p video, and in that case, the motion estimated by the motion vector estimation unit 131 is controlled by controlling the interpolation image generation unit 133. An image converted to 120p is output without using a vector.

  However, the above-described method has a problem in that a 30p video detection unit 132 is provided separately, and a process for detecting a 30p video is required separately, which increases the processing amount.

  Also, for example, if a part of the video is 30p video such as PIP (Picture in Picture: video in which another video is inserted in a small area on the screen), the 30p video is displayed on the entire screen. Since it is detected, such a 30p video region cannot be detected.

  Therefore, for example, when only a part of the screen is a 30p video, the interpolation process based on motion estimation as described with reference to FIG. 4B is performed on the 30p video region. Become.

Hereinafter, embodiments of an image processing apparatus and an image processing method will be described in detail with reference to the accompanying drawings.
FIG. 5 is a block diagram showing an embodiment of an image processing apparatus (frame interpolation apparatus). Note that the frame interpolation apparatus in FIG. 5 is applied to the liquid crystal television in FIG. 1 described above, for example.

  As illustrated in FIG. 5, the frame interpolation device 3 a according to the present exemplary embodiment includes a motion vector estimation unit 31, a motion estimation unit 32, a motion vector determination unit 33, and an interpolation image generation unit 34.

  The motion vector estimator 31 estimates and outputs a motion vector V (t) of the input video, and the motion estimator 32 adds the motion vector V (t) to the supplied motion vector and thus the motion of the object in the video. An estimated motion vector Va (t) for estimating is output.

  The motion vector determination unit 33 determines and outputs an interpolation determination value DV according to the estimated motion vector Va (t) from the motion estimation unit 32 and the motion vector V (t) from the motion vector estimation unit 31, and also performs interpolation. The image generation unit 34 generates an interpolated image according to the interpolation determination value DV. In the embodiment shown in FIG. 5, the input image is also supplied to the interpolation image generation unit 34.

  Here, the motion vector estimation unit 31 performs a motion vector search using, for example, a block matching method, and determines and outputs a motion vector V (t).

  FIG. 6 is a diagram for explaining an example of the operation of the motion vector estimation unit 31 in the image processing apparatus of FIG. 5, and shows a motion vector estimation method using a block matching method.

  As shown in FIGS. 5 and 6, the motion vector estimation unit 31 receives two frames (and two fields) of video (for example, frames (fields) f2 and f3 in FIG. 4).

  Here, the frame f3 is a reference frame that is the starting point of the vector, and the frame f2 that is the end point of the motion vector is the reference frame.

  The reference frame f3 is divided into blocks of a predetermined size (for example, 8 × 8 pixels), attention is given to a certain block B1, and a motion vector V (t) of the block B1 is obtained. First, SAD (Sum of Absolute Difference) is calculated for all motion vector candidates.

  SAD is a value that quantitatively represents the correlation between images, and the smaller this value, the more consistent the images.

  Then, the minimum value of the SAD is set as the motion vector of the block B1, and this process is performed on all the blocks, thereby calculating the motion vectors of all the blocks.

  In this way, the motion vector V (t) calculated by the motion vector estimation unit 31 is supplied to the motion estimation unit 32, the motion vector determination unit 33, and the interpolation image generation unit 34.

FIG. 7 is a block diagram illustrating an example of a motion estimation unit in the image processing apparatus of FIG.
As illustrated in FIG. 7, the motion estimation unit 32 includes a vector delay unit 321, an acceleration estimation unit 322, and an addition unit 323.

  The vector delay unit 321 stores the current motion vector V (t) and outputs past motion vectors V (t−1), V (t−2), and the like, and the acceleration estimation unit 322 includes a vector. The acceleration is estimated using a plurality of past vectors V (t-1), V (t-2), etc. from the delay unit 321.

  The adder 323 receives the past motion vector V (t−1) from the vector delay unit 321 and the acceleration a from the acceleration estimator 322, and estimates and outputs the current vector.

  That is, the vector delay unit 321 stores (holds) the motion vector V (t) from the motion vector estimation unit 31. The acceleration estimation unit 322 estimates the acceleration a from the vector V (t−1) 1 time past and the vector V (t−2) 2 times past from the vector delay unit 321.

  Specifically, for example, the acceleration a can be approximately calculated by a = V (t−1) −V (t−2).

  Then, the adder 323 adds V (t−1) and a to calculate an estimated motion vector Va (t) of V (t). That is, the estimated motion vector Va (t) is obtained as Va (t) = V (t−1) + a.

Here, the acceleration a and the vector V are vector values having position coordinate x and y components. That is, it is assumed that the motion estimated by the motion estimation unit is a motion in which a photographed object in the video satisfies x = a _x t ² + V _x t and y = a _y t ² + V _y t. If you are looking for speed.

  The motion vector Va (t) calculated by the motion estimation unit 32 obtained in this way is supplied to the motion vector determination unit 33.

  The motion vector determination unit 33 compares the motion vector V (t) from the motion vector estimation unit 31 with the estimated motion vector Va (t) from the motion estimation unit 32 to determine match / mismatch.

  That is, Va (t) and V (t) are compared, and if it is equal to or greater than a certain threshold value, it is determined that the interpolation is performed as matching, and otherwise, the interpolation determination value DV is determined as not matching and not interpolated. Is output. The interpolation determination value DV from the motion vector determination unit 33 is supplied to the interpolation image generation unit 34.

  FIG. 8 is a diagram for explaining an example of the operation of the interpolated image generation unit in the image processing apparatus of FIG. As in FIG. 6, reference numeral f3 indicates a reference frame that is a starting point of a vector, and f2 indicates a reference frame that is an end point of a motion vector. Reference numeral f32 indicates an interpolation frame (interpolation image) inserted by the interpolation image generation unit 34.

  First, the interpolation frame f32 is divided into blocks of a predetermined size (for example, 8 × 8 pixels), and attention is paid to a certain block B2 ′, and an interpolation image of the block B2 ′ is determined.

  Specifically, for example, the motion vector V (t) obtained by the motion vector estimation unit 31 is reduced to 1/2 (V (t) / 2), and the start point of the motion vector is set as the reference frame f3. To the position of the interpolation frame f32 to calculate a motion vector V (t) -2.

  Further, the image (B2) at the end point of the motion vector V (t) -2 in the reference frame f2 is copied to the start point (B2 ') of the interpolation frame f32. And the process with respect to the said block is performed with respect to all the blocks (B2 ').

  Here, as shown in FIG. 5, an input image is also supplied to the interpolated image generation unit 34 of the present embodiment, and interpolation is performed for each region in accordance with the interpolation determination value DV from the motion vector determination unit 33. One of the frame image f32 and the input image (frame f2) is selected and output.

  FIG. 9 is a block diagram illustrating an example of the interpolation image generation unit, FIG. 9A illustrates an example corresponding to the interpolation image generation unit 34 illustrated in FIG. 5, and FIG. 9B illustrates a modification of the interpolation image generation unit. An example is given.

  First, as illustrated in FIG. 9A, the interpolation image generation unit 34 of an example includes an interpolation image generation circuit 341 and a switch (first switch) 342. The interpolation image generation circuit 341 is substantially a circuit corresponding to the interpolation image generation unit 34 that receives the motion vector V (t) described above and generates an interpolation image.

  The switch 342 selects one of the interpolation image f32 generated by the interpolation image generation circuit 341 and the input image f2 according to the interpolation determination value DV, and outputs the image as an interpolation image from the interpolation image generation unit 34. As a result, the interpolation image generation unit 34 outputs the interpolation image f32 or f2 corresponding to the interpolation determination value DV.

  Alternatively, as illustrated in FIG. 9B, the interpolation image generation unit 34 a according to the modification includes a switch (second switch) 343 and an interpolation image generation circuit 344. The interpolation image generation circuit 344 is substantially a circuit corresponding to the interpolation image generation unit 34 that generates the above-described interpolation image.

  The switch 343 selects one of the motion vector V (t) and the “0” vector from the motion vector estimation unit 31 according to the interpolation determination value DV, and supplies the selected vector to the interpolation image generation circuit 344. .

  Here, when the switch 343 selects the “0” vector and the “0” vector is supplied to the interpolation image generation circuit 344, the interpolation image generation circuit 344 outputs the reference frame f2 as it is, for example. As a result, the interpolation image generation unit 34a outputs the interpolation image f32 or f2 corresponding to the interpolation determination value DV.

  As described above, for example, it is possible to calculate the motion of an object in an image and perform interpolation processing only on an object whose motion is moving based on the motion law of classical mechanics. That is, for example, it is possible not to interpolate an image having a motion that does not exist in nature such as a 30p image.

FIG. 10 is a diagram for explaining an example of the operation of the image processing apparatus of FIG.
First, when the image processing operation starts, in operation SOA, the input frame is divided into blocks of 8 × 8 pixels. Here, it goes without saying that the blocks to be divided are not limited to 8 × 8 pixels.

  Next, the process proceeds to operation SOB, and as described with reference to FIG. 6, the motion vector estimation unit 31 estimates (calculates) the motion vector V (t) using a block matching method or the like, and returns to the operation SOC. move on.

  Here, the operations SOC to SOE correspond to the processing of the motion estimation unit 32, the operation SOC corresponds to the vector delay unit 321, the operation SOD corresponds to the acceleration estimation unit 322, and the operation SOE corresponds to the processing of the addition unit 323.

  That is, as described with reference to FIG. 7, in the operation SOC, the vector delay unit 321 stores (stores) the calculated motion vector V (t), and in the operation SOD, the acceleration estimation unit 322 calculates the acceleration a. Estimate (calculate).

  Further, in operation SOE, the adder 323 estimates (calculates) the estimated motion vector Va (t).

  Specifically, in the operation SOD, the acceleration a is calculated from the vector V (t−1) and the vector V (t−2) two times past from the vector delay unit 321 by a = V (t−1). ) −V (t−2).

  Further, in the operation SOE, the estimated motion vector Va (t) is calculated as Va (t) = V (t-1) + a by adding the vector V (t-1) and the acceleration a of one time past, Thereafter, the operation proceeds to operation SOF.

  The operation SOF corresponds to the processing of the motion vector determination unit 33, compares the motion vector V (t) with the estimated motion vector Va (t), and determines that the values are equal to each other (interpolate) if the threshold value is greater than a certain threshold value. Otherwise, it is determined that there is a mismatch (no interpolation), and the operation proceeds to operation SOG.

  Operation SOG corresponds to the processing of the interpolation image generation unit 34, and generates an interpolation image (f23) according to the match / mismatch result (interpolation determination value DV) and the motion vector V (t) from the motion vector determination unit 33.

  Then, the operation proceeds to operation SOH, the above processing is performed on all 8 × 8 pixel blocks, and the image processing operation is terminated. Each operation may be a processing step.

  The image processing apparatus of the present embodiment is not limited to the application to the liquid crystal television shown in FIG. The image processing apparatus described above can also be realized as an image processing program executed by a computer.

  FIG. 11 is a diagram for explaining an example of an image processing program to which the present embodiment is applied and a medium on which the image processing program is recorded.

  In FIG. 11, reference numeral 10 denotes a processing device (computer), 20 denotes a program (data) provider, and 30 denotes a portable recording medium.

  The present invention is given as a program (data) for the processing apparatus 10 as shown in FIG. The processing device 10 includes an arithmetic processing device main body 11 including a processor, and a processing device side memory (for example, a RAM (Random Access Memory) that stores a result of giving or processing a program (data) to the arithmetic processing device main body 11. ) And hard disk) 12 and the like. The program provided to the processing device 10 is loaded and executed on the main memory of the processing device 10.

  The program provider 20 has means (line destination memory: for example, DASD (Direct Access Storage Device)) 21 for storing the program, and provides the program to the processing apparatus 10 via a line such as the Internet, or The data is provided to the processing apparatus 10 via a portable recording medium 30 such as an optical disk such as a CD-ROM or DVD, a magnetic disk, or a magnetic tape. Needless to say, the medium on which the image processing program according to the present invention is recorded includes various media such as the processing device side memory 12, the line destination memory 21, and the portable recording medium 30.

Regarding the embodiment including the above examples, the following supplementary notes are further disclosed.
(Appendix 1)
An image processing apparatus for performing frame interpolation on a video obtained by converting a progressive video having a first frame number into an interlace format having a second frame number larger than the first frame number,
A motion vector estimation unit that calculates a motion vector by estimating a motion vector of an arbitrary part in the input interlaced video;
A motion estimator that estimates the motion of the arbitrary part according to the motion vector and calculates an estimated motion vector;
A motion vector determination unit that determines an interpolation determination value according to the motion vector and the estimated motion vector;
An image processing apparatus comprising: an interpolation image generation unit configured to generate an interpolation image according to the interpolation determination value.

(Appendix 2)
In the image processing apparatus according to attachment 1,
The motion estimator is
A vector delay unit that holds a current motion vector from the motion vector estimation unit and outputs a past motion vector;
An acceleration estimating unit that estimates acceleration using a plurality of past vectors from the vector delay unit;
An image processing apparatus comprising: an addition unit that adds the acceleration and the past vector to estimate a current vector in the arbitrary portion.

(Appendix 3)
In the image processing device according to attachment 2,
The vector delay unit receives the motion vector at the first time from the motion vector estimation unit, and the motion vector at the second time one hour before the first time and two times past from the first time. An image processing apparatus, wherein a motion vector at a third time is supplied to the acceleration estimation unit.

(Appendix 4)
In the image processing device according to attachment 3,
The acceleration estimation unit obtains an acceleration by subtracting the motion vector at the third time from the motion vector at the second time,
The image processing apparatus, wherein the adding unit calculates the estimated motion vector by adding the motion vector at the second time and the acceleration.

(Appendix 5)
In the image processing device according to any one of appendices 1 to 4,
The image processing apparatus outputs a progressive video having a third frame number that is n times the second frame number, where n is an integer of 2 or more.

(Appendix 6)
In the image processing device according to attachment 5,
The third frame number is twice the second frame number;
The interpolation image generation unit
An interpolation image generation circuit for generating the interpolation image;
An image processing apparatus comprising: an output image of the interpolation image generation circuit according to the interpolation determination value; and a first switch that selects and outputs a past image that has not been subjected to interpolation processing.

(Appendix 7)
In the image processing device according to attachment 5,
The third frame number is twice the second frame number;
The interpolation image generation unit
A second switch for selecting the motion vector and the zero vector according to the interpolation determination value;
An image processing apparatus comprising: an interpolation image generation circuit that switches and outputs the interpolated image and a past image that is not subjected to interpolation processing according to the output of the second switch.

(Appendix 8)
The image processing apparatus according to any one of appendices 1 to 7,
A decoder that receives the interlaced video of the second number of frames and converts it into moving image data;
A video converter for performing video conversion processing on the moving image data;
A delay unit for delaying a frame image from the video converter;
A third switch for sequentially switching the interpolated image from the image processing device and the frame image from the delay unit;
And a display panel that receives the output of the third switch and displays an image.

(Appendix 9)
An image processing method for performing frame interpolation on a video obtained by converting a progressive video having a first frame number into an interlace format having a second frame number larger than the first frame number,
A motion vector is calculated by estimating a motion vector of an arbitrary part in the input interlaced video,
Estimating the motion of the arbitrary part according to the motion vector to calculate an estimated motion vector;
Determining an interpolation decision value according to the motion vector and the estimated motion vector; and
An image processing method comprising generating an interpolated image according to the interpolation determination value.

(Appendix 10)
An image processing program for performing frame interpolation on a video obtained by converting a progressive video having a first frame number into an interlace format having a second frame number larger than the first frame number,
On the computer,
A procedure for calculating a motion vector by estimating a motion vector of an arbitrary part in the input interlaced video;
A procedure for estimating the motion of the arbitrary portion according to the motion vector and calculating an estimated motion vector;
A procedure for determining an interpolation determination value according to the motion vector and the estimated motion vector; and
A procedure for generating an interpolated image according to the interpolation determination value.

(Appendix 11)
A program recording medium in which the program according to appendix 10 is recorded.

1 Tuner / Decoder 2 Video Converter 3, 3a Frame Interpolator 4 Delay Unit 5 Switch (Third Switch)
6 Liquid crystal panel 10 Processing unit 11 Arithmetic processing unit body 12 Processing unit side memory 20 Program (data) provider 21 Means for storing program (line destination memory)
DESCRIPTION OF SYMBOLS 30 Portable recording medium 31,131 Motion vector estimation part 32 Motion estimation part 33 Motion vector determination part 34,34a, 133 Interpolation image generation part 100 Liquid crystal television (display apparatus)
132 30p video detection unit 321 vector delay unit 322 acceleration estimation unit 323 addition unit 341, 344 interpolation image generation circuit 342 switch (first switch)
343 switch (second switch)

Claims (5)

An image processing apparatus for performing frame interpolation on a video obtained by converting a progressive video having a first frame number into an interlace format having a second frame number larger than the first frame number,
A motion vector estimation unit that calculates a motion vector by estimating a motion vector of an arbitrary part in the input interlaced video;
A motion estimator that estimates the motion of the arbitrary part according to the motion vector and calculates an estimated motion vector;
A motion vector determination unit that determines an interpolation determination value according to the motion vector and the estimated motion vector;
An image processing apparatus comprising: an interpolation image generation unit configured to generate an interpolation image according to the interpolation determination value. The image processing apparatus according to claim 1.
The motion estimator is
A vector delay unit that holds a current motion vector from the motion vector estimation unit and outputs a past motion vector;
An acceleration estimating unit that estimates acceleration using a plurality of past vectors from the vector delay unit;
An image processing apparatus comprising: an addition unit that adds the acceleration and the past vector to estimate a current vector in the arbitrary portion. The image processing apparatus according to claim 1 or 2,
The image processing apparatus outputs a progressive video having a third frame number that is n times the second frame number, where n is an integer of 2 or more. The image processing apparatus according to claim 3.
The third frame number is twice the second frame number;
The interpolation image generation unit
An interpolation image generation circuit for generating the interpolation image;
An image processing apparatus comprising: an output image of the interpolation image generation circuit according to the interpolation determination value; and a first switch that selects and outputs a past image that has not been subjected to interpolation processing. An image processing method for performing frame interpolation on a video obtained by converting a progressive video having a first frame number into an interlace format having a second frame number larger than the first frame number,
A motion vector is calculated by estimating a motion vector of an arbitrary part in the input interlaced video,
Estimating the motion of the arbitrary part according to the motion vector to calculate an estimated motion vector;
Determining an interpolation decision value according to the motion vector and the estimated motion vector; and
An image processing method comprising generating an interpolated image according to the interpolation determination value.

Images