JP2004320279A - Dynamic image time axis interpolation method and dynamic image time axis interpolation apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a dynamic image time axis interpolation method and a dynamic image time axis interpolation apparatus by obtaining a temporally forward interpolation image and a temporally backward interpolation image and adaptively summating both the interpolation images according to the correlation and the probability between images to be interpolated so as to obtain a final interpolation image thereby forming a proper interpolation image even for an image part with a greater time change. <P>SOLUTION: A motion estimate unit 5 obtains the backward interpolation image resulting from applying motion compensation to a temporal future image of the image to be interpolated and information about its reliability. A motion estimate unit 15 obtains the forward interpolation image resulting from applying motion compensation to a temporal past image of the image to be interpolated and information about its reliability. Motion compensation units 6, 7 and a subtractor 9 obtain the inter-interpolation image similarity between the forward interpolation image and the backward interpolation image. A weight discrimination unit 14 decides a coefficient k in response to the information of each reliability of the backward interpolation image and the forward interpolation image and the inter-interpolation image similarity, a multiplier 16 multiplies the coefficient k with the backward interpolation image, a multiplier 17 multiplex a coefficient 1-k with the forward interpolation image, and an adder 8 sums outputs of the multipliers and provides an interpolation image signal subjected to the adaptive weight summation. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a moving picture time axis interpolation method and a moving picture time axis interpolation apparatus, and more particularly to a method for extracting a moving picture signal having an image rate different from that of an incoming moving picture signal. The present invention relates to a moving picture time axis interpolation method and a moving picture time axis interpolation apparatus for forming a frame or a field of a time not to be interpolated from an incoming moving picture signal and changing an effective frame (field) rate of the incoming moving picture signal.
[0002]
[Prior art]
Since a normal NTSC television signal has 60 fields per second in interlaced scanning, there is not much problem in the smoothness of motion of a moving image. On the other hand, a film image of 24 to 30 frames per second, such as a movie, or a computer graphics image formed by sequential scanning of 30 frames per second has an unnatural motion (judder, jerkiness) in a moving image.
[0003]
On the other hand, a television signal of the PAL system or the SECAM system has 50 fields per second, and therefore, it is necessary to convert the signal into 60 fields per second in order to broadcast or display in the NTSC system. Further, since the PAL system and the SECAM system have a low field frequency, flicker on a large screen poses a problem, and it is desired to convert the display into 75 fields or 100 fields instead of 50 fields.
[0004]
Thus, when converting to a moving image signal having an image rate different from that of the input moving image signal, it is desired that the movement of the image be natural. Therefore, a moving image rate conversion method (moving image time axis interpolation method) for forming a frame or field that does not exist temporally as motion compensation interpolation and performing motion compensation to change the effective image rate with smooth movement has been proposed. (For example, see Patent Documents 1 and 2).
[0005]
That is, in Patent Document 1, when a motion compensation field obtained by motion compensation based on a motion vector is weighted and added at a predetermined field interpolation ratio to obtain an interpolation field, the field interpolation ratio is determined by the phase relation of the fields. A moving image time axis interpolation method that adaptively switches based on a determined value and a value of a motion vector is disclosed.
[0006]
Further, in Patent Document 2, a block-based motion vector is searched based on an image signal, a pixel-based motion vector is generated based on the block-based motion vector, and interpolation of the image signal generated based on the pixel-based motion vector is performed. A method of converting the number of frames of an image signal by using an interpolation frame of an image signal generated by a frame or a frame signal of an image signal is disclosed.
[0007]
In addition, conventionally, a moving image interpolation device shown in the block diagram of FIG. 4 is also known. FIG. 4 shows a moving image interpolating device that converts a progressively scanned image signal of 30 frames per second into a progressively scanned image signal of 60 frames per second. The progressively scanned image signal of 30 frames per second input from the image input terminal 1 is The signals are supplied to the frame delay unit 2, the motion estimator 51, the motion compensator 6, and the frame buffer 10, respectively. The frame delay unit 2 delays the input sequentially scanned image signal of 30 frames per second by approximately one frame.
[0008]
The motion estimator 51 receives the progressively scanned image signal of 30 frames per second from the image input terminal 1 and the progressively scanned image signal of 30 frames per second delayed by approximately one frame by the frame delay unit 2 and performs interpolation. A motion vector (MV) of each part of the interpolated image is obtained from matching between frames before and after the position. Here, each part is a block of 8 × 8 pixels or the like, but may not be a finer block or a square block.
[0009]
The motion compensator 6 spatially moves the sequentially scanned image signal of 30 frames per second from the image input terminal 1 according to the MV from the motion estimator 51. The motion compensator 7 spatially moves the 30-frame-per-second progressively scanned image signal output from the frame delay unit 2 and delayed by approximately one frame according to the MV from the motion estimator 51. Here, the MV is common to both the motion compensators 6 and 7, but the moving direction is reversed between the motion compensator 6 and the motion compensator 7.
[0010]
The input image signal motion-compensated by the motion compensator 6 and the one-frame delayed image signal motion-compensated in the reverse direction by the motion compensator 7 are added by the adder 8 and then divided by 2 to form an interpolated image. . This interpolated image is stored in the frame buffer 11 and read out at twice the speed. Similarly, the input sequential scanning image signal from the image input terminal 1 is also stored in the frame buffer 10 and read out at twice the speed. At one frame time of the input image signal, the input image signal held in the frame buffer 10 and the interpolated image signal held in the frame buffer 11 are alternately read out, and sent to the image output terminal 13 via the switch 12. It is output as a progressively scanned image signal at twice the image rate, that is, 60 frames per second.
[0011]
FIG. 5 shows how interpolation is performed by this conventional device. In the figure, one circle is one pixel, and the shading indicates a pixel value. The vertical continuation indicates a part of the scanning line or a pixel row in the vertical direction. The solid line indicates an input progressively scanned image signal of 30 frames per second, and the broken line indicates an interpolated image signal. The center is the current pixel to be interpolated, the dark and thin arrows are the MVs with a high correlation between the previous and next frames, and the thin and thick arrows are the motion compensated interpolations by the MVs. FIG. 5 shows that the pixels are moving slowly with time, but that the motion compensation allows for appropriate interpolation.
[0012]
[Patent Document 1]
JP-A-10-23374 [Patent Document 2]
JP-A-11-112939
[Problems to be solved by the invention]
However, the above-described conventional moving image time axis interpolation apparatus and method perform interpolation based on the correlation between the images before and after the interpolated image (frame or field). However, there is a problem that there is no good image portion and proper interpolation cannot be performed. Conventionally, only one type of motion vector has been obtained. Therefore, if the only obtained motion vector is inappropriate, interpolation is not properly performed.
[0014]
The present invention has been made by paying attention to the above points, and obtains an interpolated image that is forward in time and an interpolated image that is reverse in time, and adapts both interpolated images according to the correlation and certainty between the interpolated images. It is an object of the present invention to provide a moving image time axis interpolation method and a moving image time axis interpolation device in which an addition is performed to obtain a final interpolated image, thereby forming an appropriate interpolated image even for an image portion having a large temporal change.
[0015]
[Means for Solving the Problems]
In order to achieve the above object, a moving image time axis interpolation method of the present invention generates an interpolated image (frame or field) temporally different from an incoming moving image, and generates a new moving image from the incoming moving image and the interpolated image. A moving image time axis interpolation method for forming an image, comprising: a backward interpolation image in which a frame or a field of an incoming moving image in the future is temporally compensated for an interpolation image to be generated; A second step of obtaining a forward interpolation image obtained by motion-compensating a frame or a field of an incoming moving image temporally past with respect to an interpolation image to be generated, and information of its reliability. A third step of calculating a similarity between the interpolated images of the forward interpolation image and the backward interpolation image; information on the reliability of the backward interpolation image; information on the reliability of the forward interpolation image; Depending on the similarity A fourth step of adaptively weighting and adding the forward interpolation image and the backward interpolation image to generate an interpolation image, and a fifth step of forming a new moving image from the incoming moving image and the generated interpolation image. It is characterized by including.
[0016]
Further, in order to achieve the above object, the moving image time axis interpolation apparatus of the present invention generates an interpolated image (frame or field) that is temporally different from an incoming moving image, and newly generates an interpolated image from the incoming moving image and the interpolated image. A time axis interpolating apparatus for forming a moving image, comprising: a backward interpolation image in which a frame or a field of an incoming moving image in the future is temporally compensated for an interpolation image to be generated; Backward interpolation means for obtaining information on the forward interpolation image obtained by motion-compensating a frame or field of an incoming moving image in the past with respect to the interpolation image to be generated, and forward information for obtaining information on its reliability. Interpolation means, correlation detection means for obtaining a similarity between the interpolated images of the forward interpolation image and the backward interpolation image, information on the reliability of the backward interpolation image, information on the reliability of the forward interpolation image, and an interpolation image Between similarities Adaptive weighting means for adaptively weighting and adding the forward interpolation image and the backward interpolation image to generate an interpolation image; and a moving image forming means for forming a new moving image from the incoming moving image and the generated interpolation image. It has the structure which has.
[0017]
In the moving image time axis interpolation method and apparatus according to the present invention described above, a backward interpolation image in which a frame or a field of an incoming moving image in the future is temporally compensated for the interpolation image is formed, and the interpolation image is temporally interpolated. A forward interpolation image is formed by motion-compensating a frame or a field of a past incoming moving image, and information on the reliability of each of the backward interpolation image and the forward interpolation image, and the backward interpolation image and the forward interpolation image. According to the similarity between the interpolated images of the images, the backward interpolated image and the forward interpolated image are adaptively weighted and added to obtain the interpolated image signal, so that the final interpolated image signal is always obtained from the appropriate interpolated image. Can be formed.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of a moving image time axis interpolation apparatus according to the present invention. 4, the same components as those in FIG. 4 are denoted by the same reference numerals. This embodiment is different from the conventional apparatus shown in FIG. 4 in that frame delayers 3 and 4, a subtractor 9, a weight determiner 14, and multipliers 16 and 17 are added. The processing operations of the units 5 and 15 are significantly different from those of the motion estimator 51.
[0019]
In FIG. 1, a moving image signal, which is a progressively scanned image signal input from an image input terminal 1, is supplied to a frame delay unit 2 and a motion estimator 5, respectively. The frame delay unit 2 delays the input moving image signal by approximately one frame. The output moving image signal of the frame delay unit 2 is supplied to a frame delay unit 3, motion estimators 5 and 15, a motion compensator 6, and a frame buffer 10, respectively. The frame delay unit 3 delays the moving image signal input from the frame delay unit 2 by approximately one frame and supplies the moving image signal to the frame delay unit 4, the motion estimators 5 and 15, and the motion compensator 7, respectively. The frame delay unit 4 delays the moving image signal input from the frame delay unit 3 by approximately one frame, and supplies the moving image signal to the motion estimator 15.
[0020]
Here, the input moving image signal from the image input terminal 1, the output delay moving image signal of the frame delay unit 2, the output delay moving image signal of the frame delay unit 3, and the output delay moving image signal of the frame delay unit 4 are substantially the same. Used as four frames delayed by one frame. The input moving image signal is a first image, the output delay moving image signal of the frame delay unit 2 is a second image, the output delay moving image signal of the frame delay unit 3 is a third image, and the output delay moving image signal of the frame delay unit 4 is This is the fourth image.
[0021]
The motion compensator 6 spatially moves the second image according to the backward motion vector (MV _B ) supplied from the motion estimator 5. The motion compensator 7 spatially moves the third image according to the forward motion vector (MV _F ) supplied from the motion estimator 15. The second image motion-compensated by the motion compensator 6 becomes a temporally backward-interpolated image later than the interpolated image, and is multiplied by the coefficient k supplied from the weight determination unit 14 by the multiplier 16. Similarly, the third image motion-compensated by the motion compensator 7 becomes a forward-interpolated image that is temporally past the interpolated image, and is supplied by the multiplier 17 from the weight determining unit 14 with the coefficient (k−1). Is multiplied by The output signals of the multipliers 16 and 17 are added by the adder 8 to form a final interpolated image signal, which is supplied to the frame buffer 11 and accumulated for one frame.
[0022]
Further, the backward interpolation image and the forward interpolation image are subtracted by the subtractor 9, and the difference as the subtraction result is supplied to the weight determination unit 14. The weight determination unit 14 obtains a correlation result between the interpolation signals of the block by multiplying the incoming difference by an absolute value or a square and spatially integrating the difference. Further, the reliability information of the interpolation supplied from the motion estimators 5 and 15 is obtained, the coefficient k is determined based on the correlation result and the reliability information, and given to the multipliers 16 and 17. A specific method for determining k will be described later.
[0023]
One frame of the interpolated image signal stored in the frame buffer 11 is read out at twice the writing speed. On the other hand, after the second image output from the frame delay unit 2 is stored in the frame buffer 10 for one frame, the second image is read at twice the writing speed. The moving image signal (second image) held in the frame buffer 10 and the interpolated image signal held in the frame buffer 11 are alternately read in one frame time of the incoming moving image signal, and the incoming moving image is read. It is output as a moving image signal having an image rate twice as high as the image rate of the image signal.
[0024]
In the present embodiment, motion estimators 5 and 15 are provided instead of the motion estimator 51 of the conventional example. FIG. 2 shows a block diagram of an embodiment of the motion estimator 5. 2, the frame delay units 2 and 3 are common to the frame delay units 2 and 3 of FIG. The incoming video signal as the first image is output to the motion compensator 21, the output video signal from the frame delay unit 2 as the second image is output to the motion compensator 22, and the output video from the frame delay unit 3 as the third image is output. The image signals are supplied to the motion compensator 23, respectively. The motion compensators 21, 22, and 23 perform motion compensation according to the temporary MV provided from the temporary MV setting unit 29.
[0025]
Here, the temporary MV is common to all the motion compensators 21, 22 and 23, but the amount of spatial movement differs depending on the motion compensators 21, 22 and 23. From the temporal relationship between the interpolated image and each image, if the motion compensator 22 for the second image is set to “1” for both the horizontal and vertical components, the motion compensator 21 for the first image is “3”, and the third image Has a relative relationship of “−1”.
[0026]
The first image motion-compensated by the motion compensator 21 is sent to the subtractor 31, the second image motion-compensated by the motion compensator 22 is sent to the subtractor 31 and the subtractor 32, and the second image motion-compensated by the motion compensator 23. The three images are supplied to the subtractor 32, respectively. The subtractor 31 obtains a difference between the first image and the second image and supplies the difference to the correlation detector 41. The subtractor 32 obtains the difference between the second image and the third image and supplies the difference to the correlation detector 42.
[0027]
The correlation detectors 41 and 42 convert the input difference into an absolute value or a square, accumulate the difference in the block, and obtain a correlation result of the block in the provisional MV. The output correlation result of the correlation detector 41 is a correlation result between the first image and the second image, and is supplied to the correlation comparator 25 as a first correlation. On the other hand, the output correlation result of the correlation detector 42 is a correlation result between the second image and the third image, and is supplied to the correlation comparator 25 as a second correlation.
[0028]
The correlation comparator 25 compares the input first correlation with the second correlation and supplies the evaluation value of each temporary MV to the MV determiner 26. The MV determiner 26 compares the evaluation values of each temporary MV among the temporary MVs from the temporary MV setting unit 29, determines the temporary MV that gives the highest evaluation value as the final MV, and outputs the MV output terminal. 27 to output as a backward motion vector (MV _B ). The temporary MV setting unit 29 generates a temporary MV set as a search range in the block, and supplies the information to the motion compensators 21, 22, and 23 and the MV determination unit 26, respectively.
[0029]
Next, a process of determining an evaluation value and a coefficient k from two types of correlation will be described. Since the output correlation results of the correlation detectors 41 and 42 are block matching values, the larger the value, the worse the correlation (the lower the correlation).
[0030]
Evaluation value C, the first correlation C ₁ output from the correlation detector 41 finds the second from the correlation C ₂ output from the correlation detector 42 under the following conditions. When the value obtained by doubling the value of one of the first and second correlations is equal to or greater than the value of the other correlation, the value obtained by adding the respective values C ₁ and C ₂ of the first and second correlations Is the evaluation value C. When the value obtained by doubling the value of one of the first and second correlations is less than the value of the other correlation, only the value of one of the correlations is used as the evaluation value C. Here, the total correlation is better if the addition is performed, and if the addition is not performed for correction, the multiplication is tripled. The value obtained in this manner becomes the evaluation value C of the temporary MV of the block. The above is summarized as follows.
[0031]
C = (C ₁ + C ₂ ) 2C ₁ ≧ C ₂ or 2C ₂ ≧ C ₁
C = 3C ₁ ... 2C ₁ <C ₂
C = 3C ₂ ... 2C ₂ <C ₁
Evaluation value C is in addition used for the determination of MV in MV determiner 26, an evaluation value C for the MV that is finally determined in the block is output from the reliability information output terminal 28 as a trusted information C _B interpolation .
[0032]
The configuration and operation of the motion estimator 15 are basically the same as those of the motion estimator 5, and only the used image is different. Instead of the first image, the second image, and the third image in the motion estimator 5, the motion estimator 15 uses the second image, the third image, and the fourth image. The ratio of the spatial movement amount in the motion compensation also changes from the relationship of the time position with the interpolated image. Assuming that the movement amount for the third image is “1” for both the horizontal and vertical components, the movement amount for the fourth image is “3”, and the movement amount for the second image is “−1”. Thus, from the motion estimator 15 reliability information _{C F} is outputted as the forward motion vector (MV _F).
[0033]
To Referring back to FIG. 1 again, the weighted determining unit 14, the coefficient k reliable information and reliability information C _B reverse interpolation given by the motion estimator 5, the forward interpolation given by the motion estimator 15 C and _F, is determined by the following equation from the correlation C _I of the interpolation image. Since each value is a matching value, the larger the value, the lower the reliability (the lower the correlation).
[0034]
_{k '= 0.5 + (C F} -C B) C I / (C F + C B) 2
k = k '... 1≥k'≥0
k = 1 ... k '> 1
k = 0 ... k '<0
In the above equation, the second term higher similarity value is less forward interpolated image and backward interpolated image C _I approaches 0, k approaches 0.5. On the other hand, when the value of C _B is high reliability of the small reverse interpolation than C _F, the second term becomes positive, k is close to 1. If the value of C _F is high reliability smaller than the forward interpolation C _B Conversely, the second term is negative, k approaches 0. k is limited between 0 and 1.
[0035]
As described above, the weighting determination unit 14 in FIG. 1 performs weighted addition. However, as a slightly simpler process, k obtained above is reduced to only 0, 0.5, and 1, and forward interpolation, It is also possible to adopt a form that selects from backward interpolation or the average of both.
[0036]
Further, since the embodiment of FIG. 1 is an example of the conversion of the image rate from 30 fps to 60 fps, the time of the interpolated image becomes the center of the input moving image signal, and the reference (first term) is 0.5 in the expression of k. Has become. However, for example, in the conversion of the image rate from 50 fps to 60 fps, the interpolated image is not necessarily at the center in time, so the first term in the above equation is not 0.5, and becomes 0 or 1 depending on the time distance. Let's approach. In this case, the relationship between the motion vector movement amounts also differs depending on the time relationship.
[0037]
Next, time axis interpolation according to the present embodiment will be described. FIG. 3 shows a state of time axis interpolation according to the present embodiment. 3A, 3B, and 3C, one circle is one pixel, and the shading indicates a pixel value. The continuation in the vertical direction indicates a part of the scanning line or a pixel row in the vertical direction. The numbers from 1 to 4 indicate the first to fourth images. Further, pixels indicated by solid lines are input moving image signals of 30 frames per second, and pixels indicated by dotted lines are interpolation signals. The center is the current pixel to be interpolated, the dark and thin arrows are MVs having a high correlation between the preceding and succeeding frames, and the thin and thick arrows are motion compensation interpolation based on the MVs. Also, the arrow indicated by the dotted line is not used for MV determination.
[0038]
FIG. 3A shows the state of the backward interpolation image formation which is the output of the motion compensator 6. FIG. 3B shows the state of the forward interpolation image formation which is the output of the motion compensator 7, but a motion vector different from that of the backward interpolation image formation of FIG. 3A is adopted. . FIG. 3C shows the state of the adaptive addition interpolation in the adder 8 using both the forward interpolation and the backward interpolation. In the example of FIG. Since the reliability of the backward interpolation is better than that of the forward interpolation, k approaches 1, and the backward interpolation is mainly used.
[0039]
As described above, according to the present embodiment, when an interpolated image is formed using a plurality of moving image signals different from each other by one frame from an incoming moving image signal, a temporally past image of the interpolated image is formed. By forming a forward-interpolated image using a temporally future image of the interpolated image to form a backward-interpolated image, even if there is a large image change before and after the interpolated image signal, In one of the interpolation and the backward interpolation, a motion vector for motion compensation is appropriately obtained.
[0040]
Further, according to the present embodiment, based on the similarity between the forward interpolation image and the backward interpolation image and the reliability information of each interpolation image, the forward interpolation image and the backward interpolation image are added to the degree of addition. By changing and adding, the final interpolation image is always formed from the appropriate interpolation image, so that an appropriate interpolation image can be stably formed without being affected by the degree or change of the image motion, In particular, when interpolation in both the backward direction and the forward direction is appropriate, equal addition is performed, so that the phase relationship on the time axis is linear, and the effect of suppressing random noise is large. As a result, it is possible to obtain an image rate converted image that is smooth in motion and has no image quality deterioration.
[0041]
The present invention is not limited to the above embodiment. For example, instead of the frame delay units 2 to 4, it is also possible to use a field delay unit that delays approximately one field.
[0042]
【The invention's effect】
As described above, according to the present invention, a backward-interpolated image in which a frame or a field of an incoming moving image in the future is temporally compensated for an interpolated image is formed, and a backward-interpolated image is temporally compensated for the interpolated image. To form a forward-interpolated image obtained by motion-compensating a frame or a field of an incoming moving image, and information on the reliability of each of the backward-interpolated image and the forward-interpolated image; By adaptively weighting and adding the backward interpolation image and the forward interpolation image according to the inter-image similarity to obtain an interpolation image signal, a final interpolation image signal is always formed from the appropriate interpolation image. Therefore, even if there is a large image change before and after the interpolated image, an appropriate interpolated image signal can be formed stably without being affected by the degree or change of the image movement. If Since the forward interpolation image and the backward interpolation image are equally added, the phase relation on the time axis is linear, the effect of suppressing random noise is large, and as a result, the image rate conversion image is smooth and has no image quality deterioration. Is obtained.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an embodiment of the present invention.
FIG. 2 is a block diagram showing a configuration of an embodiment of a motion estimator in FIG. 1;
FIG. 3 is a diagram showing a state of motion compensation interpolation in FIG. 1;
FIG. 4 is a block diagram illustrating a configuration of an example of a conventional device.
FIG. 5 is a diagram showing a state of conventional motion compensation interpolation.
[Explanation of symbols]
1 image input terminals 2, 3, 4 frame delay unit 5, 15 motion estimator 6, 7, 21, 22, 23 motion compensator 8 adder 9, 31, 32 subtractor 10, 11 frame buffer 12 switch 13 image output Terminal 14 Weight judging unit 16, 17 Multiplier 25 Correlation comparator 26 MV judging unit 27 MV output terminal 28 Reliability information output terminal 29 Temporary MV setting units 41, 42 Correlation detector

Claims (2)

A moving image time axis interpolation method for generating a temporally different interpolated image (frame or field) from an incoming moving image and forming a new moving image from the incoming moving image and the interpolated image,
A backward interpolation image obtained by motion-compensating a frame or field of the incoming moving image in the future with respect to the interpolation image to be generated, and a first step of obtaining information on its reliability;
A forward interpolation image obtained by motion-compensating a frame or a field of the incoming moving image in the past with respect to the interpolation image to be generated, and a second step of obtaining information on the reliability thereof;
A third step of obtaining a similarity between the interpolated images of the forward interpolation image and the backward interpolation image;
Adaptively weighting the forward interpolation image and the backward interpolation image according to the information on the reliability of the backward interpolation image, the information on the reliability of the forward interpolation image, and the similarity between the interpolation images. A fourth step of adding to generate the interpolated image;
A fifth step of forming a new moving image from the incoming moving image and the generated interpolated image. What is claimed is: 1. A moving image time axis interpolating apparatus for generating an interpolated image (frame or field) temporally different from an incoming moving image and forming a new moving image from the incoming moving image and the interpolated image,
A backward-interpolated image obtained by motion-compensating a frame or a field of the incoming moving image in the future with respect to the interpolated image to be generated, and a backward-interpolating means for obtaining information on its reliability;
A forward interpolation image obtained by motion-compensating a frame or a field of the incoming moving image in the past with respect to the interpolation image to be generated, and a forward interpolation means for obtaining information on its reliability;
Correlation detecting means for calculating a similarity between the interpolated images of the forward interpolation image and the backward interpolation image,
Adaptive weighted addition of the forward interpolation image and the backward interpolation image according to the information on the reliability of the backward interpolation image, the information on the reliability of the forward interpolation image, and the similarity between the interpolation images. Adaptive weighting means for generating the interpolation image by
A moving image time axis interpolating apparatus comprising: a moving image forming unit that forms a new moving image from the incoming moving image and the generated interpolation image.

Images