CN104205807A - Image processing device and method, and program - Google Patents

Abstract

The present technique relates to an image processing device and method and a program that make it possible to obtain a more high-quality looped moving image. A frame sequence determination unit extracts a transition source frame sequence and a transition destination frame sequence from an input moving image material. A partial frame sequence determination unit extracts, from the transition destination frame sequence, several partial frame sequences having different lengths. A matching processing unit performs DP matching between the transition source frame sequence and the partial frame sequences and determines pairs of frames corresponding to each other. A blend processing unit blends the images of the respective pairs of frames to generate a transition period frame sequence, an image of which transits from an image of the transition source frame sequence to an image of the transition destination frame sequence. A looped moving image generation unit generates a looped moving image on the basis of the moving image material and the transition period frame sequence. The present technique is applicable to image processing devices.

Description

Image processing equipment, method and program

Technical field

This technology relates to image processing equipment, method and program, and this technology relates to the image processing equipment, method and the program that are configured to the shuttling movement image that obtains higher quality especially.

Background technology

For example, the known video texture technology that creates and present shuttling movement image from video image raw material.This video texture technology is a kind of method that makes the junction point not outstanding establishment shuttling movement image of multiimage in raw-material situation of video repeating to reappear the several seconds by carries out image processing.

This shuttling movement image can be at video image return period by seamlessly end frame and the start frame of reproduction loop moving image present video image, this video image is the video image of endless seemingly, wherein on described video image, stores the value once repeating of image.In addition, due to only preserve vedio data once repeat value just enough, so shuttling movement image can be saved memory space and transmission time.

For example, provide the image that has for example water and flow through the period of the view that waterfall or flag flutter in the wind, by repeating to reappear described image as shuttling movement image, observer can also watch described image and there is no inharmonic sensation.Therefore, shuttling movement image be suitable for for example watching DPF, for the advertising moving picture of website with for the application of the landscape moving image of personal computer screen.

As the method for automatic establishment shuttling movement image, for example known in NPL1 disclosed video texture technology.In video texture technology, automatically calculate the recurrence interval for repeating described shuttling movement image and described converted frames image.

More specifically, with respect to each two field picture included in video image, calculate the similarity of two arbitrary frame images.In addition, the a pair of two field picture with the highest similarity of calculating is configured to repeat to interior point (in point) and the exterior point (out point) of reproduction, and creates shuttling movement image to make it repeat to reappear between described two points.Now, in the conversion period before interior point and exterior point and afterwards, carry out video image and be fade-in fade-out processing to make the junction point of interior point and exterior point outstanding.

Quoted passage list

NPL1:Video?Textures；Arno?Schodl,Richard?Szeliski,David?H.Salesin,Irfan?Essa；Proceedings?of?SIGGRAPH2000；pages489-498,July2000

Summary of the invention

Technical problem

But, in above-mentioned technology, there is the situation that wherein can not obtain the shuttling movement image with enough high-quality.

For example, the video image that is comprising aperiodic motion in above-mentioned video texture technology is configured in the raw-material situation of shuttling movement image, owing to can not trying to achieve interior point and the exterior point with high similarity, so can become clear at the junction point of repeating return period, thereby result is not preferred.Therefore, expectation is that a kind of establishment can be processed compared with the method for the raw-material shuttling movement image of the video image of multiple types.

In view of such situation has designed this technology, and this technical configuration is become can obtain the shuttling movement image of higher quality.

The solution of problem

According to this technology aspect, a kind of image processing equipment is provided, described image processing equipment create image wherein between the first moving image and the second moving image from a converting motion image that is transformed into another, described image processing equipment comprises: matching treatment unit, and similarity search for of described matching treatment unit based on forming between the image of frame of described the first moving image and the image of the frame of described the second moving image of formation has described first moving image of similar image and the frame pair of described the second moving image; Reorientate processing unit, described in reorientate the time delay of frame of right described the first moving image of the described frame of processing unit based on adjacent one another are and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And mixed processing unit, described mixed processing unit creates described converting motion image in the following way: the image that is configured to the frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.

The right frame of described the first moving image and the frame of described the second moving image of described multiple frames of arranging according to time series can be arranged according to the time series of ascending order or descending respectively.

Described reorientate processing unit reorientate described in can carrying out make to utilize following time delay to frame adjacent one another are to positioning: described time delay is by the time delay weighting summation of the frame of the time delay of the frame of described the first moving image right described frame adjacent one another are and described the second moving image is obtained.

Can be configured to the mean value of the weight of each frame of right described the first moving image of described frame adjacent one another are for the weight of the time delay of the frame of described first moving image of weighting summation, and the weight of each frame of described the first moving image can be created as the weight of frame of the front side (leading side) that makes to be positioned at described the first moving image larger.

When using predetermined frame when change described the second moving image with respect to the reproduction speed of described the first moving image as initial point, described the first moving image that matching treatment unit can be based on should present simultaneously and the frame of described the second moving image between similarity, by any one frame of the frame centering of some reproduction speeds to being configured to described predetermined frame adjacent frame pair.

Described matching treatment unit can for multiple first moving images each other with different length calculate according to time series arrange described multiple frames pair, and described mixed processing unit can with the described multiple frame centerings calculating for each the first moving image, wherein taking the similarity about each frame as basis be evaluated as the highest frame to creating described converting motion image.

Described image processing equipment can also comprise shuttling movement image creation unit, and described shuttling movement image creation unit is based on described converting motion creation of image shuttling movement image.

According to this technology on the other hand, a kind of image processing method and program are provided, wherein image is from a converting motion image that is transformed into another between the first moving image and the second moving image for described image processing method and program creation, and described image processing method and program comprise the following steps: the similarity search based on forming between the image of frame and the image of the frame of described the second moving image of formation of described the first moving image has described first moving image of similar image and the frame pair of described the second moving image; The time delay of frame of described the first moving image that frame based on adjacent one another are is right and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And create in the following way described converting motion image: the image that is configured to the frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.

In aspect this technology described, the image that creates image wherein and be transformed into from another converting motion image between the first moving image and the second moving image is processed, the similarity search based on forming between the image of frame and the image of the frame of described the second moving image of formation of described the first moving image has described first moving image of similar image and the frame pair of described the second moving image; The time delay of frame of described the first moving image that frame based on adjacent one another are is right and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And be configured to converting motion image described in the creation of image of frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.

The beneficial effect of the invention

According to the various aspects of this technology, can obtain the shuttling movement image of higher quality.

Brief description of the drawings

Fig. 1 has described the figure that creates shuttling movement image by video texture technology.

Fig. 2 is the figure that describes two dimensional difference value row.

Fig. 3 is the figure that describes two dimensional difference value row and switching cost.

Fig. 4 has described the figure that mates to search for minimal cost path with DP.

Fig. 5 has described the figure that mates to search for minimal cost path with DP.

Fig. 6 is the figure that is described in the tilt boundary on the limit on DP plane surface.

Fig. 7 is the figure that describes the calculating of the cost that the length of side is taken into account.

Fig. 8 is the figure that has described mixed processing.

Fig. 9 has described the figure that creates the shuttling movement image that comprises reverse reproduction.

Figure 10 is the figure of the ios dhcp sample configuration IOS DHCP of presentation video treatment facility.

Figure 11 is the flow chart of describing the processing of shuttling movement image creation.

Figure 12 is the figure that the ios dhcp sample configuration IOS DHCP of computer is shown.

Embodiment

Hereinafter, with reference to the accompanying drawings the execution mode of applying this technology is described.

< the first execution mode >

[establishment of shuttling movement image]

First, will be described utilizing video texture technology to create shuttling movement image.

In addition, in this case, there is the raw-material single moving image (video image) as shuttling movement image, and by determining that the interval of repeating to reappear creates shuttling movement image from single moving image.

For example, as shown in Figure 1, provide moving image MT11 as raw material, and created shuttling movement image LP11 with this moving image MT11.

In addition,, in Fig. 1, the multiple rectangles in the rectangle that represents moving image MT11 and shuttling movement image LP11 represent respectively the image of single frame.In addition,, in Fig. 1, the frame of left end is that frame number is minimum frame in the drawings, and in the normal reproduction period, carries out reproduction according to the frame from left end to the order of the frame of right-hand member.For example, the frame of the left end of the moving image MT11 in figure is the first frame, and the frame adjacent with this frame is the second frame on right side.

In video texture technology, in the processing with two steps, create shuttling movement image.

First,, in first step, from moving image MT11, determine that frame capable these two frames of frame capable and conversion destination of conversion source are capable.In other words, determine conversion source and the interior point of each frame capable (interval) of conversion destination and the corresponding relation of exterior point.

In the example of Fig. 1, the interval being formed by five frames in moving image MT11 is configured to the capable TS11 of frame of conversion source, and the interval being formed by five frames before the capable TS11 of frame in moving image MT11 is configured to change the capable TD11 of frame of destination.

In this case, in the capable TS11 of frame and the capable TD11 of frame, the front end frame (leading frame) that this frame is capable and rear end frame (ending frame) correspondence are put and exterior point in the inner.

That is to say, in the capable TS11 of frame, front end frame FS _infor interior point, and rear end frame FS _outfor exterior point.In addition, in the capable TD11 of frame, front end frame FD _infor interior point, and rear end frame FD _outfor exterior point.

Create the capable TS11 of frame and the capable TD11 of frame, the image that makes the frame of the same position capable in described frame is similar each other image.Conventionally, the capable TS11 of the frame of conversion source selects near the end as raw-material moving image MT11, and the capable TD11 of frame of conversion destination selects near the top of moving image MT11.

In addition, in second step, the frame FD based on from moving image MT11 _into frame FS _outthe view data at interval create shuttling movement image LP11.

More specifically, the capable TD11 of frame of the capable TS11 of the frame of conversion source and conversion destination is carried out to mixed processing, and create the image of each frame of the interval of the latter half of shuttling movement image LP11---changing period Tr---.In mixed processing, the imagery exploitation weight of the capable TS11 of frame in same position and the frame of the capable TD11 of frame is added, and is configured to the image of each frame of the conversion period Tr of shuttling movement image LP11.

Therefore, for example, the front end frame FB of conversion period Tr _inimage be by by the front end frame FS of the capable TS11 of frame of conversion source _inthe front end frame FD of the capable TD11 of frame of image and conversion destination _inimage mix obtained image.

In addition, the rear end frame FB of the conversion period Tr of shuttling movement image LP11 _outimage be by by the rear end frame FS of the capable TS11 of frame of conversion source _outthe rear end frame FD of the capable TD11 of frame of image and conversion destination _outimage mix obtained image.

In the conversion period Tr obtaining by this mixed processing, the image of each frame is the image that changes gradually the image of the capable TD11 of frame of (conversion) one-tenth conversion destination from the image of the capable TS11 of frame of conversion source.

In addition, by the frame FD at moving image MT11 _outwith frame FS _inbetween interval NT11 be arranged to the interval T n of the first half of unaltered, shuttling movement image LP11, and obtain the shuttling movement image LP11 being formed by interval T n and conversion period Tr.

At the return period of shuttling movement image LP11, the front end frame that is again back to interval T n by the front end frame according to from interval T n after the order of the rear end frame of conversion period Tr is reappeared repeatedly reappears the each frame that forms shuttling movement image LP11.

In addition,, at the return period of shuttling movement image LP11, be provided in advance changing a large amount of frames that required a large amount of frames change period Tr as parameter.In addition, also provide in advance minimal circulation moving image length T r_min as parameter, described Tr_min is namely from frame FD _into frame FS _inthe minimum distance limit at interval, i.e. the minimum length of shuttling movement image LP11.

Next, use description to determine the capable TS11 of frame of conversion source and the interior point of the capable TD11 of frame of conversion destination and the method for exterior point.

First, for the image F forming as any i frame i of the raw-material moving image of input _iimage F with any j frame j _jcarry out the difference value D (i, j) of computed image.Namely, carry out the calculating of following formula (1).

[formula 1]

$D(i,j)=\underset{(x,y)\&Element;P}{\mathrm{\&Sigma;}}{|F_i(x,y)-F_j(x,y)|}^2\&CenterDot;\&CenterDot;\&CenterDot;\left(1\right)$

In addition, in formula (1), F _i(x, y) represents to be positioned at image F _ithe pixel value of the pixel located of position (x, y), and F _j(x, y) represents to be positioned at image F _jthe pixel value of the pixel located of position (x, y).Therefore, in formula (1), for image F _iwith image F _jall pixels calculate and be positioned at image F _iwith image F _jthe pixel at same position place between the square value of difference of pixel value, and the summation of described square value (integrated value) is arranged to the difference value D (i, j) of framing i and frame j.

Difference value D (i, j) represents the image F of frame i _iimage F with frame j _jbetween similarity, and image is more similar, the value of difference value D (i, j) is less.

Between the startup stage of shuttling movement image, calculate difference value D (i, j) for all (i, the j) combination forming as raw-material moving image, and difference value D (i, j) is saved as to two dimensional difference value matrix MD.

In this case, two dimensional difference value matrix MD is for example following matrix: wherein, and as shown in Figure 2, the horizontal direction that longitudinal direction in figure is configured in i axle, figure is configured to j axle, and the value of the key element of position (i, j) is difference value D (i, j).In addition, in Fig. 2, each square represents the each key element in two dimensional difference value matrix MD, represents that the color of square of key element is darker, the value of key element the or in other words value of difference value D (i, j) is lower.

For example,, in cornerwise each key element of extending to lower right on the upper left side of the two dimensional difference value matrix MD from figure, because frame i and frame j are identical frames, so the value of key element (difference value D (i, j)) is 0.In addition, because frame i and frame j are the frames that forms same moving image, so two dimensional difference value matrix MD is about straight line i=j symmetry.

In the time obtaining in this way two dimensional difference value matrix MD, subsequently continuously arranged rows of elements on two dimensional difference value matrix MD is carried out to the calculating of following formula (2), thereby calculate switching cost C (i, j).

[formula 2]

$C(i,j)=\underset{k=0}{\overset{T_r}{\mathrm{\&Sigma;}}}D(i+k,j+k)\&CenterDot;\&CenterDot;\&CenterDot;\left(2\right)$

In addition, in formula (2), Tr represents than the number of the number little 1 of the frame with reference to the described conversion of Fig. 1 period Tr.Therefore,, in formula (2), the summation of the difference value D (i, j) from position (i, j) to position (i+Tr, j+Tr) is calculated as to switching cost C (i, j).

For example, the in the situation that of Tr=4, pay close attention to the position (i in Fig. 2, j)=(i1, j1) summation of, difference value D (i, j)---i.e. value of the each key element in included five key elements in the RC11 of region---becomes about position (i1, j1) switching cost C (i1, j1).

In this case, in the RC11 of region, included rows of elements is that wherein the key element of position (i1, j1) is as the front end frame of rows of elements in the drawings at the downward row of five key elements of adjacent arrangement in direction to the right diagonally.

For example,, if frame i is the frame FS in Fig. 1 _in, from frame i to frame, (i+Tr) becomes the frame FS of configuration frame row TS11 respectively _into frame FS _out.In addition, if frame j is the frame FD in Fig. 1 _in, become the frame FD of configuration frame row TD11 respectively from frame j to frame (j+Tr) _into frame FD _out.

In this case, be the summation that is positioned at the difference value D (i, j) of the frame at the same position place of the capable TS11 of frame and the capable TD11 of frame about the switching cost C (i, j) of position (i, j).

Therefore, switching cost C (i, j) can represent the similarity between the capable TS11 of frame and the capable TD11 of frame.Therefore be, minimum position (i if calculate wherein switching cost C (i, j), j), and the frame of being arranged to conversion source and conversion destination using this frame as the interval of the frame of its front end frame is capable, can obtain shuttling movement image, wherein junction point is unlikely outstanding.

Under these circumstances, between the startup stage of shuttling movement image, calculate at each position (i, j) switching cost C (i in, j) be minimum position (i,, and the frame i that uses obtained position (i, j) to represent and frame j are arranged to be separately the frame FS of interior point j) _inwith frame FD _in.

In addition, in order to explain in more detail, at each position of two dimensional difference value matrix MD (i, j) in, by the region being created by minimal circulation moving image length T r_min or more specifically near the region key element at i=j place eliminating to switching cost C (i, j) be outside the detection of minimum position (i, j).

In addition, in video texture technology, at switching cost C (i, j) computing interval, except the difference value D (i, j) to position carries out outside simple integration, propose a kind ofly will to be added with the difference value D (i of weight, j) weighted product score value is arranged to the method for switching cost C (i, j), and wherein said weight reduces gradually using the centre position between interior point and exterior point as its maximum and towards these two end points.

Simultaneously, in above-described video texture technology, from the moving image search as raw material inputs and to export similar frame capable, and the capable similar frame transfer point that is arranged for repetition is put and exterior point, and still on practical significance, in image, two capable images consistent with each other of frame are considerably less.

For example, even in two intervals as in raw-material moving image the kinematic similitude of reference object, do not comprise situation of cycle movement etc. in as raw-material moving image in primary importance, also there is the situation that movement velocity is different.In this case, even by creating shuttling movement image as raw-material moving image, at the return period repeatedly of shuttling movement image, also can clearly identify the junction point of front end frame and rear end frame.

Therefore, in order to obtain the shuttling movement image of higher quality, if the speed of the motion of reference object is difference aspect two similar intervals as raw-material moving image, preferably determine the transfer point of also speed being taken into account, and the image of each frame is carried out to mixed processing.In addition, even if the motion of reference object is not periodically, if also comprise that the situation of reappearing moving image using reverse manner, as conversion source and the capable candidate of frame who changes destination, also exists the possibility that will find more suitable conversion source.

In this case, if considered reproduction speed is arranged to N speed, the situation that the former increases, reduces etc. corresponding to reproduction speed, or in other words forward reappears corresponding to considering that N is 0 or the situation of larger speed, and the latter can be thought of as to the situation that N is negative value.

For example, as shown in Figure 3, in the expression formula of two dimensional difference value matrix MD, not the capable switching cost C (i of frame reappearing by normal speed, j) corresponding in the drawings at the integration of difference value D (i, j) that is not the key element of arranging in the direction of oblique bottom right of 45 °.In addition, oppositely reappear switching cost C (i, j) that frame the is capable integration corresponding to the difference value D (i, j) of the key element of arranging in the drawings in the direction of oblique lower-left.

In addition, in Fig. 3, longitudinal direction and horizontal direction represent respectively i direction of principal axis and j direction of principal axis, and in Fig. 3, show the two dimensional difference value matrix MD identical with the two dimensional difference value matrix MD shown in Fig. 2.

For example, in the example of Fig. 3, in the case of reappear with the reproduction speed of normal speed the frame of frame in capable capable, difference value D (i, j)---i.e. value of the each key element in included eight key elements in the RC21 of region---and become about position (i, j) switching cost C (i, j).In this example, during reappearing the image of frame on a j direction of principal axis frame in capable, reappear the image of two frames that frame on i direction of principal axis is capable.In this case, described two capable length of frame are different, but because the capable reproduction speed of frame is different, so the capable reproduction time of each frame is identical length.

In addition, in the situation that making that frame is one of capable oppositely to be reappeared with respect to other frames are capable, difference value D (i, j)---i.e. value of the each key element in included six key elements in the RC22 of region---and become about position (i, j) switching cost C (i, j).In this example, starting to make in order the capable reproduction of frame in the case of i direction of principal axis being that minimum frame is capable from frame number, is that maximum frame starts to make in order the capable reproduction of frame on j direction of principal axis from frame number.

In addition, determine that in the mode of also reproduction speed being taken into account the frame of conversion source frame capable and conversion destination is capable in for example region RC21 and region RC22, due to the length difference of conversion period, so be necessary by switching cost C (i, j) being normalized to capable the comparing of frame capable to the frame of conversion source and conversion destination.

In aforesaid way, if reproduction speed and reproduction direction are taken into account, capable as the frame frame capable and conversion destination of conversion source owing to can obtaining more suitable interval, so can create the shuttling movement image of higher quality.Under these circumstances, also by being reappeared, N speed takes into account (prior art only consider normal speed in direction reappear),, this technical configuration is become can obtain to the shuttling movement image of higher quality.

In addition, being suitable for one of capable frame being set to respect to the capable moving image that is reversed reproduction of other frames is to comprise the not directive image of tool that wherein moves, and is for example as hypograph: for example people changes the image in the image of its expression, orientation that animal changes its health and the image that flag flutters in the wind.

In contrast, the image that comprises the directive motion of tool is that people walks the image waiting to the right from left side.If this image setting is become to raw material, and by capable capable the frame that wherein makes the interval of a part of image oppositely the reappear frame frame capable and conversion destination of being arranged to conversion source, the shuttling movement image that obtained becomes nature.

[establishment of the shuttling movement image that reproduction speed is taken into account]

Next, by the description of proceeding create shuttling movement image by this technology.

In this technique, in the time creating shuttling movement image, in governing speed N, create optimum translation two field picture.

First, determine as the frame of conversion source capable and capable as the frame of conversion destination for the raw-material moving image as shuttling movement image (being also called hereinafter raw material moving image).Hereinafter, as the capable capable FS of conversion source frame that is called as of frame of conversion source, as the capable capable FD of conversion destination frame that is called as of frame of conversion destination.

For example, typically, the capable FS of conversion source frame selects near the end of raw material moving image, and the capable FD of conversion destination frame selects near the initiating terminal of raw material moving image.In addition, provide in advance and form some frame NF that each frame each frame capable and the capable FD of conversion destination frame of conversion source frame capable FS is capable as input parameter.

In the shuttling movement image that will create, with the interval of a part of the capable FS of conversion source frame and conversion destination frame capable FD being changed by image.In addition, the frame NF_min for changing required minimal amount is predisposed to input parameter at the frame of the minimal amount of included conversion period of shuttling movement image.

For example,---also comprising the reproduction speed of N=1---calculates the optimum translation period and calculates capable associated to make its cost as much as possible little the same of partial frame that each frame capable from each frame of the capable FS of conversion source frame and the capable FD of conversion destination frame extracts in capable to utilize speed N.In addition, in this case, the switching cost C (i, j) of described cost for for example obtaining in the calculating of formula (2).

Now, if different from the capable FS of the conversion source frame length capable with the frame extracting the capable FD of conversion destination frame, this means the conversion that wherein reproduction speed will be different.

For example, if 30 conversion destination frames are associated with 15 conversion source frames, when making to change the capable reproduction of frame of destination with the speed of N=2, image is changed.

If regard this related question as a kind of more common problem, this corresponding to: signal X and these two signals of signal Y are carried out to Elastic Matching.

That is to say, from signal X and signal Y, remove respectively partial sequence, expand and shrink and eachly calculate the distance between these two sequences when being removed sequence, and to search for its middle distance be minimum combined sequence.

Movement programming (DP coupling) is a kind of method that calculating has the optimum corresponding relation of such sequence of multiple different lengths, and DP coupling is used to time sequencing pattern recognition and the image model identification of various fields such as sound, gesture etc.

In order to carry out the DP coupling of one-dimensional signal X and signal Y, be necessary to determine the coupling restriction between described signal.

Usually, the length of signal X is arranged to J, the length of signal Y is arranged to I, and for example as shown in Figure 4, there is the DP plane surface of (I × J) individual lattice-site by definition, connection between lattice-site (limit) is provided, and the restriction that is called gradient restriction has been applied to the connection between each lattice-site.

In addition, in Fig. 4, vertical and horizontal represent respectively the time orientation of signal X and signal Y, and each circle represents the single lattice-site on DP plane surface.

In this case, if the horizontal direction in figure is arranged to j direction of principal axis and longitudinal direction is arranged to i direction of principal axis, can use the position of ij coordinate system (wherein, 1≤i≤I, 1≤j≤J) to represent the position of the each lattice-site on DP plane surface.

On the DP of Fig. 4 plane surface, by position (i, j)=(1,1) be arranged to starting point SP11, position (i, j)=(I, J) is arranged to terminal DP11, and in the time considering path from starting point SP11 to terminal DP11, provide the path of three routes that represent with arrow Q11 as the path from each lattice-site to another lattice-site.That is to say, provide with the inclination restriction shown in arrow Q11.

More specifically, can be from position (i, j) lattice-site PO11 converts in position (i, j+1) lattice-site PO12, in position (i+1, j+1) any lattice-site in lattice-site PO13 or the lattice-site PO14 in position (i+2, j+1).In other words, lattice-site PO11 is connected to the arbitrary lattice-site the lattice-site from lattice-site PO12 to lattice-site PO14.

In addition,, on DP plane surface, for the limit between each lattice-site, lattice-site or for the limit between each lattice-site, lattice-site, both define cost.

In addition, edge is carried out to integration from the starting point SP11 of DP plane surface to the cost in the path of terminal DP11, mating to come calculation cost with DP is minimum path, and each lattice-site group that the path as a result of obtaining is passed through becomes the path that Optimal Signals combines.

This DP coupling can be applied to the above-mentioned associated of the capable FS of conversion source frame and the capable FD of conversion destination frame.

In this case, obtaining in the following manner the capable FS of conversion source frame and change distance between the capable FD of destination frame is minimum combination.That is to say, to two capable combinations of frame from the capable FS of conversion source frame and the capable FD removal of conversion destination frame, change and be removed the length that frame is capable simultaneously, to the capable execution of every framing Elastic Matching, and if be minimum one group from each group selection distance, this is just enough.

But, if carry out such processing, become tremendous amount from the number of the capable combination of two frames of the capable FS of conversion source frame and the capable FD removal of conversion destination frame.Under these circumstances, by using for example following expanded function of DP coupling, can reduce the number of the combination that frame is capable.

That is to say, the DP coupling being fixed with starting point SP11 in the example of Fig. 4 and terminal DP11 is compared, and the DP coupling that uses expanded function is to have the DP coupling of free starting point and free terminal and be to provide the DP coupling for multiple candidates of starting point and terminal.

More specifically, as shown in Figure 5, expanded DP plane surface.In addition, in Fig. 5, longitudinal direction and horizontal direction represent respectively i direction of principal axis and j direction of principal axis, and each circle represents the single lattice-site on DP plane surface.

In Fig. 5, compare with the DP plane surface shown in Fig. 4, arbitrary origin TSP11 and supposition terminal TDP11 are also provided.

In addition, on DP plane surface, 5 lattice-sites from lattice-site PO21 to lattice-site PO25 are arranged to the true starting point candidate with respect to arbitrary origin TSP11, define from arbitrary origin TSP11 to lattice-site each limit of (from lattice-site PO21 to lattice-site PO25), and the cost on described limit is arranged to 0.

In addition, 6 lattice-sites from lattice-site PO31 to lattice-site PO36 are arranged to the true endpoint candidates with respect to supposition terminal TDP11, define each limit from supposition terminal TDP11 to lattice-site (from lattice-site PO31 lattice-site PO36), and the cost on described limit is arranged to 0.

As a result of, only, by DP plane surface application DP is mated, it is minimum path that the path from true starting point to true terminal is defined as to total cost automatically.

Owing to having this DP coupling of free starting point and free terminal, for signal X, in the part signal of signal X, selecting cost is minimum part signal.

That is to say, the signal X with variable-length with have in the Elastic Matching of signal Y of variable-length, due to input that can fixed signal X, so can greatly reduce the number of the combination that will attempt.In addition, by changing part signal length in all part signal patterns and part signal original position is carried out Elastic Matching to signal Y and signal X extracting.

In other words, on the DP plane surface shown in Fig. 5, owing to having determined arbitrary origin and supposition terminal, if input fixed signal X carries out coupling by DP coupling for the each part signal extracting from signal X.Therefore,, if carry out DP coupling to described part signal with as the signal X of its input in the signal length that changes the part signal extracting from signal Y, obtain the Elastic Matching result of variable-length signal X and variable-length signal Y.

Next, use description to mate to create with above-mentioned DP the concrete grammar of shuttling movement image.In addition, in the situation that creating shuttling movement image, capable conversion source frame FS and conversion destination frame capable FD can be arranged to have variable-length, but in this case, by the capable FS of conversion source frame being there is to regular length, only change the example that frame capable FD in destination has variable-length and be described.Under these circumstances, compared with two frame provisional capitals being arranged to have the situation of variable-length, can reduce amount of calculation.

For example, provide the capable FS of conversion source frame that wherein number of frame is NF and the capable FD of conversion destination frame, and calculate these frames capable in the included capable Optimum Matching of partial frame.

In this case, capable conversion source frame FS is arranged to have regular length, and utilizes free starting point and free terminal to select the partial frame of the capable FS of conversion source frame capable.

In addition, about conversion destination frame capable FD, by between the first frame at the capable FD of conversion destination frame and (NF-NF_min) frame, change the original position that partial frame is capable and changing to from NF_min NF length between change length that partial frame is capable to carry out determining section frame capable.In addition, hereinafter, there is following situation: by the capable capable FD' of partial frame that is called of frame that extract and that mate for DP from the capable FD of conversion destination frame.

In this technique, for example, create DP plane surface in the mode identical with mode in Fig. 5 according to the capable FS of conversion source frame and the capable FD of conversion destination frame.Now, a part for true starting point and true terminal becomes the capable FD' of partial frame.

In this example, on DP plane surface, the direction of the capable FS of conversion source frame is i direction of principal axis, and the capable FD'(of partial frame changes the capable FD of destination frame) direction be j direction of principal axis.In addition, in ij coordinate system, the i coordinate of the position of K the frame of the capable FS of conversion source frame is configured to i=K, and the j coordinate of the position of L the frame of the capable FD of conversion destination frame is configured to j=L, and L the frame of the capable FD of wherein said conversion destination frame is configured to the frame of the capable FD' of partial frame.

In addition, on each position (i, j) of DP plane surface, lattice-site is set, and provides arbitrary origin and terminal to DP plane surface.In addition, to be positioned at position (i, j)=(1,1) to (1, NF-NF_min) lattice-site is connected to arbitrary origin, and is maximum and each lattice-site of j coordinate between NF_min and its maximum by supposing that terminal is connected at its i of place coordinate.

In addition, provide connection (limit) between lattice-site, and for example apply restriction to the connection between each lattice-site, example tilts to limit as shown in Figure 6.

In addition,, in Fig. 6, longitudinal direction and horizontal direction represent respectively i direction of principal axis (direction of the capable FS of conversion source frame) and j direction of principal axis (direction of the capable FD' of partial frame), and each circle represents single lattice-site.

In the example of Fig. 6, can take from lattice-site PO41 to the path of any one lattice-site from lattice-site PO51 to lattice-site PO55.

For example, if lattice-site PO41 is arranged in position (i, j), the position of lattice-site PO51 becomes position (i+1, j+3).In other words, become in the capable FD' direction of partial frame and carry out three associations from lattice-site PO41 to the path of lattice-site PO51, and in the capable FS direction of conversion source frame, carry out once associated.

If the reproduction speed of the capable FS of conversion source frame is arranged to normal speed, described association corresponding to: the reproduction speed of the capable FD' of partial frame becomes triple speed degree.In other words, described association corresponding to: the relative reproduction speed of the capable FD' of partial frame becomes three times of the capable FS of conversion source frame.

Therefore,, in the case of the path that advances to lattice-site PO51 from lattice-site PO41, the position (i, j) of lattice-site PO41 and the position (i+1, j+3) of lattice-site PO51 can have following relation.

That is to say, frame i and frame j are arranged to initial point (reproduction original position), the reproduction speed of the capable FD' of partial frame is arranged to three times of reproduction speed of the capable FS of conversion source frame, and capable conversion source frame FS and the capable FD' of partial frame are arranged to supposition and reappear.Now, the wherein frame i of the capable FS of conversion source frame and the capable FD' of the partial frame frame centering different with frame j, at the frame as after reappearing original position and should being the first frame of presenting right frame i and frame j simultaneously to being frame i+1 and frame j+3.

Lattice-site PO52 becomes position (i+1, j+2) with respect to the position of the position (i, j) of lattice-site PO41, and now the capable FD' of partial frame becomes 2 speeds with respect to the relative reproduction speed of the capable FS of conversion source frame.

In addition, lattice-site PO53 becomes position (i+1, j+1) with respect to the position of the position (i, j) of lattice-site PO41, and now the capable FD' of partial frame becomes normal speed with respect to the relative reproduction speed of the capable FS of conversion source frame.

Lattice-site PO54 becomes position (i+2, j+1) with respect to the position of the position (i, j) of lattice-site PO41, and now the capable FD' of partial frame becomes 1/2nd speed with respect to the relative reproduction speed of the capable FS of conversion source frame.

In addition, lattice-site PO55 becomes position (i+3, j+1) with respect to the position of the position (i, j) of lattice-site PO41, and now the capable FD' of partial frame becomes 1/3rd speed with respect to the relative reproduction speed of the capable FS of conversion source frame.

In addition, described reproduction speed is for describing two position relationships between lattice-site in this example, and is different from the reproduction speed that the difference of the total length by the capable FS of conversion source frame and the capable FD' of partial frame creates.The reproduction speed creating by the difference of the capable total length of frame is to reappear time consistency to carry out from conversion source to the conversion capable FS of the needed conversion source frame of conversion of destination and the relative reproduction speed of the capable FD' of partial frame in order to make in the time arranging.

In addition, on DP plane surface, for the limit definition cost between each lattice-site.

For example, be provided with the inclination restriction shown in Fig. 6 at each lattice-site of DP plane surface, be necessary the cost in the each path from arbitrary origin to predetermined lattice-site on DP plane surface to be normalized.This be due to, even if path arrives same lattice-site, if path difference, the number of times that is added cost also can be different.

For example, in this case, supposing will be in position (i, the cost at lattice-site place j) is arranged to the difference value D (i being obtained by above-mentioned formula (1), j) value, on practical significance, use configuration as follows: different costs are distributed to the each limit that arrives lattice-site as the cost of adding to limit.That is to say, adding to the cost on limit is for example convergent-divergent corresponding to length or the length of side on limit.In addition, be the cost in order to provide cost temporarily to provide to limit in the cost at lattice-site place, and do not provide cost to the lattice-site on final DP plane surface.

More specifically, the cost at lattice-site place that is positioned at position (i, j) is arranged to the value of difference value D (i, j), the edge lengths of the limit k being connected with this lattice-site is arranged to length (k).In this case, as shown in following formula (3), will be arranged to add the cost E (i, j, k) to limit k by difference value D (i, j) being multiplied by the value that length (k) obtains.

[formula 3]

E(i，j，k)＝D(i，j)×|ength(k)···(3)

For example, as shown in Figure 7, on DP plane surface, the length of the limit k11 from lattice-site OP61 to lattice-site PO62 is arranged to length (k).In addition, position (i, j) is arranged to in the position of lattice-site OP62.

In this case, add cost E (i, the j to limit K11, k) become for position (i, j) product " D (i, j) × length (k) " of the length l ength (k) of the difference value D (i, j) calculating and limit K11.

In this case, difference value D (i, j) is the difference value obtaining by calculating above-mentioned formula (1).That is to say, difference value D (i, j) be from the pixel value of each pixel of the image of i frame in the front end frame of the capable FS of conversion source frame and from the summation of the square value of the difference between the pixel value of each pixel of the image of j frame in the front end frame of the capable FD of conversion destination frame, wherein said j frame is configured to the frame of the capable FD' of partial frame.

Similarity between image and the image of the capable FD' of partial frame of the capable FS of difference value D (i, j) expression conversion source frame, but determining in the situation of cost E (i, j, k), can replace difference value D (i, j) with light stream etc.

According to such configuration, add cost E (i, j, k) to the limit between the each lattice-site on DP plane surface.Now, because total cost in the path of the origin-to-destination from DP plane surface is to add the total value to the cost on limit along described path, the number of times that adds cost in the computing interval of total cost in path is fewer, and the long limit of selecting on path is just more.

Under these circumstances, the cost on limit is set by the length on limit is multiplied by difference value, can makes the cost increase on limit a certain amount of, the number of times that adds thus cost reduces, and is minimum path thereby accurately calculate total cost.

In addition, hereinafter, there is following situation: by by the capable FS of conversion source frame and the capable FD' of partial frame being carried out that DP coupling obtains and being that minimum path is also called minimal cost path from total cost of the origin-to-destination of DP plane surface, and total cost of minimal cost path is called to minimum total cost.

If the capable FS of conversion source frame mates by definite arbitrary origin and supposition terminal and carries out with the DP of the capable FD of conversion destination frame, the capable FS of conversion source frame is carried out to DP with the capable FD' of each partial frame and mate.

If the capable FS of conversion source frame is carried out to DP with the capable FD' of partial frame to be mated, owing to having obtained minimum total cost for the capable FD' of each partial frame in conversion destination frame capable FD, in the capable FD' of partial frame, selecting minimum total cost is that the minimum capable FD' of partial frame is just enough.

But, the length of signal or the number difference of frame in the capable FD' of each partial frame, and because the computing interval in the total cost of minimum is for the number of times difference of the capable FD' interpolation of each partial frame cost, in the situation that not doing to change, can not compare the total cost of each minimum with reasonable manner.

Under these circumstances, can be by after the total cost of minimum of calculating for the capable FD' of partial frame be normalized the total cost of minimum divided by the number of the frame of signal length or the capable FD' of partial frame, selecting is wherein the minimum capable FD' of partial frame through the total cost of normalized minimum.

Therefore, be that m and the original position of the capable FD' of partial frame on DP plane surface are position (i in the signal length of the capable FD' of partial frame, j) in situation, carry out total cost C (i of the minimal cost path of the capable FD' of calculating section frame by calculating formula (4) below, j, m).

[formula 4]

$C(i,j,m)=\frac{1}{m}\underset{(x,j)\&Element;\min \_\mathrm{path}(i,j,m)}{\overset{y=j+m}{\underset{x=i,y=j}{\mathrm{\&Sigma;}}}}E(x,y,k)\&CenterDot;\&CenterDot;\&CenterDot;\left(4\right)$

In addition, in formula (4), the cost on the limit that E (x, y, k) expression use formula (3) obtains.Therefore, by the summation of the cost E on the each limit on minimal cost path (x, y, k) is obtained to total cost C (i, j, m) divided by the signal length m of the capable FD' of partial frame.

In the capable FD' of each partial frame, total cost C (i, j, m) that will wherein be calculated by formula (4) is arranged to finally change the capable FD of destination frame for the minimum capable FD' of partial frame.

In aforesaid way, if carry out DP coupling, obtain the capable FS of conversion source frame of the final conversion source of conduct and the capable FD of conversion destination frame or the capable FD' of selected partial frame as final conversion destination.

Next, by providing, by mating by DP, the obtained capable FS of conversion source frame and conversion destination frame capable FD mix and the description of the mode of reappearing.

For example, in the case of being fixed as 1 by capable conversion source frame FS is carried out to the associated reproduction speed by conversion source with conversion destination frame capable FD, the reproduction speed of changing destination becomes different speed.

Therefore,, if the image repetition of conversion destination frame capable FD being arranged to the reproduction speed of the capable FS of conversion source frame and the image of each frame by hybrid frame row being obtained, in the time being transformed into conversion destination completely, the connection of image is poor.This is because produced the position of changing into rapidly normal speed at the reproduction speed of its conversion destination, place from N speed.

Under these circumstances, in this technique, changing start time point place or at the front end frame place that changes the period, conversion source be arranged to reproduction speed into 1 and be arranged to reproduction speed into N by changing destination, and create the each frame in the conversion period by changing gradually reproduction speed, become reproduction speed into 1 to make at EOC time point place or to become reproduction speed into 1/N and change destination at frame place, the rear end conversion source of changing the period.

In this technique, carry out the processing that distributes in this way reproduction speed.

That is to say, during DP coupling, obtain the row of the frame corresponding with the capable FS of conversion source frame with mate the obtained capable FD of conversion destination frame by DP or similar frame (being also called hereinafter coupling frame) according to minimal cost path.

Except the frame of the lattice-site position on minimal cost path, by determining and obtain coupling frame with the capable corresponding frame of other frames that are not configured to the frame that mates frame in each frame of the conversion capable FD of destination frame and the capable FS of conversion source frame.

More specifically, for example obtained the DP matching result representing with the arrow Q31 of Fig. 8.In this example, trunnion axis represents that the frame number i (wherein, 1≤i≤6) of the capable FS of conversion source frame and vertical axis represent to change the frame number j (wherein, 1≤j≤7) of the capable FD of destination frame in the drawings.In addition, each circle represents that the coupling frame of the capable FS of conversion source frame and the capable FD of conversion destination frame is capable.

For example, will be at position (i, j)=(1,1), (2,3), (3,4), the each locational coupling frame of (5,5) and (6,7) be configured to by the lattice-site along minimal cost path represented, mate the capable FS of conversion source frame that obtains and a framing of conversion destination frame capable FD by DP.For example, position (i, j)=(1,1) represents the frame that mates that the first frame of the capable FS of conversion source frame wherein corresponds to each other with the first frame of the capable FD of conversion destination frame.

But, the frame of the conversion destination frame capable FD corresponding with the 4th frame of the capable FS of conversion source frame and with the frame of the second frame of conversion destination frame capable FD and the corresponding capable FS of conversion source frame of the 6th frame not as create.

Under these circumstances, for example determine with the 4th frame of the capable FS of conversion source frame and change the second frame of the capable FD of destination frame and the 6th frame is corresponding mates frame based on each position (i, j) corresponding with lattice-site on minimal cost path.

The frame that as a result of, for example will represent each position of position (i, j)=(1,2), (4,4) and (5,6) is wherein to being arranged to mate frame.

That is to say, the frame corresponding with the second frame of the capable FD of conversion destination frame is arranged to the first frame of the capable FS of conversion source frame, and the frame corresponding with the 4th frame of the capable FS of conversion source frame is arranged to change the 4th frame of the capable FD of destination frame.In addition, the frame corresponding with the 6th frame of the capable FD of conversion destination frame is arranged to the 5th frame of the capable FS of conversion source frame.

If next with as capable in the coupling frame that creates the capable FS of conversion source frame and the capable FD of conversion destination frame by the mode that the arrow Q32 on the right-hand side of Fig. 8 represents, coupling frame distributed and makes the speed with 1 in the situation that not doing to change carry out reproduction under initial condition.

In addition, in Fig. 8, the dextrad direction indication time orientation on right-hand side, and each rectangle represents the image of single frame.

Especially, in rectangle, write F _sithe frame of (wherein, 1≤i≤6) represents i the frame starting from the front end frame of the capable FS of conversion source frame, writes F in rectangle _djthe frame of (wherein, 1≤j≤7) represents j the frame starting from the front end frame of the capable FD of conversion destination frame.In addition, in rectangle, write F _bhthat the frame of (wherein, 1≤h≤7) represents to start from the front end frame of conversion period, by by capable conversion source frame FS with change destination frame capable FD and mix h obtained frame.

In addition, hereinafter, i the frame of the capable FS of conversion source frame is called to frame F _siand j the frame of the capable FD of conversion destination frame is called to frame F _dj.In addition, hereinafter, h the frame of conversion period is called to frame F _bh.

In Fig. 8, in the part representing with arrow Q32, each coupling frame is arranged at certain intervals.

That is to say frame F _s1with frame F _d1frame F in pairs, _s1with frame F _d2frame F in pairs, _s2with frame F _d3in pairs and frame F _s3with frame F _d4in dextrad direction, arrange in order in pairs.

In addition, frame F _s4with frame F _d4frame F in pairs, _s5with frame F _d5frame F in pairs, _s5with frame F _d6in pairs and frame F _s6with frame F _d7in dextrad direction, seniority among brothers and sisters arrives above-mentioned each right right side in order in pairs.

By the frame F of the capable FS of conversion source frame arranging according to time sequencing _siframe F with the capable FD of conversion destination frame _djbe configured to right each frame F _siaccording to increase or the order that reduces frame number in other words according to ascending order or descending.In an identical manner, by frame F _siwith frame F _djbe configured to right each frame F _djaccording to ascending order or descending.

In addition, in the part representing with arrow Q32, the each frame F arranging in dextrad direction _sibetween show the numerical value that represents the time delay between frame.In addition the number that, the unit of time delay is frame.

For example, arranged same number of frames F at its place _s1point between show F _s1time delay between frame is " 0 ", and has arranged frame F at its place _s1with frame F _s2the time delay showing between the point of arranging between frame is " 1 ".

In the same way, the each frame FD arranging in dextrad direction _jbetween show the numerical value that represents the time delay between frame.For example, arranged same number of frames F at its place _d4point between show the time delay F between frame _d4for " 0 ", and arrange frame F at its place _d1with frame F _d2point between show time delay between frame for " 1 ".

If coupling frame is arranged in this way at certain intervals, start to carry out coupling frame from this state (initial condition) and reorientate processing, and reorientate frame F _siwith frame F _djin every pair of frame.

Reorientate in processing at coupling frame, by the frame F by arranging according to time sequencing _siwith frame F _djthe right position of frame of composition moves on to end from the top of conversion period, namely moves towards its tail end from the right front end frame of described frame, to make the time delay (interval) between the frame of conversion source and the frame of conversion destination become gradually 1.

That is to say, regulate the right placement position of each frame, to make near of the original position (left-hand side in Fig. 8) of conversion period, each frame F of the capable FS of conversion source frame _sibetween interval become 1, and near the terminal position (right-hand side in Fig. 8) of conversion period each frame F of the capable FD of conversion destination frame _djbetween interval become 1.

Will be by frame F _siwith frame F _djeach frame of composition to locate in the situation that on time orientation, and the interval that same in the drawings frame is arranged continuously in dextrad direction is will start to carry out the position reappearing taking time delay as 0 at its place.

But, under the state representing with arrow Q32, even the frame F arranging in the horizontal direction _sibetween 0 the situation of being spaced apart under, also there is the frame F in same position _djbetween interval be not 0 position.For example,, by frame F _s1with frame F _d1the frame pair of composition with by frame F _s1with frame F _d2the frame of composition is to the part of arranging, frame F _s1time delay be 0, and frame F _d1with F _d2the time delay of frame is 1.

Under these circumstances, reorientate in processing at coupling frame, the different position of time delay between conversion destination and conversion source, utilizes weight to regulate the interval (time delay) between the placement position of each frame.As a result of, the capable FS of conversion source frame is located at the interval that to use close to reproduction speed at the top place changing be 1, and the capable FD of conversion destination frame is located at the interval that to use close to reproduction speed in the end of changing be 1.

For example, reorientate in processing at coupling frame, to being positioned to make the frame period of the frame of conversion destination adjacent one another are and the frame of conversion source or in other words to the time delay additional weight representing with arrow Q32.In addition, by the frame period through weighting (time delay) is mixed, calculate the frame period being updated.In addition,, for each frame pair, redeploy frame to make each frame to frame before being arranged on time orientation the frame period to be obtained (time delay) with respect to described frame immediately.

More specifically, to conversion source frame, capable FS provides weights W S, and provides weights W D to the capable FD of conversion destination frame.

In addition,, in order to explain in more detail, weights W S is by the each frame F for the capable FS of conversion source frame _sithe weights W S providing _i(wherein, 1≤i≤6) forms, and weights W D is by the each frame FD for the capable FD of conversion destination frame _jthe weights W D providing _j(wherein, 1≤j≤7) form.

In this case, create weights W S, weights W S is reduced towards back-end location from the front position of the capable FS of conversion source frame.In other words, for example, by weights W S ₁be arranged to 1.0, by weights W S ₆be arranged to 0.0, and by weights W S between the two _ibe arranged to use weight WS ₁with weights W S ₆carry out the value that linear interpolation method is calculated.

On the other hand, create weights W D, weights W D is increased towards back-end location from the front position of the capable FD of conversion destination frame.In other words, for example, by weights W D ₁be arranged to 0.0, by weights W D ₇be arranged to 1.0, and by weights W D between the two _jbe arranged to use weight WD ₁with weights W D ₇carry out the value that linear interpolation method is calculated.

Use this weights W S, and the weight between the frame of the capable FS of conversion source frame is calculated.Weight between frame is for example configured to the mean value of the weight of frame adjacent one another are.Therefore, for example, frame FS ₁with FS ₂weight between frame is configured to (WS ₁+ WS ₂)/2.With and the frame of the capable FS of conversion source frame between the identical mode of weight, by utilizing weight WD to calculate the weight between the frame of the capable FD of conversion destination frame.

In addition, use weight used, the frame period (time delay) of frame period (time delay) to the capable FS of conversion source frame and conversion destination frame capable FD carries out mixed processing, and for destination frame to calculating the frame period (time delay) being updated.

For example, pay close attention to by frame FS ₁with frame FD ₂the frame of composition is to being destination, immediately described frame to frame before to being by frame FS ₁with frame FD ₁the frame pair of composition.

Therefore, for the right capable FS of conversion source frame of these frames by same frame FS ₁arrange, and change the capable FD of destination frame by frame F about it _d1with frame F _d2arrange.

Under these circumstances, as the weight using, calculate frame F in the mixed processing of frame period _d1weights W D ₁with frame F _d2weights W D ₂mean value (be configured to WD as the weight between frame ₁or WD ₂).In addition, due to about the capable FS of conversion source frame by same frame F _s1arrange, so utilize weight WS in the situation that not doing to change ₁.The reason of doing is like this, two weights W S ₁mean value be weights W S ₁.

In addition, to frame F immediately _s1with frame F _d2target frame the right frame period of frame is before carried out and is mixed.

In this case, owing to arranging same frame F about the capable FS of conversion source frame _s1so its frame period (time delay) is " 0 ".In addition, owing to arranging F about the capable FD of conversion destination frame _d1with frame F _d2so its frame period (time delay) is " 1 ".

Therefore, if by calculated weight phase Calais being carried out to the mixing (weighting summation) of these frame periods, the desired frame period of final acquisition.That is to say, calculate (WS ₁× 0)+(WD ₁, ₂× 1), thus the value obtaining is final frame period.

In the time having obtained final frame period (time delay), redeploy by frame F _s1with frame F _d2the frame pair of composition, to make by frame F _s1with frame F _d2composition target to immediately before it by frame F _s1with frame F _d1composition frame between frame period in other words in the drawings in the horizontal direction arrange interval become calculated frame period.

Carry out by this way coupling frame and reorientate processing, and when reorientate each frame of representing with arrow Q32 to time, obtained the layout representing with arrow Q33.In this example, by frame F _s1with frame F _d2the frame of composition is to being positioned in and being next to by frame F _s1with frame F _d1the frame of composition is to substantially overlapping position.

Reorientate processing if carry out coupling frame, and reorientate each frame pair, be chosen in the coupling frame in each moment of the conversion period being reproduced on practical significance.

To the each frame representing with arrow Q33 to positioning, the position taking the right position of the right front end frame of frame that makes to arrange according to time sequencing as the moment of the front end frame of conversion period.

In this case, for example, as represented with arrow Q34, each frame between, represent the moment about the each frame with the dotted line shown conversion period each, selection is positioned in the locational frame pair that approaches the described moment most.In this case, also exist and be dropped and non-selected frame pair.

In the example representing with arrow Q34, frame F _s1with frame F _d1frame F in pairs, _s2with frame F _d3frame F in pairs, _s3with frame F _d4frame F in pairs, _s4with frame F _d4frame F in pairs, _s5with frame F _d5frame F in pairs, _s5with frame F _d6in pairs and frame F _s6with frame F _d7be selected as in pairs coupling frame right in each moment of conversion period.

Finally, mix the image of the each frame right for the selected frame of each moment of conversion period with composite rate α, and described image setting is become to the image of the frame of conversion period.In addition, in Fig. 8, show in the position of dotted line in moment that represents the conversion period conversion period each moment place composite rate α.

In this example, composite rate α represents and the each frame F that changes the capable FD of destination frame _djthe weight multiplying each other, and along with the frame number of conversion period increases, composite rate α increases to α=1.0 with linear mode from α=0.0.

In addition, between the right mixing period of frame, the each frame F by (1-α) as weight and the capable FS of conversion source frame _simultiply each other.

Therefore, for example, pay close attention to the first frame FB of conversion period ₁if, by the frame F of the capable FS of conversion source frame _s1image setting become F _s1and by the frame F of the capable FD of conversion destination frame _d1image setting become F _d1, by α × F _d1+ (1-α) × F _s1calculate frame FB ₁image.

The result of mixing as each frame of the capable FS of this conversion source frame and the capable FD of conversion destination frame, has created the image of changing each frame of period.In Fig. 8, the image (frame is capable) of conversion period is for starting to be gradually converted to from the image of the capable FS of conversion source frame the image of the image of the capable FD of conversion destination frame.

When the frame that obtains the conversion period is when capable, obtain by the capable shuttling movement image forming of frame at the interval between the rear end frame (exterior point) of the capable FD of conversion destination frame and the start frame of the capable FS of conversion source frame (interior point) of raw material moving image and to change the frame that immediately described frame is capable of period capable.

In addition, can also create the shuttling movement that comprises reverse reproduction with the calculating identical with said method.

Under these circumstances, in above-mentioned DP coupling, can add and will oppositely reappear the combination of taking into account combination with the capable FD' of partial frame extracting from the capable FD of conversion destination frame as the capable FS of conversion source frame.

For example, in shuttling movement image, the minimal amount of the frame of included conversion period is configured to NF_min, and the number that forms the frame that each frame of conversion source frame capable FS and the capable FD of conversion destination frame is capable is configured to NF.

In this case, the length of the signal by the front end frame (original position) of the capable FD' of partial frame extracting from the capable FD of conversion destination frame being changed to the frame between NF frame and (NF-NF_min) individual frame of the capable FD of conversion destination frame and the capable FD' of partial frame between change NF_min and NF from front end frame is carried out the capable FD' of Extraction parts frame.Now, capable or in other words by each frame is arranged to the capable capable FD' of partial frame that is configured to of the frame obtaining from new frame number to previous frame number by the capable DISPLAY ORDER (order of frame) of frame oppositely extracting from conversion destination frame capable FD being arranged to the frame obtaining.

In addition, each combination of the capable FS of conversion source frame and the capable FD' of partial frame obtaining is carried out to DP coupling, thereby obtained the capable FD of final conversion destination frame of reverse reproduction.Therefore, obtain the reverse reproduction frame of conversion period from the capable FS of conversion source frame of reverse reproduction and the capable FD of conversion destination frame capable.

But, the shuttling movement image oppositely reappearing in use is finally exported, due to two conversion periods of needs, so be necessary that creating respectively forward reproduction independent of each other from raw material moving image changes the period and oppositely reappear and change the period.

For example, as shown in Figure 9, used the configuration that creates the shuttling movement image LP31 that comprises reverse recurrence interval from raw material moving image MT31.

In this case, created and mated to obtain forward according near the interval FV11 DP end in raw material moving image MT31 and reappear conversion period TR11 or in other words use reproduction in direction to carry out the capable F of conversion source frame of the conversion period TR11 of carries out image conversion _s1with the capable F of conversion destination frame _d1.

In addition, mix the capable F of conversion source frame _s1with the image of each frame of conversion destination frame capable FD1, and create conversion period TR11.

In addition, created and obtained reverse reproduction conversion period TR12 or in other words with the capable F of conversion source frame of conversion period TR12 that oppositely reappears carries out image conversion near the interval FV12 top of raw material moving image MT31 by DP coupling _s2with the capable F of conversion destination frame _d2.In addition, mix the capable F of conversion source frame _s2with the capable F of conversion destination frame _d2the image of each frame, and create conversion period TR12.

In addition the urgent capable F of conversion destination frame being connected in raw material moving image MT31, _d2frame afterwards arrives immediately at the capable F of conversion source frame _s1the interval of frame is before in fact cut, and is configured to the forward reproduction period TU11 of shuttling movement image LP31.

In addition, according to the capable F of conversion source frame in raw material moving image MT31 immediately _s2frame is before to immediately changing the capable F of destination frame _d1the interval of frame is before cut, and the frame at cut interval is arranged to the order of previous frame number according to new frame number.In addition be configured to, the reverse reproduction period TU12 of shuttling movement image LP31 by the capable interval forming of the frame obtaining as its result.Oppositely reappearing period TU12 is the interval that wherein makes the interval of a part of raw material moving image MT31 reappear in the opposite direction.

In addition, by forward being reappeared to period TU11, conversion period TR11, oppositely reappearing period TU12 and conversion period TR12 the obtained moving image that is linked in sequence is configured to shuttling movement image LP31.

In addition, hereinafter, for simplified characterization, will the establishment of the shuttling movement image that does not comprise reverse reproduction be described.

[ios dhcp sample configuration IOS DHCP for the treatment of facility]

Next, will embodiment that apply this technology be described.

Figure 10 is the ios dhcp sample configuration IOS DHCP that is illustrated in the execution mode of the image processing equipment of wherein applying this technology.

Image processing equipment 11 in Figure 10 by acquiring unit 21, the capable determining unit 22 of frame, the capable determining unit 23 of partial frame, matching treatment unit 24, reorientate processing unit 25, mixed processing unit 26 and shuttling movement image creation unit 27 and form.

Acquiring unit 21 obtains raw material moving image, and this raw material moving image is as the raw material of shuttling movement image to be created, and raw material moving image is offered to the capable determining unit 22 of frame and shuttling movement image creation unit 27.

The capable determining unit 22 of frame is extracted the capable FS of conversion source frame and the capable FD of conversion destination frame from the raw material moving image being provided by acquiring unit 21, and capable conversion source frame FS and the capable FD of conversion destination frame are offered to the capable determining unit 23 of partial frame, matching treatment unit 24 and mixed processing unit 26.

The conversion destination frame capable FD Extraction parts frame capable FD' of the capable determining unit 23 of partial frame from being provided by the capable determining unit 22 of frame, and capable partial frame FD' is offered to matching treatment unit 24.

The conversion source frame capable FS of matching treatment unit 24 based on from the capable determining unit 22 of frame is with the conversion capable FD of destination frame and carry out Elastic Matching from the capable FD' of partial frame of the capable determining unit 23 of partial frame, and the result of coupling is offered and reorientates processing unit 25.

The matching result of processing unit 25 based on providing from matching treatment unit 24 is provided and carries out coupling frame and reorientate processing, and the result of processing is offered to mixed processing unit 26.

Mixed processing unit 26 is based on from reorientating the result of processing unit 25 and carrying out mixed processing from the capable FS of conversion source frame of the capable determining unit 22 of frame and the capable FD of conversion destination frame, generate and formed each frame of the conversion period of shuttling movement image, and described frame has been offered to shuttling movement image creation unit 27.

Each frame of the conversion period of shuttling movement image creation unit 27 based on from mixed processing unit 26 and create shuttling movement image from the raw material moving image of acquiring unit 21, and output shuttling movement image.

[description of shuttling movement image creation processing]

Incidentally, in the time that raw material moving image is provided for the establishment of image processing equipment 11 and instruction shuttling movement image, carries out the processing of shuttling movement image creation by image processing equipment 11, and created shuttling movement image.Hereinafter, with reference to the flow chart of Figure 11, the shuttling movement image creation processing owing to image processing equipment 11 is described.

In step S11, provided raw material moving image is provided acquiring unit 21, and raw material moving image is offered to the capable determining unit 22 of frame and shuttling movement image creation unit 27.

In step S12, the capable determining unit 22 of frame is provided by the interval of the capable FS of conversion source frame and the capable FD of conversion destination frame in the raw material moving image being provided by acquiring unit 21, and capable conversion source frame FS and the capable FD of conversion destination frame are offered to the capable determining unit 23 of partial frame, matching treatment unit 24 and mixed processing unit 26.

For example, the capable multiple frame NF of each frame that form the capable FS of conversion source frame and the capable FD of conversion destination frame have been pre-created.In this case, the capable determining unit 22 of frame is arranged to change the capable FD of destination frame by the front end frame from raw material moving image to the interval of NF frame, and the capable FS of conversion source frame is arranged to in the interval being formed by last NF frame of original material moving image.

In addition, the capable FS of conversion source frame and the capable FD of conversion destination frame can be configured to respectively extract from different raw material moving images.

In step S13, the conversion destination frame capable FD Extraction parts frame capable FD' of the capable determining unit 23 of partial frame from being provided by the capable determining unit 22 of frame, and capable partial frame FD' is offered to matching treatment unit 24.

For example, the number N F of the frame of the capable FS of conversion source frame and the capable FD of conversion destination frame, and in shuttling movement image, the minimal amount NF_min of the frame of included conversion period is configured to be created in advance.

In this case, the capable determining unit 23 of partial frame exists by changing ' original position between the first frame of conversion destination frame capable FD and (NF-NF_min) individual frame, the capable FD' of partial frame and the length that also changes the capable FD' of partial frame between NF_min and NF frame carrys out the capable FD of determining section frame.Therefore, due to can be by the capable multiple frames capable FD' of partial frame that becomes, in step S13, in described frame is capable, by capable the frame that is not yet the configured to processing target capable FD' of partial frame that is arranged to.

In step S14, the conversion source frame capable FS of matching treatment unit 24 based on from the capable determining unit 22 of frame is with the conversion capable FD of destination frame and carry out Elastic Matching from the capable FD' of partial frame of the capable determining unit 23 of partial frame.

For example, carrying out DP mates as Elastic Matching.Under these circumstances, matching treatment unit 24 creates DP plane surface based on the capable FS of conversion source frame and the capable FD of conversion destination frame, and the cost E (i, j, k) that will be represented by formula (3) offers each limit of DP plane surface.Now, provide arbitrary origin and supposition terminal to DP plane surface as required.

In addition, the Least-cost path from the origin-to-destination of DP plane surface is searched in matching treatment unit 24, and calculates total cost C (i, j, m) of minimal cost path by computing formula (4).The known total cost being obtained by formula (4) is the assessed value of the minimal cost path of the similarity of the image based on each coupling frame.

In addition, the starting point on DP plane surface is configured to the position of the lattice-site being created by the front end frame of the capable FS of conversion source frame and the front end frame of the capable FD' of partial frame.In an identical manner, the terminal on DP plane surface is configured to the position of the lattice-site being created by the rear end frame of the capable FS of conversion source frame and the rear end frame of the capable FD' of partial frame.

In step S15, matching treatment unit 24 determines whether by total cost C (i, j, m) of the obtained minimal cost path of anticipating of step S14 be minimum.That is to say, determine the total cost C (i that whether is less than the minimal cost path calculating for the capable FD' of partial frame that has been arranged at present processing target by total cost C (i, j, m) of the obtained minimal cost path of anticipating of step S14, j, m).

Total cost C (i, the j of the minimal cost path for example, calculating at the capable FD' of partial frame that has been arranged at present processing target, m) in, minimum total cost C (i, j, m) and the coupling frame from start are this moment preserved in matching treatment unit 24.In addition, in abovementioned steps S14, new total cost of calculating is less than preserved total cost, and matching treatment unit 24 determines whether total cost is minimum value.

In step S15, determine the in the situation that total cost being minimum, in step S16, matching treatment unit 24 upgrades preserved total cost C (i, j, m) and coupling frame.

That is to say, matching treatment unit 24 abandons total cost of being always saved in now and coupling frame, and preserves total cost of the new minimal cost path calculating and by the represented coupling frame of minimal cost path.

By coming that in this way total cost of minimal cost path and coupling frame are carried out to renewal, obtain wherein based on the highest coupling frame of being evaluated as of total cost.When to total cost and coupling frame execution renewal, this processing subsequently advances to step S17.

In addition, in step S15, determine the in the situation that total cost not being minimum, process and advance to step S17, and total cost and coupling frame are not carried out to renewal.

If determine that in step S15 total cost is not minimum or in step S16, total cost and coupling frame is carried out and upgraded, in step S17, matching treatment unit 24 determines whether to carry out and process for the capable FD' of all partial frames.

In step S17, determine that the in the situation that of not yet the capable FD' of all partial frames being carried out to processing, this processing is back to step S13, and repeats above-mentioned processing.

In contrast, in step S17, determine that the in the situation that of carrying out processing for the capable FD' of all partial frames, matching treatment unit 24 offers preserved coupling frame to reorientate processing unit 25, and processing advances to step S18.

In step S18, the coupling frame of processing unit 25 based on providing from matching treatment unit 24 is provided and carries out coupling frame and reorientate processing, and the result of this processing is offered to mixed processing unit 26.

For example, reorientate processing unit 25 suitably to calculate coupling frame with reference to the described mode of Fig. 8 interpolation method, and the frame that mates the capable FS of conversion source frame of frame and change the capable FD of destination frame being arranged to is to arranging according to time sequencing.

For example, as represented in the arrow Q31 in Fig. 8, calculate by frame F by interpolation method _s1with frame F _d2composition frame to, by frame F _s4with frame F _d4composition frame to and by frame F _s5with frame F _d6the frame pair of composition, and as represented in arrow Q32, and each frame is to being arranged.

In addition,, for each frame pair, reorientate the weight between time delay (frame period) and the frame of processing unit 25 based between frame, the mode representing with arrow Q33 redeploys the right layout of frame.

In step S19, the result of mixed processing unit 26 based on reorientating processing unit 25 carried out and redistributed processing each frame.

For example, mixed processing unit 26 with reference to the described mode of Fig. 8, to conversion the period each moment distribute single frame pair.As a result of, as represented in the arrow Q34 in Fig. 8, for conversion the period each moment create the frame pair for the mixed processing in moment.

In step S20, the allocation result that the frame in each moment of mixed processing unit 26 based on the conversion period is right and carry out mixed processing from the capable FS of conversion source frame and the capable FD of conversion destination frame of the capable determining unit 22 of frame, and create the image of each frame of conversion period.

For example, for each moment of conversion period, mixed processing unit 26 is with reference to the described mode of Fig. 1, mix the frame that is assigned to the described moment to or in other words by the image of the frame of the capable FS of conversion source frame and the capable FD of the capable FD'(conversion destination frame of partial frame) the image of frame mix, and the image of the frame of conversion period is set.As a result of, obtained the frame of the conversion period represented with the arrow Q35 in Fig. 8 capable.Mixed processing unit 26 by conversion the period the capable shuttling movement image creation unit 27 that offers of the frame that obtains.

In step S21, the frame of the conversion period of shuttling movement image creation unit 27 based on from mixed processing unit 26 is capable and create shuttling movement image from the raw material moving image of acquiring unit 21.

For example, after shuttling movement image creation unit 27 frame by the interval between rear end frame and the front end frame of the capable FS of conversion source frame of the capable FD of conversion destination frame in raw material moving image is capable, be connected that to change the frame of period capable, create shuttling movement image.

In the time that shuttling movement image is created, created shuttling movement image is exported in shuttling movement image creation unit 27, and shuttling movement image creation is finished dealing with.The shuttling movement image of exporting from image processing equipment 11 is reproduced and is stored in recording medium etc.

According to above-mentioned configuration, image processing equipment 11 by calculating Optimum Matching frame to the capable FD' of each partial frame and the capable FS execution of conversion source frame coupling when change is as the length of the capable FD' of partial frame for the final candidate who changes the capable FD of destination frame and the position of front end frame thereof.

In addition, image processing equipment 11 is by being adjusted in the position of appearing on the time orientation of obtained coupling frame, and the frame that creates the conversion period by mixed processing is capable, and with the capable shuttling movement image that creates of frame of changing the period.

By carrying out coupling in this way in changing the length of partial frame capable FD' and the position of its front end frame, can obtain better suited right to as the capable FS of conversion source frame and the capable FD of conversion destination frame.As a result of, can change similar frame with higher precision level, and the shuttling movement image that can obtain higher quality as a result of.

Incidentally, above-mentioned a series of processing can utilize hardware to carry out or can utilize software to carry out.In the situation that utilizing software to carry out this series of processes, the program that configuration software has been installed on computers.In this case, as computer, can comprise: computer that specialized hardware comprises, can carry out general purpose personal computer of various functions etc. thereon due to various programs being installed.

Figure 12 shows service routine carries out the block diagram of the ios dhcp sample configuration IOS DHCP of the hardware of the computer of above-mentioned a series of processing.

In computer, CPU (CPU) 201, read-only memory (ROM) 202, and random access memory (RAM) 203 is connected to each other by bus 204.

Input/output interface 205 is also connected to bus 204, input unit 206, output unit 207, memory cell 208, communication unit 209 and drive unit 210 and is connected to input/output interface 205.

Input unit 206 is made up of keyboard, mouse, microphone, image-forming component etc.Output unit 207 is made up of display, loud speaker etc.Memory cell 208 is made up of hard disk, nonvolatile memory etc.Communication unit 209 is made up of network interface etc.Drive unit 210 drives removable media 211, as disk, CD, magneto optical disk or semiconductor memory.

In the computer of configuration in the above described manner, above-mentioned a series of processing load and carry out by for example CPU201 the program being stored in memory cell 208 and RAM203 by input/output interface 205 and bus 204 and carry out.

The programming that for example computer (CPU201) can be carried out becomes be stored on the removable media 211 of encapsulation medium etc.In addition, can provide described program by wired or wireless transmission medium for example local area network (LAN), internet or digital satellite broadcasting.

In computer, can by removable media 211 is installed to drive unit 210 via input/output interface 205 by this installation in memory cell 208.In addition, this program can be received and be arranged in memory cell 208 by communication unit 209 by wired or wireless transmission medium.In addition, program can be arranged in ROM202 or memory cell 208 in advance.

In addition, the program that computer is carried out can be the program of processing of wherein carrying out with time sequencing according to the order of describing in this specification, or can be for example in the time carrying out alarm, to locate to carry out the program of processing concurrently or at required time.

In addition, the execution mode of this technology is not limited to above-mentioned execution mode, and can make various changes in the scope that does not depart from this technical scope.

For example, this technology can have cloud computing configuration, and described cloud computing configuration is processed individual feature by function being assigned to multiple equipment via network in the mode of cooperation.

In addition,, except carrying out by individual equipment, each step described in above-mentioned flow chart can be carried out by being assigned to multiple equipment.

In addition,, in the case of multiple processing are included in single step, except being carried out by individual equipment, be included in that multiple processing in single step can multiple equipment carries out by being assigned to.

The execution mode of this technology can have following configuration.

[1] image processing equipment, described image processing equipment create image wherein between the first moving image and the second moving image from a converting motion image that is transformed into another, described image processing equipment comprises:

Matching treatment unit, similarity search for of described matching treatment unit based on forming between the image of frame of described the first moving image and the image of the frame of described the second moving image of formation has described first moving image of similar image and the frame pair of described the second moving image; Reorientate processing unit, described in reorientate the time delay of frame of right described the first moving image of the described frame of processing unit based on adjacent one another are and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And mixed processing unit, described mixed processing unit creates described converting motion image in the following way: the image that is configured to the frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.

[2], according to the image processing equipment [1] described, wherein, wherein, the right frame of described the first moving image and the frame of described the second moving image of multiple described frame of arranging according to time series arranged according to the time series of ascending order or descending respectively.

[3] according to the image processing equipment [2] described, wherein, described in, reorientating processing unit reorientates described in carrying out and makes by following time delay frame adjacent one another are positioning: described time delay is by the time delay weighting summation of the frame of the time delay of the frame of described the first moving image right described frame adjacent one another are and described the second moving image is obtained.

[4] according to the image processing equipment [3] described, wherein, be configured to the mean value of the weight of each frame of right described the first moving image of described frame adjacent one another are for the weight of the time delay of the frame of described first moving image of weighting summation, and the weight of each frame of described the first moving image to be created as the weight of the frame that makes the front side that is positioned at described the first moving image larger.

[5] according to the image processing equipment described in any one in [1] to [4], wherein, when using predetermined frame when change described the second moving image with respect to the reproduction speed of described the first moving image as initial point, the frame of described first moving image of described matching treatment unit based on should present simultaneously and described the second moving image between similarity, by any one frame of the frame centering of some reproduction speeds to being configured to described predetermined frame adjacent frame pair.

[6] according to the image processing equipment described in any one in [1] to [5], wherein, described matching treatment unit for multiple first moving images each other with different length calculate according to time series arrange multiple frames pair, and described mixed processing unit use the multiple frame centerings that calculate for each the first moving image, wherein taking the similarity about each frame as basis be evaluated as the highest frame to creating described converting motion image.

[7] according to the image processing equipment described in any one in [1] to [6], also comprise shuttling movement image creation unit, described shuttling movement image creation unit is based on described converting motion creation of image shuttling movement image.

Reference numerals list

11 image processing equipments

The capable determining unit of 22 frame

The capable determining unit of 23 partial frame

24 matching treatment unit

25 reorientate processing unit

26 mixed processing unit

27 shuttling movement image creation unit

Claims (9)

1. an image processing equipment, described image processing equipment create image wherein between the first moving image and the second moving image from a converting motion image that is transformed into another, described image processing equipment comprises:

Matching treatment unit, similarity search for of described matching treatment unit based on forming between the image of frame of described the first moving image and the image of the frame of described the second moving image of formation has described first moving image of similar image and the frame pair of described the second moving image;

Reorientate processing unit, described in reorientate the time delay of frame of right described the first moving image of the described frame of processing unit based on adjacent one another are and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And

Mixed processing unit, described mixed processing unit creates described converting motion image in the following way: the image that is configured to the frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.

2. image processing equipment according to claim 1,

Wherein, the right frame of described the first moving image and the frame of described the second moving image of multiple described frame of arranging according to time series arranged according to the time series of ascending order or descending respectively.

3. image processing equipment according to claim 2,

Wherein, described in, reorientating processing unit reorientates described in carrying out and makes by following time delay frame adjacent one another are positioning: described time delay is by the time delay weighting summation of the frame of the time delay of the frame of described the first moving image right described frame adjacent one another are and described the second moving image is obtained.

4. image processing equipment according to claim 3,

Wherein, be configured to the mean value of the weight of each frame of right described the first moving image of described frame adjacent one another are for the weight of the time delay of the frame of described first moving image of weighting summation, and

The weight that the weight of each frame of described the first moving image is created as the frame that makes the front side that is positioned at described the first moving image is larger.

5. image processing equipment according to claim 2,

Wherein, when using predetermined frame when change described the second moving image with respect to the reproduction speed of described the first moving image as initial point, the frame of described first moving image of described matching treatment unit based on should present simultaneously and described the second moving image between similarity, by any one frame of the frame centering of some reproduction speeds to being configured to described predetermined frame adjacent frame pair.

6. image processing equipment according to claim 2,

Wherein, described matching treatment unit calculates multiple frames pair of arranging according to time series for multiple first moving images each other with different length, and

Described mixed processing unit use the multiple frame centerings that calculate for each the first moving image, wherein taking the similarity about each frame as basis be evaluated as the highest frame to creating described converting motion image.

7. image processing equipment according to claim 2, also comprises:

Shuttling movement image creation unit, described shuttling movement image creation unit is based on described converting motion creation of image shuttling movement image.

8. an image processing method, described image processing method create image wherein between the first moving image and the second moving image from a converting motion image that is transformed into another, described image processing method comprises the following steps:

Similarity search based on forming between the image of frame of described the first moving image and the image of the frame of described the second moving image of formation has described first moving image of similar image and the frame pair of described the second moving image;

The time delay of frame of described the first moving image that frame based on adjacent one another are is right and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And

Create in the following way described converting motion image: the image that is configured to the frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.

9. for a program for image processing, described image processing create image wherein between the first moving image and the second moving image from a converting motion image that is transformed into another, described program makes computer carry out the processing comprising the following steps:

Similarity search based on forming between the image of frame of described the first moving image and the image of the frame of described the second moving image of formation has described first moving image of similar image and the frame pair of described the second moving image;

The time delay of frame of described the first moving image that frame based on adjacent one another are is right and the time delay of the frame of described the second moving image on time orientation to multiple frames of arranging according to time series to reorientating; And

Be configured to converting motion image described in the creation of image of frame of described converting motion image by the image that forms the right each frame of the frame of reorientating being mixed to the image of the right each frame of frame that described formation is reorientated.