JP2003101878A - Image special effect device and image special effect method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To adjust an overlapping degree of an afterimage part on a present image. SOLUTION: An image composition signal KMIX indicating an image composition ratio of an afterimage and the present image of an inputted moving image signal and an output image key signal KOUT which is a key signal indicating an object to which a recursive effect processing is applied are generated on the basis of equations (1) and (2) by a key generation means. By an image composition part, the afterimage and the present image of the inputted moving image signal are composited on the basis of the image composition signal KMIX and a moving image signal for which the recursive effect processing is applied to the object is generated. In this case, KLIVE is a present image key signal which is the key signal indicating the object to be a recursive effect processing object indicated by the inputted moving image signal. KAFTER is an afterimage key signal for which the output image key signal KOUT of one frame before is multiplied with a prescribed attenuation amount. GZ is a parameter having a value of 0-1.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image special effect device and an image special effect method for performing recursive effect processing on an object displayed in an input moving image signal.

[0002]

2. Description of the Related Art The trail effect, which is a typical recursive effect, can be obtained by synthesizing an afterimage and a current image (hereinafter referred to as a current image). The afterimage is recorded in the image frame memory after the synthesis and is generated by lowering the level of the key signal.

A conventional image special effect device (DME: Didtal Mul)
ti Elcts), in order to combine the current image and the afterimage, a method of using the key of the original image as it is as a combining coefficient,
Further, by applying this, a method of correcting the synthesis coefficient so that the original image is output as it is in the portion where the key does not exist in the afterimage portion is adopted.

[0004]

However, the conventional image special effect device has problems 1 to 3.

Problem 1: When the original image key is used as a synthesis coefficient when the original image is superimposed on the steep edge afterimage, the edge of the original image key is used again when the trail is finally added, and the key is used. Since the edges of are used twice, they are steeper than the original image edges, which causes ringing and aliasing and impairs the image quality.

Problem 2: Color matte bleeds to the edge of the image When an effect of adding an arbitrary color to the trail portion is realized, the color matte is applied to the afterimage portion, but in this case, the object remains stationary. Even when there is a color matte on the edge of the object, the quality is poor. This is because the slope of the key edge is used for the synthesis coefficient.

Problem 3: Problem of circuit complexity and continuity of effect on parameters In the conventional model, these problems are mitigated by performing special processing on the key edge, but it is not complete and the circuit is complicated. Not only is it difficult to understand, but there is the problem that the circuit scale increases. Furthermore, as a variation of the effect, it is possible to cover the afterimage with the current image or vice versa, and it is also possible to freely adjust the degree of overlap between the original image and the afterimage by changing the composition ratio. It is necessary to switch the circuit configuration and processing algorithm according to the degree of overlap between the original image and the afterimage and the use of a color mat for the trail, and the overlap condition parameters and the original image completely overlap with each other. However, there was an inconvenience when representing a continuous change in effect.

Therefore, the present invention solves these problems in realizing the effect of adding a trail to an object moving in the screen, and an image special effect device and an image special effect in which the configuration and operation are easy to understand. It provides a method.

It is an object of the present invention to provide an image special effect apparatus and an image special effect method having a function of enabling selection of an image other than an afterimage on a trail portion and adding a video other than an afterimage such as a color matte. It is in.

Another object of the present invention is to provide an image special effect apparatus and an image special effect method in which an Over state and an Under state can be selected as a trail addition type.

Still another object of the present invention is to provide an image special effect apparatus and an image special effect method capable of adjusting the degree of the afterimage portion overlapping the current image in the above function.

[0012]

Since the trail is usually an effect of dragging an afterimage on the current image, the current image is superimposed on the afterimage. However, in order to represent the state in which the current image moves to the back, superimposition with the afterimage on top is realized. Here, as shown in FIG. 1, a state in which the current image V _{LIV E} is on top is defined as Over, and a state in which the afterimage V _After is on top is defined as Under, and the degree to which the afterimage portion overlaps is freely adjusted. If possible, it is possible to express an effect that the afterimage portion is dark when the speed of moving to the back is fast, and becomes thin when it is slow. As shown in FIG.
The intermediate state between the ver state and the Under state is defined as the Mix state.

According to the present invention, in an image special effect device for subjecting an object displayed in an input moving image signal to recursive effect processing, an afterimage and an input moving image signal of a current image are combined. Image synthesis signal K indicating the ratio
_MIX and key generation means for generating an output image key signal K _OUT which is a key signal indicating the object subjected to the recursive effect process, and a moving image input as an afterimage based on the image synthesis signal K _MIX. Image synthesis means for synthesizing the current image of the signal to generate a moving image signal in which the object is subjected to recursive effect processing, and the key generation means includes the output image key signal K _OUT and the image synthesis signal K
It is characterized in that _MIX is generated based on the following equation.

[0014]

[Equation 5]

Here, K _LIVE is a current image key signal which is a key signal indicating an object to be processed by the recursive effect displayed in the input moving image signal.

K _AFTER is an afterimage key signal obtained by multiplying the output image key signal K _OUT one frame before by a predetermined amount of attenuation.

G _Z is a parameter having a value of 0 to 1.

Further, according to the present invention, in an image special effect method for performing recursive effect processing on an object displayed in an input moving image signal, a residual image and a current image of the input moving image signal are combined. An image synthesis signal K _MIX indicating an image synthesis ratio, and an output image key signal K _OUT which is a key signal indicating the object subjected to the recursive effect process,
The image is generated based on the following equation, and the afterimage is combined with the current image of the input moving image signal based on the image combination signal K _MIX to generate a moving image signal in which the object is subjected to recursive effect processing. It is characterized by

[0019]

[Equation 6]

Here, K _LIVE is a current image key signal which is a key signal indicating an object to be subjected to recursive effect processing which is displayed in the input moving image signal.

K _AFTER is an afterimage key signal obtained by multiplying the output image key signal K _OUT one frame before by a predetermined attenuation amount.

G _Z is a parameter having a value of 0 to 1.

Further, according to the present invention, in an image special effect device for subjecting an object displayed in an input moving image signal to recursive effect processing, an afterimage and a current image of the input moving image signal are combined. image synthesis signal K _MIX showing an image combining _ratio, and a key generating means for generating an output image key signal K _OUT is a key signal indicating the object recursive effect processing has been performed, based on the image synthesizing signal K _MIX , An image synthesizing unit for synthesizing the afterimage and the current image of the input moving image signal to generate a moving image signal subjected to recursive effect processing on the object, wherein the key generating unit is The image synthesizing signal K _MIX and the output image key signal K _OUT are generated based on

[0024]

[Equation 7]

Here, K _LIVE is a current image key signal which is a key signal indicating an object to be subjected to recursive effect processing which is displayed in the input moving image signal.

K _AFTER is an afterimage key signal obtained by multiplying the output image key signal (K _OUT ) one frame before by a predetermined amount of attenuation.

G _Z is a parameter having a value of 0 to 1.

Further, according to the present invention, in the image special effect method for subjecting the object displayed in the input moving image signal to the recursive effect processing, the afterimage and the current image of the input moving image signal are combined. An image synthesis signal K _MIX indicating an image synthesis ratio, and an output image key signal K _OUT which is a key signal indicating the object subjected to the recursive effect process,
The image is generated based on the following equation, and the afterimage is combined with the current image of the input moving image signal based on the image combination signal K _MIX to generate a moving image signal in which the object is subjected to recursive effect processing. It is characterized by

[0029]

[Equation 8]

Here, K _LIVE is a current image key signal which is a key signal indicating an object to be processed by the recursive effect displayed in the input moving image signal.

K _AFTER is an afterimage key signal obtained by multiplying the output image key signal K _OUT one frame before by a predetermined attenuation amount.

G _Z is a parameter having a value of 0 to 1.

[0033]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

First, the basic principle of the trail effect will be described with reference to FIGS.

FIG. 2 shows how the trail effect is applied when a rectangular object is moving. The numerical value written on the object represents the number of frames before the object. The image denoted by 3 means that the image was at that location three frames ago. The image disappears over time and you can see how it blends into the background. In addition, the portions 1 to 4 in FIG. 2 are afterimages, and 0 is the current image. In the next frame, images 0 to 4 are combined, and the one whose level is further lowered is the afterimage.

Image special effect device 10 for producing this effect
As shown in FIG.
(Video Mix.) 1, key generation unit (Key Proc.) 2, frame memories (Frame Mem.) 3, 4, a multiplier 5, a selection circuit 6, and the like.

The image synthesizing unit 1 uses the moving image signal of the current image portion (hereinafter, referred to as "video input") from the outside.
V _LIVE is supplied, the image signal V _OUT output from the image composition unit 1 is supplied as an afterimage signal V _AFTER via the frame memory 3, and the key generation unit 2 is also used. From image synthesis signal K
_MIX is supplied. In the case where the image synthesizing unit 1 is supplied with the color matte signal Matt as the image signal of the afterimage section through the selection circuit 6 instead of the afterimage image signal V _AFTER supplied through the frame memory 3. is there.

Then, the image synthesizing section 1 performs a process in accordance with the linear interpolation equation shown in the following equation (1) based on the image synthesizing signal K _MIX ,

[0039]

[Equation 9]

The afterimage signal V_AFTERAnd the current image
Issue V_LIVEBy combining and, recursive effect on the above object
Processed video signal V_OUTGenerated, generated
Video signal V_OUTIs supplied to the frame memory 3
Together with the moving image signal V _OUTVideo output (Video
 Output) to the outside.

Further, the key generation section 2 uses a key signal (hereinafter referred to as a current image key signal) K _LIVE for the current image signal V _LIVE as a key input from the outside.
, And the output image key signal K _OUT output from the key generation unit 2 is passed through the frame memory 4 and further multiplied by the adjustment parameter Decay by the multiplier 5 to obtain a key signal for an afterimage (afterimage image key signal). It is supplied as K _AFTER .

Then, the key generation unit 2 uses the current image
Key signal K_LIVEAnd afterimage key signal K_AFTERFrom
Afterimage signal V_AFTERAnd the current image signal V_LIVEWith
Image synthesis signal K indicating the image synthesis ratio_MIXAnd and Rika
Output is a key signal that indicates an object that has been subjected to a passive effect process.
Force image key signal K_OUTAnd the generated image synthesis signal
Issue K_MIXIs supplied to the image synthesizing unit 1 and is also generated.
Output image key signal K _OUTTo the frame memory 4
In addition to supply, the output image key signal K_{O UT}The key
-Output to outside as Key Output.

The operation principle of the image special effect device 10 having such a configuration will be described.

The afterimage is a state in which a past image remains, and is considered to represent all the images in which the signal level of the original image is close to the background level with time. In order to realize this, it is preferable that the key signal level decreases with time and finally becomes 0. The degree of decrease in this level, that is, how much the afterimage portion disappears is determined by the adjustment parameter De by which the output of the frame memory 4 is multiplied by the multiplier 5.
It is pay. The adjustment parameter Decay has a value of 1 or less, and is 1 output from the frame memory 4.
The key output before the frame is multiplied. Frame memory 4
The current image key signal K _LIVE and the afterimage key signal K
_{A combination of AFTER} and _AFTER is input, and the level of the key signal decreases with time. The image output of the afterimage portion is a frozen image, and its level does not change with time. However, it is possible to observe the effect that the afterimage part gradually disappears in the image mixed with the background due to the decrease in the level of the key signal.

The effect of adding the trail of any color is that the afterimage signal V supplied to the image synthesizer 1 is
_This is realized by supplying an arbitrary matte signal Matt to _AFTER via the selection circuit 6.

In this image special effect device 10,
The afterimage and the current image are combined based on the 2-channel video combine principle, and the key generation unit 2 calculates the image combination signal K _MIX and the output image key signal K _{OUT according} to the following equations (2) and (3). Ask.

[0047]

[Equation 10]

Here, G _z is a variable indicating the degree of overlapping of afterimages. When the value of the variable G _z is 1, the after state in which the afterimage is superposed on top is considered, and when the value of the variable G _z is 0, it is considered as the over state in which the current image is superposed on top. It should be noted that if the afterimage and the current image input are applied to the channels opposite to the combine principle equation, the Ove for the variable G _z
The meanings of the r state and the Under state are opposite.

[0049] In the key generation unit 2, for example, by the arithmetic circuit 20 of the configuration shown in FIG. 4, the formula (2), calculates the image synthesis signal _{K MIX} and an output image key signal _{K O UT} according to equation (3) .

That is, the arithmetic circuit 20 having the configuration shown in FIG.
, The subtractor 21 subtracts the current image key signal K _LIVE from the constant 1.0 and outputs the subtraction output (1-
K _LIVE ) to the multiplier 22.

The multiplier 22 multiplies the subtraction output (1-K _LIVE ) of the subtracter 21 by the afterimage key signal K _AFTER and outputs the multiplication output (K _AFTER × (1-K
_LIVE )) is supplied to the adder 23 and the combiner 24.

The adder 23 operates as the multiplier 2
By adding the multiplication output of 2 (K _AFTER × (1-K _LIVE )) and the current image key signal K _LIVE , the output image key signal K _{OUT represented} by the above formula (3) is output as the addition output. It is also supplied to the divider 25.

Further, the synthesizer 24 is supplied with a variable G _z indicating the degree of afterimage overlap, and a = K.
_AFTER , b = K _AFTER , k = G _z , a synthesis process of x = (ab) k + b is performed, and the synthesized output x is divided by the divider 25.
Supply to.

Then, the divider 25 is the adder 2
3 addition output, that is, output image key signal K_OUTTo y
Then, the synthesized output x of the synthesizer 24 is set to the output image key signal.
Issue K _OUTThat is, by dividing by y, the division
As an output, the image synthesis signal K represented by the above equation (2)
_MIXIs output.

In the key generation unit 2, the equation (2),
By calculating the image synthesis signal K _MIX and the output image key signal K _OUT according to the equation (3), the following advantages can be obtained.

That is, it is based on the combine principle, and the inclination of the key of the input channel is guaranteed even after the combination. Therefore, the sharpening of the edge by the double key does not occur.

Further, the degree of superposition can be freely adjusted, and the state of 0ver · Under is the same as the case where the coefficient is maximum or minimum in the Mix state. further,
Using this property, a variable G _z indicating the degree of afterimage overlap
The depth information can be reflected in to realize a more effective trail. In addition, it is true to theory as a synthesis method for recursive effects other than trail. Recursive circuit is not only trail but Motion Decay, Key Frame Strob
It also realizes effects such as e, Multi Freeze and Recursive Shadow.

Here, in the key generation unit 2, the Over
State and Under state are calculated separately, and the result is Mi
Alternatively, the image composite signal K _MIX can be obtained by performing x.

That is, in this case, the state equations of the image signals of the Over trail and the Under trail are defined, and M
The ix trail is considered to be a combination of these two states. However, when the image signal in each state is mixed, since the circuit scale becomes large, an image synthesis signal K _MIX that is equivalent to the formula obtained by the final operation result of the video is derived.

The Over state is defined so as to satisfy the following conditions A1) to A3).

Condition A1) The combination result of the key signals is the maximum value of the afterimage key signal K _AFTER and the current image key signal K _LIVE , that is, the Positive NAM output.
This eliminates the problem of increasing the key level in the stationary state.

Condition A2) In order to validate the original inclination of the image edge, the state definition is performed in the key-processed state in consideration of the consistency when combined with the background or the like.

Condition A3) The trail is the afterimage key signal K.
_{It is considered that AFTER} is added when the level is higher than the level of the current image key signal K _LIVE . This prevents the afterimage from seeping in the stationary state.

In order to satisfy the condition A1), the output image key signal K _OUT is defined by the following equation (4).

[0065]

[Equation 11]

Further, the image output is defined by the following expression (5) based on the condition A2).

[0067]

[Equation 12]

This means that the afterimage is added only when the level of the afterimage key signal K _AFTER is higher than the current image key signal K _LIVE , and the condition 3) is satisfied.
From this equation (5), the moving image signal V _OVER which is an image synthesis output in the Over state can be obtained by the following equation (6).

[0069]

[Equation 13]

The definitional expression (6) is divided into the following cases depending on the key levels of the afterimage and the current image.

A. If K _AFTER ≧ K _LIVE

[0072]

[Equation 14]

B. When K _AFTER ≤ K _LIVE

[0074]

[Equation 15]

From this, it can be seen that the condition A3) is satisfied.

In addition, the Over state has the following conditions B1) to B:
3) is defined so as to satisfy.

[0077] B1) synthesis result of the key signal is the maximum value of the afterimage key signal _{K AFTER} and the current image key signal _{K L IVE,}
That is, Positive NAM is output. This eliminates the problem of increasing the key level in the stationary state.

B2) In order to validate the original inclination of the image edge, the state definition is performed in the key-processed state in consideration of the consistency when combined with the background or the like.

B3) In the Under state, afterimages have priority, but all afterimages are reflected in the output. It is assumed that the current image is output only when the key signal K _LIVE is larger than the afterimage key signal K _AFTER .

Of these, the conditions other than B3) are the same as those of Over. The output image key signal K _OUT has the same expression, that is,
It is defined by the equation (4), and the image output is defined by the following equation (9).

[0081]

[Equation 16]

Therefore, the moving image signal V _UNDER , which is an image combining output in the Under state, is expressed by the following equation (10).
Can be obtained by

[0083]

[Equation 17]

Similar to Over, the respective key levels are compared and the video output is as follows.

A. If K _AFTER ≧ K _LIVE

[0086]

[Equation 18]

B. When K _AFTER ≤ K _LIVE

[0088]

[Formula 19]

From this, it is understood that the condition B3) is satisfied.

The Mix state equation is derived as follows.

That is, the Mix state is the Over state and the U state.
It is considered that the nder state is synthesized by a certain mix ratio. Since the definition of the output image key signal K _OUT is the same in the Over state and the Under state, the moving image signal V _OUT , which is the image output after combination, is simply V _OVER without considering the key signal level after combination. and _{V UNDE R}
And may be combined as shown in the following equation (13).

[0092]

[Equation 20]

The moving image signal V represented by the equation (13)
_OUT is in the Under state when the variable G _z indicating the degree of overlapping of afterimages has a maximum value of 1.0, and is in the Over state when the value is 0.0.

Here, the level of the afterimage key signal K _AFTER and the level of the current image key signal K _LIVE are compared, and they are expressed by the afterimage and the current image as follows.

A. If K _AFTER ≧ K _LIVE

[0096]

[Equation 21]

This equation (14) is transformed into the following equation (15).

[0098]

[Equation 22]

B. When K _AFTER ≤ K _LIVE

[0100]

[Equation 23]

This equation (16) is transformed into the following equation (17).

[0102]

[Equation 24]

Here, paying attention to the difference between the arithmetic expressions under both conditions, the above a. In the case of, the part of subtracting the current image key signal K _LIVE from the afterimage key signal K _AFTER of the equation (15) is b. It can be seen that the value is 0 in the case of. That is, when the afterimage key signal K _AFTER is equal to or lower than the level of the current image key signal K _LIVE , it becomes 0, so that the moving image signal V _OUT which is the image output after the combination.
Is expressed as the following expression (18) which applies a limiter to the subtraction result so that the output becomes 0 or more.

[0104]

[Equation 25]

This equation (18) is based on the above-mentioned trail effect.
Linear interpolation formula between afterimage and current image explained in the basic principle
It is none other than. Coefficient K at that time_MIXAt the beginning of the right side
The entire fractional part described. Also, this coefficient K_MIX
The denominator of is the current image key signal K _LIVEAnd afterimage key signal K
_AFTEROf the output image key signal K
_OUTIt is itself. Therefore, finally image synthesis
Image synthesis signal K representing the ratio_MIXAnd output image key signal
K_OUTIs expressed by the following equations (19) and (20).
Be done.

[0106]

[Equation 26]

Therefore, in the key generation section 2, the arithmetic circuit 30 having the configuration shown in FIG.
9), the image synthesis signal K _MIX and the output image key signal K _OUT are calculated according to the equation (20).

That is, the arithmetic circuit 30 having the configuration shown in FIG.
In, the subtracter 31 subtracts the current image key signal K _LIVE from the afterimage key signal K _AFTER and supplies the subtraction output (K _{A FTER} −K _LIVE ) to the limiter circuit 32.

The limiter circuit 32 includes the subtractor 31.
The subtraction output (K _AFTER −K _{LI VE} ) is applied with a limiter of 0 or more, and the limiter output (0, K
_AFTER- K _LIVE ) is supplied to the adder 33 and the combiner 34.

The adder 33 outputs the limiter output (0, K _{A FTER} -K of the limiter circuit 32.
_(LIVE ) and the current image key signal K _LIVE are added, and the output image key signal K _{OUT represented} by the above equation (20) is output as the addition output and is also supplied to the divider 35.

Further, the synthesizer 34 is supplied with a variable G _z indicating the degree of overlapping of afterimages, and a = K.
_AFTER , b = K _AFTER , k = G _z , a synthesis process of x = (ab) k + b is performed, and the synthesized output x is divided by the divider 35.
Supply to.

Then, the divider 35 is the adder 3
3 addition output, that is, output image key signal K_OUTTo y
Then, the synthesized output x of the synthesizer 24 is set to the output image key signal.
Issue K _OUTThat is, by dividing by y, the division
As an output, the image composite signal K represented by the above equation (19)
_MIXIs output.

In the key generation unit 2, the above equation (1
By calculating the image combination signal K _MIX and the output image key signal K _OUT according to 9) and the equation (20), the following advantages can be obtained.

In other words, the Over and Under state definition formulas employ the afterimage and the edge of the current image as they are, so that the problem due to the double key does not occur. This is Over
-Under Guaranteed even in the Mix state obtained by combining both states.

In principle, both the Over and Under states are first calculated, and then the Mix is performed by the variable G _z indicating the degree of overlapping of afterimages. However, in the calculation circuit 30 shown in FIG. The hardware is minimized by reflecting the variable G _z indicating the degree of overlapping of the afterimages with respect to the image composite signal K _MIX . That is, in the arithmetic circuit 30 shown in FIG. 5, the number of dividers and adders is about half of the hardware configuration according to the principle procedure.

In the 0ver state, the afterimage key signal K
_When the level of _AFTER is equal to or lower than the level of the current image key signal K _LIVE , the operation formula is such that no trail is added. Afterimage key signal K in the still image state
Since the level of _AFTER becomes less current image key signal _{K LIVE,} image after image portion even if the current image key signal _{K LIVE} level of 1 or less does not come appear in the table. That is, the problem of seeping in a color matte signal or the like is completely solved.

Further, the degree of superposition can be freely adjusted by the coefficient G _z , and the state of 0 vem · Under is the same as the case where the coefficient G _z is maximized or minimized in the Mix state. Therefore, similar to the combine method, it is possible to reflect the depth information in the variable G _z indicating the degree of overlapping of the afterimages and realize a more effective trail.

Here, consider the case where the polarities of the variable G _z , which is the composite ratio of the Over state and the Under state, is reversed.
In this case, the parameter G ′ _z represented by the following equation (21) is the synthesis ratio with respect to the above equation.

[0119]

[Equation 27]

When the parameter G ′ _z has the maximum value, Ov
The moving image signal V _OUT , which is a parameter in the er state and is an image output after combination, is expressed by the following equation (22).

[0121]

[Equation 28]

At this time, the moving image signal V _OUT and the image synthesis signal K _MIX representing the image synthesis ratio are calculated by the same calculation.
And the output image key signal K _OUT are represented by the following equations (23), (24) and (25).

[0123]

[Equation 29]

This is the afterimage and the current image compared to the original equation.
And afterimage key signal K _AFTERAnd the current image
Key signal K_LIVEIt has become a formula that replaces and
Recognize. That is, without changing the circuit configuration at all
This can be handled by switching the afterimage input and the current image input.

The arithmetic circuit 20 shown in FIG. 4 and the arithmetic circuit 30 shown in FIG. 5 described above include many similar components, and like the arithmetic circuit 40 shown in FIG.
By adding the selection circuit 41 and the limiter circuit 42 to 0, the arithmetic circuit 40 having both arithmetic functions can be realized.

Here, in the case of realizing a recursive effect other than the trail, it is more appropriate and advantageous in terms of image quality to adopt the arithmetic method by the arithmetic circuit 20 when considering the video composition principle. Further, although the control is complicated, the recursive is set to 0N only when there is movement, so that the arithmetic circuit 2 can be operated at the time of trailing.
It is also possible to adopt a calculation method based on 0.

Further, by applying the present invention to a system having depth information, the above-mentioned key in the image special effect device 10 whose principle structure is shown in FIG. 3 is applied like the image special effect device 50 shown in FIG. Over state and Un in the generation unit 2
The depth information can be reflected in the trail process by providing the depth information generation unit 8 that gives the variable G _z that is the synthesis ratio of the der state.

In the image special effect device 50 shown in FIG. 7,
The depth information generation unit 8 inputs depth information from the outside.
Depth information (hereinafter referred to as current image depth information) Z _LIVE for the current image signal V _LIVE is supplied as (Z Input), and output depth information Z _OUT output from the depth information generation unit 8 is supplied to the frame memory 9. Depth information for afterimage through (hereinafter referred to as afterimage depth information)
It is supplied as Z _AFTER .

Then, the depth information generating section 8 uses the current image depth information Z _LIVE and the afterimage depth information Z.
_{From AFTER} , a variable G _z that specifies the composite ratio of the Over state and the Under state and depth information (referred to as output image depth information) Z _OUT of the output image are generated, and the generated variable G _z is supplied to the key generation unit 2. Also, the output image generated image depth information Z _OUT is output as depth information (Key Output).
To the outside.

The key generation section 2 supplies the image synthesis signal K _MIX corresponding to the variable G _z supplied from the depth information generation section 8 to the image synthesis section 1.

The image synthesizing unit 1 synthesizes the current image signal V _LIVE and the afterimage signal V _{AFT ER} at a synthesizing ratio according to the image synthesizing signal K _MIX supplied from the key generating unit 2. The moving image signal V _OUT is generated.

By reflecting the depth information in the trail processing in this way, the state of moving to the front or the back without special control can be represented by the trail. Furthermore, it is possible to obtain the effect that the 4 attack image penetrates the trail portion.

[0133]

As described above, according to the present invention, the trail processing can be performed without the problem of sharpening the edge in the trail effect, that is, the sharpening of the edge by the double key. Further, it is possible to adjust the degree to which the afterimage of the trail in the Mix state and the current image overlap. Further, the trail processing can be performed without causing the color mat to seep into the image edge.

That is, according to the present invention, an image special effect apparatus and an image special effect method are provided which have a function of enabling selection of an image other than an afterimage on a trail portion and adding a video other than an afterimage such as a color matte. can do.

Further, according to the present invention, it is possible to provide an image special effect apparatus and an image special effect method in which an Over state and an Under state can be selected as a trail addition type.

Further, according to the present invention, the degree to which the afterimage portion overlaps the current image can be adjusted, and the Over state and Under
An image special effect device and an image special effect method capable of ensuring continuity with a state can be provided.

[Brief description of drawings]

FIG. 1 is a conceptual diagram of an Under state, an Over state, and a Mix state showing an overlapping state of a current image and an afterimage in trail processing of the present invention.

FIG. 2 is a diagram showing how the trail effect is applied when a rectangular object is moving.

FIG. 3 is a block diagram showing a principle configuration of an image special effect device that produces the trail effect.

FIG. 4 is a block diagram showing a configuration example of an arithmetic circuit provided in a key generation unit in the image special effect device.

FIG. 5 is a block diagram showing another configuration example of an arithmetic circuit provided in a key generation unit in the image special effect device.

FIG. 6 is a block diagram showing still another configuration example of the arithmetic circuit provided in the key generation unit in the image special effect device.

FIG. 7 is a block diagram showing a configuration example of an image special effect device in which the present invention is applied to a system having depth information.

[Explanation of symbols] 10,50 image special effect device, 1 image synthesizing unit (Video
Mix.), 2 key generation part (Key Proc.), 3, 4, 9 frame memory (Frame Mem.), 5 multiplier, 6 selection circuit,
8 depth information generation unit, 20, 30, 40 arithmetic circuit,
21, 31 Subtractor, 22 Multiplier, 23, 33 Adder, 24, 34 Combiner, 25, 35 Divider, 32, 4
2 limiter circuit, 50 image special effect device

Claims (12)

[Claims] 1. An image special effect device for performing recursive effect processing on an object displayed in an input moving image signal, wherein an image combination ratio of an afterimage and a current image of the input moving image signal is calculated. image synthesis signal K _{MIX shown,} and a key generating means for generating an output image key signal K _OUT is a key signal indicating the object recursive effect processing has been performed, based on the image synthesizing signal K _MIX, and residual image It synthesizes the current image of the input moving image signal, and an image synthesizing means for generating a moving image signal recursive effect processing is applied to the object, the key generation means, output image key signal K _OUT And an image special effect device which generates an image composite signal K _MIX based on the following equation. [Equation 1] Here, K _LIVE is a current image key signal that is a key signal indicating an object to be processed by the recursive effect processing, which is displayed in the input moving image signal. K
_{AF TER} is the output image key signal K one frame before.
It is an afterimage key signal obtained by multiplying _OUT by a predetermined attenuation amount. G _Z is a parameter having a value of 0 to 1. 2. The image special effect apparatus according to claim 1, wherein the afterimage is an output image one frame before. 3. The image special effect device according to claim 1, wherein the afterimage is a color matte signal. 4. An image special effect method for performing recursive effect processing on an object displayed in an input moving image signal, wherein an image combining ratio between an afterimage and a current image of the input moving image signal is calculated. The image synthesis signal K _MIX shown and an output image key signal K _OUT , which is a key signal showing the object subjected to the recursive effect processing, are generated based on the following equation, and the afterimage is generated based on the image synthesis signal K _MIX. And a current image of the input moving image signal are combined with each other to generate a moving image signal in which the object is subjected to recursive effect processing, to generate a special image effect method. [Equation 2] Here, K _LIVE is a current image key signal that is a key signal indicating an object to be processed by the recursive effect processing, which is displayed in the input moving image signal. K
_AFTER is the output image key signal K of the previous frame.
It is an afterimage key signal obtained by multiplying _OUT by a predetermined attenuation amount. G _Z is a parameter having a value of 0 to 1. 5. The image special effect method according to claim 4, wherein the afterimage is an output image one frame before. 6. The image special effect method according to claim 4, wherein the afterimage is a color matte signal. 7. An image special effect device for performing recursive effect processing on an object displayed in an input moving image signal, wherein an image combination ratio between an afterimage and a current image of the input moving image signal is calculated. An image synthesizing signal (K _MIX ), and a key generation unit that generates an output image key signal K _OUT , which is a key signal indicating the object subjected to the recursive effect processing, and an afterimage based on the image synthesizing signal K _MIX. An image combining unit that combines the image and the current image of the input moving image signal to generate a moving image signal that is subjected to recursive effect processing on the object, and the key generating unit is based on the following formula. Image synthesis signal K
An image special effect device characterized by generating a _MIX and an output image key signal K _OUT . [Equation 3] Here, K _LIVE is a current image key signal that is a key signal indicating an object to be processed by the recursive effect processing, which is displayed in the input moving image signal. K
_AFTER is the output image key signal K of the previous frame.
It is an afterimage key signal obtained by multiplying _OUT by a predetermined attenuation amount. G _Z is a parameter having a value of 0 to 1. 8. The image special effect apparatus according to claim 7, wherein the afterimage is an output image one frame before. 9. The image special effect device according to claim 7, wherein the afterimage is a color matte signal. 10. An image special effect method for performing recursive effect processing on an object displayed in an input moving image signal, wherein an image combination ratio between an afterimage and a current image of the input moving image signal is calculated. The image synthesis signal K _MIX shown and an output image key signal K _OUT , which is a key signal showing the object subjected to the recursive effect processing, are generated based on the following equation, and the afterimage is generated based on the image synthesis signal K _MIX. And a current image of the input moving image signal are combined with each other to generate a moving image signal in which the object is subjected to recursive effect processing, to generate a special image effect method. [Equation 4] Here, K _LIVE is a current image key signal that is a key signal indicating an object to be processed by the recursive effect processing, which is displayed in the input moving image signal. K
_AFTER is the output image key signal K of the previous frame.
It is an afterimage key signal obtained by multiplying _OUT by a predetermined attenuation amount. G _Z is a parameter having a value of 0 to 1. 11. The image special effect method according to claim 10, wherein the afterimage is an output image one frame before. 12. The image special effect method according to claim 10, wherein the afterimage is a color matte signal.