JPH08102889A - Special picture effect device - Google Patents

Abstract

PURPOSE: To obtain special picture effect device which superimposes only the contour of a past picture on a present input picture through the use of contour information of an input picture signal. CONSTITUTION: The device is provided with a first mixer 23 provided with an input picture signal showing an input picture, a first delay means 24 delaying an output picture signal from the first mixer 23 for a prescribed time and providing the first mixer 23 with the delayed output picture signal, an edge detection means 26 which is provided with the input picture signal, detects the edge of the input picture shown by the input picture signal and outputs an edge signal showing the edge, and control means 27 to 29 generating a mixing ratio control signal based on the edge signal from the edge detection means 26. The first mixer 23 mixes the input picture signal and the delayed output picture signal from the first delay means 24 by a mixing ratio based on the mixing ratio control signals from the mixing ratio control means 27 to 29.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image special effect device for processing an image special effect on an input image signal.

[0002]

2. Description of the Related Art Conventionally, there has been an image special effect device for detecting a contour of an input image of an input image signal and blurring the contour. For example, Japanese Patent Application Nos. 63-225323 and 1-52150 detect the contour of an input image of an input image signal, convert the detected contour into a flat histogram, and convert the contour. There is disclosed a special effect device which makes an input image like a line drawing by synthesizing the contour signal with the original input image signal.

However, an image special effect device that detects the contour of the input image of the input image signal and uses the contour signal indicating the detected contour to convert not only the contour but also the original input image signal itself is It didn't exist before. In particular, there has been no image special effect device that superimposes only the contour of the past image on the current input image by using the contour information of the input image signal. Further, there has not been a conventional image special effect device that uses the contour information of the input image signal to superimpose only the contour of the past image on the current input image as an afterimage. Further, there has not been a conventional image special effect device that uses the contour information of the input image signal to superimpose only the contour of the image of the past frame as an afterimage on the input image of the current frame.

[0004]

In view of the above point, the present invention proposes an image special effect device which uses the contour information of an input image signal to superimpose only the contours of past images on the current input image. It is what

Another object of the present invention is to propose an image special effect device which uses the contour information of an input image signal to superimpose only the contour of the past image on the current input image as an afterimage.

Further, the present invention proposes an image special effect device which uses the contour information of the input image signal to superimpose only the contour of the image of the past frame on the input image of the current frame as an afterimage. Is.

[0007]

According to a first aspect of the present invention, a first mixer to which an input image signal indicating an input image is supplied and an output image signal from the first mixer are delayed by a predetermined time. First delay means for supplying the delayed output image signal to the first mixer, and an input image signal supplied for detecting an edge of the input image indicated by the input image signal, and an edge indicating the edge The first mixer includes an edge detection unit that outputs a signal and a control unit that generates a mixing ratio control signal based on the edge signal from the edge detection unit.
The image special effect device is characterized in that the input image signal and the delayed output image signal from the first delay unit are mixed at a mixing ratio based on a mixing ratio control signal from the mixing ratio control unit.

According to the present invention, the input image signal representing the input image is supplied to the first mixer, and the output image signal from the first mixer is delayed for a predetermined time by the first delay means. Then, the delayed output image signal is supplied to the first mixer, the input image signal is supplied to the edge detecting means to obtain the edge signal, and the first mixing is performed by the control means based on the edge signal. A control signal for controlling the mixing ratio of the input device is generated, and the signal delayed by the first delay means for the input image signal and the output image signal is mixed at the mixing ratio.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION An image special effect apparatus according to an embodiment of the present invention will be described below with reference to FIG. 20 and 25
Is an input terminal and an output terminal of the image special effect device. An input image signal (input digital image signal) is supplied to the input terminal 20, and an output image signal (output digital image signal) is output from the output terminal 25. The image special effect device includes an afterimage effect generating circuit 21, which is a delay unit 2
2, a mixer (mixer) 23 and a frame memory (1 frame time delay device) 24.

The delay device 22 delays the input image signal from the input terminal 20 by a predetermined time, and is a delay compensating delay device having a delay amount equal to that of an edge detection circuit 26 described later. is there. However, the edge detection circuit 2
When the delay amount in 6 is 0 or extremely short, the delay unit 22
Can be omitted.

The input image signal from the input terminal 20 is supplied to the delay unit 22 and delayed for a predetermined time, and the delayed input image signal A is supplied to the mixer 23. The output image signal Q from the mixer 23 is output to the output terminal 25 and is also supplied to the frame memory (one frame period delay means) 24 to be delayed by one frame period. The delayed output image signal B is the delayed output image signal B. Is supplied to.

An input image signal from the input terminal 20 is supplied to the edge detection circuit 26, an edge of the input image is detected, an edge signal E indicating the edge is generated, and the edge signal E serves as a mixer. It is supplied to the NAM (non-additive mixer) 27. The NAM 27 is a circuit that outputs a higher level input signal of the two input signals. The output of the NAM 27 is supplied to a frame memory (1 frame cycle delay means) 28 and delayed by 1 frame time. The output of the frame memory 28 is supplied to the attenuation coefficient multiplier 29 and is multiplied by the attenuation constant D (0 <D <1). The output of the multiplier 29 is supplied to the NAM 27 and also to the mixer 23 as a mixing ratio control signal (key signal) C. The NAM 27, the frame memory 28, and the multiplier 29 constitute control means for generating the mixing ratio control signal to be supplied to the mixer 23.

Next, the operation of the image special effect device of the embodiment will be described with reference to FIG. Time points t-2, t-1 and t
Input image signals A (t-2), A for each frame in
In the input images of (t-1) and A (t), as shown in the figure, a square image portion is moved diagonally to the right. It is assumed that the image of the input image signal one frame before the input image signal A (t-2) does not have a square image portion. E (t-
2), E (t-1), and E (t) are input image signals A (t
-2), A (t-1), and A (t) show the edge signal for each frame in the line shown by the dotted line of the input image. The edge signal is a signal which is 1 during the period in which the edge exists and 0 during the other periods.

C (t-2), C (t-1), C (t)
Are input image signals A (t-2), A (t-1), A
The key signals corresponding to (t) are shown. With respect to the input image signal A (t-2), the input image signal one frame before has no square image portion, so that the key signal is 0, that is, the key signal cannot be obtained. Input image signal A (t-1)
, The key signal C (t-1) obtained by lowering the level of the edge signal E (t-2) of the square image portion at the time of the input image signal A (t-2) is obtained. Signal C (t
-1) controls the mixing ratio of the input image signal A and the delayed input image signal B in the mixer 23. With respect to the input image signal A (t), the levels of the edge signal E (t-1) and the key signal C (t-1) of the square image portion when the input image signal A (t-1) is respectively The key signal C (t) is obtained by adding it by the NAM 27, and the key signal C (t) controls the mixing ratio of the input image signal A and the delayed input image signal B in the mixer 23.

In this case, the mixing ratio of the input image signal A based on the mixing ratio control signal (key signal) in the mixer 23 and the output signal B from the frame memory 24 is set to (1-C): C. In the past and present, C is 0 <C <1 in the edge period in which the edge exists, and C = 0 in the other periods.

Therefore, the output image signals output from the output terminal 25 at the time points t-2, t-1, and t are:
Q (t-2), Q (t-1), Q (t), and the respective output images are shown on the lower side thereof. Output image signal Q (t
-2) indicates that the output image is the input image signal A at time t-2.
It is the same as the input image indicated by (t-2). The output image represented by the output image signal Q (t-1) is obtained by superimposing only the afterimage of the contour of the input image one frame before on the input image represented by the input image signal A (t-1) at time t-1. Becomes Furthermore,
The output image indicated by the output image signal Q (t) is the input image of the input image signal A (t) at the time point t with only the afterimage of the contour of the input image one frame before and two frames before. . In this way, only the contours of the input images of the past frames are successively superimposed, and an image in which the afterimage of the contours of the images is displayed is obtained.

Further, the afterimage of the contour superimposed on the input image is
Due to the multiplication coefficient D (0 <D <1) given to the multiplier 29, the contour level of the old frame becomes smaller. The smaller the damping constant D, the more quickly the outline of the old frame disappears from the output image. When the attenuation coefficient D is 1, the contour of the old frame is displayed at the same level as the contour of the image of the current frame.

In the embodiment of FIG. 1, the delay amount of the frame memories 24 and 28 as the delay device is one frame period, but the delay time is 2, 3, 4, ... May be. That is, the frame memories 24 and 28
The delay amounts are equal to each other and may be a natural number multiple of one frame time.

Next, a specific example of an edge detection circuit suitable for application to the edge detection circuit 26 of the image special effect apparatus of the embodiment of FIG. 1 will be described with reference to FIG. The original input image signal (digital image signal consisting of a column of pixel data) from the input terminal 1 is supplied to the low-pass filter 2 for noise removal, and an input digital image signal from which noise has been removed is obtained. The input digital image signal is supplied to the vertical edge detection circuit 3 through the delay device 3L having a delay amount for delay compensation of 1H (H is a horizontal period of the input digital image signal), and at the same time, a delay amount for delay compensation. 2τ (τ is the period of the sampling clock of the input digital image signal) is supplied to the horizontal edge detection circuit 4.

First, the vertical edge detection circuit 3 will be described. The input digital image signal from the 1H delay unit 3L is directly supplied to the weighting coefficient multiplier 5L, is supplied to the weighting coefficient multiplier 6L through the delay unit 8L having a delay time of 2τ, and the delay input digital signal from the delay unit 8L is supplied. The image signal is supplied to the weighting coefficient multiplier 7L through the delay device 9L having a delay time of 2τ. Multipliers 5L, 6L and 7
L is supplied with different weighting factors l, k, j from a CPU (control device) (not shown).

As the delay units 8L and 9L, D-type flip-flop circuits each having a sampling clock signal supplied to a clock input terminal are cascade-connected in two stages.

The outputs of the multipliers 5L, 6L and 7L are supplied to the adder 10L and added, and the added output is supplied to the binarization circuit 11L. The binarization circuit 11L has a CP
Control signal ON / OFF whether to perform binarization from U or not
And a threshold value are supplied. 2 when the control signal is ON
The binarization circuit 11L binarizes (normalizes) the addition output from the adder 10L, that is, the binarization circuit 11L outputs the maximum value when the output signal from the adder 10L exceeds a threshold value. If the threshold value is not more than the threshold value, the minimum value is output. When the control signal is OFF, the binarization circuit 11L
Causes the addition output from the adder 10L to be multivalued (3, 4, 5, ...

As shown in FIG. 4A, K is the pixel data having the input pixel signal from the 1H delay unit 3L and K is the pixel data.
If the pixel data that is advanced by 2τ is J and the pixel data that is delayed by 2τ from the pixel data is L, the multiplier 5L,
6L and 7L include synchronized pixel data L, K, J
Are supplied and multiplied by the weighting factors l, k and j shown in FIG. An edge signal 1 × L + k × K + j × J for the pixel data K is output from the adder 10L, and this is supplied to the binarization circuit 11L to obtain a binarized edge signal for the pixel data K. The weighting factors l, k, j are chosen to be l + k + j = 0.

The delay time of the delay units 8L and 9L is 2τ.
However, any number may be used as long as it is a natural number multiple of τ such as τ, 3τ, 4τ, 5τ ,.

Next, the horizontal edge detection circuit 4 will be described. The input digital image signal from the 2τ delay unit 4W is directly supplied to the weighting coefficient multiplier 5W, is supplied to the weighting coefficient multiplier 6W through the delay unit 8W having a delay time of 1H, and the delay input digital signal from the delay unit 8W is supplied. The image signal is supplied to the weighting coefficient multiplier 7W through the delay device 9W having a delay time of 1H. Multipliers 5W, 6W and 7
W is supplied with different weighting factors o, n, and m from a CPU (control device) (not shown).

The outputs of the multipliers 5W, 6W and 7W are supplied to the adder 10W and added, and the added output is supplied to the binarization circuit 11W. The binarization circuit 11W has a CP
Control signal ON / OFF whether to perform binarization from U or not
And a threshold value are supplied. 2 when the control signal is ON
The addition output from the adder 10W is binarized (normalized) by the binarization circuit 11W, that is, the maximum value is output from the binarization circuit 11W when the output signal from the adder 10W exceeds the threshold value. If the threshold value is not more than the threshold value, the minimum value is output. When the control signal is OFF, the binarization circuit 11W
Thus, the addition output from the adder 10W is multi-valued (3, 4, 5, ... Quantization) (normalization) according to the level.

As shown in FIG. 4C, the pixel data having the input pixel signal from the 2τ delay unit 4W is N, and the pixel data N is
Assuming that the pixel data leading 1H further is M and the pixel data 1H behind the pixel data N is O, a multiplier 5W,
6W and 7W include synchronized pixel data O, N, M
Is supplied and multiplied by the weighting factors o, n, and m shown in FIG. An edge signal o × O + n × N + m × M for the pixel data N is output from the adder 10W and is supplied to the binarization circuit 11W to obtain a binarized edge signal for the pixel data N. The weighting factors o, n, m are selected so that o + n + m = 0.

The delay time of the delay units 8W and 9W is 1H.
However, it is not limited to this, and any number such as 2H, 3H, 4H, 5H, ... Instead of providing the binarization circuits 11L and 11W, a binarization circuit may be provided on the output side of the adder 13.

Further, regarding the pixel data K in the vertical edge detection circuit 3 and the pixel data N in the horizontal edge detection circuit 4, the pixel data with the input digital image signal from the low pass filter 2 are both delayed by 1H + 2τ. It is the same pixel data. Therefore, when the edge detection circuit of FIG. 3 is applied to the edge detection circuit 26 of the image special effect apparatus of FIG. 1, the delay amount of the delay device 22 of the image special effect apparatus of FIG. 1 becomes 1H + 2τ.

Further, multipliers 5L, 6L, 7L; 5W, 6
W and 7W can be configured by bit shifters, and the weighting coefficient can be represented by, for example, 3 bits.

4E to 4J, weighting factors j,
Some numerical examples of k, l; m, n, and o are shown. FIG.
In (E) and (F), j = m = 1, k = n = 0, l = o
= -1. In FIGS. 4G and 4H, j = m = 2,
k = n = 0 and l = o = -2. 4 (I), (J)
Then, j = m = 1, k = n = -2, and l = o = 1.
In any of the cases of FIGS. 4E to 4J, j + k + l
It can be seen that = 0 and m + n + o = 0.

Returning to FIG. 3, the binarized outputs P and Q from the vertical edge detection circuit 3 and the horizontal edge detection circuit 4 are supplied to the coefficient multipliers 12L and 12W, respectively, and are 0.5. After being multiplied by, they are supplied to the adder 13 and added, and the edge detection output (edge signal) R is output from the output terminal 14.

The edge width can be changed by changing the cutoff frequency of the low-pass filter 2. The higher the cutoff frequency, the narrower the edge width, and the lower the width.

The 1H delay unit 3L for delay compensation is
Instead of inserting between the low-pass filter 2 and the vertical edge detection circuit 3, the adder 10L and the binarization circuit 11L
It may be inserted between the binarization circuit 11L and the coefficient multiplier 12L or between the coefficient multiplier 12L and the adder 13. Similarly, the 2τ delay device 4W for delay compensation is inserted between the adder 10W and the binarization circuit 11W instead of being inserted between the low-pass filter 2 and the lateral edge detection circuit 4.
It may be inserted between the binarization circuit 11W and the coefficient multiplier 12W or between the coefficient multiplier 12W and the adder 13.

[0035]

According to the first aspect of the present invention, the first mixer to which the input image signal indicating the input image is supplied and the output image signal from the first mixer are delayed for a predetermined time, and A first delay means for supplying the delayed output image signal to the first mixer, and an input image signal are supplied, the edge of the input image indicated by the input image signal is detected, and an edge signal indicating the edge is detected. The first mixer has an output edge detecting means and a control means for generating a mixing ratio control signal based on the edge signal from the edge detecting means, and the first mixer outputs the mixing ratio control signal from the mixing ratio control means. Since the input image signal and the delayed output image signal from the first delay means are mixed with the mixing ratio based on the above, the contour information of the input image signal is used to display the past image on the current input image. Image special effect that superimposes only contours It can be obtained device.

According to the second aspect of the present invention, in the image special effect apparatus of the first aspect of the present invention, the control means further comprises a second mixer to which the edge signal from the edge detection means is supplied,
The second mixer includes the second delay means for delaying the output signal of the second mixer by the same delay amount as the delay amount in the first delay means, so that the second mixer outputs the output signal of the second delay means. And mixing the edge signals from the edge detection means,
Since the mixing ratio control signal is generated based on the output signal of the delay means, the same effect as the effect of the first aspect of the present invention can be obtained.

According to the third aspect of the present invention, in the image special effect apparatus of the second aspect of the present invention, the control means further multiplies the output signal of the second delay means by an attenuation constant smaller than 1 and larger than 0. Since the output signal of the multiplication means is supplied to the second mixer and mixed with the edge signal, the multiplication means for generating the mixing ratio control signal is provided. In addition to the effect, by using the contour information of the input image signal, it is possible to obtain the image special effect device that superimposes only the contour of the past image on the current input image as an afterimage.

According to the fourth aspect of the invention, in the image special effect apparatus of the second aspect of the invention, the delay amounts of the first and second delay means are natural numbers times the frame period of the input image signal. Therefore, in addition to the effect of the second aspect of the present invention, an image special effect device that uses the contour information of the input image signal to superimpose only the contour of the image of the past frame on the input image of the current frame as an afterimage is obtained. be able to.

[Brief description of drawings]

FIG. 1 is a block diagram showing an image special effect device of an embodiment of the present invention.

FIG. 2 is an operation explanatory diagram of a contour afterimage effect generation of the image special effect device of the embodiment.

FIG. 3 is a block diagram showing an edge detection circuit according to an embodiment of the present invention.

FIG. 4 is an explanatory diagram of an edge detection filter according to an embodiment. (A) Pixel data used for vertical edge detection (B) Weighting coefficient used for vertical edge detection (C) Pixel data used for horizontal edge detection (D) Weighting coefficient used for horizontal edge detection (E) Vertical edge Example of weighting coefficient used for detection (F) Example of weighting coefficient used for horizontal edge detection (G) Example of weighting coefficient used for vertical edge detection (H) Example of weighting coefficient used for horizontal edge detection (I) Vertical Example of weighting coefficient used for directional edge detection (J) Example of weighting coefficient used for lateral edge detection

[Explanation of symbols]

 1 Input Terminal 2 Low Pass Filter 3 Vertical Edge Detection Circuit 3L Delay Device 4 Horizontal Edge Detection Circuit 4W Delay Device 5L to 7L Multiplier 5W to 7W Multiplier 8L, 9L Delay Device 8W, 9W Delay Device 10L Adder 10W Adder 11L Binarization Circuit 11W Binarization Circuit 12L Coefficient Multiplier 12W Coefficient Multiplier 13 Adder 14 Output Terminal 20 Input Terminal 21 Afterimage Effect Generating Circuit 22 Delayer 23 Mixer (Mixer) 24 Frame Memory (Delay Means) 25 Output Terminal 26 Edge Detection Circuit 27 NAM 28 Frame Memory (Delay Means) 29 Attenuation Coefficient Multiplier

Claims (6)

[Claims] 1. A first mixer to which an input image signal indicating an input image is supplied, an output image signal from the first mixer is delayed for a predetermined time, and the delayed output image signal is output to the first mixer. First delay means for supplying the mixer to the first mixer, edge detecting means for supplying the input image signal, detecting an edge of the input image indicated by the input image signal, and outputting an edge signal indicating the edge, Control means for generating a mixing ratio control signal based on the edge signal from the edge detecting means, wherein the first mixer has a mixing ratio based on the mixing ratio control signal from the mixing ratio control means, An image special effect device, characterized in that the input image signal and the output image signal delayed by the first delay means are mixed. 2. The image special effect apparatus according to claim 1, wherein the control means further includes a second mixer to which an edge signal from the edge detection means is supplied, and the second mixer. Second delay means for delaying the output signal by the same delay amount as the delay amount in the first delay means, wherein the second mixer comprises the output signal of the second delay means and the edge detection means. The image special effect device is characterized in that the edge ratio signals are mixed and the mixing ratio control signal is generated based on the output signal of the second delay means. 3. The image special effect device according to claim 2, wherein said control means further multiplies an output signal of said second delay means by an attenuation constant smaller than 1 and larger than 0, and said mixing ratio. An image special effect device comprising: a multiplication means for generating a control signal, wherein an output signal of the multiplication means is supplied to the second mixer and mixed with the edge signal. 4. The image special effect device according to claim 3, wherein the second mixer is a non-additive adder. 5. The image special effect device according to claim 2, wherein the delay amounts of the first and second delay means are a natural multiple of the frame period of the input image signal. Image special effect device. 6. The image special effect device according to claim 3, wherein the edge detection unit sets a value of 1 in a period corresponding to an edge of the input image to 0 in a period other than a period corresponding to the edge.
An image special effect device, which outputs an edge signal having a value of.