CN101540055B - Cartoon stylization method facing online real-time application - Google Patents

Abstract

The invention discloses a cartoon stylization method facing online real-time application. The method comprises the following steps of: utilizing iterative bidirectional filtering to carry out edge sharpening processing to an image; on the processing result of iterative bidirectional filtering, using the real time implementation of a Gauss-Laplace method to carry out edge detection so as to obtain sketch effect; carrying out quantization on the processing result of iterative bidirectional filtering so as to obtain oil paint effect; and carrying out combination to the results of edge detection and quantization so as to obtain cartoon effect. Compared with the traditional method, the cartoon stylization method can obtain faster speed and better visual effect, obtain good effect to the face and scenery in application occasions with high real-time requirement, such as video chat, games and the like, and expand the application field of video cartoon stylization.

Description

Cartoon stylization method towards online real-time application

Technical field

The present invention relates to real-time multimedia treatment technology, particularly relate to a kind of cartoon stylization method towards online real-time application.

Background technology

At present, various stylized special efficacys are applied to Online Video chat occasion, strengthen the image of entertainment effect or change oneself.Such special efficacy has had some realizations in the middle of the USB webcam driver of the MSN of Microsoft Messenger, sieve skill.Is the abstract method for cartoon, animation style of reality one of stylized system, is commonly called cartoon styleization.It has attracted to pay close attention to widely recently.

The application scenario of cartoon style system is divided into two classes, and a class is to handle the cartoon style system of static images, and another kind of is the cartoon style system that handles video.For the cartoon style system of traditional processing static images, they are very low to the requirement of real-time, so they are not suitable for video is handled in real time.And for the cartoon style system of in the past processing video, there are two problems.One is that travelling speed is still slower, is not suitable for the application that real-times such as Online Video chat are had relatively high expectations; Another is because the edge detection results of successive frame differs greatly, and causes visual effect undesirable.

As previously mentioned, because the Online Video chat is had higher requirement to the real-time of cartoon style system, therefore need carry out processing such as edge sharpening, rim detection and quantification at image and improve, thereby obtain faster speed and better visual effect.

Summary of the invention

Carry out problems such as edge sharpening, rim detection and quantification treatment in order to solve image, the object of the present invention is to provide a kind of cartoon stylization method towards online real-time application.

The technical solution used in the present invention is:

(1) utilizing iterative bidirectional filtering that image is carried out edge sharpening handles;

(2) on processing result of iterative bidirectional filtering, use the real time implementation of Gauss-Laplace method to realize carrying out rim detection, to obtain sketch effect;

(3) on processing result of iterative bidirectional filtering, quantize, to obtain oil paint effect;

(4) result with rim detection and color quantizing carries out combination, to obtain cartoon effect.

The beneficial effect that the present invention has is:

At first, improved edge detection algorithm speed is fast, and the visual effect in successive frame surpassed the edge detection method that other use fixed thresholds, such as the Canny operator.Secondly, in cataloged procedure, marginal date is separated with quantized data, thereby improved code efficiency, reduce code check.At last, based on the real-time video stylization, the present invention is suitable for the application of high real-time requirement.

In the process of video stylization, rim detection is the highest part of computation complexity.In this step, process of the present invention has adopted improving one's methods based on Gauss-Laplce.Except edge detection method faster, the present invention adopts the mode of tabling look-up to obtain filter factor and quantized value in prolonging nonlinear diffusion and color quantizing process.This processing mode can be avoided calculating Gauss equation into each pixel, thereby further accelerates the speed of whole stylizing method.

Description of drawings

Accompanying drawing is treatment effect figure of the present invention.

Embodiment

The present invention includes following four big steps, as shown in drawings:

(1) utilizing iterative bidirectional filtering that image is carried out edge sharpening handles;

(2) on processing result of iterative bidirectional filtering, use the real time implementation of Gauss-Laplace method to realize carrying out rim detection, to obtain sketch effect;

(3) on processing result of iterative bidirectional filtering, quantize, to obtain oil paint effect;

(4) result with rim detection and color quantizing carries out combination, to obtain cartoon effect.

Concrete steps are as follows:

In the image the higher fringe region of contrast by sharpening, and lower regional smoothed of contrast; On the one-dimensional space, bidirectional filtering can be represented with following formula:

$r_0=\frac{\underset{|x-x_0|<=s}{\mathrm{\&Sigma;}}f(x,x_0)\&CenterDot;I\left(p_0\right)}{\underset{|x-x_0|<=s}{\mathrm{\&Sigma;}}f(x,x_0)}---\left(1\right)$

X wherein ₀Be central point p ₀Ordinate or horizontal ordinate, x is the ordinate or the horizontal ordinate of point in the filter window around the central point, s is the distance of central point to the filter window edge, I (p ₀) be p ₀Gray-scale value, r ₀Be p ₀The filtering result; F (x, x ₀) be p ₀Bidirectional filter on every side is defined as:

f(x，x ₀)＝g _s(x-x ₀，σ _s)·g _t(I(p)-I(p ₀)，σ _t)(2)

σ wherein _sAnd σ _tBe the space and the tone ratio of bidirectional filtering;

g _sAnd g _tBe important space and tone weight coefficient, be defined as by Gauss equation:

$g(t,\mathrm{\&sigma;})=\frac{1}{\mathrm{\&sigma;}\sqrt{2\mathrm{\&pi;}}}{e}^{\frac{-t^2}{2{\mathrm{\&sigma;}}^2}}---\left(3\right)$

The one dimension bidirectional filtering is applied on first dimension space; Intermediate result is carried out filtering on second dimension space, can reduce computation complexity greatly like this.

Consider the parameter in formula (1) and (2), the field of definition of input parameter is:

$\left\{\begin{array}{c}|x-x_0|\&le;s\\ |I\left(p\right)-I\left(p_0\right)|\&le;255\end{array}\right.---\left(4\right)$

The filter window size is set to 9 * 9; Therefore two-dimensional array of initialization has wherein been preserved all possible corresponding filtering result according to input parameter; The size of array is 4 * 256; Only need obtain in the array when then image being carried out filtering operation | x-x ₀| row, the | I (p)-I (p ₀) | the data of row.

2. utilize the circulation symmetry characteristic of Gauss-Laplace's equation, made the size of question blank control within the acceptable range;

Discrete Gauss-Laplce's mask is defined as:

$D(x,y,{\mathrm{\&sigma;}}_d)=(1-k\&CenterDot;\frac{x^2+y^2}{{{\mathrm{\&sigma;}}_d}^2})e^{\frac{x^2+y^2}{2\&CenterDot;{{\mathrm{\&sigma;}}_d}^2}}---\left(5\right)$

Wherein k to make the mask coefficient and approach 0, promptly k satisfies:

$\underset{x=-\frac{N-1}{2}}{\overset{\frac{N-1}{2}}{\mathrm{\&Sigma;}}}\underset{y=-\frac{N-1}{2}}{\overset{\frac{N-1}{2}}{\mathrm{\&Sigma;}}}(1-k\&CenterDot;\frac{x^2+y^2}{{{\mathrm{\&sigma;}}_d}^2})e^{\frac{x^2+y^2}{2\&CenterDot;{{\mathrm{\&sigma;}}_d}^2}}=0---\left(6\right)$

Because the circulation symmetry characteristic of Gauss-Laplace's equation, the coefficient array of mask can be represented with table 1; W (i) represents Gauss-Laplce's mask numerical value; The size of this array is:

$T=(\frac{N+1}{2}+(\frac{N+1}{2}-1)+...+1)=\frac{(N+1)(N+3)}{8}---\left(7\right)$

Therefore the question blank of Gauss-Laplce's mask can be expressed as:

LUT[i][j]＝w(i)×j (8)

Wherein i is the position of mask, and j is the gray-scale value that will carry out the point of Gauss-Laplce's mask.The field of definition of i and j can be expressed as:

$\left\{\begin{array}{c}0\&le;i\&le;\frac{(N+1)(N+3)}{8}\\ 0\&le;j\&le;255\end{array}\right.---\left(9\right)$

3. the conventional quantization method has been carried out the lifting on the speed.Quantizing equation is defined as:

Q wherein _ClosestBe to approach p most ₀The quantification edge of gray-scale value, Δ q is a quantization width,

It is the parameter of the sharp-pointed degree in control edge;

Similar with bidirectional filtering, quantizing the unique parameter of equation is I (p ₀); Field of definition is:

0≤I(p ₀)≤255(11)

Therefore one-dimension array of initialization is preserved all possible quantized result; The size of this array is 256; By simply obtaining I (p in the array ₀) individual value obtains a p immediately ₀Quantized value.

4. 2 and 3 result is carried out combination: rim detection is the position that has the edge, and then the value of capture vegetarian refreshments is 0; Otherwise the value of capture vegetarian refreshments is color quantizing result's a value.

Claims (2)

1. cartoon stylization method towards online real-time application is characterized in that:

(1) utilizing iterative bidirectional filtering that image is carried out edge sharpening handles;

(2) on processing result of iterative bidirectional filtering, use the real time implementation of Gauss's one Laplace method to realize carrying out rim detection, to obtain sketch effect;

(3) on processing result of iterative bidirectional filtering, quantize, to obtain oil paint effect;

(4) result with rim detection and color quantizing carries out combination, to obtain cartoon effect;

The fringe region that contrast is high in the image in the described step (1) is by sharpening, and low regional smoothed of contrast; On the one-dimensional space, bidirectional filtering is represented with following formula:

$r_0=\frac{\underset{|x-x_0|<=s}{\mathrm{\&Sigma;}}f(x,x_0)\&CenterDot;I\left(p_0\right)}{\underset{|x-x_0|<=s}{\mathrm{\&Sigma;}}f(x,x_0)}---\left(1\right)$

Wherein: x ₀Be central point p ₀Ordinate or horizontal ordinate, x is the ordinate or the horizontal ordinate of point in the filter window around the central point, s is the distance of central point to the filter window edge, I (p ₀) be p ₀Gray-scale value, r ₀Be p ₀The filtering result; F (x, x ₀) be p ₀Bidirectional filter on every side is defined as:

f(x，x ₀)＝g _s(x-x ₀，σ _s)·g _t(I(p)-I(p ₀)，σ _t) (2)

Wherein: σ _sAnd σ _tBe the space and the tone ratio of bidirectional filtering;

g _sAnd g _tBe important space and tone weight coefficient, be defined as by Gauss equation:

$(t,\mathrm{\&sigma;})\frac{1}{\mathrm{\&sigma;}\sqrt{2\mathrm{\&pi;}}}{e}^{\frac{-t^2}{2{\mathrm{\&sigma;}}^2}}---\left(3\right)$

The one dimension bidirectional filtering is applied on first dimension space; Intermediate result is carried out filtering on second dimension space, can reduce computation complexity greatly like this;

Consider the parameter in formula (1) and (2), the field of definition of input parameter is:

$\left\{\begin{array}{c}|x-x_0|\&le;s\\ |I\left(p\right)-I\left(p_0\right)|\&le;255\end{array}\right.---\left(4\right)$

The filter window size is set to 9 * 9; Therefore two-dimensional array of initialization has wherein been preserved all possible corresponding filtering result according to input parameter; The size of array is 4 * 256; Only need obtain in the array when then image being carried out filtering operation | x-x ₀| row, the | I (p)-I (p ₀) | the data of row.

2. a kind of cartoon stylization method towards online real-time application according to claim 1 is characterized in that: the quantization method in the described step (3) has carried out the lifting on the speed; Quantizing equation is defined as:

Q wherein _ClosestBe to approach p most ₀The quantification edge of gray-scale value, Δ q is a quantization width,

It is the parameter of the sharp-pointed degree in control edge;

Similar with bidirectional filtering, quantizing the unique parameter of equation is I (p ₀); Field of definition is:

0≤I(p ₀)≤255

Therefore one-dimension array of initialization is preserved all possible quantized result; The size of this array is 256; By simply obtaining I (p in the array ₀) individual value obtains a p immediately ₀Quantized value.

Images