CN103745444B - Based on the non-photorealistic image rendering intent of topological tree - Google Patents

Based on the non-photorealistic image rendering intent of topological tree Download PDF

Info

Publication number
CN103745444B
CN103745444B CN201410027475.XA CN201410027475A CN103745444B CN 103745444 B CN103745444 B CN 103745444B CN 201410027475 A CN201410027475 A CN 201410027475A CN 103745444 B CN103745444 B CN 103745444B
Authority
CN
China
Prior art keywords
shape
image
tree
topology tree
rendering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410027475.XA
Other languages
Chinese (zh)
Other versions
CN103745444A (en
Inventor
夏桂松
刘钢
胡凡
张良培
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan University WHU
Original Assignee
Wuhan University WHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan University WHU filed Critical Wuhan University WHU
Priority to CN201410027475.XA priority Critical patent/CN103745444B/en
Publication of CN103745444A publication Critical patent/CN103745444A/en
Application granted granted Critical
Publication of CN103745444B publication Critical patent/CN103745444B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of non-photorealistic image rendering intent based on topological tree, comprise step: step 1, the shape topological tree of setting up original image is expressed; Step 2, according to the shape attribute of shape each in shape topological tree, keeps shape topological tree Structure, deletes the shape that shape attribute does not meet threshold requirement; Step 3, by modifying to realize image rendering and reconstruct to shape in shape topological tree.The shape topological tree that the present invention is based on image is expressed, and modifies, to reach the object that non-photorealistic image is played up, and under the prerequisite of not losing image information, greatly can improve rendering efficiency to image basic comprising unit.

Description

Non-photorealistic image rendering method based on topology tree
Technical Field
The invention belongs to the field of image processing, and particularly relates to a non-photorealistic image rendering method based on a topological tree.
Background
Image Non-photorealistic rendering (NPR), in turn, is translated into Non-photorealistic rendering or stylistic rendering (stylistic rendering), which refers to the generation of Non-photorealistic, but hand-drawn, image technologies using computers. It originated from an interactive painting and mapping system that created digitized images by gradually adding artistic brush effects to the images. It is not aimed at the realism of the figures, but mainly at representing the artistic quality of the figures, simulating the works of art (even including defects in the works) or as an effective complement to the realistic figures. Non-photorealistic rendering does not pursue complete photorealism, the main objective being to represent an object in a concise, inclusive, aesthetically pleasing manner.
Research on non-photorealistic rendering of images has been a hot topic, and many researchers are working on automatic rendering and modification based on strokes[1]~[6]. Most of these efforts rely on basic image analysis, i.e. full or partial structural representation of the image, such as edge detection[1]Linear scale space[6]Region extraction[2]Table of significance[4]Laplacian pyramid[3]And the like.
Most of the existing image non-photorealistic rendering needs to process images through a specific painting model, and is inconvenient. If a model can be used to obtain different non-photorealistic rendering effects by only modifying a small number of parameters or processes, the image processing efficiency can be greatly improved
The relevant references are:
[1]ThomasStrothotteandStefanSchlechtweg,Non-PhotorealisticComputerGraphics:Modeling,Rendering,andAnimation.MorganKaufmannPublishersInc.,SanFrancisco,CA,USA,2002.
[2]P.Litinowicz,Processingimagesandvideoforanimpressionisteffect.InProc.ofSIGGRAPH’97,pp.407-414,1997.
[3]G.C.P.S.B.Gooch,Artisticvision:painterlyrenderingusingcomputervisiontechniques.InProc.ofNPAR,pp.83-90,2002.
[4]S.Brooks,Mixedmediapaintingandportraiture.IEEETrans.VisualizationandComputerGraphics,Vol.12,No.5,pp.1041-1054,2007.
[5]J.P.C.a.P.M.Hall,Painterlyrenderingusingimagesalience.InProc.ofEurographicsUKConference,p.122–128,2002.
[6]A.Hertzmann,PaintByRelaxation.InProc.ofInternationalConferenceonComputerGraphics,2001.
[7]A.Hertzmann,Painterlyrenderingwithcurvedbushstrokesofmultiplesizes.InProc.ofSIGGRAPH'98,pp.453-460,1988.
disclosure of Invention
Aiming at the defects in the prior art, the invention provides a topological tree-based non-photorealistic image rendering method which can greatly improve rendering efficiency.
In order to solve the technical problems, the invention adopts the following technical scheme:
a topological tree based non-photorealistic image rendering method comprises the following steps:
step 1, establishing a shape topological tree expression of an original image;
step 2, according to the shape attribute of each shape in the shape topological tree, maintaining the shape topological tree structure, and deleting the shape of which the shape attribute does not meet the requirement of a threshold value;
and 3, modifying the shape in the shape topology tree to realize image rendering and reconstruction.
Step 1 further comprises the sub-steps of:
1.1, converting an original color image into an HSV image, and taking an illumination intensity channel of the HSV image;
1.2 according to the illumination intensity level of the HSV image, acquiring a basic constitutional unit, namely a shape, of the image by adopting a level set algorithm;
1.3, representing each shape by adopting a cascade structure, establishing a shape topological tree expression, wherein the nodes of the shape topological tree represent the shapes, the shape represented by a father node comprises the shape represented by a child node in an image space, and a root node represents the whole image.
The step 1.2 is specifically as follows:
defining a level set according to the illumination intensity level of the HSV image, wherein the level set is a level set binary image which comprises one or more independent holes, and filling the holes with pixels corresponding to the positions of the original color image to obtain independent shapes; and continuously increasing the illumination intensity value, and obtaining the corresponding independent shape by adopting a level set algorithm.
And step 1.3, combining the shapes corresponding to the illumination intensities into a cascade tree structure according to the illumination intensity sequence.
And step 1.3, establishing the shape topological tree expression by adopting a rapid level set transformation method.
The shape attribute described in step 2 includes a shape aspect ratioWherein λ is1And λ2Is the eigenvalue of the second order inertia matrix of shape, and1>λ2deleting ∈ the aspect ratio in the shape topology tree is not less than the aspect ratio threshold0The shape of (2).
The shape attribute in the step 2 comprises the shape area, namely the sum of pixels in the shape, and the area in the deleted shape topological tree is not more than an area threshold A0The shape of (2).
The shape attribute described in step 2 includes the compactness of the shapeWherein, A (S)i) Is the area of the shape, λ1And λ2Is the eigenvalue of the second order inertia matrix of shape, and1>λ2deleting the shape topology tree with a compactness not greater than a compactness threshold k0The shape of (2).
The shape attribute described in step 2 includes a shape-to-scale ratioWherein, A (S)i) Is the area of the shape, Si rIndicates the shape SiThe r level ancestor shape in the shape topological tree, M is the self-defined series range, the scale ratio in the deleted shape topological tree is not more than the scale ratio threshold α0The shape of (2).
The first specific scheme of the step 3 further comprises the following substeps:
3.1 maintaining the relative structure of the shape topology tree, adopting the main shaft deflection angle theta (S) of each shapei) The shape of the rotation, wherein,(x, y) is the pixel coordinates in the shape;is the shape center position index;
3.2, giving a shape s, and respectively adjusting the shape attribute of the shape s aiming at each shape in the shape topological tree to ensure that the difference between the shape attribute of the shape s and the shape attribute of the shape in the shape topological tree is minimum;
3.3 for each shape in the shape topology tree, counting the average value of the colors of all pixels in the shape in the original color image, and filling the corresponding pixels in the shape by using the average value of the colors; replacing each shape in the shape topology tree by the new shape s to obtain an updated shape topology tree;
3.4 reconstructing the image based on the updated shape topology tree to obtain a shape rendered image.
The second embodiment of step 3 further comprises the substeps of:
3.1 for shape S in shape topology TreeiRespectively calculating the principal axis deflection angle theta (S)i): θ ( S i ) = tan - 1 ∫ S i ( y - y ‾ ) dx ∫ S i ( x - x ‾ ) dy , And produce a series of satisfaction ( Δx λ 1 ) 2 + ( Δy λ 2 ) 2 ≤ ρ Of (a) is given, wherein1And λ2Is the eigenvalue of the second order inertia matrix of shape, and1>λ2(ii) a ρ is the custom oscillation amplitude;
3.2 generating the shape s from each set of variables (Δ x, Δ y)i' { (x + Δ x, y + Δ y) }, and for shape siCarrying out random rotation and position processing to obtain a processed shape;
3.3 all processed shapes and shapes S in the shape topology TreeiSuperposing to obtain the shape si″;
3.4, processing all shapes in the shape topology tree by steps 3.1-3.3 respectively to obtain a modified shape topology tree;
and 3.5, reconstructing the image based on the modified shape topology tree to obtain an oil painting rendering image.
The third embodiment of step 3 further comprises the substeps of:
3.1 for shape S in shape topology TreeiRespectively counting the shape SiThe number of pixels in a rectangular window with the scale of (2t +1) and each pixel as the center;
3.2 judging the number of pixels in the rectangular window and the area of the rectangular window, and if the number of pixels in the rectangular window is smaller than the area of the rectangular window, giving up the central pixel of the rectangular window;
3.3 pairs of shapes SiAll the pixels in the image are processed in steps 3.1-3.2, and the shape SiTransformation to new shape si′;
3.4, respectively completing the steps 3.1-3.3 for each shape in the shape topology tree to obtain a modified shape topology tree, and reconstructing an image based on the modified shape topology tree to obtain a fuzzy rendering image.
Compared with the prior art, the invention has the following characteristics:
1. and constructing an image geometric structure based on the shape topological tree expression, namely expressing an image through the cascade connection or the inclusion relation of the shapes, and recovering the original image based on the shape topological tree.
2. And directly modifying, resetting, replacing and the like the shape in the shape topology tree to obtain the modified shape topology tree, and restoring the modified shape topology tree to realize image rendering.
3. And replacing the shape in the shape topology tree by using the new shape to obtain a modified shape topology tree, and restoring the modified shape topology tree to realize image rendering.
4. The topological tree expression is a complete expression, so that any information of the image is not lost, and the topological tree expression can adapt to any subtle operation of the image; in addition, the topology tree expression is a multi-scale expression and can provide multi-scale analysis of the image, the topology tree is a simple cascading relation tree of shapes, so that the image rendering operation can be converted into a simple modification operation of the shapes, and fig. 1 is a result of performing shape replacement on an original image.
Drawings
FIG. 1 is an example of image rendering, where graph (a) is an original color image, graph (b) is a circle rendered image, graph (c) is a line rendered image, and graph (d) is a dictionary-shaped rendered image;
FIG. 2 is an example of geometric rendering of an image, where graph (a) is an original color image, graph (b) is a circle rendered image, graph (c) is a line rendered image, and graph (d) is a dictionary-shaped rendered image;
FIG. 3 is an example of ink rendering of an image, where (a) and (c) are original color images and (b) and (d) are rendered images of a canvas;
fig. 4 is an example of watercolor rendering of an image, where fig. (a) and (c) are original color images, and fig. (b) and (d) are watercolor rendered images.
Detailed Description
The technical solution of the present invention will be further explained with reference to the accompanying drawings and the detailed description.
Step 1, establishing a shape topological tree expression of an image.
This step is well known in the art. The specific implementation method comprises the following steps:
for a given color image I, convert it into HSV image I1And taking an HSV image illumination intensity channel, calculating a topological tree structure based on a level set algorithm, and establishing a shape topological tree expression of the image.
The level set is defined as:
χl(Il)={p∈Ω;Il(p)≥l}
(1)
χl(Il)={p∈Ω;Il(p)≤l}
wherein, χl(Il) Representing an image I1The upper level set of (a); chi shapel(Il) Representing an image I1Omega is the image space, p is the image pixel point index, L ∈ [ 1., L]Representing increasing image illumination intensity levels.
The level set may be considered as a binary image, i.e. comprising parts belonging to the level or parts not belonging to the level. The level set binary image contains one or more individual holes that represent pixels outside the level set. The holes are filled with pixels corresponding to the positions of the holes in the original image I, so that independent shapes can be obtained, and the shapes are basic constitutional units of the image. By increasing the value of the illumination intensity l, a corresponding level set, i.e. a corresponding shape, can be obtained. Combining the shapes into a tree structure according to the sequence of the corresponding illumination intensity, and obtaining the shape topology tree T ═ S (S) of the imagei)i=1,...,NWherein S isiIs an independent shape, i is the shape index and N is the total number of shapes.
The obtained shape topology tree includes all information of the image in the independent shape SiAnd will be independent of shape SiRepresented by a cascade structure. Specifically, all shapes obtained from all level sets form a cascaded shape topology tree according to the size and the inclusion relationship, wherein each node represents a shape, the shape represented by a parent node spatially contains the shape represented by a child node, and the root node represents the whole image. In addition, the shape topology tree can be obtained by directly using Fast Level Set Transformation (FLST) algorithm, which is not described herein.
For HSV image I1Topology tree structure of (S) ═ Si)i=1,...,NTo shape SiRespectively averaging RGB three-channel colors of all the contained pixels to obtain the shape SiColor index c ofi∈R3Shape SiAdding color information of (to) the topology tree structure T ═ Si)i=1,...,NObtaining a final shape topology tree T ═ (S)i,ci)i=1,...,N
And 2, selecting the shape.
For shape SiThe shape S is defined by { (x, y); (x, y ∈ Ω) }iOrder of (p + q) of (u)pq(Si):
μ pq ( S i ) = ∫ ∫ S i ( x - x ‾ ) p ( y - y ‾ ) q dxdy - - - ( 2 )
Wherein (x, y) is the shape SiA middle pixel coordinate; Ω is the image space; p and q are the norm of x and y, respectively;indicates the shape SiThe position index of the center, i.e., the center of gravity.
x ‾ = 1 μ 00 ( S i ) ∫ ∫ S i xdxdy - - - ( 3 )
y ‾ = 1 μ 00 ( S i ) ∫ ∫ S i ydxdy - - - ( 4 )
In formulae (3) to (4), μ00(Si) Is in the shape Si0 order of moment, i.e. shape SiIs defined as the shape SiTotal number of middle pixels.
Considering the stability and invariance of the shape, the second moment of the shape has the strongest representation meaning and is the most stable, so the invention utilizes the characteristic value lambda of the second-order inertia matrix C(s) of the shape1And λ2Shape selection is made, and1>λ2
C ( s ) = μ 20 ( s ) μ 11 ( s ) μ 11 ( s ) μ 02 ( s ) - - - ( 5 )
shape selection is to select important and representative shapes in the shape topology tree and remove the miscellaneous points in the image. Shape attributes are defined by classifying shapes as meaningful and meaningless according to their attributes:
aspect ratioArea A (S)i)=μ00(Si) Compactness degreeRatio of sum to sizeWherein S isi rIndicates the shape SiAnd (4) in the topology tree, the shape of the ancestors at the r-th layer, and M is a self-defined series range.
Among the above shape attributes, aspect ratio ∈ (S)i) Define the shape SiA larger aspect ratio indicates a flatter shape, and a smaller aspect ratio indicates a rounder shape; area A (S)i) Define the shape SiSize; compactness kappa (S)i) Define the shape SiConcentration of medium pixels, larger compactness indicates more irregular shape, smaller compactness indicates more round shape, and scale ratio α (S)i) Define the shape SiIn relation to the shape of its parent node, a larger scale ratio indicates the shape SiThe larger the difference from the upper shape, the smaller the scale ratio indicates the shape SiThe smaller the difference in shape from the upper layer.
For all shapes in the shape topology tree, respectively judging whether each shape should be reserved based on the shape attribute:
(1) if shape SiAspect ratio ∈ (S)i)<∈0Then the shape S is retainediI.e. keeping the aspect ratio less than the aspect ratio threshold ∈0The shape of (a);
(2) if shape SiArea A (S) ofi)>A0Then the shape S is retainediI.e. the remaining area is greater than the area threshold A0The shape of (a);
(3) if shape SiIs of (a) is ofi)>κ0Then the shape S is retainediI.e. keeping the compactness larger than the compactness threshold k0The shape of (a);
(4) if shape SiScale ratio of α (S)i)>α0Then the shape S is retainediI.e. keeping the scaling ratio greater than the scaling ratio threshold α0The shape of (2).
And (4) judging whether each shape in the shape topology tree is reserved or not by adopting one or more judgment modes in the (1) to (4). The shape attribute threshold values such as the aspect ratio threshold value, the area threshold value, the compactness threshold value, and the scale ratio threshold value are set empirically and manually.
And 3, rendering and reconstructing the image.
And after the shape selection step is completed on the shape topology tree, obtaining a shape topology tree T ', and the step achieves the aim of image rendering by modifying the shape topology tree T'. The invention provides three image rendering schemes, including geometric redrawing of images, oil redrawing of images and fuzzy redrawing of images. The three image rendering schemes are explained below.
(1) Geometric redrawing of images
The geometric redrawing of the image is to replace the shape in the shape topology tree T' with a shape with a similar structure, which is realized by giving a shape s (such as an ellipse, a line or a dictionary shape) and performing the following operations:
(a) the shape is biased.
Keeping the cascade relation among all shapes in the shape topological tree unchanged, and keeping the shape S in the shape topological treeiCalculating the principal axis deflection angle theta (S) by using the following formulai):
θ ( S i ) = tan - 1 ∫ S i ( y - y ‾ ) dx ∫ S i ( x - x ‾ ) dy - - - ( 6 )
In the formula (6), (x, y) is the shape SiA middle pixel coordinate;indicates the shape SiThe position index of the center can be obtained by calculation using equations (3) and (4).
Using the main shaft deflection angle theta (S)i) Rotation shape SiThe method specifically comprises the following steps: shape SiEach pixel in (1) is multiplied by a rotation variation matrix, in this embodiment M ( θ ) = cos θ ( S I ) - sin θ ( S I ) sin θ ( S I ) cos θ ( S I ) .
(b) And (4) geometric transformation.
Keeping the relative structure of the shape topology tree unchanged, for each shape S in the shape topology treeiRespectively calculating the areas A (S)i) Aspect ratio ∈ (S)i) And compactness kappa (S)i). Adjusting the area, aspect ratio and compactness of the shape S to match the shape S with the shape SiMost similar, namely D (S, S) in the formulai) Minimum:
D(s,Si)=|∈(Si)-∈(s)|+|κ(Sii)-κ(s)|+|A(Si)-A(S)|(7)
the shape S and the shape S are defined in the formula (7)iSimilarity D (S, S)i)。
(c) And (6) color correction.
Keeping the relative structure of the shape topology tree unchanged, for each shape S in the shape topology treeiRespectively calculate the colors (S) thereofi,ci). The specific method comprises the following steps: for shape SiRespectively counting the average value of RGB three-channel colors in the original image I, and utilizing the color average value of each pixel to calculate the shape SiFilling corresponding pixels in the pixel array; obtaining the shape S by the method in step (b)iThe most similar shape S, each shape S in the shape topology tree TiThe replacement with the shape s results in an updated shape topology tree T ".
(d) And (5) image reconstruction.
And reconstructing the rendered image based on the shape topology tree T', and realizing image reconstruction by directly using a recovery algorithm provided by the MegaWave library, which is not described herein any more. The final experimental effect is shown in fig. 2.
(2) Redrawing of oil painting
The oil painting redrawing of the image is to render the digital image into an image with oil painting style. The invention provides a shape dithering method, which generates a large amount of redundant information through shape dithering and generates an oscillation boundary to obtain a fuzzy oil painting effect, and comprises the following specific steps:
(a) for each shape S in the shape topology treeiCalculating the principal axis deflection angle theta (S) by respectively adopting the formula (6)i) And produce a series of satisfactionOf (a) is given, wherein1And λ2Respectively, the characteristic values of the shape second-order inertia matrix, wherein rho is self-defined oscillation amplitude, and the bigger rho is, the stronger the oscillation effect is, and the more fuzzy the generated image is.
Using the main shaft deflection angle theta (S)i) Rotational variables (Δ x, Δ y), such that (Δ x, Δ y)T=M(θ(Si))(Δx,Δy)TWherein M ( θ ( S i ) ) = cos θ ( S i ) - sin θ ( S i ) sin θ ( S i ) cos θ ( S i ) .
(b) generating a new shape s for each set of variables (Δ x, Δ y)i' { (x + Δ x, y + Δ y) }, (x, y) is the shape S on the shape topology treeiA middle pixel; shape si' random rotation and location processing, i.e. shape si' randomly deflect an angle and randomly shift a position.
(c) The average of all new shapes is compared to the original shape SiOverlapping to obtain final shape si″。
(d) And (c) respectively processing all shapes in the shape topology tree in the steps (a) to (c), obtaining the modified shape topology tree, and recovering the rendered image from the modified shape topology tree by directly using a recovery algorithm provided by a MegaWave library. The effect of the best test is shown in FIG. 3.
(3) Blurred redrawing of images
The image fuzzy redrawing is to carry out fuzzy processing on the digital image to generate an image with a watercolor effect. The invention provides an image fuzzy redrawing method based on shape median filtering, which comprises the following steps:
(a) given a median filtering scale (2t +1), S is applied to each shape in the shape topology treeiFor shape S { (x, y) }iAll the contained pixel points (x)k,yk) And respectively counting the number of pixels in a rectangular window with the scale of (2t +1) and each pixel point as the center.
(b) And if the number of pixels in the rectangular window is less than half of the area of the rectangular window, discarding the central pixel of the rectangular window.
(c) For shape SiAfter all the pixels in the shape S have completed steps (a) - (b)iTransformation to new shape si′。
(d) And (4) respectively completing the steps (a) to (c) for each shape in the shape topology tree to obtain a modified shape topology tree, and directly recovering the rendered image from the modified shape topology tree by using a recovery algorithm provided by a MegaWave library. The effect of the best test is shown in FIG. 4.

Claims (9)

1. The non-photorealistic image rendering method based on the topology tree is characterized by comprising the following steps of:
step 1, establishing a shape topological tree expression of an original image;
step 2, according to the shape attribute of each shape in the shape topological tree, maintaining the shape topological tree structure, and deleting the shape of which the shape attribute does not meet the requirement of a threshold value;
step 3, modifying the shape in the shape topology tree to realize image rendering and reconstruction;
step 3 further comprises the sub-steps of:
3.1 maintaining the relative structure of the shape topology tree, adopting the main shaft deflection angle theta (S) of each shapei) The shape of the rotation, wherein,(x, y) is the pixel coordinates in the shape;is the shape center position index;
3.2, giving a shape s, and respectively adjusting the shape attribute of the shape s aiming at each shape in the shape topological tree to ensure that the difference between the shape attribute of the shape s and the shape attribute of the shape in the shape topological tree is minimum;
3.3 for each shape in the shape topology tree, counting the average value of the colors of all pixels in the shape in the original color image, and filling the corresponding pixels in the shape by using the average value of the colors; replacing each shape in the shape topology tree by the new shape s to obtain an updated shape topology tree;
3.4 reconstructing the image based on the updated shape topology tree to obtain a shape rendered image.
2. The non-photorealistic image rendering method based on the topology tree is characterized by comprising the following steps of:
step 1, establishing a shape topological tree expression of an original image;
step 2, according to the shape attribute of each shape in the shape topological tree, maintaining the shape topological tree structure, and deleting the shape of which the shape attribute does not meet the requirement of a threshold value;
step 3, modifying the shape in the shape topology tree to realize image rendering and reconstruction;
step 3 further comprises the sub-steps of:
3.1 for shape S in shape topology TreeiRespectively calculating the principal axis deflection angle theta (S)i): θ ( S i ) = tan - 1 ∫ S i ( y - y ‾ ) d x ∫ S i ( x - x ‾ ) d y , And produce a series of satisfaction ( Δ x λ 1 ) 2 + ( Δ y λ 2 ) 2 ≤ ρ Of (a) is given, wherein1And λ2Is the eigenvalue of the second order inertia matrix of shape, and1>λ2(ii) a ρ is the custom oscillation amplitude;
3.2 root of Chinese AraliaGenerating the shape s from each set of variables (Δ x, Δ y)i' { (x + Δ x, y + Δ y) }, and for shape siCarrying out random rotation and position processing to obtain a processed shape;
3.3 all processed shapes and shapes S in the shape topology TreeiSuperposing to obtain the shape si”;
3.4, processing all shapes in the shape topology tree by steps 3.1-3.3 respectively to obtain a modified shape topology tree;
and 3.5, reconstructing the image based on the modified shape topology tree to obtain an oil painting rendering image.
3. The non-photorealistic image rendering method based on the topology tree is characterized by comprising the following steps of:
step 1, establishing a shape topological tree expression of an original image;
step 2, according to the shape attribute of each shape in the shape topological tree, maintaining the shape topological tree structure, and deleting the shape of which the shape attribute does not meet the requirement of a threshold value;
step 3, modifying the shape in the shape topology tree to realize image rendering and reconstruction;
step 3 further comprises the sub-steps of:
3.1 for shape S in shape topology TreeiRespectively counting the shape SiThe number of pixels in a rectangular window with the scale of (2t +1) and each pixel as the center;
3.2 judging the number of pixels in the rectangular window and the area of the rectangular window, and if the number of pixels in the rectangular window is smaller than the area of the rectangular window, giving up the central pixel of the rectangular window;
3.3 pairs of shapes SiAll the pixels in the image are processed in steps 3.1-3.2, and the shape SiTransformation to New shape s'i
3.4, respectively completing the steps 3.1-3.3 for each shape in the shape topology tree to obtain a modified shape topology tree, and reconstructing an image based on the modified shape topology tree to obtain a fuzzy rendering image.
4. The method for rendering the non-photorealistic image based on the topology tree according to any one of claims 1 to 3, wherein:
step 1 further comprises the sub-steps of:
1.1, converting an original color image into an HSV image, and taking an illumination intensity channel of the HSV image;
1.2 according to the illumination intensity level of the HSV image, acquiring a basic constitutional unit, namely a shape, of the image by adopting a level set algorithm;
1.3, representing each shape by adopting a cascade structure, establishing a shape topological tree expression, wherein the nodes of the shape topological tree represent the shapes, the shape represented by a father node comprises the shape represented by a child node in an image space, and a root node represents the whole image.
5. The method of claim 4 for non-photorealistic image rendering based on a topology tree, wherein:
the step 1.2 is specifically as follows:
defining a level set according to the illumination intensity level of the HSV image, wherein the level set is a level set binary image which comprises one or more independent holes, and filling the holes with pixels corresponding to the positions of the original color image to obtain independent shapes; and continuously increasing the illumination intensity value, and obtaining the corresponding independent shape by adopting a level set algorithm.
6. The method for rendering the non-photorealistic image based on the topology tree according to any one of claims 1 to 3, wherein:
the shape attribute described in step 2 includes a shape aspect ratioWherein λ is1And λ2Is the eigenvalue of the second order inertia matrix of shape, and1>λ2deleting ∈ the aspect ratio in the shape topology tree is not less than the aspect ratio threshold0The shape of (2).
7. The method for rendering the non-photorealistic image based on the topology tree according to any one of claims 1 to 3, wherein:
the shape attribute in the step 2 comprises the shape area, namely the sum of pixels in the shape, and the area in the deleted shape topological tree is not more than the area threshold valueThe shape of (2).
8. The method for rendering the non-photorealistic image based on the topology tree according to any one of claims 1 to 3, wherein:
the shape attribute described in step 2 includes the compactness of the shapeWherein,is the area of the shape, λ1And λ2Is the eigenvalue of the second order inertia matrix of shape, and1>λ2deleting the shape topology tree with a compactness not greater than a compactness threshold k0The shape of (2).
9. The method for rendering the non-photorealistic image based on the topology tree according to any one of claims 1 to 3, wherein:
the shape attribute described in step 2 includes a shape-to-scale ratioWherein,is the area of the shape, Si rIndicates the shape SiIn the shape topological tree, the shape of an ancestor at the r-th layer, M is a self-defined stage range; deleting the shape topology tree with the scale ratio not greater than the scale ratio thresholdα0The shape of (2).
CN201410027475.XA 2014-01-21 2014-01-21 Based on the non-photorealistic image rendering intent of topological tree Expired - Fee Related CN103745444B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410027475.XA CN103745444B (en) 2014-01-21 2014-01-21 Based on the non-photorealistic image rendering intent of topological tree

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410027475.XA CN103745444B (en) 2014-01-21 2014-01-21 Based on the non-photorealistic image rendering intent of topological tree

Publications (2)

Publication Number Publication Date
CN103745444A CN103745444A (en) 2014-04-23
CN103745444B true CN103745444B (en) 2016-04-27

Family

ID=50502459

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410027475.XA Expired - Fee Related CN103745444B (en) 2014-01-21 2014-01-21 Based on the non-photorealistic image rendering intent of topological tree

Country Status (1)

Country Link
CN (1) CN103745444B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106327422B (en) * 2015-07-01 2019-05-07 北京大学 A kind of image stylization method for reconstructing and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2068550A1 (en) * 2007-12-05 2009-06-10 Ricoh Company, Ltd. Inidication of use of colour material saving on printed output
CN101853386A (en) * 2010-05-14 2010-10-06 武汉大学 Topological tree based extraction method of image texture element features of local shape mode
CN101887366A (en) * 2010-06-01 2010-11-17 云南大学 Digital simulation and synthesis technology with artistic style of Yunnan heavy-color painting

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2068550A1 (en) * 2007-12-05 2009-06-10 Ricoh Company, Ltd. Inidication of use of colour material saving on printed output
CN101853386A (en) * 2010-05-14 2010-10-06 武汉大学 Topological tree based extraction method of image texture element features of local shape mode
CN101887366A (en) * 2010-06-01 2010-11-17 云南大学 Digital simulation and synthesis technology with artistic style of Yunnan heavy-color painting

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于内容的矢量工程图检索技术研究;邱丽丽;《中国优秀硕士学位论文全文数据库(信息科技辑)》;20120315;论文中第20、23、28、33页 *
线条画艺术风格转换技术的研究;陈刚;《中国优秀硕士学位论文全文数据库(信息科技辑)》;20120315;论文中第13页第2.4.1节、第15页第2.2节 *

Also Published As

Publication number Publication date
CN103745444A (en) 2014-04-23

Similar Documents

Publication Publication Date Title
Guérin et al. Interactive example-based terrain authoring with conditional generative adversarial networks.
Engin et al. Cycle-dehaze: Enhanced cyclegan for single image dehazing
Rosin Training cellular automata for image processing
Hartmann et al. Streetgan: Towards road network synthesis with generative adversarial networks
CN102254333B (en) Image-based method for generating ink painting style image
Price et al. Object-based vectorization for interactive image editing
Kumar et al. Structure-preserving NPR framework for image abstraction and stylization
CN111210517B (en) Multi-grid terrain generation method based on neural network
CN107507146A (en) A kind of natural image soft shadowses removing method
CN111626951A (en) Image shadow elimination method based on content perception information
Parakkat et al. Color by numbers: Interactive structuring and vectorization of sketch imagery
Liao et al. Multi-scale mutual feature convolutional neural network for depth image denoise and enhancement
CN106778789A (en) A kind of fast target extracting method in multi-view image
CN103745444B (en) Based on the non-photorealistic image rendering intent of topological tree
CN114782645A (en) Virtual digital person making method, related equipment and readable storage medium
Kałużny et al. LAESI: Leaf Area Estimation with Synthetic Imagery
CN117173063A (en) Infrared and visible light visual information fusion method based on gradient transformation priori
Wang et al. Interactive image manipulation using morphological trees and spline-based skeletons
Wang et al. Automatic image-based pencil sketch rendering
Ma A comparison of art style transfer in Cycle-GAN based on different generators
Xiang et al. A deep network architecture for image inpainting
CN112926500B (en) Pedestrian detection method combining head and overall information
CN104504719A (en) Image edge detection method and equipment
CN114549288A (en) Sketch landscape map generation method based on deep learning
CN111080512B (en) Cartoon image generation method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160427

Termination date: 20170121