AU714685B2 - Font decoration by automatic mesh fitting - Google Patents

Description

S F Ref: 436685

AUSTRALIA

PATENTS ACT 1990 COMPLETE SPECIFICATION FOR A STANDARD PATENT

ORIGINAL

Name and Address of Applicant: Canon Kabushiki Kaisha 30-2, Shimomaruko 3-chome Ohta-ku Tokyo 146

JAPAN

0

S

0

*O

0o 0 0* 0

S

oo Canon Information Systems Research Australia Pty Ltd 1 Thomas Holt Drive North Ryde New South Wales 2113

AUSTRALIA

Actual Inventor(s): Address for Service: Cameron Bolitho Browne Spruson Ferguson, Patent Attorneys Level 33 St Martins Tower, 31 Market Street Sydney, New South Wales, 2000, Australia Font Decoration by Automatic Mesh Fitting Invention Title: ASSOCIATED PROVISIONAL APPLICATION DETAILS [31] Application No(s) [33] Country PP0267 AU [32] Application Date 7 November 1997 The following statement is a full description of this invention, including the best method of performing it known to me/us:- 5815

_I

FONT DECORATION BY AUTOMATIC MESH FITTING Field of the Invention The present invention relates to the creation of artistic fonts for utilisation by a computer image creation program to create computer generated images.

Background of the Invention The utilisation of font characters in images is extremely popular and often required. Font characters themselves require substantial artistic judgement in creation.

Hence, over time, many thousands of different font types have been created by artists.

Each font must be created for each character within an alphabet and in addition, it is popular to create italicised and bold fonts in a matching artistic format. The creation of font characters is therefore an artistically laborious task and this is especially the case where the alphabet contains a large number of characters. Further, non english languages can have a large number of characters, such as chinese characters, arabic and hebrew characters in addition to the roman characters popular with the English language.

g.Given such a high level of artistic complexity substantial judgements are made by the artist when creating a new font.

S 20 One form of popular traditional artwork which appears to have arisen sometime ••between 563AD and 744AD is the "Celtic" style which consists of a woven plait or o•o: •knotwork. This Celtic knotwork is a distinctive style of art based on the woven plait, often fitted to an outline contour in which cords are broken and rejoined in a systematic S* omanner to create the effect of an intricate weave.

25 Turning initially to Fig. 1, there is illustrated a number of simple examples of knotwork designs based on a plait. With a first example being based on a plain plait, the example being placed on a plait with angular tips, the example being based on a plait with a break and example being based on a more complicated system ofbreaks.

e g.

S 30 For more information on Celtic type fonts, the work of George Bain entitled "Celtic Art; The Methods of Construction", Constable, London, 1951 is normally considered the definitive text on Celtic knotwork constructions techniques.

_M I M -2- It should be further noted that many different possible designs techniques are possible wherein substantial artistic judgement can be brought to bare. For example, Fig. 2 illustrates a number of examples of different artistic renderings of a knotwork creation for the letter Further, other types of knotwork designs include the alternating weave property of multiple-fibres as illustrated in Fig. 3.

Given the high level of artistic endeavour required, it would be desirable to provide for a system for the automatic creation of Celtic type fonts.

Summary of the Invention In accordance with a first aspect of the present invention, there is provided a method of creating artistic effects in object outlines including the steps of: generating a mesh over the internal area of said outline; forming a series of areas from said mesh; for each of said series of areas, warping one of a predetermined series of tile shapes to cover said area, said tile shapes having a series of edge portions and said one of said series of tile shapes being chosen to substantially match in an aesthetically pleasing sense along its edges with adjacent ones of said tiles.

•In accordance with a second aspect of the present invention, there is provided a 0. method of creating artistic effects in object outlines including the steps of: providing a .20 set of tiles in response to user input; generating a series of areas over the internal area o•of said outline; selecting, for each said area, a tile from said tile set, wherein each said tile is selected so as to match selected tiles from adjacent areas; mapping, for each said area, a selected tile to said area; and rendering the mapped tiles.

Sto In accordance with a third aspect of the present invention, there is provided an 25 apparatus for creating artistic effects in object outlines including: means for generating a mesh over the internal area of said outline; means for forming a series of areas from *oo said mesh; means for warping, for each of said series of areas, one of a predetermined *:*too series of tile shapes to cover said area, said tile shapes having a series of edge portions and said one of said series of tile shapes being chosen to substantially match in an S 30 aesthetically pleasing sense along its edges with adjacent ones of said tiles.

In accordance with a fourth aspect of the present invention, there is provided an apparatus for creating artistic effects in object outlines including: means for providing

I

a set of tiles in response to user input; means for generating a series of areas over the internal area of said outline; means for selecting, for each said area, a tile from said tile set, wherein each said tile is selected so as to match selected tiles from adjacent areas; means for mapping, for each said area, a selected tile to said area; and means for rendering the mapped tiles.

In accordance with a fifth aspect of the present invention, there is provided a computer program product including a computer readable medium having recorded thereon a computer program for creating artistic effects in object outlines, the computer program product including: means for generating a mesh over the internal area of said outline; means for forming a series of areas from said mesh; means for warping, for each of said series of areas, one of a predetermined series of tile shapes to cover said area, said tile shapes having a series of edge portions and said one of said series of tile shapes being chosen to substantially match in an aesthetically pleasing sense along its edges with adjacent ones of said tiles.

In accordance with a sixth aspect of the present invention, there is provided a computer program product including a computer readable medium having recorded thereon a computer program for creating artistic effects in object outlines, the cc..

computer program product including means for providing a set of tiles in response to user input; means for generating a series of areas over the internal area of said outline; cc cc S 20 means for selecting, for each said area, a tile from said tile set, wherein each said tile is :e selected so as to match selected tiles from adjacent areas; means for mapping, for each said area, a selected tile to said area; and means for rendering the mapped tiles.

Preferably, the artistic effects include Celtic type knotwork designs and the object outlines include font characters. Hence the tiles can include substantially curves 25 representing rope segments and the aesthetically pleasing sense can include substantially matching the position and thickness of rope segments along the edges of oCooo the tile. Additionally, the rope segments can include multiple grouped substantially parallel rope segments.

In another preferred embodiment, the generating step can further include: (a) gee.

creating a series of border points around the outline; deriving from each of the border points a wave front including a series of internal points being a predetermined distance from a corresponding one of the border points and being internal to the border

I

points within the outline; combining the internal points where multiple internal points are within a predetermined distance; utilising the internal points as a new wave front and iteratively applying steps and to the wave front points until the internal area is substantially covered by points being of similar distance from one another.

The points can include a normal vector and the internal points are created substantially along the normal vector and at substantially right angles to the normal vector. The predetermined distance can also be determined by a user setable parameter.

Preferably, the step of forming a series of areas from the mesh includes performing a Delaunay triangulation of the mesh points and forming a series of areas from the mesh further includes forming a series of quadrilateral elements having substantially right angle corners and edges of similar lengths from the Delaunay triangulation in addition to a series of residual triangles. The step of generating a mesh over the internal area of the outline can further include perturbing the mesh points.

In another preferred embodiment there is further proposed the step of applying an opacity map to the rope segments within the tiles. The opacity map blending towards the sides of the rope segments to allow colour variation consistent with a 3D model of the rope segments.

S 20 Brief Description of the Drawings S. •Notwithstanding any other forms which may fall within the scope of the present invention, preferred forms of the invention will now be described, by way of example only, with reference to the accompanying drawings in which: Fig. 1 illustrates a number of example knotworks; Fig. 2 illustrates an example Celtic knotwork design for the letter Fig.3 illustrates the various variations ofknotwork designs; Figs. 4 and 5 illustrate different possible tiling arrangements for utilisation and construction of knotwork designs; Fig. 6 illustrates the process of dealing with knot overlays in accordance with the preferred embodiment; Fig. 7 illustrates the process of variation of thickness of knotwork designs; Fig. 8 illustrates a character having a boarder portion and an internal portion; Fig. 9 illustrates a simple mesh structure utilising the preferred embodiments; Fig. 10 illustrate the effects of variation in a density parameter on the knotwork structure; Fig. 11 illustrates the process of mesh formation utilising the preferred embodiment; Fig. 12 illustrates the process of deriving points from a given point utilised by the mesh generation programme of the preferred embodiment; Fig. 13 illustrate a number of Delaunay triangles; Fig. 14 illustrate the process of forming quadrilaterals from triangles as utilised in the preferred embodiment; Fig. 15 illustrates an initial and final mesh for an example of the preferred embodiment; Fig. 16 illustrates one form of resulting character divided by the preferred embodiment; Fig. 17 illustrates a character structure as created in accordance with the variation of preferred embodiments; Fig. 18 illustrates the process of triangular warp mapping as utilised by the preferred embodiment; o1: ~Fig. 19 illustrates a first effect created for a Celtic font; 20 Fig. 20 illustrate a second effect utilising the creation of Celtic fonts.

Fig. 21 is a flow diagram of a method of creating artistic effects in object outlines in accordance with a preferred embodiment; and Fig. 22 is a block diagram of a general-purpose computer for implementing the preferred method.

Description of Preferred and Other Embodiments •In the preferred embodiment, there is provided methods for automatically fitting a flexible mesh to an arbitrary character outline, based on a semi regular distribution of internal points and their Delaunay triangulation. The mesh is processed to be S 30 composed of substantially well formed quadelectral elements, with additional supporting triangular elements, upon which a knotwork design is then realised.

Generally, any method of knotwork design generally demonstrates the following desirable features: Grid agreement: Cord paths are strongly diagonal, reflecting their derivation from the plaitwork grid.

Continuity: Designs are composed of a single cord (or as few as possible) that follows a continuous path. The complexity that can be achieved with a single cord is a measure of the artist's skill.

Alternating weave: Starting from an arbitrary point, a cord alternately passes over and under the intersecting cord at each crossing, as it is followed around the design. It is known that an alternating weave can be applied to any set of closed curves if there exists: no point at which three or more curves cross, and (ii) no point at which curves touch without then crossing.

Regularity: Cords are evenly spaced and uniformly dense across the pattern.

Breaks are generally placed symmetrically and at regular intervals.

Repetition: Knotwork units often form motifs that are repeated across the design, and connected continuously with neighbouring units. To fit the outline shape, motif units may vary in size uniformly, or through (possibly non-affine) transformations.

Cord interlacement: The term interlacement refers to the technique of replacing 20 single cord paths with multiple parallel cord paths. Interlaced cords are topologically equivalent to their single-cord counterparts, and obey the alternating weave constraint.

N-interlacement refers to the replacement of single cord paths with n cords.

Preferred Embodiment of Method(s) Turning now to Fig. 21, there is shown a flow diagram of the preferred method of creating artistic effects in object outlines. In step 2100, the method commences and any necessary parameters are initialised. In the next step 2102, a tile set is generated in response to user input. The manner in which the tile sets are generated is discussed in more detail below under the heading Generation of Tile Sets". After the 30 completion of the generation of the tile sets, the method proceeds with step 2104, where a mesh is generated. The manner in which this mesh is generated is described in more detail below under the heading of Generation of Mesh". In the next step roeo

S

00o0 @0 0 0 000* 0 0 00 0 0 0 0 0 0 0 0 2106, knotwork designs are applied to the mesh. This step is described in more detail below under the heading Applying Knotwork Designs to the Mesh". After step 2106, the method proceeds to step 2108, where the tiles are mapped to mesh elements of the mesh. This step is described in more detail below under the heading "4.

Mapping Tiles to Mesh Elements". In the next step 2110, the created knotwork fonts are stored and then rendered. The manner in which the fonts are rendered are described in detail in the section herein entitled Rendering Knotwork Fonts". The method then terminates at step 2112.

1. Generation of Tile Sets A variety of alternative techniques are known for the realisation of knotwork designs, including the use of discrete tile sets. Sloss (A,.Sloss, "How to Draw Celtic Knotwork: A Practical Handbook", Blandford, London, 1995) demonstrates this approach by applying tiles directly to a simple regular (square) 4-mesh, with rotation as required.

The results being similar to that set out in example of Fig. 2. To successfully apply this technique to a non-regular 3,4-mesh, however, the tile set must be expanded to include triangular tiles that 'fit' with arbitrarily shaped quadrilateral tiles (derived from non-affine transformations applied to square tiles). An n-tile set is complete if it contains a tile for each possible entry/exit combination, for n edges. Fig. 4 shows a .o 20 minimal complete 3,4-tile set that can handle all cases that may occur in a 3,4-mesh.

o The standard right-handed weave is the convention used in this description, therefore entry curves form overpasses at tile edges, and exit curves form underpasses at tile edges. For example, as illustrated in Fig. 4, the title includes exit curve 1 forming an underpass at edge 3 with an entry curve 2. The curves illustrated in figure 3 25 show the paired offsets (positive and negative) that are derived from director curves .055 "describing the cord paths (which are not shown).

oto. Each tile contains at most one entry curve and one exit curve per edge, and edges o with entry curves always have a corresponding exit curve. Entry and exit curves are open curves. Internal curves are closed curves that exist within the tile boundary

*O*S

30 without touching or crossing it at any point and are illustrated for example, in Fig. 4(f) and 4(j).

To maintain geometric continuity between neighbouring tiles, angles of entry and exit should agree (450 in this case), and the relative entry and exit positions should also agree (0.5 for both unit triangle and unit square tiles).

Fig. 5 demonstrates a more complex complete 3,4-tile set. Any number of tiles from different tile sets may be combined to create interesting weaving effects, provided that the resulting set is complete with respect to the target mesh. Complete 3-tile sets or complete 4-tile sets (subsets of the complete 3,4-tile sets) may be further chosen to fit a 3-mesh or 4-mesh respectively.

1.1 Multiple Cord Interlacement The alternating weave property of closed plane curves can be exploited to automatically apply n-interlacement to tile sets to produce effects such as those illustrated in Fig. 3(a) and Fig. Cord paths describing the n-interlacement are obtained by offsetting the director (entry) curves to a specified cord spacing. The defining cord edges can then be obtained by offsetting the n cord paths to a specified cord width in the positive and negative directions, relative to the cord paths.

Turning now to Fig. 6, there will be now illustrated an example of the process of multicord interlacement. A single director cord path 5 is first offset in both directions 0400 6, 7. The cord edges eg. 8, 9 are then obtained by offsetting the cord path eg. 7 by a 20 specified cord width in both directions 8, 9.

Both the director and cord path offsets are exact to within a given tolerance, but *must be processed to ensure geometric continuity matching that of the original curves.

Offset curve ends can be clipped or extended to snap end points as required, then clipped to the unit tile shape. Entry and exit points are adjusted to maintain constant °0 25 spacing at tile edges.

0000 The alternating weave pattern is visualised by hiding curve segments that see*: correspond to underpasses. This can be achieved by subdividing curves at intersection points, and marking every fourth crossing interval as 'hidden'. Care must be taken to synchronise the crossing count for multiply interlaced curves.

sea* 30 As the positive and negative cord path offsets must match at over and under passes, invalid weaving patterns may occur for convoluted director curves or multiple

N

-9interlacement, especially for wider cords. This problem is avoided through the use of adaptive variable offsetting of the edges as follows: apply constant offset while invalid weave reduce internal offset radius apply variable offset The offset radius at curve entry and exit points remains constant, despite the internal offset radius, to ensure that curve ends correspond to those of neighbouring tiles. A simple heuristic is used to determine whether a weaving pattern is valid, based on the number of crossings for each cord offset.

Fig. 7 demonstrates the adaptive variable offsetting process for increasing cord width, where re is the constant offset radius at entry/exit points, and ri is the variable radius offset at all other (internal) points. Note how the curve width at midpoints is effectively reduced to allow a valid weave, and larger re r ratios (such as that of figure 6c) require that the 450 entry/exit angle condition be relaxed for offsets, though the equispaced entry/exit position condition holds. The offset radii are given in tile units, where each tile edge is 1.0 unit in length with the files being as follows: constant offset re ri 0.075, variable offset re= 0.15, r 0.1275, variable offset re 0.175, ri= 0.1264.

°O

20 Hence the generation of n-interlaced tile sets can be parameterised, and a wide ~variety of patterns may be created simply by specifying: a set of director curves, (ii) othe number of interlaced cords offsets, (iii) cord separation, and (iv) cord width. The tile set used to generate the knotwork design has then been defined. Rather than generate such tile sets each time, the tile sets may be stored in a library from which 25 they may be accessed by a user during the creation process. The next step is to generate the fitted 3,4-mesh upon which the tile set is to be mapped.

a 2. Generation of a Mesh For an explanation of mesh generation algorithms, reference is made Y. T. Lee

S.

'30 and A. De Pennington, "Automatic Finite-Element Mesh Generation from Geometric Models A Point-Based Approach", ACM Transactions or Graphics, Vol. 3, No. 4, Oct. 1984. Known algorithms for the generation of a finite-element mesh composed of quadrilateral and triangular elements normally are constructed from simple shapes with regularly distributed point sets that are merged using constructive solid geometry (CSG) rules. This approach is generally unsuitable here for two main reasons: Shape complexity: Character outline shapes may be arbitrarily complex, and may not amenable to regular point distributions. A method for generating an acceptable distribution of mesh points is central to the following algorithm.

Directional bias: One of the strengths of the methods referred to in the aforementioned article is the efficient columnar traversal of mesh points. However, this introduces a strong left-right bias that is especially noticeable for irregular point distributions. For knotwork designs it is desirable that mesh elements be strongly fitted to the outline, and that any uncertainty occurs towards the centre of the shape.

This is especially important for the generation of borders around knotwork shapes such as in the example shown in Fig. 8.

Turning to Fig. 9 where there is illustrated a sample mesh grid, the following notation will be used in the discussion of the preferred embodiment: v-point(eg. 12) a mesh point at an outline vertex, e-point (eg. 13) a mesh point on the outline that is not a vertex (ie. an edge point), ob-point boundary point (either an e-point or a v-point), Oi-point (eg. 14) mesh point internal to the outline shape.

o 20 The generation of a distribution of mesh points within a font outline shape is achieved using a wavefront that moves in discrete steps. The front progresses from the or, outline towards the shape's interior, until it is cancelled by an opposing wavefront, 3 depositing equispaced points along its perimeter at regular intervals. The density of the mesh is determined by a density parameter. A base length (Lb) is determined directly 25 from the mesh density, which is the preferred length of mesh element edges and the C default spacing for mesh points. Lb is inversely proportional to the density parameter Fig. 10 Oa to I O1c illustrate the effect of variation in the density parameter with Fig. having a density of 0.1, Fig. 10b a density of 0.5 and Fig. 10c a density of 0.825.

The minimum length (Lm) for element edges is given by Lb 42. This puts a 30 lower limit on mesh element size, ensuring some degree of regularity, and means that any mesh point P falling within the region described by a set of 3 or 4 reasonably spaced (Lb distant) mesh points P, will be at most Lm distance from at least one member of Pr. This is critical in detecting interference along the wavefront and ensuring that the wavefront progression terminates.

In Fig. 1 la to 1 c there is illustrated an example of the mesh generation process.

As shown in Fig. 1 la the wavefront is initialised by the addition of v-points eg.

15 that correspond to outline curve end points that do not exhibit first-degree geometric continuity across the join. Intervals along the outline between successive v-points are seeded by e-points eg. 16 that are initially regularly spaced by a distance as close to Lb as possible. This regular spacing is modified by local outline curvature so that convex intervals are more densely packed and concave intervals are more sparsely spaced (see the arch 17 of the in Fig. 1 la). This curvature-dependent spacing reflects the effect on point spacing observed when a regular mesh is subjected to torsion. The seeded epoints are also added to the initial wavefront (figure 8a).

A normal direction vector n, eg. 18 is associated with each initial seed point, determined by the inward curve normal at the corresponding point on the outline. The seed b-points that include the initial wavefront are also added to the initial set of mesh points Pm. The wavefront progressively moves forward, adding new points to Pm until Pw is empty in accordance with the following method: Pm Pw initial seed points while Pw not empty S 20 for eachPe P, Sgenerate P,' merge P' with Pm add surviving to Pw remove P from Pw S*O* 25 where Pp' is the projected point set derived from point P. As illustrated in Fig. 12 P g includes three points: the forward projected point in the direction n, (ii) the left projected point in the direction 900 anticlockwise from n, and (iii) the right projected point in the direction 900 clockwise from n. All three projected points are a distance Lb from P. Projected points .that lie outside the outline shape are 30 removed from Each member of Pp' is tested for proximity to existing Pm points, and point pairs that are less than Lm distance apart are merged according to rules given in the following table wherein, given two points to be merged and P 2 the actions outlined are as follows:

P

2 is v-point P, is e-point P 2 is i-point P, is v-point Delete either Delete P 2 Delete P 2 P is e-point Delete P, Delete either Delete P 2 P, is i-point Delete P, Delete P, Take average Taking the average of two i-points involves moving either of the points to the midpoint of the line segment PP 2 and deleting the other point. As this midpoint may itself violate the Lm space of existing Pm points, a postprocessing step merges invalid pairs within Point pair proximity can be efficiently determined by a grid-based local neighbourhood search.

All points generated during the wavefront progression are i-points, so only the last row and last column of the table apply during this process. However, other cases may occur when generating the seed points with which the wavefront is initialised, for instance adjacent v-points that are less than L, distance apart.

The wavefront is propagated to each successive step by the addition of members that are not deleted during the merge operation (For example, see Fig. 11 Each mesh 15 point is given a timestamp that indicates at which wavefront iteration it was added to All members of are merged when opposing wave fronts meet, effectively cancelling out the wavefront at those points giving a final mesh grid as illustrated in Fig llc. The relationship of length to Lb previously mentioned ensures that wavefronts do not 'pass through' each other. The wavefront may split into separate 20 pockets during its progression, in which case the set P, is the union of member points of each pocket. Following wavefront cancellation, we have the complete set of mesh o0 points Pm.

The final distribution of points is quite regular around the outline as desired, but becomes more uncertain towards the shape's centre (noticeable in the arch of the 19 25 Fig. lc). Internal regularity is improved during the following steps of mesh element generation.

A Delaunay triangulation (DT) process is then applied to the set of mesh points generated in the previous step. The Delaunay triangulation process is a well known process for the generation of high quality meshes. For a further discussion of the process, reference is made to Dani Lischinski, "Incremented Delaunay Triangulation", Graphics Gems, Vol 3, No. 4, Academic Press, Boston, 1994 at pages 47 59.

The Delaunay triangulation of a finite set of data points is the triangulation that satisfies the empty circumcircle property, that is, there exists no triangle within the DT whose circumcircle contains any data points Fig. 13 a to 13c illustrate example Delaunay triangles. It is a robust and well-documented technique for which efficient algorithms exist.

The algorithm can be summarised as follows: starting with an initial triangle known to contain all mesh points, each mesh point is added to the DT such that the empty circumcircle property holds. As each point is added to the DT new edges must be created to accommodate it, and existing edges may need to be 'flipped' between alternative point pairs to maintain the empty circumcircle property. Flipped edges may themselves require further edges to be flipped, though this process converges quickly in practice.

A drawback of Lischinski's algorithm is that four or more cocircular points result in a non-unique DT as illustrated in Fig. 13b and 13c. However, this problem is •-•largely irrelevant to the process of 3,4-mesh generation as such degenerate cases are 00.0 readily converted to equivalent quadrilateral mesh elements (for the case of four *•o•20 coincident points anyway). That is, the triangles Figs. 13a and 13b will resolve to the 0 same quadrilateral element.

2.1 Conversion to Mesh Elements The final step in the generation of the 3,4-mesh is the conversion of DT triangles 25 into quadrilateral and triangular mesh elements. This process can proceed as follows: o••0• Internal triangles (DT triangles whose midpoint lies within the outline shape) are •oe identified and added to the set Ti. Non-internal triangles are discarded, including those triangles formed from the initial three DT seed points. Degenerate internal triangles (those with area less than some threshold) are also discarded. Each internal triangle is •0 30 given a timestamp that corresponds to the minimum timestamp of the mesh points that include its vertices.

Optimal quadrilateral elements that can be formed from the members of T are identified and added to the 3,4-mesh. An optimal quadrilateral occurs when the edge shared by two neighbouring triangles is the longest edge of each triangle, and is instantiated by the removal of the shared edge. For example, in Fig. 14a the optimal quadrilateral ABCD is obtained by removing edge AC common to triangles T, and T 2 The two component triangles T 2 are removed from Ti. To encourage an outward-in progression of optimal quadrilateral elements in discrete steps, an initial pass is made on T, members with the same timestamp, and then another pass is made regardless of timestamp.

Good quadrilateral elements that can be formed from the remaining members of T, are identified and added to the 3,4-mesh. A good quadrilateral occurs when the shared edge of neighbouring triangles is removed, and the resulting quadrilateral satisfies some conditions regarding shape and proportion. Turning now to Fig. 14b, a suitable 11 b. evaluation function used for the triangles T 3 and T 4 in the current implementation is as follows: if I a 901)/90 I LLag threshold then quadrilateral is good 6 20 where a i is the quadrilateral's internal angle at the ith vertex, L is the length of the i th edge (for i 1 to and L,,g is the average edge length. This favours quadrilateral o:'o elements with internal angles that are approximately right-angled, and edges of approximately equal length.

The two component triangles used to create the good quadrilateral are removed 25 from Ti. Again, an initial pass is made on T, members with the same timestamp, and then another pass is made regardless of timestamp.

A quadrilateral is well-formed if it is optimal or good.

o-The remaining members of T, are added to the 3,4-mesh directly as triangular mesh elements. The 3,4-mesh is now constructed; with all members of T, being either converted into well-formed quadrilateral mesh elements, or added directly. Fig. illustrates and example mesh fitting process wherein the mesh 25 is translated into the corresponding final mesh 26.

The uniformity of mesh elements can be improved at this point by adjusting each mesh point so that it is as equidistant as possible from all other mesh points with which it shares a mesh element edge. This is evident in the improvement in regularity from the mesh 25 to the mesh 26. The parameter can be specified for the number of adjustment passes to be applied through a uniformity parameter, in practice no more than a couple of passes are required.

By contrast, mesh points may be perturbed by moving each mesh point a small amount in a random direction. This introduces entropy into the mesh and reduces the regularity evident in some automatically derived grids. A user specifies a perturbation value to achieve this effect Fig. 2b and Fig. 2d illustrate final examples where a mesh perturbation has been applied.

The 3-mesh for an arbitrary outline shape can be derived directly from the DT by following the above method, but avoiding the quadrilateral conversion steps. Fig. 16 illustrates a character formed from 3-mesh to which a triangular tile set has been applied.

The 4-mesh for an arbitrary outline shape cannot be derived from the DT using the above method, as T i members remaining after the conversion to quadrilateral elements oo• ocannot be discarded without serious impact on the connectivity of the resulting mesh.

Instead, the 4-mesh can be obtained by sampling the filled outline shape on a regular 20 grid, and converting each occupied grid cell directly to a quadrilateral mesh element •i which is for exampled illustrated in the examples Fig. la and Fig. lb. This is analogous to pixelating the filled outline shape at a lower resolution. The grid resolution is governed by the density parameter.

Preferably the user may choose the mesh type explicitly through a dialogue, or S 25 implicitly through their choice of tile set.

00 000. 3. Applying Knotwork Designs to the Mesh 0 Given a 3,4-mesh fitted to the outline shape, mesh elements are related so that neighbouring elements share a link across the common edge. This allows knotwork continuity across tile edges. Breaks are introduced into the design by severing the link between neighbouring elements Figs. 17 and 8 illustrate examples of breaks with Fig.

17 having random breaks across the shape on a square grid with perturbation 0.4, and Fig. 8 being 3,4-mesh with border width 1.

Dividing the knotwork into border and interior regions, a device common in Celtic knotwork, is readily achieved by introducing breaks between elements with timestamp less than or equal to the border width and those with timestamp greater than the border width. As illustrated by the example of Fig. 8 and Fig. 16. Border width can be a parameter set by the user.

Once the knotwork design has been decided and applied, a knotwork tile and its orientation is associated with each mesh element. For each mesh element E, the set of matching tiles T, is determined, such that each tile T e Tm has the same number of vertices as E, and the number and distribution of entry/exit curve pairs in T matches the number and distribution of unbroken links in E. A tile T e T, is chosen at random, and the orientation required to match T to E is recorded.

4. Mapping Tiles to Mesh Elements The paths that describe the final knotwork are derived as follows: copies are made of the component curves of each mesh element's associated tile. These tile curve copies are then mapped to fit the element's position, orientation and shape. Only the o*o control points that describe the curves are mapped.

For quadrilateral mesh elements, the unit square tile curves are mapped using a ,standard non-affine bilinear warp. The source coordinates are the vertices of the tile's unit square, and the destination coordinates are the mesh element vertices. The associated orientation value is used to align source and destination coordinates correctly.

S 25 4.1 Triangular Interpolation Triangular tiles are mapped to triangular mesh elements using an interpolation S-oo* scheme based on barycentric coordinates. An example of this process is illustrated in Fig. 18 wherein there is shown the warp of a first triangle 30 to a second triangle 31.

Each control point P of the unit tile triangle UVW is mapped to the corresponding 30 point P' in the destination triangle U'V'W'.

The barycentric coordinates u, v, w for source triangle UVW, and w' for destination triangle are subject to the constraints that u v w 1 and u' v' w' 1. These coordinates can be evaluated as follows: u =A /A v /A w =A,/A u' A' v' A' w' where A is the area of the triangle UVW, is the area of the triangle PVW, Av is the area of the triangle PWU, A, is the area of the triangle PUV, similarly for the destination areas Av' and The area of triangle UVW is given by: A 2 Ux) for vertices in anticlockwise order. This result will be negative for clockwise triangles.

Advantage can be taken of the fact that the barycentric coordinates for point P remain constant under transformation from triangle UVW to point P' in triangle U'V'W' as follows: u

U'

20 A /A

AA'/A

Substituting the area equation for and rearranging, this expands to: "o 25 Wy') P,'(W x Vx') 2 A, A' A Wx'V Similarly for v v': *99*g Px'(Wy' Wx') 2 A, A' A UxWy This gives a system of two linear equations with two unknowns (Px' and which are solved to determine P'.

After the tile set has been mapped to the mesh, the only step remaining is to render the final result.

Rendering Knotwork Fonts Each set of knotwork curves generated by the 3,4-mesh tiling can be stored in a single edges record per cord for each character. Each edges record can be associated with a path. Each such path is readily composited with other graphical objects such as a filled character shape as illustrated in Fig. 19 or another set of knotwork curves generated at a different mesh density to create more complex effects.

There are three basic rendering styles of interest: Stroked edges: Visible curve segments are drawn as open curves using a stroked pen.

Edge blends: Visible curve segments are paired with their opposing offsets (that is, positive cord offsets are paired with their negative counterparts), and are drawn as open curves with an edge blend between them.

Filled shapes: Visible curve segments and their opposing offsets are closed and filled.

Highlighting and shadow effects provide visual cues that emphasise the weave 0*00 pattern. One passable depth effect can be achieved by compositing an edge-blended •oO 20 path that smoothly changes from fully opaque along its centre to fully transparent along ••its periphery, over a filled path in a darker colour that exactly matches its shape. The result can then composited over a filled background shape. The same edges record is used for all paths that make up the knotwork in this example, increasing efficiency.

For example, in Fig. 20a, there is illustrated a portion of a rope 34 having edges 25 35, 36. An opacity section taken through the line A A- of Fig. 10 Oa is illustrated in Fig. 20b wherein the opacity profile is as illustrated 37.

It will be further evident that many other variations can be achieved so as to provide for a wide range of character not work designs.

The method has been described for fitting a flexible mesh including well-formed 30 quadrilateral elements and subsidiary triangular elements to an outline shape, based on a semi-regular distribution of internal points and their Delaunay triangulation.

Methods for mapping the knotwork tiles to the flexible mesh are further provided.

-19 The resulting characters are of reasonable artistic merit, defined by few parameters, and produced in a fraction of the time that it would take to derive similar characters by traditional techniques.

The usefulness of the mesh generation algorithm is not limited to knotwork decoration, and has a wide range of possible applications (including geometric tessellations, space-filling curves, Escher-like tilings).

Preferred Embodiment of Apparatus(s) The method of creating artistic effects in object outlines is preferably practiced using a conventional general-purpose computer, such as the one shown in Fig. 22 wherein the processes of Figs. 1 to 21 may be implemented as software executing on the computer. In particular, the steps of method of creating artistic effects in object outlines are effected by instructions in the software that are carried out by the computer. The software may be divided into two separate parts; one part for carrying out the creation processes; and another part to manage the user interface between the latter and the user. The software may be stored in a computer readable medium, including the storage devices described below, for example. The software is loaded vow* a into the computer from the computer readable medium, and then executed by the computer. A computer readable medium having such software or computer program 20 recorded on it is a computer program product. The use of the computer program product in the computer preferably effects an advantageous apparatus for creating artistic effects in object outlines accordance with the embodiments of the invention.

The computer system 2200 consists of the computer 2202, a video display 2216, and input devices 2218, 2220. In addition, the computer system 2200 can have S 25 any of a number of other output devices including line printers, laser printers, plotters, and other reproduction devices connected to the computer 2202. The computer system 2200 can be connected to one or more other computers via a communication interface :2208a using an appropriate communication channel 2230 such as a modem communications path, a computer network, or the like. The computer network may include a local area network (LAN), a wide area network (WAN), an Intranet, and/or the Internet The computer 2202 itself consists of a central processing unit(s) (simply referred to as a processor hereinafter) 2204, a memory 2206 which may include random access memory (RAM) and read-only memory (ROM), input/output

(IO)

interfaces 2208a 2208b a video interface 2210, and one or more storage devices generally represented by a block 2212 in Fig. 22. The storage device(s) 2212 can consist of one or more of the following: a floppy disc, a hard disc drive, a magnetooptical disc drive, CD-ROM, magnetic tape or any other of a number of non-volatile storage devices well known to those skilled in the art. Each of the components 2204 to 2212 is typically connected to one or more of the other devices via a bus 2214 that in turn can consist of data, address, and control buses.

The video interface 2210 is connected to the video display 2216 and provides video signals from the computer 2202 for display on the video display 2216. User input to operate the computer 2202 can be provided by one or more input devices 2208b. For example, an operator can use the keyboard 2218 and/or a pointing device such as the mouse 2220 to provide input to the computer 2202.

The system 2200 is simply provided for illustrative purposes and other configurations can be employed without departing from the scope and spirit of the C. invention. Exemplary computers on which the embodiment can be practiced include IBM-PC/ATs or compatibles, one of the Macintosh (TM) family of PCs, Sun S 20 Sparcstation or the like. The foregoing are merely exemplary of the types of Scomputers with which the embodiments of the invention may be practiced. Typically, -the processes of the embodiments, described hereinafter, are resident as software or a program recorded on a hard disk drive (generally depicted as block 2212 in Fig. 22) as the computer readable medium, and read and controlled using the processor 2204.

25 Intermediate storage of the program and pixel data and any data fetched from the network may be accomplished using the semiconductor memory 2206, possibly in concert with the hard disk drive 2212.

5.,In some instances, the program may be supplied to the user encoded on a CD-ROM or a floppy disk (both generally depicted by block 2212), or alternatively could be read by the user from the network via a modem device connected to the computer, for example. Still further, the software can also be loaded into the computer system 2200 from other computer readable medium including magnetic tape, a ROM 21or integrated circuit, a magneto-optical disk, a radio or infra-red transmission channel between the computer and another device, a computer readable card such as a PCMCIA card, and the Internet and Intranets including email transmissions and information recorded on websites and the like. The foregoing are merely exemplary of relevant computer readable mediums. Other computer readable mediums may be practiced without departing from the scope and spirit of the invention.

It would be appreciated by a person skilled in the art that numerous variations and/or modifications may be made to the present invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects to be illustrative and not restrictive.

0 0 00**0 0 0 0000 @000

Claims (45)

1. A method of creating artistic effects in object outlines including the steps of: generating a mesh over the internal area of said outline; forming a series of areas from said mesh; for each of said series of areas, warping one of a predetermined series of tile shapes to cover said area, said tile shapes having a series of edge portions and said one of said series of tile shapes being chosen to substantially match in an aesthetically pleasing sense along its edges with adjacent ones of said tiles.

2. A method as claimed in claim 1, wherein said artistic effects include Celtic type knotwork designs.

3. A method as claimed in claim 1 or 2, wherein said object outlines include font characters.

4. A method as claimed in claim 1 or 2, wherein said tiles include substantially curves representing rope segments. e 20 5. A method as claimed in claim 4, wherein said aesthetically pleasing sense includes substantially matching the position and thickness of rope segments along the edges of said tile.

6. A method as claimed in claim 4 or 5, wherein said rope segments include S 25 multiple grouped substantially parallel rope segments.

7. A method as as claimed in claim 1, wherein said generating step includes: S:o- creating a series of border points around said outline; deriving from each of said border points a wave front including a series 30 of internal points being a predetermined distance from a corresponding one of said border points and being internal to said border points within said outline; 23 combining said internal points where multiple internal points are within a predetermined distance; utilising said internal points as a new wave front and iteratively applying steps and to said wave front points until said internal area is substantially covered by points being of similar distance from one another.

8. A method as claimed in claim 7, wherein each of said points includes a normal vector and said internal points are created substantially along said normal vector and at substantially right angles to said normal vector.

9. A method as claimed in claim 7 or 8, wherein said predetermined distance is determined by a user setable parameter. A method as claimed in claim 1, wherein said step of forming a series of areas from said mesh includes performing a Delaunay triangulation of said mesh points.

11. A method as claimed in claim 10, wherein said step of forming a series of S• areas from said mesh further includes forming a series of quadrilateral elements having 20 substantially right angle corners and edges of similar lengths from said Delaunay triangulation in addition to a series of residual triangles. rO•O

12. A method as claimed in claim 1, wherein said step of generating a mesh over the internal area of said outline further includes perturbing said mesh points. S 5059

13. A method as claimed in claim 4, further including the step of: 1 applying an opacity map to said rope segments within said tiles. oor 3 14. A method as claimed in claim 13, wherein said opacity map includes a blend towards the sides of said rope segments. 24 A method of creating artistic effects in object outlines including the steps of: providing a set of tiles in response to user input; generating a series of areas over the internal area of said outline; selecting, for each said area, a tile from said tile set, wherein each said tile is selected so as to match selected tiles from adjacent areas; mapping, for each said area, a selected tile to said area; and rendering the mapped tiles.

16. A method as claimed in claim 15, wherein said artistic effects include Celtic type knotwork designs.

17. A method as claimed in claim 15 or 16, wherein said object outlines include font characters.

18. A method as claimed in claim 15 or 16, wherein said tiles include substantially curves representing rope segments. oef• -oo

19. A method as claimed in claim 18, wherein said matching of tiles includes 1o 20 substantially matching the position and thickness of rope segments along the edges of said tile. *D 0 OS*O A method as claimed in claim 18 or 19, wherein said rope segments include multiple grouped substantially parallel rope segments.

21. A method as claimed in claim 15, wherein said step of generating a series of areas includes the substeps of generating a mesh over the internal area of said outline; and forming a series of said areas from said mesh. S.. 30 22. A method as as claimed in claim 21, wherein said mesh generating step includes: creating a series of border points around said outline; deriving from each of said border points a wave front including a series of internal points being a predetermined distance from a corresponding one of said border points and being internal to said border points within said outline; combining said internal points where multiple internal points are within a predetermined distance; utilising said internal points as a new wave front and iteratively applying steps and to said wave front points until said internal area is substantially covered by points being of similar distance from one another.

23. A method as claimed in claim 22, wherein each of said points includes a normal vector and said internal points are created substantially along said normal vector and at substantially right angles to said normal vector.

24. A method as claimed in claim 22 or 23, wherein said predetermined distance is determined by a user setable parameter. A method as claimed in claim 21, wherein said substep of forming a series r .of areas from said mesh includes performing a Delaunay triangulation of said mesh points. OS Sb

26. A method as claimed in claim 25, wherein said substep of forming a series of areas from said mesh further includes forming a series of quadrilateral elements having substantially right angle corners and edges of similar lengths from said Delaunay triangulation in addition to a series of residual triangles. S.r S.

27. A method as claimed in claim 21, wherein said step of generating a mesh over the internal area of said outline further includes perturbing said mesh points. oooroo

28. A method as claimed in claim 18, further including the step of: applying an opacity map to said rope segments within said tiles.

29. A method as claimed in claim 28, wherein said opacity map includes a blend towards the sides of said rope segments. An apparatus for creating artistic effects in object outlines including: means for generating a mesh over the internal area of said outline; means for forming a series of areas from said mesh; means for warping, for each of said series of areas, one of a predetermined series of tile shapes to cover said area, said tile shapes having a series of edge portions and said one of said series of tile shapes being chosen to substantially match in an aesthetically pleasing sense along its edges with adjacent ones of said tiles.

31. An apparatus as claimed in claim 30, wherein said artistic effects include Celtic type knotwork designs.

32. An apparatus as claimed in claim 30 or 31, wherein said object outlines include font characters. c.. 20o 33. An apparatus as claimed in claim 30 or 31, wherein said tiles include 20 substantially curves representing rope segments.

34. An apparatus as claimed in claim 33, wherein said aesthetically pleasing sense includes substantially matching the position and thickness of rope segments along the edges of said tile. An apparatus as claimed in claim .33 or 34, wherein said rope segments C include multiple grouped substantially parallel rope segments.

36. An apparatus as as claimed in claim 30, wherein said generating means includes: means for creating a series of border points around said outline; means for deriving from each of said border points a wave front including a series of internal points being a predetermined distance from a corresponding one of said border points and being internal to said border points within said outline; means for combining said internal points where multiple internal points are within a predetermined distance; means for utilising said internal points as a new wave front and iteratively performing the operations of said deriviation and combination means to said wave front points until said internal area is substantially covered by points being of similar distance from one another.

37. An apparatus as claimed in claim 36, wherein each of said points includes a normal vector and said internal points are created substantially along said normal vector and at substantially right angles to said normal vector.

38. An apparatus as claimed in claim 36 or 37, wherein said predetermined distance is determined by a user setable parameter.

39. An apparatus as claimed in claim 30, wherein said means for forming a series of areas from said mesh includes means for performing a Delaunay triangulation V" 20 of said mesh points. °00

40. An apparatus as claimed in claim 39, wherein said means for forming a series of areas from said mesh further includes means for forming a series of oquadrilateral elements having substantially right angle corners and edges of similar 25 lengths from said Delaunay triangulation in addition to a series of residual triangles.

41. An apparatus as claimed in claim 30, wherein said means for generating a mesh over the internal area of said outline further includes means for perturbing said S mesh points.

42. An apparatus as claimed in claim 33, further including: 28 means for applying an opacity map to said rope segments within said tiles.

43. An apparatus as claimed in claim 42, wherein said opacity map includes a blend towards the sides of said rope segments.

44. An apparatus for creating artistic effects in object outlines including: means for providing a set of tiles in response to user input; means for generating a series of areas over the internal area of said outline; means for selecting, for each said area, a tile from said tile set, wherein each said tile is selected so as to match selected tiles from adjacent areas; means for mapping, for each said area, a selected tile to said area; and means for rendering the mapped tiles.

45. An apparatus as claimed in claim 44, wherein said artistic effects include Celtic type knotwork designs.

46. An apparatus as claimed in claim 44 or 45, wherein said object outlines include font characters.

47. An apparatus as claimed in claim 44 or 45, wherein said tiles include substantially curves representing rope segments. b 48. An apparatus as claimed in claim 47, wherein said matching of tiles includes substantially matching the position and thickness of rope segments along the edges of said tile. a *4.000 ~49. An apparatus as claimed in claim 47 or 48, wherein said rope segments include multiple grouped substantially parallel rope segments. •o 29 An apparatus as claimed in claim 44, wherein said means for generating a series of areas includes means for generating a mesh over the internal area of said outline; and means for forming a series of said areas from said mesh.

51. An apparatus as as claimed in claim 50, wherein said means for generating said mesh includes: means for creating a series of border points around said outline; means for deriving from each of said border points a wave front including a series of internal points being a predetermined distance from a corresponding one of said border points and being internal to said border points within said outline; means for combining said internal points where multiple internal points are within a predetermined distance; means for utilising said internal points as a new wave front and iteratively performing the operations of said deriviation and combination means to said wave front points until said internal area is substantially covered by points being of similar distance from one another.

52. An apparatus as claimed in claim 51, wherein each of said points includes a normal vector and said internal points are created substantially along said normal Sa 20 vector and at substantially right angles to said normal vector. S An apparatus as claimed in claim 51 or 52, wherein said predetermined distance is determined by a user setable parameter. 0 so *0.e 25 54. An apparatus as claimed in claim 50, wherein said means for forming a series of areas from said mesh includes means for performing a Delaunay triangulation •of said mesh points. U

55. An apparatus as claimed in claim '54, wherein said means for forming a series of areas from said mesh further includes means for forming a series of quadrilateral elements having substantially right angle corners and edges of similar lengths from said Delaunay triangulation in addition to a series of residual triangles. S ~3O

56. An apparatus as claimed in claim 50, wherein said means for generating a mesh over the internal area of said outline further includes means for perturbing said mesh points.

57. An apparatus as claimed in claim 47, further including: means for applying an opacity map to said rope segments within said tiles.

58. An apparatus as claimed in claim 57, wherein said opacity map includes a blend towards the sides of said rope segments.

59. A computer program product including a computer readable medium having recorded thereon a computer program for creating artistic effects in object outlines, the computer program product including: means for generating a mesh over the internal area of said outline; means for forming a series of areas from said mesh; r ,e ~means for warping, for each of said series of areas, one of a r r predetermined series of tile shapes to cover said area, said tile shapes having a series of S 20 edge portions and said one of said series of tile shapes being chosen to substantially match in an aesthetically pleasing sense along its edges with adjacent ones of said 6•° •tiles.

60. A computer program product including a computer readable 25 medium having recorded thereon a computer program for creating artistic effects in JO a object outlines, the computer program product including *•Omeans for providing a set of tiles in response to user input; means for generating a series of areas over the internal area of said outline; means for selecting, for each said area, a tile from said tile set, wherein each said tile is selected so as to match selected tiles from adjacent areas; means for mapping, for each said area, a selected tile to said area; and means for rendering the mapped tiles. Dated 6 November, 1998 Canon Kabushiki Kaisha Canon Information Systems Research Australia Pty Ltd Patent Attorneys for the Applicants/Nominated Persons SPRUSON FERGUSON J 4 0e 4. 6 0O go 4 S 0 6 0060.. OeeO *e ~0 S a. S 00 4* 60 4 0 S 0 0800 @0 4 IN:\LIBF)03224:GMM