AU2005200528B2 - Compositing with clip-to-self functionality without using a shape channel - Google Patents

Description

I

S&F Ref: 694628

AUSTRALIA

PATENTS ACT 1990 COMPLETE SPECIFICATION FOR A STANDARD PATENT Name and Address of Applicant: Actual Inventor(s): Address for Service: Invention Title: Canon Kabushiki Kaisha, of 30-2, Shimomaruko 3-chome, Ohta-ku, Tokyo, 146, Japan Craig William Northway Craig Matthew Brown Alexander Vincent Danilo Philip Doak Armstrong Matthew James Allen Spruson Ferguson St Martins Tower Level 31 Market Street Sydney NSW 2000 (CCN 3710000177) Compositing with clip-to-self functionality without using a shape channel Associated Provisional Application Details: [33] Country:

AU

AU

[31] Appl'n No(s): 2004900710 2004902101 [32] Application Date: 13 Feb 2004 20 Apr 2004 The following statement is a full description of this invention, including the best method of performing it known to me/us:- 5845c I, -1- N, COMPOSITING WITH CLIP-TO-SELF FUNCTIONALITY WITHOUT USING A SSHAPE CHANNEL 00 Field of the Invention The present invention relates generally to image creation and, in particular, to the 00 rendering of overlapping groups of graphical objects O Background A graphical object is a description of certain features such as lines, curves, text, colours and the like that make up an image entity, this being generally known as vector graphics. An image may be formed by a single object or a combination of multiple objects having a defined interaction. Graphical objects are converted into a bitmap image by rendering them one after another, typically into a memory or onto a page thus forming the bitmnap image.

Some types of objects that may be combined into an output bitmap include: shapes, lines, curves, fill and stroke colours); -text; images; and effects a blur or a lighting effect).

It is common to group or combine two or more of the above objects. Once grouped, the objects may be treated as a single source object. This may done for a number of reasons: to apply an effect to a group of objects (eg. blur all the items in a group or make the whole group partially transparent); to reuse a group of objects; or to transform objects as a group (eg. the objects in a group may be animated as a single object and moved across a page together).

694628AU.doc S-2- ,i When rendering objects onto a page, either in memory or direct to a printable page, Sit is most common to render the objects onto the page sequentially. Where one partially 00 0transparent object sits on top of another object, the colour information of both objects is combined to produce the final pixel colour result. This combining is known as 00 compositing and can be used to produce a variety of effects. For example, one of effects of compositing is the appearance of looking at an image through tinted glass.

While it is common to place objects on top of each other as described above, it is sometimes useful to use different mathematical techniques to combine objects. For example, it might be useful for one object to be used as a shadow on another object, or to intersect with another object. Two techniques are commonly used for combining objects.

A first is that described in the seminal paper "Compositing Digital Images", T. Porter, T. Duff, Computer Graphics, Vol. 18, No. 3, July 1984 pp 253-259, which described what is now commonly known as "Porter Duff compositing". Another compositing technique is that called "Adobe® Blending Modes" as described in the Portable Document Fornmat (PDF) specification published by Adobe Systems Incorporated.

In most situations, when each object is placed onto a page to form a resultant image, the object adds to the resultant image. For some operations, such as the Porter Duff "in" operation, the new object being placed onto the page is intersected with the objects already on the page. This can result in a final image that contains less data than before the new object was drawn. Consequently, compositing an object onto an image using certain operations removes data from the image.

For most drawing operations, an image is only affected within the extent of the object being drawn. For example, if a circle is drawn on a background with one of such drawing operations, nothing outside the circle is modified. For some operations, such as the Porter Duff "in" operation, the background outside the extent of such a circle is 694628AU.doc n -3r, cleared. While it is desirable to perform the Porter Duff "in" operation within an Sobject, it is not always desirable to have this extra side-effect that the background is 00 0cleared outside the extent of the object being drawn.

Some drawing systems, such as Java2D manufactured by Sun Microsystems, Inc.

00 may turn off this side-effect. When a single object is composited onto the background, Ssystems such as Java2D can determine which pixels are within the extent of the object and which are not, and thus can determine which output image pixels to clear, and which not to touch, if the side-effect is turned off. Some drawing systems, such as Microsoft Windows Graphics Device Interface (GDI), also avoid this side-effect by allowing lO compositing (using the equivalent of the Porter Duff "over" operation) of an object over a background through a defined clipping path. However, most conventional drawing systems such as the Microsoft Windows GDI, do not support the remaining Porter Duff compositing operations, or do not do so in conjunction with a defined clipping path.

Furthermore, when a number of objects are combined together into a group, most conventional drawing systems find it difficult to determine which areas (ie. those pixels) that are within the group of objects and which are not, without storing a bitmap representation (ie. a "shape channel") of the extent of the combined objects.

Thus a need clearly exists for an improved method of compositing graphical objects.

Summary It is an object of the present invention to substantially overcome, or at least ameliorate, one or more disadvantages of existing arrangements.

Disclosed are arrangements which seek to address the above problems by forming a clipping channel corresponding to the shape of the group of objects.

694628AU.doc I -4-

O

O In one arrangement, a compositing operation is changed and the new compositing O operation is performed on an existing temporary buffer instead of a main buffer. Such an arrangement avoids the need of a composite result buffer and reduces memory usage and copying operations.

00 0, 5 According to one aspect of the present disclosure, there is provided a method of

(N

Scompositing a group comprising a plurality of graphical objects onto a main buffer using l t a specified compositing operation, said method comprising the steps of: C forming said group of objects in a temporary buffer; deriving a corresponding clipping path for each object in said group of objects; combining said clipping paths using a set operation 'union' as hereinbefore defined, to determine a resultant clipping path; compositing said group of objects from said temporary buffer to said main buffer through said resultant clipping path using said specified compositing operation; and displaying said main buffer using a display device.

According to another aspect of the present disclosure, there is provided an apparatus for compositing a group comprising a plurality of graphical objects, said apparatus comprising: object forming means for forming said group of objects in a temporary buffer; clipping path deriving means for deriving a corresponding clipping path for each object in said group of objects; combining means for combining said clipping paths using a set operation 'union' as hereinbefore defined, to determine a resultant clipping path; compositing means for compositing said group of objects from said temporary buffer to a main buffer through said resultant clipping path.

694628AU.doc (767506vl)

S.

O According to still another aspect of the present disclosure, there is provided a o computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to composite a group comprising a plurality of graphical objects, said program comprising the steps of: code for forming said group of objects in a temporary buffer; Scode for deriving a corresponding clipping path for each object in said group of tt objects; Ni code for combining said clipping paths using a set operation, 'union' as hereinbefore defined, to determine a resultant clipping path and code for compositing said group of objects from said temporary buffer to a main buffer through said resultant clipping path.

According to still another aspect of the present disclosure, there is provided a method of compositing a group comprising a plurality of graphical objects onto a main buffer using a specified compositing operation, said method comprising the steps of: forming said group of objects in a temporary buffer; deriving a corresponding clipping path for each object in said group of objects; combining said clipping paths using a set operation 'union' as hereinbefore defined, to determine a resultant clipping path; compositing said main buffer onto said group of objects in said temporary buffer using a compositing operation that is complementary to said specified compositing operation; copying said temporary buffer to said main buffer through said resultant clipping path; and displaying said main buffer using a display device.

694628AU.doc (767506v)

|I

-6-

O

0 According to still another aspect of the present disclosure, there is provided a O method of compositing an opaque graphical object comprising at least one curved edge onto a second opaque graphical object using a 'clear compositing operation as hereinbefore defined, said method comprising at least the steps: 00 0, 5 compositing said opaque graphical object onto said second graphical object using a 'rout' compositing operation as hereinbefore defined, wherein pixel values outside said at n least one curved edge of the boundary of said opaque graphical object are unaffected; and CN displaying said graphical objects using a display device.

According to still another aspect of the present disclosure, there is provided an apparatus for compositing a group comprising a plurality of graphical objects onto a main buffer using a specified compositing operation, said apparatus comprising: object forming means for forming said group of objects in a temporary buffer; clipping path deriving means for deriving a corresponding clipping path for each object in said group of objects; combining means for combining said clipping paths using a set operation 'union' as hereinbefore defined, to determine a resultant clipping path; compositing means for compositing said main buffer onto said group of objects in said temporary buffer using a compositing operation that is complementary to said specified compositing operation; and copying means for copying said temporary buffer to said main buffer through said resultant clipping path.

According to still another aspect of the present disclosure, there is provided a computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to composite a group comprising a 694628AU.doc (767506v 1) a I -7-

O

O plurality of graphical objects onto a main buffer using a specified compositing operation, O said program comprising: code for forming said group of objects in a temporary buffer; code for deriving a corresponding clipping path for each object in said group of 00 C 5 objects;

(N

Scode for combining said clipping paths using a set operation 'union' as hereinbefore t defined, to determine a resultant clipping path; C code for compositing said main buffer onto said group of objects in said temporary buffer using a compositing operation that is complementary to said specified compositing operation; and code for copying said temporary buffer to said main buffer through said resultant clipping path.

According to still another aspect of the present disclosure, there is provided a method of compositing an opaque graphical object, stored on a computer-readable medium, comprising at least one curved edge onto a second opaque graphical object using a 'src' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using an 'over' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device.

According to still another aspect of the present disclosure, there is provided a method of compositing an opaque graphical object, stored on a computer-readable medium, comprising at least one curved edge onto a second opaque graphical object using 694628AU.doc (767506v II S-8an 'in' compositing operation as hereinbefore defined, said method comprising at least the O steps: compositing said opaque graphical object onto said second graphical object using an 'atop' compositing operation as hereinbefore defined, wherein pixel values outside oO 00 5 said at least one curved edge of the boundary of said opaque graphical object are

(N

Sunaffected; and *n displaying said graphical objects using a display device.

C1 According to still another aspect of the present disclosure, there is provided a method of compositing an opaque graphical object, stored on a computer-readable medium, comprising at least one curved edge onto a second opaque graphical object using a mathematical 'rin' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using a 'dst' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device.

According to still another aspect of the present disclosure, there is provided a method of compositing an opaque graphical object, stored on a computer-readable medium, comprising at least one curved edge onto a second opaque graphical object using a mathematical 'out' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using an 'xor' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and 694628AU.doc (767506vl) -9displaying said graphical objects using a display device.

O According to still another aspect of the present disclosure, there is provided a method of compositing an opaque graphical object, stored on a computer-readable medium, comprising at least one curved edge onto a second opaque graphical object using 00 0, 5 a mathematical 'ratop' compositing operation as hereinbefore defined, said method comprising at least the steps: n compositing said opaque graphical object onto said second graphical object using CN an 'rover' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device.

Other aspects of the invention are also disclosed.

Brief Description of the Drawings One or more embodiments of the present invention will now be described with reference to the drawings, in which: Fig. 1 shows an initial object in a main buffer; Fig. 2 shows a temporary buffer; Fig. 3 shows a further object rendered to the temporary buffer; Fig. 4 shows a clipping path associated with the further object of Fig. 3; Fig. 5 shows an additional object rendered to the temporary buffer; 694628AU.doc (767506vl) tt

O

c Fig. 6 shows a clipping path associated with the additional object of Fig. SFig. 7 shows a union of the clipping paths of Figs. 4 and 6; 00 Fig. 8 shows the result of compositing the main buffer of Fig. 1 onto the temporary buffer of Fig. 00 Fig. 9 shows a final rendering of the objects of Fig. 5 to that of Fig. 1 based upon Sthe clipping path of Fig. 7; 0Fig. 10 is a flow diagram showing a method of compositing objects; Fig. 11 is a schematic block diagram of a general-purpose computer upon which arrangements described can be practiced; Fig. 12 illustrates various Porter Duff compositing operations implemented without and with clip-to-self functionality; Fig. 13 illustrates the various Porter Duff compositing operations of Fig. 12 on a non-opaque destination object implemented without and with clip-to-self functionality; Fig. 14 illustrates simple Porter Duff compositing with opaque objects.

Fig. 15 is a flow diagram showing another method of compositing objects; Fig. 16 shows the result of compositing the main buffer of Fig. 1 onto the temporary buffer of Fig. 5, using the method of Fig. 15; and Fig. 17 is a flow diagram showing a method of performing clip-to-self compositing, as executed in the method of Fig. Detailed Description including Best Mode Where reference is made in any one or more of the accompanying drawings to steps and/or features, which have the same reference numerals, those steps and/or features have for the purposes of this description the same function(s) or operation(s), unless the contrary intention appears.

694628AU.doc t' -11- N It is to be noted that the discussions contained in the "Background" section and that Sbelow relating to prior art arrangements relate to discussions of documents or devices 00which form public knowledge through their respective publication and/or use. Such should not be interpreted as a representation by the present inventor(s) or patent applicant 00 n that such documents or devices in any way form part of the common general knowledge in the art.

For some compositing operations, such as the Porter Duff "in" operation, the background the area outside the boundaries of a source object being drawn) is cleared. Such an effect is not always desirable. One method of avoiding this effect is to clip a compositing operation within the boundaries of the source object. This is termed 'clip-to-self compositing. Most conventional drawing systems, such as the Microsoft Windows GDI discussed above are not able to perform clip-to-self compositing with fewer than three buffers a "source" buffer, a "background" buffer and a "composite result" buffer), when required to support the entire set of Porter Duff operations. In such a conventional drawing system, to draw a source object, the composite result buffer is initialised to the background buffer. A corresponding Porter Duff compositing operation is then performed on the contents of the source buffer (eg. an object) and the contents of the composite result buffer. The composite result buffer is then copied to the background buffer using the "src" operation through a clip path. Therefore, to draw the source object, additional memory is required for the composite result buffer. Further, a copy operation of the background buffer into the composite result buffer is required for each composite operation.

A method 1000 (see Fig 10) of compositing objects is described below with reference to Figs. 1 to 14. The method 1000 may be used to composite a single object, or a group of objects, with a background using a specified compositing operation. The 694628AU.doc tn -12method 1000 avoids the need of a composite result buffer and reduces memory usage and Scopying operations.

0 The method 1000 may be practiced using a general-purpose computer system 1100, such as that shown in Fig. 11 wherein the processes depicted in Figs. 1 to 10 may be 00 implemented as software, such as an application program executing within the computer system 1100. In particular, the steps of the method 1000 may be effected by instructions in the software that are carried out by the computer. The instructions may be formed as one or more code modules, each for performing one or more particular tasks. The software may also be divided into two separate parts, in which a first part performs the compositing methods and a second part manages a user interface between the first part and the user. The software may be stored in a computer readable medium, including the storage devices described below, for example. The software may be loaded into the computer from the computer readable medium, and then executed by the computer. A computer readable medium having such software or computer program recorded on it is a computer program product. The use of the computer program product in the computer preferably effects an advantageous apparatus for compositing objects.

The computer system 1100 is formed by a computer module 1101, input devices such as a keyboard 1102 and mouse 1103, output devices including a printer 1115, a display device 1114 and loudspeakers 1117. A Modulator-Demodulator (Modem) transceiver device 1116 is used by the computer module 1101 for communicating to and from a communications network 1120, for example connectable via a telephone line 1121 or other functional medium. The modem 1116 may be used to obtain access to the Intemrnet, and other network systems, such as a Local Area Network (LAN) or a Wide Area Network (WAN), and may be incorporated into the computer module 1101 in some implementations.

694628AU.doc -13r The computer module 1101 typically includes at least one processor unit 1105, and Sa memory unit 1106, for example formed from semiconductor random access memory 00 00(RAM) and read only memory (ROM). The module 1101 also includes an number of input/output interfaces including an audio-video interface 1107 that couples to the 00 video display 1114 and loudspeakers 1117, an 1/O interface 1113 for the keyboard 1102 Sand mouse 1103 and optionally a joystick (not illustrated), and an interface 1108 for the modem 1116 and printer 1115. In some implementations, the modem 1116 may be incorporated within the computer module 1101, for example within the interface 1108. A storage device 1109 is provided and typically includes a hard disk drive 1110 and a floppy disk drive 1111. A magnetic tape drive (not illustrated) may also be used. A CD- ROM drive 1112 is typically provided as a non-volatile source of data. The components 1105 to 1113 of the computer module 1101, typically communicate via an interconnected bus 1104 and in a manner which results in a conventional mode of operation of the computer system 1100 known to those in the relevant art. Examples of computers on which the described arrangements can be practised include IBM-PC's and compatibles, Sun Sparcstations or alike computer systems evolved therefrom.

Typically, the application program is resident on the hard disk drive 1110 and read and controlled in its execution by the processor 1105. Intermediate storage of the program and any data fetched from the network 1120 may be accomplished using the semiconductor memory 1106, possibly in concert with the hard disk drive 1110. In some instances, the application program may be supplied to the user encoded on a CD-ROM or floppy disk and read via the corresponding drive 1112 or 1111, or alternatively may be read by the user from the network 1120 via the modem device 1116. Still further, the software can also be loaded into the computer system 1100 from other computer readable media. The term "computer readable medium" as used herein refers to any storage or 694628AU.doc -14transmission medium that participates in providing instructions and/or data to the Scomputer system 1100 for execution and/or processing. Examples of storage media 00 0include floppy disks, magnetic tape, CD-ROM, a hard disk drive, a ROM or integrated circuit, a magneto-optical disk, or a computer readable card'such as a PCMCIA card and 00 S 5 the like, whether or not such devices are internal or external of the computer Smodule 1101. Examples of transmission media include radio or infra-red transmission channmels as well as a network connection to another computer or networked device, and the Internet or Intranets including e-mail transmissions and information recorded on Websites and the like.

The method 1000 may be implemented as the application program discussed above, which typically would form a component or sub-program of a larger application such as a desktop publishing system or the like. The method 1000 will be described below by way of example. In the example, the method 1000 operates upon three objects, which include an initial object A seen in Fig. 1 and a group of objects B seen in Fig. 5. The group of objects B is formed of a first group object C and a second group object D.

Initially, in step 1002, the initial object A is drawn (ie. rendered) onto a background in a main image buffer V, as shown in Fig. 1. The step 1002 is exemplary, as the buffer V may be empty or may contain the results of previous compositing or other operations.

The buffer V may be formed in the memory 1106, but where capacity is limited may in part or whole be formed in the HDD 1110. Rendering is performed by the processor 1105 interpreting the description of the object A according to a predetermined language and outputting pixel colour values to the buffer V. The background may, or may not comprise image elements. In the present example, the objects A, C and D are each rectangles, for ease of illustration. However, any regular or arbitrary shape may be used, as well as text or an image.

694628AU.doc tt ,Ic [n step 1004, as shown in Fig. 2, a temporary buffer W is created into which the Sgroup of objects B is to be rendered as seen in Fig. 5. The buffer W is formed in a 00 00 fashion akin to that of the buffer V. The following step 1006 creates an empty 'resultant 0 clipping path' which, after subsequent operations, is to become the resultant group 00 clipping path. A clipping path, such as the resultant clipping path, may be represented as San array of edges. An edge may be described by start coordinates (startx, starty) and one or more segment descriptions. Each segment description includes a memory address pointing to a next segment in the edge and a finish segment used to terminate the edge.

The segments of an edge are contiguous in the sense the starting point of each segment is coincident with the end point of a previous segment. A straight-line segment is described by horizontal and vertical differences (Dx, Dy) between the start and end point of the segment. The resultant clipping path represented as an array of edges may be stored in memory 1106 and/or HDD 1110. The clipping path may be used to determine the pixels modified when performing rendering or compositing operations.

Step 1008, which follows, operates to render the first group object C into the buffer W, as seen in Fig. 3.

As seen in Fig. 4, step 1010 operates to create a clipping path X corresponding to the extent of the object C. The clipping path X is preferably a simple outline path, i.e. a single continuous path with uniform orientation and a non-zero winding rule. The path X shown in Fig. 4 is of this kind. The clipping path X may be stored in memory 1106.

Step 1012 then performs a union between the clipping path formed in step 1010 and the (initially empty) resultant clipping path of step 1006. The union between the clipping path formed in step 1010 and the resultant clipping path of step 1006 may be determined by concatenating the edge arrays describing each path. The result of the union of step 1012 may be stored as the resultant clipping path in memory 1106.

694628AU.doc t -16ri Step 1014 then tests to determine if there are any more group objects to be Sprocessed. If so, control returns to step 1008. In the present example, step 1008 on a 00 0second pass operates to render the group object D, as shown in Fig. 5, to the temporary 0 buffer W. Step 1010 then creates a clipping path Y, in memory 1106, corresponding to 00 the extent of the group object D. This is seen in Fig. 6.

SStep 1012 then operates to create a union between the clipping paths X and Y. In the present example this defines a clipping path Z in memory 1106, representing the outline of the union of extents of the objects C and D, as seen in Fig. 7. The clipping path Z is stored as the resultant clipping path in memory 1106.

Step 1014 then again tests for the presence of more group objects. In the present example there are none and control proceeds to step 1015.

Steps 1010 and 1012, in an alternative arrangement, may precede step 1008, so step 1014 loops back to step 1010, followed by steps 1012 and 1008, and then step 1014 again.

As will now be described, the following steps 1015 and 1016 perform clip-to-self compositing on the main buffer V and the temporary buffer W. Conventionally, to perform such clip-to-self compositing a Porter Duff source operand one or more objects in the temporary buffer W) is composited with a Porter Duff destination operand the background in the main buffer V) through the resultant clipping path stored in memory 1106 using a specified Porter Duff operation. However, conventional rendering systems such as Windows GDI, as previously discussed, require another buffer a composite result buffer) in order to support the separate compositing and clipping steps.

In the method 1000, as will be described in more detail below, step 1015 reverses the Porter Duff operands to be composited and selects a complementary Porter Duff operation to composite the reversed operands. The result of the compositing operation is 694628AU.doc tm -17-

O

c substantially equivalent to compositing the original operands in the manner described in Sthe paragraph directly above. However, in the method 1000, the composite result buffer 0 00 is not required to support the separate compositing and clipping steps.

At step 1015 a Porter Duff compositing operation is performed with the contents 00 N 5 of the main buffer V background) as the source operand and the contents of the 0 temporary buffer W the group of objects B) as the destination operand. Thus, the Stemporary buffer W is modified to contain the result of the Porter Duff compositing operation. The Porter Duff compositing operation performed at step 1015 is the complement of an original clip-to-self compositing operation specified to composite the contents of the main buffer V background) and the contents of the temporary buffer W the group of objects For example, as shown in Table 1 below, if the specified clip-to-self compositing operation is "src" then the corresponding operation "dst" under the "complementary" column from Table 1 is selected to composite the reversed operands at step 1015.

Table 1 Specified compositing operation Complementary compositing operation Clear Clear Src Dst Dst Src Over Rover Rover Over In Rin Rin In Out Rout Rout Out Atop Ratop Ratop Atop Xor Xor For the present example, the specified clip-to-self operation is the Porter Duff "in" operation which will be complemented to operation "rin" at step 1015 using Table 1.

694628AU.doc tn -18- ,Ic Fig. 8 shows the state of temporary buffer W after performing the complementary compositing operation in step 1015 according to the present example.

00 Step 1016 then copies the contents of the temporary buffer W the result of compositing operation 1015) onto the contents of the main buffer V the objects A) 00 but through the resultant clipping path Z. Thereby the background in regions outside of Sthe resultant clipping path Z is unaffected by step 1016. As shown in Fig. 9, the composited result pixels replace the pixels of object A within the resultant clipping path Z, but object A is unaffected outside the resultant clipping path Z, which is shown as a dashed outline. If such operations conclude the image generation process, step 1018 may be implemented to output the contents of the main buffer V, as seen in Fig. 9, for display upon the video screen 1114 or for hard copy reproduction via the printer 1115. If further objects are to be composited, control may return via a path 1020 to step 1004, where the present content of the main buffer V may be construed as the initial object A.

The creating of the clipping path in step 1010 may be performed according to the following: for shapes and text, use the path defining the object as the clipping path; for stroked objects, convert the stroked path to a clipping path; for bitmap image objects, use the edge or bounds of the image; and for effects (eg. a blur), there exists a region in which the effect operates, and the bounds of this region is converted to the clipping path.

Fig. 12 illustrates various fundamental Porter Duff compositing operations between opaque source (src, or A) and destination (dest, or B) operands. Please note that Fig. 12 does not show the complementary operations of Table 1. Fig. 12 also shows the result of the Porter Duff operations on the same opaque objects using the method 1000, implementing clip-to-self functionality. Whilst the above example makes reference to the 694628AU.doc tn -19-

O

cq "in" operation, exemplified by "A in B" of Fig. 12, the principles discussed above may be Sused to address problems caused by other ones of the operations. Those operations 0 0 0 include: clear A AinB ArinB AoutB Aratop B 00 The methods disclosed above are equally applicable to the case where one or more O of the group objects is not completely opaque. Fig. 14 shows Porter Duff compositing l Soperations for opaque objects. Fig. 13 shows the result of the Porter Duff compositing operations, both without and with clip-to-self functionality, for the case where the destination operand has 70% opacity. Moreover, the final compositing operation of step 1016 may also impart less than 100% opacity to the temporary buffer containing the group. The methods disclosed above are equally applicable in this case also.

The method 1000 described above may also be used to process a single object. In this instance, only one iteration of steps 1008 to 1014 of the method 1000 is required.

The method 1000 therefore affords an approach by which objects or groups of objects may be processed using full clip-to-self compositing functionality in a manner compatible with traditional compositing operations without the overhead of an additional buffer and copy per clip-to-self operation. This is achieved by reversing the operands to use the temporary buffer as the destination buffer and by changing the compositing operation to the complement of the specified compositing operation, as described above.

Removing the overhead of using an additional temporary buffer for each clip-to-self operation and consequential copying may thus be achieved, and clip-to-self functionality for single or grouped objects may be implemented on systems lacking compositing functionality in conjunction with a clipping path. Using the method 1000, clip-to-self compositing may be performed without requiring the use of a shape channel or an additional memory buffer and corresponding copy operation overhead.

694628AU.doc tn

O

cN, In another arrangement, if the source object (or all source objects in the case of a Sgroup of objects) and the destination object(s) are opaque, then the specified clip-to-self 0 0 operation may be replaced by a simple Porter Duff compositing operation. In this instance, there is no need to maintain a resultant clipping path and steps 1006, 1010, 00 1012, or 1016 are not required to be performed. Further, in step 1015 the temporary 0 buffer W is composited onto the main buffer V using a simple Porter Duff compositing Soperation as in the "Opaque clip-to-self compositing operation column" in the corresponding row of Table 2, below: Table 2 Specified compositing operation Opaque clip-to-self compositing operation Clear Rout Src Over Dst Dst Over Over Rover Rover In Atop Rin Dst Out Xor Rout Rout Atop Atop Ratop Rover Xor Xor For example, if the specified clip-to-self operation is the Porter Duff "in" operation for compositing where the source object (or all source objects in the case of a group) and the destination object(s) are opaque, the source object(s) and the destination object(s) will be composited using operation "atop" at step 1015 in accordance with Table 2.

In still another arrangement of the method 1000, as shown in Fig. 15, steps 1015 and 1016 may be replaced with step 1516. At step 1516, the contents of the temporary 694628AU.doc tn -21- N buffer W are composited onto the contents of the main buffer V through the clipping path SZ. A flow diagram showing a method 1700 of performing clip-to-self compositing, as 00 0executed at step 1516, will now be described with reference to Fig. 17.

The method 1700 begins at step 1701, where the processor 1105 makes a copy U of 00 the main buffer V the objects At the next step 1703, the processor 1105 Scomposites the contents of the temporary buffer W the group of objects B) onto the contents of the main buffer copy U the objects A) using a Porter Duff compositing operation specified to composite the contents of the temporary buffer W. In the present example, the "src_in" operation, exemplified by "A in B" of Fig. 12, is used at step 1703.

At the next step 1705, the processor 1105 copies the contents of the main buffer copy U, containing the group of objects B, onto the main buffer V through the resultant clipping path Z. The result of step 1516 is seen in Fig. 16 where the object group B is intersected with object A, but object A is unaffected outside the resultant clipping path Z. Again, the result of step 1516 is identical to the representation of Fig. 9 where the outline of the clipping path Z is shown.

Whilst the example of Figs. 15 to 17 makes reference to the "src_in" operation, the principles discussed above may be used to address problems caused by other ones of the operations. Those operations include: clear A AinB ArinB AoutB AratopB Accordingly, the arrangement of Fig. 15 requires a composite result buffer the main buffer copy U) when used with some conventional drawing systems, as discussed above, in order to support the entire set of Porter Duff compositing operations. For such conventional drawing systems, the method 1000 as shown in Fig. 10 may be used to avoid the need of a composite result buffer.

Industrial Applicability 694628AU.doc tm -22-

O

CI It is apparent from the above that the arrangements described are applicable to the computer graphic and image processing industries.

0 The foregoing describes only some embodiments of the present invention, and modifications and/or changes can be made thereto without departing from the scope and 00 spirit of the invention, the embodiments being illustrative and not restrictive.

O In the context of this specification, the word "comprising" means "including 0principally but not necessarily solely" or "having" or "including", and not "consisting only of'. Variations of the word "comprising", such as "comprise" and "comprises" have correspondingly varied meanings.

694628AU.doc

Claims (19)

1. A method of compositing a group comprising a plurality of graphical objects onto a main buffer using a specified compositing operation, said method comprising the steps of: 00 0, 5 forming said group of objects in a temporary buffer; deriving a corresponding clipping path for each object in said group of objects; t' combining said clipping paths using a set operation 'union' as hereinbefore defined, CN to determine a resultant clipping path; compositing said group of objects from said temporary buffer to said main buffer through said resultant clipping path using said specified compositing operation; and displaying said main buffer using a display device.

2. A method according to claim 1, wherein at least one of said objects has less than 100% opacity.

3. A method according to either of claims 1, wherein said group of objects has less than 100% opacity.

4. A method according to any of claims 1, 2 or 3, wherein said specified compositing is a 'clear' compositing operation as hereinbefore defined. A method according to any of claims 1, 2 or 3, wherein said specified compositing operation is an 'in' operation as hereinbefore defined. 694628AU.doc (767506v1) -24- O O 6. A method according to any of claims 1, 2 or 3, wherein said specified compositing O operation is a 'rin' operation as hereinbefore defined.

7. A method according to any of claims 1, 2 or 3, wherein said specified compositing oO 0 5 operation is an 'out' operation as hereinbefore defined. n 8. A method according to any of claims 1, 2 or 3, wherein said specified compositing CI operation is an 'ratop' operation as hereinbefore defined.

9. A method according to any of claims 1, 2 or 3, wherein said forming comprises rendering each of said objects in said group to said temporary buffer. A method according to claim 9, wherein said rendering is performed sequentially and said deriving is performed for each said object, as each said object is rendered.

11. A method according to any of claims 1, 2 or 3, wherein said main buffer, prior to said compositing, comprises a rendering of at least one further graphical object.

12. A method according to any of claims 1, 2 or 3, wherein said deriving of said clipping path is performed using a path defining said object, where said object defines one of shapes and text.

13. A method according to any of claims 1, 2 or 3, wherein said deriving of said clipping path is performed, for a stroked object, by converting the stroked path to a clipping path. 694628AU.doc (767506v1) O O 14. A method according to any of claims 1, 2 or 3 wherein said deriving of said clipping path is performed, for a bitmap image object, using an edge or extent of the bitmap image object. oO N, A method according to any of claims 1, 2 or 3, wherein when one said object is an effect object having a region in which the effect operates, said deriving of said clipping N path comprises converting the extent of said region to the clipping path.

16. A method according to claim 1, wherein said compositing step comprises the sub- steps of: compositing said main buffer onto said group of objects in said temporary buffer using a compositing operation that is complementary to said specified compositing operation; copying said temporary buffer onto said main buffer through said resultant clipping path.

17. A method according to claim 1, wherein said compositing step comprises the sub- steps of: copying said main buffer; compositing said group of objects from said temporary buffer to said main buffer copy using said specified compositing operation; copying said main buffer copy onto said main buffer through said resultant clipping path. 694628AU.doc (767506vl) -26- O

18. A method according to claim 1, wherein said objects are opaque and said O compositing step comprises the sub-steps of: compositing said group of objects from said temporary buffer to said main buffer using a second compositing operation that is derived from said specified compositing 00 5 operation. S19. An apparatus for compositing a group comprising a plurality of graphical objects, Ci said apparatus comprising: object forming means for forming said group of objects in a temporary buffer; clipping path deriving means for deriving a corresponding clipping path for each object in said group of objects; combining means for combining said clipping paths using a set operation 'union' as hereinbefore defined, to determine a resultant clipping path; compositing means for compositing said group of objects from said temporary buffer to a main buffer through said resultant clipping path. A computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to composite a group comprising a plurality of graphical objects, said program comprising the steps of: code for forming said group of objects in a temporary buffer; code for deriving a corresponding clipping path for each object in said group of objects; code for combining said clipping paths using a set operation, 'union' as hereinbefore defined, to determine a resultant clipping path and 694628AU.doc (767506v1) -27- O O code for compositing said group of objects from said temporary buffer to a main O buffer through said resultant clipping path.

21. A method of compositing a group comprising a plurality of graphical objects onto a OO 0, 5 main buffer using a specified compositing operation, said method comprising the steps of: Sforming said group of objects in a temporary buffer; Sderiving a corresponding clipping path for each object in said group of objects; CN combining said clipping paths using a set operation, 'union' as hereinbefore defined, to determine a resultant clipping path; compositing said main buffer onto said group of objects in said temporary buffer using a compositing operation that is complementary to said specified compositing operation; copying said temporary buffer to said main buffer through said resultant clipping path; and displaying said main buffer using a display device.

22. A method of compositing an opaque graphical object comprising at least one curved edge onto a second opaque graphical object using a 'clear' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using a 'rout' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device. 694628AU.doc (767506v1) I -28- O O 23. A method according to claim 22, wherein said opaque graphical object is a group O comprising a plurality of further opaque graphical objects.

24. An apparatus for compositing a group comprising a plurality of graphical objects 00 0 5 onto a main buffer using a specified compositing operation, said apparatus comprising: (N Sobject forming means for forming said group of objects in a temporary buffer; Q clipping path deriving means for deriving a corresponding clipping path for each CN object in said group of objects; combining means for combining said clipping paths using a set operation, 'union' as hereinbefore defined, to determine a resultant clipping path; compositing means for compositing said main buffer onto said group of objects in said temporary buffer using a compositing operation that is complementary to said specified compositing operation; and copying means for copying said temporary buffer to said main buffer through said resultant clipping path. A computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to composite a group comprising a plurality of graphical objects onto a main buffer using a specified compositing operation, said program comprising: code for forming said group of objects in a temporary buffer; code for deriving a corresponding clipping path for each object in said group of objects; code for combining said clipping paths using a set operation, 'union' as hereinbefore defined, to determine a resultant clipping path; 694628AU.doc (767506v1) -29- O O code for compositing said main buffer onto said group of objects in said temporary O buffer using a compositing operation that is complementary to said specified compositing operation; and code for copying said temporary buffer to said main buffer through said resultant 00 S 5 clipping path. t 26. A method of compositing an opaque graphical object, stored on a computer- CN readable medium, comprising at least one curved edge onto a second opaque graphical object using a 'src' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using an 'over' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device.

27. A method of compositing an opaque graphical object, stored on a computer- readable medium, comprising at least one curved edge onto a second opaque graphical object using an 'in' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using an 'atop' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device. 694628AU.doc (767506v1) O O O 28. A method of compositing an opaque graphical object, stored on a computer- readable medium, comprising at least one curved edge onto a second opaque graphical object using a mathematical 'rin' compositing operation as hereinbefore defined, said 00 5 method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using a S'dst' compositing operation as hereinbefore defined, wherein pixel values outside said at CN least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device.

29. A method of compositing an opaque graphical object, stored on a computer- readable medium, comprising at least one curved edge onto a second opaque graphical object using a mathematical 'out' compositing operation as hereinbefore defined, said method comprising at least the steps: compositing said opaque graphical object onto said second graphical object using an 'xor' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and displaying said graphical objects using a display device. A method of compositing an opaque graphical object, stored on a computer- readable medium, comprising at least one curved edge onto a second opaque graphical object using a mathematical 'ratop' compositing operation as hereinbefore defined, said method comprising at least the steps: 694628AU.doc (767506v1) -31- O compositing said opaque graphical object onto said second graphical object using O an 'rover' compositing operation as hereinbefore defined, wherein pixel values outside said at least one curved edge of the boundary of said opaque graphical object are unaffected; and 00 0 5 displaying said graphical objects using a display device. N n 31. A method of compositing a group comprising a plurality of graphical objects onto a CN main buffer using a specified compositing operation, said method being substantially as herein before described with reference to any one of the embodiments as that embodiment is shown in the accompanying drawings.

32. An apparatus for compositing a group comprising a plurality of graphical objects, said apparatus being substantially as herein before described with reference to any one of the embodiments as that embodiment is shown in the accompanying drawings.

33. A computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure to composite a group comprising a plurality of graphical objects, said program being substantially as herein before described with reference to any one of the embodiments as that embodiment is shown in the accompanying drawings. Dated 29 November 2007 CANON KABUSHIKI KAISHA Patent Attorneys for the Applicant SPRUSON FERGUSON 694628AU.doc (767506vl)