Definitions

• This invention relates to an image processing apparatus for generating visible output images, including visually distinct objects.
• This invention also relates to a method of generating visible output images, including visually distinct objects.
• Image processing methods and apparatus are disclosed in copending PCT application nos. GB91/02122, GB91/02124, GB92/( 5130699) assigned to the present Assignee and are included herein as part of the present disclosure. Description of Background Art
• images may now be represented in electronic form, in which the image is displayed on a cathode ray tube device or similar apparatus.
• the cathode ray itself may be manipulated in response to vectors which trace the outline of an object, producing images which may be referred to as skeletons or wire frames.
• Vector systems of this type have advantages in that they are memory efficient and may generate image data at a definition which is independent of the definition of the display device.
• images may be produced on a cathode ray tube by raster scanning techniques, in which the whole of the screen is scanned periodically and the intensity of the cathode ray is modified in response to image data.
• Raster scanning in this way is employed in televsision systems and raster scan monitors are readily available.
• An advantage of the raster scanning approach is that pixel values may be stored in a frame store representing not only the outline of the image but also the overall colour and texture of the image. Thus, very realistic images may be produced and the amount of storage required to store an image is not dependent upon the level of detail within the image itself. Images stored in framestores in forms compatable with television standards are attractive to the video industry and allow artists to generate graphics for use in television programs. Systems of this type are disclosed in British patent 2059625 which relates to machines manufactured and sold by Quantel Limited under the trade mark "PAINTBOX". The art of manipulating pixel values within a framestore is commonly referred to "video graphics".
• an operator selects the characteristics of the graphics tool he wishes to imitate and then manipulates a pressure sensitive stylus over a digitising pad to input a desired line.
• the apparatus senses the stylus position and the pressure applied thereto, reads image data from a corresponding mapped area of an image store (e.g a frame buffer) modifies the data in accordance with the sensed pressure, and writes it back into the store.
• an image store e.g a frame buffer
• the system is arranged and intended to simulate conventional graphics tools, such as pencil paintbrush or airbrush, and the artist exerts control over the parameters of the line "drawn" in the image store in the same way, so that the width and other attributes of the line are controlled as the stylus moves.
• the stored image data comprises a direct representation of the line itself, corresponding to a manually painted line.
• a problem with video graphics systems is that much of the image manipulation can only be done in response to operator commands.
• the image data is stored in a form which can be understood by a human operator and not in a form which can be easily understood by a machine. Consequently, machine manipulation of the image data is difficult.
• image data is stored in machine readable form and final images are produced on a frame by frame basis in a process known as rendering.
• Complex computer graphics algorithms are known, capable of producing very impressive images.
• the rendering process may take several hours to complete, even when running on very fast machines. Such a situation may be acceptable when producing glossy one off images but in many applications such a demand on computer time is unacceptable and cannot compete with human operation.
• An example of an operation in which a large number of images must be produced at reasonable cost is animation.
• an animator produces a series of key frames as very rough pencil sketches.
• the animators skill is that of being able to work in the temporal domain.
• Other artists are then required to complete each of the key frames and, furthermore, to create inbetween frames, thereby providing sufficient frames such that, when shown as a sequence at sufficient speed, smooth movement of characters is perceived by a viewer.
• a brush stroke is first defined by data specifying the linear trajectory of the brush (as point positions and tangents), and the pressure applied to the brush (which in turn specifies the width of the stroke normal to the line running along the trajectory), and then the colour profile laterally across the brush stroke is specified by the user defining a profile of individual bristle colours laterally across the brush stroke. It is suggested that profiles could be defined at the start and end of the stroke, and the colour profile along the stroke be interpolated from the end values.
• WO84/02993 shows a system for generating images, in which an image path is dictated by Bezier control points. It is possible to vary the width of the entire stroke defined by the path, as a whole, but not to provide a varying width along the stroke; the object of that proposal is to create a stroke of uniform width.
• an image processing apparatus for generating visible output images, including visually distinct objects, characterised by processing means for generating displayable image data; input means for supplying operator defined input signals to the processing means, said input signals defining boundary lines for said objects and a sectional line identifying two boundary lines as defining an object; and storage means for storing data generated in response to said input signals and for storing attribute data defining visual attributes of the object.
• the processing means includes a programable processing unit and video frame storage means, wherein said displayable image data are generated by repeatedly reading pixel data from the frame storage means.
• the memory means stores data relating to the position of selected points defining points on boundary lines and sectional lines and the processing means calculates the position of the boundary lines and the sectional lines in response to data read from the memory means.
• a plurality of sectional lines connect the boundary lines, each sectional line having operator defined attribute data associated therewith.
• end sectional lines connect the ends of the boundary lines defining a closed object.
• the attribute data may define the colour and transparency of an object, each of which is variable across a sectional line.
• pixel values within an object area are rendered by interpolating attribute data between sectional lines.
• the position of boundary lines may be calculated at a greater definition than that of pixel positions within the frame storage means and values accorded to pixels of boundaries may depend upon the degree to which a pixel region is occupied by an object.
• the definition of the boundary lines may be eight times that of the pixel positions, providing smooth anti-aliased lines, after a rendering process.
• a method of generating visible output images including visually distinct objects characterised by the steps of supplying operator defined input signals to a processing means, defining boundary lines and a sectional line, said sectional line identifying the boundary lines as defining an object, storing data generated in response to said input signals, storing attribute data defining visual attributes of the object and generating displayable image data in response to said stored data.
• the boundary lines are defined as Bezier curves and data is stored representing the position of the fixed ends of the curves, along with tangent points.
• the sectional lines may be straight lines.
• said sectional lines may also be Bezier curves, defined by data similar to that for defining the boundary lines.
• Figure la shows a curved line
• Figures 1b and 1c shows straight line approximations to the curved line of Figure la and Figures Id and le shown Bezier curves
• Figure 2a shows the effect of modiyfing the length of a tangent vector to a Bezier curve
• Figure 2b shows the effect of modifying the direction of a tangent vector for a Bezier curve
• Figure 3 shows an image processing apparatus, including processing elements, storage elements and interface elements
• Figure 4 schematically shows the arrangement of data in a memory forming part of the apparatus shown in Figure 3;
• Figure 5a and 5b show displays produced by the apparatus shown in Figure 3;
• Figure 5 shown a schematic representation of data stored in memory forming part of the apparatus shown in Figure 3;
• Figure 7 shows a schematic representation of the functional elements of an apparatus for generating a display;
• Figure 8 shows a schematic representation of the process by which the apparatus produces a display;
• Figure 9 shows a schematic representation of the functional elements of the apparatus of Figure 3, for allowing the input of data to produce a display;
• Figure 10 shows a process performed by the apparatus for receiving input data
• Figure 11 shows a schematic represetation of the functional elements of the apparatus for producing a dispaly
• Figure 12 illustrates boundary lines and sectional lines defining the position of an object, including a plurality of regions
• Figure 13 details one of the regions shown in Figure 12, including a plurality of strips;
• Figure 14 details one of the strips shown in Figure 13.
• Figure 15 shows a schematic representation of an arrangement forming part of the apparatus.
• Figure 16 schematically shows a process performed by the apparatus.
• Parametric curves are referred to in, for example, "Interactive Computer Graphics", P Burger and D Gillies, 1989, Edison Wesley, ISBN 0-201-17439-1, and "An Introduction to Splines for Use in Computer Graphics and Geometric Modelling", by R H Bartels, J C Beatty and B A Barsky, published by Morgan Kaufmann, ISBN 0-934613-27-3 (both incorporated herein by reference).
• a fairly smooth freehand curve is shown.
• one way of representing the curve would be to draw a series of straight line segments, meeting at points.
• the number of straight line segments has to be large, as illustrated in Figure 1c, before the simulation is at all convincing.
• the curve may be represented as a series of curve segments running between points. If, as in Figure 1d, adjacent curve segments have the same slope at the point of which they join, the curve can be made smooth.
• x a x t 3 + b x t 2 + c x t + d x (1)
• y a y t 3 + b y t 2 + c y t + d y (2)
• x 1 a x + b x + c x + d x ( 3 )
• y 1 a y + b y + c y + d y ( 4 )
• the slope of the curved segment is also fixed or predetermined so that each segment can be matched to its neighbours to provide a continuous curve, if desired.
• the shape of the curve between the end points is defined by the slopes at the end points and by a further item of information at each point, which is conveniently visualised as the length of a tangent vector at each point.
• the curve between the two points may be thought of as clamped at its end points, with fixed slopes thereat, while the tangent vectors exercises a pull on the direction of the curve, proportional to their length so that, if the tangent vector is long, the curve tends to follow the tangent over much of its length.
• the data used to define a curve segment is the coordinates of the end points, the slope of the tangent vector at each end point and the length of each tangent vector.
• the data used to define a curve segment are the coordinates of the end points, and the coordinates of the ends of each tangent vectors. Conversion between the Hermite and Bezier format is merely a matter of converting between polar and rectangular coordinates.
• Figure 2a shows the effect of varying the magnitude or lengths of the tangent vectors, while keeping their angle constant. It will be seen that the effect is to "pull" the curve towards the tangent vector, more or less strongly depending on the length of the tangent vector.
• Figure 2b shows the effect of varying the angle of the tangent vector while keeping its magnitude fixed.
• a smooth curve is defined by a number of such end points, and two adjacent segments will share a common end point. If the curve is to be smooth, the tangent angles defined at the end point in relation to each curve segment will be equal, although the tangent vector lengths will in general not be equal.
• a significant advantage of this form of curve representation is that a smooth, bold curve can be defined using only a small number of coefficients or control points, and parts of it can be amended without extensive recalculation of the whole line.
• apparatus comprises a computer 100 comprising a central processing unit 110, a memory device 120 for storing the program sequence for the CPU 110 and providing working read/write memory, a frame store 130 comprising a series of memory locations each associated with, or mapped to, a point in an image to be generated or processed, and an input/output controller 140 providing input and output ports for reading from and writing to external devices, all intercoupled through common parallel data and address buses 150.
• a monitor 160 is connected to the computer 100 and its display updated from the frame store 130 under control of the CPU 110.
• At least one user input device 170a, 170b is provided; typically a keyboard 170b for inputting commands or control signals for controlling peripheral operations such as starting, finishing and storing the results of an image generation or image processing operation, and a position sensitive input device 170a such as, in combination, a stylus and digitising tablet, or a "mouse", or a touch sensitive screen on the monitor 160, or a "trackerball” device or a joystick.
• a cursor symbol is generated by the computer 180 for display on the monitor 160 in dependence upon the signal from the position sensitive input device 170a to allow a user to inspect an image on the monitor 160 and select or designate a point or region of the image during image generation or processing.
• a mass storage device 180 such as, for instance, a hard disk device is preferably provided as a long term image store, since the amount of data associated with a single image stored as a frame at an acceptable resolution is high.
• the mass storage device 180 also or alternatively comprises a removable medium storage device such as a floppy disk drive, to allow data to be transferred into and out from the computer 100.
• printer 190 for producing a permanent visual output record of the image generated.
• the output may be provided on a transparency or on a sheet of paper.
• a picture input device 195 such as a scanner for scanning an image on, for example, a slide, and inputting a corresponding video image signal to the computer 150 may also be provided.
• a suitable computer 100 is the NeXTCUBE computer including the NeXTdimension colour board, available from NeXTComputer, Inc., USA. This arrangement provides direct formatted outputs for connection to a videocassette recorder or other video storage device, and accepts video input signals. Further, it includes means for compressing images for storage on a disk store 180, and for decompressing such stored images for display.
• the frame store device 130 comprises a pair of image stores 130a, 130b.
• the image store 130a stores the image point, or pixel, data for the image to be generated or processed.
• the second area, 130b stores a supervisory or control image displayed during generation or processing of the image stored in the store 130a.
• the supervisory image may be represented at a lower resolution than the generated image and/or in monochrome and hence the image store 130b may be smaller than the store 130a.
• the appearance of the contents of the generated image store 130a when displayed on the monitor 160 or output by the printer 180, comprises, as shown, objects a,b each having a trajectory and an background c also possess colour (or in a monochrome system, brightness).
• the system of the preferred embodiment is arranged to generate visible output images, including visually distinct objects. These objects may be perceived as representing strokes of a graphic implement, such as a pen, pencil, brush or air brush. However, the stokes or objects may have sophistacted characteristics, such as variations in colour across their widths, which are not attainable by a single stroke of a traditional implement.
• Image data may be full colour pixel related data displayable on a video monitor.
• the pixel data is held in frame store 130b and the definition of this data, that is to say, the number of pixel locations present within frame store 130b, is dictated by the definition required for the final output image.
• image data may be produced for broadcast television purposes, high definition television or film, requiring higher levels of definition.
• the processing system for generating displayable image data also includes a programable processor for generating the displayable image data in response to operator defined data.
• an input device which may consist of a mouse, a trackerball or a stylus and touch tablet combination, for example, or any other suitable user interface for defining two dimensional coordinate locations.
• the operator does not define image data directly, unlike the aforesaid video graphics equipment and is instead provided with a system for defining objects in a machine readable form by defining boundary lines and a sectional line.
• Display data relating to boundary lines and sectional lines is stored in a supervisory frame store, 130b, which, typically, has a lower definition than the image store 130a.
• Boundary lines define the outer edge of an object and a sectional line connects boundary lines, thereby identifying the connected boundary lines as outlining an object.
• image store 130a In addition to frame store 130b, for storing positional data generated by an operator, storage is also provided for storing attribute data, which defines visual attributes of the object. Thus, these attributes define the colour of the object and its transparency. Colour and transparency values are then generated for each pixel location, therefore image store 130a has pixel locations of sufficient depth for storing colour and transparency. Colour in the image store may be stored as luminance plus colour difference signals or, preferably, as full colour RGB signals.
• Supervisory store 130b identifies supervisory data which may be represented in a plurality of colours, although full colour storage is not required.
• the contents of the generated image frame store 130a therefore comprise a plurality of point data defining colour and/or intensity of each of a plurality of points to be displayed to form the display shown in FIG 5A, for example, 500 ⁇ 500 image point data, each comprising colour or brightness information as a multi-bit digital number.
• 500 ⁇ 500 image point data each comprising colour or brightness information as a multi-bit digital number.
• several bits representing each of Red (R), Green (G) and Blue (B) are provided.
• the frame store 130a is of the type which stores additionally a transparency value for each image point to allow the generated image to be merged with another image.
• the address within the store 130a of given point data is related, or mapped, to its position in the display of FIG 5A, which will hereafter be referred to in X (horizontal position) and Y (vertical position) Cartesian co-ordinates.
• the contents of the supervisory image store 130b comprise point data for a plurality of points making up the image of FIG 3B; in this case, however, the display may comprise only a monochrome line and the point data may for each point merely comprise a single bit set to indicate either a dark point or a light point.
• a line shown on the supervisory display image in FIG 5B is therefore represented by a plurality of pixel values at corresponding X,Y positions within the supervisory image store area 130b.
• this representation of the line is difficult to manipulate if the line is to be amended.
• a second representation of the line is therefore concurrently maintained in the working memory area 121 of the memory device 120.
• This representation comprises a plurality of data defining the curve in vector form.
• the curve 13 is represented by the position of points ("control points") between which intervening curve values can be derived by calculation.
• display frames consisting of line drawings of objects, are created and/or edited with reference to stored control point data, preferably data stored in the Bezier format referred to above.
• a stored representation of a display frame comprises a plurality of control points which define line segments which make up a line representation.
• a table 122 is provided in the working memory 121 storing the control point data for that line as shown in FIG 4.
• the data are stored as a plurality of point data each comprising point x,y co-ordinates, and data representing slope value for the tangent to the curve at those coordinates, and a tangent magnitude parameter indicating (broadly speaking) the extent to which the curve follows the tangent.
• This format is used, for example, in control of laser printer output devices.
• the data may be stored as point coordinates x and y, and tangent angle and length (Hermite form), but is conventionally and conveniently stored as point coordinates x and y and tangent end coordinates.
• 'Bezier' format will be used to describe both. Full details will be found at "An Introduction to Splines For Use in Computer Graphics and Geometric Modelling" R H Bartels et al, especially at pages 211-245, published by Morgan Kaufmann, ISBN 0-934613-27-3.
• Each control point is thus represented by data comprising positional data (x i ,y i ) representing the position within the area of the display of that control point, and tangent data (x ei ,y ei , x fi ,y fi ) defining two tangent end points associated with the curved segments on either side of the control point.
• the tangent extent point data (x ei ,y ei , x fi ,y fi ) are stored as position data X, Y defining the position of the tangent end point. It would also be possible to store instead the x,y offsets from the control point position.
• Complex curved lines can be represented by a number of such control points, two (at least) for each inflexion in the line.
• the control points stored in the line table 122 each define, between adjacent points, a line segment described by a corresponding cubic equation, and are the values at which the parameter t in that equation is 0 and 1.
• intervening points in the line e.g POINT 2
• each is effectively two control points and consequently has data defining two stored tangents.
• the above described Bezier format is particularly convenient, other parametric ways of representing a curve by control points may be employed, such as the B-spline form, in which the curve control points are not required to lie upon the curve which they characterise.
• supervisory display generating means 111 reads the control point data from the corresponding line table 122 in the memory 120, and calculates the values of intervening points on the curve. It then accesses the supervisory display image store 130b and sets the values of the corresponding image points therein, to cause display of the generated line on the monitor 160.
• the line generating means 111 comprises the CPU 110 operating under control of a program stored in a program store area 129 of the memory 120.
• the supervisory display image store 130b is unnecessary and the generating means 111 supplies vector information from the table 122 to the display, for example as a command in the "Postscript" graphics computer language.
• Separate monitor devices 160a,160b could be provided, one for each of the supervisory display and generated display; for instance, the supervisory display monitor may be a monochrome personal computer monitor provided with the computer 100 and the monitor 160b for the generated image a high resolution colour monitor.
• the computer 100 may be arranged to alternately select one of the supervisory display and generated image display for display on the monitor 160, by alternately connecting the frame stores 130a or 130b thereto. Normally, the supervisory display would be shown, except where it is desired to view the effect of editing an object in the generated image.
• a single monitor 160 could be arranged to display both displays adjacent or one overlaying the other as a window.
• the outputs of both the frame stores 130a, 130b may be connected so that the supervisory display overlies the generated image; in this case, the supervisory display may be indicated by dashed lines or in any other convenient manner so as not to be confusable with the generated image.
• the position and tangent data for a pair of adjacent control points is read from the table 122, and the parameters a,b,c,d of equation 1 are derived therefrom.
• a large number of intervening values of the parameter t between 0 and 1 are then sequentially calculated to provide x,y coordinates of interventing points along the line, and these are quantised to reflect the number of image points available in the supervisory display, and corresponding point data in the supervisory image store 130b are set.
• the supervisory display generator 111 accesses the next pair of points in the table 122. This method is relatively slow, however; faster methods will be found in the above Bartels reference.
• the curve or path vector data held within the line tables 122 may have been stored therein from different sources.
• the data may be read from a file within the mass storage (for example disk) device 180.
• they could be derived by fitting a spline approximation to an input curve represented by data derived, for instance, from a scanner or from a user operated digitising pad and stylus.
• a particularly preferred method of allowing the input and modification of the point data will now be described.
• Editing may involve either modifying the trajectory of existing lines or (more rarely) adding new lines. It is therefore necessary both to amend the data held in the frame table 122, and desirably to amend the image data in the image store 130 so as to enable the user to view the effects of the change. It is found that the best way of providing the user with means for amending the frame data stored in the table 122 is to allow him to employ a position sensitive input device 170a, so as to appear to directly amend the displayed representation of the frame on the screen monitor 160.
• a user manipulates the position sensing input device 170a, such as a mouse, by moving the device 170a so as to generate a signal indicating the direction and extent of the movement.
• This signal is sensed by the device input/output controller 140, which provides a corresponding signal to a cursor position controller 112 (in practice, provided by the CPU 110 operating under stored program control) which maintains stored current cursor position data in x,y co-ordinates and updates the stored cursor position in accordance with the signal from the device input/output controller 140.
• the cursor position controller 112 accesses the supervisory display store area 130b and amends the image data corresponding to the stored cursor position to cause the display of a cursor position symbol D on the supervisory display shown on the monitor 160. The user may thus, by moving the input device 170a, move the position of the displayed cursor position symbol D.
• the supervisory display line generator 111 is arranged not only to write data corresponding to the line A into the supervisory display store 130b, but also to generate a display of the control point data. Accordingly, for each control point A 1 ,A 2 , the supervisory image generator 111 writes data representing a control point symbol (for example, a small dark disc) into the image store 130b at address locations corresponding to the control point co-ordinates x,y.
• a control point symbol for example, a small dark disc
• the supervisory image generator 111 preferably, for each control point, correspondingly generates a second control point symbol E 1 located relative to the A 1 along a line defined by the control point tangent data at a length determined by the control point magnitude data; preferably, a line between the two points A 1 and E 1 is likewise generated to show the tangent itself.
• the user signals an intention so to do
• the cursor position controller 112 supplies the current cursor position data to the table 122 as control point position co-ordinates, and the supervisory display generator 111 correspondingly writes data representing a control point symbol into the image store 130b at address locations corresponding to the control point co-ordinates.
• the user then inputs tangent information, for example via the keyboard 170b, or in the manner described below.
• the supervisory image generator 111 will correspondingly generate the line segment therebetween on the supervisory display by writing the intervening image points into the supervisory display store 130a.
• a user manipulates the input device 170a to move the cursor position symbol D to coincide with one of the control point symbols A 1 or E 1 on the display 160.
• the user then generates a control signal, for example by clicking the mouse input device 170a.
• the device input/ output controller 140 responds by supplying a control signal to the cursor position controller 112.
• the cursor position controller 112 supplies the cursor position data to a supervisory display editor 113, (comprising in practice the CPU 110 operating under stored program control) which compares the stored cursor position with, for each point, the point position (X,Y) and the position E of the end of the tangent.
• the display editor 113 is thereafter arranged to receive the updated cursor position from the cursor controller 112 and to amend the point data corresponding to the point A. with which the cursor symbol coincides, so as to move that point to track subsequent motion of the cursor.
• the supervisory display generator 111 regenerates the line segment affected by the control point in question within the supervisory display image store 130b so as to change the representation of the line on the supervisory display.
• Figure 3b represents only lines, and corresponds to, for example, the output of an animation program or a PostScript (TM) page design program.
• the objects a,b shown in Figure 3a correspond to the lines A,B shown in Figure 3b insofar as their general trajectory or path is concerned, but differ therefrom by displaying one or more of the following additional attributes:
• Each object a,b in Figure 5a may be coloured, and the colour may vary along the line of each object.
• the profile of colour across the width of the object may also be non-constant.
• An object a,b may be given the appearance of a semitransparent object positioned in front of the background c, by providing that the colour of a part of the object a, be influenced by the colour of the background c, to an extent determined by an opacity parameter varying between 0 (for a transparent or invisible object, the colour of which is entirely dictated by the colour of the background c) and unity (for an entirely opaque object, the colour of which does not depend on that of the the background c).
• the effect of the opacity of the object is significant when the object is moved, since parts of the object exhibiting some transparency will show an altered appearance depending upon the colour of the background c.
• the objects a,b to be displayed are represented within the frame store 130a, in a similar form to that in which they would be represented by a computer painting system, that is, as an array of pixel data.
• a computer painting system that is, as an array of pixel data.
• changing the representation of attributes in this form requires a very large amount of data processing, since a large number of pixel values must be amended. Further, it is not possible to change the position or shape of a line while leaving other of the above listed attributes unaffected.
• this embodiment Rather than storing colour information for every image pixel in the object a or b, this embodiment accordingly stores information corresponding to attributes of the object associated with predetermined points along the lines shown in the supervisory display and the corresponding values at intervening points in the object are generated by an image generator device 114 shown in Figure 11 comprising, in practice, the CPU 110 operating under stored program control, and the generated image data stored at corresponding positions within the generated image store 130a for display on the generated image display on the monitor 160.
• the generation of an image may be considered as taking place in two stages. Firstly, in response to operator commands, a control image is generated, control data is stored and a representation of this data is supplied to the supervisory store, allowing the data to be interactively viewed by the operator.
• the operator works in relation to a cartisian coordinate reference, the definition of which is user selectable up to the operating constraints of the system.
• a suitable operating environment consists of a work station based around an intel 486 microprocessor, providing 32 bit floating point arithmetic. Thus, any point position may be calculated in 32 bit floating point arithmetic providing a very high spatical definition.
• a notional x/y frame Upon start-up, a notional x/y frame is provided with coordinate locations separated by 1/72 inch points, providing 500 identifiable locations in both the x and y directions. To facilitate detailed work, this area may be zoomed up, by up to a factor of 64 times. However, these values are only arbitrarily defined and may be adjusted to suit a particular environment, if necessary.
• x/y coordinates defining lines are recalculated, thereby retaining line smoothness irrespective of zoom magnification.
• An object generated by the system may be considered as a brush stroke although, given the level of sophistication provided by the system, details such as colouring and transparency may be modified across the stroke and a whole object or a significant part of an object may be represented by a single stroke.
• data representing a single stroke may be sufficient to define a complete cherry stalk, with colouring and shading creating the illusion of depth.
• the extent of a stroke or object is defined by boundary lines.
• Each boundary line is a Bezier curve, generated in response to control points.
• a control point fixes the position of a Bezier curve within the coordinate frame.
• Individual transformations may be performed on the control points, in response to user operations, or affine transformations may be performed on a collection of points.
• Such modifications are stored by modifying data representing the Bezier descriptions and the actual lines resulting from these Bezier descriptions are redrawn on a frame by frame basis.
• Two lines are defined as boundary lines for an object by connecting them with a sectional line.
• a sectional line may connect with a boundary line at a control point, thereby fixing the position of the sectional line or, alternatively, the connecting point need not be a control point and is referred to as an attribute point, in which case the sectional line will be modified in accordance with movements to the boundary line.
• FIG. 12 An example of a stroke is shown in Figure 12.
• supervisory store 130b within frame store 130 ( Figure 3) is active and generates image signals which are supplied to monitor 160.
• a cursor is displayed on monitor 160 which responds, spatially, to operation of the mouse 170a.
• an operator identifies a desire to create a control point C1 and moves the mouse so that the cursor is displayed at the desired position of control point C1.
• the x and y locations of the control point 1 are recorded in working memory, in a table of the form shown in Figure 6.
• the operator now moves the mouse so that the cursor is displayed at the position required for a second control point C2 and on clicking the mouse again, point C2 is created.
• a subroutine for generating Bezier curves is provided and on selecting the second control point C2, a call is made to this subroutine.
• x/y coordinate positions along the Bezier curve are generated and this data is written to the supervisory store 130b, resulting in a boundary line Bl being displayed on the monitor 160.
• boundary lines are drawn with a width of one pixel and cannot be antialiased.
• this line is only a representation of the mathematical definition of the boundary line, which can be rendered at any desired definition.
• control point C3 and C4 are generated which are then connected by a boundary line B2, using Bezier curves.
• a two dimensional object is identified by connecting the boundary lines B1 and B2 together by a sectional line.
• control point C1 is connected to control point C3 by a sectional line S1 and control point C2 is connected to control point C4 by a sectional line S2, thus defining a closed region or object C1, C2, C4, C3.
• the sectional lines S1 and S2 are also Bezier curves and an additional line table, of the type shown in Figure 6, is required to define the position of such sectional lines.
• a third sectional line S3 is generated between control point C5 and C6, again generated by placing the cursor, in response to movements of the mouse, at the required positions along the boundary lines B1 and B2.
• control point C5 and C6 not only identify the position of sectional lines S3 but also control the shape of Bezier curves C1 C5, C5 C2, C3 C6 and C6 C4.
• Sectional lines define attribute data consisting of colour and transparency.
• the colour data stored comprises the colour value for each of a small number of points along the cross-section 53, and the image generating means 114 correspondingly generates the colour values at the intervening points by interpolation therebetween. Colour values are set at a colour control point.
• the positions therebetween of the intervening points could be pre- determined but are preferably selectable by the user, in which case an indication of the position along a sectional line is stored with each value C 2 C 3
• the position data stored comprises a fraction of the distance along the sectional line.
• Opacity or transparency data specifying, as a fraction, the relative dependence of the colour of the object a on the colour data for the object a relative to the colour data for the background, is likewise stored in the line table 122 corresponding to opacity control points H 1 ,H 2 in the same manner as described above for colour data, except that an opacity value is stored rather than a colour value. It is therefore possible to vary the degree of transparency of the object across its section, as well as along its length.
• the image generator 114 is therefore arranged preferably to derive colour data values by interpolating between colour control points, and to do likewise to derive transparency values and, finally, to set the colours of image points stored in the generated image store 130a by reading the stored background colour and forming, for each image point, the interpolated colour value multiplied by the interpolated opacity value, together with the background colour value multiplied by unity less the interpolated opacity value.
• the user to set up the attribute values for an object a to be displayed on the monitor 160, the user generates a control signal (typically by typing an appropriate command on the keyboard 170b, or by. positioning the cursor symbol on a specified part of the screen of the monitor 160 and clicking the mouse, indicating that an attribute is to be input or added to the object.
• a control signal typically by typing an appropriate command on the keyboard 170b, or by. positioning the cursor symbol on a specified part of the screen of the monitor 160 and clicking the mouse, indicating that an attribute is to be input or added to the object.
• the supervisory display editor 113 receives the cursor position from the cursor controller 112, and writes a corresponding attribute control point symbol into a corresponding position in the supervisory display image store 130b, which is consequently subsequently displayed on the monitor 160.
• the stored cursor position indicating the position along the line at which the control point is placed by the user is then processed for storage in the attribute line data within the line table 122 in the memory 120.
• the cursor position is not directly stored since, if the user subsequently repositioned the line as discussed above, the attribute control point would no longer lie on the line. Instead, an indication of the relative position along the line, between its two neighbouring curve control points, is derived and this indication is stored so that the position of the attribute control point is defined relative to the position of the line, regardless of subsequent redefinitions of the line position.
• the value of t at the closest point on the line is derived, for example to set (x-x t ) 2 + (y-y t ) 2 to a minimum.
• the value of the parameter t is then stored as an entry in the attribute data within the line table 122.
• a profile generating means 118 (comprising, conveniently, the CPU 100 acting under stored program control) causes the display 160 to display the contents of a profile display store 130c (as, for example, a display "window" overlying the supervisory display).
• the contents of the profile display store 130c comprise image data defining a horizontal and vertical axes.
• the display represents the profile of opacity across the brush, corresponding to a cross-section along the line A.
• the horizontal axis represents position across the line A between the two lateral extents e 1 ,e 2 .
• the vertical line represents opacity. Both axes are conveniently scaled between 0 and 1.
• the cursor position controller 112 is arranged to write data into the profile display store 130c to cause the display of a cursor symbol D at a position therein defined by movements of the position sensitive input device 170b.
• the user By positioning the cursor symbol at a point between the axes, and generating a control signal, the user signals an opacity value at a given distance across the object a transverse to the line A.
• the corresponding position between the extents e 1 ,e 2 and opacity value thereat are derived by the profile generator 118 from the current cursor position supplied by the cursor tracker 112 and are written into the attribute data held within the line data store 122.
• the profile generator 118 likewise causes the generation, at the current cursor position, of a point symbol. The cursor may then be repositioned, but the point symbol remains.
• the profile generator 118 preferably calculates by interpolation, the coordinates of image data within the profile display store corresponding to intervening points along an interpolated line between the points for which opacity data is stored, and sets the value of those image points within the profile display store 130c, so that when displayed on the display device 160, so as to represent the profile which would be followed at that point.
• Generating a schematic cross-section display of this type is found to be of assistance to a user in visualising the transparency of, for example, an object corresponding to an airbrush stroke.
• the interpolation performed by the profile generator 118 is preferably the same as that which will be performed by the image generator 114.
• the line table 122 is dimensioned to allow storage of two attribute values for each such lateral position C 2 ,C 3 ; as shown in FIG 12, one value is used to perform interpolation to one neighbouring point and the other to the other neighbouring point.
• a corresponding profile display could be provided to allow the input and amendment of other attributes; for instance, brightness (of a monochrome object) or colour (of a coloured object).
• predefined attribute data specifying colour profiles and opacity profiles are also stored on the mass storage device 180 corresponding, for example, to particular paintbrushes or airbrushes, or to particular previously defined objects.
• the user may enter an appropriate command (via the keyboard 170b) to read such predetermined data from the mass storage device 180 into the line data table 122.
• the data stored for each attribute control point can specify all, or only a subset of the available attributes; for instance, it may be used to specify only only colour or opacity.
• the variations across the object a of these attributes may be separately controlled, and independently edited.
• the default predetermined value assigned to each attribute is a flag indicating that the attribute is not set.
• additional sectional lines S4 and S5 are generated, again in the form of Bezier curves.
• the points at which the sectional lines S4 and S5 intersect with boundary lines B1 and B2 are not control points, in that they do not define the shapes of B1 and B2.
• Such attribute points Al A2 are selected from the menu and poisitionally located by means of the mouse, as previously described.
• section line S4 Before section line S4 is created, it would be common for attributes to have been set for sectional lines S1 and S3. After S4 is created, attributes of colour and transparency are generated for sectional line S4 by interperlating values between sectional lines S1 and S3. Thereafter, the colour and transparency of values set along line S4 may be modified by the operator.
• the second stage may be initiated in order to render the stroke into a full colour image stored in the image store 130a of Figure 4.
• Sectional lines S1, S4,' S3, S5 and S2 define regions R1, R2, R3 and R4.
• the first step is to determine the colour and opacity profile for each of these regions.
• Each region between each pair of adjacent sectional lines can be rendered independently and region R2 is detailed in Figure 13.
• the region R2 is divided into a plurality of strips SS1, SS2, SS3 etc between sectional lines S4 and S3.
• the strips SS1 etc are defined by forming additional sectional lines, generated by interpolating sectional lines SS4 and SS3.
• the additional sectional lines are interpolated by transforming sectional lines S4 and S3 so that their end points are at, for example, (0,0) and (0,1) in Cartesian space.
• the curve is translated so that its first end point lies at the origin.
• the translated curve is then rotated about the origin so that its other end point lies along the y axis.
• the curve is then scaled to bring the other end point to coordinate (0,1).
• Strip SS2 is shown in greater detail in Figure 14.
• the strip SS2 is defined by two additional sectional lines ASL1 and ASL2.
• Addtional sectional lines ASL1 and ASL2 have no opacity and colour profiles, these parameters being generated by interpolating the values stored for sectional lines S4 and S3.
• the strip is now divided into quadrilaterals Q1, Q2, Q3, Q4 and Q5 as shown in Figure 14.
• the colour and opacity of each cooner of each qualrilateral is determined, from which colour and opacity values for each pixel within a quadrilateral may be calculated by linerally interpolating these values.
• the strip is divided into qualrilaterals by placing notional control points along lines ASL1 and ASL2. Such control points are positioned at places where colours are defined and then additional points are identified, such that adjacent points may be connected by a straight line, without crossing pixel boundaries. Thus, a quadrilateral may be formed if its edges do not cross a pixel boundary.
• smaller quadrilaterals are formed, such that, for example, straight lines defining quadrilaterals may be drawn to a definition of one eighth of the pixel spacing.
• Pixels falling at the boundary of a quadrilateral are rendered separately, so that contributions from both quadrilateral regions may be combined before the image is placed against a background.
• the attribute data could be arranged to store attributes other than colour and opacity.
• the attribute data could be arranged to store attributes other than colour and opacity.
• linear interpolation is performed, other forms of interpolation, such as Hermite interpolation could be performed if required.

Landscapes

• Processing Or Creating Images (AREA)

Applications Claiming Priority (6)

Publications (1)

Family

ID=26298932

Family Applications (1)

Country Status (2)

• 1992
  • 1992-05-21 AU AU17934/92A patent/AU1793492A/en not_active Abandoned
  • 1992-05-21 AU AU17921/92A patent/AU1792192A/en not_active Abandoned
  • 1992-05-21 EP EP19920910492 patent/EP0586444A1/de not_active Ceased

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events