GB2401522A - Testing whether objects are of interest within a tile of a 3D computer graphic image - Google Patents

Testing whether objects are of interest within a tile of a 3D computer graphic image Download PDF

Info

Publication number
GB2401522A
GB2401522A GB0407045A GB0407045A GB2401522A GB 2401522 A GB2401522 A GB 2401522A GB 0407045 A GB0407045 A GB 0407045A GB 0407045 A GB0407045 A GB 0407045A GB 2401522 A GB2401522 A GB 2401522A
Authority
GB
United Kingdom
Prior art keywords
list
rectangular area
display
bounding box
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB0407045A
Other versions
GB0407045D0 (en
GB2401522B (en
Inventor
Simon Fenney
Sheila Xile
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Imagination Technologies Ltd
Original Assignee
Imagination Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Imagination Technologies Ltd filed Critical Imagination Technologies Ltd
Publication of GB0407045D0 publication Critical patent/GB0407045D0/en
Publication of GB2401522A publication Critical patent/GB2401522A/en
Application granted granted Critical
Publication of GB2401522B publication Critical patent/GB2401522B/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/40Filling a planar surface by adding surface attributes, e.g. colour or texture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/40Hidden part removal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/12Bounding box

Abstract

A display on which a 30 image is to be viewed is subdivided into a plurality of rectangular areas. For each rectangular area a list of objects in the image which may be visible is determined and this is then used to determine how the rectangular area should be shaded for display. In deriving the list of objects a determination of maximum and minimum values for each object in X and Y directions is used and a set of sampling points determined from these values. If a bounding box surrounding the object covers any of the sampling points they are added to the object list or otherwise rejected. Also provided is a method and apparatus for testing edge information for each object against the sample points to determine whether or not the object falls into a rectangular area in a bounding box surrounding the object. The step of testing the edge information includes shifting the edge information by a predetermined amount in dependence of the orientation of each edge.

Description

1 2401 522 IMPROVEMENTS TO A TILING SYSTEM FOR 3D RENDERED GRAPHICS
Field of the Invention
This invention relates to the generation of 3D computer graphics images and describes improvements to techniques described in our British patent 2343603, and earlier related patent, GB2298111.
Background To The Invention
In these systems, the 2D image plane is subdivided into preferably rectangular regions of pixels and, for each such region, a list of the objects that are 'of interest' to that region is compiled. These regions will be referred to as tiles. When the list for a particular tile contains all such objects, the tile can be rendered entirely. An alternative scheme, (as described in our patent application PCT/GB01/02536), allows for partial rendering whereby the list may simply contain a subset of the required objects.
It is important to have a cost-effective means of determining which primitives, typically triangles and line segments, should be placed in which tiles. An example is given in Figure 1. This shows the virtual image plane (e.g. framebuffer) '1', consisting of a collection of pixels, '2'. These pixels are grouped by tiles, '3'.
An example primitive '4', a triangle, is shown. This would then need to be placed or referenced by at least the lists for the shaded tiles, 5. Note that it is permissible to include the primitive in additional tile lists, e.g. such as for tile '6', but it would be incorrect to leave it out any of the shaded tiles.
The process of determining which primitives belong in which tiles is called 'binning' or 'tiling'.
Modern 3D computer games tend to have very high polygon counts and thus a high number of primitives. During the generation of the scene, many of the primitives become too small to be sampled and 46003.uk thus do not affect the image. This happens as the objects which they are used to represent recede into the distance. Storing these very small primitives in tile lists is an unnecessary use of time, memory, and processing effort. In Figure 7, a simple example of a small triangle primitive, '53', is shown against a grid of image pixels, '50'. Typically, pixels, for example '51', are sampled at one point, say the top left corner, '52'. The triangle, '53' falls to cross any of the sample locations and so will not affect the image. In this particular example, this fact can be trivially determined by considering the primitive's bounding box, '54'.
Because this does not contain any 'integer' sampling locations, the primitive is redundant.
In Figures 8 and 9, other small triangles that miss all the sampling points are shown. In these cases, however, a bounding box rejection test will fail to cull these primitives. One naive cost- I saving approach might be to compute the area of the primitive and, if it is small, reject the surface. Unfortunately, this does not always work as a object may have been modelled by, say, by tessellation to small triangles- rejecting all small triangles could easily make the entire object disappear! In 3D computer graphics, it is common for triangular/convex polygonal primitives to be defined with an associated 'winding order' which is typically one of {Both, Clockwise, Anticlockwise).
Winding order is used as performance optimization to eliminate some primitives prior to rendering. This optimization functions such that if, after projection, the primitive has an order of vertices that doesn't match its specified winding order, that primitive can be ignored.
In the IEEE 754 standard, floating point numbers are represented using a sign bit value, sign, an exponent value, ex, and an 'M' bit mantissa value, m, which with the exception of some minor special cases which can be ignored, represents a value equal to (-l)g.2.(1+2M), where 0< m <2M. For 32-bit IEEE floating point numbers, M is 23, but reduced precision maths could use fewer bits.
If a system were converting a normalised IEEE float, x, to a system 46003. uk that uses M bits for the mantissa, then it can be shown that the error in the approximated xvalue, x, obeys the inequality...
M
erróJx,)< M+l |X| eqn 1 Similar expressions for addition and multiplication operations can be derived: err(M+ MY) < errUx)+ err(y) eqn 2 err(X y) errs + err(y)lXI + err(X'L?rr(My) In GB2343603, a method of determining which primitives (i.e. the basic rendering components used to represent objects) are in a particular tile is presented. For each primitive (in particular, a triangle) it first determines a bounding box of candidate tiles and then attempts to eliminate a candidate tile by testing each of the edge equations against certain corner points of that tile. For each edge, only one corner of each tile needs to be tested. If the candidate is not eliminated, then the primitive is added to the tile's list.
There are several inconvenient aspects with the approach described in that patent: (1) The precision of the mathematics used to perform the rejection calculations must be at least as accurate as, or at least give identical results to, that used by the rendering system when that decides which pixels a primitive covers.
An example of a potential problem is shown in Figure 2. A 2x2 subset of the image's tiles, '7', consisting of a number of pixels, 8, is shown along with a boundary edge of a primitive, '9'. Those pixels, shown in grey, represent the pixels that may be deemed to be inside' the primitive by the renderer. Obviously, any tile that 46003.uk contains such a pixel, even if there is only one such pixel, e.g. 10', should also have the primitive included in its list.
This may seem like a triviality, but in practice it may be more complicated. For example, floating point arithmetic may be used to perform the various inside/outside tests, and when rendering a particular tile, the coordinate system may be re-aligned so that rather than using a pixel origin that is at the top left of the image, the rendering may use a local origin, say, at the top left of the tile. Doing this reduces the cost of the hardware needed when rendering inside the tile, however, it would make it very difficult and/or more expensive to have a 'global test' with exactly the same accuracy that can be used for the 'tiling' operation. If there is any deviation in accuracy, then there is a chance that tile '11' might be deemed to not include the primitive and hence cause pixel 10' to be rendered incorrectly.
Even if the mathematics provides exactly the same results as that used inside the renderer, a hardware solution would require a i significant amount of silicon.
An alternative could be to use fixed-point mathematics, rather than floating-point, but this incurs the problem that arbitrary polygons would have to be 'clipped' to the valid supported mathematical range. Clipping is an expensive operation which is preferable to avoid.
(2) The 'test corner' of the tile varies depending on the parameters of the particular edge's line/plane equation. This is an inconvenience, as it requires decisions on a tile-by-tile/edge-by- edge basis.
(3) The system only supported triangles and it is useful to also apply the 'tiling' process to other primitive types such as, thick lines' constructed from parallelograms. Of course, it is I trivial to either convert a parallelogram to a pair of triangles, or even extend the method to support any convex polygon, but for the case of lines a more efficient approach is desirable. I (4) The system does not attempt to address cases where 'tiny' primitives, e.g. those that are around the size of a pixel, are supplied to the tiling engine but don't actually get rendered. Many such primitives, such as those illustrated in Figures 6 thru 8 46003.uk simply will not affect the outcome of the final image because they fall between the 'sampling points' used in the renderer. Adding these to the tile list is thus wasted effort.
Summary of the Invention
Preferred embodiments of the invention presents a method of handling not only the simple case shown in figure 6, but also those that arise in figures 7 and 8.
We have appreciated that although it is desirable to add each (convex polygon) primitive to the minimum set of tile lists, it may be expensive to compute this minimal set and that it is certainly safe to occasionally add extra unneeded tiles, such as '6' shown in Figure 1. It thus becomes apparent that lower precision maths, i.e. cheaper to implement, could be used provided that, if it erred, it always did so in favour of including additional tiles. More precisely, the set of tiles computed by a lower precision approach must be a superset of the correct set of tiles. i As a first embodiment of the invention, a method and apparatus are presented which safely use lower precision calculations.
Furthermore, the system may be tuned to trade-off accuracy, i.e. implementation cost, of the maths against the increased likelihood of additional redundant tiles. The system also has the advantage of using a uniform testing procedure for all edges/tiles.
In a second embodiment of the invention, we have also appreciated that a method of directly tiling line segment primitives that takes advantage of special properties, is desirable. The method presented is cheaper than converting the primitive to an equivalent polygon or polygons.
In a third embodiment, the invention provides a means of, rejecting certain 'small' primitives that are guaranteed not to I influence the image.
Brief Description of the Drawings I
Preferred embodiments of the invention will now be described in detail by way of example with reference to the accompanying diagrams in which: 46003.uk Figure 1 shows a triangular primitive projected onto an image plane and illustrates the minimal set of tiles which are affected by the primitive; Figure 2 shows a 'close up' of a region of four tiles and a primitive edge in which one tile contains only a single pixel that is affected by the primitive; Figure 3 shows an overview of the steps performed when determining if and how to 'tile' a primitive using the invention; Figure 4 shows the steps performed for the tiling of a primitive that has not been rejected due to tiling; Figure 5 shows a tile partially covered by a primitive with a safe' test point for the edge, as described in the prior art of GB2343603, and the preferred sampling location for an embodiment of the invention; Figure 6 shows the shape and orientation of preferred line segment primitives; Figure 7 shows an example of a small primitive that will not be visible if passed to the renderer, but could be rejected or culled using a simple bounding box test; Figures 8 and 9 show examples of small primitives that also will not be visible, but cannot be culled simply using bounding boxes; and Figure 10 shows the steps used in testing whether small polygons can be culled.
46003.uk
Detailed Description of Preferred Embodiments
A preferred embodiment of the invention will be presented with reference to figure 3. As a first step, a primitive, which is preferably a triangle, is input, '14'.
The triangle has vertices, {(x0,y0l(x,y)(x2'y2)}' which are specified using IEEE, 32-bit, floating-point coordinates. As with GB2343603, the bounding box of the primitive is identified by computing the maximums and minimums of both the projected X and Y coordinates values, '15', i.e. Pond =() l Puma = maX(xO,x,x2) P'DiD =min(yO'Y,,Y2) Pymax = max(yO, Y., Y2) These maximums and minimums are determined at full accuracy as this is a relatively cheap operation. As an optimization, it is also possible to test for equality of the vertex positions and reject those triangles that have repeated vertex positions, as these have exactly zero area and will not contribute to the image. At this point, the invention can also reject any primitives that are trivially completely 'off-screen'.
Using the computed bounding box and primitive's coordinates, small primitive culling tests are performed, '16', details of which are given later. If the primitive is deemed to not affect the image, it is discarded, '17', otherwise it is 'tiled', i.e. placed into the relevant tile lists, '18'. The details of the tiling process for the triangle primitive, '18', will now be presented along with extensions to process wide lines. The small object culling, '16' is presented after that.
Our British patent No. 2343603 describes how the edges of a (convex polygonal) primitive can be represented as lines (or plane equations) of the form..
46003.uk Ax + By + C = 0 where A, B. and C are coefficients that depend on the position and orientation of the particular edge and x and y are pixel coordinates. A point, (x,y), in the image plane is defined as being strictly inside a 'clockwise' primitive when 3 Ax+Biy+Ci >0 for all edges, i. Under certain circumstances (e.g. the fill rules described in the computer graphics standard, OpenGL), some edges are also included as being inside the primitive. For the purposes of tiling, where the system can afford to be conservative, all edges can be considered to be part of the primitive and so the inside test for a 'clockwise' primitive is relaxed to: Vi, Aix+Bjy+Ci 20 Anticlockwise' primitives should use a '<' test. For brevity, the document will only describe the clockwise case, as the extension to the other cases will be obvious to one skilled in the art.
For a projected triangle, GB 2343603 also gives the equations for computing the coefficients for the edge test, i.e., if (xi,yi) and (xi+,yi+,) are the end points of an edge, i, then Ai = Hi - Yi+ Bi = Xi+l - Xi Ci = Xiyi+l-Xi+lYi These equations are actually derived from the adjoins of 3x3 matrix that contains just the projected coordinates of the triangle vertices. In some situations it is preferable to calculate the (projected) edges of the triangle without having to project the vertices, i.e. using the homogeneous coordinates. In that situation, 46003.uk the edge equations can also be computed using the corresponding adjoins matrix and, in an alternative embodiment, the tiling operation can be performed using homogeneous coordinates. For brevity, that alternative embodiment will not be presented, but the adaptation will be clear to one skilled in the art.
The overview of the processing steps contained in '18' in the preferred embodiment is now presented with reference to Figure 4.
An initial rectangular region of candidate tiles, limited to the extent of the image plane, is then determined from the primitive's extremities, '22'.
As an optimization in the preferred embodiment, when the set of candidate tiles is only a single tile high and/or a single tile wide, '23', the bounding box can be used directly as all tiles will be required, '24'.
The next step is to compute the edge equations' parameters, 25'. This processing step differs from that of the earlier systems and will be described in more detail shortly.
The process continues by iterating through the candidate set of tiles, '26', testing each candidate against each of the edges, 27'. Only if all edge tests 'pass' is the primitive included in that tile's list. The edge test employed in the invention is also simpler than that presented in GB2343603. In an alternative embodiment, the system could use an alternative order to process the candidate tiles, such as a binary chop, which would eliminate some tiles based on the results of their neighbours.
To understand the edge equation calculations performed in 25', references will now be made to Figure 5. For a given candidate tile, '30', we must consider each of the primitive's edges. In this example, an edge, '31' crosses the tile. The shaded region, '32', represents part of the area inside the primitive. As discussed in GB2343603, although performing an inside test at corner '33' for this particular edge will produce the correct result for this particular edge, it is inconvenient to have to select the sample point on an edge-by-edge basis. Instead, it is preferable to use a uniform sampling location. In the preferred embodiment, this is chosen to be the top left corner '34'. The actual edge equations are adjusted slightly to allow this to be done.
46003.uk Each edge is computed independently and this is now described.
We define the end points (in order of definition) of edge 'i', in original full floating-point precision, to be (xf,yf) and (xf,yf) where osi<2and j=(i+l)mod3. Two comparisons of these data values, xf 2x,f end yf 2yf, are performed and are used as described in the following pseudo code. This pseudo code can be implemented by those skilled in the art in either hardware or software.
0rientationTypes = {TopLeft, TopRight, BottomLeft, BottomRight}; OrientationTypes Mode; BOOL Xj GTE, Yj GTE; // Compare the coordinate values XjGTE:= (xj a= xi); YjGTE:= (yj a= yi); // Determine edge orientation...
IF (XjGTE AND NOT Yj GTE) Mode:= TopLeft; ELSE IF (XjGTE AND Yj GTE) Mode:= TopRight; ELSE IF (NOT Xj GTE AND YjGTE) Mode:= BottomRight;
ELSE
Mode:= BottomLeft; 46003.uk The orientation of the edge determines the adjustments made to the edge equations. This involves computing 'shift' amounts as described in the following pseudo-code; the Tx and Ty values represent the dimensions of a tile in the x and y directions respectively.
IF ((Mode == ToTopLeft) OR (Mode == ToBottomLeft)) x_shift = Tx;
ELSE
x_shift = 0; IF ((Mode == ToTopLeft) OR (Mode == ToTopRight)) y_shift = Ty;
ELSE { 1
y_shift = 0; The logic behind this shift amount is that, rather than moving test point as a function of the edge, each edge will be shifted so that the same test corner can be used for all the edges. It will shortly become apparent to one skilled in the art that it is preferable to choose tile dimensions which are exact powers of two in size, for example, 32x16, as this will result in lower cost implementations.
This shift value is used to compute a news, coefficient for the edge based on the equation C=Xy2-x2y'+x5hf.Ai+y5hif'B' This equation, however, cannot be used directly unless full precision mathematics is employed. Instead we use a 'safe' calculation that can be done with reduced precision.
46003.uk Floating-point mathematics is used with a small number of mantissa bits, M. This will typically be between 8 and 22 bits, with the preferred embodiment using 16 bits.
From inequalities 1, 2, and 3, above, it is apparent that the errors in the floating-point numbers are bounded by their magnitudes. Using these magnitudes directly is inconvenient and so the embodiment simplifies the tests by relaxing the error bounds further. Therefore, as a first step to computing a 'safe' edge equation, the following values, xmagj and ymagi, are computed from the end points such that the following inequalities are obeyed: 2xmag2 maxxjl,xil'Tx)>2xmag- 2Ymag2 maxtyjllylT)>2ymag-i It should be apparent to one skilled in the art, that this is a simple operation when applied to floating point numbers.
From these values and application of the equations 1, 2, and 3, a 'safety margin' value, fslop, is computed thus: fslop, = 13 * 2xmag+ ymag-(M+) Again, this is a simple operation in floating point involving a 'constant' mantissa value (derived from the '13') and some simple integer mathematics to derive the floating-point exponent. . Using the reduced precision mathematics, the edge equation coefficients are calculated as follows: ai = Hi- Yj
M M M
hi = Xj- Xi
M M M
c j = x, y j-x jYi + reship À al + upshift hi + fslopi 1
M M M M M M M
(Note, for anticlockwise primitives, the fslop value should be subtracted in the last equation).
46003.uk Once these values have been computed for each edge, the system' can iterate through the set of candidate tiles, '26'.
The inequality test for each edge in each tile, performed in 27', can be done in several ways. One such possibility is...
aiX +biY+c20
M M M
where X and Y are the coordinates of the top left corner of the candidate tile, but the preferred embodiment uses the following...
biY+C; 2-aiX
M M M
since (1) a floating-point magnitude comparison is slightly less expensive than an addition and (2) since this formulation also allows the left hand side to be held constant while iterating through a row of candidate tiles.
Although floating-point arithmetic has been used in the preferred embodiment, it would also be feasible with some adjustments to employ integer calculations.
Although unit '26' has been described as 'stepping' or iterating' through the candidate tiles, in an alternative embodiment, several candidate tiles could be tested simultaneously.
In an extension to the preferred embodiment, support for wide line segments is also provided, and would re-use many of the facilities provided for the tiling of other triangle/convex primitives. These line segments are preferably of the form shown in; Figure 6, and fall into two classes - those that are predominantly vertical, such as that shown by '40', and those that are predominantly horizontal, such as '41'. They are specified by defining the end points of the central axis, i.e., '42' (x0, y0)' and 43', (x,y). A line segment is chosen to be of the 'mainly vertical' form if || < |AYI and 'mainly horizontal' otherwise. The 'vertical' lines segments are capped by a horizontal line of a known width wx, 44', while the 'horizontal' lines are closed by a vertical section of a alternative known width wy, '45'.
46003.uk As with the triangle primitives, the first step is to compute the bounding box of candidate tiles. Because the preferred embodiment avoids the use of full accuracy mathematics for cost saving purposes, it is not possible to know with 100% certainty which class a particular line segment falls into. For this reason the bounding box calculation will assume that the line segment could have either horizontal or vertical ends. As before, the system can compute min and max values of the end points cheaply. For the preferred embodiment, a bounding box on the segment is set to be: (Xbound non Abound Fax) t(min(XO' XI) 2),(max(xO,x')+ 2): (Yboundn Yboundx)= :(min(yO'YI)- 2),(maX(yO,y)+ 2); This then determines the set of candidate tiles and steps 22, 23, and 24 are applied as before.
For the testing of edges, the invention only needs to consider the two edges that are parallel to the central axis, as the end caps have effectively been tested as part of the bounding box. These will be called EdgeO and Edgel. The computation of EdgeO's a and b values is done as before: an = YO - Y'
M M M
ho = x - XO
M M M
The computation EdgeO's C co-efficient, CO now proceeds as
M
follows: The orientation of the edge is determined as described previously, and then the shift amounts are computed using the following method: 46003.uk IF ((Mode == ToTopLeft) OR (Mode == ToBottomLeft)) x_shift = (Tx + w_x/2);
ELSE
x_shift = (-w_x /2); IF ((Mode == ToTopLeft) OR (Mode == ToTopRight)) y_shift = (Ty + w_y /2);
ELSE
y_shift = (-w_y/2); The remainder of the calculation for cods then exactly the same as
M
previously, i.e.....
Ci = Xi Y;-Xj yi + Xshift al + Yshift À k + fSIopi
M M M M M M M
where i=0,j=l.
For edger, the 'a' and 'b' values are simply negatives of EdgeO's values, while its c coefficient is computed using the above procedure.
We now describe the steps taken in unit '16' of the preferred embodiment, i.e. the testing for small primitives that can be rejected during tiling because they will not be sampled by the renderer. Although this will be discussed in reference to triangle primitives, this aspect can also be applied to the line segment primitives but, for brevity, this will not be covered here, as its application will be apparent to those skilled in the art. Similarly, the discussion only covers 'clockwise' primitives, as the modifications to support the other 'culling' types are also 46003.uk straightforward. The embodiment uses a pixel sampling point that is located at the top left corner of the pixel. Other possibilities, such as choosing the centre of the pixel, could be achieved by offsetting the primitive.
The processing is described with reference to Figure 10. Using the primitive's maximum and minimum values, as computed in step 21', the system determines a set of 4 pixel sampling locations, {S00'Solslosll}, '80', as follows...
Sxmin = IPxmin1 Sxmax = LPxmaxA Symin Pymin 1 Symax LPymax] 500 (Sxmin Symin) SO I (sx max sy min) 510 (Sxmin SymaX) 511 (Sxmax Symax) where Lx] and axe are the standard 'floor' and 'ceiling' operators. As examples, in Figure 7, S00 and Sl0 are indicated by '55' and '56' respectively, while in Figure 9, they are indicated by '73' and '71' respectively. Note that the positions of these appear to swap due to the relative sizes of the bounding boxes and the behaviour of 'floor' and 'ceiling'.
In step '81', the bounding box of the primitive is tested to see if it misses all sampling points, i.e. testing for trivial cases, an example of which is shown in Figure 7. If this is the case, the primitive is culled, '82'. The test in '81' can be summarized as: IF ( Sxmin > sxmax OR Symjn > Symax) THEN CULL This test, however, will not cull the examples shown in Figures 8 and 9.
Because it is not cost effective to consider primitives larger than a certain size, the preferred embodiment limits its small object culling tests to those primitives whose chosen sampling locations are spread out no further than a lxl pixel area. Step '83' tests for this condition and if the primitive is deemed to be too 46003.uk large, it is not tested for culling, '84'. The test performed in 83' is: IF ( ( Sxmax-Cumin) > 1) OR ( Symax-Symin) 1) THEN KEEP The invention now tests each of the four sampling points to see if they are inside the primitive: As before, the edge coefficients, '85' are computed using the previously specified edge equations. In this situation, however, because the range of numbers is so small, the calculations can be done in 'high precision' very cheaply using fixed-point mathematics.
Note that there are at most three possible cases to consider: That of only one distinct sampling point, two distinct sampling points (as shown by '61' and '62' in Figure 8), or four distinct sampling points (as shown by '71', '72', '73i, and '74' in Figure 9) . In the preferred embodiment, up to four sample locations can be tested, '86', against each edge quite cheaply by noting that the four test inequalities for an edge for the situation with the four distinct sampling locations are: AiSXmjn+BiSymin+ Ci20 AiSxmax+BiSymin+ Ci20 = Ai(Sxm;n+l)+BiSymin+ Ci20 i =) AiS:mjn+BiSymjn+ Ci2-A AiSxmjn+BiSymax+ Ci20 => AiSXmjn+ BiSymjn+ Ci2-B AiSxmax+BiSymax+ Ci20 => AiSXmjn+BiSymjn+ Ci2-Bi-A 46003.uk As can be seen, the same basic calculation is reused, i.e. A'SXnjn+BiSynjn+ Ci and then compares it to the four values, {O,-Ai,-B,,(-Ai-Bi)}. Since the worst case requires four sampling points and since sampling outside the primitive does no harm, the embodiment, for simplicity, tests all of the above conditions regardless of the number of genuinely interesting sampling points.
A sample point is deemed to be outside the primitive if any of the edges fails its test. In '87', if all of the sample locations are outside the primitive, then the primitive is culled, '82', otherwise it is kept, '84'.
In an alternative embodiment, a larger than 2x2 sampling grid could be used.
46003.uk

Claims (18)

1. A method for shading 3-dimensional computer graphics images comprising the steps of: subdividing a display on which an image is to be viewed into a plurality of rectangular areas; for each rectangular area deriving a list of objects in the image which may be visible in that rectangular area; using the list of objects to determine how the rectangular area should be shaded for display; characterized in that the step of deriving a list of objects comprises the steps of: determining maximum and minimum values for each object in x and y directions; determining a set of sampling points from the maximum and minimum values; determining whether or not a bounding box surrounding the object covers any of the sampling points; and adding or rejecting the object from the list in dependence on the result of the determination.
2. A method according to claim 1 including the step of determining whether or not the separation of the sampling points in the x and y directions exceeds the resolution of the display; and adding or rejecting the object from the list in dependence on the result of the determination.
3. A method according to claim 2 in which the resolution of the display comprises the pixel separation of the display.
4. A method according to claim 1, 2 or 3 including the step of testing each sampling point against each edge of the object; determining whether the object covers any sampling point from the testing step, and adding or rejecting the object from the list in dependence on the result of the determination.
46003.uk
5. A method according to any preceding claim including the step of deriving a bounding box for an object to be displayed, and for each object selecting only those rectangular areas which fall at least partially within the bounding box when determining whether or not that object is to be added to the list for a rectangular area.
6. A method for shading 3-dimensional computer graphics images comprising the steps of: subdividing a display for an image into a plurality of rectangular areas; for each object in the image determining a bounding box of rectangular areas into which the object may fall; testing edge information from each object against a sample point in each rectangular area to determine whether or not the object falls into each of the rectangular areas in the bounding box; inserting the object in an object list for a rectangular area in dependence on the result of the determination; and characterized in that the step of testing edge information includes the step of shifting the edge information by a predetermined amount in dependence on the orientation of each edge.
7. A method according to claim 6 in which the step of shifting edge information comprises shifting by either the vertical or horizontal dimension of a rectangular area.
8. A method according to claim 7 in which the shifting step is performed using a floating point calculation.
9. A method according to claim 6, 7 or 8 in which the shifting step-is performed with a safety margin whereby objects will be included in object lists for a rectangular area if the edge information falls close to a sampling point.
10. Apparatus for shading a three-dimensional computer graphics Image compr1slng: means for subdividing a display on which the image is to be viewed into a plurality of rectangular areas; 46003.uk means for deriving for each rectangular area a list of objects in the image which may be visible in that rectangular area; means for determining how the rectangular area should be shaded for display by using the list of objects; characterized in that the means for deriving a list of object comprises; means for determining maximum and minimum values for each object in X and Y directions; means for determining a set of sampling points from the maximum and minimum values; means for determining whether or not a bounding box surrounding the object covers any of the sampling points; and means for adding or rejecting the object from the list in dependence on the result of the determination.
11. The apparatus according to claim 10 including means for determining whether or not the separation of the sampling points in the X and Y directions exceeds the resolution of the display; and means for adding or rejecting the object from the list in dependence on the result of the determination.
12. Apparatus according to claim 11 in which the resolution of the display comprises the pixel separation of the display.
13. Apparatus according to claim 10, 11 or 12 including means for testing each sampling point against each edge of the object; means for determining from the test performed by the testing means whether or not the object covers any sampling point; and means for adding or rejecting the object from the list in dependence on the result of the determination.
14. Apparatus according to any claims 10 to 13 including means for deriving a bounding box for an object to be displayed, and means for selecting for each object only those rectangular areas which fall at least partially within the bounding box when determining whether or not that object is to be added to the list for a rectangular area.
46003.uk
15. Apparatus for shading a three-dimensional computer graphics image comprising: means for subdividing a display for an image into a plurality of rectangular areas; means for determining for each object in the image a bounding box of rectangular areas into which the object may fall; means for testing edge information from each object against a sample point in each rectangular to determine whether or not the object falls into each of the rectangular areas in the bounding box; means for inserting the object in an object list for a rectangular area in dependence on the result of the determination; characterized in that the means for testing edge information includes means for shifting the edge information by a predetermined amount in dependence on the orientation of each edge.
16. An apparatus according to claim 15 in which the means for shifting edge information comprises means for shifting by either the vertical or horizontal dimension of a rectangular area.
17. An apparatus according to claim 16 in which the shifting means uses a floating point calculation.
18. Apparatus according to claim 6, 7 or 8 in which the shifting means uses a safety margin whereby objects will be included in object lists for a rectangular area if the edge information falls close to a sampling point.
46003.uk
GB0407045A 2003-03-27 2004-03-29 Improvements to a tiling system for 3D rendered graphics Expired - Lifetime GB2401522B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GBGB0307095.0A GB0307095D0 (en) 2003-03-27 2003-03-27 Improvements to a tiling system for 3d rendered graphics

Publications (3)

Publication Number Publication Date
GB0407045D0 GB0407045D0 (en) 2004-04-28
GB2401522A true GB2401522A (en) 2004-11-10
GB2401522B GB2401522B (en) 2005-06-15

Family

ID=9955666

Family Applications (3)

Application Number Title Priority Date Filing Date
GBGB0307095.0A Ceased GB0307095D0 (en) 2003-03-27 2003-03-27 Improvements to a tiling system for 3d rendered graphics
GBGB0405615.6A Ceased GB0405615D0 (en) 2003-03-27 2004-03-12 Improvements to a tiling system for 3D rendered graphics
GB0407045A Expired - Lifetime GB2401522B (en) 2003-03-27 2004-03-29 Improvements to a tiling system for 3D rendered graphics

Family Applications Before (2)

Application Number Title Priority Date Filing Date
GBGB0307095.0A Ceased GB0307095D0 (en) 2003-03-27 2003-03-27 Improvements to a tiling system for 3d rendered graphics
GBGB0405615.6A Ceased GB0405615D0 (en) 2003-03-27 2004-03-12 Improvements to a tiling system for 3D rendered graphics

Country Status (5)

Country Link
US (1) US7834872B2 (en)
EP (1) EP1611551B1 (en)
JP (1) JP4690312B2 (en)
GB (3) GB0307095D0 (en)
WO (1) WO2004086309A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2549787A (en) * 2016-04-29 2017-11-01 Imagination Tech Ltd Generation of a control stream for a tile
EP3249612A3 (en) * 2016-04-29 2017-12-13 Imagination Technologies Limited Generation of a control stream for a tile
EP3444775A1 (en) 2017-08-15 2019-02-20 Imagination Technologies Limited Single pass rendering for head mounted displays

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8692844B1 (en) 2000-09-28 2014-04-08 Nvidia Corporation Method and system for efficient antialiased rendering
US8872833B2 (en) 2003-09-15 2014-10-28 Nvidia Corporation Integrated circuit configuration system and method
US8732644B1 (en) 2003-09-15 2014-05-20 Nvidia Corporation Micro electro mechanical switch system and method for testing and configuring semiconductor functional circuits
US8775997B2 (en) 2003-09-15 2014-07-08 Nvidia Corporation System and method for testing and configuring semiconductor functional circuits
US8711161B1 (en) 2003-12-18 2014-04-29 Nvidia Corporation Functional component compensation reconfiguration system and method
US8723231B1 (en) 2004-09-15 2014-05-13 Nvidia Corporation Semiconductor die micro electro-mechanical switch management system and method
US8711156B1 (en) 2004-09-30 2014-04-29 Nvidia Corporation Method and system for remapping processing elements in a pipeline of a graphics processing unit
US8427496B1 (en) 2005-05-13 2013-04-23 Nvidia Corporation Method and system for implementing compression across a graphics bus interconnect
GB0524804D0 (en) 2005-12-05 2006-01-11 Falanx Microsystems As Method of and apparatus for processing graphics
US20070188491A1 (en) * 2005-12-12 2007-08-16 Ensco, Inc. System and method for fast efficient contour shading of sampled data
US8698811B1 (en) 2005-12-15 2014-04-15 Nvidia Corporation Nested boustrophedonic patterns for rasterization
US8390645B1 (en) 2005-12-19 2013-03-05 Nvidia Corporation Method and system for rendering connecting antialiased line segments
US9117309B1 (en) 2005-12-19 2015-08-25 Nvidia Corporation Method and system for rendering polygons with a bounding box in a graphics processor unit
US8928676B2 (en) 2006-06-23 2015-01-06 Nvidia Corporation Method for parallel fine rasterization in a raster stage of a graphics pipeline
US8477134B1 (en) * 2006-06-30 2013-07-02 Nvidia Corporation Conservative triage of polygon status using low precision edge evaluation and high precision edge evaluation
GB2449399B (en) * 2006-09-29 2009-05-06 Imagination Tech Ltd Improvements in memory management for systems for generating 3-dimensional computer images
US8427487B1 (en) 2006-11-02 2013-04-23 Nvidia Corporation Multiple tile output using interface compression in a raster stage
US8482567B1 (en) 2006-11-03 2013-07-09 Nvidia Corporation Line rasterization techniques
US9965886B2 (en) 2006-12-04 2018-05-08 Arm Norway As Method of and apparatus for processing graphics
GB0710795D0 (en) * 2007-06-05 2007-07-18 Arm Norway As Method of and apparatus for processing graphics
JP4370438B2 (en) 2007-06-27 2009-11-25 Necシステムテクノロジー株式会社 Vector image drawing apparatus, vector image drawing method and program
GB2452300B (en) * 2007-08-30 2009-11-04 Imagination Tech Ltd Predicated geometry processing in a tile based rendering system
GB2461821B (en) 2007-09-12 2010-06-30 Imagination Tech Ltd Methods and systems for generating 3-dimensional computer images
US8724483B2 (en) 2007-10-22 2014-05-13 Nvidia Corporation Loopback configuration for bi-directional interfaces
US8063903B2 (en) * 2007-11-09 2011-11-22 Nvidia Corporation Edge evaluation techniques for graphics hardware
US8059119B2 (en) * 2007-12-05 2011-11-15 Stmicroelectronics S.R.L. Method for detecting border tiles or border pixels of a primitive for tile-based rendering
US9064333B2 (en) * 2007-12-17 2015-06-23 Nvidia Corporation Interrupt handling techniques in the rasterizer of a GPU
US8780123B2 (en) 2007-12-17 2014-07-15 Nvidia Corporation Interrupt handling techniques in the rasterizer of a GPU
US8923385B2 (en) 2008-05-01 2014-12-30 Nvidia Corporation Rewind-enabled hardware encoder
US8681861B2 (en) 2008-05-01 2014-03-25 Nvidia Corporation Multistandard hardware video encoder
US8587610B2 (en) * 2008-12-12 2013-11-19 Microsoft Corporation Rendering source content for display
GB0823254D0 (en) 2008-12-19 2009-01-28 Imagination Tech Ltd Multi level display control list in tile based 3D computer graphics system
GB0823468D0 (en) 2008-12-23 2009-01-28 Imagination Tech Ltd Display list control stream grouping in tile based 3D computer graphics systems
US8217962B2 (en) * 2009-01-29 2012-07-10 Microsoft Corporation Single-pass bounding box calculation
US20110063305A1 (en) 2009-09-16 2011-03-17 Nvidia Corporation Co-processing techniques on heterogeneous graphics processing units
KR101609266B1 (en) * 2009-10-20 2016-04-21 삼성전자주식회사 Apparatus and method for rendering tile based
US9530189B2 (en) 2009-12-31 2016-12-27 Nvidia Corporation Alternate reduction ratios and threshold mechanisms for framebuffer compression
US9331869B2 (en) 2010-03-04 2016-05-03 Nvidia Corporation Input/output request packet handling techniques by a device specific kernel mode driver
US9171350B2 (en) 2010-10-28 2015-10-27 Nvidia Corporation Adaptive resolution DGPU rendering to provide constant framerate with free IGPU scale up
US9019280B2 (en) * 2011-07-22 2015-04-28 Qualcomm Incorporated Area-based rasterization techniques for a graphics processing system
US9633458B2 (en) * 2012-01-23 2017-04-25 Nvidia Corporation Method and system for reducing a polygon bounding box
US20130257885A1 (en) * 2012-03-28 2013-10-03 Intel Corporation Low Power Centroid Determination and Texture Footprint Optimization For Decoupled Sampling Based Rendering Pipelines
US9495781B2 (en) * 2012-06-21 2016-11-15 Nvidia Corporation Early sample evaluation during coarse rasterization
US9424685B2 (en) 2012-07-31 2016-08-23 Imagination Technologies Limited Unified rasterization and ray tracing rendering environments
US9218679B2 (en) * 2012-10-08 2015-12-22 Intel Corporation Reduced bitcount polygon rasterization
US9317948B2 (en) 2012-11-16 2016-04-19 Arm Limited Method of and apparatus for processing graphics
US9858709B2 (en) 2012-11-29 2018-01-02 Samsung Electronics Co., Ltd. Apparatus and method for processing primitive in three-dimensional (3D) graphics rendering system
US9591309B2 (en) 2012-12-31 2017-03-07 Nvidia Corporation Progressive lossy memory compression
US9607407B2 (en) 2012-12-31 2017-03-28 Nvidia Corporation Variable-width differential memory compression
GB2511817A (en) 2013-03-14 2014-09-17 Imagination Tech Ltd Rendering in computer graphics systems
US9633469B2 (en) * 2013-03-15 2017-04-25 Nvidia Corporation Conservative rasterization of primitives using an error term
US10204391B2 (en) 2013-06-04 2019-02-12 Arm Limited Method of and apparatus for processing graphics
US9710894B2 (en) 2013-06-04 2017-07-18 Nvidia Corporation System and method for enhanced multi-sample anti-aliasing
CN104516880A (en) * 2013-09-26 2015-04-15 Sap欧洲公司 Block-based graphics layout
GB2520076B (en) * 2013-11-11 2020-07-29 Advanced Risc Mach Ltd Rasterisation in graphics processing systems
GB2526598B (en) * 2014-05-29 2018-11-28 Imagination Tech Ltd Allocation of primitives to primitive blocks
GB2524121B (en) * 2014-06-17 2016-03-02 Imagination Tech Ltd Assigning primitives to tiles in a graphics processing system
US10217272B2 (en) * 2014-11-06 2019-02-26 Intel Corporation Zero-coverage rasterization culling
GB2537659B (en) 2015-04-22 2019-05-01 Imagination Tech Ltd Tiling a primitive in a graphics processing system
GB2537661B (en) 2015-04-22 2018-09-26 Imagination Tech Ltd Tiling a primitive in a graphics processing system
GB2539509B (en) * 2015-06-19 2017-06-14 Advanced Risc Mach Ltd Method of and apparatus for processing graphics
US9959665B2 (en) 2015-07-21 2018-05-01 Qualcomm Incorporated Zero pixel culling for graphics processing
GB2541692B (en) * 2015-08-26 2019-10-02 Advanced Risc Mach Ltd Graphics processing systems
GB2553744B (en) 2016-04-29 2018-09-05 Advanced Risc Mach Ltd Graphics processing systems
GB2574361B (en) 2017-12-18 2021-03-24 Advanced Risc Mach Ltd Graphics Processing
US10726610B2 (en) 2018-08-29 2020-07-28 Arm Limited Efficient graphics processing using metadata

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030122819A1 (en) * 2001-12-31 2003-07-03 Satyaki Koneru Method and apparatus for determining bins to be updated for polygons, including lines

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2251770B (en) * 1991-01-09 1995-01-11 Du Pont Pixel Systems Graphics accelerator system with polygon traversal operation
US5265210A (en) * 1991-11-04 1993-11-23 Calcomp Inc. Method and apparatus for plotting pixels to approximate a straight line on a computer display device without substantial irregularities
US5729672A (en) * 1993-07-30 1998-03-17 Videologic Limited Ray tracing method and apparatus for projecting rays through an object represented by a set of infinite surfaces
GB2298111B (en) 1995-01-31 2000-01-19 Videologic Ltd Improvements relating to computer 3d rendering systems
US5668940A (en) * 1994-08-19 1997-09-16 Martin Marietta Corporation Method and apparatus for anti-aliasing polygon edges in a computer imaging system
US5864342A (en) * 1995-08-04 1999-01-26 Microsoft Corporation Method and system for rendering graphical objects to image chunks
US5809219A (en) * 1996-04-15 1998-09-15 Silicon Graphics, Inc. Analytic motion blur coverage in the generation of computer graphics imagery
US6259452B1 (en) * 1997-04-14 2001-07-10 Massachusetts Institute Of Technology Image drawing system and method with real-time occlusion culling
US6300965B1 (en) * 1998-02-17 2001-10-09 Sun Microsystems, Inc. Visible-object determination for interactive visualization
US6624823B2 (en) * 1998-02-17 2003-09-23 Sun Microsystems, Inc. Graphics system configured to determine triangle orientation by octant identification and slope comparison
US6099573A (en) * 1998-04-17 2000-08-08 Sandia Corporation Method and apparatus for modeling interactions
US6646639B1 (en) * 1998-07-22 2003-11-11 Nvidia Corporation Modified method and apparatus for improved occlusion culling in graphics systems
GB2343603B (en) * 1998-11-06 2003-04-02 Videologic Ltd Shading 3-dimensional computer generated images
US6437780B1 (en) * 1999-03-17 2002-08-20 Nvidia Us Investment Company Method for determining tiles in a computer display that are covered by a graphics primitive
EP1287494B1 (en) * 2000-06-08 2007-03-14 Imagination Technologies Limited Tiling and compression for rendering 3d images
US6760038B2 (en) * 2001-05-31 2004-07-06 Geometric Software Solutions Co. Limited Method for recognizing blends in solid models
JP3981808B2 (en) * 2001-11-19 2007-09-26 信越化学工業株式会社 Injection mold and method for producing injection molded product using the same
US7081903B2 (en) * 2001-12-12 2006-07-25 Hewlett-Packard Development Company, L.P. Efficient movement of fragment stamp

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030122819A1 (en) * 2001-12-31 2003-07-03 Satyaki Koneru Method and apparatus for determining bins to be updated for polygons, including lines

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2549787A (en) * 2016-04-29 2017-11-01 Imagination Tech Ltd Generation of a control stream for a tile
EP3249612A3 (en) * 2016-04-29 2017-12-13 Imagination Technologies Limited Generation of a control stream for a tile
US10140761B2 (en) 2016-04-29 2018-11-27 Imagination Technologies Limited Generation of a control stream for a tile
US10733796B2 (en) 2016-04-29 2020-08-04 Imagination Technologies Limited Generation of a control stream for a tile
GB2549787B (en) * 2016-04-29 2020-09-30 Imagination Tech Ltd Generation of a control stream for a tile
US11410385B2 (en) 2016-04-29 2022-08-09 Imagination Technologies Limited Generation of a control stream for a tile
US11954803B2 (en) 2016-04-29 2024-04-09 Imagination Technologies Limited Generation of a control stream for a tile
EP3444775A1 (en) 2017-08-15 2019-02-20 Imagination Technologies Limited Single pass rendering for head mounted displays

Also Published As

Publication number Publication date
WO2004086309A3 (en) 2004-12-23
JP4690312B2 (en) 2011-06-01
EP1611551B1 (en) 2023-06-28
JP2006521612A (en) 2006-09-21
WO2004086309A2 (en) 2004-10-07
GB0407045D0 (en) 2004-04-28
GB0405615D0 (en) 2004-04-21
US20040246251A1 (en) 2004-12-09
GB2401522B (en) 2005-06-15
EP1611551A2 (en) 2006-01-04
US7834872B2 (en) 2010-11-16
GB0307095D0 (en) 2003-04-30

Similar Documents

Publication Publication Date Title
GB2401522A (en) Testing whether objects are of interest within a tile of a 3D computer graphic image
McCool Shadow volume reconstruction from depth maps
US6437782B1 (en) Method for rendering shadows with blended transparency without producing visual artifacts in real time applications
US6359623B1 (en) Method and apparatus for performing scan conversion in a computer graphics display system
JP5111638B2 (en) Apparatus and method for dividing a parametric curve into smaller subpatches
EP3080781B1 (en) Image rendering of laser scan data
Bala et al. Combining edges and points for interactive high-quality rendering
EP0775982B1 (en) System and method for merging pixel fragments based on depth range values
KR100504421B1 (en) Method and apparatus for attribute interpolation in 3d graphics
US7023437B1 (en) System and method for accelerating graphics processing using a post-geometry data stream during multiple-pass rendering
US6894689B1 (en) Occlusion culling method and apparatus for graphics systems
JP3764478B2 (en) Tessellation system
US5497453A (en) Method and apparatus for detecting and visualizing interferences between solids
US7948487B2 (en) Occlusion culling method and rendering processing apparatus
KR940007905B1 (en) Adjustment of z-buffer values for lines on the surface of a polygon
EP2410492A2 (en) Optimal point density using camera proximity for point-based global illumination
US20140267300A1 (en) Rendering in computer graphics systems
Lindstrom et al. Level-of-detail management for real-time rendering of phototextured terrain
US5926182A (en) Efficient rendering utilizing user defined shields and windows
Wang et al. Second-depth shadow mapping
US8068120B2 (en) Guard band clipping systems and methods
US6741248B2 (en) Rendering geometric features of scenes and models by individual polygons
CA2043176C (en) Z-buffer quantization of three-dimensional lines
US5926183A (en) Efficient rendering utilizing user defined rooms and windows
Mesquita et al. Non-overlapping geometric shadow map

Legal Events

Date Code Title Description
PE20 Patent expired after termination of 20 years

Expiry date: 20240328