US20080158235A1 - Method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system - Google Patents
Method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system Download PDFInfo
- Publication number
- US20080158235A1 US20080158235A1 US11/901,458 US90145807A US2008158235A1 US 20080158235 A1 US20080158235 A1 US 20080158235A1 US 90145807 A US90145807 A US 90145807A US 2008158235 A1 US2008158235 A1 US 2008158235A1
- Authority
- US
- United States
- Prior art keywords
- graphics
- pixel
- gpu
- parallel
- parallel graphics
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/363—Graphics controllers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/52—Parallel processing
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/06—Use of more than one graphics processor to process data before displaying to one or more screens
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/393—Arrangements for updating the contents of the bit-mapped memory
Definitions
- the present invention relates to new and improved ways of and means for carrying out the object division method of parallel graphics rendering on multiple GPU-based graphics platforms associated with diverse types of computing machinery.
- GDL Graphical Display List
- 3D scenes and objects are represented as a complex of geometric models (primitives) in 3D continuous geometric space, and 2D views or images of such 3D scenes are computed using geometrical projection, ray tracing, and light scattering/reflection/absorption modeling techniques, typically based upon laws of physics
- VOXEL VOlume ELement
- 3D scenes and objects are represented as a complex of voxels (x,y,z volume elements) represented in 3D Cartesian Space, and 2D views or images of such 3D voxel-based scenes are also computed using geometrical projection, ray tracing, and light scattering/reflection/absorption modeling techniques, again typically based upon laws of physics.
- 3D graphics subsystem based the “graphics display list (GDL)” system design.
- GDL graphics display list
- objects within a 3D scene are represented by 3D geometrical models, and these geometrical models are typically constructed from continuous-type 3D geometric representations including, for example, 3D straight line segments, planar polygons, polyhedra, cubic polynomial curves, surfaces, volumes, circles, and quadratic objects such as spheres, cones, and cylinders.
- 3D geometrical representations are used to model various parts of the 3D scene or object, and are expressed in the form of mathematical functions evaluated over particular values of coordinates in continuous Cartesian space.
- the 3D geometrical representations of the 3D geometric model are stored in the format of a graphical display list (i.e. a structured collection of 2D and 3D geometric primitives).
- a graphical display list i.e. a structured collection of 2D and 3D geometric primitives.
- planar polygons mathematically described by a set of vertices, are the most popular form of 3D geometric representation.
- the 3D scene is graphically displayed (as a 2D view of the 3D geometrical model) along a particular viewing direction, by repeatedly scan-converting the graphical display list.
- the scan-conversion process can be viewed as a “computational geometry” process which involves the use of (i) a geometry processor (i.e. geometry processing subsystem or engine) as well as a pixel processor (i.e. pixel processing subsystem or engine) which together transform (i.e. project, shade and color) the display-list objects and bit-mapped textures, respectively, into an unstructured matrix of pixels.
- the composed set of pixel data is stored within a 2D frame buffer (i.e. Z buffer) before being transmitted to and displayed on the surface of a display screen.
- a video processor/engine refreshes the display screen using the pixel data stored in the 2D frame buffer.
- FIGS. 1A through 1C In order to distribute the computational workload associated with interactive parallel graphics rendering processes, three different methods of graphics rendering have been developed over the years. These three basic methods of parallel graphics rendering are illustrated in FIGS. 1A through 1C . While these three methods of parallel graphics rendering are different in ways which will be described below, they each have five (5) basic stages or phases in common, namely:
- the parallel graphics platform uses the multiple sets of pixel data generated by each graphics pipeline to synthesize (or compose) a final set of pixels that are representative of the 3D scene (taken along the specified viewing direction), and this final set of pixel data is then stored in a frame buffer;
- the Image Division (Sort-First) Method of Parallel Graphics Rendering distributes all graphics display list data and commands to each of the graphics pipelines, and decomposes the final view (i.e. projected 2D image) in Screen Space, so that, each graphical contributor (e.g. graphics pipeline and GPU) renders a 2D tile of the final view.
- This mode has a limited scalability due to the parallel overhead caused by objects rendered on multiple tiles.
- the Time Division (DPlex) Method of Parallel Graphics Rendering distributes all display list graphics data and commands associated with a first scene to the first graphics pipeline, and all graphics display list data and commands associated with a second/subsequent scene to the second graphics pipeline, so that each graphics pipeline (and its individual rendering node or GPU) handles the processing of a full, alternating image frame.
- this method scales very well, the latency between user input and final display increases with scale, which is often irritating for the user.
- the Object Division (Sort-last) Method of Parallel Graphics Rendering decomposes the 3D scene (i.e. rendered database) and distributes graphics display list data and commands associated with a portion of the scene to the particular graphics pipeline (i.e. rendering unit), and recombines the partially rendered pixel frames, during recomposition.
- This mode scales the rendering process very well, but implementation of the recomposition step is very expensive due to the amount of pixel data processing required during recomposition. Consequently, the practice of the Object Division Method of Parallel Graphics Rendering has not been commercially feasible in the affordable PC computing marketplace, while the Image and Time Division Methods of Parallel Graphics Rendering are being widely practiced in commercial PC-based graphics products, as indicated above.
- a primary and highly desirable advantage associated with the Object Division Method of Parallel Graphics Rendering stems from dividing the stream of graphic display commands and data into partial streams, targeted to different GPUs, thereby removing traditional bottlenecks associated with polygon and texture data processing.
- Applications with massive polygon data such as CAD
- massive texture data such as high-quality video games
- CAD workers and video gamers who typically use PC-based computing systems and workstations have access to computer graphics subsystems that support the Object Division Method of Parallel Graphics Rendering.
- the PC motherboard is populated with a CPU ( 201 ) that is equipped with a memory bridge (i.e. “chipset,” 203 ) (e.g. nForce 680 by Nvidia).
- the memory bridge supports two PCI-express buses ( 207 , 208 ) which are capable of driving two external graphic cards.
- the primary graphics card ( 205 ) and the secondary graphics card ( 204 ) are attached to a display device ( 206 ) such as a LCD panel.
- the architecture of a typical Shader-based graphic card ( 204 , 205 ) comprises a GPU ( 212 ) and video memory ( 213 ).
- the GPU comprises a geometry subsystem (which is transform bound) and a pixel subsystem (which is fill bound).
- the video memory ( 213 ) comprises texture memory ( 218 ), a frame buffer ( 216 ), a command buffer, and a vertex buffer.
- the stream of graphics (display list) data and commands, originating at the host CPU, describes the 3D scene in terms of polygon vertices and bit-mapped textures. As shown, this data stream is provided to the video memory ( 213 ) via PCIexpress bus ( 207 or 208 ).
- the texture memory ( 218 ) plays a central role, and is accessible to and from the chip input, the vertex and fragment shaders, FB ( 216 ), and the blend & raster ops unit ( 217 ).
- the shader hardware ( 214 , 215 ) is realized as a programmable parallel array of processing elements running shader source code written in a graphics-specific programming language.
- the Vertex Shader ( 214 ) specializes in vertex data processing
- the Fragment Shader ( 215 ) specializes in pixel data processing.
- FIG. 3 A 1 there is shown a parallel graphics system supporting the Object Division Method of Parallel Graphics Rendering, as illustrated as in FIG. 1C , but with further emphasis on the Recomposition Stage which is shown carried out using specialized apparatus.
- FIG. 3 A 2 the basic object division recomposition process carried out by such specialized apparatus is schematically illustrated in the form of a flow chart.
- the first step of this pixel composition process involves accessing images (pixel data sets) from first and second frame buffers (FB 1 , FB 20 , each having a color value buffer and a depth value (Z) buffer.
- the second step involves performing a relatively simple process for each x,y pixel value in the frame buffers: advance to the next x,y location; for x,y, compare the depth values in the Z buffers and select the lower value which corresponds to the pixel value closest to the view (along the specified viewing direction); move the corresponding pixel value from the color buffer associated with the winning Z-buffer1 to the final FB.
- FIGS. 3 B 1 and 3 B 2 there is shown a prior art multiple GPU-based graphics subsystem having multiple graphics pipelines with multiple GPUs supporting the Object Division Method of Parallel Graphics Rendering, using dedicated/specialized hardware to perform the basic image recomposition process illustrated in FIG. 3 A 2 .
- Examples of prior art parallel graphics systems based on this design include: the ChromiumTM Parallel Graphics System developed by researchers and engineers of Stanford University, and employing Binaryswap SPU hardware to carry out the image (re)composition process illustrated in FIG. 3 A 2 ; and HP Corporation's PixelFlow (following development of North Carolina University at Chapel Hill) employing parallel pipeline hardware, and SGI's Origin 2000 Supercomputer Shared Memory Compositor method (known also as “Direct Send”) on distributed memory architecture.
- the application's rendering code ( 301 ) which is representative of a 3D scene to be viewed from a particular viewing direction, is decomposed into two streams of graphics (display list) data and commands ( 302 ). These streams of graphics data and commands ( 302 ) are distributed ( 303 ) to the multiple graphics processing pipelines for rendering ( 304 ). Each GPU in its pipeline participates in only a fraction of the overall computational workload. Each frame buffer (FB) holds a full 2D image (i.e. frame of pixel data) of a sub-scene.
- FB frame buffer
- the full image of the 3D scene must be then composed from the viewing direction, using these two full 2D images, and this compositing process involves testing each and every pixel location for the pixel that is closest to the eye of the viewer ( 305 ). Consequently, recomposition according to this prior art Object Division Method of Parallel Graphics Rendering is expensive due to the amount of pixel data processing required during recomposition.
- the recomposed final FB is ultimately sent to the display device ( 306 ) for display to the human viewer.
- the dedicated/specialized hardware-based recomposition stage/phase of the object division mode of the parallel graphics rendering process of FIG. 3 B 1 comprises multiple stages of frame buffers (FBs), wherein each graphics pipeline will have at least one FB.
- FB frame buffers
- each FB there is buffered image data comprising pixel color and depth (z) values.
- These pixel color and depth (z) values are processed according to the basic pixel processing algorithm of FIG. 3 A 2 , so as to ultimately compose the final pixel data set (i.e. image) which is stored in the final frame buffer.
- the pixel data stored in the final frame buffer is then ultimately used to display the image on the screen of the display device using conventional video processing and refreshing techniques generally known in the art.
- GPUs graphics processing pipelines
- the dedicated hardware becomes to practice this prior art hard-ware based recomposition technique during the object division mode of such a parallel graphics rendering platform.
- FIGS. 3 C 1 , 3 C 2 and 3 C 3 there is shown a prior art multiple GPU-based graphics subsystem having multiple graphics pipelines with multiple GPUs supporting the Object Division Method of Parallel Graphics Rendering, using a dedicated/specialized software solution to perform the basic image recomposition process illustrated in FIG. 3 A 2 .
- Examples of prior art parallel graphics systems based on this design include: the Onyx® Parallel Graphics System developed by SGI, and employing pseudocode illustrated in FIGS. 3 C 2 and 3 C 3 , to carry out the image (re)composition process illustrated in FIG. 3 A 2 .
- the application's rendering code ( 301 ) which is representative of a 3D scene to be viewed from a particular viewing direction, is decomposed into two streams of graphics (display list) data and commands ( 302 ). These streams of graphics data and commands ( 302 ) are distributed ( 303 ) to the multiple graphics processing pipelines for rendering ( 304 ). Each GPU in its pipeline participates in only a fraction of the overall computational workload. Each frame buffer (FB) holds a full 2D image (i.e. frame of pixel data) of a sub-scene.
- FB frame buffer
- the full image of the 3D scene must be then composed from the viewing direction, using these two full 2D images, and this compositing process involves testing each and every pixel location for the pixel that is closest to the eye of the viewer ( 305 ). Consequently, recomposition according to this prior art Object Division Method of Parallel Graphics Rendering is expensive due to the amount of pixel data processing required during recomposition.
- the recomposed final FB is ultimately sent to the display device ( 306 ) for display to the human viewer.
- FIG. 3 C 2 the software-based recomposition stage/phase of the object division mode of the parallel graphics rendering process of FIG. 3 C 1 is schematically illustrated in greater detail.
- this prior art image (re)composition process involves using a dedicated/specialized computational platform to implement the basic pixel processing algorithm of FIG. 3 A 2 .
- this comprising dedicated/specialized computational platform comprises a plurality of CPUs for accessing and composite-processing the pixel color and z depth values of the pixel data sets buffered in the frame buffers (FBs) of each graphics pipeline supported on the parallel graphics platform.
- FBs frame buffers
- each graphics pipeline i.e. GPU
- there is buffered image data comprising pixel color and depth (z) values.
- FIG. 3 C 2 there is shown an illustrative example of a dedicated software-based recomposition platform employing two CPUs, and a final frame buffer FB 0 , to support a dual GPU-based parallel graphics rendering platform.
- the pixel color and depth (z) values stored in FB 1 and FB 2 are processed according to the basic pixel processing algorithm of FIG. 3 A 2 , so as to ultimately compose the final pixel data set (i.e. image) which is stored in the final frame buffer FB 0 .
- FIG. 3 C 3 shows pseudocode that is executed by each CPU on the recomposition platform in order to carry out the pixel processing algorithm described in FIG. 3 A 2 .
- the pixel data stored in the final frame buffer is then ultimately used to display the image on the screen of the display device using conventional video processing and refreshing techniques generally known in the art.
- graphics processing pipelines GPUs
- the image recomposition step requires the use of dedicated or otherwise specialized computational apparatus which, when taken together with the cost associated with computational machinery within the multiple GPUs to support the rendering phase of the parallel graphics process, has put the Object Division Method outside limits of practicality and feasibility for use in connection with PC-based computing systems.
- a primary object of the present invention is to provide a new and improved method of and apparatus for supporting the object division method of parallel graphics rendering, while avoiding the shortcomings and drawbacks associated with prior art apparatus and methodologies.
- Another object of the present invention is to provide such apparatus in the form of a multiple graphics processing unit (GPU) based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the video memory and the pixel processing subsystem in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- GPU graphics processing unit
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the video memory and the pixel processing subsystem in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the video memory and both the geometry and pixel processing subsystems in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein the video memory of each GPU includes texture memory and a pixel frame buffer, wherein the geometry processing subsystem includes a vertex shading unit, wherein the pixel processing subsystem includes a fragment/pixel shading unit, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the texture memory and the fragment/pixel shading unit are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein the video memory of each GPU includes texture memory and a pixel frame buffer, wherein the geometry processing subsystem includes a vertex shading unit, wherein the pixel processing subsystem includes a fragment/pixel shading unit, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the texture memory and the vertex shading unit are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the texture memory and the vertex shading unit are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system, wherein the recomposition stage of the object division mode of the parallel graphics rendering process can be carried out using conventional GPU-based graphics cards originally designed to support the image and time division modes of a parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system, wherein the pixel frame buffers within multiple GPUs of a parallel graphics pipeline can be composited without use of specialized and/or additional components of hardware or software
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system, having low design and manufacturing cost as well as relatively low architectural complexity that is highly suitable for PC-based computing systems, as well as video game consoles and systems widely used in the consumer entertainment industry.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system, having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein the object division mode can be implemented entirely in software, using the same computational resources provided for within the multiple GPUs for the purpose of carrying out the rendering stage of the parallel graphics rendering process (i.e. involving geometry projection, ray tracing, shading and texture mapping) and at cost of implementation that is comparable to the cost of implementation of image division and time division modes of a parallel graphics rendering process.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system, having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, which does not require compositing in main, shared or distributed memory of the host system (e.g. involving the movement of pixel data from the frame buffers or FBs to main memory, processing the pixel data in the CPU of the host for composition, and moving the result out to the GPU for display) thereby avoiding the use of expensive procedure and resources of the system (e.g. buses, caches, memory, and CPU)
- main, shared or distributed memory of the host system e.g. involving the movement of pixel data from the frame buffers or FBs to main memory, processing the pixel data in the CPU of the host for composition, and moving the result out to the GPU for display
- Another object of the present invention is to provide a novel method of operating a multiple GPU-based parallel graphics system, having multiple graphics processing pipelines (e.g. cards) with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein implementation of the pixel composition phase of the parallel graphics rendering process is carried out using the computational resources within the GPUs, thereby avoiding the need for dedicated or specialized pixel image compositing hardware and/or software based apparatus.
- multiple graphics processing pipelines e.g. cards
- Another object of the present invention is to provide a novel method of converting a multiple GPU-based parallel graphics system supporting a parallel graphics rendering process having a time and/or image division mode of operation, into a multiple GPU-based parallel graphics system supporting a parallel graphics rendering process having an object division mode of operation,
- Another object of the present invention is to provide a novel process of parallel graphics rendering having an object division mode of operation, which can be implemented on conventional as well as non conventional multiple GPU-based graphics platforms.
- Another object of the present invention is to provide a novel process of parallel graphics rendering having an object division mode of operation, which can be implemented on any special purpose graphic systems requiring an image composition or comparable pixel compositing processes.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, and which can be implemented on conventional multiple GPU-based platforms so as to replacing image division or time division parallelism supported by the original equipment manufacturer (OEM),
- OEM original equipment manufacturer
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, wherein the vendors of conventional multiple GPU-based graphics platforms can easily incorporate object division modes of operation, into their image division and time division modes of operation.
- Another object of the present invention is to provide a novel method of parallel graphics rendering which enables the construction of low cost multiple GPU-based cards supporting an object division mode of parallel graphics rendering, with or without other time and/or image division parallelization modes
- Another object of the present invention is to provide a novel method of parallel graphics rendering that enables the construction of reduced-cost silicon chips having multiple GPUs that support an object division mode of parallel graphics rendering for diverse end-user applications.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which can be embodied within an integrated graphics device (IGD) which is capable of running external GPU-based graphics cards, without the risk of the IGD getting disconnected by the BIOS of the host system when the external GPU-based graphics cards are operating, thereby improving the efficiency and performance of such systems.
- IGD integrated graphics device
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which can be embodied within an integrated graphics device (IGD) which is capable of driving multiple external GPU-based graphics cards.
- IGD integrated graphics device
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which can be embodied within an integrated graphics device (IGD) based chipset having two or more IGDs.
- IGD integrated graphics device
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which allows users to enjoy sharp videos and photos, smooth video playback, astonishing effects, and vibrant colors, as well as texture-rich 3D performance in next-generation games.
- FIG. 1A is a schematic representation illustrating the prior art Image Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs);
- FIG. 1B is a schematic representation illustrating the prior art Time Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs);
- FIG. 1C is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs);
- FIG. 2A is a schematic representation of a prior art PC-based computing system employing a dual-GPU graphics subsystem having a chipset ( 203 ) (e.g. nForce 680 by Nvidia) with two PCI-express buses ( 207 , 208 ), driving a pair of external graphic cards ( 204 , 205 ), and supporting the Image Division Method of Parallel Graphics Rendering (e.g. such as SLI by Nvidia, or Crossfire by AMD, driving 2 or 4 graphic cards);
- a chipset 203
- nForce 680 by Nvidia e.g. nForce 680 by Nvidia
- PCI-express buses 207 , 208
- driving a pair of external graphic cards 204 , 205
- Image Division Method of Parallel Graphics Rendering e.g. such as SLI by Nvidia, or Crossfire by AMD, driving 2 or 4 graphic cards
- FIG. 2B is a schematic representation of each prior art graphics card ( 204 , 205 ) employed in the PC-based computing system of FIG. 2A , shown comprising a GPU ( 202 ) and a Video Memory ( 203 ), wherein the stream of graphics commands and data, originating at host CPU, describes the 3D scene in terms of vertices and textures, wherein the Shader hardware is a programmable parallel array of processing elements running shader source code written in a graphics specific programming language, wherein the Vertex Shader ( 214 ) specializes in vertex processing, the Fragment Shader ( 215 ) specializes in pixel processing, and wherein the texture memory ( 218 ) is accessible from/to chip input, Shaders, FB ( 216 ), and blend & raster ops unit ( 217 );
- FIG. 3 A 1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs), wherein emphasis is placed on the fact that the image recomposition stage is implemented using specialized/dedicated apparatus;
- GPUs graphical processing units
- FIG. 3 A 2 is a flow chart illustrating the basic steps associated with the prior art image recomposition process carried out in most object division methods of parallel graphics rendering supported on multiple GPU-based graphics platform;
- FIG. 3 B 1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a multiple graphical processing units (GPUs), wherein the image recomposition stage is implemented using specialized/dedicated hardware-based recomposition apparatus comprising multiple stages of pixel composing units (indicated by COMPOSE);
- GPUs graphical processing units
- COMPOSE specialized/dedicated hardware-based recomposition apparatus comprising multiple stages of pixel composing units
- FIG. 3 B 2 is a schematics representation of the prior art specialized/dedicated hardware-based recomposition apparatus used to carry out the recomposition stage of the object division mode of graphics parallel rendering process supported on the multiple GPU-based graphics platform shown in FIG. 3 B 1 ;
- FIG. 3 C 1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a multiple graphical processing units (GPUs), wherein the image recomposition stage is implemented using specialized/dedicated software-based recomposition apparatus comprising multiple CPUs programmed for pixel composition using a graphics programming language (e.g. Cg);
- GPUs graphical processing units
- FIG. 3 C 1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a multiple graphical processing units (GPUs), wherein the image recomposition stage is implemented using specialized/dedicated software-based recomposition apparatus comprising multiple CPUs programmed for pixel composition using a graphics programming language (e.g. Cg);
- a graphics programming language e.g. Cg
- FIG. 3 C 2 is a schematics representation of the prior art specialized/dedicated software-based recomposition apparatus used to carry out the recomposition stage of the object division mode of graphics parallel rendering process supported on the multiple GPU-based graphics platform shown in FIG. 3 C 1 , wherein an illustrative example of two CPUs or processors (p 0 , p 1 ) and three pixel Frame Buffers (FB 0 , FB 1 , FB 2 ) provide the apparatus for carrying out the pixel composition process illustrated in FIG. 3 A 2 ;
- FIG. 3 C 3 is a prior art pseudo code for programming the processors to carry out the software-based recomposition stage of FIG. 3 C 2 ;
- FIG. 4A is a schematic representation illustrating the Object Division Method of Parallel Graphics Rendering in accordance with the principles of the present invention, carried out on a parallel graphics platform employing a multiple graphical processing units (GPUs), wherein the recomposition stage of the rendering process is carried out using computational resources (e.g. video memory and the geometry and/or pixel processing subsystems/engines) supplied by the a primary GPU employed on the parallel graphics platform;
- computational resources e.g. video memory and the geometry and/or pixel processing subsystems/engines
- FIG. 4B is a schematic representation illustrating a multiple GPU-based parallel graphics system according to the present invention, having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated (via an inter-GPU communication process) to the video memory of a primary GPU, and wherein the video memory and the geometry and/or pixel processing subsystems in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process;
- FIG. 4C is a time-line representation of process of generating a frame of pixels for an image along a specified viewing during a particular parallel rendering cycle in accordance with the principles of the present invention, wherein the pixel recomposition step of the parallel rendering process is shown to reuses GPU-based computational resources during its idle time, without the need for specialized or dedicated compositional apparatus required by prior art parallel graphics systems supporting an object division mode of parallel graphics rendering;
- FIG. 5A is a schematic representation of the a dual GPU-based parallel graphics system according to the present invention, having a pair of graphics processing pipelines with a pair of GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated (via an inter-GPU communication process supported over a pair of PCI Express buses) to the video memory of a primary GPU, and wherein the video memory and the geometry and/or pixel processing subsystems in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process;
- FIG. 5B is a schematic representation of decomposing module and distributing module supported within the host CPU Program Space of the host computer system shown in FIG. 5A , wherein the decomposing module of present invention comprises functional sub-blocks for OS-GPU I/F and Utilities, Division Control and State Monitoring, and Composition Management, whereas the Distributing Module comprises functional sub-block for (Graphics Display List Data and Command) Distribution Management;
- FIG. 6A is a schematic representation of the parallel graphics rendering process of the present invention having an object division mode, supported on the dual GPU-based parallel graphics system shown in FIG. 5A ;
- FIG. 6B is a graphical representation of Shader code (expressed in a graphics programming language, e.g. Cg) that is used within the primary GPU in order to carry out the pixel recomposition stage of the object division mode/method of the parallel graphics rendering process of the present invention, supported on the dual GPU-based parallel graphics system shown in FIG. 5A ;
- Shader code expressed in a graphics programming language, e.g. Cg
- FIG. 7A is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using a multiple GPU-based graphics cards;
- FIG. 7B is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using multiple GPUs on a single card
- FIG. 7C is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using an external box equipped with multiple GPU-based graphics cards;
- FIG. 8 is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using a multiple-GPU chip design;
- FIG. 9A is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as an integrated graphics device (IGD) based system provided with a single graphics card;
- IGD integrated graphics device
- FIG. 9B is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a combined system comprising an IGD-based system provided with two graphics cards;
- FIG. 9C is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a system having dual or multiple IGDs each embodying the object division based parallel graphics rendering process of the present invention.
- FIG. 10 is a graphical representation of an implementation of the multiple GPU-based parallel graphics system of the present invention, wherein the multiple GPU-based parallel graphics system and process are incorporated within a video game console.
- the pixel recomposition phase of the object division based graphics rendering process is carried out by means of GPU-based pixel processing resources including video memory, and the geometry processing subsystem and/or the pixel processing subsystem, as emphasized in FIG. 4A .
- FIG. 4B illustrates the give major steps associated with the object division based parallel graphics rendering process of present invention, namely: decompose, distribute, render, recompose, and display.
- the computational resources contained within one of the multiple GPUs on the platform, termed the primary GPU, and to which the display device ( 406 ) is attached are reutilized for image/pixel recomposing, in addition to graphics rendering.
- the general case of a multiple GPU-based graphic subsystem is considered with n GPUs being shown.
- Pixel data contained in the Frame buffers (FB) associated with the secondary GPUs are moved to the primary GPU by way of an inter-GPU communication process (e.g.
- pixel image (re)composition is then sent to display device, and alternatively, also returned to the secondary GPUs, if required in some applications as a basis of the next pixel frame.
- FIG. 4C illustrates the time-line of one complete composited pixel frame, including time slots associated with the different steps of object division rendering.
- the reuse of GPU resources for compositing not only eliminates the use of an additional specialized apparatus, but it is utilized in a time slot, where in prior art the specialized apparatus works, leaving the GPU resources idle during the recompose step.
- GPU resources are used “for free” without sacrificing system performance.
- FIG. 5A shows an illustrative example of a dual GPU-based graphics system of present invention supporting object division mode of parallel graphics rendering employing GPU-based pixel recomposition.
- the object division based GPU graphics system of the present invention is implemented using a conventional dual-GPU graphics platform (e.g. Nvidia's SLITM dual-GPU graphics system system) supporting image or/and time division modes of parallel graphics rendering, and converting into the novel object division based GPU-based parallel graphics system of the present invention.
- a conventional dual-GPU graphics platform e.g. Nvidia's SLITM dual-GPU graphics system system
- This graphics platform conversion process which is only one aspect of the present invention, is carried out using the novel software architecture and programming principles of the present invention ( 503 ), which in combination transforms a multiple GPU-based graphics platform (capable of supporting time and/or image division mode of parallel graphics rendering), by controlling the primary GPU (on the primary graphics card ( 205 )) in such as way that it operates and supports pixel and other data processing operations that implement compositing stage of the object division based parallel graphics rendering process of the present invention.
- decomposition is accomplished by Decomposing module ( 504 ), and the distribution of graphics display list data and command streams by Distributing module ( 505 ).
- the graphics support environment on the host computer comprises: the application ( 501 ); the Standard Graphics Library ( 502 , e.g. OpenGL or Direct3D); and the vendor's GPU driver ( 506 ).
- the vendor's GPU driver 506
- One of these cards ( 205 ) is attached to display device ( 106 ) and is therefore termed the “primary” card, and its GPU, is termed the “primary GPU”.
- the primary card is magnified so as show its internal architecture, which was described in part with reference to FIG. 2B .
- the decomposing and distributing modules of present invention comprises a number of functional sub-blocks, namely: Decomposing module ( 504 ); OS-GPU Interface and Utilities ( 521 ); Division Control and State Monitoring ( 522 ); Composition Management ( 523 ); Distribution Management module ( 525 ).
- the Decomposing module ( 504 ) primarily implements the decomposing step of object division rendering process, but also interfaces with the OS and vendor's GPU driver and with GPUs, and supervises recomposition process in GPUs. These steps are accomplished by means of the following functional blocks: OS-GPU Interface and Utilities ( 521 ); Division Control and State Monitoring ( 522 ); and Composition Management ( 523 ).
- OS-GPU Interface and Utilities Module ( 521 ) performs all the functions associated with interaction with the Operation System, graphic library (e.g. OpenGL or DirectX), and interfacing with GPUs.
- graphic library e.g. OpenGL or DirectX
- This functional block is responsible for interception of the graphic commands from the standard graphic library, forwarding and creating graphic commands to Vendor's GPU Driver, controlling registry and installation, OS services and utilities.
- Division Control and State Monitoring Module controls the object division parameters and data to be processed by each GPU for load balancing, data validity, etc., and also handles state validity across the system.
- the graphic libraries e.g. OpenGL and DirectX
- Parallelization must preserve cohesive state across the graphic system. It is done by continuous analysis of all incoming commands, while the state commands and some of the data must be duplicated to all pipelines in order to preserve the valid state across the graphic pipeline. This function is exercised mainly in object division scheme, as disclosed in detail in inventor's previous pending patent PCT/IL04/001069, incorporated herein by reference.
- Composition Management Module ( 523 ) supervises the composition process at GPUs issuing commands and shader codes to handling the read-back of frame buffers, transfer data and perform compositing, as will be described in details hereinafter.
- the Distributing Step/Phase ( 505 ) of object division parallel graphics rendering process of the present invention is implemented by the Distribution Management Module ( 525 ), which addresses the streams of commands and data to the different GPUs via chipset outputs.
- the innovative pixel compositing phase of the multiple-GPU based parallel graphics rendering process of the present invention will now be described in great technical detail.
- the compositing phase/stage involves moving the pixel Depth and Color values from the frame buffers FB in the secondary GPU, to the FB in the primary GPU (via inter-GPU communication), and merging then merging these pixel values with their counterparts at the primary GPU by means of programmable Fragment Shader in the pixel processing subsystem ( 211 ).
- FIG. 6A provides a flowchart for the compositing process.
- a compositing process employing dual GPUs is described. However, it is understood that if more GPUs are involved, then the flowchart process will repeat accordingly for each additional “secondary” GPU, until the final step when the partially composited pixel data in the frame buffer (FB) in the last secondary GPU, is finally composited with the pixel data within the frame buffer of the primary GPU.
- FB frame buffer
- the pixel frame generating pipeline includes the steps: decompose ( 402 , see FIG. 4 A)), distribute ( 403 ), and render ( 404 ).
- the recompose step ( 405 ) is carried out for final FB, which is finally displayed to the display device ( 405 ).
- the Distributing step ( 403 ) is supervised by the Distributing module ( 505 , FIG. 5A ). They are sent to Vendor's GPU Driver ( 506 ), memory bridge ( 203 ), and delivered for rendering to graphics cards, the primary ( 205 ) and secondary ( 204 ) via separate PCIexpress buses ( 207 , 208 ).
- Rendering (step 404 ) is done simultaneously ( 602 , 603 ) in both GPUs, creating two partial FBs.
- the compositing process (step 405 of FIG. 4 ) comprises the following substeps:
- step 404 b To complete rendering (step 404 b ), the following substeps are performed:
- step 405 the detailed shader program is used to composite two color textures based on depth test between two depth textures, as shown in FIG. 6B .
- the compositing phase/stage can involve moving the pixel Depth and Color values from the frame buffers FB in the secondary GPU, to the FB in the primary GPU (via inter-GPU communication), and merging then merging these pixel values with their counterparts at the primary GPU by means of programmable Vertex Shader in the geometry processing subsystem ( 210 ).
- the compositing phase/stage can involve moving the pixel Depth and Color values from the frame buffers FB in the secondary GPU, to the FB in the primary GPU (via inter-GPU communication), and merging then merging these pixel values with their counterparts at the primary GPU by means of both programmable Vertex and Fragment Shaders in the geometry and pixel processing subsystems in the primary GPU.
- the GPU-based composition process associated with the object division parallel graphics rendering process of the present invention can be realized as a software method that (i) controls the computational machinery within the GPUs of the parallel graphics platform, and (ii) exploits the Shader (pixel) processing capabilities in the primary GPU, with no need for any external hardware.
- the object division parallel graphics rendering process and platform of present invention can be implemented on a great variety of existing, as well as new graphics systems in a multitude of ways. Below are just some examples of possible system designs that can be constructed using the principles of the present invention.
- FIG. 7A there is shown a first implementation of the dual GPU-based parallel graphics system ( 700 ) according to the present invention, constructed using a multiple GPU-based graphics cards ( 701 ).
- host motherboard can be realized as an Huawei A8N-SLI ( 702 ), and the graphics cards can be realized by a pair of Nvidia GEforce 6800 cards ( 701 ) and chipset nForce 680 by Nvidia (not shown).
- FIG. 7B there is shown an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using multiple GPUs on a single card.
- FIG. 7C there is shown a second implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using an external box equipped with multiple GPU-based graphics cards.
- FIG. 8 there is shown a third implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using a multiple-GPU chip design.
- FIG. 9 there is shown a fourth Implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as an integrated graphics device (IGD) based system ( 901 ) provided with a single graphics card ( 902 ).
- IGD integrated graphics device
- FIG. 9 there is shown a fourth Implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as an integrated graphics device (IGD) based system ( 901 ) provided with a single graphics card ( 902 ).
- IGD-based chipsets e.g. Intel 845GL
- the external GPU on the graphics card will function as the primary GPU and perform the pixel composition process in accordance with the principles of the present invention.
- FIG. 9B there is shown a fifth implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a combined system comprising an IGD-based system ( 911 ). provided with two graphics cards ( 912 , 913 ).
- the IGD of this dual card system has dual PCIexpress bus (e.g. bearlake by Intel), so that two external GPUs can be used.
- FIG. 9C there is show a sixth implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a system having dual or multiple IGDs each embodying the object division based parallel graphics rendering process of the present invention.
- IGD will include a programmable shader to practice the pixel composition process of the present invention.
- FIG. 10 there is shown a graphical representation of a seventh possible implementation of the multiple GPU-based parallel graphics system of the present invention, wherein the multiple GPU-based parallel graphics system and process are incorporated within a video game console.
- This illustrative example shows the MicrosoftTM Xbox 360 game console embodying the parallel graphics rendering process and apparatus of the present invention.
Abstract
A multiple graphics processing unit (GPU) based parallel graphics system comprising multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation. Each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem. According to the principles of the present invention, pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and the video memory and the pixel processing subsystem in the primary GPU are used to carry out the image recomposition process, without the need for dedicated or specialized apparatus.
Description
- The present application is a Continuation of U.S. application Ser. No. 11/648,160 filed Dec. 31, 2006; said patent application being commonly owned by Lucid Information Technology, Ltd., and being incorporated herein by reference as if set forth fully herein.
- 1. Field of Invention
- The present invention relates to new and improved ways of and means for carrying out the object division method of parallel graphics rendering on multiple GPU-based graphics platforms associated with diverse types of computing machinery.
- 2. Brief Description of the State of the Knowledge In the Art
- There is a great demand for high performance three-dimensional (3D) computer graphics systems in the fields of product design, simulation, virtual-reality, video-gaming, scientific research, and personal computing (PC). Clearly a major goal of the computer graphics industry is to realize real-time photo-realistic 3D imagery on PC-based workstations, desktops, laptops, and mobile computing devices.
- In general, there are two fundamentally different classes of machines in the 3D computer graphics field, namely: (1) Graphical Display List (GDL) based systems, wherein 3D scenes and objects are represented as a complex of geometric models (primitives) in 3D continuous geometric space, and 2D views or images of such 3D scenes are computed using geometrical projection, ray tracing, and light scattering/reflection/absorption modeling techniques, typically based upon laws of physics; and (2) VOlume ELement (VOXEL) based systems, wherein 3D scenes and objects are represented as a complex of voxels (x,y,z volume elements) represented in 3D Cartesian Space, and 2D views or images of such 3D voxel-based scenes are also computed using geometrical projection, ray tracing, and light scattering/reflection/absorption modeling techniques, again typically based upon laws of physics. Examples of early GDL-based graphics systems are disclosed in U.S. Pat. No. 4,862,155, whereas examples of early voxel-based 3D graphics systems are disclosed in U.S. Pat. No. 4,985,856, each incorporated herein by reference in its entirety.
- In the contemporary period, most PC-based computing systems include a 3D graphics subsystem based the “graphics display list (GDL)” system design. In such graphics system design, “objects” within a 3D scene are represented by 3D geometrical models, and these geometrical models are typically constructed from continuous-type 3D geometric representations including, for example, 3D straight line segments, planar polygons, polyhedra, cubic polynomial curves, surfaces, volumes, circles, and quadratic objects such as spheres, cones, and cylinders. These 3D geometrical representations are used to model various parts of the 3D scene or object, and are expressed in the form of mathematical functions evaluated over particular values of coordinates in continuous Cartesian space. Typically, the 3D geometrical representations of the 3D geometric model are stored in the format of a graphical display list (i.e. a structured collection of 2D and 3D geometric primitives). Currently, planar polygons, mathematically described by a set of vertices, are the most popular form of 3D geometric representation.
- Once modeled using continuous 3D geometrical representations, the 3D scene is graphically displayed (as a 2D view of the 3D geometrical model) along a particular viewing direction, by repeatedly scan-converting the graphical display list. At the current state of the art, the scan-conversion process can be viewed as a “computational geometry” process which involves the use of (i) a geometry processor (i.e. geometry processing subsystem or engine) as well as a pixel processor (i.e. pixel processing subsystem or engine) which together transform (i.e. project, shade and color) the display-list objects and bit-mapped textures, respectively, into an unstructured matrix of pixels. The composed set of pixel data is stored within a 2D frame buffer (i.e. Z buffer) before being transmitted to and displayed on the surface of a display screen.
- A video processor/engine refreshes the display screen using the pixel data stored in the 2D frame buffer. Any changes in the 3D scene requires that the geometry and pixel processors repeat the whole computationally-intensive pixel-generation pipeline process, again and again, to meet the requirements of the graphics application at hand. For every small change or modification in viewing direction of the human system user, the graphical display list must be manipulated and repeatedly scan-converted. This, in turn, causes both computational and buffer contention challenges which slow down the working rate of the graphics system. To accelerate this computationally-intensive pipeline process, custom hardware including geometry, pixel and video engines, have been developed and incorporated into most conventional “graphics display-list” system designs.
- In high-performance graphics applications, the number of computations required to render a 3D scene (from its underlying graphical display lists) and produce high-resolution graphical projections greatly exceeds the capabilities of systems employing a single graphics processing unit (GPU). Consequently, the use of parallel graphics pipelines, and multiple graphics processing units (GPUs), have become the rule for high-performance graphics system architecture and design.
- In order to distribute the computational workload associated with interactive parallel graphics rendering processes, three different methods of graphics rendering have been developed over the years. These three basic methods of parallel graphics rendering are illustrated in
FIGS. 1A through 1C . While these three methods of parallel graphics rendering are different in ways which will be described below, they each have five (5) basic stages or phases in common, namely: - (1) the Decomposition Phase, wherein the 3D scene or object is analyzed and its corresponding graphics display list data and commands are assigned to particular graphics pipelines available on the parallel multiple GPU-based graphics platform;
- (2) the Distribution Phase, wherein the graphics display list data and commands are distributed to particular available graphics pipelines determined during the Decomposition Phase;
- (3) the Rendering Phase, wherein the geometry processing subsystem/engine and the pixel processing subsystem/engine along each graphics pipeline of the parallel graphics platform uses the graphics display list data and commands distributed to its pipeline, and transforms (i.e. projects, shades and colors) the display-list objects and bit-mapped textures into a subset of unstructured matrix of pixels;
- (4) the Recomposition Phase, wherein the parallel graphics platform uses the multiple sets of pixel data generated by each graphics pipeline to synthesize (or compose) a final set of pixels that are representative of the 3D scene (taken along the specified viewing direction), and this final set of pixel data is then stored in a frame buffer; and
- (5) the Display Phase, wherein the final set of pixel data retreived from the frame buffer; and provided to the screen of the device of the system. As will be explained below with reference to
FIGS. 1A through 1C , each of these methods of parallel graphics rendering has both advantages and disadvantages. - As illustrated in
FIG. 1A , the Image Division (Sort-First) Method of Parallel Graphics Rendering distributes all graphics display list data and commands to each of the graphics pipelines, and decomposes the final view (i.e. projected 2D image) in Screen Space, so that, each graphical contributor (e.g. graphics pipeline and GPU) renders a 2D tile of the final view. This mode has a limited scalability due to the parallel overhead caused by objects rendered on multiple tiles. - As illustrated in
FIG. 1B , the Time Division (DPlex) Method of Parallel Graphics Rendering distributes all display list graphics data and commands associated with a first scene to the first graphics pipeline, and all graphics display list data and commands associated with a second/subsequent scene to the second graphics pipeline, so that each graphics pipeline (and its individual rendering node or GPU) handles the processing of a full, alternating image frame. Notably, while this method scales very well, the latency between user input and final display increases with scale, which is often irritating for the user. - As illustrated in
FIG. 1C , the Object Division (Sort-last) Method of Parallel Graphics Rendering decomposes the 3D scene (i.e. rendered database) and distributes graphics display list data and commands associated with a portion of the scene to the particular graphics pipeline (i.e. rendering unit), and recombines the partially rendered pixel frames, during recomposition. This mode scales the rendering process very well, but implementation of the recomposition step is very expensive due to the amount of pixel data processing required during recomposition. Consequently, the practice of the Object Division Method of Parallel Graphics Rendering has not been commercially feasible in the affordable PC computing marketplace, while the Image and Time Division Methods of Parallel Graphics Rendering are being widely practiced in commercial PC-based graphics products, as indicated above. - A primary and highly desirable advantage associated with the Object Division Method of Parallel Graphics Rendering stems from dividing the stream of graphic display commands and data into partial streams, targeted to different GPUs, thereby removing traditional bottlenecks associated with polygon and texture data processing. Applications with massive polygon data (such as CAD) or massive texture data (such as high-quality video games) are able to take the most advantage of this kind of graphics rendering parallelism. Thus, there is a real need for CAD workers and video gamers who typically use PC-based computing systems and workstations have access to computer graphics subsystems that support the Object Division Method of Parallel Graphics Rendering.
- In order to increase the level of parallelism and thus rendering performance of conventional PC-based graphics systems (i.e. beyond the converge limitations of a single-core GPU), it is now popular for conventional PC computing platforms to practice the Image and Time Division Methods of Parallel Graphics Rendering using either multiple GPU-based graphics cards, or multiple GPU chips on a graphics card. As shown in
FIGS. 2A and 2B , this parallel graphics processing technique is practiced today in a number of commercial products (e.g. the SLI™ product design by Nvidia, and the Crossfire™ product design by ATI), employing a dual-card graphics subsystem, and supporting both Image and Time Division Methods/Modes of Parallel Graphics Rendering. - As shown in
FIG. 2A , the PC motherboard is populated with a CPU (201) that is equipped with a memory bridge (i.e. “chipset,” 203) (e.g. nForce 680 by Nvidia). The memory bridge supports two PCI-express buses (207, 208) which are capable of driving two external graphic cards. As shown inFIG. 2A , the primary graphics card (205) and the secondary graphics card (204) are attached to a display device (206) such as a LCD panel. As shown inFIG. 2B , the architecture of a typical Shader-based graphic card (204, 205) comprises a GPU (212) and video memory (213). The GPU comprises a geometry subsystem (which is transform bound) and a pixel subsystem (which is fill bound). The video memory (213) comprises texture memory (218), a frame buffer (216), a command buffer, and a vertex buffer. The stream of graphics (display list) data and commands, originating at the host CPU, describes the 3D scene in terms of polygon vertices and bit-mapped textures. As shown, this data stream is provided to the video memory (213) via PCIexpress bus (207 or 208). In the shader-based GPU, the texture memory (218) plays a central role, and is accessible to and from the chip input, the vertex and fragment shaders, FB (216), and the blend & raster ops unit (217). As shown, the shader hardware (214, 215) is realized as a programmable parallel array of processing elements running shader source code written in a graphics-specific programming language. Notably, the Vertex Shader (214) specializes in vertex data processing, whereas the Fragment Shader (215) specializes in pixel data processing. - In FIG. 3A1, there is shown a parallel graphics system supporting the Object Division Method of Parallel Graphics Rendering, as illustrated as in
FIG. 1C , but with further emphasis on the Recomposition Stage which is shown carried out using specialized apparatus. In FIG. 3A2, the basic object division recomposition process carried out by such specialized apparatus is schematically illustrated in the form of a flow chart. As described in FIG. 3A2, the first step of this pixel composition process involves accessing images (pixel data sets) from first and second frame buffers (FB1, FB20, each having a color value buffer and a depth value (Z) buffer. The second step involves performing a relatively simple process for each x,y pixel value in the frame buffers: advance to the next x,y location; for x,y, compare the depth values in the Z buffers and select the lower value which corresponds to the pixel value closest to the view (along the specified viewing direction); move the corresponding pixel value from the color buffer associated with the winning Z-buffer1 to the final FB. The determine whether or not all x,y values in the image have been processed as described above. If not, then return to the beginning of the processing loop as shown, and continue to process all pixel values in the image until the composition process is completed. - In FIGS. 3B1 and 3B2, there is shown a prior art multiple GPU-based graphics subsystem having multiple graphics pipelines with multiple GPUs supporting the Object Division Method of Parallel Graphics Rendering, using dedicated/specialized hardware to perform the basic image recomposition process illustrated in FIG. 3A2. Examples of prior art parallel graphics systems based on this design include: the Chromium™ Parallel Graphics System developed by researchers and engineers of Stanford University, and employing Binaryswap SPU hardware to carry out the image (re)composition process illustrated in FIG. 3A2; and HP Corporation's PixelFlow (following development of North Carolina University at Chapel Hill) employing parallel pipeline hardware, and SGI's Origin 2000 Supercomputer Shared Memory Compositor method (known also as “Direct Send”) on distributed memory architecture.
- As shown in FIG. 3B1, the application's rendering code (301), which is representative of a 3D scene to be viewed from a particular viewing direction, is decomposed into two streams of graphics (display list) data and commands (302). These streams of graphics data and commands (302) are distributed (303) to the multiple graphics processing pipelines for rendering (304). Each GPU in its pipeline participates in only a fraction of the overall computational workload. Each frame buffer (FB) holds a full 2D image (i.e. frame of pixel data) of a sub-scene. According to this prior art method of Object Division, the full image of the 3D scene must be then composed from the viewing direction, using these two full 2D images, and this compositing process involves testing each and every pixel location for the pixel that is closest to the eye of the viewer (305). Consequently, recomposition according to this prior art Object Division Method of Parallel Graphics Rendering is expensive due to the amount of pixel data processing required during recomposition. The recomposed final FB is ultimately sent to the display device (306) for display to the human viewer.
- As shown in FIG. 3B2, the dedicated/specialized hardware-based recomposition stage/phase of the object division mode of the parallel graphics rendering process of FIG. 3B1 comprises multiple stages of frame buffers (FBs), wherein each graphics pipeline will have at least one FB. In each FB, there is buffered image data comprising pixel color and depth (z) values. These pixel color and depth (z) values are processed according to the basic pixel processing algorithm of FIG. 3A2, so as to ultimately compose the final pixel data set (i.e. image) which is stored in the final frame buffer. The pixel data stored in the final frame buffer is then ultimately used to display the image on the screen of the display device using conventional video processing and refreshing techniques generally known in the art. Notably, the more graphics processing pipelines (GPUs) that are employed in the parallel graphics rendering platform, the more complex and expensive the dedicated hardware becomes to practice this prior art hard-ware based recomposition technique during the object division mode of such a parallel graphics rendering platform.
- In FIGS. 3C1, 3C2 and 3C3, there is shown a prior art multiple GPU-based graphics subsystem having multiple graphics pipelines with multiple GPUs supporting the Object Division Method of Parallel Graphics Rendering, using a dedicated/specialized software solution to perform the basic image recomposition process illustrated in FIG. 3A2. Examples of prior art parallel graphics systems based on this design include: the Onyx® Parallel Graphics System developed by SGI, and employing pseudocode illustrated in FIGS. 3C2 and 3C3, to carry out the image (re)composition process illustrated in FIG. 3A2.
- As shown in FIG. 3C1, the application's rendering code (301), which is representative of a 3D scene to be viewed from a particular viewing direction, is decomposed into two streams of graphics (display list) data and commands (302). These streams of graphics data and commands (302) are distributed (303) to the multiple graphics processing pipelines for rendering (304). Each GPU in its pipeline participates in only a fraction of the overall computational workload. Each frame buffer (FB) holds a full 2D image (i.e. frame of pixel data) of a sub-scene. According to this prior art method of Object Division, the full image of the 3D scene must be then composed from the viewing direction, using these two full 2D images, and this compositing process involves testing each and every pixel location for the pixel that is closest to the eye of the viewer (305). Consequently, recomposition according to this prior art Object Division Method of Parallel Graphics Rendering is expensive due to the amount of pixel data processing required during recomposition. The recomposed final FB is ultimately sent to the display device (306) for display to the human viewer.
- In FIG. 3C2, the software-based recomposition stage/phase of the object division mode of the parallel graphics rendering process of FIG. 3C1 is schematically illustrated in greater detail. As shown, this prior art image (re)composition process involves using a dedicated/specialized computational platform to implement the basic pixel processing algorithm of FIG. 3A2. As In general, this comprising dedicated/specialized computational platform comprises a plurality of CPUs for accessing and composite-processing the pixel color and z depth values of the pixel data sets buffered in the frame buffers (FBs) of each graphics pipeline supported on the parallel graphics platform. In the FB of each graphics pipeline (i.e. GPU), there is buffered image data comprising pixel color and depth (z) values. In FIG. 3C2, there is shown an illustrative example of a dedicated software-based recomposition platform employing two CPUs, and a final frame buffer FB0, to support a dual GPU-based parallel graphics rendering platform. The pixel color and depth (z) values stored in FB1 and FB2 are processed according to the basic pixel processing algorithm of FIG. 3A2, so as to ultimately compose the final pixel data set (i.e. image) which is stored in the final frame buffer FB0. FIG. 3C3 shows pseudocode that is executed by each CPU on the recomposition platform in order to carry out the pixel processing algorithm described in FIG. 3A2. The pixel data stored in the final frame buffer is then ultimately used to display the image on the screen of the display device using conventional video processing and refreshing techniques generally known in the art. Notably, the more graphics processing pipelines (GPUs) that are employed in the parallel graphics rendering platform, the more complex and expensive the software-based recomposition platform becomes to practice this prior art software based recomposition technique during the object division mode of such a parallel graphics rendering platform.
- In both prior art parallel graphics systems described in FIGS. 3B1 and 3B2 and 3C1 through 3C3, the image recomposition step requires the use of dedicated or otherwise specialized computational apparatus which, when taken together with the cost associated with computational machinery within the multiple GPUs to support the rendering phase of the parallel graphics process, has put the Object Division Method outside limits of practicality and feasibility for use in connection with PC-based computing systems.
- Thus, there is a great need in the art for a new and improved way of and means for practicing the object division method of parallel graphics rendering in computer graphics systems, while avoiding the shortcomings and drawbacks of such prior art methodologies and apparatus.
- Accordingly, a primary object of the present invention is to provide a new and improved method of and apparatus for supporting the object division method of parallel graphics rendering, while avoiding the shortcomings and drawbacks associated with prior art apparatus and methodologies.
- Another object of the present invention is to provide such apparatus in the form of a multiple graphics processing unit (GPU) based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the video memory and the pixel processing subsystem in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the video memory and the pixel processing subsystem in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the video memory and both the geometry and pixel processing subsystems in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein the video memory of each GPU includes texture memory and a pixel frame buffer, wherein the geometry processing subsystem includes a vertex shading unit, wherein the pixel processing subsystem includes a fragment/pixel shading unit, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the texture memory and the fragment/pixel shading unit are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein the video memory of each GPU includes texture memory and a pixel frame buffer, wherein the geometry processing subsystem includes a vertex shading unit, wherein the pixel processing subsystem includes a fragment/pixel shading unit, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the texture memory and the vertex shading unit are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated to the video memory of a primary GPU, and wherein the texture memory and the vertex shading unit are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system, wherein the recomposition stage of the object division mode of the parallel graphics rendering process can be carried out using conventional GPU-based graphics cards originally designed to support the image and time division modes of a parallel graphics rendering process.
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system, wherein the pixel frame buffers within multiple GPUs of a parallel graphics pipeline can be composited without use of specialized and/or additional components of hardware or software
- Another object of the present invention is to provide such a multiple GPU-based parallel graphics system, having low design and manufacturing cost as well as relatively low architectural complexity that is highly suitable for PC-based computing systems, as well as video game consoles and systems widely used in the consumer entertainment industry.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system, having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein the object division mode can be implemented entirely in software, using the same computational resources provided for within the multiple GPUs for the purpose of carrying out the rendering stage of the parallel graphics rendering process (i.e. involving geometry projection, ray tracing, shading and texture mapping) and at cost of implementation that is comparable to the cost of implementation of image division and time division modes of a parallel graphics rendering process.
- Another object of the present invention is to provide a multiple GPU-based parallel graphics system, having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, which does not require compositing in main, shared or distributed memory of the host system (e.g. involving the movement of pixel data from the frame buffers or FBs to main memory, processing the pixel data in the CPU of the host for composition, and moving the result out to the GPU for display) thereby avoiding the use of expensive procedure and resources of the system (e.g. buses, caches, memory, and CPU)
- Another object of the present invention is to provide a novel method of operating a multiple GPU-based parallel graphics system, having multiple graphics processing pipelines (e.g. cards) with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein implementation of the pixel composition phase of the parallel graphics rendering process is carried out using the computational resources within the GPUs, thereby avoiding the need for dedicated or specialized pixel image compositing hardware and/or software based apparatus.
- Another object of the present invention is to provide a novel method of converting a multiple GPU-based parallel graphics system supporting a parallel graphics rendering process having a time and/or image division mode of operation, into a multiple GPU-based parallel graphics system supporting a parallel graphics rendering process having an object division mode of operation,
- Another object of the present invention is to provide a novel process of parallel graphics rendering having an object division mode of operation, which can be implemented on conventional as well as non conventional multiple GPU-based graphics platforms.
- Another object of the present invention is to provide a novel process of parallel graphics rendering having an object division mode of operation, which can be implemented on any special purpose graphic systems requiring an image composition or comparable pixel compositing processes.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, and which can be implemented on conventional multiple GPU-based platforms so as to replacing image division or time division parallelism supported by the original equipment manufacturer (OEM),
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, wherein the vendors of conventional multiple GPU-based graphics platforms can easily incorporate object division modes of operation, into their image division and time division modes of operation.
- Another object of the present invention is to provide a novel method of parallel graphics rendering which enables the construction of low cost multiple GPU-based cards supporting an object division mode of parallel graphics rendering, with or without other time and/or image division parallelization modes
- Another object of the present invention is to provide a novel method of parallel graphics rendering that enables the construction of reduced-cost silicon chips having multiple GPUs that support an object division mode of parallel graphics rendering for diverse end-user applications.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which can be embodied within an integrated graphics device (IGD) which is capable of running external GPU-based graphics cards, without the risk of the IGD getting disconnected by the BIOS of the host system when the external GPU-based graphics cards are operating, thereby improving the efficiency and performance of such systems.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which can be embodied within an integrated graphics device (IGD) which is capable of driving multiple external GPU-based graphics cards.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which can be embodied within an integrated graphics device (IGD) based chipset having two or more IGDs.
- Another object of the present invention is to provide a novel parallel graphics rendering system supporting an object division mode of operation, which allows users to enjoy sharp videos and photos, smooth video playback, astonishing effects, and vibrant colors, as well as texture-rich 3D performance in next-generation games.
- These and other objects of the present invention will become apparent hereinafter and in the claims to invention.
- For a more complete understanding of how to practice the Objects of the Present Invention, the following Detailed Description of the Illustrative Embodiments can be read in conjunction with the accompanying Drawings, briefly described below:
-
FIG. 1A is a schematic representation illustrating the prior art Image Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs); -
FIG. 1B is a schematic representation illustrating the prior art Time Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs); -
FIG. 1C is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs); -
FIG. 2A is a schematic representation of a prior art PC-based computing system employing a dual-GPU graphics subsystem having a chipset (203) (e.g. nForce 680 by Nvidia) with two PCI-express buses (207, 208), driving a pair of external graphic cards (204, 205), and supporting the Image Division Method of Parallel Graphics Rendering (e.g. such as SLI by Nvidia, or Crossfire by AMD, driving 2 or 4 graphic cards); -
FIG. 2B is a schematic representation of each prior art graphics card (204, 205) employed in the PC-based computing system ofFIG. 2A , shown comprising a GPU (202) and a Video Memory (203), wherein the stream of graphics commands and data, originating at host CPU, describes the 3D scene in terms of vertices and textures, wherein the Shader hardware is a programmable parallel array of processing elements running shader source code written in a graphics specific programming language, wherein the Vertex Shader (214) specializes in vertex processing, the Fragment Shader (215) specializes in pixel processing, and wherein the texture memory (218) is accessible from/to chip input, Shaders, FB (216), and blend & raster ops unit (217); - FIG. 3A1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a pair of graphical processing units (GPUs), wherein emphasis is placed on the fact that the image recomposition stage is implemented using specialized/dedicated apparatus;
- FIG. 3A2 is a flow chart illustrating the basic steps associated with the prior art image recomposition process carried out in most object division methods of parallel graphics rendering supported on multiple GPU-based graphics platform;
- FIG. 3B1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a multiple graphical processing units (GPUs), wherein the image recomposition stage is implemented using specialized/dedicated hardware-based recomposition apparatus comprising multiple stages of pixel composing units (indicated by COMPOSE);
- FIG. 3B2 is a schematics representation of the prior art specialized/dedicated hardware-based recomposition apparatus used to carry out the recomposition stage of the object division mode of graphics parallel rendering process supported on the multiple GPU-based graphics platform shown in FIG. 3B1;
- FIG. 3C1 is a schematic representation illustrating the prior art Object Division Method of Parallel Graphics Rendering on a computer graphics platform employing a multiple graphical processing units (GPUs), wherein the image recomposition stage is implemented using specialized/dedicated software-based recomposition apparatus comprising multiple CPUs programmed for pixel composition using a graphics programming language (e.g. Cg);
- FIG. 3C2 is a schematics representation of the prior art specialized/dedicated software-based recomposition apparatus used to carry out the recomposition stage of the object division mode of graphics parallel rendering process supported on the multiple GPU-based graphics platform shown in FIG. 3C1, wherein an illustrative example of two CPUs or processors (p0, p1) and three pixel Frame Buffers (FB0, FB1, FB2) provide the apparatus for carrying out the pixel composition process illustrated in FIG. 3A2;
- FIG. 3C3 is a prior art pseudo code for programming the processors to carry out the software-based recomposition stage of FIG. 3C2;
-
FIG. 4A is a schematic representation illustrating the Object Division Method of Parallel Graphics Rendering in accordance with the principles of the present invention, carried out on a parallel graphics platform employing a multiple graphical processing units (GPUs), wherein the recomposition stage of the rendering process is carried out using computational resources (e.g. video memory and the geometry and/or pixel processing subsystems/engines) supplied by the a primary GPU employed on the parallel graphics platform; -
FIG. 4B is a schematic representation illustrating a multiple GPU-based parallel graphics system according to the present invention, having multiple graphics processing pipelines with multiple GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated (via an inter-GPU communication process) to the video memory of a primary GPU, and wherein the video memory and the geometry and/or pixel processing subsystems in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process; -
FIG. 4C is a time-line representation of process of generating a frame of pixels for an image along a specified viewing during a particular parallel rendering cycle in accordance with the principles of the present invention, wherein the pixel recomposition step of the parallel rendering process is shown to reuses GPU-based computational resources during its idle time, without the need for specialized or dedicated compositional apparatus required by prior art parallel graphics systems supporting an object division mode of parallel graphics rendering; -
FIG. 5A is a schematic representation of the a dual GPU-based parallel graphics system according to the present invention, having a pair of graphics processing pipelines with a pair of GPUs supporting a parallel graphics rendering process having an object division mode of operation, wherein each GPU comprises video memory, a geometry processing subsystem and a pixel processing subsystem, wherein pixel (color and z depth) data buffered in the video memory of each GPU is communicated (via an inter-GPU communication process supported over a pair of PCI Express buses) to the video memory of a primary GPU, and wherein the video memory and the geometry and/or pixel processing subsystems in the primary GPU are used to carry out the image recomposition phase of the object division mode of parallel graphics rendering process; -
FIG. 5B is a schematic representation of decomposing module and distributing module supported within the host CPU Program Space of the host computer system shown inFIG. 5A , wherein the decomposing module of present invention comprises functional sub-blocks for OS-GPU I/F and Utilities, Division Control and State Monitoring, and Composition Management, whereas the Distributing Module comprises functional sub-block for (Graphics Display List Data and Command) Distribution Management; -
FIG. 6A is a schematic representation of the parallel graphics rendering process of the present invention having an object division mode, supported on the dual GPU-based parallel graphics system shown inFIG. 5A ; -
FIG. 6B is a graphical representation of Shader code (expressed in a graphics programming language, e.g. Cg) that is used within the primary GPU in order to carry out the pixel recomposition stage of the object division mode/method of the parallel graphics rendering process of the present invention, supported on the dual GPU-based parallel graphics system shown inFIG. 5A ; -
FIG. 7A is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using a multiple GPU-based graphics cards; -
FIG. 7B is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using multiple GPUs on a single card -
FIG. 7C is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using an external box equipped with multiple GPU-based graphics cards; -
FIG. 8 is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using a multiple-GPU chip design; -
FIG. 9A is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as an integrated graphics device (IGD) based system provided with a single graphics card; -
FIG. 9B is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a combined system comprising an IGD-based system provided with two graphics cards; -
FIG. 9C is a schematic representation of an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a system having dual or multiple IGDs each embodying the object division based parallel graphics rendering process of the present invention; and -
FIG. 10 is a graphical representation of an implementation of the multiple GPU-based parallel graphics system of the present invention, wherein the multiple GPU-based parallel graphics system and process are incorporated within a video game console. - Referring to the
FIG. 4A through 10 in the accompanying Drawings, the various illustrative embodiments of the multiple GPU-based parallel graphics system and process of the present invention will be described in great detail, wherein like elements will be indicated using like reference numerals. - In accordance with the principles of the present invention, the pixel recomposition phase of the object division based graphics rendering process is carried out by means of GPU-based pixel processing resources including video memory, and the geometry processing subsystem and/or the pixel processing subsystem, as emphasized in
FIG. 4A . -
FIG. 4B illustrates the give major steps associated with the object division based parallel graphics rendering process of present invention, namely: decompose, distribute, render, recompose, and display. As illustrated inFIG. 4B , the computational resources contained within one of the multiple GPUs on the platform, termed the primary GPU, and to which the display device (406) is attached, are reutilized for image/pixel recomposing, in addition to graphics rendering. InFIG. 5B , the general case of a multiple GPU-based graphic subsystem is considered with n GPUs being shown. Pixel data contained in the Frame buffers (FB) associated with the secondary GPUs are moved to the primary GPU by way of an inter-GPU communication process (e.g. supported by multiple-lane PCI Express™ buses), and processed within the local FB of the primary GPU, to perform pixel image (re)composition, as will be explained in greater detail hereinafter. The pixel composition result is then sent to display device, and alternatively, also returned to the secondary GPUs, if required in some applications as a basis of the next pixel frame. -
FIG. 4C illustrates the time-line of one complete composited pixel frame, including time slots associated with the different steps of object division rendering. The reuse of GPU resources for compositing not only eliminates the use of an additional specialized apparatus, but it is utilized in a time slot, where in prior art the specialized apparatus works, leaving the GPU resources idle during the recompose step. Thus, by virtue of the present invention, GPU resources are used “for free” without sacrificing system performance. -
FIG. 5A shows an illustrative example of a dual GPU-based graphics system of present invention supporting object division mode of parallel graphics rendering employing GPU-based pixel recomposition. In the illustrative embodiment, the object division based GPU graphics system of the present invention is implemented using a conventional dual-GPU graphics platform (e.g. Nvidia's SLI™ dual-GPU graphics system system) supporting image or/and time division modes of parallel graphics rendering, and converting into the novel object division based GPU-based parallel graphics system of the present invention. This graphics platform conversion process, which is only one aspect of the present invention, is carried out using the novel software architecture and programming principles of the present invention (503), which in combination transforms a multiple GPU-based graphics platform (capable of supporting time and/or image division mode of parallel graphics rendering), by controlling the primary GPU (on the primary graphics card (205)) in such as way that it operates and supports pixel and other data processing operations that implement compositing stage of the object division based parallel graphics rendering process of the present invention. - As shown in
FIG. 5A , decomposition is accomplished by Decomposing module (504), and the distribution of graphics display list data and command streams by Distributing module (505). Typically, the graphics support environment on the host computer comprises: the application (501); the Standard Graphics Library (502, e.g. OpenGL or Direct3D); and the vendor's GPU driver (506). In the illustrative embodiment of the system, there are two graphic cards (204, 205) driven by vendor's GPU driver, attached to the PC motherboard, and connected by two PCIexpress buses (207, 208) via memory bridge (203) (termed also “chipset”). One of these cards (205) is attached to display device (106) and is therefore termed the “primary” card, and its GPU, is termed the “primary GPU”. The primary card is magnified so as show its internal architecture, which was described in part with reference toFIG. 2B . - As shown in
FIG. 5B , the decomposing and distributing modules of present invention comprises a number of functional sub-blocks, namely: Decomposing module (504); OS-GPU Interface and Utilities (521); Division Control and State Monitoring (522); Composition Management (523); Distribution Management module (525). - The Decomposing module (504) primarily implements the decomposing step of object division rendering process, but also interfaces with the OS and vendor's GPU driver and with GPUs, and supervises recomposition process in GPUs. These steps are accomplished by means of the following functional blocks: OS-GPU Interface and Utilities (521); Division Control and State Monitoring (522); and Composition Management (523).
- OS-GPU Interface and Utilities Module (521) performs all the functions associated with interaction with the Operation System, graphic library (e.g. OpenGL or DirectX), and interfacing with GPUs. This functional block is responsible for interception of the graphic commands from the standard graphic library, forwarding and creating graphic commands to Vendor's GPU Driver, controlling registry and installation, OS services and utilities.
- Division Control and State Monitoring Module (522) controls the object division parameters and data to be processed by each GPU for load balancing, data validity, etc., and also handles state validity across the system. The graphic libraries (e.g. OpenGL and DirectX) are state machines. Parallelization must preserve cohesive state across the graphic system. It is done by continuous analysis of all incoming commands, while the state commands and some of the data must be duplicated to all pipelines in order to preserve the valid state across the graphic pipeline. This function is exercised mainly in object division scheme, as disclosed in detail in inventor's previous pending patent PCT/IL04/001069, incorporated herein by reference.
- Composition Management Module (523) supervises the composition process at GPUs issuing commands and shader codes to handling the read-back of frame buffers, transfer data and perform compositing, as will be described in details hereinafter.
- The Distributing Step/Phase (505) of object division parallel graphics rendering process of the present invention is implemented by the Distribution Management Module (525), which addresses the streams of commands and data to the different GPUs via chipset outputs.
- Referring now to
FIGS. 4A , 5A, 6A, and 6B, the innovative pixel compositing phase of the multiple-GPU based parallel graphics rendering process of the present invention will now be described in great technical detail. In one illustrative embodiment of the present invention, the compositing phase/stage involves moving the pixel Depth and Color values from the frame buffers FB in the secondary GPU, to the FB in the primary GPU (via inter-GPU communication), and merging then merging these pixel values with their counterparts at the primary GPU by means of programmable Fragment Shader in the pixel processing subsystem (211). -
FIG. 6A provides a flowchart for the compositing process. In the illustrative embodiment, a compositing process employing dual GPUs is described. However, it is understood that if more GPUs are involved, then the flowchart process will repeat accordingly for each additional “secondary” GPU, until the final step when the partially composited pixel data in the frame buffer (FB) in the last secondary GPU, is finally composited with the pixel data within the frame buffer of the primary GPU. - As shown in
FIG. 6A , the pixel frame generating pipeline includes the steps: decompose (402, see FIG. 4A)), distribute (403), and render (404). Towards the end of the graphics pipeline, the recompose step (405) is carried out for final FB, which is finally displayed to the display device (405). - During the Decompositing step (402), graphics commands and data stream are decomposed into well load balanced sub-streams in Decompositing Module (504,
FIG. 5A ), keeping state consistency of graphics libraries. - The Distributing step (403) is supervised by the Distributing module (505,
FIG. 5A ). They are sent to Vendor's GPU Driver (506), memory bridge (203), and delivered for rendering to graphics cards, the primary (205) and secondary (204) via separate PCIexpress buses (207, 208). - Rendering (step 404) is done simultaneously (602, 603) in both GPUs, creating two partial FBs.
- The compositing process (step 405 of
FIG. 4 ) comprises the following substeps: - Step (606): The color FB is read back from the secondary GPU, and moved via memory bridge (203) to the primary GPU's Texture memory (218) as a texture tex1.
- Step (607): The Z-buff is read back from the secondary GPU, and moved via memory bridge (203) to the primary GPU's Texture memory (218) as a texture dep1.
- Step (604): Color FB of primary GPU is copied to texture memory as texture tex2.
- Step (605): Z-buffer of primary GPU is copied to texture memory as texture dep2.
- Step (608): Shader code for recomposition (as shown in
FIG. 6B ) is downloaded and exercised on four textures tex1, tex2, dep1, dep2 as follows: - Step (609): The two depth textures are compared pixel by pixel for their depth values. Assuming the rule that the closest pixel is the one to be transferred to the final FB, at each x,y location the two depth textures are compared for lowest depth value, the lowest is chosen, and the color value at x,y of its correspondent color texture is moved to the x,y location in the final texture.
- Step (610): The resulting texture is copied back to the primary color FB.
- To complete rendering (step 404 b), the following substeps are performed:
- Step (611): All transparent objects of the scene and overlays (such as score titles) are essentially kept by applications for the very last data to be rendered. Therefore, once all opaque objects have been rendered in parallel at separate GPUs and composed back to the primary's FB, the additional and final phase of a non-parallel rendering of transparent objects takes place in the primary GPU.
- Step (612): The final FB is sent to the display device for display on its display screen.
- In
step 405, the detailed shader program is used to composite two color textures based on depth test between two depth textures, as shown inFIG. 6B . - While the above illustrative embodiment discloses the use of the Fragment Shader in the pixel processing subsystem/engine within the primary GPU to carry out the composition process in the dual GPU-based graphics platform of the present invention, it is understood that other computational resources within the GPU can be used in accordance with the scope and spirit of the present invention. In particular, in a second illustrative embodiments, the compositing phase/stage can involve moving the pixel Depth and Color values from the frame buffers FB in the secondary GPU, to the FB in the primary GPU (via inter-GPU communication), and merging then merging these pixel values with their counterparts at the primary GPU by means of programmable Vertex Shader in the geometry processing subsystem (210). And in yet another illustrative embodiment of the present invention, the compositing phase/stage can involve moving the pixel Depth and Color values from the frame buffers FB in the secondary GPU, to the FB in the primary GPU (via inter-GPU communication), and merging then merging these pixel values with their counterparts at the primary GPU by means of both programmable Vertex and Fragment Shaders in the geometry and pixel processing subsystems in the primary GPU. Such modifications will become readily apparent to those skilled in the art having the benefit of the present inventive disclosure.
- As taught hereinabove, the GPU-based composition process associated with the object division parallel graphics rendering process of the present invention can be realized as a software method that (i) controls the computational machinery within the GPUs of the parallel graphics platform, and (ii) exploits the Shader (pixel) processing capabilities in the primary GPU, with no need for any external hardware. As this GPU exists in any dual or multiple GPU-based graphics system, the object division parallel graphics rendering process and platform of present invention can be implemented on a great variety of existing, as well as new graphics systems in a multitude of ways. Below are just some examples of possible system designs that can be constructed using the principles of the present invention.
- In
FIG. 7A , there is shown a first implementation of the dual GPU-based parallel graphics system (700) according to the present invention, constructed using a multiple GPU-based graphics cards (701). In an illustrative embodiment, host motherboard can be realized as an Asus A8N-SLI (702), and the graphics cards can be realized by a pair of Nvidia GEforce 6800 cards (701) and chipset nForce 680 by Nvidia (not shown). - In
FIG. 7B , there is shown an implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using multiple GPUs on a single card. - In
FIG. 7C , there is shown a second implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using an external box equipped with multiple GPU-based graphics cards. - In
FIG. 8 , there is shown a third implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed using a multiple-GPU chip design. - In
FIG. 9 , there is shown a fourth Implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as an integrated graphics device (IGD) based system (901) provided with a single graphics card (902). As conventional IGD-based chipsets (e.g. Intel 845GL) do not have programmable shaders yet the external GPU on the graphics card will function as the primary GPU and perform the pixel composition process in accordance with the principles of the present invention. - In
FIG. 9B , there is shown a fifth implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a combined system comprising an IGD-based system (911). provided with two graphics cards (912, 913). In the illustrative embodiment, the IGD of this dual card system has dual PCIexpress bus (e.g. bearlake by Intel), so that two external GPUs can be used. - In
FIG. 9C , there is show a sixth implementation of the multiple GPU-based parallel graphics system according to the present invention, constructed as a system having dual or multiple IGDs each embodying the object division based parallel graphics rendering process of the present invention. Such an IGD will include a programmable shader to practice the pixel composition process of the present invention. - In
FIG. 10 , there is shown a graphical representation of a seventh possible implementation of the multiple GPU-based parallel graphics system of the present invention, wherein the multiple GPU-based parallel graphics system and process are incorporated within a video game console. This illustrative example shows the Microsoft™ Xbox 360 game console embodying the parallel graphics rendering process and apparatus of the present invention. - While the illustrative embodiments of the present invention have been described in connection with various PC-based computing system applications, it is understood that that parallel graphics systems and rendering processes of the present invention can also be used in video game consoles and systems, mobile computing devices, e-commerce and POS displays and the like.
- It is understood that the parallel graphics rendering technology employed in computer graphics systems of the illustrative embodiments may be modified in a variety of ways which will become readily apparent to those skilled in the art of having the benefit of the novel teachings disclosed herein. All such modifications and variations of the illustrative embodiments thereof shall be deemed to be within the scope and spirit of the present invention as defined by the Claims to Invention appended hereto.
Claims (6)
1. A method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system,
wherein said parallel graphics rendering system supports a parallel graphics rendering process using an object division mode of parallel computing operation, and wherein said parallel graphics rendering system includes a primary GPPL and at least one secondary GPPL, and
wherein each said GPPL includes (i) a GPU having a pixel processing subsystem provided with a programmable fragment shader, and (ii) video memory including a frame buffer (FB) having depth and color frame buffers for buffering pixel depth and color value, respectively,
said method comprising the steps of:
(a) during the recompositing stage, moving the pixel Depth and Color values from said frame buffers in said secondary GPPL, to said frame buffers in said primary GPPL, by way of inter-GPPL communication; and
(b) merging said pixel depth and color values with their counterparts, within said frame buffer of said primary GPPL using said programmable fragment shader provided in said pixel processing subsystem.
2. The method of claim 1 , wherein steps (a) and (b) are carried out transparently to said graphics-based application.
3. A method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system,
wherein said parallel graphics rendering system supports a parallel graphics rendering process using an object division mode of parallel computing operation, and wherein said parallel graphics rendering system includes a primary GPPL and at least one secondary GPPL, and
wherein each said GPPL includes (i) a GPU having a geometry processing subsystem provided with a programmable vertex shader, and (ii) video memory including a frame buffer (FB) having depth and color frame buffers for buffering pixel depth and color value, respectively,
said method comprising the steps of:
(a) during the recompositing stage, moving the pixel Depth and Color values from said frame buffers in said secondary GPPL, to said frame buffer in said primary GPPL, by way of inter-GPPL communication; and
(b) merging said pixel depth and color values with their counterparts, within said frame buffer of said primary GPPL using said programmable vertex shader supported in said pixel processing subsystem.
4. The method of claim 3 , wherein steps (a) and (b) are carried out transparently to said graphics-based application.
5. A method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system,
wherein said parallel graphics rendering system supports a parallel graphics rendering process using an object division mode of parallel computing operation, and wherein said parallel graphics rendering system includes a primary GPPL and at least one secondary GPPL, and
wherein each said GPPL includes (i) a GPU having a geometry processing subsystem provided with a programmable vertex shader, and a pixel processing subsystem provided with a programmable fragment shader, and (ii) video memory including a frame buffer (FB) having depth and color frame buffers for buffering pixel depth and color value, respectively, said method comprising the steps of:
(a) during the recompositing stage, moving the pixel Depth and Color values from said frame buffers in said secondary GPPL, to said frame buffers in said primary GPPL, by way of inter-GPPL communication; and
(b) merging said pixel depth and color values with their counterparts, within said frame buffer of said primary GPPL using both said programmable vertex shader provided in said geometry processing subsystem and said programmable fragment shader provided in said pixel processing subsystem.
6. The method of claim 5 , wherein steps (a) and (b) are carried out transparently to said graphics-based application.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/901,458 US20080158235A1 (en) | 2006-12-31 | 2007-09-17 | Method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/648,160 US8497865B2 (en) | 2006-12-31 | 2006-12-31 | Parallel graphics system employing multiple graphics processing pipelines with multiple graphics processing units (GPUS) and supporting an object division mode of parallel graphics processing using programmable pixel or vertex processing resources provided with the GPUS |
US11/901,458 US20080158235A1 (en) | 2006-12-31 | 2007-09-17 | Method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/648,160 Continuation US8497865B2 (en) | 2003-11-19 | 2006-12-31 | Parallel graphics system employing multiple graphics processing pipelines with multiple graphics processing units (GPUS) and supporting an object division mode of parallel graphics processing using programmable pixel or vertex processing resources provided with the GPUS |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080158235A1 true US20080158235A1 (en) | 2008-07-03 |
Family
ID=39583236
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/648,160 Active 2030-11-04 US8497865B2 (en) | 2003-11-19 | 2006-12-31 | Parallel graphics system employing multiple graphics processing pipelines with multiple graphics processing units (GPUS) and supporting an object division mode of parallel graphics processing using programmable pixel or vertex processing resources provided with the GPUS |
US11/901,458 Abandoned US20080158235A1 (en) | 2006-12-31 | 2007-09-17 | Method of rendering pixel-composited images for a graphics-based application running on a host computing system embodying a parallel graphics rendering system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/648,160 Active 2030-11-04 US8497865B2 (en) | 2003-11-19 | 2006-12-31 | Parallel graphics system employing multiple graphics processing pipelines with multiple graphics processing units (GPUS) and supporting an object division mode of parallel graphics processing using programmable pixel or vertex processing resources provided with the GPUS |
Country Status (1)
Country | Link |
---|---|
US (2) | US8497865B2 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8325178B1 (en) | 2007-12-05 | 2012-12-04 | The United States Of America, As Represented By The Secretary Of The Navy | Lines-of-sight and viewsheds determination system |
US8400448B1 (en) | 2007-12-05 | 2013-03-19 | The United States Of America, As Represented By The Secretary Of The Navy | Real-time lines-of-sight and viewsheds determination system |
US10019775B2 (en) | 2015-04-30 | 2018-07-10 | Honeywell International Inc. | Method and system for scalable, radiation-tolerant, space-rated, high integrity graphics processing unit |
WO2020038407A1 (en) * | 2018-08-21 | 2020-02-27 | 腾讯科技(深圳)有限公司 | Image rendering method and apparatus, image processing device, and storage medium |
CN111857918A (en) * | 2020-07-09 | 2020-10-30 | 长沙景嘉微电子股份有限公司 | 2D desktop PorterDuff implementation method and device |
CN115298686A (en) * | 2020-02-03 | 2022-11-04 | 索尼互动娱乐股份有限公司 | System and method for efficient multi-GPU rendering of geometry by pre-testing interlaced screen regions prior to rendering |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8072460B2 (en) * | 2007-10-17 | 2011-12-06 | Nvidia Corporation | System, method, and computer program product for generating a ray tracing data structure utilizing a parallel processor architecture |
TWI482118B (en) * | 2012-10-18 | 2015-04-21 | Wistron Corp | System and method for processing load balance of graphic streams |
CN102903087B (en) * | 2012-10-25 | 2015-09-30 | 西安电子科技大学 | Based on the SAR image denoising method of GPU programming |
US9030480B2 (en) * | 2012-12-18 | 2015-05-12 | Nvidia Corporation | Triggering performance event capture via pipelined state bundles |
US9384522B2 (en) * | 2012-12-28 | 2016-07-05 | Qualcomm Incorporated | Reordering of command streams for graphical processing units (GPUs) |
US20140192052A1 (en) * | 2013-01-09 | 2014-07-10 | Advanced Micro Devices, Inc. | 2d rendering on 3d graphics hardware |
CN103544729A (en) * | 2013-09-24 | 2014-01-29 | Tcl集团股份有限公司 | Animation data processing method and system |
CN104240199A (en) * | 2014-09-02 | 2014-12-24 | 苏州阔地网络科技有限公司 | Method and device for eliminating noise of image |
US9761042B2 (en) * | 2015-05-27 | 2017-09-12 | Siemens Healthcare Gmbh | Method for streaming-optimized medical raytracing |
US9940688B2 (en) * | 2015-06-04 | 2018-04-10 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Video adapter alignment |
CN104992421B (en) * | 2015-07-09 | 2018-08-17 | 西安电子科技大学 | A kind of parallel optimization method of the Image denoising algorithm based on OpenCL |
US10433025B2 (en) * | 2016-05-10 | 2019-10-01 | Jaunt Inc. | Virtual reality resource scheduling of process in a cloud-based virtual reality processing system |
CN107977227A (en) * | 2016-10-21 | 2018-05-01 | 超威半导体公司 | The pipeline of separate hardware data path including different instruction type |
US10241766B2 (en) | 2017-06-22 | 2019-03-26 | Microsoft Technology Licensing, Llc | Application binary interface cross compilation |
US10102015B1 (en) | 2017-06-22 | 2018-10-16 | Microsoft Technology Licensing, Llc | Just in time GPU executed program cross compilation |
US10289393B2 (en) | 2017-06-22 | 2019-05-14 | Microsoft Technology Licensing, Llc | GPU-executed program sequence cross-compilation |
US10657698B2 (en) * | 2017-06-22 | 2020-05-19 | Microsoft Technology Licensing, Llc | Texture value patch used in GPU-executed program sequence cross-compilation |
JP7003994B2 (en) * | 2017-08-08 | 2022-01-21 | ソニーグループ株式会社 | Image processing equipment and methods |
GB2571306A (en) * | 2018-02-23 | 2019-08-28 | Sony Interactive Entertainment Europe Ltd | Video recording and playback systems and methods |
US11170461B2 (en) * | 2020-02-03 | 2021-11-09 | Sony Interactive Entertainment Inc. | System and method for efficient multi-GPU rendering of geometry by performing geometry analysis while rendering |
CN115223516B (en) * | 2022-09-20 | 2022-12-13 | 深圳市优奕视界有限公司 | Graphics rendering and LCD driving integrated chip and related method and device |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040066384A1 (en) * | 2002-09-06 | 2004-04-08 | Sony Computer Entertainment Inc. | Image processing method and apparatus |
US7015915B1 (en) * | 2003-08-12 | 2006-03-21 | Nvidia Corporation | Programming multiple chips from a command buffer |
US7388581B1 (en) * | 2003-08-28 | 2008-06-17 | Nvidia Corporation | Asynchronous conditional graphics rendering |
US7525547B1 (en) * | 2003-08-12 | 2009-04-28 | Nvidia Corporation | Programming multiple chips from a command buffer to process multiple images |
US7598958B1 (en) * | 2004-11-17 | 2009-10-06 | Nvidia Corporation | Multi-chip graphics processing unit apparatus, system, and method |
US7633505B1 (en) * | 2004-11-17 | 2009-12-15 | Nvidia Corporation | Apparatus, system, and method for joint processing in graphics processing units |
Family Cites Families (191)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US685376A (en) * | 1900-09-13 | 1901-10-29 | Sinclair J Johnson | Car-door. |
CA2073516A1 (en) | 1991-11-27 | 1993-05-28 | Peter Michael Kogge | Dynamic multi-mode parallel processor array architecture computer system |
JP3199205B2 (en) | 1993-11-19 | 2001-08-13 | 株式会社日立製作所 | Parallel processing unit |
EP0693737A3 (en) | 1994-07-21 | 1997-01-08 | Ibm | Method and apparatus for managing multiprocessor graphical workload distribution |
US5745762A (en) | 1994-12-15 | 1998-04-28 | International Business Machines Corporation | Advanced graphics driver architecture supporting multiple system emulations |
US5687357A (en) | 1995-04-14 | 1997-11-11 | Nvidia Corporation | Register array for utilizing burst mode transfer on local bus |
US5754866A (en) | 1995-05-08 | 1998-05-19 | Nvidia Corporation | Delayed interrupts with a FIFO in an improved input/output architecture |
US5623692A (en) | 1995-05-15 | 1997-04-22 | Nvidia Corporation | Architecture for providing input/output operations in a computer system |
US5758182A (en) | 1995-05-15 | 1998-05-26 | Nvidia Corporation | DMA controller translates virtual I/O device address received directly from application program command to physical i/o device address of I/O device on device bus |
US5909595A (en) | 1995-05-15 | 1999-06-01 | Nvidia Corporation | Method of controlling I/O routing by setting connecting context for utilizing I/O processing elements within a computer system to produce multimedia effects |
US5794016A (en) | 1995-12-11 | 1998-08-11 | Dynamic Pictures, Inc. | Parallel-processor graphics architecture |
KR100269106B1 (en) | 1996-03-21 | 2000-11-01 | 윤종용 | Multiprocessor graphics system |
WO1998007266A1 (en) | 1996-08-14 | 1998-02-19 | Northern Telecom Limited | Internet-based telephone call manager |
US6118462A (en) | 1997-07-01 | 2000-09-12 | Memtrax Llc | Computer system controller having internal memory and external memory control |
US6169553B1 (en) | 1997-07-02 | 2001-01-02 | Ati Technologies, Inc. | Method and apparatus for rendering a three-dimensional scene having shadowing |
US6201545B1 (en) | 1997-09-23 | 2001-03-13 | Ati Technologies, Inc. | Method and apparatus for generating sub pixel masks in a three dimensional graphic processing system |
US6856320B1 (en) | 1997-11-25 | 2005-02-15 | Nvidia U.S. Investment Company | Demand-based memory system for graphics applications |
US6337686B2 (en) | 1998-01-07 | 2002-01-08 | Ati Technologies Inc. | Method and apparatus for line anti-aliasing |
US6496187B1 (en) | 1998-02-17 | 2002-12-17 | Sun Microsystems, Inc. | Graphics system configured to perform parallel sample to pixel calculation |
US6473089B1 (en) | 1998-03-02 | 2002-10-29 | Ati Technologies, Inc. | Method and apparatus for a video graphics circuit having parallel pixel processing |
US6259460B1 (en) | 1998-03-26 | 2001-07-10 | Silicon Graphics, Inc. | Method for efficient handling of texture cache misses by recirculation |
US7038692B1 (en) | 1998-04-07 | 2006-05-02 | Nvidia Corporation | Method and apparatus for providing a vertex cache |
US6092124A (en) | 1998-04-17 | 2000-07-18 | Nvidia Corporation | Method and apparatus for accelerating the rendering of images |
US6184908B1 (en) | 1998-04-27 | 2001-02-06 | Ati Technologies, Inc. | Method and apparatus for co-processing video graphics data |
US6212617B1 (en) | 1998-05-13 | 2001-04-03 | Microsoft Corporation | Parallel processing method and system using a lazy parallel data type to reduce inter-processor communication |
US6477687B1 (en) | 1998-06-01 | 2002-11-05 | Nvidia U.S. Investment Company | Method of embedding RAMS and other macrocells in the core of an integrated circuit chip |
US7068272B1 (en) | 2000-05-31 | 2006-06-27 | Nvidia Corporation | System, method and article of manufacture for Z-value and stencil culling prior to rendering in a computer graphics processing pipeline |
US6636215B1 (en) | 1998-07-22 | 2003-10-21 | Nvidia Corporation | Hardware-assisted z-pyramid creation for host-based occlusion culling |
US6646639B1 (en) | 1998-07-22 | 2003-11-11 | Nvidia Corporation | Modified method and apparatus for improved occlusion culling in graphics systems |
US7023437B1 (en) | 1998-07-22 | 2006-04-04 | Nvidia Corporation | System and method for accelerating graphics processing using a post-geometry data stream during multiple-pass rendering |
US6415345B1 (en) | 1998-08-03 | 2002-07-02 | Ati Technologies | Bus mastering interface control system for transferring multistream data over a host bus |
US6191800B1 (en) | 1998-08-11 | 2001-02-20 | International Business Machines Corporation | Dynamic balancing of graphics workloads using a tiling strategy |
US6492987B1 (en) | 1998-08-27 | 2002-12-10 | Ati Technologies, Inc. | Method and apparatus for processing object elements that are being rendered |
US6188412B1 (en) | 1998-08-28 | 2001-02-13 | Ati Technologies, Inc. | Method and apparatus for performing setup operations in a video graphics system |
US6292200B1 (en) | 1998-10-23 | 2001-09-18 | Silicon Graphics, Inc. | Apparatus and method for utilizing multiple rendering pipes for a single 3-D display |
US6753878B1 (en) | 1999-03-08 | 2004-06-22 | Hewlett-Packard Development Company, L.P. | Parallel pipelined merge engines |
JP3169933B2 (en) | 1999-03-16 | 2001-05-28 | 四国日本電気ソフトウェア株式会社 | Parallel drawing device |
US6535209B1 (en) | 1999-03-17 | 2003-03-18 | Nvidia Us Investments Co. | Data stream splitting and storage in graphics data processing |
US6288418B1 (en) | 1999-03-19 | 2001-09-11 | Nvidia Corporation | Multiuse input/output connector arrangement for graphics accelerator integrated circuit |
US6181352B1 (en) | 1999-03-22 | 2001-01-30 | Nvidia Corporation | Graphics pipeline selectively providing multiple pixels or multiple textures |
US6577320B1 (en) | 1999-03-22 | 2003-06-10 | Nvidia Corporation | Method and apparatus for processing multiple types of pixel component representations including processes of premultiplication, postmultiplication, and colorkeying/chromakeying |
US6333744B1 (en) | 1999-03-22 | 2001-12-25 | Nvidia Corporation | Graphics pipeline including combiner stages |
DE19917092A1 (en) | 1999-04-15 | 2000-10-26 | Sp3D Chip Design Gmbh | Accelerated method for grid forming of graphic basic element in order beginning with graphic base element instruction data to produce pixel data for graphic base element |
US6442656B1 (en) | 1999-08-18 | 2002-08-27 | Ati Technologies Srl | Method and apparatus for interfacing memory with a bus |
US6578068B1 (en) | 1999-08-31 | 2003-06-10 | Accenture Llp | Load balancer in environment services patterns |
US6352479B1 (en) | 1999-08-31 | 2002-03-05 | Nvidia U.S. Investment Company | Interactive gaming server and online community forum |
US6657635B1 (en) | 1999-09-03 | 2003-12-02 | Nvidia Corporation | Binning flush in graphics data processing |
US6452595B1 (en) | 1999-12-06 | 2002-09-17 | Nvidia Corporation | Integrated graphics processing unit with antialiasing |
US6573900B1 (en) | 1999-12-06 | 2003-06-03 | Nvidia Corporation | Method, apparatus and article of manufacture for a sequencer in a transform/lighting module capable of processing multiple independent execution threads |
US6417851B1 (en) | 1999-12-06 | 2002-07-09 | Nvidia Corporation | Method and apparatus for lighting module in a graphics processor |
US6870540B1 (en) | 1999-12-06 | 2005-03-22 | Nvidia Corporation | System, method and computer program product for a programmable pixel processing model with instruction set |
US6844880B1 (en) | 1999-12-06 | 2005-01-18 | Nvidia Corporation | System, method and computer program product for an improved programmable vertex processing model with instruction set |
US6198488B1 (en) | 1999-12-06 | 2001-03-06 | Nvidia | Transform, lighting and rasterization system embodied on a single semiconductor platform |
US6353439B1 (en) | 1999-12-06 | 2002-03-05 | Nvidia Corporation | System, method and computer program product for a blending operation in a transform module of a computer graphics pipeline |
US7050055B2 (en) | 1999-12-06 | 2006-05-23 | Nvidia Corporation | Single semiconductor graphics platform with blending and fog capabilities |
US6473086B1 (en) | 1999-12-09 | 2002-10-29 | Ati International Srl | Method and apparatus for graphics processing using parallel graphics processors |
US6557065B1 (en) | 1999-12-20 | 2003-04-29 | Intel Corporation | CPU expandability bus |
US6760031B1 (en) | 1999-12-31 | 2004-07-06 | Intel Corporation | Upgrading an integrated graphics subsystem |
WO2001069207A1 (en) | 2000-03-16 | 2001-09-20 | Fuji Photo Film Co., Ltd. | Measuring method and instrument utilizing total reflection attenuation |
US6831652B1 (en) | 2000-03-24 | 2004-12-14 | Ati International, Srl | Method and system for storing graphics data |
US6975319B1 (en) | 2000-03-24 | 2005-12-13 | Nvidia Corporation | System, method and article of manufacture for calculating a level of detail (LOD) during computer graphics processing |
US6741243B2 (en) | 2000-05-01 | 2004-05-25 | Broadcom Corporation | Method and system for reducing overflows in a computer graphics system |
US6725457B1 (en) | 2000-05-17 | 2004-04-20 | Nvidia Corporation | Semaphore enhancement to improve system performance |
US6670958B1 (en) | 2000-05-26 | 2003-12-30 | Ati International, Srl | Method and apparatus for routing data to multiple graphics devices |
US6728820B1 (en) | 2000-05-26 | 2004-04-27 | Ati International Srl | Method of configuring, controlling, and accessing a bridge and apparatus therefor |
US6662257B1 (en) | 2000-05-26 | 2003-12-09 | Ati International Srl | Multiple device bridge apparatus and method thereof |
US6633296B1 (en) | 2000-05-26 | 2003-10-14 | Ati International Srl | Apparatus for providing data to a plurality of graphics processors and method thereof |
US6789154B1 (en) | 2000-05-26 | 2004-09-07 | Ati International, Srl | Apparatus and method for transmitting data |
US6724394B1 (en) | 2000-05-31 | 2004-04-20 | Nvidia Corporation | Programmable pixel shading architecture |
US6593923B1 (en) | 2000-05-31 | 2003-07-15 | Nvidia Corporation | System, method and article of manufacture for shadow mapping |
US6532013B1 (en) | 2000-05-31 | 2003-03-11 | Nvidia Corporation | System, method and article of manufacture for pixel shaders for programmable shading |
US6664963B1 (en) | 2000-05-31 | 2003-12-16 | Nvidia Corporation | System, method and computer program product for programmable shading using pixel shaders |
US6690372B2 (en) | 2000-05-31 | 2004-02-10 | Nvidia Corporation | System, method and article of manufacture for shadow mapping |
US6801202B2 (en) | 2000-06-29 | 2004-10-05 | Sun Microsystems, Inc. | Graphics system configured to parallel-process graphics data using multiple pipelines |
US7405734B2 (en) | 2000-07-18 | 2008-07-29 | Silicon Graphics, Inc. | Method and system for presenting three-dimensional computer graphics images using multiple graphics processing units |
US6959110B1 (en) | 2000-08-17 | 2005-10-25 | Nvidia Corporation | Multi-mode texture compression algorithm |
US7116331B1 (en) | 2000-08-23 | 2006-10-03 | Intel Corporation | Memory controller hub interface |
US6842180B1 (en) | 2000-09-20 | 2005-01-11 | Intel Corporation | Opportunistic sharing of graphics resources to enhance CPU performance in an integrated microprocessor |
US6502173B1 (en) | 2000-09-29 | 2002-12-31 | Ati Technologies, Inc. | System for accessing memory and method therefore |
US6532525B1 (en) | 2000-09-29 | 2003-03-11 | Ati Technologies, Inc. | Method and apparatus for accessing memory |
US6731298B1 (en) | 2000-10-02 | 2004-05-04 | Nvidia Corporation | System, method and article of manufacture for z-texture mapping |
US6828980B1 (en) | 2000-10-02 | 2004-12-07 | Nvidia Corporation | System, method and computer program product for z-texture mapping |
JP3580789B2 (en) | 2000-10-10 | 2004-10-27 | 株式会社ソニー・コンピュータエンタテインメント | Data communication system and method, computer program, recording medium |
US6961057B1 (en) | 2000-10-12 | 2005-11-01 | Nvidia Corporation | Method and apparatus for managing and accessing depth data in a computer graphics system |
US6362997B1 (en) | 2000-10-16 | 2002-03-26 | Nvidia | Memory system for use on a circuit board in which the number of loads are minimized |
US6636212B1 (en) | 2000-11-14 | 2003-10-21 | Nvidia Corporation | Method and apparatus for determining visibility of groups of pixels |
US6778181B1 (en) | 2000-12-07 | 2004-08-17 | Nvidia Corporation | Graphics processing system having a virtual texturing array |
US7027972B1 (en) | 2001-01-24 | 2006-04-11 | Ati Technologies, Inc. | System for collecting and analyzing graphics data and method thereof |
US7358974B2 (en) | 2001-01-29 | 2008-04-15 | Silicon Graphics, Inc. | Method and system for minimizing an amount of data needed to test data against subarea boundaries in spatially composited digital video |
US6888580B2 (en) | 2001-02-27 | 2005-05-03 | Ati Technologies Inc. | Integrated single and dual television tuner having improved fine tuning |
US7130316B2 (en) | 2001-04-11 | 2006-10-31 | Ati Technologies, Inc. | System for frame based audio synchronization and method thereof |
US6542971B1 (en) | 2001-04-23 | 2003-04-01 | Nvidia Corporation | Memory access system and method employing an auxiliary buffer |
US6664960B2 (en) | 2001-05-10 | 2003-12-16 | Ati Technologies Inc. | Apparatus for processing non-planar video graphics primitives and associated method of operation |
US6700583B2 (en) | 2001-05-14 | 2004-03-02 | Ati Technologies, Inc. | Configurable buffer for multipass applications |
US6894687B1 (en) | 2001-06-08 | 2005-05-17 | Nvidia Corporation | System, method and computer program product for vertex attribute aliasing in a graphics pipeline |
US6697064B1 (en) | 2001-06-08 | 2004-02-24 | Nvidia Corporation | System, method and computer program product for matrix tracking during vertex processing in a graphics pipeline |
WO2002101497A2 (en) | 2001-06-08 | 2002-12-19 | Nvidia Corporation | System, method and computer program product for programmable fragment processing in a graphics pipeline |
JP2003030641A (en) | 2001-07-19 | 2003-01-31 | Nec System Technologies Ltd | Plotting device, parallel plotting method therefor and parallel plotting program |
US6828987B2 (en) | 2001-08-07 | 2004-12-07 | Ati Technologies, Inc. | Method and apparatus for processing video and graphics data |
US6778189B1 (en) | 2001-08-24 | 2004-08-17 | Nvidia Corporation | Two-sided stencil testing system and method |
US6744433B1 (en) | 2001-08-31 | 2004-06-01 | Nvidia Corporation | System and method for using and collecting information from a plurality of depth layers |
US6989840B1 (en) | 2001-08-31 | 2006-01-24 | Nvidia Corporation | Order-independent transparency rendering system and method |
US6704025B1 (en) | 2001-08-31 | 2004-03-09 | Nvidia Corporation | System and method for dual-depth shadow-mapping |
US6947047B1 (en) | 2001-09-20 | 2005-09-20 | Nvidia Corporation | Method and system for programmable pipelined graphics processing with branching instructions |
US6938176B1 (en) | 2001-10-05 | 2005-08-30 | Nvidia Corporation | Method and apparatus for power management of graphics processors and subsystems that allow the subsystems to respond to accesses when subsystems are idle |
US6999076B2 (en) | 2001-10-29 | 2006-02-14 | Ati Technologies, Inc. | System, method, and apparatus for early culling |
US7091971B2 (en) | 2001-10-29 | 2006-08-15 | Ati Technologies, Inc. | System, method, and apparatus for multi-level hierarchical Z buffering |
US6677953B1 (en) | 2001-11-08 | 2004-01-13 | Nvidia Corporation | Hardware viewport system and method for use in a graphics pipeline |
US20030117971A1 (en) | 2001-12-21 | 2003-06-26 | Celoxica Ltd. | System, method, and article of manufacture for profiling an executable hardware model using calls to profiling functions |
US6683614B2 (en) | 2001-12-21 | 2004-01-27 | Hewlett-Packard Development Company, L.P. | System and method for automatically configuring graphics pipelines by tracking a region of interest in a computer graphical display system |
US7012610B2 (en) | 2002-01-04 | 2006-03-14 | Ati Technologies, Inc. | Portable device for providing dual display and method thereof |
US6774895B1 (en) | 2002-02-01 | 2004-08-10 | Nvidia Corporation | System and method for depth clamping in a hardware graphics pipeline |
US6829689B1 (en) | 2002-02-12 | 2004-12-07 | Nvidia Corporation | Method and system for memory access arbitration for minimizing read/write turnaround penalties |
US6947865B1 (en) | 2002-02-15 | 2005-09-20 | Nvidia Corporation | Method and system for dynamic power supply voltage adjustment for a semiconductor integrated circuit device |
US6933943B2 (en) | 2002-02-27 | 2005-08-23 | Hewlett-Packard Development Company, L.P. | Distributed resource architecture and system |
US6700580B2 (en) | 2002-03-01 | 2004-03-02 | Hewlett-Packard Development Company, L.P. | System and method utilizing multiple pipelines to render graphical data |
US6853380B2 (en) | 2002-03-04 | 2005-02-08 | Hewlett-Packard Development Company, L.P. | Graphical display system and method |
US20030171907A1 (en) | 2002-03-06 | 2003-09-11 | Shay Gal-On | Methods and Apparatus for Optimizing Applications on Configurable Processors |
US7009605B2 (en) | 2002-03-20 | 2006-03-07 | Nvidia Corporation | System, method and computer program product for generating a shader program |
EP1495412B1 (en) | 2002-03-22 | 2012-11-28 | Alandro Consulting NY LLC | Scalable high performance 3d graphics |
US20030212735A1 (en) | 2002-05-13 | 2003-11-13 | Nvidia Corporation | Method and apparatus for providing an integrated network of processors |
US20040153778A1 (en) | 2002-06-12 | 2004-08-05 | Ati Technologies, Inc. | Method, system and software for configuring a graphics processing communication mode |
US6980209B1 (en) | 2002-06-14 | 2005-12-27 | Nvidia Corporation | Method and system for scalable, dataflow-based, programmable processing of graphics data |
US6812927B1 (en) | 2002-06-18 | 2004-11-02 | Nvidia Corporation | System and method for avoiding depth clears using a stencil buffer |
US6876362B1 (en) | 2002-07-10 | 2005-04-05 | Nvidia Corporation | Omnidirectional shadow texture mapping |
US6797998B2 (en) | 2002-07-16 | 2004-09-28 | Nvidia Corporation | Multi-configuration GPU interface device |
US6954204B2 (en) | 2002-07-18 | 2005-10-11 | Nvidia Corporation | Programmable graphics system and method using flexible, high-precision data formats |
US6825843B2 (en) | 2002-07-18 | 2004-11-30 | Nvidia Corporation | Method and apparatus for loop and branch instructions in a programmable graphics pipeline |
US6864893B2 (en) | 2002-07-19 | 2005-03-08 | Nvidia Corporation | Method and apparatus for modifying depth values using pixel programs |
US6952206B1 (en) | 2002-08-12 | 2005-10-04 | Nvidia Corporation | Graphics application program interface system and method for accelerating graphics processing |
US7112884B2 (en) | 2002-08-23 | 2006-09-26 | Ati Technologies, Inc. | Integrated circuit having memory disposed thereon and method of making thereof |
US6779069B1 (en) | 2002-09-04 | 2004-08-17 | Nvidia Corporation | Computer system with source-synchronous digital link |
US7324547B1 (en) | 2002-12-13 | 2008-01-29 | Nvidia Corporation | Internet protocol (IP) router residing in a processor chipset |
US6885376B2 (en) | 2002-12-30 | 2005-04-26 | Silicon Graphics, Inc. | System, method, and computer program product for near-real time load balancing across multiple rendering pipelines |
WO2004070652A2 (en) | 2003-01-28 | 2004-08-19 | Lucid Information Technology Ltd. | Method and system for compositing three-dimensional graphics images using associative decision mechanism |
US7145565B2 (en) | 2003-02-27 | 2006-12-05 | Nvidia Corporation | Depth bounds testing |
US6911983B2 (en) | 2003-03-12 | 2005-06-28 | Nvidia Corporation | Double-buffering of pixel data using copy-on-write semantics |
US7129909B1 (en) | 2003-04-09 | 2006-10-31 | Nvidia Corporation | Method and system using compressed display mode list |
US6940515B1 (en) | 2003-04-10 | 2005-09-06 | Nvidia Corporation | User programmable primitive engine |
US6900810B1 (en) | 2003-04-10 | 2005-05-31 | Nvidia Corporation | User programmable geometry engine |
US7068278B1 (en) | 2003-04-17 | 2006-06-27 | Nvidia Corporation | Synchronized graphics processing units |
US7483031B2 (en) | 2003-04-17 | 2009-01-27 | Nvidia Corporation | Method for synchronizing graphics processing units |
US7120816B2 (en) | 2003-04-17 | 2006-10-10 | Nvidia Corporation | Method for testing synchronization and connection status of a graphics processing unit module |
US7038678B2 (en) | 2003-05-21 | 2006-05-02 | Nvidia Corporation | Dependent texture shadow antialiasing |
US7038685B1 (en) | 2003-06-30 | 2006-05-02 | Nvidia Corporation | Programmable graphics processor for multithreaded execution of programs |
US7119808B2 (en) | 2003-07-15 | 2006-10-10 | Alienware Labs Corp. | Multiple parallel processor computer graphics system |
US6995767B1 (en) | 2003-07-31 | 2006-02-07 | Nvidia Corporation | Trilinear optimization for texture filtering |
US7075541B2 (en) | 2003-08-18 | 2006-07-11 | Nvidia Corporation | Adaptive load balancing in a multi-processor graphics processing system |
US8250412B2 (en) | 2003-09-26 | 2012-08-21 | Ati Technologies Ulc | Method and apparatus for monitoring and resetting a co-processor |
US7978197B2 (en) | 2003-11-14 | 2011-07-12 | Microsoft Corporation | Systems and methods for downloading algorithmic elements to a coprocessor and corresponding techniques |
US7015914B1 (en) | 2003-12-10 | 2006-03-21 | Nvidia Corporation | Multiple data buffers for processing graphics data |
US7053901B2 (en) | 2003-12-11 | 2006-05-30 | Nvidia Corporation | System and method for accelerating a special purpose processor |
US7248261B1 (en) | 2003-12-15 | 2007-07-24 | Nvidia Corporation | Method and apparatus to accelerate rendering of shadow effects for computer-generated images |
JP3879002B2 (en) | 2003-12-26 | 2007-02-07 | 国立大学法人宇都宮大学 | Self-optimizing arithmetic unit |
US6975325B2 (en) | 2004-01-23 | 2005-12-13 | Ati Technologies Inc. | Method and apparatus for graphics processing using state and shader management |
US7259606B2 (en) | 2004-01-27 | 2007-08-21 | Nvidia Corporation | Data sampling clock edge placement training for high speed GPU-memory interface |
US7483034B2 (en) | 2004-02-25 | 2009-01-27 | Siemens Medical Solutions Usa, Inc. | System and method for GPU-based 3D nonrigid registration |
US7027062B2 (en) | 2004-02-27 | 2006-04-11 | Nvidia Corporation | Register based queuing for texture requests |
US7289125B2 (en) * | 2004-02-27 | 2007-10-30 | Nvidia Corporation | Graphics device clustering with PCI-express |
US20050195186A1 (en) | 2004-03-02 | 2005-09-08 | Ati Technologies Inc. | Method and apparatus for object based visibility culling |
US20050275760A1 (en) | 2004-03-02 | 2005-12-15 | Nvidia Corporation | Modifying a rasterized surface, such as by trimming |
US7978194B2 (en) | 2004-03-02 | 2011-07-12 | Ati Technologies Ulc | Method and apparatus for hierarchical Z buffering and stenciling |
US7315912B2 (en) | 2004-04-01 | 2008-01-01 | Nvidia Corporation | Deadlock avoidance in a bus fabric |
US7336284B2 (en) | 2004-04-08 | 2008-02-26 | Ati Technologies Inc. | Two level cache memory architecture |
US7265759B2 (en) | 2004-04-09 | 2007-09-04 | Nvidia Corporation | Field changeable rendering system for a computing device |
US6985152B2 (en) | 2004-04-23 | 2006-01-10 | Nvidia Corporation | Point-to-point bus bridging without a bridge controller |
US20050237329A1 (en) | 2004-04-27 | 2005-10-27 | Nvidia Corporation | GPU rendering to system memory |
US7738045B2 (en) | 2004-05-03 | 2010-06-15 | Broadcom Corporation | Film-mode (3:2/2:2 Pulldown) detector, method and video device |
US7079156B1 (en) | 2004-05-14 | 2006-07-18 | Nvidia Corporation | Method and system for implementing multiple high precision and low precision interpolators for a graphics pipeline |
US7426724B2 (en) | 2004-07-02 | 2008-09-16 | Nvidia Corporation | Optimized chaining of vertex and fragment programs |
US7218291B2 (en) | 2004-09-13 | 2007-05-15 | Nvidia Corporation | Increased scalability in the fragment shading pipeline |
US7868891B2 (en) | 2004-09-16 | 2011-01-11 | Nvidia Corporation | Load balancing |
US7571296B2 (en) | 2004-11-11 | 2009-08-04 | Nvidia Corporation | Memory controller-adaptive 1T/2T timing control |
US7477256B1 (en) | 2004-11-17 | 2009-01-13 | Nvidia Corporation | Connecting graphics adapters for scalable performance |
US8066515B2 (en) | 2004-11-17 | 2011-11-29 | Nvidia Corporation | Multiple graphics adapter connection systems |
US7451259B2 (en) | 2004-12-06 | 2008-11-11 | Nvidia Corporation | Method and apparatus for providing peer-to-peer data transfer within a computing environment |
US7275123B2 (en) | 2004-12-06 | 2007-09-25 | Nvidia Corporation | Method and apparatus for providing peer-to-peer data transfer within a computing environment |
US7372465B1 (en) | 2004-12-17 | 2008-05-13 | Nvidia Corporation | Scalable graphics processing for remote display |
US20060156399A1 (en) | 2004-12-30 | 2006-07-13 | Parmar Pankaj N | System and method for implementing network security using a sequestered partition |
US7924281B2 (en) | 2005-03-09 | 2011-04-12 | Ati Technologies Ulc | System and method for determining illumination of a pixel by shadow planes |
US7796095B2 (en) | 2005-03-18 | 2010-09-14 | Ati Technologies Ulc | Display specific image processing in an integrated circuit |
US7568056B2 (en) | 2005-03-28 | 2009-07-28 | Nvidia Corporation | Host bus adapter that interfaces with host computer bus to multiple types of storage devices |
US7681187B2 (en) | 2005-03-31 | 2010-03-16 | Nvidia Corporation | Method and apparatus for register allocation in presence of hardware constraints |
US7817155B2 (en) | 2005-05-24 | 2010-10-19 | Ati Technologies Inc. | Master/slave graphics adapter arrangement |
US20080143731A1 (en) | 2005-05-24 | 2008-06-19 | Jeffrey Cheng | Video rendering across a high speed peripheral interconnect bus |
US7539801B2 (en) | 2005-05-27 | 2009-05-26 | Ati Technologies Ulc | Computing device with flexibly configurable expansion slots, and method of operation |
US20060282604A1 (en) | 2005-05-27 | 2006-12-14 | Ati Technologies, Inc. | Methods and apparatus for processing graphics data using multiple processing circuits |
US7325086B2 (en) | 2005-12-15 | 2008-01-29 | Via Technologies, Inc. | Method and system for multiple GPU support |
US7728841B1 (en) | 2005-12-19 | 2010-06-01 | Nvidia Corporation | Coherent shader output for multiple targets |
US7768517B2 (en) | 2006-02-21 | 2010-08-03 | Nvidia Corporation | Asymmetric multi-GPU processing |
US8284204B2 (en) | 2006-06-30 | 2012-10-09 | Nokia Corporation | Apparatus, method and a computer program product for providing a unified graphics pipeline for stereoscopic rendering |
-
2006
- 2006-12-31 US US11/648,160 patent/US8497865B2/en active Active
-
2007
- 2007-09-17 US US11/901,458 patent/US20080158235A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040066384A1 (en) * | 2002-09-06 | 2004-04-08 | Sony Computer Entertainment Inc. | Image processing method and apparatus |
US7015915B1 (en) * | 2003-08-12 | 2006-03-21 | Nvidia Corporation | Programming multiple chips from a command buffer |
US7525547B1 (en) * | 2003-08-12 | 2009-04-28 | Nvidia Corporation | Programming multiple chips from a command buffer to process multiple images |
US7388581B1 (en) * | 2003-08-28 | 2008-06-17 | Nvidia Corporation | Asynchronous conditional graphics rendering |
US7598958B1 (en) * | 2004-11-17 | 2009-10-06 | Nvidia Corporation | Multi-chip graphics processing unit apparatus, system, and method |
US7633505B1 (en) * | 2004-11-17 | 2009-12-15 | Nvidia Corporation | Apparatus, system, and method for joint processing in graphics processing units |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8325178B1 (en) | 2007-12-05 | 2012-12-04 | The United States Of America, As Represented By The Secretary Of The Navy | Lines-of-sight and viewsheds determination system |
US8400448B1 (en) | 2007-12-05 | 2013-03-19 | The United States Of America, As Represented By The Secretary Of The Navy | Real-time lines-of-sight and viewsheds determination system |
US10019775B2 (en) | 2015-04-30 | 2018-07-10 | Honeywell International Inc. | Method and system for scalable, radiation-tolerant, space-rated, high integrity graphics processing unit |
WO2020038407A1 (en) * | 2018-08-21 | 2020-02-27 | 腾讯科技(深圳)有限公司 | Image rendering method and apparatus, image processing device, and storage medium |
US11295528B2 (en) | 2018-08-21 | 2022-04-05 | Tencent Technology (Shenzhen) Company Limited | Image rendering method and apparatus, image processing device, and storage medium |
CN115298686A (en) * | 2020-02-03 | 2022-11-04 | 索尼互动娱乐股份有限公司 | System and method for efficient multi-GPU rendering of geometry by pre-testing interlaced screen regions prior to rendering |
CN111857918A (en) * | 2020-07-09 | 2020-10-30 | 长沙景嘉微电子股份有限公司 | 2D desktop PorterDuff implementation method and device |
Also Published As
Publication number | Publication date |
---|---|
US8497865B2 (en) | 2013-07-30 |
US20080158236A1 (en) | 2008-07-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8497865B2 (en) | Parallel graphics system employing multiple graphics processing pipelines with multiple graphics processing units (GPUS) and supporting an object division mode of parallel graphics processing using programmable pixel or vertex processing resources provided with the GPUS | |
US9584592B2 (en) | Internet-based graphics application profile management system for updating graphic application profiles stored within the multi-GPU graphics rendering subsystems of client machines running graphics-based applications | |
US7944450B2 (en) | Computing system having a hybrid CPU/GPU fusion-type graphics processing pipeline (GPPL) architecture | |
Blythe | Rise of the graphics processor | |
EP1594091B1 (en) | System and method for providing an enhanced graphics pipeline | |
US7796130B2 (en) | PC-based computing system employing multiple graphics processing units (GPUS) interfaced with the central processing unit (CPU) using a PC bus and a hardware hub, and parallelized according to the object division mode of parallel operation | |
US7737982B2 (en) | Method and system for minimizing an amount of data needed to test data against subarea boundaries in spatially composited digital video | |
US20080094403A1 (en) | Computing system capable of parallelizing the operation graphics processing units (GPUs) supported on a CPU/GPU fusion-architecture chip and one or more external graphics cards, employing a software-implemented multi-mode parallel graphics rendering subsystem | |
Liu et al. | Multi-stream based rendering task distribution on graphics cluster | |
Schulze-Döbold | Interactive volume rendering in virtual environments | |
Schirski | Interactive particle tracing for the exploration of flow fields in virtual environments | |
Graphics | Just the Facts |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LUCID INFORMATION TECHNOLOGY, LTD., ISRAEL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BAKALASH, REUVEN;LEVIATHAN, YANIV;REEL/FRAME:020998/0762 Effective date: 20080513 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: GOOGLE LLC, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LUCIDLOGIX TECHNOLOGY LTD.;REEL/FRAME:046361/0169 Effective date: 20180131 |