CA2737575A1 - Configurable depth-of-field raycaster for medical imaging - Google Patents
Configurable depth-of-field raycaster for medical imaging Download PDFInfo
- Publication number
- CA2737575A1 CA2737575A1 CA 2737575 CA2737575A CA2737575A1 CA 2737575 A1 CA2737575 A1 CA 2737575A1 CA 2737575 CA2737575 CA 2737575 CA 2737575 A CA2737575 A CA 2737575A CA 2737575 A1 CA2737575 A1 CA 2737575A1
- Authority
- CA
- Canada
- Prior art keywords
- ray
- sight
- value
- view plane
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/08—Volume rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/06—Ray-tracing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
- A61B6/46—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment with special arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/466—Displaying means of special interest adapted to display 3D data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
Abstract
A method for volume ray casting is provided. For each pixel of a 2D image placed in a view plane a ray of sight is projected through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. A plurality of sampling points is determined along each ray of sight such that a distance between two consecutive sampling points is larger at a larger distance to the view plane. At each sampling point a color value and a transparency value is determined in dependence upon voxels in proximity of the sampling point and a lighting calculation, wherein for the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane. For each ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of each ray corresponds to a pixel value of the 2D
image. The color and the transparency value of a sampling point are composited with the color and transparency value of a previous sampling point before determining the color and transparency value of a following sampling point. The compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
image. The color and the transparency value of a sampling point are composited with the color and transparency value of a previous sampling point before determining the color and transparency value of a following sampling point. The compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
Description
CONFIGURABLE DEPTH-OF-FIELD RAYCASTER FOR MEDICAL IMAGING
FIELD OF THE INVENTION
[001] The instant invention relates to computer graphics and in particular to a method for rendering a volume dataset using volume ray casting.
BACKGROUND
FIELD OF THE INVENTION
[001] The instant invention relates to computer graphics and in particular to a method for rendering a volume dataset using volume ray casting.
BACKGROUND
[002] Modern hospitals utilize medical images from a variety of imaging devices such as, for example, a Computer Tomography (CT) scanner or a Magnetic Resonance Imaging (MRI) scanner producing volume datasets. The image data are then rendered for producing 2D images using a computer to enable medical professionals to view and diagnose the captured medical images.
[003] Volume rendering is an important field of computer graphics and is of particular importance for medical applications for the rendering of volume image data sets generated by, for example, a CT or MRI scanner.
[004] For rendering a volume dataset on a two dimensional display a view plane is defined, which depends on viewing parameters such as eye position, view direction, etc.
For each point on the view plane a ray of sight is cast into the volume. Then the volume data are sampled at discrete sample points along each individual ray of sight. Each ray of sight accumulates color and transparency values along the ray of sight direction for each increment.
The ray of sight is incremented until a maximum number of iterations has been reached, for example, the ray of sight travels until the back edge of the volume. Each increment of the ray includes a lighting calculation, typically using Phong shading comprising ambient, diffuse, and specular lighting calculations.
For each point on the view plane a ray of sight is cast into the volume. Then the volume data are sampled at discrete sample points along each individual ray of sight. Each ray of sight accumulates color and transparency values along the ray of sight direction for each increment.
The ray of sight is incremented until a maximum number of iterations has been reached, for example, the ray of sight travels until the back edge of the volume. Each increment of the ray includes a lighting calculation, typically using Phong shading comprising ambient, diffuse, and specular lighting calculations.
[005] A major limitation of the employment of volume ray casting is its use of significant computational processing resources in particular when applied to large volume datasets of diagnostic quality medical images.
[006] It would be desirable to provide a method for rendering a volume dataset using volume ray casting that substantially reduces the use of computational processing resources.
SUMMARY OF EMBODIMENTS OF THE INVENTION
SUMMARY OF EMBODIMENTS OF THE INVENTION
[007] In accordance with embodiments of the present invention there is provided a method for volume ray casting. For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
[008] In accordance with embodiments of the present invention there is provided a further method for volume ray casting. For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight.
For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
[009] In accordance with embodiments of the present invention there is provided a further method for volume ray casting. For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object. The compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
(00101 In accordance with embodiments of the present invention there is provided a storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing volume ray casting.
For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
100111 In accordance with embodiments of the present invention there is further provided a storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing volume ray casting.
For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
[0012] In accordance with embodiments of the present invention there is yet further provided a storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing volume ray casting.
For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object. The compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
BRIEF DESCRIPTION OF THE FIGURES
[0013] Exemplary embodiments of the invention will now be described in conjunction with the following drawings, in which:
[0014] Figure 1 is a simplified block diagram of a system for implementing the method for volume ray casting according to embodiments of the invention;
[0015] Figures 2 and 3 are schematic diagrams illustrating the geometry of volume ray casting according to embodiments of the invention; and 100161 Figure 4 is a simplified flow diagram of embodiments of a method for volume ray casting according to the invention.
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
[00171 The following description is presented to enable a person skilled in the art to make and use the invention, and is provided in the context of a particular application and its requirements.
Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments disclosed, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
[00181 Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs.
[00191 While embodiments of the invention will be described for rendering volume medical image data for the sake of simplicity, it will become evident to those skilled in the art that the embodiments of the invention are not limited thereto, but are applicable in numerous other fields where volume ray casting is employed for rendering volume data sets such as, for example, geophysical applications, scientific simulations, 3D design, gaming and entertainment.
[00201 Referring to Figure 1, an example 100 of a system for implementing a method for volume ray casting according to embodiments of the invention described herein below is shown.
The system comprises, for example, a workstation 102 for rendering images using a Graphics Processing Unit (GPU) 106. For example, a medical practitioner is rendering images from a volume dataset for performing a diagnosis. During the rendering process the medical practitioner interacts with the GPU for determining different 2D images corresponding to different views of the volume dataset which are displayed on monitor 104. Typically, 2D images are rendered from a volume dataset using volume ray casting for the high quality of the rendered images. The method for volume ray casting according to embodiments of the invention described herein below enables volume rendering of large size volume datasets, for example, diagnostic quality medical image datasets, at computation times which are useful for numerous interactive processes. It will become evident to those skilled in the art that the embodiments of the invention described herein below are implementable by executing executable commands stored in memory 107 and executed on processor 108 of one of various standard GPUs wherein the executable commands are created using one of various standard programming languages and GPUs.
Alternatively, the embodiments of the invention are implemented using other processing units such as, for example, a CPU 110 and system memory 112 of various types of computers.
[00211 Referring to Figures 2, 3, and 4, a method for volume ray casting according to embodiments of the invention is provided. Figure 2 illustrates a volume 150 -in a top view -determined by a plurality of voxels of a volumetric dataset located at grid intersections thereof.
The volumetric dataset comprises data indicative of an object 160. A 2D image 152 of the volume - object - is a view determined by distance and orientation of a view plane 154 with respect to the volume 150. Using a processor, for example, GPU processor 108, for each pixel 156 of the 2D image 152 placed in the view plane 154 a ray of sight 158 is projected - 10 - from the view plane 154 through the volume 150. The view plane 154 has a predetermined distance and orientation to the volume 150, typically determined through user interaction with the processor performing the rendering operation using, for example, a keyboard or a graphical user interface. The rays of sight 158 are projected for providing a parallel projection, i.e. having an orientation perpendicular to the view plane and parallel to each other.
Alternatively, the rays of sight 158 are projected for providing a perspective projection, i.e.
originating from a single predetermined point and projecting in a diverging fashion through the view plane 154 and the volume 150.
[00221 The number of rays of sight is not limited to one ray per image pixel.
Optionally, the number of rays is configured such that there is a plurality of rays per pixel -occurring, for example, in perspective projection - or such that there are less than one ray per pixel - resulting in black dots in the 2D image. Further optionally, ray jittering - randomly or pseudo randomly setting the ray to an offset from the pixel center - is used to remove aliasing artifacts from the 2D
image.
[0023] At 12, using the processor a plurality of sampling points 162 is determined along each ray of sight 158 such that a distance between two consecutive sampling points is larger at a larger distance to the view plane 154. For example, as the ray of sight 158 travels along its path the position of a sampling point is incremented by a value "step". In the depth-of-field concept according to an embodiment of the invention the step is incremented slightly at each iteration along the path of the ray of sight 158. Thus, with increasing distance to the view plane 154 the resolution becomes less accurate as data values are sampled at a lower frequency. The decrease in the sampling rate also decreases the number of samples used to calculate the final color value of the respective 2D image pixel 156 resulting in a substantially improved performance. The area of the volume 150 closest to the "viewer" - i.e. the view plane 154 - is sampled at a high sampling rate, while areas of the volume 154 at a further distance to the viewer are sampled at a lower sampling rate. The result is that the front of the volume 150 appears to be "in focus" while the back of the volume 150 appears slightly "out of focus" - depending on the step increase.
Alternatively, the step between two consecutive sampling points is a same in an area close to the viewer and then changed to a larger step - constant or increasing - at a larger distance to the viewer.
[0024] Using the processor a color value and a transparency value is determined at each sampling point - 14 - in dependence upon voxels 166 in proximity of the sampling point 164 and a lighting calculation. Since in general the sampling points 164 of the ray of sight 158 are not aligned with the voxels 166 disposed in the volume 150, the color value and the transparency value corresponding to a sampling point 164 are determined using interpolation such as, for example, trilinear interpolation. The color values and the transparency -alpha - values are, for example, retrieved from a Color Look-Up-Table (CLUT).
[0025] The calculation at each sampling point also includes the lighting calculation - shading -that determines the effect of a light source 168. The light source 168 is projected along a direction that is different than the direction of the ray of sight 158. At each sampling point a gradient representing the orientation of local surfaces of the object 160 within the volume 150 is determined. The samples are then shaded - i.e. colored and lighted - according to their surface orientation and the light source 168. The lighting in dependence upon the gradient is determined using a lighting model such as, for example, Phong shading or Gourad shading.
The Phong shading contains calculations for determining ambient, diffuse, and specular lighting conditions.
The Phong shading is computationally more intense than Gourad shading but produces substantially higher image quality.
[0026] According to an embodiment of the invention a first lighting model and a second lighting model are used for the lighting calculation in dependence upon a distance of the sampling point 162 to the view plane 154. For example, instead of using the Phong shading model for the entire length of the ray of sight 158, Phong shading is applied for a predetermined first portion of the ray closer to the view plane 154, and then the specular lighting calculation is disabled for a predetermined second portion at a larger distance to the view plane 154. This "hybrid" lighting model results in a front-facing result that contains Phong shading but at a further distance into the volume the Gourad shading model is used.
Alternatively, other lighting models are employed as a first and a second lighting model.
[0027] Using the processor for each ray of sight 158 a final color value is determined - 16 - by compositing along the ray of sight the color values and the transparency values. The final color value of each ray of sight 158 corresponds to a pixel 156 value of the 2D
image 152 which is indicative of the object 160. The color and the transparency value of a sampling point 164 are composited with the color and transparency value of a previous sampling point before determining the color and transparency value of a following sampling point.
[0028] According to an embodiment of the invention the compositing and, therefore, the sampling is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
[0029] In general, the sampling is performed until the accumulated transparency reaches a value of 1.0 - indicative of opacity. In case the accumulated value does not reach 1.0 the sampling is terminated at the back of the volume 150. In many situations this results in sampling through empty space. In the embodiment according to the invention rather than using the value 1.0 indicative of opacity the value for stopping the sampling is configurable within a predetermined range of, for example, 0.9 to 1.0 causing the sampling to terminate earlier with a negligible impact on image quality but a substantial improvement in computational performance.
Terminating the sampling at a value less than 1.0 decreases the number of lighting calculations per ray of sight 158.
[00301 The calculation of each pixel value of the 2D image 152 according to the embodiments of the invention can be performed in parallel. A GPU based configuration is well suited for the implementation due to the GPU's massively parallel architecture, but the implementation is not limited thereto.
[00311 The present invention has been described herein with regard to preferred embodiments.
However, it will be obvious to persons skilled in the art that a number of variations and modifications can be made without departing from the scope of the invention as described herein.
(00101 In accordance with embodiments of the present invention there is provided a storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing volume ray casting.
For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
100111 In accordance with embodiments of the present invention there is further provided a storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing volume ray casting.
For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object.
[0012] In accordance with embodiments of the present invention there is yet further provided a storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing volume ray casting.
For a pixel of a 2D image placed in a view plane a ray of sight is projected from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object. The view plane has a predetermined distance and orientation to the volume. A plurality of sampling points is determined along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane. For at least a portion of the plurality of sampling points a color value and a transparency value is determined in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation. For the ray of sight a final color value is determined by compositing along the ray the color values and the transparency values. The final color value of the ray contributes to a pixel value of the 2D image which is indicative of the object. The compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
BRIEF DESCRIPTION OF THE FIGURES
[0013] Exemplary embodiments of the invention will now be described in conjunction with the following drawings, in which:
[0014] Figure 1 is a simplified block diagram of a system for implementing the method for volume ray casting according to embodiments of the invention;
[0015] Figures 2 and 3 are schematic diagrams illustrating the geometry of volume ray casting according to embodiments of the invention; and 100161 Figure 4 is a simplified flow diagram of embodiments of a method for volume ray casting according to the invention.
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
[00171 The following description is presented to enable a person skilled in the art to make and use the invention, and is provided in the context of a particular application and its requirements.
Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments disclosed, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
[00181 Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs.
[00191 While embodiments of the invention will be described for rendering volume medical image data for the sake of simplicity, it will become evident to those skilled in the art that the embodiments of the invention are not limited thereto, but are applicable in numerous other fields where volume ray casting is employed for rendering volume data sets such as, for example, geophysical applications, scientific simulations, 3D design, gaming and entertainment.
[00201 Referring to Figure 1, an example 100 of a system for implementing a method for volume ray casting according to embodiments of the invention described herein below is shown.
The system comprises, for example, a workstation 102 for rendering images using a Graphics Processing Unit (GPU) 106. For example, a medical practitioner is rendering images from a volume dataset for performing a diagnosis. During the rendering process the medical practitioner interacts with the GPU for determining different 2D images corresponding to different views of the volume dataset which are displayed on monitor 104. Typically, 2D images are rendered from a volume dataset using volume ray casting for the high quality of the rendered images. The method for volume ray casting according to embodiments of the invention described herein below enables volume rendering of large size volume datasets, for example, diagnostic quality medical image datasets, at computation times which are useful for numerous interactive processes. It will become evident to those skilled in the art that the embodiments of the invention described herein below are implementable by executing executable commands stored in memory 107 and executed on processor 108 of one of various standard GPUs wherein the executable commands are created using one of various standard programming languages and GPUs.
Alternatively, the embodiments of the invention are implemented using other processing units such as, for example, a CPU 110 and system memory 112 of various types of computers.
[00211 Referring to Figures 2, 3, and 4, a method for volume ray casting according to embodiments of the invention is provided. Figure 2 illustrates a volume 150 -in a top view -determined by a plurality of voxels of a volumetric dataset located at grid intersections thereof.
The volumetric dataset comprises data indicative of an object 160. A 2D image 152 of the volume - object - is a view determined by distance and orientation of a view plane 154 with respect to the volume 150. Using a processor, for example, GPU processor 108, for each pixel 156 of the 2D image 152 placed in the view plane 154 a ray of sight 158 is projected - 10 - from the view plane 154 through the volume 150. The view plane 154 has a predetermined distance and orientation to the volume 150, typically determined through user interaction with the processor performing the rendering operation using, for example, a keyboard or a graphical user interface. The rays of sight 158 are projected for providing a parallel projection, i.e. having an orientation perpendicular to the view plane and parallel to each other.
Alternatively, the rays of sight 158 are projected for providing a perspective projection, i.e.
originating from a single predetermined point and projecting in a diverging fashion through the view plane 154 and the volume 150.
[00221 The number of rays of sight is not limited to one ray per image pixel.
Optionally, the number of rays is configured such that there is a plurality of rays per pixel -occurring, for example, in perspective projection - or such that there are less than one ray per pixel - resulting in black dots in the 2D image. Further optionally, ray jittering - randomly or pseudo randomly setting the ray to an offset from the pixel center - is used to remove aliasing artifacts from the 2D
image.
[0023] At 12, using the processor a plurality of sampling points 162 is determined along each ray of sight 158 such that a distance between two consecutive sampling points is larger at a larger distance to the view plane 154. For example, as the ray of sight 158 travels along its path the position of a sampling point is incremented by a value "step". In the depth-of-field concept according to an embodiment of the invention the step is incremented slightly at each iteration along the path of the ray of sight 158. Thus, with increasing distance to the view plane 154 the resolution becomes less accurate as data values are sampled at a lower frequency. The decrease in the sampling rate also decreases the number of samples used to calculate the final color value of the respective 2D image pixel 156 resulting in a substantially improved performance. The area of the volume 150 closest to the "viewer" - i.e. the view plane 154 - is sampled at a high sampling rate, while areas of the volume 154 at a further distance to the viewer are sampled at a lower sampling rate. The result is that the front of the volume 150 appears to be "in focus" while the back of the volume 150 appears slightly "out of focus" - depending on the step increase.
Alternatively, the step between two consecutive sampling points is a same in an area close to the viewer and then changed to a larger step - constant or increasing - at a larger distance to the viewer.
[0024] Using the processor a color value and a transparency value is determined at each sampling point - 14 - in dependence upon voxels 166 in proximity of the sampling point 164 and a lighting calculation. Since in general the sampling points 164 of the ray of sight 158 are not aligned with the voxels 166 disposed in the volume 150, the color value and the transparency value corresponding to a sampling point 164 are determined using interpolation such as, for example, trilinear interpolation. The color values and the transparency -alpha - values are, for example, retrieved from a Color Look-Up-Table (CLUT).
[0025] The calculation at each sampling point also includes the lighting calculation - shading -that determines the effect of a light source 168. The light source 168 is projected along a direction that is different than the direction of the ray of sight 158. At each sampling point a gradient representing the orientation of local surfaces of the object 160 within the volume 150 is determined. The samples are then shaded - i.e. colored and lighted - according to their surface orientation and the light source 168. The lighting in dependence upon the gradient is determined using a lighting model such as, for example, Phong shading or Gourad shading.
The Phong shading contains calculations for determining ambient, diffuse, and specular lighting conditions.
The Phong shading is computationally more intense than Gourad shading but produces substantially higher image quality.
[0026] According to an embodiment of the invention a first lighting model and a second lighting model are used for the lighting calculation in dependence upon a distance of the sampling point 162 to the view plane 154. For example, instead of using the Phong shading model for the entire length of the ray of sight 158, Phong shading is applied for a predetermined first portion of the ray closer to the view plane 154, and then the specular lighting calculation is disabled for a predetermined second portion at a larger distance to the view plane 154. This "hybrid" lighting model results in a front-facing result that contains Phong shading but at a further distance into the volume the Gourad shading model is used.
Alternatively, other lighting models are employed as a first and a second lighting model.
[0027] Using the processor for each ray of sight 158 a final color value is determined - 16 - by compositing along the ray of sight the color values and the transparency values. The final color value of each ray of sight 158 corresponds to a pixel 156 value of the 2D
image 152 which is indicative of the object 160. The color and the transparency value of a sampling point 164 are composited with the color and transparency value of a previous sampling point before determining the color and transparency value of a following sampling point.
[0028] According to an embodiment of the invention the compositing and, therefore, the sampling is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
[0029] In general, the sampling is performed until the accumulated transparency reaches a value of 1.0 - indicative of opacity. In case the accumulated value does not reach 1.0 the sampling is terminated at the back of the volume 150. In many situations this results in sampling through empty space. In the embodiment according to the invention rather than using the value 1.0 indicative of opacity the value for stopping the sampling is configurable within a predetermined range of, for example, 0.9 to 1.0 causing the sampling to terminate earlier with a negligible impact on image quality but a substantial improvement in computational performance.
Terminating the sampling at a value less than 1.0 decreases the number of lighting calculations per ray of sight 158.
[00301 The calculation of each pixel value of the 2D image 152 according to the embodiments of the invention can be performed in parallel. A GPU based configuration is well suited for the implementation due to the GPU's massively parallel architecture, but the implementation is not limited thereto.
[00311 The present invention has been described herein with regard to preferred embodiments.
However, it will be obvious to persons skilled in the art that a number of variations and modifications can be made without departing from the scope of the invention as described herein.
Claims (13)
1. A method comprising:
using a processor projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
using the processor determining a plurality of sampling points along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane;
using the processor determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation; and, using the processor determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
using a processor projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
using the processor determining a plurality of sampling points along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane;
using the processor determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation; and, using the processor determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
2. A method as defined in claim 1 wherein one ray of sight is projected for each pixel of the 2D
image and wherein the final color value of the ray of sight corresponds to a respective pixel value.
image and wherein the final color value of the ray of sight corresponds to a respective pixel value.
3. A method as defined in claim 1 wherein the distance between consecutive sampling points is incremented along the path of the ray of sight.
4. A method comprising:
using a processor projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
using the processor determining a plurality of sampling points along the ray of sight;
using the processor determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation, wherein for the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane; and, using the processor determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
using a processor projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
using the processor determining a plurality of sampling points along the ray of sight;
using the processor determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation, wherein for the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane; and, using the processor determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
5. A method as defined in claim 4 wherein one ray of sight is projected for each pixel of the 2D
image and wherein the final color value of the ray of sight corresponds to a respective pixel value.
image and wherein the final color value of the ray of sight corresponds to a respective pixel value.
6. A method as defined in claim 4 wherein the first lighting model is used for a predetermined first portion of the ray of sight closer to the view plane and the second lighting model is used for a predetermined second portion of the ray of sight at a larger distance to the view plane.
7. A method as defined in claim 6 wherein the first lighting model determines ambient, diffuse, and specular lighting conditions and wherein the second lighting model determines ambient and diffuse lighting conditions.
8. A method comprising:
using a processor projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
using the processor determining a plurality of sampling points along the ray of sight;
using the processor determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation; and, using the processor determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object, wherein the compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
using a processor projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
using the processor determining a plurality of sampling points along the ray of sight;
using the processor determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation; and, using the processor determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object, wherein the compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
9. A method as defined in claim 8 wherein one ray of sight is projected for each pixel of the 2D
image and wherein the final color value of the ray of sight corresponds to a respective pixel value.
image and wherein the final color value of the ray of sight corresponds to a respective pixel value.
10. A method as defined in claim 8 wherein the color and the transparency value of a sampling point are composited with the color and transparency value of a previous sampling point before determining the color and transparency value of a following sampling point.
11. A storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing:
projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
determining a plurality of sampling points along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane;
determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation; and, determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
determining a plurality of sampling points along the ray of sight such that a distance between consecutive sampling points is larger at a larger distance to the view plane;
determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and in dependence upon a lighting calculation; and, determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
12. A storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing:
projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
determining a plurality of sampling points along the ray of sight;
determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation, wherein for the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane;
and, determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
determining a plurality of sampling points along the ray of sight;
determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation, wherein for the lighting calculation a first lighting model and a second lighting model are used in dependence upon a distance of the sampling point to the view plane;
and, determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object.
13. A storage medium having stored therein executable commands for execution on a processor of a computer system, the processor when executing the commands performing:
projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
determining a plurality of sampling points along the ray of sight;
determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation; and, determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object, wherein the compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
projecting for a pixel of a 2D image placed in a view plane a ray of sight from the view plane through a volume determined by a plurality of voxels of a volumetric dataset indicative of an object, the view plane having a predetermined distance and orientation to the volume;
determining a plurality of sampling points along the ray of sight;
determining for at least a portion of the plurality of sampling points a color value and a transparency value in dependence upon voxels in proximity of the respective sampling point and a lighting calculation; and, determining for the ray of sight a final color value by compositing along the ray the color values and the transparency values, the final color value of the ray contributing to a pixel value of the 2D image, the 2D image being indicative of the object, wherein the compositing is stopped when the composited transparency value is within a predetermined range less than a value indicative of opacity.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA 2737575 CA2737575A1 (en) | 2011-04-18 | 2011-04-18 | Configurable depth-of-field raycaster for medical imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA 2737575 CA2737575A1 (en) | 2011-04-18 | 2011-04-18 | Configurable depth-of-field raycaster for medical imaging |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2737575A1 true CA2737575A1 (en) | 2012-10-18 |
Family
ID=47022387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA 2737575 Abandoned CA2737575A1 (en) | 2011-04-18 | 2011-04-18 | Configurable depth-of-field raycaster for medical imaging |
Country Status (1)
| Country | Link |
|---|---|
| CA (1) | CA2737575A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2541928A (en) * | 2015-09-04 | 2017-03-08 | Advanced Risc Mach Ltd | Graphics processing systems |
| US10282895B2 (en) | 2014-07-24 | 2019-05-07 | Arm Limited | Transparency parameter determination when rendering a scene for output in graphics processing systems |
| US10614619B2 (en) | 2015-02-27 | 2020-04-07 | Arm Limited | Graphics processing systems |
| US10636213B2 (en) | 2015-10-26 | 2020-04-28 | Arm Limited | Graphics processing systems |
-
2011
- 2011-04-18 CA CA 2737575 patent/CA2737575A1/en not_active Abandoned
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10282895B2 (en) | 2014-07-24 | 2019-05-07 | Arm Limited | Transparency parameter determination when rendering a scene for output in graphics processing systems |
| US10614619B2 (en) | 2015-02-27 | 2020-04-07 | Arm Limited | Graphics processing systems |
| GB2541928A (en) * | 2015-09-04 | 2017-03-08 | Advanced Risc Mach Ltd | Graphics processing systems |
| GB2541928B (en) * | 2015-09-04 | 2018-01-31 | Advanced Risc Mach Ltd | Graphics processing systems |
| US10089776B2 (en) | 2015-09-04 | 2018-10-02 | Arm Limited | Graphics processing systems |
| US10636213B2 (en) | 2015-10-26 | 2020-04-28 | Arm Limited | Graphics processing systems |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9177416B2 (en) | Space skipping for multi-dimensional image rendering | |
| Roettger et al. | Smart hardware-accelerated volume rendering | |
| KR101281258B1 (en) | Graphics processing unit with deferred vertex shading | |
| EP3312701B1 (en) | Method and apparatus for foveated rendering | |
| US8294706B2 (en) | Volume rendering using N-pass sampling | |
| JP2009034521A (en) | System and method for volume rendering data in medical diagnostic imaging, and computer readable storage medium | |
| US10699469B2 (en) | Configurable depth-of-field raycaster for medical imaging | |
| US8040352B2 (en) | Adaptive image interpolation for volume rendering | |
| Liu et al. | Octree rasterization: Accelerating high-quality out-of-core GPU volume rendering | |
| US10832375B2 (en) | Image decomposition and path-space motion estimation | |
| WO2013101167A1 (en) | Five-dimensional rasterization with conservative bounds | |
| CA2737575A1 (en) | Configurable depth-of-field raycaster for medical imaging | |
| Gumbau et al. | Screen space soft shadows | |
| Franke et al. | Multi-layer depth of field rendering with tiled splatting | |
| US20120177287A1 (en) | Analytical Motion Blur Rasterization With Compression | |
| JP7237623B2 (en) | Medical image diagnostic device, medical image processing device and medical image processing program | |
| JP2019209149A (en) | Medical image processing apparatus and rendering method | |
| US9082217B1 (en) | Avoidance-based ray tracing for volume rendering | |
| US9035945B1 (en) | Spatial derivative-based ray tracing for volume rendering | |
| RU2533055C1 (en) | Method of optimising maximum intensity projection technique for rendering scalar three-dimensional data in static mode, in interactive mode and in real time | |
| Elnokrashy et al. | Multipass GPU surface rendering in 4D ultrasound | |
| Kumar et al. | CUDA based interactive volume rendering of 3D medical data | |
| JP5908241B2 (en) | Medical image display device | |
| Kumar et al. | Gpu-accelerated interactive visualization of 3D volumetric data using CUDA | |
| Limberger et al. | Progressive rendering using multi-frame sampling |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request |
Effective date: 20160408 |
|
| FZDE | Dead |
Effective date: 20190418 |