EP2050066A2 - A method, apparatus and computer-readable medium for scale-based visualization of an image dataset - Google Patents

A method, apparatus and computer-readable medium for scale-based visualization of an image dataset

Info

Publication number
EP2050066A2
EP2050066A2 EP07825893A EP07825893A EP2050066A2 EP 2050066 A2 EP2050066 A2 EP 2050066A2 EP 07825893 A EP07825893 A EP 07825893A EP 07825893 A EP07825893 A EP 07825893A EP 2050066 A2 EP2050066 A2 EP 2050066A2
Authority
EP
European Patent Office
Prior art keywords
voxels
image dataset
scale
identifying
transfer function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP07825893A
Other languages
German (de)
French (fr)
Inventor
Hubrecht L. T. De Bliek
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to EP07825893A priority Critical patent/EP2050066A2/en
Publication of EP2050066A2 publication Critical patent/EP2050066A2/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G06T2207/10136—3D ultrasound image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/36—Level of detail

Definitions

  • This invention pertains in general to the field of image analysis. More particularly the invention relates 3-D volume visualization for displaying structures present in a scanned volume, e.g. from Computed Tomography (CT), Magnetic Resonance Imaging (MRI), or Ultrasound Imaging (US).
  • CT Computed Tomography
  • MRI Magnetic Resonance Imaging
  • US Ultrasound Imaging
  • Display parameters control the way a 2D or 3D image is visualized on a display. These display parameters may be modified with help of software or hardware user interface gadgets.
  • Valuators are a logic class of units used in graphical systems as inputs of scalars. Valuators are used to set different graphic parameters, such as rotation angle, scale factors and to set physical parameters associated with a specific application, such as temperature setting, volt level, etc.
  • Other approaches of changing the ways of displaying images on a screen is by dragging a mouse or joystick over specific regions on the display or interacting with wheels on a dialbox.
  • a dialbox is a box that contains six or eight (hardware) dials. These dials are used to alter parameters assigned to them.
  • Another way to modify the (software) parameters is to use any hardware device that is designed for that purpose. As a result of the manipulation the reconstruction of voxel gray values to display gray or color values is changed.
  • the Philips ViewForum workstation offers the possibility to change the visualization of voxels from an image dataset by means of the manipulation of a valuator or by dragging the mouse over a specific region on the display, i.e. so-called Direct Mouse Manipulation. This may result in changing the window width and level of a 2D image dataset or changing the visibility, i.e. opacity map, of a structure present in a 3D image dataset.
  • a problem of prior art is that the valuator gadgets almost never are large enough to display the required scale range, as the amount of screen area available for user interaction is limited. Limiting the scale range to fit the window screen area results in loss of resolution. To solve this problem a modifiable scale range and offset may be used. However, modification of the scale range and offset requires additional user interactions, which are time consuming.
  • the present invention preferably seeks to mitigate, alleviate or eliminate one or more of the above-identified deficiencies in the art and disadvantages singly or in any combination and solves at least the above-mentioned problems by providing a method, apparatus and a computer-readable medium according to the appended patent claims.
  • a method for use in scale-based visualization of an image dataset comprises identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non- linear.
  • an apparatus for use in scale-based visualization comprises a first identification unit for identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, a second identification unit for identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and a calculation unit for calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non- linear.
  • a computer-readable medium having embodied thereon a computer program for processing by a computer.
  • the computer program comprises a first identification code segment for identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, a second identification code segment for identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and a calculation code segment for calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non-linear.
  • the purpose of this invention is to eliminate the shortcomings of prior art and to offer high manipulation accuracy where required within a limited amount of display space. This may be achieved by changing the linear interaction scale into a non-linear scale, by giving important image dataset gray values a higher percentage of interaction space on the available display space than other less important image dataset gray values. This means that important image dataset gray values, e.g. gray values located in the vicinity of the mouse drag start position are taken into account with the highest possible interaction resolution. Gray values with very low importance will be skipped automatically because of the limited accuracy of the user interface. Accordingly the method according to some embodiments saves valuable display area and increases interaction performance. BRIEF DESCRIPTION OF THE DRAWINGS
  • Fig. 1 is a screen dump from the Philips ViewForum system
  • Fig. 2 is a schematic view of a method according to an embodiment
  • FIG. 3 is an illustration of a practical implementation of a method according to an embodiment
  • Fig. 4 is a schematic view of an apparatus according to an embodiment
  • Fig. 5 is a schematic view of a computer readable medium according to an embodiment.
  • Fig. 1 illustrates a screen dump from the current Philips ViewForum system 10 comprising valuator gadgets 11 with scale range buttons 12, 13.
  • image dataset comprising pixels or voxels
  • display properties by dragging the mouse over certain areas on the display, such as a viewport, or by manipulating user interface gadgets, such as a valuator or specific hardware, such as a joystick or spaceball or any other physical input device.
  • the present invention provides elimination of the above-mentioned shortcomings of prior art and offers high manipulation accuracy where required within a limited amount of display space. In most cases it is not needed to offer access to all gray values through the valuator, display drag area or joystick. Instead of offering a linear scale, the scale may be non- linear.
  • a method for visualization of an image dataset comprises the following steps: identifying 21 a first set of voxels of the image dataset for high accuracy visualization, identifying 22 a second set of voxels of the image dataset for low accuracy visualization, and calculating 23 a scale based on the first set and second set of voxels.
  • the method according to this embodiment provides a high accuracy for important, i.e. first set of voxels and a low accuracy for less important, i.e. second set of voxels values. This means that the first set of voxels are given a higher-percentage of interaction space on the available display space than the second set of voxels.
  • the identifying of the first set of voxels and the identifying of the second set of voxels are performed using histogram equalization.
  • An intermediate result of the histogram equalization is a transfer function f(x) (see more details below) that has a steeper upslope, i.e. high first derivative, for voxel gray values that are present more often
  • the output scale values are mapped through the inverse version of that transfer function.
  • the identifying steps are performed using any other method that re-distributes gray values along the available display space.
  • the calculating step involves deriving the scale range and offset from an area around the center of the original image dataset because it is most likely that the structure of interest is present at the center of the image dataset voxel contents.
  • the calculating step involves determining the scale range and offset from the image dataset voxel contents around the initial display drag area starting point in case the structure of interest is not present at the center of the image dataset voxel contents.
  • the calculating step involves determining the scale range and offset from a volume of interest defined in the image dataset.
  • the result of using the method according to some embodiments is that voxels with gray values that need a high manipulation resolution get assigned more display space than the voxels with gray values that need less manipulation resolution.
  • the calculated scale is forwarded to a rendering algorithm 24 producing a 2D or 3D visualization of the image dataset for presentation on a display.
  • the method facilitates when defining the gray-level window width and level parameters.
  • the method is useful when manipulating the opacity map or color map.
  • a maximum intensity projection is a 2D projection of a 3D image volume along a given viewing direction. For each point in the 2D projection, a ray is cast along the given viewing direction through the 3D volume, and then the point in the 2D projection is assigned the maximum value that was encountered along the ray. In this way, lower brightness values in the 3D volume can never occlude higher brightness values in the 2D projection.
  • the viewing direction may be freely chosen by the user, e.g. by mouse interaction, or automatically rotated around a given axis, such as the vertical body axis.
  • a practical implementation of the method is provided.
  • the gray values of higher importance i.e. the voxels with gray values that are present more often are stretched over a larger scale than the voxels with gray values that are present less often.
  • a histogram displays at the x-axis the voxel values and at the y-axis the number of times the voxel values are present. So voxels that are present more often than others, have a higher peak in the histogram.
  • Transfer function f(x) is calculated by accumulating the histogram y-axis values as explained above. Values at and around the steep slope of f(x) are given more display space and thus have a higher manipulation accuracy.
  • scale value n' can be found with help of the inverse function F(x). This may be observed from Fig. 3 where voxels of histogram H a in range n, n+1 are mapped to voxels of histogram Hb in a transformed range ri , n'+ ⁇ .
  • the scale of function H b (x) is used instead of using the scale of function H b (x) for parameter manipulation wherein x defines the voxel location. High interaction accuracy is obtained for voxels in range n, n+1 and low interaction accuracy outside this range.
  • the voxels are pixels in a 2D image dataset. In an embodiment, according to Fig.
  • an apparatus 40 for visualization of an image dataset comprises: a first identification unit 41 for identifying a first set of voxels of the image dataset that are frequently present for high accuracy visualization, a second identification unit 42 for identifying a second set of voxels of the image dataset that are not frequently present for low accuracy visualization, and a calculation unit 43 for calculating a scale based on the first set of voxels and second set of voxels using a transfer function, wherein the transfer function is non- linear, and comprises a derivative, wherein the derivate for the first set of voxels is higher than the derivate for the second set of voxels.
  • the apparatus 40 further comprises a render unit 44 for rendering a 2D or 3D visualization of the image dataset based on the calculated scale.
  • Typical interactions on a 2D image are gray- value adaptations (window level/width).
  • 3D image setting interactions are less common.
  • typical (expert) interactions on 3D images are manipulations of the opacity map and color map.
  • the apparatus 40 further comprises a display unit 45 for displaying the rendered 2D or 3D visualization to a user.
  • the introduced methods helps when defining the gray-level window width and level parameters.
  • 3D shaded volume rendered visualizations the method is useful when manipulating the opacity map or color map.
  • the processor 43, and render unit 44 may be any unit normally used for performing the involved tasks, e.g. a hardware, such as a processor with a memory.
  • the processor may be any of variety of processors, such as Intel or AMD processors, CPUs, microprocessors, Programmable Intelligent Computer (PIC) microcontrollers, Digital Signal Processors (DSP), etc. However, the scope of the invention is not limited to these specific processors.
  • the memory may be any memory capable of storing information, such as Random Access Memories (RAM) such as, Double Density RAM (DDR, DDR2), Single Density RAM (SDRAM), Static RAM (SRAM), Dynamic RAM (DRAM), Video RAM (VRAM), etc.
  • RAM Random Access Memories
  • DDR Double Density RAM
  • SDRAM Single Density RAM
  • SRAM Static RAM
  • DRAM Dynamic RAM
  • VRAM Video RAM
  • the memory may also be a FLASH memory such as a USB, Compact Flash, SmartMedia, MMC memory, MemoryStick, SD Card, MiniSD, MicroSD, xD Card, TransFlash, and MicroDrive memory etc.
  • FLASH memory such as a USB, Compact Flash, SmartMedia, MMC memory, MemoryStick, SD Card, MiniSD, MicroSD, xD Card, TransFlash, and MicroDrive memory etc.
  • the scope of the invention is not limited to these specific memories.
  • the apparatus comprises units for performing the method according to some embodiments.
  • the apparatus is comprised in a medical workstation or medical system, such as a Computed Tomography (CT) system, Magnetic Resonance Imaging (MRI) System or Ultrasound Imaging (US) system.
  • CT Computed Tomography
  • MRI Magnetic Resonance Imaging
  • US Ultrasound Imaging
  • a computer-readable medium having embodied thereon a computer program 50 for processing by a computer comprises: a first identification code segment 51 for identifying a first set of voxels of the image dataset that are frequently present for high accuracy visualization, a second identification code segment 52 for identifying a second set of voxels of the image dataset that are not frequently present for low accuracy visualization, and a calculation code segment 53 for calculating a scale based on the first set of voxels and second set of voxels using a transfer function, wherein the transfer function is non- linear, and comprises a derivative, wherein the derivate for the first set of voxels is higher than the derivate for the second set of voxels.
  • the computer program 50 further comprises a render code segment 54 for rendering a 2D or 3D visualization of the image dataset based on the calculated scale.
  • Typical interactions on a 2D image are gray- value adaptations (window level/width).
  • 3D image setting interactions are less common.
  • typical (expert) interactions on 3D images are manipulations of the opacity map and color map.
  • the computer program 50 further comprises a display code segment 55 for displaying the rendered 2D or 3D visualization to a user.
  • a display code segment 55 for displaying the rendered 2D or 3D visualization to a user.
  • the introduced methods helps when defining the gray-level window width and level parameters.
  • 3D shaded volume rendered visualizations the method is useful when manipulating the opacity map or color map.
  • the computer-readable medium comprises code segments arranged, when run by an apparatus having computer-processing properties, for performing all of the method steps defined in some embodiments.
  • the method according to an embodiment may be detected as follows, 1) loading an image into the application, and 2) examining the scale of the user interface gadget or determining it for the user interface display drag area or dialbox. In the latter cases the parameter value should be visible somewhere on the user interface. 3) Loading another image with a different content into the application and 4) examining the scale of the user interface gadget or determining it for the user interface display drag area or dialbox.
  • the method according to an embodiment is used when the scale of the user interface gadget is non-linear and different for both cases.
  • Applications and use of the above-described embodiments according to the invention are various and include exemplary fields that utilize modification of image dataset display properties for visualization of an image dataset.
  • the invention may be implemented in any suitable form including hardware, software, firmware or any combination of these. However, preferably, the invention is implemented as computer software running on one or more data processors and/or digital signal processors.
  • the elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit, or may be physically and functionally distributed between different units and processors.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Image Generation (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A method for use in scale-based visualization of an image dataset is provided. The method comprises identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non-linear. The method offers high manipulation accuracy where required within a limited amount of display space, by changing the linear interaction scale into a non-linear scale. Important image/volume gray values are given a higher percentage of interaction space on the available display space than other less important gray values.

Description

A method, apparatus and computer-readable medium for scale-based visualization of an image dataset
FIELD OF THE INVENTION
This invention pertains in general to the field of image analysis. More particularly the invention relates 3-D volume visualization for displaying structures present in a scanned volume, e.g. from Computed Tomography (CT), Magnetic Resonance Imaging (MRI), or Ultrasound Imaging (US).
BACKGROUND OF THE INVENTION
Display parameters control the way a 2D or 3D image is visualized on a display. These display parameters may be modified with help of software or hardware user interface gadgets. In 2D imaging and 3D imaging the way images are displayed on a screen may be changed by manipulating valuators. Valuators are a logic class of units used in graphical systems as inputs of scalars. Valuators are used to set different graphic parameters, such as rotation angle, scale factors and to set physical parameters associated with a specific application, such as temperature setting, volt level, etc. Other approaches of changing the ways of displaying images on a screen is by dragging a mouse or joystick over specific regions on the display or interacting with wheels on a dialbox. A dialbox is a box that contains six or eight (hardware) dials. These dials are used to alter parameters assigned to them. Another way to modify the (software) parameters is to use any hardware device that is designed for that purpose. As a result of the manipulation the reconstruction of voxel gray values to display gray or color values is changed.
The Philips ViewForum workstation offers the possibility to change the visualization of voxels from an image dataset by means of the manipulation of a valuator or by dragging the mouse over a specific region on the display, i.e. so-called Direct Mouse Manipulation. This may result in changing the window width and level of a 2D image dataset or changing the visibility, i.e. opacity map, of a structure present in a 3D image dataset. A problem of prior art is that the valuator gadgets almost never are large enough to display the required scale range, as the amount of screen area available for user interaction is limited. Limiting the scale range to fit the window screen area results in loss of resolution. To solve this problem a modifiable scale range and offset may be used. However, modification of the scale range and offset requires additional user interactions, which are time consuming.
In the ViewForum application valuators and display drag areas have a linear scale range. To enable high interaction accuracy or cover larger parameter ranges it is possible to modify the valuator scale range and offset. The acceleration of the mouse while dragging may also be used as a discriminator for interacting with high sensitivity or interacting with large steps. However this feature is currently not enabled as the behavior of such system is difficult to predict and thus it is easier to predict what happens when the mouse moves over a linear scale.
Another problem is that a minimum sensitivity is required when manipulating image display parameters by dragging the mouse over certain display areas. Multiple drags are unavoidable when large parameter changes are requested. When direct mouse manipulation is used to change a parameter it is necessary to both be able to cover the required (possibly large) range and to accurately define the final (possibly small) value. This requirement however cannot be fulfilled with the current linear scale definitions. Either the scale has a high sensitivity and covers a small range or the scale has a low sensitivity and covers a large range.
Accordingly, either a large amount of display space is required to accurately modify the image display parameters, or many user interactions are needed to overcome the high sensitivity of the user interface gadgets that accurately perform the given task within a limited amount of display space.
Hence, an improved method for modifying image display properties allowing for increased flexibility, cost-effectiveness, time-effectiveness, and user friendliness would be advantageous.
SUMMARY OF THE INVENTION
Accordingly, the present invention preferably seeks to mitigate, alleviate or eliminate one or more of the above-identified deficiencies in the art and disadvantages singly or in any combination and solves at least the above-mentioned problems by providing a method, apparatus and a computer-readable medium according to the appended patent claims.
According to one aspect of the invention, a method for use in scale-based visualization of an image dataset is provided. The method comprises identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non- linear.
In another aspect of the invention an apparatus for use in scale-based visualization is provided. The apparatus comprises a first identification unit for identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, a second identification unit for identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and a calculation unit for calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non- linear.
In yet another aspect a computer-readable medium having embodied thereon a computer program for processing by a computer is provided. The computer program comprises a first identification code segment for identifying a first set of voxels of the image dataset, wherein the voxels of the first set of voxels comprises gray values that are statistically frequently present in the image dataset, a second identification code segment for identifying a second set of voxels, wherein the voxels of the second set of voxels comprises gray values that are not statistically frequently present in the image dataset, and a calculation code segment for calculating a scale based on the first set of voxels and the second set of voxels using a transfer function, wherein the transfer function is non-linear. The purpose of this invention is to eliminate the shortcomings of prior art and to offer high manipulation accuracy where required within a limited amount of display space. This may be achieved by changing the linear interaction scale into a non-linear scale, by giving important image dataset gray values a higher percentage of interaction space on the available display space than other less important image dataset gray values. This means that important image dataset gray values, e.g. gray values located in the vicinity of the mouse drag start position are taken into account with the highest possible interaction resolution. Gray values with very low importance will be skipped automatically because of the limited accuracy of the user interface. Accordingly the method according to some embodiments saves valuable display area and increases interaction performance. BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects, features and advantages of which the invention is capable of will be apparent and elucidated from the following description of embodiments of the present invention, reference being made to the accompanying drawings, in which
Fig. 1 is a screen dump from the Philips ViewForum system;
Fig. 2 is a schematic view of a method according to an embodiment;
Fig. 3 is an illustration of a practical implementation of a method according to an embodiment; Fig. 4 is a schematic view of an apparatus according to an embodiment; and
Fig. 5 is a schematic view of a computer readable medium according to an embodiment.
DESCRIPTION OF EMBODIMENTS Fig. 1 illustrates a screen dump from the current Philips ViewForum system 10 comprising valuator gadgets 11 with scale range buttons 12, 13.
The following description focuses on embodiments of the present invention applicable to applications that modify image dataset (comprising pixels or voxels) display properties by dragging the mouse over certain areas on the display, such as a viewport, or by manipulating user interface gadgets, such as a valuator or specific hardware, such as a joystick or spaceball or any other physical input device.
The present invention provides elimination of the above-mentioned shortcomings of prior art and offers high manipulation accuracy where required within a limited amount of display space. In most cases it is not needed to offer access to all gray values through the valuator, display drag area or joystick. Instead of offering a linear scale, the scale may be non- linear.
In an embodiment, according to Fig. 2, a method for visualization of an image dataset is provided. The method comprises the following steps: identifying 21 a first set of voxels of the image dataset for high accuracy visualization, identifying 22 a second set of voxels of the image dataset for low accuracy visualization, and calculating 23 a scale based on the first set and second set of voxels. The method according to this embodiment provides a high accuracy for important, i.e. first set of voxels and a low accuracy for less important, i.e. second set of voxels values. This means that the first set of voxels are given a higher-percentage of interaction space on the available display space than the second set of voxels.
In an embodiment the identifying of the first set of voxels and the identifying of the second set of voxels are performed using histogram equalization. An intermediate result of the histogram equalization is a transfer function f(x) (see more details below) that has a steeper upslope, i.e. high first derivative, for voxel gray values that are present more often A digital implementation of histogram equalization is usually performed by defining a transfer function of the form: f(x) = max(0, round[Dm * nx/N2)] - 1) where N is the number of image pixels and nx is the number of pixels at intensity level x or less. Dm is the number of intensity levels present in the image.
To calculate the image pixel values from the non-linear output scale, the output scale values are mapped through the inverse version of that transfer function. Thus voxels with gray values that are present more often receive more physical display interaction space.
In another embodiment the identifying steps are performed using any other method that re-distributes gray values along the available display space.
In an embodiment the calculating step involves deriving the scale range and offset from an area around the center of the original image dataset because it is most likely that the structure of interest is present at the center of the image dataset voxel contents.
In another embodiment the calculating step involves determining the scale range and offset from the image dataset voxel contents around the initial display drag area starting point in case the structure of interest is not present at the center of the image dataset voxel contents.
In another embodiment the calculating step involves determining the scale range and offset from a volume of interest defined in the image dataset.
The result of using the method according to some embodiments is that voxels with gray values that need a high manipulation resolution get assigned more display space than the voxels with gray values that need less manipulation resolution.
In an embodiment the calculated scale is forwarded to a rendering algorithm 24 producing a 2D or 3D visualization of the image dataset for presentation on a display. For 2D visualizations and 3D maximum intensity projections the method according to embodiments facilitates when defining the gray-level window width and level parameters. For 3D shaded volume rendered visualizations the method is useful when manipulating the opacity map or color map. A maximum intensity projection is a 2D projection of a 3D image volume along a given viewing direction. For each point in the 2D projection, a ray is cast along the given viewing direction through the 3D volume, and then the point in the 2D projection is assigned the maximum value that was encountered along the ray. In this way, lower brightness values in the 3D volume can never occlude higher brightness values in the 2D projection. The viewing direction may be freely chosen by the user, e.g. by mouse interaction, or automatically rotated around a given axis, such as the vertical body axis. In an embodiment, according to Fig. 3, a practical implementation of the method is provided. Using histogram equalization the gray values of higher importance, i.e. the voxels with gray values that are present more often are stretched over a larger scale than the voxels with gray values that are present less often. A histogram displays at the x-axis the voxel values and at the y-axis the number of times the voxel values are present. So voxels that are present more often than others, have a higher peak in the histogram. Transfer function f(x) is calculated by accumulating the histogram y-axis values as explained above. Values at and around the steep slope of f(x) are given more display space and thus have a higher manipulation accuracy. The intermediate result of histogram equalization is a look-up table F(x) (see Fig 3) see also the explanation of the well-known histogram equalization function that can be used to transform an original histogram Ha into a so-called equalized histogram Hb, e.g. the value n in function Ha is translated through look-up table F: n' = F(n) where n' is the new scale value of function Hb. To determine the original value n from the scale value n', scale value n' can be found with help of the inverse function F(x). This may be observed from Fig. 3 where voxels of histogram Hain range n, n+1 are mapped to voxels of histogram Hb in a transformed range ri , n'+\ . Instead of using the scale of function Ha(x) for parameter manipulation wherein x defines the voxel location, the scale of function Hb(x) is used. High interaction accuracy is obtained for voxels in range n, n+1 and low interaction accuracy outside this range. In an embodiment the voxels are pixels in a 2D image dataset. In an embodiment, according to Fig. 4, an apparatus 40 for visualization of an image dataset is provided. The apparatus 40 comprises: a first identification unit 41 for identifying a first set of voxels of the image dataset that are frequently present for high accuracy visualization, a second identification unit 42 for identifying a second set of voxels of the image dataset that are not frequently present for low accuracy visualization, and a calculation unit 43 for calculating a scale based on the first set of voxels and second set of voxels using a transfer function, wherein the transfer function is non- linear, and comprises a derivative, wherein the derivate for the first set of voxels is higher than the derivate for the second set of voxels. In an embodiment of the invention the apparatus 40 further comprises a render unit 44 for rendering a 2D or 3D visualization of the image dataset based on the calculated scale. Typical interactions on a 2D image are gray- value adaptations (window level/width). 3D image setting interactions are less common. However, typical (expert) interactions on 3D images are manipulations of the opacity map and color map. In an embodiment the apparatus 40 further comprises a display unit 45 for displaying the rendered 2D or 3D visualization to a user. For 2D visualizations and 3D maximum intensity projections the introduced methods helps when defining the gray-level window width and level parameters. For 3D shaded volume rendered visualizations the method is useful when manipulating the opacity map or color map. The first identification unit 41, second identification unit 42, calculation unit
43, and render unit 44 may be any unit normally used for performing the involved tasks, e.g. a hardware, such as a processor with a memory. The processor may be any of variety of processors, such as Intel or AMD processors, CPUs, microprocessors, Programmable Intelligent Computer (PIC) microcontrollers, Digital Signal Processors (DSP), etc. However, the scope of the invention is not limited to these specific processors. The memory may be any memory capable of storing information, such as Random Access Memories (RAM) such as, Double Density RAM (DDR, DDR2), Single Density RAM (SDRAM), Static RAM (SRAM), Dynamic RAM (DRAM), Video RAM (VRAM), etc. The memory may also be a FLASH memory such as a USB, Compact Flash, SmartMedia, MMC memory, MemoryStick, SD Card, MiniSD, MicroSD, xD Card, TransFlash, and MicroDrive memory etc. However, the scope of the invention is not limited to these specific memories.
In an embodiment the apparatus comprises units for performing the method according to some embodiments.
In an embodiment the apparatus is comprised in a medical workstation or medical system, such as a Computed Tomography (CT) system, Magnetic Resonance Imaging (MRI) System or Ultrasound Imaging (US) system.
In an embodiment, according to Fig. 5, a computer-readable medium having embodied thereon a computer program 50 for processing by a computer is provided. The computer-readable medium comprises: a first identification code segment 51 for identifying a first set of voxels of the image dataset that are frequently present for high accuracy visualization, a second identification code segment 52 for identifying a second set of voxels of the image dataset that are not frequently present for low accuracy visualization, and a calculation code segment 53 for calculating a scale based on the first set of voxels and second set of voxels using a transfer function, wherein the transfer function is non- linear, and comprises a derivative, wherein the derivate for the first set of voxels is higher than the derivate for the second set of voxels.
In an embodiment the computer program 50 further comprises a render code segment 54 for rendering a 2D or 3D visualization of the image dataset based on the calculated scale. Typical interactions on a 2D image are gray- value adaptations (window level/width). 3D image setting interactions are less common. However, typical (expert) interactions on 3D images are manipulations of the opacity map and color map.
In an embodiment the computer program 50 further comprises a display code segment 55 for displaying the rendered 2D or 3D visualization to a user. For 2D visualizations and 3D maximum intensity projections the introduced methods helps when defining the gray-level window width and level parameters. For 3D shaded volume rendered visualizations the method is useful when manipulating the opacity map or color map.
In an embodiment the computer-readable medium comprises code segments arranged, when run by an apparatus having computer-processing properties, for performing all of the method steps defined in some embodiments.
If the method according to an embodiment is used by an application it may be detected as follows, 1) loading an image into the application, and 2) examining the scale of the user interface gadget or determining it for the user interface display drag area or dialbox. In the latter cases the parameter value should be visible somewhere on the user interface. 3) Loading another image with a different content into the application and 4) examining the scale of the user interface gadget or determining it for the user interface display drag area or dialbox. The method according to an embodiment is used when the scale of the user interface gadget is non-linear and different for both cases. Applications and use of the above-described embodiments according to the invention are various and include exemplary fields that utilize modification of image dataset display properties for visualization of an image dataset.
The invention may be implemented in any suitable form including hardware, software, firmware or any combination of these. However, preferably, the invention is implemented as computer software running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit, or may be physically and functionally distributed between different units and processors.
Although the present invention has been described above with reference to specific embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the invention is limited only by the accompanying claims and, other embodiments than the specific above are equally possible within the scope of these appended claims. Also combinations of the specific embodiments are equally possible within the scope of the invention.
In the claims, the term "comprises/comprising" does not exclude the presence of other elements or steps. Furthermore, although individually listed, a plurality of means, elements or method steps may be implemented by e.g. a single unit or processor.
Additionally, although individual features may be included in different claims, these may possibly advantageously be combined, and the inclusion in different claims does not imply that a combination of features is not feasible and/or advantageous. In addition, singular references do not exclude a plurality. The terms "a", "an", "first", "second" etc do not preclude a plurality. Reference signs in the claims are provided merely as a clarifying example and shall not be construed as limiting the scope of the claims in any way.

Claims

CLAIMS:
1. A method for use in scale based visualization of an image dataset, said method comprising: identifying a first set of voxels of the image dataset, wherein the voxels of said first set of voxels comprises gray values that are statistically frequently present in said image dataset, identifying a second set of voxels, wherein the voxels of said second set of voxels comprises gray values that are not statistically frequently present in said image dataset, and calculating a scale based on said first set of voxels and said second set of voxels using a transfer function, wherein said transfer function is non- linear.
2. The method according to claim 1, wherein said transfer function has a derivative, wherein said derivate for said first set of voxels is higher than said derivate for said second set of voxels.
3. The method according to any of the previous claims, further comprising visualizing, based on said calculated scale, said first set of voxels in a first resolution and said second set of voxels in a second resolution on a display, wherein said first resolution is higher than said second resolution.
4. The method according to any one of the previous claims, comprising histogram equalization, wherein said histogram comprise said identifying said first set of voxels, said identifying said second set of voxels and said non- linear transfer function.
5. The method according to claim 4, wherein said histogram equalization comprises transforming an original histogram Ha into an equalized histogram Hb based on a look-up table derived from said histogram equalization.
6. The method according to any of the previous claims, further comprising calculating the original voxel values of said scale by the inverse version of said transfer function.
7. The method according to any one of the previous claims, further comprising re-distributing gray values along the available display space for identifying said first set of voxels and said identifying second set of voxels.
8. The method according to any one of the previous claims, wherein said calculating said scale comprises deriving the scale from said first set of voxels and said second set of voxels present in said image dataset.
9. The method according to any of the claims 1-8, wherein said calculating said scale comprises deriving the scale from voxels present inside a defined structure or present in an area around the center of said image dataset.
10. The method according to any one of the claims 1-9, wherein said calculating said scale comprises determining the scale from the image dataset voxel contents around an initial display drag area starting point.
11. The method according to any one of the previous claims, wherein said image dataset is a 2D, 3D, or multi-dimensional medical image dataset.
12. The method according to any one the previous claims, further comprising rendering (24) said calculated scale producing a 2D or 3D visualization of said image dataset for presentation on a display.
13. An apparatus (40) for use in scale based visualization of an image dataset, said apparatus comprising: a first identification unit (41) for identifying a first set of voxels of the image dataset, wherein the voxels of said first set of voxels comprises gray values that are statistically frequently present in said image dataset, a second identification unit (42) for identifying a second set of voxels, wherein the voxels of said second set of voxels comprises gray values that are not statistically frequently present in said image dataset, and a calculation unit (43) for calculating a scale based on said first set of voxels and said second set of voxels using a transfer function, wherein said transfer function is nonlinear.
14. The apparatus (40) according to claim 13, further comprising a render unit
(44) for rendering a 2D or 3D visualization of said image dataset based on said calculated scale.
15. The apparatus (40) according to any one of claims 13-14, further comprising a display unit (45) for displaying the rendered 2D or 3D visualization to a user.
16. The apparatus according to any one of the claims 13-15 being comprised in a medical workstation or medical system, such as a Computed Tomography (CT) system, Magnetic Resonance Imaging (MRI) System or Ultrasound Imaging (US) system.
17. A computer-readable medium (50) having embodied thereon a computer program for processing by a computer, said computer program comprising: a first identification code segment (51) for identifying a first set of voxels of the image dataset, wherein the voxels of said first set of voxels comprises gray values that are statistically frequently present in said image dataset, a second identification code segment (52) for identifying a second set of voxels, wherein the voxels of said second set of voxels comprises gray values that are not statistically frequently present in said image dataset, and a calculation code segment (53) for calculating a scale based on said first set of voxels and said second set of voxels using a transfer function, wherein said transfer function is non- linear.
18. The computer-readable medium (50) according to claim 17, further comprising a render code segment (54) for rendering a 2D or 3D visualization of said image dataset based on said calculated scale.
19. The computer-readable medium (50) according to claim 18, further comprising a display code segment (55) for displaying said rendered 2D or 3D visualization on a display.
20. The computer-readable medium according to any one of the claims 17-19, comprising code segments arranged, when run by an apparatus having computer-processing properties, for performing all of the method steps defined in claims 1-10.
EP07825893A 2006-07-31 2007-07-05 A method, apparatus and computer-readable medium for scale-based visualization of an image dataset Withdrawn EP2050066A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP07825893A EP2050066A2 (en) 2006-07-31 2007-07-05 A method, apparatus and computer-readable medium for scale-based visualization of an image dataset

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP06118153 2006-07-31
PCT/IB2007/052638 WO2008015592A2 (en) 2006-07-31 2007-07-05 A method, apparatus and computer-readable medium for scale-based visualization of an image dataset
EP07825893A EP2050066A2 (en) 2006-07-31 2007-07-05 A method, apparatus and computer-readable medium for scale-based visualization of an image dataset

Publications (1)

Publication Number Publication Date
EP2050066A2 true EP2050066A2 (en) 2009-04-22

Family

ID=38997538

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07825893A Withdrawn EP2050066A2 (en) 2006-07-31 2007-07-05 A method, apparatus and computer-readable medium for scale-based visualization of an image dataset

Country Status (5)

Country Link
US (1) US20090174712A1 (en)
EP (1) EP2050066A2 (en)
JP (1) JP2009545355A (en)
CN (1) CN101496061B (en)
WO (1) WO2008015592A2 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110154426A1 (en) * 2008-08-22 2011-06-23 Ingo Tobias Doser Method and system for content delivery
EP2517180A1 (en) * 2009-12-21 2012-10-31 Koninklijke Philips Electronics N.V. Processing an image dataset based on clinically categorized populations
US20150287188A1 (en) * 2014-04-02 2015-10-08 Algotec Systems Ltd. Organ-specific image display
US11109842B2 (en) 2014-12-10 2021-09-07 General Electric Company Method and system for enhanced visualization of individual images in a real-time scan
US10062200B2 (en) 2015-04-03 2018-08-28 Dental Imaging Technologies Corporation System and method for displaying volumetric images
KR101798083B1 (en) * 2016-02-04 2017-12-12 삼성전자주식회사 Apparatus and method for processing medical image, and computer readable recording medium related to the method
US10873681B2 (en) * 2016-02-08 2020-12-22 Imago Systems, Inc. System and method for the visualization and characterization of objects in images
WO2017171656A1 (en) * 2016-03-31 2017-10-05 Agency For Science, Technology And Research Panoramic visualization of coronary arterial tree
US10545211B2 (en) * 2017-06-28 2020-01-28 Synaptive Medical (Barbados) Inc. Method of correcting gradient nonuniformity in gradient motion sensitive imaging applications
CN109658491A (en) * 2017-10-11 2019-04-19 中国石油化工股份有限公司 A kind of generation method and device of interactive mode transfer function
US10593099B2 (en) * 2017-11-14 2020-03-17 Siemens Healthcare Gmbh Transfer function determination in medical imaging
CN110232660B (en) * 2019-04-28 2022-05-03 电子科技大学 Novel infrared image recognition preprocessing gray stretching method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003021284A1 (en) * 2001-08-28 2003-03-13 Koninklijke Philips Electronics Nv System and method of user guidance in magnetic resonance imaging including operating curve feedback and multi-dimensional parameter optimization
US6658080B1 (en) * 2002-08-05 2003-12-02 Voxar Limited Displaying image data using automatic presets

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5542003A (en) * 1993-09-13 1996-07-30 Eastman Kodak Method for maximizing fidelity and dynamic range for a region of interest within digitized medical image display
US5542006A (en) * 1994-06-21 1996-07-30 Eastman Kodak Company Neural network based character position detector for use in optical character recognition
KR100261214B1 (en) * 1997-02-27 2000-07-01 윤종용 Histrogram equalization method and apparatus of a contrast expanding apparatus in image processing system
US6236751B1 (en) * 1998-09-23 2001-05-22 Xerox Corporation Automatic method for determining piecewise linear transformation from an image histogram
JP2001243464A (en) * 2000-02-29 2001-09-07 Canon Inc Device, system, and method for image processing, and storage medium
US7046247B2 (en) * 2002-05-15 2006-05-16 Hewlett-Packard Development Company, L.P. Method for visualizing graphical data sets having a non-uniform graphical density for display
US7218763B2 (en) * 2003-02-27 2007-05-15 Eastman Kodak Company Method for automated window-level settings for magnetic resonance images
US7454078B2 (en) * 2003-07-22 2008-11-18 Warner Bros. Entertainment Inc. Method and apparatus for flicker removal from an image sequence
JP4626138B2 (en) * 2003-09-30 2011-02-02 コニカミノルタエムジー株式会社 Image processing apparatus, image processing method, and program
JP4484579B2 (en) * 2004-05-11 2010-06-16 キヤノン株式会社 Image processing apparatus and method, and program
US20050273009A1 (en) * 2004-06-02 2005-12-08 Harald Deischinger Method and apparatus for co-display of inverse mode ultrasound images and histogram information
US7660488B2 (en) * 2004-11-04 2010-02-09 Dr Systems, Inc. Systems and methods for viewing medical images

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003021284A1 (en) * 2001-08-28 2003-03-13 Koninklijke Philips Electronics Nv System and method of user guidance in magnetic resonance imaging including operating curve feedback and multi-dimensional parameter optimization
US6658080B1 (en) * 2002-08-05 2003-12-02 Voxar Limited Displaying image data using automatic presets

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
KELLY REHM ET AL: "Display of Merged Multimodality Brain Images Using Interleaved Pixels with Independent Color Scales", THE JOURNAL OF NUCLEAR MEDICINE, 1 November 1994 (1994-11-01), UNITED STATES, pages 1815, XP055405773, Retrieved from the Internet <URL:http://jnm.snmjournals.org/content/35/11/1815.full.pdf> [retrieved on 20180118] *
REZK-SALAMA C., HASTREITER P., SCHERER J., GREINER G.: "Automatic Adjustement of Transfer Functions for 3D Volume Visualization", PROC. WORKSHOP VISION, MODELING, AND VISUALIZATION (VMV 2000), 2000 *
SEREDA P ET AL: "Visualization of boundaries in volumetric data sets using LH histograms", IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, IEEE SERVICE CENTER, LOS ALAMITOS, CA, US, vol. 12, no. 2, 1 March 2006 (2006-03-01), pages 208 - 218, XP002549932, ISSN: 1077-2626, DOI: 10.1109/TVCG.2006.39 *

Also Published As

Publication number Publication date
JP2009545355A (en) 2009-12-24
WO2008015592A3 (en) 2008-07-03
US20090174712A1 (en) 2009-07-09
CN101496061B (en) 2016-05-04
CN101496061A (en) 2009-07-29
WO2008015592A2 (en) 2008-02-07

Similar Documents

Publication Publication Date Title
US20090174712A1 (en) Method, apparatus and computer-readable medium for scale-based visualization of an image dataset
CN111192356B (en) Method, device, equipment and storage medium for displaying region of interest
US9053565B2 (en) Interactive selection of a region of interest in an image
US7889900B2 (en) Medical image viewing protocols
US10275930B2 (en) Combined intensity projection
US20230351594A1 (en) Method for aiding visualization of lesions in medical imagery and apparatus using the same
US10188361B2 (en) System for synthetic display of multi-modality data
US20050237336A1 (en) Method and system for multi-object volumetric data visualization
CN103325139A (en) Medical image processing apparatus and medical image processing method
US11683438B2 (en) Systems and methods to semi-automatically segment a 3D medical image using a real-time edge-aware brush
EP2050071B1 (en) A method, apparatus and computer-readable medium for creating a preset map for the visualization of an image dataset
CN113658284B (en) X-ray image synthesis from CT images for training a nodule detection system
US20180122088A1 (en) Method for establishing an overlay image to be displayed, display device, computer program, and data medium
US20160148388A1 (en) Method of defining a region of interest
EP3441944A1 (en) Volume rendering of volumetric image data with interactive segmentation
US20130076748A1 (en) 3d visualization of medical 3d image data
CN111724388A (en) Visualization of medical image data
Park et al. Feature selection of 3D volume data through multi-dimensional transfer functions
Abdellah et al. Optimized GPU-accelerated framework for x-ray rendering using k-space volume reconstruction
Malek et al. Instant Feedback Rapid Prototyping for GPU‐Accelerated Computation, Manipulation, and Visualization of Multidimensional Data

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20090302

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20101028

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KONINKLIJKE PHILIPS N.V.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20180228