WO2011100575A2 - Systems, methods and computer readable storage mediums storing instructions for applying multiscale bilateral filtering to magnetic resonance (mr) images - Google Patents
Systems, methods and computer readable storage mediums storing instructions for applying multiscale bilateral filtering to magnetic resonance (mr) images Download PDFInfo
- Publication number
- WO2011100575A2 WO2011100575A2 PCT/US2011/024565 US2011024565W WO2011100575A2 WO 2011100575 A2 WO2011100575 A2 WO 2011100575A2 US 2011024565 W US2011024565 W US 2011024565W WO 2011100575 A2 WO2011100575 A2 WO 2011100575A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sinogram
- image
- sinograms
- images
- decomposing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/168—Segmentation; Edge detection involving transform domain methods
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
- G06T2207/20028—Bilateral filtering
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20036—Morphological image processing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30016—Brain
Definitions
- Magnetic Resonance (MR) images provide invaluable information to medical practitioners.
- MR Magnetic Resonance
- conventional techniques do not yield satisfactory results over a wide range of scan types and neuroanatomies without manual intervention.
- traditional techniques are not robust enough for large scale analyses.
- a method, performed by a computer having a memory and a processor, for segmenting anatomical landmark in digital medical images may include: transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram; decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale; combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
- the method may include transforming the reconstructed sinogram from the Radon Domain to the Image Domain to obtain a segmented MR Image.
- the method may include displaying the segmented MR Image.
- the method may include using the segmented MR Image for attenuation control of a positron emission tomography (PET) Image.
- PET positron emission tomography
- the decomposing is performed using a bilateral filter.
- the decomposing may include filtering the original sinogram to a scale of six, wherein the plurality of sinograms is six sinograms.
- the method may include filtering each of the plurality of sinograms with a gradient filter after the decomposing the sinogram to the plurality of sinograms.
- the gradient filter may be selected based on the anatomical landmark.
- the anatomical landmark may include any one, or a combination, of a brain, at least one lung, a thorax, and at least one bone.
- the transformation may be based on the following calculation:
- a computer-readable storage medium may store instructions for segmenting an anatomical landmark in digital medical images, the instructions may include: transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram; decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale; combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
- the medium may include instructions for transforming the reconstructed sinogram from the Radon Domain to the Image Domain to obtain a segmented MR Image.
- the medium may include displaying the segmented MR Image.
- the medium may include instructions for using the segmented MR Image for attenuation control of a PET Image.
- the decomposing is performed using a bilateral filter.
- a system for processing PET and MR images from a PET/MRI machine may include an apparatus including at least one processor; and [0011] at least one memory including computer program code.
- the at least one memory and the computer program code configured to, with the at least one processor, may cause the apparatus to perform at least the following: transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram; decomposing the original sinogram to obtain a plurality of sinograms, each of plurality of sinograms being at a different scale; combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
- Figure 1 shows a method according to an exemplary embodiment to obtain a segmented tissue image from a scanned original MR image of a subject's anatomy
- Figure 2 illustrates an example of a schematic diagram of the Radon transform with respect to a brain scan
- Figures 3(a) and 3(b) illustrate an example of a transformation of a MR image of a brain
- FIG 4 illustrates an example of how the Radon transform according to embodiments may improve the signal to noise rate (SNR);
- Figures 5(a) and (b) illustrate an example of how the Radon transform may decrease the noise in the original images by illustrate the profiles drawing through MR images and corresponding sinograms, respectively;
- Figure 6 shows a method of decomposing an original sinogram to a multi-scale sinogram according to an exemplary embodiment
- Figure 7 illustrates an example of a scheme diagram of a bilateral filter
- Figures 8(a) and 8(b) illustrate an example of three scales of generating kernel w i and its Fourier transforms 1 ⁇ ;
- Figure 9 illustrates a scale-space of decomposed images constructed by bilateral filtering
- Figure 10 illustrates a comparison of the profiles of the decomposed images in every scale
- Figures 11(a) and 11(b) show kernels for two filters for a brain scan according to an exemplary embodiment
- Figure 12 illustrates multiscale processing of a brain image to obtain a reconstructed sinogram according to an exemplary embodiment
- Figure 13 shows an example of an apparatus for providing superposed MR and PET imaging according to an exemplary embodiment.
- the methods of the disclosure are described with respect to a brain scan. However, it should be understood that the disclosure is not limited to the brain and may be applied to scans of other anatomical landmarks, including but not limited to, scans of a thorax, at least one lung, and at least one bone.
- sequences of instructions designed to implement the methods may be compiled for execution on a variety of hardware platforms and for interface to a variety of operating systems.
- embodiments are not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement embodiments of the disclosure.
- Attenuation correction is an essential step in the study of quantitative PET imaging of certain body anatomy, specifically those having a well-defined outline such as a scalp, thorax, and lung.
- One approach is to use MR images for attenuation correction of PET images, involving a segmented tissue technique in which a scan for attenuation correction is taken to segment the scanned anatomy to produce an attenuation correction (AC) map.
- the brain may be segmented into the scalp, skull, and brain tissue so that one can assign different attenuation coefficients to the segmented tissue and then produce the AC map.
- the skull On the AC map, the skull has the largest attenuation coefficient; and thus will dominate the attenuation correction of the image.
- FIG. 1 illustrates a method according to an embodiment to obtain a segmented tissue image from a scanned original MR image of a subject's anatomy.
- segmentation method 100 may include a preprocessing step 102 that processes Tl -weighted MR images.
- the preprocessing step 102 may include processing Tl-weighted MR images using a predetermined threshold and a Gaussian filter in order to remove the background noise and smooth the original image.
- the preprocessing may be according to methods well known in the art.
- the method 100 may further include a transforming step 104 that transforms the MR image from the Image Domain to the Radon Domain to obtain a sinogram.
- the Radon transform may be defined as follows from a complete set of line integrals P s (a).
- Figure 2 illustrates an example of a schematic diagram of the Radon transform with respect to a brain scan 210.
- s is the perpendicular distance of a line from the origin and a is the angle formed by the distance vector.
- the projection image, i.e., sonogram 220 may have two gaps because of low signal for skull.
- the Fourier slice theorem states that for a 2-D function f(x,y) 215, the 1-D Fourier transforms of the Radon transform along s , are the 1- D radial samples of the 2-D Fourier transform of f(x,y) 215 at the corresponding angles.
- f(x,y) 215 the 1-D Fourier transforms of the Radon transform along s
- This is more fully detailed, for example, in Yang et al., 2010, Proc.SPIE 2010 Mar.4; 7623, (1):76233K, 7623, 76233K, which is incorporated in its entirety.
- Figures 3(a) and 3(b) illustrate an example of a transformation of a MR image 310 of a brain.
- Figure 3(a) illustrates the MR image 310
- Figure 3(b) illustrates the corresponding sinogram 320 in the Radon domain.
- Using the Radon Transform may improve the robustness of the image to noise. Assuming white noise with zero mean is added to the image, the Radon transform of noise will be constant for all of the points and directions and will be equal to the mean value of the noise, which is assumed to be zero, because the Radon transform is line integral of the image, for the continuous case. Accordingly, zero-mean white noise may have no effect on the Radon transform of the image.
- Figure 4 illustrates an example of how the Radon transform according to embodiments may improve the signal to noise rate (SNR). Specifically, Figure 4 illustrates an example of a brain ellipse model 400 and calculation scheme in the Radon domain. The example may be described by the following equation:
- the intensity values along the pixels for the Radon transform may be summed as shown in Figure 4.
- the following calculations are based on the assumption that the point f(x,y) is 2D discrete signals whose intensity values are independent of random variables with mean ⁇ and variance ⁇ 2 .
- SNR Radon in Radon domain may be calculated as
- the SNR MRI may be defined as . So
- the SNR has been increased by 101og 10 (218) « 23.4dB .
- this method may be robust to additive noise.
- Figures 5(a) and (b) illustrate an example of how the Radon transform may decrease the noise in the original images by illustrate the profiles drawing through MR images and corresponding sinograms, respectively.
- a first comparison of line profiles 510 is illustrated in Figure 5(a), in which 8% and 16% noise were added to the original MR image. As shown, the image with 16% noise has severe contamination as the details were lost on the noised image.
- the profiles between the corresponding sinograms are close, showing that the Radon transform has decreased the noise in the original images.
- the SNRs are 28.2dB and 14.4dB for 8% and 16% noised image, respectively.
- the SNRs are 63.8dB and 50.1dB, respectively. Thus, the SNRs are increased by 35.6dB and 35.7dB.
- the method may further include step 130 that decomposes the sinogram to a multi- scale sinogram.
- the decomposing step 130 may performed by the steps shown in Figure 6.
- the decomposing method may result in a multiscale sinogram representing a series of images with different levels of spatial resolution. In the course scale, the general information is extracted and maintained in images, and in the fine scale, images have more local tissue information.
- the decomposing step 130 may include a receiving step 131 for receiving the image in the Radon domain. Because the image is original, the scale, i, equals 0.
- the decomposing may be performed by a bilateral filter by a factor of 2. As shown in Figure 6, the decomposing step may further include two filtering steps 132 and 133.
- Bilateral filtering is a non-linear filtering technique. Such technique is further detailed in Tomasi and Manduchi, 1998, Computer Vision, 1998, Sixth International Conference, 839-846, which is incorporated by reference in its entirety.
- the filter may be a weighted average of the local neighborhood samples, where the weights are computed based on temporal (or spatial in case on images) and radiometric distance between the center sample and the neighboring samples.
- the bilateral filtering may smooth the images while preserving edges, by means of a nonlinear combination of nearby image values. Bilateral filtering may be described as follows:
- FIG. 7 illustrates an example of a scheme diagram 700 of a bilateral filter. As shown in the Figure 7, the bilateral filter may replace the pixel value at x with an average of similar and nearby pixel values.
- pixel values in a small neighborhood may be similar to each other, and the bilateral filter acts essentially as a standard domain filter, averaging away the small, weakly correlated differences between pixel values caused by noise.
- This scheme is further described in Elad, 2002, Image Processing, IEEE Transactions, 11(10), 1141- 1151, which is incorporated by reference in its entirety.
- the bilateral filtering may be performed by many different kernels.
- the bilateral filtering may be performed by a Gaussian filtering.
- the Gaussian filtering may be shift-invariant Gaussian filtering, in which both the spatial function and the range function are Gaussian functions of the Euclidean distance between their arguments.
- this may be simply the absolute difference of the pixel difference.
- the Gaussian range filter may also be insensitive to overall additive changes of image intensity.
- the range filter may also be shift-invariant.
- Figure 6 illustrates a multiscale bilateral composition.
- the decomposing method may further include an obtaining step 135 that obtains each image (sinogram) that is filtered.
- the method may further include a determination step 135 that determines whether the filtering step should be repeated so as to build a series of filtered images having different scales as shown in step 136. The filtering step may be repeated until the number of images at the predetermined scale N is obtained.
- a series of filtered images /'that preserve the strongest edges in / while smoothing small changes in intensity may be obtained based with the following calculations.
- the image is then filtered through a bilateral filter in steps 132 and 133.
- Application of the bilateral filter may compute the following:
- W a (x) exp(-x 2 / ⁇ 2 ) , ⁇ ⁇ 1 and ⁇ , , are the widths of the spatial and range Gaussians respectively and A: is an offset relative to wthat runs across the support of the spatial Gaussian.
- the repeated convolution by W aJ may increase the spatial smoothing at each scale i .
- the spatial kernel may be set to .
- the filtered image /' may not be identical to bilaterally filtering the original input image / with a spatial kernel of cumulative width.
- the range Gaussian is an edge-stopping function.
- the initial width a r may be set to A 125 , where A is the intensity range of the image.
- Figures 8(a) and 8(b) illustrate an example of three scales 810, 820, and 830 of generating kernel w t and its Fourier transforms w r
- Dashed lines in Figure 8(a) show the envelopes of three scales kernel.
- Dashed lines in Figure 8(b) indicate smoothing condition boundaries
- kernels w' have a fixed number 2m +1 , of non-zero coefficients, yet expand in space by the introduction of 2' -1 zeros between these coefficients.
- the expansion of the w' by inserting zeros leads to the introduction of 2' aliases in #'( ⁇ ) .
- the generating kernels themselves do not operate as low-pass filters. However, as long as the following smoothing condition, holds, it will follow that ( )
- Figure 9 illustrates a scale-space 910 constructed by bilateral filtering.
- the scale number may be selected based on the anatomy selected to be scanned.
- the multiscale bilateral decomposition technique smoothes the images as the scale / increases.
- the scale i may be considered as the scale level and the original image is at the level 0.
- the images become more blurred and contain more general information.
- downsampling may prevent the decomposition from being translation invariant and could introduce grid artifacts when the coarser scales are manipulated.
- Figure 10 illustrates a comparison of the profiles 1000 in every scale. As shown in Figure 10, when the scale increases, small edges in intra-region are smoothed and the big edges in the inter-region are preserved. Gradient Filtering
- the segmentation method 100 may further include a filtering step 140 that filters each sinogram through a predetermined gradient filter, as shown in Figure 1.
- the images may be filtered through different filters.
- the images may be use two sets of filters.
- the filters may be selected based on the anatomy scanned.
- Figures 11(a) and 11(b) show kernels 1110 and 1120, respectively, for two filters utilized for a brain scan.
- the method 100 may optionally include a processing step 150 for processing each sinogram with morphological image processing.
- the sinograms may be combined in step 160.
- the combined sinograms may determine a binary sinogram in step 170.
- a thresholding method is used to determine the binary sinogram from the combined sinograms.
- the binary sinogram may then be used to reconstruct the sinogram in step 180.
- the reconstruction step 180 may include transforming the sinogram from the Radon Domain to the Image Domain. The transformation may be based on any known calculations.
- the reconstruction may be performed using filter back projection or ordered-subset expectation maximization (OSEM) methods.
- OSEM ordered-subset expectation maximization
- FIG 12 is an illustration of multiscale processing 1200 performed in steps 160 through 180 on a brain image to obtain a reconstructed sinogram.
- the scale increases from up to down.
- the upper half of the first filtered mage is combined with the lower half of the second filtered image in order to get a new sinogram as shown in (1) of Figure 10.
- These images are then used to get a mask in step (2).
- the mask is inversed to obtain the mask in step (3).
- the mask from step (3) may be used to obtain a binary skull in the Radon domain in step (4).
- the skull then may be reconstructed in step (5) to obtain the segmented skull
- Reconstruction in step 180 may be performed after obtaining the binary sinogram as discussed above.
- a threshold may be utilized in the reconstruction to eliminate some artifacts introduced by reconstruction. Reconstruction may be described as: (18)
- the segmented tissue may be displayed in step 190.
- the segmented MR Image with segmented tissue may be forwarded for further processing.
- the segmented MR Image may be used as part of the attenuation control of PET images.
- the segmented MR Image with segmented tissue may be both displayed and forwarded.
- FIG. 13 shows an example of a known apparatus 1300 for superposed MR and PET imaging.
- the apparatus 1300 may include any known MRI tube 102.
- the MRI tube 1304 defines a longitudinal direction z, which extends orthogonally to the plane of the drawing of FIG. 13.
- the system may contain a scanner including one or more gamma ray detectors (not shown) (e.g., a ring of gamma ray detectors) incorporated into a RF coil assembly (not shown).
- the one or more gamma ray detectors may be configured to detect gamma rays from positron annihilations and may include a plurality of scintillators and photodetectors arranged circumferentially about a gantry (i.e., a ring of gamma ray detectors or a detector ring).
- the system may further include a plurality of PET detection units 1306 arranged in mutually opposing pairs around the longitudinal direction z are arranged coaxially within the MRI tube 1304.
- the PET detection units 1306 may preferably include a photodiode array 1310, such an APD photodiode array, with an upstream array of crystals 1308, such as LSO crystals, and an electrical amplifier circuit (AMP) 1306.
- a photodiode array 1310 such an APD photodiode array
- crystals 1308, such as LSO crystals such as LSO crystals
- AMP electrical amplifier circuit
- the apparatus may further include a computer system 1320 to carry out the image processing for superposed MR and PET imaging.
- the computer system 1320 may further be used to control the operation of the system or a separate system may be included.
- the computer system 1320 may include a number of modules that communicate with each other through electrical and/or data connections (not shown). Data connections may be direct wired links or may be fiber optic connections or wireless communications links or the like. The computer system 1320 may also be connected to permanent or back-up memory storage, a network, or may communicate with a separate system control through a link (not shown).
- the modules may include a CPU 1322, a memory 1324, an image processor 1326, an input device 1328, a display 1330, and a printer interface 1332. The computer system 1320 may also be connected to another computer system as well as a network.
- the CPU 1322 may be one or more of any known central processing unit, including but not limited to a processor, or a microprocessor.
- the CPU 1322 may be coupled directly or indirectly to memory elements.
- the memory 1324 may include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combinations thereof).
- the memory may also include a frame buffer for storing image data arrays.
- the described processes may be implemented as a routine that is stored in memory 1324 and executed by the CPU 1322.
- the computer system 1320 may be a general purpose computer system that becomes a specific purpose computer system when executing the routine of the disclosure.
- the computer system 1320 may also include an operating system and micro instruction code.
- the various processes and functions described herein may either be part of the micro instruction code or part of the application program or routine (or combination thereof) that is executed via the operating system.
- various other peripheral devices may be connected to the computer platform such as an additional data storage device, a printing device, and I/O devices.
- the image processor 1326 may be one or more of any known central processing unit, including but not limited to a processor, or a microprocessor. In some embodiments, the image processor 1326 also processes the data. In other embodiments, the image processor 1326 may be replaced by image processing functionality on the CPU 1322.
- the input device 1328 may include a mouse, joystick, keyboard, track ball, touch activated screen, light wand, voice control, or any similar or equivalent input device, and may be used for interactive geometry prescription.
- the input device 1328 may control the production, display of images on the display 1330, and printing of the images by the printer interface 1332.
- the display 1330 and the printer interface 1332 may be any known display screen and the printer interface 1332 may be any known printer, either locally or network connected.
- An MRI scan is complete when one or more sets of raw k-space data has been acquired in by the image processor 1326.
- the image processor 1326 reconstructs the raw k- space data by transforming the data raw k-space data (via Fourier transformation or another technique) into image data. This image data may then be stored in the memory 1324. In other embodiments, another computer system may assume the duties of image reconstruction or other functions of the image processor 1326.
- the image data stored in the memory 1324 may be archived in long term storage or may be further processed by the image processor 1326 and presented on the display 1330. PET images may be reconstructed by the image processor 1326 and may be combined with MR images to produce hybrid structural and metabolic or functional images.
- the embodiments of the disclosure be implemented in various forms of hardware, software, firmware, special purpose processes, or a combination thereof.
- the disclosure may be implemented in software as an application program tangible embodied on a computer readable program storage device.
- the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
- the system and method of the present disclosure may be implemented in the form of a software application running on a computer system, for example, a mainframe, personal computer (PC), handheld computer, server, etc.
- the software application may be stored on a recording media locally accessible by the computer system and accessible via a hard wired or wireless connection to a network, for example, a local area network, or the Internet.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- High Energy & Nuclear Physics (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Nuclear Medicine (AREA)
- Image Processing (AREA)
Abstract
Systems, methods and computer-readable storage mediums relate to segmenting MR images using multiscale bilateral filtering. Before the multiscale bilateral filtering, the MR images are transformed from the Image Domain to the Radon Domain.
Description
SYSTEMS, METHODS AND COMPUTER READABLE STORAGE MEDIUMS STORING INSTRUCTIONS FOR APPLYING MULTISCALE BILATERAL FILTERING TO
MAGNETIC RESONANCE (MR) IMAGES
PRIOR APPLICATION
[0001] This application claims priority to U.S. Provisional Application No. 61/303,392 filed February 11, 2010, which is hereby incorporated by reference.
BACKGROUND INFORMATION
[0002] Magnetic Resonance (MR) images provide invaluable information to medical practitioners. However, due to the presence of imaging artifacts, anatomical variability, varying contrast properties, and poor registration, conventional techniques do not yield satisfactory results over a wide range of scan types and neuroanatomies without manual intervention. Moreover, traditional techniques are not robust enough for large scale analyses.
[0003] Thus, there is a need for an image processing technique that is robust and accurate. SUMMARY
[0004] Systems, methods and computer-readable storage mediums storing instructions are provided for segmenting MR images using multiscale bilateral filtering. In some embodiments, a method, performed by a computer having a memory and a processor, for segmenting anatomical landmark in digital medical images, may include: transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram; decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale; combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
[0005] In some embodiments, the method may include transforming the reconstructed sinogram from the Radon Domain to the Image Domain to obtain a segmented MR Image. In further embodiments, the method may include displaying the segmented MR Image. In further embodiments, the method may include using the segmented MR Image for attenuation control of
a positron emission tomography (PET) Image. In other embodiments, the decomposing is performed using a bilateral filter.
[0006] In some embodiments, the decomposing may include filtering the original sinogram to a scale of six, wherein the plurality of sinograms is six sinograms. In other embodiments, the method may include filtering each of the plurality of sinograms with a gradient filter after the decomposing the sinogram to the plurality of sinograms. In some embodiments, the gradient filter may be selected based on the anatomical landmark. In other embodiments, the anatomical landmark may include any one, or a combination, of a brain, at least one lung, a thorax, and at least one bone.
[0008] In some embodiments, a computer-readable storage medium may store instructions for segmenting an anatomical landmark in digital medical images, the instructions may include: transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram; decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale; combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
[0009] In some embodiments, the medium may include instructions for transforming the reconstructed sinogram from the Radon Domain to the Image Domain to obtain a segmented MR Image. In further embodiments, the medium may include displaying the segmented MR Image. In further embodiments, the medium may include instructions for using the segmented MR Image for attenuation control of a PET Image. In other embodiments, the decomposing is performed using a bilateral filter.
[0010] In some embodiments, a system for processing PET and MR images from a PET/MRI machine may include an apparatus including at least one processor; and
[0011] at least one memory including computer program code. The at least one memory and the computer program code configured to, with the at least one processor, may cause the apparatus to perform at least the following: transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram; decomposing the original sinogram to obtain a plurality of sinograms, each of plurality of sinograms being at a different scale; combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The disclosure can be better understood with the reference to the following drawings and description. The components in the figures are not necessarily to scale, emphasis being placed upon illustrating the principles of the disclosure.
[0013] Figure 1 shows a method according to an exemplary embodiment to obtain a segmented tissue image from a scanned original MR image of a subject's anatomy;
[0014] Figure 2 illustrates an example of a schematic diagram of the Radon transform with respect to a brain scan;
[0015] Figures 3(a) and 3(b) illustrate an example of a transformation of a MR image of a brain;
[0016] Figure 4 illustrates an example of how the Radon transform according to embodiments may improve the signal to noise rate (SNR);
[0017] Figures 5(a) and (b) illustrate an example of how the Radon transform may decrease the noise in the original images by illustrate the profiles drawing through MR images and corresponding sinograms, respectively;
[0018] Figure 6 shows a method of decomposing an original sinogram to a multi-scale sinogram according to an exemplary embodiment;
[0019] Figure 7 illustrates an example of a scheme diagram of a bilateral filter;
[0020] Figures 8(a) and 8(b) illustrate an example of three scales of generating kernel wi and its Fourier transforms 1な ;
[0021] Figure 9 illustrates a scale-space of decomposed images constructed by bilateral filtering;
[0022] Figure 10 illustrates a comparison of the profiles of the decomposed images in every scale;
[0023] Figures 11(a) and 11(b) show kernels for two filters for a brain scan according to an exemplary embodiment;
[0024] Figure 12 illustrates multiscale processing of a brain image to obtain a reconstructed sinogram according to an exemplary embodiment; and
[0025] Figure 13 shows an example of an apparatus for providing superposed MR and PET imaging according to an exemplary embodiment.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0026] The following description, numerous specific details are set forth such as examples of specific components, devices, methods, etc., in order to provide a thorough understanding of embodiments of the disclosure. It will be apparent, however, to one skilled in the art that these specific details need not be employed to practice embodiments of the disclosure. In other instances, well-known materials or methods have not been described in detail in order to avoid unnecessarily obscuring embodiments of the disclosure. While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure.
[0027] The methods of the disclosure are described with respect to a brain scan. However, it should be understood that the disclosure is not limited to the brain and may be applied to scans of
other anatomical landmarks, including but not limited to, scans of a thorax, at least one lung, and at least one bone.
[0028] The methods of the disclosure are not limited to the steps described herein. The steps may be individually modified or omitted, as well as additional steps may be added.
[0029] Unless stated otherwise as apparent from the following discussion, it will be appreciated that terms such as "decomposing," "filtering," "combining," "reconstructing," "segmenting," "generating," "registering," "determining," "obtaining," "processing," "computing," "selecting," "estimating," "detecting," "tracking," "obtaining" or the like may refer to the actions and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (e.g., electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices. Embodiments of the methods described herein may be implemented using computer software. If written in a programming language conforming to a recognized standard, sequences of instructions designed to implement the methods may be compiled for execution on a variety of hardware platforms and for interface to a variety of operating systems. In addition, embodiments are not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement embodiments of the disclosure.
[0030] Attenuation correction (AC) is an essential step in the study of quantitative PET imaging of certain body anatomy, specifically those having a well-defined outline such as a scalp, thorax, and lung. One approach is to use MR images for attenuation correction of PET images, involving a segmented tissue technique in which a scan for attenuation correction is taken to segment the scanned anatomy to produce an attenuation correction (AC) map.
[0031] For example, with respect to a brain scan, the brain may be segmented into the scalp, skull, and brain tissue so that one can assign different attenuation coefficients to the segmented tissue and then produce the AC map. On the AC map, the skull has the largest attenuation coefficient; and thus will dominate the attenuation correction of the image. Once the skull is
segmented from MR images, the shape and size of the scalp that is outside of the skull and the brain tissue that is inside of the skull may be determined.
[0032] Traditionally, many combined PET/MRI machines do not offer transmission scans for attenuation correction because of space limit considerations. Additionally, as mentioned, a number of techniques that have been proposed to segment tissue in MR images fail to provide satisfactory results over a wide range of scan types and anatomies.
Segmentation Method
[0033] Figure 1 illustrates a method according to an embodiment to obtain a segmented tissue image from a scanned original MR image of a subject's anatomy. In some embodiments, segmentation method 100 may include a preprocessing step 102 that processes Tl -weighted MR images. The preprocessing step 102 may include processing Tl-weighted MR images using a predetermined threshold and a Gaussian filter in order to remove the background noise and smooth the original image. The preprocessing may be according to methods well known in the art.
Transforming Step
[0034] The method 100 may further include a transforming step 104 that transforms the MR image from the Image Domain to the Radon Domain to obtain a sinogram. In some embodiments, the Radon transform may be defined as follows from a complete set of line integrals Ps (a).
[0035] Figure 2 illustrates an example of a schematic diagram of the Radon transform with respect to a brain scan 210. As shown in Figure 2, s is the perpendicular distance of a line from the origin and a is the angle formed by the distance vector. In this example, the projection image, i.e., sonogram 220 may have two gaps because of low signal for skull. The point f(x,y)
215 in the brain scan 210 corresponds to the sine curve in the Radon domain. According to the
Fourier slice theorem, this transformation is invertible. The Fourier slice theorem states that for a 2-D function f(x,y) 215, the 1-D Fourier transforms of the Radon transform along s , are the 1-
D radial samples of the 2-D Fourier transform of f(x,y) 215 at the corresponding angles. This is more fully detailed, for example, in Yang et al., 2010, Proc.SPIE 2010 Mar.4; 7623, (1):76233K, 7623, 76233K, which is incorporated in its entirety.
[0036] Figures 3(a) and 3(b) illustrate an example of a transformation of a MR image 310 of a brain. Figure 3(a) illustrates the MR image 310 and Figure 3(b) illustrates the corresponding sinogram 320 in the Radon domain. As shown in Figure 3(b), there may be two low intensity gaps on top and bottom sides of the sinogram 320 along the vertical direction, which indicate the skull may have relatively low signal intensity on the Tl -weighted MR image.
[0037] Using the Radon Transform according to some embodiments may improve the robustness of the image to noise. Assuming white noise with zero mean is added to the image, the Radon transform of noise will be constant for all of the points and directions and will be equal to the mean value of the noise, which is assumed to be zero, because the Radon transform is line integral of the image, for the continuous case. Accordingly, zero-mean white noise may have no effect on the Radon transform of the image.
[0038] Figure 4 illustrates an example of how the Radon transform according to embodiments may improve the signal to noise rate (SNR). Specifically, Figure 4 illustrates an example of a brain ellipse model 400 and calculation scheme in the Radon domain. The example may be described by the following equation:
[0039] To demonstrate the improved SNR, the intensity values along the pixels for the Radon transform may be summed as shown in Figure 4. The following calculations are based on the assumption that the point f(x,y) is 2D discrete signals whose intensity values are independent of random variables with mean μ and variance σ2. For each point along the projection ps, nf pixels off(x,y) are summed and therefore, mean{ps) - n^ - μ and var(ps) = ns -a2.
[0040] Meanwhile, ns = s · tan θ = R · sin Θ and R =
, where R is the radius of the ellipse area in terms of pixels, and the integer s is the projection index, which varies from -a to a .
[0041] The average of is
[0042] Its expected value is defined as . Then
[0045] In order to simplify this integral, a = b , just like a circular area.
mean and variance . Thus SNRRadon in Radon domain may be calculated as
[0048] In practice, for real brain MRI, generally, μ) > σ) . So
[0049] Thus, these calculations may demonstrate that SNRRadon may be at least increased by a factor of . If the size of MR image is 256*256, thus . So
the SNR has been increased by 101og10(218) « 23.4dB . As a result, this method may be robust to additive noise.
[0050] Figures 5(a) and (b) illustrate an example of how the Radon transform may decrease the noise in the original images by illustrate the profiles drawing through MR images and corresponding sinograms, respectively. A first comparison of line profiles 510 is illustrated in Figure 5(a), in which 8% and 16% noise were added to the original MR image. As shown, the image with 16% noise has severe contamination as the details were lost on the noised image. However, as illustrated in a second comparison of profiles 520 in Figure 5(b), the profiles between the corresponding sinograms are close, showing that the Radon transform has decreased the noise in the original images. Before the Radon transform, the SNRs are 28.2dB and 14.4dB for 8% and 16% noised image, respectively. After the Radon transform, the SNRs are 63.8dB and 50.1dB, respectively. Thus, the SNRs are increased by 35.6dB and 35.7dB.
Decomposing Step
[0051] The method may further include step 130 that decomposes the sinogram to a multi- scale sinogram. In some embodiments, the decomposing step 130 may performed by the steps shown in Figure 6. The decomposing method may result in a multiscale sinogram representing a
series of images with different levels of spatial resolution. In the course scale, the general information is extracted and maintained in images, and in the fine scale, images have more local tissue information.
[0052] As shown in Figure 6, the decomposing step 130 may include a receiving step 131 for receiving the image in the Radon domain. Because the image is original, the scale, i, equals 0.
[0053] In some embodiments, the decomposing may be performed by a bilateral filter by a factor of 2. As shown in Figure 6, the decomposing step may further include two filtering steps 132 and 133.
[0054] Bilateral filtering is a non-linear filtering technique. Such technique is further detailed in Tomasi and Manduchi, 1998, Computer Vision, 1998, Sixth International Conference, 839-846, which is incorporated by reference in its entirety. In some embodiments, the filter may be a weighted average of the local neighborhood samples, where the weights are computed based on temporal (or spatial in case on images) and radiometric distance between the center sample and the neighboring samples. The bilateral filtering may smooth the images while preserving edges, by means of a nonlinear combination of nearby image values. Bilateral filtering may be described as follows:
[0056] Where I(x) and h(x) denote input images and output images, respectively. And W measures the geometric closeness between the neighborhood center x and a nearby point ξ and Wffr measures the photometric similarity between the pixel at the neighborhood center x and that of a nearby point ξ . Thus, the similarity function operates in the range of the image function / , while the closeness function operates in the domain of / .
[0057] Figure 7 illustrates an example of a scheme diagram 700 of a bilateral filter. As shown in the Figure 7, the bilateral filter may replace the pixel value at x with an average of similar and nearby pixel values. In smooth regions, pixel values in a small neighborhood may be similar to each other, and the bilateral filter acts essentially as a standard domain filter, averaging away the small, weakly correlated differences between pixel values caused by noise. This scheme is further described in Elad, 2002, Image Processing, IEEE Transactions, 11(10), 1141- 1151, which is incorporated by reference in its entirety.
[0058] The bilateral filtering may be performed by many different kernels. In some embodiments the bilateral filtering may be performed by a Gaussian filtering. The Gaussian filtering may be shift-invariant Gaussian filtering, in which both the spatial function and the range function are Gaussian functions of the Euclidean distance between their arguments.
More specifically, may be described as:
[0060] where is a suitable measure of distance in intensity space.
[0061] In the scalar case, this may be simply the absolute difference of the pixel difference. The Gaussian range filter may also be insensitive to overall additive changes of image intensity. Thus, the range filter may also be shift-invariant.
[0062] As discussed above, Figure 6 illustrates a multiscale bilateral composition. The decomposing method may further include an obtaining step 135 that obtains each image (sinogram) that is filtered. In further embodiments, the method may further include a determination step 135 that determines whether the filtering step should be repeated so as to
build a series of filtered images having different scales as shown in step 136. The filtering step may be repeated until the number of images at the predetermined scale N is obtained.
[0063] In some embodiments, a series of filtered images /'that preserve the strongest edges in / while smoothing small changes in intensity may be obtained based with the following calculations.
[0064] For the calculations, it is assumed that the original image obtained in step 131 is the 0th scale (/' = 0 ), that is, set I° = I. The image is then filtered through a bilateral filter in steps 132 and 133. Application of the bilateral filter may compute the following:
with
where n is a pixel coordinate, Wa(x) = exp(-x2 / σ2) , σχ 1 and σ, , are the widths of the spatial and range Gaussians respectively and A: is an offset relative to wthat runs across the support of the spatial Gaussian. The repeated convolution by WaJ may increase the spatial smoothing at each scale i . At the finest scale, the spatial kernel may be set to .
However, because the bilateral filter is non-linear, the filtered image /'may not be identical to bilaterally filtering the original input image / with a spatial kernel of cumulative width. The range Gaussian is an edge-stopping function.
[0065] In some embodiments, in order to preserve the edge after several iterations of the bilateral decomposition, may be set. Increasing the width of the range Gaussian
at previous iteration may be smoothed away in later iterations. Also, the initial width ar may be set to A 125 , where A is the intensity range of the image.
[0066] Figures 8(a) and 8(b) illustrate an example of three scales 810, 820, and 830 of generating kernel wt and its Fourier transforms wr Dashed lines in Figure 8(a) show the
envelopes of three scales kernel. Dashed lines in Figure 8(b) indicate smoothing condition boundaries
kernels w' have a fixed number 2m +1 , of non-zero coefficients, yet expand in space by the introduction of 2' -1 zeros between these coefficients. The expansion of the w' by inserting zeros leads to the introduction of 2' aliases in #'(<ø) . Thus, the generating kernels themselves do not operate as low-pass filters. However, as long as the following smoothing condition, holds, it will follow that
( ) | | may
be essentially a low-pass filter.
[0068] Figure 9 illustrates a scale-space 910 constructed by bilateral filtering. The scale space 910 is composed of a stack of images filtered at different scales where i=0 is the original image. Figure 9 illustrates six scales (i=6), however, it would be understood that the decomposing step may be performed to any number of scales. The scale number may be selected based on the anatomy selected to be scanned.
[0069] As shown in Figure 9, the multiscale bilateral decomposition technique smoothes the images as the scale / increases. The scale i may be considered as the scale level and the original image is at the level 0. When the scale increases, the images become more blurred and contain more general information. Unlike many multi-resolution techniques where the images are down-sampled along the resolution, it is not necessary to subsample the /' because such downsampling may blur the edges in/'. In addition, downsampling may prevent the decomposition from being translation invariant and could introduce grid artifacts when the coarser scales are manipulated.
[0070] Figure 10 illustrates a comparison of the profiles 1000 in every scale. As shown in Figure 10, when the scale increases, small edges in intra-region are smoothed and the big edges in the inter-region are preserved.
Gradient Filtering
[0071] After the sinogram is decomposed into a multiscale sinogram, the segmentation method 100 may further include a filtering step 140 that filters each sinogram through a predetermined gradient filter, as shown in Figure 1.
[0072] In some embodiments, the images may be filtered through different filters. In some embodiments, the images may be use two sets of filters. In further embodiments, the filters may be selected based on the anatomy scanned. Figures 11(a) and 11(b) show kernels 1110 and 1120, respectively, for two filters utilized for a brain scan.
Morphological Image Processing
[0073] In further embodiments, the method 100 may optionally include a processing step 150 for processing each sinogram with morphological image processing.
Combining Filtered Sinograms through Reconstruction of Sinogram
[0074] In further embodiments, after each sinogram is filtered and processed, the sinograms may be combined in step 160. The combined sinograms may determine a binary sinogram in step 170. In some embodiments, a thresholding method is used to determine the binary sinogram from the combined sinograms. The binary sinogram may then be used to reconstruct the sinogram in step 180. In some embodiments, the reconstruction step 180 may include transforming the sinogram from the Radon Domain to the Image Domain. The transformation may be based on any known calculations. In some embodiments, the reconstruction may be performed using filter back projection or ordered-subset expectation maximization (OSEM) methods.
[0075] Figure 12 is an illustration of multiscale processing 1200 performed in steps 160 through 180 on a brain image to obtain a reconstructed sinogram. The scale increases from up to down. After the filtered images are processed, the upper half of the first filtered mage is combined with the lower half of the second filtered image in order to get a new sinogram as shown in (1) of Figure 10. These images are then used to get a mask in step (2). From the mask obtained in step (2), the mask is inversed to obtain the mask in step (3). After which, the mask
from step (3) may be used to obtain a binary skull in the Radon domain in step (4). The skull then may be reconstructed in step (5) to obtain the segmented skull
[0076] Reconstruction in step 180, may be performed after obtaining the binary sinogram as discussed above. In some embodiments, a threshold may be utilized in the reconstruction to eliminate some artifacts introduced by reconstruction. Reconstruction may be described as:
(18)
[0077] With Qe are the ramp-filtered projections.
[0078] After the reconstruction, in some embodiments, the segmented tissue may be displayed in step 190. In other embodiments, the segmented MR Image with segmented tissue may be forwarded for further processing. In some embodiments, the segmented MR Image may be used as part of the attenuation control of PET images. In further embodiments, the segmented MR Image with segmented tissue may be both displayed and forwarded.
System Implementation
[0079] FIG. 13 shows an example of a known apparatus 1300 for superposed MR and PET imaging. The apparatus 1300 may include any known MRI tube 102. The MRI tube 1304 defines a longitudinal direction z, which extends orthogonally to the plane of the drawing of FIG. 13. Although not shown, the system may contain a scanner including one or more gamma ray detectors (not shown) (e.g., a ring of gamma ray detectors) incorporated into a RF coil assembly (not shown). The one or more gamma ray detectors may be configured to detect gamma rays from positron annihilations and may include a plurality of scintillators and photodetectors arranged circumferentially about a gantry (i.e., a ring of gamma ray detectors or a detector ring).
[0080] As shown in FIG. 13, the system may further include a plurality of PET detection units 1306 arranged in mutually opposing pairs around the longitudinal direction z are arranged coaxially within the MRI tube 1304. The PET detection units 1306 may preferably include a
photodiode array 1310, such an APD photodiode array, with an upstream array of crystals 1308, such as LSO crystals, and an electrical amplifier circuit (AMP) 1306.
[0081] The apparatus may further include a computer system 1320 to carry out the image processing for superposed MR and PET imaging. The computer system 1320 may further be used to control the operation of the system or a separate system may be included.
[0082] The computer system 1320 may include a number of modules that communicate with each other through electrical and/or data connections (not shown). Data connections may be direct wired links or may be fiber optic connections or wireless communications links or the like. The computer system 1320 may also be connected to permanent or back-up memory storage, a network, or may communicate with a separate system control through a link (not shown). The modules may include a CPU 1322, a memory 1324, an image processor 1326, an input device 1328, a display 1330, and a printer interface 1332. The computer system 1320 may also be connected to another computer system as well as a network.
[0083] The CPU 1322 may be one or more of any known central processing unit, including but not limited to a processor, or a microprocessor. The CPU 1322 may be coupled directly or indirectly to memory elements. The memory 1324 may include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combinations thereof). The memory may also include a frame buffer for storing image data arrays.
[0084] The described processes (e.g., Figures 1 and 6) may be implemented as a routine that is stored in memory 1324 and executed by the CPU 1322. As such, the computer system 1320 may be a general purpose computer system that becomes a specific purpose computer system when executing the routine of the disclosure. The computer system 1320 may also include an operating system and micro instruction code. The various processes and functions described herein may either be part of the micro instruction code or part of the application program or routine (or combination thereof) that is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device, a printing device, and I/O devices.
[0085] The image processor 1326 may be one or more of any known central processing unit, including but not limited to a processor, or a microprocessor. In some embodiments, the image processor 1326 also processes the data. In other embodiments, the image processor 1326 may be replaced by image processing functionality on the CPU 1322.
[0086] The input device 1328 may include a mouse, joystick, keyboard, track ball, touch activated screen, light wand, voice control, or any similar or equivalent input device, and may be used for interactive geometry prescription. The input device 1328 may control the production, display of images on the display 1330, and printing of the images by the printer interface 1332. The display 1330 and the printer interface 1332 may be any known display screen and the printer interface 1332 may be any known printer, either locally or network connected.
[0087] An MRI scan is complete when one or more sets of raw k-space data has been acquired in by the image processor 1326. The image processor 1326 reconstructs the raw k- space data by transforming the data raw k-space data (via Fourier transformation or another technique) into image data. This image data may then be stored in the memory 1324. In other embodiments, another computer system may assume the duties of image reconstruction or other functions of the image processor 1326. In response to commands received from the input device 1328, the image data stored in the memory 1324 may be archived in long term storage or may be further processed by the image processor 1326 and presented on the display 1330. PET images may be reconstructed by the image processor 1326 and may be combined with MR images to produce hybrid structural and metabolic or functional images.
[0088] It is to be understood that the embodiments of the disclosure be implemented in various forms of hardware, software, firmware, special purpose processes, or a combination thereof. In one embodiment, the disclosure may be implemented in software as an application program tangible embodied on a computer readable program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. The system and method of the present disclosure may be implemented in the form of a software application running on a computer system, for example, a mainframe, personal computer (PC), handheld computer, server, etc. The software application may be stored on a recording media
locally accessible by the computer system and accessible via a hard wired or wireless connection to a network, for example, a local area network, or the Internet.
[0089] It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures can be implemented in software, the actual connections between the systems components (or the process steps) may differ depending upon the manner in which the disclosure is programmed. Given the teachings of the disclosure provided herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the disclosure.
[0090] While the disclosure has been described in detail with reference to exemplary embodiments, those skilled in the art will appreciate that various modifications and substitutions can be made thereto without departing from the spirit and scope of the disclosure as set forth in the appended claims. For example, elements and/or features of different exemplary embodiments may be combined with each other and/or substituted for each other within the scope of this disclosure and appended claims.
Claims
1. A method, performed by a computer having a memory and a processor, for segmenting an anatomical landmark in digital medical images, comprising:
transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram;
decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale;
combining the plurality of sinograms into a binary sinogram; and
reconstructing the binary sinogram into a reconstructed sinogram.
2. The method according to claim 1 , wherein the reconstructing includes transforming the binary sinogram from the Radon Domain to the Image Domain to obtain a segmented magnetic resonance (MR) Image.
3. The method according to claim 2, further comprising:
displaying the segmented MR Image.
4. The method according to claim 2, further comprising:
using the segmented MR Image for attenuation control of a positron emission
tomography (PET) Image.
5. The method according to claim 1 , wherein the decomposing is performed using a bilateral filter.
6. The method according to claim 1 , wherein the decomposing includes filtering the original sinogram to a scale of six, wherein the plurality of sinograms is six sinograms.
7. The method according to claim 1 , further comprising:
filtering each of the plurality of sinograms with a gradient filter after the decomposing of the original sinogram.
8. The method according to claim 8, wherein the gradient filter is selected based on the anatomical landmark.
9. The method according to claim 1 , wherein the anatomical landmark includes any one of a brain, a lung, or a thorax.
11. A computer-readable storage medium storing instructions for segmenting an anatomical landmark in digital medical images, the instructions comprising:
transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram;
decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale;
combining the plurality of sinograms into a binary sinogram; and
reconstructing the binary sinogram into a reconstructed sinogram.
12. The medium according to claim 11 , wherein the reconstructing includes transforming the binary sinogram from the Radon Domain to the Image Domain to obtain a segmented magnetic resonance (MR) Image.
13. The medium according to claim 12, further comprising:
displaying the segmented MR Image.
14. The medium according to claim 12, further comprising:
using the segmented MR Image for attenuation control of a positron emission
tomography (PET) Image.
15. The medium according to claim 11 , wherein the decomposing is performed using a bilateral filter.
16. The medium according to claim 11 , wherein the filtering includes filtering the original sinogram to a scale of six, wherein the plurality of sinograms is six sinograms.
17. The medium according to claim 11, further comprising:
filtering each of the plurality of sinograms with a gradient filter after the decomposing of the original sinogram.
18. The medium according to claim 17, wherein the gradient filter is selected based on the anatomical landmark.
19. The medium according to claim 11 , wherein the anatomical landmark includes any one of a brain, at least one lung, a thorax, or at least one bone.
20. A system for processing positron emission tomography (PET) and magnetic resonance
(MR) images from a PET/MRI machine, comprising: an apparatus including:
at least one processor; and
at least one memory including computer program code,
wherein the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:
transforming at least one digital image of an anatomical landmark from an Image Domain to a Radon Domain to obtain an original sinogram;
decomposing the original sinogram to obtain a plurality of sinograms, each of the plurality of sinograms being at a different scale;
combining the plurality of sinograms into a binary sinogram; and reconstructing the binary sinogram into a reconstructed sinogram.
22
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/522,646 US8989462B2 (en) | 2010-02-11 | 2011-02-11 | Systems, methods and computer readable storage mediums storing instructions for applying multiscale bilateral filtering to magnetic resonance (RI) images |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US30339210P | 2010-02-11 | 2010-02-11 | |
| US61/303,392 | 2010-02-11 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2011100575A2 true WO2011100575A2 (en) | 2011-08-18 |
| WO2011100575A3 WO2011100575A3 (en) | 2011-11-24 |
Family
ID=44368463
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2011/024565 Ceased WO2011100575A2 (en) | 2010-02-11 | 2011-02-11 | Systems, methods and computer readable storage mediums storing instructions for applying multiscale bilateral filtering to magnetic resonance (mr) images |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US8989462B2 (en) |
| WO (1) | WO2011100575A2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111667492A (en) * | 2020-05-14 | 2020-09-15 | 广东轻工职业技术学院 | Fruit image segmentation method based on radon transform |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10242440B2 (en) * | 2011-09-26 | 2019-03-26 | Siemens Medical Solutions Usa, Inc. | Doseless emission tomography attenuation correction |
| CA2812998A1 (en) * | 2012-05-07 | 2013-11-07 | National Cerebral And Cardiovascular Center | Method of extracting contour of tomogram, and program and apparatus therefor |
| US8942445B2 (en) * | 2012-09-14 | 2015-01-27 | General Electric Company | Method and system for correction of lung density variation in positron emission tomography using magnetic resonance imaging |
| US9715744B2 (en) * | 2014-12-11 | 2017-07-25 | General Electric Company | Method and device of obtaining beam hardening correction coefficient for carrying out beam hardening correction on computed tomography data |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4718010A (en) * | 1984-12-28 | 1988-01-05 | Kabushiki Kaisha Toshiba | CT system for creating image data from high and low energy radiation |
| US5841890A (en) * | 1996-05-06 | 1998-11-24 | Northrop Grumman Corporation | Multi-dimensional wavelet tomography |
| US6263096B1 (en) * | 1999-06-23 | 2001-07-17 | The Board Of Trustees Of The University Of Illinois | Multilevel domain decomposition method for fast reprojection of images |
| US6282257B1 (en) * | 1999-06-23 | 2001-08-28 | The Board Of Trustees Of The University Of Illinois | Fast hierarchical backprojection method for imaging |
| WO2004042546A1 (en) | 2002-11-04 | 2004-05-21 | V-Target Technologies Ltd. | Apparatus and methods for imaging and attenuation correction |
| US7057178B1 (en) * | 2004-11-15 | 2006-06-06 | General Electric Company | Method and system for imaging using a filter for Time-of-Flight PET |
| US7602879B2 (en) * | 2005-11-02 | 2009-10-13 | Wisconsin Alumni Research Foundation | Method for increasing the resolution of a CT image during image reconstruction |
| US20080135769A1 (en) | 2006-11-22 | 2008-06-12 | Rosen Bruce R | Attenuation correction of pet image using image data acquired with an mri system |
-
2011
- 2011-02-11 US US13/522,646 patent/US8989462B2/en active Active
- 2011-02-11 WO PCT/US2011/024565 patent/WO2011100575A2/en not_active Ceased
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111667492A (en) * | 2020-05-14 | 2020-09-15 | 广东轻工职业技术学院 | Fruit image segmentation method based on radon transform |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2011100575A3 (en) | 2011-11-24 |
| US20120294503A1 (en) | 2012-11-22 |
| US8989462B2 (en) | 2015-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11915425B2 (en) | Systems and methods for attenuation correction | |
| CN103732147B (en) | X-ray computed tomography device and image reconstruction method | |
| US20200098152A1 (en) | Systems and methods for correcting mismatch induced by respiratory motion in positron emission tomography image reconstruction | |
| WO2021041772A1 (en) | Dilated convolutional neural network system and method for positron emission tomography (pet) image denoising | |
| CN110717956B (en) | A Finite Angle Projection Superpixel Guided L0 Norm Optimal Reconstruction Method | |
| WO2020151424A1 (en) | Limited-angle ct reconstruction algorithm based on anisotropic total variation | |
| Nguyen et al. | Incorporating anatomical side information into PET reconstruction using nonlocal regularization | |
| Hashemi et al. | Adaptively tuned iterative low dose CT image denoising | |
| CN103679706B (en) | A kind of CT sparse angular method for reconstructing based on image anisotropy rim detection | |
| US8989462B2 (en) | Systems, methods and computer readable storage mediums storing instructions for applying multiscale bilateral filtering to magnetic resonance (RI) images | |
| CN109712213B (en) | PET image reconstruction methods, systems, readable storage media and equipment | |
| Li et al. | Multienergy cone-beam computed tomography reconstruction with a spatial spectral nonlocal means algorithm | |
| CN118229741A (en) | Image processing method and image processing device | |
| Yang et al. | Explicit and implicit representations in AI-based 3D reconstruction for radiology: a systematic review | |
| CN111161182A (en) | A non-local mean-guided partial volume correction method for PET images constrained by MR structure information | |
| Yu et al. | Performance evaluation of edge-directed interpolation methods for noise-free images | |
| CN121147338A (en) | A method and system for ROI image reconstruction based on SPECT data | |
| CN119788790A (en) | Noise reduction processing method and noise reduction processing device | |
| Liao et al. | Noise Estimation for Single‐Slice Sinogram of Low‐Dose X‐Ray Computed Tomography Using Homogenous Patch | |
| CN118736030A (en) | System and method for automatic quality control of image reconstruction | |
| Huo et al. | Removing ring artifacts in CBCT images via smoothing | |
| Tahaei et al. | MR-guided PET image denoising | |
| Niethammer et al. | Outlier rejection for diffusion weighted imaging | |
| Koç et al. | Design and evaluation of an accurate CNR-guided small region iterative restoration-based tumor segmentation scheme for PET using both simulated and real heterogeneous tumors | |
| Gopi et al. | Iterative computed tomography reconstruction from sparse-view data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11742883 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 13522646 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 11742883 Country of ref document: EP Kind code of ref document: A2 |


















