WO2013116709A1 - Computerized image reconstruction method and apparatus - Google Patents

Computerized image reconstruction method and apparatus Download PDF

Info

Publication number
WO2013116709A1
WO2013116709A1 PCT/US2013/024423 US2013024423W WO2013116709A1 WO 2013116709 A1 WO2013116709 A1 WO 2013116709A1 US 2013024423 W US2013024423 W US 2013024423W WO 2013116709 A1 WO2013116709 A1 WO 2013116709A1
Authority
WO
WIPO (PCT)
Prior art keywords
cost function
image
estimated
information
path
Prior art date
Application number
PCT/US2013/024423
Other languages
French (fr)
Other versions
WO2013116709A8 (en
Inventor
Zhengrong Liang
Jianhua Ma
Yan Liu
Original Assignee
The Research Foundation of States University of New York
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Research Foundation of States University of New York filed Critical The Research Foundation of States University of New York
Priority to US14/376,177 priority Critical patent/US9251606B2/en
Publication of WO2013116709A1 publication Critical patent/WO2013116709A1/en
Publication of WO2013116709A8 publication Critical patent/WO2013116709A8/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/003Reconstruction from projections, e.g. tomography
    • G06T11/005Specific pre-processing for tomographic reconstruction, e.g. calibration, source positioning, rebinning, scatter correction, retrospective gating
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/003Reconstruction from projections, e.g. tomography
    • G06T11/006Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/02Devices for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computerised tomographs
    • A61B6/032Transmission computed tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10116X-ray image
    • G06T2207/10124Digitally reconstructed radiograph [DRR]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30096Tumor; Lesion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00Image generation
    • G06T2211/40Computed tomography
    • G06T2211/424Iterative

Definitions

  • the present invention generally relates to computerized image reconstruction and, more particularly, to image reconstruction from projected data along curved paths of proton particles through an object being imaged.
  • Computed tomographic image reconstruction has typically focused on X-rays or photons that pass through the body in a straight line. Any path deviation from an original direction is considered as the path of scattered particles and may be ignored.
  • imaging modalities such as X-ray Computed Tomography (xCT) or simple CT, Single-Photon Emission Computed Tomography (SPECT) and Positron Emission Tomography (PET), provide high energy X-rays or Gamma-rays that travel along a straight line path inside the body.
  • xCT X-ray Computed Tomography
  • SPECT Single-Photon Emission Computed Tomography
  • PET Positron Emission Tomography
  • Proton therapy for cancer treatment has gained more recognition and attracted great interest in the past decade as evidenced by the increased number of proton radiation therapy facilities.
  • a proton loses energy through elastic and inelastic collisions with atomic electrons and nuclei, resulting in a nonlinear path of traversal.
  • This mode of interaction also results in an energy deposition phenomenon known as the Bragg peak in which the proton releases a burst of energy around the end of its trajectory.
  • Conventional proton therapy utilizes X-ray beams to produce the computed tomographic images (i.e., xCT) or the X-ray attenuation map of the body for treatment planning. Because of the difference of X-ray and proton interaction with the body tissues, the xCT attenuation map introduces an uncertainty into proton therapy treatment planning. Since the Bragg peak releases a large amount of energy locally, a minor error on the targeted cancerous volume could cause significant harm to the surrounding normal tissues.
  • the present invention provides an image reconstruction method for curved paths applicable to heavy particles, in addition to particles following straight line paths. Also provided is a method of use of a proton beam for dose calculation and patient anatomy
  • the present invention also provides improved image reconstruction of particle beams, resulting in improved treatment planning schemes and overcomes the above shortcomings, by minimizing the uncertainty from image reconstruction techniques.
  • the present invention further provides more accurate, efficient reconstruction of pCT images for use in proton therapy and other diagnostic and therapeutic applications.
  • An aspect of the present invention provides an image reconstruction method including recording projection path information and energy loss information of a plurality of particles traversing an object being imaged, determining an estimated image of the object, based on the projection path information and the energy loss information sampled into a projection format, wherein the estimated image includes an active volume defined by an enclosure border, performing cost function minimization using one of an Adaptive-weighted Total Variation (AwTV) cost function, a Penalized Weighted Least-Squares (PWLS) cost function, and an Alpha- Divergence (a-D) cost function, to update the estimated image, performing an iterative updating algorithm corresponding to the cost function, to update the estimated image, and producing a final image based on the estimated image, when a difference between the estimated image and a previously estimated image is lower than a predetermined threshold, with the one of the AwTV cost function, the PWLS cost function, and the a-D cost function performed based on the estimated image, the recorded projection path information, the energy loss information and a volume
  • Fig. 1 is a flowchart of image reconstruction by a cost function minimization, according to an embodiment of the present invention
  • Fig. 2 is a flowchart of image reconstruction by Adaptive -weighted Total Variation (AwTV) minimization, according to an embodiment of the present invention
  • Fig. 3 is a flowchart of image reconstruction by Alpha-Divergence (a-D) constrained total variation minimization, according to an embodiment of the present invention
  • Fig. 4 is a flowchart of image reconstruction by Penalized Weighted Least-Squares (PWLS) minimization, according to an embodiment of the present invention
  • Fig. 5 is a flowchart of an image reconstruction method by TV-Stokes minimization, according to an embodiment of the present invention.
  • Fig. 6 is a diagram of a volumetric path, according to an embodiment of the present invention.
  • the image formation principles of proton beams for pCT rely on hardware configuration and data acquisition to reconstruct an image from projected data along proton trajectories through the body.
  • Image formation for pCT relies on the interaction of incident energy with the tissues inside the body. The knowledge of the interaction and the accuracy of measuring the difference of the exit energy from the incident energy determine the quality of the reconstructed image about the body internals.
  • a single-proton-tracking pCT scanner tracks individual protons pre and post patient with two-dimensional (2D) sensitive Silicon Strip Detectors (SSDs), providing projection path information, such as proton position and direction at the boundaries of the image space.
  • 2D two-dimensional
  • This projection path information is relied upon in estimating the image, and includes various data for each of the plurality of particles, including energy information, position information, direction information, orientation information and angle information of the plurality of particles, upon entering and exiting the object, object parameter distribution and interaction quantity information.
  • the position of individual protons is determined by individually recording protons with known incident energy by the four planes of position-sensitive silicon detectors which form the scanner reference system. These four planar detectors provide positions as well as azimuth and declination angles of the protons in front and behind the object.
  • an intermediate image is determined, upon a first iteration, by determining the path integral of relative electron density of a known object, for example a water- equivalent object, i.e., an object of water composition but varying electron density that produces the same energy loss as the real object, is determined.
  • the integral of relative stopping power along each path is calculated, based on the data obtained from the previous iterations.
  • protons When traversing the body, protons lose some of their energy via inelastic collisions with the outer electrons of the tissue atomic components leading to ionizations and excitations. Furthermore, protons are deflected by multiple small-angle scattering from the nuclei of the tissue atomic components, referred to as Multiple Coulomb Scattering (MCS). These two main processes, occurring a great number of times along the macroscopic path length of the protons, lead to the macroscopic effects of the interaction of protons with the tissues inside the body: (1) loss of energy and (2) deflection from their original direction.
  • MCS Multiple Coulomb Scattering
  • the image reconstruction method takes into account that the proton will undergo the MCS process inside the body in a volumetric banana-shaped path to provide interleaved operations of path estimation and image reconstruction.
  • the method begins by recording projection path information and energy loss information of a plurality of particles traversing an object being imaged, in Step 110.
  • An initial image of the object is determined based on the projection path information and energy loss information sampled into a projection sinogram format, in Step 120.
  • measurements are reformed into the projection format producing a sonogram, since measurements of the proton path and energy loss are not recorded in a regular pattern on the detector surface.
  • the measurements are sampled into a sonogram projection format by arranging the measurements by an interpolation method into a regular data array format on a detector surface. Then, an initial image of the object is determined based on the reformed measurements by Filtered Back- Projection (FBP).
  • FBP Filtered Back- Projection
  • the estimated image includes an active volume defined by an enclosure border of the estimated image. Specifically, from the initial image, the border of the image is determined, and from the border, the entry and exit positions of the proton on the border are determined. The determined positions on the border are used to determine the path within the image volume.
  • the cost function is performed based on the estimated image, the recorded projection path information, the energy loss information and a volumetric path determined in Step 130.
  • the cost function minimization is performed in Step 140 using one of an Adaptive- weighted Total Variation (AwTV) cost function, a Penalized Weighted Least- Squares (PWLS) cost function, and an Alpha-Divergence (a-D) cost function, to update the estimated image in Step 150.
  • AwTV Adaptive- weighted Total Variation
  • PWLS Penalized Weighted Least- Squares
  • a-D Alpha-Divergence
  • the image is reconstructed by taking into account that the proton will undergo the MCS process inside the body, in a volumetric path, as illustrated in Fig. 6.
  • the volumetric path is determined from recorded projection path information and energy loss information, within the active volume.
  • the volumetric path comprises an object parameter distribution comprising an all path probability distribution in a banana-shaped volume 601 and a centerline 602 of the banana-shaped volume indicates a Most Likely Path (MLP) of the plurality of particles.
  • MLP Most Likely Path
  • the centerline 602 is initially determined when the object is assumed as a uniform medium, such as water, by the use of the recorded projection path information, the energy of the incident proton and the active volume.
  • a proton has the highest probability traversing through the centerline 602 and lower probabilities of being away from the center.
  • the proton path probability may be described by a Gaussian distribution on a cross section plane, with its standard deviation depending on the medium at that position. Notably, the larger the media difference from the assumed water medium, the larger the standard deviation.
  • the maximum standard deviation is given by a Cubic Spline Path (CSP) estimated by the use of the recorded projection path information, the energy of incident proton, and the active volume. That is, the difference between the MLP (or the centerline 602) and the CSP on the cross section plane gives the maximum standard deviation of the Gaussian distribution at that position.
  • CSP Cubic Spline Path
  • An integration is computed along the above estimated volumetric path through the above estimated object image.
  • the standard deviation of the Gaussian distribution for that position on the cross section plane is determined by the material at that position. If the position is occupied by water or a less dense material such as fat, air, and other materials less dense than water, then the standard deviation is zero. If the position is occupied by bone, which is considered the densest material in the body, then the standard deviation is given by the difference between the MLP and the CSP at that position. For other materials, the standard deviation is between zero and a maximal value of the difference between the MLP and the CSP. If the standard deviation is not zero, then the highest probability is that the proton passes through the centerline 602 and a lower probability is that the proton passes through other nearby locations near the center within volume 601.
  • the estimated image of the object is determined in Step 120, for example, by sampling the recorded projection path information and energy loss information to create a tomographic projection, reconstructing an initial image by applying FBP image reconstruction using the sampled recorded projection path information and energy loss information, identifying the enclosure border of the initial image and designating a volume within the enclosure border as the active volume of the object being imaged.
  • the estimated image is updated in Step 150 in iterations by performing an iterative updating algorithm in Step 180 corresponding to the cost function of Step 140, and a final image is produced based on the updated estimated image when a difference between the estimated image and a previously estimated image is determined to be less than a predetermined threshold in Step 170. For example, when the difference between the images is less than 5%, the iterations stop and the final image is output in Step 190.
  • the iterative updating algorithm for each cost function minimization initially relies on recorded and assumed information, and this information is updated with each iteration. Specifically, an interleaved approach is used, where proton path estimation in Step 160 is interleaved into the iterative process, producing more accurate results.
  • the volumetric path is estimated based on an estimated path within the initial active volume.
  • the expected data for projection path information and energy loss information is calculated using the estimated volumetric path and the estimated image, in Steps 120 and 130, respectively, and the cost function is performed in Step 140 based on the computed expected data to obtain an updated object image in Step 150.
  • the volumetric path is updated in Step 160 before proceeding to a subsequent iteration, in an interleaved approach of path estimation.
  • Step 150 Subsequent iterations provide an updated estimated active volume based on the updated object image resulting in Step 150.
  • the volumetric path is then updated in Step 160, in an interleaved approach, based on the updated volumetric path and the updated object image of previous iterations.
  • the cost function minimization in Step 140 is performed based on updated data, resulting in an updated object image. That is, the cost function is minimized based on updated data, such as the updated active volume, updated volumetric path and updated object image.
  • the iterations stop when reaching a threshold in Step 170, for example when a difference between a previous estimated object image and the updated estimated object image is greater than a predetermined threshold, for example less than a difference of 5%.
  • an object to be imaged is represented by a three-dimensional (3D) grid of image elements or voxels.
  • 3D three-dimensional
  • an interleaved approach of iterative image reconstruction at the beginning or zero iteration, the image at a certain position of the image voxel in the 3D space, is estimated assuming a uniform media at that voxel.
  • an MLP algorithm is used to perform the projection operation estimating the proton path and providing the expected value of the proton.
  • the difference between the expected value of the proton and the measured value of the proton at a voxel position is then used to update the image.
  • the medium is determined not to be uniform, and thus the MLP estimation is not a valid estimation of the proton path.
  • a more accurate estimation is determined by simulating the proton path in a non-uniform medium, for example through Monte Carlo simulation. Through this simulation, the difference between the simulated value of the proton and the measured value of the proton at a certain position is then used to update the image estimation at next iteration.
  • Step 180 iterative updating algorithms can be employed in Step 180 to iteratively calculate the solutions to the cost functions in Step 140, including the iterative updating algorithms implemented by a projection onto a Plurality Of Convex Sets (POCS) algorithm for minimizing the AwTV cost function, illustrated Fig. 2, a aD-TV minimizing algorithm for minimizing the a- D cost function, illustrated in Fig. 3 and a Gauss-Seidel (GS) updating algorithm for minimizing the PWLS cost function, as illustrated in Fig. 4.
  • POCS Plurality Of Convex Sets
  • GS Gauss-Seidel
  • an imaging reconstruction model minimizes an AwTV cost function, in Step 240, represented by Equation (1):
  • Equation (2) The AwTV cost function in Equation (1) is subject to an error tolerance condition represented by Equation (2):
  • Equations (1) and (2) ⁇ is a vector of the relative electron density distribution (relative to water) within the object to be imaged, p is the recorded energy loss information, and ⁇ is an error tolerance data fidelity constraint determined by a noise level of measurements p, H is an integration operator for computing an expected projection path and energy-loss information, and H77 is an expected value of a recorded value p expressed as an integral of energy loss along the estimated path through the estimated object image within the estimated active volume at the n-th iteration.
  • Equation (3) The AwTV cost function is determined by a set of equations, represented as Equation (3):
  • Equation (3) ⁇ represents a vector of the relative electron density distribution within the object to be reconstructed, f] ⁇ is a maximum value of the object image and ⁇ is a minimum value of the object image, (i, j) represents a position inside the object in 2D representation. Similarly, ( , j, k) can be used to represent a position inside the object in 3D representation.
  • the image reconstruction model with AwTV minimization is illustrated in Fig. 2 can be applied for sparse data, toward Low-Dose X-ray Computed Tomography (LD-xCT) image reconstruction to mitigate the over-smoothing of edges.
  • LD-xCT Low-Dose X-ray Computed Tomography
  • the AwTV model is described with reference to Equation (4) as applied to LD-xCT, rewritten from Equations (1) and (2) as follows: (4)
  • the AwTV of the to-be-reconstructed image i.e., I ⁇ IL ⁇ , is defined by a set of equations,
  • denotes, for xCT application, the vector of attenuation coefficients of the object with ⁇ M.
  • M wherein the object is discretized on a 3D grid of M image elements or voxels, s and t are the 2D indices of the location of the attenuation coefficients, p represents the linearized or log-transformed projection data,
  • A is the system matrix which depends on the projection geometry, and its elements are usually modeled as the intersecting lengths of a ray path with the associated voxels on the path.
  • the operator A is similar to H for pCT where H is along a curved path and A is along a straght line.
  • Equation (4) allows for full consideration of the gradient of the desired image and also includes the change of local voxel intensity. Specifically, for a smaller change of voxel intensity, a higher weight will be given, whereas for a larger change of voxel intensity, a weaker weight will be given.
  • the intra-region smoothing is encouraged in reference to inter-region smoothing.
  • the image reconstruction algoritm begins by initializng parameters in Step 210 and estimating an image of the object in Step 220.
  • Step 210 the algorithm parameters ⁇ , ⁇ , ⁇ and ⁇ are initialized before the iteration begins.
  • the error tolerance ⁇ is initialized based on the noise level of the data.
  • the selection of the initial value of ⁇ for the weighted factor in the AwTV depends on the intensity range of the image.
  • the parameter ⁇ of the weight w s s in the AwTV model plays an important role for the AwTV-POCS algorithm due to its effect on the image resolution and noise tradeoff.
  • the initial value of co and ⁇ may be set as 1 and 0.7 x lO 5 , respectively. Then these initial values may be updated in the iterative process, as shown in Table 1.
  • Step 220 the image is estimated, for example by assuming a uniform medium, represented by setting the initial estimate of the image voxel value to 1.
  • the iterative method in the implementation of the AwTV-POCS algorithm provides an optimization solution in two distinct operations in Steps 230 and 240.
  • Step 230 an initially estimated image from Step 220, is updated iteratively by a POCS strategy.
  • a Simultaneous Algebraic Reconstruction Technique (SART) is used to reconstruct an image from sparse-sampled sinogram data to yield an intermediate estimated image.
  • Step 240 the intermediate estimated image is further updated by adopting a gradient descent technique to minimize the AwTV of the intermediate estimated image.
  • the first-order derivative of the AwTV term with respect to each voxel value is calculated.
  • Step 240 due to the nonlinear form of the AwTV with respect to the image intensity, it is numerically difficult to utilize directly the second-order derivative for the purpose of effectively minimizing the objective function represented by Equation (5).
  • the gradient descent technique is adapted to minimize the AwTV of the SA T-estimated intermediate image where only the first- order derivative of the AwTV term respect to each voxel value is needed, which can be approximately expressed as a set of equations in Equation (6):
  • Equation (6) is a relax parameter introduced to avoid the denominator going to zero.
  • Step 250 the algorithm parameters are updated iteratively.
  • Step 260 the condition criteria is checked and when satisfied, the final image is produced in Step 270. If the stop condition is not satisfied in Step 260, Steps 230 through 250 are performed in the next iteration.
  • the stop condition can include a threshold value, for example as described in reference to Step 170 in Fig. 1.
  • the stop condition may also include a predetermined number of general iterations to ensure convergence. Additionally, the stop condition may include a combination of parameters and conditions.
  • each of the / general iteration steps includes performiong Step 230 J number of times, i.e., J steps of POCS iterations and K steps of gradient descent iterations in Step 240.
  • the relax parameter ⁇ 3 ⁇ 4 in the POCS is decreased and the step-size for the following gradient descend of AwTV is also minimized automatically in the iteration processes.
  • a value of 0.995 is used to update parameters ⁇ and ⁇ in lines 20 and 24, to ensure that these two parameters decrease smoothly.
  • Each outer loop (lines 3-22) is performed by two iteration parts, i.e., the POCS (lines 4- 12) in Step 230, and the gradient descent for the AwTV minimization (lines 16-17) in Step 240.
  • the AwTV minimization (lines 16-17) in Step 240 is updated iteratively by the gradient descend procedure. Because the parameter ⁇ controls the step-size of the POCS (lines 4-12) in Step 230, this algorithm is steepest-descent and based on the values of dp and ⁇ 8 ⁇ , the adjustable relax parameter o is updated at line 20.
  • the AwTV-POCS algorithm described above mitigates overs-moothness on the edges of a resulting image, in a piecewise-smoothed computed tomography (xCT or pCT) image, reconstructed from sparse-sampled data without introducing noticeable artifacts.
  • the AwTV- POCS model considers the anisotropic properties among neighboring voxels in an image.
  • the associated weights in AwTV-POCS are expressed as an exponential function, which can be adaptively adjusted with the local image-intensity gradient to preserve edge details.
  • the associated weights in the AwTV model are expressed as an exponential function, which can be adaptively adjusted with the local image-intensity gradient for preservation of edge details.
  • the AwTV-POCS optimization scheme minimizes the AwTV of the to-be- estimated image subject to data conditions and other constrains for the concerned low-dose xCT and pCT image reconstruction issue and yields images with noticeable gains.
  • is the relative electron density distribution for pCT
  • H is the integration operator along the curved proton path inside the object
  • is a smoothing parameter which controls a degree of agreement between the estimated and the recorded projection data information
  • Q(rj) is a penalty term determined by the AwTV cost function.
  • Equation (8) The methodology for Alpha-Divergence ( -D) Constrained Total Variation (TV) minimization as applied for low-dose Computed Tomography (LD-xCT) image reconstruction, is as follows.
  • Equation (8) the subscript BV R N ) denotes the space of functions with bounded total variation in R N , and ⁇ > 0 is the global penalty parameter.
  • a cost function consists of two components, a fidelity term and a priori information term.
  • the data fidelity term models the statistics of the measured data.
  • the priori information term regularizes the data fidelity for an optimal solution or image reconstruction.
  • Equation (9) The data fidelity term in Equation (8), constructed by alpha-divergence measure, is provided by Equation (9):
  • Equation (10) div(») represents the divergence operator and ⁇ denotes the dual variable of TV minimization.
  • the image reconstruction algoritm begins by initializng parameters in Step 310 and estimating an image of the object in Step 320, similar to Steps 210 and 220 in Fig. 2.
  • the initial algorithm parameters are initialized before the iteration begins.
  • the initial values of ⁇ and ⁇ may be set to 1 and ⁇ to 0.7 x lO , and error tolerance ⁇ is initialized based on the noise level of the data.
  • Steps 330 and 340 the following nested two step optimized scheme is performed, to minimize the aD-TV cost function, re resented by the set of equations in Equation ( 1 1):
  • Step 330 i.e. , the first AD step
  • the iterative form is similar to that of a Maximum Likelihood Expectation-Maximization (ML-EM) algorithm.
  • ML-EM Maximum Likelihood Expectation-Maximization
  • Step 340 the second TV step, a projection gradient descent algorithm is adopted to optimize the dual variable ⁇ , similar to Equation (10). Given an initial dual variable co , the following update is derived, to achieve an optimal dual parameter ⁇ ⁇ [ n Equation (12) :
  • time step t adaptively estimated based on a non-monotone Chambolle projection algorithm for TV image restoration.
  • Steps 350-370 in Fig. 3 are similar to Steps 250-270 in Fig. 2. That is, in Step 350, the algorithm parameter ⁇ is updated iteratively in a smooth fashion, i.e., decreasing slowly. In Step 360, the condition criteria is checked and when satisfied, the final image is produced in Step 370.
  • step 7 else go to step 7;
  • the aD-TV model for image reconstruction more reasonably measures, by the data fidelity term, the discrepancy between the measured data and the estimated data in the cost function, via the a-divergence.
  • the AwTV penalty as an edge -preserving prior, is adapted to regularize the solution, i.e., an aD-AwTV approach.
  • the aD-TV / aD-AwTV minimizing algorithms described above perform better in lowering the noise-induced artifacts, while preserving the image edge and accelerating the algorithm convergence speed.
  • Equation (13) An imaging reconstruction model minimizing a PWLS cost function, according to an embodiment of the present invention, is represented by Equation (13):
  • ⁇ ) (p - ⁇ ) + ⁇ Q( ) , (13) with H77 being an expectation of the measured proton energy loss p, ⁇ is a smoothing parameter which controls a degree of agreement between the estimated and the recorded projection path information, and ⁇ is a diagonal matrix with a diagonal value being a corresponding variance of a data element of p and Q ⁇ j ) is a penalty term determined by the AwTV cost function.
  • the PWLS-AwTV algorithm method considers the data statistical properties of minimizing data constraints in image reconstruction and is especially advantageous in cases where the data sparsity is not severe and the noise level is relatively high, for example in proton CT where the number of protons is limited while travesing the whole object and low-mAs acquisition for low-dose X-ray CT imaging.
  • the image reconstruction algorithm begins by determining an estimated image in Step 410 and determining initial weights from AwTV in Step 420 by Equation (5) above. Because incident proton orientation will deviate in three dimensions, a cone-beam Feldkamp- Davis-Kress (FDK) algoritm method, which is extended from the FBP method, can be used for imaging a system in cone-beam geometry.
  • FDK Feldkamp- Davis-Kress
  • each voxel of the image is updated iteratively by applying the PWLS algorithm described below.
  • the weights of the PWLS algorithm are iteratively updated as well.
  • Step 450 similar to the condition steps in the figures described above, the stop condition is checked and when satisfied, the final image is produced in Step 460.
  • Equation 15 a formula of the mean-variance relationship in CT projection domain by considering the effect of the Gaussian distributed electronic background noise at different mAs levels represented by Equation (15):
  • I i0 is the mean number of incident photons along projection path i
  • p i denotes the log-transformed ideal projection datum along path i and is usually called the line integral of the attenuation coefficients along the projection ray
  • a e 2 i is the variance of the electronic noise associated with the measurement on p ⁇ , and represents the estimated variance of measuring projection datum p t .
  • Equation (16) p is the acquired projection data and A represents the system transfer matrix, which depends on the projection geometry, and its elements of a i . can be calculated as the length of the intersection of projection ray i with voxel j, ⁇ is the vector of ideal attenuation coefficients to be reconstructed.
  • the first term on the right hand side is the data fidelity term described as a weighted least-squares (WLS) measurement wherein the matrix ⁇ is a diagonal matrix and its i-th element denotes the variance of the projection datum at detector i.
  • WLS weighted least-squares
  • Equation (17) s and t are the 2D indices of the location of the attenuation coefficients along in-plane domain (slice), z is the indices of the attenuation coefficients along axial direction, ⁇ in the weights is a scale factor which controls the strength of the diffusion during each iteration.
  • Step 1 Minimize first term (p - ⁇ ) ⁇ ⁇ ⁇ ⁇ - ⁇ ) by ⁇ 7
  • argmax j/i /
  • the PWLS strategy employing the PWLS-AwTV algorithm as described above, mitigates the noise effect and produces a higher quality image.
  • the PWLS strategy can be implemented by using the PWLS-AwTV algorithm and is especially advantageous in cases of sufficient angular sampling and low-dose on respective views.
  • An imaging reconstruction model minimizes an AwTV cost function, expanded to a TV-Stroke cost function represented by Equatio
  • V is a vector differential operator, is a transpose operator, and V 1 is an orthogonal vector differential operator, wherein V satisfies an irrotationality condition, v 1 satisfies an incompressibility condition, ⁇ is the relative electron density distribution for pCT, / is a function of ⁇ , n is a normal vector, and ⁇ is a tangential vector.
  • V being a vector differential operator
  • T representing the transpose operator
  • V 1 being an orthogonal vector differential operator
  • Total Variation Stokes (TVS) strategy requires the desired image satisfy the incompressibility condition in the tangential vector field and data fidelity.
  • the desired image is reconstructed by the fo Ho wing optimization problem, represented by Equation (21):
  • Equation (21) p is the projection data, Ais the transfer matrix or system matrix, which is related to the projection geometry of the CT scanner, ⁇ is the error tolerance between the projection data and the projections of the to-be-estimated image.
  • Equation (21) is solved with multiple variables by decomposing the objective function to two sub-optimization problems, as described with reference to Fig. 5.
  • the initial parameters are determined in Step 510 and an initial image is estimated in Step 520.
  • Step 540 the normal vector is estimated with incompressibility constraints, in the Tangent Field Smoothing (TFS) operation.
  • TFS Tangent Field Smoothing
  • Step 550 the desired image is reconstructed by fitting it to the estimated normal field with constraints from data fidelity, obtained by solving the following minimization Equation (23): ⁇ ⁇
  • 2 ⁇ ⁇ is solved by performing the POCS strategy described above.
  • Step 570 the desired image can be obtained in Step 570, by executing Steps 540 and 550 iteratively until a stop condition is satisfied in Step 560.
  • TFS Tangent Field Smoothing
  • the image reconstruction operation in Step 550 is provided by Equations (30)-(33). Specifically, after tangential vector ⁇ * is smoothed in Step 540, of the above TFS algorithm by solving Equations (28) and (29), the optimized normal vector n * can be found, which will be used to reconstruct the low-dose CT image by fitting the normal vector of the desired image with the optimized normal vector n * with constraints from the fidelity of the acquired projection data as described in Equation (23).
  • these two terms require integration in different domains, the image domain and the projection domain. Thus, due to the difficulty of solving this problem simultaneously, by using the simple AL method below, these two terms are solved separately.
  • Equation 1 The first term is solved by using Euler-Lagrange (EL) method, represented by Equation
  • Equation (33) The fidelity term is solved by performing the POCS algorithm in Step 530, represented by Equation (33):
  • Equation (23) the desired image solution of Equation (23) can be obtained iteratively by using Equations (32) and (33).
  • the updating function for Step 2 uses the PCOS algorithm in Step 530, as described above.
  • the TV-Stokes strategies for CT image reconstruction in the AwTV-POCS algorithm are described in the pseudo code in Table 5. Table 5

Abstract

Provided herein is a computerized image reconstruction apparatus and method that includes recording projection path information and energy loss information of a plurality of particles traversing an object being imaged and determining an estimated image of the object based on the projection path information and the energy loss information sampled into a projection format. The estimated image includes an active volume defined by an enclosure border. Cost function minimization uses an Adaptive-weighted Total Variation cost function, a Penalized Weighted Least-Squares cost function, or an Alpha-Divergence cost function to update the estimated image. An iterative updating algorithm corresponding to the cost function updates the estimated image and produces a final image based on the estimated image according to a predetermined threshold.

Description

COMPUTERIZED IMAGE RECONSTRUCTION METHOD AND APPARATUS
PRIORITY
This application claims priority to U.S. Provisional Application No. 61/593,634, filed with the U.S. Patent and Trademark Office on February I, 2012, the entire content of which is incorporated herein by reference.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention generally relates to computerized image reconstruction and, more particularly, to image reconstruction from projected data along curved paths of proton particles through an object being imaged.
2. Description of the Related Art
Computed tomographic image reconstruction has typically focused on X-rays or photons that pass through the body in a straight line. Any path deviation from an original direction is considered as the path of scattered particles and may be ignored. Such imaging modalities, such as X-ray Computed Tomography (xCT) or simple CT, Single-Photon Emission Computed Tomography (SPECT) and Positron Emission Tomography (PET), provide high energy X-rays or Gamma-rays that travel along a straight line path inside the body. The various image reconstruction methodologies and algorithms developed and applied to these imaging modalites generate satisfactory image quality for diagnosis and other medical applications.
However, travel paths of heavy particles, such as proton, muon, neutron, carbon, alpha particle, do not follow a straight line within the body, and present image reconstruction difficulties for proton Computed Tomography (pCT).
Clinical applications of pCT and proton beam treatments in medicine provide improved radiation therapy due to the distinct advantages of proton beams compared to other radiation therapy options, such as X-rays, electron beams. Proton beams deliver radiation energy in a precise manner and leave normal tissues around targeted diseased tissue, such as a tumor, mostly unharmed or undamaged. Thus, there is a growing demand for efficient, low-cost and more accurate proton beam radiation therapy, which has sparked great scientific interest in the development of image reconstruction from projected data along proton paths that may not necessarily be straight lines through the object to be imaged.
Proton therapy for cancer treatment has gained more recognition and attracted great interest in the past decade as evidenced by the increased number of proton radiation therapy facilities. Different from an X-ray beam, which losses intensity by photon absorption and scatter along the entire beam path of a straight line/strip, a proton loses energy through elastic and inelastic collisions with atomic electrons and nuclei, resulting in a nonlinear path of traversal. This mode of interaction also results in an energy deposition phenomenon known as the Bragg peak in which the proton releases a burst of energy around the end of its trajectory. By this property, protons have the potential to deliver a desired radiation dose to a targeted cancerous volume with minimal harm to the normal tissues.
However, existing proton treatments have several problems associated with radiation dose calculations due to varied positioning of patient anatomy, and are currently performed based on X-ray computed tomography or xCT, with the patient positioned with the help of X-ray radiographs, hence direct visualization of the three-dimensional (3D) patient anatomy in the treatment room is presently impossible, limiting the accuracy of proton therapy. Further, conventional practices for estimating the proton path rely on single line-type curve estimations and fail to consider proton deflection and scattering within the body.
Conventional proton therapy utilizes X-ray beams to produce the computed tomographic images (i.e., xCT) or the X-ray attenuation map of the body for treatment planning. Because of the difference of X-ray and proton interaction with the body tissues, the xCT attenuation map introduces an uncertainty into proton therapy treatment planning. Since the Bragg peak releases a large amount of energy locally, a minor error on the targeted cancerous volume could cause significant harm to the surrounding normal tissues.
Thus, the accuracy of xCT for proton treatment planning is limited due to the difference in physical interactions between X-ray photons and particle protons, which partially obviates the advantage of proton therapy. Further, conventional methods do not accurately modify xCT in the treatment room based on patient position. Thus, there is a need for more accurate image reconstruction of proton beams to provide improved proton dose distributions and verification of the patient position on the treatment table, and to develop accurate 3D imaging techniques. SUMMARY OF THE INVENTION
Accordingly, the present invention provides an image reconstruction method for curved paths applicable to heavy particles, in addition to particles following straight line paths. Also provided is a method of use of a proton beam for dose calculation and patient anatomy
positioning that provides improved convenience, cost effectiveness and achieves more precise patient treatment.
The present invention also provides improved image reconstruction of particle beams, resulting in improved treatment planning schemes and overcomes the above shortcomings, by minimizing the uncertainty from image reconstruction techniques. The present invention further provides more accurate, efficient reconstruction of pCT images for use in proton therapy and other diagnostic and therapeutic applications.
An aspect of the present invention provides an image reconstruction method including recording projection path information and energy loss information of a plurality of particles traversing an object being imaged, determining an estimated image of the object, based on the projection path information and the energy loss information sampled into a projection format, wherein the estimated image includes an active volume defined by an enclosure border, performing cost function minimization using one of an Adaptive-weighted Total Variation (AwTV) cost function, a Penalized Weighted Least-Squares (PWLS) cost function, and an Alpha- Divergence (a-D) cost function, to update the estimated image, performing an iterative updating algorithm corresponding to the cost function, to update the estimated image, and producing a final image based on the estimated image, when a difference between the estimated image and a previously estimated image is lower than a predetermined threshold, with the one of the AwTV cost function, the PWLS cost function, and the a-D cost function performed based on the estimated image, the recorded projection path information, the energy loss information and a volumetric path. BRIEF DESCRIPTION OF THE DRAWINGS
The above and other aspects, features and advantages of certain embodiments of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
Fig. 1 is a flowchart of image reconstruction by a cost function minimization, according to an embodiment of the present invention;
Fig. 2 is a flowchart of image reconstruction by Adaptive -weighted Total Variation (AwTV) minimization, according to an embodiment of the present invention;
Fig. 3 is a flowchart of image reconstruction by Alpha-Divergence (a-D) constrained total variation minimization, according to an embodiment of the present invention;
Fig. 4 is a flowchart of image reconstruction by Penalized Weighted Least-Squares (PWLS) minimization, according to an embodiment of the present invention;
Fig. 5 is a flowchart of an image reconstruction method by TV-Stokes minimization, according to an embodiment of the present invention; and
Fig. 6 is a diagram of a volumetric path, according to an embodiment of the present invention.
DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION
The following detailed description of various embodiments of the present invention will be made in reference to the accompanying drawings. In describing the present invention, explanation about related functions or constructions known in the art are omitted to avoid obscuring the present invention with unnecessary detail.
The image formation principles of proton beams for pCT rely on hardware configuration and data acquisition to reconstruct an image from projected data along proton trajectories through the body. Image formation for pCT relies on the interaction of incident energy with the tissues inside the body. The knowledge of the interaction and the accuracy of measuring the difference of the exit energy from the incident energy determine the quality of the reconstructed image about the body internals. A single-proton-tracking pCT scanner tracks individual protons pre and post patient with two-dimensional (2D) sensitive Silicon Strip Detectors (SSDs), providing projection path information, such as proton position and direction at the boundaries of the image space. This projection path information is relied upon in estimating the image, and includes various data for each of the plurality of particles, including energy information, position information, direction information, orientation information and angle information of the plurality of particles, upon entering and exiting the object, object parameter distribution and interaction quantity information. The position of individual protons is determined by individually recording protons with known incident energy by the four planes of position-sensitive silicon detectors which form the scanner reference system. These four planar detectors provide positions as well as azimuth and declination angles of the protons in front and behind the object. US Patent Publication No. 2011/0220794 Al to Censor et al.
In addition to tracking the position of individual protons, the energy lost by each proton after traversal of the image space is recorded. Using these measurements, an intermediate image is determined, upon a first iteration, by determining the path integral of relative electron density of a known object, for example a water- equivalent object, i.e., an object of water composition but varying electron density that produces the same energy loss as the real object, is determined. Upon subsequent iterations, the integral of relative stopping power along each path is calculated, based on the data obtained from the previous iterations.
When traversing the body, protons lose some of their energy via inelastic collisions with the outer electrons of the tissue atomic components leading to ionizations and excitations. Furthermore, protons are deflected by multiple small-angle scattering from the nuclei of the tissue atomic components, referred to as Multiple Coulomb Scattering (MCS). These two main processes, occurring a great number of times along the macroscopic path length of the protons, lead to the macroscopic effects of the interaction of protons with the tissues inside the body: (1) loss of energy and (2) deflection from their original direction. As individual interaction events occur randomly, these two processes result in a statistical distribution of the following two principal quantities observed for proton imaging: (1) the amount of energy lost by each proton after traversing the body, and (2) the lateral and angular displacements of the proton from its incident position and direction. According to an aspect of the present invention, the image reconstruction method takes into account that the proton will undergo the MCS process inside the body in a volumetric banana-shaped path to provide interleaved operations of path estimation and image reconstruction.
Referring to Fig. 1, the method begins by recording projection path information and energy loss information of a plurality of particles traversing an object being imaged, in Step 110. An initial image of the object is determined based on the projection path information and energy loss information sampled into a projection sinogram format, in Step 120.
Specifically, measurements are reformed into the projection format producing a sonogram, since measurements of the proton path and energy loss are not recorded in a regular pattern on the detector surface. Thus, the measurements are sampled into a sonogram projection format by arranging the measurements by an interpolation method into a regular data array format on a detector surface. Then, an initial image of the object is determined based on the reformed measurements by Filtered Back- Projection (FBP).
The estimated image includes an active volume defined by an enclosure border of the estimated image. Specifically, from the initial image, the border of the image is determined, and from the border, the entry and exit positions of the proton on the border are determined. The determined positions on the border are used to determine the path within the image volume.
The cost function is performed based on the estimated image, the recorded projection path information, the energy loss information and a volumetric path determined in Step 130.
The cost function minimization is performed in Step 140 using one of an Adaptive- weighted Total Variation (AwTV) cost function, a Penalized Weighted Least- Squares (PWLS) cost function, and an Alpha-Divergence (a-D) cost function, to update the estimated image in Step 150.
According to an embodiment of the present invention, the image is reconstructed by taking into account that the proton will undergo the MCS process inside the body, in a volumetric path, as illustrated in Fig. 6. The volumetric path is determined from recorded projection path information and energy loss information, within the active volume.
The volumetric path comprises an object parameter distribution comprising an all path probability distribution in a banana-shaped volume 601 and a centerline 602 of the banana-shaped volume indicates a Most Likely Path (MLP) of the plurality of particles. As illustrated in FIG. 6, the centerline 602 is initially determined when the object is assumed as a uniform medium, such as water, by the use of the recorded projection path information, the energy of the incident proton and the active volume.
A proton has the highest probability traversing through the centerline 602 and lower probabilities of being away from the center. The proton path probability may be described by a Gaussian distribution on a cross section plane, with its standard deviation depending on the medium at that position. Notably, the larger the media difference from the assumed water medium, the larger the standard deviation.
The maximum standard deviation is given by a Cubic Spline Path (CSP) estimated by the use of the recorded projection path information, the energy of incident proton, and the active volume. That is, the difference between the MLP (or the centerline 602) and the CSP on the cross section plane gives the maximum standard deviation of the Gaussian distribution at that position.
An integration is computed along the above estimated volumetric path through the above estimated object image. During integration at a position on the centerline 602, the standard deviation of the Gaussian distribution for that position on the cross section plane is determined by the material at that position. If the position is occupied by water or a less dense material such as fat, air, and other materials less dense than water, then the standard deviation is zero. If the position is occupied by bone, which is considered the densest material in the body, then the standard deviation is given by the difference between the MLP and the CSP at that position. For other materials, the standard deviation is between zero and a maximal value of the difference between the MLP and the CSP. If the standard deviation is not zero, then the highest probability is that the proton passes through the centerline 602 and a lower probability is that the proton passes through other nearby locations near the center within volume 601.
Returning to FIG. 1, the estimated image of the object is determined in Step 120, for example, by sampling the recorded projection path information and energy loss information to create a tomographic projection, reconstructing an initial image by applying FBP image reconstruction using the sampled recorded projection path information and energy loss information, identifying the enclosure border of the initial image and designating a volume within the enclosure border as the active volume of the object being imaged.
The estimated image is updated in Step 150 in iterations by performing an iterative updating algorithm in Step 180 corresponding to the cost function of Step 140, and a final image is produced based on the updated estimated image when a difference between the estimated image and a previously estimated image is determined to be less than a predetermined threshold in Step 170. For example, when the difference between the images is less than 5%, the iterations stop and the final image is output in Step 190.
As discussed above, the iterative updating algorithm for each cost function minimization initially relies on recorded and assumed information, and this information is updated with each iteration. Specifically, an interleaved approach is used, where proton path estimation in Step 160 is interleaved into the iterative process, producing more accurate results.
Upon a first iteration, the volumetric path is estimated based on an estimated path within the initial active volume. The expected data for projection path information and energy loss information is calculated using the estimated volumetric path and the estimated image, in Steps 120 and 130, respectively, and the cost function is performed in Step 140 based on the computed expected data to obtain an updated object image in Step 150. The volumetric path is updated in Step 160 before proceeding to a subsequent iteration, in an interleaved approach of path estimation.
Subsequent iterations provide an updated estimated active volume based on the updated object image resulting in Step 150. The volumetric path is then updated in Step 160, in an interleaved approach, based on the updated volumetric path and the updated object image of previous iterations. The cost function minimization in Step 140 is performed based on updated data, resulting in an updated object image. That is, the cost function is minimized based on updated data, such as the updated active volume, updated volumetric path and updated object image.
The iterations stop when reaching a threshold in Step 170, for example when a difference between a previous estimated object image and the updated estimated object image is greater than a predetermined threshold, for example less than a difference of 5%.
More specifically, an object to be imaged is represented by a three-dimensional (3D) grid of image elements or voxels. In an interleaved approach of iterative image reconstruction, at the beginning or zero iteration, the image at a certain position of the image voxel in the 3D space, is estimated assuming a uniform media at that voxel. Thus, an MLP algorithm is used to perform the projection operation estimating the proton path and providing the expected value of the proton. In subsequent iterations, the difference between the expected value of the proton and the measured value of the proton at a voxel position is then used to update the image. However, after the initial iteration, the medium is determined not to be uniform, and thus the MLP estimation is not a valid estimation of the proton path. A more accurate estimation is determined by simulating the proton path in a non-uniform medium, for example through Monte Carlo simulation. Through this simulation, the difference between the simulated value of the proton and the measured value of the proton at a certain position is then used to update the image estimation at next iteration.
Several iterative updating algorithms can be employed in Step 180 to iteratively calculate the solutions to the cost functions in Step 140, including the iterative updating algorithms implemented by a projection onto a Plurality Of Convex Sets (POCS) algorithm for minimizing the AwTV cost function, illustrated Fig. 2, a aD-TV minimizing algorithm for minimizing the a- D cost function, illustrated in Fig. 3 and a Gauss-Seidel (GS) updating algorithm for minimizing the PWLS cost function, as illustrated in Fig. 4.
Referring to Fig. 2, an imaging reconstruction model, according to an embodiment of the present invention, minimizes an AwTV cost function, in Step 240, represented by Equation (1):
mm
μ≥0 1 \AWTV (1)
The AwTV cost function in Equation (1) is subject to an error tolerance condition represented by Equation (2):
Figure imgf000011_0001
In Equations (1) and (2), η is a vector of the relative electron density distribution (relative to water) within the object to be imaged, p is the recorded energy loss information, and ε is an error tolerance data fidelity constraint determined by a noise level of measurements p, H is an integration operator for computing an expected projection path and energy-loss information, and H77 is an expected value of a recorded value p expressed as an integral of energy loss along the estimated path through the estimated object image within the estimated active volume at the n-th iteration.
The AwTV cost function is determined by a set of equations, represented as Equation (3):
Figure imgf000011_0002
Figure imgf000012_0001
In Equation (3), η represents a vector of the relative electron density distribution within the object to be reconstructed, f]^ is a maximum value of the object image and ^ is a minimum value of the object image, (i, j) represents a position inside the object in 2D representation. Similarly, ( , j, k) can be used to represent a position inside the object in 3D representation.
The image reconstruction model with AwTV minimization is illustrated in Fig. 2 can be applied for sparse data, toward Low-Dose X-ray Computed Tomography (LD-xCT) image reconstruction to mitigate the over-smoothing of edges. The AwTV model is described with reference to Equation (4) as applied to LD-xCT, rewritten from Equations (1) and (2) as follows:
Figure imgf000012_0002
(4)
The AwTV of the to-be-reconstructed image, i.e., I^IL^ , is defined by a set of equations,
Figure imgf000012_0003
In Equations (4) and (5), μ denotes, for xCT application, the vector of attenuation coefficients of the object with μ≡M.M , wherein the object is discretized on a 3D grid of M image elements or voxels, s and t are the 2D indices of the location of the attenuation coefficients, p represents the linearized or log-transformed projection data, A is the system matrix which depends on the projection geometry, and its elements are usually modeled as the intersecting lengths of a ray path with the associated voxels on the path. The operator A is similar to H for pCT where H is along a curved path and A is along a straght line.
The form of AwTV in Equation (4) allows for full consideration of the gradient of the desired image and also includes the change of local voxel intensity. Specifically, for a smaller change of voxel intensity, a higher weight will be given, whereas for a larger change of voxel intensity, a weaker weight will be given. Through this diffusion-type weighting coefficients, the intra-region smoothing is encouraged in reference to inter-region smoothing. Referring to Fig. 2, the image reconstruction algoritm begins by initializng parameters in Step 210 and estimating an image of the object in Step 220.
In Step 210, the algorithm parameters δ , ε , ω and τ are initialized before the iteration begins. For example, the error tolerance ε is initialized based on the noise level of the data. The selection of the initial value of δ for the weighted factor in the AwTV depends on the intensity range of the image.
Notably, the parameter δ of the weight ws s in the AwTV model plays an important role for the AwTV-POCS algorithm due to its effect on the image resolution and noise tradeoff. Based on the tendency of the resolution-noise tradeoff curves, it is possible to obtain an optimal resolution-noise tradeoff in the reconstruction by determining a proper value δ . A minimal value of δ is determined theoretically as 0.01, which may give the highest resolution. Starting from this minimum value, the value can increase empirically until a proper value δ is obtained. For example, δ =0.6 generates visually appealing results, and in order to ensure the cost function being convex, let δ e (0.0822,∞) .
The initial value of co and τ may be set as 1 and 0.7 x lO 5 , respectively. Then these initial values may be updated in the iterative process, as shown in Table 1.
In Step 220, the image is estimated, for example by assuming a uniform medium, represented by setting the initial estimate of the image voxel value to 1.
The iterative method in the implementation of the AwTV-POCS algorithm provides an optimization solution in two distinct operations in Steps 230 and 240.
In Step 230, an initially estimated image from Step 220, is updated iteratively by a POCS strategy. In this step, a Simultaneous Algebraic Reconstruction Technique (SART) is used to reconstruct an image from sparse-sampled sinogram data to yield an intermediate estimated image.
In Step 240, the intermediate estimated image is further updated by adopting a gradient descent technique to minimize the AwTV of the intermediate estimated image. To implement the gradient descent technique, the first-order derivative of the AwTV term with respect to each voxel value is calculated. Specifically, in Step 240, due to the nonlinear form of the AwTV with respect to the image intensity, it is numerically difficult to utilize directly the second-order derivative for the purpose of effectively minimizing the objective function represented by Equation (5).
However, the weights can be pre-computed at current iteration for the AwTV minimization at the next iteration. By this strategy, in Step 240, the gradient descent technique is adapted to minimize the AwTV of the SA T-estimated intermediate image where only the first- order derivative of the AwTV term respect to each voxel value is needed, which can be approximately expressed as a set of equations in Equation (6):
Figure imgf000014_0001
In Equation (6), is a relax parameter introduced to avoid the denominator going to zero.
In Step 250, the algorithm parameters are updated iteratively. In Step 260, the condition criteria is checked and when satisfied, the final image is produced in Step 270. If the stop condition is not satisfied in Step 260, Steps 230 through 250 are performed in the next iteration. The stop condition can include a threshold value, for example as described in reference to Step 170 in Fig. 1. The stop condition may also include a predetermined number of general iterations to ensure convergence. Additionally, the stop condition may include a combination of parameters and conditions.
The pseudo code for the AwTV-POCS algorithm is provided in Table 1.
Table 1 initial: μ^' := I; s = 1,2, ...,S,t = 1,2, ...,T;
initial : δ , £ , τ;ω = I;
while (stop criterion is not met)
for j= 1,2,..., J; (POCS)
if j==l;
Figure imgf000015_0001
else μ » := SART (μ^,ω); s = \,2,...,S ,t = \,2,...,T ;
end if
end for
10 if μ > 0, then μ = μ ; s h,2,...,S,t 1,2?..., Γ;
11 else μ^} := 0; s 1=2,..., S,r \,2=,...,T;
12 end if
13 2,...,S,t = 1,2,.
14 1,=2,...,S,? 1,2,..
^ «(J) - w(J) ^
15 : exp
16: for & =1,2, (AwTV gradient descent) 17:
18 end for
19 if dp < ε;
20 ω := 0.995 ;
21 end if
22 := ^ 1;
23 calculate the criterion;
24 T = T * 0.995;
25 end if stop criterion is satisfy
In Table 1, the AwTV-POCS is implemented as follows. For an S T image, each of the / general iteration steps includes performiong Step 230 J number of times, i.e., J steps of POCS iterations and K steps of gradient descent iterations in Step 240. The relax parameter <¾ in the POCS is decreased and the step-size for the following gradient descend of AwTV is also minimized automatically in the iteration processes. Further, a value of 0.995 is used to update parameters ω and τ in lines 20 and 24, to ensure that these two parameters decrease smoothly. Each outer loop (lines 3-22) is performed by two iteration parts, i.e., the POCS (lines 4- 12) in Step 230, and the gradient descent for the AwTV minimization (lines 16-17) in Step 240. The AwTV minimization (lines 16-17) in Step 240 is updated iteratively by the gradient descend procedure. Because the parameter ω controls the step-size of the POCS (lines 4-12) in Step 230, this algorithm is steepest-descent and based on the values of dp and άμ8ΑΚΤ , the adjustable relax parameter o is updated at line 20. Additionally, considering the fact that in LD-xCT imaging the linear attenuation coefficient (or in pCT the relative eletronic density) of bone is the highest and the linear attenuation coefficient (or the relative eletronic density in pCT) of air is the lowest, the maximum u v / n„ and minimum u - I η - of δ values can be pre-estimated before image reconstruction.
The AwTV-POCS algorithm described above mitigates overs-moothness on the edges of a resulting image, in a piecewise-smoothed computed tomography (xCT or pCT) image, reconstructed from sparse-sampled data without introducing noticeable artifacts. The AwTV- POCS model considers the anisotropic properties among neighboring voxels in an image. The associated weights in AwTV-POCS are expressed as an exponential function, which can be adaptively adjusted with the local image-intensity gradient to preserve edge details. That is, in order to achieve a reasonable balance between resolution and Contrast-to-Noise Ratio (CNR) in the reconstruction, the associated weights in the AwTV model are expressed as an exponential function, which can be adaptively adjusted with the local image-intensity gradient for preservation of edge details. The AwTV-POCS optimization scheme minimizes the AwTV of the to-be- estimated image subject to data conditions and other constrains for the concerned low-dose xCT and pCT image reconstruction issue and yields images with noticeable gains.
An imaging reconstruction model minimizing an Alpha-Divergence ( -D) cost function, according to an embodiment of the present invention, is represented in Equation (7): Φ(η) = Da (p, q) = [ ap + (l - a ) q - pa q " ldx + YQ^), a e (-∞, +∞)
a (\ - a ) J ^ /}
, with q representing H77 as an expectation of the measured proton energy loss p, η is the relative electron density distribution for pCT, H is the integration operator along the curved proton path inside the object, γ is a smoothing parameter which controls a degree of agreement between the estimated and the recorded projection data information, and Q(rj) is a penalty term determined by the AwTV cost function.
The methodology for Alpha-Divergence ( -D) Constrained Total Variation (TV) minimization as applied for low-dose Computed Tomography (LD-xCT) image reconstruction, is as follows. In order to achieve high-quality low-dose CT image reconstruction, an imaging reconstruction framework with alpha-divergence (a-D) constrained total variation (aD-TV) minimization, rewritten from Equation (7), is represented in Equation (8):
min N £>α (ρ,Αμ) + λ \μ\ (8)
In Equation (8), the subscript BV RN) denotes the space of functions with bounded total variation in RN , and λ > 0 is the global penalty parameter.
As in most image reconstruction algorithms, a cost function consists of two components, a fidelity term and a priori information term. The data fidelity term models the statistics of the measured data. The priori information term regularizes the data fidelity for an optimal solution or image reconstruction.
The data fidelity term in Equation (8), constructed by alpha-divergence measure, is provided by Equation (9):
M
Da (p, Αμ) = [αΑ. + (1 - α)(Α ); - ρ» (Αμ)) α ] (9)
(l )
In Equation (9), μ = [μι , μ2,· · · , μΝ]τ G RN denotes the attenuation coefficients (for xCT) to be estimated, ρ = Υρχ , ρ1, · · ·, ρΜί <≡^M represents the linearized or log-transformed projections data (for xCT), and A = {A; } eIRMxiV is the system matrix (similar to the H described above for pCT) which depends on the projection geometry, and its elements are modeled as the intersecting lengths of a ray path with the associated voxels on the path.
The priori information term
Figure imgf000017_0001
In Equation (10), div(») represents the divergence operator and ω denotes the dual variable of TV minimization. Referring to Fig. 3, the image reconstruction algoritm begins by initializng parameters in Step 310 and estimating an image of the object in Step 320, similar to Steps 210 and 220 in Fig. 2.
In Step 310, the initial algorithm parameters are initialized before the iteration begins. For example, the initial values of λ and ω may be set to 1 and τ to 0.7 x lO , and error tolerance ε is initialized based on the noise level of the data.
In Steps 330 and 340, the following nested two step optimized scheme is performed, to minimize the aD-TV cost function, re resented by the set of equations in Equation ( 1 1):
Figure imgf000018_0001
where λ . /- ∑ .Λ . ; .
In Step 330, i.e. , the first AD step, the iterative form is similar to that of a Maximum Likelihood Expectation-Maximization (ML-EM) algorithm.
In Step 340, the second TV step, a projection gradient descent algorithm is adopted to optimize the dual variable ω , similar to Equation (10). Given an initial dual variable co , the following update is derived, to achieve an optimal dual parameter ω ^ [n Equation (12):
Figure imgf000018_0002
, with time step t adaptively estimated based on a non-monotone Chambolle projection algorithm for TV image restoration.
Steps 350-370 in Fig. 3 are similar to Steps 250-270 in Fig. 2. That is, in Step 350, the algorithm parameter λ is updated iteratively in a smooth fashion, i.e., decreasing slowly. In Step 360, the condition criteria is checked and when satisfied, the final image is produced in Step 370.
The pseudo code for the a-D algorithm is provided in Table 2. Table 2 1 initial: μ0ϋ):=1; j =1,2, --,N;
2 initial: e, λ, t, ω° , a = 1.3, k =0, n Θ;
3 while (stop criterion is not met)
4 I/2 (7) = 0')(∑ A/( ( ,)a) ∑ A,,; i =4,2,···,Μ; / ¾2,---,N; (AD-step)
5 A+i/2 ") := max+i/2 o); 7 = 1, , · · · , N;
Figure imgf000019_0001
I ~
7 g" := V(av2a - 1λμ?ών(ω)— , μΙ+υι)>' (dual variable optimizing)
V2 -1
8 <y"+1 := j— j-; (projection gradient descent) 9 if ||ω"+1-ω" |<ε;
10 : ½+i ") = A&/2 C/) - (ϊ)άίν{ω]); j = 1, 2, · · · , N; (TV-step)
11 : else go to step 7;
12 : endif
13 : calculate the criterion;
14 : λ := 1*0.995;
15 : k:=k + l;
16 : end if stop criterion is satisfy
In Table 2, a value of 0.995 is used to update parameter λ in line 14, in the aD-TV algorithm to ensure that the parameter decreases smoothly.
The aD-TV model for image reconstruction more reasonably measures, by the data fidelity term, the discrepancy between the measured data and the estimated data in the cost function, via the a-divergence. Further, to achieve a stable ill-posed image reconstruction, the AwTV penalty, as an edge -preserving prior, is adapted to regularize the solution, i.e., an aD-AwTV approach. The aD-TV / aD-AwTV minimizing algorithms described above perform better in lowering the noise-induced artifacts, while preserving the image edge and accelerating the algorithm convergence speed.
An imaging reconstruction model minimizing a PWLS cost function, according to an embodiment of the present invention, is represented by Equation (13):
η) = (p
Figure imgf000019_0002
-Ηη) + γ Q( ) , (13) with H77 being an expectation of the measured proton energy loss p, γ is a smoothing parameter which controls a degree of agreement between the estimated and the recorded projection path information, and∑ is a diagonal matrix with a diagonal value being a corresponding variance of a data element of p and Q{j ) is a penalty term determined by the AwTV cost function.
The PWLS-AwTV algorithm method considers the data statistical properties of minimizing data constraints in image reconstruction and is especially advantageous in cases where the data sparsity is not severe and the noise level is relatively high, for example in proton CT where the number of protons is limited while travesing the whole object and low-mAs acquisition for low-dose X-ray CT imaging.
Referring to Fig. 4, the image reconstruction algorithm begins by determining an estimated image in Step 410 and determining initial weights from AwTV in Step 420 by Equation (5) above. Because incident proton orientation will deviate in three dimensions, a cone-beam Feldkamp- Davis-Kress (FDK) algoritm method, which is extended from the FBP method, can be used for imaging a system in cone-beam geometry.
In Step 430, each voxel of the image is updated iteratively by applying the PWLS algorithm described below. In Step 440 the weights of the PWLS algorithm are iteratively updated as well.
In Step 450, similar to the condition steps in the figures described above, the stop condition is checked and when satisfied, the final image is produced in Step 460.
In applying the methodology for low-dose X-ray CT image reconstruction by AwTV- constrained Penalized Weighted Least-Squares (PWLS), two principle sources of causing the CT noise, i.e., the photon counting statistics and the electronic background noise are considered. The measured transmission data / is assumed to statistically follow the Poisson distribution upon a Gaussian distributed background noise, as represented in Equation (14):
/ = Poisson(2) + Normal(me, ae 2), (14) with λ being the mean of Poisson distribution, and me and oe 2 as the mean and variance of the Gaussian distribution from the electronic background noise, respectively. The mean me of the electronic noise is often calibrated to be zero. Based on this measurement model, a formula of the mean-variance relationship in CT projection domain by considering the effect of the Gaussian distributed electronic background noise at different mAs levels represented by Equation (15):
1 1.25
σΛ =— exp(/7. ) 1 + - -exp(/?, ) (15)
In Equation (15), Ii0 is the mean number of incident photons along projection path i, pi denotes the log-transformed ideal projection datum along path i and is usually called the line integral of the attenuation coefficients along the projection ray, ae 2 i is the variance of the electronic noise associated with the measurement on p{ , and represents the estimated variance of measuring projection datum pt .
For CT image reconstruction, the associated cost function of penalized weighted least- squares (PWLS) in Equation (13) is rewritten as Equation (16):
Φ(μ) = {p - Αμ)τ∑-1 (p - Αμ) + βϋ{μ). (16)
In Equation (16), p is the acquired projection data and A represents the system transfer matrix, which depends on the projection geometry, and its elements of ai . can be calculated as the length of the intersection of projection ray i with voxel j, μ is the vector of ideal attenuation coefficients to be reconstructed.
The first term on the right hand side is the data fidelity term described as a weighted least-squares (WLS) measurement wherein the matrix∑ is a diagonal matrix and its i-th element denotes the variance of the projection datum at detector i.
The second term on the right hand side is the priori penalty term. The AwTV is used as the penalty term, represented by the set of equations in Equation (17):
Figure imgf000021_0001
(17) In Equation (17), s and t are the 2D indices of the location of the attenuation coefficients along in-plane domain (slice), z is the indices of the attenuation coefficients along axial direction, δ in the weights is a scale factor which controls the strength of the diffusion during each iteration.
The pseudo code for the PWLS algorithm is provided in Table 3.
Table 3
1 : Initialization:
=FDK{/3};
r = ρ-Αμ;
s. =aJ'∑~1aJ, Vj;
Figure imgf000022_0001
For each iteration:
For each pixel j = {s, t, z} :
For each neighbor me N.
9 if m e M = [s-\,t,z}J{s,t -l,z}J{s,t,z -1}
w
10:
11: if m = Is + l,t,z
12:
Figure imgf000022_0002
15: else if m = is, t,z + 1
16:
( ) Ά
17: end if 18 : 19 :
βΥ
Figure imgf000023_0001
21 : ? := τ + α} {μ? - μ, ) ;
22 : end for
23 : end for
μ - μ.
24 : update W. = exp m e N .
25 : end if stop criterion is satisfied.
Since the weights in AwTV depend on the local intensity of the image, implementation of the second-order derivative of the AwTV term in the above PWLS algorithm is complicated. The optimization of the cost function is in two separate steps. The first step is using the separable paraboloid surrogate method and the second step is using the gradient descent method to minimize the AwTV-related term. By executing these two steps iteratively, a desired image can be obtained. These iteration steps are summarized in Table 4, with a constant of 1.25 in Equation (15) above.
Table 4
1 Initialization:
2 fi = FBP{p} ;
Figure imgf000023_0002
5 For each iteration:
6 Step 1: Minimize first term (p -Αμ)τΈ ι ρ - Αμ) by
Figure imgf000023_0003
μ7 | = argmax j/i/| , 0
Figure imgf000024_0001
10 Step 2: AwTV gradient descent
1 1 i l = gradient descent(fi . ) 1
Figure imgf000024_0002
3 update∑ using ;
14 End
The PWLS strategy, employing the PWLS-AwTV algorithm as described above, mitigates the noise effect and produces a higher quality image. The PWLS strategy can be implemented by using the PWLS-AwTV algorithm and is especially advantageous in cases of sufficient angular sampling and low-dose on respective views.
An imaging reconstruction model, according to an embodiment of the present invention, minimizes an AwTV cost function, expanded to a TV-Stroke cost function represented by Equatio
Figure imgf000024_0003
In Equation (18), V is a vector differential operator, is a transpose operator, and V1 is an orthogonal vector differential operator, wherein V satisfies an irrotationality condition, v1 satisfies an incompressibility condition, η is the relative electron density distribution for pCT, / is a function of η , n is a normal vector, and τ is a tangential vector.
Specifically, in the methodology for TV-Stokes strategies for xCT image reconstruction, given a 2D image f(p) (also in 3D space), where μ is the attenuation coefficient in xCT image reconstruction field, two orthogonal vectors, the normal vector n and the tangential vector τ of the image are defined b Equation (19): n = V/0/) (19)
Figure imgf000024_0004
with V being a vector differential operator, T representing the transpose operator, and V1 being an orthogonal vector differential operator. These two vector fields should satisfy the irrotationality condition and incompressibility condition separately. The irrotationality condition and incompressibility condition can be mathematically expressed by Equation (20) :
V x n = 0 and V x = 0 , (20) with the left side being the cross product and a mathematical description of the irrotationality condition, and the right side being the dot product and a mathematical description of the incompressibility condition.
Total Variation Stokes (TVS) strategy requires the desired image satisfy the incompressibility condition in the tangential vector field and data fidelity. The desired image is reconstructed by the fo Ho wing optimization problem, represented by Equation (21):
Figure imgf000025_0001
In Equation (21) p is the projection data, Ais the transfer matrix or system matrix, which is related to the projection geometry of the CT scanner, σ is the error tolerance between the projection data and the projections of the to-be-estimated image. The optimization problem in Equation (21) is solved with multiple variables by decomposing the objective function to two sub-optimization problems, as described with reference to Fig. 5.
Referring to Fig. 5, the initial parameters are determined in Step 510 and an initial image is estimated in Step 520.
In Step 540, the normal vector is estimated with incompressibility constraints, in the Tangent Field Smoothing (TFS) operation. The minimization problem of Step 540 is represented by Equation (22):
min subject to ν ·τ = 0 . (22)
Figure imgf000025_0002
In Step 550, the desired image is reconstructed by fitting it to the estimated normal field with constraints from data fidelity, obtained by solving the following minimization Equation (23): ηιίη|η ^|ν/| - ν/ · ·ρ άμ subject to \\P - Αμ\ζ < σ2 . (23) In Step 530, |^- Α |2 < σ is solved by performing the POCS strategy described above.
Thus, the desired image can be obtained in Step 570, by executing Steps 540 and 550 iteratively until a stop condition is satisfied in Step 560.
More specifically, the two-step algorithm for TVS strategy is described as performed in two distinct operations, by applying Tangent Field Smoothing (TFS) and performing image reconstruction. The TFS operation in tep 540 is provided by Equation (24):
Figure imgf000026_0001
where λ is the Lagrange multiplier and β is a penalty parameter. The saddle point optimization problem is the following set of Euler-Lagrange Equations (25)-(27):
V -r = 0 in Ω (26) with the Neumann boundary condition
Figure imgf000026_0003
where v is the unit outward normal and / is the identity matrix. To solve such minimization problem, we use the method of gradient-descent method by considering an artificial time variable t, utilizing Equations (28)-(29):
Figure imgf000026_0004
The image reconstruction operation in Step 550 is provided by Equations (30)-(33). Specifically, after tangential vector τ* is smoothed in Step 540, of the above TFS algorithm by solving Equations (28) and (29), the optimized normal vector n* can be found, which will be used to reconstruct the low-dose CT image by fitting the normal vector of the desired image with the optimized normal vector n* with constraints from the fidelity of the acquired projection data as described in Equation (23). However, these two terms require integration in different domains, the image domain and the projection domain. Thus, due to the difficulty of solving this problem simultaneously, by using the simple AL method below, these two terms are solved separately.
The first term is solved by using Euler-Lagrange (EL) method, represented by Equation
(30):
Figure imgf000027_0001
The corresponding set of EL equations for the saddle point is represented in Equations
Figure imgf000027_0002
with the Neumann boundar condition:
Figure imgf000027_0003
where ? represents outwards unit normal vectors on the boundary
The fidelity term is solved by performing the POCS algorithm in Step 530, represented by Equation (33):
(33)
Thus the desired image solution of Equation (23) can be obtained iteratively by using Equations (32) and (33).
In implementing the updating function for the first TFS operation in Step 540, several assumptions are made:
1. Assume the forward/backward difference operators along x and y axes are and
2. Assume the centered difference operators along x and y axes are Cx h and C 'y ' where h corresponds to the order of neighbors of the central pixels.
3. Define a vector («, v) as:
Figure imgf000027_0004
The value of the variable u, v and λ at at step n+1 can be calculated by Equations (35)-
(41): vn+1 = v" + AL D: x (A"+Div(T")) (35) un+i = un + At, D; Z) ( " + Z)iv(r")) (36)
Figure imgf000028_0001
λη+ιη +At2(D +Dy +un), (37) where
Figure imgf000028_0002
T2 = J(Ay (cy ))2 + (Dy )2 + (Dy )2 + (Mx (c ))2 + ε (40)
Mxw = (w(x,y) + w(x + h,y))/2 and Myw = (w(x,y) + w(x,y + h))/2. (41) The updating function for the second operation in Step 550 is solved by Equations (42)-
(45) as follows. From Equation (38) we know that n = ψ(μ) v) , utilizing
Figure imgf000028_0003
Equations (42)-(45):
Figure imgf000028_0004
where
Figure imgf000028_0005
+ ε. (44)
U and » = (45) u2 + [Mx(Myv ^+(My(Mxu))2 + ε
The updating function for Step 2 uses the PCOS algorithm in Step 530, as described above. The TV-Stokes strategies for CT image reconstruction in the AwTV-POCS algorithm are described in the pseudo code in Table 5. Table 5
1 : initial: μφ) := FBP;
2 : initial: tl, t2 and ε
3 : caculate the initial vectors u and v from μ(0);
3: while stop criterion is not met
calculate calculate τ" , T" T";
Figure imgf000029_0001
7 forj = l,2 (POCS)
8 if j= i; =
9 μυ) :=SART(^0),coy,
10 else μυ) := SART(p(j l) ,co);
11 end if
12 end for
13 if μ(] > 0, then μ% = μ%; x = \,2,...,X,y =1,2,..., 7;
14 else^ :=0; x=\,2,...,X,y =1,2,...,F;
15 end if
16
17
18: 1,2,..., 7;
Figure imgf000029_0002
en or
end if stop criterion is satisfy
While the present invention has been shown and described with reference to various embodiments of the present invention thereof, it will be understood by those skilled in the art that changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the appended claims and equivalents thereof.

Claims

WHAT IS CLAIMED IS:
1. A method for imaging an object, the method comprising:
recording projection path information and energy loss information of a plurality of particles traversing an object;
determining an estimated image based on the projection path information and the energy loss information sampled into a projection format, wherein the estimated image includes an active volume defined by an enclosure border;
updating the estimated image by performing cost function minimization using one of an Adaptive-weighted Total Variation (AwTV) cost function, a Penalized Weighted Least-Squares (PWLS) cost function, and an Alpha-Divergence (a-D) cost function;
updating the estimated image by performing an iterative updating algorithm corresponding to the cost function minimization; and
when a difference between the updated estimated image and a previously estimated image is lower than a predetermined threshold, producing a final image based on the estimated image, wherein the one of the AwTV cost function, the PWLS cost function, and the a-D cost function is performed based on the estimated image, the recorded projection path information and energy loss information and a volumetric path.
2. The method of claim 1, wherein the step of determining the estimated image comprises:
sampling the recorded projection path information and energy loss information to create a tomographic projection;
reconstructing an initial image by applying a Filtered Back-Projection (FBP) image reconstruction method using the sampled recorded projection path information and energy loss information;
identifying the enclosure border of the initial image; and
designating a volume within the enclosure border as the active volume of the object being imaged.
3. The method of claim 1, wherein the step of performing the iterative updating algorithm corresponding to the cost function minimization comprises:
performing a first iteration by updating the volumetric path based on an estimated path within the active volume, computing expected data for projection path information and energy loss information using the updated volumetric path and the estimated image, performing the cost function based on computed expected data and recorded data, and obtaining an updated object image; and
performing subsequent iterations by updating the estimated active volume based on the updated object image, updating the volumetric path based on the updated active volume and the updated object image, minimizing the cost function based on the updated active volume, updated volumetric path, updated object image, the computed expected data and the recorded data, to further update the object image.
4. The method of claim 1, wherein the projection path information includes energy loss information of each of the plurality of particles, position information, direction information, orientation information, and angle information of the plurality of particles, upon entering and exiting the object, object parameter distribution and interaction quantity information.
5. The method of claim 1, wherein the volumetric path is a banana-shaped volume determined from recorded projection path information and energy loss information within the active volume,
wherein the banana-shaped volume provides an object parameter distribution including an all path probability distribution, and
wherein a centerline of the banana-shaped volume indicates a most likely path of the plurality of particles.
6. The method of claim 1, wherein the iterative updating algorithm comprises one of: a projection onto a Plurality Of Convex Sets (POCS) algorithm for minimizing the AwTV cost function;
a Gauss-Seidel (GS) updating algorithm for minimizing the PWLS cost function; and an D-TV minimizing algorithm for minimizing the a-D cost function.
7. The method of claim I, wherein the AwTV cost function is determined by:
Figure imgf000032_0001
wherein the AwTV cost function is subject to an error tolerance condition ε , represented by:
Figure imgf000032_0002
wherein η is a vector of a relative electron density distribution within the object, p is the recorded energy loss information, and G is an error tolerance data fidelity constraint determined by a noise level of p, H is an integration operator for computing an expected energy-loss information along a projection path, and H77 is an expected value of a recorded value p expressed as an integral of energy loss along the estimated path through the estimated object image within the estimated active volume at the n-th iteration.
8. The meth f claim 7, wherein the AwTV cost function is determined by:
Figure imgf000032_0003
wherein, rj represents a vector of the relative electron density distribution within the ect, 77max is a maximum value of the object image and 77min is a minimum value of the object ge, and represents a position inside the object in two-dimensional representation.
9. The method of claim 1, wherein the AwTV cost function is expanded to a TV-Stroke cost function represented by: n = V/to) dm m and T = V /(f?) = fdm^ dmv
Figure imgf000032_0004
where V is a vector differential operator, T is a transpose operator, and Vx is an orthogonal vector differential operator, wherein V satisfies an irrotationality condition, v1 satisfies an incompressibility condition, η represents a vector of the relative electron density distribution within the object to be reconstructed, / (η) is a function of η, n is a normal vector, and τ is a tangential vector.
10. The method of claim 1, wherein the a-D cost function is represented by: φθ7) = D a (P> q) + γζ)(η), a e (-∞, +∞)
Figure imgf000033_0001
where q represents H77 and is an expectation of the measured proton energy loss p, γ is a smoothing parameter which controls a degree of agreement between the estimated and the recorded projection path information, and Q(j]) is a penalty term solved by the AwTV cost function.
11. The method of claim 1 , wherein the PWLS cost function is represented by:
{η) = {ρ -
Figure imgf000033_0002
- 1Άη) + γ Q{rf) ,
wherein H77 is an expectation of the measured proton energy loss p, γ is a smoothing parameter which controls a degree of agreement between the estimated and the recorded projection path information,∑ is a diagonal matrix with a diagonal value being a corresponding variance of a data element of p, and Qij]) is a penalty term solved by the AwTV cost function.
12. The method of claim 1, wherein the particles traversing the object are one of protons, neutrons, muons, carbon and alpha particles.
13. The method of claim 1, wherein the plurality of particles includes X-ray photons, Gamma-ray photons, and wherein the recorded projection path is a straight line.
PCT/US2013/024423 2012-02-01 2013-02-01 Computerized image reconstruction method and apparatus WO2013116709A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/376,177 US9251606B2 (en) 2012-02-01 2013-02-01 Computerized image reconstruction method and apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261593634P 2012-02-01 2012-02-01
US61/593,634 2012-02-01

Publications (2)

Publication Number Publication Date
WO2013116709A1 true WO2013116709A1 (en) 2013-08-08
WO2013116709A8 WO2013116709A8 (en) 2013-09-12

Family

ID=48905894

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/024423 WO2013116709A1 (en) 2012-02-01 2013-02-01 Computerized image reconstruction method and apparatus

Country Status (2)

Country Link
US (1) US9251606B2 (en)
WO (1) WO2013116709A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104299239A (en) * 2014-10-23 2015-01-21 南方医科大学 Dynamic PET image factor processing method based on divergence alpha
CN104537620A (en) * 2014-12-30 2015-04-22 华中科技大学 Direction-adaptive image deblurring method
WO2016016653A1 (en) * 2014-08-01 2016-02-04 University Of Lincoln Method and apparatus for proton computerised tomography
US10028712B2 (en) 2014-06-09 2018-07-24 University Of Lincoln Computerized tomography systems and methods
CN109074635A (en) * 2016-05-03 2018-12-21 皇家飞利浦有限公司 Device and method for the denoising of opposite magnitude image
EP3526733A4 (en) * 2016-11-18 2020-06-10 Wolfram R. Jarisch Extended high efficiency computed tomography with optimized recursions and applications
CN111836583A (en) * 2017-12-28 2020-10-27 北伊利诺伊大学董事会 Processing a pipeline for immediate particle image reconstruction
US11270479B2 (en) 2016-02-29 2022-03-08 Koninklijke Philips N.V. Optimization-based reconstruction with an image-total-variation constraint in PET
CN111652951B (en) * 2020-05-07 2023-06-06 中国工程物理研究院材料研究所 Sparse angle fast neutron CT imaging method

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11321772B2 (en) 2012-01-12 2022-05-03 Kofax, Inc. Systems and methods for identification document processing and business workflow integration
US9514357B2 (en) 2012-01-12 2016-12-06 Kofax, Inc. Systems and methods for mobile image capture and processing
US10783615B2 (en) 2013-03-13 2020-09-22 Kofax, Inc. Content-based object detection, 3D reconstruction, and data extraction from digital images
US10127636B2 (en) 2013-09-27 2018-11-13 Kofax, Inc. Content-based detection and three dimensional geometric reconstruction of objects in image and video data
US11620733B2 (en) 2013-03-13 2023-04-04 Kofax, Inc. Content-based object detection, 3D reconstruction, and data extraction from digital images
EP3053143B1 (en) * 2013-09-30 2019-03-27 Koninklijke Philips N.V. Method for local adjustment of regularization parameters for image quality optimization in fully 3d iterative ct reconstruction
JP6351164B2 (en) * 2014-06-12 2018-07-04 国立研究開発法人量子科学技術研究開発機構 Beam irradiation object confirmation device, beam irradiation object confirmation program, and stopping power ratio calculation program
EP3286736B1 (en) * 2015-02-03 2018-09-05 Koninklijke Philips N.V. Image reconstruction system, method, and computer program
US9886760B2 (en) * 2015-03-05 2018-02-06 Broncus Medical Inc. GPU-based system for performing 2D-3D deformable registration of a body organ using multiple 2D fluoroscopic views
WO2016154136A1 (en) * 2015-03-20 2016-09-29 Rensselaer Polytechnic Institute Automatic system calibration method of x-ray ct
KR101636207B1 (en) * 2015-05-07 2016-07-05 한국과학기술원 Development of iterative reconstruction framework using analytic principle for low dose x-ray ct
US10467465B2 (en) 2015-07-20 2019-11-05 Kofax, Inc. Range and/or polarity-based thresholding for improved data extraction
US10242285B2 (en) 2015-07-20 2019-03-26 Kofax, Inc. Iterative recognition-guided thresholding and data extraction
CN109069092B (en) * 2016-03-23 2021-04-13 衣阿华大学研究基金会 Apparatus, system, and method for utilizing a small-frame based iterative maximum likelihood reconstruction algorithm in spectral CT
US10055860B2 (en) 2016-05-27 2018-08-21 Toshiba Medical Systems Corporation Computed tomography apparatus and empirical pre-weighting method for decreasing image noise nonuniformity
US11354830B2 (en) * 2016-07-25 2022-06-07 The General Hospital Corporation System and method for tomographic image reconstruction
US10692251B2 (en) * 2017-01-13 2020-06-23 Canon Medical Systems Corporation Efficient variance-reduced method and apparatus for model-based iterative CT image reconstruction
US11276208B2 (en) 2017-06-12 2022-03-15 The Research Foundation For The State University Of New York System, method and computer-accessible medium for ultralow dose computed tomography image reconstruction
US10628539B2 (en) * 2017-10-19 2020-04-21 The Boeing Company Computing system and method for dynamically managing monte carlo simulations
US11062176B2 (en) * 2017-11-30 2021-07-13 Kofax, Inc. Object detection and image cropping using a multi-detector approach
CN108038828B (en) * 2017-12-08 2020-04-17 中国电子科技集团公司第二十八研究所 Image denoising method based on self-adaptive weighted total variation
KR102591672B1 (en) 2018-08-29 2023-10-20 한국전자통신연구원 Image generating apparatus, imaging system including image generating apparatus and operating method of imaging system
CN111724331B (en) * 2019-03-22 2023-05-09 四川大学 Porous medium image reconstruction method based on generation network
EP3783570B1 (en) * 2019-08-23 2023-05-17 Siemens Healthcare GmbH Computer-implemented method for reconstructing medical image data
US10783401B1 (en) * 2020-02-23 2020-09-22 Fudan University Black-box adversarial attacks on videos
CN114415504B (en) * 2021-12-28 2023-06-20 苏州大学 Unified control method based on self-adaptive control and iterative learning control

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050105693A1 (en) * 2003-11-17 2005-05-19 General Electric Company Iterative ct reconstruction method using multi-modal edge information
US20060104410A1 (en) * 2004-11-17 2006-05-18 The University Of Notre Dame Du Lac Methods, apparatus, and software to facilitate iterative reconstruction of images
US20070031337A1 (en) * 2004-06-22 2007-02-08 Reinhard Schulte Nanoparticle enhanced proton computed tomography and proton therapy
US20110220794A1 (en) * 2010-02-12 2011-09-15 Yair Censor Systems and methodologies for proton computed tomography

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7187794B2 (en) * 2001-10-18 2007-03-06 Research Foundation Of State University Of New York Noise treatment of low-dose computed tomography projections and images
US6754298B2 (en) * 2002-02-20 2004-06-22 The Regents Of The University Of Michigan Method for statistically reconstructing images from a plurality of transmission measurements having energy diversity and image reconstructor apparatus utilizing the method
EP2024902A4 (en) 2006-02-13 2012-06-13 Univ Chicago Image reconstruction from limited or incomplete data
US8897528B2 (en) * 2006-06-26 2014-11-25 General Electric Company System and method for iterative image reconstruction
US8571287B2 (en) * 2006-06-26 2013-10-29 General Electric Company System and method for iterative image reconstruction
US7551708B2 (en) * 2007-02-07 2009-06-23 General Electric Company Method of iterative reconstruction for energy discriminating computed tomography systems
US8144829B2 (en) * 2008-02-27 2012-03-27 The Board Of Trustees Of The Leland Stanford Junior University Cone-beam CT imaging scheme
US8971599B2 (en) * 2010-12-20 2015-03-03 General Electric Company Tomographic iterative reconstruction

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050105693A1 (en) * 2003-11-17 2005-05-19 General Electric Company Iterative ct reconstruction method using multi-modal edge information
US20070031337A1 (en) * 2004-06-22 2007-02-08 Reinhard Schulte Nanoparticle enhanced proton computed tomography and proton therapy
US20060104410A1 (en) * 2004-11-17 2006-05-18 The University Of Notre Dame Du Lac Methods, apparatus, and software to facilitate iterative reconstruction of images
US20110220794A1 (en) * 2010-02-12 2011-09-15 Yair Censor Systems and methodologies for proton computed tomography

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10383586B2 (en) 2014-06-09 2019-08-20 University Of Lincoln Assembly, apparatus, system and method
US10028712B2 (en) 2014-06-09 2018-07-24 University Of Lincoln Computerized tomography systems and methods
US10159451B2 (en) 2014-06-09 2018-12-25 University Of Lincoln Assembly, apparatus, system and method
WO2016016653A1 (en) * 2014-08-01 2016-02-04 University Of Lincoln Method and apparatus for proton computerised tomography
GB2543695B (en) * 2014-08-01 2020-11-25 The Univ Of Lincoln Method and apparatus for proton computerised tomography
US10249063B2 (en) 2014-08-01 2019-04-02 University Of Lincoln Method and apparatus for proton computerised tomography
GB2543695A (en) * 2014-08-01 2017-04-26 The Univ Of Lincoln Method and apparatus for proton computerised tomography
CN104299239A (en) * 2014-10-23 2015-01-21 南方医科大学 Dynamic PET image factor processing method based on divergence alpha
CN104537620A (en) * 2014-12-30 2015-04-22 华中科技大学 Direction-adaptive image deblurring method
US11270479B2 (en) 2016-02-29 2022-03-08 Koninklijke Philips N.V. Optimization-based reconstruction with an image-total-variation constraint in PET
CN109074635A (en) * 2016-05-03 2018-12-21 皇家飞利浦有限公司 Device and method for the denoising of opposite magnitude image
CN109074635B (en) * 2016-05-03 2023-05-30 皇家飞利浦有限公司 Apparatus and method for denoising vector image
US10789743B2 (en) 2016-11-18 2020-09-29 Wolfram R. JARISCH Extended high efficiency computed tomography with optimized recursions and applications
EP3526733A4 (en) * 2016-11-18 2020-06-10 Wolfram R. Jarisch Extended high efficiency computed tomography with optimized recursions and applications
US11813105B2 (en) 2017-12-28 2023-11-14 Board Of Trustees Of Northern Illinois University Processing pipeline for prompt particle image reconstruction
CN111836583A (en) * 2017-12-28 2020-10-27 北伊利诺伊大学董事会 Processing a pipeline for immediate particle image reconstruction
CN111836583B (en) * 2017-12-28 2022-03-29 北伊利诺伊大学董事会 Processing a pipeline for immediate particle image reconstruction
CN111652951B (en) * 2020-05-07 2023-06-06 中国工程物理研究院材料研究所 Sparse angle fast neutron CT imaging method

Also Published As

Publication number Publication date
US9251606B2 (en) 2016-02-02
WO2013116709A8 (en) 2013-09-12
US20150030227A1 (en) 2015-01-29

Similar Documents

Publication Publication Date Title
US9251606B2 (en) Computerized image reconstruction method and apparatus
Kida et al. Cone beam computed tomography image quality improvement using a deep convolutional neural network
Wang et al. Scatter correction for cone‐beam computed tomography using moving blocker strips: a preliminary study
Xu et al. A practical cone-beam CT scatter correction method with optimized Monte Carlo simulations for image-guided radiation therapy
Niu et al. Shading correction for on‐board cone‐beam CT in radiation therapy using planning MDCT images
EP3400876B1 (en) Automatic estimating and reducing scattering in computed tomography scans
US7907697B2 (en) System to estimate X-ray scatter
Zhao et al. Patient-specific scatter correction for flat-panel detector-based cone-beam CT imaging
Dauvergne et al. Monte Carlo comparison of x-ray and proton CT for range calculations of proton therapy beams
US10049446B2 (en) Accelerated statistical iterative reconstruction
Yan et al. A hybrid reconstruction algorithm for fast and accurate 4D cone‐beam CT imaging
Kearney et al. Automated landmark-guided deformable image registration
Xu et al. Statistical iterative reconstruction to improve image quality for digital breast tomosynthesis
Chen et al. Optimization of the geometry and speed of a moving blocker system for cone‐beam computed tomography scatter correction
Dhou et al. 3D fluoroscopic image estimation using patient-specific 4DCBCT-based motion models
Watson et al. Implementation of an efficient Monte Carlo calculation for CBCT scatter correction: phantom study
Mason et al. Quantitative cone-beam CT reconstruction with polyenergetic scatter model fusion
Schmitz et al. Validation of proton dose calculation on scatter corrected 4D cone beam computed tomography using a porcine lung phantom
Trapp et al. Empirical scatter correction: CBCT scatter artifact reduction without prior information
Sun et al. Rapid scatter estimation for CBCT using the Boltzmann transport equation
Chun et al. Algorithms and analyses for joint spectral image reconstruction in Y-90 bremsstrahlung SPECT
Lee et al. Low-dose CBCT reconstruction via joint non-local total variation denoising and cubic B-spline interpolation
Xu et al. Quantitative rotating multisegment slant-hole SPECT mammography with attenuation and collimator-detector response compensation
Bopp et al. Quantitative proton imaging from multiple physics processes: a proof of concept
Jacobson et al. Abbreviated on-treatment CBCT using roughness penalized mono-energization of kV-MV data and a multi-layer MV imager

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13744306

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14376177

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 13744306

Country of ref document: EP

Kind code of ref document: A1