WO2004032740A2 - Kinematic and deformation analysis of 4-d coronary arterial trees reconstructed from cine angiograms - Google Patents

Kinematic and deformation analysis of 4-d coronary arterial trees reconstructed from cine angiograms Download PDF

Info

Publication number
WO2004032740A2
WO2004032740A2 PCT/US2003/031552 US0331552W WO2004032740A2 WO 2004032740 A2 WO2004032740 A2 WO 2004032740A2 US 0331552 W US0331552 W US 0331552W WO 2004032740 A2 WO2004032740 A2 WO 2004032740A2
Authority
WO
WIPO (PCT)
Prior art keywords
displaying
representation
time varying
flexion
determining
Prior art date
Application number
PCT/US2003/031552
Other languages
English (en)
French (fr)
Other versions
WO2004032740A3 (en
Inventor
Shiuh-Yung James Chen
John D. Carroll
Original Assignee
The Regents Of The University Of Colorado
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Regents Of The University Of Colorado filed Critical The Regents Of The University Of Colorado
Priority to AU2003284002A priority Critical patent/AU2003284002A1/en
Publication of WO2004032740A2 publication Critical patent/WO2004032740A2/en
Publication of WO2004032740A3 publication Critical patent/WO2004032740A3/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/46Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment with special arrangements for interfacing with the operator or the patient
    • A61B6/461Displaying means of special interest
    • A61B6/466Displaying means of special interest adapted to display 3D data
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/02Devices for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/50Clinical applications
    • A61B6/504Clinical applications involving diagnosis of blood vessels, e.g. by angiography
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30101Blood vessel; Artery; Vein; Vascular
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/41Medical
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20Indexing scheme for editing of 3D models
    • G06T2219/2012Colour editing, changing, or manipulating; Use of colour codes

Definitions

  • the present invention relates to reconstruction, a display and analysis of vascular tree structures and more specifically relates to reconstruction and of a moving cardiovascular tree structure from sequences of and geographic images and analysis of such a reconstructed moving model.
  • Co-pending patent application 09/444,138 teaches particular methods for accurately reconstructing a three-dimensional representation of a vascular tree structure from pairs of two-dimensional radiographic images each representing a view from a particular imaging angle.
  • Such a three-dimensional reconstructed representation may be derived from, for example, a pair of images generated in a biplane radiographic imaging system or from a pair of images generated by a single plane radiographic imaging system positioned at each of two distinct viewing angles.
  • Such a three-dimensional reconstructed representation of a vascular tree structure is useful, as known in the art, for visualizing the vascular structure and for quantitative analysis of various measured attributes and parameters of selected portions ofthe vascular tree structure. For example, as discussed in co-pending patent application 09/444,138 such quantitative analysis and visualization is helpful for clinical procedures involving vascular implants and bypass procedures.
  • coronary arteries and veins are dynamic, curvilinear structures that have a great degree of individual to individual variability and tortuosity.
  • percutaneous catheter-based interventional (i.e., therapeutic) procedures include a variety of coronary interventions, such as the placement of metal stents, atherectomy, radiation emitting catheters, devices to trap embolization of atherosclerotic debris, and placement of pacing electrodes in the coronary venous system.
  • These procedures presently use two-dimensional X-ray based imaging as the sole or the major imaging modality for procedure guidance and quantification of key parameters. With the complex motions ofthe heart during each contraction, the degree of curvilinearity of coronary arteries undergoes a considerable change.
  • the 3-D coronary arteries were reconstructed from a set of X-ray perspective projections by use of an algorithm from computed tomography. Due to the motion of heart, only a limited number of projections can be acquired. Therefore, accurate reconstruction and quantitative measurement are not easily achieved.
  • the present invention solves the above and other problems, thereby advancing the state ofthe useful arts, by providing methods and associated systems for reconstructing, visualizing and analyzing a three-dimensional representation of a moving vascular tree structure from time varying sequences of radiographic images thereof.
  • a broad purpose ofthe invention is to provide a novel patient-specific 4-D (e.g., 1-D in time varying space plus 3-D geometry) vascular model and to provide quantitative display tools to improve patient outcomes and enhance patient safety during, for example, percutaneous catheter-based interventions.
  • these dynamic vascular trees can be displayed for an in-room advanced visual interface for the operator to better understand the target for intervention.
  • the invention broadly consists of three major processes (1) reconstruction of moving vascular tree throughout its motion cycle, (2) establishment of temporal correspondence with the smoothness constraints, and (3) kinematic and deformation analysis ofthe reconstructed 3-D moving vascular trees throughout its movement cycle.
  • the present invention provides methods and systems for reconstructing a moving coronary arterial tree throughout its cardiac cycle movement, establishment of temporal correspondence between sequences of imaging frames, and quantitative analysis of various kinematic and deformation measures of the reconstructed, displayed three-dimensional moving coronary arterial tree.
  • Figure 1 is a flowchart describing the overall precessing of methods ofthe present invention.
  • Figures 2a-2c respectively show an example of a manually identified 2-D coronary arterial tree superimposed to the corresponding image, the initially identified 2-D model corresponding thereto and the corresponding final 2-D coronary arterial tree.
  • Figure 3 depicts the determination of correspondences using the epi-polar plane.
  • Figures 4a-4b depict corresponding points from two views.
  • Figure 5 shows a refinement process employed to calculate the refined correspondence using optimal parametric arguments.
  • Figures 6a and 6b provide an exemplary pair of angiograms from two angles.
  • Figure 6c shows a first reconstruction ofthe arterial tree represented by figures 6a and 6b.
  • Figure 6d shows a refined reconstruction ofthe arterial tree represented by figures 6a and 6b.
  • Figure 7a and 7b show a refined reconstructed arterial tree and a skeletal representation thereof, respectively.
  • Figure 8 shows an exemplary global flexion analysis for a representative selected segment of a reconstructed arterial tree.
  • Figures 9a and 9b show two sequences of six images of an arterial tree for each of two viewing angles, respectively.
  • Figures 9c-9k show the color coded results of an exemplary 3-D reconstruction ofthe sequences of figures 9a and 9b as deformation analysis and kinematic analysis.
  • Figures 10a and 10b show two sequences of six images of an arterial tree for each of two viewing angles, respectively.
  • Figures 10c- 10k show the color coded results of an exemplary 3-D reconstruction ofthe sequences of figures 10a and 10b as deformation analysis and kinematic analysis.
  • Figure 11 is a sequence of exemplary, color-coded, curvature analysis displays corresponding to a first selected view of a reconstructed 3-D arterial tree.
  • Figure 12 is a sequence of exemplary, color-coded, curvature analysis displays corresponding to a second selected view of a reconstructed 3-D arterial tree.
  • Figure 13 is a flowchart of a method to determine a transformation matrix for each pair of images in a sequence of cine arteriograms.
  • Figure 14 is a flowchart describing a method to determine correspondences between images in a sequence of cine arteriograms.
  • vascular and arterial tree structures as well as cardiovascular structures. As the terms relate to the present invention, all such vascular and arterial tree structures may be considered equivalent. Applications ofthe present invention are readily apparent in analysis of cardiovascular structures. Other applications for other vascular and arterial structures are similarly apparent to those of ordinary skill in the art. References herein to cardiac structures and motion should therefore be understood not as limitations on the application ofthe invention nor as limitations on the structures or methods ofthe claimed invention. Rather, all references to any particular vascular or arterial structure should be broadly understood to represent any arterial or vascular structure for which cine images of motion can be generated.
  • a first aspect ofthe present invention provides methods and associated systems for 3-D reconstruction of a vascular tree structure.
  • Prior methods taught by co-pending patent application 09/444,138 are enhanced and extended herein to accurately reconstruct the moving coronary arterial trees throughout the cardiac cycle based on two sequences of cine angiograms acquired from a biplane or single-plane imaging system.
  • the present reconstruction method broadly comprises four major steps: (A) acquisition of two angiogram sequences based on a single-plane or biplane imaging system, (B) identification of 2-D coronary arterial trees and feature extractions including bifurcation points, vessel diameters, and vessel directional vectors in the two image sequences, (C) determination of transformation in terms of a global T g and a local transformation T k matrices based on the identified vessel features, and (D) calculation of moving 3-D coronary arterial trees based on the transformations and extracted vessel features.
  • a standard coronary arteriogram may be completed in two standard views; one injection in a biplane system and two injections in a single plane imaging system.
  • Such images may be acquired at a rate of 15 frames per second in each view throughout the cardiac cycle in each ofthe two views.
  • the images may be selected with the aid ofthe superimposed electrocardiogram (ECG) signals and transferred to an appropriate personal computer or workstation for the 3-D reconstruction process.
  • ECG electrocardiogram
  • the images may be at a resolution of 512 x 512 matrix with a pixel color depth of one byte per pixel or any other desired resolution and pixel color depth.
  • Radiographic systems and methods are common for generating such images.
  • MRI magnetic resonance imaging
  • CT Computer tomography
  • All such sources of images are useful in association with the reconstruction aspects, features, methods and systems ofthe present invention.
  • An interactive, computer-based, semi-automatic system based on the technique of deformation model and segmentation may be employed as known in the art for the identification ofthe 2-D coronary arterial tree in the acquired angiograms.
  • the required user interaction involves only the indication of several points inside the lumen, near the projection of each vessel centerline in the angiogram.
  • a spline-curve may be formed based on the selected points.
  • the spline-curve may serve as the initial centerline of a corresponding vessel.
  • An m by m operator ridge operator
  • the identified pixels serve as the external forces to act on the initial.model curve such that it will be gradually deformed and finally reside on the real centerline ofthe vessel.
  • Co-pending patent application 09/444,138 provides a detailed discussion of such processes of feature extraction for a single, static pair of angiograms.
  • the identified centerlines and the branching relationships may be used for construction ofthe vessel hierarchy in each angiogram by their labeling according to the appropriate anatomy and connectivity among the primary and secondary coronary arteries.
  • the 2-D coronary arterial tree on the image acquired at the first time frame After the 2-D coronary arterial tree on the image acquired at the first time frame is obtained, it may be used as the initial 2-D arterial tree model for identification of he coronary arterial tree on the angiogram acquired at the next time frame.
  • the ridge operator and deformable model may be employed as described previously such that the initial model curve is gradually aligned with the real centerline of vessel. Such a procedure may be performed iteratively to identify the 2-D coronary arterial trees with the associated coronary features in each angiogram sequences.
  • Figure 1 is a flowchart depicting the 2-D feature extraction as an iterative process where the first image in the sequence of images may be used as an initial centerline approximation for the next image and so on for each image in the sequence.
  • element 100 is first operable to access the next (first) image pair in the pair of cine angiogram sequences.
  • cardiovascular structures are but one example of a useful application of such sequences of radiographic images. Numerous other examples of dynamic, moving vascular tree structures will be readily apparent to those of ordinary skill in the art.
  • Element 102 determines whether this image pair is the first in the sequence of images.
  • processing continues with element 104 to receive user input to identify a sequence of points and landmarks along the vascular tree 2D images to permit 3D reconstruction ofthe vascular structure at this first image pair from the sequence of time varying image pairs. Processing then continues as below with element 108. If element 102 determines that this is not the first image pair in the sequences of time varying image pairs, then element 106 is next operable to display the next pair of images in the time varying sequences superimposed with a 2D projection ofthe identified tree structure from the previous image pair with the identified points therefrom. Element 106 also receives user input to move the displayed point to new locations corresponding to the same points in the next time varying pair of images. Processing then continues with element 108.
  • Element 108 is then operable to align the 2D model ofthe present displayed pair of images according to the deformation discussed herein. Specifically, the 2D model is adjusted according to smoothness constraints and other constraints as discussed further herein below.
  • element 110 and 112 are operable to optionally receive user input to adjust the automatically determined projection. In particular, element 110 determines whether the user desires to make such adjustments and if so, element 112 receives user input to define any such adjustments.
  • Element 114 is then operable determine parameters ofthe reconstruction process (identify bifurcation points, vessel diameters and direction vectors) and to construct the 3D representation ofthe vascular tree corresponding to the present time varying image pair. Element 116 then determines if this was the last image in the time varying sequences of images. If not, the process continues by looping back to element 100 to process the next pair of images from the time varying sequences of images.
  • Figure 2a shows an example of a manually identified 2-D coronary arterial tree superimposed to the corresponding image.
  • Figure 2b shows this initially identified 2-D model (of figure 2a) superimposed to the next image in conjunction with the optical calculation.
  • the final 2-D coronary arterial tree may be obtained as shown in figure 2c.
  • C. Determination of transformations characterizing two pairs of angiographic views By use of a biplane or single-plane system for image acquisitions, the spatial relationship between any two views can be characterized by a transformation in the forms of a rotation matrix R and a translation vector with the X-ray source (or focal spot) served as the origin of 3-D coordinate space.
  • the second projection view of the biplane imaging system can be describe in terms of a second pair of image and object coordinate systems u' v' and x'y' z' defined in an analogous manner.
  • the geometrical relationship between the two views can be characterized by
  • the transformation may be calculated based on the identified bifurcation points and direction vectors ofthe 2-D coronary arterial trees in each view.
  • the required prior information i.e., the intrinsic parameters of each single-plane imaging system
  • SID focal-spot to imaging-plane distance
  • ze e.g., .3 mm pixel
  • iso-center distance with respect to which the rotary motion of the gantry arm rotates
  • n denotes the number of pairs of corresponding points extracted from the two images
  • v, and v , denote the respective 2-D vessel directional vectors of bifurcations in each views
  • v jv
  • ,v 2 ,...,v n j and v'
  • FIG. 13 is a flowchart describing a method ofthe present invention to determine a transformation for each pair of images.
  • Element 1300 first determines a global transformation T g as discussed further herein below.
  • the calculated R g and t are the estimates that characterize the two image sequences.
  • each pair of angiograms may be acquired almost simultaneously throughout the cardiac cycle. Therefore, the global transformation is feasible to define each pair of images acquired from different time frames.
  • the two image sequences maybe acquired independently (i.e., two separate injections) corresponding to two different single cardiac cycles.
  • the global transformation may not truly characterize every pair of images throughout the cardiac cycle; especially for those image pairs near the end-systolic time frame.
  • c k denotes the respective y ' -th column vectors of matrix R k
  • represent the matrix and vector norms
  • d r and d. denote the upper bounds of respective k k k norms, (?,-, ?,) and ?'., ? '.
  • this information may be used to establish the point correspondences on each pair of 2-D vessel centerlines and calculate 3-D structures of coronary arterial tree.
  • the transformation in conjunction with the epi-polar constraints and vessel hierarchy may be employed as the framework for calculation.
  • the epi-polar plane and each image plane intersect along a straight line called the epi-polar line (as labeled in figure 3). Therefore, the location of point P b in the second image must lie on the epi-polar line resulting from the intersection between the second image plane and the plane defined by point P a and the two focal spots.
  • FIG. 4a shows a first angiogram with four identified points: A, B, C and D.
  • Figure 4b shows the matching angiogram from another view angle with the corresponding four points a, b, c and d established by the initial correspondence.
  • FIG 14 provides a flowchart describing a method ofthe present invention to compute correspondences between points in each pair of images in the sequence.
  • Element 1400 is first operable to calculate an initial point correspondence for the k-t pair of images based on epi-polar constraints and the corresponding transformation T k .
  • Element 1402 refines the correspondences based on individual pairs of arterial segments and a nonlinear optimization.
  • Element 1404 refines the determination of vessel centerlines and diameters.
  • Element 1406 causes the processing of elements 1400, 1402 and 1404 to repeat for each ofthe k time frames ofthe sequence.
  • Figure 5 shows a typical result ofthe refinement process employed to calculate the refined correspondence using optimal parametric arguments s l ,s 2 ,. .. s n _ i s n based on the following equation:
  • n k denotes the number of points ofthe 2-D vessel centerline at the k-t time frame
  • fi are the respective spline-curve model and extracted 2-D vessel centerline points in two views, f' s - l l ( , f y ⁇ s . ) and v' .
  • the vessel centerline correspondences are globally established by incorporating the entire vessel shape in terms of directions and locations that will yield more accurate results than those obtained by only use of epi-polar constraints with local vessel segment points; especially when epi-polar line and vessel segment are tangential.
  • Figures 6c and 6d show the results of 3-D left coronary arterial (LCA) reconstructed from a pair of angiograms as shown in figures 6a and 6b based on the simple epi-polar technique and the refinement process, respectively.
  • the reconstruction of left main artery apparently illustrates inaccurate results based on the simple epi-polar process (figure 6c) which are corrected after employing the refinement process (corrected as in figure 6d).
  • the incorrect reconstruction of figure 6c is caused by the complete occlusion ofthe mid-LAD section ofthe
  • rk v denotes the component ofthe rotational matrix R k at the &-th time frame.
  • the anatomical morphology of coronary arterial tree can then be generated by a surface based reproduction technique.
  • the 3-D lumen surface is modeled on the basis of a sequence of cross-sectional contours.
  • Each contour S, along the vessel is represented by a d- m circular disk centered at and perpendicular to the 3-D vessel centerline.
  • the surfaces between every pair of consecutive contour S, and S /+1 are generated based on a number of polygonal patches.
  • s ⁇ — ⁇ s Xj , s 2j , ... , s ntj > denotes the set of parametric variables corresponding to the 3-D vessel centerline points ofthe artery / .
  • T and N* denote the tangent and normal vectors at point P .
  • the parametric curve function /* • (*';) defines the centerline points of the artery / .
  • the module of elasticity at one vessel centerline point is defined to be inverse proportional to the area ofthe cross section (i.e., KI J oc 1 Id ).
  • Numerous standard mathematics library functions are readily available to those of ordinary skill in the art.
  • the subroutines vel7 and vfl3 of Harwell Subroutine Library may be employed to solve the above equation. (Harwell Subroutine Library, vol. Vz, AEA Technology, Harwell Laboratory, Oxfordshire, England, December 1995).
  • the first term in the above minimization equation defines the required minimal kinetic energy due to motion and the second term characterizes the minimal change in potential energy due to arterial segment stretching or foreshortening between k and k' time frames.
  • the local shape similarity between the two coronary arteries is characterized based on the last two terms by minimizing the total angle differences of tangent and normal vectors at every pair of corresponding points on the respective arteries.
  • the temporal correspondence of vessel centerline points between any two time frames e.g., end-diastole and end-systole
  • a regularization solution may be obtained by minimizing an energy ofthe following form
  • A is a set of indices to the sample data points, x,'s are the locations of the data points, ⁇ ⁇ 0 is a weighting factor and n ⁇ 1 is an integer number.
  • the first term on the right hand side called the closeness term, imposes the constraint from the data d.
  • the second term called the smoothness term or the regularizer, imposes the a priori smoothness constraint on the solution. It is desired to minimize both but they may not be each minimized simultaneously.
  • the two constraints are balanced by ⁇ . Any /minimizing the above equation may be a smooth solution in the so-called Sobolev space W . In the Sobolev space, every point of/is a function whose!
  • the employed smoothness constraints function is a Bezier surface function S u,vj that is formed as the Cartesian product of Bezier blending functions: m n
  • Bj,m(u) and B ⁇ ,n(v) are polynomial functions of degree one less than the number of control points used (i.e., at least a third order derivative function) and may be defined as
  • the analysis features and aspects ofthe present invention may be applied to any reconstructed 3-D representation of an arterial tree structure.
  • the above- identified methods and structures for such reconstruction and smoothing are but one exemplary technique believed to generate highly accurate representations ofthe arterial structure. Numerous other methods and structure for generating such a 3-D representation will be readily apparent to those of ordinary skill in the art.
  • rotational angiography systems and techniques are rapidly developing that are capable of generating 3-D representations of moving arterial tree structures.
  • the skeleton of a reconstructed 3-D vessel may be mathematically defined as a curve function p (s) - (x(s),y(s),z(s)) connecting all the 3-D centerline points.
  • a right coronary arterial (RCA) tree shown in figure 7a as a full 3D reconstruction and in and 7b as a skeleton structure, where 0 ⁇ s ⁇ 1 is the parametric variable.
  • the employed parametric function is a Bezier curve ? (5) that is formed as the Cartesian product of Bezier blending functions: m pis) - ⁇ pjBj, m (s), O ⁇ s ⁇ l,
  • Bj,m(s) is a polynomial function of degree one less than the number of control points used (i.e., at least a third order derivative function) and is defined as above.
  • B g , m(u) is a polynomial function of degree one less than the number of control points as described in the above equations.
  • r y (w),r ( l( ) andr (2 j(w) can be derived that define two other motion parameters in terms of velocity and acceleration for every vessel centerline point as
  • the F-S theory consists of five components: three vector fields along the given curve (the tangent T(s), the normal N(s), and the bi-normal B(s) vectors) and two scalar valued functions (the curvature ?(s) and the torsion t(s)) where s denotes the parametric variable defining the location of point on the curve function(s).
  • the curvature ?(s 0 ) measures the rate of change of the angle defined by the two neighboring tangents T(s 0 ) and -t so+d.) associated with the two points ?(s 0 ) and ?(s 0 +d s ).
  • the torsion at t(s 0 ) measures a rate of change (or twisting) at a point ?(s 0 ) how its trajectory twists out ofthe plane O t perpendicular to the normal vector B(s 0 )).
  • N(so) B(so) x T(so)
  • the analysis may be performed by comparing the coronary trees reconstructed at two different time frames k and k'.
  • the enclosed angle ? k (? k ) may be defined as the angle formed by two chords that extend from a point along the centerline to the location with the minimal length between a pre-defined length ⁇ (e.g., 5 mm) and the next local minimal curvature d c in each direction as shown in figure 8.
  • the enclosed angle may be calculated for every point of the centerlines between the two time frames.
  • the local maximum with the value greater than a threshold s (e.g., 15 degrees) is marked as a flexion point (FP) with bending movement.
  • the local minimum with the value less than a threshold -s (e.g., -15 degrees) is marked as a flexion point (FP) with straightening movement.
  • the threshold value can be chosen dynamically within a range (e.g., 7.5 degrees - 45 degrees) such that different sets of FPs can be calculated.
  • the kinematic and deformation measurements r , r*'* , r ⁇ y , ?(s), t(s) and ? ⁇ ex may be color coded on the lumen of moving coronary arterial tree. Seven colors (red, orange, yellow, green, blue, cyanic, and purple) may be used to represent the magnitudes of each kinetic measurement. The magnitude of each measurement throughout the cardiac cycle are divided into 7 sub-regions corresponding to each color where the red color denotes the largest magnitude and purple color represents the smallest magnitude. Those of ordinary skill in the art will recognize that any number of colors and gradations of colors maybe used to represent the dynamic measures.
  • FIGS 9a and 9b an example is shown of a pair of left coronary cine angiograms acquired between end-diastole and end-systole using a single-plane imaging system.
  • figure 9a is a sequence of six (6) from a first angle of a single plane imaging system
  • figure 9b is a second sequence of six (6) images from a different angle ofthe same single plane imaging system. Both image sequences cover (in six frames) an entire cardiac cycle ofthe movement ofthe coronary arterial tree.
  • Figures 9c through 9k show the color coded results ofthe reconstruction as deformation analysis and kinematic analysis.
  • figure 9c indicates the degree of curvature ofthe arterial tree over its range of motion through the cardiac cycle, six images are shown superimposed over one another corresponding to the six images in the original cine angiogram sequences. For clarity of this presentation, only one ofthe six 3D, color coded images is shown atop the others with others shown “greyed” out as "shadow” 3D images behind the top most image.
  • the sequence of images may preferably be presented to the user as a sequence of 3D reconstructed images, each color coded to express a particular quantitative measure (if selected), such that the user may view the structure as a moving 3D model ofthe dynamic vascular structure.
  • the user may interact with the system to select a particular "frame" ofthe 3D reconstructed views or may sequence through the frames in fast or slow motion to view the overall motion ofthe vascular structure.
  • a user may also request the quantitative analysis of a selected attribute so as to present the 3D model with color coding to represent the dynamic measure of the selected attribute through the cycle of motion ofthe vascular tree.
  • FIG. 10a Another example is shown of right coronary .cine angiograms acquired between end-diastole and end-systole, also from a single-plane imaging, in figures 10a and 10b.
  • the reconstructed dynamic 3-D coronary arterial trees with the corresponding kinematic and deformation analyses are shown in figures 10c, lOd and lOe and figures lOf, lOg and lOh.
  • the components of displacement, velocity, and acceleration along x-axis, y-axis, and z-axis are shown in Figs. lOi, lOj and 10k, respectively.
  • Figures 9c-9k and 10c- 10k show a sequence of time varying, color-coded displays indicating the value of a dynamic measure by the color coding at the corresponding section of the reconstructed 3-D arterial display.
  • the depiction ofthe time varying sequences of figures 9c-9k and 10c- 10k show the sequences of images overlaying one another on each figure with the last color-coded image ofthe sequence depicted on top. Earlier images in the sequence are shown "greyed” or "shadowed.”
  • Figure 11 shows a similar sequence of color-coded 3-D arterial reconstructions as a sequence of 6 individual frames rather than overlayed as shown in figures 9c-9k and 10c- 10k.
  • the sequence of displays in figure 11 represent an exemplary arterial tree display color-coded for curvature through the six frame sequence.
  • Figure 12 shows a similar sequence of images color-coded for curvature measures but viewed from an alternate selected viewing angle. While the invention has been illustrated and described in the drawings and foregoing description, such illustration and description is to be considered as exemplary and not restrictive in character, it being understood that only the preferred embodiment and minor variants thereof have been shown and described and that all changes and modifications that come within the spirit ofthe invention are desired to be protected.
  • the features ofthe invention to reconstruct a 3-D representation of cine-angiographic images may be implemented as an appropriately programmed general or special purpose computer, as computational and imaging electronics and devices as may be commercially available or as custom computational and imaging devices and electronics, or as combinations of such software, firmware and hardware components.
  • Such design choices among such a variety of means are well known to those of ordinary skill in the art.
PCT/US2003/031552 2002-10-08 2003-10-07 Kinematic and deformation analysis of 4-d coronary arterial trees reconstructed from cine angiograms WO2004032740A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2003284002A AU2003284002A1 (en) 2002-10-08 2003-10-07 Kinematic and deformation analysis of 4-d coronary arterial trees reconstructed from cine angiograms

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/267,151 US7113623B2 (en) 2002-10-08 2002-10-08 Methods and systems for display and analysis of moving arterial tree structures
US10/267,151 2002-10-08

Publications (2)

Publication Number Publication Date
WO2004032740A2 true WO2004032740A2 (en) 2004-04-22
WO2004032740A3 WO2004032740A3 (en) 2004-08-26

Family

ID=32042801

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/031552 WO2004032740A2 (en) 2002-10-08 2003-10-07 Kinematic and deformation analysis of 4-d coronary arterial trees reconstructed from cine angiograms

Country Status (3)

Country Link
US (1) US7113623B2 (US20040066958A1-20040408-M00010.png)
AU (1) AU2003284002A1 (US20040066958A1-20040408-M00010.png)
WO (1) WO2004032740A2 (US20040066958A1-20040408-M00010.png)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006011242A1 (de) * 2006-03-10 2007-09-13 Siemens Ag Verfahren zur Rekonstruktion einer 3D-Darstellung

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050018885A1 (en) * 2001-05-31 2005-01-27 Xuesong Chen System and method of anatomical modeling
ATE336761T1 (de) * 2003-01-31 2006-09-15 Koninkl Philips Electronics Nv Verfahren zur rekonstruktion dreidimensionaler objekte
JP4714677B2 (ja) * 2003-03-14 2011-06-29 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 動き補正された三次元ボリュームイメージング方法
JP2006524092A (ja) * 2003-04-24 2006-10-26 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 非侵襲性左心室容積決定
US20050074150A1 (en) * 2003-10-03 2005-04-07 Andrew Bruss Systems and methods for emulating an angiogram using three-dimensional image data
US8165358B2 (en) * 2004-01-12 2012-04-24 Ge Medical Systems Global Technology Co., Llc System and method for overlaying color cues on a virtual representation of an anatomical structure
US20050110791A1 (en) * 2003-11-26 2005-05-26 Prabhu Krishnamoorthy Systems and methods for segmenting and displaying tubular vessels in volumetric imaging data
WO2005055496A2 (en) * 2003-11-26 2005-06-16 Viatronix Incorporated System and method for optimization of vessel centerlines
US7599535B2 (en) * 2004-08-02 2009-10-06 Siemens Medical Solutions Usa, Inc. System and method for tree-model visualization for pulmonary embolism detection
US20060058674A1 (en) * 2004-08-31 2006-03-16 General Electric Company Optimizing ultrasound acquisition based on ultrasound-located landmarks
DE102004043676B4 (de) * 2004-09-09 2014-01-09 Siemens Aktiengesellschaft Verfahren zur Visualisierung von Plaqueablagerungen aus 3D-Bilddatensätzen von Gefäßstrukturen
US7532748B2 (en) * 2004-11-24 2009-05-12 General Electric Company Methods and apparatus for selecting and/or labeling vessel branches
JP5268365B2 (ja) * 2005-02-04 2013-08-21 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 脈管幾何形状及び流れ特性を決定するシステム
US8335357B2 (en) * 2005-03-04 2012-12-18 Kabushiki Kaisha Toshiba Image processing apparatus
US8019135B2 (en) * 2005-03-09 2011-09-13 Koninklijke Philips Electronics N. V. Apparatus and method for providing 2D representation of 3D image data representing an anatomical lumen tree structure
US7760962B2 (en) * 2005-03-30 2010-07-20 Casio Computer Co., Ltd. Image capture apparatus which synthesizes a plurality of images obtained by shooting a subject from different directions, to produce an image in which the influence of glare from a light is reduced
EP1746558B1 (en) * 2005-07-20 2013-07-17 MedTAG Ltd. A system for simulating a manual interventional operation by a user in a medical procedure
JP2009504297A (ja) * 2005-08-17 2009-02-05 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 自動4d冠動脈モデリングおよび動きベクトル場推定のための方法および装置
DE102006019918A1 (de) * 2006-04-28 2007-11-15 Siemens Ag Verfahren zur Gefäß-Segmentierung in tomographischen Volumendaten und Tomographiesystem
US8649576B2 (en) * 2006-06-16 2014-02-11 George Mason Intellectual Properties, Inc. Arborization reconstruction
US8428317B2 (en) * 2006-06-28 2013-04-23 Bio-Tree Systems, Inc. Binned micro-vessel density methods and apparatus
US7912270B2 (en) * 2006-11-21 2011-03-22 General Electric Company Method and system for creating and using an impact atlas
US7940974B2 (en) * 2006-11-21 2011-05-10 General Electric Company Method and system for adjusting 3D CT vessel segmentation
US8160395B2 (en) * 2006-11-22 2012-04-17 General Electric Company Method and apparatus for synchronizing corresponding landmarks among a plurality of images
US8126238B2 (en) * 2006-11-22 2012-02-28 General Electric Company Method and system for automatically identifying and displaying vessel plaque views
US8244015B2 (en) * 2006-11-22 2012-08-14 General Electric Company Methods and apparatus for detecting aneurysm in vasculatures
US7957574B2 (en) * 2006-11-22 2011-06-07 General Electric Company Methods and apparatus for generating a risk metric for soft plaque in vessels
DE102007024451B4 (de) * 2007-05-25 2010-07-08 Siemens Ag Ermittlungsverfahren für örtlich dreidimensional aufgelöste Anwesenheitsverteilungen einer Substanz in einem Gefäßsystem und hiermit korrespondierende Einrichtungen
JP4388104B2 (ja) * 2007-06-29 2009-12-24 ザイオソフト株式会社 画像処理方法、画像処理プログラム及び画像処理装置
US8428316B2 (en) * 2007-12-03 2013-04-23 Siemens Aktiengesellschaft Coronary reconstruction from rotational X-ray projection sequence
JP5543976B2 (ja) * 2008-11-26 2014-07-09 コーニンクレッカ フィリップス エヌ ヴェ 冠状動脈ツリーの視覚化
GB2468164B (en) * 2009-02-27 2014-08-13 Samsung Electronics Co Ltd Computer-aided detection of lesions
US8428319B2 (en) * 2009-04-24 2013-04-23 Siemens Aktiengesellschaft Automatic measurement of morphometric and motion parameters of the coronary tree from a rotational X-ray sequence
US20110007933A1 (en) * 2009-07-10 2011-01-13 Microsoft Corporation 3D Image Processing
EP2465094B1 (en) 2009-08-12 2016-01-06 Koninklijke Philips N.V. Generating object data
US8934686B2 (en) * 2009-11-26 2015-01-13 Algotec Systems Ltd. User interface for selecting paths in an image
DE102010012621A1 (de) * 2010-03-24 2011-09-29 Siemens Aktiengesellschaft Verfahren und Vorrichtung zur automatischen Adaption eines Referenzbildes
GB201008281D0 (en) 2010-05-19 2010-06-30 Nikonovas Arkadijus Indirect analysis and manipulation of objects
MY152058A (en) * 2010-06-21 2014-08-15 Univ Putra Malaysia A method of constructing at least one 3 dimensional image
JP5944917B2 (ja) * 2010-11-24 2016-07-05 ボストン サイエンティフィック サイムド,インコーポレイテッドBoston Scientific Scimed,Inc. 身体内腔分岐を検出及び表示するためのコンピュータ可読媒体及び同コンピュータ可読媒体を含むシステム
US9020232B2 (en) * 2012-07-24 2015-04-28 Kabushiki Kaisha Toshiba Per vessel, vessel tree modelling with shared contours
WO2014064702A2 (en) 2012-10-24 2014-05-01 Cathworks Ltd. Automated measurement system and method for coronary artery disease scoring
US10210956B2 (en) 2012-10-24 2019-02-19 Cathworks Ltd. Diagnostically useful results in real time
US10595807B2 (en) 2012-10-24 2020-03-24 Cathworks Ltd Calculating a fractional flow reserve
US9814433B2 (en) * 2012-10-24 2017-11-14 Cathworks Ltd. Creating a vascular tree model
US9858387B2 (en) * 2013-01-15 2018-01-02 CathWorks, LTD. Vascular flow assessment
US9305352B2 (en) * 2012-12-04 2016-04-05 Siemens Corporation Deformable tree matching with tangent-enhanced coherent point drift
US8864763B2 (en) 2013-03-13 2014-10-21 DePuy Synthes Products, LLC External bone fixation device
RU2015143523A (ru) 2013-03-13 2017-04-19 Депуи Синтез Продактс, Инк. Устройство для внешней фиксации кости
US9039706B2 (en) 2013-03-13 2015-05-26 DePuy Synthes Products, Inc. External bone fixation device
US9471989B2 (en) * 2013-06-03 2016-10-18 University Of Florida Research Foundation, Inc. Vascular anatomy modeling derived from 3-dimensional medical image processing
EP3954298A3 (en) 2013-10-24 2022-03-16 Cathworks Ltd. Vascular characteristic determination with correspondence modeling of a vascular tree
US10342502B2 (en) * 2015-11-18 2019-07-09 Lightlab Imaging, Inc. X-ray image feature detection and registration systems and methods
US10524687B2 (en) * 2016-04-27 2020-01-07 Myocardial Solutions, Inc. Rapid quantitative evaluations of heart function with strain measurements from MRI
IL263065B1 (en) 2016-05-16 2024-04-01 Cathworks Ltd Vascular evaluation system
EP4241694A3 (en) 2016-05-16 2023-12-20 Cathworks Ltd. Selection of vascular paths from images
US10835318B2 (en) 2016-08-25 2020-11-17 DePuy Synthes Products, Inc. Orthopedic fixation control and manipulation
DE102016215970B3 (de) * 2016-08-25 2017-11-09 Siemens Healthcare Gmbh Verfahren zum Betreiben eines Röntgengerätes sowie Röntgengerät für ein Erstellen einer dreidimensionalen Angiographie
US11017531B2 (en) * 2017-03-09 2021-05-25 Cathworks Ltd Shell-constrained localization of vasculature
US11439436B2 (en) 2019-03-18 2022-09-13 Synthes Gmbh Orthopedic fixation strut swapping
US11304757B2 (en) 2019-03-28 2022-04-19 Synthes Gmbh Orthopedic fixation control and visualization
WO2020205247A1 (en) * 2019-03-29 2020-10-08 Tornier, Inc. Pre-morbid characterization of anatomical object using statistical shape modeling (ssm)
US11872019B2 (en) 2019-06-05 2024-01-16 Myocardial Solutions, Inc. MRI-derived strain-based measurements and related image data acquisitions, image data processing, patient evaluations and monitoring methods and systems
CN110751615B (zh) * 2019-08-29 2021-06-08 浙江工业大学 基于环境感知的立体树木图像融合方法
US11334997B2 (en) 2020-04-03 2022-05-17 Synthes Gmbh Hinge detection for orthopedic fixation
WO2023079657A1 (ja) * 2021-11-04 2023-05-11 国立大学法人東北大学 情報処理装置、木構造を示す器官の構造の対応付け方法、及び、木構造を示す器官の構造の対応付けプログラム

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4839822A (en) * 1987-08-13 1989-06-13 501 Synthes (U.S.A.) Computer system and method for suggesting treatments for physical trauma
US4878115A (en) * 1987-09-25 1989-10-31 University Of Kentucky Research Foundation Dynamic coronary roadmapping
US4875165A (en) * 1987-11-27 1989-10-17 University Of Chicago Method for determination of 3-D structure in biplane angiography
US5151856A (en) * 1989-08-30 1992-09-29 Technion R & D Found. Ltd. Method of displaying coronary function
US5839440A (en) * 1994-06-17 1998-11-24 Siemens Corporate Research, Inc. Three-dimensional image registration method for spiral CT angiography
US5920319A (en) * 1994-10-27 1999-07-06 Wake Forest University Automatic analysis in virtual endoscopy
US5709206A (en) * 1995-11-27 1998-01-20 Teboul; Michel Imaging system for breast sonography
US6047080A (en) * 1996-06-19 2000-04-04 Arch Development Corporation Method and apparatus for three-dimensional reconstruction of coronary vessels from angiographic images
US6115485A (en) * 1997-10-06 2000-09-05 General Electric Company Introducing reduced data set information into a primary image data set
US6718054B1 (en) * 1999-06-23 2004-04-06 Massachusetts Institute Of Technology MRA segmentation using active contour models
US6546271B1 (en) * 1999-10-01 2003-04-08 Bioscience, Inc. Vascular reconstruction
WO2001041648A1 (en) * 1999-12-07 2001-06-14 Koninklijke Philips Electronics N.V. Ultrasonic image processing method and system for displaying a composite image sequence of an artery segment
JP2003518404A (ja) * 1999-12-28 2003-06-10 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 移動部を有する対象物の超音波色分けイメージを表示する超音波イメージ処理方法及び装置
US20020136440A1 (en) * 2000-08-30 2002-09-26 Yim Peter J. Vessel surface reconstruction with a tubular deformable model
US6650928B1 (en) 2000-11-27 2003-11-18 Ge Medical Systems Global Technology Company, Llc Color parametric and composite maps for CT perfusion
JP2005528157A (ja) * 2002-06-04 2005-09-22 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 回転血管造影法に基づく冠状動脈構造のハイブリッド3d再構成

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006011242A1 (de) * 2006-03-10 2007-09-13 Siemens Ag Verfahren zur Rekonstruktion einer 3D-Darstellung
DE102006011242B4 (de) * 2006-03-10 2012-03-29 Siemens Ag Verfahren zur Rekonstruktion einer 3D-Darstellung
US8275448B2 (en) 2006-03-10 2012-09-25 Siemens Aktiengesellschaft Method for reconstructing a 3D presentation

Also Published As

Publication number Publication date
AU2003284002A8 (en) 2004-05-04
US7113623B2 (en) 2006-09-26
AU2003284002A1 (en) 2004-05-04
WO2004032740A3 (en) 2004-08-26
US20040066958A1 (en) 2004-04-08

Similar Documents

Publication Publication Date Title
US7113623B2 (en) Methods and systems for display and analysis of moving arterial tree structures
Chen et al. 3-D reconstruction of coronary arterial tree to optimize angiographic visualization
MacKay et al. Graphics methods for tracking three-dimensional heart wall motion
US6501848B1 (en) Method and apparatus for three-dimensional reconstruction of coronary vessels from angiographic images and analytical techniques applied thereto
Garreau et al. A knowledge-based approach for 3-D reconstruction and labeling of vascular networks from biplane angiographic projections
US7155046B2 (en) Method of determining physical parameters of bodily structures
Sato et al. A viewpoint determination system for stenosis diagnosis and quantification in coronary angiographic image acquisition
Baert et al. Three-dimensional guide-wire reconstruction from biplane image sequences for integrated display in 3-D vasculature
CN1672179B (zh) 最佳视图v.o.01
Chen et al. Kinematic and deformation analysis of 4-D coronary arterial trees reconstructed from cine angiograms
Yang et al. Novel approach for 3-D reconstruction of coronary arteries from two uncalibrated angiographic images
Frakes et al. Application of an adaptive control grid interpolation technique to morphological vascular reconstruction
WO1997049065A9 (en) Method and apparatus for three-dimensional reconstruction of coronary vessels from angiographic images
CN103493098B (zh) 医学图像处理系统和方法
CN112419484B (zh) 三维血管合成方法、系统及冠状动脉分析系统和存储介质
EP1851721B1 (en) A method, a system and a computer program for segmenting a surface in a multidimensional dataset
CN112419462A (zh) 三维血管的渲染合成方法、系统及存储介质
Ruan et al. Three-dimensional motion and reconstruction of coronary arteries from biplane cineangiography
Wahle et al. 3D heart-vessel reconstruction from biplane angiograms
Kawata et al. Measurement of blood vessel characteristics for disease detection based on cone-beam CT images
CN109313803B (zh) 一种用于映射对象的身体的至少部分的图像中的结构的至少部分的方法和装置
MacLeod et al. Visualization tools for computational electrocardiology (Proceedings Only)
Noordmans et al. Localization of implanted EEG electrodes in a virtual-reality environment
Chen et al. Computer assisted coronary intervention by use of on-line 3D reconstruction and optimal view strategy
Fang et al. Motion-flow-guided recurrent network for respiratory signal estimation of x-ray angiographic image sequences

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP