WO2009077971A1 - Fusion of cardiac 3d ultrasound and x-ray information by means of epicardial surfaces and landmarks - Google Patents
Fusion of cardiac 3d ultrasound and x-ray information by means of epicardial surfaces and landmarks Download PDFInfo
- Publication number
- WO2009077971A1 WO2009077971A1 PCT/IB2008/055309 IB2008055309W WO2009077971A1 WO 2009077971 A1 WO2009077971 A1 WO 2009077971A1 IB 2008055309 W IB2008055309 W IB 2008055309W WO 2009077971 A1 WO2009077971 A1 WO 2009077971A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- heart
- ventricular epicardium
- anatomical feature
- images
- dimensional
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30048—Heart; Cardiac
Definitions
- the present invention relates to methods and systems for integrating cardiac three- dimensional X-ray and ultrasound information based on anatomical features (e.g., epicardial surfaces and landmarks) within X-ray and ultrasound images of a ventricular epicardium of a heart.
- anatomical features e.g., epicardial surfaces and landmarks
- CTR's cardiac resynchronization therapies
- the left ventricular lead position is manipulated within the coronary venous anatomy to position the electrode tip within the region of greatest mechanical delay.
- Three- dimensional vein models derived from rotational venograms help the physician to identify promising vein branches for lead navigation, whereas dyssynchrony assessment based on three-dimensional ultrasound imaging helps identify the target location for electrode tip placement.
- a registration i.e., a spatial alignment between the X-ray and ultrasound images must be computed.
- One endocardial image technique for registering the X-ray and ultrasound images uses ventriculography-derived LV chamber anatomy in combination with the same chamber imaged with ultrasound for registration.
- Patients undergoing cardiac resynchronization therapy are, however, typically fragile and are in heart failure, and therefore are often unable to tolerate large volume contrast agent injections that are typically required of procedures such as ventriculography.
- Ventriculography -based registration of X-ray and ultrasound images is therefore problematic for CRT patients with poor cardiac and renal function.
- the approach of the present invention avoids ventriculography entirely, and is more clinically -viable in situations where patients cannot tolerate large volume contrast opacification.
- One form of the present invention is a ventricular epicardium registration method involving (1) an identification of one or more anatomical features visible within ultrasound images of a ventricular epicardium of a heart, (2) an identification of the anatomical feature(s) visible within X-ray images of the ventricular epicardium of the heart, and (3) a registration of the X-ray images and the ultrasound images of the ventricular epicardium of the heart based on the identification of the anatomical feature(s) visible within the ultrasound images and the X-ray images.
- the anatomical feature(s) include, but are not limited to, a portion or an entirety of an epicardial surface and a coronary sinus vein.
- a second form of the present invention is a multimodality registration system comprising a processor and memory in communication with the processor wherein the memory stores programming instructions executable by the processor to (1) identify one or more anatomical features visible within ultrasound images of a ventricular epicardium of a heart, (2) identify the anatomical feature(s) visible within X-ray images of the ventricular epicardium of the heart, and (3) register the ultrasound images and the X-ray images of the ventricular epicardium of the heart based on the identification of the anatomical feature(s) visible within the ultrasound images and the X-ray images.
- FIG. 1 illustrates an exemplary embodiment of an integrated epicardial shell/coronary venous model in accordance with present invention.
- FIG. 2 illustrates a block diagram of various systems in accordance with the present invention for implementing a ventricular epicardium registration method in accordance with the present invention.
- FIG. 3 illustrates a flowchart representative of an exemplary embodiment of a ventricular epicardium registration method in accordance with the present invention.
- FIG. 4 illustrates a flowchart representative of an exemplary embodiment of an ultrasound imaging phase in accordance with the present invention.
- FIG. 5 illustrates a flowchart representative of an exemplary embodiment of an X-ray imaging phase in accordance with the present invention.
- FIG. 6 illustrates a flowchart representative of an exemplary embodiment of an imaging registration phase in accordance with the present invention.
- ventricular epicardium may be used for location of the left and/or right ventricles of the heart.
- X-ray images of the ventricular epicardium can be automatically, semi- automatically, or manually-segmented to generate a surface model onto which a position of a viable anatomical feature as visualized by the X-ray images can be annotated.
- large volume imaging can be enabled or multiple smaller volumes can be fused together to capture the shape of the entire ventricular epicardium whereby a viable anatomical feature is often enlarged and visible in ultrasound imaging.
- a position of the anatomical feature can be automatically, semi-automatically or manually annotated onto the ultrasound images.
- X-ray images of the ventricular epicardium of a heart 10 can be segmented to generate a surface model onto which a position of an epicardial surface 11 of a left ventricle of heart 10, a position of an epicardial surface 12 of a right ventricle of heart 10, and/or a position of a coronary sinus vein 13 as visualized in a posterior view of heart 10 by the X-images can be annotated.
- large volume imaging can be enabled or multiple smaller volumes can be fused together to capture the shape of the entire ventricular epicardium of heart 10 whereby coronary sinus vein 13 is enlarged and visible in ultrasound imaging.
- the position of epicardial surface 11 of the left ventricle of heart 10, the position of the epicardial surface 12 of the right ventricle of heart 10, and/or the position of the coronary sinus vein 13 can automatically, semi-automatically or manually annotated onto the ultrasound images.
- the end result of the present invention is a registration of the ultrasound images and the X-ray images to obtain an epicardial surface/coronary venous integration for surgical purposes, such as, for example, the integrated epicardial surface/coronary venous integration 20 shown in FIG. 1.
- integration 20 includes an endocardial surface 21 having a coronary sinus vein 22 spaced from surface 21 and landmarks 23 and 24 (e.g., a catheter tip) related to surface 21.
- FIG. 2 illustrates an X- ray system 30, an ultrasound system 40, and new and unique multimodality registration system 50 having a processor 51 and a memory 51 storing instructions executable by processor 51 for implementing a ventricular epicardium registration method represented by a flowchart 60 shown in FIG. 3.
- X-ray system 30 is any X-ray system structurally configured to generate X-ray images 31 for vessel imaging heart 10, and to communicate X-ray imaging data 32 indicative of the X-ray images 31 to system 50.
- ultrasound system 40 is any ultrasound system structurally configured to generate three-dimensional ultrasound images 41 of a full volume three-dimensional or a multiple-volume three-dimensional ultrasound imaging of heart 10, and to communicate ultrasound imaging data 42 indicative of the ultrasound images 41 to system 50.
- Multimodality registration system 50 is structurally configured with instructions stored in memory 52 and executable by processor 51 to process X-ray venography data 32 and ultrasound data 42 for purposes of implementing flowchart 60.
- an ultrasound imaging phase P61 of flowchart 60 involves processor 51 executing instructions for identifying one or more anatomical features visible in ultrasound images 41.
- An X-ray imaging phase P62 of flowchart 60 involves processor 51 executing instructions for identifying one or more anatomical features visible in X-ray images 31.
- an image registration phase P63 of flowchart 60 involves processor 51 executing instructions for registering images 31 and 41 based on the anatomical feature identifications.
- examples of anatomical features include, but are not limited to, epicardial surfaces 11 and 12 and coronary sinus vein 13 as shown in FIGS. 1 and 2.
- ultrasound imaging phase P61 will typically be performed as a preoperative event while X-ray imaging phase P62 and image registration phase P63 will be performed as operational events.
- a flowchart 70 shown in FIG. 4 is an exemplary embodiment of ultrasound imaging phase P61 in view of epicardial surfaces 11 and 12 and coronary sinus vein 13 serving as the anatomical features.
- a stage S71 of flowchart 70 involves processor 51 generating a three-dimensional epicardial shell from ultrasound data 42
- a stage S72 of flowchart 70 involves processor 51 defining one or more epicardial surface segments of the three-dimensional epicardial shell that can be used to match convex hull segment(s) defined during a stage S83 of flowchart 80 as will be subsequently explained herein.
- a stage S73 of flowchart 70 involves processor 51 annotating a position of coronary sinus vein 13 on the three-dimensional epicardial shell.
- the position of coronary sinus vein 13 includes spatial location coordinates of coronary sinus vein 13, and/or angular orientation coordinates of coronary sinus vein 13.
- a flowchart 80 shown in FIG. 5 is an exemplary embodiment of an X-ray imaging phase P62 in view of epicardial surfaces 11 and 12 and coronary sinus vein 13 serving as the anatomical features.
- a stage S81 of flowchart 80 involves processor 51 generating a three-dimensional vein model from X-ray venography data 32
- a stage S82 of flowchart 80 involves processor 51 generating a three-dimensional convex hull from the three-dimensional vein model for purposes of approximating the entire ventricular epicardium of heart 10.
- a stage S83 of flowchart 80 involves processor 51 defining one or more segments of the three-dimensional convex hull that accurately reflects the ventricular epicardium of heart 10 whereby these convex hull segment(s) can be used to match the epicardial surface segments of the three-dimensional epicardial shell defined during stage S72 of flowchart 70 as previously explained herein.
- a stage S84 of flowchart 80 involves processor 51 annotating a position of coronary sinus vein 13 on the three-dimensional convex hull. The position includes spatial location coordinates of coronary sinus vein 13, and/or angular orientation coordinates of coronary sinus vein 13.
- a flowchart 90 shown in FIG. 6 is an exemplary embodiment of imaging registration phase P63 in view of epicardial surfaces 11 and 12 and coronary sinus vein 13 serving as the anatomical features.
- a stage S91 of flowchart 90 involves processor 91 estimating one or more registration parameters as necessary to thereby obtain a minimal total distance between the convex hull and epicardial surface segments during stage S92 of flowchart 90, and to thereby obtain a minimal total distance between the positions of coronary sinus vein 13 in the three-dimensional convex hull and the three-dimensional epicardial shell during a stage S93 of flowchart 90.
- a stage S94 of flowchart 90 involves processor 51 mapping X-ray images 31 and ultrasound images 41 based on the minimal total distance metric of stages S92 and S93.
- stage S94 of flowchart 90 can involve processor 51 mapping X-ray images 31 and ultrasound images 41 based on the minimal total distance determination of either stage S92 or stage S93 as indicated by the dashed lines.
- additional intrinsic landmarks e.g., an anatomical landmark 21 shown in FIG. 2
- extrinsic landmarks e.g., catheter/electrode tip 22 shown in FIG. 2
- a total distance metric or any other appropriate goodness of fit parameter technique can be used during stages S92 and/or S93.
- the result is a ventricular shell/coronary venous model integration (e.g., endocardial shell/coronary venous model integration 20 shown in FIGS. 1 and 2) for purposes of conducting applicable cardiovascular procedures, such as, for example, interventional X- ray/EP domain procedures, and particularly cardiac resynchronization therapy.
- segmentation of the three- dimensional convex hull is derived from Elco Oost, et.al, "Automated contour detection in X- ray left ventricular angiograms using multiview active appearance models and dynamic programming", IEEE Trans Med Imaging September 2006, (2) segmentation of the three- dimensional epicardial shell is derived from Alison Noble, et.al, "Ultrasound image segmentation: a survey", IEEE Trans Med Imaging, August 2006, and (3) registration of the X-ray and ultrasound images is derived from Audette et al, Medical Image Analysis, 2000.
Abstract
A ventricular epicardium registration method (60) involves three phases. The first phase (P61) is an identification of one or more anatomical features visible within ultrasound images (41) of the ventricular epicardium of the heart (10). The second phase (P62) is an identification of the anatomical feature(s) visible within X-ray images (31) of a ventricular epicardium of a heart (10). The third phase (P63) is a mapping of the ultrasound images (41) and the X-ray images (31) of the ventricular epicardium of the heart (10) based on the identification of the anatomical feature(s) visible within the ultrasound images (41) and the X-ray images (31). Examples of the anatomical feature(s) include, but are not limited to, a portion or an entirety of an epicardial surface (11, 12) and a coronary sinus vein (13).
Description
FUSION OF CARDIAC 3D ULTRASOUND AND X-RAY INFORMATION BASED ON EPICARDIAL SURFACES AND LANDMARKS
Applicant claims benefit of U.S. Provisional Application Serial No. 61/014,455, filed December 18, 2007. Related application is U.S. Provisional Application Serial No. 61/014,451, filed December 18, 2007.
The present invention relates to methods and systems for integrating cardiac three- dimensional X-ray and ultrasound information based on anatomical features (e.g., epicardial surfaces and landmarks) within X-ray and ultrasound images of a ventricular epicardium of a heart.
Patients undergoing cardiac interventions are typically extremely fragile and are in heart failure. They are often unable to tolerate large volume contrast injections that are typical of procedures such as, for example, a ventriculography. In some of these scenarios, multimodal image-based registration requiring ventriculography cannot ethically be performed.
For example, cardiac resynchronization therapies ("CRT's") rely on the implantation of biventricular pacer leads in the right and left heart chambers. To synchronize cardiac contraction, the left ventricular lead position is manipulated within the coronary venous anatomy to position the electrode tip within the region of greatest mechanical delay. Three- dimensional vein models derived from rotational venograms help the physician to identify promising vein branches for lead navigation, whereas dyssynchrony assessment based on three-dimensional ultrasound imaging helps identify the target location for electrode tip placement. To effectively utilize information from X-ray and ultrasound, a registration (i.e., a spatial alignment) between the X-ray and ultrasound images must be computed. One endocardial image technique for registering the X-ray and ultrasound images uses ventriculography-derived LV chamber anatomy in combination with the same chamber imaged with ultrasound for registration. Patients undergoing cardiac resynchronization therapy are, however, typically fragile and are in heart failure, and therefore are often unable to tolerate large volume contrast agent injections that are typically required of procedures such as ventriculography. Ventriculography -based registration of X-ray and ultrasound images is therefore problematic for CRT patients with poor cardiac and renal function.
The approach of the present invention avoids ventriculography entirely, and is more clinically -viable in situations where patients cannot tolerate large volume contrast opacification.
One form of the present invention is a ventricular epicardium registration method involving (1) an identification of one or more anatomical features visible within ultrasound images of a ventricular epicardium of a heart, (2) an identification of the anatomical feature(s) visible within X-ray images of the ventricular epicardium of the heart, and (3) a registration of the X-ray images and the ultrasound images of the ventricular epicardium of the heart based on the identification of the anatomical feature(s) visible within the ultrasound images and the X-ray images. Examples of the anatomical feature(s) include, but are not limited to, a portion or an entirety of an epicardial surface and a coronary sinus vein. A second form of the present invention is a multimodality registration system comprising a processor and memory in communication with the processor wherein the memory stores programming instructions executable by the processor to (1) identify one or more anatomical features visible within ultrasound images of a ventricular epicardium of a heart, (2) identify the anatomical feature(s) visible within X-ray images of the ventricular epicardium of the heart, and (3) register the ultrasound images and the X-ray images of the ventricular epicardium of the heart based on the identification of the anatomical feature(s) visible within the ultrasound images and the X-ray images. The foregoing forms and other forms of the present invention as well as various features and advantages of the present invention will become further apparent from the following detailed description of various embodiments of the present invention read in conjunction with the accompanying drawings. The detailed description and drawings are merely illustrative of the present invention rather than limiting, the scope of the present invention being defined by the appended claims and equivalents thereof.
FIG. 1 illustrates an exemplary embodiment of an integrated epicardial shell/coronary venous model in accordance with present invention.
FIG. 2 illustrates a block diagram of various systems in accordance with the present invention for implementing a ventricular epicardium registration method in accordance with the present invention.
FIG. 3 illustrates a flowchart representative of an exemplary embodiment of a ventricular epicardium registration method in accordance with the present invention.
FIG. 4 illustrates a flowchart representative of an exemplary embodiment of an ultrasound imaging phase in accordance with the present invention.
FIG. 5 illustrates a flowchart representative of an exemplary embodiment of an X-ray imaging phase in accordance with the present invention. FIG. 6 illustrates a flowchart representative of an exemplary embodiment of an imaging registration phase in accordance with the present invention.
The present invention is premised on a recognition that, instead of using ventriculography for delineation of the left and/or right ventricle endocardial surfaces of a heart, ventricular epicardium may be used for location of the left and/or right ventricles of the heart. Specifically, X-ray images of the ventricular epicardium can be automatically, semi- automatically, or manually-segmented to generate a surface model onto which a position of a viable anatomical feature as visualized by the X-ray images can be annotated. Additionally, for three-dimensional ultrasound, large volume imaging can be enabled or multiple smaller volumes can be fused together to capture the shape of the entire ventricular epicardium whereby a viable anatomical feature is often enlarged and visible in ultrasound imaging. As such, a position of the anatomical feature can be automatically, semi-automatically or manually annotated onto the ultrasound images.
For example, referring to FIG. 1 , X-ray images of the ventricular epicardium of a heart 10 can be segmented to generate a surface model onto which a position of an epicardial surface 11 of a left ventricle of heart 10, a position of an epicardial surface 12 of a right ventricle of heart 10, and/or a position of a coronary sinus vein 13 as visualized in a posterior view of heart 10 by the X-images can be annotated. Additionally, for three-dimensional ultrasound, large volume imaging can be enabled or multiple smaller volumes can be fused together to capture the shape of the entire ventricular epicardium of heart 10 whereby coronary sinus vein 13 is enlarged and visible in ultrasound imaging. As such, the position of epicardial surface 11 of the left ventricle of heart 10, the position of the epicardial surface 12 of the right ventricle of heart 10, and/or the position of the coronary sinus vein 13 can automatically, semi-automatically or manually annotated onto the ultrasound images.
The end result of the present invention is a registration of the ultrasound images and the X-ray images to obtain an epicardial surface/coronary venous integration for surgical purposes, such as, for example, the integrated epicardial surface/coronary venous integration 20 shown in FIG. 1. In this example, integration 20 includes an endocardial surface 21
having a coronary sinus vein 22 spaced from surface 21 and landmarks 23 and 24 (e.g., a catheter tip) related to surface 21.
To facilitate a further understanding of the present invention, FIG. 2 illustrates an X- ray system 30, an ultrasound system 40, and new and unique multimodality registration system 50 having a processor 51 and a memory 51 storing instructions executable by processor 51 for implementing a ventricular epicardium registration method represented by a flowchart 60 shown in FIG. 3.
Referring to FIG. 2, X-ray system 30 is any X-ray system structurally configured to generate X-ray images 31 for vessel imaging heart 10, and to communicate X-ray imaging data 32 indicative of the X-ray images 31 to system 50. Complimentarily, ultrasound system 40 is any ultrasound system structurally configured to generate three-dimensional ultrasound images 41 of a full volume three-dimensional or a multiple-volume three-dimensional ultrasound imaging of heart 10, and to communicate ultrasound imaging data 42 indicative of the ultrasound images 41 to system 50. Multimodality registration system 50 is structurally configured with instructions stored in memory 52 and executable by processor 51 to process X-ray venography data 32 and ultrasound data 42 for purposes of implementing flowchart 60.
Specifically, an ultrasound imaging phase P61 of flowchart 60 involves processor 51 executing instructions for identifying one or more anatomical features visible in ultrasound images 41. An X-ray imaging phase P62 of flowchart 60 involves processor 51 executing instructions for identifying one or more anatomical features visible in X-ray images 31. And, an image registration phase P63 of flowchart 60 involves processor 51 executing instructions for registering images 31 and 41 based on the anatomical feature identifications. Again, examples of anatomical features include, but are not limited to, epicardial surfaces 11 and 12 and coronary sinus vein 13 as shown in FIGS. 1 and 2. In practice, ultrasound imaging phase P61 will typically be performed as a preoperative event while X-ray imaging phase P62 and image registration phase P63 will be performed as operational events. Nonetheless, for purposes of the present invention, phases P61-P63 can be practiced as necessary to perform any applicable cardiovascular procedure. A flowchart 70 shown in FIG. 4 is an exemplary embodiment of ultrasound imaging phase P61 in view of epicardial surfaces 11 and 12 and coronary sinus vein 13 serving as the anatomical features. Referring to FIG. 4, a stage S71 of flowchart 70 involves processor 51 generating a three-dimensional epicardial shell from ultrasound data 42, and a stage S72 of
flowchart 70 involves processor 51 defining one or more epicardial surface segments of the three-dimensional epicardial shell that can be used to match convex hull segment(s) defined during a stage S83 of flowchart 80 as will be subsequently explained herein. A stage S73 of flowchart 70 involves processor 51 annotating a position of coronary sinus vein 13 on the three-dimensional epicardial shell. Again, the position of coronary sinus vein 13 includes spatial location coordinates of coronary sinus vein 13, and/or angular orientation coordinates of coronary sinus vein 13.
A flowchart 80 shown in FIG. 5 is an exemplary embodiment of an X-ray imaging phase P62 in view of epicardial surfaces 11 and 12 and coronary sinus vein 13 serving as the anatomical features. Referring to FIG. 5, a stage S81 of flowchart 80 involves processor 51 generating a three-dimensional vein model from X-ray venography data 32, and a stage S82 of flowchart 80 involves processor 51 generating a three-dimensional convex hull from the three-dimensional vein model for purposes of approximating the entire ventricular epicardium of heart 10. In view of the fact that the three-dimensional convex hull may be accurate over a limited portion of epicardial surfaces 11 and 12 (e.g., the apical hull shape may not be accurate), a stage S83 of flowchart 80 involves processor 51 defining one or more segments of the three-dimensional convex hull that accurately reflects the ventricular epicardium of heart 10 whereby these convex hull segment(s) can be used to match the epicardial surface segments of the three-dimensional epicardial shell defined during stage S72 of flowchart 70 as previously explained herein. A stage S84 of flowchart 80 involves processor 51 annotating a position of coronary sinus vein 13 on the three-dimensional convex hull. The position includes spatial location coordinates of coronary sinus vein 13, and/or angular orientation coordinates of coronary sinus vein 13.
A flowchart 90 shown in FIG. 6 is an exemplary embodiment of imaging registration phase P63 in view of epicardial surfaces 11 and 12 and coronary sinus vein 13 serving as the anatomical features. Referring to FIG. 6, a stage S91 of flowchart 90 involves processor 91 estimating one or more registration parameters as necessary to thereby obtain a minimal total distance between the convex hull and epicardial surface segments during stage S92 of flowchart 90, and to thereby obtain a minimal total distance between the positions of coronary sinus vein 13 in the three-dimensional convex hull and the three-dimensional epicardial shell during a stage S93 of flowchart 90. Upon obtaining such minimal total distances, a stage S94 of flowchart 90 involves processor 51 mapping X-ray images 31 and
ultrasound images 41 based on the minimal total distance metric of stages S92 and S93. Alternatively, stage S94 of flowchart 90 can involve processor 51 mapping X-ray images 31 and ultrasound images 41 based on the minimal total distance determination of either stage S92 or stage S93 as indicated by the dashed lines. In further alternative embodiments, additional intrinsic landmarks (e.g., an anatomical landmark 21 shown in FIG. 2) and/or extrinsic landmarks (e.g., catheter/electrode tip 22 shown in FIG. 2) can be used for annotation and/or distance minimization between the X-ray and ultrasound images. Additionally, a total distance metric or any other appropriate goodness of fit parameter technique can be used during stages S92 and/or S93. The result is a ventricular shell/coronary venous model integration (e.g., endocardial shell/coronary venous model integration 20 shown in FIGS. 1 and 2) for purposes of conducting applicable cardiovascular procedures, such as, for example, interventional X- ray/EP domain procedures, and particularly cardiac resynchronization therapy.
Referring to FIG. 1-6, those having ordinary skill in the art will appreciate the various benefits of the present invention including, but not limited to, a reduction or an elimination of external tracking systems that results in low clinical overhead and allows/requires very small contrast boluses. Additionally, in practice, various techniques for the annotation, segmentation and registration requirements of the present invention may be used in dependence upon the specific cardiac procedure being performed and the specific equipment being used to perform the cardiac procedure. Preferably, (1) segmentation of the three- dimensional convex hull is derived from Elco Oost, et.al, "Automated contour detection in X- ray left ventricular angiograms using multiview active appearance models and dynamic programming", IEEE Trans Med Imaging September 2006, (2) segmentation of the three- dimensional epicardial shell is derived from Alison Noble, et.al, "Ultrasound image segmentation: a survey", IEEE Trans Med Imaging, August 2006, and (3) registration of the X-ray and ultrasound images is derived from Audette et al, Medical Image Analysis, 2000.
While the embodiments of the invention disclosed herein are presently considered to be preferred, various changes and modifications can be made without departing from the spirit and scope of the invention. The scope of the invention is indicated in the appended claims, and all changes that come within the meaning and range of equivalents are intended to be embraced therein.
Claims
1. A ventricular epicardium registration method (60), comprising:
(P61) an identification of at least one anatomical feature visible within ultrasound images (41) of a ventricular epicardium of a heart (10); and
(P62) an identification of the at least one anatomical feature visible within X-ray images (31) of the ventricular epicardium of the heart (10);
(P63) a registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the ultrasound images (41) and the X-ray images (31).
2. The ventricular epicardium registration method (60) of claim 1, wherein the at least one anatomical feature includes at least one of an epicardial surface (11, 12) and a coronary sinus vein (13) of the heart (10).
3. The ventricular epicardium registration method (60) of claim 1, wherein (P61) the identification of the at least one anatomical feature visible within the ultrasound images (41) of the ventricular epicardium of the heart (10) includes:
(571) a generation of a three-dimensional epicardial shell.
4. The ventricular epicardium registration method (60) of claim 3, wherein (P61) the identification of the at least one anatomical feature visible within the ultrasound images (41) of the ventricular epicardium of the heart (10) further includes at least one of:
(572) a definition of at least one epicardial surface segment from the three- dimensional epicardial shell; and
(573) an annotation of a position of a coronary sinus vein (13) on the three- dimensional epicardial shell.
5. The ventricular epicardium registration method (60) of claim 1, wherein (P62) the identification of the at least one anatomical feature visible within the X-ray images (31) of the ventricular epicardium of the heart (10) includes: (581) a generation of a three-dimensional vein model based on rotational X-ray venography data (32) indicative of the ventricular epicardium.
6. The ventricular epicardium registration method (60) of claim 5, wherein (P62) the identification of the at least one anatomical feature visible within the X-ray images (31) of the ventricular epicardium of the heart (10) further includes:
(582) a generation of a three-dimensional convex hull as an approximation of the ventricular epicardium based on the three-dimensional vein model.
7. The ventricular epicardium registration method (60) of claim 6, wherein (P62) the identification of the at least one anatomical feature visible within the X-ray images (31) of the ventricular epicardium of the heart (10) further includes at least one of:
(583) a definition of at least one convex hull segment of the three-dimensional convex hull; and
(584) an annotation of a position of a coronary sinus vein (13) on the three- dimensional convex hull.
8. The ventricular epicardium registration method (60) of claim 1, wherein (P63) the registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the X-ray images (31) and the ultrasound images (41) includes:
(S91) at least one estimation of at least one registration parameter;
(S92, S93) for each estimation, a determination of a total distance between the at least one anatomical feature as identified in X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10); and
(S94) mapping the X-ray images (31) and the ultrasound image of the ventricular epicardium based on a minimal total distance between the at least one anatomical feature as identified in X-ray images (31) and the ultrasound image of the ventricular epicardium of the heart (10).
9. The ventricular epicardium registration method (60) of claim 1, wherein (P61) the identification of the at least one anatomical feature visible within ultrasound images (41) of the ventricular epicardium of the heart (10) further includes: (S72) a definition of at least one epicardial shell segment from the three- dimensional epicardial shell; wherein (P62) the identification of the at least one anatomical feature visible within X-ray images (31) of the ventricular epicardium further includes:
(S83) a definition of at least one convex hull segment of the three-dimensional convex hull; and wherein (P63) the registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the X-ray images (31) and the ultrasound images (41) includes:
(591) at least one estimation of at least one registration parameter;
(592) for each estimation, a determination of a total distance between the at least one convex hull segment and the at least one epicardial surface segment; and
(S94) mapping the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium based on a minimal total distance between the at least one convex hull segment and the at least one epicardial surface segment.
10. The ventricular epicardium registration method (60) of claim 1, wherein (P61) the identification of the at least one anatomical feature visible within ultrasound images (41) of the ventricular epicardium of the heart (10) further includes: (S72) a definition of at least one epicardial shell segment from the three- dimensional epicardial shell; wherein (P62) the identification of the at least one anatomical feature visible within X-ray images (31) of the ventricular epicardium further includes:
(S83) a definition of at least one convex hull segment of the three-dimensional convex hull; and wherein (P63) the registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the X-ray images (31) and the ultrasound images (41) includes: (S91) at least one estimation of at least one registration parameter;
(593) for each estimation, a determination of a total distance between the positions of the coronary sinus vein (13) on the three-dimensional convex hull and the three-dimensional epicardial shell; and
(594) mapping the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium based on a minimal total distance between the positions of the coronary sinus vein (13) on the three-dimensional convex hull and the three- dimensional epicardial shell.
11. A multimodality registration system (50), comprising: a processor (51); and a memory (52) in communication with the processor (51), wherein the memory (52) stores programming instructions executable by the processor (51) to:
(P61) identify at least one anatomical feature visible within ultrasound images (41) of a ventricular epicardium of a heart (10); and
(P62) identify the at least one anatomical feature visible within X-ray images (31) of the ventricular epicardium of the heart (10);
(P63) register the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the X-ray images (31) and the ultrasound images (41).
12. The multimodality registration system (50) of claim 11, wherein the at least one anatomical feature includes at least one of an epicardial surface (11, 12) and a coronary sinus vein (13) of the heart (10).
13. The multimodality registration system (50) of claim 11, wherein (P61) an identification of the at least one anatomical feature visible within the ultrasound images (41) of the ventricular epicardium of the heart (10) includes:
(S71) a generation of a three-dimensional epicardial shell.
14. The multimodality registration system (50) of claim 13, wherein (P61) an identification of the at least one anatomical feature visible within the ultrasound images (41) of the ventricular epicardium of the heart (10) further includes at least one of:
(572) a definition of at least one epicardial surface segment from the three- dimensional epicardial shell; and
(573) an annotation of a position of a coronary sinus vein (13) on the three- dimensional epicardial shell.
15. The multimodality registration system (50) of claim 11, wherein (P62) an identification of the at least one anatomical feature visible within the X-ray images (31) of the ventricular epicardium of the heart (10) includes:
(581) a generation of a three-dimensional vein model based on rotational X-ray venography data (32) indicative of the ventricular epicardium.
16. The multimodality registration system (50) of claim 15, wherein (P62) an identification of the at least one anatomical feature visible within the X-ray images (31) of the ventricular epicardium of the heart (10) further includes:
(582) a generation of a three-dimensional convex hull as an approximation of the ventricular epicardium based on the three-dimensional vein model.
17. The multimodality registration system (50) of claim 16, wherein (P62) an identification of the at least one anatomical feature visible within the X-ray images (31) of the ventricular epicardium of the heart (10) further includes at least one of:
(583) a definition of at least one convex hull segment of the three-dimensional convex hull; and
(584) an annotation of a position of a coronary sinus vein (13) on the three- dimensional convex hull.
18. The multimodality registration system (50) of claim 11, wherein (P63) a registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the ultrasound images (41) and the X-ray images (31) includes: (S91) at least one estimation of at least one registration parameter;
(S92, S93) for each estimation, a determination of a total distance between the at least one anatomical feature as identified in X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10); and
(S94) a mapping of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on a minimal total distance between the at least one anatomical feature as identified in X-ray images (31) and the ultrasound images of the ventricular epicardium of the heart (10).
19. The multimodality registration system (50) of claim 11, wherein (P61) the identification of the at least one anatomical feature visible within ultrasound images (41) of the ventricular epicardium of the heart (10) further includes: (S72) a definition of at least one epicardial shell segment from the three- dimensional epicardial shell; wherein (P62) the identification of the at least one anatomical feature visible within X-ray images (31) of the ventricular epicardium further includes:
(S83) a definition of at least one convex hull segment of the three-dimensional convex hull; and wherein (P63) the registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the X-ray images (31) and the ultrasound images (41) includes:
(591) at least one estimation of at least one registration parameter;
(592) for each estimation, a determination of a total distance between the at least one convex hull segment and the at least one epicardial surface segment; and
(S94) a mapping of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium based on a minimal total distance between the at least one convex hull segment and the at least one epicardial surface segment.
20. The multimodality registration system (50) of claim 11, wherein (P61) an identification of the at least one anatomical feature visible within ultrasound images (41) of the ventricular epicardium of the heart (10) includes: (S73) an annotation of a position of the coronary sinus vein (13) on the three- dimensional epicardial shell; wherein (P62) an identification of the at least one anatomical feature visible within X- ray images (31) of the ventricular epicardium of the heart (10) includes:
(S84) an annotation of a position of the coronary sinus vein (13) on the three- dimensional convex hull; and wherein (P63) a registration of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on the identification of the at least one anatomical feature visible within the X-ray images (31) and the ultrasound images (41) includes:
(S91) at least one estimation of at least one registration parameter;
(593) for each estimation, a determination of a total distance between the positions of the coronary sinus vein (13) on the three-dimensional convex hull and the three-dimensional epicardial shell; and
(594) a mapping of the X-ray images (31) and the ultrasound images (41) of the ventricular epicardium of the heart (10) based on a minimal total distance between the positions of the coronary sinus vein (13) on the three-dimensional convex hull and the three-dimensional epicardial shell.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US1445507P | 2007-12-18 | 2007-12-18 | |
| US61/014,455 | 2007-12-18 | ||
| US9963708P | 2008-09-24 | 2008-09-24 | |
| US61/099,637 | 2008-09-24 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2009077971A1 true WO2009077971A1 (en) | 2009-06-25 |
Family
ID=40405017
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IB2008/055309 WO2009077971A1 (en) | 2007-12-18 | 2008-12-15 | Fusion of cardiac 3d ultrasound and x-ray information by means of epicardial surfaces and landmarks |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2009077971A1 (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050031176A1 (en) * | 2003-08-08 | 2005-02-10 | Hertel Sarah R. | Method and apparatus of multi-modality image fusion |
| DE102005023167A1 (en) * | 2005-05-19 | 2006-11-23 | Siemens Ag | Method and device for registering 2D projection images relative to a 3D image data set |
-
2008
- 2008-12-15 WO PCT/IB2008/055309 patent/WO2009077971A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050031176A1 (en) * | 2003-08-08 | 2005-02-10 | Hertel Sarah R. | Method and apparatus of multi-modality image fusion |
| DE102005023167A1 (en) * | 2005-05-19 | 2006-11-23 | Siemens Ag | Method and device for registering 2D projection images relative to a 3D image data set |
Non-Patent Citations (1)
| Title |
|---|
| TIMO MÄKELÄ*MAKELA ET AL: "A Review of Cardiac Image Registration Methods", IEEE TRANSACTIONS ON MEDICAL IMAGING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 21, no. 9, 1 September 2002 (2002-09-01), XP011076356, ISSN: 0278-0062 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5841335B2 (en) | Method and system for multi-modality fusion of imaging data based on statistical models of anatomical structures | |
| US10332253B2 (en) | Methods and devices for registration of image data sets of a target region of a patient | |
| JP5039295B2 (en) | Imaging system for use in medical intervention procedures | |
| US7499743B2 (en) | Method and system for registration of 3D images within an interventional system | |
| CN100518648C (en) | Cardiac CT system for planning and treatment of biventricular pacing | |
| US8532352B2 (en) | Method and system for intraoperative guidance using physiological image fusion | |
| EP1837828B1 (en) | Image registration using locally-weighted fitting | |
| US9687204B2 (en) | Method and system for registration of ultrasound and physiological models to X-ray fluoroscopic images | |
| AU2006302057B2 (en) | Sensor guided catheter navigation system | |
| CA2606366C (en) | Registration of images of an organ using anatomical features outside the organ | |
| US20060078195A1 (en) | Method and system for registering 3D models of anatomical regions with projection images of the same | |
| EP2052362B1 (en) | Registration of electroanatomical mapping points to corresponding image data | |
| JP5122743B2 (en) | System for aligning 3D images within an interventional system | |
| US8422753B2 (en) | Method and system for automatic extraction of personalized left atrium models | |
| Hohmann et al. | A novel open‐source software‐based high‐precision workflow for target definition in cardiac radioablation | |
| JP2021504046A (en) | Alignment of static preoperative planning data with respect to dynamic intraoperative segmentation data | |
| WO2009077971A1 (en) | Fusion of cardiac 3d ultrasound and x-ray information by means of epicardial surfaces and landmarks | |
| KR102347029B1 (en) | Method of rigid registration between 2d x-ray angiogram image and 3d computed tomography angiography image, recording medium and device for performing the method | |
| EP2956065A1 (en) | Method and apparatus for image fusion based planning of c-arm angulation for structural heart disease | |
| Housden et al. | Three-modality registration for guidance of minimally invasive cardiac interventions | |
| Thomas et al. | Mechanical Activation Computation from Fluoroscopy for Guided Cardiac Resynchronization Therapy | |
| Ma et al. | Echocardiography to magnetic resonance image registration for use in image-guide electrophysiology procedures | |
| Koolwal et al. | Catheter localization in the left atrium using an outdated anatomic reference for guidance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08862611 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 08862611 Country of ref document: EP Kind code of ref document: A1 |