WO2006134565A2 - Method of model-based elastic image registration for comparing a first and a second image - Google Patents

Method of model-based elastic image registration for comparing a first and a second image Download PDF

Info

Publication number
WO2006134565A2
WO2006134565A2 PCT/IB2006/051906 IB2006051906W WO2006134565A2 WO 2006134565 A2 WO2006134565 A2 WO 2006134565A2 IB 2006051906 W IB2006051906 W IB 2006051906W WO 2006134565 A2 WO2006134565 A2 WO 2006134565A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
constraints
restricted
landmarks
structures
Prior art date
Application number
PCT/IB2006/051906
Other languages
French (fr)
Other versions
WO2006134565A3 (en
Inventor
Vladimir Pekar
Ingwer-Curt Carlsen
Original Assignee
Koninklijke Philips Electronics N.V.
Philips Intellectual Property & Standards Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V., Philips Intellectual Property & Standards Gmbh filed Critical Koninklijke Philips Electronics N.V.
Priority to JP2008516489A priority Critical patent/JP2008546441A/en
Priority to US11/917,155 priority patent/US20080205719A1/en
Priority to EP06765744A priority patent/EP1894161A2/en
Publication of WO2006134565A2 publication Critical patent/WO2006134565A2/en
Publication of WO2006134565A3 publication Critical patent/WO2006134565A3/en

Links

Classifications

    • G06T3/153
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing

Definitions

  • the invention relates to a method of model-based elastic image registration for comparing a first and a second image, in particular for a medical and/or a biomedical application.
  • the invention also relates to a respective system for model-based elastic image registration for comparing a first and a second image, in particular for a medical and/or biomedical application.
  • the invention relates to an image acquisition device, an image workstation and a computer program product and an information carrier.
  • Image registration is an important procedure in medical image analysis, aiming at obtaining complementary information from different representations of the same anatomy.
  • the goal of image registration is to find a transformation bringing the anatomy in the source and target image into best possible spatial correspondence.
  • Point- based (landmark-based) elastic registration can be carried out by automatically finding corresponding point landmarks in both images and using the point landmark correspondences as constraints to interpolate or approximate the global displacement field as for instance described in "Medical Image Registration", J. V. Hajnal, D.L.G. Hill and DJ.
  • An advantage of parametric methods is the ability to represent non- linear transformations with a moderate number of parameters.
  • One example is deformable registration based on regular B-spline grids as for instance described in "Spline-Based Elastic Image Registration", Karl Rohr, PAMM, Vol. 3, Issue 1, pages 36-39, published online: November 28, 2000.
  • the performance thereof is highly dependent on the grid resolution, with fine grids leading to a high-dimensional search space and coarse grids leading to improper registration of small structures.
  • Desirable is a concept of increased computational efficiency and better results also for inhomogeneous materials.
  • the object of which is to provide, in particular for a medical and/or biomedical application, a method and apparatus of model- based elastic image registration for comparing a first and a second image wherein even upon dealing with inhomogeneous materials computational efficiency and result quality is increased.
  • a method of model-based elastic image registration for comparing a first and a second image comprising the steps of: determining an optimized elastic deformation field by optimizing a similarity measure between the first and the second image on basis of an adaptive elastic registration, wherein deformation field constraints are imposed by automatically providing corresponding control point landmarks in the first and second image applying adaptive Gaussian- shaped forces as a transformation module at the control point landmarks.
  • the step of imposing deformation field constraints further comprises: partitioning one or more of corresponding, restricted structures in the first and the second image; providing additional constraints derived from a-priori-knowledge to the one or more restricted structures.
  • a system for modul-based elastic image registration for comparing a first and a second image comprising: means for determining an optimized elastic deformation field by optimizing a similarity -measure between the first and the second image on basis of an adaptive elastic registration, means for imposing deformation field constraints comprising means for automatically providing corresponding control point landmarks in the first and second image means for applying adaptive Gaussian- shaped forces as a transformation module at the control point landmarks;
  • the means for imposing deformation field constraints further comprises: means for partitioning one or more restricted structures corresponding in the first and the second image; - means for providing additional constraints derived from a-priori-knowledge to the one or more restricted structures.
  • the present invention is directed to improve the elastic registration paradigm by combining the automated optimization procedure for adaptive Gaussian forces with a-priori-knowledge which is applied for restricted structures, correspondingly in the first and the second image, said restricted structures are identified by a proper process of partitioning.
  • Such process may be applied manually, semi-automatically, for instance interactively, or automatically upon use of proper conditions and of a respective system by a user, in particular by a physician.
  • tools for partitioning can be effectively implemented to identify restricted structures in an image and subsequently imposing additional constraints derived from a-priori-knowledge to the one or more restricted structures.
  • A-priori-knowledge is available in various forms as will be described in developed configurations of the inventive concept.
  • the concept leads to effective reduction of computational efforts, and therefore combines the advantages of non- linear model-based elastic image registration concepts based on adaptive Gaussian-shaped forces with practical approaches using a-priori-knowledge.
  • the inventive concept allows to combine offline global optimization concepts with online local refinement concepts at interactive speed. This is of particular importance for online situations like in surgery.
  • global and local registration accuracy requirement can be adapted to foci on clinical interest and registration can be improved to safely handle highly disparate modalities.
  • it can be advantageous in certain situations to neglect an optimization of a global similarity measure to the advantage of an optimization of a local similarity measure.
  • the partitioning step comprises segmentation of the first and second image.
  • segmentation process may be accomplished by various techniques, for instance by a tresholding process or a seed-growing technique.
  • the a-priori-knowledge constraints for the restricted structure are applied as geometrical constraints.
  • Preferred geometrical constraints are imposed by defining a restricted structure in form of a point or a line or an area. Also the form or boundary of an area or a line or a point gives proper geometrical constraints to a restricted structure.
  • the advantage is that geometrical constraints are easy to apply, in particular manually, semi- automatically or automatically if necessary.
  • additional constraints are imposed as interactively defining corresponding point landmarks in the first and second image.
  • additional constraints can be imposed as landmarks resulting from automatic, semi-automatic or interactive identification of corresponding areas or boundaries in the first and second image.
  • Landmarks in form of a point, line or area can be easy applied for instance by manually selecting point landmarks or by applying automated deformable mesh adaptation in images to be registered wherein the vertices of meshes will provide a desired mapping.
  • Meshes of the mentioned kind are preferably provided by a segmentation process mentioned above. This concept is advantageously applied even in the case that structures cannot clearly be identified automatically, e.g. on the basis of gray- values.
  • the a-priori-knowledge constraints for the restricted structure are applied as physiological constraints.
  • different material properties of corresponding structures may be applied to certain geometric structures in an image.
  • the latter may be outlined by a point or a line or an area or a form or a boundary thereof or the like.
  • the inhomogeneous properties of a material are accounted for. For instance different elastic material properties may be given to a first structure of an image as compared to further structures of the image.
  • constraints which clearly transcend mere geometric reasoning.
  • the latter kind of constraints are preferably applied when no geometric landmark can be identified clearly.
  • spatial neighborhood relations can be established.
  • time constraints based on, for instance, tracer dynamics, can be given to impose a-priori- knowledge constraints. Mathematically such schemes lead to more approximation- like concepts instead of strict interpolation- like concepts for clearly defined structures.
  • a digital circuit processor of the mentioned kind may be implemented in one or more multi-processor systems.
  • inventive concept also leads to an image acquisition device and image workstation each comprising the system as described above.
  • the invention leads to a computer program product storable on a medium readable by a computing, imaging and/or printer system, comprising a software code section which induces the computing, imaging and/or printer system to execute the method as described above when the product is executed on the computing, imaging and/or system.
  • the invention also leads to an information carrier comprising the computer program product as described above.
  • the described embodiments are not mandatory.
  • a person skilled in the art may change the order of steps or perform steps concurrently using threading models, multi-processor systems or multiple processes without departing from the concept as intended by the current invention.
  • the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer.
  • several of these means can be embodied by one and the same item of computer readable software or hardware.
  • imaging device in particular comprise systems for medical acquisition of data like 3D- RA, MR, PET, SPECT etc..
  • Fig. 1 depicts a diagrammatic scheme of a system for model-based elastic image registration for comparing a first and a second image in a medical and/or biomedical application according to a preferred embodiment of the invention
  • Fig. 2 depicts a source and a target image of a PET/CT registration of a lung wherein the partitioned restricted structure of the lungs are imposed to an additional constraint with regard to material properties and point landmarks are interactively defined, both kinds of constraints are derived from a-priori-knowledge according to a preferred embodiment of the invention
  • Fig. 1 depicts a diagrammatic scheme of a system for model-based elastic image registration for comparing a first and a second image in a medical and/or biomedical application according to a preferred embodiment of the invention
  • Fig. 2 depicts a source and a target image of a PET/CT registration of a lung wherein the partitioned restricted structure of the lungs are imposed to an additional constraint with regard to material properties and point landmarks are interactively defined
  • FIG. 3 depicts a source and a target image of a CT registration with application to radiation therapy of an abdominopelvic as a further anatomical example using a boundary mapping as an additional constraint of a-priori-knowledge in a further preferred embodiment of the invention
  • Fig. 4 depicts a source and target image and a respective deformed mesh image of a MRI registration of a knee example wherein a smooth deformation field is used for less compressible materials as an additional a-priori-knowledge constraint according to a further preferred embodiment of the invention
  • Fig. 5 depicts images like those of Fig. 4 for a PET/CT registration of a lung wherein an inhomogeneous deformation field is used for more compressible materials as an additional constraint of a-priori-knowledge according to a further preferred embodiment of the invention
  • Fig. 6 depicts a source and a target image of a PET/CT registration of a further anatomical example wherein an additional point landmark constraint is used as a- priori-knowledge according to a preferred embodiment of the invention.
  • the preferred embodiment of the instant invention is directed to physics-based registration of images, i.e. a source image Is(x) indicated by reference mark 3 and a target image I ⁇ (x) indicated by reference mark 5.
  • images i.e. a source image Is(x) indicated by reference mark 3 and a target image I ⁇ (x) indicated by reference mark 5.
  • the elastic deformation or displacement field is indicated by reference mark 7.
  • / : ⁇ — > IR 3 denotes the vector of the applied forces acting on the underlying physical medium.
  • u : ⁇ — > IR 3 is the displacement field
  • L is an operator defining the response of the material.
  • the optimal elastic deformation is determined by optimizing, in particular maximizing a similarity measure M between a source image Is(x) and a target image Ij ⁇ x), which is indicated by reference mark 11.
  • a respective system 1 for model based elastic image registration for comparing a first image 3 and a second image 5 is adapted for a medical and/or biomedical application.
  • Said system 1 comprises means 11 for determining an optimal elastic deformation field 7 by maximizing a similarity measure 11 between the first image Is(x) and the second image Ij ⁇ x) on basis of an adaptive elastic registration.
  • Deformation constraints are imposed by means 13 for automatically providing control point landmarks 2 in the first image 3 and correspondingly control point landmarks 4 in the second image 5.
  • the system 1 provides means 15 for applying adaptive Gaussian- shaped forces f° as a transformation module at the control point landmarks 2, 4.
  • the position of the landmarks 2, 4, the directions and magnitudes of the applied forces f° as well as their influence areas are optimized to reach a maximum of the similarity measure between the images 3 und 5, i.e. Is(x) and Ij ⁇ x).
  • the preferred embodiment of the system 1 provides a means 17 for imposing additional deformation field constraints.
  • the means 17 further comprises means 19 for partitioning one or more of restricted structures, corresponding in the first image 3 and the second image 5; and means 21 for providing additional constraints / Add pa r t derived from a-priori-knowledge to the one or more restricted structures, like for instance the structures indicated by landmarks 2, 4.
  • the preferred embodiment of the instant invention as outlined in Fig. 1 reduces the complexity of the solution process and thereby limits computational costs for optimization and increases efficiency of the solution process. Furthermore, the embodiment of the instant invention achieves to perform the registration process also for inhomogeneous materials and still the computational effort is kept low.
  • FIG. 2 shows on the left hand side a first image 3 in form of a CT image and on the right hand side a second image 5 in form of a PET transmission map each with segmented lung outlines 23 and additional point landmarks 25, both serving as additional deformation field constraints.
  • lung and body outlines can be segmented automatically, for example by using deformable mesh adaptation and corresponding structures identified through a mapping between mesh vertices.
  • point landmarks 25 which may be defined preferably interactively.
  • point landmarks may be defined automatically.
  • the instant embodiment has preferable use in the case point landmarks cannot be defined due to low contrast values or insufficient gray value parameters in an image 3, 5. Defining landmarks 23, 25 interactively, manually or semi-automatically is an essential help to reduce the complexity of the problem to be solved as outlined with regard to Fig. 1.
  • a physiological constraint is imposed to the area 27 defined by the lung outlines 23.
  • tissuel which is different from the elastic property assigned to the tissue2 outside the lung outlines 23. Consequently, different materials in the image are provided with different material properties of the corresponding structure upon registration of the images 3, 5.
  • Interventional applications are a good example to illustrate a possible implementation of this technique.
  • pre- operatively acquired images for instance CT, MR or nuclear images
  • online acquired microscopic, endoscopic or ultra-sound images to monitor or plan the interventional procedure.
  • Registration of such disparate modalities and of images that have been acquired under such different circumstances and patient positioning is hard due to the large non- linear deformations to be compensated and due to the lack of sufficient landmarks that can automatically and unambiguously identified in the respective image data.
  • landmarks such as fiducial markers, surgical instruments, anatomical structures in conjunction with information extracted from the DICOM header accompanying the pre-operatively acquired images and providing information about patient position, details of the acquisition protocol, the anatomical domain imaged etc.
  • a further example of point-to-point correspondences between the boundaries of organs in the images to be registered is given in Fig. 3.
  • the corresponding anatomical structure in a primary image 3 and the follow up image 5 are denoted between regions of different gray- value appearance.
  • Some boundaries 29 are indicated for example as boundaries between bone und tissue or as boundaries between organs.
  • the boundaries 29 can be registered automatically adapting deformable models for instance triangular meshes to the anatomical structures of interest, where certain mesh vertices can also be used as landmarks. In the latter case also landmarks, which have not a reference mark in Fig. 3, can be registered automatically.
  • the proposed concept of the invention can be used to achieve optimized global registration and thereafter, in a second step, to achieve optimized local registration of a certain body organ or another body feature of interest.
  • a knee and to Fig. 5 the lungs are shown in a first image 3 as a source and a second image 5 as a target next to a respective deformation field 6.
  • the underlying deformations can give a clue for assigning the material properties.
  • incompressible elastic materials like those for the bones of a knee in the MRI registration of Fig. 4 are well suited for a modeling such deformation fields.
  • highly compressible elastic materials are advantageous for registration of PET/CT lung images as shown in Fig. 5, where the breathing motion causes considerable local expansion and/or contraction in the images.
  • An elasticity of less compressible material is favorable in cases where the deformation field is smooth like for instance inside the lungs. More compressible materials where the deformation field is inhomogeneous may be applied to an area outside the lung.
  • This kind of assigning different material properties to individual anatomical structures based on the physical properties like compressibility etc. is a further developed embodiment and has advantages over an over-all assigning of a deformation elasticity for an image.
  • a-priori-knowledge about elastic material properties can be derived by explicitly including the Poisson's ratio v into the optimization procedure.
  • a smooth deformation field (of less compressible materials) can be achieved by v — > 0.49.
  • An inhomogenous deformation field (of more compressible materials) can be achieved by v — > 0.0. It's optimal value for a specific registration application can be obtained by test runs and then fixed to reduce the dimensionality of the optimization problem.
  • Fig. 6 depicts a structure where the position of the hot spot indicated by the arrow in the PET image was used as a point landmark to register a CT image with a PET image.
  • MI molecular imaging
  • CTAs may be based on geometric relations restricting CTAs to certain anatomical domains such as organ boundaries, areas of certain cell or tissue types etc.. They may alternatively or in addition be based on time constraints restricting the contrast ranges to match with respect to the tracer dynamics and the timing of the acquisition protocol. These relations will have to be inferred from the pharmaceutical description of the dynamic and the targeting behavior of the tracer substance at hand.
  • the invention aims at improving the point-based elastic registration paradigm.
  • Point-based elastic registration is typically carried out by finding corresponding point landmarks 2, 4 in both images and using the point correspondences as constraints to interpolate the global displacement field.
  • a limitation of this approach is that it only ensures the correspondences between structures where point landmarks 2, 4 can be identified.
  • Alternative concepts are limited by high computational costs for optimization.
  • the concept of the invention provides a method and a system 1 wherein additional deformation fields constraints are imposed by: partitioning (PART (Is, I T )) one or more restricted structures corresponding in the first and the second image and providing additional constraints / Add pa r t derived from a-priori-knowledge to the one or more restricted structures.
  • Preferred examples are i) pairs of interactively defined point landmarks 25, ii) landmarks resulting from automatic identification of corresponding structures in form of a line 23 or an area 27 or a form or a boundary (29, Fig. 3) thereof, iii) different material properties, like tissue 1 and tissue2, of corresponding structures, iv) physiological constraints establishing more general correspondences.

Abstract

The invention aims at improving the point-based elastic registration paradigm. Point-based elastic registration is typically carried out by finding corresponding point landmarks (2, 4) in both images and using the point correspondences as constraints to interpolate the global displacement field. A limitation of this approach is that it only ensures the correspondences between structures where point landmarks (2, 4) can be identified. Alternative concepts are limited by high computational costs for optimization. The concept of the invention provides a method and a system (1) wherein additional deformation field constraints are imposed by: partitioning (PART (IS, IT)) one or more restricted structures corresponding in the first (3) and the second (5) image and imposing additional constraints (ƒAddpart) derived from a-priori-knowledge to the one or more restricted structures. Preferred examples are i) pairs of interactively defined point landmarks (25), ii) landmarks resulting from automatic identification of corresponding structures in form of a line (23) or an area (27) or a form or a boundary (29, Fig. 3) thereof, iii) different material properties (tissuel, tissue2) of corresponding structures, iv) physiological constraints establishing more general correspondences.

Description

Method of model-based elastic image registration for comparing a first and a second image
The invention relates to a method of model-based elastic image registration for comparing a first and a second image, in particular for a medical and/or a biomedical application.
The invention also relates to a respective system for model-based elastic image registration for comparing a first and a second image, in particular for a medical and/or biomedical application.
Also the invention relates to an image acquisition device, an image workstation and a computer program product and an information carrier.
Image registration is an important procedure in medical image analysis, aiming at obtaining complementary information from different representations of the same anatomy. The goal of image registration is to find a transformation bringing the anatomy in the source and target image into best possible spatial correspondence. Many algorithms using rigid and affine transformations exist, which are significantly simpler than those using non- linear transformations, but whose application range is limited. Only few potentially feasible solutions using non- linear transformations exist despite many years of active research. Point- based (landmark-based) elastic registration can be carried out by automatically finding corresponding point landmarks in both images and using the point landmark correspondences as constraints to interpolate or approximate the global displacement field as for instance described in "Medical Image Registration", J. V. Hajnal, D.L.G. Hill and DJ. Hawkes (eds.) CRC Press, 2001. A limitation of this approach is that it only ensures the correspondences between structures where landmarks can be automatically identified. The similarity between the images is maximized only if a very dense point landmark distribution is used, otherwise the registration quality may be poor. A challenging problem in deformable image registration therefore is, coping with the complexity of the underlying non- linear transformations, often resulting in prohibitive computational costs for the practical use. The use of non-parametric transformations may, for example, lead to optimization problems with several million unknowns, where only a few efficient solutions are known in the literature. One is for instance described in "Fast fluid registration of medical images", Bro-Nielsen, M., Gramkow, C. in: Proc. Visualization in Biomedical Computing (VBC'96), Hamburg (1996) 267-276; or "Fast image registration - a variational approach", Fischer, B., Modesitzki, J. in: Proc. of the Int. Conf. on Numerical Analysis and Computational Mathematics (NACoM'03), Cambridge (2003) 69-74.
An advantage of parametric methods is the ability to represent non- linear transformations with a moderate number of parameters. One example is deformable registration based on regular B-spline grids as for instance described in "Spline-Based Elastic Image Registration", Karl Rohr, PAMM, Vol. 3, Issue 1, pages 36-39, published online: November 28, 2000. However, the performance thereof is highly dependent on the grid resolution, with fine grids leading to a high-dimensional search space and coarse grids leading to improper registration of small structures.
A further improvement has been proposed in "Deformable Image Registration by Adaptive Gaussian Forces", V. Pekar, E. Gladilin in: Proc. ECCV 2004, Workshops CVAMIA and MMBIA, pg 317-328, Prague, Czech republic, May 2004, LNCS 3117 Springer, wherein it is assumed that Gaussian-shaped forces are applied at several independent control points in the image to be deformed. This results in an optimization scheme, where the positions of the control points as well as the optimal force strengths and directions are determined which maximize the similarity between images. This method also allows for controlling the local influence of individual control points by explicitly including the Gaussian standard deviation into the optimization process. The latter approach introduces adaptive irregular grids of control points with limited influence area using a physics-based elastic deformation model. Though this strategy is a promising approach it is limited to homogenous elastic materials wherein the image is considered to be an infinite elastic continuum and limited by high computational costs for optimization and the computational efficiency remains limited.
Desirable is a concept of increased computational efficiency and better results also for inhomogeneous materials.
This is where the invention comes in, the object of which is to provide, in particular for a medical and/or biomedical application, a method and apparatus of model- based elastic image registration for comparing a first and a second image wherein even upon dealing with inhomogeneous materials computational efficiency and result quality is increased. As regards the method the object is achieved by a method of model-based elastic image registration for comparing a first and a second image comprising the steps of: determining an optimized elastic deformation field by optimizing a similarity measure between the first and the second image on basis of an adaptive elastic registration, wherein deformation field constraints are imposed by automatically providing corresponding control point landmarks in the first and second image applying adaptive Gaussian- shaped forces as a transformation module at the control point landmarks. According to the invention the step of imposing deformation field constraints further comprises: partitioning one or more of corresponding, restricted structures in the first and the second image; providing additional constraints derived from a-priori-knowledge to the one or more restricted structures.
As regards this apparatus the object is achieved by a system for modul-based elastic image registration for comparing a first and a second image comprising: means for determining an optimized elastic deformation field by optimizing a similarity -measure between the first and the second image on basis of an adaptive elastic registration, means for imposing deformation field constraints comprising means for automatically providing corresponding control point landmarks in the first and second image means for applying adaptive Gaussian- shaped forces as a transformation module at the control point landmarks;
According to the invention the means for imposing deformation field constraints further comprises: means for partitioning one or more restricted structures corresponding in the first and the second image; - means for providing additional constraints derived from a-priori-knowledge to the one or more restricted structures.
In its basic idea the present invention is directed to improve the elastic registration paradigm by combining the automated optimization procedure for adaptive Gaussian forces with a-priori-knowledge which is applied for restricted structures, correspondingly in the first and the second image, said restricted structures are identified by a proper process of partitioning. Such process may be applied manually, semi-automatically, for instance interactively, or automatically upon use of proper conditions and of a respective system by a user, in particular by a physician. It has been realized by the invention that tools for partitioning can be effectively implemented to identify restricted structures in an image and subsequently imposing additional constraints derived from a-priori-knowledge to the one or more restricted structures. A-priori-knowledge is available in various forms as will be described in developed configurations of the inventive concept. Furthermore, the concept leads to effective reduction of computational efforts, and therefore combines the advantages of non- linear model-based elastic image registration concepts based on adaptive Gaussian-shaped forces with practical approaches using a-priori-knowledge.
In particular, as compared to commonplace measures a variety of advantages are achieved by the inventive concept. Firstly a registrational robustness is improved, since it can be guaranteed that certain structures in both, the first (source) image and the second (target) image correspond, which otherwise may be difficult to achieve when applying for instance gray- value-based similarity measures only. As outlined in the introduction, gray-value-based similarity measures lead to problems when landmarks cannot be identified clearly. Secondly the parameter space of degrees of freedom for optimization is restricted and the use of computationally efficient local optimization methods can be feasible.
Thirdly the inventive concept allows to combine offline global optimization concepts with online local refinement concepts at interactive speed. This is of particular importance for online situations like in surgery. In particular global and local registration accuracy requirement can be adapted to foci on clinical interest and registration can be improved to safely handle highly disparate modalities. E.g. it can be advantageous in certain situations to neglect an optimization of a global similarity measure to the advantage of an optimization of a local similarity measure.
This also leads to a large variety of applications of the instant concept which is not restricted only to medical and/or biomedical applications but may in particular also be extended to applications like molecular imaging.
Developed configurations of the invention are further outlined in the dependent claims of the method and system respectively. Thereby the mentioned advantages of the proposed concept are even more improved and in particular the developed configurations give preferred concepts of introducing a-priori-knowledge.
In a preferred embodiment the partitioning step comprises segmentation of the first and second image. Such segmentation process may be accomplished by various techniques, for instance by a tresholding process or a seed-growing technique.
Preferably, the a-priori-knowledge constraints for the restricted structure are applied as geometrical constraints. Preferred geometrical constraints are imposed by defining a restricted structure in form of a point or a line or an area. Also the form or boundary of an area or a line or a point gives proper geometrical constraints to a restricted structure. The advantage is that geometrical constraints are easy to apply, in particular manually, semi- automatically or automatically if necessary.
In a simplifying preferred configuration additional constraints are imposed as interactively defining corresponding point landmarks in the first and second image. Additional or in combination with another preferred configuration additional constraints can be imposed as landmarks resulting from automatic, semi-automatic or interactive identification of corresponding areas or boundaries in the first and second image. Landmarks in form of a point, line or area can be easy applied for instance by manually selecting point landmarks or by applying automated deformable mesh adaptation in images to be registered wherein the vertices of meshes will provide a desired mapping. Meshes of the mentioned kind are preferably provided by a segmentation process mentioned above. This concept is advantageously applied even in the case that structures cannot clearly be identified automatically, e.g. on the basis of gray- values.
In a further advantageous developed configuration the a-priori-knowledge constraints for the restricted structure are applied as physiological constraints. As an exemplifying preferred configuration thereof different material properties of corresponding structures may be applied to certain geometric structures in an image. The latter may be outlined by a point or a line or an area or a form or a boundary thereof or the like. Thereby advantageously the inhomogeneous properties of a material are accounted for. For instance different elastic material properties may be given to a first structure of an image as compared to further structures of the image.
As another example physiological relations may be useful establishing constraints which clearly transcend mere geometric reasoning. In particular the latter kind of constraints are preferably applied when no geometric landmark can be identified clearly. For instance spatial neighborhood relations can be established. As another example time constraints based on, for instance, tracer dynamics, can be given to impose a-priori- knowledge constraints. Mathematically such schemes lead to more approximation- like concepts instead of strict interpolation- like concepts for clearly defined structures.
The method and system and developed configurations thereof as outlined above may be implemented by digital circuits of any preferred kind, whereby the advantages associated with digital circuits may be obtained. A single processor or other unit will fulfill the function of several means recited in the claims. A digital circuit processor of the mentioned kind may be implemented in one or more multi-processor systems.
In particular, the inventive concept also leads to an image acquisition device and image workstation each comprising the system as described above.
Also the invention leads to a computer program product storable on a medium readable by a computing, imaging and/or printer system, comprising a software code section which induces the computing, imaging and/or printer system to execute the method as described above when the product is executed on the computing, imaging and/or system. The invention also leads to an information carrier comprising the computer program product as described above.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
It is, of course, not possible to describe every conceivable configuration of the components or methodologies for purposes of describing the present invention, but one of ordinary skill in the art will recognize that many further combinations and permutations of the present invention are possible.
In particular, as regards the method, the described embodiments are not mandatory. A person skilled in the art may change the order of steps or perform steps concurrently using threading models, multi-processor systems or multiple processes without departing from the concept as intended by the current invention. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In particular in claims enumerating several means, several of these means can be embodied by one and the same item of computer readable software or hardware.
Whereas the invention has particular utility for and will be described as associated with a CT acquisition device, it should be understood that the invention is also operable with other forms of imaging devices capable for reproducing volumetric image data. Such imaging device in particular comprise systems for medical acquisition of data like 3D- RA, MR, PET, SPECT etc..
For a more complete understanding of the invention, reference should be made to the accompanying drawing, wherein:
Fig. 1 depicts a diagrammatic scheme of a system for model-based elastic image registration for comparing a first and a second image in a medical and/or biomedical application according to a preferred embodiment of the invention; Fig. 2 depicts a source and a target image of a PET/CT registration of a lung wherein the partitioned restricted structure of the lungs are imposed to an additional constraint with regard to material properties and point landmarks are interactively defined, both kinds of constraints are derived from a-priori-knowledge according to a preferred embodiment of the invention; Fig. 3 depicts a source and a target image of a CT registration with application to radiation therapy of an abdominopelvic as a further anatomical example using a boundary mapping as an additional constraint of a-priori-knowledge in a further preferred embodiment of the invention;
Fig. 4 depicts a source and target image and a respective deformed mesh image of a MRI registration of a knee example wherein a smooth deformation field is used for less compressible materials as an additional a-priori-knowledge constraint according to a further preferred embodiment of the invention;
Fig. 5 depicts images like those of Fig. 4 for a PET/CT registration of a lung wherein an inhomogeneous deformation field is used for more compressible materials as an additional constraint of a-priori-knowledge according to a further preferred embodiment of the invention;
Fig. 6 depicts a source and a target image of a PET/CT registration of a further anatomical example wherein an additional point landmark constraint is used as a- priori-knowledge according to a preferred embodiment of the invention.
As outlined in Fig. 1 the preferred embodiment of the instant invention is directed to physics-based registration of images, i.e. a source image Is(x) indicated by reference mark 3 and a target image Iτ(x) indicated by reference mark 5. In an elastic image registration for comparing the first image 3 and the second image 5 the images are modeled as physical continua (elastic solid, fluids, etc.) deforming under the application of external forces /. The problem of physics-based registration can be formulated as finding the elastic deformation φ : Ω — > K3 in a spatial domain Ω with the boundary SΩ (Ω = ΩυdΩ). The elastic deformation or displacement field is indicated by reference mark 7. As a basis solving a (generally non- linear) partial differential equation (PDE) of the type indicated by reference mark 9: L(u) = f with the appropriate boundary conditions is used. Here / : Ω — > IR3 denotes the vector of the applied forces acting on the underlying physical medium. Therein u : Ω — > IR3 is the displacement field, and L is an operator defining the response of the material. The connection between the elastic deformation and the displacement field is given as φ(x) = x + u(x) by reference mark 7. The optimal elastic deformation is determined by optimizing, in particular maximizing a similarity measure M between a source image Is(x) and a target image Ij{x), which is indicated by reference mark 11.
In a preferred embodiment a respective system 1 for model based elastic image registration for comparing a first image 3 and a second image 5 is adapted for a medical and/or biomedical application. Said system 1 comprises means 11 for determining an optimal elastic deformation field 7 by maximizing a similarity measure 11 between the first image Is(x) and the second image Ij{x) on basis of an adaptive elastic registration. Deformation constraints are imposed by means 13 for automatically providing control point landmarks 2 in the first image 3 and correspondingly control point landmarks 4 in the second image 5. Additionally, the system 1 provides means 15 for applying adaptive Gaussian- shaped forces f° as a transformation module at the control point landmarks 2, 4.
The position of the landmarks 2, 4, the directions and magnitudes of the applied forces f° as well as their influence areas are optimized to reach a maximum of the similarity measure between the images 3 und 5, i.e. Is(x) and Ij{x).
According to the concept of the invention the preferred embodiment of the system 1 provides a means 17 for imposing additional deformation field constraints. The means 17 further comprises means 19 for partitioning one or more of restricted structures, corresponding in the first image 3 and the second image 5; and means 21 for providing additional constraints /Add part derived from a-priori-knowledge to the one or more restricted structures, like for instance the structures indicated by landmarks 2, 4.
The preferred embodiment of the instant invention as outlined in Fig. 1 reduces the complexity of the solution process and thereby limits computational costs for optimization and increases efficiency of the solution process. Furthermore, the embodiment of the instant invention achieves to perform the registration process also for inhomogeneous materials and still the computational effort is kept low.
This is of essential interest in the development of robust elastic image registration tools in the medical industry and medical workstations. Global elastic registration is required for a variety of clinical applications, where images acquired at different times, with different modalities or different patients have to be aligned. Important examples relate to tumor diagnosis and surgery, where images of different modalities show different aspects of the tumor, comparison of pre- and post-intervention images, analysis of time series of medical images, matching of individual images with anatomical images, etc. An example of providing a-priori-knowledge in registration of a PET/CT lung study is illustrated in Fig. 2. Fig. 2 shows on the left hand side a first image 3 in form of a CT image and on the right hand side a second image 5 in form of a PET transmission map each with segmented lung outlines 23 and additional point landmarks 25, both serving as additional deformation field constraints. In CT images and PET transmission maps, lung and body outlines can be segmented automatically, for example by using deformable mesh adaptation and corresponding structures identified through a mapping between mesh vertices. The same holds for the pairs of point landmarks 25 which may be defined preferably interactively. Additionally, also point landmarks may be defined automatically. However, the instant embodiment has preferable use in the case point landmarks cannot be defined due to low contrast values or insufficient gray value parameters in an image 3, 5. Defining landmarks 23, 25 interactively, manually or semi-automatically is an essential help to reduce the complexity of the problem to be solved as outlined with regard to Fig. 1.
As a further additional deformation field constraint in the embodiment of Fig. 2 a physiological constraint is imposed to the area 27 defined by the lung outlines 23. Inside the lung outlines 23, i.e. area 27, an elastic property is assigned to tissuel which is different from the elastic property assigned to the tissue2 outside the lung outlines 23. Consequently, different materials in the image are provided with different material properties of the corresponding structure upon registration of the images 3, 5.
Further examples for imposing deformation field constraints in form of geometrical constraints are numerous. Interventional applications are a good example to illustrate a possible implementation of this technique. During the intervention, pre- operatively acquired images, for instance CT, MR or nuclear images, will have to be registered with online acquired microscopic, endoscopic or ultra-sound images to monitor or plan the interventional procedure. Registration of such disparate modalities and of images that have been acquired under such different circumstances and patient positioning is hard due to the large non- linear deformations to be compensated and due to the lack of sufficient landmarks that can automatically and unambiguously identified in the respective image data. Here, interactively identified landmarks such as fiducial markers, surgical instruments, anatomical structures in conjunction with information extracted from the DICOM header accompanying the pre-operatively acquired images and providing information about patient position, details of the acquisition protocol, the anatomical domain imaged etc. is essential for guiding the adaptive Gaussian registration process towards an acceptable result by providing additional unambiguous landmarks and force field constraints. A further example of point-to-point correspondences between the boundaries of organs in the images to be registered is given in Fig. 3. The corresponding anatomical structure in a primary image 3 and the follow up image 5 are denoted between regions of different gray- value appearance. Some boundaries 29 are indicated for example as boundaries between bone und tissue or as boundaries between organs. The boundaries 29 can be registered automatically adapting deformable models for instance triangular meshes to the anatomical structures of interest, where certain mesh vertices can also be used as landmarks. In the latter case also landmarks, which have not a reference mark in Fig. 3, can be registered automatically.
Especially in applications of radiation therapy it may be also preferable to accent local optimization instead of global optimization. In a further improved example e.g. in a first step the proposed concept of the invention can be used to achieve optimized global registration and thereafter, in a second step, to achieve optimized local registration of a certain body organ or another body feature of interest.
A further example of deformation field constraints applied as physiological constraints with regard to the material property is given in Fig. 4 and Fig. 5.
With regard to Fig. 4 a knee and to Fig. 5 the lungs are shown in a first image 3 as a source and a second image 5 as a target next to a respective deformation field 6.
Here, the underlying deformations can give a clue for assigning the material properties. For example, in kinematic studies of joints motion, no substantial local contraction or expansion takes place, therefore incompressible elastic materials like those for the bones of a knee in the MRI registration of Fig. 4 are well suited for a modeling such deformation fields. On the contrary, highly compressible elastic materials are advantageous for registration of PET/CT lung images as shown in Fig. 5, where the breathing motion causes considerable local expansion and/or contraction in the images. An elasticity of less compressible material is favorable in cases where the deformation field is smooth like for instance inside the lungs. More compressible materials where the deformation field is inhomogeneous may be applied to an area outside the lung. This kind of assigning different material properties to individual anatomical structures based on the physical properties like compressibility etc. is a further developed embodiment and has advantages over an over-all assigning of a deformation elasticity for an image. Here a-priori-knowledge about elastic material properties can be derived by explicitly including the Poisson's ratio v into the optimization procedure. A smooth deformation field (of less compressible materials) can be achieved by v — > 0.49. An inhomogenous deformation field (of more compressible materials) can be achieved by v — > 0.0. It's optimal value for a specific registration application can be obtained by test runs and then fixed to reduce the dimensionality of the optimization problem.
Fig. 6 depicts a structure where the position of the hot spot indicated by the arrow in the PET image was used as a point landmark to register a CT image with a PET image. This is an example of geometrical and physiological relations for establishing a more general than direct point-to-point landmark correspondences. This is the most advanced application of a-priori-knowledge in conjunction with registration applications on the basis of a Gaussian- force field as it clearly transcends purely geometric reasoning. It addresses a particular issue with molecular imaging (MI). One example is the accumulation of tracer in certain areas of an organ or a tumor like the hot spot in Fig. 6, which are visible in PET images but completely invisible in CT. In this case only approximate special neighbourhood relations can be established. Mathematically this leads to approximation schemes instead of strict interpolation.
This is particular important with improving specificity of tracer substances. Registration of molecular images with images showing anatomical contrasts, as delivered for instance by MR or CT, will become difficult or even impossible due to the loss of anatomical contrast in the MI data. The more specific a tracer, the less general tissue uptake it will show, i.e. the less anatomical contrast will appear in the MI image that may be unambiguously matched with the anatomy as it appears in the CT or MR images. Here, additional information about the relation of centers of tracer accumulation (CTAs) and anatomical entities is needed. These will have to be more general than simple point-to-point correspondences. They may be based on geometric relations restricting CTAs to certain anatomical domains such as organ boundaries, areas of certain cell or tissue types etc.. They may alternatively or in addition be based on time constraints restricting the contrast ranges to match with respect to the tracer dynamics and the timing of the acquisition protocol. These relations will have to be inferred from the pharmaceutical description of the dynamic and the targeting behavior of the tracer substance at hand.
All the deformation field constraints imposed and the examples given above may be applied alone or in combination in further developed embodiments which are not described in detail here.
In summary, the invention aims at improving the point-based elastic registration paradigm. Point-based elastic registration is typically carried out by finding corresponding point landmarks 2, 4 in both images and using the point correspondences as constraints to interpolate the global displacement field. A limitation of this approach is that it only ensures the correspondences between structures where point landmarks 2, 4 can be identified. Alternative concepts are limited by high computational costs for optimization. The concept of the invention provides a method and a system 1 wherein additional deformation fields constraints are imposed by: partitioning (PART (Is, IT)) one or more restricted structures corresponding in the first and the second image and providing additional constraints /Add part derived from a-priori-knowledge to the one or more restricted structures. Preferred examples are i) pairs of interactively defined point landmarks 25, ii) landmarks resulting from automatic identification of corresponding structures in form of a line 23 or an area 27 or a form or a boundary (29, Fig. 3) thereof, iii) different material properties, like tissue 1 and tissue2, of corresponding structures, iv) physiological constraints establishing more general correspondences.
While the invention has been described in detail, the foregoing description is in all aspects illustrative and not restrictive. It is understood that numerous other modifications and variations can be devised without departing from the scope of the inventioa
The features disclosed in the foregoing description, in the claims and/or in the accompanying drawings may, both separately and in any combination thereof, be material for realizing further developed configurations of the invention in diverse forms thereof.
Accordingly, the present invention is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims. In particular any reference signs in the claims shall not be construed as limiting the scope of the invention. The wording "comprising" does not exclude other elements or steps. The wording "a" or "an" does not exclude a plurality. Reference Numerals:
1 system
2 point landmark
3 first image
4 point landmark
5 second image
6 deformation field
7 deformation field
11 means for determining an optimized elastic deformation field
13 means for automatically providing point landmarks
15 means for applying adaptive Gaussian- shaped forces
17 means for imposing deformation field constraints
19 means for partitioning
23 line
25 point, point landmarks
27 area
29 boundary
tissue 1 material property tissue 2 material property
M measure f° Gaussian-shaped force
PART (Is, Ix) partitioning step /Addpart additional constraints

Claims

CLAIMS:
1. Method of model-based elastic image registration for comparing a first (3) and a second (5) image, in particular for a medical and/or a biomedical application, comprising the steps of: determining an optimized elastic deformation field (6, 7) by optimizing a similarity measure (M) between the first (3) and the second (5) image on basis of an adaptive elastic registration, wherein deformation field constraints are imposed by automatically providing corresponding control point landmarks (2, 4) in the first (3) and second (5) image - applying adaptive Gaussian- shaped forces (J°) as a transformation module at the control point landmarks (2, 4); characterized in that the step of imposing deformation field constraints further comprises: partitioning (PART (Is, IT)) one or more restricted structures corresponding in the first (3) and the second (5) image; providing additional constraints (/Add part) derived from a-priori-knowledge to the one or more restricted structures.
2. Method as claimed in claim 1 characterized in that the partitioning step (PART (IS5 IT)) comprises segmentation of the first (3) and second (5) image.
3. Method as claimed in claim 1 or 2 characterized in that the a-priori-knowledge constraints for the restricted structure are applied as geometrical constraints, in particular with regard to a restricted structure in form of a point (25), line (23) or area (27) or a form or a boundary (29, Fig. 3) thereof.
4. Method as claimed in claim 3 characterized in that the additional constraints are imposed as: interactively defined corresponding point landmarks (25) in the first (3) and second (5) image.
5. Method as claimed in claim 3 characterized in that the additional constraints are imposed as: landmarks resulting from automatic, semi-automatic or interactive identification of corresponding lines (23), areas (27) or boundaries (29, Fig. 3) in the first (3) and second (5) image.
6. Method as claimed in one of the claims 1 to 5 characterized in that the a- priori-knowledge constraints for the restricted structure are applied as physiological constraints, in particular with regard to a material property (tissue 1, tissue 2) or a time constraint of the restricted structure (Fig. 6), or a spatial neighborhood relation.
7. Method as claimed in claim 6 characterized in that the additional constraints are imposed as: an elastic property or a tissue type (tissue 1, tissue 2) of the restricted structure.
8. Method as claimed in claim 6 or 7 characterized in that the additional constraints are selected as: automatic, semi-automatic or interactive identification.
9. Method as claimed in one of the claims 1 to 8 characterized in that - boundary conditions are provided at least for some points of the boundaries
(29, Fig. 3) between the restricted structures.
10. System (1) for model-based elastic image registration for comparing a first (3) and a second (5) image, in particular for a medical and/or a biomedical application, comprising: means (11) for determining an optimized elastic deformation field (6, 7) by optimizing a similarity measure (M) between the first (3) and the second (5) image on basis of an adaptive elastic registration, means (17) for imposing deformation field constraints, comprising means (13) for automatically providing corresponding control point landmarks (2, 4) in the first (3) and second (5) image means (15) for applying adaptive Gaussian-shaped forces (J°) as a transformation module at the control point landmarks (2, 4); characterized in that the means (17) for imposing deformation field constraints further comprises: means (19) for partitioning one or more restricted structures corresponding in the first (3) and the second (5) image; means (21) for providing additional constraints (/Add part) derived from a-priori- knowledge to the one or more restricted structures.
11. System (1) as claimed in claim 10 characterized in that the partitioning means
(19) comprises means for segmentation of the first (3) and second (5) image.
12. System (1) as claimed in claim 10 or 11 characterized by a-priori-knowledge constraints for the restricted structure in form of geometrical constraints, in particular with regard to a restricted structure in form of a point (25), line (23) or area or a form or a boundary thereof.
13. System (1) as claimed in one of the claims 10 to 12 characterized by a-priori- knowledge constraints for the restricted structure in form of physiological constraints, in particular with regard to a material property (tissue 1, tissue2) or a time constraint of the restricted structure.
14. System (1) as claimed in one of the claims 10 to 13 characterized by means for automatic, semi-automatic or interactive identification of the additional constraints.
15. Image acquisition device comprising the system (1) as claimed in one of claims 10 to 14.
16. Image workstation comprising the system (1) as claimed in one of claims 10 to 14.
17. Computer program product storable on a medium readable by a computing, imaging and/or printer system, comprising a software code section which induces the computing, imaging and/or printer system to execute the method as claimed in any of the claims 1 to 9 when the product is executed on the computing, imaging and/or printer system.
18. Information carrier comprising the computer program product as claimed in claim 17.
PCT/IB2006/051906 2005-06-15 2006-06-14 Method of model-based elastic image registration for comparing a first and a second image WO2006134565A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2008516489A JP2008546441A (en) 2005-06-15 2006-06-14 Elastic image registration method based on a model for comparing first and second images
US11/917,155 US20080205719A1 (en) 2005-06-15 2006-06-14 Method of Model-Based Elastic Image Registration For Comparing a First and a Second Image
EP06765744A EP1894161A2 (en) 2005-06-15 2006-06-14 Method of model-based elastic image registration for comparing a first and a second image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP05105238.9 2005-06-15
EP05105238 2005-06-15

Publications (2)

Publication Number Publication Date
WO2006134565A2 true WO2006134565A2 (en) 2006-12-21
WO2006134565A3 WO2006134565A3 (en) 2007-02-22

Family

ID=37395855

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/051906 WO2006134565A2 (en) 2005-06-15 2006-06-14 Method of model-based elastic image registration for comparing a first and a second image

Country Status (5)

Country Link
US (1) US20080205719A1 (en)
EP (1) EP1894161A2 (en)
JP (1) JP2008546441A (en)
CN (1) CN101198981A (en)
WO (1) WO2006134565A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009019630A2 (en) * 2007-08-03 2009-02-12 Koninklijke Philips Electronics N.V. Anatomically constrained image registration
WO2010058854A1 (en) 2008-11-20 2010-05-27 Canon Kabushiki Kaisha Information processing apparatus, information processing method, program, and storage medium
WO2012172454A1 (en) * 2011-06-16 2012-12-20 Koninklijke Philips Electronics N.V. Hybrid point-based registration
EP2923262A4 (en) * 2012-11-23 2016-07-13 Cadens Medical Imaging Inc Method and system for displaying to a user a transition between a first rendered projection and a second rendered projection

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2044884B1 (en) * 2007-10-02 2015-12-09 Brainlab AG Detection and determination of changes in position of structural parts of a body
EP2249702A4 (en) * 2008-03-04 2012-01-25 Tomotherapy Inc Method and system for improved image segmentation
EP2422318B1 (en) * 2009-04-15 2019-10-16 Koninklijke Philips N.V. Quantification of medical image data
CN102549623B (en) * 2009-06-10 2014-11-19 皇家飞利浦电子股份有限公司 Visualization apparatus for visualizing an image data set
CN102460509B (en) * 2009-06-24 2015-01-07 皇家飞利浦电子股份有限公司 Establishing a contour of a structure based on image information
WO2011010231A1 (en) * 2009-07-20 2011-01-27 Koninklijke Philips Electronics N.V. Anatomy modeling for tumor region of interest defiinition
WO2012035538A1 (en) * 2010-09-16 2012-03-22 Mor Research Applications Ltd. Method and system for analyzing images
US9579079B2 (en) 2011-01-05 2017-02-28 Koninklijke Philips Electronics N.V. Device and method for determining actual tissue layer boundaries of a body
WO2012109641A2 (en) * 2011-02-11 2012-08-16 Emory University Systems, methods and computer readable storage mediums storing instructions for 3d registration of medical images
DE102011080905B4 (en) * 2011-08-12 2014-03-27 Siemens Aktiengesellschaft Method for visualizing the registration quality of medical image data sets
WO2014022480A1 (en) * 2012-07-31 2014-02-06 Henry Ford Health System Deformable dosimetric phantom
US9443633B2 (en) 2013-02-26 2016-09-13 Accuray Incorporated Electromagnetically actuated multi-leaf collimator
JP6131161B2 (en) * 2013-09-27 2017-05-17 富士フイルム株式会社 Image registration apparatus, method, program, and three-dimensional deformation model generation method
CN106030655B (en) 2014-01-06 2019-07-23 皇家飞利浦有限公司 Articulated structure registration in the magnetic resonance image of brain
CN107851303B (en) * 2015-07-17 2023-03-14 皇家飞利浦有限公司 Histopathological image registration method and device
CN106056586B (en) * 2016-05-25 2019-08-09 湖南拓视觉信息技术有限公司 A kind of sub-pixel positioning method and device
CN106691487B (en) * 2017-01-05 2021-01-05 东软医疗系统股份有限公司 Imaging method and imaging system
US10635930B2 (en) * 2017-02-24 2020-04-28 Siemens Healthcare Gmbh Patient position control for scanning
US11010630B2 (en) 2017-04-27 2021-05-18 Washington University Systems and methods for detecting landmark pairs in images
CN113724307B (en) * 2021-09-02 2023-04-28 深圳大学 Image registration method and device based on characteristic self-calibration network and related components
CN114187338B (en) * 2021-12-08 2023-04-28 卡本(深圳)医疗器械有限公司 Organ deformation registration method based on estimated 2d displacement field

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1695289A1 (en) * 2003-12-08 2006-08-30 Philips Intellectual Property & Standards GmbH Adaptive point-based elastic image registration
WO2006036842A2 (en) * 2004-09-24 2006-04-06 The University Of North Carolina At Chapel Hill Methods, systems, and computer program products for hierarchical registration between a blood vessel and tissue surface model for a subject and blood vessel and tissue surface image for the subject
JP5676840B2 (en) * 2004-11-17 2015-02-25 コーニンクレッカ フィリップス エヌ ヴェ Improved elastic image registration function
JP5015804B2 (en) * 2005-01-28 2012-08-29 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ User interface for motion analysis in kinematic MR examination
EP1941455A1 (en) * 2005-10-17 2008-07-09 Koninklijke Philips Electronics N.V. Motion estimation and compensation of image sequences
EP1969564A2 (en) * 2005-12-20 2008-09-17 University of Maryland, Baltimore Method and apparatus for accelerated elastic registration of multiple scans of internal properties of a body

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
B.FISCHER; J.MODESITZKI.: ""Fast image registration - a variational approach"", PROC. OF THE INT. CONF. ON NUMERICAL ANALYSES AND COMPUTATIONAL MATHEMATICS (NACOM'03), 2003, CAMBRIDGE, pages 69 - 74
J.V.HAJNAL; D.L.G.HILL; D.J.HAWKES., "MEDICAL IMAGE REGISTRATION", 2001, CRC PRESS
M.BRO-NIELSEN; C.GRAMKOW.: ""Fast fluid registration of medical images"", PROC. VISUALIZATION IN BIOMEDICAL COMPUTING (VCB'96), 1996, HAMBURG, pages 267 - 276
V.PEKAR; E.GLADILIN.: ""Deformable Image Registation by Adaptive Gaussian Forces"", PROC. ECCV 2004, WORKSHOPS CVAMIA AND MMBIA., May 2004 (2004-05-01), PRAGUE, CZECH. REPUBLIC, LNCS 3117 SPRINGE., pages 317 - 328

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009019630A2 (en) * 2007-08-03 2009-02-12 Koninklijke Philips Electronics N.V. Anatomically constrained image registration
WO2009019630A3 (en) * 2007-08-03 2009-08-13 Koninkl Philips Electronics Nv Anatomically constrained image registration
WO2010058854A1 (en) 2008-11-20 2010-05-27 Canon Kabushiki Kaisha Information processing apparatus, information processing method, program, and storage medium
EP2358277A4 (en) * 2008-11-20 2017-04-26 Canon Kabushiki Kaisha Information processing apparatus, information processing method, program, and storage medium
WO2012172454A1 (en) * 2011-06-16 2012-12-20 Koninklijke Philips Electronics N.V. Hybrid point-based registration
US9600856B2 (en) 2011-06-16 2017-03-21 Koninklijke Philips N.V. Hybrid point-based registration
EP2923262A4 (en) * 2012-11-23 2016-07-13 Cadens Medical Imaging Inc Method and system for displaying to a user a transition between a first rendered projection and a second rendered projection
US10905391B2 (en) 2012-11-23 2021-02-02 Imagia Healthcare Inc. Method and system for displaying to a user a transition between a first rendered projection and a second rendered projection

Also Published As

Publication number Publication date
WO2006134565A3 (en) 2007-02-22
EP1894161A2 (en) 2008-03-05
US20080205719A1 (en) 2008-08-28
CN101198981A (en) 2008-06-11
JP2008546441A (en) 2008-12-25

Similar Documents

Publication Publication Date Title
US20080205719A1 (en) Method of Model-Based Elastic Image Registration For Comparing a First and a Second Image
Ferrante et al. Slice-to-volume medical image registration: A survey
Ferrant et al. Serial registration of intraoperative MR images of the brain
Oliveira et al. Medical image registration: a review
Schnabel et al. A generic framework for non-rigid registration based on non-uniform multi-level free-form deformations
Cootes et al. A unified framework for atlas matching using active appearance models
EP1695287B1 (en) Elastic image registration
Maes et al. Medical image registration using mutual information
EP1719078B1 (en) Device and process for multimodal registration of images
US20080095422A1 (en) Alignment method for registering medical images
WO2001043070A2 (en) Method and apparatus for cross modality image registration
EP2052362B1 (en) Registration of electroanatomical mapping points to corresponding image data
Rohr Elastic registration of multimodal medical images: A survey
Penney et al. A stochastic iterative closest point algorithm (stochastICP)
Zheng et al. (i) Registration techniques for computer navigation
Walimbe et al. Automatic elastic image registration by interpolation of 3D rotations and translations from discrete rigid-body transformations
Fang et al. 3D shape reconstruction of lumbar vertebra from two X-ray images and a CT model
Samir et al. Elastic shape analysis of cylindrical surfaces for 3D/2D registration in endometrial tissue characterization
Papademetris et al. Articulated rigid registration for serial lower-limb mouse imaging
Pekar et al. An adaptive irregular grid approach for 3D deformable image registration
Sindhu Madhuri Classification of image registration techniques and algorithms in digital image processing–a research survey
Morooka et al. A survey on statistical modeling and machine learning approaches to computer assisted medical intervention: Intraoperative anatomy modeling and optimization of interventional procedures
EP1695289A1 (en) Adaptive point-based elastic image registration
CN116612166A (en) Registration fusion algorithm for multi-mode images
Wirth et al. Point-to-point registration of non-rigid medical images using local elastic transformation methods

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006765744

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 11917155

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2008516489

Country of ref document: JP

Ref document number: 200680021261.5

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: DE

WWE Wipo information: entry into national phase

Ref document number: 251/CHENP/2008

Country of ref document: IN

WWP Wipo information: published in national office

Ref document number: 2006765744

Country of ref document: EP