EP1563460A1 - Procede de recalage d'images - Google Patents
Procede de recalage d'imagesInfo
- Publication number
- EP1563460A1 EP1563460A1 EP03778261A EP03778261A EP1563460A1 EP 1563460 A1 EP1563460 A1 EP 1563460A1 EP 03778261 A EP03778261 A EP 03778261A EP 03778261 A EP03778261 A EP 03778261A EP 1563460 A1 EP1563460 A1 EP 1563460A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- criterion
- displacement
- distance
- control points
- smoothness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000006073 displacement reaction Methods 0.000 claims abstract description 22
- 238000011156 evaluation Methods 0.000 claims abstract description 4
- 230000009466 transformation Effects 0.000 claims abstract description 3
- 238000013459 approach Methods 0.000 claims description 4
- 238000005452 bending Methods 0.000 claims description 2
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- 238000011161 development Methods 0.000 claims description 2
- 230000000737 periodic effect Effects 0.000 claims description 2
- 230000002123 temporal effect Effects 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000004613 tight binding model Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000011478 gradient descent method Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012804 iterative process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/14—Transformations for image registration, e.g. adjusting or mapping for alignment of images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
Definitions
- the invention relates to a method for image registration, ie for correcting geometric differences in different representations of an object.
- These processes play e.g. play an important role in medical technology and especially in the analysis of tissue changes in the context of early cancer detection.
- This object is achieved according to the invention by iteratively determining a transformation which is optimal with regard to a predetermined distance and smoothness criterion, in which corresponding control points are guaranteed to be mapped to one another by (1.) initializing an iteration counter and the initial displacement field, (2.) Determination of the numerical solutions of the non-linear partial differential equation (PDE) with the differential operator derived from a given smoothness criterion and the point evaluation functionals located at given control points, (3.) summarizing the interpolation conditions, (4.) calculating a special numerical solution of the PDE with the force determined on the basis of the distance criterion and the current displacement field and the differential operator derived from the smoothness criterion, (5.) evaluating the special solution at the control points, (6.) determining the coefficients to calculate an updated displacement, (7.) update the displacement field and increase the iteration counter, (8.) check the displacement for convergence and (9.) if the convergence criterion is not met, repeat steps (4.) to (8.
- reference image reference image
- template T template
- the reference and template can be in discrete form.
- T u T u (x)
- T u T (x -u (x)
- a minimizer of the abovementioned distance criterion can be determined in an iterative manner by means of a gradient descent method.
- any distance criterion can be selected.
- the forces associated with the common distance criteria can be found in the literature (Modersitzki 2002). However, the specific way in which these forces are calculated is not essential for the registration process.
- any functional known from the literature can be used as a smoothness criterion.
- a partial differential operator A can be derived from the smoothness criterion. These operators are known for the criteria used in the literature (Modersitzki 2002).
- the desired shift u can then be characterized as a solution of a non-linear partial differential equation (PDE).
- PDE non-linear partial differential equation
- This procedure coincides with the procedure for the method based solely on the distance criterion and the smoothness criterion.
- the specific numerical method for the solution of the PDE is irrelevant for the registration procedure.
- the v J , j ⁇ ⁇ , ..., m are Green's functions of the differential operator A, which represent a solution of the PDE for a given single point shift.
- a suitable linear combination of these Green functions therefore ensures that all control points are mapped onto one another as required in the overall process.
- the function v ° is determined using an iterative process so that the distance criterion is minimized while maintaining the required smoothness.
- the weighting factors / L * are adjusted so that the control points are mapped in the required manner.
- the initialization according to the invention is followed by a common iteration procedure, in the course of which a gradient descent is carried out taking into account the control points. Human intervention is not necessary.
- the described method thus combines the advantages of the methods based on distance criteria (in particular the ability to be automated and an optimal registration on average) with those of the checkpoint procedure (guaranteed registration of excellent points) and, when specifying an initial set of checkpoints, provides reproducible, optimal results regardless of the user or computer program.
- the details of the computer code do not play a significant role in the final result of the image registration and only influence the required computing time and the storage requirements.
- the images to be registered can be digital images, pixels, JPEG, wavelet-based objects or acoustic signals.
- linear equation systems occurring in the method can be solved directly, indirectly, iteratively or by means of multigrid and a reference coordinate system can be used for the method, which is represented by Euler or Lagrange coordinates.
- the invention proposes to register one-, two- or three-dimensional objects as well as sequences of one-, two- and three-dimensional objects and to use control points which are anatomical landmarks, fiducial markers or other characteristic parameters.
- One proposed distance criterion is based on intensity, edge, corner, surface normal or level set or on the sum of squared differences, I 2 distance, correlation, variants of the correlation, Mutual information or variants of the mutual information is based.
- the force terms associated with the distance measure should be calculated using finite difference methods or gradient formation and the smoothness criterion used should be physically motivated via an elastic potential or a fluid approach based on temporal or spatial derivations of the displacement via diffusive or curvature approaches.
- boundary conditions of the differential operator should advantageously be given via explicit or implicit, Neumann, Dirichlet, sliding, bending or periodic boundary conditions.
- the type of discretization of the differential operator should be based on finite differences, finite volumes, finite elements, Fourier methods, series development, filter techniques, collocations or multigrid, and the interpolation should be carried out one-dimensionally using splines or wavelets.
- the move can be explicitly updated using the increment of the move or its time derivative.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
L'invention concerne un procédé de recalage d'images par détermination itérative d'une transformation optimale relativement à un critère de distance et à un critère de planéité prédéterminés, caractérisé en ce que des points de contrôle correspondants dans les images sont mis en correspondance les uns avec les autres de façon garantie. Ce procédé consiste à (1) initialiser un compteur d'itérations et le champ de déplacement initial, (2) déterminer les solutions numériques de l'équation aux dérivées partielles (PDE) non linéaire avec l'opérateur différentiel dérivable d'un critère de planéité prédéterminé et les fonctions d'évaluation de points localisées au niveau de points de contrôle prédéterminés, (3) réunir les conditions d'interpolation, (4) calculer une solution numérique spéciale de la PDE avec la force déterminée sur la base du critère de distance et du champ de déplacement actuel et l'opérateur différentiel dérivé du critère de planéité, (5) évaluer la solution spéciale au niveau des points de contrôle, (6) déterminer les coefficients pour calculer un déplacement actualisé, (7) mettre à jour le champ de déplacement et incrémenter le compteur d'itérations, (8) contrôler le déplacement du point de vue de la convergence et (9) répéter les étapes (4) à (8) si le critère de convergence n'est pas rempli.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE10253784 | 2002-11-19 | ||
DE10253784A DE10253784A1 (de) | 2002-11-19 | 2002-11-19 | Verfahren zur Bildregistrierung |
PCT/DE2003/003805 WO2004047024A1 (fr) | 2002-11-19 | 2003-11-18 | Procede de recalage d'images |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1563460A1 true EP1563460A1 (fr) | 2005-08-17 |
Family
ID=32318525
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP03778261A Ceased EP1563460A1 (fr) | 2002-11-19 | 2003-11-18 | Procede de recalage d'images |
Country Status (5)
Country | Link |
---|---|
US (1) | US20060008179A1 (fr) |
EP (1) | EP1563460A1 (fr) |
AU (1) | AU2003285277A1 (fr) |
DE (1) | DE10253784A1 (fr) |
WO (1) | WO2004047024A1 (fr) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7639896B2 (en) | 2004-08-09 | 2009-12-29 | Carestream Health, Inc. | Multimodal image registration using compound mutual information |
WO2006095221A2 (fr) * | 2005-03-11 | 2006-09-14 | Philips Intellectual Property & Standards Gmbh | Procede d'imagerie |
JP4398919B2 (ja) * | 2005-08-22 | 2010-01-13 | 株式会社東芝 | 画像マッチング装置、画像マッチング方法および画像マッチングプログラム |
US8064664B2 (en) * | 2006-10-18 | 2011-11-22 | Eigen, Inc. | Alignment method for registering medical images |
JP5908898B2 (ja) * | 2011-05-16 | 2016-04-26 | テルモ株式会社 | クランプおよび血液バッグシステム |
US9939509B2 (en) * | 2014-01-28 | 2018-04-10 | Ohio State Innovation Foundation | Variable density incoherent spatiotemporal acquisition (VISTA) for highly accelerated magnetic resonance imaging |
US10607334B2 (en) | 2014-12-09 | 2020-03-31 | Asml Netherlands B.V. | Method and apparatus for image analysis |
US10437157B2 (en) | 2014-12-09 | 2019-10-08 | Asml Netherlands B.V. | Method and apparatus for image analysis |
CN107437253B (zh) * | 2017-08-07 | 2020-10-23 | 江西农业大学 | 一种基于灭点的条播作物行提取的预处理方法 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5850486A (en) * | 1996-04-29 | 1998-12-15 | The Mclean Hospital Corporation | Registration of image data |
US6226418B1 (en) * | 1997-11-07 | 2001-05-01 | Washington University | Rapid convolution based large deformation image matching via landmark and volume imagery |
US6633686B1 (en) * | 1998-11-05 | 2003-10-14 | Washington University | Method and apparatus for image registration using large deformation diffeomorphisms on a sphere |
WO2002056241A1 (fr) * | 2001-01-12 | 2002-07-18 | University Of Florida | Algorithmes computationnels pour enregistrement d'images |
-
2002
- 2002-11-19 DE DE10253784A patent/DE10253784A1/de not_active Withdrawn
-
2003
- 2003-11-18 AU AU2003285277A patent/AU2003285277A1/en not_active Abandoned
- 2003-11-18 WO PCT/DE2003/003805 patent/WO2004047024A1/fr not_active Application Discontinuation
- 2003-11-18 US US10/535,682 patent/US20060008179A1/en not_active Abandoned
- 2003-11-18 EP EP03778261A patent/EP1563460A1/fr not_active Ceased
Non-Patent Citations (1)
Title |
---|
See references of WO2004047024A1 * |
Also Published As
Publication number | Publication date |
---|---|
DE10253784A1 (de) | 2005-06-02 |
WO2004047024A1 (fr) | 2004-06-03 |
US20060008179A1 (en) | 2006-01-12 |
AU2003285277A1 (en) | 2004-06-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1191476B1 (fr) | Dispositif et procédé de calcul d'une transformation de correspondance pour deux images | |
CN104008538B (zh) | 基于单张图像超分辨率方法 | |
DE102008032006B4 (de) | Verfahren zur Steurung der Bildaufnahme bei einer Bildaufnahmeeinrichtung, sowie eine Bildaufnahmeeinrichtung | |
EP1958154B1 (fr) | Procede pour la representation topographique de modifications dans un cerveau examine | |
EP2284795A2 (fr) | Analyse quantitative, visualisation, et correction de mouvement dans des processus dynamiques | |
DE10392259T5 (de) | Objektkorrespondenzidentifikation ohne volle Volumenregistration | |
WO2005059831A1 (fr) | Mise en correspondance flexible d'images | |
DE102007019514A1 (de) | Allgemeines Framework für die Bildsegmentierung unter Verwendung geordneter räumlicher Abhängigkeit | |
DE102005003605A1 (de) | Vorwissen, Niveaumengenrepräsentationen und visuelle Gruppierung | |
DE102010016034A1 (de) | Verfahren und Systeme zum Anzeigen quantitativer segmentaler Daten im 4D-Rendering | |
EP1563460A1 (fr) | Procede de recalage d'images | |
DE102006050364A1 (de) | Verfahren zum Detektieren und Verfolgen deformierbarer Objekte unter Verwendung eines adaptiven zeitvariierenden autoregressiven Modells | |
Attia et al. | Spatially aware melanoma segmentation using hybrid deep learning techniques | |
Rogelj et al. | Validation of a nonrigid registration algorithm for multimodal data | |
Freiman et al. | A curvelet-based patient-specific prior for accurate multi-modal brain image rigid registration | |
EP3391337A1 (fr) | Systèmes et procédés de traitement d'images | |
Boone et al. | ROOD-MRI: Benchmarking the robustness of deep learning segmentation models to out-of-distribution and corrupted data in MRI | |
Oeuvray et al. | A new derivative-free algorithm for the medical image registration problem | |
DE102020210136A1 (de) | Magnetresonanz-Bildgebungsrekonstruktion unter Verwendung von Maschinenlernen | |
CN100550056C (zh) | 在图像序列中进行运动校正的方法及系统 | |
Färber et al. | Live-wire-based segmentation using similarities between corresponding image structures | |
DE19829170C2 (de) | Berechnung und Darstellung 2- oder 3-dimensionaler Deformationen räumlicher Strukturen | |
Kasiri et al. | Multi-modal image registration using structural features | |
CN112435284A (zh) | 图像配准方法、电子设备及存储介质 | |
Boukellouz et al. | Evaluation of several similarity measures for deformable image registration using T1-weighted MR images of the brain |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20050510 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20060623 |