CN101609553A - Non-rigid image registration algorithm based on implicit shape representation and edge information fusion - Google Patents

Non-rigid image registration algorithm based on implicit shape representation and edge information fusion Download PDF

Info

Publication number
CN101609553A
CN101609553A CNA2009101007492A CN200910100749A CN101609553A CN 101609553 A CN101609553 A CN 101609553A CN A2009101007492 A CNA2009101007492 A CN A2009101007492A CN 200910100749 A CN200910100749 A CN 200910100749A CN 101609553 A CN101609553 A CN 101609553A
Authority
CN
China
Prior art keywords
registration
image
edge
information fusion
batten
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2009101007492A
Other languages
Chinese (zh)
Inventor
于慧敏
廖秀秀
金伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CNA2009101007492A priority Critical patent/CN101609553A/en
Publication of CN101609553A publication Critical patent/CN101609553A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of non-rigid image registration algorithm based on implicit shape representation and edge information fusion, it comprises following steps: at first, the exterior contour alignment with floating image subject to registration and reference picture realizes the global registration based on implicit shape; Then, selection is carried out local registration based on the Free Transform model of the multi-resolution grid of the B batten of edge information fusion.The invention has the beneficial effects as follows: by in the registration framework, introducing tolerance the edge registration, made full use of the significant contribution of marginal information in image registration, improve accuracy of registration and robustness, obtained transform domain level and smooth, continuous and that assurance is shone upon one to one.

Description

Non-rigid image registration algorithm based on implicit shape representation and edge information fusion
Technical field
This algorithm is the medical image registration method that the hierarchical transformation model of a kind of use from the overall situation to the part covers whole transform domain, particularly solves the image registration problem that big local deformation is arranged.
Background technology
Image registration is the prerequisite of image co-registration, is to generally acknowledge the bigger image processing techniques of difficulty, also is the gordian technique of decision Medical image fusion technical development.Since the later stage eighties, the research of medical figure registration is subjected to the attention of medical circle and engineering circle day by day, the expansion in extensive range in the world.All kinds of bibliographical informations are vast as the open sea, and new method emerges in an endless stream.The method for registering images of existing comparative maturity still is mainly used on rigid body or the accurate rigid body, and for the research of non-rigid body still a little less than the relative thin.Because the complicacy of medical structure itself, diversity, clinical in there not being the rigid boundary, even the registration at the position of obscurity boundary has urgent requirement, impelled the research centre of medical figure registration progressively to shift to non-rigid body field.
At present medical figure registration mainly contains two big classifications: based on the image registration (framework is arranged) of surface with based on the image registration (frameless) of image internal feature.Using mutual information to do to measure the registration medical image is present widely used reasonable a kind of method.Mutual information is a key concept in the information theory, is estimating of two stochastic variable statistic correlations.When two width of cloth reached optimal registration based on the image of common anatomical structure, it is maximum that the gray scale mutual information of their respective pixel should reach.Because this is estimated the relation that does not need between different imaging pattern hypograph gray scales and makes any hypothesis, do not need image is cut apart or any pre-service yet, so be widely used in CT/MR, in the Image Registration such as PET/MR, particularly when the data division of one of them image is damaged, also can obtain good registration effect.Based on the problem that the image registration of mutual information exists, mainly show as the robustness problem of registration, promptly in the process of search optimal transformation, exist the interference of a large amount of local maximums, make registration process be trapped in local maximum easily and cause image to mismatch.
Summary of the invention
The present invention is directed to the deficiency of prior art, a kind of non-rigid image registration algorithm based on implicit shape representation and edge information fusion has been proposed, the steps include: that at first the exterior contour alignment with floating image subject to registration and reference picture realizes the global registration based on implicit shape; Then, selection is carried out local registration based on the Free Transform model of the multi-resolution grid of the B batten of edge information fusion.
Global registration concrete grammar based on implicit shape representation is: the exterior contour of at first using the implicit shape representation image, with the exterior contour of two images subject to registration zero level collection as distance function, the range conversion space that impliedly is embedded into high one dimension, calculate its distance map figure respectively, realize global registration by the mutual information of maximization distance map figure then, the alignment exterior contour obtains the global registration image.
Carrying out local registration concrete grammar based on the Free Transform model of the multi-resolution grid of the B batten of edge information fusion is: at first, merge marginal information; Then, select Free Transform model,, and improve image similarity tolerance by the improvement of level method for registering speed, degree of accuracy and the robustness of the multiresolution B batten control mesh from coarse to meticulous based on the B batten.
Edge and view data integration technology concrete grammar are: at first, reference picture and global registration image are carried out operator filtering respectively, obtain edge-detected image separately, pixel value in the edge-detected image is suppressed greater than the strong edge of certain threshold level by the method that multiply by an inhibiting factor; Then, former figure and edge-detected image are carried out image co-registration by certain weight, form new image; At last, the image after merging is carried out registration by multi-resolution grid Free Transform method.
Local method for registering based on the Free Transform of the multi-resolution grid of B batten is: at first, definition is 2 dimension tensor product forms of 1 dimension cubic B-spline based on the Free Transform of B batten, on reference picture, place sparse, regular lattice point, it is the reference mark, obtain the deformation territory by the motion that defines each reference mark then, use spline interpolation to assess the deformation values of calculating between the reference mark, thereby produce a local control, the level and smooth conversion of the overall situation; Then, progressively reduce the spacing at reference mark, promptly progressively increase the resolution of grid, repeat same step and carry out registration; The registration transformation of representing local deformation by the resolution that improves the reference mark grid.
Advantage of the present invention is: proposed a kind of non-rigid image registration algorithm based on implicit shape representation and edge information fusion that is applicable to complicated image, this algorithm is to improving based on the deformable registration of multi-resolution grid FFD model, in the registration framework, introduce tolerance to the edge registration, made full use of the significant contribution of marginal information in image registration, improve accuracy of registration and robustness, obtained transform domain level and smooth, continuous and that assurance is shone upon one to one.
Description of drawings
Fig. 1 is an image registration algorithm global registration framework of the present invention;
Fig. 2 is the local registration process of image registration algorithm of the present invention.
Embodiment
Below, the present invention is further illustrated with embodiment in conjunction with the accompanying drawings.
The non-rigid image registration based on implicit shape representation and edge information fusion that this algorithm proposes, it comprises the global registration based on implicit shape representation, based on the local registration of the multi-resolution grid Free Transform of the B batten of edge information fusion.Wherein the fundamental purpose of global registration is the registration image exterior contour.The shape center (hereinafter to be referred as " centre of form ") by translation transformation alignment floating image g and reference picture f exterior contour at first, make the translation parameter of overall similarity transformation for very little or be 0, calculate the distance map figure of two width of cloth images after the centre of form is alignd then, utilize similarity transformation, mutual information tolerance, gradient descending method registration distance map figure, obtain the optimal transformation parameter, utilize the parameter that obtains that reference picture is resampled again, finish the global registration process.The global registration framework as shown in Figure 1.
At first extract the exterior contour (closed curve) of image, utilize level set function, promptly use range conversion that exterior contour is embedded into high 1 dimension space as the zero level collection of distance function the exterior contour modeling.For the ease of expression, consider 2 dimension situations.Make Φ: Ω → R +Be the Lipschitz function, the range conversion of expression shape S.Shape S has defined the division of image area Ω: be enclosed in S with interior zone [R S] and background area [Ω-R S].Given above-mentioned definition, implicit shape representation is:
&Phi; S ( x , y ) = 0 , ( x , y ) &Element; S + D ( ( x , y ) , S ) > 0 , ( x , y ) &Element; R S - D ( ( x , y ) , S ) < 0 , ( x , y ) &Element; [ &Omega; - R S ]
Here D ((x, y), S) the presentation video location of pixels (x, y) and the minor increment between the shape S.
We use, and near the arrowband the profile has solved the efficiency of implicit shape representation in registration process as sample area in the embedded space, when improving speed, produced like this can with use the comparable result in entire image zone, and prevented the problem of out-of-bounds point generation error in the process of image registration.
Based on the global registration of maximization mutual information in the global registration of implicit shape representation, the mutual information of two width of cloth image A and B can be defined as follows (the distance map figure that A, B represent the floating image g exterior contour after reference picture f and the centre of form alignment respectively):
I(A,B)=H(A)+H(B)-H(A,B)
Wherein H (A), H (B) and H (A is individual entropy and the combination entropy of stochastic variable A and B B), and it is defined as:
H ( A ) = &Sigma; a - P A ( a ) log P A ( a ) H ( B ) = &Sigma; b - P B ( b ) log P B ( b ) H ( A , B ) = &Sigma; a , b - P A , B ( a , b ) log P A , B ( a , b )
Here P A(a) and P B(b) be marginal probability density function, P A, B(a b) is joint probability density function.
Based on the local registration of the multi-resolution grid Free Transform of B batten, local deformation can assist the global registration model to obtain accurate deformable registration territory.We select to describe local deformation based on the multi-resolution grid Free Transform model of B batten.Make Λ represent reference mark λ I, jA size be n x* n yGrid, reference mark λ I, jProportional spacing δ is arranged.So, Free Transform can be write as 2 dimension tensor product forms of 1 dimension cubic B-spline:
T local ( x , y ) = &Sigma; m = 0 3 &Sigma; n = 0 3 B m ( u ) B n ( v ) &lambda; i + m , j + n
Here
Figure G2009101007492D00053
Figure G2009101007492D00054
Figure G2009101007492D00055
B lRepresent l rank B spline base function:
B 0 ( u ) = ( 1 - u ) 3 / 6 B 1 ( u ) = ( 3 u 3 - 6 u 2 + 4 ) / 6 B 2 ( u ) = ( - 3 u 3 + 3 u 2 + 3 u + 1 ) / 6 B 3 ( u ) = u 3 / 6
The B batten is local control, even this makes it also very high for the reference mark counting yield of big figure.Especially, the basis function of cubic B-spline is limited support, changes reference mark λ in other words I, jOnly in the local neighborhood of reference mark, influence conversion.
Reference mark Λ as B batten Free Transform parameter and the degree of freedom of non-rigid shape deformations, its modeling mainly depends on the resolution of Λ grid.Big reference mark spacing allows overall non-rigid shape deformations, and little reference mark spacing can be to the highly non-rigid shape deformations modeling of localization.Simultaneously, the resolution of reference mark grid has defined the number of degree of freedom, thereby has determined the complexity of calculating.Make Λ 1..., Λ LThe reference mark grid of expression different resolution.The spacing of supposing the reference mark is from Λ lProgressively be reduced to Λ L+1, promptly the resolution of control mesh progressively increases.Each control mesh Λ lDefined the local deformation T of this resolution stage with its B batten FFD that is associated Local l, they with form partial transformation T Local:
T local ( x , y ) = &Sigma; l = 1 L T local l ( x , y )
In this case, partial transformation is the associating of the B batten conversion of reference mark each resolution stage of grid.For prevent to calculate separately several times B batten Free Transform expense, we by the reference mark grid progressively refinement single B batten Free Transform represent partial transformation.Like this, by inserting the reference mark grid that new reference mark grid forms the l+1 level in the l level.Suppose to reduce by half, so reference mark λ in each step reference mark spacing 2i, 2j L+1With λ I, j lThe position be the same, and new reference mark Λ L+1Value can use B batten algorithm of subdivision directly from Λ lValue obtain.
To reference picture f and global registration image g 1Carry out operator filtering respectively, obtain edge-detected image f separately Edge(x, y) and g Ledge(x, y).Owing to use the similarity measurement standard, the introducing at strong edge can seriously weaken the contribution of other weak edge to similarity measurement, therefore need be suppressed strong edge.Method is if pixel value is greater than certain threshold level in the edge-detected image, then it be multiply by one less than 1 inhibiting factor.Then former figure and edge-detected image are carried out image co-registration by certain weight, form new image f ', g 1', at last to image f ', g after merging 1' carry out registration by above-mentioned multi-resolution grid FFD method.Whole local registration process as shown in Figure 2.

Claims (5)

1. non-rigid image registration algorithm based on implicit shape representation and edge information fusion is characterized in that comprising following steps: at first, the exterior contour alignment with floating image subject to registration and reference picture realizes the global registration based on implicit shape; Then, selection is carried out local registration based on the Free Transform model of the multi-resolution grid of the B batten of edge information fusion.
2. the non-rigid image registration algorithm based on implicit shape representation and edge information fusion as claimed in claim 1, it is characterized in that, global registration concrete grammar based on implicit shape representation is: the exterior contour of at first using the implicit shape representation image, with the exterior contour of two images subject to registration zero level collection as distance function, the range conversion space that impliedly is embedded into high one dimension, calculate its distance map figure respectively, realize global registration by the mutual information of maximization distance map figure then, the alignment exterior contour obtains the global registration image.
3. the non-rigid image registration algorithm based on implicit shape representation and edge information fusion as claimed in claim 1, it is characterized in that, local registration concrete grammar based on the Free Transform model of the multi-resolution grid of the B batten of edge information fusion is: at first, merge marginal information; Then, select Free Transform model,, and improve image similarity tolerance by the improvement of level method for registering speed, degree of accuracy and the robustness of the multiresolution B batten control mesh from coarse to meticulous based on the B batten.
4. as claim 1 or 3 described non-rigid image registration algorithms based on implicit shape representation and edge information fusion, it is characterized in that, the fusion method of described marginal information is: at first, reference picture and global registration image are carried out operator filtering respectively, obtain edge-detected image separately, pixel value in the edge-detected image is suppressed greater than the strong edge of certain threshold level by the method that multiply by an inhibiting factor; Then, former figure and edge-detected image are carried out image co-registration by certain weight, form new image; At last, the image after merging is carried out registration by multi-resolution grid Free Transform method.
5. as claim 1 or 3 described non-rigid image registration algorithms based on implicit shape representation and edge information fusion, it is characterized in that, multi-resolution grid Free Transform method for registering based on the B batten is: at first, definition is 2 dimension tensor product forms of 1 dimension cubic B-spline based on the Free Transform of B batten, on reference picture, place sparse, the lattice point of rule, it is the reference mark, obtain the deformation territory by the motion that defines each reference mark then, use spline interpolation to assess the deformation values of calculating between the reference mark, thereby produce a local control, the conversion that the overall situation is level and smooth; Then, progressively reduce the spacing at reference mark, promptly progressively increase the resolution of grid, repeat same step and carry out registration; The registration transformation of representing local deformation by the resolution that improves the reference mark grid.
CNA2009101007492A 2009-07-20 2009-07-20 Non-rigid image registration algorithm based on implicit shape representation and edge information fusion Pending CN101609553A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2009101007492A CN101609553A (en) 2009-07-20 2009-07-20 Non-rigid image registration algorithm based on implicit shape representation and edge information fusion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2009101007492A CN101609553A (en) 2009-07-20 2009-07-20 Non-rigid image registration algorithm based on implicit shape representation and edge information fusion

Publications (1)

Publication Number Publication Date
CN101609553A true CN101609553A (en) 2009-12-23

Family

ID=41483299

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2009101007492A Pending CN101609553A (en) 2009-07-20 2009-07-20 Non-rigid image registration algorithm based on implicit shape representation and edge information fusion

Country Status (1)

Country Link
CN (1) CN101609553A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103247046A (en) * 2013-04-19 2013-08-14 深圳先进技术研究院 Automatic target volume sketching method and device in radiotherapy treatment planning
CN103839068A (en) * 2014-03-27 2014-06-04 大连恒锐科技股份有限公司 Shoe identity determining method
CN106650777A (en) * 2016-10-14 2017-05-10 浙江大学 Object segmentation method with dictionary group being combined
CN106886978A (en) * 2017-02-16 2017-06-23 清华大学深圳研究生院 A kind of super resolution ratio reconstruction method of image
CN107025650A (en) * 2017-04-20 2017-08-08 中北大学 A kind of medical image registration method based on multilayer P battens and sparse coding
CN108549906A (en) * 2018-04-10 2018-09-18 北京全域医疗技术有限公司 Radiotherapy hooks target method for registering images and device
CN111583319A (en) * 2020-05-13 2020-08-25 山东汇贸电子口岸有限公司 Packaging bag image registration method based on local deformation contour matching
CN114266724A (en) * 2021-11-16 2022-04-01 中国航空工业集团公司雷华电子技术研究所 High-voltage line detection method based on radar infrared visible light image fusion

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103247046B (en) * 2013-04-19 2016-07-06 深圳先进技术研究院 The method and apparatus that in a kind of radiotherapy treatment planning, target area is delineated automatically
CN103247046A (en) * 2013-04-19 2013-08-14 深圳先进技术研究院 Automatic target volume sketching method and device in radiotherapy treatment planning
CN103839068A (en) * 2014-03-27 2014-06-04 大连恒锐科技股份有限公司 Shoe identity determining method
CN103839068B (en) * 2014-03-27 2017-03-08 大连恒锐科技股份有限公司 A kind of the same method of shoes
CN106650777B (en) * 2016-10-14 2019-07-05 浙江大学 In conjunction with the Target Segmentation method of dictionary group
CN106650777A (en) * 2016-10-14 2017-05-10 浙江大学 Object segmentation method with dictionary group being combined
CN106886978A (en) * 2017-02-16 2017-06-23 清华大学深圳研究生院 A kind of super resolution ratio reconstruction method of image
CN106886978B (en) * 2017-02-16 2020-01-03 清华大学深圳研究生院 Super-resolution reconstruction method of image
CN107025650A (en) * 2017-04-20 2017-08-08 中北大学 A kind of medical image registration method based on multilayer P battens and sparse coding
CN107025650B (en) * 2017-04-20 2019-10-29 中北大学 A kind of medical image registration method based on multilayer P batten and sparse coding
CN108549906A (en) * 2018-04-10 2018-09-18 北京全域医疗技术有限公司 Radiotherapy hooks target method for registering images and device
CN111583319A (en) * 2020-05-13 2020-08-25 山东汇贸电子口岸有限公司 Packaging bag image registration method based on local deformation contour matching
CN111583319B (en) * 2020-05-13 2022-06-21 山东汇贸电子口岸有限公司 Packaging bag image registration method based on local deformation contour matching
CN114266724A (en) * 2021-11-16 2022-04-01 中国航空工业集团公司雷华电子技术研究所 High-voltage line detection method based on radar infrared visible light image fusion

Similar Documents

Publication Publication Date Title
CN101609553A (en) Non-rigid image registration algorithm based on implicit shape representation and edge information fusion
CN103700101B (en) Non-rigid brain image registration method
Okolie et al. A systematic review and meta-analysis of Digital elevation model (DEM) fusion: Pre-processing, methods and applications
CN100456323C (en) Registration method of three dimension image
Malmberg et al. A graph-based framework for sub-pixel image segmentation
CN102110227B (en) Compound method for classifying multiresolution remote sensing images based on context
Barrera et al. Multispectral piecewise planar stereo using Manhattan-world assumption
CN101911099A (en) Be used for analyzing the method and system of the singularity of digital signal
CN101609550A (en) Method for registering images based on stream shape subspace
Wei et al. Shoreline extraction in SAR image based on advanced geometric active contour model
CN103366375B (en) Image set method for registering based on dynamic directed graph
CN102163329A (en) Super-resolution reconstruction method of single-width infrared image based on scale analogy
CN102254323A (en) Method for carrying out change detection on remote sensing images based on treelet fusion and level set segmentation
CN102693216B (en) Method for tracking point feature based on fractional-order differentiation
Qiu et al. Void filling of digital elevation models with a terrain texture learning model based on generative adversarial networks
CN102945550B (en) A kind of method building remote sensing image semanteme based on Gaussian scale-space
CN115830297A (en) Processing method of remote sensing image change detection sample library
CN105447452A (en) Remote sensing sub-pixel mapping method based on spatial distribution characteristics of features
CN102034115A (en) Markov random field model and non-local prior based image registration method
Chen et al. Construct channel network topology from remote sensing images by morphology and graph analysis
CN101908211B (en) High spectral image fusion method based on variational method
CN103020936A (en) Super-resolution reconstruction method of facial image
Li et al. Unsupervised change detection in SAR images using curvelet and L1-norm based soft segmentation
Maksymiuk et al. Velocity estimation of glaciers with physically-based spatial regularization—Experiments using satellite SAR intensity images
Sun et al. Dynamic post-earthquake image segmentation with an adaptive spectral-spatial descriptor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20091223