CN105488849B - A kind of three-dimensional tooth modeling method based on mixed-level collection - Google Patents
A kind of three-dimensional tooth modeling method based on mixed-level collection Download PDFInfo
- Publication number
- CN105488849B CN105488849B CN201510821682.7A CN201510821682A CN105488849B CN 105488849 B CN105488849 B CN 105488849B CN 201510821682 A CN201510821682 A CN 201510821682A CN 105488849 B CN105488849 B CN 105488849B
- Authority
- CN
- China
- Prior art keywords
- mrow
- msub
- mtd
- mtr
- phi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000011218 segmentation Effects 0.000 claims abstract description 30
- 230000004907 flux Effects 0.000 claims abstract description 15
- 210000000988 bone and bone Anatomy 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 238000009499 grossing Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 4
- 210000000332 tooth crown Anatomy 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 abstract description 3
- 239000007787 solid Substances 0.000 abstract description 3
- 238000009472 formulation Methods 0.000 abstract 1
- 239000000203 mixture Substances 0.000 abstract 1
- 239000010410 layer Substances 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 4
- 238000004195 computer-aided diagnosis Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000002068 genetic effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 208000025157 Oral disease Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002051 biphasic effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 238000002513 implantation Methods 0.000 description 1
- 239000011229 interlayer Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 238000003325 tomography Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/30—Polynomial surface description
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Mathematical Analysis (AREA)
- Algebra (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
本发明提供一种基于混合水平集的三维牙齿建模方法,包括以下几个步骤:1)起始切片的选取和水平集初始化;2)利用先验形状约束能量、基于Flux模型的边缘能量、基于先验灰度的局部区域能量相结合构造的单相混合水平集模型分割牙根层切片图像;3)结合区域竞争约束的双相混合水平集模型分割牙冠层切片图像;4)基于分割轮廓的牙齿三维模型重建。本发明的混合水平集模型能有效克服传统分割模型边缘定位不准确以及无法处理图像灰度不均匀等问题,快速准确地构建出每颗牙齿独立的三维模型,从而为制定口腔修复规划、生物力学分析等奠定坚实的基础。
The present invention provides a three-dimensional tooth modeling method based on a mixed level set, comprising the following steps: 1) selection of a starting slice and level set initialization; 2) utilizing prior shape constraint energy, edge energy based on a Flux model, The single-phase mixed level set model based on the combination of prior grayscale and local region energy to segment the root layer slice image; 3) The two-phase mixed level set model combined with regional competition constraints to segment the crown layer slice image; 4) Based on the segmentation contour 3D model reconstruction of teeth. The mixed level set model of the present invention can effectively overcome the problems of inaccurate edge positioning of traditional segmentation models and the inability to deal with uneven gray levels of images, etc., and quickly and accurately build an independent three-dimensional model of each tooth, so as to provide a basis for the formulation of oral restoration planning, biomechanics, etc. A solid foundation of analysis, etc.
Description
技术领域technical field
本发明属于图像处理领域,涉及一种水平集方法在三维牙齿建模中的应用。The invention belongs to the field of image processing and relates to the application of a level set method in three-dimensional tooth modeling.
背景技术Background technique
近年来,随着三维数字化成像技术在口腔医学领域的飞速发展,计算机辅助诊疗修复越来越多的应用在口腔修复当中,并逐渐成为这一领域的发展趋势。在计算机口腔修复系统中,首先重要的就是要获取数字化的三维牙齿模型,而模型的精度和完整性直接关系到后续的排牙、种植、正畸、以及生物力学分析的结果。In recent years, with the rapid development of three-dimensional digital imaging technology in the field of stomatology, more and more computer-aided diagnosis and treatment have been applied in oral restoration, and it has gradually become the development trend in this field. In the computer oral restoration system, the first important thing is to obtain a digital three-dimensional tooth model, and the accuracy and integrity of the model are directly related to the results of subsequent tooth arrangement, implantation, orthodontics, and biomechanical analysis.
目前牙齿建模方法最常用的方法就是利用图像处理技术分割牙齿CT图像序列,即首先从每一层CT切片中分割出牙齿轮廓,然后利用这些层间轮廓重建出牙齿三维模型。由于该类方法能够获得整个牙齿形状结构,为患者口腔病变提供完整的诊断依据,因此,基于CT图像的牙齿建模方法越来越受到研究学者的广泛关注。At present, the most commonly used method for tooth modeling is to use image processing technology to segment tooth CT image sequences, that is, firstly segment tooth contours from each layer of CT slices, and then use these inter-layer contours to reconstruct a three-dimensional tooth model. Because this type of method can obtain the shape and structure of the entire tooth and provide a complete diagnosis basis for patients' oral lesions, the tooth modeling method based on CT images has attracted more and more attention from researchers.
由于口腔CT图像中牙齿和颌骨的密度和距离都较为接近,采用传统的图像分割方法很难精确地提取出每颗牙齿的组织轮廓。CT图像牙齿分割一直是一个充满挑战性的课题。王黎等(王黎,崔进,韩清凯等,基于CT图像的牙齿3维实体模型建立。中国图象图形学报,2005,10(10):1289-1292。)利用二值化和边界提取筛选出每层切片牙齿轮廓关键点,然后利用3D-Delaunay四面体化算法得到整颗牙齿的实体模型;但二值化操作容易产生过分割或欠分割的问题。Wu等(X.Wu,H.Gao,H.Heo,et al.Improved B-spline contourfitting using genetic algorithm for the segmentation of dental computerizedtomography image sequences.The Journal of imaging science and technology,2007,51(4):328-336.)利用基于遗传算法的B样条曲线拟合来提取每层切片的牙齿轮廓,但B样条曲线无法处理牙齿拓扑结构变化的问题。Gao等(H.Gao,O.Chae.Individual toothsegmentation from CT image s using level set method with shape and intensityprior.Pattern Recognition,2010,43:2406-2417)采用基于水平集的活动轮廓模型进行牙齿分割,并对不同牙层切片采用不同的分割模型,能够将每颗牙齿的牙冠和牙根都分割出来;该模型主要依靠图像边缘梯度和先验形状的概率分布来指导水平集的演化,但由于牙齿密度不均匀,且周围容易受到牙槽骨等结构的干扰,因此依靠先验形状周围区域的灰度概率来控制水平集轮廓的收缩和扩张容易产生边界泄露的问题。Because the densities and distances of teeth and jaws in oral CT images are relatively close, it is difficult to accurately extract the tissue contour of each tooth using traditional image segmentation methods. Teeth segmentation in CT images has always been a challenging subject. Wang Li et al. (Wang Li, Cui Jin, Han Qingkai, etc. Establishment of a 3D solid model of teeth based on CT images. Chinese Journal of Image and Graphics, 2005, 10(10): 1289-1292.) used binarization and boundary extraction to screen The key points of the tooth contour of each slice are obtained, and then the solid model of the whole tooth is obtained by using the 3D-Delaunay tetrahedronization algorithm; however, the binarization operation is prone to over-segmentation or under-segmentation. Wu et al. (X. Wu, H. Gao, H. Heo, et al. Improved B-spline contourfitting using genetic algorithm for the segmentation of dental computerized tomography image sequences. The Journal of imaging science and technology, 2007, 51(4): 328-336.) B-spline curve fitting based on genetic algorithm is used to extract the tooth profile of each slice, but the B-spline curve cannot deal with the change of tooth topology. Gao et al. (H.Gao, O.Chae.Individual toothsegmentation from CT images using level set method with shape and intensityprior.Pattern Recognition, 2010, 43: 2406-2417) used a level set-based active contour model for tooth segmentation, and Different segmentation models are used for different tooth layer slices, and the crown and root of each tooth can be segmented; the model mainly relies on the image edge gradient and the probability distribution of the prior shape to guide the evolution of the level set, but due to the tooth density It is not uniform, and the surrounding area is easily disturbed by structures such as alveolar bone, so relying on the gray probability of the surrounding area of the prior shape to control the shrinkage and expansion of the level set contour is prone to the problem of boundary leakage.
发明内容Contents of the invention
为克服上述现有技术的不足,提高牙齿分割的效率和精度,本发明综合考虑口腔CT图像牙齿形状变化特点,提出一种基于混合水平集的三维牙齿建模方法。In order to overcome the shortcomings of the above-mentioned prior art and improve the efficiency and accuracy of tooth segmentation, the present invention comprehensively considers the characteristics of tooth shape changes in oral CT images, and proposes a 3D tooth modeling method based on mixed level sets.
本发明提供:一种基于混合水平集的三维牙齿建模方法,包括如下步骤:The invention provides: a method for modeling three-dimensional teeth based on mixed level sets, comprising the following steps:
(1)从口腔CT图像序列中选取一张作为起始切片,并在该图像上勾画出每颗牙齿轮廓以初始化水平集函数;(1) Select one from the oral CT image sequence as the starting slice, and draw the outline of each tooth on the image to initialize the level set function;
(2)起始切片以下的牙根层切片利用先验形状约束能量、基于Flux模型的边缘能量、基于先验灰度的局部区域能量相结合构造的单相混合水平集模型分割牙齿轮廓;(2) The root layer slice below the initial slice uses the single-phase mixed level set model constructed by combining the prior shape constraint energy, the edge energy based on the Flux model, and the local area energy based on the prior gray level to segment the tooth contour;
(3)起始切片以上的牙冠层切片利用结合区域竞争约束的双相混合水平集模型分割牙齿轮廓;(3) The crown layer slice above the initial slice is segmented by the two-phase mixed level set model combined with regional competition constraints;
(4)将所有切片分割后的牙齿轮廓像素点转化为三维坐标,利用Delaunay三角剖分方法进行重建以得到每颗牙齿的三角网格模型。(4) Transform the pixel points of the tooth contour after all slices into three-dimensional coordinates, and use the Delaunay triangulation method to reconstruct to obtain the triangular mesh model of each tooth.
步骤(1)按如下步骤进行:在牙颈部位的切片图像中选取一张所有牙都出现且牙槽骨较少出现的切片作为起始切片,并在该切片图像上勾画出每颗牙齿的大致轮廓Ci(i=1,2,...n,n为牙齿个数)作为水平集的初始轮廓,然后利用Ci初始化n个水平集函数Φi(i=1,2,...n),Φi的初始化通过计算图像上每个点到Ci的带符号的距离来完成,即:Step (1) is carried out as follows: select a slice in which all teeth appear and less alveolar bone appears in the slice image of the dental neck as the starting slice, and outline each tooth on the slice image The approximate contour C i (i=1, 2,...n, n is the number of teeth) is used as the initial contour of the level set, and then use C i to initialize n level set functions Φ i (i=1, 2,. ..n), the initialization of Φ i is done by calculating the signed distance from each point on the image to C i , namely:
其中,d[(x),Ci]表示像素点x与曲线Ci之间的欧式距离。Wherein, d[(x), C i ] represents the Euclidean distance between the pixel point x and the curve C i .
步骤(2)所述的分割牙根层切片的单相混合水平集模型的能量泛函定义为先验形状约束能量、基于Flux模型的边缘能量、基于先验灰度的局部区域能量等的加权和:The energy functional of the single-phase mixed level set model for segmenting the root layer slices described in step (2) is defined as the weighted sum of the prior shape constraint energy, the edge energy based on the Flux model, and the local area energy based on the prior grayscale, etc. :
E牙根(Φ)=μEint(Φ)+γElength(Φ)+αEprior(Φ)+vEedge(Φ)+λEregion(Φ)E tooth root (Φ)=μE int (Φ)+γE length (Φ)+αE prior (Φ)+vE edge (Φ)+λE region (Φ)
其中,μ,γ,α,ν,λ为各个能量项的权系数;Among them, μ, γ, α, ν, λ are the weight coefficients of each energy item;
(3a)符号距离保持能量Eint(Φ),用来保证水平集演化过程中的稳定性,定义为:(3a) The signed distance preserving energy E int (Φ), which is used to ensure the stability in the evolution process of the level set, is defined as:
(3b)曲线弧长平滑能量Elength(Φ),用来平滑水平集轮廓,定义为:(3b) Curve arc length smoothing energy E length (Φ), used to smooth the level set profile, defined as:
(3c)先验形状约束能量Eprior(Φ),用来控制水平集的形状,将每次分割后的牙齿轮廓映射到相邻切片图像,作为当前水平集函数演化的先验形状加以约束,其能量泛函定义为:(3c) The prior shape constraint energy E prior (Φ), used to control the shape of the level set, maps the tooth contour after each segmentation to the adjacent slice image, and constrains it as the prior shape of the evolution of the current level set function, Its energy functional is defined as:
其中Φ为当前切片的水平集函数,Φp为上一张切片分割完成后先验形状对应的水平集函数,H(x)为Heaviside函数;Among them, Φ is the level set function of the current slice, Φ p is the level set function corresponding to the prior shape after the previous slice is segmented, and H(x) is the Heaviside function;
(3d)基于Flux模型的边缘能量Eedge(Φ),用来探测牙齿的外边界轮廓,将图像梯度方向和水平函数梯度方向之间的角度信息嵌入到传统Flux模型当中,其能量泛函定义为:(3d) The edge energy E edge (Φ) based on the Flux model is used to detect the outer boundary contour of the tooth, and the angle information between the image gradient direction and the horizontal function gradient direction is embedded into the traditional Flux model, and its energy functional definition for:
Eedge(Φ)=-∫ΩξΔIσ(1-H(Φ)dxE edge (Φ)=- ∫Ω ξΔI σ (1-H(Φ)dx
其中Δ为Laplacian算子,Iσ代表高斯平滑后的图像,Where Δ is the Laplacian operator, I σ represents the image after Gaussian smoothing,
为梯度方向检测函数,为梯度算子,·代表点积;is the gradient direction detection function, is the gradient operator, and represents the dot product;
(3e)基于先验灰度的局部区域能量Eregion(Φ),用来克服图像灰度不均匀问题,将先验灰度信息嵌入到区域模型当中,其能量泛函定义为:(3e) The local region energy E region (Φ) based on the prior gray scale is used to overcome the problem of uneven gray scale of the image, and embed the prior gray scale information into the regional model, and its energy functional is defined as:
其中fref_in(x)和fref_out(x)分别定义为先验形状上参考点的r邻域在先验形状曲线内、外的灰度均值,参考点为先验形状上距离当前图像目标像素点x最近的点;Among them, f ref_in (x) and f ref_out (x) are respectively defined as the gray mean value of the r neighborhood of the reference point on the prior shape inside and outside the prior shape curve, and the reference point is the distance from the current image target pixel on the prior shape point x nearest point;
(3f)综合以上各能量项,将牙根层切片混合水平集模型的最小化能量泛函表示为:(3f) Combining the above energy items, the minimized energy functional of the mixed level set model of the root slice is expressed as:
对上述能量泛函进行最小化,得到水平集曲线的演化方程:The above energy functional is minimized to obtain the evolution equation of the level set curve:
其中,δ(Φ)为Dirac函数。Among them, δ(Φ) is the Dirac function.
步骤(3)所述中的分割牙冠层切片的双相混合水平集模型按如下步骤建立:对起始切片利用所述的单相混合水平集模型进行分割,将分割后的所有水平集函数按照每隔一个牙齿的规则将其组合成两个耦合的双相混合水平集函数,并加入区域竞争约束能量以克服两个水平集产生重叠,其能量泛函定义为:The two-phase mixed level set model of the segmented crown layer slice described in step (3) is established as follows: the initial slice is segmented using the single-phase mixed level set model, and all level set functions after segmentation According to the rule of every other tooth, it is combined into two coupled two-phase mixed level set functions, and the area competition constraint energy is added to overcome the overlapping of the two level sets, and its energy functional is defined as:
E牙冠(Φ1,Φ2)=E牙根(Φ1)+E牙根(Φ2)+βErepulse E tooth crown (Φ 1 , Φ 2 ) = E tooth root (Φ 1 ) + E tooth root (Φ 2 ) + βE repulse
其中,Erepulse=∫ΩH(Φ1)H(Φ2)dxAmong them, E repulse =∫ Ω H(Φ 1 )H(Φ 2 )dx
为区域竞争约束能量,β用来控制两水平集函数区域重叠的程度;Constrain energy for regional competition, and β is used to control the overlapping degree of two level set functions;
对上述能量泛函进行最小化,得到双相水平集函数Φ1,Φ2的演化方程分别为: Minimize the above energy functional to obtain the evolution equations of the two-phase level set functions Φ 1 and Φ 2 respectively:
和 with
和 with
其中Φp1,Φp2分别代表Φ1,Φ2的先验值;ξ1(x)、ξ2(x)分别代表Φ1,Φ2演化时的梯度方向检测函数:Among them, Φ p1 and Φ p2 represent the prior values of Φ 1 and Φ 2 respectively; ξ 1 (x) and ξ 2 (x) represent the gradient direction detection function when Φ 1 and Φ 2 evolve respectively:
步骤(4)所述的三维牙齿重建按如下步骤进行:利用窄带法和半隐式差分方案求解上述水平集函数的演化方程,提取更新完成后的水平集函数在Φ=0的像素点,得到当前切片图像的牙齿轮廓,将所有切片图像分割后的牙齿轮廓像素点转化为三维坐标,利用基于区域增长的Delaunay三角剖分方法进行重建,以生成每颗牙齿的三角网格模型。The three-dimensional tooth reconstruction described in step (4) is carried out according to the following steps: use the narrow-band method and the semi-implicit difference scheme to solve the evolution equation of the above-mentioned level set function, extract the pixel point of the updated level set function at Φ=0, and obtain For the tooth contour of the current slice image, convert the tooth contour pixel points of all slice images into three-dimensional coordinates, and use the region growing-based Delaunay triangulation method for reconstruction to generate a triangular mesh model of each tooth.
本发明的有益效果:本发明提出的混合水平集模型结合了图像边缘、局部区域、先验知识等多方面的信息,能有效克服传统模型边缘定位不准确以及无法处理图像灰度不均匀等问题。本发明方法具有较少的人工干预,而且具有较好的分割效果和较高的准确率,重建出的三维牙齿模型能正确反映牙齿的解剖形态,从而为下一步制定口腔修复规划、生物力学分析等奠定坚实的基础,对于提高口腔修复的精度和效率具有重要意义。Beneficial effects of the present invention: the mixed level set model proposed by the present invention combines various information such as image edges, local regions, prior knowledge, etc., and can effectively overcome the problems of inaccurate edge positioning and inability to deal with uneven gray levels of images in traditional models . The method of the present invention has less manual intervention, and has better segmentation effect and higher accuracy rate, and the reconstructed three-dimensional tooth model can correctly reflect the anatomical shape of the tooth, so as to formulate oral restoration planning and biomechanical analysis for the next step It is of great significance to improve the accuracy and efficiency of dental restoration.
附图说明Description of drawings
图1为本发明的牙齿建模技术流程图。Fig. 1 is a flow chart of the tooth modeling technique of the present invention.
图2为起始切片的水平集函数初始化示意图。Figure 2 is a schematic diagram of the initialization of the level set function of the initial slice.
图3(a)为牙齿与周围干扰结构的梯度方向示意图。Fig. 3(a) is a schematic diagram of the gradient directions of teeth and surrounding interference structures.
图3(b)为水平集函数的梯度方向示意图。Figure 3(b) is a schematic diagram of the gradient direction of the level set function.
图4为牙冠层切片图像的双相水平集函数示意图。Fig. 4 is a schematic diagram of a two-phase level set function of a slice image of a dental crown layer.
图5为双相水平集分割区域示意图。Fig. 5 is a schematic diagram of biphasic level set segmentation regions.
图6为本发明与现有方法对起始切片图像的分割效果图。Fig. 6 is an effect diagram of segmentation of the initial slice image by the present invention and the existing method.
图7为本发明与现有方法对牙根切片磨牙部位的分割效果图。Fig. 7 is a diagram showing the segmentation effect of the molar part of the tooth root slice by the present invention and the existing method.
图8为本发明磨牙部位若干切片分割轮廓和三维重建效果图。Fig. 8 is a diagram showing segmentation contours and three-dimensional reconstruction effects of several slices of molar parts according to the present invention.
具体实施方式detailed description
下面结合附图对本发明实施例作进一步说明:Embodiments of the present invention will be further described below in conjunction with accompanying drawings:
如图1所示,本发明的具体实现步骤如下:As shown in Figure 1, the specific implementation steps of the present invention are as follows:
步骤1、起始切片的选取和水平集初始化:首先读取牙齿CT图像序列,然后在牙颈部位的切片图像中选择一张所有牙都出现且牙槽骨较少出现的切片作为起始切片。在起始切片图像上,勾画出每颗牙齿的大致轮廓Ci(i=1,2,...n,n为牙齿个数)作为水平集的初始轮廓,如图2所示,然后利用Ci(i=1,2,...n)初始化n个水平集函数Φi(i=1,2,...n)。Φi的初始化通过计算图像上每个点到Ci的带符号的距离来完成,即:Step 1. Selection of the starting slice and initialization of the level set: first read the tooth CT image sequence, and then select a slice in which all the teeth appear and the alveolar bone rarely appears in the slice image of the dental neck as the starting point slice. On the initial slice image, outline the approximate outline C i (i=1, 2, ... n, n is the number of teeth) of each tooth as the initial outline of the level set, as shown in Figure 2, and then use C i (i=1, 2,...n) initializes n level set functions Φ i (i=1, 2,...n). The initialization of Φi is done by computing the signed distance from each point on the image to Ci , namely:
其中,d[(x),Ci]表示点x与曲线Ci之间的欧式距离。Among them, d[(x), C i ] represents the Euclidean distance between the point x and the curve C i .
步骤2、牙根层切片分割:在牙根层图像中,牙齿易受到牙槽骨和牙髓腔等结构的较多干扰。因此,提出一种新的混合水平集牙齿分割模型。该模型的能量泛函主要由先验形状约束能量、基于Flux模型的边缘能量、基于先验灰度的局部区域能量等部分组成。Step 2. Root layer slice segmentation: In the root layer image, the teeth are easily disturbed by structures such as alveolar bone and pulp cavity. Therefore, a new hybrid level set tooth segmentation model is proposed. The energy functional of the model is mainly composed of prior shape constraint energy, edge energy based on Flux model, and local area energy based on prior gray level.
(1)在先验形状约束能量项中,由于相邻切片之间,对应牙齿的形状和位置都比较接近,因此将上一张切片已完成分割的牙齿轮廓映射到当前切片图像,作为水平集演化的先验形状加以约束。令Φ为当前切片的水平集函数,Φp为上一张切片分割完成后先验形状对应的水平集函数,则先验形状约束项定义为:(1) In the prior shape constraint energy item, since the shape and position of the corresponding teeth are relatively close between adjacent slices, the tooth contour that has been segmented in the previous slice is mapped to the current slice image as a level set The evolution of the prior shape is constrained. Let Φ be the level set function of the current slice, and Φ p be the level set function corresponding to the prior shape after the previous slice is segmented, then the prior shape constraint term is defined as:
式中,H(x)为Heaviside函数。In the formula, H(x) is the Heaviside function.
(2)在基于Flux模型的边缘能量中,利用基于梯度向量场的Flux模型来定位目标边界,同时利用图像梯度方向和水平函数梯度方向之间的角度来克服周围牙槽骨和牙髓腔的干扰问题。(2) In edge energy based on the Flux model, use the Flux model based on the gradient vector field to locate the target boundary, and at the same time use the angle between the gradient direction of the image and the gradient direction of the horizontal function to overcome the surrounding alveolar bone and pulp cavity interference problem.
由于图像在边界处梯度与边缘法向量同向,因此Flux模型通过计算图像梯度与曲线法向量内积的边缘积分来定位图像边缘,该方法能有效解决弱边界目标的分割问题,且演化速度快。Flux模型的最大化能量泛函表示为:Since the gradient of the image at the boundary is in the same direction as the edge normal vector, the Flux model locates the edge of the image by calculating the edge integral of the inner product of the image gradient and the curve normal vector. This method can effectively solve the segmentation problem of weak boundary targets, and the evolution speed is fast . The maximized energy functional of the Flux model is expressed as:
EFlux(Φ)=∫ΩΔI(1-H(Φ)dxE Flux (Φ)= ∫Ω ΔI(1-H(Φ)dx
式中,Δ为Laplacian算子,Iσ代表高斯平滑后的图像。In the formula, Δ is the Laplacian operator, and I σ represents the image after Gaussian smoothing.
然而,由于牙齿内部和外部的干扰结构较多,直接利用上述模型进行分割,水平集会同时捕捉到牙齿内部的牙髓腔以及外部的邻牙或牙槽骨等边界上,因此本发明将梯度方向约束加入到上述的Flux模型当中。However, since there are many interfering structures inside and outside the tooth, the above-mentioned model is directly used for segmentation, and the horizontal assembly can be captured on the pulp cavity inside the tooth and the boundary of the adjacent tooth or alveolar bone outside, so the present invention divides the gradient direction Constraints are added to the Flux model above.
在牙齿CT图像中,牙齿为高亮度区域,背景为低亮度区域,因此可将牙齿与周围干扰结构的图像梯度方向表示为图3a所示。由于本文定义的水平集函数Φ在水平集内部取正、外部取负,则Φ的梯度方向可表示为图3b所示。可以看出,如果要使演化曲线只捕捉到牙齿的外边界轮廓,则图像的梯度方向应该与水平集函数的梯度方向一致。因此,将本发明的边缘能量的最小化泛函定义为:In the tooth CT image, the tooth is a high-brightness area, and the background is a low-brightness area, so the image gradient direction of the tooth and surrounding interference structures can be expressed as shown in Figure 3a. Since the level set function Φ defined in this paper is positive inside the level set and negative outside, the gradient direction of Φ can be expressed as shown in Figure 3b. It can be seen that if the evolution curve only captures the outer boundary contour of the tooth, the gradient direction of the image should be consistent with the gradient direction of the level set function. Therefore, the minimized functional of the edge energy of the present invention is defined as:
Eedge(Φ)=∫ΩξΔI(1-H(Φ)dxE edge (Φ)= ∫Ω ξΔI(1-H(Φ)dx
其中 in
为梯度方向检测函数,为梯度算子,·代表点积。is the gradient direction detection function, is the gradient operator, and represents the dot product.
(3)在结合先验灰度的局部区域能量中,将先验形状的局部邻域灰度均值取代全局均值,以克服传统模型无法利用先验灰度信息和无法处理图像灰度不均匀的问题。(3) In the local area energy combined with the prior gray level, the local neighborhood gray level mean of the prior shape is replaced by the global mean value to overcome the inability of the traditional model to use the prior gray level information and the inhomogeneity of the gray level of the image question.
由于相邻切片之间图像的灰度分布非常相同,且牙齿轮廓位置也接近,因此本发明将先验灰度信息嵌入到能量模型中,以提高比较精度,其能量泛函定义为:Since the grayscale distribution of images between adjacent slices is very similar, and the tooth contour positions are also close, the present invention embeds the prior grayscale information into the energy model to improve the comparison accuracy, and its energy functional is defined as:
其中fref_in(x)和fref_out(x)分别定义为先验形状上参考点的r邻域在先验形状曲线内、外的灰度均值。参考点按照如下方法确定:当上一张切片分割完成后,计算先验形状上每个点的r邻域在先验形状曲线内、外的灰度均值,然后在当前切片图像中,将先验形状上距离当前图像目标像素点x最近的点作为参考点。r邻域半径的选取需根据图像的分辨率而定,一般不应太大,以免包含过多的邻牙区域。where f ref_in (x) and f ref_out (x) are defined as the mean gray values of the r neighborhood of the reference point on the prior shape inside and outside the prior shape curve, respectively. The reference point is determined according to the following method: after the segmentation of the previous slice is completed, the gray mean value of the r neighborhood of each point on the prior shape inside and outside the prior shape curve is calculated, and then in the current slice image, the first The point on the test shape that is closest to the target pixel point x of the current image is used as a reference point. The selection of r neighborhood radius depends on the resolution of the image, and generally should not be too large, so as not to include too many adjacent tooth areas.
(4)为保证水平集在整个演化过程中的形状和稳定性,再加入符号距离保持能量:(4) In order to ensure the shape and stability of the level set throughout the evolution process, add the signed distance to preserve energy:
和曲线弧长平滑项:and a curvilinear arc-length smoothing term:
这样,综合以上各个能量信息,可将分割牙根层切片的单相混合水平集模型的最小化能量泛函表示为:In this way, based on the above energy information, the minimized energy functional of the single-phase mixed level set model for segmenting root slices can be expressed as:
对能量方程进行最小化,可得到牙根层切片的水平集函数Φ的演化方程为:By minimizing the energy equation, the evolution equation of the level set function Φ of the root slice can be obtained as:
其中δ(Φ)为Dirac函数。Among them, δ(Φ) is the Dirac function.
步骤3、牙冠层切片分割模型:在牙冠层切片图像中,牙齿逐渐紧连在一起,缝隙较小,为有效提取相邻两牙之间的边界,对起始切片利用步骤2所述的单相混合水平集模型进行牙齿分割,将分割后的水平集函数按照每隔一个牙齿的规则将其组合成两个耦合的双相混合水平集函数,如图4所示。Step 3. Segmentation model of the crown slice: In the slice image of the crown, the teeth are gradually connected together with small gaps. In order to effectively extract the boundary between two adjacent teeth, use the method described in step 2 for the initial slice. The single-phase mixed level set model of the tooth is segmented, and the divided level set function is combined into two coupled two-phase mixed level set functions according to the rule of every other tooth, as shown in Figure 4.
由多相水平集分割原理可知,两个水平集函数Φ1、Φ2可以将图像划分为四个区域,如图5所示。对于{Φ1>0,Φ2>0}这个相,代表相邻牙齿的重叠区域。为克服Φ1、Φ2在演化过程中产生重叠,在能量泛函中引入区域竞争准则。设A1、A2分别为水平集函数Φ1、Φ2对应的水平集曲线围成的内部区域面积。根据Heaviside函数H(x)的性质,可将A1,A2分别表示为:According to the principle of multiphase level set segmentation, two level set functions Φ 1 and Φ 2 can divide the image into four regions, as shown in Fig. 5 . For the phase {Φ 1 >0, Φ 2 >0}, it represents the overlapping area of adjacent teeth. In order to overcome the overlapping of Φ 1 and Φ 2 in the evolution process, the regional competition criterion is introduced in the energy functional. Let A 1 and A 2 be the internal area enclosed by the level set curves corresponding to the level set functions Φ 1 and Φ 2 respectively. According to the properties of the Heaviside function H(x), A 1 and A 2 can be expressed as:
A1=area(Φ1≥0)=∫ΩH(Φ1)dxA 1 =area(Φ 1 ≥0)=∫ Ω H(Φ 1 )dx
A2=area(Φ2≥0)=∫ΩH(Φ2)dxA 2 =area(Φ 2 ≥0)=∫ Ω H(Φ 2 )dx
要使这两个区域不产生重叠,则应满足:In order for these two regions not to overlap, it should satisfy:
因此可将区域惩罚项定义为:Therefore, the area penalty term can be defined as:
Erepulse=∫ΩH(Φl)H(Φ2)dxE repulse =∫ Ω H(Φ l )H(Φ 2 )dx
对上式进行最小化相当于避免两个牙齿产生重叠。Minimizing the above formula is equivalent to avoiding the overlap of two teeth.
将区域惩罚项加入到水平集能量泛函当中,可得到牙冠层的双相混合水平集模型的能量方程为:Adding the area penalty term to the level set energy functional, the energy equation of the two-phase mixed level set model of the dental crown can be obtained as:
E牙冠(Φ1,Φ2)=E牙根(Φ1)+E牙根(Φ2)+βErepulse E tooth crown (Φ 1 , Φ 2 ) = E tooth root (Φ 1 ) + E tooth root (Φ 2 ) + βE repulse
其中β用来控制两水平集函数区域重叠的程度,对上述能量泛函进行最小化,可得到双相水平集函数Φ1,Φ2的演化方程分别为:Among them, β is used to control the overlapping degree of the two level set functions, and the above energy functional is minimized, and the evolution equations of the two-phase level set functions Φ 1 and Φ 2 can be obtained as follows:
和with
其中Φp1,Φp2分别代表Φ1,Φ2的先验值;ξ1(x)、ξ2(x)分别代表Φ1,Φ2演化时的梯度方向检测函数,即:Among them, Φ p1 and Φ p2 represent the prior values of Φ 1 and Φ 2 respectively; ξ 1 (x) and ξ 2 (x) respectively represent the gradient direction detection function when Φ 1 and Φ 2 evolve, namely:
步骤4、牙齿三维模型重建:利用窄带法和半隐式差分方案求解上述水平集函数的演化方程,提取更新完成后的水平集函数在Φ=0的像素点,将所有切片图像分割后的这些牙齿轮廓像素点转化为三维坐标,利用Delaunay三角剖分方法进行重建,即可得到每颗牙齿的三角网格模型。Step 4. Reconstruction of the three-dimensional tooth model: use the narrow-band method and the semi-implicit difference scheme to solve the evolution equation of the above level set function, extract the updated level set function at the pixel point of Φ=0, and divide all slice images into these The pixel points of the tooth contour are transformed into three-dimensional coordinates, and the Delaunay triangulation method is used for reconstruction to obtain the triangular mesh model of each tooth.
本发明的有效性可以通过下面的实验进一步说明:Effectiveness of the present invention can further illustrate by following experiment:
以一位下颌牙齿完整的患者口腔CT图像序列作为例。图6为利用本发明和Li模型、CV模型对该CT序列的起始切片图像进行牙齿分割结果对比图。图6(a)为在起始切片上画的各个牙齿初始轮廓多边形。可以看出,基于边缘的Li模型由于过于依赖初始曲线附近的图像梯度信息,但缺乏梯度方向约束,所以图6(b)中存在很多牙齿边缘定位不准确的现象。基于区域的C-V模型依赖全局灰度信息,因此在图6(c)中距离较近的牙齿之间以及牙齿与颌骨之间的弱边界处产生融合。图6(d)为本发明的分割结果,由于利用基于梯度向量场的Flux模型,能够有效探测弱边界,并通过加入梯度方向和先验形状约束,从而实现准确定位牙齿边界轮廓。Take the oral CT image sequence of a patient with complete mandibular teeth as an example. Fig. 6 is a comparison diagram of tooth segmentation results using the present invention, Li model, and CV model for the initial slice image of the CT sequence. Fig. 6(a) is the initial outline polygon of each tooth drawn on the initial slice. It can be seen that the edge-based Li model relies too much on the image gradient information near the initial curve, but lacks gradient direction constraints, so there are many inaccurate tooth edge positioning in Figure 6(b). The region-based C-V model relies on global grayscale information, thus producing fusions between teeth that are closer together and weak boundaries between teeth and jaws in Fig. 6(c). Fig. 6(d) is the segmentation result of the present invention. Due to the use of the Flux model based on the gradient vector field, the weak boundary can be effectively detected, and the tooth boundary contour can be accurately positioned by adding gradient direction and prior shape constraints.
图7(a)和图7(b)分别本发明和Gao等人的方法对该患者第二磨牙的牙根部位切片图像的分割结果。可以看出,本发明具有较准确的分割结果,但Gao等人的方法依靠曲线内外灰度概率来探测轮廓,由于牙髓腔的灰度较暗,会在牙齿弱边界处使探测的曲线偏向牙髓腔。Fig. 7(a) and Fig. 7(b) are the segmentation results of the root slice image of the patient's second molar by the method of the present invention and Gao et al. respectively. It can be seen that the present invention has more accurate segmentation results, but Gao et al.’s method relies on the gray-scale probability inside and outside the curve to detect the contour. Since the gray scale of the pulp cavity is dark, the detected curve will be biased at the weak boundary of the tooth pulp cavity.
图8显示了在右侧第一磨牙部位的一些切片的分割结果。可以看出,基本上所有切片图像的分割结果都能很好地贴合牙齿目标轮廓。但是,在第160层的切片中,水平集没有捕捉到牙齿内部沟槽轮廓,这主要是受到水平集演化方程中窄带大小的影响。由于牙齿表面沟槽的存在,会造成一些切片的轮廓出现极度的凹陷。如果此时窄带宽度取得较小,可能就会限制水平集演化到目标轮廓上。但这并不影响最后的分割结果,由于目标轮廓线包含在水平集曲线的内部,可通过灰度阈值提取出最终的轮廓线。图8右边显示了对分割后的每层切片牙齿轮廓进行三维重建后的结果,可以看出本发明重建的三维模型能正确反映牙齿的解剖形态,从而为下一步的计算机辅助诊断提供有效数据,使医生能够针对病人的实际情况制定最佳的手术方案。Figure 8 shows the segmentation results of some slices at the right first molar site. It can be seen that the segmentation results of basically all slice images can fit the tooth target contour well. However, in the slice of the 160th layer, the level set did not capture the groove profile inside the tooth, which was mainly affected by the size of the narrow band in the level set evolution equation. Due to the presence of grooves on the tooth surface, the contours of some sections were extremely concave. If the narrow band width is made smaller at this time, it may limit the evolution of the level set to the target contour. But this does not affect the final segmentation result. Since the target contour line is included in the level set curve, the final contour line can be extracted through the gray threshold. The right side of Fig. 8 shows the results of three-dimensional reconstruction of the segmented tooth profile of each slice. It can be seen that the reconstructed three-dimensional model of the present invention can correctly reflect the anatomical shape of the tooth, thereby providing effective data for the next step of computer-aided diagnosis. To enable doctors to formulate the best surgical plan according to the actual situation of the patient.
以上所述仅为本发明的较佳实例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above description is only a preferred example of the present invention, and is not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention within.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510821682.7A CN105488849B (en) | 2015-11-24 | 2015-11-24 | A kind of three-dimensional tooth modeling method based on mixed-level collection |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510821682.7A CN105488849B (en) | 2015-11-24 | 2015-11-24 | A kind of three-dimensional tooth modeling method based on mixed-level collection |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105488849A CN105488849A (en) | 2016-04-13 |
CN105488849B true CN105488849B (en) | 2018-01-12 |
Family
ID=55675813
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510821682.7A Active CN105488849B (en) | 2015-11-24 | 2015-11-24 | A kind of three-dimensional tooth modeling method based on mixed-level collection |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105488849B (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109310488B (en) * | 2016-06-21 | 2021-09-28 | 诺贝尔生物服务公司 | Method for estimating at least one of shape, position and orientation of a dental restoration |
CN108932716B (en) * | 2017-05-26 | 2020-09-22 | 无锡时代天使医疗器械科技有限公司 | Image segmentation method for dental images |
CN107680110B (en) * | 2017-08-29 | 2021-10-22 | 中国科学院苏州生物医学工程技术研究所 | Three-dimensional level set segmentation method of inner ear based on statistical shape model |
CA3099252A1 (en) * | 2018-05-29 | 2019-12-05 | Medicim Nv | Methods, systems, and computer programs for segmenting a tooth's pulp region from an image |
CN108986114B (en) * | 2018-07-11 | 2022-03-29 | 中南大学 | Automatic abdominal CT sequence image liver segmentation method based on level set and shape descriptor |
CN110619646B (en) * | 2019-07-23 | 2023-08-29 | 同济大学 | A Single Tooth Extraction Method Based on Panorama |
CN110889850B (en) * | 2019-12-13 | 2022-07-22 | 电子科技大学 | A CBCT tooth image segmentation method based on center point detection |
WO2024082284A1 (en) * | 2022-10-21 | 2024-04-25 | 深圳先进技术研究院 | Orthodontic automatic tooth arrangement method and system based on mesh feature deep learning |
CN115620871A (en) * | 2022-11-21 | 2023-01-17 | 优铸科技(北京)有限公司 | Corrector information generation method and device for invisible orthodontic platform |
CN115944416B (en) * | 2023-02-20 | 2023-06-27 | 极限人工智能有限公司 | Auxiliary determination method, system, medium and electronic equipment for oral implantation scheme |
CN118365964B (en) * | 2024-06-14 | 2024-09-13 | 中国人民解放军空军军医大学 | Deep learning-based recognition method for tooth position and periapical periodontitis of oral cavity curved surface fracture layer |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2874121A1 (en) * | 2013-11-18 | 2015-05-20 | Nuctech Company Limited | Methods and apparatuses for establishing statistical model of dento-enamel junction |
CN104905881A (en) * | 2015-04-27 | 2015-09-16 | 苏州光影口腔医疗科技有限公司 | Low-cost multi-material auxiliary guide plate 3 D (three dimensional) printing method |
-
2015
- 2015-11-24 CN CN201510821682.7A patent/CN105488849B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2874121A1 (en) * | 2013-11-18 | 2015-05-20 | Nuctech Company Limited | Methods and apparatuses for establishing statistical model of dento-enamel junction |
CN104905881A (en) * | 2015-04-27 | 2015-09-16 | 苏州光影口腔医疗科技有限公司 | Low-cost multi-material auxiliary guide plate 3 D (three dimensional) printing method |
Non-Patent Citations (1)
Title |
---|
数字化口腔种植关键基础技术研究;吴婷;《中国博士学位论文全文数据库信息科技辑》;20131015;第14-34页 * |
Also Published As
Publication number | Publication date |
---|---|
CN105488849A (en) | 2016-04-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105488849B (en) | A kind of three-dimensional tooth modeling method based on mixed-level collection | |
Gan et al. | Tooth and alveolar bone segmentation from dental computed tomography images | |
Xia et al. | Individual tooth segmentation from CT images scanned with contacts of maxillary and mandible teeth | |
Gan et al. | Toward accurate tooth segmentation from computed tomography images using a hybrid level set model | |
Gao et al. | Individual tooth segmentation from CT images using level set method with shape and intensity prior | |
CN102920477B (en) | Apparatus and method for determining boundary of target area in medical imaging | |
CN102243759B (en) | Three-dimensional lung vessel image segmentation method based on geometric deformation model | |
JP5072449B2 (en) | Medical image processing apparatus and medical image processing method | |
WO2019000455A1 (en) | Method and system for segmenting image | |
CN107203998A (en) | A kind of method that denture segmentation is carried out to pyramidal CT image | |
CN101971213A (en) | A method and system for anatomy structure segmentation and modeling in an image | |
CN102068281A (en) | Processing method for space-occupying lesion ultrasonic images | |
CN102254317A (en) | Method for automatically extracting dental arch curved surface in dental implantation navigation | |
US7480401B2 (en) | Method for local surface smoothing with application to chest wall nodule segmentation in lung CT data | |
CN110033454B (en) | A Segmentation Method of Lung Tumors with Large Area Adhesion to Lung Boundary Tissue in CT Images | |
Gao et al. | Accurate lung segmentation for X-ray CT images | |
CN111145226B (en) | Three-dimensional lung feature extraction method based on CT images | |
CN106780491B (en) | Initial contour generation method adopted in segmentation of CT pelvic image by GVF method | |
Kim et al. | Automatic extraction of inferior alveolar nerve canal using feature-enhancing panoramic volume rendering | |
CN106780492B (en) | Method for extracting key frame of CT pelvic image | |
US20060159328A1 (en) | Method and apparatus for airway detection and segmentation | |
Gao et al. | Automatic tooth region separation for dental CT images | |
Li et al. | Accurate and automatic dental crown components segmentation with multi-scale attention based U-Net and hybrid level set models | |
Abdolali et al. | Mandibular canal segmentation using 3D Active Appearance Models and shape context registration | |
CN114241173B (en) | Tooth CBCT image three-dimensional segmentation method and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220627 Address after: F3015c, floor 3, Aegean Sea shopping park, No. 198, Pushang Avenue, Jinshan street, Cangshan District, Fuzhou City, Fujian Province, 350000 Patentee after: Fuzhou hailijia oral Technology Co.,Ltd. Address before: 201800 358 Kefu Road, Jiading District, Shanghai_ Room j2644, Zone E, floor 1, building 4, No. 368 Patentee before: Shanghai Yiyou Information Technology Co.,Ltd. Effective date of registration: 20220627 Address after: 201800 358 Kefu Road, Jiading District, Shanghai_ Room j2644, Zone E, floor 1, building 4, No. 368 Patentee after: Shanghai Yiyou Information Technology Co.,Ltd. Address before: 314001 No. 56 South Yuexiu Road, Zhejiang, Jiaxing Patentee before: JIAXING University |
|
TR01 | Transfer of patent right |