AU2015238846A1 - Region-growing algorithm - Google Patents

Region-growing algorithm Download PDF

Info

Publication number
AU2015238846A1
AU2015238846A1 AU2015238846A AU2015238846A AU2015238846A1 AU 2015238846 A1 AU2015238846 A1 AU 2015238846A1 AU 2015238846 A AU2015238846 A AU 2015238846A AU 2015238846 A AU2015238846 A AU 2015238846A AU 2015238846 A1 AU2015238846 A1 AU 2015238846A1
Authority
AU
Australia
Prior art keywords
voxels
growing algorithm
region growing
iterations
leakage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
AU2015238846A
Other versions
AU2015238846B2 (en
Inventor
Dorian Averbuch
Yuri Kreinin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Covidien LP
Original Assignee
Covidien LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2014201021A external-priority patent/AU2014201021B2/en
Application filed by Covidien LP filed Critical Covidien LP
Priority to AU2015238846A priority Critical patent/AU2015238846B2/en
Publication of AU2015238846A1 publication Critical patent/AU2015238846A1/en
Application granted granted Critical
Publication of AU2015238846B2 publication Critical patent/AU2015238846B2/en
Priority to AU2017200332A priority patent/AU2017200332B2/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Apparatus For Radiation Diagnosis (AREA)

Abstract

REGION-GROWING ALGORITHM A region growing algorithm for creating a virtual model of an anatomical structure is disclosed. The region growing algorithm comprises a processor configured to: provide a three-dimensional image volume created from a plurality of two dimensional images; set a threshold value, above which is indicative that an imaged voxel is not representing tissue; select a seed point voxel in the three-dimensional image volume as a starting point; perform a plurality of first iterations; and detect when a number of voxels segmented equals zero. The processor is further configured to perform a plurality of second iterations on leaked objects, if any, until the number of voxels segmented equals zero. 10540662vl

Description

REGION-GROWING ALGORITHM RELATED APPLICATIONS [0001] This application is a divisional application of Australian Patent Application No. 2014201021, which is in turn a divisional application of Australian Patent Application No. 2011210257. Australian Patent Application No. 2011210257 is a national phase entry of International Patent Application No. PCT/IB2011/000243. International Patent Application No. PCT/IB2011/00243 claims priority to U.S. Provisional Patent Application Serial No. 61/300,423 filed February 1, 2010 entitled Region-Growing Algorithm, which is hereby incorporated herein by reference in its entirety. BACKGROUND [0002] Navigating the airways of the lungs has always presented challenges to physicians attempting to diagnose and treat lesions trans-luminally. As such, numerous navigational aids and imaging tools have been developed and/or utilized to provide physicians a "map" of the lungs. [0003] One such tool is a CT scanner. CT scanners use X-ray technology to take multiple scans or "slices" of the lungs. These scans each represent a cross-section of the lungs and can be viewed individually or assembled, via computer programs, to form a three-dimensional CT model. However, CT scans, like most images using X-ray technology, are somewhat cloudy and translucent in nature and difficult to view. As such computer graphics techniques are employed to interpret the information provided by the CT model and "grow" a virtual model of the airways which mimics what might be seen by a bronchoscope navigating the airways. An example of this process is shown and described in U.S. Patent Application Serial No. 11/939,537, entitled Adaptive Navigation Technique for Navigating A Catheter Through a Body Channel Or Cavity, the entirety of which is incorporated by reference herein. [0004] This graphical technique is sometimes referred to as "region growing or 3D map generation", and presents its own challenges. For example, region growing typically involves a processing of the CT data by analyzing each two-dimensional pixel, or, more pertinently, three dimensional voxel, for brightness or "density" and assigning the voxel a value that indicates either tissue or air based on whether the density meets a certain threshold value. CT scans are grayscale images composed by a plurality of pixels (2D) or voxels (3D) - if the scans have been assembled into a volume), each pixel 1 10540662vl or voxel varying in intensity from white (most intense) to black (least intense). Each intensity level between white and black appears as a shade of gray. By designating the various shades of gray from the CT scans either "tissue" or "air" the resulting image of the lungs becomes much more clear. However, if the voxels are designated incorrectly, the model of the lungs becomes inaccurate. Incorrect voxel designation results from setting the threshold level at an -incorrect value, which is an inherent problem when attempting to assign discreet values (air or tissue) to voxels which are actually various shades of gray. [0005] A presently-used technique for optimal threshold setting is beginning with a conservative threshold and performing a region-growing iteration. A conservative threshold is one that is not likely to result in leakage, which occurs when tissue is designated as air and creates a virtual image of the airways that looks like air (color) is spilling out of the airways. However, even with a conservative threshold, inaccuracies in the CT scans can result in "holes" after the segmentation process. These holes result in false branches. [0006] Moreover, a conservative threshold results in airways that end prematurely. Therefore, after a conservative iteration is performed, resulting in a stunted branched structure, the threshold is incrementally increased and a second iteration is performed. These steps are repeated until leakage occurs. Thus, the maximum threshold that does not result in leakage is determined and used. This approach, however, naturally results in the least-dense portion of the CT image dictating the threshold level. There are other problems that arise from this method as well. [0007] For example, during a full inhalation, the airways stretch and thin in order to accommodate the additional air volume. The thinning of the airways results in reduced tissue imaging density, and leakage thus arises even at lower threshold values. [0008] Another example is that each time the threshold is increased, the algorithm runs from the initial seed point. Hence, if the threshold is increased ten times before leakage arises, each of the voxels analyzed in the initial iteration, is analyzed nine more times. This algorithm is thus inherently taxing on processing resources. 2 [0009] As such, a need is identified for a region-growing algorithm that is able to identify localized weaknesses in image data and "repair" them such that more distal branches of a bronchial tree can be segmented and "grown". SUMMARY OF THE INVENTION [0009A] It is an object of the present disclosure to substantially overcome, or at least ameliorate, one or more disadvantages of existing arrangements. [0010] The present disclosure provides a technique and algorithm for controlling leakage while using a high threshold during a region growing procedure. Rather than beginning with a conservative (low) threshold, a high threshold is used but growing is analyzed and controlled. [0011] According to one aspect of the present disclosure, there is provided an algorithm that defines iteration as a single voxel layer of growth, rather than growth until leakage is detected. Each of the iterations is analyzed for a predicted increase (e.g., parabolic increase) in the number of voxels. If the voxels are not growing according to an expected rate, the unexpected increase is identified as leakage. [0012] Rather than ending the region-growing process when leakage is detected, the point of leakage is isolated or "patched" so that further iterations on the current path do not continue from that point, but the rest of the model is allowed continued growth. [0013] According to another aspect of the present disclosure, there is provided a post iteration step which, in effect, repairs or salvages branches encountering leakage. After all of the iterations are performed, branches that had leakage are retrieved from a stored location and regrown with a reduced threshold. These branches are then added to the model. [0013A] According to still another aspect of the present disclosure, there is provided a region growing algorithm for controlling leakage comprising a processor configured to: select a starting point for segmentation of data; initiate a propagation process by designating adjacent voxels around the starting point; determine whether any new voxels are segmented; count and analyze the segmented new voxels to determine leakage levels; identify and record segmented new voxels from a previous iteration when the leakage levels exceed a predetermined threshold; perform labelling of the segmented new voxels of the previous iteration; select the segmented new voxels from the previous iteration when the leakage levels fall below the predetermined threshold; and create a voxel list based on acceptable segmented voxels found in the previous iteration. [0013B] According to still another aspect of the present disclosure, there is provided a region growing algorithm for creating a virtual model of an anatomical structure, the region growing algorithm comprising a processor configured to: provide a three dimensional image volume created from a plurality of two-dimensional images; set a threshold value, above which is indicative that an imaged voxel is not representing tissue; select a seed point voxel in the three-dimensional image volume as a starting point; perform a plurality of first iterations; detect when a number of voxels segmented equals zero; and perform a plurality of second iterations on leaked objects, if any, until the number of voxels segmented equals zero. [0013C] According to still another aspect of the present disclosure, there is provided a region growing algorithm for creating a virtual model of an anatomical structure from a three-dimensional image volume, the region growing algorithm comprising a processor configured to: use, as a threshold, an image voxel density indicative of a fluid; segment voxels meeting the threshold; create a virtual model of interior cavities or lumens of the anatomical structure; perform a series of iterations using a segmented voxel as a seed point; analyze non-segmented voxels adjacent the seed point in a plurality of directions; repeat the iterations using newly segmented voxels from an iteration as seed points for a next iteration until no non-segmented voxels adjacent the seed points in the plurality of directions remain; and separate voxels meeting the threshold but forming leaked objects that fail to satisfy one or more criteria based on comporting to a known anatomical structure. [0013D] According to still another aspect of the present disclosure, there is provided a region growing algorithm for creating a virtual model of an anatomical structure, the region growing algorithm comprising a processor configured to: provide a three dimensional image volume created from a plurality of two-dimensional images; set a threshold value, above which is indicative that an imaged voxel is not representing tissue; select a seed point voxel in the three-dimensional image volume as a starting point; perform a plurality of first iterations; detect when a number of voxels segmented equals zero; and perform a plurality of second iterations on leaked objects, if any, until the number of voxels segmented equals zero. [0014] The advantages of the algorithm of the present disclosure are numerous. One advantage is a more meaningful increase in the number of branches as a result of the utilization of the highest possible threshold. [0015] Another advantage of the algorithm of the present disclosure is that the appearance of "holes" in the central segmented area of the model is greatly reduced. [0016] Yet another advantage of the algorithm of the present disclosure is a reduced number of false branches. Because each iteration is analyzed, growth is controlled and false branches are prevented from growing. [0017] Another advantage of the algorithm of the present disclosure is that the branches grown have an increased length, due to an optimized threshold as well as secondary growing efforts. [0018] Still another advantage of the algorithm of the present disclosure is reduced importance on initial threshold value selection. Through experimentation, it has been found that this algorithm is self-correcting, yielding virtually identical results regardless of the initial threshold used, so long as the thresholds are relatively high. BRIEF DESCRIPTION OF THE DRAWINGS [0019] Figure 1 is a flow-chart of a preferred embodiment of an algorithm of the present invention. DETAILED DESCRIPTION OF THE INVENTION [0020] The technique 10 of the present invention is charted in the flowchart presented as Figure 1. The technique 10 begins at 20 by selecting a starting point for the segmentation of the CT data. For example, selecting a point in the trachea is a logical starting point as it is the largest, and most proximal airway, and easily recognizable on a CT scan. Preferably, the starting point is a single voxel inside the trachea that is centered and meets a high threshold value. In other words, a voxel which is clearly air is selected. Any point from which further adjacent voxels are analyzed is hereinafter referred to as a "seed point". The starting point is the first seed point.
[0021] At 30 the propagation process is initiated by designating adjacent voxels around the starting point. This designation is known as segmentation, and it indicates that the new voxels met the threshold level for fair. Because the starting point is preferably selected in the trachea, and it is not desired to grow the airway back toward the mouth of the patient, only voxels in a distal direction of the starting point are [The next page of the specification is 5] segmented. As such, a "wave" is generated that travels distally into the airways. It is understood that the branches of the lungs fan out in all directions. As such, "distal direction" as used herein is interpreted as getting further away from the starting point along a path that remains in the airway. In other words, some "distal" points in the airways may be relatively close to the starting point if one were to cut through tissue to make a straight line between the points. [0022] It is understood that the starting point, being a single voxel, is surrounded by 26 adjacent voxels, 17 of which are extending in a direction of desired growth (in a direction not yet segmented and not in a reverse direction, such as toward the mouth). [0023] At 40, it is determined whether any new voxels were segmented. In other words, if no voxels in that "wave" met the threshold level for air, there is no growth and the tree is complete. [0024] If the answer at 40 is "yes", the algorithm continues to 50, where the segmented voxels are counted and analyzed to determine whether there is leakage. The new voxels may be more numerous than the previous iteration, but the growth should be controlled. In other words, if the increase in the number of voxels is expected (more specifically, a parabolic increase has been observed in normal growth patterns without leakage) then it is determined that there is no leakage and the process returns to step 30 to begin a new iteration. For example, as indicated above, the starting point consisted of one voxel. Assuming the starting point was surrounded by air, the next "wave" of voxels would be seventeen new seedpoints. However, because many of these are adjacent to each other, the next successive wave would not give rise to seventeen new seed points for each of the previous seventeen seed points. Additionally, the voxels behind each seed point that have been already analyzed, are not segmented again. If the airway being segemented were perfectly cylindrical, as soon as the seedpoints reached the walls of the airway, the "wave-front" would be a convex sheet, a single voxel in thickness, and would remain constant. Hence, the mathematical model for growing is somewhat parabolic, except when new branches are introduced, and considering that the airways are narrowing in the distal direction. Leakage, however, results in an abrupt increase in the number of segmented voxels. 5 [0025] If at 50 the analysis results in an unexpected or abnormally high increase in segmented voxels, it is determined that leakage exists and the process moves to step 60, which identifies and records the segmented voxels from the previous iteration and labels them as accurate. [0026] Leakage determination is derived from two important conclusions: (1) It is expected that the front size has an inverse (not necessarily linear) dependence on the iteration number, e.g. [front size]~f(1/iteration number). (2) Bifurcations and changes in airway shape may result in somewhat linear growth in front size. [0027] At 70, upon the detection of leakage, an analysis is done in order to select the most recent "good" iteration that does not contain leakage. This decision is based on the same principals used to satisfy the mathematical model in compliance with the natural structure of the bronchial tree. [0028], The voxels segmented up to the last good iteration are assumed to be committed to the segmented voxel list, while voxels that belong to each iteration above the "good" one are analyzed in order to separate the voxels that led to the leakage. In order to make this analysis, recently segmented voxels are labeled to connected objects (part of the branch). Each object is then analyzed in order to detect the object that caused leakage. [0029] The coordinates of voxels that belong to inaccurate objects are stored separately and treated differently thereafter. They are locked in the binary map to prevent their participation in the segmentation process. Voxels, belonging to accurate branches are returned to the sementation and the process returns to 30. [0030] At 80 the objects identified as leaking are removed from further segmentation and stored in a queue for post processing. After 80 the process returns to 30 for the next iteration. [0031] If at 50 the answer was "no" for leakage, the process returns to 30 for the next iteration. It should be noted that the flow chart 10, though presented in series for clarification, is actually a parallel operation. In other words, each new voxel is a seed point and the flow chart is performed on each next iteration therefrom simultaneously. 6 Hence, viewing the growth of the bronchial tree real time, one would see a near-instant tree appear, depending of course on the power of the processor running the algorithm. [0032] If at 40 there are no new voxels detected, the algorithm proceeds to 90, which is a decision step asking whether any leakage objects were identified. If the answer is "yes" step 100 is executed, which retrieves the last object from the storage queue (step 80). [0033] Next at 110, the threshold is reduced and the algorithm is performed on only the selected leakage object. Because a reduced threshold is being used, the likelihood of leakage is reduced. [0034] If at 90 it is determined that there are no leakage objects, either because there were none or they have all been reprocessed, the process is completed at 120. [0035] Although the invention has been described in terms of particular embodiments and applications, one of ordinary skill in the art, in light of this teaching, can generate additional embodiments and modifications without departing from the spirit of or exceeding the scope of the claimed invention. Accordingly, it is to be understood that the drawings and descriptions herein are proffered by way of example to facilitate comprehension of the invention and should not be construed to limit the scope thereof. 7

Claims (10)

  1. 2. The region growing algorithm of claim 1, wherein each of the plurality of first iterations includes segmenting voxels, located adjacent the seed point in a plurality of directions, that meet or exceed the threshold value.
  2. 3. The region growing algorithm of claim 2, wherein each of the plurality of first iterations further includes determining a number of voxels segmented in this iteration and if the number of voxels is greater than zero, determining whether the number is large enough to indicate leakage.
  3. 4. The region growing algorithm of claim 3, wherein each of the plurality of first iterations further includes removing leaked voxels and storing the leaked voxels as leaked objects for post-processing.
  4. 5. The region growing algorithm of claim 4, wherein each of the plurality of first iterations further includes identifying segmented voxels as seed points for a next iteration if no leakage is indicated.
  5. 6. The region growing algorithm of claim 1, wherein each of the plurality of second iterations include selecting voxels in a first iteration detecting leakage for a given leaked object as seed points. 8 10540662vl
  6. 7. The region growing algorithm of claim 6, wherein the plurality of second iterations further include reducing the threshold value.
  7. 8. The region growing algorithm of claim 7, wherein the plurality of second iterations further include segmenting voxels, located adjacent the seed points in a plurality of directions, that meet or exceed the threshold value.
  8. 9. The region growing algorithm of claim 8, wherein the plurality of second iterations further include determining a number of voxels segmented in this iteration and if the number of voxels is greater than zero, determining whether the number is large enough to indicate leakage.
  9. 10. The region growing algorithm of claim 9, wherein the plurality of second iterations further include removing leaked voxels and storing the leaked voxels as leaked objects for post-processing.
  10. 11. The region growing algorithm of claim 10, wherein the plurality of second iterations further include identifying segmented voxels as seed points for a next iteration if no leakage is indicated. Covidien LP Patent Attorneys for the Applicant/Nominated Person SPRUSON & FERGUSON 9 10540662vl
AU2015238846A 2010-02-01 2015-10-08 Region-growing algorithm Ceased AU2015238846B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2015238846A AU2015238846B2 (en) 2010-02-01 2015-10-08 Region-growing algorithm
AU2017200332A AU2017200332B2 (en) 2010-02-01 2017-01-18 Region-growing algorithm

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US61/300,423 2010-02-01
AU2014201021A AU2014201021B2 (en) 2010-02-01 2014-02-26 Region-growing algorithm
AU2015238846A AU2015238846B2 (en) 2010-02-01 2015-10-08 Region-growing algorithm

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
AU2014201021A Division AU2014201021B2 (en) 2010-02-01 2014-02-26 Region-growing algorithm

Related Child Applications (1)

Application Number Title Priority Date Filing Date
AU2017200332A Division AU2017200332B2 (en) 2010-02-01 2017-01-18 Region-growing algorithm

Publications (2)

Publication Number Publication Date
AU2015238846A1 true AU2015238846A1 (en) 2015-10-29
AU2015238846B2 AU2015238846B2 (en) 2016-10-20

Family

ID=54707454

Family Applications (2)

Application Number Title Priority Date Filing Date
AU2015238846A Ceased AU2015238846B2 (en) 2010-02-01 2015-10-08 Region-growing algorithm
AU2017200332A Ceased AU2017200332B2 (en) 2010-02-01 2017-01-18 Region-growing algorithm

Family Applications After (1)

Application Number Title Priority Date Filing Date
AU2017200332A Ceased AU2017200332B2 (en) 2010-02-01 2017-01-18 Region-growing algorithm

Country Status (1)

Country Link
AU (2) AU2015238846B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112288718A (en) * 2020-10-29 2021-01-29 推想医疗科技股份有限公司 Image processing method and apparatus, electronic device, and computer-readable storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7397937B2 (en) * 2001-11-23 2008-07-08 R2 Technology, Inc. Region growing in anatomical images
US6978039B2 (en) * 2001-12-13 2005-12-20 General Electric Company Method and system for segmentation of medical images
AU2007350982A1 (en) * 2006-11-10 2008-10-23 Dorian Averbuch Adaptive navigation technique for navigating a catheter through a body channel or cavity

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112288718A (en) * 2020-10-29 2021-01-29 推想医疗科技股份有限公司 Image processing method and apparatus, electronic device, and computer-readable storage medium
CN112288718B (en) * 2020-10-29 2021-11-02 推想医疗科技股份有限公司 Image processing method and apparatus, electronic device, and computer-readable storage medium

Also Published As

Publication number Publication date
AU2017200332B2 (en) 2018-05-10
AU2017200332A1 (en) 2017-02-02
AU2015238846B2 (en) 2016-10-20

Similar Documents

Publication Publication Date Title
US10249045B2 (en) Region-growing algorithm
CN106097305B (en) The intratracheal tree dividing method that two-pass region growing combining form is rebuild
Schlathoelter et al. Simultaneous segmentation and tree reconstruction of the airways for virtual bronchoscopy
Aykac et al. Segmentation and analysis of the human airway tree from three-dimensional X-ray CT images
EP2036040B1 (en) Automated hierarchical splitting of anatomical trees
WO2007064769A1 (en) Adaptive density mapping in computed tomographic images
US8050470B2 (en) Branch extension method for airway segmentation
Irving et al. 3D segmentation of the airway tree using a morphology based method
Wang et al. Naviairway: a bronchiole-sensitive deep learning-based airway segmentation pipeline for planning of navigation bronchoscopy
AU2015238846B2 (en) Region-growing algorithm
Wang et al. Naviairway: a bronchiole-sensitive deep learning-based airway segmentation pipeline
Singh et al. Automated 3D segmentation of the lung airway tree using gain-based region growing approach
AU2014201021B2 (en) Region-growing algorithm
Tschirren et al. Airway segmentation framework for clinical environments
Pinho et al. Robust region growing based intrathoracic airway tree segmentation
Duan et al. Two-pass region growing combined morphology algorithm for segmenting airway tree from CT chest scans
Wei et al. Segmentation of lung lobes in volumetric CT images for surgical planning of treating lung cancer
CN117541797B (en) Interactive three-dimensional bronchus segmentation system and method for chest CT (computed tomography) flat scanning
Lu et al. Semi-automatic central-chest lymph-node definition from 3D MDCT images
Khanna et al. Automated Localized Approach for Airway Segmentation in 3D Chest CT Volume
CN113689442A (en) Method for realizing lung organ segmentation based on three-dimensional image
CN117541797A (en) Interactive three-dimensional bronchus segmentation system and method for chest CT (computed tomography) flat scanning
Sabourin et al. Automatic contour retrieval in annotated TRUS prostate images

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired