WO2009074872A2 - Patent breathing modeling - Google Patents

Patent breathing modeling Download PDF

Info

Publication number
WO2009074872A2
WO2009074872A2 PCT/IB2008/003728 IB2008003728W WO2009074872A2 WO 2009074872 A2 WO2009074872 A2 WO 2009074872A2 IB 2008003728 W IB2008003728 W IB 2008003728W WO 2009074872 A2 WO2009074872 A2 WO 2009074872A2
Authority
WO
WIPO (PCT)
Prior art keywords
patient
breathing
breathing cycle
image
points
Prior art date
Application number
PCT/IB2008/003728
Other languages
French (fr)
Other versions
WO2009074872A3 (en
Inventor
Dorian Averbuch
Original Assignee
Superdimension, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Superdimension, Ltd. filed Critical Superdimension, Ltd.
Priority to EP08860538.1A priority Critical patent/EP2192855B1/en
Publication of WO2009074872A2 publication Critical patent/WO2009074872A2/en
Publication of WO2009074872A3 publication Critical patent/WO2009074872A3/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/06Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
    • A61B5/065Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
    • A61B5/066Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/267Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the respiratory tract, e.g. laryngoscopes, bronchoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101Computer-aided simulation of surgical operations
    • A61B2034/105Modelling of the patient, e.g. for ligaments or bones
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/54Control of apparatus or devices for radiation diagnosis
    • A61B6/541Control of apparatus or devices for radiation diagnosis involving acquisition triggered by a physiological signal

Definitions

  • the method of the present invention relates generally to the accurate registration of a detected sensor located in moving lungs to a static image of the lungs.
  • the evolution of procedures using less-invasive scopes has resulted in the development of sensors that can be attached to end of an endoscope and used to determine the three-dimensional location and orientation of the end of the endoscope. Examples of such sensor technology is shown and described in various patents and patent publications including U.S. Patent 6,188,355 to Gilboa, U.S. Patent 6,380,732 to Gilboa, U.S. Patent 6,593,884 to Gilboa et al., U.S. Patent 6,615,155 to Gilboa, 6,833,814 to Gilboa et al., U.S.
  • Patent 6,947,788 to Gilboa et al. each of which is incorporated herein in its entirety. Additionally, there are many other technologies (laser technology, ultrasound technology, etc.) directed toward for locating a medical tool (catheter, endoscope, needle) inside the human lungs.
  • Shao is directed to reconciling a dynamic, PET imaging data set with a static CT imaging data set. Shao accomplishes this by merely morphing (stretching or distorting) the image sets together. Doing so does not necessarily improve the accuracy of the real-time data being displayed because at least one of the data sets is being distorted. Rather, this approach merely makes the display appear to be more accurate. Moreover, PET requires prolonged exposure to radioactive imaging agents.
  • the model is completely simulated, it is useful for studying lung movement and the effects of tumor, but it would not have application during a procedure on an actual patient. Additionally, the reference discusses movement vectors within the lungs, but it does not find a mathematical relationship between these various vectors.
  • the method of the present invention provides a representative modeling of the human lungs, based on statistical anatomical data, which can be tailored to the size and shape of an individual patient.
  • the method of the present invention also utilizes a compilation of statistical anatomical data regarding lung movement in order to predict the movement of an individual patient's lungs during the breathing cycle.
  • one or more static images may be "brought to life" by applying a mathematical model that predicts how a given point in the lungs will move during the breathing cycle, based on a large sample of statistical data.
  • the mathematical model is tied to one or more external position sensors on the patient's chest. Hence, by monitoring the external sensor(s), and applying the mathematical movement model, an instantaneous position of a given point in the lungs can be predicted.
  • Th breathing cycle and its parameters may alternatively be m sensors, or other devices such as spirometry devices, for example.
  • each data set will preferably include at least one exhale scan and one inhale CT scan, acquired while the patient is holding an exhaled state or inhaled state, respectively. These scans will then be used as the extreme positions of the patient's breathing cycle.
  • the aforementioned mathematical movement model is then used to fill in the lung positions between the inhalation and exhalation points acquired by the CT scans of the actual patient. Additionally, any scans taken of the patient's lungs in intermediate breathing positions could also be added to the dynamic modeling set. Such acquired actual position data may be used to validate or modify the mathematical model as appropriate.
  • the path a given point in a lung travels between inhalation and exhalation can be described mathematically and stored in a computer.
  • the mathematical equations of the movement can be tied to one or more marker positions, so as the patient breathes, the computer may calculate the corresponding position of the point based on the position of the one or more markers.
  • the computer can then implement the mathematical equations stored for a plurality of points to either create a dynamic representation of the lungs and present this to the user via a display, or synchronize this movement with the real-time movement of the LG and present the LG as though it were not moving cyclically, just advancing and turning according to its manipulation by the user.
  • the computer can use the plurality of mathematical equations as a filter, applied to the graphic display of the LG.
  • Example 1 Constantly measuring the point at which a patient is in the breathing cycle allows a corresponding CT scan, which is closer to the actual position to the location of the sensor to be displayed over the sensor image.
  • Example 2 The measured location of the tool can be corrected "cinn th ⁇ patient breathing model. In this way the tool may be localized more corre the CT volume. And therefore any geometric model derived fr be more accurately represented relative to the tool inside the body.
  • Example 3 Using a well known technique called image warping, the CT Volume can be changed dynamically using the patient breathing model and according to the monitored phase of breathing cycle. This can be used to display augmented reality images to perform the simulation of dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc., to simulate the patient physiology synchronized to the actual patient, study the tissue movement relative to the inserted tools, and for other purposes as well.
  • image warping Using a well known technique called image warping, the CT Volume can be changed dynamically using the patient breathing model and according to the monitored phase of breathing cycle. This can be used to display augmented reality images to perform the simulation of dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc., to simulate the patient physiology synchronized to the actual patient, study the tissue movement relative to the inserted tools, and for other purposes as well.
  • dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc.
  • Figure 1 is a flowchart of one embodiment of the method of the present invention.
  • Figure 2 is a flowchart of a second embodiment of the method of the present invention.
  • Patient characteristics is a term defined herein as any attribute of the patient that will influence the position of his or her lungs during any given point in the breathing cycle.
  • Patient characteristics include, but are not limited to patient size (lung size), lung shape, lung health, altitude, patient age, diaphragm size, and diaphragm health.
  • altitude is not intrinsic to any given patient, the elevation at which a patient is breathing impacts the depth and/or the frequency of the breaths taken during the breathing cycle.
  • Lung health relates to the lung capacity of a given patient and includes such factors as whether the patient smokes, whether the patient has an increased lung capacity due to athletic training, whether the patient has ⁇ such as cystic fibrosis, etc.
  • the patient is imaged using any imaging modality that shows the lungs or desired target area.
  • CT imaging will be used.
  • the CT imaging may be high definition CT and preferably a first image set is taken with the lungs full of air and a second image set is taken after the patient has fully exhaled.
  • a single CT image set may be used if there is accurate data regarding how full the lungs are when the image is taken.
  • AOI area of interest
  • the patient position sensors are sensors on the chest, sensors in the lungs, or a device such as a spirometry device, that are used to measure the positions of key points on the patient's body in order to determine where the patient is in the breathing cycle.
  • the data from these sensors are not only used as an entering argument for the upcoming mathematical modeling step 70, but also to monitor the physical location of the patient in order to register a real-time image (such as that acquired to show the position of the beatable guide) to the CT scan image(s).
  • a mathematical model is developed to describe the movement at one or more points in the AOI(s) during the breathing cycle.
  • the mathematical model uses data from the patient position sensors as entering arguments and the result of the solved algorithm is a three dimensional position of the point in question. Selecting more points in a given AOI will result in a better registration between a display of the locatable guide (LG) and the CT scan taken at 40.
  • the ma algorithm used to develop the model may be obtained b ⁇ number of subjects in a study and relating the movement of given points to the point in the breathing cycle in which the positions were acquired.
  • the mathematical algorithm may be developed using computer simulated models, such as those described in the aforementioned Garrity et al. reference. Examples of algorithms developed for the present invention and proven useful through experimentation are described below.
  • the procedure begins on the patient.
  • the patient movement sensors are placed on or in the patient.
  • the physician intubates the patient and the LG is inserted and tracked.
  • the CT scan from 40 is displayed and registered to the superimposed LG display.
  • the location(s) of the patient location sensors are constantly monitored and entered into the algorithm to provide three dimensional location data on the AOI(s). This information is then used at 90 to ensure that the display is modified such that the LG display maintains an accurate registration with the CT scan, despite the movement of the lungs, which cause the LG to move.
  • Example 1 If multiple CT scans were acquired at 40, the data acquired at 80 may be used to determine which CT scan most accurately depicts the configuration of the lungs and can thus be superimposed onto the LG display.
  • Example 2 The measured location of the LG can be corrected using the data acquired at 80. Rather than displaying the real-time data acquired by the LG system, which represents the position of the LG in relation to a magnetic field filling the AOI, the real-time data is manipulated so the LG appears in the correct location on the CT scan, which may be static or dynamic. In this way the too 1 m ⁇ " ho localized more correctly inside the CT volume. The geometric model de the CT volume can thus be more accurately represented rel the body.
  • Example 3 Using a well-known technique called image warping, the CT Volume can be changed dynamically using the data acquired at 80 and according to the monitored phase of breathing cycle. This can be used to display augmented images to perform the simulation of dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc., to simulate the patient physiology synchronized to the actual patient, study the tissue movement relative to the inserted tools, and for other purposes as well.
  • image warping Using a well-known technique called image warping, the CT Volume can be changed dynamically using the data acquired at 80 and according to the monitored phase of breathing cycle. This can be used to display augmented images to perform the simulation of dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc., to simulate the patient physiology synchronized to the actual patient, study the tissue movement relative to the inserted tools, and for other purposes as well.
  • dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc.
  • FIG. 2 there is shown a flowchart that illustrates another embodiment 120 of the method of the present invention.
  • Patient characteristics is a term defined herein as any attribute of the patient that will influence the position of his or her lungs during any given point in the breathing cycle.
  • Patient characteristics include, but are not limited to patient size (lung size), lung shape, lung health, altitude, patient age, diaphragm size, and diaphragm health.
  • altitude is not intrinsic to any given patient, the elevation at which a patient is breathing impacts the depth and/or the frequency of the breaths taken during the breathing cycle.
  • Lung health relates to the lung capacity of a given patient and includes such factors as whether the patient smokes, whether the patient has an increased lung capacity due to athletic training, whether the patient has a condition such as cystic fibrosis, etc.
  • the patient is imaged using any imaging modality that shows the lungs or desired target area. Most likely, CT imaging will be used. Preferably a first image set is taken with the lungs full of air and a second imac patient has fully exhaled.
  • the patient is matched to an archived data set taken from a data library. It is desirable to find an archived data set that matches the patient's breathing cycle as closely as possible.
  • the patient characteristics are used as matching criteria. The specific characteristics that are used, and the number of different characteristics that are used, are largely dependent on the size of the data library. However, if the patient has any distinguishing lung traits, such as a significantly reduced capacity due to smoking, they should be given more weight than other, less-distinguishing traits when looking for a matching data set.
  • the inhaled and exhaled positions recorded and measured using CT scans could be used as the entering arguments for matching the patient to a data set. If the inhaled and exhaled positions are closely matched to a data set, it will be likely that the intermediate points between inhalation and exhalation will also match. However, considerations like patient size should still be considered to ensure that the lung geometries are also matched.
  • a CT image set for the patient is generated.
  • the closely-matched data set is either used alone, or if inhalation and exhalation CT scans have been taken, they are added to the data set to improve the degree to which the data set is matched to the actual patient geometry.
  • each image of the image set is assigned to a lung position, as measured by external or internal means. Because each of the images will be displayed during the procedure at different times during the breathing cycle, it is necessary to determine, in advance, when each image will be cued for display. There are at least two ways in which this may be done. First, the positions of sensors, such as external sensors placed on the patient's chest, may be monitored throughout the breathing cycle. Each image may be examined to determine a position of the lungs that is most closely matched to that particular image. When the external sensors indicate a particular lung position, the image will be chan most closely matched image.
  • an average bre measured to determine the inhaling period (defined herein as the amount of time between inhalation and exhalation) and the exhaling period (defined herein as the amount of time between exhalation and inhalation).
  • the inhaling period it will be known to display the inhalation image taken at 150.
  • the exhalation point it will be known to display the exhalation image taken at 150.
  • the measured periods may be divided by the number of intermediate images in the data set to determine an interval time. The images will then be changed each interval.
  • the actual procedure begins.
  • the lung position is monitored. If the first method at 170 was used, sensors on the chest, sensors in the lungs, or a device such as a spirometry device is used to determine when the images shall be displayed at 190 to most accurately represent the actual lungs. If the second method at 170 was used, the breathing cycle will be monitored using any of the aforementioned sensors or devices, to update the average inhaling and exhaling periods of the breathing cycle. At 190, the images will be changed according to the constantly-updated intervals.
  • the second method at 160 avoids the process of examining each individual image of the data set to assign it to a point in the breathing cycle.
  • the first method is used and the lung positions are monitored to determine which image to display at 190, during times of shallow breathing, the inhalation and exhalation scans may never be displayed. This is because during times of shallow breathing, the sensors will never measure a lung position that triggers the display of the scans taken at 140.
  • the second method is used, the extremes are shown each cycle. The only variance will be the frequency of the image changes.
  • step 170 maintains a constant image interval during shallc " ' iU ⁇ but ends the progression of images shown from exhalation point v determined that the patient is no longer inhaling. In other we no matter how shallow the breaths being taken are, the patient is still achieving a full exhalation. Shallow breaths mean the patient is not achieving a full inhalation. Thus, images are shown at a regular interval until the patient begins to exhale. Then, the images are shown in reverse order at the exhalation interval.
  • Local tissue deformations can be learned by analyzing the displacements of each landmark point. The missing data between the displacements of each landmark point can be interpolated.
  • Non-rigid registration techniques were used in order to get marked landmark points to smoothly transform from one state to another.
  • the methods, functions and kernels are chosen according to the stability of the transformation and robustness to possible outliers.
  • the transformation techniques used include polynomials, basis functions, and splines.
  • Modeling can be performed for all landmarks tc deformation function that can be used for global calculations. It is also possible to divide the lungs to smaller sub-parts that can be modeled separately while simplifying the needed transformation. For example, analyzing the left and right sides of the lungs separately yielded good results.
  • the methods of the present invention allow describing lung tissue deformations during breathing cycles using a low number of degrees of freedom with an acceptable level of inaccuracy. Hence, the transformation can be produced or reproduced using a small number of control points (internal and/or external) with locations sampled in real time.
  • the vectors may be divided according to anatomical regions, such as left lung and right lung, for example.
  • Linear transformation models can be extended to non-linear transformation models.
  • second order polynomial transformation For second order polynomial transformation:
  • a polynomial fit is a specific type of linear multiple regression.
  • V ( U 1 -X )
  • the 3D vector is transformed to 10D space by:
  • the minimum number of point pairs needed for identification of the transformation is determined by the number of DOFs (degrees of freedom) for an output space of function f.
  • DOFs degree of freedom
  • This optimization problem is solved using Nelder-Mead method or the Simplex Search method.
  • the method uses the concept of a Simplex, which is a polytope (generalization to any dimension of polygon) of N + 1 vertex in N dimensions; a line segment on a line, a triangle on a plane, a tetrahedron in three- dimensional space and so forth.
  • the method approximately finds a locally optimal solution to a problem with N variables when the objective function varies smoothlv.
  • the search for the global minimum is perform optimization task on the function F, defined above, in multi-dimensional space, which has 16 dimensions in this case.
  • the integration is performed over defined volume space around (using defined kernel function).
  • the integration boundaries can be 3D cube of size N or sphere with radius N.
  • the respiratory motion can also be described by means of modeling the "skeletal" motion of the lungs.
  • a skeletal tree of the lungs is produced by representing the bifurcations of the airways as nodes and then connecting the nodes to form a skeleton of the airways.
  • Skeletal trees are generated for two breathing states of the same patient. Then the trees are combined together in order to identify the changes that are modeled later by measuring the relative angles at the nodes.
  • Skeletal trees from different individuals can be further analyzed by comparing the behavior of corresponding nodes from each patient. .
  • the available data set has been divided to training and testing sets.
  • the model parameters have been estimated by the training set and verified with the testing set proving the feasibility of the method.
  • Transformation method tissue deformations of the entire lung were modeled using smooth vector function with an average fit error of about 2 mm.
  • Grid method 3 patients were used for building the model and 1 patient for verification. After applying cross validation, the average error was about 4 mm.
  • Breathing vectors for patients with normal breathing intensity was 1-2 mm in the central lung regions and 10-15 mm at the periphery (diaphragm).
  • the general breathing models that were obtained using the aforementioned technique were verified using cross-reference method.
  • the model is derived from each of the available patients and then used for modeling breathing for other available patients, including one used for model generation in order to have a comparative lower limit error estimation.
  • Seven patients participated in the study. The folio' the mean errors and standard deviations when applying the breathing model derived from the patient on the row to each of the patients from the columns.
  • the polynomial degree and element choice is determined by model accuracy specifications.
  • Tissue deformations during the breathing cycle can be described using a low number of degrees of freedom with acceptable accuracy.
  • the transformation can be reproduced using a small number of control points.
  • the "breathing vectors" correction technique can be successfully used during electromagnetic bronchoscopy procedures to reduce localization errors. However, additional data sets are needed if method verification is desired.
  • the other related issue deals with possible outlier removal.
  • the outliers can be determined with regard to their correlation with registration data set and filtered out.
  • Such filtering is essential for breathing motion generic model generation.
  • Non-uniform distribution of points is a problem that should be also addressed during while modeling the breathing cycle.
  • One possible solution is to use the same points several times in the data set in order to assign them more weight in the algorithm.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Gynecology & Obstetrics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Processing (AREA)

Abstract

A method of accounting for the movement of the lungs during an endoscopic procedure such that a previously acquired image may be dynamically registered with a display showing the position of a beatable guide. After an initial image set is acquired, an area of interest is identified and the movement thereof due to breathing is mathematically modeled. Patient movement sensors are then used to provide information on the patient's breathing patterns. This information is entered into the mathematical model in order to update the registration between the image set and a display showing the position of the locatable guide.

Description

PATIENT BREATHING MODELING
RELATED APPLICATIONS
[0001] This application claims priority to U.S. Provisional Application Serial No. 60/948,640 filed July 9, 2007 entitled Patient Breathing Modeling; and U.S. Provisional Application Serial No. 61/043,987 filed April 10, 2008 entitled Patient Breathing Modeling, all of which are hereby incorporated by reference.
BACKGROUND OF THE INVENTION
[0002] The method of the present invention relates generally to the accurate registration of a detected sensor located in moving lungs to a static image of the lungs. The evolution of procedures using less-invasive scopes has resulted in the development of sensors that can be attached to end of an endoscope and used to determine the three-dimensional location and orientation of the end of the endoscope. Examples of such sensor technology is shown and described in various patents and patent publications including U.S. Patent 6,188,355 to Gilboa, U.S. Patent 6,380,732 to Gilboa, U.S. Patent 6,593,884 to Gilboa et al., U.S. Patent 6,615,155 to Gilboa, 6,833,814 to Gilboa et al., U.S. Patent 6,947,788 to Gilboa et al., each of which is incorporated herein in its entirety. Additionally, there are many other technologies (laser technology, ultrasound technology, etc.) directed toward for locating a medical tool (catheter, endoscope, needle) inside the human lungs.
[0003] One problem that arises while using these localization methods is that, in order to provide information that is useful to a physician, a display must be used that shows a representation of the tool superimposed on an image of the lungs. If a static image of the lungs is used, the tool, which is moving with the lungs as the patient breathes, appears to float in and out of the airways in the preliminary, relatively static image. Accurately matching the position of the sensor in the lungs to an image of the lungs is achieved by "registration." Ideally, the desired result of registration would involve matching the tool representation to a real-time, dynamic image of the lungs. However, this would require constε radiation by both the patient and the medical staff during while performing the dynamic registration.
[0004] One approach at solving this problem is described in U.S. Patent 7,117,026 to Shao et al., which is incorporated by reference herein in its entirety. Shao is directed to reconciling a dynamic, PET imaging data set with a static CT imaging data set. Shao accomplishes this by merely morphing (stretching or distorting) the image sets together. Doing so does not necessarily improve the accuracy of the real-time data being displayed because at least one of the data sets is being distorted. Rather, this approach merely makes the display appear to be more accurate. Moreover, PET requires prolonged exposure to radioactive imaging agents.
[0005] Another approach at solving this problem is described in U.S. Patent Publication No. 2003/0185346 to Vilsmeier. Vilsmeier \s directed to avoiding costly CT scans by building a generic model of various areas of the body using a compilation of data from various patients, and then adapting that generic model to a specific patient. This idea certainly reduces costs and exposure to radiation, however it necessarily compromises image accuracy. Moreover, though the anatomy of the trachea and upper bronchial anatomy is very similar in most people, the lower bronchi become very patient-specific. It is in these lower bronchi where accurate information is most important. Finally, Vilsmeier does not address developing a dynamic model. Not only are the lower bronchi more patient-specific, they move more. So even if one where to use the Vilsmeier model to create a dynamic lung simulation, the lack of accuracy in the lower bronchi would not solve the problem the present invention addresses.
[0006] One reference that discusses the development of a generic model and begins to analyze the movement vectors for a breathing cycle is entitled "Development of a Dynamic Model for the Lung Lobes and Airway Tree in the NCAT Phantom" and is written by Garrity et al. This reference was published in 2002 as part of the Nuclear Science Symposium Conference Record, and appear" :~ 1^1- ^ Vol. 3, pp. 1858-1862. This reference is incorporated herein in its e describes an algorithm that fills an empty outline of a simu virtual bronchial tree. The bronchial tree simulates movement due to breathing and cardiac rhythms. Because the model is completely simulated, it is useful for studying lung movement and the effects of tumor, but it would not have application during a procedure on an actual patient. Additionally, the reference discusses movement vectors within the lungs, but it does not find a mathematical relationship between these various vectors.
[0007] There is thus an identified need for a representation of the lungs that is more representative of a breathing patient's lungs than a static, previously acquired image, but does not result in an increased exposure to radiation.
SUMMARY OF THE INVENTION
[0008] The method of the present invention provides a representative modeling of the human lungs, based on statistical anatomical data, which can be tailored to the size and shape of an individual patient. The method of the present invention also utilizes a compilation of statistical anatomical data regarding lung movement in order to predict the movement of an individual patient's lungs during the breathing cycle.
[0009] Breathing causes the lungs to move cyclically. The movement varies by amplitude and direction during the breathing cycle from 5mm to 30mm depending on such breathing characteristics as patient size, age, altitude, health, etc. In order to reduce the deviation this movement causes between a living patient and a static image, lung movement is modeled. Dynamic modeling, according to the present invention, is based on a comparison of multiple CT data sets.
[0010] In one embodiment of the present invention, one or more static images, such as a CT data set, may be "brought to life" by applying a mathematical model that predicts how a given point in the lungs will move during the breathing cycle, based on a large sample of statistical data. The mathematical model is tied to one or more external position sensors on the patient's chest. Hence, by monitoring the external sensor(s), and applying the mathematical movement model, an instantaneous position of a given point in the lungs can be predicted. Th breathing cycle and its parameters may alternatively be m sensors, or other devices such as spirometry devices, for example.
[0011] In another embodiment, each data set will preferably include at least one exhale scan and one inhale CT scan, acquired while the patient is holding an exhaled state or inhaled state, respectively. These scans will then be used as the extreme positions of the patient's breathing cycle.
[0012] The aforementioned mathematical movement model is then used to fill in the lung positions between the inhalation and exhalation points acquired by the CT scans of the actual patient. Additionally, any scans taken of the patient's lungs in intermediate breathing positions could also be added to the dynamic modeling set. Such acquired actual position data may be used to validate or modify the mathematical model as appropriate.
[0013] Alternatively, instead of matching the patient's characteristics to previously acquired CT scans of one or more other patients, the path a given point in a lung travels between inhalation and exhalation can be described mathematically and stored in a computer. The mathematical equations of the movement can be tied to one or more marker positions, so as the patient breathes, the computer may calculate the corresponding position of the point based on the position of the one or more markers. The computer can then implement the mathematical equations stored for a plurality of points to either create a dynamic representation of the lungs and present this to the user via a display, or synchronize this movement with the real-time movement of the LG and present the LG as though it were not moving cyclically, just advancing and turning according to its manipulation by the user. In other words, the computer can use the plurality of mathematical equations as a filter, applied to the graphic display of the LG.
[0014] Example 1. Constantly measuring the point at which a patient is in the breathing cycle allows a corresponding CT scan, which is closer to the actual position to the location of the sensor to be displayed over the sensor image.
[0015] Example 2. The measured location of the tool can be corrected "cinn thΩ patient breathing model. In this way the tool may be localized more corre the CT volume. And therefore any geometric model derived fr be more accurately represented relative to the tool inside the body.
[0016] Example 3. Using a well known technique called image warping, the CT Volume can be changed dynamically using the patient breathing model and according to the monitored phase of breathing cycle. This can be used to display augmented reality images to perform the simulation of dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc., to simulate the patient physiology synchronized to the actual patient, study the tissue movement relative to the inserted tools, and for other purposes as well.
BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 is a flowchart of one embodiment of the method of the present invention;
[0018] Figure 2 is a flowchart of a second embodiment of the method of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0019] Referring now to the figures and first to Figure 1 , there is shown a flowchart that illustrates one embodiment 20 of the method of the present invention.
[0020] At 30 the patient characteristics are measured or determined. "Patient characteristics" is a term defined herein as any attribute of the patient that will influence the position of his or her lungs during any given point in the breathing cycle. Patient characteristics include, but are not limited to patient size (lung size), lung shape, lung health, altitude, patient age, diaphragm size, and diaphragm health. Though altitude is not intrinsic to any given patient, the elevation at which a patient is breathing impacts the depth and/or the frequency of the breaths taken during the breathing cycle. Lung health relates to the lung capacity of a given patient and includes such factors as whether the patient smokes, whether the patient has an increased lung capacity due to athletic training, whether the patient has ε such as cystic fibrosis, etc. One skilled in the art will rea characteristics are more determinative of lung position than others and that it may only be feasible to factor a few of the listed characteristics into the matching process described below. Moreover, which factors are most determinative will likely vary by patient. Many of the characteristics can be measured using a CT scan performed prior to the procedure.
[0021] At 40 the patient is imaged using any imaging modality that shows the lungs or desired target area. Most likely, CT imaging will be used. The CT imaging may be high definition CT and preferably a first image set is taken with the lungs full of air and a second image set is taken after the patient has fully exhaled. However, it is envisioned that a single CT image set may be used if there is accurate data regarding how full the lungs are when the image is taken.
[0022] At 50 the images taken at 40 are reviewed and at least one area of interest (hereinafter "AOI") is identified. Identifying an AOI will allow the focus to remain on applicable areas of the lungs and reduce the number of computations that have to be made in later steps.
[0023] At 60 it is determined where the patient position sensors should be placed. The patient position sensors are sensors on the chest, sensors in the lungs, or a device such as a spirometry device, that are used to measure the positions of key points on the patient's body in order to determine where the patient is in the breathing cycle. The data from these sensors are not only used as an entering argument for the upcoming mathematical modeling step 70, but also to monitor the physical location of the patient in order to register a real-time image (such as that acquired to show the position of the beatable guide) to the CT scan image(s).
[0024] At 70 a mathematical model is developed to describe the movement at one or more points in the AOI(s) during the breathing cycle. The mathematical model uses data from the patient position sensors as entering arguments and the result of the solved algorithm is a three dimensional position of the point in question. Selecting more points in a given AOI will result in a better registration between a display of the locatable guide (LG) and the CT scan taken at 40. The ma algorithm used to develop the model may be obtained b^ number of subjects in a study and relating the movement of given points to the point in the breathing cycle in which the positions were acquired. Alternatively, the mathematical algorithm may be developed using computer simulated models, such as those described in the aforementioned Garrity et al. reference. Examples of algorithms developed for the present invention and proven useful through experimentation are described below.
[0025] At 80 the procedure begins on the patient. The patient movement sensors are placed on or in the patient. The physician intubates the patient and the LG is inserted and tracked. The CT scan from 40 is displayed and registered to the superimposed LG display.
[0026] As the LG is being inserted, the location(s) of the patient location sensors are constantly monitored and entered into the algorithm to provide three dimensional location data on the AOI(s). This information is then used at 90 to ensure that the display is modified such that the LG display maintains an accurate registration with the CT scan, despite the movement of the lungs, which cause the LG to move.
[0027] There are at least three ways at 90 in which the data acquired from 80 can be used to improve the registration between the LG display and the CT scan. These three examples are not to be considered exclusive, as one skilled in the art will see the usefulness of the data acquired at 80 and realize other ways to apply the data at 90 or subsequent steps.
[0028] Example 1. If multiple CT scans were acquired at 40, the data acquired at 80 may be used to determine which CT scan most accurately depicts the configuration of the lungs and can thus be superimposed onto the LG display.
[0029] Example 2. The measured location of the LG can be corrected using the data acquired at 80. Rather than displaying the real-time data acquired by the LG system, which represents the position of the LG in relation to a magnetic field filling the AOI, the real-time data is manipulated so the LG appears in the correct location on the CT scan, which may be static or dynamic. In this way the too1 mα" ho localized more correctly inside the CT volume. The geometric model de the CT volume can thus be more accurately represented rel the body.
[0030] Example 3. Using a well-known technique called image warping, the CT Volume can be changed dynamically using the data acquired at 80 and according to the monitored phase of breathing cycle. This can be used to display augmented images to perform the simulation of dynamic X-Ray modalities such as fluoroscopy, dynamic CT, etc., to simulate the patient physiology synchronized to the actual patient, study the tissue movement relative to the inserted tools, and for other purposes as well.
[0031] Referring now to Figure 2, there is shown a flowchart that illustrates another embodiment 120 of the method of the present invention.
[0032] At 130 the patient characteristics are measured or determined. "Patient characteristics" is a term defined herein as any attribute of the patient that will influence the position of his or her lungs during any given point in the breathing cycle. Patient characteristics include, but are not limited to patient size (lung size), lung shape, lung health, altitude, patient age, diaphragm size, and diaphragm health. Though altitude is not intrinsic to any given patient, the elevation at which a patient is breathing impacts the depth and/or the frequency of the breaths taken during the breathing cycle. Lung health relates to the lung capacity of a given patient and includes such factors as whether the patient smokes, whether the patient has an increased lung capacity due to athletic training, whether the patient has a condition such as cystic fibrosis, etc. One skilled in the art will realize that some patient characteristics are more determinative of lung position than others and that it may only be feasible to factor a few of the listed characteristics into the matching process described below. Moreover, which factors are most determinative will likely vary by patient. Many of the characteristics can be measured using a CT scan performed prior to the procedure.
[0033] At 140 the patient is imaged using any imaging modality that shows the lungs or desired target area. Most likely, CT imaging will be used. Preferably a first image set is taken with the lungs full of air and a second imac patient has fully exhaled.
[0034] At 150 the patient is matched to an archived data set taken from a data library. It is desirable to find an archived data set that matches the patient's breathing cycle as closely as possible. In order to match a data set to the patient, the patient characteristics are used as matching criteria. The specific characteristics that are used, and the number of different characteristics that are used, are largely dependent on the size of the data library. However, if the patient has any distinguishing lung traits, such as a significantly reduced capacity due to smoking, they should be given more weight than other, less-distinguishing traits when looking for a matching data set.
[0035] Alternatively, the inhaled and exhaled positions recorded and measured using CT scans could be used as the entering arguments for matching the patient to a data set. If the inhaled and exhaled positions are closely matched to a data set, it will be likely that the intermediate points between inhalation and exhalation will also match. However, considerations like patient size should still be considered to ensure that the lung geometries are also matched.
[0036] At 160 a CT image set for the patient is generated. The closely-matched data set is either used alone, or if inhalation and exhalation CT scans have been taken, they are added to the data set to improve the degree to which the data set is matched to the actual patient geometry.
[0037] At 170 each image of the image set is assigned to a lung position, as measured by external or internal means. Because each of the images will be displayed during the procedure at different times during the breathing cycle, it is necessary to determine, in advance, when each image will be cued for display. There are at least two ways in which this may be done. First, the positions of sensors, such as external sensors placed on the patient's chest, may be monitored throughout the breathing cycle. Each image may be examined to determine a position of the lungs that is most closely matched to that particular image. When the external sensors indicate a particular lung position, the image will be chan most closely matched image. Second, an average bre measured to determine the inhaling period (defined herein as the amount of time between inhalation and exhalation) and the exhaling period (defined herein as the amount of time between exhalation and inhalation). At the beginning of the inhaling period it will be known to display the inhalation image taken at 150. At the exhalation point, it will be known to display the exhalation image taken at 150. The measured periods may be divided by the number of intermediate images in the data set to determine an interval time. The images will then be changed each interval.
[0038] At 180 the actual procedure begins. During the procedure, the lung position is monitored. If the first method at 170 was used, sensors on the chest, sensors in the lungs, or a device such as a spirometry device is used to determine when the images shall be displayed at 190 to most accurately represent the actual lungs. If the second method at 170 was used, the breathing cycle will be monitored using any of the aforementioned sensors or devices, to update the average inhaling and exhaling periods of the breathing cycle. At 190, the images will be changed according to the constantly-updated intervals.
[0039] One skilled in the art will realize that the second method at 160 avoids the process of examining each individual image of the data set to assign it to a point in the breathing cycle. However, one skilled in the art will also see the potentially improved accuracy of the first method. Because an unconscious patient does not breathe at a constant depth, the inhalation points and exhalation points will vary during each breathing cycle. If the first method is used and the lung positions are monitored to determine which image to display at 190, during times of shallow breathing, the inhalation and exhalation scans may never be displayed. This is because during times of shallow breathing, the sensors will never measure a lung position that triggers the display of the scans taken at 140. However, if the second method is used, the extremes are shown each cycle. The only variance will be the frequency of the image changes.
[0040] In order to combine the advantages of first and second methods, one embodiment of step 170 maintains a constant image interval during shallc " ' iU~ but ends the progression of images shown from exhalation point v determined that the patient is no longer inhaling. In other we no matter how shallow the breaths being taken are, the patient is still achieving a full exhalation. Shallow breaths mean the patient is not achieving a full inhalation. Thus, images are shown at a regular interval until the patient begins to exhale. Then, the images are shown in reverse order at the exhalation interval.
Algorithms and Experimental Results [0041] DATA ACQUISITION
[0042] An experiment was conducted that began with the acquisition of CT images of patients in two respiratory states: inhalation and exhalation. A database of patients was divided into three categories according to breathing amplitude (normal, moderate, extreme). Only patients with moderate (full inhalation, normal exhalation) amplitude breathing were used for the study.
[0043] For each patient about 200 pairs of points (landmarks) were marked on both exhalation and inhalations CT images. The anatomical points were marked on airway bifurcations or on blood vessels bifurcations for the peripheral areas where airway bifurcations were hardly to identify. Each pair of matching points represents a breathing vector at that specific anatomic location. Landmark locations were chosen to be uniformly distributed throughout the lung volume.
[0044] T:R3 → R3 TRANSFORMATION METHOD
[0045] Local tissue deformations can be learned by analyzing the displacements of each landmark point. The missing data between the displacements of each landmark point can be interpolated.
[0046] Non-rigid registration techniques were used in order to get marked landmark points to smoothly transform from one state to another. The methods, functions and kernels are chosen according to the stability of the transformation and robustness to possible outliers. The transformation techniques used include polynomials, basis functions, and splines. [0047] Modeling can be performed for all landmarks tc deformation function that can be used for global calculations. It is also possible to divide the lungs to smaller sub-parts that can be modeled separately while simplifying the needed transformation. For example, analyzing the left and right sides of the lungs separately yielded good results.
[0048] The methods of the present invention allow describing lung tissue deformations during breathing cycles using a low number of degrees of freedom with an acceptable level of inaccuracy. Hence, the transformation can be produced or reproduced using a small number of control points (internal and/or external) with locations sampled in real time.
[0049] The accuracy of the model is affected by the number of degrees of freedom of the transformation. However, over-fitting the model to the data can make the model less robust. Approaching high transformation precision values on the landmarks themselves (less then 1 mm) requires the use of complicated solutions that can behave poorly on the volumes between landmarks and are, therefore, less suitable for modeling.
[0050] Though an entire breathing vector set can be used as input data for fitting algorithm, the vectors may be divided according to anatomical regions, such as left lung and right lung, for example.
[0051] Linear transformation models can be extended to non-linear transformation models. For second order polynomial transformation:
Figure imgf000013_0001
[0053] A polynomial fit is a specific type of linear multiple regression.
[0054] In order to build a polynomial transformation between the inhalation and exhalation breathing phases, the available pairs of points are used. It is assumed that the points are distributed uniformly throughout the lur global anatomical tissue displacement during the respiratory cycle.
[0055] Let U and V denote coordinates matrix of size 4xN for points of two states, inhalation and exhalation respectively:
V = (U1-X)
[0056] For N pairs of points:
Figure imgf000014_0001
where
U = f(U) = {fφλ),f$2),...,fφN)) is the function that transforms each column vector of U containing x, y, z to a column vector of higher dimension. In case of a second degree polynomial, the 3D vector is transformed to 10D space by:
{χ,y, ή- >(x2 ,y2, z2,xy, xz, yz, x, y, z,l)
[0057] The minimum number of point pairs needed for identification of the transformation is determined by the number of DOFs (degrees of freedom) for an output space of function f. Thus, for a second degree polynomial, just 10 point pairs (or breathing vectors) are required. For a third degree polynomial, a minimum of 20 point pairs are required respectively.
[0058] The mean error is calculated for all available points by:
ε = AU - V
«=-Σlk.l [0059] DERIVING THE BREATHING MODEL
[0060] It is possible to calculate a polynomial transformation for each available dataset (patient) given a sufficient number of matched pairs of points representing exhalation and inhalation states. In order to assess the similarity between breathing models for different patients, the 3D vector fields should be compared. Due to the inherent variability of different patients, it is difficult to apply a breathing model of one patient directly to another patient. Nevertheless, there is an assumption that two breathing models can be matched together applying some simple transformation that can convert from one model to another:
Tiιmple {W) = S - g{W)
[0061] where the g() transforms each vector to higher dimensional space and S is the appropriate coefficient matrix.
[0062] In order to minimize the number of degrees of freedom, it is assumed that the unknown transformation is a linear transformation (affine or perspective). Then the function g() performs the conversion into homogeneous coordinates. Therefore S is of size 4x4.
[0063] When looking for simple transformation the cost function can be defined: ε = A - /(S - U) - S - V
1 N
Sbest = arg min(F) SM
[0064] This optimization problem is solved using Nelder-Mead method or the Simplex Search method. The method uses the concept of a Simplex, which is a polytope (generalization to any dimension of polygon) of N + 1 vertex in N dimensions; a line segment on a line, a triangle on a plane, a tetrahedron in three- dimensional space and so forth. The method approximately finds a locally optimal solution to a problem with N variables when the objective function varies smoothlv. [0065] The search for the global minimum is perform optimization task on the function F, defined above, in multi-dimensional space, which has 16 dimensions in this case.
[0066] The resulting Sbest is used to fit the known polynomial function to other patient with undefined breathing model.
[0067] GRID METHOD
[0068] Assuming elastic properties of lung tissue, deformation at any given point may be evaluated by close breathing vectors.
[0069] Initial breathing vectors were used for calculating new breathing vectors located at the nodes of 3D grid.
[0070] The described procedure was applied for 4 different patients after CT volume normalization and registration. The final 3D vector field was generated by averaging results of all patients.
Figure imgf000016_0001
For each grid vertex the integration is performed over defined volume space around (using defined kernel function). The integration boundaries can be 3D cube of size N or sphere with radius N. [0071] ANATOMICAL POINTS METHOD
[0072] The respiratory motion can also be described by means of modeling the "skeletal" motion of the lungs. A skeletal tree of the lungs is produced by representing the bifurcations of the airways as nodes and then connecting the nodes to form a skeleton of the airways.
[0073] Skeletal trees are generated for two breathing states of the same patient. Then the trees are combined together in order to identify the changes that are modeled later by measuring the relative angles at the nodes.
[0074] Skeletal trees from different individuals can be further analyzed by comparing the behavior of corresponding nodes from each patient. .
[0075] The available data set has been divided to training and testing sets. The model parameters have been estimated by the training set and verified with the testing set proving the feasibility of the method.
[0076] RESULTS
[0077] Transformation method: tissue deformations of the entire lung were modeled using smooth vector function with an average fit error of about 2 mm.
[0078] Grid method: 3 patients were used for building the model and 1 patient for verification. After applying cross validation, the average error was about 4 mm.
[0079] Breathing vectors for patients with normal breathing intensity was 1-2 mm in the central lung regions and 10-15 mm at the periphery (diaphragm).
[0080] Interpolation Results
[0081] The general breathing models that were obtained using the aforementioned technique were verified using cross-reference method. The model is derived from each of the available patients and then used for modeling breathing for other available patients, including one used for model generation in order to have a comparative lower limit error estimation. [0082] Seven patients participated in the study. The folio' the mean errors and standard deviations when applying the breathing model derived from the patient on the row to each of the patients from the columns.
[0083] Mean errors:
Patient Patient Patient Patient Patient Patient Patient 1 2 3 4 5 6 7
Patient 1.4441 30.3849 22.3949 9.579 6.7975 9.1251 17.5015
Λ I
Patient 8.0471 2.1803 26.975 7.3234 6.2768 6.2002 9.4439
O
Patient 27.2102 31.8968 3.9853 12.5647 10.1514 18.2088 32.9139
O
O
Patient 4.7568 5.1671 8.9472 3.4243 7.0903 5.7553 6.1695
A
Patient 57.6078 22.6204 21.88 13.0142 3.6763 24.7327 41.5406
D C
Patient 31.4134 15.3444 51.4794 14.9238 13.7905 4.1377 27.2752 e
D
Patient 19.0761 6.8696 8.2957 12.2098 6.9798 10.0902 2.403
7
[0084] Standard deviation values:
Patient Patient Patient Patient Patient Patient Patient
1 2 3 4 5 6 7
Patient
1 0.8592 12.2057 4.9473 4.4579 2.5962 5.4156 9.8278
Patient
2 4.701 1.6283 13.9169 4.2816 3.4003 3.5902 7.437
Patient
3 15.7571 17.4782 3.2823 6.9061 5.8878 12.9119 16.6467
Patient
4 2.7333 3.9613 4.9235 2.321 3.1751 4.0883 4.2487
Patient
5 3.8712 13.2514 9.6508 5.0819 2.6654 11.5002 16.0817
Patient
6 9.4778 7.577 14.7764 9.0923 7.0307 2.7028 10.835
Patient
7 9.6453 5.2156 5.168 5.9022 4.2303 6.7865 1.3058 [0085] The grayed cells in the tables above determine tl when the same patient used both for model derivation and for error calculation. This number is expected to have the lowest value in the row and column.
[0086] The existence of acceptable values of above-mentioned function F means that respiratory motion can be modeled by known polynomial function in conjunction with some linear transformation given by a 4x4 sized matrix.
[0087] It is observed that in the above patient-related CT dataset, the best results are achieved when using the breathing model generated from Patient4. The results of this polynomial approximation method can be compared to simple linear registration method using 7 registration points.
> ft van φoi\ nonnah : -.Id (polynomial) rnujii tiinctr i
20
Figure imgf000019_0001
Pultentl PjtientZ Patκ-πt3 P.tUont4 PjtienlS Pjtiunt6 Patient?
[0088]
[0089] Mean and standard deviation for errors after simple affine registration using 7 registration points:
Figure imgf000019_0002
[0090] The above graph shows that approximation interpolation achieves significantly more accurate results than regular rigid registration. Graphs showing the breathing error distributions for each individual patient are now provided:
[0091] Patienti
Figure imgf000020_0001
Figure imgf000021_0001
0 Point number 2] Patient2
Figure imgf000021_0002
Error fmml
Figure imgf000022_0001
Point number ] Patient3
Figure imgf000022_0002
Figure imgf000023_0001
Point number
Figure imgf000023_0002
Error [mm]
Figure imgf000024_0001
Point number
Figure imgf000024_0002
Error [mm]
Figure imgf000025_0001
Point number
[0096] Patientθ
Figure imgf000025_0002
Error [rnrnl
Figure imgf000026_0001
Point number 97] Patient7
Figure imgf000026_0002
Error frnrnl
Figure imgf000027_0001
Point number
[0098] It is drawn from the graphs above that breathing models obtained using the aforementioned technique were able to significantly reduce the errors (or divergence) caused by inhalation\exhalation breathing states difference.
[0099] Generalization analysis for second order polynomial
[00100] It is proven that the generalization property has a significant effect on the registration error of volumes around the registration landmark points.
[00101] The following graph shows the comparison of registration error between rigid and polynomial-based transformations. Note that each value shown on the graph corresponds to the specific pair that did not participate in registration data set. This way the results are not biased by the transformation. The example below is based on left side lung registration.
Figure imgf000028_0001
n - point number
[00102] Compare the mean values of 8.3 mm after rigid registration to 3.2 mm after polynomial based registration.
[00103] Degree of polynomial
[00104] The mean registration errors are shown with confidence levels of two standard deviations on the following graph. Note that both left and right lungs were used for registration.
Figure imgf000029_0002
Figure imgf000029_0001
Polynomial degree
[00105] The polynomial degree and element choice is determined by model accuracy specifications.
[00106] CONCLUSIONS
[00107] Tissue deformations during the breathing cycle can be described using a low number of degrees of freedom with acceptable accuracy. The transformation can be reproduced using a small number of control points.
[00108] It is proven that a specific patient breathing motion can be modeled using the preliminary constructed static "breathing pattern" matrix and a rigid transformation 4x4 matrix dynamically defined from the specific patient.
[00109] The "breathing vectors" correction technique can be successfully used during electromagnetic bronchoscopy procedures to reduce localization errors. However, additional data sets are needed if method verification is desired.
[00110] It is possible to reproduce the behavior of about 200 breathing vectors by a reduced number of 20 vectors. When approximating the breathing motion by a third order polynomial, 60 (20x3) degrees of freedom should be determined. Hence, there is a system of 20 linear equations, which means about 200 breathing vectors throughout the lungs can be reduced to a 3D vector field vectors.
[00111] Using a simple linear transformation 4x4 in conjunction with a known preliminarily constructed constant 20x3 matrix, it is possible to model the breathing motion of a patient significantly, reducing the registration error.
[00112] However, the ability of polynomials to recover anatomical shape variability is often quite limited because they can model only global, not local, shape changes. Additionally, higher order polynomials tend to introduce artifacts, such as oscillations. Therefore, the current method may be improved using other known techniques, such as B-Splines, Thin-Plate Splines, basis functions and others. Introduction of additional deformable component to current algorithm is expected to improve the accuracy of the model. Using a weighting function may also be considered.
[00113] The other related issue deals with possible outlier removal. For example the outliers can be determined with regard to their correlation with registration data set and filtered out. Such filtering is essential for breathing motion generic model generation.
[00114] Non-uniform distribution of points is a problem that should be also addressed during while modeling the breathing cycle. One possible solution is to use the same points several times in the data set in order to assign them more weight in the algorithm.
[00115] There is a high variability of the breathing models generated from different patients by mean of the errors after performing cross-validation analysis. It is expected to find more patients representing "global breathing motion pattern" similar to Patient7 in this study. Assuming the sufficiently accurate and compatible data sets the fusion (or averaging) of several patients may be considered to get more robust results.
[00116] It is concluded from the graphs that the error distributions are Rayleigh distribution. [00117] Although the invention has been described ir embodiments and applications, one of ordinary skill in the art, in light of this teaching, can generate additional embodiments and modifications without departing from the spirit of or exceeding the scope of the claimed invention. Accordingly, it is to be understood that the drawings and descriptions herein are proffered by way of example to facilitate comprehension of the invention and should not be construed to limit the scope thereof.

Claims

What is claimed is:
1. A method of modeling lung movements due to breathing in a patient comprising:
acquiring at least one static image of a patient's lungs during a predetermined phase of the breathing cycle;
identifying locations of a plurality of points of interest on said at least one static image;
predicting mathematically locations of said plurality of points of interest at phases of the breathing cycle other than said predetermined phase.
2. The method of claim 1 wherein said acquiring at least one static image of a patient's lungs during a predetermined phase of the breathing cycle comprises acquiring a static image at a phase in the breathing cycle that is between inhalation and exhalation.
3. The method of claim 1 wherein said acquiring at least one static image of a patient's lungs during a predetermined phase of the breathing cycle comprises acquiring a static image at a phase in the breathing cycle that is between exhalation and inhalation.
4. The method of claim 1 wherein said acquiring at least one static image of a patient's lungs during a predetermined phase of the breathing cycle comprises acquiring a static image at a phase in the breathing cycle that is between inhalation and exhalation and acquiring a second image in at a phase in the breathing cycle that is between exhalation and inhalation.
5. The method of claim 1 wherein identifying locations of a plurality of points of interest on said at least one static image comprises identifying, on said at least one static image, a plurality of bifurcations in the airways.
6. The method of claim 1 wherein predicting, mathematically, locations of said plurality of points of interest at phases of the breathing cycle other than said predetermined phase comprises developing a mathematical algorithm that models the lung movement of the patient.
7. The method of claim 1 wherein predicting, mathematically, locations of said plurality of points of interest at phases of the breathing cycle other than said predetermined phase comprises calculating a polynomial transformation.
8. The method of claim 1 wherein predicting, mathematically, locations of said plurality of points of interest at phases of the breathing cycle other than said predetermined phase comprises:
measuring movement due to breathing for at a plurality of points in a plurality of patients;
averaging the results of said plurality of points in said plurality of patients;
creating a 3-dimensional vector field representative of average movements in the lungs;
applying a vector corresponding to an area of interest in the lung to said at least one image in order to predict a location of said area of interest at a given point in the breathing cycle.
9. The method of claim 1 wherein predicting, mathematically, locations of said plurality of points of interest at phases of the breathing cycle other than said predetermined phase comprises creating a skeletal tree of the lungs and modeling the skeletal motion of the lungs.
10. A method of registering at least one previously-acquired image to a real-time representation of a probe location, comprising:
attaching at least one patient sensor to the patient;
monitoring locations of said at least one patient sensor as the patient inhales and exhales;
determining a point in time said patient is in a breathing cycle based on said locations of said at least one patient sensor;
selecting one of said at least one previously-acquired images taken closest to said point in time said patient is in said breathing cycle;
superimposing said selected one of said at least one previously-acquired images over said real-time representation of said probe location.
11. A method of representing a real-time location of a probe on a previously-acquired image, comprising:
measuring a breathing cycle of a patient;
monitoring a real-time location of a probe inside the patient;
manipulating said real-time data such that said probe appears in a correct location on one of at least one previously-acquired images.
12. The method of claim 11 wherein manipulating said real-time data such that said probe appears in a correct location of said real-time location of said image comprises:
monitoring locations of said at least one patient sensor as the patient inhales and exhales; determining a point in a breathing cycle said patient is based on said locations of said at least one patient sensor;
selecting one of said at least one previously-acquired images taken closest to said point said patient is in said breathing cycle;
superimposing said selected one of said at least one previously-acquired images over said real-time representation of said probe location.
13. The method of claim 11 wherein manipulating said real-time data such that said probe appears in a correct location of said real-time location of said image comprises:
monitoring locations of said at least one patient sensor as the patient inhales and exhales;
determining a point in a breathing cycle said patient is based on said locations of said at least one patient sensor;
selecting one of said at least one previously-acquired images;
superimposing said selected one of said at least one previously-acquired images over said real-time representation of said probe location;
warping said previously-acquired image according to said monitored locations of said patient sensors such that said real-time representation of said probe location appears in an accurate position on said previously-acquired image.
14. A method of navigating a probe through airways of the lungs of a patient comprising:
measuring patient characteristics;
imaging said patient to acquire one or more images; identifying an area of interest in the lungs of said patient;
collecting data regarding positions of key points on the patient's body while the patient is breathing;
developing a mathematical model of movement due to breathing using said data;
inserting a probe into said patient;
displaying at least one of said acquired images;
displaying a real-time indication of a position of said probe on said at least one of said acquired images;
using said mathematical model to adjust relative positions of said real-time indication and said at least one acquired images such that said real-time image is accurately portrayed on said at least one acquired image.
15. The method of claim 14 wherein measuring patient characteristics comprises taking measurements selected from the set consisting of lung size, lung shape, lung health, altitude, patient age, diaphragm size, and diaphragm health.
16. The method of claim 14 wherein collecting data regarding positions of key points on the patient's body while the patient is breathing comprises collecting data from sensors placed on the patient.
17. The method of claim 14 wherein developing a mathematical model of movement due to breathing using said data comprises creating a skeletal tree of the lungs and modeling the skeletal motion of the lungs.
18. The method of claim 14 wherein developing a mathematical model of movement due to breathing using said data comprises:
measuring movement due to breathing for at a plurality of points in a plurality of patients;
averaging the results of said plurality of points in said plurality of patients;
creating a 3-dimensional vector field representative of average movements in the lungs;
applying a vector corresponding to an area of interest in the lung to said at least one image in order to predict a location of said area of interest at a given point in the breathing cycle.
19. The method of claim 14 wherein developing a mathematical model of movement due to breathing using said data comprises developing a mathematical algorithm that models the lung movement of the patient.
20. The method of claim 14 wherein developing a mathematical model of movement due to breathing using said data comprises calculating a polynomial transformation.
21. The method of claim 19 wherein developing a mathematical algorithm that models the lung movement of the patient comprises collecting data on a number of subjects in a study and relating movement of given locations in said subjects to points in the respective breathing cycles of said subjects in which the positions were acquired.
PCT/IB2008/003728 2007-07-09 2008-07-09 Patent breathing modeling WO2009074872A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP08860538.1A EP2192855B1 (en) 2007-07-09 2008-07-09 Patent breathing modeling

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US94864007P 2007-07-09 2007-07-09
US60/948,640 2007-07-09
US4398708P 2008-04-10 2008-04-10
US61/043,987 2008-04-10

Publications (2)

Publication Number Publication Date
WO2009074872A2 true WO2009074872A2 (en) 2009-06-18
WO2009074872A3 WO2009074872A3 (en) 2009-12-30

Family

ID=40754184

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2008/003728 WO2009074872A2 (en) 2007-07-09 2008-07-09 Patent breathing modeling

Country Status (3)

Country Link
US (6) US10292619B2 (en)
EP (1) EP2192855B1 (en)
WO (1) WO2009074872A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2953532A4 (en) * 2013-02-08 2016-09-14 Covidien Lp System and method for lung denervation
US10328281B2 (en) 2013-02-08 2019-06-25 Covidien Lp System and method for lung denervation
CN116392105A (en) * 2023-06-08 2023-07-07 深圳大学 Breathing training model construction method and device based on personalized feature fitting

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007033206A2 (en) 2005-09-13 2007-03-22 Veran Medical Technologies, Inc. Apparatus and method for image guided accuracy verification
US20070066881A1 (en) 2005-09-13 2007-03-22 Edwards Jerome R Apparatus and method for image guided accuracy verification
JP5877797B2 (en) 2010-02-18 2016-03-08 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. System for estimating motion of target tissue and method for operating the same
JP5897273B2 (en) * 2010-07-22 2016-03-30 株式会社東芝 Medical image display apparatus and X-ray computed tomography apparatus
US20130303887A1 (en) * 2010-08-20 2013-11-14 Veran Medical Technologies, Inc. Apparatus and method for four dimensional soft tissue navigation
US9138165B2 (en) 2012-02-22 2015-09-22 Veran Medical Technologies, Inc. Systems, methods and devices for forming respiratory-gated point cloud for four dimensional soft tissue navigation
KR102070427B1 (en) 2012-08-08 2020-01-28 삼성전자주식회사 Method and Apparatus for tracking the position of tumor
CA2940450A1 (en) 2014-03-04 2015-09-11 Xact Robotics Ltd. Dynamic planning method for needle insertion
US20150305650A1 (en) 2014-04-23 2015-10-29 Mark Hunter Apparatuses and methods for endobronchial navigation to and confirmation of the location of a target tissue and percutaneous interception of the target tissue
US20150305612A1 (en) 2014-04-23 2015-10-29 Mark Hunter Apparatuses and methods for registering a real-time image feed from an imaging device to a steerable catheter
EP3136943A4 (en) * 2014-05-01 2017-12-27 EndoChoice, Inc. System and method of scanning a body cavity using a multiple viewing elements endoscope
KR101647361B1 (en) * 2014-08-08 2016-08-11 경북대학교 산학협력단 Apparatus and method for predicting respiratory motion
WO2017013019A1 (en) * 2015-07-17 2017-01-26 Koninklijke Philips N.V. Guidance for lung cancer radiation
US20170329927A1 (en) * 2016-05-11 2017-11-16 InFluidS LLC System and method for analyzing airway-pulmonary response using computational fluid dynamics to diagnose and monitoring potential health anomalies
US20180049808A1 (en) * 2016-08-17 2018-02-22 Covidien Lp Method of using soft point features to predict breathing cycles and improve end registration
US10939963B2 (en) 2016-09-01 2021-03-09 Covidien Lp Systems and methods for providing proximity awareness to pleural boundaries, vascular structures, and other critical intra-thoracic structures during electromagnetic navigation bronchoscopy
KR20190067917A (en) 2016-11-02 2019-06-17 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Continuous political system and method for visual guided surgery
US11443441B2 (en) * 2017-02-24 2022-09-13 Brainlab Ag Deep inspiration breath-hold setup using x-ray imaging
US11944388B2 (en) 2018-09-28 2024-04-02 Covidien Lp Systems and methods for magnetic interference correction
CN111179409B (en) * 2019-04-23 2024-04-02 艾瑞迈迪科技石家庄有限公司 Respiratory motion modeling method, device and system
KR102404649B1 (en) * 2020-01-16 2022-06-07 아주대학교 산학협력단 Estimation method and appratus for polmonary function according to radiation therapy
FR3114957B1 (en) * 2020-10-08 2022-09-30 Quantum Surgical Augmented reality navigation system for a medical robot

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6188355B1 (en) 1997-12-12 2001-02-13 Super Dimension Ltd. Wireless six-degree-of-freedom locator
US6380732B1 (en) 1997-02-13 2002-04-30 Super Dimension Ltd. Six-degree of freedom tracking system having a passive transponder on the object being tracked
US6593884B1 (en) 1998-08-02 2003-07-15 Super Dimension Ltd. Intrabody navigation system for medical applications
US6615155B2 (en) 2000-03-09 2003-09-02 Super Dimension Ltd. Object tracking using a single sensor or a pair of sensors
US20030185346A1 (en) 2002-03-27 2003-10-02 Stefan Vilsmeier Medical navigation and/or pre-operative treatment planning with the assistance of generic patient data
US7117026B2 (en) 2002-06-12 2006-10-03 Koninklijke Philips Electronics N.V. Physiological model based non-rigid image registration

Family Cites Families (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5391199A (en) 1993-07-20 1995-02-21 Biosense, Inc. Apparatus and method for treating cardiac arrhythmias
US5558091A (en) 1993-10-06 1996-09-24 Biosense, Inc. Magnetic determination of position and orientation
US6690963B2 (en) 1995-01-24 2004-02-10 Biosense, Inc. System for determining the location and orientation of an invasive medical instrument
US5729129A (en) 1995-06-07 1998-03-17 Biosense, Inc. Magnetic location system with feedback adjustment of magnetic field generator
US5752513A (en) 1995-06-07 1998-05-19 Biosense, Inc. Method and apparatus for determining position of object
IL119262A0 (en) * 1996-02-15 1996-12-05 Biosense Israel Ltd Locatable biopsy needle
WO1997029710A1 (en) 1996-02-15 1997-08-21 Biosense, Inc. Medical probes with field transducers
CA2246287C (en) 1996-02-15 2006-10-24 Biosense, Inc. Medical procedures and apparatus using intrabody probes
AU721034B2 (en) 1996-02-15 2000-06-22 Biosense, Inc. Catheter based surgery
DE69738274T2 (en) 1996-02-15 2008-08-28 Biosense Webster, Inc., Diamond Bar Mobile receiving and transmitting coils for a location system
WO1997029679A2 (en) 1996-02-15 1997-08-21 Biosense Inc. Precise position determination of endoscopes
ES2210498T3 (en) 1996-02-15 2004-07-01 Biosense, Inc. POSITIONABLE TRANSDUCERS INDEPENDENTLY FOR LOCATION SYSTEM.
JP4141500B2 (en) 1996-02-27 2008-08-27 バイオセンス・ウェブスター・インコーポレイテッド Positioning device and operation method thereof
IL126864A (en) 1996-05-06 2003-05-29 Biosense Inc Method and apparatus for calibrating a magnetic field generator
US6016439A (en) 1996-10-15 2000-01-18 Biosense, Inc. Method and apparatus for synthetic viewpoint imaging
US5928248A (en) 1997-02-14 1999-07-27 Biosense, Inc. Guided deployment of stents
US6314310B1 (en) 1997-02-14 2001-11-06 Biosense, Inc. X-ray guided surgical location system with extended mapping volume
US6580938B1 (en) 1997-02-25 2003-06-17 Biosense, Inc. Image-guided thoracic therapy and apparatus therefor
US6201387B1 (en) 1997-10-07 2001-03-13 Biosense, Inc. Miniaturized position sensor having photolithographic coils for tracking a medical probe
US6147480A (en) 1997-10-23 2000-11-14 Biosense, Inc. Detection of metal disturbance
WO1999049783A1 (en) 1998-03-30 1999-10-07 Biosense Inc. Three-axis coil sensor
US20030074011A1 (en) * 1998-09-24 2003-04-17 Super Dimension Ltd. System and method of recording and displaying in context of an image a location of at least one point-of-interest in a body during an intra-body medical procedure
US6373240B1 (en) 1998-10-15 2002-04-16 Biosense, Inc. Metal immune system for tracking spatial coordinates of an object in the presence of a perturbed energy field
US8442618B2 (en) 1999-05-18 2013-05-14 Mediguide Ltd. Method and system for delivering a medical device to a selected position within a lumen
US9572519B2 (en) 1999-05-18 2017-02-21 Mediguide Ltd. Method and apparatus for invasive device tracking using organ timing signal generated from MPS sensors
US7778688B2 (en) 1999-05-18 2010-08-17 MediGuide, Ltd. System and method for delivering a stent to a selected position within a lumen
US7343195B2 (en) 1999-05-18 2008-03-11 Mediguide Ltd. Method and apparatus for real time quantitative three-dimensional image reconstruction of a moving organ and intra-body navigation
US7386339B2 (en) 1999-05-18 2008-06-10 Mediguide Ltd. Medical imaging and navigation system
US7840252B2 (en) 1999-05-18 2010-11-23 MediGuide, Ltd. Method and system for determining a three dimensional representation of a tubular organ
US6233476B1 (en) 1999-05-18 2001-05-15 Mediguide Ltd. Medical positioning system
US7366562B2 (en) 2003-10-17 2008-04-29 Medtronic Navigation, Inc. Method and apparatus for surgical navigation
US6484118B1 (en) 2000-07-20 2002-11-19 Biosense, Inc. Electromagnetic position single axis system
US6650927B1 (en) 2000-08-18 2003-11-18 Biosense, Inc. Rendering of diagnostic imaging data on a three-dimensional map
US6714810B2 (en) * 2000-09-07 2004-03-30 Cbyon, Inc. Fluoroscopic registration system and method
WO2002024051A2 (en) * 2000-09-23 2002-03-28 The Board Of Trustees Of The Leland Stanford Junior University Endoscopic targeting method and system
US6666579B2 (en) * 2000-12-28 2003-12-23 Ge Medical Systems Global Technology Company, Llc Method and apparatus for obtaining and displaying computed tomography images using a fluoroscopy imaging system
US20030018251A1 (en) * 2001-04-06 2003-01-23 Stephen Solomon Cardiological mapping and navigation system
US7286868B2 (en) 2001-06-15 2007-10-23 Biosense Inc. Medical device with position sensor having accuracy at high temperatures
US6577752B2 (en) 2001-06-15 2003-06-10 Arch Development Corporation Automated method and system for the delineation of the chest wall in computed tomography scans for the assessment of pleural disease
EP2380487B1 (en) 2002-04-17 2021-03-31 Covidien LP Endoscope structures for navigating to a target in branched structure
US20040086161A1 (en) 2002-11-05 2004-05-06 Radhika Sivaramakrishna Automated detection of lung nodules from multi-slice CT image data
US7881769B2 (en) 2002-11-18 2011-02-01 Mediguide Ltd. Method and system for mounting an MPS sensor on a catheter
US7697972B2 (en) * 2002-11-19 2010-04-13 Medtronic Navigation, Inc. Navigation system for cardiac therapies
US7505809B2 (en) * 2003-01-13 2009-03-17 Mediguide Ltd. Method and system for registering a first image with a second image relative to the body of a patient
EP1615554B1 (en) 2003-04-15 2017-12-20 Philips Intellectual Property & Standards GmbH Method and arrangement for influencing magnetic particles and detecting interfering material
US7783441B2 (en) 2003-04-17 2010-08-24 Northern Digital Inc. Eddy current detection and compensation
US7321228B2 (en) 2003-07-31 2008-01-22 Biosense Webster, Inc. Detection of metal disturbance in a magnetic tracking system
US8150495B2 (en) * 2003-08-11 2012-04-03 Veran Medical Technologies, Inc. Bodily sealants and methods and apparatus for image-guided delivery of same
US7397364B2 (en) 2003-11-11 2008-07-08 Biosense Webster, Inc. Digital wireless position sensor
EP1691666B1 (en) * 2003-12-12 2012-05-30 University of Washington Catheterscope 3d guidance and interface system
US6995729B2 (en) 2004-01-09 2006-02-07 Biosense Webster, Inc. Transponder with overlapping coil antennas on a common core
ATE482664T1 (en) 2004-01-20 2010-10-15 Koninkl Philips Electronics Nv DEVICE AND METHOD FOR NAVIGATING A CATHETER
JP4639199B2 (en) 2004-02-18 2011-02-23 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Measured value correction of magnetic positioning device
US7811294B2 (en) 2004-03-08 2010-10-12 Mediguide Ltd. Automatic guidewire maneuvering system and method
WO2005092188A1 (en) 2004-03-29 2005-10-06 Olympus Corporation System for detecting position in examinee
US7197354B2 (en) 2004-06-21 2007-03-27 Mediguide Ltd. System for determining the position and orientation of a catheter
US7373271B1 (en) 2004-09-20 2008-05-13 Ascension Technology Corporation System and method for measuring position and orientation using distortion-compensated magnetic fields
US8989349B2 (en) * 2004-09-30 2015-03-24 Accuray, Inc. Dynamic tracking of moving targets
US8611983B2 (en) * 2005-01-18 2013-12-17 Philips Electronics Ltd Method and apparatus for guiding an instrument to a target in the lung
US20080199048A1 (en) * 2005-01-19 2008-08-21 Koninklijke Philips Electronics, N.V. Image Processing System and Method for Alignment of Images
WO2006095221A2 (en) * 2005-03-11 2006-09-14 Philips Intellectual Property & Standards Gmbh Imaging method
US7236567B2 (en) 2005-03-24 2007-06-26 Siemens Aktiengesellschaft Method and apparatus for synchronizing operation of an x-ray system and a magnetic system
EP1871233A1 (en) 2005-04-11 2008-01-02 Philips Intellectual Property & Standards GmbH Three dimensional imaging for guiding interventional medical devices in a body volume
US7324915B2 (en) 2005-07-14 2008-01-29 Biosense Webster, Inc. Data transmission to a position sensor
US7301332B2 (en) 2005-10-06 2007-11-27 Biosense Webster, Inc. Magnetic sensor assembly
US20070167806A1 (en) 2005-11-28 2007-07-19 Koninklijke Philips Electronics N.V. Multi-modality imaging and treatment
US8150497B2 (en) 2006-09-08 2012-04-03 Medtronic, Inc. System for navigating a planned procedure within a body
IL187667A (en) 2006-11-27 2011-12-29 Mediguide Ltd System and method for navigating a surgical needle toward an organ of the body of a patient
US8320991B2 (en) 2006-12-01 2012-11-27 Medtronic Navigation Inc. Portable electromagnetic navigation system
US20080139915A1 (en) 2006-12-07 2008-06-12 Medtronic Vascular, Inc. Vascular Position Locating and/or Mapping Apparatus and Methods
US9220573B2 (en) 2007-01-02 2015-12-29 Medtronic Navigation, Inc. System and method for tracking positions of uniform marker geometries
IL188262A (en) 2007-01-10 2011-10-31 Mediguide Ltd System and method for superimposing a representation of the tip of a catheter on an image acquired by a moving imager
US20090080737A1 (en) * 2007-09-25 2009-03-26 General Electric Company System and Method for Use of Fluoroscope and Computed Tomography Registration for Sinuplasty Navigation

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6380732B1 (en) 1997-02-13 2002-04-30 Super Dimension Ltd. Six-degree of freedom tracking system having a passive transponder on the object being tracked
US6188355B1 (en) 1997-12-12 2001-02-13 Super Dimension Ltd. Wireless six-degree-of-freedom locator
US6593884B1 (en) 1998-08-02 2003-07-15 Super Dimension Ltd. Intrabody navigation system for medical applications
US6833814B2 (en) 1998-08-02 2004-12-21 Super Dimension Ltd. Intrabody navigation system for medical applications
US6947788B2 (en) 1998-08-02 2005-09-20 Super Dimension Ltd. Navigable catheter
US6615155B2 (en) 2000-03-09 2003-09-02 Super Dimension Ltd. Object tracking using a single sensor or a pair of sensors
US20030185346A1 (en) 2002-03-27 2003-10-02 Stefan Vilsmeier Medical navigation and/or pre-operative treatment planning with the assistance of generic patient data
US7117026B2 (en) 2002-06-12 2006-10-03 Koninklijke Philips Electronics N.V. Physiological model based non-rigid image registration

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
GARRITY ET AL.: "Nuclear Science Symposium Conference Record", vol. 3, 2002, IEEE, pages: 1858 - 1862
See also references of EP2192855A4

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2953532A4 (en) * 2013-02-08 2016-09-14 Covidien Lp System and method for lung denervation
US10328281B2 (en) 2013-02-08 2019-06-25 Covidien Lp System and method for lung denervation
US10328280B2 (en) 2013-02-08 2019-06-25 Covidien Lp System and method for lung denervation
US11547872B2 (en) 2013-02-08 2023-01-10 Covidien Lp System and method for lung denervation
CN116392105A (en) * 2023-06-08 2023-07-07 深圳大学 Breathing training model construction method and device based on personalized feature fitting
CN116392105B (en) * 2023-06-08 2023-08-25 深圳大学 Breathing training model construction method and device based on personalized feature fitting

Also Published As

Publication number Publication date
EP2192855A4 (en) 2013-08-07
US20190274583A1 (en) 2019-09-12
US20120046567A1 (en) 2012-02-23
EP2192855A2 (en) 2010-06-09
US20120046545A1 (en) 2012-02-23
US20090156951A1 (en) 2009-06-18
WO2009074872A3 (en) 2009-12-30
US20120046543A1 (en) 2012-02-23
US20210161424A1 (en) 2021-06-03
EP2192855B1 (en) 2020-03-25
US10292619B2 (en) 2019-05-21
US11089974B2 (en) 2021-08-17

Similar Documents

Publication Publication Date Title
US11089974B2 (en) Monitoring the location of a probe during patient breathing
US10898057B2 (en) Apparatus and method for airway registration and navigation
US10699410B2 (en) Automatic change detection in medical images
EP3057660B1 (en) Estimating position of an organ with a biomechanical model
Hostettler et al. A real-time predictive simulation of abdominal viscera positions during quiet free breathing
CN112996441A (en) System and method for pulmonary volume gated X-ray imaging
US11779241B2 (en) Systems, methods, and computer-readable media of estimating thoracic cavity movement during respiration
EP3468668B1 (en) Soft tissue tracking using physiologic volume rendering
Deligianni et al. Nonrigid 2-D/3-D registration for patient specific bronchoscopy simulation with statistical shape modeling: Phantom validation
Santhanam et al. Modeling real-time 3-D lung deformations for medical visualization
EP3629931A1 (en) Heatmap and atlas
KR102453028B1 (en) Method for providing three-dimensional animated video using respiratory motion tracking-based lung CT images and recording medium thereof
Yamamoto et al. Kernel-based framework to estimate deformations of pneumothorax lung using relative position of anatomical landmarks
Tsuzuki et al. Animated solid model of the lung constructed from unsynchronized MR sequential images
Santhanam et al. Visualization of tumor-influenced 3D lung dynamics
Cavoretto et al. Numerical Methods for Pulmonary Image Registration
Giroux Patient-specific biomechanical model of the respiratory system for radiation therapy
Minaeizaeim Development of a Biomechanical Basis for Lung Image Registration
Deligianni Visual augmentation for virtual environments in surgical training.
Ding Regional lung function and mechanics using image registration

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08860538

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2008860538

Country of ref document: EP