WO2010076673A1 - Path planning for reducing tissue damage in minimally invasive surgery - Google Patents
Path planning for reducing tissue damage in minimally invasive surgery Download PDFInfo
- Publication number
- WO2010076673A1 WO2010076673A1 PCT/IB2009/054993 IB2009054993W WO2010076673A1 WO 2010076673 A1 WO2010076673 A1 WO 2010076673A1 IB 2009054993 W IB2009054993 W IB 2009054993W WO 2010076673 A1 WO2010076673 A1 WO 2010076673A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- node
- configuration
- space
- free
- damage assessment
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3417—Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
- A61B17/3421—Cannulas
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/00234—Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery
- A61B2017/00292—Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery mounted on or guided by flexible, e.g. catheter-like, means
- A61B2017/003—Steerable
- A61B2017/00318—Steering mechanisms
- A61B2017/00331—Steering mechanisms with preformed bends
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/107—Visualisation of planned trajectories or target regions
Definitions
- the present invention relates to a method and a system for computing a path for a minimally invasive device to reach a target while avoiding critical structures and minimizing damage to structures.
- This path may be used to either control a device (e.g., a bronchoscope or a beveled needle) or may be used to construct a device (e.g., a nested cannula).
- a device e.g., a bronchoscope or a beveled needle
- a device e.g., a nested cannula
- Such path planning applications may be performed using the framework taught by Karen I. Trovato, A * Planning in Discrete Configuration Spaces of Autonomous System, University of Amsterdam, 1996.
- a path planning application must be characterized by a set of key parameters.
- Each parameter has one or more ranges of valid parameter values that are discretized for easier computer calculation.
- a neighborhood encapsulates a set of potential transitions based on the core capabilities of the system or device, typically within a certain range.
- a transition from one state in the configuration space to another 'neighboring' state may be caused by an event or physical motion.
- the 'neighbors' may also be determined based upon physics or 'rules of the game'. Thus, a neighborhood may include all positions for a knight within one move on an empty chessboard.
- Illegal states also have a downstream effect.
- the neighborhood of motions for a car might be an arc of travel forward, in a quarter turn. If a state along the curve is blocked by a corner (an obstacle), then not only is the transition into the corner forbidden, but the transitions beyond the corner are also forbidden.
- a 'goal' (or target) position may be mapped to one or more equivalent 'goal' nodes in the discretized configuration space. Multiple 'goal' nodes may exist because the formulation of parameters expressing the system may have more than one solution describing the system 'goal'. For example, both left-handed and right-handed configurations of your arm can reach the same location.
- the system 'start' is simply transformed to a specific starting node, which is often the current state (i.e. status) of the system or device. Finding the most desirable series of events leading from a current system node (start) to a desired 'goal' is analogous to finding an optimal path of transitions from the current node to the 'goal' node that incurs a minimum cost while avoiding all illegal nodes. It is also taught that the path may be computed from either the start to the goal, or from the goal to the start. In both cases, the connection of transitions forms a resulting path.
- Path planning often has a criterion for success sometimes called a space variant metric, a cost metric, or an objective function (e.g., a fastest, shortest, least expensive, etc.).
- the desirable series of events therefore may be found by planning a path using the configuration space nodes, neighborhood of transitions, costs, forbidden regions, and 'goal', and by defining or setting a 'starting node'.
- a graph search method such as A* provides an efficient mechanism to determine the optimal path.
- the present invention provides a structural damage quantification metric (measure) and a target node geometric expansion that expands the utilization of the subject framework taught by Trovato.
- a kinematically feasible set of nested cannulas can be computed based on an optimal path for the device that minimizes damage to critical structures during a minimally invasive surgery.
- One form of the present invention is a method for planning a path according to a surgical application incorporating a structural damage assessment technique. The method involves a construction of a configuration space structure within a data storage medium, the configuration space structure representing a discretized configuration space of an anatomical region of a body, including free-space configuration nodes and forbidden configuration nodes.
- the method further involves a generation of a structural damage assessment for each free-space configuration node, the structural damage assessment being indicative of a damage assessment of potential damage to one or more anatomical areas of the anatomical region represented by the forbidden configuration node(s) having an infinite structural assessment cost.
- the planning method incorporates the geometric expansion technique. Specifically, the method further involves an augmentation of the configuration space node structure as constructed within the data storage medium with parameter values quantifying each node of the configuration space node structure, wherein the augmentation of the configuration space node structure includes a geometric expansion of a target node involving one or more free- space configuration nodes geometrically neighboring the target node serving as surrogate seed node(s).
- FIG. 1 illustrates exemplary Brodmann areas of brain as known in the art.
- FIG. 2 illustrates an exemplary non-holonomic neighborhood for a nested cannula as known in the art.
- FIG. 3 illustrates a block diagram of a critical structure damage assessment technique and a target node geometric expansion technique in accordance with present invention.
- FIG. 4 illustrates a flowchart representative of a path planning method in accordance with the present invention.
- FIG. 5 illustrates exemplary brain vasculature and ventricles as known in the art.
- FIG. 6 illustrates an exemplary detection of critical structures within a brain in accordance with the present invention.
- FIG. 7 illustrates a flowchart representative of a weight computation method in accordance with the present invention.
- FIG. 8 illustrates an exemplary weighted scale in accordance with the present invention.
- FIG. 9 illustrates an exemplary obstacle map in accordance with the present invention.
- FIG. 10 illustrates an exemplary dilated obstacle map in accordance with the present invention.
- FIG. 11 illustrates an exemplary obstacle distance map in accordance with the present invention.
- FIG. 12 illustrates an exemplary empirical weighted map in accordance with the present invention.
- FIG. 13 illustrates an exemplary structural damage assessment map in accordance with the present invention.
- FIG. 14 illustrates a flowchart representative of a target node geometric expansion method in accordance with the present invention.
- FIG. 15 illustrates an exemplary two-dimensional geometric expansion of a target node in accordance with the present invention.
- FIG. 16 illustrates a flowchart representative of A* algorithm for determination of an optimal path from a 'seed' node to a 'goal' utilizing state parameters in accordance with the present invention.
- FIG. 17 illustrates an exemplary set of "safe" entry points for brain biopsy as known in the art.
- FIG. 18 illustrates a block diagram of a system in accordance with the present invention.
- the present invention is premised on three (3) primary inventive principles.
- a discretized configuration space for path planning applications as related to minimally invasive surgeries may be enhanced by creating a 'structural damage assessment' that provides a cost estimate or penalty accrued by traversing specific anatomical areas (e.g., critical anatomical structures within an anatomical region and fragile entry points into the anatomical region).
- This might be stored in the configuration space itself, or is preferably stored in a separate structure or as a function.
- the structural damage assessment will facilitate path planning within the anatomical region that minimizes overall damage.
- any damage to critical structures of the brain e.g., blood vessels, ventricles, pituitary glands, pons and optic nerves
- the utilization of a structural damage assessment aids minimally invasive surgery planning by minimizing, if not preventing, any damage to the critical structures and fragile entry points.
- structural damage assessment values may be used in conjunction with the cost metric and heuristic parameter values to search through a discretized configuration space that avoid obstacles, but also maintains a safe spacing from such obstacles.
- a preferred entry point or area may be highlighted, given the target and structural damage assessment, such as, for example, the Brodmann areas of brain chart 100 shown in FIG. 1.
- structural damage assessment such as, for example, the Brodmann areas of brain chart 100 shown in FIG. 1.
- a burr hole may be made in any of numerous locations, it is critical to identify the appropriate starting location based on the target, such that it minimizes overall damage, but is achievable with current tools.
- Nested cannulas extend sequentially, from largest to smallest, and are curved in different directions to reach far into the anatomy.
- the method for configuring these devices is described in International Publication WO 2008/032230 entitled "Active Cannula Configuration for Minimally Invasive Surgery” by Karen I. Trovato. Since nested cannulas do not have motorized joints along their length, nor 'marionette wires' for control, they may be made very small, which is useful for brain applications as well as many other minimally invasive procedures.
- the approach orientation to a target may not be easily identifiable or selectable.
- a common problem is how to create multiple approach orientations to a target, for example, the center of a tumor, without tedious manual entry, while maintaining a 3D configuration space for 6D planning.
- the approach orientation may be formed by the direction from adjacent neighbors to a seed node. The search direction is therefore set to the opposite direction (from seed to adjacent neighbors). This "geometric expansion" provides a simple, achievable variety of orientations while covering all surrounding directions.
- these neighbors are within acceptable accuracy to represent the target, they may be used as surrogate 'seeds', having zero cost and the defined orientation for initiating the A* search, as long as they are not in a forbidden or infinite cost location.
- geometric neighborhoods of many shapes and sizes may be used, not just those that are immediately adjacent, however they must define viable final motions or actions.
- the geometric neighborhood used to set the orientation of surrogate seeds does not necessarily have to match the neighborhood used during the A* search.
- FIG. 2 illustrates a non-holomonic neighborhood 101 of arcs that may be utilized to compute a series of nested cannulas to reach a target location within an anatomical region of a body as known in the art.
- a search of neighborhood 101 is typically expanded in an A* algorithm based on a single orientation leading into a single target node.
- a geometric expansion of the present invention would facilitate a search of neighborhood in an A* algorithm based on multiple orientations surrounding a single target node.
- the result may be a curved route through the anatomical region leading between the target node and the optimal, permitted entry point.
- FIG. 3 illustrates a setup phase 110 and a path-planning phase 111 for any type of path planning application, in particular for planning of a surgical path for an instrument within a patient during a minimally invasive surgery or for planning a construction of a nested cannula.
- setup phase 110 may minimally involve (1) a construction of a configuration space node structure representing a discretized configuration space including a plurality of states (nodes) characterized by one or more parameters, (2) an identification of a neighborhood encapsulating all of the allowed actions that cause changes or transitions between states (nodes) in the discretized configuration space, and (3) a formulation of a metric representing the cost for transitioning from one state to a neighboring state as defined by the 'neighborhood'.
- path planning phase 111 may minimally involve (1) an identification or definition of a seed node within the discretized configuration space, and (2) a utilization of the seed node to initiate a propagation of cost waves through the configuration space node structure based on the metric to find the most desirable series of events between a start node and a goal node.
- a configuration space node structure includes a plurality of nodes with each node being at a different discrete location in the discretized configuration space as characterized by the parameter(s), and technique 112 provides for the use of structural damage assessment values explicitly quantifying a damage assessment of potential damage to anatomical structures of the anatomical region of the body while technique 113 provides for the use of one or more geometrically neighboring free-space neighbors of a target node as surrogate seed nodes during an execution of a search through the free-space of the discretized configuration space.
- Exemplary embodiment of techniques 112 and 113 as shown in FIGS. 4-18 will now be described for the purpose of facilitating a further understanding of the inventive principles of the present invention whereby those having ordinary skill in the art will appreciate the various benefits of the present invention.
- FIG. 4 illustrates a flowchart 120 representative of a path planning method of the present invention.
- the objective of this method is to acquire a practical set of cost values, of the states of a discretized configuration space during setup phase 110 (FIG. 3) of a path planning application to facilitate an optimal search during path planning phase 111 (FIG. 3) of the path planning application.
- This objective is subsequently described herein in the context of an incorporation of the structural damage assessment technique 112 and the geometric expansion technique 113 of the present invention.
- a description of well-known path planning processes executed during phases 110 and 111 is provided only as needed to facilitate an understanding of the techniques 112 and 113 of the present invention.
- setup phase 110 includes a stage S 121 and a stage S 122 of flowchart 120.
- Stage 121 encompasses a detection of anatomical areas within an anatomical region of a body for which it is critical to minimize or prevent any damage to the structures.
- These critical areas include, but are not limited to, fragile entry points into the anatomical region and fragile structures within the anatomical region susceptible to damage from an instrument used during a minimally invasive surgery in the region, such as, for example, the brain vasculature/brain ventricles 130 shown in FIG. 5.
- a detection of critical areas may be achieved from images of the anatomical region on a manual basis or an atlas based basis.
- a manual based detection may involve a computed tomography, a magnetic resonance or the like image that is manually segmented or with known semi-automatic algorithms in view of a moderate number of critical structures that are simple to outline.
- FIG. 6 illustrates an exemplary segmentation and registration of a slice of an image of a brain.
- an MRI is usually used for both diagnostics and planning.
- An automatic algorithm or manual segmentation can detect major tissue types, such as, for example, white mater, grey mater, dura mater, blood vessels, cerebrospinal fluid, skull, and skin.
- major tissue types such as, for example, white mater, grey mater, dura mater, blood vessels, cerebrospinal fluid, skull, and skin.
- Brodmann areas 100 as shown in FIG. 1 may be used to define structural damage causing functional impairment.
- a manual or (semi)-automatic segmentation of visible areas within a cross-sectional MRI image 140 of a human brain results in a segmented image 141 that is registered in a deformable manner to a known detailed cross-sectional atlas 143 of the human brain to yield a labeled image 142.
- One such known atlas is Talairach atlas (ref: Lancaster JL, Woldorff MG, Parsons LM, Liotti M, Freitas CS, Rainey L, Kochunov PV, Nickerson D, Mikiten SA, Fox PT, "Automated Talairach Atlas labels for functional brain mapping".
- Stage S 122 encompasses a structural damage assessment for each free-space configuration node representing non-critical areas of the anatomical region as being safe or risky.
- each forbidden configuration node representing the detected critical areas (obstacle and fragile entry points) of the anatomical region corresponds to a critical anatomical area having an infinite risk cost.
- the risk cost of each safe free-space configuration node has a zero risk of structural damage while each risky free-space configuration node has an estimated risk of structural damage ranging from a non-zero, finite cost to an infinite cost.
- a safe free-space configuration node cost 0, and a risky free-space configuration node cost is C ⁇ ⁇ .
- the costs associated with each free-space configuration node may be set by a user, derived from forbidden configuration nodes or a combination of individual set costs and the forbidden configuration nodes, or may be set by a computer program, for example from an automatic segmentation process.
- joint costs might be formed by combining (e.g. adding or averaging): a) a cost for nearby critical points or areas (e.g. distance from critical anatomical areas) and b) a non- forbidden, risky cost.
- a stage S 151 of flowchart 150 encompasses a generation of a base obstacle map derived from forbidden configuration nodes of a labeled image, such as, for example, an obstacle map 160 shown in FIG. 9 having infinity black colored nodes associated with forbidden areas.
- a stage S 152 of flowchart 150 encompasses a generation of a dilated obstacle map derived from safety zones established around the forbidden areas.
- a dilated obstacle map 161 shown in FIG. 10 having infinity black coded safety nodes associated with the forbidden areas has an additional buffer of infinite cost free-space configuration nodes surrounding the original forbidden configuration nodes.
- the white edges around the original forbidden configuration nodes are only to help visually separate the newly added infinite cost free-space configuration nodes from the original forbidden configuration nodes.
- a stage S153 of flowchart 150 encompasses a generation of an obstacle distance map derived from the distance to the nearest infinite cost areas.
- an obstacle distance map 162 shown in FIG. 11 has finite grey colored nodes decreasing in value as free-space configuration nodes are spaced farther from any buffered critical zone.
- a stage S 154 of flowchart 150 encompasses a generation of an empirical data map from the labeled image with the empirical data being indicative of the physical sensitivity of each critical anatomical area (obstacles and fragile entry points) to an external stimuli (surgical instruments/tools).
- an empirical weight map 163 shown in FIG. 12 having zero or finite grey colored nodes corresponding to the physical sensitivity at each of the free-space configuration nodes as empirically ascertained by a user or an automatic segmentation process.
- a stage S155 of flowchart 150 encompasses a combination of the obstacle distance map and the empirical data map based on a combination (e.g., a summation and/or an averaging) of matching nodes.
- a cost map 164 has color coded areas with values collectively derived from the forbidden areas and empirical data in a manner to avoid the forbidden areas to the greatest extent possible to thereby minimize, if not prevent, any structural damage to anatomical structures associated with the forbidden areas.
- dilated obstacle mapping stage S 152 may be omitted as indicated by the dashed arrow leading from base obstacle mapping stage S151 to obstacle distance mapping stage S 153.
- obstacle distance mapping stage S 153 may be omitted as indicated by the dashed arrow leading from dilated obstacle mapping stage S 152 to mapping combination stage S 155.
- both dilated obstacle mapping stage S 152 and obstacle distance mapping stage S 153 may be omitted as indicated by the dashed arrow leading from base obstacle mapping stage S 151 to mapping combination stage S 155.
- empirical weighted mapping stage S 154 may be omitted individually or with one or more of the obstacle mapping stages S 151 -S 153 whereby the remaining obstacle mapping stage(s) is(are) utilized for structural damage assessment cost computation.
- path planning phase 11 1 includes stages S123-S126 of flowchart 120.
- Stage S 123 encompasses a user or computer identified target point, such as a tumor centroid, and a user or computer-identified set of one or more acceptable tool- insertion points/areas for the applicable surgical procedure.
- a single insertion area for a surgical instrument e.g., a nested cannula
- one or more insertion areas may be selected for entrance of the surgical instrument from any non- fragile area of the skull.
- a viable path only exists if it is possible to reach from the entrance to the target, with acceptable overall cost.
- a physician who weighs the risk and the benefit, must determine the limits of 'acceptability'.
- Stage S 124 encompasses a propagation from the target point to the insertion point(s) and/or insertion area(s) via an A* algorithm.
- a flowchart 170 as shown in FIG. 14 and a flowchart 190 as shown in FIG. 16 are executed.
- flowchart 170 is representative of a geometric expansion method of the present invention.
- a stage S 171 of flowchart 170 encompasses an identification of a target node corresponding to the selected target point within the anatomical region, and a stage S 172 of flowchart 170 encompasses a geometric expansion of the target node to identify geometrically neighboring free-space configuration nodes.
- One or more of these geometrically neighboring free-space configuration nodes may serve as surrogate seed nodes, with orientation set by the angle formed between the target node and geometrically neighboring free-space configuration node in an execution of flowchart 190 as will be subsequently explained herein.
- FIG. 15 illustrates a standard initial condition 180 of the centered target node in a simplified two-dimensional ("2D") space that is defined by a point and an orientation (e.g., -50°, 0°, 0°).
- the target node may be replaced by the set of geometrically neighboring free-space configuration nodes, where each node points outward to set the direction of the search that is transformed to an expanded initial condition 181 of the centered target node having each geometrically neighboring free- space neighbor defined by a point, an orientation, a thread and a cost.
- flowchart 190 is representative of A* algorithm for determination of an optimal path from each expanded 'seed' node to a insertion point/area 'goal' utilizing implicit or preferably explicit discrete parameter values based on a neighborhood 101 as shown in FIG. 2.
- each 'seed' node is a free-space surrogate node geometrically neighboring the target node having a structural damage assessment cost below infinity or a critical damage threshold less than infinity.
- a first expanded 'seed' node is placed into the heap in order to begin cost wave propagation, or A*.
- the heap is a balanced binary tree that maintains the lowest cost value at the root. The lowest cost node taken from the heap is called
- Step S 191 further encompasses the acquisition of the detailed configuration space information of the 'home' node, preferably the explicit discrete parameter values of the home node. This will provide the precession desired for the cost wave propagation without any negative impact on the speed and memory capacities of a system executing flowchart 190.
- a step S 192 of flowchart 190 encompasses a testing of a "stopping criterion". There are many tests that may be performed to determine if the process may stop.
- the "stopping criterion" may include, but not limited to, (1) a test of whether the heap is empty and (2) a test of whether the current ("home") node's is one of identified insertion points or belongs to one of insertion areas. This stopping criterion assures that there a viable connection between the insertion and target, and that value is a minimum for that location. This enables the search to terminate before the entire space is filled, yet nonetheless it does give the optimal path between the 'start' and 'goal'.
- a third stopping criterion customized for the present invention involves a presentation of a colored coded surface of a reached insertion point or insertion area previously selected by a user based on the cost to reach the insertion point or insertion area whereby a selection of an entrance point by a user is considered a selection of an optimal path between the 'start' and 'goal'.
- flowchart 190 is terminated. Otherwise, if the "stopping criterion' is not met, then a step S 193 of flowchart 190 encompasses a generation of the neighborhood of permissible transitions.
- the neighbors of the "home' node are calculated based on the 'home' node's orientations given by its alpha, theta and phi as well as its 'home' x, y, z location.
- the neighborhood results from rotating the nominal neighborhood by alpha, theta and phi, and then translating the already rotated neighborhood relative to the 'home' node's x, y, z location. Methods for rotation and translation of points are well known to those skilled in the art.
- the resulting neighborhood is then translated and rotated to the location of the current expanding node.
- flowchart 190 proceeds to a step S 194 where the next thread (T) of the neighborhood is chosen, if any. If there are no more threads, then flowchart 190 returns to step S191. Otherwise, if there is a thread (T), then flowchart 190 proceeds to a step S 195 to chose next neighbor (n 1 ) along the thread (T) if any. The position and orientation of neighbor n' is computed relative to the 'home' node's position and orientation for the current given thread.
- flowchart 190 returns to step S194. If there are no more neighbors along this thread (T), then flowchart 190 returns to step S194. If there is another neighbor (n), then flowchart 190 proceeds to a step 196 to test the cost value of the neighbor. If the cost is infinite, or there is another indication that the neighbor is not passable, then flowchart 190 returns to step S 194. Another indication might be that the neighbor has a cost value higher than some pre-determined threshold, which is less than infinity, but too high to pass. This threshold may be a function of the current distance traveled (at the 'home' node), for example.
- step S 197 calculates the proposed new cost g(n') for the new neighbor, n'.
- the first is called 'g(n')'. This is the cost of the best path (so far) to node n', that arrives from a 'home node' or 'parent node', often denoted as n, without a prime (').
- the function g(n') includes the cost to reach the home node, plus the transition cost from the home node to n', plus any structural damage that might arise from transitioning from home to n'.
- the length of the path is often the transition cost.
- the structural damage incurred from travelling from home to n' may be calculated as the sum of each interim state's structural damage cost, counting states beyond n (since n has already been counted), through and including n'.
- This can also be computed in an alternative way, where the overall structural damage considers the size of the tube as it traverses each voxel (volume element), such that the integral volume swept by the tube is weighted by the various structural damage regions, for example. Therefore, a 3mm diameter tube may be expected to generate twice the damage of a 1.5mm diameter tube.
- Another alternative may occur when the over-riding cost is the total structural damage regardless of distance. In this case, the transition cost may be only an estimate of structural damage with no cost incurred for distance.
- the second value computed in A* is f(n'), which in simplest terms is the 'best case scenario' for a path that first travels through 'home' (by whichever path it arrives from the seed), then travels through n' (including penalties), and finally proceeds optimistically (directly) to the entry point using a heuristic function, h(n' ).
- h(n' ) a heuristic function
- An optimistic cost for the heuristic might be zero, for example, however this uninformed heuristic does not provide guidance for the search.
- Another commonly used heuristic is the straight-line, or Euclidean distance 'as the crow flies', or in other words, the 'distance to go'.
- Flowchart 190 thereafter proceeds to a step S 198 to compare the newly calculated cost F(n') with the pre-existing cost at n', F(n'). If the newly calculated F(ri) is greater than pre-existing cost F(n'), then it is more costly to reach n via the 'home' node than whatever was determined previously (i.e., there is no improvement), and flowchart 190 returns to step S 195. If the calculated cost, F(n') is less than pre-existing cost F(n'), then this value is an improvement over the prior directions whereby flowchart 190 proceeds from step S 198 to step S 199. Step S 199 adds the neighbor node to the set of possible nodes for opening (expanding) next.
- Step S 199 further encompasses assigning the new cost to seed to n, as well as the specific position (e.g. x, y, z) and orientation (e.g. alpha, theta and phi). In a 6D space, position and orientation are represented with a 3D position (x,y,z) and 3 angles (alpha, theta, phi).
- a pose is defined with 3D position (x,y,z) and 2 angles (theta, phi).
- the revised vector is assigned a pointer to 'home', because it leads the best way to the 'seed' node.
- the number and type of the thread is also stored. This is used to determine tube dimensions for avoiding obstacles, as well as curvature options. Further, the thread number maps directly to the control parameters used for controlling devices such as a bronchoscope, or maps directly to the selection of tube and its relative orientation to adjacent nested tubes.
- stage S 125 encompasses providing a set of entry locations, including special identification of an optimal location so that a doctor can select a preferred entry point such as, for example, the entry points 240-250 as shown in FIG. 17 and taught by Set of typical "safe" entry points for brain biopsy.
- Source Sekhar, Fessler. Atlas of Neurosurgical Techniques. Chapter 33: Stereotactic Biopsy (Schwartz and Sisti), pp. 422-429.
- the planned path may provide between a target and 4 equivalent minimum-cost entry points on the skull. There also may be 10 other locations highlighted, along with their respective higher costs. The doctor may choose one of these points, which must be on a suitable stopping location or subject to a stopping criterion.
- the path will be extracted that determines the set of control parameters, or the configuration of the device, or the intended path from the selected point to the target.
- this path may be presented within a 3D image of the anatomical region during stage S 126.
- B. PATH PLANNING SYSTEM INCORPORATING A STRUCTURAL RISK ASSESSMENT AND/OR GEOMETRIC EXPANSION Referring now to FIG. 18, a system 200 is illustrated for a path planning application in accordance with the present invention.
- the system 200 includes a data processing device 210 and a data storage medium 220.
- Data processing device 210 employs a setup unit 211 and a planning unit 212 as physically separate or integrated units for implementing the structural damage assessment technique and/or geometric expansion technique of the present invention as previously explained herein in connection with FIGS. 3-17.
- setup unit 211 performs all tasks necessary to construct a configuration space data structure ("CSDS") and other structures/functions appropriate for the particular path planning application within data storage medium 220 of any type (e.g., RAM), and planning unit 212 propagates cost waves as needed to fill the configuration space node structure with costs values as a function of the parameter values in accordance with the structural damage assessment and/or geometric expansion features of the present invention as desired for the particular path planning application.
- CSDS configuration space data structure
- planning unit 212 propagates cost waves as needed to fill the configuration space node structure with costs values as a function of the parameter values in accordance with the structural damage assessment and/or geometric expansion features of the present invention as desired for the particular path planning application.
- the result is an optimal path 230 in a format suitable for the particular path
- the method or system are used to create a path.
- This path may be used in several ways.
- the path can either control a device, such as a bronchoscope or beveled needle.
- a device such as a nested cannula.
- it may be displayed on a screen, or superimposed in a 3D image and displayed within 3D goggles.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Pathology (AREA)
- Robotics (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Endoscopes (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2011131878/14A RU2596882C2 (en) | 2008-12-29 | 2009-11-10 | Scheduling path for reducing tissue damage during minimally invasive surgery |
BRPI0918308-6A BRPI0918308A2 (en) | 2008-12-29 | 2009-11-10 | method for planning a route according to a surgical application, and system for planning a route according to a surgical application |
EP09760319.5A EP2381866B1 (en) | 2008-12-29 | 2009-11-10 | Path planning for reducing tissue damage in minimally invasive surgery |
US13/139,803 US20110245625A1 (en) | 2008-12-29 | 2009-11-10 | Path planning for reducing tissue damage in minimally invasive surgery |
CN200980152965.XA CN102264312B (en) | 2008-12-29 | 2009-11-10 | For reducing the path planning of tissue injury in Minimally Invasive Surgery |
JP2011542929A JP2012513789A (en) | 2008-12-29 | 2009-11-10 | Path planning method and system for reducing damage to tissue in minimally invasive surgery |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14107008P | 2008-12-29 | 2008-12-29 | |
US61/141,070 | 2008-12-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010076673A1 true WO2010076673A1 (en) | 2010-07-08 |
Family
ID=41666767
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2009/054993 WO2010076673A1 (en) | 2008-12-29 | 2009-11-10 | Path planning for reducing tissue damage in minimally invasive surgery |
Country Status (7)
Country | Link |
---|---|
US (1) | US20110245625A1 (en) |
EP (1) | EP2381866B1 (en) |
JP (1) | JP2012513789A (en) |
CN (1) | CN102264312B (en) |
BR (1) | BRPI0918308A2 (en) |
RU (1) | RU2596882C2 (en) |
WO (1) | WO2010076673A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014139024A1 (en) * | 2013-03-15 | 2014-09-18 | Synaptive Medical (Barbados) Inc. | Planning, navigation and simulation systems and methods for minimally invasive therapy |
EP3138496A1 (en) * | 2015-08-26 | 2017-03-08 | Biosense Webster (Israel) Ltd. | Automatic ent surgery preplanning using a backtracking maze problem solution |
WO2019161073A1 (en) | 2018-02-14 | 2019-08-22 | Epica International, Inc. | Method for determination of surgical procedure access |
US10937250B2 (en) | 2016-12-06 | 2021-03-02 | National University Of Singapore | Methods of reconstructing skulls |
WO2022003444A1 (en) * | 2020-06-29 | 2022-01-06 | Biosense Webster (Israel) Ltd. | Efficient automatic finding of minimal ear-nose-throat (ent) path for probe |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2791913A2 (en) * | 2011-12-03 | 2014-10-22 | Koninklijke Philips N.V. | Interstital lung access using nested cannulas |
WO2015067299A1 (en) | 2013-11-05 | 2015-05-14 | Brainlab Ag | Quantification of brain vulnerability |
EP3108447B1 (en) * | 2014-02-17 | 2020-03-25 | Children's National Medical Center | Method and system for providing recommendation for optimal execution of surgical procedures |
US9536309B2 (en) * | 2014-11-27 | 2017-01-03 | Synaptive Medical (Barbados) Inc. | Method, system and apparatus for displaying surgical engagement paths |
GB2536650A (en) | 2015-03-24 | 2016-09-28 | Augmedics Ltd | Method and system for combining video-based and optic-based augmented reality in a near eye display |
DE102016209074A1 (en) * | 2016-05-25 | 2017-11-30 | Medical Templates Ag | A method of planning an intracorporeal location of a medical needle unit to be percutaneously introduced to a patient |
US10631933B2 (en) * | 2016-08-31 | 2020-04-28 | Covidien Lp | Pathway planning for use with a navigation planning and procedure system |
TWI670681B (en) * | 2017-06-04 | 2019-09-01 | 鈦隼生物科技股份有限公司 | Method and system of determining one or more points on operation pathway |
WO2019211741A1 (en) | 2018-05-02 | 2019-11-07 | Augmedics Ltd. | Registration of a fiducial marker for an augmented reality system |
US10939977B2 (en) | 2018-11-26 | 2021-03-09 | Augmedics Ltd. | Positioning marker |
US11766296B2 (en) | 2018-11-26 | 2023-09-26 | Augmedics Ltd. | Tracking system for image-guided surgery |
US11980506B2 (en) | 2019-07-29 | 2024-05-14 | Augmedics Ltd. | Fiducial marker |
US11480068B2 (en) | 2019-10-15 | 2022-10-25 | General Electric Company | Systems and method of servicing a turbomachine |
US11382712B2 (en) | 2019-12-22 | 2022-07-12 | Augmedics Ltd. | Mirroring in image guided surgery |
US11389252B2 (en) | 2020-06-15 | 2022-07-19 | Augmedics Ltd. | Rotating marker for image guided surgery |
CN112741688B (en) * | 2020-12-11 | 2023-09-29 | 北京信息科技大学 | Path planning method for minimally invasive surgery software manipulator |
US11896445B2 (en) | 2021-07-07 | 2024-02-13 | Augmedics Ltd. | Iliac pin and adapter |
WO2024057210A1 (en) | 2022-09-13 | 2024-03-21 | Augmedics Ltd. | Augmented reality eyewear for image-guided medical intervention |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6112750A (en) * | 1998-03-24 | 2000-09-05 | International Business Machines Corporation | Method and system for assessing risks and prognoses of a given course of medical treatment |
US20040015070A1 (en) * | 2001-02-05 | 2004-01-22 | Zhengrong Liang | Computer aided treatment planning |
WO2007042986A2 (en) * | 2005-10-11 | 2007-04-19 | Koninklijke Philips Electronics, N.V. | 3d tool path planning, simulation and control system |
EP1844725A1 (en) * | 2006-04-07 | 2007-10-17 | BrainLAB AG | Risk assessment for planned trajectories |
WO2008032230A1 (en) * | 2006-09-14 | 2008-03-20 | Koninklijke Philips Electronics N.V. | Active cannula configuration for minimally invasive surgery |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5611025A (en) * | 1994-11-23 | 1997-03-11 | General Electric Company | Virtual internal cavity inspection system |
RU2121296C1 (en) * | 1995-04-10 | 1998-11-10 | Александр Сергеевич Иова | Stereotaxic guidance method |
JP3557736B2 (en) * | 1995-07-14 | 2004-08-25 | ソニー株式会社 | Route search device |
US7379062B2 (en) * | 2005-08-01 | 2008-05-27 | Barco Nv | Method for determining a path along a biological object with a lumen |
US8060181B2 (en) * | 2006-04-07 | 2011-11-15 | Brainlab Ag | Risk assessment for planned trajectories |
EP2143071B1 (en) * | 2007-04-26 | 2014-02-26 | Koninklijke Philips N.V. | Risk indication for surgical procedures |
-
2009
- 2009-11-10 RU RU2011131878/14A patent/RU2596882C2/en not_active IP Right Cessation
- 2009-11-10 CN CN200980152965.XA patent/CN102264312B/en not_active Expired - Fee Related
- 2009-11-10 EP EP09760319.5A patent/EP2381866B1/en not_active Not-in-force
- 2009-11-10 JP JP2011542929A patent/JP2012513789A/en active Pending
- 2009-11-10 WO PCT/IB2009/054993 patent/WO2010076673A1/en active Application Filing
- 2009-11-10 US US13/139,803 patent/US20110245625A1/en not_active Abandoned
- 2009-11-10 BR BRPI0918308-6A patent/BRPI0918308A2/en not_active Application Discontinuation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6112750A (en) * | 1998-03-24 | 2000-09-05 | International Business Machines Corporation | Method and system for assessing risks and prognoses of a given course of medical treatment |
US20040015070A1 (en) * | 2001-02-05 | 2004-01-22 | Zhengrong Liang | Computer aided treatment planning |
WO2007042986A2 (en) * | 2005-10-11 | 2007-04-19 | Koninklijke Philips Electronics, N.V. | 3d tool path planning, simulation and control system |
EP1844725A1 (en) * | 2006-04-07 | 2007-10-17 | BrainLAB AG | Risk assessment for planned trajectories |
WO2008032230A1 (en) * | 2006-09-14 | 2008-03-20 | Koninklijke Philips Electronics N.V. | Active cannula configuration for minimally invasive surgery |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014139024A1 (en) * | 2013-03-15 | 2014-09-18 | Synaptive Medical (Barbados) Inc. | Planning, navigation and simulation systems and methods for minimally invasive therapy |
US9600138B2 (en) | 2013-03-15 | 2017-03-21 | Synaptive Medical (Barbados) Inc. | Planning, navigation and simulation systems and methods for minimally invasive therapy |
EP3138496A1 (en) * | 2015-08-26 | 2017-03-08 | Biosense Webster (Israel) Ltd. | Automatic ent surgery preplanning using a backtracking maze problem solution |
US10188465B2 (en) | 2015-08-26 | 2019-01-29 | Biosense Webster (Israel) Ltd. | Automatic ENT surgery preplanning using a backtracking maze problem solution |
US10492867B2 (en) | 2015-08-26 | 2019-12-03 | Biosense Webster (Israel) Ltd. | Automatic ENT surgery preplanning using a backtracking maze problem solution |
US10937250B2 (en) | 2016-12-06 | 2021-03-02 | National University Of Singapore | Methods of reconstructing skulls |
WO2019161073A1 (en) | 2018-02-14 | 2019-08-22 | Epica International, Inc. | Method for determination of surgical procedure access |
EP3752980A4 (en) * | 2018-02-14 | 2021-11-17 | Epica International, Inc. | Method for determination of surgical procedure access |
US11648061B2 (en) | 2018-02-14 | 2023-05-16 | Epica International, Inc. | Method for determination of surgical procedure access |
WO2022003444A1 (en) * | 2020-06-29 | 2022-01-06 | Biosense Webster (Israel) Ltd. | Efficient automatic finding of minimal ear-nose-throat (ent) path for probe |
Also Published As
Publication number | Publication date |
---|---|
RU2596882C2 (en) | 2016-09-10 |
EP2381866B1 (en) | 2017-03-22 |
RU2011131878A (en) | 2013-02-10 |
US20110245625A1 (en) | 2011-10-06 |
CN102264312A (en) | 2011-11-30 |
JP2012513789A (en) | 2012-06-21 |
CN102264312B (en) | 2016-09-28 |
BRPI0918308A2 (en) | 2020-08-04 |
EP2381866A1 (en) | 2011-11-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2381866B1 (en) | Path planning for reducing tissue damage in minimally invasive surgery | |
JP5442993B2 (en) | 3D instrument path planning, simulation and control system | |
CN110049742B (en) | Image-guided motion scaling for robot control | |
EP2143071B1 (en) | Risk indication for surgical procedures | |
US8831307B2 (en) | Visualizing surgical trajectories | |
US20150257847A1 (en) | Methods and apparatus for 3d route planning through hollow organs | |
US9946979B2 (en) | Method and system for fast precise path planning | |
US20070049861A1 (en) | Device and method for automated planning of an access path for a percutaneous, minimally invasive intervention | |
US20090041321A1 (en) | Method and apparatus for fast automatic centerline extraction for virtual endoscopy | |
US20210315636A1 (en) | User interface for image guided surgery system | |
Kuntz et al. | Planning high-quality motions for concentric tube robots in point clouds via parallel sampling and optimization | |
CN115397366A (en) | Computer-based method for planning a catheter-based intervention | |
US10980603B2 (en) | Updating a volumetric map | |
JP5890537B2 (en) | Method and system for generating a multidimensional surface model of a geometric structure | |
US20150012011A1 (en) | Interstital lung access using nested cannulas | |
Kunz et al. | Multimodal risk-based path planning for neurosurgical interventions | |
Bentley | Faster and Safer Motion Planning of Continuum Robots via Efficient Physics-Based Force Models | |
Gibbs et al. | Planning and visualization methods for effective bronchoscopic target localization |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980152965.X Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09760319 Country of ref document: EP Kind code of ref document: A1 |
|
REEP | Request for entry into the european phase |
Ref document number: 2009760319 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009760319 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13139803 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 2011542929 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 5198/CHENP/2011 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011131878 Country of ref document: RU |
|
ENP | Entry into the national phase |
Ref document number: PI0918308 Country of ref document: BR Kind code of ref document: A2 Effective date: 20110624 |