Classifications

• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
  • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/06—Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
  • A61B5/061—Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
  • A61B5/062—Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body using magnetic field
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
  • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
  • A61B2034/101—Computer-aided simulation of surgical operations
  • A61B2034/102—Modelling of surgical devices, implants or prosthesis
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
  • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
  • A61B2034/2046—Tracking techniques
  • A61B2034/2051—Electromagnetic tracking systems

Definitions

• the present disclosure generally relates to electromagnetic navigation, and more particularly to systems and methods for generating a map for electromagnetic navigation and identifying a location and/or an orientation of a sensor based on the map. Discussion of Related Art
• Electromagnetic navigation has helped expand medical imaging, diagnosis, prognosis, and treatment capabilities by enabling a location and/or an orientation of a medical device and/or of a target of interest to be accurately determined within a patient's body.
• an antenna generates an electromagnetic (EM) field in an EM volume
• a sensor incorporated onto a medical device senses an EM signal or strength based on the field
• the EMN system identifies a sensor location based on the sensed EM strength.
• the EM strength at each location in the EM volume is previously measured or mapped to enable the sensor location to be identified in the EM volume by comparing the sensed EM strength and the previously measured EM strength.
• the senor may be a small-sized sensor, such as a single-coil sensor, because, for instance, a small sized sensor may be navigable to additional locations (e.g., narrower portions of a luminal network) within the patient, to which a larger-sized sensor may not be navigable. Additionally, in contrast to large-size sensors which sometimes must be removed from the patient during a procedure to make room in a working channel for other tools, the small-sized sensor may remain within the patient throughout the procedure without interfering with the other tools, thereby facilitating EMN functionality throughout the procedure.
• a small-sized sensor such as a single-coil sensor
• the present disclosure is related to systems and methods for generating a map of EM field strength, for example, a high density (HD) map, for electromagnetic navigation and identifying a sensor location and/or orientation based on the map.
• the HD map has a greater (e.g., finer) gridpoint resolution (that is, more gridpoints) in the EM volume man that of a low density (LD) grid in the EM volume according to which EM field strength measurements are taken and stored in a LD map.
• the HD map in some aspects, is generated based on the previously generated LP map of measured EM field strength and also based on EM field strength calculations based, for instance on geometric configurations of antennas in an antenna assembly.
• the location and/or the orientation of the sensor navigated within the patient's body can be accurately identified without the need to take EM field strength measurements at each of the many gridpoints of the HD map within the EM volume.
• This can enable the use of a small-sized sensor in EMN procedures while minimizing any increased burden of map generation.
• a method for generating a high density (HD) map for identifying a location and/or an orientation of an electromagnetic (EM) sensor within an EM volume in which an EM field is generated by way of an antenna assembly.
• the method includes receiving a measured EM field strength at each gridpoint of a first set of gridpoints of the EM volume from a measurement device.
• An EM field strength at each gridpoint of a second set of gridpoints of the EM volume is calculated based on a geometric configuration of an antenna of the antenna assembly.
• the HD map is generated based on the measured EM field strength at each gridpoint of the first set of gridpoints and the calculated EM field strength at each gridpoint of the second set of gridpoints.
• the antenna assembly generates at least six EM waveforms as components of the EM field.
• the EM field strength is calculated along a three axes coordinate system for each of the at least six EM waveforms.
• the EM field strength is measured by way of a sensor having three coils corresponding to the three axes, respectively.
• the second set of gridpoints includes each gridpoint of the first set of gridpoints.
• the generating the HD map includes calculating an error between the measured EM field strength and the calculated EM field strength, at each gridpoint of the first set of gridpoints. An error for each gridpoint of the second set of gridpoints is interpolated based on the calculated error at each gridpoint of the first set of gridpoints. The interpolated error and the calculated EM field strength at each gridpoint of the second set of gridpoints are added to generate the HD map
• the error is calculated based on a difference between the measured EM field strength and the calculated EM field strength at each gridpoint of the first set of gridpoints.
• the error is based on at least one of an LI or L2 norm of differences between the measured EM field strength and the calculated EM field strength along the three axes.
• the method further includes calculating a pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
• the HD map further includes the pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
• an apparatus for generating an HD map for identifying a location and/or an orientation of an EM sensor within an EM volume in which an EM field is generated by way of an antenna assembly.
• the apparatus includes a processor and a memory storing processor-executable instructions that, when executed by the processor, cause the processor to receive, from a measurement device, a measured EM field strength at each gridpoint of a first set of gridpoints of the EM vohime.
• An EM field strength at each gridpoint of a second set of gridpoints of the EM volume is calculated based on a geometric configuration of at least one antenna of the antenna assembly.
• the HD map is generated based on the measured EM field strength at each gridpoint of the first set of gridpoints and the calculated EM field strength at each gridpoint of the second set of gridpoints.
• the antenna assembly generates at least six EM waveforms as components of the EM field.
• the EM field strength is calculated along a three axes coordinate system for each of the at least six EM waveforms.
• the EM field strength is measured with a sensor having three coils corresponding to the three axes, respectively.
• the second set of gridpoints includes each gridpoint of the first set of gridpoints.
• the generating of the HD map includes calculating an error between the measured EM field strength and the calculated EM field strength, at each gridpoint of the first set of gridpoints.
• An error for each gridpoint of the second plurality of gridpoints is interpolated based on the calculated error at each gridpoint of the first plurality of gridpoint.
• the interpolated error and the calculated EM field strength at each gridpoint of the second plurality of gridpoints are added to generate the HD map.
• the error is calculated based on a difference between the measured EM field strength and the calculated EM field strength at each gridpoint of the first set of gridpoints. [0024] In a further aspect of the present disclosure, the error is based on an LI and/or L2 norm of differences between the measured EM field strength and the calculated EM field strength along the three axes.
• the memory further stores instructions that, when executed by the processor, cause the processor to calculate a pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
• the HD map further includes the pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
• a method for identifying a location and/or an orientation of an EM sensor navigated within an EM volume.
• the method includes retrieving, from a memory, a calculated EM field strength at each gridpoint of a second set of gridpoints of the EM volume.
• An EM field is generated by way of an antenna assembly.
• a measured EM field strength is received from the EM sensor.
• a first gridpoint among a first set of gridpoints of the EM volume is identified based on the measured EM field strength and a HD map.
• the location and/or the orientation of the EM sensor are identified based on the HD map, using the first gridpoint as an initial condition.
• the second set of gridpoints includes the first plurality of gridpoints.
• the antenna assembly includes at least six antennas, each of the antennas including multiple loops.
• the multiple loops have a geometric configuration.
• the HD map includes a calculated EM field strength for each gridpoint of the second set of gridpoints in the EM volume.
• the calculated EM field strength is based on the respective geometric configurations of the at least six antennas.
• the HD map further includes a pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
• the identifying the first gridpoint includes identifying an orientation vector where (a,b,c) is a gridpoint in the first set of gridpoints, satisfying the following condition: where is a pseudo-inverse of which is a calculated EM field strength at gridpoint
• the identifying the location and/or the orientation includes identifying an orientation vector where is a gridpoint in the second set of gridpoints and is located nearby (e.g. within a predetermined distance) from the first gridpoint (A,B,C), satisfying the following condition: where is a pseudo-inverse of which is a
• n p 3 ⁇ 4p is related to the orientation of the EM sensor.
• the second gridpoint (D,E,F) is the location of the EM sensor.
• a system for identifying a location and/or an orientation of an EM sensor navigated within an EM volume.
• the system includes an antenna assembly, the EM sensor, a processor, and a memory.
• the antenna assembly is configured to radiate an EM field within the EM volume.
• the EM sensor is configured to measure an EM field strength based on the radiated EM field.
• the memory stores a calculated EM field strength at each gridpoint of a second set of gridpoints of the EM volume.
• the memory also stores processor-executable instructions that, when executed by the processor, cause the processor to retrieve, from the memory, the calculated EM field strength at each gridpoint of the second set of gridpoints.
• a first gridpoint among a first set of gridpoints of the EM volume is identified based on the measured EM field strength and the HD map.
• the location and/or the orientation of the EM sensor are identified based on the HD map, using the first gridpoint as an initial condition.
• the second set of gridpoints includes the first set of gridpoints.
• the antenna assembly includes at least six antennas, each of the antennas including a plurality of loops.
• the plurality of loops has a geometric configuration.
• the HD map includes a calculated EM field strength at each gridpoint of the second set of gridpoints in the EM volume.
• the calculated EM field strength is based on the respective geometric configurations of the at least six antennas.
• the HD map further includes a pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
• the identifying the first gridpoint includes identifying an orientation vector where (a,b,c) is a gridpoint in the first set of gridpoints, satisfying the following condition: where is a pseudo-inverse of which is a calculated EM field strength at gridpoint (a,b,c) in the HD map. A difference between B and V is calculated.
• the identifying the location and/or the orientation includes identifying an orientation vector , where (d,e,f) is a
• the second gridpoint (D,E,F) is the location of the EM sensor.
• FIG. 1 shows an example electromagnetic navigation (EMN) system, in accordance with the present disclosure
• FIG. 2 is a block diagram of a portion of the EMN system of FIG. 1, in accordance with the present disclosure
• FIG. 3 is a graphical illustration of example low density measurements and related curves, in accordance with the present disclosure
• FIG. 4 is a flowchart illustrating an example method for generating a high density map, in accordance with the present disclosure
• FIG. 5 is a flowchart illustrating an example method for identifying a location and/or an orientation of a sensor, in accordance with the present disclosure
• FIG. 6 is a graphical illustration of an example error function, having multiple local minima, of a discrepancy between a measurement value and a calculated value, in accordance with the present disclosure.
• FIG. 7 is a block diagram of a computing device for use in various embodiments of the present disclosure. DETAILED DESCRIPTION
• the present disclosure is related to systems and methods for generating a high density (HD) map and identifying a location and/or an orientation of a sensor, which may include at least one coil, based on the HD map.
• the respective geometric configurations the antennas enable automated and highly repeatable processes for reproducing such antennas and/or for mathematically calculating the expected or theoretical EM strength at every HD gridpoint within an EM volume (for instance, where the antennas have geometric configurations based on linear portions of printed circuit board (PCB) traces, which facilitate use of the superposition principle in computing the total contribution of the fields generated by way of each antenna to the total combined EM field within the volume).
• PCB printed circuit board
• the present disclosure is related to systems and methods for identifying a location and/or an orientation of an EM sensor by using the HD map.
• the EM sensor senses EM strengths
• an EMN system compares the sensed EM strengths with the expected EM strengths of the HD map and identifies the location and the orientation of the EM sensor.
• a fine coordinate system (e.g., a HD coordinate system or set of gridpoints) is used to describe a coordinate system of the EM volume, which includes more gridpoints than those in a coarse coordinate system (e.g., a LD coordinate system or set of gridpoints) of the EM volume.
• every gridpoint of the coarse coordinate system may be included in the fine coordinate system.
• the coarse coordinate system is utilized for actual EM field strength measurements and the fine coordinate system is utilized for mathematical calculations of EM field strength.
• FIG. 1 illustrates an example electromagnetic navigation (EMN) system
• the EMN system 100 which is configured to identify a location and/or an orientation of a medical device, or sensor thereof, navigating (e.g., to a target) within the patient's body by using an antenna assembly, which includes a plurality of antennas and generates EM fields.
• the EMN system 100 is further configured to augment CT, MRI, or fluoroscopic images in navigation through patient's body toward a target of interest, such as a deceased portion in a luminal network of a patient's lung.
• the EMN system 100 includes a catheter guide assembly 110, a bronchoscope 1 IS, a computing device 120, a monitoring device 130, an EM board 140, a tracking device 160, and reference sensors 170.
• the bronchoscope 115 is operatively coupled to the computing device 120 and the monitoring device 130 via a wired connection (as shown in FIG. 1) or wireless connection (not shown).
• the bronchoscope 115 is inserted into the mouth of a patient 150 and captures images of the luminal network of the lung.
• a catheter guide assembly 110 for achieving access to the periphery of the luminal network of the lung of the patient 150.
• the catheter guide assembly 110 may include an extended working channel (EWC) 111 with an EM sensor 112 at the distal portion of the EWC 111.
• a locatable guide catheter (LG) may be inserted into the EWC 111 with another EM sensor at the distal portion of the LG.
• the EM sensor 112 at the distal portion of the EWC 111 or the LG is used to identify a location and/or an orientation of the EWC 111 or the LG while navigating through the luminal network of the lung. Due to the size restriction in the EWC 111 or the LG, in some embodiments, the EM sensor 112 may include only one single coil for detecting EM strength of an EM field over the patient ISO. However, the number of coils in the EM sensor is not limited to one but may be two or more.
• the computing device 120 such as, a laptop, desktop, tablet, or other similar computing device, includes a display 122, one or more processors 124, memory 126, an AC current driver 127 for providing AC current signals to the antenna assembly 145, a network card 128, and an input device 129.
• the particular configuration of the computing device 120 illustrated in FIG. 1 is provided as an example, but other configurations of the components shown in FIG. 1 as being included in the computing device 120 are also contemplated. In particular, in some embodiments, one or more of the components (122, 124, 126, 127, 128, and/or 129) shown in FIG.
• the AC current driver 127 may, in some example aspects, be separate from the computing device 120 and may be coupled to the antenna assembly 145 and/or coupled to one or more components of the computing device 120, such as the processor 124 and the memory 126, by way of one or more corresponding paths.
• the EMN system 100 may also include multiple computing devices, wherein the multiple computing devices are employed for planning, treatment, visualization, or helping clinicians in a manner suitable for medical operations.
• the display 122 may be touch-sensitive and/or voice-activated, enabling the display 122 to serve as both input and output devices.
• the display 122 may display two dimensional (2D) images or three dimensional (3D) model of a lung to locate and identify a portion of the lung that displays symptoms of lung diseases.
• the one or more processors 124 execute computer-executable instructions.
• the processors 124 may perform image-processing functions so that the 3D model of the lung can be displayed on the display 122 or location algorithm to identify a location and an orientation of the EM sensor 112.
• the computing device 120 may further include a separate graphic accelerator (not shown) that performs only the image- processing functions so that the one or more processors 124 may be available for other programs.
• the memory 126 stores data and programs. For example, data may be mapping data for the EMN or any other related data such as a HD map, image data, patients' medical records, prescriptions and/or history of the patient's diseases.
• the HD map may include a plurality of gridpoints in a fine coordinate system of the EM volume in which a medical device (e.g., the EWC 111, LG, treatment probe, or other surgical devices) is to be navigated, and expected EM strengths at each of the plurality of gridpoints.
• a medical device e.g., the EWC 111, LG, treatment probe, or other surgical devices
• the one or more processors 124 may compare the sensed EM strength with the expected EM strengths in the HD map and identify the location of the EM sensor 112 within the EM volume. Further, an orientation of the medical device may be also calculated based on the sensed EM strength and the expected EM strengths in the HD map.
• the EM board 140 is configured to provide a flat surface for the patient ISO to lie upon and includes an antenna assembly 145.
• the antenna assembly 14S When the patient ISO lies upon on the EM board 140, the antenna assembly 14S generates an EM field sufficient to surround a portion of the patient ISO or the EM volume.
• the antenna assembly 14S includes a plurality of antennas, each of which may include a plurality of loops.
• each antenna is configured to generate an EM waveform having a corresponding frequency.
• the number of antennas may be at least six. In an aspect, the number of antennas may be nine so that nine different EM waveforms can be generated.
• a time multiplexing method is employed in generating the EM waveforms.
• the antennas of the antenna assembly 14S may generate EM waveforms with the same frequency at different times during a period.
• frequency multiplexing method may be employed, where each antenna generates EM waveform having a frequency different from each other.
• combination of the time multiplexing and frequency multiplexing methods may be employed.
• the antennas are grouped into more than one group. Antennas in the same group generate EM waveforms having the same frequency but at different times. Antennas in different groups may generate EM waveforms having different frequencies from each other.
• Corresponding de-multiplexing method is to be used to separate EM waveforms.
• each antenna may have a geometric configuration (for instance, where the antennas each have geometric configurations based on linear portions of printed circuit board (PCB) traces or wires, which facilitate use of the superposition principle in computing the total contribution of the fields generated by way of each antenna to the total combined EM field within the volume) so that each portion of the plurality of loops can be expressed as mathematical relationship or equations, as described in further detail below.
• the magnetic field can thus be computed for each trace on the antenna and the contributions from all traces can be summed. Based on this geometric configuration, expected EM strength at each gridpoint in the HD map can be theoretically or mathematically calculated. Additional aspects of such example antennas and methods of manufacturing the antennas are disclosed in U.S. Patent Application No.
• FIG. 2 shows a block diagram of a portion of the example electromagnetic navigation system 100 of FIG. 1, according to the present disclosure.
• the computing device 120 of the EMN system 100 controls the antenna assembly 145 embedded in the EM board 140 to generate an EM field, receives sensed results from the EM sensor 112, and determines a location and an orientation of the EM sensor 112 in the EM volume.
• the computing device 120 includes a clock 205, which generates a clock signal used for generating the EM field and sampling the sensed results. Since the same clock signal is used for generating the EM field and sampling the sensed EM field, synchronization between the magnetic field generation circuitry (e.g., a waveform generator 210) and the waveform acquisition circuitry (e.g., a digitizer 215) may be achieved. In other words, when the clock 205 provides a clock signal to the waveform generator 210 and the digitizer 215, the EM waveforms generated by the antenna assembly 145 are digitally sampled by digitizer 215 substantially at the same time.
• a clock 205 provides a clock signal to the waveform generator 210 and the digitizer 215
• the EM waveforms generated by the antenna assembly 145 are digitally sampled by digitizer 215 substantially at the same time.
• the digitizer 215 may include an analog-to-digital converter (ADC, which is not shown) to digitally sample the sensed results and an amplifier (which is not shown) to amplify the magnitude of the sensed result so that the magnitude of the sensed results is within the operable range of the ADC.
• ADC analog-to-digital converter
• the digitizer 215 may include a pre-amplifier and post-amplifier so that the magnitude of the sensed result is amplified to be within the operable range of the ADC by the pre-amplifier and digital samples are also amplified to the magnitude of the sensed result by the post-amplifier.
• the demodulator 220 demodulates the digital samples to remove unwanted signals (e.g., noises) and to restore the EM waveforms, which have been generated by the antenna assembly 145.
• the demodulator 220 may use time de-multiplexing method, frequency de-multiplexing method, or combination of both to separate and identify the EM waveforms depending on the method used by the antennas of the antenna assembly 145 to generate the EM waveforms, and to determine EM strength affected by each of the antenna of the antenna assembly 145.
• the demodulator 220 is capable of identifying six EM strengths, which is sensed by the EM sensor 112, for the six antennas, respectively.
• the outputs of the demodulator 220 may be expressed in a form of a nine by one matrix.
• the demodulator 220 demodulates the sensed result.
• the demodulator 220 may use a set of finely tuned digital filters. Orthogonal frequency division multiplexing may also be utilized, in which the EM field and sampling frequencies are chosen in such a way that only the desired frequency from a specific antenna is allowed to pass while other frequencies are precisely stopped. In an aspect, the demodulator 220 may use a multiple tap orthogonal frequency matched filter, in which the digital filter for a specific frequency is tuned to the desired demodulation window.
• the memory 126 may store data and programs related to identification of a location and an orientation.
• the data includes a high density (HD) map 225, which includes a plurality of gridpoints according to the fine coordinate system for the EM volume and expected EM strengths at the gridpoints.
• the HD map 225 may be based on three-axis coordinate system, where each gridpoint has three coordinates corresponding to the three axes, respectively.
• the expected EM strength at each gridpoint may include one EM strength value along each axis for each EM waveform.
• the expected EM strength may include nine EM strength values along the x axis, nine EM strength values along the y axis, and nine EM strength values along the z axis, at each gridpoint.
• Such expected EM strength at each gridpoint may be expressed in a nine by three matrix form.
• the HD map 22S may be made with computations 230, which includes theoretically calculated EM strengths at each axis at each gridpoint in the fine coordinate system, and measurement 235, which includes measurements at each axis at each gridpoint in the coarse coordinate system.
• the fine coordinate system includes all the gridpoints in the coarse coordinate system and the gridpoints of the fine coordinate system are more finely distributed than those of the coarse coordinate system.
• measurement may not have to be made with the fine coordinate system Rather, the measurement may be made in the coarse coordinate system and theoretical computations may be made in the fine coordinate system.
• the HD map 225 may be generated. Generation of the HD map 225 based on the measurement 235 and calculations 230 will be described in further detail with respect to FIG. 4 below.
• measurements by the EM sensor 112 or other hardware may need to be calibrated.
• Such calibration data may be also stored in the memory 126 in a form of sensor calibration 240 and hardware calibration 245.
• the computing device 120 uses the location algorithm 2S0, which is also stored in the memory 126, with the HD map 225 to identify the location and the orientation of the EM sensor 112 in the fine coordinate system. Identification of the location and/or the orientation will be described in further detail with respect to FIG. 5 below.
• the location algorithm 250 may utilize any error minimization algorithm in identifying the location and the orientation of the EM sensor 112.
• Levenberg-Marquardt algorithm may be employed to minimize errors between the expected EM strengths of the HD density map and the sensed results.
• Other error minimization methods or algorithms which a person having ordinary skill in the art can readily appreciate, may also be utilized without departing from the scope of this disclosure.
• the memory 126 further includes applications 255, which can be utilized by the computing device 120 of the EMN system 100 and which uses information regarding the location and the orientation of the EM sensor 112.
• applications 255 may be a displaying application, which displays a graphical representation of a medical device, on which the EM sensor 112 is mounted or installed, at the location of the EM sensor 112 and along the orientation of the EM sensor 112 in the EM volume, an application for treatment, which determines whether a medical device is near a target of interest, or any other applications, which use the location and the orientation of the EM sensor 112.
• FIG. 3 is a graphical illustration of multiple curves 320, 325, 330, and 340, as well as discrete EM field strength measurements 315a-315i taken in the coarse coordinate system.
• the horizontal axis may represent any axis among x, y, and z axes for the EM volume and the vertical axis represents a magnitude of EM field strengths.
• Gridpoints of the coarse coordinate system are shown separated by SO millimeters and measured EM strengths at the gridpoints of the coarse coordinate system are shown as black dots 31 Sa-31 Si.
• measurements may be taken at a specific hospital rooms and beds, where the EMN system 100 will be used, by way of a measurement jig, which includes three coils sensing an EM field strength in each of three different directions (e.g., x, y, and z axes).
• a measurement jig which includes three coils sensing an EM field strength in each of three different directions (e.g., x, y, and z axes). Examples of such a measurement jig are disclosed by Provisional U.S. Patent Application No. 62/237,084, entitled “Systems And Methods For Automated Mapping And Accuracy-Testing," filed on October S, 2015, the entire contents of which are hereby incorporated herein by reference.
• interpolation may be used to generate first and second interpolated curves, 320 and 32S.
• the first interpolated curve 320 is generated by a linear interpolation method and the second interpolated curve 32S is generated by B- spline interpolation.
• Calculated EM strengths at gridpoints in the HD map are also interpolated to generate a third interpolated curve 330.
• the first interpolated curve 320 is lower than the third interpolated curve 330, and the second interpolated curve 32S is much higher than the second and third interpolated curves 32S and 330. Due to these big differences, an error may be apparent if only one of the three interpolated curves is used. [0084] In order to minimize such differences, a fourth interpolated curve 340 is used.
• the fourth curve 340 is generated by calculating discrepancies between theoretical calculations and measurements at the LD gridpoints, such as 315a-315i, and interpolating the discrepancies for the HD gridpoints.
• FIG. 4 is a flowchart illustrating an example method 400 for generating an
• HD map based on theoretical calculations in the fine coordinate system and measurements in the coarse coordinate system. Measurements may be performed for the EM field generated by the antennas of the antenna assembly 14S of FIG. 1, each of which having a corresponding geometric configuration.
• EM field measurements at all gridpoints in the coarse coordinate system are received from a measurement jig.
• the measurements may include three different measurements along three axes in the coarse coordinate system for each EM waveform.
• the measurements at one gridpoint may include three values for the three different axes and nine of three values for the nine different waveforms, respectively.
• these measurements may be in a form of nine by three matrix.
• each antenna includes a plurality of loops, which have geometric configurations.
• each loop of the antenna can be expressed in a form of mathematical equations or is made of simply linear portions.
• EM strength at any gridpoints in the fine coordinate system may be calculated by using Biot-Savart-Laplace law as follows:
• the total EM strength at gridpoint r may include three calculated values for the three different axes (e.g., x, y, and z axes) for one antenna, and nine of three calculated values for the nine antennas, in a case when there are nine antennas.
• the calculated EM strength may be expressed in a nine by three matrix form.
• a discrepancy is calculated between the measured EM field and the calculated EM field at each gridpoint in the coarse coordinate system.
• the discrepancy may be made smaller by calibrating parameters of the three coil sensor of the measurement jig, calibrating the antennas, or calibrating parameters (e.g., frequencies or phases for the waveform generator 210) of the computing device of the EMN system.
• the calculated discrepancies at gridpoints in the coarse coordinate system are interpolated for gridpoints in the fine coordinate system. Any method of interpolation including linear interpolation, b-spline interpolation, etc. may be used.
• the interpolated discrepancies are added to the theoretical calculations of the EM field to from expected EM field strength at each gridpoint in the fine coordinate system.
• the expected EM field strength at each gridpoint may be in a form of a nine by three matrix in a case when there are nine separate EM waveforms.
• the HD map may further include a pseudo-inverse of the expected EM field strength at each gridpoint in the HD map. This pseudo-inverse may be used in identifying a location and an orientation of the EM sensor, which is described in further detail with respect to FIG. 5 below.
• FIG. 5 is a flowchart illustrating an example method 500 for identifying a location and/or an orientation of an EM sensor, for example, mounted on a medical device, which is navigated within a patient's body, in accordance with the present disclosure.
• the method 500 may be used while a medical device navigates inside the patient's body.
• the HD map which includes expected EM field strength at each gridpoint of the HD map, is retrieved from a memory.
• the expected EM field strengths are based on the theoretical computations in the fine coordinate system and measurements in the coarse coordinate system.
• the EM sensor mounted on the medical device periodically transmits sensed EM field strength to an EMN computing device, which digitally samples the sensed EM field strength.
• the EMN computing device measures the EM field strength based on the digital samples in step 520.
• the EMN computing device compares all gridpoints in the coarse coordinate system with the measured EM field strength, simply pickups, to find an approximate gridpoint in the coarse coordinate system near the location of the EM sensor, as an initial location, at 540.
• a following error function may be used at 540:
• E is the error value
• a is a counter
• N is the number of antennas
• (a,b,c) is a gridpoint in the coarse coordinate system
• B a (a,b,c) is a vector, one by three matrix, including an expected EM field strength at (a,b,c) influenced by the a-th antenna
• ⁇ is a symbol of dot product between two vectors
• n(a,b,c) is an orientation of the EM sensor
• V a is a vector, one by one matrix, including a pickup influenced by the a-th antenna
• b is a parameter to control a gain weight
• g is a gain of the EM sensor.
• the parameter b is used when the gain of the EM sensor is known and fixed.
• the value for the parameter b may be chosen so as not to dominate the error function E.
• the parameter b when the gain of the EM sensor is not known, the parameter b may be set to zero or the gain squared, g 2 , is assumed to be equal to the squared norm of the orientation vector n .
• the parameter b is assumed to be zero.
• error function is useful in identifying a location in the coarse or fine coordinate system.
• the error function is not limited to the above equation (2) or (3) and can be any error function that a person of ordinary skill in the art would readily appreciate without departing from the scope of this disclosure.
• the error function E maybe:
• a curve of an error function along one axis is shown to illustrate how selection of an initial location may impact the determination of a location that provides the global minimum of the error.
• the horizontal axis represents a location along one axis (e.g., x, y, or z axis) and the vertical axis represents a magnitude of the error function. If the initial location is set to be near 3 ⁇ 4 or Xi, the location giving a local minimum will be between X 0 and Xi. If the initial location is set to be Xs or 3 ⁇ 4, the location giving a local minimum will be between Xs and X*.
• the method 500 evaluates the error function at every gridpoint in the coarse coordinate system to find a first gridpoint, which provides the global minimum, in step 540.
• the error function E includes a term, the orientation vector n, which * at
• 540 may also be identified as follows:
• V includes pickups.
• B(a,b,c) " ' -V results in a three by one matrix, which is a column vector representing an orientation matrix, n(a,b,c) at gridpoint (a,b,c) in the coarse coordinate system.
• the error function is evaluated. Errors of all gridpoints in the coarse coordinate system are compared with each other, and the gridpoint that provides the smallest error is selected as a first gridpoint and is set as the initial location at 540. After the initial location is set at 540, 550 follows. Also, at 530, when it is determined that the initial location is set, the step 550 is performed.
• a predetermined number of gridpoints around the initial location are selected to calculate the error function in the same way as in equation (2) or (3). For example, if the predetermined number of gridpoints is three, three gridpoints from the initial location in both directions along x, y, and z axes form a cube, 7 by 7 by 7 gridpoints. Thus, 343 gridpoints are selected to calculate the error function, and one among the selected gridpoints, which provides the smallest error, is selected as a second gridpoint, i.e., the location of the EM sensor. The corresponding orientation vector is also set as the orientation of the EM sensor in step 550. The second gridpoint is set as the initial location in step 560.
• the error may be compared with a predetermined threshold. If the error is less than the predetermined threshold, that gridpoint is selected as the second gridpoint or the location of the EM sensor and corresponding orientation vector is selected as the orientation of the EM sensor.
• step 570 it is determined whether the target has been reached. When it is determined that the target has not been reached, steps 520-570 are repeated until the target is reached. Otherwise, the method 500 ends. [00101] Turning now to FIG. 7, there is shown a block diagram of a computing device 700, which can be used as the computing device 120 of the EMN system 100, the tracking device 160, or a computer performing the method 400 of FIG. 4 or the method 500 of FIG. S.
• the computing device 700 may include a memory 702, a processor 704, a display 706, network interface 708, an input device 710, and/or output module 712.
• the memory 702 includes any non-transitory computer-readable storage media for storing data and/or software that is executable by the processor 704 and which controls the operation of the computing device 700.
• the memory 702 may include one or more solid-state storage devices such as flash memory chips.
• the memory 702 may include one or more mass storage devices connected to the processor 704 through a mass storage controller (not shown) and a communications bus (not shown).
• mass storage controller not shown
• communications bus not shown
• computer readable storage media include non-transitory, volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.
• computer-readable storage media include RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD- ROM, DVD, Blu-Ray or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computing device 700.
• the memory 702 may store application 716 and data 714.
• the application 716 may, when executed by the processor 704, cause the display 706 to present user interface 718 on its screen.
• the processor 704 may be a general purpose processor, a specialized graphic processing unit (GPU) configured to perform specific graphics processing tasks while freeing up the general purpose processor to perform other tasks, and/or any number or combination of such processors.
• GPU graphic processing unit
• the display 706 may be touch-sensitive and/or voice-activated, enabling the display 706 to serve as both an input and output device.
• a keyboard not shown
• mouse not shown
• other data input devices may be employed.
• the network interface 708 may be configured to connect to a network such as a local area network (LAN) consisting of a wired network and/or a wireless network, a wide area network (WAN), a wireless mobile network, a Bluetooth network, and/or the internet
• a network such as a local area network (LAN) consisting of a wired network and/or a wireless network, a wide area network (WAN), a wireless mobile network, a Bluetooth network, and/or the internet
• LAN local area network
• WAN wide area network
• wireless mobile network a wireless mobile network
• Bluetooth network a wireless mobile network
• the computing device 700 may receive measurement data and variables, and perform the method 400 of FIG. 4 to generate a HD map.
• the computing device 700 may receive updates to its software, for example, application 716, via network interface 708.
• the computing device 700 may also display notifications on the display 706 that a software update is available.
• the computing device 700 may receive computed tomographic (CT) image data of a patient from a server, for example, a hospital server, internet server, or other similar servers, for use during surgical ablation planning.
• CT image data may also be provided to the computing device 700 via a removable memory.
• Input device 710 may be any device by means of which a user may interact with the computing device 700, such as, for example, a mouse, keyboard, foot pedal, touch screen, and/or voice interface.
• Output module 712 may include any connectivity port or bus, such as, for example, parallel ports, serial ports, universal serial busses (USB), or any other similar connectivity port known to those skilled in the art
• the application 716 may be one or more software programs stored in the memory 702 and executed by the processor 704 of the computing device 700. During generation of the HD map, one or more software programs in the application 716 may be loaded from the memory 702 and executed by the processor 704 to generate the HD map. In an embodiment, during a navigation phase, one or more programs in the application 716 may be loaded, identify the location and the orientation of an EM sensor mounted on a medical device, and display the medical device at the location along the orientation on a screen overlaid with other imaging data, such as CT data or a three dimensional model of a patient.
• one or more programs in the application 716 may guide a clinician through a series of steps to identify a target, size the target, size a treatment zone, and/or determine an access route to the target for later use during the procedure phase.
• one or more programs in the application 716 may be loaded on computing devices in an operating room or other facility where surgical procedures are performed, and is used as a plan or map to guide a clinician performing a surgical procedure by using the information regarding the location and the orientation.
• the application 716 may be installed directly on the computing device 700, or may be installed on another computer, for example a central server, and opened on the computing device 700 via the network interlace 708.
• the application 716 may run natively on the computing device 700, as a web-based application, or any other format known to those skilled in the art.
• the application 716 will be a single software program having all of the features and functionality described in the present disclosure.
• the application 716 may be two or more distinct software programs providing various parts of these features and functionality.
• the application 716 may include one software program for generating a HD map, another one for identifying a location and an orientation, and a third program for navigation and treatment program.
• the various software programs forming part of the application 716 may be enabled to communicate with each other and/or import and export various data including settings and parameters.
• the application 716 may communicate with a user interface 718 which generates a user interface for presenting visual interactive features to a user, for example, on the display 706 and for receiving input, for example, via a user input device.
• user interface 718 may generate a graphical user interface (GUI) and output the GUI to the display 706 for viewing by a user.
• GUI graphical user interface
• the computing device 700 may be linked to the display 130, thus enabling the computing device 700 to control the output on the display 130 along with the output on the display 706.
• the computing device 700 may control the display 130 to display output which is the same as or similar to the output displayed on the display 706.
• the output on the display 706 may be mirrored on the display 130.
• the computing device 700 may control the display 130 to display different output from that displayed on the display 706.
• the display 130 may be controlled to display guidance images and information during the surgical procedure, while the display 706 is controlled to display other output, such as configuration or status information of an electrosurgical generator 101 as shown in FIG. 1.
• the application 716 may include one software program for use during the planning phase, and a second software program for use during the treatment phase.
• the various software programs forming part of application 716 may be enabled to communicate with each other and/or import and export various settings and parameters relating to the navigation and treatment and/or the patient to share information.
• a treatment plan and any of its components generated by one software program during the planning phase may be stored and exported to be used by a second software program during the procedure phase.

Landscapes

• Health & Medical Sciences (AREA)
• Life Sciences & Earth Sciences (AREA)
• Engineering & Computer Science (AREA)
• Surgery (AREA)
• Heart & Thoracic Surgery (AREA)
• Animal Behavior & Ethology (AREA)
• Veterinary Medicine (AREA)
• Biomedical Technology (AREA)
• Public Health (AREA)
• Medical Informatics (AREA)
• Molecular Biology (AREA)
• General Health & Medical Sciences (AREA)
• Physics & Mathematics (AREA)
• Human Computer Interaction (AREA)
• Biophysics (AREA)
• Pathology (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Robotics (AREA)
• Position Fixing By Use Of Radio Waves (AREA)

Priority Applications (5)

Applications Claiming Priority (4)

Publications (1)

Family

ID=62025430

Family Applications (1)

Country Status (6)

Cited By (2)

Citations (6)

Family Cites Families (14)

• 2017
  • 2017-10-26 AU AU2017348161A patent/AU2017348161B2/en not_active Ceased
  • 2017-10-26 CA CA3040718A patent/CA3040718A1/en active Pending
  • 2017-10-26 CN CN201780066962.9A patent/CN109890312B/zh active Active
  • 2017-10-26 EP EP17863634.6A patent/EP3531950A4/en active Pending
  • 2017-10-26 JP JP2019523099A patent/JP7035043B2/ja active Active
  • 2017-10-26 WO PCT/US2017/058421 patent/WO2018081356A1/en unknown

Patent Citations (6)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events