WO2012172458A1 - Three-dimensional needle localization with a two-dimensional imaging probe - Google Patents

Three-dimensional needle localization with a two-dimensional imaging probe Download PDF

Info

Publication number
WO2012172458A1
WO2012172458A1 PCT/IB2012/052830 IB2012052830W WO2012172458A1 WO 2012172458 A1 WO2012172458 A1 WO 2012172458A1 IB 2012052830 W IB2012052830 W IB 2012052830W WO 2012172458 A1 WO2012172458 A1 WO 2012172458A1
Authority
WO
WIPO (PCT)
Prior art keywords
transducers
array
recited
medical device
imaging
Prior art date
Application number
PCT/IB2012/052830
Other languages
French (fr)
Inventor
Ameet Kumar Jain
Francois Guy Gerard Marie Vignon
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to CN201280039408.9A priority Critical patent/CN103747729B/en
Priority to EP12729236.5A priority patent/EP2717772B1/en
Priority to US14/118,244 priority patent/US11147532B2/en
Priority to JP2014515313A priority patent/JP6053766B2/en
Publication of WO2012172458A1 publication Critical patent/WO2012172458A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0833Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures
    • A61B8/0841Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures for locating instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4483Constructional features of the ultrasonic, sonic or infrasonic diagnostic device characterised by features of the ultrasound transducer
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/48Diagnostic techniques
    • A61B8/481Diagnostic techniques involving the use of contrast agent, e.g. microbubbles introduced into the bloodstream
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2051Electromagnetic tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2063Acoustic tracking systems, e.g. using ultrasound
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3925Markers, e.g. radio-opaque or breast lesions markers ultrasonic
    • A61B2090/3929Active markers
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/44Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
    • A61B8/4483Constructional features of the ultrasonic, sonic or infrasonic diagnostic device characterised by features of the ultrasound transducer
    • A61B8/4494Constructional features of the ultrasonic, sonic or infrasonic diagnostic device characterised by features of the ultrasound transducer characterised by the arrangement of the transducer elements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461Displaying means of special interest
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461Displaying means of special interest
    • A61B8/466Displaying means of special interest adapted to display 3D data
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray

Definitions

  • This disclosure relates to medical devices and procedures, and more particularly to systems and methods for medical device localization in three dimensions using one or two- dimensional imaging probes.
  • Needle insertion under ultrasound guidance is commonly performed, e.g., for biopsies, fluid drainage, nerve blocks, vascular access, etc.
  • Needle visualization techniques have been successfully implemented based on steering imaging beams approximately perpendicular to the needle shaft (using, e.g., needle visualization enhancement software).
  • the needle deviates from the imaging plane due to tissue heterogeneities and bevel asymmetry.
  • An out-of-plane needle disappears no matter how smart needle visualization enhancement software is, because the needle receives no ultrasound energy at all.
  • a clinician then has to move the imaging transducer to find the needle and usually loses an original target plane. Furthermore, the clinician does not know where the needle is in relation to the imaging plane and therefore has no indication of how to move the transducer to find the needle.
  • an imaging system and method include a medical device having a tracking element mounted thereon.
  • An array of transducers has the transducers spaced apart from one another for exchanging energy in a subject between the tracking element and the array of transducers.
  • a trilateration module is configured to interpret signals sensed between tracking element and the array of transducers to compute times of flight of signals associated with the transducers in the array such that a position of tracking element is determined in at least two dimensions to locate a position of the medical device in a visual image.
  • FIG. 1 is a block/flow diagram showing a system/method for imaging a medical device in accordance with one illustrative embodiment
  • FIG. 2A is a diagram showing a side-view of time-of-flight spheres emanating from transducer array elements of a probe in accordance with one illustrative embodiment
  • FIG. 2B is a diagram showing a front-view of the time-of-flight spheres emanating from array elements of the probe and showing true and symmetric intersection points in accordance with one illustrative embodiment
  • FIG. 3 is a perspective view showing three spheres intersecting to demonstrate trilateration in accordance with the present principles
  • FIG. 4 is a two-dimensional ultrasound image having a three-dimensional rendering of a needle in accordance with the present principles
  • FIG. 5 A is a schematic diagram showing elements of a physical array
  • FIG. 5B is a schematic diagram showing a virtual element formed behind a physical array in accordance with another embodiment
  • FIG. 5C is a schematic diagram showing elements of a physical array beamformed to form virtual receiver elements based on signal delays in accordance with another embodiment
  • FIG. 6 is a block/flow diagram showing a system/method for imaging a medical device in accordance with another illustrative embodiment.
  • a target plane, a relative position and trajectory of a medical device need to be imaged at the same time to avoid issues related to losing an out-of-plane needle image during a procedure.
  • One-dimensional (ID) ultrasound probes are used for two-dimensional (2D) visualization of needles with respect to the anatomy in a wide range of clinical interventions.
  • 2D two-dimensional
  • this is achieved using a simple one-dimensional (ID) probe (for 2D imaging) or using a two-dimensional (2D) probe for 3D imaging.
  • ID simple one-dimensional
  • 2D two-dimensional
  • An ultrasound element (passive or active) is embedded in a tracked tool, e.g., at a tip of the tool.
  • Ultrasound signal times-of-flight between the tracked element and multiple elements of the imaging probe are used in a three-dimensional (3D) triangulation or trilateration routine to yield the position of the tracked element.
  • 3D three-dimensional
  • the present invention will be described in terms of medical instruments; however, the teachings of the present invention are much broader and are applicable to any instruments employed in tracking or analyzing complex biological or mechanical systems.
  • the present principles are applicable to internal tracking procedures of biological systems, procedures in all areas of the body such as the lungs, gastro- intestinal tract, excretory organs, blood vessels, etc.
  • the elements depicted in the FIGS may be implemented in various combinations of hardware and software and provide functions which may be combined in a single element or multiple elements.
  • processors can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
  • the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared.
  • explicit use of the term "processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor ("DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory
  • DSP digital signal processor
  • ROM read-only memory
  • RAM random access memory
  • non-volatile storage etc.
  • embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system.
  • a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • the medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium.
  • Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk.
  • Current examples of optical disks include compact disk - read only memory (CD-ROM), compact disk - read/write (CD-R/W) and DVD.
  • System 100 may include a workstation or console 112 from which a procedure is supervised and managed. Procedures may include any procedure including but not limited to biopsies, ablations, injection of medications etc. Workstation 112 preferably includes one or more processors 114 and memory 116 for storing programs and applications. It should be understood that the function and components of system 100 may be integrated into one or more workstations or systems.
  • Memory 116 may store a device sensing module 115 configured to interpret electromagnetic, optical and/or acoustic feedback signals from a medical device 102.
  • the sensing module 115 is configured to use the signal feedback (and any other feedback) to provide a location or to depict the medical device 102 in medical images.
  • the medical device 102 may include, e.g., a needle, a catheter, a guide wire, an endoscope, a probe, a robot, an electrode, a filter device, a balloon device or other medical component, etc.
  • Workstation 112 may include a display 118 for viewing internal images of a subject using an imaging system 110.
  • the imaging system 110 may include imaging modalities such as ultrasound,
  • the imaging system 110 may also include, e.g., a magnetic resonance imaging (MRI) system, a fluoroscopy system, a computed tomography (CT) system, an ultrasound system or other system.
  • MRI magnetic resonance imaging
  • CT computed tomography
  • Display 118 may also permit a user to interact with the workstation 112 and its components and functions. This is further facilitated by an interface 120 which may include a keyboard, mouse, a joystick or any other peripheral or control to permit user interaction with the workstation 112.
  • One or more sensors/transducers 106 may be incorporated into the device(s) 102, so tracking information from an energy source 125 can be detected at the device(s) 102.
  • the present illustrative example will be described in terms of a tracked element 106 (on the device 102) being a receiver while tracking elements or transducers 107 (of an imaging array 109) are transmitters, the opposite configuration may also be provided.
  • the same times-of-flight may be measured by using the tracked element 106 (on the device 102) as a transmitter, and the tracking
  • elements/transducers 107 may act as receivers.
  • the energy source 125 need not be provided from a source external to a body/subject 148, and may be from an internal source or from another imaging device 110.
  • the energy source is an ultrasonic source.
  • the sensors/elements 106 may be employed to detect electromagnetic energy or acoustic energy (or transmit the energy). This permits the exchange of energy which will be used to interpret a position and/or orientation of the device 102.
  • the signals will be employed as feedback to make adjustments or otherwise perform the medical procedure.
  • the transducers 107 may include an ultrasonic sensor or sensors (disposed in a probe) or other sensor or transmission devices.
  • Imaging system 110 may be provided to collect real-time intra-operative imaging data.
  • the imaging data may be displayed on display 1 18.
  • Sensing module 115 may determine positions of the sensors/elements 106 and therefore the device 102 within the real-time images based upon energy measured by the sensors/elements 106. This may include employing a trilateration or triangulation method/module 104 as will be described herein.
  • a digital rendering of the medical device 102 (using feedback signals) can be displayed to realize the position of the device 102 against the real-time images (tracking).
  • the digital rendering may be generated by an image processing module 117.
  • an imaging array of transducers is the same as the tracking array of transducers. It is possible to use the imaging beams to track and vice versa (use the tracking beams to image). However, the tracking beams as described herein may not be suitable for ultrasound imaging. In such cases, imaging frames and tracking frames may be interleaved (alternated). If the tracked element is a transmitter, then either its bandwidth needs to be separate from that of the imaging pulses, or scanning may be interrupted during reception of the signals from the tracked element. Other techniques may also be employed to ensure both operations (e.g., tracking and imaging) are performed in real-time.
  • the imaging system 110 includes an ultrasonic system, and the emissions are acoustic in nature.
  • the sensor(s) 106 include ultrasonic sensors which detect acoustic signals generated by ultrasonic transducers 107 arranged in an array 109 on an ultrasonic probe 111. In this way, both anatomical images and device images can concurrently be displayed.
  • an interventional application includes the use of two or more medical devices inside of a subject 148.
  • one device 102 may include a guide catheter, which is placed at one point, and another device 102 may include a needle for performing an ablation or biopsy at fixed/different points along the length of the catheter.
  • Other combinations of devices are also contemplated.
  • one or several ultrasound sensors 106 are mounted on a tracked tool or device 102.
  • the tool 102 is tracked using the sensor 106 for tracking the position of the device 102.
  • a ID imaging array 109 is provided for imaging the tool 102 in accordance with the sensors 106.
  • the array 109 may include a line of transducers (receivers or transmitters) 107 to form the ID dimensional array 109.
  • the one dimensional array may include a straight arrangement (line) of transducers 107 or may include transducers 107 disposed on a curved path (arc).
  • a physically planar array may be employed using beamforming techniques to spatially shift an origin of a time-of-flight sphere emanating from the physical array elements 107. By focusing several physical elements into one location in space (using appropriate time delays) the focus location becomes a virtual element.
  • the sensing module 115 includes a three-dimensional (3D) trilateration routine that tracks the ultrasound elements 106 aboard the tool 102.
  • the display 118 provides a 3D rendering of the tracked tool 102 superimposed on a 2D ultrasound image. The position of the tool 102 will be determined as illustratively described with reference to FIGS. 2A-2B.
  • FIGS. 2A and 2B diagrams show a tracked tool 206 (e.g., a needle) having an element 208 (e.g., an ultrasonic element for transmitting or receiving) at its tip depicted in the vicinity of a curved array (2D probe or a ID array) ultrasonic probe 220 having a plurality of ultrasound (US) transducers or elements 222 (for transmitting or receiving).
  • a 3D position of the tool 206 with respect to an imaging plane is assessed using the ID array of transducers 222 in the probe 220.
  • the ultrasound element 208 (passive or active) is embedded in the tracked tool 206, for example, at its tip.
  • Ultrasound signal times-of-flight between the tracked element 208 and the multiple transducers 222 of the imaging probe 220 are used in a 3D triangulation or trilateration routine (104 in FIG. 1) to yield the position of the tracked element 208.
  • a 3D triangulation or trilateration routine (104 in FIG. 1) to yield the position of the tracked element 208.
  • a plurality of elements 208 may be employed on the tool 206. Each sensor's position may be tracked using the present principles to describe its position during a procedure.
  • Time-of-flight trilateration of ultrasound signals between the tracked element 208 and several transducers 222 of the imaging array can yield 3D positioning as long as the imaging array transducers 222 used are not collinear relative to the element 208.
  • the position of the tracked element 208 is at an intersection of at least three spheres 226, 228, 230 centered on the tracking transducers 222 (of the array) and with radii determined by a measured time of flight between the tracked element 208 and the tracking transducers 222.
  • intersection of three spheres 226, 228, 230 results in two points (e.g., true intersection 231 and a symmetric intersection 232) as long as the three spheres' centers are not collinear with respect to the tracked element 208 (the intersection of two spheres are a circle, the intersection of the last sphere with the circle yields two points).
  • Trilateration is employed to determine the position of the tracked element 208 and therefore the needle or tool 206. Trilateration is the process of determining absolute or relative locations of points by measurement of distances, using the geometry of spheres or triangles. In contrast to triangulation, it does not involve the measurement of angles although triangulation techniques may also be employed.
  • z is expressed as the positive or negative square root, it is possible for there to be zero, one or two solutions to the problem. This can be visualized as taking a circle 234 found from intersecting a first 226 and second sphere 230 and intersecting that with a third sphere 228. If that circle 234 falls entirely outside or inside of the sphere 228, z is equal to the square root of a negative number: no real solution exists. If that circle 234 touches the sphere 228 on exactly one point, z is equal to zero. If that circle 234 touches the surface of the sphere at two points, then z is equal to plus or minus the square root of a positive number (as depicted in FIG. 3).
  • the trilateration yields two positions (symmetric with respect to the imaged plane). This uncertainty can be broken using a priori knowledge, or by gently rocking the ultrasound probe 220 and observing the relative movement of the tracked element 208 (getting closer or farther relative to the target plane). Also, a single additional imaging sensor, transducer or element 236 (or transmitter) may also be employed on a side of the imaging array 222 to break the uncertainty (tie-breaker).
  • the present technique can detect the tracked elements 208 if the elements 208 are within a plane thickness 238, that is, near an imaging plane.
  • Customized probe design (with little elevation focusing to generate a compromise between image quality and tracking field- of-view) may be employed to extend the functionality of the system for specific applications.
  • a one-dimensional (ID) ultrasound (US) probe is employed for 2D visualization of needles or other tools, the position of the tool cannot be assessed for imaging when the tool lies outside of an US imaging plane 239.
  • Two-dimensional (2D) ultrasound probes may be employed for 2D visualization of needles with respect to a patient's anatomy in a wide range of clinical interventions.
  • clinicians spend a considerable amount of time orienting the needle fully inside the plane to visualize the needle. From oblique/orthogonal injections, the needle is very difficult to visualize.
  • the needle or tool can be located and imaged in three dimensions while also displaying the target area.
  • the needle is easy to find and its position accurately tracked for any type of procedure, such as, ultrasound-guided needle interventions, e.g., nerve blocks, biopsies, vascular access, abcess drainage, ablation, etc.
  • US-guided needle interventions are greatly facilitated, without the need for expensive additional equipment (matrix arrays). US-guided interventions become (i) more accurate; (ii) faster and (iii) inexpensive (by using 2D probes).
  • an illustrative two -dimensional ultrasonic image 242 is depicted showing a three-dimensional rendering of a needle 246 in accordance with one embodiment.
  • the needle 246 is shown within image boundaries 244, but can be tracked outside of these boundaries 244.
  • the rendering of needle 246 is generated using trilateration as described above.
  • the needle movement is tracked and displayed along with surrounding tissues in realtime.
  • the present principles permit fast and accurate imaging with a relatively inexpensive setup.
  • FIGS. 5A-5C will describe beamforming techniques. Beamforming can spatially shift the origin of spheres (for times of flight) from physical array elements to virtual array elements. By focusing several physical elements into one location in space (using appropriate time delays), the focus location becomes a virtual element.
  • a transducer array 302 includes physical elements 304, which transmit focused energy. Illustratively, beams intersect at focus locations 305, 306 and 307. These focus locations 305, 306 and 307 may be employed as sphere centers for performing time-of-fhght trilateration computations.
  • a tracking sensor 310 on a medical device acts as a receiver to receive the energy from the virtual elements (305, 306 and 307) to perform position estimation as described.
  • virtual elements may also be projected from behind a physical array 302.
  • beamforming may be employed to project a virtual element 312 which is on an opposite side of the array 302 from that of the sensor 310 attached to the medical device.
  • a device element 320 functions as a transmitter and virtual elements 322, 323 and 324 function as receivers.
  • the virtual elements 322, 323 and 324 correspond with physical elements 326 in a physical array 328.
  • the physical elements 326 receive signals transmitted from the device element 320.
  • the signal delays measured at the physical elements 326 are transformed to enable measurements from the perspective of the virtual elements 322, 323 and 324. In so doing, beamforming is employed to eliminate collinearity between physical elements 326.
  • a block/flow diagram shows a method for imaging a medical device in accordance with one illustrative embodiment.
  • a medical device is introduced into a subject.
  • the medical device includes at least one element for exchanging signals.
  • the medical device may include at least one of a needle, a catheter, a probe, a robot, a filter device, an electrode, etc.
  • signals are generated by an energy source and exchanged between the at least one element on the medical device and a plurality of transducers arranged in an array.
  • the array may be a one-dimensional array (with linear elements) or a curved or staggered array (two-dimensional).
  • times of flight of the signals between the transducers and the at least one element are determined. This may include measuring the time that a pulse or signal from the transducers is received at the at least one element (or vice versa).
  • a true intersection point is determined for spheres having radii defined by the times of flight.
  • the true intersection point is imaged over time along with the subject to track a position of the medical device.
  • the trilateration is employed to determine the true intersection point in block 412.
  • the array of transducers may be disposed in a one dimensional array along a line or curved surface.
  • the imaging may include imaging the medical devices in three-dimensions using trilateration of the at least one element relative to at least three transducers.
  • an additional element/transducer may be configured to distinguish between the true intersection point and a symmetric intersection point. This may include adding the transducer at a location where the true and symmetric intersections can be distinguished. Other techniques for distinguishing the intersection points may also be employed.
  • the time-of- flight spheres preferably have centers that are non-collinear relative to the at least one sensor.
  • beamforming may be employed for transmitted signals from one or more transmitters to provide a new origin for the transmitted signal and eliminate the collinearity.

Abstract

An imaging system and method include a medical device (102) having a tracking element (106) mounted thereon. An array(109)of transducers is spaced apart from one another for exchanging energy in a subject between tracking element and the array of transducers. A trilateration module(104) is configured to interpret signals sensed between tracking element and the array of transducers to compute times of flight of signals associated with the transducers in the array such that a position of tracking element is determined in at least two dimensions to locate a position of the medical device in a visual image.

Description

THREE-DIMENSIONAL NEEDLE LOCALIZATION WITH A TWO- DIMENSIONAL IMAGING PROBE
This disclosure relates to medical devices and procedures, and more particularly to systems and methods for medical device localization in three dimensions using one or two- dimensional imaging probes.
Needle insertion under ultrasound guidance is commonly performed, e.g., for biopsies, fluid drainage, nerve blocks, vascular access, etc. Needle visualization techniques have been successfully implemented based on steering imaging beams approximately perpendicular to the needle shaft (using, e.g., needle visualization enhancement software).
In a significant number of cases, the needle deviates from the imaging plane due to tissue heterogeneities and bevel asymmetry. An out-of-plane needle disappears no matter how smart needle visualization enhancement software is, because the needle receives no ultrasound energy at all. A clinician then has to move the imaging transducer to find the needle and usually loses an original target plane. Furthermore, the clinician does not know where the needle is in relation to the imaging plane and therefore has no indication of how to move the transducer to find the needle.
In accordance with the present principles, an imaging system and method include a medical device having a tracking element mounted thereon. An array of transducers has the transducers spaced apart from one another for exchanging energy in a subject between the tracking element and the array of transducers. A trilateration module is configured to interpret signals sensed between tracking element and the array of transducers to compute times of flight of signals associated with the transducers in the array such that a position of tracking element is determined in at least two dimensions to locate a position of the medical device in a visual image.
These and other objects, features and advantages of the present disclosure will become apparent from the following detailed description of illustrative embodiments thereof, which is to be read in connection with the accompanying drawings.
This disclosure will present in detail the following description of preferred
embodiments with reference to the following figures wherein:
FIG. 1 is a block/flow diagram showing a system/method for imaging a medical device in accordance with one illustrative embodiment;
FIG. 2A is a diagram showing a side-view of time-of-flight spheres emanating from transducer array elements of a probe in accordance with one illustrative embodiment;
FIG. 2B is a diagram showing a front-view of the time-of-flight spheres emanating from array elements of the probe and showing true and symmetric intersection points in accordance with one illustrative embodiment;
FIG. 3 is a perspective view showing three spheres intersecting to demonstrate trilateration in accordance with the present principles;
FIG. 4 is a two-dimensional ultrasound image having a three-dimensional rendering of a needle in accordance with the present principles;
FIG. 5 A is a schematic diagram showing elements of a physical array
focused/beamformed to form virtual transmitter elements in accordance with one embodiment;
FIG. 5B is a schematic diagram showing a virtual element formed behind a physical array in accordance with another embodiment;
FIG. 5C is a schematic diagram showing elements of a physical array beamformed to form virtual receiver elements based on signal delays in accordance with another embodiment; and FIG. 6 is a block/flow diagram showing a system/method for imaging a medical device in accordance with another illustrative embodiment.
In accordance with the present principles, a target plane, a relative position and trajectory of a medical device (e.g., with respect to a target anatomy of the target plane) need to be imaged at the same time to avoid issues related to losing an out-of-plane needle image during a procedure. One-dimensional (ID) ultrasound probes are used for two-dimensional (2D) visualization of needles with respect to the anatomy in a wide range of clinical interventions. However the position of the needle or tool cannot be assessed when the needle or tool lies outside of the imaging plane. The present systems and methods are provided for tracking and visualizing out-of-plane needles without losing the target anatomy image. In one embodiment, this is achieved using a simple one-dimensional (ID) probe (for 2D imaging) or using a two-dimensional (2D) probe for 3D imaging. Methods for assessing the 3D position of a needle with respect to the imaging plane using a ID array are also provided.
An ultrasound element (passive or active) is embedded in a tracked tool, e.g., at a tip of the tool. Ultrasound signal times-of-flight between the tracked element and multiple elements of the imaging probe are used in a three-dimensional (3D) triangulation or trilateration routine to yield the position of the tracked element. As a result, ultrasound- guided needle interventions are greatly facilitated, without the need for expensive additional equipment (e.g., matrix arrays).
It also should be understood that the present invention will be described in terms of medical instruments; however, the teachings of the present invention are much broader and are applicable to any instruments employed in tracking or analyzing complex biological or mechanical systems. In particular, the present principles are applicable to internal tracking procedures of biological systems, procedures in all areas of the body such as the lungs, gastro- intestinal tract, excretory organs, blood vessels, etc. The elements depicted in the FIGS, may be implemented in various combinations of hardware and software and provide functions which may be combined in a single element or multiple elements.
The functions of the various elements shown in the FIGS, can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term "processor" or "controller" should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor ("DSP") hardware, read-only memory ("ROM") for storing software, random access memory
("RAM"), non-volatile storage, etc.
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure). Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams and the like represent various processes which may be substantially represented in computer readable storage media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
Furthermore, embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk - read only memory (CD-ROM), compact disk - read/write (CD-R/W) and DVD.
Referring now to the drawings in which like numerals represent the same or similar elements and initially to FIG. 1, a system 100 for performing a medical procedure is illustratively depicted. System 100 may include a workstation or console 112 from which a procedure is supervised and managed. Procedures may include any procedure including but not limited to biopsies, ablations, injection of medications etc. Workstation 112 preferably includes one or more processors 114 and memory 116 for storing programs and applications. It should be understood that the function and components of system 100 may be integrated into one or more workstations or systems.
Memory 116 may store a device sensing module 115 configured to interpret electromagnetic, optical and/or acoustic feedback signals from a medical device 102. The sensing module 115 is configured to use the signal feedback (and any other feedback) to provide a location or to depict the medical device 102 in medical images. The medical device 102 may include, e.g., a needle, a catheter, a guide wire, an endoscope, a probe, a robot, an electrode, a filter device, a balloon device or other medical component, etc. Workstation 112 may include a display 118 for viewing internal images of a subject using an imaging system 110. The imaging system 110 may include imaging modalities such as ultrasound,
fluoroscopy, photoacoustics, etc. The imaging system 110 may also include, e.g., a magnetic resonance imaging (MRI) system, a fluoroscopy system, a computed tomography (CT) system, an ultrasound system or other system. Display 118 may also permit a user to interact with the workstation 112 and its components and functions. This is further facilitated by an interface 120 which may include a keyboard, mouse, a joystick or any other peripheral or control to permit user interaction with the workstation 112.
One or more sensors/transducers 106 may be incorporated into the device(s) 102, so tracking information from an energy source 125 can be detected at the device(s) 102.
It should be understood that while the present illustrative example will be described in terms of a tracked element 106 (on the device 102) being a receiver while tracking elements or transducers 107 (of an imaging array 109) are transmitters, the opposite configuration may also be provided. For example, the same times-of-flight may be measured by using the tracked element 106 (on the device 102) as a transmitter, and the tracking
elements/transducers 107 (of the array 109) may act as receivers.
The energy source 125 need not be provided from a source external to a body/subject 148, and may be from an internal source or from another imaging device 110. In one embodiment, the energy source is an ultrasonic source. The sensors/elements 106 may be employed to detect electromagnetic energy or acoustic energy (or transmit the energy). This permits the exchange of energy which will be used to interpret a position and/or orientation of the device 102. The signals will be employed as feedback to make adjustments or otherwise perform the medical procedure. The transducers 107 may include an ultrasonic sensor or sensors (disposed in a probe) or other sensor or transmission devices.
Imaging system 110 may be provided to collect real-time intra-operative imaging data. The imaging data may be displayed on display 1 18. Sensing module 115 may determine positions of the sensors/elements 106 and therefore the device 102 within the real-time images based upon energy measured by the sensors/elements 106. This may include employing a trilateration or triangulation method/module 104 as will be described herein. A digital rendering of the medical device 102 (using feedback signals) can be displayed to realize the position of the device 102 against the real-time images (tracking). The digital rendering may be generated by an image processing module 117.
It should be understood that tracking and imaging using an ultrasonic system may occur concurrently or sequentially. In preferred embodiments, an imaging array of transducers is the same as the tracking array of transducers. It is possible to use the imaging beams to track and vice versa (use the tracking beams to image). However, the tracking beams as described herein may not be suitable for ultrasound imaging. In such cases, imaging frames and tracking frames may be interleaved (alternated). If the tracked element is a transmitter, then either its bandwidth needs to be separate from that of the imaging pulses, or scanning may be interrupted during reception of the signals from the tracked element. Other techniques may also be employed to ensure both operations (e.g., tracking and imaging) are performed in real-time.
In one embodiment, the imaging system 110 includes an ultrasonic system, and the emissions are acoustic in nature. In this case, the sensor(s) 106 include ultrasonic sensors which detect acoustic signals generated by ultrasonic transducers 107 arranged in an array 109 on an ultrasonic probe 111. In this way, both anatomical images and device images can concurrently be displayed.
In another useful embodiment, an interventional application includes the use of two or more medical devices inside of a subject 148. For example, one device 102 may include a guide catheter, which is placed at one point, and another device 102 may include a needle for performing an ablation or biopsy at fixed/different points along the length of the catheter. Other combinations of devices are also contemplated.
In accordance with one particularly useful embodiment, one or several ultrasound sensors 106 are mounted on a tracked tool or device 102. The tool 102 is tracked using the sensor 106 for tracking the position of the device 102. A ID imaging array 109 is provided for imaging the tool 102 in accordance with the sensors 106. The array 109 may include a line of transducers (receivers or transmitters) 107 to form the ID dimensional array 109. The one dimensional array may include a straight arrangement (line) of transducers 107 or may include transducers 107 disposed on a curved path (arc).
In one embodiment, a physically planar array may be employed using beamforming techniques to spatially shift an origin of a time-of-flight sphere emanating from the physical array elements 107. By focusing several physical elements into one location in space (using appropriate time delays) the focus location becomes a virtual element.
The sensing module 115 includes a three-dimensional (3D) trilateration routine that tracks the ultrasound elements 106 aboard the tool 102. In one embodiment, the display 118 provides a 3D rendering of the tracked tool 102 superimposed on a 2D ultrasound image. The position of the tool 102 will be determined as illustratively described with reference to FIGS. 2A-2B.
Referring to FIGS. 2A and 2B, diagrams show a tracked tool 206 (e.g., a needle) having an element 208 (e.g., an ultrasonic element for transmitting or receiving) at its tip depicted in the vicinity of a curved array (2D probe or a ID array) ultrasonic probe 220 having a plurality of ultrasound (US) transducers or elements 222 (for transmitting or receiving). In accordance with the present principles, a 3D position of the tool 206 with respect to an imaging plane is assessed using the ID array of transducers 222 in the probe 220. The ultrasound element 208 (passive or active) is embedded in the tracked tool 206, for example, at its tip. Ultrasound signal times-of-flight between the tracked element 208 and the multiple transducers 222 of the imaging probe 220 are used in a 3D triangulation or trilateration routine (104 in FIG. 1) to yield the position of the tracked element 208. It should be understood that a plurality of elements 208 may be employed on the tool 206. Each sensor's position may be tracked using the present principles to describe its position during a procedure.
Time-of-flight trilateration of ultrasound signals between the tracked element 208 and several transducers 222 of the imaging array can yield 3D positioning as long as the imaging array transducers 222 used are not collinear relative to the element 208. The position of the tracked element 208 is at an intersection of at least three spheres 226, 228, 230 centered on the tracking transducers 222 (of the array) and with radii determined by a measured time of flight between the tracked element 208 and the tracking transducers 222. The intersection of three spheres 226, 228, 230 results in two points (e.g., true intersection 231 and a symmetric intersection 232) as long as the three spheres' centers are not collinear with respect to the tracked element 208 (the intersection of two spheres are a circle, the intersection of the last sphere with the circle yields two points).
Trilateration is employed to determine the position of the tracked element 208 and therefore the needle or tool 206. Trilateration is the process of determining absolute or relative locations of points by measurement of distances, using the geometry of spheres or triangles. In contrast to triangulation, it does not involve the measurement of angles although triangulation techniques may also be employed.
In two-dimensional space, using two reference points is normally sufficient to leave only two possibilities for the location determined, and the tie is broken by including a third reference point or other information. In three-dimensional space, using three reference points similarly leaves only two possibilities, and the tie is broken by including a fourth reference point or other information. Referring to FIG. 3, a solution is found by formulating equations for the three sphere surfaces 226, 228 and 230 and then solving the three equations for the three unknowns, x, y, and z. The equations for the three spheres may be expressed as: r2 = x2 + y2 + z2 r2 = (x - d)2 + y2 + z2
Figure imgf000012_0001
We need to find a point located at (x, y, z) that satisfies all three equations. First, we subtract the second equation from the first and solve for x:
2d
We assume that the first two spheres intersect in more than one point, that is that d-ri < r2 < d+ri. In this case, substituting the equation for x back into the equation for the first sphere produces the equation for a circle, the solution to the intersection of the first two spheres:
2 2 2 (ri2 - r2 +d2)
+ z = r2 -— 2
4dz
Substituting y2 + z2 = r2 - x2 into the formula for the third sphere and solving for y results in the following:
2 , r ·\2 . ·2 • 2
+ (χ - ι) + J r3 + i + j • 2
V V
Now that the x- and ^-coordinates of the solution point are obtained, the formula for the first sphere can be rearranged to find the z-coordinate:
Figure imgf000012_0002
Now we have the solution for x, y and z. Because z is expressed as the positive or negative square root, it is possible for there to be zero, one or two solutions to the problem. This can be visualized as taking a circle 234 found from intersecting a first 226 and second sphere 230 and intersecting that with a third sphere 228. If that circle 234 falls entirely outside or inside of the sphere 228, z is equal to the square root of a negative number: no real solution exists. If that circle 234 touches the sphere 228 on exactly one point, z is equal to zero. If that circle 234 touches the surface of the sphere at two points, then z is equal to plus or minus the square root of a positive number (as depicted in FIG. 3).
Referring again to FIGS. 2A and 2B, it is now possible to map the 3D position of the tracked element 208 with a ID curvilinear imaging array (222). With a linear array where elements are collinear, transmit or receive focusing can generate virtual transducers in the array that would no longer be aligned, so that the technique is also applicable to linear arrays with some beamforming. Beamforming in effect moves an origin of a sphere by moving the origin of a transmitted signal to a new location.
There may be uncertainty since the trilateration yields two positions (symmetric with respect to the imaged plane). This uncertainty can be broken using a priori knowledge, or by gently rocking the ultrasound probe 220 and observing the relative movement of the tracked element 208 (getting closer or farther relative to the target plane). Also, a single additional imaging sensor, transducer or element 236 (or transmitter) may also be employed on a side of the imaging array 222 to break the uncertainty (tie-breaker).
The present technique can detect the tracked elements 208 if the elements 208 are within a plane thickness 238, that is, near an imaging plane. Customized probe design (with little elevation focusing to generate a compromise between image quality and tracking field- of-view) may be employed to extend the functionality of the system for specific applications.
In conventional systems, if a one-dimensional (ID) ultrasound (US) probe is employed for 2D visualization of needles or other tools, the position of the tool cannot be assessed for imaging when the tool lies outside of an US imaging plane 239. Two-dimensional (2D) ultrasound probes (ID curved arrays) may be employed for 2D visualization of needles with respect to a patient's anatomy in a wide range of clinical interventions. In conventional systems, clinicians spend a considerable amount of time orienting the needle fully inside the plane to visualize the needle. From oblique/orthogonal injections, the needle is very difficult to visualize. However, in accordance with the present principles, the needle or tool can be located and imaged in three dimensions while also displaying the target area. In this way, the needle is easy to find and its position accurately tracked for any type of procedure, such as, ultrasound-guided needle interventions, e.g., nerve blocks, biopsies, vascular access, abcess drainage, ablation, etc. US-guided needle interventions are greatly facilitated, without the need for expensive additional equipment (matrix arrays). US-guided interventions become (i) more accurate; (ii) faster and (iii) inexpensive (by using 2D probes).
Referring to FIG. 4, an illustrative two -dimensional ultrasonic image 242 is depicted showing a three-dimensional rendering of a needle 246 in accordance with one embodiment. The needle 246 is shown within image boundaries 244, but can be tracked outside of these boundaries 244. The rendering of needle 246 is generated using trilateration as described above. The needle movement is tracked and displayed along with surrounding tissues in realtime. The present principles permit fast and accurate imaging with a relatively inexpensive setup.
FIGS. 5A-5C will describe beamforming techniques. Beamforming can spatially shift the origin of spheres (for times of flight) from physical array elements to virtual array elements. By focusing several physical elements into one location in space (using appropriate time delays), the focus location becomes a virtual element.
Referring to FIG. 5A, a transducer array 302 includes physical elements 304, which transmit focused energy. Illustratively, beams intersect at focus locations 305, 306 and 307. These focus locations 305, 306 and 307 may be employed as sphere centers for performing time-of-fhght trilateration computations. The focus locations 305, 306 and 307
advantageously provide non-collinear virtual elements which can enable the use of a planar one-dimensional transducer array configuration 302. In this configuration, a tracking sensor 310 on a medical device acts as a receiver to receive the energy from the virtual elements (305, 306 and 307) to perform position estimation as described.
Referring to FIG. 5B, virtual elements may also be projected from behind a physical array 302. For example, beamforming may be employed to project a virtual element 312 which is on an opposite side of the array 302 from that of the sensor 310 attached to the medical device.
Referring to FIG. 5C, in this embodiment, a device element 320 functions as a transmitter and virtual elements 322, 323 and 324 function as receivers. The virtual elements 322, 323 and 324 correspond with physical elements 326 in a physical array 328. The physical elements 326 receive signals transmitted from the device element 320. The signal delays measured at the physical elements 326 are transformed to enable measurements from the perspective of the virtual elements 322, 323 and 324. In so doing, beamforming is employed to eliminate collinearity between physical elements 326.
Referring to FIG. 6, a block/flow diagram shows a method for imaging a medical device in accordance with one illustrative embodiment. In block 402, a medical device is introduced into a subject. The medical device includes at least one element for exchanging signals. The medical device may include at least one of a needle, a catheter, a probe, a robot, a filter device, an electrode, etc.
In block 404, signals are generated by an energy source and exchanged between the at least one element on the medical device and a plurality of transducers arranged in an array. The array may be a one-dimensional array (with linear elements) or a curved or staggered array (two-dimensional). In block 406, times of flight of the signals between the transducers and the at least one element are determined. This may include measuring the time that a pulse or signal from the transducers is received at the at least one element (or vice versa).
In block 408, a true intersection point is determined for spheres having radii defined by the times of flight. In block 410, the true intersection point is imaged over time along with the subject to track a position of the medical device. The trilateration is employed to determine the true intersection point in block 412. In block 414, the array of transducers may be disposed in a one dimensional array along a line or curved surface. The imaging may include imaging the medical devices in three-dimensions using trilateration of the at least one element relative to at least three transducers.
In block 416, an additional element/transducer may be configured to distinguish between the true intersection point and a symmetric intersection point. This may include adding the transducer at a location where the true and symmetric intersections can be distinguished. Other techniques for distinguishing the intersection points may also be employed.
In block 418, the time-of- flight spheres preferably have centers that are non-collinear relative to the at least one sensor. However, in the event that the spheres are collinear, beamforming may be employed for transmitted signals from one or more transmitters to provide a new origin for the transmitted signal and eliminate the collinearity.
In interpreting the appended claims, it should be understood that:
a) the word "comprising" does not exclude the presence of other elements or acts than those listed in a given claim;
b) the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements;
c) any reference signs in the claims do not limit their scope; d) several "means" may be represented by the same item or hardware or software implemented structure or function; and
e) no specific sequence of acts is intended to be required unless specifically indicated.
Having described preferred embodiments for systems and methods for three- dimensional needle localization with a two-dimensional imaging probe (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the disclosure disclosed which are within the scope of the embodiments disclosed herein as outlined by the appended claims. Having thus described the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.

Claims

CLAIMS:
1. An imaging system, comprising:
a medical device (102) having at least one tracking element (106) mounted thereon; an array (109) of transducers spaced apart from one another for exchanging energy in a subject between the at least one tracking element and the array of transducers; and
a trilateration module (104) configured to interpret signals sensed between the at least one tracking element and the array of transducers to compute times of flight of signals associated with the transducers in the array such that a position of the at least one tracking element is determined in at least two dimensions to locate a position of the medical device in a visual image.
2. The system as recited in claim 1, wherein the medical device (102) includes at least one of a needle, a catheter, a probe and an electrode.
3. The system as recited in claim 1, wherein the array (109) of transducers are disposed in a one dimensional array along one of a line and an arc.
4. The system as recited in claim 1, wherein the array (109) of transducers includes ultrasonic transducers and the at least one element includes an ultrasonic transducer element.
5. The system as recited in claim 1 , wherein the trilateration module ( 104) determines the position of the at least one element by finding a true intersection point between spheres (226, 228, 230) having radii defined by times of flight from the transducers.
6. The system as recited in claim 5, wherein the spheres (226, 228, 230) have centers that are non-collinear relative to the at least one element.
7. The system as recited in claim 1 , further comprising an additional transducer (236) element configured to provide information to distinguish between a true intersection point and a symmetric intersection point.
8. The system as recited in claim 1, wherein the at least two dimensions include three dimensions such that a three-dimensional image of the medical device is tracked in a two-dimensional image.
9. The system as recited in claim 1, wherein the array (109) of transducers includes virtual elements beamformed to prevent collinear origins for the times of flight of signals.
10. A workstation, comprising:
an imaging probe (111) having an array (109) of transducers spaced apart from one another for exchanging energy with a tracked medical device (102) in a subject;
a processor (114); and
memory (1 16) coupled to the processor, the memory including a trilateration module (104) configured to receive signals and, in conjunction with the processor, compute times of flight of signals for the transducers in the array relative to at least one tracking element on the tracked medical device such that a position of the at least one tracking element is determined in at least two dimensions such that an image of the medical device and the subject are concurrently provided in a visual image.
11. The workstation as recited in claim 10, wherein the medical device (102) includes at least one of a needle, a catheter, a probe and an electrode.
12. The workstation as recited in claim 10, wherein the array (109) of transducers are disposed in a one dimensional array along a line or an arc.
13. The workstation as recited in claim 10, wherein the array (109) of transducers includes ultrasonic transducers and the at least one element (106) includes an ultrasonic transducer element.
14. The workstation as recited in claim 10, wherein the trilateration module (104) determines the position of the at least one element by finding a true intersection point between spheres (226, 228, 230) having radii defined by times of flight from the transducers.
15. The workstation as recited in claim 14, wherein the spheres (226, 228, 230) have centers that are non-collinear relative to the at least one element.
16. The workstation as recited in claim 10, further comprising an additional transducer (236) configured to provide information to distinguish between a true intersection point and a symmetric intersection point.
17. The workstation as recited in claim 10, wherein the at least two dimensions include three dimensions such that a three-dimensional image of the medical device is tracked in a two-dimensional image.
18. The workstation as recited in claim 10, wherein the array (109) of transducers includes virtual elements beamformed to prevent collinear origins for the times of flight of signals.
19. A method for imaging a medical device, comprising:
introducing (402) a medical device into a subject, the medical device including at least one element for exchanging energy;
exchanging (404) signals from a plurality of transducers arranged in an array with the at least one element;
determining (406) times of flight of the signals between the transducers and the at least one element;
determining (408) a true intersection point for spheres having radii defined by the times of flight; and
imaging (410) the true intersection point with the subject to track a position of the medical device.
20. The method as recited in claim 19, wherein the medical device includes at least one of a needle, a catheter, a probe and an electrode.
21. The method as recited in claim 19, wherein the array of transducers are disposed in a one dimensional array and the step of imaging includes imaging (414) the medical device in three-dimensions using trilateration of the at least one element relative to at least three transducers.
22. The method as recited in claim 19, wherein the trilateration is employed to determine the true intersection point.
23. The method as recited in claim 22, wherein the spheres have centers that are non-collinear relative to the at least one element.
24. The method as recited in claim 19, further comprising providing (416) an additional transducer configured to distinguish between the true intersection point and a symmetric intersection point.
25. The method as recited in claim 19, further comprising beamforming (418) a transmitted signal from one or more transmitters to provide a new origin for
transmitted/received signals.
PCT/IB2012/052830 2011-06-13 2012-06-06 Three-dimensional needle localization with a two-dimensional imaging probe WO2012172458A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201280039408.9A CN103747729B (en) 2011-06-13 2012-06-06 Utilize the three dimensional needle location that two-dimensional imaging is popped one's head in
EP12729236.5A EP2717772B1 (en) 2011-06-13 2012-06-06 Three-dimensional needle localization with a two-dimensional imaging probe
US14/118,244 US11147532B2 (en) 2011-06-13 2012-06-06 Three-dimensional needle localization with a two-dimensional imaging probe
JP2014515313A JP6053766B2 (en) 2011-06-13 2012-06-06 3D needle localization using a 2D imaging probe

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161496077P 2011-06-13 2011-06-13
US61/496,077 2011-06-13

Publications (1)

Publication Number Publication Date
WO2012172458A1 true WO2012172458A1 (en) 2012-12-20

Family

ID=46331655

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/052830 WO2012172458A1 (en) 2011-06-13 2012-06-06 Three-dimensional needle localization with a two-dimensional imaging probe

Country Status (5)

Country Link
US (1) US11147532B2 (en)
EP (1) EP2717772B1 (en)
JP (1) JP6053766B2 (en)
CN (1) CN103747729B (en)
WO (1) WO2012172458A1 (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014174305A2 (en) * 2013-04-26 2014-10-30 Ucl Business Plc A method and apparatus for determining the location of a medical instrument with respect to ultrasound imaging, and a medical instrument to facilitate such determination
WO2015003895A1 (en) * 2013-07-08 2015-01-15 Koninklijke Philips N.V. Imaging apparatus for biopsy or brachytherapy
WO2015010900A1 (en) * 2013-07-23 2015-01-29 Koninklijke Philips N.V. Method and system for localizing body structures
WO2015044831A1 (en) * 2013-09-24 2015-04-02 Koninklijke Philips N.V. Acoustic 3d tracking of interventional tool
WO2015155632A1 (en) * 2014-04-11 2015-10-15 Koninklijke Philips N.V. Needle with multiple sensors
WO2016103094A1 (en) * 2014-12-24 2016-06-30 Koninklijke Philips N.V. Needle trajectory prediction for target biopsy
CN105873521A (en) * 2014-01-02 2016-08-17 皇家飞利浦有限公司 Instrument alignment and tracking with ultrasound imaging plane
EP2967496A4 (en) * 2013-03-15 2017-02-15 Conavi Medical Inc. Active localization and visualization of minimally invasive devices using ultrasound
WO2017108490A1 (en) * 2015-12-22 2017-06-29 Koninklijke Philips N.V. Ultrasound based tracking
WO2017182278A1 (en) * 2016-04-19 2017-10-26 Koninklijke Philips N.V. Acoustic registration of internal and external ultrasound probes
WO2018087111A1 (en) * 2016-11-08 2018-05-17 Koninklijke Philips N.V. System and method for tracking an interventional instrument with feedback concerning tracking reliability
WO2018234230A1 (en) * 2017-06-19 2018-12-27 Koninklijke Philips N.V. Interleaved imaging and tracking sequences for ultrasound-based instrument tracking
WO2019096599A1 (en) 2017-11-14 2019-05-23 Koninklijke Philips N.V. Ultrasound vascular navigation devices and methods
WO2020052842A1 (en) * 2018-09-12 2020-03-19 B. Braun Melsungen Ag Method for determining the position of a medical invasive component and medical system for carrying out such a method
WO2020135945A1 (en) * 2018-11-14 2020-07-02 Robeaute System and method for real-time localization
US11228469B1 (en) * 2020-07-16 2022-01-18 Deeyook Location Technologies Ltd. Apparatus, system and method for providing locationing multipath mitigation

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2770344B1 (en) * 2013-02-21 2015-09-09 Sercel Method and device for estimating a relative position between towed acoustic linear antennas
EP2964292A4 (en) * 2013-03-05 2016-08-24 Ronny Kafiluddi Compound needle
JP6014643B2 (en) * 2014-10-15 2016-10-25 株式会社日立製作所 Ultrasonic diagnostic equipment
CN107106124B (en) * 2014-11-18 2021-01-08 C·R·巴德公司 Ultrasound imaging system with automatic image rendering
US10905396B2 (en) * 2014-11-18 2021-02-02 C. R. Bard, Inc. Ultrasound imaging system having automatic image presentation
JP6986966B2 (en) * 2014-11-25 2021-12-22 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Multi-sensor ultrasonic probe
JP6668817B2 (en) * 2016-02-26 2020-03-18 コニカミノルタ株式会社 Ultrasound diagnostic apparatus and control program
EP3518770A1 (en) * 2016-09-30 2019-08-07 Koninklijke Philips N.V. Tracking a feature of an interventional device
US11747456B2 (en) 2017-03-10 2023-09-05 Koninklijke Philips N.V. Location device and system for locating an ultrasound acoustic sensor
EP3755229A1 (en) * 2018-02-22 2020-12-30 Koninklijke Philips N.V. Interventional medical device tracking
EP3787520A1 (en) * 2018-05-04 2021-03-10 Hologic, Inc. Biopsy needle visualization
JP2021527487A (en) * 2018-06-22 2021-10-14 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Intravascular ultrasound position identification
EP3813676B1 (en) * 2018-06-29 2023-11-08 Koninklijke Philips N.V. Biopsy prediction and guidance with ultrasound imaging and associated devices, systems, and methods
JP7168474B2 (en) * 2019-01-31 2022-11-09 富士フイルムヘルスケア株式会社 ULTRASOUND IMAGING DEVICE, TREATMENT ASSISTANCE SYSTEM, AND IMAGE PROCESSING METHOD
CN114746021A (en) * 2019-12-04 2022-07-12 捷锐士阿希迈公司(以奥林巴斯美国外科技术名义) Surgical guiding probe
KR20230118873A (en) * 2020-12-11 2023-08-14 로보테 Micro device tracking and visualization system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1245191A2 (en) * 2001-03-28 2002-10-02 Philips Corporate Intellectual Property GmbH Method and imaging ultrasonic system for determination of the position of a catheter
US6592520B1 (en) * 2001-07-31 2003-07-15 Koninklijke Philips Electronics N.V. Intravascular ultrasound imaging apparatus and method
WO2010004564A2 (en) * 2008-07-11 2010-01-14 Barnev Ltd. A method and a system for monitoring, contractions and/or a birth process and/or the progress and/or position of a fetus

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6246898B1 (en) * 1995-03-28 2001-06-12 Sonometrics Corporation Method for carrying out a medical procedure using a three-dimensional tracking and imaging system
US6216540B1 (en) * 1995-06-06 2001-04-17 Robert S. Nelson High resolution device and method for imaging concealed objects within an obscuring medium
US5830145A (en) 1996-09-20 1998-11-03 Cardiovascular Imaging Systems, Inc. Enhanced accuracy of three-dimensional intraluminal ultrasound (ILUS) image reconstruction
JPH10277040A (en) 1997-04-09 1998-10-20 Hitachi Medical Corp Ultrasonic diagnostic device
GB2329709B (en) 1997-09-26 2001-12-19 Roke Manor Research Catheter localisation system
GB2331365B (en) * 1997-11-15 2002-03-13 Roke Manor Research Catheter tracking system
US6120453A (en) * 1997-11-17 2000-09-19 Sharp; William A. Three-dimensional ultrasound system based on the coordination of multiple ultrasonic transducers
JP2003101861A (en) 2001-09-21 2003-04-04 Sanyo Electric Co Ltd Digital camera
US6896657B2 (en) 2003-05-23 2005-05-24 Scimed Life Systems, Inc. Method and system for registering ultrasound image in three-dimensional coordinate system
US7207942B2 (en) * 2003-07-25 2007-04-24 Siemens Medical Solutions Usa, Inc. Adaptive grating lobe suppression in ultrasound imaging
US20050062469A1 (en) * 2003-09-23 2005-03-24 Anderson Peter Traneus System and method for hemisphere disambiguation in electromagnetic tracking systems
US7713210B2 (en) * 2004-11-23 2010-05-11 St. Jude Medical, Atrial Fibrillation Division, Inc. Method and apparatus for localizing an ultrasound catheter
US20070233185A1 (en) * 2005-10-20 2007-10-04 Thomas Anderson Systems and methods for sealing a vascular opening
US20070167823A1 (en) 2005-12-20 2007-07-19 General Electric Company Imaging catheter and method for volumetric ultrasound
US20070161905A1 (en) 2006-01-12 2007-07-12 Gynesonics, Inc. Intrauterine ultrasound and method for use
US8317712B2 (en) 2006-05-12 2012-11-27 Koninklijke Philips Electronics N.V. Eindhoven Retrospective dynamic transmit focusing for spatial compounding
US7621169B2 (en) * 2006-10-26 2009-11-24 General Electric Company Systems and methods for integrating a navigation field replaceable unit into a fluoroscopy system
WO2009032421A2 (en) 2007-07-27 2009-03-12 Meridian Cardiovascular Systems, Inc. Image guided intracardiac catheters
US20100210943A1 (en) * 2009-02-18 2010-08-19 West Virginia University Research Corporation Systems and Methods for Echoperiodontal Imaging
JP4776707B2 (en) * 2009-03-30 2011-09-21 株式会社東芝 Ultrasonic imaging device
JP5665040B2 (en) 2009-09-10 2015-02-04 学校法人上智学院 Displacement measuring method and apparatus, and ultrasonic diagnostic apparatus
CN102869308B (en) * 2010-05-03 2015-04-29 皇家飞利浦电子股份有限公司 Apparatus and method for ultrasonic tracking of ultrasound transducer(s) aboard an interventional tool
WO2012024201A1 (en) * 2010-08-19 2012-02-23 Mayo Foundation For Medical Education And Research Steerable catheter navigation with the use of interference ultrasonography
WO2012066430A1 (en) * 2010-11-18 2012-05-24 Koninklijke Philips Electronics N.V. Medical device with ultrasound transducers embedded in flexible foil
US10617374B2 (en) * 2011-01-28 2020-04-14 Medtronic Navigation, Inc. Method and apparatus for image-based navigation
WO2013116809A1 (en) * 2012-02-03 2013-08-08 Los Alamos National Security, Llc Ultrasound waveform tomography with tv regularization
EP2964086A4 (en) * 2013-03-09 2017-02-15 Kona Medical, Inc. Transducers, systems, and manufacturing techniques for focused ultrasound therapies
EP2967496B1 (en) * 2013-03-15 2020-04-29 Conavi Medical Inc. Active localization and visualization of minimally invasive devices using ultrasound

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1245191A2 (en) * 2001-03-28 2002-10-02 Philips Corporate Intellectual Property GmbH Method and imaging ultrasonic system for determination of the position of a catheter
US6592520B1 (en) * 2001-07-31 2003-07-15 Koninklijke Philips Electronics N.V. Intravascular ultrasound imaging apparatus and method
WO2010004564A2 (en) * 2008-07-11 2010-01-14 Barnev Ltd. A method and a system for monitoring, contractions and/or a birth process and/or the progress and/or position of a fetus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JAY MUNG ET AL: "Time of flight and FMCW catheter localization", ULTRASONICS SYMPOSIUM (IUS), 2009 IEEE INTERNATIONAL, IEEE, PISCATAWAY, NJ, USA, 20 September 2009 (2009-09-20), pages 590 - 593, XP031654703, ISBN: 978-1-4244-4389-5 *

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2967496A4 (en) * 2013-03-15 2017-02-15 Conavi Medical Inc. Active localization and visualization of minimally invasive devices using ultrasound
WO2014174305A2 (en) * 2013-04-26 2014-10-30 Ucl Business Plc A method and apparatus for determining the location of a medical instrument with respect to ultrasound imaging, and a medical instrument to facilitate such determination
WO2014174305A3 (en) * 2013-04-26 2014-12-18 Ucl Business Plc A method and apparatus for determining the location of a medical instrument with respect to ultrasound imaging, and a medical instrument to facilitate such determination
US10363015B2 (en) 2013-04-26 2019-07-30 Ucl Business Plc Method and apparatus for determining the location of a medical instrument with respect to ultrasound imaging, and a medical instrument to facilitate such determination
WO2015003895A1 (en) * 2013-07-08 2015-01-15 Koninklijke Philips N.V. Imaging apparatus for biopsy or brachytherapy
CN105358066A (en) * 2013-07-08 2016-02-24 皇家飞利浦有限公司 Imaging apparatus for biopsy or brachytherapy
WO2015010900A1 (en) * 2013-07-23 2015-01-29 Koninklijke Philips N.V. Method and system for localizing body structures
WO2015044831A1 (en) * 2013-09-24 2015-04-02 Koninklijke Philips N.V. Acoustic 3d tracking of interventional tool
CN105578984A (en) * 2013-09-24 2016-05-11 皇家飞利浦有限公司 Acoustic 3d tracking of interventional tool
US10660710B2 (en) 2013-09-24 2020-05-26 Koninklijke Philips N.V. Acoustic 3D tracking of interventional tool
CN105873521A (en) * 2014-01-02 2016-08-17 皇家飞利浦有限公司 Instrument alignment and tracking with ultrasound imaging plane
JP2017500955A (en) * 2014-01-02 2017-01-12 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Alignment and tracking of ultrasound imaging plane and instrument
US11872076B2 (en) 2014-01-02 2024-01-16 Koninklijke Philips N.V. Instrument alignment and tracking with ultrasound imaging plane
US11096656B2 (en) 2014-01-02 2021-08-24 Koninklijke Philips N.V. Instrument alignment and tracking with ultrasound imaging plane
JP2019134958A (en) * 2014-01-02 2019-08-15 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Instrument alignment and tracking with ultrasound imaging plane
EP3508134A1 (en) * 2014-01-02 2019-07-10 Koninklijke Philips N.V. Instrument alignment and tracking with ultrasound imaging plane
WO2015155632A1 (en) * 2014-04-11 2015-10-15 Koninklijke Philips N.V. Needle with multiple sensors
WO2016103094A1 (en) * 2014-12-24 2016-06-30 Koninklijke Philips N.V. Needle trajectory prediction for target biopsy
US11413011B2 (en) 2015-12-22 2022-08-16 Koninklijke Philips N.V. Ultrasound based tracking
WO2017108490A1 (en) * 2015-12-22 2017-06-29 Koninklijke Philips N.V. Ultrasound based tracking
US11633171B2 (en) 2015-12-22 2023-04-25 Koninklijke Philips N.V. Ultrasound based tracking system using triangulation and spatial positioning with detachable reference frame and ultrasound emitters
WO2017182278A1 (en) * 2016-04-19 2017-10-26 Koninklijke Philips N.V. Acoustic registration of internal and external ultrasound probes
CN109073751A (en) * 2016-04-19 2018-12-21 皇家飞利浦有限公司 The acoustics of inside and outside ultrasonic probe is registrated
CN109073751B (en) * 2016-04-19 2023-10-13 皇家飞利浦有限公司 Probe, system and method for acoustic registration
WO2018087111A1 (en) * 2016-11-08 2018-05-17 Koninklijke Philips N.V. System and method for tracking an interventional instrument with feedback concerning tracking reliability
US11642097B2 (en) 2017-06-19 2023-05-09 Koninklijke Philips N.V. Interleaved imaging and tracking sequences for ultrasound-based instrument tracking
WO2018234230A1 (en) * 2017-06-19 2018-12-27 Koninklijke Philips N.V. Interleaved imaging and tracking sequences for ultrasound-based instrument tracking
WO2019096599A1 (en) 2017-11-14 2019-05-23 Koninklijke Philips N.V. Ultrasound vascular navigation devices and methods
WO2020052842A1 (en) * 2018-09-12 2020-03-19 B. Braun Melsungen Ag Method for determining the position of a medical invasive component and medical system for carrying out such a method
WO2020135945A1 (en) * 2018-11-14 2020-07-02 Robeaute System and method for real-time localization
US11228469B1 (en) * 2020-07-16 2022-01-18 Deeyook Location Technologies Ltd. Apparatus, system and method for providing locationing multipath mitigation
US20220021566A1 (en) * 2020-07-16 2022-01-20 Deeyook Location Technologies Ltd. Apparatus, system and method for providing locationing multipath mitigation

Also Published As

Publication number Publication date
US20140094695A1 (en) 2014-04-03
JP2014516738A (en) 2014-07-17
EP2717772B1 (en) 2021-05-26
US11147532B2 (en) 2021-10-19
JP6053766B2 (en) 2016-12-27
CN103747729A (en) 2014-04-23
CN103747729B (en) 2016-07-13
EP2717772A1 (en) 2014-04-16

Similar Documents

Publication Publication Date Title
US11147532B2 (en) Three-dimensional needle localization with a two-dimensional imaging probe
US11786318B2 (en) Intelligent real-time tool and anatomy visualization in 3D imaging workflows for interventional procedures
US20220273258A1 (en) Path tracking in ultrasound system for device tracking
EP3394634B1 (en) Ultrasound based tracking
US10405827B2 (en) Medical treatment system
JP2017511728A (en) Image registration and guidance using simultaneous X-plane imaging
CN105578984B (en) Acoustic 3D tracking of interventional tools
US20190298457A1 (en) System and method for tracking an interventional instrument with feedback concerning tracking reliability
WO2015044901A1 (en) Image guidance system with user definable regions of interest
WO2017200515A1 (en) 3-d us volume from 2-d images from freehand rotation and/or translation of ultrasound probe
US20220241024A1 (en) Ultrasound object point tracking
EP4013310B1 (en) Ultrasound-based device localization
Najafi et al. A closed-form differential formulation for ultrasound spatial calibration
TW202322766A (en) Ultrasonic imaging system including an ultrasonic probe, a first characteristic pattern, a second characteristic pattern, a storage unit, an image capture unit, a display unit, and a processing unit

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12729236

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 14118244

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2014515313

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE