US20170215971A1 - System and method for 3-d tracking of surgical instrument in relation to patient body - Google Patents
System and method for 3-d tracking of surgical instrument in relation to patient body Download PDFInfo
- Publication number
- US20170215971A1 US20170215971A1 US15/486,965 US201715486965A US2017215971A1 US 20170215971 A1 US20170215971 A1 US 20170215971A1 US 201715486965 A US201715486965 A US 201715486965A US 2017215971 A1 US2017215971 A1 US 2017215971A1
- Authority
- US
- United States
- Prior art keywords
- surgical instrument
- patient body
- emf
- orientation
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/361—Image-producing devices, e.g. surgical cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2051—Electromagnetic tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/363—Use of fiducial points
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/368—Correlation of different images or relation of image positions in respect to the body changing the image on a display according to the operator's position
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/371—Surgical systems with images on a monitor during operation with simultaneous use of two cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/372—Details of monitor hardware
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3983—Reference marker arrangements for use with image guided surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/10—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis
Definitions
- the present invention relates to a system and method for wirelessly tracking an instrument and, more specifically, to a system and method for wirelessly tracking a three-dimensional position and orientation of a surgical instrument in relationship to the body of a patient being operated upon.
- a primary goal of minimally invasive surgical procedures is to minimize the adverse effects of the procedure on the patient. This reduces post-surgical trauma and pain and minimizes recovery time.
- Some minimally invasive procedures require the surgeon to create one or more small incisions through which various surgical instruments can be passed.
- Other minimally invasive procedures forego the need to make even small incisions in the patient, instead relying on surgical instruments such as, for example, flexible endoscopes that can enter the body through a natural bodily orifice.
- FIGS. 1 and 2 depict a traditional flexible endoscope 20 which can be utilized by a surgeon to remotely view and manipulate tissue within the body of a patient.
- a traditional flexible endoscope 20 generally comprises a control body 22 that connects to an insertion tube 24 .
- the control body 22 remains outside the patient, while the flexible insertion tube 24 is inserted into the interior of the patient via either a naturally occurring or man-made orifice.
- the insertion tube 24 can include, for example, various channels for performing suction, biopsy, irrigation and insufflation.
- the insertion tube 24 may also include fiber optics or light bundles for conveying light from an external light source to the interior of the patient, as well as conveying images from the interior to an exterior camera.
- a connector 32 allows the endoscope 20 to connect to one or more various related system components, including, for example, a power supply, a light source, a camera and/or video processor.
- Endoscope 20 may also include additional control means 30 for controlling one or more functions of the endoscope, such as, for example, a manipulator or other tissue processing means that extends out from the distal tip section 26 of the endoscope 20 .
- the insertion tube 24 is inserted into an orifice of the patient and then slowly advanced into the interior of the patient.
- One or more controls 28 typically located on the body 22 of the endoscope 20 allows for the surgeon to manipulate or bend the distal tip section 26 of the flexible endoscope as he or she advances the insertion tube 24 through the patient. In this manner, the surgeon can steer the tip 26 of the endoscope as it is advanced through the interior of the patient's body.
- a surgeon can utilize a flexible endoscope 20 to view and manipulate the tissue of a patient's upper gastrointestinal tract by inserting the distal tip section 26 of the endoscope 20 into the mouth 44 of the patient 42 . The surgeon then advances the insertion tube 24 down the patient's esophagus 46 until the tip region 26 of the endoscope 20 is in the region of tissue that he or she wishes to examine, i.e., the stomach 48 or duodenum 50 .
- a problem that exists in most applications involving a flexible endoscope is that the area of tissue or target anatomy that the surgeon wishes to examine and manipulate is often an area that is not in the immediate proximity of the natural orifice used to gain access to the interior of the patient's body. As such, the surgeon is often required to navigate the surgical instrument, such as the flexible endoscope, to the target anatomy and operate on portions of the anatomy that are neither directly visible nor readily visible without some degree of difficulty.
- surgical instruments such as flexible endoscopes do allow for a surgeon to remotely view and manipulate tissue, they are limited in their capabilities and difficult to master. For instance, endoscopes typically have limited field of view. In addition, they display anatomical data in two dimensions.
- the level of difficulty involved in navigating to a target tissue increases significantly as the distance between the target tissue and the orifice used to gain entry to the interior of the patient increases.
- a system and method for tracking the three-dimensional position and orientation of a surgical instrument including a stereoscopic camera system which generates a stereoscopic image of the patient body, which image is subsequently rendered on a display device.
- a wireless signal transmitted by an electromagnetic field generator is received by a sensor on the surgical instrument.
- a processor calculates the position and orientation of the surgical instrument and then superimposes upon the rendered stereoscopic image of the patient body a graphical representation indicative of the position and orientation of the surgical instrument.
- the position and orientation of a surgical instrument is wirelessly determined.
- a projector such as a low-powered laser, then projects a pattern of light upon the patient body that visually indicates the position and/or orientation of the surgical instrument in real-time as the instrument is being utilized within the interior of the patient body.
- FIG. 1 illustrates a traditional flexible endoscope.
- FIG. 2 illustrates the use of a flexible endoscope to examine and/or manipulate the tissue of a patient's upper gastrointestinal tract.
- FIG. 3 illustrates a system for tracking the 3-D position and orientation of a surgical instrument according to one embodiment of the present invention.
- FIG. 4 is an illustrative example of perspective projection.
- FIG. 5 illustrates a flow chart of the steps involved in tracking the 3-D position and orientation of a surgical instrument according to one embodiment of the present invention.
- FIG. 6 is an illustrative example of a time-parallel stereoscopic image.
- FIGS. 7A-7C are illustrative examples of the type of information rendered upon a display by the present invention according to various alternative embodiments.
- FIG. 8 illustrates a system for tracking the 3-D position and orientation of a surgical instrument according to a further embodiment of the present invention.
- FIG. 9 illustrates a system for tracking the 3-D position and orientation of a surgical instrument according to an additional embodiment of the present invention.
- FIG. 10 is a chart depicting the flow and processing of data in the system illustrated in FIG. 9 .
- FIG. 11 illustrates a system for tracking the 3-D position and orientation of a surgical instrument utilizing multiple transmitters in accordance with an additional embodiment of the present invention.
- FIG. 3 depicts a system 100 , according to a first embodiment, for tracking the three-dimensional position and orientation of a surgical instrument in relation to the body 102 of a patient lying on a surgical table 101 .
- An electromagnetic field (EMF) generator 104 communicates with a central controller 120 by means of a hard-wire connection 105 .
- the EMF generator 104 could be configured to communicate wirelessly with the central controller 120 by means of one or more proprietary or standardized wireless communication protocols, such as, for example, various infrared communication protocols, Bluetooth wireless protocol, and 802.11 a/b/g protocols, to name a few.
- the EMF generator 104 can be positioned at various locations within the operating room around the patient.
- the EMF generator 104 can be incorporated with or mounted upon the surgical table 101 so as to be located at the head, middle or foot section of the surgical table 101 .
- the EMF generator could be incorporated with or mounted upon other components near the surgical table 101 within the operating room, such as, for example, an overhead boom or independent stand.
- the EMF generator 104 should be maintained in a fixed position relative to the patient once the system 100 is in use.
- a stereoscopic camera system 106 for generating a stereoscopic image of the body of the patient.
- the stereoscopic camera 106 operates on the principle of stereopsis, wherein two images of a scene are generated from different perspectives, the two images representing independent left eye and right eye views of the scene. The two images are then displayed such that the left eye sees only the left eye view and the right eye sees only the right eye view.
- the slightly different perspectives of the images that the human eyes see are re-created, resulting in an overall image of the scene which appears three-dimensional.
- a stereoscopic image is generated according to a process known as perspective projection.
- the perspective projection process involves calculating what a three-dimensional scene would look like from the point of view of an arbitrary location, such as, for example, the location of a camera, in 3-D space.
- Perspective refers to the fact that more distant objects end up looking smaller, and the fact that parallel lines in the three-dimensional world may not end up looking parallel in a two-dimensional perspective projection.
- FIG. 4 depicts how an object 160 is viewed from a single point 170 in three-dimensional space.
- the visual rays of light reflecting off of, or projecting from, the object 160 converge at the point 170 .
- the representation of the transparent plane 190 can be considered the view that would be seen by a single eye (i.e., the left eye) at a known point in space.
- the image is formed on the transparent plane 190 by the intersecting points of the projecting lines 195 from the point 170 (i.e., the eye) to the object 160 .
- Acquiring a second view from a different point in space i.e., the right eye
- the human mind subsequently interprets corresponding first and second images from different perspectives as a three-dimensional view of a scene.
- camera 106 incorporates or has attached thereto an EMF sensor 108 that is capable of detecting the wireless electromagnetic signal being transmitted by the EMF generator 104 .
- Camera 106 and associated sensor 104 communicate with the central controller 120 via an associated wire connection 110 .
- camera 106 and associated EMF sensor 108 could be configured to communicate wirelessly with the central controller 120 , much like the EMF generator 104 as previously discussed.
- a display means or device 140 capable of depicting to the surgeon the stereoscopic image or images of the patient body 102 taken by the camera system 106 .
- the display means 140 can render multiple two-dimensional images of the patient body 102 which, when taken as a whole, allow for the identification of a three-dimensional point in space with respect to the patient body 102 .
- the display means 140 operates according to the time-parallel method, displaying both left and right views simultaneously, such as, for example, by a split screen or dual screen system.
- the surgeon wears polarizing or filtering glasses to ensure that the appropriate view is seen by the correct eye.
- the surgeon can be accommodated with a head mounted display that is configured to project the left and right images to the surgeon's left and right eyes, respectively.
- the head mounted display achieves its projection pattern by incorporating separate left and right displays for the left and right eyes, respectively.
- the display means 140 operates according to the time-multiplexed method, where the same display alternates between depicting a left view of a scene and a corresponding right view of the scene.
- the display means 140 can comprise one or more digital displays such as LCD screens or the like.
- the display means 140 could comprise one or more projectors or any other means for visualizing an image, ranging from simple display technology to more complicated digital display devices such as a “heads-up” display or head mounted display previously discussed.
- Also included in the system 100 are one or more surgical instruments 112 for visualizing and/or manipulating the tissue of a patient.
- At least one EMF sensor 114 that is capable of detecting the wireless electromagnetic signal being transmitted by the EMF generator 104 .
- the instrument 112 and associated EMF sensor 114 communicate with the central controller 120 via an associated wire connection 116 .
- each instrument 112 and associated EMF sensor 114 could be configured to communicate wirelessly with the central controller 120 , much like the EMF generator 104 as previously discussed.
- the surgical instrument 112 will reference the surgical instrument 112 as being a flexible endoscope.
- the present invention is not limited to such an application, but could be used in conjunction with various surgical instruments, including but not limited to a catheter, a guide wire, a pointer probe, a stent, a seed, an implant, or an endoscope (including a rigid endoscope, semi-rigid endoscope, or flexible endoscope).
- the stereoscopic camera system 106 begins capturing either still or video images of the patient body from two slightly different (i.e., left and right) perspectives (see step 210 ). Specifically, the camera 106 captures left and right images of the patient body 102 and converts them into electrical signals representing either still or video images (see step 212 ) and forwards the signals to the central controller 120 . The central controller 120 subsequently processes the two signals, representing the left and right images of the patient body 102 , respectively, and generates one or more stereoscopic images of the patient body 102 that can be displayed on the display means 140 (see step 214 ).
- FIG. 6 is an illustrative example of how the stereoscopic image may appear on the display means 140 .
- the display means 140 operates according to the time-parallel method, simultaneously displaying both a left image 250 and right image 252 of the patient body 102 , the two images 250 , 252 representing different views of the patient body 102 taken from slightly different perspectives.
- the EMF generator 104 begins transmitting either a continuous or repeated predetermined wireless signal (see step 216 ) that travels throughout the area surrounding the surgical table 101 .
- the EMF sensor 108 associated with the camera 106 receives the wireless signal and converts it to an electrical signal that can be subsequently conveyed to the central controller 120 via connection 110 (see steps 218 and 220 ).
- the central controller 120 then processes the camera sensor signal upon its receipt using a predefined algorithm that determines the relative position and orientation of the camera EMF sensor 108 with respect to the known position and orientation of the EMF generator 104 .
- the central controller 120 can determine the relative position and orientation of camera 106 with respect to the EMF generator 104 since the camera EMF sensor 108 is incorporated within or mounted upon the camera 106 in a fixed and known relationship (see step 222 ). With the above knowledge, the central controller 120 can render on display means 140 a stereoscopic image of the patient body having a known position and orientation with respect to the EMF generator 104 (see step 224 ).
- the flexible endoscope 112 begins to be utilized by the surgeon.
- the EMF sensor 114 located within or upon the tip section of the endoscope 112 also receives the wireless signal being transmitted by the EMF generator 104 . Similar to the camera, the endoscope EMF sensor 114 converts the received wireless signal into an electrical signal that is subsequently forwarded on to the central controller 120 via communication link 116 (see steps 226 and 228 ).
- the central controller 120 then processes the electrical signal from endoscope EMF sensor 114 using a predefined algorithm in order to determine the relative position and orientation of the endoscope sensor 114 , and thus the relative position and orientation of the tip section of the endoscope 112 itself, relative to the EMF generator 104 (see step 230 ).
- the processing of the sensor signals by the central controller 120 occurs on a near-continuous basis, thereby allowing the central controller 120 to determine the relative position and orientation of both the camera 106 (and thus the patient body 102 ) and the endoscope EMF sensor 114 at essentially any point in real-time. This is especially important with respect to the endoscope EMF sensor 114 , whose position and orientation would presumably be changing frequently as the instrument is utilized by the surgeon. In contrast, the camera 106 and patient body 102 are presumably fixed in position and orientation during the surgical procedure, although this is not a requirement for the current system to function properly.
- the central controller 120 subsequently compares the relative position and orientation of the endoscope EMF sensor 114 to the relative position and orientation of the patient body 102 (see step 232 ).
- the central controller 120 then superimposes a graphical representation of endoscope 112 (see step 234 ) upon the stereoscopic image of the patient body rendered on display means 140 .
- this graphical representation of endoscope 112 is updated in near real-time so as to accurately reflect the actual position and orientation of the tip section of endoscope 112 with respect to the patient body 102 .
- the surgeon is thus able to quickly determine the position and orientation of the tip section of the flexible endoscope 112 relative to the patient body by simply glancing at the display means 140 and noting the relative position and orientation of the endoscope tip on the rendered stereoscopic image of the patient body.
- FIGS. 7A-7C illustrate various examples of a display means 300 depicting a stereoscopic image of a patient body.
- FIGS. 7A-7C do not depict more conventional stereoscopic images such as that illustrated in FIG. 6 .
- FIGS. 7A-7C can be similarly applied to more conventional stereoscopic images such as that depicted in the illustrative example of FIG. 6 .
- the location of the endoscope EMF sensor 114 is graphically depicted simply as a dot 330 on the display means 300 .
- a surgeon can glance at the display means 300 and quickly determine the actual 3-D position (but not orientation in the immediate example) of the endoscope EMF sensor, and thus the 3-D position of the tip section of the endoscope, relative to the patient body even though the surgeon may otherwise not be able to visualize the actual tip of the endoscope.
- the endoscope EMF sensor 114 is graphically rendered on display means 300 as a line, arrow or pointer 332 .
- the surgeon can quickly glance at the display means 300 and determine the actual 3-D position and orientation of the tip section of the endoscope within the patient body.
- the endoscope EMF sensor 114 is again graphically rendered on the display means 300 as a line, arrow or pointer 332 .
- trailing the pointer 332 is a dotted line 334 which, according to a first sub-embodiment, represents the path that sensor 114 previously traveled before arriving at its current location indicated by pointer 332 .
- the central controller simply configures the display means 300 to depict prior locations of the endoscope EMF sensor 114 using a different graphical depiction (e.g., dashed or colored line) than that used to indicate a current position of sensor 114 (e.g., arrow or pointer).
- dotted line 334 represents the actual position of at least a portion of the insertion tube that follows the tip section of the flexible endoscope.
- the endoscope incorporates or has mounted thereto a plurality of EMF sensors along at least a portion of the length of the endoscope's insertion tube, with the central controller tracking the position and orientation of each individual EMF sensor.
- graphical representations of different shapes and sizes can be utilized on the display means to indicate the position and orientation of one or more portions of a surgical instrument such as an endoscope.
- a simple graphical representation such as an arrow or pointer, can be utilized to readily depict the position and orientation of at least a tip section of an instrument.
- the system can be configured to generate a graphical depiction of a surgical instrument that actually resembles that specific instrument being monitored by the system.
- the central controller could be configured to visually depict the instrument on the display means as a rigid endoscope.
- the system could be configured to display a graphical likeness of the implant on the display means used by the surgeon to monitor the actual position and orientation of the implant.
- an actual surgical instrument being tracked by the system would be represented on the display means by a corresponding graphical object programmed in by a user.
- a plurality of different size and shape graphical objects, corresponding to different surgical instruments can be preprogrammed into the central controller. A user then simply selects the preprogrammed graphical object that most closely resembles the surgical instrument that is to be tracked by the system.
- the central controller automatically selects a preprogrammed graphical object that most closely resembles the actual surgical instrument to be tracked based upon an identification code or other data encoded in some form of memory associated with the instrument.
- the central controller upon connecting a semi-rigid endoscope to the system, the central controller would query a memory of the endoscope, such as by optically scanning a barcode on the endoscope, or reading data from an associated wireless RFID tag or hard-wired memory chip associated with the endoscope.
- the central controller Upon retrieval of certain identification data for that specific endoscope, the central controller would search either a local or remote database and determine the most appropriate graphical object to use to represent that specific endoscope on the display means.
- FIG. 8 illustrates a further embodiment of the present invention. Similar to FIG. 3 , the system 400 illustrated in FIG. 8 includes a stereoscopic camera 406 and associated EMF sensor 408 , a central controller 420 , display means 440 , and one or more surgical instruments 412 , such as a flexible endoscope, that includes one or more EMF sensors 414 incorporated therein. However, instead of a smaller, more point-source-like EMF generator as previously disclosed, the present embodiment utilizes a larger, flat EMF generator 404 that can be mounted upon, underneath or within the surgical table 401 , and which transmits an electromagnetic wireless signal that more effectively overcomes electromagnetic interference caused by the ferrous metal components sometimes found in surgical tables.
- a surgical instrument position and orientation tracking system 500 comprises at least three subsystems.
- a tracking subsystem 510 operates to provide real-time position data indicative of the position and orientation of one or more surgical instruments being tracked by the system 500 .
- a stereoscopic camera system 512 includes at least one surgical instrument 514 for remotely viewing and manipulating tissue, at least one EMF sensor 516 incorporated into or attached to the surgical instrument, at least one EMF sensor 518 incorporated into or attached to the stereoscopic camera system, an EMF generator 520 for transmitting a wireless tracking signal, and an electromagnetic tracking controller 522 to coordinate and control the EMF generator and various EMF sensors.
- system 500 Also included in system 500 is a data processor subsystem 540 . Included in subsystem 540 are an interface component 542 for the stereoscopic camera system, which is capable of capturing and providing real-time intra-operative 2-D scans of the patient body. Also included is a model generation component 544 for generating graphical models used to indicate the position and orientation of the surgical instrument being tracked. Lastly included is a projection transform component 546 for computing a perspective projection of a given 3-D point to a point on a given plane.
- an interface component 542 for the stereoscopic camera system, which is capable of capturing and providing real-time intra-operative 2-D scans of the patient body.
- model generation component 544 for generating graphical models used to indicate the position and orientation of the surgical instrument being tracked.
- projection transform component 546 for computing a perspective projection of a given 3-D point to a point on a given plane.
- System 500 also includes a user interface subsystem 560 which operates to provide audio and visual output to the surgeon as well as accept user input. Included in subsystem 560 are a display device 564 capable of rendering video signal data acquired by one or more surgical instruments, such as an endoscope, as well as the stereoscopic camera system.
- a merge component 562 operates to mix the graphical model representing the surgical instrument with the stereoscopic images of the patient body generated by the stereoscopic camera system 512 , thereby producing a video signal capable of being rendered by the display device.
- FIG. 10 The general operation of the surgical instrument position and orientation tracking system 500 is illustrated in the diagram of FIG. 10 .
- Right and left camera feeds 610 A and 610 B are generated by the stereoscopic camera system 512 and provided to the camera interface component 542 , which generates 2-D scans of the patient body.
- These right and left 2-D scans are subsequently provided to the merge component 562 to generate one or more stereoscopic images of the patient body.
- one or more camera location sensor scans 612 A and 612 B allow the system to determine the location of the cameras relative to the EMF generator 520 , and thus be able to represent each 2-D camera scan as an image plane equation having a known relative position.
- instrument location sensor scans 614 provide real-time positional and orientation information for the surgical instrument 514 relative to the EMF generator 520 .
- This instrument location sensor scan data 614 is first provided to the model generation component 544 , which generates a model or graphical representation of the surgical instrument that can subsequently be rendered on the display device 564 .
- the instrument location sensor data 614 and associated instrument graphical model data 544 are then provided to the projection transform component 546 .
- the instrument location data is related to the camera location data based on their common frame of reference (that being their position relative to the EMF generator 520 ). All of this data is then relayed to the merge component 562 , which superimposes the graphical model of the surgical instrument being tracked with the dual 2-D camera scans and generates a video signal representing a stereoscopic image of the patient body superimposed with a graphical representation indicative of the relative position and orientation of the surgical instrument. The subsequent video signal generated by the merge component 562 is then relayed to the display device 564 where it can be viewed by the surgeon.
- real-time tracking of a surgical instrument's 3-D position and orientation is accomplished by means of a stereoscopic camera system utilized in combination with an electromagnetic field (EMF) generator and associated EMF sensors.
- EMF electromagnetic field
- the EMF generator transmits a wireless signal that travels throughout an area of space surrounding the surgical table.
- An EMF sensor detects the magnetic field associated with the wireless signal and generates a corresponding signal that gets forwarded to a central controller and processed by one or more predefined algorithms to determine the exact 3-D position and orientation of the EMF sensor relative to the EMF generator that is the source of the magnetic field.
- AMR anisotropic magneto-resistive
- Examples of an appropriate EMF generator and AMR sensor that can be utilized in the above embodiments include the multi-axis transmitter and associated 1.3 and 1.8 mm microBIRDTM sensors manufactured by Ascension Technology Corporation and discussed in greater detail in U.S. Pat. No. 6,754,596, the disclosure of which is herein incorporated by reference.
- the present invention can be configured to operate using other wireless tracking technology.
- FIG. 11 illustrates another system for tracking the position of a surgical instrument during a medical procedure.
- the tracking system 700 includes a stereoscopic camera system 706 for acquiring stereoscopic images of the patient body 702 .
- the current system 700 also includes a central controller 730 and a display means 740 .
- system 700 does not utilize a single EMF generator for creating a magnetic field that can be detected by a plurality of EMF sensors associated with the surgical instrument and camera system.
- system 700 incorporates a minimum of three wireless transmitters 720 A, 720 B and 720 C distributed at three known, static locations in space around the surgical table.
- the surgical instrument 712 that is to be tracked incorporates, or has mounted thereupon, a sensor 714 capable of simultaneously receiving each of the wireless signals originating from the three transmitters 720 .
- each of the wireless transmitters 720 A- 720 C generate their own time-encoded wireless signal.
- the surgical instrument 712 As the surgical instrument 712 is used, its sensor 714 receives all three wireless signals and forwards them over connection 716 to central controller 730 .
- central controller 730 can determine for any point in time the distance that exists between the instrument sensor 714 and each of the three wireless transmitters 720 A- 720 C. By then utilizing computational methods such as 3-D trilateration or triangulation, the central controller 730 can determine the specific 3-D position and orientation of instrument sensor 714 , and thus the position and orientation of surgical instrument 712 itself. The same process is repeated for the endoscopic camera system 706 utilizing camera sensor 708 . Consequently, the 3-D position of both the camera sensor 708 and instrument sensor 714 are determined relative to the same frame of reference (that being the three wireless transmitters 720 ).
- system 700 operates in the same manner as the previously described embodiments, with the system 700 rendering upon display means 740 one or more stereoscopic images of the patient body 702 that are superimposed with some form of graphical representation of surgical instrument 712 that indicates the position and orientation of the instrument relative to the patient body.
- an instrument tracking system does not generate a stereoscopic image of the patient body on a display, nor superimpose some form of graphical object corresponding to the surgical tool upon the display.
- the controller initiates the projection of some form of light beam (i.e., low power laser) directly upon the patient body.
- some form of light beam i.e., low power laser
- the immediate embodiment projects an instrument image or other graphical representation of the surgical instrument upon the actual patient body.
- a tracking system would include, among other things, an EMF generator, one or more EMF sensors associated with a surgical instrument, means for projecting a light beam upon the patient body, and one or more EMF sensors associated with the projector so that the system could determine the three-dimensional location of the projector relative to the EMF generator.
- one or more of the systems as described above are modified to include two or more stereoscopic camera systems positioned at different locations around the patient body.
- the modified system is able to generate multiple stereoscopic views, with each view representing the patient body from a different perspective.
- the stereoscopic camera or cameras were positioned around the patient body at presumably fixed locations.
- one or more of the stereoscopic cameras in the system are not in a fixed position, but instead are mobile.
- the camera is movably mounted such that it can be repositioned during the surgical procedure in order to obtain a stereoscopic view of the patient body from a different perspective.
- the camera is portable and can be carried by or mounted upon a member of the surgical staff.
- the camera could be configured to be worn by the surgeon as eyewear or headwear, resulting in the camera tracking the movement of the surgeon. Consequently, the camera will capture and generate a stereoscopic image of the area of the patient body currently being looked at by the surgeon.
- the advantage of such a system is that it allows the surgeon to obtain stereoscopic images of the patient body from numerous perspectives.
- the system includes a stereoscopic camera that is mounted upon or worn by the surgeon, such as, for example, as eyewear or headwear.
- the camera includes zooming capabilities that can automatically adjust based on the distance between the camera and the patient body.
- the camera could be configured to automatically zoom in and out by a predetermined or calculated amount in response to the surgeon getting closer or farther away from the patient body.
- the system can be configured to automatically adjust the scale of the displayed stereoscopic image, including the depiction of the patient body and graphical object representing the surgical instrument, in response to the zoom level of the camera.
Abstract
Description
- This is a divisional of prior U.S. application Ser. No. 11/388 756, filed Mar. 24, 2006.
- The present invention relates to a system and method for wirelessly tracking an instrument and, more specifically, to a system and method for wirelessly tracking a three-dimensional position and orientation of a surgical instrument in relationship to the body of a patient being operated upon.
- A primary goal of minimally invasive surgical procedures is to minimize the adverse effects of the procedure on the patient. This reduces post-surgical trauma and pain and minimizes recovery time. Some minimally invasive procedures require the surgeon to create one or more small incisions through which various surgical instruments can be passed. Other minimally invasive procedures forego the need to make even small incisions in the patient, instead relying on surgical instruments such as, for example, flexible endoscopes that can enter the body through a natural bodily orifice.
-
FIGS. 1 and 2 depict a traditionalflexible endoscope 20 which can be utilized by a surgeon to remotely view and manipulate tissue within the body of a patient. As illustrated inFIG. 1 , a traditionalflexible endoscope 20 generally comprises acontrol body 22 that connects to aninsertion tube 24. Thecontrol body 22 remains outside the patient, while theflexible insertion tube 24 is inserted into the interior of the patient via either a naturally occurring or man-made orifice. Depending on the intended function of a specific flexible endoscope, theinsertion tube 24 can include, for example, various channels for performing suction, biopsy, irrigation and insufflation. Theinsertion tube 24 may also include fiber optics or light bundles for conveying light from an external light source to the interior of the patient, as well as conveying images from the interior to an exterior camera. Aconnector 32 allows theendoscope 20 to connect to one or more various related system components, including, for example, a power supply, a light source, a camera and/or video processor.Endoscope 20 may also include additional control means 30 for controlling one or more functions of the endoscope, such as, for example, a manipulator or other tissue processing means that extends out from thedistal tip section 26 of theendoscope 20. - In practice, the
insertion tube 24 is inserted into an orifice of the patient and then slowly advanced into the interior of the patient. One ormore controls 28 typically located on thebody 22 of theendoscope 20 allows for the surgeon to manipulate or bend thedistal tip section 26 of the flexible endoscope as he or she advances theinsertion tube 24 through the patient. In this manner, the surgeon can steer thetip 26 of the endoscope as it is advanced through the interior of the patient's body. - Thus, as illustrated in the example of
FIG. 2 , a surgeon can utilize aflexible endoscope 20 to view and manipulate the tissue of a patient's upper gastrointestinal tract by inserting thedistal tip section 26 of theendoscope 20 into themouth 44 of thepatient 42. The surgeon then advances theinsertion tube 24 down the patient'sesophagus 46 until thetip region 26 of theendoscope 20 is in the region of tissue that he or she wishes to examine, i.e., thestomach 48 orduodenum 50. - However, a problem that exists in most applications involving a flexible endoscope is that the area of tissue or target anatomy that the surgeon wishes to examine and manipulate is often an area that is not in the immediate proximity of the natural orifice used to gain access to the interior of the patient's body. As such, the surgeon is often required to navigate the surgical instrument, such as the flexible endoscope, to the target anatomy and operate on portions of the anatomy that are neither directly visible nor readily visible without some degree of difficulty. Furthermore, even though surgical instruments such as flexible endoscopes do allow for a surgeon to remotely view and manipulate tissue, they are limited in their capabilities and difficult to master. For instance, endoscopes typically have limited field of view. In addition, they display anatomical data in two dimensions. As a result, even an experienced surgeon can find it difficult to navigate to a specified area of tissue and localize a specific target region, such as an organ or lesion. Moreover, the level of difficulty involved in navigating to a target tissue increases significantly as the distance between the target tissue and the orifice used to gain entry to the interior of the patient increases.
- A system and method for tracking the three-dimensional position and orientation of a surgical instrument, as the instrument is being utilized within the interior of a patient body, including a stereoscopic camera system which generates a stereoscopic image of the patient body, which image is subsequently rendered on a display device. A wireless signal transmitted by an electromagnetic field generator is received by a sensor on the surgical instrument. Utilizing this sensor data, a processor calculates the position and orientation of the surgical instrument and then superimposes upon the rendered stereoscopic image of the patient body a graphical representation indicative of the position and orientation of the surgical instrument.
- According to another embodiment, the position and orientation of a surgical instrument is wirelessly determined. A projector, such as a low-powered laser, then projects a pattern of light upon the patient body that visually indicates the position and/or orientation of the surgical instrument in real-time as the instrument is being utilized within the interior of the patient body.
- One or more embodiments of the present invention are illustrated by way of example and should not be construed as being limited to the specific embodiments depicted in the accompanying drawings, in which like references indicate similar elements and in which:
-
FIG. 1 illustrates a traditional flexible endoscope. -
FIG. 2 illustrates the use of a flexible endoscope to examine and/or manipulate the tissue of a patient's upper gastrointestinal tract. -
FIG. 3 illustrates a system for tracking the 3-D position and orientation of a surgical instrument according to one embodiment of the present invention. -
FIG. 4 is an illustrative example of perspective projection. -
FIG. 5 illustrates a flow chart of the steps involved in tracking the 3-D position and orientation of a surgical instrument according to one embodiment of the present invention. -
FIG. 6 is an illustrative example of a time-parallel stereoscopic image. -
FIGS. 7A-7C are illustrative examples of the type of information rendered upon a display by the present invention according to various alternative embodiments. -
FIG. 8 illustrates a system for tracking the 3-D position and orientation of a surgical instrument according to a further embodiment of the present invention. -
FIG. 9 illustrates a system for tracking the 3-D position and orientation of a surgical instrument according to an additional embodiment of the present invention. -
FIG. 10 is a chart depicting the flow and processing of data in the system illustrated inFIG. 9 . -
FIG. 11 illustrates a system for tracking the 3-D position and orientation of a surgical instrument utilizing multiple transmitters in accordance with an additional embodiment of the present invention. -
FIG. 3 depicts asystem 100, according to a first embodiment, for tracking the three-dimensional position and orientation of a surgical instrument in relation to thebody 102 of a patient lying on a surgical table 101. - An electromagnetic field (EMF)
generator 104 communicates with acentral controller 120 by means of a hard-wire connection 105. Alternatively, the EMFgenerator 104 could be configured to communicate wirelessly with thecentral controller 120 by means of one or more proprietary or standardized wireless communication protocols, such as, for example, various infrared communication protocols, Bluetooth wireless protocol, and 802.11 a/b/g protocols, to name a few. TheEMF generator 104 can be positioned at various locations within the operating room around the patient. For example, theEMF generator 104 can be incorporated with or mounted upon the surgical table 101 so as to be located at the head, middle or foot section of the surgical table 101. Alternatively, the EMF generator could be incorporated with or mounted upon other components near the surgical table 101 within the operating room, such as, for example, an overhead boom or independent stand. However, regardless of location, theEMF generator 104 should be maintained in a fixed position relative to the patient once thesystem 100 is in use. - Also included in the
system 100 is astereoscopic camera system 106 for generating a stereoscopic image of the body of the patient. Thestereoscopic camera 106 operates on the principle of stereopsis, wherein two images of a scene are generated from different perspectives, the two images representing independent left eye and right eye views of the scene. The two images are then displayed such that the left eye sees only the left eye view and the right eye sees only the right eye view. The slightly different perspectives of the images that the human eyes see are re-created, resulting in an overall image of the scene which appears three-dimensional. - More specifically, a stereoscopic image is generated according to a process known as perspective projection. The perspective projection process involves calculating what a three-dimensional scene would look like from the point of view of an arbitrary location, such as, for example, the location of a camera, in 3-D space. Perspective refers to the fact that more distant objects end up looking smaller, and the fact that parallel lines in the three-dimensional world may not end up looking parallel in a two-dimensional perspective projection.
- An illustrative example of perspective projection is provided by
FIG. 4 , which depicts how anobject 160 is viewed from asingle point 170 in three-dimensional space. The visual rays of light reflecting off of, or projecting from, theobject 160 converge at thepoint 170. The representation of thetransparent plane 190 can be considered the view that would be seen by a single eye (i.e., the left eye) at a known point in space. The image is formed on thetransparent plane 190 by the intersecting points of the projectinglines 195 from the point 170 (i.e., the eye) to theobject 160. Acquiring a second view from a different point in space (i.e., the right eye) would result in a second transparent plane and associated image (not illustrated). The human mind subsequently interprets corresponding first and second images from different perspectives as a three-dimensional view of a scene. - In the current example,
camera 106 incorporates or has attached thereto anEMF sensor 108 that is capable of detecting the wireless electromagnetic signal being transmitted by theEMF generator 104.Camera 106 and associatedsensor 104 communicate with thecentral controller 120 via an associatedwire connection 110. Alternatively,camera 106 and associatedEMF sensor 108 could be configured to communicate wirelessly with thecentral controller 120, much like theEMF generator 104 as previously discussed. - Also connecting to the
central controller 120 via either an associatedwire connection 139 or wirelessly is a display means ordevice 140 capable of depicting to the surgeon the stereoscopic image or images of thepatient body 102 taken by thecamera system 106. The display means 140 can render multiple two-dimensional images of thepatient body 102 which, when taken as a whole, allow for the identification of a three-dimensional point in space with respect to thepatient body 102. - Two different methods exist for displaying the two views making up a stereoscopic image, including a time-parallel method and a time-multiplexed method. In one embodiment, the display means 140 operates according to the time-parallel method, displaying both left and right views simultaneously, such as, for example, by a split screen or dual screen system. According to this method, the surgeon wears polarizing or filtering glasses to ensure that the appropriate view is seen by the correct eye. Alternatively, the surgeon can be accommodated with a head mounted display that is configured to project the left and right images to the surgeon's left and right eyes, respectively. According to one example, the head mounted display achieves its projection pattern by incorporating separate left and right displays for the left and right eyes, respectively.
- In an alternative embodiment, the display means 140 operates according to the time-multiplexed method, where the same display alternates between depicting a left view of a scene and a corresponding right view of the scene.
- Regardless of operating method, the display means 140 can comprise one or more digital displays such as LCD screens or the like. Alternatively, the display means 140 could comprise one or more projectors or any other means for visualizing an image, ranging from simple display technology to more complicated digital display devices such as a “heads-up” display or head mounted display previously discussed.
- Also included in the
system 100 are one or moresurgical instruments 112 for visualizing and/or manipulating the tissue of a patient. Incorporated within or mounted upon at least a distal tip of thesurgical instrument 112 is at least oneEMF sensor 114 that is capable of detecting the wireless electromagnetic signal being transmitted by theEMF generator 104. Theinstrument 112 and associatedEMF sensor 114 communicate with thecentral controller 120 via an associatedwire connection 116. Alternatively, eachinstrument 112 and associatedEMF sensor 114 could be configured to communicate wirelessly with thecentral controller 120, much like theEMF generator 104 as previously discussed. - For purposes of example, the remainder of the discussion will reference the
surgical instrument 112 as being a flexible endoscope. However, the present invention is not limited to such an application, but could be used in conjunction with various surgical instruments, including but not limited to a catheter, a guide wire, a pointer probe, a stent, a seed, an implant, or an endoscope (including a rigid endoscope, semi-rigid endoscope, or flexible endoscope). - The basic operation of
system 100, as described above, will now be discussed with reference toFIG. 5 . After thepatient body 102 has been positioned on the surgical table 101, thestereoscopic camera system 106 begins capturing either still or video images of the patient body from two slightly different (i.e., left and right) perspectives (see step 210). Specifically, thecamera 106 captures left and right images of thepatient body 102 and converts them into electrical signals representing either still or video images (see step 212) and forwards the signals to thecentral controller 120. Thecentral controller 120 subsequently processes the two signals, representing the left and right images of thepatient body 102, respectively, and generates one or more stereoscopic images of thepatient body 102 that can be displayed on the display means 140 (see step 214). -
FIG. 6 is an illustrative example of how the stereoscopic image may appear on the display means 140. According to this example, the display means 140 operates according to the time-parallel method, simultaneously displaying both aleft image 250 andright image 252 of thepatient body 102, the twoimages patient body 102 taken from slightly different perspectives. - While the right and left views of the
patient body 102 are being generated, theEMF generator 104 begins transmitting either a continuous or repeated predetermined wireless signal (see step 216) that travels throughout the area surrounding the surgical table 101. TheEMF sensor 108 associated with thecamera 106 receives the wireless signal and converts it to an electrical signal that can be subsequently conveyed to thecentral controller 120 via connection 110 (seesteps 218 and 220). Thecentral controller 120 then processes the camera sensor signal upon its receipt using a predefined algorithm that determines the relative position and orientation of thecamera EMF sensor 108 with respect to the known position and orientation of theEMF generator 104. This in turn allows for thecentral controller 120 to determine the relative position and orientation ofcamera 106 with respect to theEMF generator 104 since thecamera EMF sensor 108 is incorporated within or mounted upon thecamera 106 in a fixed and known relationship (see step 222). With the above knowledge, thecentral controller 120 can render on display means 140 a stereoscopic image of the patient body having a known position and orientation with respect to the EMF generator 104 (see step 224). - While the above is occurring, the
flexible endoscope 112 begins to be utilized by the surgeon. TheEMF sensor 114 located within or upon the tip section of theendoscope 112 also receives the wireless signal being transmitted by theEMF generator 104. Similar to the camera, theendoscope EMF sensor 114 converts the received wireless signal into an electrical signal that is subsequently forwarded on to thecentral controller 120 via communication link 116 (seesteps 226 and 228). - The
central controller 120 then processes the electrical signal fromendoscope EMF sensor 114 using a predefined algorithm in order to determine the relative position and orientation of theendoscope sensor 114, and thus the relative position and orientation of the tip section of theendoscope 112 itself, relative to the EMF generator 104 (see step 230). - It should be noted that the processing of the sensor signals by the
central controller 120 occurs on a near-continuous basis, thereby allowing thecentral controller 120 to determine the relative position and orientation of both the camera 106 (and thus the patient body 102) and theendoscope EMF sensor 114 at essentially any point in real-time. This is especially important with respect to theendoscope EMF sensor 114, whose position and orientation would presumably be changing frequently as the instrument is utilized by the surgeon. In contrast, thecamera 106 andpatient body 102 are presumably fixed in position and orientation during the surgical procedure, although this is not a requirement for the current system to function properly. - The
central controller 120 subsequently compares the relative position and orientation of theendoscope EMF sensor 114 to the relative position and orientation of the patient body 102 (see step 232). Thecentral controller 120 then superimposes a graphical representation of endoscope 112 (see step 234) upon the stereoscopic image of the patient body rendered on display means 140. Furthermore, this graphical representation ofendoscope 112 is updated in near real-time so as to accurately reflect the actual position and orientation of the tip section ofendoscope 112 with respect to thepatient body 102. The surgeon is thus able to quickly determine the position and orientation of the tip section of theflexible endoscope 112 relative to the patient body by simply glancing at the display means 140 and noting the relative position and orientation of the endoscope tip on the rendered stereoscopic image of the patient body. - To further clarify how the system described above functions, see
FIGS. 7A-7C , which illustrate various examples of a display means 300 depicting a stereoscopic image of a patient body. Note that due to the inherent limitations in depicting three-dimensional images on paper, as well as for purpose of clarity,FIGS. 7A-7C do not depict more conventional stereoscopic images such as that illustrated inFIG. 6 . Instead,FIGS. 7A-7C depict relatively unconventional stereoscopic images that comprise two 2-D graphical representations of the patient body taken from significantly different perspectives, with one representation being a top-down view 310 of the body while the other representation is aside view 320 of the body. It should be kept in mind, however, that the embodiments discussed below with respect toFIGS. 7A-7C can be similarly applied to more conventional stereoscopic images such as that depicted in the illustrative example ofFIG. 6 . - According to the embodiment of
FIG. 7A , the location of theendoscope EMF sensor 114 is graphically depicted simply as adot 330 on the display means 300. As a result, a surgeon can glance at the display means 300 and quickly determine the actual 3-D position (but not orientation in the immediate example) of the endoscope EMF sensor, and thus the 3-D position of the tip section of the endoscope, relative to the patient body even though the surgeon may otherwise not be able to visualize the actual tip of the endoscope. - According to the embodiment of
FIG. 7B , theendoscope EMF sensor 114 is graphically rendered on display means 300 as a line, arrow orpointer 332. As a result, the surgeon can quickly glance at the display means 300 and determine the actual 3-D position and orientation of the tip section of the endoscope within the patient body. - According to the alternate embodiment of
FIG. 7C , theendoscope EMF sensor 114 is again graphically rendered on the display means 300 as a line, arrow orpointer 332. However, trailing thepointer 332 is a dottedline 334 which, according to a first sub-embodiment, represents the path thatsensor 114 previously traveled before arriving at its current location indicated bypointer 332. In this case, the central controller simply configures the display means 300 to depict prior locations of theendoscope EMF sensor 114 using a different graphical depiction (e.g., dashed or colored line) than that used to indicate a current position of sensor 114 (e.g., arrow or pointer). - According to a second sub-embodiment of
FIG. 7C , dottedline 334 represents the actual position of at least a portion of the insertion tube that follows the tip section of the flexible endoscope. To achieve this embodiment, the endoscope incorporates or has mounted thereto a plurality of EMF sensors along at least a portion of the length of the endoscope's insertion tube, with the central controller tracking the position and orientation of each individual EMF sensor. - As shown above, graphical representations of different shapes and sizes can be utilized on the display means to indicate the position and orientation of one or more portions of a surgical instrument such as an endoscope. According to a previous embodiment, a simple graphical representation, such as an arrow or pointer, can be utilized to readily depict the position and orientation of at least a tip section of an instrument. However, according to an alternative embodiment, the system can be configured to generate a graphical depiction of a surgical instrument that actually resembles that specific instrument being monitored by the system. Thus, for example, if the system were being used to track the position and orientation of a rigid endoscope, the central controller could be configured to visually depict the instrument on the display means as a rigid endoscope. In another example, if the system were tracking the position and orientation of a surgical implant, the system could be configured to display a graphical likeness of the implant on the display means used by the surgeon to monitor the actual position and orientation of the implant.
- According to one alternative embodiment, an actual surgical instrument being tracked by the system would be represented on the display means by a corresponding graphical object programmed in by a user. Alternatively, a plurality of different size and shape graphical objects, corresponding to different surgical instruments, can be preprogrammed into the central controller. A user then simply selects the preprogrammed graphical object that most closely resembles the surgical instrument that is to be tracked by the system.
- According to a still further embodiment, the central controller automatically selects a preprogrammed graphical object that most closely resembles the actual surgical instrument to be tracked based upon an identification code or other data encoded in some form of memory associated with the instrument. Thus, for example, upon connecting a semi-rigid endoscope to the system, the central controller would query a memory of the endoscope, such as by optically scanning a barcode on the endoscope, or reading data from an associated wireless RFID tag or hard-wired memory chip associated with the endoscope. Upon retrieval of certain identification data for that specific endoscope, the central controller would search either a local or remote database and determine the most appropriate graphical object to use to represent that specific endoscope on the display means.
-
FIG. 8 illustrates a further embodiment of the present invention. Similar toFIG. 3 , thesystem 400 illustrated inFIG. 8 includes astereoscopic camera 406 and associatedEMF sensor 408, acentral controller 420, display means 440, and one or moresurgical instruments 412, such as a flexible endoscope, that includes one ormore EMF sensors 414 incorporated therein. However, instead of a smaller, more point-source-like EMF generator as previously disclosed, the present embodiment utilizes a larger,flat EMF generator 404 that can be mounted upon, underneath or within the surgical table 401, and which transmits an electromagnetic wireless signal that more effectively overcomes electromagnetic interference caused by the ferrous metal components sometimes found in surgical tables. - According to an additional embodiment of the present invention, a surgical instrument position and
orientation tracking system 500 comprises at least three subsystems. As illustrated inFIG. 9 , atracking subsystem 510 operates to provide real-time position data indicative of the position and orientation of one or more surgical instruments being tracked by thesystem 500. Included intracking subsystem 510 are astereoscopic camera system 512, at least onesurgical instrument 514 for remotely viewing and manipulating tissue, at least oneEMF sensor 516 incorporated into or attached to the surgical instrument, at least oneEMF sensor 518 incorporated into or attached to the stereoscopic camera system, anEMF generator 520 for transmitting a wireless tracking signal, and anelectromagnetic tracking controller 522 to coordinate and control the EMF generator and various EMF sensors. - Also included in
system 500 is adata processor subsystem 540. Included insubsystem 540 are aninterface component 542 for the stereoscopic camera system, which is capable of capturing and providing real-time intra-operative 2-D scans of the patient body. Also included is amodel generation component 544 for generating graphical models used to indicate the position and orientation of the surgical instrument being tracked. Lastly included is aprojection transform component 546 for computing a perspective projection of a given 3-D point to a point on a given plane. -
System 500 also includes auser interface subsystem 560 which operates to provide audio and visual output to the surgeon as well as accept user input. Included insubsystem 560 are adisplay device 564 capable of rendering video signal data acquired by one or more surgical instruments, such as an endoscope, as well as the stereoscopic camera system. Amerge component 562 operates to mix the graphical model representing the surgical instrument with the stereoscopic images of the patient body generated by thestereoscopic camera system 512, thereby producing a video signal capable of being rendered by the display device. - The general operation of the surgical instrument position and
orientation tracking system 500 is illustrated in the diagram ofFIG. 10 . Right and left camera feeds 610A and 610B, respectively, are generated by thestereoscopic camera system 512 and provided to thecamera interface component 542, which generates 2-D scans of the patient body. These right and left 2-D scans are subsequently provided to themerge component 562 to generate one or more stereoscopic images of the patient body. At the same time, one or more cameralocation sensor scans EMF generator 520, and thus be able to represent each 2-D camera scan as an image plane equation having a known relative position. These cameralocation sensor scans projection transform component 546, which is subsequently able to associate relative position and orientation to the stereoscopic image(s) of the patient body. Simultaneously, instrument location sensor scans 614 provide real-time positional and orientation information for thesurgical instrument 514 relative to theEMF generator 520. This instrument locationsensor scan data 614 is first provided to themodel generation component 544, which generates a model or graphical representation of the surgical instrument that can subsequently be rendered on thedisplay device 564. The instrumentlocation sensor data 614 and associated instrumentgraphical model data 544 are then provided to theprojection transform component 546. Here, the instrument location data is related to the camera location data based on their common frame of reference (that being their position relative to the EMF generator 520). All of this data is then relayed to themerge component 562, which superimposes the graphical model of the surgical instrument being tracked with the dual 2-D camera scans and generates a video signal representing a stereoscopic image of the patient body superimposed with a graphical representation indicative of the relative position and orientation of the surgical instrument. The subsequent video signal generated by themerge component 562 is then relayed to thedisplay device 564 where it can be viewed by the surgeon. - In the embodiments described above, real-time tracking of a surgical instrument's 3-D position and orientation is accomplished by means of a stereoscopic camera system utilized in combination with an electromagnetic field (EMF) generator and associated EMF sensors. During operation of the system, the EMF generator transmits a wireless signal that travels throughout an area of space surrounding the surgical table. An EMF sensor detects the magnetic field associated with the wireless signal and generates a corresponding signal that gets forwarded to a central controller and processed by one or more predefined algorithms to determine the exact 3-D position and orientation of the EMF sensor relative to the EMF generator that is the source of the magnetic field. Physical displacement of an EMF sensor results in subtle changes in the magnetic field detected by the sensor, which in turn are translated into new 3-D position coordinates (X, Y, Z) and/or orientation coordinates (yaw, pitch, and roll) for the sensor relative to the EMF generator.
- The above-described process of magnetic position sensing relies on the use of anisotropic magneto-resistive (AMR) sensors that are capable of detecting the relative intensity and direction of a magnetic field which can subsequently be quantified electronically. Examples of an appropriate EMF generator and AMR sensor that can be utilized in the above embodiments include the multi-axis transmitter and associated 1.3 and 1.8 mm microBIRD™ sensors manufactured by Ascension Technology Corporation and discussed in greater detail in U.S. Pat. No. 6,754,596, the disclosure of which is herein incorporated by reference.
- Beyond magnetic position sensing technology, the present invention can be configured to operate using other wireless tracking technology. For instance, consider
FIG. 11 , which illustrates another system for tracking the position of a surgical instrument during a medical procedure. Similar to previous embodiments, thetracking system 700 includes astereoscopic camera system 706 for acquiring stereoscopic images of thepatient body 702. As in prior embodiments, thecurrent system 700 also includes acentral controller 730 and a display means 740. However, unlike prior embodiments,system 700 does not utilize a single EMF generator for creating a magnetic field that can be detected by a plurality of EMF sensors associated with the surgical instrument and camera system. Instead,system 700 incorporates a minimum of threewireless transmitters surgical instrument 712 that is to be tracked incorporates, or has mounted thereupon, asensor 714 capable of simultaneously receiving each of the wireless signals originating from the three transmitters 720. Then in a manner similar in operation to the U.S. military global positioning satellite (GPS) network, each of thewireless transmitters 720A-720C generate their own time-encoded wireless signal. As thesurgical instrument 712 is used, itssensor 714 receives all three wireless signals and forwards them overconnection 716 tocentral controller 730. By then comparing its own synchronized time clock to the time code contained in each of the three wireless signals,central controller 730 can determine for any point in time the distance that exists between theinstrument sensor 714 and each of the threewireless transmitters 720A-720C. By then utilizing computational methods such as 3-D trilateration or triangulation, thecentral controller 730 can determine the specific 3-D position and orientation ofinstrument sensor 714, and thus the position and orientation ofsurgical instrument 712 itself. The same process is repeated for theendoscopic camera system 706 utilizingcamera sensor 708. Consequently, the 3-D position of both thecamera sensor 708 andinstrument sensor 714 are determined relative to the same frame of reference (that being the three wireless transmitters 720). From this point on,system 700 operates in the same manner as the previously described embodiments, with thesystem 700 rendering upon display means 740 one or more stereoscopic images of thepatient body 702 that are superimposed with some form of graphical representation ofsurgical instrument 712 that indicates the position and orientation of the instrument relative to the patient body. - In yet another embodiment of the invention, an instrument tracking system does not generate a stereoscopic image of the patient body on a display, nor superimpose some form of graphical object corresponding to the surgical tool upon the display. Instead, when a controller of the system determines the actual position of a surgical instrument within the patient body, the controller initiates the projection of some form of light beam (i.e., low power laser) directly upon the patient body. As the instrument proceeds to move, the light beam projected upon the patient body will proceed to track the movement of the instrument. Thus, instead of superimposing a graphical representation of a surgical instrument upon a stereoscopic image of the patient body and rendering the combined image upon a display, the immediate embodiment projects an instrument image or other graphical representation of the surgical instrument upon the actual patient body.
- According to variation of the above embodiment, a tracking system would include, among other things, an EMF generator, one or more EMF sensors associated with a surgical instrument, means for projecting a light beam upon the patient body, and one or more EMF sensors associated with the projector so that the system could determine the three-dimensional location of the projector relative to the EMF generator.
- In an additional embodiment of the present invention, one or more of the systems as described above are modified to include two or more stereoscopic camera systems positioned at different locations around the patient body. As a result, the modified system is able to generate multiple stereoscopic views, with each view representing the patient body from a different perspective.
- In the previously discussed embodiments, the stereoscopic camera or cameras were positioned around the patient body at presumably fixed locations. However, according to an alternative embodiment, one or more of the stereoscopic cameras in the system are not in a fixed position, but instead are mobile. In a first example, the camera is movably mounted such that it can be repositioned during the surgical procedure in order to obtain a stereoscopic view of the patient body from a different perspective. According to a second example, the camera is portable and can be carried by or mounted upon a member of the surgical staff. For instance, the camera could be configured to be worn by the surgeon as eyewear or headwear, resulting in the camera tracking the movement of the surgeon. Consequently, the camera will capture and generate a stereoscopic image of the area of the patient body currently being looked at by the surgeon. The advantage of such a system is that it allows the surgeon to obtain stereoscopic images of the patient body from numerous perspectives.
- In a similar embodiment, the system includes a stereoscopic camera that is mounted upon or worn by the surgeon, such as, for example, as eyewear or headwear. However, according to the immediate embodiment, the camera includes zooming capabilities that can automatically adjust based on the distance between the camera and the patient body. For example, the camera could be configured to automatically zoom in and out by a predetermined or calculated amount in response to the surgeon getting closer or farther away from the patient body. According to another example, the system can be configured to automatically adjust the scale of the displayed stereoscopic image, including the depiction of the patient body and graphical object representing the surgical instrument, in response to the zoom level of the camera.
- Although the present invention has been described with reference to specific exemplary embodiments, it will be recognized that the invention is not limited to the embodiments described, but can be practiced with modification and alteration within the spirit and scope of the appended claims. Accordingly, the specification and drawings are to be regarded in an illustrative sense rather than a restrictive sense.
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/486,965 US20170215971A1 (en) | 2006-03-24 | 2017-04-13 | System and method for 3-d tracking of surgical instrument in relation to patient body |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/388,756 US9636188B2 (en) | 2006-03-24 | 2006-03-24 | System and method for 3-D tracking of surgical instrument in relation to patient body |
US15/486,965 US20170215971A1 (en) | 2006-03-24 | 2017-04-13 | System and method for 3-d tracking of surgical instrument in relation to patient body |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/388,756 Division US9636188B2 (en) | 2006-03-24 | 2006-03-24 | System and method for 3-D tracking of surgical instrument in relation to patient body |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170215971A1 true US20170215971A1 (en) | 2017-08-03 |
Family
ID=38370690
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/388,756 Active 2033-11-17 US9636188B2 (en) | 2006-03-24 | 2006-03-24 | System and method for 3-D tracking of surgical instrument in relation to patient body |
US15/486,965 Abandoned US20170215971A1 (en) | 2006-03-24 | 2017-04-13 | System and method for 3-d tracking of surgical instrument in relation to patient body |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/388,756 Active 2033-11-17 US9636188B2 (en) | 2006-03-24 | 2006-03-24 | System and method for 3-D tracking of surgical instrument in relation to patient body |
Country Status (4)
Country | Link |
---|---|
US (2) | US9636188B2 (en) |
EP (1) | EP2001390B1 (en) |
JP (1) | JP5055352B2 (en) |
WO (1) | WO2007111955A2 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160073025A1 (en) * | 2008-01-29 | 2016-03-10 | Enforcement Video, Llc | Omnidirectional camera for use in police car event recording |
US10063805B2 (en) | 2004-10-12 | 2018-08-28 | WatchGuard, Inc. | Method of and system for mobile surveillance and event recording |
US10334249B2 (en) | 2008-02-15 | 2019-06-25 | WatchGuard, Inc. | System and method for high-resolution storage of images |
US10341605B1 (en) | 2016-04-07 | 2019-07-02 | WatchGuard, Inc. | Systems and methods for multiple-resolution storage of media streams |
Families Citing this family (201)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8482488B2 (en) | 2004-12-22 | 2013-07-09 | Oakley, Inc. | Data input management system for wearable electronically enabled interface |
US20120105740A1 (en) | 2000-06-02 | 2012-05-03 | Oakley, Inc. | Eyewear with detachable adjustable electronics module |
US7013009B2 (en) | 2001-06-21 | 2006-03-14 | Oakley, Inc. | Eyeglasses with wireless communication features |
KR20080111020A (en) * | 2006-03-31 | 2008-12-22 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Image guided surgery system |
US8442281B2 (en) * | 2006-04-28 | 2013-05-14 | The Invention Science Fund I, Llc | Artificially displaying information relative to a body |
US7616982B1 (en) * | 2006-06-22 | 2009-11-10 | United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Determination and application of location and angular orientation of a pill transmitter within a body |
US20080051677A1 (en) * | 2006-08-23 | 2008-02-28 | Warsaw Orthopedic, Inc. | Method and apparatus for osteochondral autograft transplantation |
NL1032559C2 (en) * | 2006-09-22 | 2008-03-26 | D O R C Dutch Ophthalmic Res C | Eye surgical lighting unit, light guide, method, computer program product and computer system. |
WO2008059636A1 (en) * | 2006-11-13 | 2008-05-22 | Olympus Medical Systems Corp. | Endoscope insertion shape analyzing system, and observation system for living body |
US7740353B2 (en) | 2006-12-14 | 2010-06-22 | Oakley, Inc. | Wearable high resolution audio visual interface |
US8233963B2 (en) * | 2007-02-19 | 2012-07-31 | Medtronic Navigation, Inc. | Automatic identification of tracked surgical devices using an electromagnetic localization system |
NL1034206C2 (en) * | 2007-07-30 | 2009-02-02 | D O R C Dutch Ophthalmic Res C | Eye surgical unit and eye surgical instrument. |
WO2009028186A1 (en) * | 2007-08-29 | 2009-03-05 | Kanazawa University | Electromagnetic field space distribution visualizing device, electromagnetic field space distribution visualizing method, and program thereof |
US8323182B2 (en) * | 2007-12-18 | 2012-12-04 | Manohara Harish M | Endoscope and system and method of operation thereof |
WO2010008846A2 (en) | 2008-06-23 | 2010-01-21 | John Richard Dein | Intra-operative system for identifying and tracking surgical sharp objects, instruments, and sponges |
US20100305427A1 (en) * | 2009-06-01 | 2010-12-02 | General Electric Company | Long-range planar sensor array for use in a surgical navigation system |
US9668820B2 (en) * | 2009-08-20 | 2017-06-06 | Brainlab Ag | Integrated surgical device combining instrument, tracking system and navigation system |
US20110137152A1 (en) * | 2009-12-03 | 2011-06-09 | General Electric Company | System and method for cooling components of a surgical navigation system |
GB2476245A (en) * | 2009-12-15 | 2011-06-22 | Hospital Authority | Stereoscopic display system for surgery |
US8308632B2 (en) * | 2010-06-15 | 2012-11-13 | Siemens Aktiengesellschaft | Method and apparatus for displaying information in magnetically guided capsule endoscopy |
CN102984998B (en) * | 2010-07-09 | 2018-04-27 | 美国医软科技公司 | The method and system of real-time surgical auxiliary is carried out using electronic organ map |
US8702592B2 (en) | 2010-09-30 | 2014-04-22 | David Allan Langlois | System and method for inhibiting injury to a patient during laparoscopic surgery |
WO2012094426A2 (en) | 2011-01-04 | 2012-07-12 | Schwartz Alan N | Gel-based seals and fixation devices and associated systems and methods |
US11045246B1 (en) | 2011-01-04 | 2021-06-29 | Alan N. Schwartz | Apparatus for effecting feedback of vaginal cavity physiology |
KR102191950B1 (en) | 2011-02-15 | 2020-12-17 | 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 | Indicator for knife location in a stapling or vessel sealing instrument |
US9449241B2 (en) | 2011-02-23 | 2016-09-20 | The Johns Hopkins University | System and method for detecting and tracking a curvilinear object in a three-dimensional space |
WO2012132638A1 (en) * | 2011-03-30 | 2012-10-04 | オリンパスメディカルシステムズ株式会社 | Endoscope system |
JP5841451B2 (en) | 2011-08-04 | 2016-01-13 | オリンパス株式会社 | Surgical instrument and control method thereof |
JP6000641B2 (en) | 2011-08-04 | 2016-10-05 | オリンパス株式会社 | Manipulator system |
JP6005950B2 (en) | 2011-08-04 | 2016-10-12 | オリンパス株式会社 | Surgery support apparatus and control method thereof |
JP5936914B2 (en) | 2011-08-04 | 2016-06-22 | オリンパス株式会社 | Operation input device and manipulator system including the same |
EP2740433B1 (en) | 2011-08-04 | 2016-04-27 | Olympus Corporation | Surgical implement and medical treatment manipulator |
JP6081061B2 (en) | 2011-08-04 | 2017-02-15 | オリンパス株式会社 | Surgery support device |
JP6009840B2 (en) | 2011-08-04 | 2016-10-19 | オリンパス株式会社 | Medical equipment |
EP2740434A4 (en) | 2011-08-04 | 2015-03-18 | Olympus Corp | Medical manipulator and method for controlling same |
JP5931497B2 (en) | 2011-08-04 | 2016-06-08 | オリンパス株式会社 | Surgery support apparatus and assembly method thereof |
JP5953058B2 (en) | 2011-08-04 | 2016-07-13 | オリンパス株式会社 | Surgery support device and method for attaching and detaching the same |
CN103648425B (en) | 2011-08-04 | 2016-10-19 | 奥林巴斯株式会社 | Medical manipulator and surgery support device |
JP6021484B2 (en) | 2011-08-04 | 2016-11-09 | オリンパス株式会社 | Medical manipulator |
JP6021353B2 (en) | 2011-08-04 | 2016-11-09 | オリンパス株式会社 | Surgery support device |
WO2013044166A1 (en) | 2011-09-23 | 2013-03-28 | Schwartz Alan N | Non-invasive and minimally invasive and tightly targeted minimally invasive therapy methods and devices for parathyroid treatment |
US9107737B2 (en) | 2011-11-21 | 2015-08-18 | Alan Schwartz | Goggles with facial conforming eyepieces |
JP2015515638A (en) | 2012-02-17 | 2015-05-28 | オークリー インコーポレイテッド | System and method for removably coupling an electronic device to eyeglasses |
US9561022B2 (en) | 2012-02-27 | 2017-02-07 | Covidien Lp | Device and method for optical image correction in metrology systems |
EP2838415A4 (en) * | 2012-04-18 | 2016-01-27 | Oncofluor Inc | Light emitting diode endoscopic devices for visualization of diseased tissue in humans and animals |
WO2013169327A1 (en) | 2012-05-07 | 2013-11-14 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Medical device navigation system stereoscopic display |
WO2013173810A2 (en) * | 2012-05-17 | 2013-11-21 | Schwartz Alan N | Localization of the parathyroid |
US11871901B2 (en) | 2012-05-20 | 2024-01-16 | Cilag Gmbh International | Method for situational awareness for surgical network or surgical network connected device capable of adjusting function based on a sensed situation or usage |
JP6146981B2 (en) * | 2012-10-16 | 2017-06-14 | オリンパス株式会社 | Observation device, observation support device, and program |
US20140188107A1 (en) | 2012-12-31 | 2014-07-03 | Paul Joseph Weber | Methods and systems for tissue dissection and modification |
US10045761B2 (en) | 2012-12-31 | 2018-08-14 | Tdm Surgitech, Inc. | Systems, apparatus and methods for tissue dissection |
GB2525800A (en) | 2013-02-14 | 2015-11-04 | Paul Weber | Systems, apparatus and methods for tissue dissection |
US8966681B2 (en) | 2013-02-26 | 2015-03-03 | Linda L. Burch | Exercise mat |
CN205177388U (en) | 2013-03-15 | 2016-04-20 | 奥克利有限公司 | Eyepiece system |
CN205691887U (en) | 2013-06-12 | 2016-11-16 | 奥克利有限公司 | Modular communication system and glasses communication system |
KR101510129B1 (en) | 2013-07-10 | 2015-04-08 | 주식회사 디에보 | Three-dimensional positioning ceiling system |
WO2015031877A2 (en) * | 2013-08-30 | 2015-03-05 | Maracaja-Neto Luiz | Endo-navigation systems and methods for surgical procedures and cpr |
AU2015221258B2 (en) | 2014-02-21 | 2019-11-21 | Cilag Gmbh International | A set comprising a surgical instrument |
US9681107B2 (en) * | 2014-05-22 | 2017-06-13 | Siemens Energy, Inc. | Flexible tether position tracking camera inspection system for visual inspection of off line industrial gas turbines and other power generation machinery |
US11504192B2 (en) | 2014-10-30 | 2022-11-22 | Cilag Gmbh International | Method of hub communication with surgical instrument systems |
US10524851B2 (en) | 2014-10-31 | 2020-01-07 | Medtronic Advanced Energy Llc | Fingerswitch circuitry to reduce RF leakage current |
US10144637B2 (en) | 2014-11-25 | 2018-12-04 | Synaptive Medical (Barbados) Inc. | Sensor based tracking tool for medical components |
US20180263574A1 (en) * | 2014-12-10 | 2018-09-20 | Sparkbio S.R.L. | System for the capture and combined display of video and analog signals coming from electromedical instruments and equipment |
US10105107B2 (en) * | 2015-01-08 | 2018-10-23 | St. Jude Medical International Holding S.À R.L. | Medical system having combined and synergized data output from multiple independent inputs |
EP3145419B1 (en) | 2015-07-21 | 2019-11-27 | 3dintegrated ApS | Cannula assembly kit, trocar assembly kit and minimally invasive surgery system |
US11020144B2 (en) | 2015-07-21 | 2021-06-01 | 3Dintegrated Aps | Minimally invasive surgery system |
DK178899B1 (en) | 2015-10-09 | 2017-05-08 | 3Dintegrated Aps | A depiction system |
US10196927B2 (en) | 2015-12-09 | 2019-02-05 | General Electric Company | System and method for locating a probe within a gas turbine engine |
US10196922B2 (en) | 2015-12-09 | 2019-02-05 | General Electric Company | System and method for locating a probe within a gas turbine engine |
WO2017098259A1 (en) * | 2015-12-10 | 2017-06-15 | Cambridge Medical Robotics Limited | Robotic system |
CN108472090B (en) * | 2015-12-29 | 2021-06-18 | 皇家飞利浦有限公司 | System, control unit and method for controlling a surgical robot |
US10603101B2 (en) | 2016-03-26 | 2020-03-31 | Paul Joseph Weber | Apparatus, systems and methods for minimally invasive dissection of tissues |
IL246068A0 (en) * | 2016-06-06 | 2016-08-31 | Medigus Ltd | Endoscope-like devices comprising sensors that provide positional information |
WO2018039223A1 (en) * | 2016-08-23 | 2018-03-01 | Neurosimplicity, Llc | System, devices and method for surgical navigation including active tracking and drift elimination |
US11051886B2 (en) * | 2016-09-27 | 2021-07-06 | Covidien Lp | Systems and methods for performing a surgical navigation procedure |
WO2018221599A1 (en) * | 2017-05-31 | 2018-12-06 | カリーナシステム株式会社 | Surgical instrument detection system and computer program |
US11071593B2 (en) * | 2017-07-14 | 2021-07-27 | Synaptive Medical Inc. | Methods and systems for providing visuospatial information |
US11357575B2 (en) * | 2017-07-14 | 2022-06-14 | Synaptive Medical Inc. | Methods and systems for providing visuospatial information and representations |
US11179203B2 (en) | 2017-10-26 | 2021-11-23 | Biosense Webster (Israel) Ltd. | Position-tracking-enabling connector for an ear-nose-throat (ENT) tool |
US11801098B2 (en) | 2017-10-30 | 2023-10-31 | Cilag Gmbh International | Method of hub communication with surgical instrument systems |
US11141160B2 (en) | 2017-10-30 | 2021-10-12 | Cilag Gmbh International | Clip applier comprising a motor controller |
US11317919B2 (en) | 2017-10-30 | 2022-05-03 | Cilag Gmbh International | Clip applier comprising a clip crimping system |
US11291510B2 (en) | 2017-10-30 | 2022-04-05 | Cilag Gmbh International | Method of hub communication with surgical instrument systems |
US11311342B2 (en) | 2017-10-30 | 2022-04-26 | Cilag Gmbh International | Method for communicating with surgical instrument systems |
US11911045B2 (en) | 2017-10-30 | 2024-02-27 | Cllag GmbH International | Method for operating a powered articulating multi-clip applier |
US11229436B2 (en) | 2017-10-30 | 2022-01-25 | Cilag Gmbh International | Surgical system comprising a surgical tool and a surgical hub |
US11564756B2 (en) | 2017-10-30 | 2023-01-31 | Cilag Gmbh International | Method of hub communication with surgical instrument systems |
US11925373B2 (en) | 2017-10-30 | 2024-03-12 | Cilag Gmbh International | Surgical suturing instrument comprising a non-circular needle |
US11510741B2 (en) | 2017-10-30 | 2022-11-29 | Cilag Gmbh International | Method for producing a surgical instrument comprising a smart electrical system |
US11234756B2 (en) | 2017-12-28 | 2022-02-01 | Cilag Gmbh International | Powered surgical tool with predefined adjustable control algorithm for controlling end effector parameter |
US11291495B2 (en) | 2017-12-28 | 2022-04-05 | Cilag Gmbh International | Interruption of energy due to inadvertent capacitive coupling |
US11844579B2 (en) | 2017-12-28 | 2023-12-19 | Cilag Gmbh International | Adjustments based on airborne particle properties |
US11419667B2 (en) | 2017-12-28 | 2022-08-23 | Cilag Gmbh International | Ultrasonic energy device which varies pressure applied by clamp arm to provide threshold control pressure at a cut progression location |
US10943454B2 (en) | 2017-12-28 | 2021-03-09 | Ethicon Llc | Detection and escalation of security responses of surgical instruments to increasing severity threats |
US11253315B2 (en) | 2017-12-28 | 2022-02-22 | Cilag Gmbh International | Increasing radio frequency to create pad-less monopolar loop |
US11147607B2 (en) | 2017-12-28 | 2021-10-19 | Cilag Gmbh International | Bipolar combination device that automatically adjusts pressure based on energy modality |
US11166772B2 (en) | 2017-12-28 | 2021-11-09 | Cilag Gmbh International | Surgical hub coordination of control and communication of operating room devices |
US11109866B2 (en) | 2017-12-28 | 2021-09-07 | Cilag Gmbh International | Method for circular stapler control algorithm adjustment based on situational awareness |
US11419630B2 (en) | 2017-12-28 | 2022-08-23 | Cilag Gmbh International | Surgical system distributed processing |
US11832899B2 (en) | 2017-12-28 | 2023-12-05 | Cilag Gmbh International | Surgical systems with autonomously adjustable control programs |
US11857152B2 (en) * | 2017-12-28 | 2024-01-02 | Cilag Gmbh International | Surgical hub spatial awareness to determine devices in operating theater |
US11678881B2 (en) | 2017-12-28 | 2023-06-20 | Cilag Gmbh International | Spatial awareness of surgical hubs in operating rooms |
US11864728B2 (en) | 2017-12-28 | 2024-01-09 | Cilag Gmbh International | Characterization of tissue irregularities through the use of mono-chromatic light refractivity |
US11464559B2 (en) | 2017-12-28 | 2022-10-11 | Cilag Gmbh International | Estimating state of ultrasonic end effector and control system therefor |
US11633237B2 (en) | 2017-12-28 | 2023-04-25 | Cilag Gmbh International | Usage and technique analysis of surgeon / staff performance against a baseline to optimize device utilization and performance for both current and future procedures |
US11571234B2 (en) | 2017-12-28 | 2023-02-07 | Cilag Gmbh International | Temperature control of ultrasonic end effector and control system therefor |
US11896322B2 (en) | 2017-12-28 | 2024-02-13 | Cilag Gmbh International | Sensing the patient position and contact utilizing the mono-polar return pad electrode to provide situational awareness to the hub |
US11100631B2 (en) | 2017-12-28 | 2021-08-24 | Cilag Gmbh International | Use of laser light and red-green-blue coloration to determine properties of back scattered light |
US20190201139A1 (en) | 2017-12-28 | 2019-07-04 | Ethicon Llc | Communication arrangements for robot-assisted surgical platforms |
US11432885B2 (en) | 2017-12-28 | 2022-09-06 | Cilag Gmbh International | Sensing arrangements for robot-assisted surgical platforms |
US11324557B2 (en) | 2017-12-28 | 2022-05-10 | Cilag Gmbh International | Surgical instrument with a sensing array |
US11376002B2 (en) | 2017-12-28 | 2022-07-05 | Cilag Gmbh International | Surgical instrument cartridge sensor assemblies |
US11559307B2 (en) | 2017-12-28 | 2023-01-24 | Cilag Gmbh International | Method of robotic hub communication, detection, and control |
US11818052B2 (en) | 2017-12-28 | 2023-11-14 | Cilag Gmbh International | Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs |
US10758310B2 (en) | 2017-12-28 | 2020-09-01 | Ethicon Llc | Wireless pairing of a surgical device with another device within a sterile surgical field based on the usage and situational awareness of devices |
US10892899B2 (en) | 2017-12-28 | 2021-01-12 | Ethicon Llc | Self describing data packets generated at an issuing instrument |
US11410259B2 (en) | 2017-12-28 | 2022-08-09 | Cilag Gmbh International | Adaptive control program updates for surgical devices |
US11202570B2 (en) | 2017-12-28 | 2021-12-21 | Cilag Gmbh International | Communication hub and storage device for storing parameters and status of a surgical device to be shared with cloud based analytics systems |
US11744604B2 (en) | 2017-12-28 | 2023-09-05 | Cilag Gmbh International | Surgical instrument with a hardware-only control circuit |
US11364075B2 (en) | 2017-12-28 | 2022-06-21 | Cilag Gmbh International | Radio frequency energy device for delivering combined electrical signals |
US11903601B2 (en) | 2017-12-28 | 2024-02-20 | Cilag Gmbh International | Surgical instrument comprising a plurality of drive systems |
US11696760B2 (en) | 2017-12-28 | 2023-07-11 | Cilag Gmbh International | Safety systems for smart powered surgical stapling |
US11096693B2 (en) | 2017-12-28 | 2021-08-24 | Cilag Gmbh International | Adjustment of staple height of at least one row of staples based on the sensed tissue thickness or force in closing |
US11317937B2 (en) | 2018-03-08 | 2022-05-03 | Cilag Gmbh International | Determining the state of an ultrasonic end effector |
US11786245B2 (en) | 2017-12-28 | 2023-10-17 | Cilag Gmbh International | Surgical systems with prioritized data transmission capabilities |
US11069012B2 (en) | 2017-12-28 | 2021-07-20 | Cilag Gmbh International | Interactive surgical systems with condition handling of devices and data capabilities |
US11896443B2 (en) | 2017-12-28 | 2024-02-13 | Cilag Gmbh International | Control of a surgical system through a surgical barrier |
US11602393B2 (en) | 2017-12-28 | 2023-03-14 | Cilag Gmbh International | Surgical evacuation sensing and generator control |
US11056244B2 (en) | 2017-12-28 | 2021-07-06 | Cilag Gmbh International | Automated data scaling, alignment, and organizing based on predefined parameters within surgical networks |
US11389164B2 (en) | 2017-12-28 | 2022-07-19 | Cilag Gmbh International | Method of using reinforced flexible circuits with multiple sensors to optimize performance of radio frequency devices |
US10944728B2 (en) | 2017-12-28 | 2021-03-09 | Ethicon Llc | Interactive surgical systems with encrypted communication capabilities |
US11051876B2 (en) | 2017-12-28 | 2021-07-06 | Cilag Gmbh International | Surgical evacuation flow paths |
US11266468B2 (en) | 2017-12-28 | 2022-03-08 | Cilag Gmbh International | Cooperative utilization of data derived from secondary sources by intelligent surgical hubs |
US11832840B2 (en) | 2017-12-28 | 2023-12-05 | Cilag Gmbh International | Surgical instrument having a flexible circuit |
US11576677B2 (en) | 2017-12-28 | 2023-02-14 | Cilag Gmbh International | Method of hub communication, processing, display, and cloud analytics |
US11612408B2 (en) | 2017-12-28 | 2023-03-28 | Cilag Gmbh International | Determining tissue composition via an ultrasonic system |
US11529187B2 (en) | 2017-12-28 | 2022-12-20 | Cilag Gmbh International | Surgical evacuation sensor arrangements |
US11423007B2 (en) | 2017-12-28 | 2022-08-23 | Cilag Gmbh International | Adjustment of device control programs based on stratified contextual data in addition to the data |
US11969216B2 (en) | 2017-12-28 | 2024-04-30 | Cilag Gmbh International | Surgical network recommendations from real time analysis of procedure variables against a baseline highlighting differences from the optimal solution |
US11311306B2 (en) | 2017-12-28 | 2022-04-26 | Cilag Gmbh International | Surgical systems for detecting end effector tissue distribution irregularities |
US11160605B2 (en) | 2017-12-28 | 2021-11-02 | Cilag Gmbh International | Surgical evacuation sensing and motor control |
US11666331B2 (en) | 2017-12-28 | 2023-06-06 | Cilag Gmbh International | Systems for detecting proximity of surgical end effector to cancerous tissue |
US11304763B2 (en) | 2017-12-28 | 2022-04-19 | Cilag Gmbh International | Image capturing of the areas outside the abdomen to improve placement and control of a surgical device in use |
US11304745B2 (en) | 2017-12-28 | 2022-04-19 | Cilag Gmbh International | Surgical evacuation sensing and display |
US11446052B2 (en) | 2017-12-28 | 2022-09-20 | Cilag Gmbh International | Variation of radio frequency and ultrasonic power level in cooperation with varying clamp arm pressure to achieve predefined heat flux or power applied to tissue |
US11672605B2 (en) | 2017-12-28 | 2023-06-13 | Cilag Gmbh International | Sterile field interactive control displays |
US20190201039A1 (en) | 2017-12-28 | 2019-07-04 | Ethicon Llc | Situational awareness of electrosurgical systems |
US11659023B2 (en) | 2017-12-28 | 2023-05-23 | Cilag Gmbh International | Method of hub communication |
US11464535B2 (en) | 2017-12-28 | 2022-10-11 | Cilag Gmbh International | Detection of end effector emersion in liquid |
US11540855B2 (en) | 2017-12-28 | 2023-01-03 | Cilag Gmbh International | Controlling activation of an ultrasonic surgical instrument according to the presence of tissue |
US10892995B2 (en) | 2017-12-28 | 2021-01-12 | Ethicon Llc | Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs |
US10966791B2 (en) | 2017-12-28 | 2021-04-06 | Ethicon Llc | Cloud-based medical analytics for medical facility segmented individualization of instrument function |
US11179208B2 (en) | 2017-12-28 | 2021-11-23 | Cilag Gmbh International | Cloud-based medical analytics for security and authentication trends and reactive measures |
US11424027B2 (en) | 2017-12-28 | 2022-08-23 | Cilag Gmbh International | Method for operating surgical instrument systems |
US10987178B2 (en) | 2017-12-28 | 2021-04-27 | Ethicon Llc | Surgical hub control arrangements |
US11589888B2 (en) | 2017-12-28 | 2023-02-28 | Cilag Gmbh International | Method for controlling smart energy devices |
US10932872B2 (en) | 2017-12-28 | 2021-03-02 | Ethicon Llc | Cloud-based medical analytics for linking of local usage trends with the resource acquisition behaviors of larger data set |
US11786251B2 (en) | 2017-12-28 | 2023-10-17 | Cilag Gmbh International | Method for adaptive control schemes for surgical network control and interaction |
US10755813B2 (en) | 2017-12-28 | 2020-08-25 | Ethicon Llc | Communication of smoke evacuation system parameters to hub or cloud in smoke evacuation module for interactive surgical platform |
US11559308B2 (en) | 2017-12-28 | 2023-01-24 | Cilag Gmbh International | Method for smart energy device infrastructure |
US11937769B2 (en) | 2017-12-28 | 2024-03-26 | Cilag Gmbh International | Method of hub communication, processing, storage and display |
US11132462B2 (en) | 2017-12-28 | 2021-09-28 | Cilag Gmbh International | Data stripping method to interrogate patient records and create anonymized record |
US10849697B2 (en) | 2017-12-28 | 2020-12-01 | Ethicon Llc | Cloud interface for coupled surgical devices |
US11278281B2 (en) | 2017-12-28 | 2022-03-22 | Cilag Gmbh International | Interactive surgical system |
US11969142B2 (en) | 2017-12-28 | 2024-04-30 | Cilag Gmbh International | Method of compressing tissue within a stapling device and simultaneously displaying the location of the tissue within the jaws |
US11045591B2 (en) | 2017-12-28 | 2021-06-29 | Cilag Gmbh International | Dual in-series large and small droplet filters |
US11257589B2 (en) | 2017-12-28 | 2022-02-22 | Cilag Gmbh International | Real-time analysis of comprehensive cost of all instrumentation used in surgery utilizing data fluidity to track instruments through stocking and in-house processes |
US11304720B2 (en) | 2017-12-28 | 2022-04-19 | Cilag Gmbh International | Activation of energy devices |
US11076921B2 (en) | 2017-12-28 | 2021-08-03 | Cilag Gmbh International | Adaptive control program updates for surgical hubs |
US11273001B2 (en) | 2017-12-28 | 2022-03-15 | Cilag Gmbh International | Surgical hub and modular device response adjustment based on situational awareness |
US11304699B2 (en) | 2017-12-28 | 2022-04-19 | Cilag Gmbh International | Method for adaptive control schemes for surgical network control and interaction |
US11284936B2 (en) | 2017-12-28 | 2022-03-29 | Cilag Gmbh International | Surgical instrument having a flexible electrode |
US11308075B2 (en) | 2017-12-28 | 2022-04-19 | Cilag Gmbh International | Surgical network, instrument, and cloud responses based on validation of received dataset and authentication of its source and integrity |
US11058498B2 (en) | 2017-12-28 | 2021-07-13 | Cilag Gmbh International | Cooperative surgical actions for robot-assisted surgical platforms |
US11259830B2 (en) | 2018-03-08 | 2022-03-01 | Cilag Gmbh International | Methods for controlling temperature in ultrasonic device |
US11389188B2 (en) | 2018-03-08 | 2022-07-19 | Cilag Gmbh International | Start temperature of blade |
US11337746B2 (en) | 2018-03-08 | 2022-05-24 | Cilag Gmbh International | Smart blade and power pulsing |
US11589865B2 (en) | 2018-03-28 | 2023-02-28 | Cilag Gmbh International | Methods for controlling a powered surgical stapler that has separate rotary closure and firing systems |
US11096688B2 (en) | 2018-03-28 | 2021-08-24 | Cilag Gmbh International | Rotary driven firing members with different anvil and channel engagement features |
US11219453B2 (en) | 2018-03-28 | 2022-01-11 | Cilag Gmbh International | Surgical stapling devices with cartridge compatible closure and firing lockout arrangements |
US11129611B2 (en) | 2018-03-28 | 2021-09-28 | Cilag Gmbh International | Surgical staplers with arrangements for maintaining a firing member thereof in a locked configuration unless a compatible cartridge has been installed therein |
US11207067B2 (en) | 2018-03-28 | 2021-12-28 | Cilag Gmbh International | Surgical stapling device with separate rotary driven closure and firing systems and firing member that engages both jaws while firing |
US11090047B2 (en) | 2018-03-28 | 2021-08-17 | Cilag Gmbh International | Surgical instrument comprising an adaptive control system |
US11278280B2 (en) | 2018-03-28 | 2022-03-22 | Cilag Gmbh International | Surgical instrument comprising a jaw closure lockout |
US10973520B2 (en) | 2018-03-28 | 2021-04-13 | Ethicon Llc | Surgical staple cartridge with firing member driven camming assembly that has an onboard tissue cutting feature |
US11471156B2 (en) | 2018-03-28 | 2022-10-18 | Cilag Gmbh International | Surgical stapling devices with improved rotary driven closure systems |
US20200015907A1 (en) * | 2018-07-16 | 2020-01-16 | Ethicon Llc | Integration of imaging data |
US20200237459A1 (en) | 2019-01-25 | 2020-07-30 | Biosense Webster (Israel) Ltd. | Flexible multi-coil tracking sensor |
US11369377B2 (en) | 2019-02-19 | 2022-06-28 | Cilag Gmbh International | Surgical stapling assembly with cartridge based retainer configured to unlock a firing lockout |
US11317915B2 (en) | 2019-02-19 | 2022-05-03 | Cilag Gmbh International | Universal cartridge based key feature that unlocks multiple lockout arrangements in different surgical staplers |
US11357503B2 (en) | 2019-02-19 | 2022-06-14 | Cilag Gmbh International | Staple cartridge retainers with frangible retention features and methods of using same |
US11751872B2 (en) | 2019-02-19 | 2023-09-12 | Cilag Gmbh International | Insertable deactivator element for surgical stapler lockouts |
US11331101B2 (en) | 2019-02-19 | 2022-05-17 | Cilag Gmbh International | Deactivator element for defeating surgical stapling device lockouts |
EP3833288A4 (en) | 2019-03-21 | 2022-05-04 | Paul Weber | Apparatus and methods for minimally invasive dissection and modification of tissues |
JP7247702B2 (en) * | 2019-03-27 | 2023-03-29 | ソニーグループ株式会社 | Endoscope system, endoscope control method, and imaging control device |
DE102020109121A1 (en) * | 2019-04-02 | 2020-10-08 | Ascension Technology Corporation | Correction of distortions |
USD952144S1 (en) | 2019-06-25 | 2022-05-17 | Cilag Gmbh International | Surgical staple cartridge retainer with firing system authentication key |
USD964564S1 (en) | 2019-06-25 | 2022-09-20 | Cilag Gmbh International | Surgical staple cartridge retainer with a closure system authentication key |
USD950728S1 (en) | 2019-06-25 | 2022-05-03 | Cilag Gmbh International | Surgical staple cartridge |
CA3102791C (en) | 2019-12-30 | 2024-02-27 | Northern Digital Inc. | Reducing interference between electromagnetic tracking systems |
US11166006B2 (en) | 2020-01-22 | 2021-11-02 | Photonic Medical Inc. | Open view, multi-modal, calibrated digital loupe with depth sensing |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6233476B1 (en) * | 1999-05-18 | 2001-05-15 | Mediguide Ltd. | Medical positioning system |
US20020058929A1 (en) * | 1992-01-21 | 2002-05-16 | Green Philip S. | Roll pitch roll tool |
US20020065461A1 (en) * | 1991-01-28 | 2002-05-30 | Cosman Eric R. | Surgical positioning system |
US6450978B1 (en) * | 1998-05-28 | 2002-09-17 | Orthosoft, Inc. | Interactive computer-assisted surgical system and method thereof |
US20040151354A1 (en) * | 2003-02-04 | 2004-08-05 | Francois Leitner | Method and apparatus for capturing information associated with a surgical procedure performed using a localization device |
US6920347B2 (en) * | 2000-04-07 | 2005-07-19 | Surgical Navigation Technologies, Inc. | Trajectory storage apparatus and method for surgical navigation systems |
US20060004286A1 (en) * | 2004-04-21 | 2006-01-05 | Acclarent, Inc. | Methods and devices for performing procedures within the ear, nose, throat and paranasal sinuses |
US20070019936A1 (en) * | 2003-07-24 | 2007-01-25 | Rainer Birkenbach | Stereoscopic visualization device for patient image data and video images |
US20070167701A1 (en) * | 2005-12-26 | 2007-07-19 | Depuy Products, Inc. | Computer assisted orthopaedic surgery system with light source and associated method |
US7988633B2 (en) * | 2005-10-12 | 2011-08-02 | Volcano Corporation | Apparatus and method for use of RFID catheter intelligence |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0141609B1 (en) | 1983-11-05 | 1988-02-03 | LUCAS INDUSTRIES public limited company | Device for limiting output force applied by a rotary transmission |
JP3135068B2 (en) * | 1994-09-15 | 2001-02-13 | ビジュアリゼイション テクノロジー インコーポレイテッド | Position tracking and image generation system for medical applications using a reference unit fixed to the patient's head |
US6016439A (en) * | 1996-10-15 | 2000-01-18 | Biosense, Inc. | Method and apparatus for synthetic viewpoint imaging |
US6580938B1 (en) * | 1997-02-25 | 2003-06-17 | Biosense, Inc. | Image-guided thoracic therapy and apparatus therefor |
AU2475799A (en) | 1998-01-28 | 1999-08-16 | Eric R. Cosman | Optical object tracking system |
US6470207B1 (en) * | 1999-03-23 | 2002-10-22 | Surgical Navigation Technologies, Inc. | Navigational guidance via computer-assisted fluoroscopic imaging |
US7343195B2 (en) | 1999-05-18 | 2008-03-11 | Mediguide Ltd. | Method and apparatus for real time quantitative three-dimensional image reconstruction of a moving organ and intra-body navigation |
DE19946948A1 (en) * | 1999-09-30 | 2001-04-05 | Philips Corp Intellectual Pty | Method and arrangement for determining the position of a medical instrument |
JP2001109445A (en) * | 1999-10-07 | 2001-04-20 | Olympus Optical Co Ltd | Face-mounted video display device |
US20050165276A1 (en) * | 2004-01-28 | 2005-07-28 | Amir Belson | Methods and apparatus for accessing and treating regions of the body |
EP1356413A2 (en) * | 2000-10-05 | 2003-10-29 | Siemens Corporate Research, Inc. | Intra-operative image-guided neurosurgery with augmented reality visualization |
JP5030335B2 (en) * | 2001-03-06 | 2012-09-19 | オリンパス株式会社 | Medical image display device |
JP2004530485A (en) * | 2001-06-13 | 2004-10-07 | ヴォリューム・インタラクションズ・プライヴェート・リミテッド | Guide systems and probes therefor |
EP1550024A2 (en) | 2002-06-21 | 2005-07-06 | Cedara Software Corp. | Computer assisted system and method for minimal invasive hip, uni knee and total knee replacement |
US6754596B2 (en) | 2002-11-01 | 2004-06-22 | Ascension Technology Corporation | Method of measuring position and orientation with improved signal to noise ratio |
US7570791B2 (en) * | 2003-04-25 | 2009-08-04 | Medtronic Navigation, Inc. | Method and apparatus for performing 2D to 3D registration |
US8354837B2 (en) | 2003-09-24 | 2013-01-15 | Ge Medical Systems Global Technology Company Llc | System and method for electromagnetic tracking operable with multiple coil architectures |
EP1722705A2 (en) | 2004-03-10 | 2006-11-22 | Depuy International Limited | Orthopaedic operating systems, methods, implants and instruments |
US10555775B2 (en) * | 2005-05-16 | 2020-02-11 | Intuitive Surgical Operations, Inc. | Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery |
-
2006
- 2006-03-24 US US11/388,756 patent/US9636188B2/en active Active
-
2007
- 2007-03-22 JP JP2009501563A patent/JP5055352B2/en active Active
- 2007-03-22 WO PCT/US2007/007147 patent/WO2007111955A2/en active Application Filing
- 2007-03-22 EP EP07753750A patent/EP2001390B1/en active Active
-
2017
- 2017-04-13 US US15/486,965 patent/US20170215971A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020065461A1 (en) * | 1991-01-28 | 2002-05-30 | Cosman Eric R. | Surgical positioning system |
US20020058929A1 (en) * | 1992-01-21 | 2002-05-16 | Green Philip S. | Roll pitch roll tool |
US6450978B1 (en) * | 1998-05-28 | 2002-09-17 | Orthosoft, Inc. | Interactive computer-assisted surgical system and method thereof |
US6233476B1 (en) * | 1999-05-18 | 2001-05-15 | Mediguide Ltd. | Medical positioning system |
US6920347B2 (en) * | 2000-04-07 | 2005-07-19 | Surgical Navigation Technologies, Inc. | Trajectory storage apparatus and method for surgical navigation systems |
US20040151354A1 (en) * | 2003-02-04 | 2004-08-05 | Francois Leitner | Method and apparatus for capturing information associated with a surgical procedure performed using a localization device |
US20070019936A1 (en) * | 2003-07-24 | 2007-01-25 | Rainer Birkenbach | Stereoscopic visualization device for patient image data and video images |
US20060004286A1 (en) * | 2004-04-21 | 2006-01-05 | Acclarent, Inc. | Methods and devices for performing procedures within the ear, nose, throat and paranasal sinuses |
US7988633B2 (en) * | 2005-10-12 | 2011-08-02 | Volcano Corporation | Apparatus and method for use of RFID catheter intelligence |
US20070167701A1 (en) * | 2005-12-26 | 2007-07-19 | Depuy Products, Inc. | Computer assisted orthopaedic surgery system with light source and associated method |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10063805B2 (en) | 2004-10-12 | 2018-08-28 | WatchGuard, Inc. | Method of and system for mobile surveillance and event recording |
US10075669B2 (en) | 2004-10-12 | 2018-09-11 | WatchGuard, Inc. | Method of and system for mobile surveillance and event recording |
US20160073025A1 (en) * | 2008-01-29 | 2016-03-10 | Enforcement Video, Llc | Omnidirectional camera for use in police car event recording |
US10334249B2 (en) | 2008-02-15 | 2019-06-25 | WatchGuard, Inc. | System and method for high-resolution storage of images |
US10341605B1 (en) | 2016-04-07 | 2019-07-02 | WatchGuard, Inc. | Systems and methods for multiple-resolution storage of media streams |
Also Published As
Publication number | Publication date |
---|---|
US9636188B2 (en) | 2017-05-02 |
WO2007111955A3 (en) | 2008-04-24 |
US20070225550A1 (en) | 2007-09-27 |
JP5055352B2 (en) | 2012-10-24 |
EP2001390B1 (en) | 2012-01-25 |
EP2001390A2 (en) | 2008-12-17 |
WO2007111955A2 (en) | 2007-10-04 |
JP2009530037A (en) | 2009-08-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20170215971A1 (en) | System and method for 3-d tracking of surgical instrument in relation to patient body | |
US11481868B2 (en) | System and method of providing real-time dynamic imagery of a medical procedure she using multiple modalities | |
EP3618748B1 (en) | Surgical navigation system | |
CN108430373B (en) | Apparatus and method for tracking the position of an endoscope within a patient | |
US8251893B2 (en) | Device for displaying assistance information for surgical operation, method for displaying assistance information for surgical operation, and program for displaying assistance information for surgical operation | |
US8248413B2 (en) | Visual navigation system for endoscopic surgery | |
US8248414B2 (en) | Multi-dimensional navigation of endoscopic video | |
US7945310B2 (en) | Surgical instrument path computation and display for endoluminal surgery | |
US7824328B2 (en) | Method and apparatus for tracking a surgical instrument during surgery | |
US9289267B2 (en) | Method and apparatus for minimally invasive surgery using endoscopes | |
WO2019141704A1 (en) | An augmented reality surgical guidance system | |
US20080071141A1 (en) | Method and apparatus for measuring attributes of an anatomical feature during a medical procedure | |
KR101799281B1 (en) | Endoscope for minimally invasive surgery | |
JP2023080220A (en) | Endoscopic image of invasive procedures in narrow passages | |
EP2437676A1 (en) | Distance-based position tracking method and system | |
WO2019006456A1 (en) | Systems and methods for intraoperative planning and placement of implants | |
US20210121238A1 (en) | Visualization system and method for ent procedures | |
US9345394B2 (en) | Medical apparatus | |
KR20200132174A (en) | AR colonoscopy system and method for monitoring by using the same | |
KR20180058692A (en) | Medical device using augmented reality and short distance location tracking |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |