US20170325901A1 - Anatomical model controlling - Google Patents
Anatomical model controlling Download PDFInfo
- Publication number
- US20170325901A1 US20170325901A1 US15/593,844 US201715593844A US2017325901A1 US 20170325901 A1 US20170325901 A1 US 20170325901A1 US 201715593844 A US201715593844 A US 201715593844A US 2017325901 A1 US2017325901 A1 US 2017325901A1
- Authority
- US
- United States
- Prior art keywords
- user interface
- catheter
- input
- graphical user
- shaft
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- HQLZFBUAULNEGP-ZCFIWIBFSA-N CCC[C@@H](CC)N Chemical compound CCC[C@@H](CC)N HQLZFBUAULNEGP-ZCFIWIBFSA-N 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/25—User interfaces for surgical systems
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B18/04—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body by heating
- A61B18/12—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body by heating by passing a current through the tissue to be heated, e.g. high-frequency current
- A61B18/14—Probes or electrodes therefor
- A61B18/1492—Probes or electrodes therefor having a flexible, catheter-like structure, e.g. for heart ablation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
- G09B23/30—Anatomical models
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00315—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body for treatment of particular body parts
- A61B2018/00345—Vascular system
- A61B2018/00351—Heart
- A61B2018/00357—Endocardium
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00571—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body for achieving a particular surgical effect
- A61B2018/00577—Ablation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/25—User interfaces for surgical systems
- A61B2034/252—User interfaces for surgical systems indicating steps of a surgical procedure
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/0202—Constructional details or processes of manufacture of the input device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
Definitions
- Three-dimensional models are sometimes used to assist in the placement or use of a device when such placement or use is not easily observable or practical.
- three-dimensional models presented on a graphical user interface are used to assist in the placement and use of medical devices as part of diagnosis or treatment of patients.
- An example of such a medical procedure carried out with the assistance of a three-dimensional model presented on a graphical user interface is the use of a catheter for radio frequency (“RF”) ablation to terminate certain arrhythmias in the heart.
- RF radio frequency
- Devices, systems, and methods of the present disclosure facilitate control of a graphical user interface by a physician during a medical procedure, such as a procedure in which the physician is maneuvering a catheter in a hollow anatomic structure (e.g., a heart cavity).
- a medical procedure such as a procedure in which the physician is maneuvering a catheter in a hollow anatomic structure (e.g., a heart cavity).
- a variety of options related to the medical procedure can be presented to the physician during the medical procedure by presenting subsets of actions to the physician on the graphical user interface on a state-dependent basis, with the state at any given time depending on the context of the action being performed by the physician at the given time.
- the presentation of subsets of actions to the physician on a state-dependent basis can, for example, facilitate control of the graphical user interface by the physician using an input device with only a few input sources (e.g., buttons).
- the simplified input interface associated with the devices, systems, and methods of the present disclosure can improve the ability of the physician to manipulate the graphical user interface, of a graphical representation of the hollow anatomic structure, or both while the physician is also manipulating the catheter. Additionally, or alternatively, the devices, systems, and methods of the present disclosure can facilitate control of the graphical user interface and/or the graphical representation of the hollow anatomic structure from within the sterile field and, optionally, without the assistance of a person outside of the sterile field.
- Such autonomy of control by the physician can, for example, simplify medical procedures by reducing, or even eliminating, the need for the physician to communicate with a person outside of the sterile field to achieve desired control over the graphical user interface and, further or instead, control over the graphical representation of the hollow anatomic structure.
- a method includes receiving a signal indicative of location of a cardiac catheter in a cavity of a patient's heart, displaying, on a first portion of a graphical user interface, a graphical representation of the cavity of the patient's heart, the graphical representation based on the received location signal from the cardiac catheter, receiving, from a first input device, a first input command based on a first set of input options displayed on the first portion of the graphical user interface, receiving, from a second input device, a second input command based on a second set of input options displayed on a second portion of the graphical user interface, and, based on the first input command and the second input command, modifying the graphical representation in the first portion of the graphical user interface.
- modifying the graphical representation can include adjusting the displayed graphical representation according to an order in which the first input command and the second input command are received.
- At least some of the second set of input options can be the same as some of the first set of input options.
- receiving the first input command can include receiving the first input command along a first communication channel and receiving the second input command can include receiving the second input command along a second communication channel, each communication channel dedicated to the respective portion of the graphical user interface.
- the method can further include receiving navigation commands for moving, within the second portion of the graphical user interface, between the options in the second set of input options.
- the second set of input options represented on the second portion of the graphical user interface can correspond to a current state of a state machine having a plurality of states.
- the second input command or at least one of the navigation commands can change a current state of a state machine.
- the second input command or at least one of the navigation commands can change a top-level state of the current state of the state machine.
- the navigation commands can include commands to change the top-level state of the current state of the state machine between a build state, a view state, and a tag state.
- representing the current state in the second portion of the graphical user interface can include representing input command options to start and to stop building a three-dimensional representation, shown in the first portion of the graphical user interface, of the cavity of the patient's heart.
- representing the current state in the second portion of the graphical user interface includes representing options to turn an automatic view control on and off.
- representing the current state in the second portion of the graphical user interface can include a selection of identifiers corresponding to anatomic features of the heart cavity.
- the navigation commands can include discrete direction commands.
- the discrete direction commands can include commands for left, right, up, and down navigation in the second portion of the graphical user interface.
- At least one of the navigation commands can scroll through the second set of options displayed as an infinite wheel.
- the method can further include detecting receipt of an initial command, the initial command being one of the second input command or one of the navigation commands, and, based on the detected receipt of the initial command, changing one or more display features of the second portion of the graphical user interface.
- changing the one or more display features of the second portion of the graphical user interface can include displaying, in the second portion of the graphical user interface, additional input options of the second set of input options.
- changing one or more display features of the second portion of the graphical user interface can include changing the one or more display features of the second portion, relative to the first portion of the graphical user interface, between a baseline configuration and modified configuration.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between a baseline configuration and a modified configuration can include changing a size of the second portion of the graphical user interface relative to a size of the first portion of the graphical user interface.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing an opacity of the second portion of the graphical user interface relative to an opacity of the first portion of the graphical user interface.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing a position of the second portion of the graphical user interface relative to a position of the first portion of the graphical user interface.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between the baseline configuration and the modified configuration can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration if a time between receipt of a first one of the input commands and receipt of a second one of the input commands exceeds a predetermined inactivity threshold period.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between the baseline configuration and the modified configuration can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration based on a received input command of the second set of input commands.
- the first portion can be viewable on the graphical user interface at the same time that the second portion can be viewable on the graphical user interface.
- modification of the displayed graphical representation can include adjusting an orientation of a displayed view of the graphical representation of the heart cavity of the patient.
- adjusting the orientation of the displayed view of the graphical representation of the heart cavity of the patient can include rotating the graphical representation of the heart cavity about an axis.
- modifying the displayed graphical representation in the first portion of the graphical user interface can include modifying a pose of the graphical representation in the first portion of the graphical user interface.
- the second input command can include a discrete selection command.
- receiving the second input command can include receiving a wireless input command.
- the second input device can be a remote device and receiving the second input command can include receiving an input command from the remote device.
- the second input device can be releasably coupled to a handle of the cardiac catheter.
- a method includes receiving as signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying, on a graphical user interface, a graphical representation of the location of the catheter tip in the cavity of the patient's heart, receiving, from a first input device, a first input command responsive to a first set of input options displayed on the graphical user interface, receiving, from a second input device separate from the first input device, navigation commands and a second input command, the navigation commands for moving through a second set of input options, and the second input command responsive to the second set of input options displayed on the graphical user interface, and based on the first input command and the second input command, modifying the displayed graphical representation.
- modifying the graphical representation can include modifying the graphical representation according to an order in which the first input command and the second input command are received.
- the method can further include displaying the first set of input options on a first portion of the graphical user interface, and displaying the second set of input options on a second portion of the graphical user interface.
- the second set of input options can include available transitions of a state machine. Additionally, or alternatively, the second set of input options displayed on the graphical user interface are based on a current state of the state machine.
- receiving the navigation commands can include receiving discrete directional commands for moving through the second set of input options.
- the discrete directional commands can correspond to right, left, up, and down navigation through the second set of input options.
- receiving the navigation commands can include receiving an analog command for navigating through the second set of input options.
- the second set of input options can be arranged in an infinite wheel and receiving the navigation commands can include receiving a scroll command for moving through states of the infinite wheel.
- the method can further include modifying, based on the received navigation commands, one or more display features of the second set of input options between a baseline configuration and a modified configuration. For example, a size of the displayed second set of input options to relative to a size of the displayed first set of input options can be greater in the modified configuration than in the baseline configuration. Additionally, or alternatively, an opacity of the displayed second set of input options relative to an opacity of the first set of input options can be greater in the modified configuration than in the baseline configuration. Further, or instead, a position of the second set of input options relative to the first set of input options on the graphical user interface can be different in the modified configuration than in the baseline configuration.
- modifying the one or more display features of the second set of input options between a baseline configuration and a modified configuration can include changing the second set of input options from the modified configuration to the baseline configuration if a time between receipt of a first input command and receipt of a second input command exceeds a predetermined inactivity threshold period.
- modifying the one or more display features of the second set of input options between a baseline configuration and a modified configuration can include changing the second set of input options from the baseline configuration to the modified configuration if an input command of the second set of input options is received.
- a non-transitory, computer-readable storage medium has stored thereon computer executable instructions for causing one or more processors to perform operations including receiving a signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying, on a graphical user interface, a graphical representation of the location of the catheter tip in the cavity of the patient's heart, receiving, from a first input device, a first input command responsive to a first set of input options displayed on the graphical user interface, receiving, from a second input device separate from the first input device, navigation commands and a second input command, the navigation commands for moving through a second set of input options, and the second input command responsive to the second set of input options displayed on the graphical user interface, and, based on the first input command and the second input command, modifying the graphical representation on the graphical user interface.
- the operations can further include displaying the first set of input options on a first portion of the graphical user interface, and displaying the second set of input options on a second portion of the graphical user interface.
- receiving the navigation commands can include receiving an analog command for navigating through the second set of input options.
- the operations can further include modifying, based on the received navigation commands, one or more display features of the second set of input options between a baseline configuration to a modified configuration.
- a catheter includes a catheter shaft having a proximal end region and a distal end region, a handle portion coupled to the proximal end region of the catheter shaft, an articulation controller supported on the handle portion, the articulation controller in mechanical communication with the catheter shaft to modify a position of the distal end region of the catheter shaft, and a graphical user interface (GUI) controller coupled to the handle portion and disposed relative to the articulation controller along the handle portion such that a user can maintain the distal end region of the catheter in place while manipulating the GUI controller.
- GUI graphical user interface
- the GUI controller can be configured for communication with a graphical representation of at least a portion of the catheter on a GUI.
- the GUI controller can be disposed relative to the articulation controller along the handle portion such that the user can manipulate the GUI controller and the articulation controller through one-handed operation.
- the GUI controller can be disposed relative to the articulation controller along the handle portion such that the user can manipulate the GUI controller and the articulation controller using the same grip of the handle portion.
- the GUI controller can be releasably coupled to the handle portion.
- the GUI controller can be rotatably coupled to the handle portion such that the GUI controller is rotatable about an axis defined by the catheter shaft.
- the GUI controller can be rotatable about 180 degrees of a circumference of the catheter shaft.
- the GUI controller can be freely rotatable about a circumference of the catheter shaft.
- the GUI controller can include discrete navigation inputs.
- the navigation inputs can include right, left, up, and down navigation inputs.
- the GUI controller can include a capacitive touch portion.
- the GUI controller can be coupled to the handle portion distal to the articulation controller.
- the GUI controller can include one or more inputs and the articulation controller can be moveable along a plane substantially perpendicular to a direction of movement of the one or more inputs.
- the GUI controller can include an orientation feature extending from a surface of the GUI controller to provide tactile feedback to the user regarding a position of the user's hand with respect to the GUI controller.
- the GUI controller is sterilizable.
- the GUI controller can be formed of components compatible with one or more of the following sterilization techniques: ethylene oxide sterilization, autoclave sterilization, gamma radiation, gas-plasma sterilization.
- the catheter can further include at least one electrode mechanically coupled to the distal end region of the catheter shaft.
- the at least one electrode can be disposed along an expandable element coupled to the distal end region of the catheter shaft.
- the GUI controller can be configured for communication with a remote graphical user interface.
- the GUI controller can include a transmitter.
- the GUI controller includes a wireless transmitter.
- a system includes a graphical user interface, one or more processors, a first input device in communication with the one or more processors, a second input device separate from the first input device, the second input device in communication with the one or more processors, and a non-transitory, computer-readable storage medium having stored thereon computer executable instructions for causing one or more processors to perform operations including receiving a signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying, on the graphical user interface, a graphical representation of the cavity of the patient's heart, receiving, from the first input device, a first input command responsive to a first set of input options displayed on the graphical user interface, receiving, from the second input device separate from the first input device, navigation commands and a second input command, the navigation commands for moving through a second set of input options, and the second input command responsive to the second set of input options displayed on the graphical user interface, and, based on the first input command and the second input command, modifying the displayed
- a remote communication device includes a user interface including one or more inputs, a transmitter in communication with the user interface to send one or more control commands to a remote processor, and a housing carrying the user interface and the transmitter, the housing securable to an outer circumference of a catheter shaft with the user interface at least partially constrained in at least one direction relative to the catheter shaft.
- the transmitter includes a wireless transmitter.
- the user interface can be at least partially constrained in a radial direction relative to the catheter shaft. Additionally, or alternatively, with the housing secured to the outer circumference of the catheter shaft, the user interface can be movable less than about 1 cm in the radial direction relative to the catheter shaft. Further, or instead, with the housing secured to the outer circumference of the catheter shaft, the user interface can be entirely constrained in the radial direction relative to the catheter shaft. Still further, or instead, with the housing secured to the outer circumference of the catheter shaft, the one or more inputs of the user interface can be depressible in a direction parallel to the at least one partially constrained direction of the user interface.
- the user interface can be movable along an axis defined by the catheter shaft.
- the user interface can be rotatable about the catheter shaft.
- the user interface can be rotatable about an axis of rotation coaxial with an axis defined by the catheter shaft.
- the user interface can be rotatable 360 degrees about the catheter shaft.
- the one or more inputs can be depressible in a direction transverse to the axis of rotation of the user interface.
- the user interface can be rotatable relative to a handle coupled to the catheter shaft.
- the housing can define a recess positionable about at least a portion of the outer circumference of the catheter shaft.
- the portion of the housing defining the recess can include a first section and a second section releasably engageable with the first section to define the recess.
- the second section can be releasably engageable with the first section through an interference fit.
- the first section of the housing can include a first material
- the second section of the housing can include a second material magnetically attracted to the first material
- the first section and the second section of the housing can be releasably engageable to one another through a magnetic force between the first material and the second material.
- first section and the second section can each define a portion of the recess.
- first section and the second section can each define substantially half of the recess.
- portion of the housing defining the recess can further include a hinge disposed between the first section and the second section, the hinge pivotable to move the first section and the second section into releasable engagement with one another.
- the housing can include a clip positionable about at least a portion of the outer circumference of the catheter shaft.
- the housing can be securable in a fixed axial position relative to the catheter shaft.
- the housing can be securable in the fixed axial position relative to the catheter shaft through an interference fit between the outer circumference of the catheter shaft and the housing.
- the one or more inputs can include a capacitive touch portion.
- the housing can be formed of material compatible with sterilization.
- the remote communication device can further include a cover enclosing the housing and the user interface, the cover removable from the housing and the user interface, and the cover formed of material compatible with one or more of the following sterilization techniques: ethylene oxide sterilization, autoclave sterilization, gamma radiation, gas-plasma sterilization.
- the housing can define a volume and the transmitter is disposed within the volume.
- the one or more inputs can be at least partially disposed outside of the volume.
- the volume can be substantially resistant to fluid ingress.
- the remote communication device can further include a power source in communication with the transmitter, the power source carried by the housing.
- the power source can be, for example, releasably coupled to the housing.
- the remote communication device can further include a processor carried by the housing, the processor in communication with the user interface and the transmitter.
- a method includes positioning a remote communication device about shaft of a catheter, the shaft having a proximal end region coupled to a handle and a distal end region coupled to an electrode, and securing the remote communication device to an outer circumference of the shaft, along the proximal end region of the shaft, the remote communication device including a housing, a user interface, a transmitter (e.g., a wireless transmitter) in electrical communication with the user interface to send one or more control commands to a remote processor, the housing carrying the user interface and the transmitter, wherein the user interface includes one or more inputs and, with the remote communication device secured to the outer circumference of the shaft, the user interface is at least partially constrained in at least one direction relative to the shaft.
- a transmitter e.g., a wireless transmitter
- the remote communication device can be secured to the outer circumference of the shaft, the user interface can be at least partially constrained in a radial direction relative to the shaft.
- the user interface can be movable less than about 1 cm in the radial direction relative to the shaft.
- the user interface can be entirely constrained in the radial direction relative to the shaft.
- the one or more inputs of the user interface can be depressible in a direction parallel to the at least one partially constrained direction of the user interface.
- the user interface can be movable along an axis defined by the shaft.
- the user interface can be rotatable about an axis of rotation coaxial with an axis defined by the shaft.
- the user interface can be rotatable 360 degrees about the axis of rotation.
- the one or more inputs can be depressible in a direction transverse to the axis of rotation of the user interface.
- the user interface can be rotatable relative to the handle coupled to the shaft.
- the housing can define a recess, and securing the remote communication device to the proximal end region of the shaft can include positioning the recess about at least a portion of the outer circumference of the shaft.
- the portion of the housing defining the recess can include a first section and a second section, and securing the remote communication device to the proximal end region of the shaft can include coupling the first section and the second section to one another about the proximal end region of the shaft.
- the housing can be secured to the proximal end region of the shaft with the housing extending distal to the handle.
- the housing can be secured to the proximal end region of the shaft such that the housing is adjacent to the handle.
- the housing can be mechanically coupled to the handle.
- the method can further include pressing the one or more inputs to generate one or more control commands based on the one or more inputs. Additionally, or alternatively, the method can further include wirelessly transmitting one or more control commands to a processor remote from the remote communication device.
- a system includes a catheter, a catheter interface unit, and a remote communication device.
- the catheter includes a handle, a tip portion, a shaft having a proximal end region and a distal end region, the proximal end region coupled to the handle, and the distal end region coupled to the tip portion.
- the catheter interface unit includes a processing unit and a graphical user interface.
- the remote communication device is coupled to the proximal end region of the shaft of the catheter, the remote communication device including a user interface and a wireless transmitter in communication with the user interface to send one or more control commands to the processing unit of the catheter interface unit, the one or more control commands corresponding to a set of input options displayed on the graphical user interface.
- the distal end region of the shaft can be directly coupled to the tip portion.
- movement of the user interface can be constrained in at least one direction with respect to the shaft of the catheter and the one or more inputs of the user interface are depressible in a direction parallel to the at least one constrained direction of the user interface.
- the remote communication device can be at least partially constrained in a radial direction relative to the shaft.
- the user interface can be movable less than about 1 cm in the radial direction relative to the shaft.
- the user interface can be entirely constrained in the radial direction relative to the shaft.
- the user interface can be movable along an axis defined by the shaft of the catheter.
- the user interface can be rotatable about an axis defined by the shaft of the catheter.
- the user interface can be rotatable relative to the handle.
- the remote communication device can be coupled to the proximal end region of the shaft of the catheter at a fixed axial position of the shaft.
- the remote communication device can further include a housing, a portion of the housing defining a recess extending circumferentially about an outer surface of the shaft of the catheter.
- the remote communication device can be coupled to the proximal end region of the shaft through an interference fit between the portion of the housing defining the recess and the proximal end region of the shaft of the catheter.
- the remote communication device can be releasably coupled to the proximal end region of the shaft of the catheter.
- the catheter can further include an articulation controller supported on the handle, the articulation controller in mechanical communication with the shaft of the catheter to modify a position of the distal end region of the shaft.
- the remote communication device can be distal to the articulation controller.
- the remote communication device can be electrically and fluidically isolated from the handle and from the shaft of the catheter.
- the one or more inputs of the user interface can be positioned relative to the shaft of the catheter such that the one or more inputs are manipulatable by a hand of the user while the same hand of the user applies an axial force to the shaft.
- the one or more inputs of the user interface can be positioned relative to the shaft of the catheter such that the one or more inputs are manipulatable by a hand of the user while the same hand of the user applies torque to the handle of the catheter.
- Embodiments can include one or more of the following advantages.
- the graphical representation of the cavity of the patient's heart can be modified based on input commands received from the first input device and from the second input device.
- control of the graphical representation of the cavity can be advantageously split between two users.
- the divided control provided by the first input device and the second input device can facilitate receiving direct input from the physician, which can result in more efficient modification of the graphical representation.
- the graphical representation can also be controlled by a technician operating the first input device, functionality associated with complex manipulation and/or modification of the graphical representation can be retained.
- the second set of input options can correspond to a current state of a state machine having a plurality of states. Because the state of the state machine changes dynamically according to a given set of events associated with the medical procedure and/or inputs from the second input device, robust functionality can be provided to the physician through relatively few inputs on the second input device. Such relatively few inputs on the second input device can be useful, for example, for facilitating one-handed operation of the second input device. Additionally, or alternatively, the relatively few inputs on the second input device can facilitate integrating the control functionality of the second input device into the handle of the catheter. Further in addition, or further in the alternative, the simple interface of the second input device can advantageously reduce the physician's need to look at the second input device, which can be useful for maintaining the physician's focus on the graphical user interface during a medical procedure.
- FIG. 1 is a schematic representation of a system during a medical treatment, the system including a catheter, a catheter interface unit, a first input device, and a second input device.
- FIG. 2 is a top view of the catheter of the system of FIG. 1 .
- FIG. 3 is a schematic representation of a tip portion of the catheter of FIG. 2 , with the tip portion depicted as inserted into a heart cavity of the patient of FIG. 1 .
- FIG. 4 is a schematic representation of a graphical user interface of the system of FIG. 1 .
- FIG. 5 is a schematic representation of a state machine corresponding to menu options on a second portion of the graphical user interface of FIG. 4 .
- FIG. 6 is a flowchart of an exemplary method of controlling a graphical representation on the graphical user interface of the system of FIG. 1 .
- FIG. 7 is a flowchart of an exemplary method of controlling a graphical representation on the graphical user interface of the system of FIG. 1 .
- FIG. 8 is a schematic representation of a system during a medical treatment, the system including a catheter, a catheter interface unit, a first input device, and a second input device separate from the catheter.
- FIG. 9 is a schematic representation of a system during a medical treatment, the system including a catheter, a catheter interface unit, a first input device, and a second input device.
- FIG. 10 is an isometric view of the catheter and the second input device of FIG. 9 .
- FIG. 11 is a side view of the second input device and a portion of the catheter of FIG. 9 .
- FIG. 12 is an isometric view of the second input device of FIG. 9 .
- the present disclosure is generally directed to devices, systems, and methods of facilitating a physician's interactions with a graphical user interface associated with a medical procedure being performed by the physician.
- the devices, systems, and methods of the present disclosure can facilitate the physician's ability to modify a representation of a three-dimensional model on the graphical user interface autonomously (e.g., without assistance from a second person), without interfering with the physician's ability to control the catheter during the medical procedure.
- the devices, systems, and methods of the present disclosure are described with respect to the use of a catheter in a heart cavity of a patient during a medical procedure (e.g., cardiac ablation).
- systems and methods of the present disclosure can be used for any of various different medical procedures in which it is desirable for a physician to interact with a graphical user interface autonomously while simultaneously maintaining control over the medical device used as part of the medical procedure.
- the term “physician” should be considered to include any type of medical personnel who may be directly interacting with a catheter as part of a medical procedure and is used interchangeably herein with the term “user.”
- treatment should be considered to include any manner and type of medical procedure involving the use of a catheter and, therefore, should be considered to include diagnosis, treatment, and combinations thereof, unless otherwise specified or made clear from the context.
- FIG. 1 is a schematic representation of a system 100 during a cardiac treatment (e.g., an ablation treatment) performed on a patient 102 .
- the system 100 can include a catheter interface unit 104 in communication (e.g., wired or wireless communication) with a catheter 106 , a first input device 108 , and a second input device 110 .
- the catheter interface unit 104 can be in communication with the catheter 106 via an extension cable 111 and, additionally or alternatively, in wireless communication with one or more of the first input device 108 and the second input device 110 .
- the catheter interface unit 104 can include a processing unit 112 , a non-transitory, computer readable storage medium 114 , and a graphical user interface 116 .
- the processing unit 112 can be a controller including one or more processors, and the storage medium 114 can have stored thereon computer executable instructions for causing the one or more processors of the processing unit 112 to carry out one or more of the various methods described herein.
- the catheter interface unit 104 can include additional features, including, without limitation, one or more of the following: current generation; magnetic field generation; magnetic field sensing, and the like.
- the first input device 108 can be a computer (e.g., a desktop computer, a laptop computer, or both), or other, similar input device.
- the first input device 108 can be operated, for example, by a technician outside of a sterile field, while the second input device 110 can include a simple interface suitable for operation by the physician within the sterile field.
- the catheter interface unit 104 can receive one or more input commands from the first input device 108 and from the second input device 110 , in response to respective input options on the graphical user interface 116 . Based on the received one or more input commands, the catheter interface unit 104 can modify a three-dimensional model of a heart cavity of the patient 102 displayed on the graphical user interface 116 .
- the input options available to be controlled by the second input device 110 on the graphical user interface 116 can be state-dependent, as also described in greater detail below, such that the second input device 110 can be used to interact extensively with the graphical user interface 116 through the use of only a few input sources (e.g., buttons) on the second input device 110 . That is, the input options corresponding to the input sources on the second input device 110 at any given time during a medical procedure can be displayed on the graphical user interface 116 .
- these input options can change according to a state of a state machine, which itself can change according to context (e.g., based on one or more previous actions, a current state, or a combination of both) and/or inputs.
- the meaning of pressing a particular input source can change based on the state of the state machine, and the meaning of the particular input source at any given time can be displayed to the physician via the graphical user interface 116 .
- the dynamic interaction between the second input device 110 and the graphical user interface 116 can facilitate the use of the state machine which, in turn, can facilitate achieving a given level of control over the graphical user interface 116 using fewer input sources on the second input device 110 .
- the second input device 110 can be made into a form factor suitable for integration into a medical device such as the catheter 106 , as described in further detail below.
- a physician can use the second input device 110 to interact with the graphical user interface 116 while maintaining control over the catheter 106 during the medical procedure and, thus, while remaining in a sterile field.
- the limited number of input sources on the second input device 110 can make it easier for the physician to use the second input device 110 to interact with the graphical user interface 116 with less of a need to switch focus between the graphical user interface 116 and the second input device 110 .
- the physician has less of a need to look at the second input device 110 during operation of the second input device 110 .
- the simplified inputs of the second input device 110 can facilitate continuous manipulation of the catheter 106 by the physician, particularly in instances in which the physician must look at the graphical user interface 116 to manipulate the catheter 106 during a medical procedure.
- the catheter 106 can include a catheter shaft 118 , a handle portion 120 , and a tip portion 122 .
- the catheter shaft 118 includes a proximal end region 124 and a distal end region 126 .
- the handle portion 120 is coupled to the proximal end region 124 and the tip portion 122 is coupled to the distal end region 126 .
- the second input device 110 can be coupled to the handle portion 120 and can communicate with the graphical user interface 116 such that the second input device 110 should be understood to be a graphical user interface (GUI) controller according to all aspects of the present disclosure.
- GUI graphical user interface
- An articulation controller 128 can also, or instead, be supported on the handle portion 120 .
- the second input device 110 can be operated to communicate with the catheter interface unit 104 (e.g., with the processing unit 112 ) such that commands received by the catheter interface unit 104 from the second input device 110 can form the basis of one or more changes to a three-dimensional model of a heart cavity of the patient 102 displayed on the graphical user interface 116 while the articulation controller 128 can be operated to move the tip portion 122 of the catheter 106 in the heart cavity.
- the second input device 110 can be in remote communication with the graphical user interface 116 and, for example, can include a transmitter (e.g., a wired transmitter, a wireless transmitter, or both) for such remote communication.
- a transmitter e.g., a wired transmitter, a wireless transmitter, or both
- communication between the second input device 110 and the catheter interface unit 104 can be via wires 111 extending from the catheter 106 to the catheter interface unit 104 .
- communication between the second input device 110 and the catheter interface unit 104 can include communication via any of various different known wireless communication protocols.
- An example of such a wireless communication protocol is Bluetooth®, a wireless standard available from Bluetooth SIG, Inc. While a standardized communication protocol, such as Bluetooth®, may be useful for pairing off-the-shelf hardware components, it should be appreciated that a customized communication protocol can be useful for avoiding interference with the communication between the second input device 110 and the catheter interface unit 104 .
- the form factor of the second input device 110 can be based on one or more of the size of the handle portion 120 and the orientation of the second input device 110 relative to the articulation controller 128 .
- a small form factor of the second input device 110 can be desirable for sizing the handle portion 120 , for example, for ease of operation by the physician (e.g., one-handed operation).
- the second input device 110 can include a small number of input options (e.g., less than ten) arranged relative to one another in a space-efficient and, or instead, intuitive manner.
- the simple interface provided by the second input device 110 can, in certain instances, be used by the physician without requiring the physician to look at the second input device 110 , making it easier for the physician's attention to remain on the graphical user interface 116 during a medical procedure. It should be appreciated, however, that providing a physician with access to a diverse set of actions on the graphical user interface 116 can additionally, or alternatively, be desirable.
- the simple interface of the second input device 110 can cooperate with the graphical user interface 116 to provide the physician with state-dependent functionality, on the graphical user interface 116 , which can be both useful for a given state of the medical procedure and easily navigated using the small number of inputs on the second input device 110 .
- the second input device 110 can include inputs 130 a , 130 b , 130 c , 130 d , 130 e spatially arranged relative to one another to facilitate intuitive navigation, using the second input device 110 , through one or more menus on the graphical user interface 116 .
- the inputs 130 a , 130 b , 130 c , 130 d can be discrete navigation inputs separate from one another.
- the navigation inputs 130 a , 130 b , 130 c , 130 d can be arranged in a right ( 130 a ), left ( 130 b ), up ( 130 c ), and down ( 130 d ) configuration relative to one another such that pressing the right navigation input 130 a corresponds to navigation to the right in a menu displayed on the graphical user interface 116 , pressing the left navigation input 130 b corresponds to navigation to the left in a menu displayed on the graphical user interface 116 , etc.
- the input 130 e can be an “enter” input and can be arranged, for example, substantially in the middle of the navigation inputs 130 a , 130 b , 130 c , 130 d .
- the press time and/or number of presses e.g., single click versus double click
- the press time and/or number of presses associated with pressing one or more of the inputs 130 a , 130 b , 130 c , 130 d , and 130 e can be used to achieve further functionality of the second input device 110 using a limited number of inputs.
- a long press time of one or more of the inputs 130 a , 130 b , 130 c , 130 d , and 130 e can change a high level state of the state machine controlled by the second input device 110 while a short press time of one or more of the inputs 130 a , 130 b , 130 c , 130 d , and 130 e can scroll through a lower level state of the state machine controlled by the second input device 110 .
- the navigation inputs 130 a , 130 b , 130 c , 130 d can be, in certain instances, buttons that are pressed to provide input to the second input device 110 .
- the second input device 110 can include a capacitive touch portion such that, for example, a sliding motion (e.g., of a finger) across the capacitive touch portion can be a navigation input transmitted by the second input device 110 to the graphical user interface 116 .
- the capacitive touch portion can be arranged, in certain instances, as a circle such that a sliding motion detected around the circle is interpreted as a navigation input corresponding to scrolling (e.g., through a menu on the graphical user interface 116 ).
- the capacitive touch portion can include any one or more of the inputs 130 a , 130 b , 130 c , 130 d , 130 e . More generally, the inputs 130 a , 130 b , 130 c , 130 d , 130 e can be any of various different types, alone or in combination with one another and can, in addition or optionally, be of any number useful for navigating through one or more menus displayed on the graphical user interface 116 .
- a combination of the number, size, and shape of the inputs 130 a , 130 b , 130 c , 130 d , 130 e is such that the user can distinguish the buttons by feel.
- the inputs 130 a , 130 b , 130 c , 130 d , 130 e are in a constant position relative to one another and in a relatively constant position with respect to an axis defined by the catheter 106 (e.g., with respect to an axis defined by the catheter shaft 118 ).
- the inputs 130 c and 130 d are typically to the physician's right and left as the physician grips the handle 120 .
- the inputs 130 a and 130 b can be in similarly predictable positions with respect to the physician's hand, given that the inputs 130 a and 130 b are in a fixed position relative to the inputs 130 c and 130 d.
- the second input device 110 can include an orientation feature 132 extending from a surface of the second input device 110 .
- the orientation feature 132 can extend from a surface of the up navigation input 130 c .
- the orientation feature 132 can provide tactile feedback to the physician regarding the position of the physician's hand with respect to the second input device 110 .
- the physician can use tactile feedback from the orientation feature 132 to discern, without needing to look at the second input device 110 , the position of the physician's hand with respect to the inputs 130 a , 130 b , 130 c , 130 d , 130 e .
- This can be useful, for example, for facilitating switching back and forth, by the physician, between the operation of the articulation controller 128 and the second input device 110 .
- the second input device 110 can be disposed relative to the articulation controller 128 along the handle portion 120 . More generally, according to any one or more of the various different arrangements of the second input device 110 relative to the articulation controller 128 described herein, the physician can operate the second input device 110 to modify the graphical user interface 116 to achieve a desired view of the tip portion 122 of the catheter 106 on the graphical user interface 116 and, based on this desired view on the graphical user interface 116 , can operate the articulation controller 128 to move the tip portion 122 of the catheter 106 to a desired location (e.g., into contact with tissue).
- a desired location e.g., into contact with tissue
- the physician can control (e.g., maintain in place) the distal end region 126 of the catheter shaft 118 while simultaneously manipulating the second input device 110 according to any one or more of the methods described herein. Accordingly, it should be understood that such relative positioning of the articulation controller 128 relative to the second input device 110 along the handle portion 120 can include any of various different configurations that advantageously facilitate coordinated operation of the articulation controller 128 and the second input device 110 .
- the second input device 110 can be disposed relative to the articulation controller 128 along the handle portion 120 such that the physician can manipulate the second input device 110 and the articulation controller 128 through one-handed operation.
- one-handed operation should be understood to include manipulating the second input device 110 substantially simultaneously with manipulation of the articulation controller 128 using any combination of fingers of a single hand of the physician while the single hand of the physician maintains the same grip of the handle portion 120 ), leaving the physician with a free hand during the medical procedure.
- Such one-handed operation of the second input device 110 and the articulation controller 128 can be useful, for example, for allowing the physician to grip the catheter shaft 118 with a free hand to maintain the distal end region 126 in place in the heart cavity of the patient 102 .
- the second input device 110 can be coupled to the handle portion 120 at a position distal to the articulation controller 128 to facilitate operation of the articulation controller 128 with a thumb and manipulation of the second input device 110 with an index finger of the same hand while that hand maintains a natural grip of the handle portion 120 .
- the second input device 110 can be coupled to the handle portion 120 along an axial position at which the articulation controller 128 is positioned on the handle portion 120 .
- the articulation controller 128 can be movable, in certain instances, along a plane substantially perpendicular to a direction of movement of one or more of the inputs 130 a , 130 b , 130 c , 130 d , 130 e .
- Such an orientation of the articulation controller 128 relative to the inputs 130 a , 130 b , 130 c , 130 d , 130 e can be useful directing forces associated with manipulation of the articulation controller 128 in a direction different from a direction of forces associated with the one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e , which can facilitate substantially simultaneous but substantially independent operation of the articulation controller 128 and the one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e.
- one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e can be positioned to facilitate other types of one-handed operation.
- the one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e can be positioned relative to the catheter shaft 118 such that the one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e are manipulatable by a hand of the user while the same hand of the user applies an axial force to the catheter shaft 118 (e.g., through gripping the catheter shaft 118 between a thumb and another finger of a single hand).
- the one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e can be positioned relative to the catheter shaft 118 such that one or more inputs 130 a , 130 b , 130 c , 130 d , 130 e are manipulatable by a hand of the user while the same hand of the user applies torque to the handle portion 120 .
- the second input device 110 can be rotatably coupled to the handle portion 120 such that the second input device 110 is rotatable about a circumference of the catheter shaft 118 .
- operation of the second input device 110 and the articulation controller 128 can include rotating the second input device 110 relative to the catheter shaft 118 and, thus, relative to the articulation controller 128 to bring the second input device 110 into proximity to the articulation controller 128 and/or to the physician's hand during a procedure. Accordingly, it should be appreciated that rotation of the second input device 110 relative to the catheter shaft 118 can, in certain instances, facilitate one-handed operation of the second input device 110 and the articulation controller 128 .
- the second input device 110 can be, for example, rotatable (e.g., between zero degrees and about 180 degrees) about the circumference of the catheter shaft 118 .
- the second input device 110 can rotate freely about the circumference of the catheter shaft 118 such that the second input device 110 can be moved unimpeded about the circumference of the catheter shaft 118 through multiple rotations in any given direction.
- Such free rotation of the second input device 110 can facilitate moving the second input device 110 quickly into a desired position.
- the physician can spin the second input device 110 into a desired position.
- the physician can move the second input device 110 into place using any finger that might not otherwise be engaged during a medical procedure.
- the second input device 110 can be releasably coupled to the handle portion 120 .
- a releasable coupling between the second input device 110 and the handle portion 120 can include a pin-and-socket configuration in which electrical communication and mechanical coupling between the second input device 110 and the handle portion 120 are established at substantially the same time as pins extending from the second input device 110 are inserted into corresponding sockets defined by the handle portion 120 .
- the second input device 110 can be sterilizable.
- the second input device 110 can be formed of components compatible with sterilization according to one or more of the following sterilization techniques: ethylene oxide sterilization, autoclave sterilization, gamma radiation, gas-plasma sterilization.
- the second input device 110 can be sterilizable separately from the handle portion 120 .
- the second input device 110 can be reusable such that the second input device 110 can be sterilized between uses and secured to a new handle portion 120 for each use.
- the articulation controller 128 can be in mechanical communication with the catheter shaft 118 .
- the articulation controller 128 can modify the position of the distal end region 126 of the catheter shaft 118 and, thus, modify the position of the tip portion 122 of the catheter 106 .
- one or more pull wires (not shown) can couple the articulation controller 128 to the catheter shaft 118 as is known in the art.
- Operation of the articulation controller 128 can move one or more of the pull wires in a proximal direction to create a deflection force at the distal end region 126 of the catheter shaft 118 .
- the articulation controller 128 can include one or more levers rotatable about an axis substantially perpendicular to an axis defined by the handle portion 120 , with the rotation of the articulation controller 128 moving one or more of the pull wires to deflect the distal end region 126 of the catheter shaft 118 .
- the articular controller 128 can include a plunger (e.g., proximal or distal to the handle portion 120 ) movable along an axis substantially parallel to an axis defined by the handle portion 120 , with proximal and distal movement of the articulation controller 128 moving one or more pull wires to move the distal end region 126 of the catheter shaft between a deflected position and a straight position. Because the tip portion 122 is coupled to the distal end region 126 of the catheter shaft 118 , the deflection force at the distal end region 126 of the catheter shaft 118 can deflect the tip portion 122 .
- a plunger e.g., proximal or distal to the handle portion 120
- proximal and distal movement of the articulation controller 128 moving one or more pull wires to move the distal end region 126 of the catheter shaft between a deflected position and a straight position.
- articulation controller 128 has been described as being in mechanical communication with the catheter shaft 118 via one or more pull wires, it should be appreciated the articulation controller 128 can additionally, or alternatively, be in mechanical communication with the catheter shaft 118 through any one or more methods known in the art (e.g., through torque transmitted via a rotating member).
- the catheter 106 can further, or instead, include a magnetic position sensor 133 along the distal end region 126 of the catheter shaft 118 .
- the magnetic position sensor 133 can be any of various magnetic position sensors well known in the art and can be positioned at any point along the distal end region 126 .
- the magnetic position sensor 133 can, for example, include one or more coils that detect signals emanating from magnetic field generators. One or more coils for determining position with five or six degrees of freedom can be used.
- the magnetic field detected by the magnetic position sensor 133 can be used to determine the position of the distal end region 126 of the catheter shaft 118 according to one or more methods commonly known in the art such as, for example, methods based on using a sensor, such as the magnetic position sensor 133 , to sense magnetic fields and using a look-up table to determine location of the magnetic position sensor 133 . Because the tip portion 122 is coupled to the distal end region 126 of the catheter shaft 118 in a known, fixed relationship to the magnetic position sensor 133 , the magnetic position sensor 133 can provide the location of the tip portion 122 . While the location of the tip portion 122 is described as being determined based on magnetic position sensing, other position sensing methods can additionally or alternatively be used. For example, the location of the tip portion 122 can be additionally, or alternatively, based on impedance, ultrasound, and/or imaging (e.g., real time MRI or fluoroscopy).
- impedance, ultrasound, and/or imaging e.g., real time MRI or
- the tip portion 122 can be one or more of a diagnostic tip and a treatment tip for directing energy (e.g., RF energy, ultrasound energy, chemical energy) toward tissue of the heart cavity.
- the tip portion 122 can include at least one electrode mechanically coupled (e.g., directly coupled or indirectly coupled) to the distal end region 126 of the catheter shaft 118 .
- the at least one electrode can be, additionally or alternatively, disposed along an expandable element coupled to the distal end region 126 of the catheter shaft 118 .
- the tip portion 122 can be inserted into a heart cavity 134 of the patient 102 ( FIG. 2 ) as part of the medical procedure.
- the tip portion 122 can interact with a surface 135 of the heart cavity 134 as part of a medical procedure.
- the tip portion 122 can deliver energy to the surface 135 for the purpose of treatment, diagnosis, or both.
- the energy delivered through the tip portion 122 can include any manner and form of energy known in the art and, therefore, can include RF energy.
- the location of the tip portion 122 relative to the surface 135 of the heart cavity 134 can be known (e.g., based on a signal received from the magnetic position sensor 133 of FIG. 2 ). Further, or in the alternative, the shape of the surface 135 of the heart cavity 134 can be known based on any of various different methods, including methods based on known locations visited by the tip portion 122 within the heart cavity 134 . Accordingly, as described in greater detail below, the graphical user interface 116 can represent the location of the tip portion 122 relative to the surface 135 on the graphical user interface 116 .
- a physician can use the graphical user interface 116 as a tool for visualization of the tip portion 122 and/or the heart cavity 134 during a medical procedure.
- the graphical user interface 116 can include any of various different types of two-dimensional and/or three-dimensional displays known in the art.
- the graphical user interface 116 can include a computer monitor or another similar type of two-dimensional display.
- the graphical user interface 116 can include an augmented reality environment, a virtual reality environment, or combinations thereof.
- the graphical user interface 116 can include a first portion 136 and a second portion 138 spatially delineated from the first portion 136 .
- the spatial delineation between the first portion 136 and the second portion 138 can facilitate accommodating two different use cases on the graphical user interface 116 at the same time.
- the second portion 138 can work in cooperation with the limited inputs of the second input device 110 to provide the physician with a robust interface while the first portion 136 can cooperate with more expansive input options available through the first input device 108 (e.g., input options compatible with a full keyboard, a mouse, or combinations thereof).
- these use cases are not interchangeable with one another as efficient input solutions.
- the spatial delineation between the first input portion 136 and the second input portion 138 can be useful for providing different users with user interface elements that are appropriate for a given use case associated with the respective user.
- spatial delineation of the first portion 136 from the second portion 138 can be useful for facilitating switching focus between the first portion 136 and the second portion 138 by a physician during a medical procedure.
- the physician can easily switch focus back and forth between the first portion 136 and the second portion 138 with little time and effort expended to locate or relocate the physician-specific interface on the second portion 138 of the graphical user interface 116 .
- such spatial delineation of the first portion 136 from the second portion 138 can facilitate concurrent, or substantially concurrent, use of the graphical user interface 116 by two different users, as described in greater detail below.
- the first portion 136 of the graphical user interface 116 can include a first set of input options 140 and, further or instead, a graphical representation 142 of the heart cavity 134 .
- the graphical representation 142 of the heart cavity 134 can include partial depictions of the heart cavity 134 , such as those that may be generated in implementations in which the graphical representation 142 is built based on known locations of the catheter 106 .
- the first set of input options 140 can correspond to permissible modifications and/or display settings of the graphical representation 142 . Such modifications and/or display settings of the graphical representation 142 can correspond to one or more input commands based on the first set of input options 140 and received in preparation for and/or during a medical procedure.
- the graphical representation 142 can be based, for example, on the shape of the surface 135 of the heart cavity 134 such that the graphical representation 142 can include at least one two-dimensional projection of a three-dimensional model of the heart cavity 134 . Additionally, or alternatively, the graphical representation 142 can include a depiction of a portion of the catheter 106 (e.g., the tip portion 122 ), which can be useful for locating the portion of the catheter 106 relative to the heart cavity 134 . As shown in FIG.
- the graphical representation 142 can include, for example, more than one two-dimensional projection of a three-dimensional model of the heart cavity 134 , with each two-dimensional projection projected to a different image plane and, thus, corresponding to a different view of the three-dimensional model of the heart cavity 134 .
- the second portion 138 of the graphical user interface 116 can include a second set of input options 144 .
- the second set of input options 144 can advantageously be different from the first set of input options 140 , as described in greater detail below.
- the second set of input options 144 can correspond to permissible modifications and/or display settings associated with the graphical representation 142 in the first portion 136 of the graphical user interface 116 .
- Such modifications of the graphical representation 142 can correspond to one or more input commands based on the second set of input options 144 and received in preparation for and/or during a medical procedure.
- the first input device 108 can be in communication with the first portion 136 of the graphical user interface 116 while the second input device 110 can be in communication with the second portion 138 of the graphical user interface 116 .
- a first user e.g., a technician outside of a sterile field
- a second user e.g., a physician within a sterile field
- the second set of input options 144 can advantageously be state-dependent to facilitate navigation of the second set of input options 144 using only a limited number of inputs, such as the inputs 130 a , 130 b , 130 c , 130 d , 130 e , of the second input device 110 .
- state-dependent is inclusive of a state machine in which the second set of input options 144 can be in one of a set number of conditions, or states, based on one or more previous states and on previous inputs, with state transitions in such a state machine depending on the present state and the present inputs. Examples of a state-machine associated with the second set of input options 144 are described in greater detail below.
- the second set of input options 144 can be state-dependent such that, although a given state of the second set of input options 144 may be a reduced set of options as compared to the first set of input options 140 , the combination of the states of the second set of input options 144 can offer functionality equivalent or similar to the functionality available through all or a subset of the first set of input options 140 .
- the second portion 138 of the graphical user interface 116 can include, for example, a banner section 146 and a menu section 148 .
- the banner section 146 and the menu section 148 can present the second set of input options 144 corresponding to the current state of a plurality of states of the state machine.
- the combination of the banner section 146 and the menu section 148 can provide the physician with visual context for navigating to other states of the state machine.
- Such visual context can facilitate, for example, efficient navigation to the various states of the state machine (e.g., as necessitated during the medical procedure) using only a limited number of inputs, such as the inputs 130 a , 130 b , 130 c , 130 d , 130 e of the second input device 110 .
- FIG. 5 is a schematic representation of an example of a state machine 150 implemented on the catheter interface unit 104 ( FIG. 1 ).
- the states of the state machine 150 are generally represented relative to one another in two-dimensions in FIG. 5 .
- Each arrow between states of the state machine 150 represents a navigation input command that will move the state machine 150 from one state to another.
- right/left navigation commands received from the second input device 110 ( FIG. 2 ) move to the right or left, as the case may be, of a given state
- up/down navigation commands received from the second input device 110 ( FIG. 2 ) move up or down, as the case may be, relative to a given state.
- the press time e.g., a long press time
- the press time associated with a navigation input command from the second input device 110 can be used to skip to a particular state in the state machine 150 .
- the current state of the state machine 150 can be represented on the second portion 138 of the graphical user interface 116 , and an adjacent state or states of the state machine 150 can be represented on the second portion 138 of the graphical user interface 116 (e.g., as a preview) to facilitate navigation from one state to another.
- the state machine 150 can have any of various different configurations, which can depend on, among other things, the configuration of the second input device 110 , the configuration of the second set of input options 144 , the functionality to be provided to the physician, and/or the application to which the state machine is being applied. Accordingly, while specific implementations of the state machine 150 are described herein by way of example, further or alternative implementations of the state machine 150 are additionally or alternatively possible.
- the state machine 150 can include a top-level 152 and one or more sublevels 153 .
- the functionality described herein with respect to the top-level 152 and the one or more sublevels 153 is by way of example and not limitation.
- the state machine 150 can include a layer above the top-level 152 through which access to the state machine 150 is gained.
- the state machine 150 can include one or more layers above the top-level 152 to allow the physician to choose between an ablation mode and a mode in which the physician can work with the state machine 150 to modify the graphical representation 142 .
- the top-level 152 includes a build state 154 a , a view state 156 a , and a tag state 158 a (sometimes collectively referred to herein as “top-level states” and sometimes individually referred to herein as a “top-level state”).
- One or more sublevel state can be below each top-level state.
- the hierarchy of states of the state machine 150 is represented in FIG. 5 such that each top-level state has an element number ending with “a,” each sublevel state below the respective top-level state is represented with the same element number ending with “b” (in the case of a first sublevel state), and the input options corresponding to a given sublevel state are represented with the same element number ending with “c”.
- Navigation through the states of the state machine 150 can be represented in the second portion 138 of the graphical user interface 116 (e.g., as a change in the state highlighted in the second portion 138 ).
- one or more of the inputs 130 a , 130 b , 130 c , 130 d , 130 e of the second input device 110 can be used to send navigation commands to the catheter interface unit 104 to navigate through the states of the state machine 150 and one or more of the inputs 130 a , 130 b , 130 c , 130 d , 130 e can be used to provide one or more input commands to the catheter interface unit 104 to select a particular state of the state machine 150 .
- the representation of the states of the state machine 150 on the second portion 138 of the graphical user interface 116 can change accordingly.
- the second portion 138 of the graphical user interface 116 can highlight or otherwise accentuate the current navigation position of the state machine 150 .
- a received input command can select the current navigation position as the state of the state machine 150 .
- a “navigation command” should be understood to include an input sent from one or more of the inputs 130 a , 130 b , 130 c , 130 d , 130 e to the catheter interface unit 104 to change a display of one or more states on the second portion 138 of the graphical user interface 116 , with the change of the display of the one or more states corresponding to navigation through the states of the state machine 150 .
- an “input command” should be understood to include an input sent from one or more of the inputs 130 a , 130 b , 130 c , 130 d , 130 e to the catheter interface unit to make a selection in the one or more displayed states on the second portion 138 of the graphical user interface 116 .
- Respective icons for the build state 154 a , the view state 156 a , and the tag state 158 a can be displayed in the banner section 146 of the second portion 138 of the graphical user interface 116 .
- These respective icons can advantageously provide a visual indication of the contents of the corresponding sublevel state displayed in the menu section 148 below the corresponding top-level state. For example, if an icon associated with the build state 154 a is highlighted in the banner section 146 , the physician can readily assess that the sublevel state shown in the menu section 148 corresponds to the build state 154 a.
- the inputs 130 a and 130 b can be used to provide navigation commands to scroll across the sublevel states in the state machine 150 .
- scrolling across the sublevel states in the state machine 150 can be advantageous for efficient navigation at least because such scrolling reduces the need to use also the inputs 130 c and 130 d (up/down) to navigate to other sublevel states of the state machine 150 .
- the physician can use single button operation (e.g., using only the input 130 a (right) or only the input 130 b (left)) to scroll across the sublevel states.
- Scrolling across the sublevel states can be represented as a change in the sublevel state shown or highlighted in the menu section 148 .
- a corresponding change in the display of the icons of the top-level state can be shown in the banner section 146 .
- the inputs 130 c and 130 d (up/down) can be used to scroll through input options within a given sublevel state of the state machine 150 , with the scrolling within the sublevel state represented as a change in the sublevel state option shown or highlighted in the menu section 148 .
- the inputs 130 c and 130 d can be used to scroll through first build input options 154 c ′ in the first build sublevel state 154 b ′, second build input options 154 c ′′ in the second build sublevel, first view input options 156 c ′ in the first view sublevel state, second view input options 156 c ′′ in the second view sublevel state 156 b ′′, and tag input options 158 c in the tag sublevel state 158 b.
- the physician can use the inputs 130 a and 130 b (right/left) to scroll from the tag sublevel state 158 b to the view sublevel state 156 b ′′ to see options for adjusting the graphical representation 142 on the first portion 136 of the graphical user interface 116 .
- This may be desirable, for example, for better visualization of the graphical representation 142 and, thus, for more accurate placement of tags on the graphical representation 142 .
- the highlighted icon in the banner section 146 can change accordingly to provide the physician with a visual indication of the top-level state corresponding to the second set of input options 144 .
- the physician can select the desired sublevel state, which is the view sub level state 156 b ′′ in this example, by providing an input command, such as an enter command via input 130 e .
- the physician can use the inputs 130 c and 130 d (up/down) to scroll through input options associated with the selected sublevel state. It should be appreciated that other transitions between states of the state-machine 150 are additionally, or alternatively, possible and can similarly facilitate execution of the medical procedure by the physician.
- the build state 154 a can have a first build sublevel state 154 b ′ and a second build sublevel state 154 b ′′.
- the state machine 150 can be in one or the other of the first build sublevel state 154 b ′ and the second build sublevel state 154 b ′′, depending on whether a build procedure is in progress.
- the build procedure can include formation of a three-dimensional model of the heart cavity 134 used to form the graphical representation 142 displayed on the graphical user interface 116 .
- the build procedure can be based on received locations of the tip portion 122 of the catheter 106 in the heart cavity 134 .
- the first build sublevel state 154 b ′ can correspond to the build procedure being stopped. Accordingly, the first build sublevel state 154 b ′ can include an input for starting the build procedure, which can be displayed in the menu section 148 of the second portion 138 of the graphical user interface 116 . When the physician selects the input to start the build procedure, the current state of the state machine 150 can switch to the second build sublevel state 154 b′′.
- the second build sublevel state 154 b ′′ can correspond to the build procedure being in progress. Accordingly, the second build sublevel state 154 b ′′ can include an input for stopping the build procedure, which can be displayed in the menu section 148 of the second portion 138 of the graphical user interface 116 .
- the current state of the state machine 150 can switch to the first build level state 154 b ′.
- the state machine 150 moves between sublevel states (the first build sublevel state 154 b ′ and the second build sublevel state 154 b ′′, in this example) to present the physician with input options that represent the next logical step or steps in the medical procedure, given the current state of the state machine 150 .
- the view state 156 a can correspond to control of the graphical representation 142 on the first portion 136 of the graphical user interface 116 .
- the state machine 150 is described with respect to the view state 156 a controlling a single view of the graphical representation 142 . It should be appreciated, however, that the view state 156 a can include multiple states, each corresponding to control of a different view of the graphical representation 142 on the first portion 136 of the graphical user interface 116 .
- the view state 156 a can include states corresponding to the respective views on the left side and right side of the graphical user interface 116 .
- the view state 156 a can include a first view sublevel state 156 b ′ and a second view sublevel state 156 b ′′. While the view state 156 a is described as having two sublevels, it should be appreciated that the view state 156 a can have any of various different sublevels. In general, the sublevels associated with the view state 156 a can depend on the amount of control to be provided to the physician with respect to the graphical representation 142 on the first portion 136 of the graphical user interface 116 . Accordingly, the number of sublevels associated with the view state 156 a can depend on the particular implementation.
- the view state 156 a can include a sublevel associated with rotation of the graphical representation 142 and a sublevel associated with one or more fixed views of the graphical representation 142 .
- the state machine 150 can be in one or the other of the first view sublevel state 156 b ′ and the second view sublevel state 156 b ′′, depending on which of various, different view control features is selected.
- An example of a view control feature can be a fixed view mode in which a plurality of fixed views (e.g., left-anterior oblique (LAO), right-anterior oblique (RAO), etc.) are displayed in the menu section 148 such that the physician can scroll through the fixed views and select a desired view.
- a view control feature can be an adjustable view mode (e.g., in which the physician can adjust a view parameter such as tilt).
- the physician can switch between the fixed view mode and the adjustable view mode as desired (e.g., by scrolling across the sublevel states).
- the tag state 158 a can have, for example, a single tag sublevel state 158 b including a selection of identifiers corresponding to anatomic features of the heart cavity.
- the identifiers of the tag sublevel state 158 b can be displayed in the menu section 148 of the second portion 138 of the graphical user interface 116 .
- the physician can navigate through the identifiers displayed in the menu section 148 using, for example, the inputs 130 a , 130 b , 130 c , 130 d and can select an identifier using the input 130 e .
- an appropriate tag can appear on the graphical representation 142 shown on the first portion 136 of the graphical user interface 116 .
- the appropriate tag can appear on the graphical representation 142 at a location based on the location of the catheter tip 122 .
- the tags available in the tag sublevel state 158 b can be a function of the global state of the state machine 150 and, thus, can themselves be state dependent. For example, if the state machine 150 is in an “ablation” mode, the tags available in the tag sublevel state 158 b can include tags related to marking the location of one or more ablations on the graphical representation 142 . As an additional or alternative example, if the state machine 150 is in an “anatomy” mode, the tags available in the tag sublevel state 158 b can correspond to marking anatomic features on the graphical representation 142 . In cardiac implementations, the tags available in the tag sublevel state 158 b can be dependent on the chamber of the heart in which the catheter 106 is inserted. For example, information regarding the chamber can be received from the first input device 108 and/or the second input device 110 , and the tags in the tag sublevel state 158 b can be updated accordingly.
- the computer executable instructions stored on the computer readable storage medium 114 can cause the processing unit 112 to receive inputs from the first input device 108 and the second input device 110 to modify the graphical representation 142 according to one or more of the following exemplary methods.
- the computer executable instructions stored on the storage medium 114 and executable by the processing unit 112 can be an application built using Visualization Toolkit, an open-source 3D computer graphics toolkit, available at www.vtk.org. Unless otherwise indicated or made clear from context, each of the following exemplary methods can be implemented using the system 100 and/or one or more components thereof.
- FIG. 6 is a flowchart of an exemplary method 160 of controlling a graphical representation on a graphical user interface.
- the graphical representation and the graphical user interface can be, for example, any of the various different graphical representations and graphical user interfaces described herein. Accordingly, the exemplary method 160 can control the display of the graphical representation 142 ( FIG. 4 ) on the graphical user interface 116 ( FIGS. 1 and 4 ).
- the exemplary method 160 can include receiving 162 a signal indicative of location of a cardiac catheter in a cavity of a patient's heart, displaying 164 a graphical representation of the cavity of the patient's heart, receiving 166 a a first input command based on a first set of input options, receiving 166 b a second input command based on a second set of input options, and modifying 168 the graphical representation based on the first input command and on the second input command.
- the graphical representation can be based on the received 162 signal indicative of location of the cardiac catheter and can be displayed on a first portion of a graphical user interface, along with the first set of input options.
- the second set of input options can be displayed, for example, on a second portion of the graphical user interface.
- Receiving 162 the signal indicative of location of the cardiac catheter in the cavity of the patient's heart can include any of the various different methods described herein for determining a location of a cardiac catheter in a heart cavity.
- receiving 162 the signal indicative of location of the cardiac catheter in the cavity of the patient's heart can include receiving a signal from a sensor such as the magnetic position sensor 133 ( FIG. 2 ).
- the received 162 signal can be indicative of any predetermined location of the cardiac catheter in the heart cavity.
- the received 162 signal can be indicative of a tip portion (e.g., tip portion 122 ) of the cardiac catheter.
- displaying 164 the graphical representation of the cavity of the patient's heart can include projecting a model (e.g., a three-dimensional model) of either or both of the cardiac catheter and the cavity to an image plane corresponding to the graphical user interface. Further, or alternatively, displaying 164 the graphical representation can include displaying the cavity of the patient's heart in one or more views in the first portion of the graphical user interface. Such multiple views can be useful, for example, for visualizing movement of the cardiac catheter relative to one or more surfaces of the cavity.
- a model e.g., a three-dimensional model
- displaying 164 the graphical representation can include displaying only a graphical representation of the cardiac catheter initially, while a graphical representation of the heart cavity is being built. As the graphical representation of the heart cavity is built, displaying 164 the graphical representation can include updating the graphical representation to show the gradual generation of the graphical representation of the heart cavity.
- Displaying 164 the graphical representation can be based on the received 166 a first input command and the received 166 b second input command. That is, in general, displaying 164 the graphical representation can be based on inputs received from two different sources. Such multiple inputs can be useful, for example, for facilitating receiving input directly from a physician while allowing a technician to provide additional or alternative inputs for controlling the graphical representation.
- Receiving 166 a the first input command from the first input device and receiving 166 b the second input command from the second input device can occur concurrently.
- receiving 166 a the first input command can be along a first communication channel
- receiving 166 b the second input command can be along a second communication channel, different from the first communication channel.
- Each communication channel can be associated with a respective portion of the graphical user interface such that the first communication channel can be associated with the first portion of the graphical user interface, upon which the first set of input options is displayed and, similarly, the second communication channel can be associated with the second portion of the graphical user interface, upon which the second set of input options is displayed.
- one of the first communication channel or the second communication channel can have a predetermined priority over the other.
- the second communication channel can be given priority over the first communication channel such that communication from the second input device associated with the physician is given priority over communication from the first input device.
- One or both of receiving 166 a the first input command from the first input device and receiving 166 b the second input command from the second input device can include wireless or wired communication according to any of the various different communication systems and methods described herein. Further, one of the receiving 166 a the first input command from the first input device and receiving 166 b the second input command from the second input device can include wireless communication while the other includes wired communication.
- Receiving 166 a the first input command from the first input device can include receiving an input command from any of various different input devices known in the art, including, for example, one or more of a keyboard, a mouse, a touchscreen, etc.
- the first input command can be received 156 a from a technician, or other similar personnel, who is ordinarily not in the sterile field and, thus, ordinarily has full use of both hands to manipulate the first input device.
- the second set of input options can be a subset of the first set of input options such that the technician may have access to certain input options that are not available to the physician as the physician operates the second input device during the medical procedure. That is, the technician can have access to input options associated with functions that are more efficiently carried out by the technician than by the physician, who must also manipulate the catheter during the medical procedure.
- the first set of input options from which the received 166 a first input command is derived can be displayed along a portion of the graphical user interface that is ordinarily not an area of focus for the physician.
- the first set of input options can be on the first portion of the graphical user interface and, optionally, set off to one side of the graphical representation of the heart cavity. It should be appreciated that such orientation of the first set of input options can be useful for efficient use of the space available on the graphical user interface.
- placing the first set of input options in a non-central location, or an otherwise deemphasized location, on the graphical user interface can facilitate presentation of the most relevant information to the physician during a medical procedure. That is, the second portion of the graphical user interface, upon which the second set of input options is displayed, can be substantially centrally positioned on the graphical user interface.
- receiving 166 b the second input command can include receiving one or more commands from a remote device.
- the term “remote device” includes an input device that is spatially separated from the first input device, from the graphical user interface, and/or from a processing unit of a catheter interface unit. In general, such spatial separation can be delineated by a sterile field such that the term “remote device” is inclusive of a device that transmits one or more input commands from within a sterile field to one or more portions of the system outside of the sterile field. Accordingly, it should be appreciated that remote communication using the remote device can offer certain advantages for communicating with a processing unit or other portions of a catheter interface unit while maintaining the sterile field.
- Receiving 166 b the second input command from the remote device can include receiving an input command from any of the various different remote devices described herein.
- receiving 166 b the second input command from the remote device can include receiving an input command from a second input device disposed on a handle portion of a catheter (e.g., the second input device 110 disposed on the handle portion 120 of the catheter 106 as described with respect to FIG. 2 ).
- receiving 166 b the second input command from the remote device can include receiving an input command from a second input device that is separate from a catheter, as described in greater detail below.
- Receiving 166 b the second input command can include receiving a discrete selection command.
- the discrete selection command can include a click, or other similar discrete input appropriate for the second input device, corresponding to selection of one of the second set of input options.
- the discrete selection command can include an input such as the input 130 e arranged as an “enter” input as described with respect to FIG. 2 .
- the instruction corresponding to the discrete selection command can vary depending on the state of a state machine represented in the second portion of the graphical user interface. More generally, the instruction corresponding to the discrete selection command can be based on the context of a particular portion of the medical procedure and, thus, can change over the course of the medical procedure.
- the exemplary method 160 can further include receiving 167 navigation commands for moving, within the second portion of the graphical user interface, between the options in the second set of options.
- the received 167 navigation commands can include discrete direction commands (e.g., left, right, up, and down corresponding to input from one or more of inputs 130 a , 130 b , 130 c , 130 d , and 130 e ) in the second portion of the graphical user interface. Because the physician may have to manipulate the catheter while providing the navigation commands, such discrete direction commands can facilitate navigating through the second portion of the graphical user interface through a simplified user interface manipulated, for example, through one-handed operation by the physician.
- the navigation commands can be received before and/or concurrently with receiving 156 b the second input command.
- one or more of the received 167 navigation commands and the received 156 b second input command can be used to navigate through the various different states of a state machine according to any one or more of the systems and methods described herein and, in particular, with respect to FIG. 5 .
- At least one of the received 167 navigation commands can scroll through the second set of input options displayed as an infinite wheel. That is, repeated receipt 167 of a particular navigation command (e.g., a “left” command) can cycle through the second set of input options continuously. Such continuous cycling in response to repeated receipt 167 of a particular navigation command can facilitate one-handed operation of the second input device to navigate the second set of input options. For example, if the physician inadvertently scrolls past a desired input option, the physician can continue to press the same navigation input (e.g., input 130 a , 130 b , 130 c , 130 d of FIG. 2 ) until the desired input appears again in the second portion of the graphical user interface.
- the same navigation input e.g., input 130 a , 130 b , 130 c , 130 d of FIG. 2
- the exemplary method 160 can further include detecting 169 receipt of an initial command.
- the initial command can be the received 166 b second input command.
- the detected 169 receipt of the initial command can follow a period of inactivity and/or a predetermined change in the second portion of the graphical user interface.
- the initial command can be one of the received 167 navigation commands.
- the first portion is viewable on the graphical user interface at the same time that the second portion is viewable on the graphical user interface, and it can be useful to delineate between the first portion and the second portion during the medical procedure.
- one or more display features of the second portion of the graphical user interface can be changed based on the detected 169 receipt of the initial command. Such a change in the second portion of the graphical user interface can advantageously provide the physician with feedback regarding proper operation of the second input device.
- the change in the second portion of the graphical user interface can be perceived by the physician and, thus, serve as an indication that the commands from the second input device are being reflected in the second portion of the graphical user interface.
- Changes to the one or more display features of the second portion of the graphical user interface can include displaying additional input options of the second set of input options (e.g., displaying additional input options related to a current state of the state machine such as the state machine 150 described with respect to FIG. 5 ).
- detecting 169 receipt of the initial command can result in expansion of a menu to provide the physician with a visual representation of additional options.
- detecting 169 receipt of the initial command can result in displaying one or more menus to provide the physician with a preview of menus that are adjacent to a current menu to facilitate navigation to an appropriate menu in the second portion of the graphical user interface.
- changing one or more display features of the second portion of the graphical user interface can include changing one or more display features of the second portion of the graphical user interface, relative to the first portion of the graphical user interface, between a baseline configuration and a modified configuration.
- such a change can include changing the size of the second portion of the graphical user interface relative to the size of the first portion of the graphical user interface.
- detecting 169 receipt of the initial command can result in the second portion of the graphical user interface increasing in size relative to the first portion of the graphical user interface. This change in size can make the second portion of the graphical user interface easier to perceive by the physician and, thus, can facilitate navigation through one or more menus displayed on the second portion of the graphical user interface.
- changing the one or more display features of the second portion of the graphical user interface can include changing opacity of the second portion of the graphical user interface relative to the opacity of the first portion of the graphical user interface.
- the baseline configuration of the second portion of the graphical user interface can be relatively opaque prior to detecting 169 receipt of the initial command and can become less opaque upon detecting 169 receipt of the initial command. Such a change in opacity of the second portion of the graphical user interface can make the second portion of the graphical user interface more easily perceivable by the physician.
- changing one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing the position of the second portion of the graphical user interface relative to the position of the first portion of the graphical user interface.
- An example of such a change in position can include displaying the second portion of the graphical user interface as a pop-up window.
- the pop-up window can appear in front of the first portion of the graphical user interface.
- a change in position of the second portion of the graphical user interface relative to the first portion of the graphical user interface can facilitate prominently displaying the second portion of the user interface for improved perceptibility by the physician during the medical procedure.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration if a time between receipt 169 of the initial command and receipt of a subsequent input command exceeds a predetermined inactivity threshold period.
- the predetermined inactivity threshold period can be programmable (e.g., by the physician according to the physician's preference). Such a period of inactivity can coincide with the physician moving the catheter within the heart cavity. Accordingly, during this period, the second portion of the graphical user interface can be advantageously deemphasized in favor of a more prominent display of the first portion of the graphical user interface, which includes the graphical representation of the heart cavity.
- changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between the baseline configuration and the modified configuration can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration based on a received input command of the second set of input commands. Further, or in the alternative, a received input command of the second set of input commands can toggle between the modified configuration and the baseline configuration. Toggling between the modified configuration and the baseline configuration can, for example, provide the physician with control over the display of the second portion of the graphical user interface. Such control can be useful for deemphasizing the second portion of the graphical user interface on command to facilitate observation of the first portion of the graphical user interface by the physician (e.g., during a particular portion of the medical procedure).
- modifying 168 the displayed graphical representation in the first portion of the graphical user interface can include any one or more of various different changes to the displayed graphical representation that may improve visualization of the graphical representation by the physician.
- modifying 168 the displayed graphical representation can include building a graphical representation of the heart cavity, altering a display view of the graphical representation, and/or tagging one or more anatomic features on the graphical representation.
- modifying 168 the displayed graphical representation can be based on the received 166 a first input command from the first input device and the received 166 b second input command from the second input device, it should be appreciated that relatively simple modifications 168 of the displayed graphical representation can be implemented through the second input device operated by the physician while more complex modifications 168 of the displayed graphical representation can be implemented through the first input device operated by the technician.
- Modifying 168 the displayed graphical representation in the first portion of the graphical user interface can include, for example, modifying a pose of the graphical representation including one or more of a translation and an orientation.
- the pose can include two rotation angles.
- the pose can correspond to one or more predetermined poses of the graphical representation.
- the pose can be customizable according to one or more inputs from one or both of the first input device and the second input device.
- modifying 168 the displayed graphical representation can include adjusting an orientation of a displayed view of the graphical representation of the heart cavity such as, for example, by rotating the graphical representation of the heart cavity about an axis.
- modifying 168 the displayed graphical representation in the first portion of the graphical user interface can include adjusting the displayed graphical representation according to the order in which the first input command the second input command are received.
- modification 168 of the displayed graphical representation can allow the physician to undo or otherwise modify an input command provided by the technician through the first input device. More generally, the first input command and the second input command can operate in concert to modify 168 the displayed graphical representation.
- FIG. 7 is a flowchart of an exemplary method 170 of controlling a graphical representation on a graphical user interface.
- the graphical representation and the graphical user interface can be, for example, any of the various different graphical representations and graphical user interfaces described herein. Accordingly, the exemplary method 170 can control the display of the graphical representation 142 ( FIG. 4 ) on the graphical user interface 116 ( FIGS. 1 and 4 ).
- the exemplary method 170 can include receiving 171 a signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying 172 , on a graphical user interface, a graphical representation of the location of the catheter tip in the cavity of the patient's heart, receiving 174 a a first input command from a first input device, receiving 174 b navigation commands and a second input command from a second input device, and modifying 176 the displayed graphical representation based on the first input command and the second input command.
- the first input command can be responsive to a first set of input options displayed on the graphical user interface
- the second input command can be responsive to a second set of input options displayed on the graphical user interface.
- Receiving 171 the signal indicative of the location of the catheter tip in the cavity of the patient's heart can include any one or more of the various different methods of receiving location information described herein.
- receiving 171 the signal indicative of location of the cardiac catheter in the cavity of the patient's heart can include receiving a signal from a sensor such as the magnetic position sensor 133 ( FIG. 2 ).
- the received 171 signal can be indicative of any predetermined location of the cardiac catheter in the heart cavity.
- the received 171 signal can be indicative of a location of a tip portion (e.g., tip portion 122 ) of the cardiac catheter.
- Displaying 172 the graphical representation of the cavity of the patient's heart on the graphical user interface can include any of the various different methods of displaying the graphical representation described herein. Accordingly, as an example, displaying 172 the graphical representation can include displaying a two-dimensional projection of a three-dimensional model of the cavity of the patient's heart. Additionally, or alternatively, displaying 172 the graphical representation of the cavity of the patient's heart on the graphical user interface can include displaying one or more views of the graphical representation.
- the first input command can be received 174 a from the various different devices and systems described herein with respect to the first input device and, additionally or alternatively, according to any one or more of the various different methods described herein with respect to sending and receiving a first input command from the first input device.
- the first input command can be received 174 a by a catheter interface unit via wired or wireless communication with a keyboard and/or mouse operated by a technician (e.g., outside of a sterile field).
- the first input command can be received 174 a from among the first set of input options, which can be a full complement of possible input commands available for modifying the displayed 172 graphical representation of the cavity of the patient's heart.
- the first set of input options can be displayed on a dedicated portion of a graphical user interface, away from the second set of input options, according to any of the various different methods described herein. Accordingly, the first set of input options can be displayed on the first portion of the graphical user interface, and the second set of input options on a second portion of the graphical user interface.
- the navigation commands and/or the second input command can be received 174 b from the various different devices and systems described herein with respect to the second input device and, additionally or alternatively, according to any one or more of the various different methods described herein with respect to sending and receiving navigation commands and/or a second input command from the second input device.
- the navigation commands and the second input command can be received 174 b by a catheter interface unit in wired or wireless communication with a second input device operated by a physician.
- the second input device can be any of the various different second input devices described herein.
- the second input device can include relatively few inputs as compared to the first input device, with the functionality of the second input device being a function of the representation of a state machine on the graphical user interface.
- the second set of input options displayed on the graphical user interface can be based at least in part on the current state of the state machine and, additionally or alternatively, can include available transitions of a state machine.
- the navigation input commands received 174 b from the second input device can be used to navigate through the transitions of the state machine and an input command received 174 b from the second input device can be used to select a particular state of the state machine.
- the changing state of the state machine can impart additional functionality to the inputs of the second input device. That is, the result produced by a given received 174 b input command can vary according to the state of the state machine at the time the input command is received 174 b.
- Receiving 174 b the navigation commands and the second input command from the second input device can include receiving discrete commands.
- the discrete commands can include commands for moving through the second set of input options.
- Examples of such discrete directional commands can include commands corresponding to right, left, up, and down navigation through the second set of input commands displayed in the second portion of the graphical user interface.
- receiving 174 b the navigation commands and the second input command from the second input device can include receiving one or more analog commands.
- one or more inputs of the second input device can include a capacitive touch sensor that produces an analog input command. This analog command can be used, in certain instances, for navigating through the second set of input options.
- the capacitive touch sensor is arranged as a scroll wheel
- the scroll wheel can be used to scroll through the second set of input options.
- the second set of input options can be arranged in an infinite wheel according to any of the arrangements described herein.
- receiving 174 b the navigation commands can include receiving a scroll command (e.g., a discrete command, an analog command, or a combination thereof) for moving through the states of the infinite wheel.
- a scroll command e.g., a discrete command, an analog command, or a combination thereof
- a physician can press a single input on the second input device repeatedly, or by holding down the single input, to continually move through the infinite wheel until a desired input command is highlighted and can be selected.
- Modifying 176 the displayed graphical representation can include any one or more of the various different modifications described herein. Accordingly, as an example, modifying 176 the displayed graphical representation can be based on the order in which the first input command and the second input command are received. Thus, in this example, the second input command can override a modification made based on the first input command and, in this way, can provide the physician with a mechanism for overriding a change made by the technician. Also, or instead, in instances in which the first input command and the second input command are received at the same time or substantially the same time, the second input command can override the first input command to reduce the likelihood that the second input command (associated with the physician) is inadvertently overwritten or otherwise undone by the first input command.
- the exemplary method 170 can further include modifying 177 one or more display features of the second set of input options based on the received 174 b navigation command and/or second input command. Modifying 177 the one or more display features of the second set of input options can be based, for example, on detecting an initial navigation or initial input command (e.g., after some predetermined period of inactivity). Additionally, or alternatively, modifying 177 the one or more display features of the second set of input options can include changing the second set of input options from the modified configuration to the baseline configuration if a time between receipt of a first input command and receipt of a second input command exceeds a predetermined inactivity threshold period.
- modifying 177 the one or more display features of the second set of input options can include changing between a baseline configuration and a modified configuration of the display features according to any of the various different methods described herein.
- the relative size of the displayed second set of input options to the size of the displayed first set of input options can be greater in the modified configuration than in the baseline configuration to facilitate reading the second set of input options by the physician.
- the opacity of the displayed second set of input options compared to the opacity of the first set of input options can be greater in the modified configuration than in the baseline configuration to facilitate drawing the physician's attention to the appropriate location on the graphical user interface.
- the position of the second set of input options relative to the first set of input options on the graphical user interface can be different in the modified configuration than in the baseline configuration, with the change in position, for example, advantageously drawing the physician's attention toward the second set of input options.
- a system 100 ′ can include a second input device 180 separate from a catheter 106 ′.
- elements designated by prime (′) element numbers in FIG. 8 should be understood to be analogous to elements with unprimed element numbers described herein, unless otherwise indicated or made clear from the context, and, thus, are not described separately from primed or unprimed counterparts, except to highlight certain aspects.
- element number 116 ′ in FIG. 8 should be understood to be a graphical user interface analogous to the graphical user interface 116 ( FIGS. 1 and 4 ), unless otherwise indicated or made clear from the context.
- the second input device 180 can be, for example, in communication with the catheter interface unit 104 ′ to transmit navigation commands and/or input commands to a second portion of the graphical user interface 116 ′ according to any of the various different methods described herein. Because the second input device 180 is not disposed along the catheter 106 ′, the second input device 180 can be advantageously in wireless communication with the catheter interface unit 104 ′ to reduce the number of wires in the vicinity of the physician during the medical procedure.
- the second input device 180 can be manually operable by the physician while the physician manipulates the catheter 106 ′.
- the physician may pick up the second input device 180 as needed, and then put the second input device 180 down if both hands are needed for manipulation of the catheter 106 ′.
- a system 100 ′′ can include a second input device 210 securable to a catheter shaft 118 ′′ of a catheter 106 ′′.
- elements designated by double prime (′′) element numbers in FIG. 9 should be understood to be analogous to elements with unprimed and/or primed element numbers described herein, unless otherwise indicated or made clear from the context, and, thus, are not described separately from primed or unprimed counterparts, except to highlight certain aspects.
- FIG. 9 should be understood to be a catheter analogous to the catheter 106 ( FIGS. 1 and 4 ) and the catheter 106 ′ ( FIG. 8 ), and element number 118 ′′ in FIG. 9 should be understood to be a catheter shaft analogous to the catheter shaft 118 ( FIGS. 1 and 4 ) and the catheter shaft 118 ′ ( FIG. 8 ), unless otherwise indicated or made clear from the context.
- the second input device 210 can be in communication (e.g., wireless communication) with the catheter interface unit 104 ′′ to transmit navigation commands and/or input commands to a second portion of the graphical user interface 116 ′′ according to any of the various different methods described herein.
- securing the second input device 210 to the catheter shaft 118 ′′ of the catheter 106 ′′ can facilitate locating the second input device 210 by the physician without requiring the physician to divert his or her attention from the medical procedure.
- securing the second input device 210 to the catheter shaft 118 ′′ can facilitate single-handed operation of the second input device 210 during a medical procedure.
- the second input device 210 can include a user interface 230 , a wireless transmitter 250 , and a housing 270 carrying the user interface 230 and the wireless transmitter 250 .
- the user interface 230 can include one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, and 130 e ′′, which can be any one or more of the various different inputs described herein.
- the physician can depress or otherwise engage the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, and 130 e ′′, and the wireless transmitter 250 can be in communication with the user interface 230 to send one or more navigation and/or control commands to a remote processor, such as the processing unit 112 ′′, according to any one or more of the various different methods described herein.
- the physician can manipulate the user interface 230 to send one or more navigation and/or control commands to the processing unit 112 ′′ based on input options displayed on a portion of a graphical user interface, such as the graphical user interface 116 ′′, according to any of the various different methods described herein.
- the second input device 210 can be at least one of electrically and fluidically isolated from a handle 120 ′′ and the catheter shaft 118 ′′ to facilitate, for example, robust operation of the second input device 210 throughout the medical procedure, independent of the catheter 106 ′′.
- the housing 270 can define a volume, and the wireless transmitter 250 can be disposed within the volume defined by the housing 270 .
- the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, and 130 e ′′ can be at least partially disposed outside of the volume defined by the housing 270 such that the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ form at least a portion of an outer surface of the second input device 210 and are accessible by the physician.
- the volume defined by the housing 270 can be substantially resistant to fluid ingress such that the wireless transmitter 250 is protected from fluid that may contact the second input device 210 during a medical procedure.
- the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ can be arranged relative to the housing 270 to reduce the likelihood of fluid ingress into the volume defined by the housing 270 .
- the housing 270 can be securable to an outer circumference of the catheter shaft 118 ′′ with the user interface 230 partially constrained in at least one direction relative to the catheter shaft 118 ′′.
- Such constrained movement of the user interface 230 relative to the catheter shaft 118 ′′ can, for example, facilitate locating the user interface 230 by the physician during a medical procedure. That is, given that the user interface 230 is at least partially constrained in at least one direction relative to the catheter shaft 118 ′′, the physician can find the user interface 230 by moving his or her hand along the catheter shaft 118 ′′ to find the user interface 230 .
- the catheter shaft 118 ′′ itself can act as a guide for the physician, which can reduce the need for the physician to divert his or her attention away from the graphical user interface 116 ′′ to find the user interface 230 of the second input device 210 .
- the user interface 230 can be at least partially constrained in a radial direction relative to the catheter shaft 118 ′′.
- partial constraint in the radial direction can include movement of less than about 2 cm (e.g., less than about 1 cm) and, therefore, can include complete constraint in the radial direction.
- the user interface 230 can be movable along an axis defined by the catheter shaft 118 ′′ and, thus, partial constraint in the radial direction can include radial movement sufficient to allow the housing 270 and the user interface 230 to move along the axis defined by the catheter shaft 118 ′′.
- the housing 270 and the user interface 230 can be movable between the handle 120 ′′ of the catheter 106 ′′ and a sheath at the insertion site of the catheter 106 ′′ into the patient.
- the housing 270 can be securable in a fixed axial position relative to the catheter shaft 118 ′′.
- an interference fit between the outer circumference of the catheter shaft 118 ′′ and the housing 270 can hold the housing 270 in a fixed axial position relative to the catheter 118 ′′ during a medical procedure.
- the fixed axial position can be any of various different axial positions along the catheter shaft 118 ′′.
- the housing 270 can be secured to a proximal end region 124 ′′ of the catheter shaft 118 ′′ with the housing 270 extending distal to the handle 120 ′′ of the catheter 106 ′′.
- the housing 270 can be secured to the proximal end region 124 of the catheter shaft 118 ′′ such that the housing 270 is adjacent to the handle 120 ′′.
- the user interface 230 can be rotatable about the catheter shaft 118 ′′ and, optionally, rotatable about the handle 120 ′′ coupled to the catheter shaft 118 ′′.
- the user interface 230 can be rotatable about an axis of rotation coaxial with an axis defined by the catheter shaft 118 ′′ (e.g., freely rotatable 360 degrees about the axis of rotation such that the user interface 230 is rotatable through multiple revolutions about the axis of rotation). Rotation of this type can facilitate, for example, single-handed operation of the second input device 210 by the physician. That is, the physician can rotate the user interface 230 as necessary to align the user interface 230 in a desired radial orientation.
- the housing 270 can be at least partially formed of a material compatible with sterilization (e.g., any of the various different sterilization techniques described herein) and, in some instances, the housing 270 can be sterilized prior to being secured to the catheter shaft 118 ′′.
- the second input device 210 can include a cover enclosing the housing 270 and the user interface 230 , and the cover can be formed of a material compatible with sterilization such as any of the various sterilization techniques described herein.
- a cover separable from the housing 270 can be useful, for example, in implementations in which the housing 270 carries one or more components (e.g., batteries) that are not readily compatible with sterilization. In such instances, the cover can be sterilized apart from the second input device 210 and then used to cover the second input device 210 prior to securing the second input device 210 to the catheter shaft 118 ′′.
- the housing 270 can be securable to the catheter shaft 118 ′′ without the use of tools.
- the ability to secure the housing 270 to the catheter shaft 118 ′′ in this way can for example, facilitate securing the housing 270 to the catheter shaft 118 ′′ by the physician or other medical personnel in the sterile field.
- the housing 270 can include a first section 272 and a second section 274 , each defining a portion (e.g., substantially half) of a recess 276 .
- the first section 272 and the second section 274 can be releasably engageable with one another to position the recess 276 about at least a portion of an outer circumference of the catheter shaft 118 ′′.
- the releasable engagement between the first section 272 and the second section 274 can be achieved through an interference fit between mating features of the first section 272 and the second section 274 .
- first section 272 can include a first material and the second section 274 can include a second material magnetically attracted to the first material such that placing the first section 272 and the second section 274 in proximity to one another results in coupling the first section 272 to the second section 274 through the magnetic force between the first material and the second material.
- first section 272 and the second section 274 can be coupled to one another at a hinge 278 pivotable to move the first section 272 and the second section 274 in a clamshell arrangement into engagement with each other to position the recess 276 about the catheter shaft 118 ′′.
- the hinge 278 can be useful, for example, for accounting for manufacturing tolerances associated with the outer circumference of the catheter shaft 118 ′′. Additionally, or alternatively, the hinge 278 can be useful for reducing the number of parts needed to be manipulated by the physician or other medical personnel in the sterile field to secure the second input device 210 to the catheter shaft 118 ′′.
- the housing 270 can include a clip defining the recess 276 and positionable about at least a portion of the outer circumference of the catheter shaft 118 ′′.
- the clip may be “U-shaped” such that the recess 276 is defined by legs that are movable away from one another to accept the catheter shaft 118 ′′ and biased back toward one another to hold the second input device 210 about the outer circumference of the catheter shaft 118 ′′.
- the recess 276 can be sized, for example, to fit about a standard catheter size such that the second input device 210 can be securable to any of various different catheters of a given standard catheter size, including catheters made by different manufacturers. Additionally, or alternatively, the recess 276 can be sized to account for manufacturing tolerances associated with a given standard catheter size.
- the user interface 230 can be suitable for single-handed operation by the physician during a medical procedure. Such single-handed operation can facilitate, for example, simultaneous or substantially simultaneous operation of the user interface 230 with one hand while the physician holds the catheter shaft 118 ′′ or the handle 120 ′′ with the other hand.
- the remote communication device 210 can be secured to the outer circumference of the catheter shaft 118 ′′ at a position distal to an articulation controller 128 ′′ of the catheter 106 ′′.
- the articulation controller 128 ′′ can be, for example, any of the various different articulation controllers described herein to modify a distal end region 126 ′′ of the catheter shaft 118 ′′.
- the physician can operate the articulation controller 128 ′′ with one hand while simultaneously or substantially simultaneously operating the user interface 230 with the other hand.
- the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ can be arranged relative to the catheter shaft 118 ′′ such that manipulation of the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ does not cause unintended movement of the housing 270 relative to the catheter shaft 118 ′′.
- the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ of the user interface 230 can be any of the various different inputs described herein and can be depressible or otherwise engageable in a direction parallel to the at least one partially constrained direction of the user interface 230 such that the constrained movement of the user interface 230 can counter the force exerted on the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, and 130 e ′′ and, thus, restricts undesired movement of the second input device 210 as one or more inputs are received.
- the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ can be depressible in a direction transverse to the axis of rotation of the user interface 230 such that providing an input is less likely to result in inadvertent rotation of the user interface 230 about the catheter shaft 118 ′′. It should be appreciated from these examples that such an arrangement of forces can facilitate single-handed operation of the second input device 210 .
- the physician can use a single hand to depress the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ without requiring the use of a second hand to hold the user interface 230 in place as input is provided at the one or more inputs 130 a ′′, 130 b ′′, 130 c , 130 d ′′, 130 e′′.
- the second input device 210 can further include a power source 280 carried by the housing 270 and in electrical communication with the wireless transmitter 250 to power the wireless transmitter 250 .
- the power source 280 can be for example one or more batteries. Additionally, or alternatively, the power source 280 can be releasably coupled to the housing to facilitate replacement or recharging of the power source 280 (e.g., during or in between medical procedures).
- the second input device 210 can further include a processor 282 in communication with the user interface 230 and the wireless transmitter 250 .
- the processor 282 can receive a signal from the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ and send a corresponding signal to the wireless transmitter 250 for transmission.
- the second input device 210 can include circuitry to receive a signal from the one or more inputs 130 a ′′, 130 b ′′, 130 c ′′, 130 d ′′, 130 e ′′ and send a corresponding signal to the wireless transmitter 250 .
- a second input device can include a housing through which a distal end region of a catheter can be moved. Through such movement of the distal end region of the catheter through the housing, the second device can be disposed about a shaft of the catheter.
- the distal end region of the catheter can be introduced into a patient through the housing of the second input device.
- the housing of the second input device can include an introducer sheath positionable, as is known in the art, in vasculature of the patient and through which the distal end region of the catheter can be introduced into the vasculature of the patient during a procedure.
- the housing of the second input device can include an insertion sleeve positionable relative to the introducer sheath, as is also known in the art. In use, the distal end region of the catheter can be moved through the insertion sleeve and into vasculature of the patient via an introducer sheath positioned in the vasculature of the patient.
- a second input device can include a foot pedal operable by the physician tapping one or more inputs on the foot pedal to navigate through a second portion of a graphical user interface according to one or more of the methods described herein.
- second input devices have been described as being physical devices manipulated by the physician, other implementations are additionally or alternatively possible.
- a second input device can be implemented through a virtual reality system (such as Leap Motion available from Leap Motion, Inc. of San Francisco, Calif.).
- a physician's hand or hands can interact with a virtual reality environment to navigate and provide inputs to the second portion of the graphical user interface according to any one or more of the methods described herein.
- second input devices have been described as being operated with one or more of a physician's limbs, other implementations are additionally or alternatively possible.
- the second input device can be responsive to one or more voice commands (e.g., “up,” “down,” “right,” “left,” and “enter”) to navigate and provide inputs to the second portion of the graphical user interface according to any one or more of the methods described herein.
- voice commands e.g., “up,” “down,” “right,” “left,” and “enter”
- Such a second input device responsive to voice commands can, for example, reduce the need for separate hardware in the sterile field with the physician.
- the above systems, devices, methods, processes, and the like may be realized in hardware, software, or any combination of these suitable for a particular application.
- the hardware may include a general-purpose computer and/or dedicated computing device. This includes realization in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices or processing circuitry, along with internal and/or external memory. This may also, or instead, include one or more application specific integrated circuits, programmable gate arrays, programmable array logic components, or any other device or devices that may be configured to process electronic signals.
- a realization of the processes or devices described above may include computer-executable code created using a structured programming language such as C, an object oriented programming language such as C++, or any other high-level or low level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software.
- the methods may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways. At the same time, processing may be distributed across devices such as the various systems described above, or all of the functionality may be integrated into a dedicated, standalone device or other hardware.
- means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
- Embodiments disclosed herein may include computer program products comprising computer-executable code or computer-usable code that, when executing on one or more computing devices, performs any and/or all of the steps thereof.
- the code may be stored in a non-transitory fashion in a computer memory, which may be a memory from which the program executes (such as random access memory associated with a processor), or a storage device such as a disk drive, flash memory or any other optical, electromagnetic, magnetic, infrared or other device or combination of devices.
- any of the systems and methods described above may be embodied in any suitable transmission or propagation medium carrying computer-executable code and/or any inputs or outputs from same.
- performing the step of X includes any suitable method for causing another party such as a remote user, a remote processing resource (e.g., a server or cloud computer) or a machine to perform the step of X.
- performing steps X, Y and Z may include any method of directing or controlling any combination of such other individuals or resources to perform steps X, Y and Z to obtain the benefit of such steps.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Public Health (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Human Computer Interaction (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Robotics (AREA)
- Radiology & Medical Imaging (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Chemical & Material Sciences (AREA)
- Medicinal Chemistry (AREA)
- Algebra (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Cardiology (AREA)
- Plasma & Fusion (AREA)
- Otolaryngology (AREA)
- User Interface Of Digital Computer (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
- This application claims the benefit under 35 U.S.C. §119(e) of U.S. Prov. App. No. 62/335,120, filed May 12, 2016, U.S. Prov. App. No. 62/336,143, filed May 13, 2016, U.S. Prov. App. No. 62/338,210, filed May 18, 2016, U.S. Prov. App. No. 62/384,291, filed Sep. 7, 2016, U.S. Prov. App. No. 62/410,022, filed Oct. 19, 2016, and U.S. Prov. App. No. 62/463,870, filed Feb. 27, 2017, with the entire contents of each of these applications hereby incorporated herein by reference.
- This application is also related to the following commonly-owned U.S. patent application filed on even date herewith and having Attorney Docket Number AFRA-0007-P01, and entitled “THREE-DIMENSIONAL CARDIAC REPRESENTATION,” the entire contents of which are hereby incorporated herein by reference.
- Three-dimensional models are sometimes used to assist in the placement or use of a device when such placement or use is not easily observable or practical. For example, in medical procedures, three-dimensional models presented on a graphical user interface are used to assist in the placement and use of medical devices as part of diagnosis or treatment of patients. An example of such a medical procedure carried out with the assistance of a three-dimensional model presented on a graphical user interface is the use of a catheter for radio frequency (“RF”) ablation to terminate certain arrhythmias in the heart.
- Devices, systems, and methods of the present disclosure facilitate control of a graphical user interface by a physician during a medical procedure, such as a procedure in which the physician is maneuvering a catheter in a hollow anatomic structure (e.g., a heart cavity). For example, using the devices, systems, and methods of the present disclosure, a variety of options related to the medical procedure can be presented to the physician during the medical procedure by presenting subsets of actions to the physician on the graphical user interface on a state-dependent basis, with the state at any given time depending on the context of the action being performed by the physician at the given time. The presentation of subsets of actions to the physician on a state-dependent basis can, for example, facilitate control of the graphical user interface by the physician using an input device with only a few input sources (e.g., buttons).
- As compared to an interface requiring a keyboard and a mouse, the simplified input interface associated with the devices, systems, and methods of the present disclosure can improve the ability of the physician to manipulate the graphical user interface, of a graphical representation of the hollow anatomic structure, or both while the physician is also manipulating the catheter. Additionally, or alternatively, the devices, systems, and methods of the present disclosure can facilitate control of the graphical user interface and/or the graphical representation of the hollow anatomic structure from within the sterile field and, optionally, without the assistance of a person outside of the sterile field. Such autonomy of control by the physician can, for example, simplify medical procedures by reducing, or even eliminating, the need for the physician to communicate with a person outside of the sterile field to achieve desired control over the graphical user interface and, further or instead, control over the graphical representation of the hollow anatomic structure.
- According to one aspect, a method includes receiving a signal indicative of location of a cardiac catheter in a cavity of a patient's heart, displaying, on a first portion of a graphical user interface, a graphical representation of the cavity of the patient's heart, the graphical representation based on the received location signal from the cardiac catheter, receiving, from a first input device, a first input command based on a first set of input options displayed on the first portion of the graphical user interface, receiving, from a second input device, a second input command based on a second set of input options displayed on a second portion of the graphical user interface, and, based on the first input command and the second input command, modifying the graphical representation in the first portion of the graphical user interface.
- In certain implementations, modifying the graphical representation can include adjusting the displayed graphical representation according to an order in which the first input command and the second input command are received.
- In some implementations, at least some of the second set of input options can be the same as some of the first set of input options.
- In certain implementations, receiving the first input command can include receiving the first input command along a first communication channel and receiving the second input command can include receiving the second input command along a second communication channel, each communication channel dedicated to the respective portion of the graphical user interface.
- In some implementations, the method can further include receiving navigation commands for moving, within the second portion of the graphical user interface, between the options in the second set of input options. For example, the second set of input options represented on the second portion of the graphical user interface can correspond to a current state of a state machine having a plurality of states. In certain instances, the second input command or at least one of the navigation commands can change a current state of a state machine. Additionally, or alternatively, in each of the plurality of states, the second input command or at least one of the navigation commands can change a top-level state of the current state of the state machine. For example, the navigation commands can include commands to change the top-level state of the current state of the state machine between a build state, a view state, and a tag state.
- In certain implementations, when the current state is the build state, representing the current state in the second portion of the graphical user interface can include representing input command options to start and to stop building a three-dimensional representation, shown in the first portion of the graphical user interface, of the cavity of the patient's heart. Additionally, or alternatively, when the current state is the view state, representing the current state in the second portion of the graphical user interface includes representing options to turn an automatic view control on and off. Further, or instead, when the current state is the tag state, representing the current state in the second portion of the graphical user interface can include a selection of identifiers corresponding to anatomic features of the heart cavity.
- In some implementations, the navigation commands can include discrete direction commands. For example, the discrete direction commands can include commands for left, right, up, and down navigation in the second portion of the graphical user interface.
- In certain implementations, at least one of the navigation commands can scroll through the second set of options displayed as an infinite wheel.
- In some implementations, the method can further include detecting receipt of an initial command, the initial command being one of the second input command or one of the navigation commands, and, based on the detected receipt of the initial command, changing one or more display features of the second portion of the graphical user interface. For example, changing the one or more display features of the second portion of the graphical user interface can include displaying, in the second portion of the graphical user interface, additional input options of the second set of input options. Additionally, or alternatively, changing one or more display features of the second portion of the graphical user interface can include changing the one or more display features of the second portion, relative to the first portion of the graphical user interface, between a baseline configuration and modified configuration. By way of example, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between a baseline configuration and a modified configuration can include changing a size of the second portion of the graphical user interface relative to a size of the first portion of the graphical user interface. Also, or instead, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing an opacity of the second portion of the graphical user interface relative to an opacity of the first portion of the graphical user interface. By way of further or alternative example, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing a position of the second portion of the graphical user interface relative to a position of the first portion of the graphical user interface. As still a further or alternative example, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between the baseline configuration and the modified configuration can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration if a time between receipt of a first one of the input commands and receipt of a second one of the input commands exceeds a predetermined inactivity threshold period. Additionally, or alternatively, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between the baseline configuration and the modified configuration can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration based on a received input command of the second set of input commands.
- In certain implementations, the first portion can be viewable on the graphical user interface at the same time that the second portion can be viewable on the graphical user interface. In some instances, modification of the displayed graphical representation can include adjusting an orientation of a displayed view of the graphical representation of the heart cavity of the patient. For example, adjusting the orientation of the displayed view of the graphical representation of the heart cavity of the patient can include rotating the graphical representation of the heart cavity about an axis.
- In some implementations, modifying the displayed graphical representation in the first portion of the graphical user interface can include modifying a pose of the graphical representation in the first portion of the graphical user interface.
- In certain implementations, the second input command can include a discrete selection command.
- In some implementations, receiving the second input command can include receiving a wireless input command.
- In certain implementations, the second input device can be a remote device and receiving the second input command can include receiving an input command from the remote device.
- In some implementations, the second input device can be releasably coupled to a handle of the cardiac catheter.
- According to another aspect, a method includes receiving as signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying, on a graphical user interface, a graphical representation of the location of the catheter tip in the cavity of the patient's heart, receiving, from a first input device, a first input command responsive to a first set of input options displayed on the graphical user interface, receiving, from a second input device separate from the first input device, navigation commands and a second input command, the navigation commands for moving through a second set of input options, and the second input command responsive to the second set of input options displayed on the graphical user interface, and based on the first input command and the second input command, modifying the displayed graphical representation.
- In some implementations, modifying the graphical representation can include modifying the graphical representation according to an order in which the first input command and the second input command are received.
- In certain implementations, the method can further include displaying the first set of input options on a first portion of the graphical user interface, and displaying the second set of input options on a second portion of the graphical user interface.
- In some implementations, the second set of input options can include available transitions of a state machine. Additionally, or alternatively, the second set of input options displayed on the graphical user interface are based on a current state of the state machine.
- In certain implementations, receiving the navigation commands can include receiving discrete directional commands for moving through the second set of input options. For example, the discrete directional commands can correspond to right, left, up, and down navigation through the second set of input options.
- In certain implementations, receiving the navigation commands can include receiving an analog command for navigating through the second set of input options.
- In some implementations, the second set of input options can be arranged in an infinite wheel and receiving the navigation commands can include receiving a scroll command for moving through states of the infinite wheel.
- In certain implementations, the method can further include modifying, based on the received navigation commands, one or more display features of the second set of input options between a baseline configuration and a modified configuration. For example, a size of the displayed second set of input options to relative to a size of the displayed first set of input options can be greater in the modified configuration than in the baseline configuration. Additionally, or alternatively, an opacity of the displayed second set of input options relative to an opacity of the first set of input options can be greater in the modified configuration than in the baseline configuration. Further, or instead, a position of the second set of input options relative to the first set of input options on the graphical user interface can be different in the modified configuration than in the baseline configuration.
- In some implementations, modifying the one or more display features of the second set of input options between a baseline configuration and a modified configuration can include changing the second set of input options from the modified configuration to the baseline configuration if a time between receipt of a first input command and receipt of a second input command exceeds a predetermined inactivity threshold period.
- In certain implementations, modifying the one or more display features of the second set of input options between a baseline configuration and a modified configuration can include changing the second set of input options from the baseline configuration to the modified configuration if an input command of the second set of input options is received.
- According to still another aspect, a non-transitory, computer-readable storage medium has stored thereon computer executable instructions for causing one or more processors to perform operations including receiving a signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying, on a graphical user interface, a graphical representation of the location of the catheter tip in the cavity of the patient's heart, receiving, from a first input device, a first input command responsive to a first set of input options displayed on the graphical user interface, receiving, from a second input device separate from the first input device, navigation commands and a second input command, the navigation commands for moving through a second set of input options, and the second input command responsive to the second set of input options displayed on the graphical user interface, and, based on the first input command and the second input command, modifying the graphical representation on the graphical user interface.
- In some implementations, the operations can further include displaying the first set of input options on a first portion of the graphical user interface, and displaying the second set of input options on a second portion of the graphical user interface.
- In certain implementations, receiving the navigation commands can include receiving an analog command for navigating through the second set of input options.
- In some implementations, the operations can further include modifying, based on the received navigation commands, one or more display features of the second set of input options between a baseline configuration to a modified configuration.
- According to still another aspect, a catheter includes a catheter shaft having a proximal end region and a distal end region, a handle portion coupled to the proximal end region of the catheter shaft, an articulation controller supported on the handle portion, the articulation controller in mechanical communication with the catheter shaft to modify a position of the distal end region of the catheter shaft, and a graphical user interface (GUI) controller coupled to the handle portion and disposed relative to the articulation controller along the handle portion such that a user can maintain the distal end region of the catheter in place while manipulating the GUI controller.
- In certain implementations, the GUI controller can be configured for communication with a graphical representation of at least a portion of the catheter on a GUI.
- In some implementations, the GUI controller can be disposed relative to the articulation controller along the handle portion such that the user can manipulate the GUI controller and the articulation controller through one-handed operation.
- In certain implementations, the GUI controller can be disposed relative to the articulation controller along the handle portion such that the user can manipulate the GUI controller and the articulation controller using the same grip of the handle portion.
- In some implementations, the GUI controller can be releasably coupled to the handle portion.
- In some implementations, the GUI controller can be rotatably coupled to the handle portion such that the GUI controller is rotatable about an axis defined by the catheter shaft. For example, the GUI controller can be rotatable about 180 degrees of a circumference of the catheter shaft. Additionally, or alternatively, the GUI controller can be freely rotatable about a circumference of the catheter shaft.
- In certain implementations, the GUI controller can include discrete navigation inputs. For example, the navigation inputs can include right, left, up, and down navigation inputs.
- In some implementations, the GUI controller can include a capacitive touch portion.
- In certain implementations, the GUI controller can be coupled to the handle portion distal to the articulation controller.
- In some implementations, the GUI controller can include one or more inputs and the articulation controller can be moveable along a plane substantially perpendicular to a direction of movement of the one or more inputs.
- In certain implementations, the GUI controller can include an orientation feature extending from a surface of the GUI controller to provide tactile feedback to the user regarding a position of the user's hand with respect to the GUI controller.
- In some implementations, the GUI controller is sterilizable. For example, the GUI controller can be formed of components compatible with one or more of the following sterilization techniques: ethylene oxide sterilization, autoclave sterilization, gamma radiation, gas-plasma sterilization.
- In certain implementations, the catheter can further include at least one electrode mechanically coupled to the distal end region of the catheter shaft. For example, the at least one electrode can be disposed along an expandable element coupled to the distal end region of the catheter shaft.
- In some implementations, the GUI controller can be configured for communication with a remote graphical user interface. For example, the GUI controller can include a transmitter. Additionally, or alternatively, the GUI controller includes a wireless transmitter.
- According to another aspect, a system includes a graphical user interface, one or more processors, a first input device in communication with the one or more processors, a second input device separate from the first input device, the second input device in communication with the one or more processors, and a non-transitory, computer-readable storage medium having stored thereon computer executable instructions for causing one or more processors to perform operations including receiving a signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying, on the graphical user interface, a graphical representation of the cavity of the patient's heart, receiving, from the first input device, a first input command responsive to a first set of input options displayed on the graphical user interface, receiving, from the second input device separate from the first input device, navigation commands and a second input command, the navigation commands for moving through a second set of input options, and the second input command responsive to the second set of input options displayed on the graphical user interface, and, based on the first input command and the second input command, modifying the displayed graphical representation.
- According to still another aspect, a remote communication device includes a user interface including one or more inputs, a transmitter in communication with the user interface to send one or more control commands to a remote processor, and a housing carrying the user interface and the transmitter, the housing securable to an outer circumference of a catheter shaft with the user interface at least partially constrained in at least one direction relative to the catheter shaft.
- In certain implementations, the transmitter includes a wireless transmitter.
- In some implementations, with the housing secured to the outer circumference of the catheter shaft, the user interface can be at least partially constrained in a radial direction relative to the catheter shaft. Additionally, or alternatively, with the housing secured to the outer circumference of the catheter shaft, the user interface can be movable less than about 1 cm in the radial direction relative to the catheter shaft. Further, or instead, with the housing secured to the outer circumference of the catheter shaft, the user interface can be entirely constrained in the radial direction relative to the catheter shaft. Still further, or instead, with the housing secured to the outer circumference of the catheter shaft, the one or more inputs of the user interface can be depressible in a direction parallel to the at least one partially constrained direction of the user interface.
- In certain implementations, with the housing secured to the outer circumference of the catheter shaft, the user interface can be movable along an axis defined by the catheter shaft.
- In some implementations, with the housing secured to the outer circumference of the catheter shaft, the user interface can be rotatable about the catheter shaft.
- In certain implementations, with the housing secured to the outer circumference of the catheter shaft, the user interface can be rotatable about an axis of rotation coaxial with an axis defined by the catheter shaft. For example, the user interface can be rotatable 360 degrees about the catheter shaft. Additionally, or alternatively, the one or more inputs can be depressible in a direction transverse to the axis of rotation of the user interface.
- In some implementations, with the housing secured to the outer circumference of the catheter shaft, the user interface can be rotatable relative to a handle coupled to the catheter shaft.
- In certain implementations, the housing can define a recess positionable about at least a portion of the outer circumference of the catheter shaft. For example, the portion of the housing defining the recess can include a first section and a second section releasably engageable with the first section to define the recess. For example, the second section can be releasably engageable with the first section through an interference fit. Additionally, or alternatively, the first section of the housing can include a first material, the second section of the housing can include a second material magnetically attracted to the first material, and the first section and the second section of the housing can be releasably engageable to one another through a magnetic force between the first material and the second material. Further, or instead, the first section and the second section can each define a portion of the recess. By way of example, the first section and the second section can each define substantially half of the recess. As a further or alternative example, the portion of the housing defining the recess can further include a hinge disposed between the first section and the second section, the hinge pivotable to move the first section and the second section into releasable engagement with one another.
- In some implementations, the housing can include a clip positionable about at least a portion of the outer circumference of the catheter shaft.
- In certain implementations, the housing can be securable in a fixed axial position relative to the catheter shaft. For example, the housing can be securable in the fixed axial position relative to the catheter shaft through an interference fit between the outer circumference of the catheter shaft and the housing.
- In some implementations, the one or more inputs can include a capacitive touch portion.
- In certain implementations, the housing can be formed of material compatible with sterilization.
- In some implementations, the remote communication device can further include a cover enclosing the housing and the user interface, the cover removable from the housing and the user interface, and the cover formed of material compatible with one or more of the following sterilization techniques: ethylene oxide sterilization, autoclave sterilization, gamma radiation, gas-plasma sterilization.
- In certain implementations, the housing can define a volume and the transmitter is disposed within the volume. For example, the one or more inputs can be at least partially disposed outside of the volume. By way of further or alternative example, the volume can be substantially resistant to fluid ingress.
- In some implementations, the remote communication device can further include a power source in communication with the transmitter, the power source carried by the housing. The power source can be, for example, releasably coupled to the housing.
- In certain implementations, the remote communication device can further include a processor carried by the housing, the processor in communication with the user interface and the transmitter.
- According to still another aspect, a method includes positioning a remote communication device about shaft of a catheter, the shaft having a proximal end region coupled to a handle and a distal end region coupled to an electrode, and securing the remote communication device to an outer circumference of the shaft, along the proximal end region of the shaft, the remote communication device including a housing, a user interface, a transmitter (e.g., a wireless transmitter) in electrical communication with the user interface to send one or more control commands to a remote processor, the housing carrying the user interface and the transmitter, wherein the user interface includes one or more inputs and, with the remote communication device secured to the outer circumference of the shaft, the user interface is at least partially constrained in at least one direction relative to the shaft.
- In some implementations, the remote communication device can be secured to the outer circumference of the shaft, the user interface can be at least partially constrained in a radial direction relative to the shaft. For example, with the remote communication device secured to the outer circumference of the shaft, the user interface can be movable less than about 1 cm in the radial direction relative to the shaft. Further, or instead, with the remote communication device secured to the outer circumference of the shaft, the user interface can be entirely constrained in the radial direction relative to the shaft.
- In certain implementations, with the remote communication device secured to the outer circumference of the catheter shaft, the one or more inputs of the user interface can be depressible in a direction parallel to the at least one partially constrained direction of the user interface.
- In some implementations, with the remote communication device secured to the outer circumference of the catheter shaft, the user interface can be movable along an axis defined by the shaft.
- In certain implementations, the user interface can be rotatable about an axis of rotation coaxial with an axis defined by the shaft. For example, the user interface can be rotatable 360 degrees about the axis of rotation.
- In certain implementations, the one or more inputs can be depressible in a direction transverse to the axis of rotation of the user interface.
- In some implementations, the user interface can be rotatable relative to the handle coupled to the shaft.
- In certain implementations, the housing can define a recess, and securing the remote communication device to the proximal end region of the shaft can include positioning the recess about at least a portion of the outer circumference of the shaft. For example, the portion of the housing defining the recess can include a first section and a second section, and securing the remote communication device to the proximal end region of the shaft can include coupling the first section and the second section to one another about the proximal end region of the shaft.
- In some implementations, the housing can be secured to the proximal end region of the shaft with the housing extending distal to the handle. For example, the housing can be secured to the proximal end region of the shaft such that the housing is adjacent to the handle. As a more specific example, the housing can be mechanically coupled to the handle.
- In certain implementations, the method can further include pressing the one or more inputs to generate one or more control commands based on the one or more inputs. Additionally, or alternatively, the method can further include wirelessly transmitting one or more control commands to a processor remote from the remote communication device.
- According to yet another aspect, a system includes a catheter, a catheter interface unit, and a remote communication device. The catheter includes a handle, a tip portion, a shaft having a proximal end region and a distal end region, the proximal end region coupled to the handle, and the distal end region coupled to the tip portion. The catheter interface unit includes a processing unit and a graphical user interface. The remote communication device is coupled to the proximal end region of the shaft of the catheter, the remote communication device including a user interface and a wireless transmitter in communication with the user interface to send one or more control commands to the processing unit of the catheter interface unit, the one or more control commands corresponding to a set of input options displayed on the graphical user interface.
- In certain implementations, the distal end region of the shaft can be directly coupled to the tip portion.
- In some implementations, movement of the user interface can be constrained in at least one direction with respect to the shaft of the catheter and the one or more inputs of the user interface are depressible in a direction parallel to the at least one constrained direction of the user interface.
- In certain implementations, the remote communication device can be at least partially constrained in a radial direction relative to the shaft. For example, the user interface can be movable less than about 1 cm in the radial direction relative to the shaft. For example, the user interface can be entirely constrained in the radial direction relative to the shaft.
- In some implementations, the user interface can be movable along an axis defined by the shaft of the catheter.
- In certain implementations, the user interface can be rotatable about an axis defined by the shaft of the catheter. For example, the user interface can be rotatable relative to the handle.
- In some implementations, the remote communication device can be coupled to the proximal end region of the shaft of the catheter at a fixed axial position of the shaft.
- In certain implementations, the remote communication device can further include a housing, a portion of the housing defining a recess extending circumferentially about an outer surface of the shaft of the catheter. For example, the remote communication device can be coupled to the proximal end region of the shaft through an interference fit between the portion of the housing defining the recess and the proximal end region of the shaft of the catheter.
- In some implementations, the remote communication device can be releasably coupled to the proximal end region of the shaft of the catheter.
- In certain implementations, the catheter can further include an articulation controller supported on the handle, the articulation controller in mechanical communication with the shaft of the catheter to modify a position of the distal end region of the shaft. For example, the remote communication device can be distal to the articulation controller.
- In some implementations, the remote communication device can be electrically and fluidically isolated from the handle and from the shaft of the catheter.
- In certain implementations, the one or more inputs of the user interface can be positioned relative to the shaft of the catheter such that the one or more inputs are manipulatable by a hand of the user while the same hand of the user applies an axial force to the shaft.
- In some implementations, the one or more inputs of the user interface can be positioned relative to the shaft of the catheter such that the one or more inputs are manipulatable by a hand of the user while the same hand of the user applies torque to the handle of the catheter.
- Embodiments can include one or more of the following advantages.
- In certain implementations, the graphical representation of the cavity of the patient's heart can be modified based on input commands received from the first input device and from the second input device. Thus, control of the graphical representation of the cavity can be advantageously split between two users. As compared to systems controllable by only a single user, the divided control provided by the first input device and the second input device can facilitate receiving direct input from the physician, which can result in more efficient modification of the graphical representation. Additionally, or alternatively, because the graphical representation can also be controlled by a technician operating the first input device, functionality associated with complex manipulation and/or modification of the graphical representation can be retained.
- In some implementations, the second set of input options, represented on the second portion of the graphical user interface and interacted with by the second input device, can correspond to a current state of a state machine having a plurality of states. Because the state of the state machine changes dynamically according to a given set of events associated with the medical procedure and/or inputs from the second input device, robust functionality can be provided to the physician through relatively few inputs on the second input device. Such relatively few inputs on the second input device can be useful, for example, for facilitating one-handed operation of the second input device. Additionally, or alternatively, the relatively few inputs on the second input device can facilitate integrating the control functionality of the second input device into the handle of the catheter. Further in addition, or further in the alternative, the simple interface of the second input device can advantageously reduce the physician's need to look at the second input device, which can be useful for maintaining the physician's focus on the graphical user interface during a medical procedure.
- Other aspects, features, and advantages will be apparent from the description and drawings, and from the claims.
-
FIG. 1 is a schematic representation of a system during a medical treatment, the system including a catheter, a catheter interface unit, a first input device, and a second input device. -
FIG. 2 is a top view of the catheter of the system ofFIG. 1 . -
FIG. 3 is a schematic representation of a tip portion of the catheter ofFIG. 2 , with the tip portion depicted as inserted into a heart cavity of the patient ofFIG. 1 . -
FIG. 4 is a schematic representation of a graphical user interface of the system ofFIG. 1 . -
FIG. 5 is a schematic representation of a state machine corresponding to menu options on a second portion of the graphical user interface ofFIG. 4 . -
FIG. 6 is a flowchart of an exemplary method of controlling a graphical representation on the graphical user interface of the system ofFIG. 1 . -
FIG. 7 is a flowchart of an exemplary method of controlling a graphical representation on the graphical user interface of the system ofFIG. 1 . -
FIG. 8 is a schematic representation of a system during a medical treatment, the system including a catheter, a catheter interface unit, a first input device, and a second input device separate from the catheter. -
FIG. 9 is a schematic representation of a system during a medical treatment, the system including a catheter, a catheter interface unit, a first input device, and a second input device. -
FIG. 10 is an isometric view of the catheter and the second input device ofFIG. 9 . -
FIG. 11 is a side view of the second input device and a portion of the catheter ofFIG. 9 . -
FIG. 12 is an isometric view of the second input device ofFIG. 9 . - Like reference symbols in the various drawings indicate like elements.
- The present disclosure is generally directed to devices, systems, and methods of facilitating a physician's interactions with a graphical user interface associated with a medical procedure being performed by the physician. For example, the devices, systems, and methods of the present disclosure can facilitate the physician's ability to modify a representation of a three-dimensional model on the graphical user interface autonomously (e.g., without assistance from a second person), without interfering with the physician's ability to control the catheter during the medical procedure. By way of non-limiting example and for the sake of clarity of explanation, the devices, systems, and methods of the present disclosure are described with respect to the use of a catheter in a heart cavity of a patient during a medical procedure (e.g., cardiac ablation). However, it should be appreciated that, unless otherwise specified or made clear from the context, the systems and methods of the present disclosure can be used for any of various different medical procedures in which it is desirable for a physician to interact with a graphical user interface autonomously while simultaneously maintaining control over the medical device used as part of the medical procedure.
- As used herein, the term “physician” should be considered to include any type of medical personnel who may be directly interacting with a catheter as part of a medical procedure and is used interchangeably herein with the term “user.” The term “treatment” should be considered to include any manner and type of medical procedure involving the use of a catheter and, therefore, should be considered to include diagnosis, treatment, and combinations thereof, unless otherwise specified or made clear from the context.
- In the following description, it is understood that terms such as “first,” “second,” “top,” “bottom,” “up,” “down,” “right,” “left,” and the like, are words of convenience and are not to be construed as limiting terms.
-
FIG. 1 is a schematic representation of asystem 100 during a cardiac treatment (e.g., an ablation treatment) performed on apatient 102. Thesystem 100 can include acatheter interface unit 104 in communication (e.g., wired or wireless communication) with acatheter 106, afirst input device 108, and asecond input device 110. For example, thecatheter interface unit 104 can be in communication with thecatheter 106 via anextension cable 111 and, additionally or alternatively, in wireless communication with one or more of thefirst input device 108 and thesecond input device 110. Thecatheter interface unit 104 can include aprocessing unit 112, a non-transitory, computerreadable storage medium 114, and agraphical user interface 116. Theprocessing unit 112 can be a controller including one or more processors, and thestorage medium 114 can have stored thereon computer executable instructions for causing the one or more processors of theprocessing unit 112 to carry out one or more of the various methods described herein. In certain implementations, thecatheter interface unit 104 can include additional features, including, without limitation, one or more of the following: current generation; magnetic field generation; magnetic field sensing, and the like. - The
first input device 108 can be a computer (e.g., a desktop computer, a laptop computer, or both), or other, similar input device. Thefirst input device 108 can be operated, for example, by a technician outside of a sterile field, while thesecond input device 110 can include a simple interface suitable for operation by the physician within the sterile field. As described in greater detail below, thecatheter interface unit 104 can receive one or more input commands from thefirst input device 108 and from thesecond input device 110, in response to respective input options on thegraphical user interface 116. Based on the received one or more input commands, thecatheter interface unit 104 can modify a three-dimensional model of a heart cavity of thepatient 102 displayed on thegraphical user interface 116. - The input options available to be controlled by the
second input device 110 on thegraphical user interface 116 can be state-dependent, as also described in greater detail below, such that thesecond input device 110 can be used to interact extensively with thegraphical user interface 116 through the use of only a few input sources (e.g., buttons) on thesecond input device 110. That is, the input options corresponding to the input sources on thesecond input device 110 at any given time during a medical procedure can be displayed on thegraphical user interface 116. Advantageously, as also described in greater detail below, these input options can change according to a state of a state machine, which itself can change according to context (e.g., based on one or more previous actions, a current state, or a combination of both) and/or inputs. Thus, for example, the meaning of pressing a particular input source (e.g., pressing an “up” button) can change based on the state of the state machine, and the meaning of the particular input source at any given time can be displayed to the physician via thegraphical user interface 116. Accordingly, as compared to systems in which controller actions are displayed on a handle of a device or on the controller itself and/or are otherwise fixed, the dynamic interaction between thesecond input device 110 and thegraphical user interface 116 can facilitate the use of the state machine which, in turn, can facilitate achieving a given level of control over thegraphical user interface 116 using fewer input sources on thesecond input device 110. With fewer input sources, thesecond input device 110 can be made into a form factor suitable for integration into a medical device such as thecatheter 106, as described in further detail below. - It should be appreciated that, in implementations in which the
second input device 110 includes only a few input sources, a physician can use thesecond input device 110 to interact with thegraphical user interface 116 while maintaining control over thecatheter 106 during the medical procedure and, thus, while remaining in a sterile field. In such implementations, it should be further appreciated that the limited number of input sources on thesecond input device 110 can make it easier for the physician to use thesecond input device 110 to interact with thegraphical user interface 116 with less of a need to switch focus between thegraphical user interface 116 and thesecond input device 110. Thus, for example, because thesecond input device 110 includes only a few input sources, the physician has less of a need to look at thesecond input device 110 during operation of thesecond input device 110. For at least this reason, the simplified inputs of thesecond input device 110 can facilitate continuous manipulation of thecatheter 106 by the physician, particularly in instances in which the physician must look at thegraphical user interface 116 to manipulate thecatheter 106 during a medical procedure. - Referring now to
FIGS. 1 and 2 , thecatheter 106 can include acatheter shaft 118, ahandle portion 120, and atip portion 122. Thecatheter shaft 118 includes aproximal end region 124 and adistal end region 126. Thehandle portion 120 is coupled to theproximal end region 124 and thetip portion 122 is coupled to thedistal end region 126. Thesecond input device 110 can be coupled to thehandle portion 120 and can communicate with thegraphical user interface 116 such that thesecond input device 110 should be understood to be a graphical user interface (GUI) controller according to all aspects of the present disclosure. Anarticulation controller 128 can also, or instead, be supported on thehandle portion 120. Thus, as described in greater detail below, thesecond input device 110 can be operated to communicate with the catheter interface unit 104 (e.g., with the processing unit 112) such that commands received by thecatheter interface unit 104 from thesecond input device 110 can form the basis of one or more changes to a three-dimensional model of a heart cavity of thepatient 102 displayed on thegraphical user interface 116 while thearticulation controller 128 can be operated to move thetip portion 122 of thecatheter 106 in the heart cavity. - The
second input device 110 can be in remote communication with thegraphical user interface 116 and, for example, can include a transmitter (e.g., a wired transmitter, a wireless transmitter, or both) for such remote communication. In implementations in which thesecond input device 110 includes a wired transmitter, communication between thesecond input device 110 and thecatheter interface unit 104 can be viawires 111 extending from thecatheter 106 to thecatheter interface unit 104. In addition, or in the alternative, in implementations in which thesecond input device 110 includes a wireless transmitter, communication between thesecond input device 110 and thecatheter interface unit 104 can include communication via any of various different known wireless communication protocols. An example of such a wireless communication protocol is Bluetooth®, a wireless standard available from Bluetooth SIG, Inc. While a standardized communication protocol, such as Bluetooth®, may be useful for pairing off-the-shelf hardware components, it should be appreciated that a customized communication protocol can be useful for avoiding interference with the communication between thesecond input device 110 and thecatheter interface unit 104. - The form factor of the
second input device 110 can be based on one or more of the size of thehandle portion 120 and the orientation of thesecond input device 110 relative to thearticulation controller 128. Thus, a small form factor of thesecond input device 110 can be desirable for sizing thehandle portion 120, for example, for ease of operation by the physician (e.g., one-handed operation). To achieve a small form factor, thesecond input device 110 can include a small number of input options (e.g., less than ten) arranged relative to one another in a space-efficient and, or instead, intuitive manner. Additionally, or alternatively, it can be desirable to include a small number of input options on thesecond input device 110 to provide a simple interface that can be operated by the physician with little to no need for the physician's attention to move back and forth from thegraphical user interface 116 to thesecond input device 110. That is, the simple interface provided by thesecond input device 110 can, in certain instances, be used by the physician without requiring the physician to look at thesecond input device 110, making it easier for the physician's attention to remain on thegraphical user interface 116 during a medical procedure. It should be appreciated, however, that providing a physician with access to a diverse set of actions on thegraphical user interface 116 can additionally, or alternatively, be desirable. To manage these competing design considerations, as described in greater detail below, the simple interface of thesecond input device 110 can cooperate with thegraphical user interface 116 to provide the physician with state-dependent functionality, on thegraphical user interface 116, which can be both useful for a given state of the medical procedure and easily navigated using the small number of inputs on thesecond input device 110. - The
second input device 110 can includeinputs second input device 110, through one or more menus on thegraphical user interface 116. Theinputs navigation inputs right navigation input 130 a corresponds to navigation to the right in a menu displayed on thegraphical user interface 116, pressing theleft navigation input 130 b corresponds to navigation to the left in a menu displayed on thegraphical user interface 116, etc. Additionally, or alternatively, theinput 130 e can be an “enter” input and can be arranged, for example, substantially in the middle of thenavigation inputs inputs second input device 110 using a limited number of inputs. For example, a long press time of one or more of theinputs second input device 110 while a short press time of one or more of theinputs second input device 110. - The
navigation inputs second input device 110. Additionally, or alternatively, thesecond input device 110 can include a capacitive touch portion such that, for example, a sliding motion (e.g., of a finger) across the capacitive touch portion can be a navigation input transmitted by thesecond input device 110 to thegraphical user interface 116. The capacitive touch portion can be arranged, in certain instances, as a circle such that a sliding motion detected around the circle is interpreted as a navigation input corresponding to scrolling (e.g., through a menu on the graphical user interface 116). Additionally, or alternatively, the capacitive touch portion can include any one or more of theinputs inputs graphical user interface 116. - In some implementations, a combination of the number, size, and shape of the
inputs inputs inputs handle 120. Theinputs inputs inputs - In certain implementations, the
second input device 110 can include anorientation feature 132 extending from a surface of thesecond input device 110. For example, theorientation feature 132 can extend from a surface of the upnavigation input 130 c. The orientation feature 132 can provide tactile feedback to the physician regarding the position of the physician's hand with respect to thesecond input device 110. Thus, in use, the physician can use tactile feedback from theorientation feature 132 to discern, without needing to look at thesecond input device 110, the position of the physician's hand with respect to theinputs articulation controller 128 and thesecond input device 110. - In general, the
second input device 110 can be disposed relative to thearticulation controller 128 along thehandle portion 120. More generally, according to any one or more of the various different arrangements of thesecond input device 110 relative to thearticulation controller 128 described herein, the physician can operate thesecond input device 110 to modify thegraphical user interface 116 to achieve a desired view of thetip portion 122 of thecatheter 106 on thegraphical user interface 116 and, based on this desired view on thegraphical user interface 116, can operate thearticulation controller 128 to move thetip portion 122 of thecatheter 106 to a desired location (e.g., into contact with tissue). In certain instances, the physician can control (e.g., maintain in place) thedistal end region 126 of thecatheter shaft 118 while simultaneously manipulating thesecond input device 110 according to any one or more of the methods described herein. Accordingly, it should be understood that such relative positioning of thearticulation controller 128 relative to thesecond input device 110 along thehandle portion 120 can include any of various different configurations that advantageously facilitate coordinated operation of thearticulation controller 128 and thesecond input device 110. - In certain implementations, the
second input device 110 can be disposed relative to thearticulation controller 128 along thehandle portion 120 such that the physician can manipulate thesecond input device 110 and thearticulation controller 128 through one-handed operation. As used herein, one-handed operation should be understood to include manipulating thesecond input device 110 substantially simultaneously with manipulation of thearticulation controller 128 using any combination of fingers of a single hand of the physician while the single hand of the physician maintains the same grip of the handle portion 120), leaving the physician with a free hand during the medical procedure. Such one-handed operation of thesecond input device 110 and thearticulation controller 128 can be useful, for example, for allowing the physician to grip thecatheter shaft 118 with a free hand to maintain thedistal end region 126 in place in the heart cavity of thepatient 102. - As an example, the
second input device 110 can be coupled to thehandle portion 120 at a position distal to thearticulation controller 128 to facilitate operation of thearticulation controller 128 with a thumb and manipulation of thesecond input device 110 with an index finger of the same hand while that hand maintains a natural grip of thehandle portion 120. - Additionally, or alternatively, the
second input device 110 can be coupled to thehandle portion 120 along an axial position at which thearticulation controller 128 is positioned on thehandle portion 120. Thearticulation controller 128 can be movable, in certain instances, along a plane substantially perpendicular to a direction of movement of one or more of theinputs articulation controller 128 relative to theinputs articulation controller 128 in a direction different from a direction of forces associated with the one ormore inputs articulation controller 128 and the one ormore inputs - Further or instead, one or
more inputs more inputs catheter shaft 118 such that the one ormore inputs catheter shaft 118 between a thumb and another finger of a single hand). As an additional or alternative example, the one ormore inputs catheter shaft 118 such that one ormore inputs handle portion 120. - In some implementations, the
second input device 110 can be rotatably coupled to thehandle portion 120 such that thesecond input device 110 is rotatable about a circumference of thecatheter shaft 118. In such implementations, operation of thesecond input device 110 and thearticulation controller 128 can include rotating thesecond input device 110 relative to thecatheter shaft 118 and, thus, relative to thearticulation controller 128 to bring thesecond input device 110 into proximity to thearticulation controller 128 and/or to the physician's hand during a procedure. Accordingly, it should be appreciated that rotation of thesecond input device 110 relative to thecatheter shaft 118 can, in certain instances, facilitate one-handed operation of thesecond input device 110 and thearticulation controller 128. - The
second input device 110 can be, for example, rotatable (e.g., between zero degrees and about 180 degrees) about the circumference of thecatheter shaft 118. As a more specific example, thesecond input device 110 can rotate freely about the circumference of thecatheter shaft 118 such that thesecond input device 110 can be moved unimpeded about the circumference of thecatheter shaft 118 through multiple rotations in any given direction. Such free rotation of thesecond input device 110 can facilitate moving thesecond input device 110 quickly into a desired position. For example, the physician can spin thesecond input device 110 into a desired position. Additionally, or alternatively, with free rotation about thecatheter shaft 118, the physician can move thesecond input device 110 into place using any finger that might not otherwise be engaged during a medical procedure. - In some implementations, the
second input device 110 can be releasably coupled to thehandle portion 120. For example, a releasable coupling between thesecond input device 110 and thehandle portion 120 can include a pin-and-socket configuration in which electrical communication and mechanical coupling between thesecond input device 110 and thehandle portion 120 are established at substantially the same time as pins extending from thesecond input device 110 are inserted into corresponding sockets defined by thehandle portion 120. - The
second input device 110 can be sterilizable. For example, thesecond input device 110 can be formed of components compatible with sterilization according to one or more of the following sterilization techniques: ethylene oxide sterilization, autoclave sterilization, gamma radiation, gas-plasma sterilization. In implementations in which thesecond input device 110 is releasably coupled to thehandle portion 120, thesecond input device 110 can be sterilizable separately from thehandle portion 120. Further, or instead, thesecond input device 110 can be reusable such that thesecond input device 110 can be sterilized between uses and secured to anew handle portion 120 for each use. - The
articulation controller 128 can be in mechanical communication with thecatheter shaft 118. In operation, thearticulation controller 128 can modify the position of thedistal end region 126 of thecatheter shaft 118 and, thus, modify the position of thetip portion 122 of thecatheter 106. As an example, one or more pull wires (not shown) can couple thearticulation controller 128 to thecatheter shaft 118 as is known in the art. - Operation of the
articulation controller 128 can move one or more of the pull wires in a proximal direction to create a deflection force at thedistal end region 126 of thecatheter shaft 118. For example, thearticulation controller 128 can include one or more levers rotatable about an axis substantially perpendicular to an axis defined by thehandle portion 120, with the rotation of thearticulation controller 128 moving one or more of the pull wires to deflect thedistal end region 126 of thecatheter shaft 118. Additionally, or alternatively, thearticular controller 128 can include a plunger (e.g., proximal or distal to the handle portion 120) movable along an axis substantially parallel to an axis defined by thehandle portion 120, with proximal and distal movement of thearticulation controller 128 moving one or more pull wires to move thedistal end region 126 of the catheter shaft between a deflected position and a straight position. Because thetip portion 122 is coupled to thedistal end region 126 of thecatheter shaft 118, the deflection force at thedistal end region 126 of thecatheter shaft 118 can deflect thetip portion 122. While thearticulation controller 128 has been described as being in mechanical communication with thecatheter shaft 118 via one or more pull wires, it should be appreciated thearticulation controller 128 can additionally, or alternatively, be in mechanical communication with thecatheter shaft 118 through any one or more methods known in the art (e.g., through torque transmitted via a rotating member). - The
catheter 106 can further, or instead, include amagnetic position sensor 133 along thedistal end region 126 of thecatheter shaft 118. Themagnetic position sensor 133 can be any of various magnetic position sensors well known in the art and can be positioned at any point along thedistal end region 126. Themagnetic position sensor 133 can, for example, include one or more coils that detect signals emanating from magnetic field generators. One or more coils for determining position with five or six degrees of freedom can be used. - The magnetic field detected by the
magnetic position sensor 133 can be used to determine the position of thedistal end region 126 of thecatheter shaft 118 according to one or more methods commonly known in the art such as, for example, methods based on using a sensor, such as themagnetic position sensor 133, to sense magnetic fields and using a look-up table to determine location of themagnetic position sensor 133. Because thetip portion 122 is coupled to thedistal end region 126 of thecatheter shaft 118 in a known, fixed relationship to themagnetic position sensor 133, themagnetic position sensor 133 can provide the location of thetip portion 122. While the location of thetip portion 122 is described as being determined based on magnetic position sensing, other position sensing methods can additionally or alternatively be used. For example, the location of thetip portion 122 can be additionally, or alternatively, based on impedance, ultrasound, and/or imaging (e.g., real time MRI or fluoroscopy). - The
tip portion 122 can be one or more of a diagnostic tip and a treatment tip for directing energy (e.g., RF energy, ultrasound energy, chemical energy) toward tissue of the heart cavity. For example, thetip portion 122 can include at least one electrode mechanically coupled (e.g., directly coupled or indirectly coupled) to thedistal end region 126 of thecatheter shaft 118. The at least one electrode can be, additionally or alternatively, disposed along an expandable element coupled to thedistal end region 126 of thecatheter shaft 118. - Referring now to
FIG. 3 , in use, thetip portion 122 can be inserted into aheart cavity 134 of the patient 102 (FIG. 2 ) as part of the medical procedure. In certain implementations, thetip portion 122 can interact with asurface 135 of theheart cavity 134 as part of a medical procedure. For example, thetip portion 122 can deliver energy to thesurface 135 for the purpose of treatment, diagnosis, or both. The energy delivered through thetip portion 122 can include any manner and form of energy known in the art and, therefore, can include RF energy. - The location of the
tip portion 122 relative to thesurface 135 of theheart cavity 134 can be known (e.g., based on a signal received from themagnetic position sensor 133 ofFIG. 2 ). Further, or in the alternative, the shape of thesurface 135 of theheart cavity 134 can be known based on any of various different methods, including methods based on known locations visited by thetip portion 122 within theheart cavity 134. Accordingly, as described in greater detail below, thegraphical user interface 116 can represent the location of thetip portion 122 relative to thesurface 135 on thegraphical user interface 116. Thus, in medical procedures in which direct visualization of thetip portion 122 in theheart cavity 134 is not possible, or is at least impractical, a physician can use thegraphical user interface 116 as a tool for visualization of thetip portion 122 and/or theheart cavity 134 during a medical procedure. - Referring now to
FIGS. 1-4 , thegraphical user interface 116 can include any of various different types of two-dimensional and/or three-dimensional displays known in the art. Thus, for example, thegraphical user interface 116 can include a computer monitor or another similar type of two-dimensional display. Additionally, or alternatively, thegraphical user interface 116 can include an augmented reality environment, a virtual reality environment, or combinations thereof. - The
graphical user interface 116 can include afirst portion 136 and asecond portion 138 spatially delineated from thefirst portion 136. In general, the spatial delineation between thefirst portion 136 and thesecond portion 138 can facilitate accommodating two different use cases on thegraphical user interface 116 at the same time. For example, thesecond portion 138 can work in cooperation with the limited inputs of thesecond input device 110 to provide the physician with a robust interface while thefirst portion 136 can cooperate with more expansive input options available through the first input device 108 (e.g., input options compatible with a full keyboard, a mouse, or combinations thereof). In general, these use cases are not interchangeable with one another as efficient input solutions. That is, it would be inefficient to use thesecond input device 110, with limited input options, to operate thefirst portion 136 of thegraphical user interface 116, and the opposite case of operating thefirst input device 108, with multiple input options, to navigate through a state machine represented on thesecond portion 138 of thegraphical user interface 116 is also an inefficient input solution. Accordingly, the spatial delineation between thefirst input portion 136 and thesecond input portion 138 can be useful for providing different users with user interface elements that are appropriate for a given use case associated with the respective user. - In certain implementations, spatial delineation of the
first portion 136 from thesecond portion 138 can be useful for facilitating switching focus between thefirst portion 136 and thesecond portion 138 by a physician during a medical procedure. For example, because thesecond portion 138 is in a readily identifiable location (e.g., centered on the graphical user interface 116) relative to thefirst portion 136 on thegraphical user interface 116, the physician can easily switch focus back and forth between thefirst portion 136 and thesecond portion 138 with little time and effort expended to locate or relocate the physician-specific interface on thesecond portion 138 of thegraphical user interface 116. Further, or in the alternative, such spatial delineation of thefirst portion 136 from thesecond portion 138 can facilitate concurrent, or substantially concurrent, use of thegraphical user interface 116 by two different users, as described in greater detail below. - The
first portion 136 of thegraphical user interface 116 can include a first set ofinput options 140 and, further or instead, agraphical representation 142 of theheart cavity 134. As used herein, thegraphical representation 142 of theheart cavity 134 can include partial depictions of theheart cavity 134, such as those that may be generated in implementations in which thegraphical representation 142 is built based on known locations of thecatheter 106. The first set ofinput options 140 can correspond to permissible modifications and/or display settings of thegraphical representation 142. Such modifications and/or display settings of thegraphical representation 142 can correspond to one or more input commands based on the first set ofinput options 140 and received in preparation for and/or during a medical procedure. - The
graphical representation 142 can be based, for example, on the shape of thesurface 135 of theheart cavity 134 such that thegraphical representation 142 can include at least one two-dimensional projection of a three-dimensional model of theheart cavity 134. Additionally, or alternatively, thegraphical representation 142 can include a depiction of a portion of the catheter 106 (e.g., the tip portion 122), which can be useful for locating the portion of thecatheter 106 relative to theheart cavity 134. As shown inFIG. 4 , thegraphical representation 142 can include, for example, more than one two-dimensional projection of a three-dimensional model of theheart cavity 134, with each two-dimensional projection projected to a different image plane and, thus, corresponding to a different view of the three-dimensional model of theheart cavity 134. - The
second portion 138 of thegraphical user interface 116 can include a second set ofinput options 144. The second set ofinput options 144 can advantageously be different from the first set ofinput options 140, as described in greater detail below. In general, the second set ofinput options 144 can correspond to permissible modifications and/or display settings associated with thegraphical representation 142 in thefirst portion 136 of thegraphical user interface 116. Such modifications of thegraphical representation 142 can correspond to one or more input commands based on the second set ofinput options 144 and received in preparation for and/or during a medical procedure. - The
first input device 108 can be in communication with thefirst portion 136 of thegraphical user interface 116 while thesecond input device 110 can be in communication with thesecond portion 138 of thegraphical user interface 116. In general, a first user (e.g., a technician outside of a sterile field) can use thefirst input device 108 to interact with the first set ofinput options 140 on thegraphical user interface 116, and a second user (e.g., a physician within a sterile field) can use thesecond input device 110 to interact with the second set ofinput options 144 on thegraphical user interface 116 while concurrently, or substantially concurrently, manipulating thecatheter 106. Because the second user can be constrained (e.g., by requirements for maintaining the sterile field and/or the need to manipulate the catheter 106), the second set ofinput options 144 can advantageously be state-dependent to facilitate navigation of the second set ofinput options 144 using only a limited number of inputs, such as theinputs second input device 110. - As used herein, the term “state-dependent” is inclusive of a state machine in which the second set of
input options 144 can be in one of a set number of conditions, or states, based on one or more previous states and on previous inputs, with state transitions in such a state machine depending on the present state and the present inputs. Examples of a state-machine associated with the second set ofinput options 144 are described in greater detail below. In general, however, the second set ofinput options 144 can be state-dependent such that, although a given state of the second set ofinput options 144 may be a reduced set of options as compared to the first set ofinput options 140, the combination of the states of the second set ofinput options 144 can offer functionality equivalent or similar to the functionality available through all or a subset of the first set ofinput options 140. - The
second portion 138 of thegraphical user interface 116 can include, for example, abanner section 146 and amenu section 148. In combination, thebanner section 146 and themenu section 148 can present the second set ofinput options 144 corresponding to the current state of a plurality of states of the state machine. Also, or instead, the combination of thebanner section 146 and themenu section 148 can provide the physician with visual context for navigating to other states of the state machine. Such visual context can facilitate, for example, efficient navigation to the various states of the state machine (e.g., as necessitated during the medical procedure) using only a limited number of inputs, such as theinputs second input device 110. -
FIG. 5 is a schematic representation of an example of astate machine 150 implemented on the catheter interface unit 104 (FIG. 1 ). For the sake of clarity of representation, the states of thestate machine 150 are generally represented relative to one another in two-dimensions inFIG. 5 . Each arrow between states of thestate machine 150 represents a navigation input command that will move thestate machine 150 from one state to another. Thus, in the example shown inFIG. 5 , right/left navigation commands received from the second input device 110 (FIG. 2 ) move to the right or left, as the case may be, of a given state, and up/down navigation commands received from the second input device 110 (FIG. 2 ) move up or down, as the case may be, relative to a given state. It should be appreciated, however, that additional or alternative relationships between navigations inputs from the second input device 110 (FIG. 2 ) can be used to navigate through the states of thestate machine 150. As an example, the press time (e.g., a long press time) associated with a navigation input command from thesecond input device 110 can be used to skip to a particular state in thestate machine 150. - Referring now to
FIGS. 1-5 , as described in further detail below, the current state of thestate machine 150 can be represented on thesecond portion 138 of thegraphical user interface 116, and an adjacent state or states of thestate machine 150 can be represented on thesecond portion 138 of the graphical user interface 116 (e.g., as a preview) to facilitate navigation from one state to another. - The
state machine 150 can have any of various different configurations, which can depend on, among other things, the configuration of thesecond input device 110, the configuration of the second set ofinput options 144, the functionality to be provided to the physician, and/or the application to which the state machine is being applied. Accordingly, while specific implementations of thestate machine 150 are described herein by way of example, further or alternative implementations of thestate machine 150 are additionally or alternatively possible. - In general, the
state machine 150 can include a top-level 152 and one ormore sublevels 153. The functionality described herein with respect to the top-level 152 and the one ormore sublevels 153 is by way of example and not limitation. Further, it should be appreciated that thestate machine 150 can include a layer above the top-level 152 through which access to thestate machine 150 is gained. For example, thestate machine 150 can include one or more layers above the top-level 152 to allow the physician to choose between an ablation mode and a mode in which the physician can work with thestate machine 150 to modify thegraphical representation 142. - In the
exemplary state machine 150, the top-level 152 includes abuild state 154 a, aview state 156 a, and atag state 158 a (sometimes collectively referred to herein as “top-level states” and sometimes individually referred to herein as a “top-level state”). One or more sublevel state can be below each top-level state. For the sake of clarity, the hierarchy of states of thestate machine 150 is represented inFIG. 5 such that each top-level state has an element number ending with “a,” each sublevel state below the respective top-level state is represented with the same element number ending with “b” (in the case of a first sublevel state), and the input options corresponding to a given sublevel state are represented with the same element number ending with “c”. - Navigation through the states of the
state machine 150 can be represented in thesecond portion 138 of the graphical user interface 116 (e.g., as a change in the state highlighted in the second portion 138). In general, one or more of theinputs second input device 110 can be used to send navigation commands to thecatheter interface unit 104 to navigate through the states of thestate machine 150 and one or more of theinputs catheter interface unit 104 to select a particular state of thestate machine 150. As navigation commands are sent to thecatheter interface unit 104, the representation of the states of thestate machine 150 on thesecond portion 138 of thegraphical user interface 116 can change accordingly. For example, thesecond portion 138 of thegraphical user interface 116 can highlight or otherwise accentuate the current navigation position of thestate machine 150. In certain implementations, a received input command can select the current navigation position as the state of thestate machine 150. Thus, as used herein, a “navigation command” should be understood to include an input sent from one or more of theinputs catheter interface unit 104 to change a display of one or more states on thesecond portion 138 of thegraphical user interface 116, with the change of the display of the one or more states corresponding to navigation through the states of thestate machine 150. Additionally, or alternatively, an “input command” should be understood to include an input sent from one or more of theinputs second portion 138 of thegraphical user interface 116. - Respective icons for the
build state 154 a, theview state 156 a, and thetag state 158 a can be displayed in thebanner section 146 of thesecond portion 138 of thegraphical user interface 116. These respective icons can advantageously provide a visual indication of the contents of the corresponding sublevel state displayed in themenu section 148 below the corresponding top-level state. For example, if an icon associated with thebuild state 154 a is highlighted in thebanner section 146, the physician can readily assess that the sublevel state shown in themenu section 148 corresponds to thebuild state 154 a. - In use, the
inputs state machine 150. It should be appreciated that scrolling across the sublevel states in thestate machine 150 can be advantageous for efficient navigation at least because such scrolling reduces the need to use also theinputs state machine 150. For example, the physician can use single button operation (e.g., using only theinput 130 a (right) or only theinput 130 b (left)) to scroll across the sublevel states. Scrolling across the sublevel states can be represented as a change in the sublevel state shown or highlighted in themenu section 148. Optionally, a corresponding change in the display of the icons of the top-level state can be shown in thebanner section 146. - The
inputs state machine 150, with the scrolling within the sublevel state represented as a change in the sublevel state option shown or highlighted in themenu section 148. For example, theinputs build input options 154 c′ in the firstbuild sublevel state 154 b′, secondbuild input options 154 c″ in the second build sublevel, firstview input options 156 c′ in the first view sublevel state, secondview input options 156 c″ in the secondview sublevel state 156 b″, and taginput options 158 c in thetag sublevel state 158 b. - As an example of navigation of the
state machine 150, the physician can use theinputs tag sublevel state 158 b to theview sublevel state 156 b″ to see options for adjusting thegraphical representation 142 on thefirst portion 136 of thegraphical user interface 116. This may be desirable, for example, for better visualization of thegraphical representation 142 and, thus, for more accurate placement of tags on thegraphical representation 142. As the physician scrolls from thetag sublevel state 158 b to theview sublevel state 156 b″, the highlighted icon in thebanner section 146 can change accordingly to provide the physician with a visual indication of the top-level state corresponding to the second set ofinput options 144. The physician can select the desired sublevel state, which is the viewsub level state 156 b″ in this example, by providing an input command, such as an enter command viainput 130 e. With the desired sublevel state selected, the physician can use theinputs machine 150 are additionally, or alternatively, possible and can similarly facilitate execution of the medical procedure by the physician. - The
build state 154 a can have a firstbuild sublevel state 154 b′ and a secondbuild sublevel state 154 b″. Thestate machine 150 can be in one or the other of the firstbuild sublevel state 154 b′ and the secondbuild sublevel state 154 b″, depending on whether a build procedure is in progress. As used herein, the build procedure can include formation of a three-dimensional model of theheart cavity 134 used to form thegraphical representation 142 displayed on thegraphical user interface 116. For example, the build procedure can be based on received locations of thetip portion 122 of thecatheter 106 in theheart cavity 134. - The first
build sublevel state 154 b′ can correspond to the build procedure being stopped. Accordingly, the firstbuild sublevel state 154 b′ can include an input for starting the build procedure, which can be displayed in themenu section 148 of thesecond portion 138 of thegraphical user interface 116. When the physician selects the input to start the build procedure, the current state of thestate machine 150 can switch to the secondbuild sublevel state 154 b″. - The second
build sublevel state 154 b″ can correspond to the build procedure being in progress. Accordingly, the secondbuild sublevel state 154 b″ can include an input for stopping the build procedure, which can be displayed in themenu section 148 of thesecond portion 138 of thegraphical user interface 116. When the physician selects the input to stop the build procedure, the current state of thestate machine 150 can switch to the firstbuild level state 154 b′. Thus, thestate machine 150 moves between sublevel states (the firstbuild sublevel state 154 b′ and the secondbuild sublevel state 154 b″, in this example) to present the physician with input options that represent the next logical step or steps in the medical procedure, given the current state of thestate machine 150. - The
view state 156 a can correspond to control of thegraphical representation 142 on thefirst portion 136 of thegraphical user interface 116. For the sake of clarity of explanation, thestate machine 150 is described with respect to theview state 156 a controlling a single view of thegraphical representation 142. It should be appreciated, however, that theview state 156 a can include multiple states, each corresponding to control of a different view of thegraphical representation 142 on thefirst portion 136 of thegraphical user interface 116. For example, in instances in which a first view of thegraphical representation 142 is displayed on the left side of thegraphical user interface 116 and a second view of thegraphical representation 142 is displayed on the right side of thegraphical user interface 116, theview state 156 a can include states corresponding to the respective views on the left side and right side of thegraphical user interface 116. - The
view state 156 a can include a firstview sublevel state 156 b′ and a secondview sublevel state 156 b″. While theview state 156 a is described as having two sublevels, it should be appreciated that theview state 156 a can have any of various different sublevels. In general, the sublevels associated with theview state 156 a can depend on the amount of control to be provided to the physician with respect to thegraphical representation 142 on thefirst portion 136 of thegraphical user interface 116. Accordingly, the number of sublevels associated with theview state 156 a can depend on the particular implementation. For example, in the case of implementations related to visualization of a medical procedure performed on theheart cavity 134 of thepatient 102, theview state 156 a can include a sublevel associated with rotation of thegraphical representation 142 and a sublevel associated with one or more fixed views of thegraphical representation 142. - The
state machine 150 can be in one or the other of the firstview sublevel state 156 b′ and the secondview sublevel state 156 b″, depending on which of various, different view control features is selected. An example of a view control feature can be a fixed view mode in which a plurality of fixed views (e.g., left-anterior oblique (LAO), right-anterior oblique (RAO), etc.) are displayed in themenu section 148 such that the physician can scroll through the fixed views and select a desired view. Additionally, or alternatively, a view control feature can be an adjustable view mode (e.g., in which the physician can adjust a view parameter such as tilt). Accordingly, in implementations in which the firstview sublevel state 156 b′ corresponds to a fixed view mode and the secondview sublevel state 156 b″ corresponds to an adjustable view mode, the physician can switch between the fixed view mode and the adjustable view mode as desired (e.g., by scrolling across the sublevel states). - The
tag state 158 a can have, for example, a singletag sublevel state 158 b including a selection of identifiers corresponding to anatomic features of the heart cavity. Thus, for example, when the top-level state of the state machine corresponds to thetag state 158 a, the identifiers of thetag sublevel state 158 b can be displayed in themenu section 148 of thesecond portion 138 of thegraphical user interface 116. In use, the physician can navigate through the identifiers displayed in themenu section 148 using, for example, theinputs input 130 e. As a result of this selection, an appropriate tag can appear on thegraphical representation 142 shown on thefirst portion 136 of thegraphical user interface 116. As an example, the appropriate tag can appear on thegraphical representation 142 at a location based on the location of thecatheter tip 122. - The tags available in the
tag sublevel state 158 b can be a function of the global state of thestate machine 150 and, thus, can themselves be state dependent. For example, if thestate machine 150 is in an “ablation” mode, the tags available in thetag sublevel state 158 b can include tags related to marking the location of one or more ablations on thegraphical representation 142. As an additional or alternative example, if thestate machine 150 is in an “anatomy” mode, the tags available in thetag sublevel state 158 b can correspond to marking anatomic features on thegraphical representation 142. In cardiac implementations, the tags available in thetag sublevel state 158 b can be dependent on the chamber of the heart in which thecatheter 106 is inserted. For example, information regarding the chamber can be received from thefirst input device 108 and/or thesecond input device 110, and the tags in thetag sublevel state 158 b can be updated accordingly. - The computer executable instructions stored on the computer
readable storage medium 114 can cause theprocessing unit 112 to receive inputs from thefirst input device 108 and thesecond input device 110 to modify thegraphical representation 142 according to one or more of the following exemplary methods. For example, the computer executable instructions stored on thestorage medium 114 and executable by theprocessing unit 112 can be an application built using Visualization Toolkit, an open-source 3D computer graphics toolkit, available at www.vtk.org. Unless otherwise indicated or made clear from context, each of the following exemplary methods can be implemented using thesystem 100 and/or one or more components thereof. -
FIG. 6 is a flowchart of anexemplary method 160 of controlling a graphical representation on a graphical user interface. The graphical representation and the graphical user interface can be, for example, any of the various different graphical representations and graphical user interfaces described herein. Accordingly, theexemplary method 160 can control the display of the graphical representation 142 (FIG. 4 ) on the graphical user interface 116 (FIGS. 1 and 4 ). - The
exemplary method 160 can include receiving 162 a signal indicative of location of a cardiac catheter in a cavity of a patient's heart, displaying 164 a graphical representation of the cavity of the patient's heart, receiving 166 a a first input command based on a first set of input options, receiving 166 b a second input command based on a second set of input options, and modifying 168 the graphical representation based on the first input command and on the second input command. The graphical representation can be based on the received 162 signal indicative of location of the cardiac catheter and can be displayed on a first portion of a graphical user interface, along with the first set of input options. The second set of input options can be displayed, for example, on a second portion of the graphical user interface. - Receiving 162 the signal indicative of location of the cardiac catheter in the cavity of the patient's heart can include any of the various different methods described herein for determining a location of a cardiac catheter in a heart cavity. For example, receiving 162 the signal indicative of location of the cardiac catheter in the cavity of the patient's heart can include receiving a signal from a sensor such as the magnetic position sensor 133 (
FIG. 2 ). Further, it should be appreciated that the received 162 signal can be indicative of any predetermined location of the cardiac catheter in the heart cavity. Accordingly, the received 162 signal can be indicative of a tip portion (e.g., tip portion 122) of the cardiac catheter. - In certain implementations, displaying 164 the graphical representation of the cavity of the patient's heart can include projecting a model (e.g., a three-dimensional model) of either or both of the cardiac catheter and the cavity to an image plane corresponding to the graphical user interface. Further, or alternatively, displaying 164 the graphical representation can include displaying the cavity of the patient's heart in one or more views in the first portion of the graphical user interface. Such multiple views can be useful, for example, for visualizing movement of the cardiac catheter relative to one or more surfaces of the cavity.
- In certain implementations, displaying 164 the graphical representation can include displaying only a graphical representation of the cardiac catheter initially, while a graphical representation of the heart cavity is being built. As the graphical representation of the heart cavity is built, displaying 164 the graphical representation can include updating the graphical representation to show the gradual generation of the graphical representation of the heart cavity.
- Displaying 164 the graphical representation can be based on the received 166 a first input command and the received 166 b second input command. That is, in general, displaying 164 the graphical representation can be based on inputs received from two different sources. Such multiple inputs can be useful, for example, for facilitating receiving input directly from a physician while allowing a technician to provide additional or alternative inputs for controlling the graphical representation.
- Receiving 166 a the first input command from the first input device and receiving 166 b the second input command from the second input device can occur concurrently. For example, receiving 166 a the first input command can be along a first communication channel and receiving 166 b the second input command can be along a second communication channel, different from the first communication channel. Each communication channel can be associated with a respective portion of the graphical user interface such that the first communication channel can be associated with the first portion of the graphical user interface, upon which the first set of input options is displayed and, similarly, the second communication channel can be associated with the second portion of the graphical user interface, upon which the second set of input options is displayed. It should be appreciated that during concurrent communication, one of the first communication channel or the second communication channel can have a predetermined priority over the other. For example, the second communication channel can be given priority over the first communication channel such that communication from the second input device associated with the physician is given priority over communication from the first input device.
- One or both of receiving 166 a the first input command from the first input device and receiving 166 b the second input command from the second input device can include wireless or wired communication according to any of the various different communication systems and methods described herein. Further, one of the receiving 166 a the first input command from the first input device and receiving 166 b the second input command from the second input device can include wireless communication while the other includes wired communication.
- Receiving 166 a the first input command from the first input device can include receiving an input command from any of various different input devices known in the art, including, for example, one or more of a keyboard, a mouse, a touchscreen, etc. In general, the first input command can be received 156 a from a technician, or other similar personnel, who is ordinarily not in the sterile field and, thus, ordinarily has full use of both hands to manipulate the first input device. Accordingly, the second set of input options can be a subset of the first set of input options such that the technician may have access to certain input options that are not available to the physician as the physician operates the second input device during the medical procedure. That is, the technician can have access to input options associated with functions that are more efficiently carried out by the technician than by the physician, who must also manipulate the catheter during the medical procedure.
- The first set of input options from which the received 166 a first input command is derived can be displayed along a portion of the graphical user interface that is ordinarily not an area of focus for the physician. For example, the first set of input options can be on the first portion of the graphical user interface and, optionally, set off to one side of the graphical representation of the heart cavity. It should be appreciated that such orientation of the first set of input options can be useful for efficient use of the space available on the graphical user interface. For example, because the first set of input options are not associated with the second input device operated by the physician, placing the first set of input options in a non-central location, or an otherwise deemphasized location, on the graphical user interface can facilitate presentation of the most relevant information to the physician during a medical procedure. That is, the second portion of the graphical user interface, upon which the second set of input options is displayed, can be substantially centrally positioned on the graphical user interface.
- In general, receiving 166 b the second input command can include receiving one or more commands from a remote device. As used herein, the term “remote device” includes an input device that is spatially separated from the first input device, from the graphical user interface, and/or from a processing unit of a catheter interface unit. In general, such spatial separation can be delineated by a sterile field such that the term “remote device” is inclusive of a device that transmits one or more input commands from within a sterile field to one or more portions of the system outside of the sterile field. Accordingly, it should be appreciated that remote communication using the remote device can offer certain advantages for communicating with a processing unit or other portions of a catheter interface unit while maintaining the sterile field.
- Receiving 166 b the second input command from the remote device can include receiving an input command from any of the various different remote devices described herein. Thus, for example, receiving 166 b the second input command from the remote device can include receiving an input command from a second input device disposed on a handle portion of a catheter (e.g., the
second input device 110 disposed on thehandle portion 120 of thecatheter 106 as described with respect toFIG. 2 ). Further, or in the alternative, receiving 166 b the second input command from the remote device can include receiving an input command from a second input device that is separate from a catheter, as described in greater detail below. - Receiving 166 b the second input command can include receiving a discrete selection command. The discrete selection command can include a click, or other similar discrete input appropriate for the second input device, corresponding to selection of one of the second set of input options. For example, the discrete selection command can include an input such as the
input 130 e arranged as an “enter” input as described with respect toFIG. 2 . The instruction corresponding to the discrete selection command can vary depending on the state of a state machine represented in the second portion of the graphical user interface. More generally, the instruction corresponding to the discrete selection command can be based on the context of a particular portion of the medical procedure and, thus, can change over the course of the medical procedure. - In certain implementations, the
exemplary method 160 can further include receiving 167 navigation commands for moving, within the second portion of the graphical user interface, between the options in the second set of options. As an example, the received 167 navigation commands can include discrete direction commands (e.g., left, right, up, and down corresponding to input from one or more ofinputs - The navigation commands can be received before and/or concurrently with receiving 156 b the second input command. For example, one or more of the received 167 navigation commands and the received 156 b second input command can be used to navigate through the various different states of a state machine according to any one or more of the systems and methods described herein and, in particular, with respect to
FIG. 5 . - At least one of the received 167 navigation commands can scroll through the second set of input options displayed as an infinite wheel. That is, repeated
receipt 167 of a particular navigation command (e.g., a “left” command) can cycle through the second set of input options continuously. Such continuous cycling in response to repeatedreceipt 167 of a particular navigation command can facilitate one-handed operation of the second input device to navigate the second set of input options. For example, if the physician inadvertently scrolls past a desired input option, the physician can continue to press the same navigation input (e.g., input 130 a, 130 b, 130 c, 130 d ofFIG. 2 ) until the desired input appears again in the second portion of the graphical user interface. - In some implementations, the
exemplary method 160 can further include detecting 169 receipt of an initial command. The initial command can be the received 166 b second input command. By way of non-limiting example, the detected 169 receipt of the initial command can follow a period of inactivity and/or a predetermined change in the second portion of the graphical user interface. Additionally, or alternatively, the initial command can be one of the received 167 navigation commands. - In general, the first portion is viewable on the graphical user interface at the same time that the second portion is viewable on the graphical user interface, and it can be useful to delineate between the first portion and the second portion during the medical procedure. As an example of such a delineation between the first portion and the second portion, one or more display features of the second portion of the graphical user interface can be changed based on the detected 169 receipt of the initial command. Such a change in the second portion of the graphical user interface can advantageously provide the physician with feedback regarding proper operation of the second input device. That is, as the one or more display features of the second portion of the graphical user interface change, the change in the second portion of the graphical user interface can be perceived by the physician and, thus, serve as an indication that the commands from the second input device are being reflected in the second portion of the graphical user interface.
- Changes to the one or more display features of the second portion of the graphical user interface can include displaying additional input options of the second set of input options (e.g., displaying additional input options related to a current state of the state machine such as the
state machine 150 described with respect toFIG. 5 ). For example, detecting 169 receipt of the initial command can result in expansion of a menu to provide the physician with a visual representation of additional options. Additionally, or alternatively, detecting 169 receipt of the initial command can result in displaying one or more menus to provide the physician with a preview of menus that are adjacent to a current menu to facilitate navigation to an appropriate menu in the second portion of the graphical user interface. - In certain implementations, changing one or more display features of the second portion of the graphical user interface can include changing one or more display features of the second portion of the graphical user interface, relative to the first portion of the graphical user interface, between a baseline configuration and a modified configuration. As an example, such a change can include changing the size of the second portion of the graphical user interface relative to the size of the first portion of the graphical user interface. Thus, in such instances, detecting 169 receipt of the initial command can result in the second portion of the graphical user interface increasing in size relative to the first portion of the graphical user interface. This change in size can make the second portion of the graphical user interface easier to perceive by the physician and, thus, can facilitate navigation through one or more menus displayed on the second portion of the graphical user interface.
- In addition to, or as an alternative to, changing the size of the second portion of the graphical user interface in response to detecting 169 receipt of the initial command, changing the one or more display features of the second portion of the graphical user interface can include changing opacity of the second portion of the graphical user interface relative to the opacity of the first portion of the graphical user interface. As an example, the baseline configuration of the second portion of the graphical user interface can be relatively opaque prior to detecting 169 receipt of the initial command and can become less opaque upon detecting 169 receipt of the initial command. Such a change in opacity of the second portion of the graphical user interface can make the second portion of the graphical user interface more easily perceivable by the physician.
- Further in addition, or further in the alternative, changing one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing the position of the second portion of the graphical user interface relative to the position of the first portion of the graphical user interface. An example of such a change in position can include displaying the second portion of the graphical user interface as a pop-up window. For example, the pop-up window can appear in front of the first portion of the graphical user interface. More generally, a change in position of the second portion of the graphical user interface relative to the first portion of the graphical user interface can facilitate prominently displaying the second portion of the user interface for improved perceptibility by the physician during the medical procedure.
- In some implementations, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration if a time between
receipt 169 of the initial command and receipt of a subsequent input command exceeds a predetermined inactivity threshold period. For example, the predetermined inactivity threshold period can be programmable (e.g., by the physician according to the physician's preference). Such a period of inactivity can coincide with the physician moving the catheter within the heart cavity. Accordingly, during this period, the second portion of the graphical user interface can be advantageously deemphasized in favor of a more prominent display of the first portion of the graphical user interface, which includes the graphical representation of the heart cavity. - In certain implementations, changing the one or more display features of the second portion of the graphical user interface relative to the first portion of the graphical user interface between the baseline configuration and the modified configuration can include changing the second portion of the graphical user interface from the modified configuration to the baseline configuration based on a received input command of the second set of input commands. Further, or in the alternative, a received input command of the second set of input commands can toggle between the modified configuration and the baseline configuration. Toggling between the modified configuration and the baseline configuration can, for example, provide the physician with control over the display of the second portion of the graphical user interface. Such control can be useful for deemphasizing the second portion of the graphical user interface on command to facilitate observation of the first portion of the graphical user interface by the physician (e.g., during a particular portion of the medical procedure).
- In general, modifying 168 the displayed graphical representation in the first portion of the graphical user interface can include any one or more of various different changes to the displayed graphical representation that may improve visualization of the graphical representation by the physician. For example, modifying 168 the displayed graphical representation can include building a graphical representation of the heart cavity, altering a display view of the graphical representation, and/or tagging one or more anatomic features on the graphical representation. Because modifying 168 the displayed graphical representation can be based on the received 166 a first input command from the first input device and the received 166 b second input command from the second input device, it should be appreciated that relatively
simple modifications 168 of the displayed graphical representation can be implemented through the second input device operated by the physician while morecomplex modifications 168 of the displayed graphical representation can be implemented through the first input device operated by the technician. - Modifying 168 the displayed graphical representation in the first portion of the graphical user interface can include, for example, modifying a pose of the graphical representation including one or more of a translation and an orientation. For example, the pose can include two rotation angles. The pose can correspond to one or more predetermined poses of the graphical representation. Further, or in the alternative, the pose can be customizable according to one or more inputs from one or both of the first input device and the second input device. In certain implementations, modifying 168 the displayed graphical representation can include adjusting an orientation of a displayed view of the graphical representation of the heart cavity such as, for example, by rotating the graphical representation of the heart cavity about an axis.
- In certain implementations, modifying 168 the displayed graphical representation in the first portion of the graphical user interface can include adjusting the displayed graphical representation according to the order in which the first input command the second input command are received.
Such modification 168 of the displayed graphical representation can allow the physician to undo or otherwise modify an input command provided by the technician through the first input device. More generally, the first input command and the second input command can operate in concert to modify 168 the displayed graphical representation. -
FIG. 7 is a flowchart of anexemplary method 170 of controlling a graphical representation on a graphical user interface. The graphical representation and the graphical user interface can be, for example, any of the various different graphical representations and graphical user interfaces described herein. Accordingly, theexemplary method 170 can control the display of the graphical representation 142 (FIG. 4 ) on the graphical user interface 116 (FIGS. 1 and 4 ). - The
exemplary method 170 can include receiving 171 a signal indicative of a location of a catheter tip in a cavity of a patient's heart, displaying 172, on a graphical user interface, a graphical representation of the location of the catheter tip in the cavity of the patient's heart, receiving 174 a a first input command from a first input device, receiving 174 b navigation commands and a second input command from a second input device, and modifying 176 the displayed graphical representation based on the first input command and the second input command. The first input command can be responsive to a first set of input options displayed on the graphical user interface, and the second input command can be responsive to a second set of input options displayed on the graphical user interface. - Receiving 171 the signal indicative of the location of the catheter tip in the cavity of the patient's heart can include any one or more of the various different methods of receiving location information described herein. For example, receiving 171 the signal indicative of location of the cardiac catheter in the cavity of the patient's heart can include receiving a signal from a sensor such as the magnetic position sensor 133 (
FIG. 2 ). Further, it should be appreciated that the received 171 signal can be indicative of any predetermined location of the cardiac catheter in the heart cavity. Accordingly, the received 171 signal can be indicative of a location of a tip portion (e.g., tip portion 122) of the cardiac catheter. - Displaying 172 the graphical representation of the cavity of the patient's heart on the graphical user interface can include any of the various different methods of displaying the graphical representation described herein. Accordingly, as an example, displaying 172 the graphical representation can include displaying a two-dimensional projection of a three-dimensional model of the cavity of the patient's heart. Additionally, or alternatively, displaying 172 the graphical representation of the cavity of the patient's heart on the graphical user interface can include displaying one or more views of the graphical representation.
- The first input command can be received 174 a from the various different devices and systems described herein with respect to the first input device and, additionally or alternatively, according to any one or more of the various different methods described herein with respect to sending and receiving a first input command from the first input device. Thus, for example, the first input command can be received 174 a by a catheter interface unit via wired or wireless communication with a keyboard and/or mouse operated by a technician (e.g., outside of a sterile field). The first input command can be received 174 a from among the first set of input options, which can be a full complement of possible input commands available for modifying the displayed 172 graphical representation of the cavity of the patient's heart. Additionally, or alternatively, the first set of input options can be displayed on a dedicated portion of a graphical user interface, away from the second set of input options, according to any of the various different methods described herein. Accordingly, the first set of input options can be displayed on the first portion of the graphical user interface, and the second set of input options on a second portion of the graphical user interface.
- The navigation commands and/or the second input command can be received 174 b from the various different devices and systems described herein with respect to the second input device and, additionally or alternatively, according to any one or more of the various different methods described herein with respect to sending and receiving navigation commands and/or a second input command from the second input device. For example, the navigation commands and the second input command can be received 174 b by a catheter interface unit in wired or wireless communication with a second input device operated by a physician. The second input device can be any of the various different second input devices described herein.
- In general, the second input device can include relatively few inputs as compared to the first input device, with the functionality of the second input device being a function of the representation of a state machine on the graphical user interface. For example, the second set of input options displayed on the graphical user interface can be based at least in part on the current state of the state machine and, additionally or alternatively, can include available transitions of a state machine. Continuing with this example, the navigation input commands received 174 b from the second input device can be used to navigate through the transitions of the state machine and an input command received 174 b from the second input device can be used to select a particular state of the state machine. Accordingly, it should be appreciated that the changing state of the state machine can impart additional functionality to the inputs of the second input device. That is, the result produced by a given received 174 b input command can vary according to the state of the state machine at the time the input command is received 174 b.
- Receiving 174 b the navigation commands and the second input command from the second input device can include receiving discrete commands. For example, the discrete commands can include commands for moving through the second set of input options. Examples of such discrete directional commands can include commands corresponding to right, left, up, and down navigation through the second set of input commands displayed in the second portion of the graphical user interface.
- Also, or instead, receiving 174 b the navigation commands and the second input command from the second input device can include receiving one or more analog commands. As an example, one or more inputs of the second input device can include a capacitive touch sensor that produces an analog input command. This analog command can be used, in certain instances, for navigating through the second set of input options. For example, in implementations in which the capacitive touch sensor is arranged as a scroll wheel, the scroll wheel can be used to scroll through the second set of input options.
- The second set of input options can be arranged in an infinite wheel according to any of the arrangements described herein. In such implementations, receiving 174 b the navigation commands can include receiving a scroll command (e.g., a discrete command, an analog command, or a combination thereof) for moving through the states of the infinite wheel. Thus, for example, a physician can press a single input on the second input device repeatedly, or by holding down the single input, to continually move through the infinite wheel until a desired input command is highlighted and can be selected.
- Modifying 176 the displayed graphical representation can include any one or more of the various different modifications described herein. Accordingly, as an example, modifying 176 the displayed graphical representation can be based on the order in which the first input command and the second input command are received. Thus, in this example, the second input command can override a modification made based on the first input command and, in this way, can provide the physician with a mechanism for overriding a change made by the technician. Also, or instead, in instances in which the first input command and the second input command are received at the same time or substantially the same time, the second input command can override the first input command to reduce the likelihood that the second input command (associated with the physician) is inadvertently overwritten or otherwise undone by the first input command.
- In some implementations, the
exemplary method 170 can further include modifying 177 one or more display features of the second set of input options based on the received 174 b navigation command and/or second input command. Modifying 177 the one or more display features of the second set of input options can be based, for example, on detecting an initial navigation or initial input command (e.g., after some predetermined period of inactivity). Additionally, or alternatively, modifying 177 the one or more display features of the second set of input options can include changing the second set of input options from the modified configuration to the baseline configuration if a time between receipt of a first input command and receipt of a second input command exceeds a predetermined inactivity threshold period. - In general, modifying 177 the one or more display features of the second set of input options can include changing between a baseline configuration and a modified configuration of the display features according to any of the various different methods described herein. Thus, for example, the relative size of the displayed second set of input options to the size of the displayed first set of input options can be greater in the modified configuration than in the baseline configuration to facilitate reading the second set of input options by the physician. In addition, or in the alternative, the opacity of the displayed second set of input options compared to the opacity of the first set of input options can be greater in the modified configuration than in the baseline configuration to facilitate drawing the physician's attention to the appropriate location on the graphical user interface. Additionally, or alternatively, the position of the second set of input options relative to the first set of input options on the graphical user interface can be different in the modified configuration than in the baseline configuration, with the change in position, for example, advantageously drawing the physician's attention toward the second set of input options.
- While certain implementations have been described, other implementations are additionally or alternatively possible.
- For example, while a second input device has been described as being disposed along a handle of a catheter, other implementations are additionally or alternatively possible. As an example, referring now to
FIG. 8 , asystem 100′ can include asecond input device 180 separate from acatheter 106′. For the sake of efficient and clear description, elements designated by prime (′) element numbers inFIG. 8 should be understood to be analogous to elements with unprimed element numbers described herein, unless otherwise indicated or made clear from the context, and, thus, are not described separately from primed or unprimed counterparts, except to highlight certain aspects. Thus, for example,element number 116′ inFIG. 8 should be understood to be a graphical user interface analogous to the graphical user interface 116 (FIGS. 1 and 4 ), unless otherwise indicated or made clear from the context. - The
second input device 180 can be, for example, in communication with thecatheter interface unit 104′ to transmit navigation commands and/or input commands to a second portion of thegraphical user interface 116′ according to any of the various different methods described herein. Because thesecond input device 180 is not disposed along thecatheter 106′, thesecond input device 180 can be advantageously in wireless communication with thecatheter interface unit 104′ to reduce the number of wires in the vicinity of the physician during the medical procedure. - In general, the
second input device 180 can be manually operable by the physician while the physician manipulates thecatheter 106′. For example, the physician may pick up thesecond input device 180 as needed, and then put thesecond input device 180 down if both hands are needed for manipulation of thecatheter 106′. - As another example, while the second input device has been described as being disposed along the handle of the catheter or as separate from the catheter, other implementations are additionally or alternatively possible. For example, referring now to
FIGS. 9-12 , asystem 100″ can include asecond input device 210 securable to acatheter shaft 118″ of acatheter 106″. For the sake of efficient and clear description, elements designated by double prime (″) element numbers inFIG. 9 should be understood to be analogous to elements with unprimed and/or primed element numbers described herein, unless otherwise indicated or made clear from the context, and, thus, are not described separately from primed or unprimed counterparts, except to highlight certain aspects. Thus, for example,element number 106″ inFIG. 9 should be understood to be a catheter analogous to the catheter 106 (FIGS. 1 and 4 ) and thecatheter 106′ (FIG. 8 ), andelement number 118″ inFIG. 9 should be understood to be a catheter shaft analogous to the catheter shaft 118 (FIGS. 1 and 4 ) and thecatheter shaft 118′ (FIG. 8 ), unless otherwise indicated or made clear from the context. - The
second input device 210 can be in communication (e.g., wireless communication) with thecatheter interface unit 104″ to transmit navigation commands and/or input commands to a second portion of thegraphical user interface 116″ according to any of the various different methods described herein. As described in greater detail below, securing thesecond input device 210 to thecatheter shaft 118″ of thecatheter 106″ can facilitate locating thesecond input device 210 by the physician without requiring the physician to divert his or her attention from the medical procedure. Additionally, or alternatively, as also described in greater detail below, securing thesecond input device 210 to thecatheter shaft 118″ can facilitate single-handed operation of thesecond input device 210 during a medical procedure. - In general, the
second input device 210 can include auser interface 230, awireless transmitter 250, and a housing 270 carrying theuser interface 230 and thewireless transmitter 250. Theuser interface 230 can include one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, and 130 e″, which can be any one or more of the various different inputs described herein. In use, the physician can depress or otherwise engage the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, and 130 e″, and thewireless transmitter 250 can be in communication with theuser interface 230 to send one or more navigation and/or control commands to a remote processor, such as theprocessing unit 112″, according to any one or more of the various different methods described herein. Thus, for example, the physician can manipulate theuser interface 230 to send one or more navigation and/or control commands to theprocessing unit 112″ based on input options displayed on a portion of a graphical user interface, such as thegraphical user interface 116″, according to any of the various different methods described herein. - The
second input device 210 can be at least one of electrically and fluidically isolated from ahandle 120″ and thecatheter shaft 118″ to facilitate, for example, robust operation of thesecond input device 210 throughout the medical procedure, independent of thecatheter 106″. For example, the housing 270 can define a volume, and thewireless transmitter 250 can be disposed within the volume defined by the housing 270. The one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, and 130 e″ can be at least partially disposed outside of the volume defined by the housing 270 such that the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ form at least a portion of an outer surface of thesecond input device 210 and are accessible by the physician. In certain instances, the volume defined by the housing 270 can be substantially resistant to fluid ingress such that thewireless transmitter 250 is protected from fluid that may contact thesecond input device 210 during a medical procedure. Additionally, or alternatively, the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ can be arranged relative to the housing 270 to reduce the likelihood of fluid ingress into the volume defined by the housing 270. - In certain implementations, the housing 270 can be securable to an outer circumference of the
catheter shaft 118″ with theuser interface 230 partially constrained in at least one direction relative to thecatheter shaft 118″. Such constrained movement of theuser interface 230 relative to thecatheter shaft 118″ can, for example, facilitate locating theuser interface 230 by the physician during a medical procedure. That is, given that theuser interface 230 is at least partially constrained in at least one direction relative to thecatheter shaft 118″, the physician can find theuser interface 230 by moving his or her hand along thecatheter shaft 118″ to find theuser interface 230. Thus, thecatheter shaft 118″ itself can act as a guide for the physician, which can reduce the need for the physician to divert his or her attention away from thegraphical user interface 116″ to find theuser interface 230 of thesecond input device 210. - As an example, with the housing 270 secured to the outer circumference of the
catheter shaft 118″, theuser interface 230 can be at least partially constrained in a radial direction relative to thecatheter shaft 118″. As used herein, partial constraint in the radial direction can include movement of less than about 2 cm (e.g., less than about 1 cm) and, therefore, can include complete constraint in the radial direction. In certain implementations, theuser interface 230 can be movable along an axis defined by thecatheter shaft 118″ and, thus, partial constraint in the radial direction can include radial movement sufficient to allow the housing 270 and theuser interface 230 to move along the axis defined by thecatheter shaft 118″. It should be appreciated that, in such implementations in which the housing 270 and theuser interface 230 are movable along the axis defined by thecatheter shaft 118″, the housing 270 and theuser interface 230 can be movable between thehandle 120″ of thecatheter 106″ and a sheath at the insertion site of thecatheter 106″ into the patient. - Additionally, or alternatively, the housing 270 can be securable in a fixed axial position relative to the
catheter shaft 118″. For example, an interference fit between the outer circumference of thecatheter shaft 118″ and the housing 270 can hold the housing 270 in a fixed axial position relative to thecatheter 118″ during a medical procedure. The fixed axial position can be any of various different axial positions along thecatheter shaft 118″. For example, the housing 270 can be secured to aproximal end region 124″ of thecatheter shaft 118″ with the housing 270 extending distal to thehandle 120″ of thecatheter 106″. Additionally, or alternatively, the housing 270 can be secured to theproximal end region 124 of thecatheter shaft 118″ such that the housing 270 is adjacent to thehandle 120″. - With the housing 270 at least partially constrained in at least one direction relative to the
catheter shaft 118″, theuser interface 230 can be rotatable about thecatheter shaft 118″ and, optionally, rotatable about thehandle 120″ coupled to thecatheter shaft 118″. For example, theuser interface 230 can be rotatable about an axis of rotation coaxial with an axis defined by thecatheter shaft 118″ (e.g., freely rotatable 360 degrees about the axis of rotation such that theuser interface 230 is rotatable through multiple revolutions about the axis of rotation). Rotation of this type can facilitate, for example, single-handed operation of thesecond input device 210 by the physician. That is, the physician can rotate theuser interface 230 as necessary to align theuser interface 230 in a desired radial orientation. - The housing 270 can be at least partially formed of a material compatible with sterilization (e.g., any of the various different sterilization techniques described herein) and, in some instances, the housing 270 can be sterilized prior to being secured to the
catheter shaft 118″. Additionally, or alternatively, thesecond input device 210 can include a cover enclosing the housing 270 and theuser interface 230, and the cover can be formed of a material compatible with sterilization such as any of the various sterilization techniques described herein. A cover separable from the housing 270 can be useful, for example, in implementations in which the housing 270 carries one or more components (e.g., batteries) that are not readily compatible with sterilization. In such instances, the cover can be sterilized apart from thesecond input device 210 and then used to cover thesecond input device 210 prior to securing thesecond input device 210 to thecatheter shaft 118″. - In general, the housing 270 can be securable to the
catheter shaft 118″ without the use of tools. The ability to secure the housing 270 to thecatheter shaft 118″ in this way can for example, facilitate securing the housing 270 to thecatheter shaft 118″ by the physician or other medical personnel in the sterile field. - As an example, the housing 270 can include a
first section 272 and asecond section 274, each defining a portion (e.g., substantially half) of arecess 276. Thefirst section 272 and thesecond section 274 can be releasably engageable with one another to position therecess 276 about at least a portion of an outer circumference of thecatheter shaft 118″. The releasable engagement between thefirst section 272 and thesecond section 274 can be achieved through an interference fit between mating features of thefirst section 272 and thesecond section 274. Further, or instead, thefirst section 272 can include a first material and thesecond section 274 can include a second material magnetically attracted to the first material such that placing thefirst section 272 and thesecond section 274 in proximity to one another results in coupling thefirst section 272 to thesecond section 274 through the magnetic force between the first material and the second material. - In certain instances, the
first section 272 and thesecond section 274 can be coupled to one another at ahinge 278 pivotable to move thefirst section 272 and thesecond section 274 in a clamshell arrangement into engagement with each other to position therecess 276 about thecatheter shaft 118″. Thehinge 278 can be useful, for example, for accounting for manufacturing tolerances associated with the outer circumference of thecatheter shaft 118″. Additionally, or alternatively, thehinge 278 can be useful for reducing the number of parts needed to be manipulated by the physician or other medical personnel in the sterile field to secure thesecond input device 210 to thecatheter shaft 118″. - As an additional, or alternative, example, the housing 270 can include a clip defining the
recess 276 and positionable about at least a portion of the outer circumference of thecatheter shaft 118″. For example, the clip may be “U-shaped” such that therecess 276 is defined by legs that are movable away from one another to accept thecatheter shaft 118″ and biased back toward one another to hold thesecond input device 210 about the outer circumference of thecatheter shaft 118″. - The
recess 276 can be sized, for example, to fit about a standard catheter size such that thesecond input device 210 can be securable to any of various different catheters of a given standard catheter size, including catheters made by different manufacturers. Additionally, or alternatively, therecess 276 can be sized to account for manufacturing tolerances associated with a given standard catheter size. - With the housing 270 secured to the outer circumference of the
catheter shaft 118″, theuser interface 230 can be suitable for single-handed operation by the physician during a medical procedure. Such single-handed operation can facilitate, for example, simultaneous or substantially simultaneous operation of theuser interface 230 with one hand while the physician holds thecatheter shaft 118″ or thehandle 120″ with the other hand. Additionally, or alternatively, theremote communication device 210 can be secured to the outer circumference of thecatheter shaft 118″ at a position distal to anarticulation controller 128″ of thecatheter 106″. Thearticulation controller 128″ can be, for example, any of the various different articulation controllers described herein to modify adistal end region 126″ of thecatheter shaft 118″. In certain implementations, the physician can operate thearticulation controller 128″ with one hand while simultaneously or substantially simultaneously operating theuser interface 230 with the other hand. - In general, with the housing 270 secured to the outer circumference of the
catheter shaft 118″, the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ can be arranged relative to thecatheter shaft 118″ such that manipulation of the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ does not cause unintended movement of the housing 270 relative to thecatheter shaft 118″. For example, the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ of theuser interface 230 can be any of the various different inputs described herein and can be depressible or otherwise engageable in a direction parallel to the at least one partially constrained direction of theuser interface 230 such that the constrained movement of theuser interface 230 can counter the force exerted on the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, and 130 e″ and, thus, restricts undesired movement of thesecond input device 210 as one or more inputs are received. Additionally, or alternatively, in implementations in which theuser interface 230 is rotatable about an axis defined by thecatheter shaft 118″, the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ can be depressible in a direction transverse to the axis of rotation of theuser interface 230 such that providing an input is less likely to result in inadvertent rotation of theuser interface 230 about thecatheter shaft 118″. It should be appreciated from these examples that such an arrangement of forces can facilitate single-handed operation of thesecond input device 210. That is, the physician can use a single hand to depress the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ without requiring the use of a second hand to hold theuser interface 230 in place as input is provided at the one ormore inputs 130 a″, 130 b″, 130 c, 130 d″, 130 e″. - In certain implementations, the
second input device 210 can further include apower source 280 carried by the housing 270 and in electrical communication with thewireless transmitter 250 to power thewireless transmitter 250. Thepower source 280 can be for example one or more batteries. Additionally, or alternatively, thepower source 280 can be releasably coupled to the housing to facilitate replacement or recharging of the power source 280 (e.g., during or in between medical procedures). - In some implementations, the
second input device 210 can further include aprocessor 282 in communication with theuser interface 230 and thewireless transmitter 250. For example, theprocessor 282 can receive a signal from the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ and send a corresponding signal to thewireless transmitter 250 for transmission. In addition to, or instead of, theprocessor 282, thesecond input device 210 can include circuitry to receive a signal from the one ormore inputs 130 a″, 130 b″, 130 c″, 130 d″, 130 e″ and send a corresponding signal to thewireless transmitter 250. - While second input devices have been described as including housings that can be clamped onto a shaft of a catheter, other implementations are additionally or alternatively possible. For example, a second input device can include a housing through which a distal end region of a catheter can be moved. Through such movement of the distal end region of the catheter through the housing, the second device can be disposed about a shaft of the catheter. Thus, in certain implementations, the distal end region of the catheter can be introduced into a patient through the housing of the second input device. For example, the housing of the second input device can include an introducer sheath positionable, as is known in the art, in vasculature of the patient and through which the distal end region of the catheter can be introduced into the vasculature of the patient during a procedure. Additionally, or alternatively, the housing of the second input device can include an insertion sleeve positionable relative to the introducer sheath, as is also known in the art. In use, the distal end region of the catheter can be moved through the insertion sleeve and into vasculature of the patient via an introducer sheath positioned in the vasculature of the patient.
- While second input devices have been described as being hand operated, other implementations are additionally or alternatively possible. For example, a second input device can include a foot pedal operable by the physician tapping one or more inputs on the foot pedal to navigate through a second portion of a graphical user interface according to one or more of the methods described herein.
- While second input devices have been described as being physical devices manipulated by the physician, other implementations are additionally or alternatively possible. For example, a second input device can be implemented through a virtual reality system (such as Leap Motion available from Leap Motion, Inc. of San Francisco, Calif.). In such an implementation, a physician's hand or hands can interact with a virtual reality environment to navigate and provide inputs to the second portion of the graphical user interface according to any one or more of the methods described herein.
- While second input devices have been described as being operated with one or more of a physician's limbs, other implementations are additionally or alternatively possible. For example, the second input device can be responsive to one or more voice commands (e.g., “up,” “down,” “right,” “left,” and “enter”) to navigate and provide inputs to the second portion of the graphical user interface according to any one or more of the methods described herein. Such a second input device responsive to voice commands can, for example, reduce the need for separate hardware in the sterile field with the physician.
- The above systems, devices, methods, processes, and the like may be realized in hardware, software, or any combination of these suitable for a particular application. The hardware may include a general-purpose computer and/or dedicated computing device. This includes realization in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices or processing circuitry, along with internal and/or external memory. This may also, or instead, include one or more application specific integrated circuits, programmable gate arrays, programmable array logic components, or any other device or devices that may be configured to process electronic signals.
- It will further be appreciated that a realization of the processes or devices described above may include computer-executable code created using a structured programming language such as C, an object oriented programming language such as C++, or any other high-level or low level programming language (including assembly languages, hardware description languages, and database programming languages and technologies) that may be stored, compiled or interpreted to run on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software. In another aspect, the methods may be embodied in systems that perform the steps thereof, and may be distributed across devices in a number of ways. At the same time, processing may be distributed across devices such as the various systems described above, or all of the functionality may be integrated into a dedicated, standalone device or other hardware. In another aspect, means for performing the steps associated with the processes described above may include any of the hardware and/or software described above. All such permutations and combinations are intended to fall within the scope of the present disclosure.
- Embodiments disclosed herein may include computer program products comprising computer-executable code or computer-usable code that, when executing on one or more computing devices, performs any and/or all of the steps thereof. The code may be stored in a non-transitory fashion in a computer memory, which may be a memory from which the program executes (such as random access memory associated with a processor), or a storage device such as a disk drive, flash memory or any other optical, electromagnetic, magnetic, infrared or other device or combination of devices.
- In another aspect, any of the systems and methods described above may be embodied in any suitable transmission or propagation medium carrying computer-executable code and/or any inputs or outputs from same.
- The method steps of the implementations described herein are intended to include any suitable method of causing such method steps to be performed, consistent with the patentability of the following claims, unless a different meaning is expressly provided or otherwise clear from the context. So, for example performing the step of X includes any suitable method for causing another party such as a remote user, a remote processing resource (e.g., a server or cloud computer) or a machine to perform the step of X. Similarly, performing steps X, Y and Z may include any method of directing or controlling any combination of such other individuals or resources to perform steps X, Y and Z to obtain the benefit of such steps. Thus, method steps of the implementations described herein are intended to include any suitable method of causing one or more other parties or entities to perform the steps, consistent with the patentability of the following claims, unless a different meaning is expressly provided or otherwise clear from the context. Such parties or entities need not be under the direction or control of any other party or entity, and need not be located within a particular jurisdiction.
- It should further be appreciated that the methods above are provided by way of example. Absent an explicit indication to the contrary, the disclosed steps may be modified, supplemented, omitted, and/or re-ordered without departing from the scope of this disclosure.
- It will be appreciated that the methods and systems described above are set forth by way of example and not of limitation. Numerous variations, additions, omissions, and other modifications will be apparent to one of ordinary skill in the art. In addition, the order or presentation of method steps in the description and drawings above is not intended to require this order of performing the recited steps unless a particular order is expressly required or otherwise clear from the context. Thus, while particular embodiments have been shown and described, it will be apparent to those skilled in the art that various changes and modifications in form and details may be made therein without departing from the spirit and scope of this disclosure and are intended to form a part of the invention as defined by the following claims.
Claims (19)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/593,844 US20170325901A1 (en) | 2016-05-12 | 2017-05-12 | Anatomical model controlling |
US18/153,306 US20230215547A1 (en) | 2016-05-12 | 2023-01-11 | Anatomical model controlling |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662335120P | 2016-05-12 | 2016-05-12 | |
US201662336143P | 2016-05-13 | 2016-05-13 | |
US201662338210P | 2016-05-18 | 2016-05-18 | |
US201662384291P | 2016-09-07 | 2016-09-07 | |
US201662410022P | 2016-10-19 | 2016-10-19 | |
US201762463870P | 2017-02-27 | 2017-02-27 | |
US15/593,844 US20170325901A1 (en) | 2016-05-12 | 2017-05-12 | Anatomical model controlling |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US202117343741A Continuation | 2016-05-12 | 2021-06-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170325901A1 true US20170325901A1 (en) | 2017-11-16 |
Family
ID=58765985
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/593,778 Active 2037-05-17 US10751134B2 (en) | 2016-05-12 | 2017-05-12 | Anatomical model controlling |
US15/593,844 Abandoned US20170325901A1 (en) | 2016-05-12 | 2017-05-12 | Anatomical model controlling |
US15/594,039 Active 2039-06-05 US11728026B2 (en) | 2016-05-12 | 2017-05-12 | Three-dimensional cardiac representation |
US18/153,306 Pending US20230215547A1 (en) | 2016-05-12 | 2023-01-11 | Anatomical model controlling |
US18/339,086 Pending US20230335262A1 (en) | 2016-05-12 | 2023-06-21 | Three-dimensional cardiac representation |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/593,778 Active 2037-05-17 US10751134B2 (en) | 2016-05-12 | 2017-05-12 | Anatomical model controlling |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/594,039 Active 2039-06-05 US11728026B2 (en) | 2016-05-12 | 2017-05-12 | Three-dimensional cardiac representation |
US18/153,306 Pending US20230215547A1 (en) | 2016-05-12 | 2023-01-11 | Anatomical model controlling |
US18/339,086 Pending US20230335262A1 (en) | 2016-05-12 | 2023-06-21 | Three-dimensional cardiac representation |
Country Status (3)
Country | Link |
---|---|
US (5) | US10751134B2 (en) |
EP (1) | EP3455756A2 (en) |
WO (2) | WO2017197247A2 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111000629A (en) * | 2019-12-05 | 2020-04-14 | 武汉奇致激光技术股份有限公司 | Safety authentication device for laser therapy apparatus and control method |
US10751134B2 (en) | 2016-05-12 | 2020-08-25 | Affera, Inc. | Anatomical model controlling |
US10765481B2 (en) | 2016-05-11 | 2020-09-08 | Affera, Inc. | Anatomical model generation |
US20210085425A1 (en) * | 2017-05-09 | 2021-03-25 | Boston Scientific Scimed, Inc. | Operating room devices, methods, and systems |
CN112822989A (en) * | 2018-07-18 | 2021-05-18 | 西姆拉特无生命模型公司 | Surgical training apparatus, method and system |
US20210338367A1 (en) * | 2020-04-29 | 2021-11-04 | Medtronic Navigation, Inc. | System and Method for Viewing a Subject |
US11593972B2 (en) | 2020-04-29 | 2023-02-28 | Medtronic Navigation, Inc. | System and method for viewing a subject |
US11984219B2 (en) * | 2020-12-04 | 2024-05-14 | Boston Scientific Scimed, Inc. | Operating room devices, methods, and systems |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020008326A1 (en) * | 2018-07-04 | 2020-01-09 | Navix International Limited | Systems and methods for reconstruction of medical images |
WO2020163940A1 (en) | 2019-02-14 | 2020-08-20 | Kardium Inc. | Catheter navigation systems and methods |
US11357573B2 (en) * | 2019-04-25 | 2022-06-14 | International Business Machines Corporation | Optimum treatment planning during coronary intervention by simultaneous simulation of a continuum of outcomes |
US20200352652A1 (en) * | 2019-05-06 | 2020-11-12 | Biosense Webster (Israel) Ltd. | Systems and methods for improving cardiac ablation procedures |
US11914835B2 (en) * | 2020-11-16 | 2024-02-27 | Samsung Electronics Co., Ltd. | Method for displaying user interface and electronic device therefor |
US11974817B2 (en) * | 2021-02-01 | 2024-05-07 | Biosense Webster (Israel) Ltd. | Catheter representation via voxels within organ |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5364395A (en) * | 1993-05-14 | 1994-11-15 | West Jr Hugh S | Arthroscopic surgical instrument with cauterizing capability |
US6216027B1 (en) * | 1997-08-01 | 2001-04-10 | Cardiac Pathways Corporation | System for electrode localization using ultrasound |
US20020165541A1 (en) * | 2001-04-20 | 2002-11-07 | Whitman Michael P. | Bipolar or ultrasonic surgical device |
US20030176778A1 (en) * | 2002-03-15 | 2003-09-18 | Scimed Life Systems, Inc. | Medical device control systems |
US20080308256A1 (en) * | 2007-06-18 | 2008-12-18 | Deborski Christopher A | Microwave cable cooling |
US20120123404A1 (en) * | 2010-11-16 | 2012-05-17 | Tyco Healthcare Group Lp | Fingertip Electrosurgical Instruments for Use in Hand-Assisted Surgery and Systems Including Same |
Family Cites Families (170)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4734690A (en) | 1984-07-20 | 1988-03-29 | Tektronix, Inc. | Method and apparatus for spherical panning |
US5276785A (en) | 1990-08-02 | 1994-01-04 | Xerox Corporation | Moving viewpoint with respect to a target in a three-dimensional workspace |
US5133336A (en) * | 1990-10-22 | 1992-07-28 | Endoscopy Support Services, Inc. | Disposable liquid supply system for use in an endoscope |
US5687737A (en) | 1992-10-09 | 1997-11-18 | Washington University | Computerized three-dimensional cardiac mapping with interactive visual displays |
US5433198A (en) | 1993-03-11 | 1995-07-18 | Desai; Jawahar M. | Apparatus and method for cardiac ablation |
US5391199A (en) | 1993-07-20 | 1995-02-21 | Biosense, Inc. | Apparatus and method for treating cardiac arrhythmias |
US5447529A (en) | 1994-01-28 | 1995-09-05 | Philadelphia Heart Institute | Method of using endocardial impedance for determining electrode-tissue contact, appropriate sites for arrhythmia ablation and tissue heating during ablation |
JPH07262412A (en) | 1994-03-16 | 1995-10-13 | Fujitsu Ltd | Device and system for indicating cross section of three-dimensional model |
US5797849A (en) | 1995-03-28 | 1998-08-25 | Sonometrics Corporation | Method for carrying out a medical procedure using a three-dimensional tracking and imaging system |
US5655535A (en) | 1996-03-29 | 1997-08-12 | Siemens Medical Systems, Inc. | 3-Dimensional compound ultrasound field of view |
US5889524A (en) | 1995-09-11 | 1999-03-30 | University Of Washington | Reconstruction of three-dimensional objects using labeled piecewise smooth subdivision surfaces |
US6175655B1 (en) | 1996-09-19 | 2001-01-16 | Integrated Medical Systems, Inc. | Medical imaging system for displaying, manipulating and analyzing three-dimensional images |
US5820568A (en) | 1996-10-15 | 1998-10-13 | Cardiac Pathways Corporation | Apparatus and method for aiding in the positioning of a catheter |
IL120867A0 (en) | 1997-05-20 | 1997-09-30 | Cadent Ltd | Computer user interface for orthodontic use |
JP3183632B2 (en) | 1997-06-13 | 2001-07-09 | 株式会社ナムコ | Information storage medium and image generation device |
JPH1132986A (en) * | 1997-07-16 | 1999-02-09 | Olympus Optical Co Ltd | Endoscope system |
US7092773B1 (en) * | 1997-09-24 | 2006-08-15 | Sony Corporation | Method and system for providing enhanced editing capabilities |
US6120496A (en) | 1998-05-05 | 2000-09-19 | Scimed Life Systems, Inc. | Surgical method and apparatus for positioning a diagnostic or therapeutic element within the body and coupling device for use with same |
WO1999060921A1 (en) | 1997-11-24 | 1999-12-02 | Burdette Medical Systems | Real time brachytherapy spatial registration and visualization system |
US6037937A (en) * | 1997-12-04 | 2000-03-14 | Nortel Networks Corporation | Navigation tool for graphical user interface |
US6377865B1 (en) | 1998-02-11 | 2002-04-23 | Raindrop Geomagic, Inc. | Methods of generating three-dimensional digital models of objects by wrapping point cloud data points |
US7734656B2 (en) | 1998-02-24 | 2010-06-08 | Luc Bessette | System and method for electronically managing medical data files in order to facilitate genetic research |
US6271856B1 (en) | 1998-11-19 | 2001-08-07 | Paraform, Inc. | Creating and modifying parameterizations of surfaces |
US6572611B1 (en) | 1998-11-23 | 2003-06-03 | C. R. Bard, Inc. | Intracardiac grasp catheter |
US6256038B1 (en) | 1998-12-10 | 2001-07-03 | The Board Of Trustees Of The Leland Stanford Junior University | Parameterized surface fitting technique having independent control of fitting and parameterization |
AU4439900A (en) | 1999-04-21 | 2001-01-22 | Auckland Uniservices Limited | Method and system of measuring characteristics of an organ |
US7343195B2 (en) * | 1999-05-18 | 2008-03-11 | Mediguide Ltd. | Method and apparatus for real time quantitative three-dimensional image reconstruction of a moving organ and intra-body navigation |
US6443894B1 (en) | 1999-09-29 | 2002-09-03 | Acuson Corporation | Medical diagnostic ultrasound system and method for mapping surface data for three dimensional imaging |
US6556206B1 (en) | 1999-12-09 | 2003-04-29 | Siemens Corporate Research, Inc. | Automated viewpoint selection for 3D scenes |
US6968299B1 (en) | 2000-04-14 | 2005-11-22 | International Business Machines Corporation | Method and apparatus for reconstructing a surface using a ball-pivoting algorithm |
JP3854062B2 (en) | 2000-04-28 | 2006-12-06 | 株式会社モリタ製作所 | Tomographic image display method, display device, and recording medium storing program for realizing the display method |
JP3579646B2 (en) * | 2000-11-21 | 2004-10-20 | ペンタックス株式会社 | Ultrasound endoscope |
JP3579651B2 (en) * | 2000-11-21 | 2004-10-20 | ペンタックス株式会社 | Ultrasound endoscope |
CN1639675B (en) | 2001-07-06 | 2015-12-09 | 高通股份有限公司 | With the image processing method of the three-dimensional surface interaction represented in 3-D view |
US6764442B2 (en) * | 2001-08-10 | 2004-07-20 | Pentax Corporation | Liquid and gas supply apparatus and portable endoscope with the same |
US7114500B2 (en) | 2001-08-28 | 2006-10-03 | Marctec, Llc | Surgical draping system |
US7023432B2 (en) | 2001-09-24 | 2006-04-04 | Geomagic, Inc. | Methods, apparatus and computer program products that reconstruct surfaces from data point sets |
WO2003053491A2 (en) | 2001-11-09 | 2003-07-03 | Cardio-Optics, Inc. | Coronary sinus access catheter with forward-imaging |
GB2387519B (en) | 2002-04-08 | 2005-06-22 | Canon Europa Nv | Viewing controller for three-dimensional computer graphics |
TW558689B (en) | 2002-08-30 | 2003-10-21 | Univ Taipei Medical | Three-dimensional surgery simulation system and method |
JP2004105256A (en) | 2002-09-13 | 2004-04-08 | Fuji Photo Film Co Ltd | Image display device |
US7697972B2 (en) | 2002-11-19 | 2010-04-13 | Medtronic Navigation, Inc. | Navigation system for cardiac therapies |
WO2004061775A2 (en) | 2002-11-29 | 2004-07-22 | Bracco Imaging, S.P.A. | System and method for displaying and comparing 3d models |
WO2004068300A2 (en) | 2003-01-25 | 2004-08-12 | Purdue Research Foundation | Methods, systems, and data structures for performing searches on three dimensional objects |
US7343058B2 (en) | 2003-04-22 | 2008-03-11 | Intel Corporation | Efficient light coupler from off-chip to on-chip waveguides |
EP1636761A1 (en) | 2003-06-11 | 2006-03-22 | Koninklijke Philips Electronics N.V. | User control of 3d volume plane crop |
US9082220B2 (en) | 2003-08-26 | 2015-07-14 | Siemens Product Lifecycle Management Software Inc. | System, method, and computer program product for smoothing |
DE10339979B4 (en) | 2003-08-29 | 2005-11-17 | Tomtec Imaging Systems Gmbh | Method and device for displaying a predeterminable area in multi-dimensional data sets |
JP3847744B2 (en) * | 2003-11-04 | 2006-11-22 | オリンパス株式会社 | Insertion support system |
US7317955B2 (en) * | 2003-12-12 | 2008-01-08 | Conmed Corporation | Virtual operating room integration |
WO2005058137A2 (en) | 2003-12-12 | 2005-06-30 | University Of Washington | Catheterscope 3d guidance and interface system |
EP1699361B1 (en) | 2003-12-22 | 2009-12-09 | Koninklijke Philips Electronics N.V. | System for guiding a medical instrument in a patient body |
US20190269368A1 (en) | 2004-05-28 | 2019-09-05 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Robotic Surgical System and Method for Automated Creation of Ablation Lesions |
US7715604B2 (en) | 2005-01-18 | 2010-05-11 | Siemens Medical Solutions Usa, Inc. | System and method for automatically registering three dimensional cardiac images with electro-anatomical cardiac mapping data |
US20060241445A1 (en) | 2005-04-26 | 2006-10-26 | Altmann Andres C | Three-dimensional cardial imaging using ultrasound contour reconstruction |
CN102225023B (en) | 2005-07-21 | 2014-04-02 | 泰科医疗集团有限合伙公司 | Systems and methods for treating a hollow anatomical structure |
US20070038088A1 (en) | 2005-08-04 | 2007-02-15 | Rich Collin A | Medical imaging user interface and control scheme |
US7365745B2 (en) | 2005-09-15 | 2008-04-29 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Method of rendering a surface from a solid graphical image |
US8229545B2 (en) | 2005-09-15 | 2012-07-24 | St. Jude Medical, Atrial Fibrillation Division, Inc. | System and method for mapping complex fractionated electrogram information |
AU2006302057B2 (en) | 2005-10-11 | 2013-03-21 | Carnegie Mellon University | Sensor guided catheter navigation system |
DK1793349T3 (en) | 2005-12-05 | 2010-11-29 | Siemens Corp | Method and apparatus for separately rounding masks and for rounding by rotating a ball |
US8403925B2 (en) | 2006-12-06 | 2013-03-26 | St. Jude Medical, Atrial Fibrillation Division, Inc. | System and method for assessing lesions in tissue |
US20090177111A1 (en) | 2006-12-06 | 2009-07-09 | Miller Stephan P | System and method for displaying contact between a catheter and tissue |
EP1966767A2 (en) * | 2005-12-31 | 2008-09-10 | BRACCO IMAGING S.p.A. | Systems and methods for collaborative interactive visualization of 3d data sets over a network ("dextronet") |
US20070203396A1 (en) | 2006-02-28 | 2007-08-30 | Mccutcheon John G | Endoscopic Tool |
US8930834B2 (en) | 2006-03-20 | 2015-01-06 | Microsoft Corporation | Variable orientation user interface |
US7855723B2 (en) | 2006-03-21 | 2010-12-21 | Biosense Webster, Inc. | Image registration using locally-weighted fitting |
EP2004060A1 (en) | 2006-04-03 | 2008-12-24 | Koninklijke Philips Electronics N.V. | Determining tissue surrounding an object being inserted into a patient |
US7729752B2 (en) * | 2006-06-13 | 2010-06-01 | Rhythmia Medical, Inc. | Non-contact cardiac mapping, including resolution map |
US7505810B2 (en) * | 2006-06-13 | 2009-03-17 | Rhythmia Medical, Inc. | Non-contact cardiac mapping, including preprocessing |
US7515954B2 (en) | 2006-06-13 | 2009-04-07 | Rhythmia Medical, Inc. | Non-contact cardiac mapping, including moving catheter and multi-beat integration |
EP2298413B1 (en) * | 2006-08-15 | 2015-07-01 | SpectraCure AB | System for controlling and adjusting interstitial photodynamic light therapy parameters |
US8014561B2 (en) | 2006-09-07 | 2011-09-06 | University Of Louisville Research Foundation, Inc. | Virtual fly over of complex tubular anatomical structures |
US8007437B2 (en) | 2006-11-08 | 2011-08-30 | Siemens Aktiengesellschaft | Method and apparatus for interactive 4-dimensional (4D) virtual endoscopy |
US9220439B2 (en) * | 2006-12-29 | 2015-12-29 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Navigational reference dislodgement detection method and system |
JP5639764B2 (en) * | 2007-03-08 | 2014-12-10 | シンク−アールエックス,リミティド | Imaging and tools for use with moving organs |
US9549689B2 (en) | 2007-03-09 | 2017-01-24 | St. Jude Medical, Atrial Fibrillation Division, Inc. | System and method for correction of inhomogeneous fields |
US10433929B2 (en) | 2007-03-09 | 2019-10-08 | St. Jude Medical, Atrial Fibrillation Division, Inc. | System and method for local deformable registration of a catheter navigation system to image data or a model |
US8224432B2 (en) | 2007-05-08 | 2012-07-17 | C.R.Bard, Inc. | Rapid 3D mapping using multielectrode position data |
US8057394B2 (en) | 2007-06-30 | 2011-11-15 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Ultrasound image processing to render three-dimensional images from two-dimensional images |
US7894663B2 (en) | 2007-06-30 | 2011-02-22 | General Electric Company | Method and system for multiple view volume rendering |
US20090076476A1 (en) | 2007-08-15 | 2009-03-19 | Hansen Medical, Inc. | Systems and methods employing force sensing for mapping intra-body tissue |
US8357152B2 (en) | 2007-10-08 | 2013-01-22 | Biosense Webster (Israel), Ltd. | Catheter with pressure sensing |
JP5337161B2 (en) | 2007-11-02 | 2013-11-06 | コーニンクレッカ フィリップス エヌ ヴェ | Automatic movie flight path calculation |
US8103327B2 (en) * | 2007-12-28 | 2012-01-24 | Rhythmia Medical, Inc. | Cardiac mapping catheter |
US9211160B2 (en) | 2008-01-16 | 2015-12-15 | Luiz Geraldo Pivotto | Remotely controlled catheter insertion system with automatic control system |
CN102065781B (en) * | 2008-03-27 | 2014-05-07 | 梅奥医学教育和研究基金会 | Navigation and tissue capture systems |
US9161817B2 (en) * | 2008-03-27 | 2015-10-20 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Robotic catheter system |
US9241768B2 (en) * | 2008-03-27 | 2016-01-26 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Intelligent input device controller for a robotic catheter system |
US8494608B2 (en) | 2008-04-18 | 2013-07-23 | Medtronic, Inc. | Method and apparatus for mapping a structure |
US8786594B2 (en) | 2008-05-30 | 2014-07-22 | Siemens Aktiengesellschaft | Method and system for rendering a medical image |
US8803910B2 (en) | 2008-08-28 | 2014-08-12 | Tomotherapy Incorporated | System and method of contouring a target area |
US9245382B2 (en) | 2008-10-04 | 2016-01-26 | Microsoft Technology Licensing, Llc | User-guided surface reconstruction |
EP2179703B1 (en) | 2008-10-21 | 2012-03-28 | BrainLAB AG | Integration of surgical instrument and display device for supporting image-based surgery |
US8137343B2 (en) * | 2008-10-27 | 2012-03-20 | Rhythmia Medical, Inc. | Tracking system using field mapping |
EP2345024B1 (en) | 2008-11-10 | 2017-11-08 | Cardioinsight Technologies, Inc. | Visualization of electrophysiology data |
US8745536B1 (en) | 2008-11-25 | 2014-06-03 | Perceptive Pixel Inc. | Volumetric data exploration using multi-point input controls |
US8700129B2 (en) * | 2008-12-31 | 2014-04-15 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Devices and methods for catheter localization |
CN101836862B (en) * | 2009-03-16 | 2014-03-26 | 上海微创医疗器械(集团)有限公司 | Three-dimensional mapping method of human chamber inner wall and equipment and system thereof |
US20100305427A1 (en) * | 2009-06-01 | 2010-12-02 | General Electric Company | Long-range planar sensor array for use in a surgical navigation system |
JP5795576B2 (en) | 2009-06-12 | 2015-10-14 | バード・アクセス・システムズ,インコーポレーテッド | Method of operating a computer-based medical device that uses an electrocardiogram (ECG) signal to position an intravascular device in or near the heart |
US9439736B2 (en) | 2009-07-22 | 2016-09-13 | St. Jude Medical, Atrial Fibrillation Division, Inc. | System and method for controlling a remote medical device guidance system in three-dimensions using gestures |
US8218727B2 (en) | 2009-09-04 | 2012-07-10 | Siemens Medical Solutions Usa, Inc. | System for medical image processing, manipulation and display |
EP2517622A3 (en) | 2009-09-29 | 2013-04-24 | C. R. Bard, Inc. | Stylets for use with apparatus for intravascular placement of a catheter |
US10624553B2 (en) | 2009-12-08 | 2020-04-21 | Biosense Webster (Israel), Ltd. | Probe data mapping using contact information |
US10835207B2 (en) | 2009-12-23 | 2020-11-17 | Biosense Webster (Israel) Ltd. | Fast anatomical mapping using ultrasound images |
US9521376B2 (en) | 2010-01-20 | 2016-12-13 | Olympus Corporation | Endoscope apparatus |
US10580325B2 (en) | 2010-03-24 | 2020-03-03 | Simbionix Ltd. | System and method for performing a computerized simulation of a medical procedure |
US9888973B2 (en) | 2010-03-31 | 2018-02-13 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Intuitive user interface control for remote catheter navigation and 3D mapping and visualization systems |
EP2555036B1 (en) * | 2010-04-01 | 2017-05-31 | Olympus Corporation | Endoscope apparatus and connection unit therefor |
CA2800813C (en) | 2010-05-28 | 2019-10-29 | C.R. Bard, Inc. | Apparatus for use with needle insertion guidance system |
US8811699B2 (en) * | 2010-09-22 | 2014-08-19 | Siemens Aktiengesellschaft | Detection of landmarks and key-frames in cardiac perfusion MRI using a joint spatial-temporal context model |
US8340766B2 (en) * | 2010-10-07 | 2012-12-25 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Method and system for identifying cardiac arrhythmia driver sites |
US9769912B2 (en) | 2010-10-20 | 2017-09-19 | Medtronic Navigation, Inc. | Gated image acquisition and patient model construction |
US9095715B2 (en) | 2010-12-23 | 2015-08-04 | Medtronic, Inc. | Implanted device data to guide ablation therapy |
US9547752B2 (en) * | 2010-12-31 | 2017-01-17 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Automated catheter guidance system |
US9047395B2 (en) | 2011-01-05 | 2015-06-02 | Olympus Corporation | Endoscope apparatus and method for storing endoscopic image |
US20120191079A1 (en) | 2011-01-20 | 2012-07-26 | Hansen Medical, Inc. | System and method for endoluminal and translumenal therapy |
US8606597B2 (en) | 2011-02-24 | 2013-12-10 | Olympus Corporation | Endoscope inspection report creating apparatus, creating method of endoscope inspection report and storage medium |
US20120245465A1 (en) | 2011-03-25 | 2012-09-27 | Joger Hansegard | Method and system for displaying intersection information on a volumetric ultrasound image |
US20130002858A1 (en) | 2011-06-28 | 2013-01-03 | Bridge Robert F | Mechanisms for Conserving Power in a Compressive Imaging System |
US20130030285A1 (en) | 2011-07-26 | 2013-01-31 | General Electric Company | System and method for integrating multiple data sources into an x-ray image referential |
US9298351B2 (en) * | 2011-08-03 | 2016-03-29 | Olympus Corporation | Inspection image display apparatus, inspection image display method and storage medium |
US8817076B2 (en) | 2011-08-03 | 2014-08-26 | General Electric Company | Method and system for cropping a 3-dimensional medical dataset |
US8724881B2 (en) | 2011-11-09 | 2014-05-13 | Siemens Aktiengesellschaft | Method and system for precise segmentation of the left atrium in C-arm computed tomography volumes |
US8920368B2 (en) | 2011-12-22 | 2014-12-30 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Multi-user touch-based control of a remote catheter guidance system (RCGS) |
US9311744B2 (en) | 2012-01-09 | 2016-04-12 | Fca Us Llc | System and method for generating an outer layer representation of an object |
US20130241929A1 (en) | 2012-03-13 | 2013-09-19 | Fady Massarwa | Selectably transparent electrophysiology map |
US9418475B2 (en) | 2012-04-25 | 2016-08-16 | University Of Southern California | 3D body modeling from one or more depth cameras in the presence of articulated motion |
US8832551B2 (en) * | 2012-05-10 | 2014-09-09 | Dassault Systemes Americas Corp. | Video-based undo and redo operations |
US9846960B2 (en) | 2012-05-31 | 2017-12-19 | Microsoft Technology Licensing, Llc | Automated camera array calibration |
US10070827B2 (en) * | 2012-10-05 | 2018-09-11 | Volcano Corporation | Automatic image playback |
US10912476B2 (en) | 2013-01-16 | 2021-02-09 | University Of Vermont | Catheters, systems, and related methods for mapping, minimizing, and treating cardiac fibrillation |
JP2016507304A (en) | 2013-02-11 | 2016-03-10 | アンジオメトリックス コーポレーション | System for detecting and tracking and superimposing objects |
US11278353B2 (en) | 2016-03-16 | 2022-03-22 | Synaptive Medical Inc. | Trajectory alignment system and methods |
EP2992513B1 (en) | 2013-05-02 | 2022-08-10 | Smith & Nephew, Inc. | Surface and image integration for model evaluation and landmark determination |
US9576107B2 (en) | 2013-07-09 | 2017-02-21 | Biosense Webster (Israel) Ltd. | Model based reconstruction of the heart from sparse samples |
US20160147308A1 (en) | 2013-07-10 | 2016-05-26 | Real View Imaging Ltd. | Three dimensional user interface |
US9460538B2 (en) | 2013-08-07 | 2016-10-04 | Siemens Medical Solutions Usa, Inc. | Animation for conveying spatial relationships in multi-planar reconstruction |
US11324419B2 (en) | 2013-08-20 | 2022-05-10 | Biosense Webster (Israel) Ltd. | Graphical user interface for medical imaging system |
WO2015066113A1 (en) | 2013-10-30 | 2015-05-07 | St. Jude Medical, Cardiology Division, Inc. | Cardiac mapping system and method for bi-directional activation detection of electrograms |
EP3122246B1 (en) | 2014-03-25 | 2022-05-04 | Acutus Medical, Inc. | Cardiac analysis user interface system and method |
US9949659B2 (en) | 2014-03-27 | 2018-04-24 | The General Hospital Corporation | System and method for determining dynamic elecardiographic ischemic changes |
WO2015168781A1 (en) | 2014-05-06 | 2015-11-12 | Conceptualiz Inc. | System and method for interactive 3d surgical planning and modelling of surgical implants |
US20160000300A1 (en) * | 2014-07-07 | 2016-01-07 | Integrated Medical Systems International, Inc. | System and Method for Wirelessly Transmitting Operational Data From an Endoscope to a Remote Device |
CN105631936A (en) | 2014-10-31 | 2016-06-01 | 富泰华工业(深圳)有限公司 | Point cloud repair method and system |
EP3232969A1 (en) | 2014-12-18 | 2017-10-25 | Boston Scientific Scimed Inc. | Real-time morphology analysis for lesion assessment |
US11026750B2 (en) | 2015-01-23 | 2021-06-08 | Queen's University At Kingston | Real-time surgical navigation |
US20160242667A1 (en) | 2015-02-20 | 2016-08-25 | Boston Scientific Scimed Inc. | Tissue contact sensing using a medical device |
US10019784B2 (en) | 2015-03-18 | 2018-07-10 | Toshiba Medical Systems Corporation | Medical image processing apparatus and method |
US20170046483A1 (en) | 2015-04-30 | 2017-02-16 | D.R. Systems, Inc. | Database systems and interactive user interfaces for dynamic interaction with, and comparison of, digital medical image data |
US20160331262A1 (en) | 2015-05-13 | 2016-11-17 | Ep Solutions Sa | Combined Electrophysiological Mapping and Cardiac Ablation Methods, Systems, Components and Devices |
US20160364527A1 (en) * | 2015-06-12 | 2016-12-15 | Merge Healthcare Incorporated | Methods and Systems for Automatically Analyzing Clinical Images and Determining when Additional Imaging May Aid a Diagnosis |
EP3282995B1 (en) | 2015-06-19 | 2019-04-24 | St. Jude Medical, Cardiology Division, Inc. | Electromagnetic dynamic registration for device navigation |
KR102035993B1 (en) | 2015-09-03 | 2019-10-25 | 지멘스 메디컬 솔루션즈 유에스에이, 인크. | Ultrasound system and method for generating elastic image |
WO2017048965A1 (en) | 2015-09-18 | 2017-03-23 | Adagio Medical Inc. | Tissue contact verification system |
AU2016341195B2 (en) | 2015-10-19 | 2019-03-14 | Icu Medical, Inc. | Hemodynamic monitoring system with detachable display unit |
JP6227200B1 (en) | 2015-12-16 | 2017-11-08 | オリンパス株式会社 | MEDICAL MANIPULATOR SYSTEM AND MEDICAL MANIPULATOR CONTROL METHOD |
WO2017123215A1 (en) | 2016-01-13 | 2017-07-20 | Hewlett-Packard Development Company, L.P. | Executing multiple pen inputs |
WO2017130135A1 (en) | 2016-01-26 | 2017-08-03 | St. Jude Medical International Holding S.A R.L. | Magnetic field distortion detection and correction in a magnetic localization system |
EP3882867A1 (en) | 2016-05-03 | 2021-09-22 | Affera, Inc. | Anatomical model displaying |
US10376320B2 (en) | 2016-05-11 | 2019-08-13 | Affera, Inc. | Anatomical model generation |
US10751134B2 (en) | 2016-05-12 | 2020-08-25 | Affera, Inc. | Anatomical model controlling |
WO2018092063A1 (en) | 2016-11-16 | 2018-05-24 | Navix International Limited | Real-time display of treatment-related tissue changes using virtual material |
US20210022623A1 (en) | 2017-04-14 | 2021-01-28 | Tyler Bywaters Rice | Non-invasive hemodynamic assessment via interrogation of biological tissue using a coherent light source |
EP3614946B1 (en) | 2017-04-27 | 2024-03-20 | EPiX Therapeutics, Inc. | Determining nature of contact between catheter tip and tissue |
US10561380B2 (en) | 2017-05-02 | 2020-02-18 | Apn Health, Llc | Determining and displaying the 3D location and orientation of a cardiac-ablation balloon |
US11806126B2 (en) | 2017-05-10 | 2023-11-07 | Navix International Limited | Property- and position-based catheter probe target identification |
US11052246B2 (en) | 2017-07-28 | 2021-07-06 | Medtronic, Inc. | Expandable elements for delivery of electric fields |
WO2019046376A1 (en) | 2017-08-30 | 2019-03-07 | Affera, Inc. | Catheter-based identification of cardiac regions |
-
2017
- 2017-05-12 US US15/593,778 patent/US10751134B2/en active Active
- 2017-05-12 WO PCT/US2017/032378 patent/WO2017197247A2/en unknown
- 2017-05-12 EP EP17725821.7A patent/EP3455756A2/en active Pending
- 2017-05-12 US US15/593,844 patent/US20170325901A1/en not_active Abandoned
- 2017-05-12 US US15/594,039 patent/US11728026B2/en active Active
- 2017-05-12 WO PCT/US2017/032459 patent/WO2017197294A1/en active Application Filing
-
2023
- 2023-01-11 US US18/153,306 patent/US20230215547A1/en active Pending
- 2023-06-21 US US18/339,086 patent/US20230335262A1/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5364395A (en) * | 1993-05-14 | 1994-11-15 | West Jr Hugh S | Arthroscopic surgical instrument with cauterizing capability |
US6216027B1 (en) * | 1997-08-01 | 2001-04-10 | Cardiac Pathways Corporation | System for electrode localization using ultrasound |
US20020165541A1 (en) * | 2001-04-20 | 2002-11-07 | Whitman Michael P. | Bipolar or ultrasonic surgical device |
US20030176778A1 (en) * | 2002-03-15 | 2003-09-18 | Scimed Life Systems, Inc. | Medical device control systems |
US7285117B2 (en) * | 2002-03-15 | 2007-10-23 | Boston Scientific Scimed, Inc. | Medical device control systems |
US20080308256A1 (en) * | 2007-06-18 | 2008-12-18 | Deborski Christopher A | Microwave cable cooling |
US20120123404A1 (en) * | 2010-11-16 | 2012-05-17 | Tyco Healthcare Group Lp | Fingertip Electrosurgical Instruments for Use in Hand-Assisted Surgery and Systems Including Same |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10765481B2 (en) | 2016-05-11 | 2020-09-08 | Affera, Inc. | Anatomical model generation |
US10751134B2 (en) | 2016-05-12 | 2020-08-25 | Affera, Inc. | Anatomical model controlling |
US11728026B2 (en) | 2016-05-12 | 2023-08-15 | Affera, Inc. | Three-dimensional cardiac representation |
US20210085425A1 (en) * | 2017-05-09 | 2021-03-25 | Boston Scientific Scimed, Inc. | Operating room devices, methods, and systems |
CN112822989A (en) * | 2018-07-18 | 2021-05-18 | 西姆拉特无生命模型公司 | Surgical training apparatus, method and system |
CN111000629A (en) * | 2019-12-05 | 2020-04-14 | 武汉奇致激光技术股份有限公司 | Safety authentication device for laser therapy apparatus and control method |
US20210338367A1 (en) * | 2020-04-29 | 2021-11-04 | Medtronic Navigation, Inc. | System and Method for Viewing a Subject |
US11593972B2 (en) | 2020-04-29 | 2023-02-28 | Medtronic Navigation, Inc. | System and method for viewing a subject |
US11628037B2 (en) * | 2020-04-29 | 2023-04-18 | Medtronic Navigation, Inc. | System and method for viewing a subject |
US11984219B2 (en) * | 2020-12-04 | 2024-05-14 | Boston Scientific Scimed, Inc. | Operating room devices, methods, and systems |
Also Published As
Publication number | Publication date |
---|---|
US20230335262A1 (en) | 2023-10-19 |
WO2017197247A2 (en) | 2017-11-16 |
WO2017197294A1 (en) | 2017-11-16 |
EP3455756A2 (en) | 2019-03-20 |
US20170325900A1 (en) | 2017-11-16 |
US20170330487A1 (en) | 2017-11-16 |
US10751134B2 (en) | 2020-08-25 |
WO2017197247A3 (en) | 2018-01-18 |
US20230215547A1 (en) | 2023-07-06 |
US11728026B2 (en) | 2023-08-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230215547A1 (en) | Anatomical model controlling | |
US11272993B2 (en) | Association processes and related systems for manipulators | |
JP7275204B2 (en) | System and method for on-screen menus in telemedicine systems | |
US20190167370A1 (en) | System and method for controlling a remote medical device guidance system in three-dimensions using gestures | |
CN106715057B (en) | Use the surgical system user interface of the robot of Collaborative Control | |
EP2923669B1 (en) | Systems and devices for catheter driving instinctiveness | |
US8368649B2 (en) | Control system for use within a sterile environment | |
US20100013764A1 (en) | Devices for Controlling Computers and Devices | |
KR101798590B1 (en) | Master robot, surgical robot system using thereof, control method thereof, and recording medium thereof | |
US11633247B2 (en) | Graphical user guidance for a robotic surgical system | |
US20140258917A1 (en) | Method to operate a device in a sterile environment | |
US20230073049A1 (en) | Systems and methods for navigating an onscreen menu in a teleoperational medical system | |
WO2014156229A1 (en) | Operation input device and master-slave system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AFFERA, INC., MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HARLEV, DORON;WRIGHT, GEOFFREY PETER;HARWOOD, MATTHEW PETER NEVILLE;AND OTHERS;SIGNING DATES FROM 20170530 TO 20170606;REEL/FRAME:042789/0528 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |