US20230107857A1 - Surgical sealing devices for a natural body orifice - Google Patents
Surgical sealing devices for a natural body orifice Download PDFInfo
- Publication number
- US20230107857A1 US20230107857A1 US17/491,375 US202117491375A US2023107857A1 US 20230107857 A1 US20230107857 A1 US 20230107857A1 US 202117491375 A US202117491375 A US 202117491375A US 2023107857 A1 US2023107857 A1 US 2023107857A1
- Authority
- US
- United States
- Prior art keywords
- surgical
- port
- instrument
- natural body
- tissue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/02—Surgical instruments, devices or methods, e.g. tourniquets for holding wounds open; Tractors
- A61B17/0218—Surgical instruments, devices or methods, e.g. tourniquets for holding wounds open; Tractors for minimally invasive surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3417—Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
- A61B17/3421—Cannulas
- A61B17/3423—Access ports, e.g. toroid shape introducers for instruments or hands
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000095—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope for image enhancement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/00048—Constructional features of the display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00055—Operational features of endoscopes provided with output arrangements for alerting the user
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00064—Constructional details of the endoscope body
- A61B1/00071—Insertion part of the endoscope body
- A61B1/0008—Insertion part of the endoscope body characterised by distal tip features
- A61B1/00087—Tools
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00112—Connection or coupling means
- A61B1/00121—Connectors, fasteners and adapters, e.g. on the endoscope handle
- A61B1/00126—Connectors, fasteners and adapters, e.g. on the endoscope handle optical, e.g. for light supply cables
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00147—Holding or positioning arrangements
- A61B1/00149—Holding or positioning arrangements using articulated arms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00147—Holding or positioning arrangements
- A61B1/00154—Holding or positioning arrangements using guiding arrangements for insertion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00147—Holding or positioning arrangements
- A61B1/0016—Holding or positioning arrangements using motor drive units
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00193—Optical arrangements adapted for stereoscopic vision
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00194—Optical arrangements adapted for three-dimensional imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/005—Flexible endoscopes
- A61B1/009—Flexible endoscopes with bending or curvature detection of the insertion part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/012—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor
- A61B1/018—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor for receiving instruments
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/046—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for infrared imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B1/053—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion being detachable
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0605—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for spatially modulated illumination
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
- A61B1/0676—Endoscope light sources at distal tip of an endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/07—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/313—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
- A61B1/3132—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes for laparoscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/00234—Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/12—Surgical instruments, devices or methods, e.g. tourniquets for ligaturing or otherwise compressing tubular parts of the body, e.g. blood vessels, umbilical cord
- A61B17/12022—Occluding by internal devices, e.g. balloons or releasable wires
- A61B17/12099—Occluding by internal devices, e.g. balloons or releasable wires characterised by the location of the occluder
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/12—Surgical instruments, devices or methods, e.g. tourniquets for ligaturing or otherwise compressing tubular parts of the body, e.g. blood vessels, umbilical cord
- A61B17/12022—Occluding by internal devices, e.g. balloons or releasable wires
- A61B17/12099—Occluding by internal devices, e.g. balloons or releasable wires characterised by the location of the occluder
- A61B17/12104—Occluding by internal devices, e.g. balloons or releasable wires characterised by the location of the occluder in an air passage
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/12—Surgical instruments, devices or methods, e.g. tourniquets for ligaturing or otherwise compressing tubular parts of the body, e.g. blood vessels, umbilical cord
- A61B17/12022—Occluding by internal devices, e.g. balloons or releasable wires
- A61B17/12131—Occluding by internal devices, e.g. balloons or releasable wires characterised by the type of occluding device
- A61B17/12136—Balloons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3417—Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
- A61B17/3421—Cannulas
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3474—Insufflating needles, e.g. Veress needles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4887—Locating particular structures in or on the body
- A61B5/489—Blood vessels
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4887—Locating particular structures in or on the body
- A61B5/4893—Nerves
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/361—Image-producing devices, e.g. surgical cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/026—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by measuring distance between sensor and object
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/11—Surgical instruments, devices or methods, e.g. tourniquets for performing anastomosis; Buttons for anastomosis
- A61B17/115—Staplers for performing anastomosis in a single operation
- A61B17/1155—Circular staplers comprising a plurality of staples
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/32—Surgical cutting instruments
- A61B17/320068—Surgical cutting instruments using mechanical vibrations, e.g. ultrasonic
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3462—Trocars; Puncturing needles with means for changing the diameter or the orientation of the entrance port of the cannula, e.g. for use with different-sized instruments, reduction ports, adapter seals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B18/04—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body by heating
- A61B18/12—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body by heating by passing a current through the tissue to be heated, e.g. high-frequency current
- A61B18/14—Probes or electrodes therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00017—Electrical control of surgical instruments
- A61B2017/00022—Sensing or detecting at the treatment site
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00017—Electrical control of surgical instruments
- A61B2017/00022—Sensing or detecting at the treatment site
- A61B2017/00057—Light
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00017—Electrical control of surgical instruments
- A61B2017/00022—Sensing or detecting at the treatment site
- A61B2017/00057—Light
- A61B2017/00061—Light spectrum
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00017—Electrical control of surgical instruments
- A61B2017/00022—Sensing or detecting at the treatment site
- A61B2017/00075—Motion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00017—Electrical control of surgical instruments
- A61B2017/00199—Electrical control of surgical instruments with a console, e.g. a control panel with a display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/00234—Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery
- A61B2017/00292—Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery mounted on or guided by flexible, e.g. catheter-like, means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00367—Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like
- A61B2017/00398—Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like using powered actuators, e.g. stepper motors, solenoids
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00743—Type of operation; Specification of treatment sites
- A61B2017/00809—Lung operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00743—Type of operation; Specification of treatment sites
- A61B2017/00818—Treatment of the gastro-intestinal system
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00831—Material properties
- A61B2017/00876—Material properties magnetic
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3417—Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
- A61B2017/3419—Sealing means between cannula and body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3417—Details of tips or shafts, e.g. grooves, expandable, bendable; Multiple coaxial sliding cannulas, e.g. for dilating
- A61B17/3421—Cannulas
- A61B2017/3445—Cannulas used as instrument channel for multiple instruments
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B17/3462—Trocars; Puncturing needles with means for changing the diameter or the orientation of the entrance port of the cannula, e.g. for use with different-sized instruments, reduction ports, adapter seals
- A61B2017/3466—Trocars; Puncturing needles with means for changing the diameter or the orientation of the entrance port of the cannula, e.g. for use with different-sized instruments, reduction ports, adapter seals for simultaneous sealing of multiple instruments
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B2017/347—Locking means, e.g. for locking instrument in cannula
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/34—Trocars; Puncturing needles
- A61B2017/348—Means for supporting the trocar against the body or retaining the trocar inside the body
- A61B2017/3482—Means for supporting the trocar against the body or retaining the trocar inside the body inside
- A61B2017/3484—Anchoring means, e.g. spreading-out umbrella-like structure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
- A61B2018/00696—Controlled or regulated parameters
- A61B2018/00702—Power or energy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2051—Electromagnetic tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
- A61B2034/2057—Details of tracking cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2061—Tracking techniques using shape-sensors, e.g. fiber shape sensors with Bragg gratings
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B2034/301—Surgical robots for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/064—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/371—Surgical systems with images on a monitor during operation with simultaneous use of two cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3937—Visible markers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3937—Visible markers
- A61B2090/3945—Active visible markers, e.g. light emitting diodes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3954—Markers, e.g. radio-opaque or breast lesions markers magnetic, e.g. NMR or MRI
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
- A61B2505/05—Surgical care
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0062—Arrangements for scanning
- A61B5/0064—Body surface scanning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/7425—Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/50—Supports for surgical instruments, e.g. articulated arms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/50—Supports for surgical instruments, e.g. articulated arms
- A61B90/57—Accessory clamps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
Definitions
- the present invention relates generally to surgical devices, systems, and methods of using the same for sealing, instrument control, instrument stabilization, etc.
- Surgical systems often incorporate an imaging system, which can allow medical practitioners to view a surgical site and/or one or more portions thereof on one or more displays, e.g., a monitor, a computer tablet screen, etc.
- the display(s) can be local and/or remote to a surgical theater.
- the imaging system can include a scope with a camera that views the surgical site and transmits the view to the one or more displays viewable by medical practitioner(s).
- Imaging systems can be limited by the information that they are able to recognize and/or convey to the medical practitioner(s). For example, certain concealed structures, physical contours, and/or dimensions within a three-dimensional space may be unrecognizable intraoperatively by certain imaging systems. For another example, certain imaging systems may be incapable of communicating and/or conveying certain information to the medical practitioner(s) intraoperatively.
- a surgical sealing device includes a seal housing and at least one retention element.
- the seal housing is configured to be at least partially disposed within a natural body orifice and defining a plurality of ports.
- the plurality of ports includes at least one first port configured to control the ingress and egress of fluid between an interior volume of the natural body orifice and an ambient environment, and at least one second port that is configured to form a seal around an instrument inserted therethrough.
- the at least one retention element is arranged on an exterior surface of the housing and configured to affix the housing to the natural body orifice.
- the at least one first port can be operatively connected to a valve arranged outside of the seal housing.
- the valve can have at least one monitored parameter that can be used to control a fluid transfer rate through the at least one first port.
- the at least one monitored parameter can be a fluid transfer pressure and/or volume and a direction of the fluid transfer.
- the at least one retention element can have a variety of configurations.
- the at least one retention element can be deployable inside of the natural body lumen.
- the at least one retention element can be deployable outside of the natural body lumen.
- the at least one retention element can be a barb extending from the exterior surface of the housing.
- the at least one retention element can be a balloon that can be configured to be selectively inflated to contact an internal or an external surface of the natural body orifice and secure the housing thereto.
- the fluid can include at least one gas or at least one liquid. In other embodiments, the fluid can include at least one gas and at least one liquid.
- a control system can be configured to control the ingress and egress of fluid to create a pressure differential between the interior volume of the natural body orifice and the ambient environment.
- the ports of the surgical sealing device can be bi-directional.
- a method includes positioning a surgical sealing device at least partially within the natural body orifice, in which the surgical sealing device has a seal housing defining a plurality of ports, releasably positioning at least one retention element configured to affix the seal housing to the natural body orifice, controlling the ingress and egress of a fluid between an interior volume of the natural body orifice and an ambient environment through at least one first port, and passing at least one surgical instrument through at least one second port such that the at least one second port forms a seal around the at least one surgical instrument.
- the surgical sealing device defines at least one passageway through the natural body orifice.
- the method can include removing the at least one surgical instrument from the at least one second port without removing the seal housing from the natural body lumen.
- the at least one first port can be operatively connected to a valve arranged outside of the seal housing.
- the valve can have at least one monitored parameter which can be used to control a fluid transfer rate through the at least one first port.
- the at least one monitored parameter can be a fluid transfer pressure and/or volume and a direction of the fluid transfer.
- the at least one retention element can have a variety of configurations.
- the at least one retention element can be deployable inside of the natural body lumen.
- the at least one retention element can be deployable outside of the natural body lumen.
- the fluid can include a dye.
- the fluid can include at least one gas or at least one liquid.
- the fluid can include at least one gas and at least one liquid.
- FIG. 1 is a schematic view of one embodiment of a surgical visualization system
- FIG. 2 is a schematic view of triangularization between a surgical device, an imaging device, and a critical structure of FIG. 1 ;
- FIG. 3 is a schematic view of another embodiment of a surgical visualization system
- FIG. 4 is a schematic view of one embodiment of a control system for a surgical visualization system
- FIG. 5 is a schematic view of one embodiment of a control circuit of a control system for a surgical visualization system
- FIG. 6 is a schematic view of one embodiment of a combinational logic circuit of a surgical visualization system
- FIG. 7 is a schematic view of one embodiment of a sequential logic circuit of a surgical visualization system
- FIG. 8 is a schematic view of yet another embodiment of a surgical visualization system
- FIG. 9 is a schematic view of another embodiment of a control system for a surgical visualization system.
- FIG. 10 is a graph showing wavelength versus absorption coefficient for various biological materials
- FIG. 11 is a schematic view of one embodiment of a spectral emitter visualizing a surgical site
- FIG. 12 is a graph depicting illustrative hyperspectral identifying signatures to differentiate a ureter from obscurants
- FIG. 13 is a graph depicting illustrative hyperspectral identifying signatures to differentiate an artery from obscurants
- FIG. 14 is a graph depicting illustrative hyperspectral identifying signatures to differentiate a nerve from obscurants
- FIG. 15 is a schematic view of one embodiment of a near infrared (NIR) time-of-flight measurement system being utilized intraoperatively;
- NIR near infrared
- FIG. 16 shows a time-of-flight timing diagram for the system of FIG. 15 ;
- FIG. 17 is a schematic view of another embodiment of a near infrared (NIR) time-of-flight measurement system being utilized intraoperatively;
- NIR near infrared
- FIG. 18 is a schematic view of one embodiment of a computer-implemented interactive surgical system
- FIG. 19 is a schematic view of one embodiment a surgical system being used to perform a surgical procedure in an operating room
- FIG. 20 is a schematic view of one embodiment of a surgical system including a smart surgical instrument and a surgical hub;
- FIG. 21 is a flowchart showing a method of controlling the smart surgical instrument of FIG. 20 ;
- FIG. 22 is a schematic view of an exemplary embodiment of a surgical sealing device
- FIG. 23 is a cross-sectional view of the surgical sealing device of FIG. 22 ;
- FIG. 24 is a cross-sectional view of another exemplary embodiment of a surgical sealing device.
- FIG. 25 is a cross-sectional view of another exemplary embodiment of a surgical sealing device, showing the device inserted into a natural body orifice;
- FIG. 26 is an exemplary image of a colon
- FIG. 27 is a schematic view of an exemplary embodiment of a surgical system having first and second multi-port devices
- FIG. 28 is a schematic view of the surgical system of FIG. 27 , showing the first and second multi-port devices partially inserted within an abdominal cavity;
- FIG. 29 is a schematic view of an exemplary embodiment of a surgical sealing system having a sealing device with ports extending therethrough;
- FIG. 30 is a top view of the sealing device of FIG. 29 ;
- FIG. 31 is a schematic view of the ports of the surgical sealing port of FIG. 29 ;
- FIG. 32 is a schematic view of the altered ports of the surgical sealing port of FIG. 31 ;
- FIG. 33 is the sealing device of FIG. 29 , showing an instrument inserted into one port of the sealing device;
- FIG. 34 is a schematic view of an exemplary embodiment of a surgical sealing system having threaded restraints
- FIG. 35 is a schematic of an exemplary embodiment of a surgical robotic system that includes electomechanical arms each having a surgical instrument mounted thereto, and being wirelessly coupled to a control system;
- FIG. 36 is schematic view of an embodiment of a locking arm
- FIG. 37 is a schematic view of one embodiment of a locking structure prior to exposure to external energy.
- FIG. 38 is the locking structure of FIG. 37 after exposure to external energy.
- like-named components of the embodiments generally have similar features, and thus within a particular embodiment each feature of each like-named component is not necessarily fully elaborated upon.
- linear or circular dimensions are used in the description of the disclosed systems, devices, and methods, such dimensions are not intended to limit the types of shapes that can be used in conjunction with such systems, devices, and methods.
- a person skilled in the art will recognize that an equivalent to such linear and circular dimensions can easily be determined for any geometric shape.
- a dimension may not be a precise value but nevertheless be considered to be at about that value due to any number of factors such as manufacturing tolerances and sensitivity of measurement equipment. Sizes and shapes of the systems and devices, and the components thereof, can depend at least on the size and shape of components with which the systems and devices will be used.
- a surgical visualization system is configured to leverage “digital surgery” to obtain additional information about a patient's anatomy and/or a surgical procedure.
- the surgical visualization system is further configured to convey data to one or more medical practitioners in a helpful manner.
- Various aspects of the present disclosure provide improved visualization of the patient's anatomy and/or the surgical procedure, and/or use visualization to provide improved control of a surgical tool (also referred to herein as a “surgical device” or a “surgical instrument”).
- Digital surgery can embrace robotic systems, advanced imaging, advanced instrumentation, artificial intelligence, machine learning, data analytics for performance tracking and benchmarking, connectivity both inside and outside of the operating room (OR), and more.
- various surgical visualization systems described herein can be used in combination with a robotic surgical system, surgical visualization systems are not limited to use with a robotic surgical system.
- surgical visualization using a surgical visualization system can occur without robotics and/or with limited and/or optional robotic assistance.
- digital surgery can occur without robotics and/or with limited and/or optional robotic assistance.
- a surgical system that incorporates a surgical visualization system may enable smart dissection in order to identify and avoid critical structures.
- Critical structures include anatomical structures such as a ureter, an artery such as a superior mesenteric artery, a vein such as a portal vein, a nerve such as a phrenic nerve, and/or a tumor, among other anatomical structures.
- a critical structure can be a foreign structure in the anatomical field, such as a surgical device, a surgical fastener, a clip, a tack, a bougie, a band, a plate, and other foreign structures.
- Critical structures can be determined on a patient-by-patient and/or a procedure-by-procedure basis.
- Smart dissection technology may provide, for example, improved intraoperative guidance for dissection and/or may enable smarter decisions with critical anatomy detection and avoidance technology.
- a surgical system incorporating a surgical visualization system may enable smart anastomosis technologies that provide more consistent anastomoses at optimal location(s) with improved workflow.
- Cancer localization technologies may be improved with a surgical visualization platform. For example, cancer localization technologies can identify and track a cancer location, orientation, and its margins. In certain instances, the cancer localization technologies may compensate for movement of a surgical instrument, a patient, and/or the patient's anatomy during a surgical procedure in order to provide guidance back to the point of interest for medical practitioner(s).
- a surgical visualization system may provide improved tissue characterization and/or lymph node diagnostics and mapping.
- tissue characterization technologies may characterize tissue type and health without the need for physical haptics, especially when dissecting and/or placing stapling devices within the tissue.
- Certain tissue characterization technologies may be utilized without ionizing radiation and/or contrast agents.
- lymph node diagnostics and mapping a surgical visualization platform may, for example, preoperatively locate, map, and ideally diagnose the lymph system and/or lymph nodes involved in cancerous diagnosis and staging.
- information available to a medical practitioner via the “naked eye” and/or an imaging system may provide an incomplete view of the surgical site.
- certain structures such as structures embedded or buried within an organ, can be at least partially concealed or hidden from view.
- certain dimensions and/or relative distances can be difficult to ascertain with existing sensor systems and/or difficult for the “naked eye” to perceive.
- certain structures can move pre-operatively (e.g., before a surgical procedure but after a preoperative scan) and/or intraoperatively. In such instances, the medical practitioner can be unable to accurately determine the location of a critical structure intraoperatively.
- a medical practitioner's decision-making process can be inhibited. For example, a medical practitioner may avoid certain areas in order to avoid inadvertent dissection of a critical structure; however, the avoided area may be unnecessarily large and/or at least partially misplaced. Due to uncertainty and/or overly/excessive exercises in caution, the medical practitioner may not access certain desired regions. For example, excess caution may cause a medical practitioner to leave a portion of a tumor and/or other undesirable tissue in an effort to avoid a critical structure even if the critical structure is not in the particular area and/or would not be negatively impacted by the medical practitioner working in that particular area. In certain instances, surgical results can be improved with increased knowledge and/or certainty, which can allow a surgeon to be more accurate and, in certain instances, less conservative/more aggressive with respect to particular anatomical areas.
- a surgical visualization system can allow for intraoperative identification and avoidance of critical structures.
- the surgical visualization system may thus enable enhanced intraoperative decision making and improved surgical outcomes.
- the surgical visualization system can provide advanced visualization capabilities beyond what a medical practitioner sees with the “naked eye” and/or beyond what an imaging system can recognize and/or convey to the medical practitioner.
- the surgical visualization system can augment and enhance what a medical practitioner is able to know prior to tissue treatment (e.g., dissection, etc.) and, thus, may improve outcomes in various instances. As a result, the medical practitioner can confidently maintain momentum throughout the surgical procedure knowing that the surgical visualization system is tracking a critical structure, which may be approached during dissection, for example.
- the surgical visualization system can provide an indication to the medical practitioner in sufficient time for the medical practitioner to pause and/or slow down the surgical procedure and evaluate the proximity to the critical structure to prevent inadvertent damage thereto.
- the surgical visualization system can provide an ideal, optimized, and/or customizable amount of information to the medical practitioner to allow the medical practitioner to move confidently and/or quickly through tissue while avoiding inadvertent damage to healthy tissue and/or critical structure(s) and, thus, to minimize the risk of harm resulting from the surgical procedure.
- a surgical visualization system can include a first light emitter configured to emit a plurality of spectral waves, a second light emitter configured to emit a light pattern, and a receiver, or sensor, configured to detect visible light, molecular responses to the spectral waves (spectral imaging), and/or the light pattern.
- the surgical visualization system can also include an imaging system and a control circuit in signal communication with the receiver and the imaging system. Based on output from the receiver, the control circuit can determine a geometric surface map, e.g., three-dimensional surface topography, of the visible surfaces at the surgical site and a distance with respect to the surgical site, such as a distance to an at least partially concealed structure.
- the imaging system can convey the geometric surface map and the distance to a medical practitioner.
- an augmented view of the surgical site provided to the medical practitioner can provide a representation of the concealed structure within the relevant context of the surgical site.
- the imaging system can virtually augment the concealed structure on the geometric surface map of the concealing and/or obstructing tissue similar to a line drawn on the ground to indicate a utility line below the surface.
- the imaging system can convey the proximity of a surgical tool to the visible and obstructing tissue and/or to the at least partially concealed structure and/or a depth of the concealed structure below the visible surface of the obstructing tissue.
- the visualization system can determine a distance with respect to the augmented line on the surface of the visible tissue and convey the distance to the imaging system.
- the visible spectrum sometimes referred to as the optical spectrum or luminous spectrum, is that portion of the electromagnetic spectrum that is visible to (e.g., can be detected by) the human eye and may be referred to as “visible light” or simply “light.”
- a typical human eye will respond to wavelengths in air that are from about 380 nm to about 750 nm.
- the invisible spectrum (e.g., the non-luminous spectrum) is that portion of the electromagnetic spectrum that lies below and above the visible spectrum . The invisible spectrum is not detectable by the human eye.
- Wavelengths greater than about 750 nm are longer than the red visible spectrum, and they become invisible infrared (IR), microwave, and radio electromagnetic radiation. Wavelengths less than about 380 nm are shorter than the violet spectrum, and they become invisible ultraviolet, x-ray, and gamma ray electromagnetic radiation.
- FIG. 1 illustrates one embodiment of a surgical visualization system 100 .
- the surgical visualization system 100 is configured to create a visual representation of a critical structure 101 within an anatomical field.
- the critical structure 101 can include a single critical structure or a plurality of critical structures.
- the critical structure 101 can be any of a variety of structures, such as an anatomical structure, e.g., a ureter, an artery such as a superior mesenteric artery, a vein such as a portal vein, a nerve such as a phrenic nerve, a vessel, a tumor, or other anatomical structure, or a foreign structure, e.g., a surgical device, a surgical fastener, a surgical clip, a surgical tack, a bougie, a surgical band, a surgical plate, or other foreign structure.
- an anatomical structure e.g., a ureter, an artery such as a superior mesenteric artery, a vein such as a portal
- the critical structure 101 can be identified on a patient-by-patient and/or a procedure-by-procedure basis.
- Embodiments of critical structures and of identifying critical structures using a visualization system are further described in U.S. Pat. No. 10,792,034 entitled “Visualization Of Surgical Devices” issued Oct. 6, 2020, which is hereby incorporated by reference in its entirety.
- the critical structure 101 can be embedded in tissue 103 .
- the tissue 103 can be any of a variety of tissues, such as fat, connective tissue, adhesions, and/or organs. Stated differently, the critical structure 101 may be positioned below a surface 105 of the tissue 103 . In such instances, the tissue 103 conceals the critical structure 101 from the medical practitioner's “naked eye” view. The tissue 103 also obscures the critical structure 101 from the view of an imaging device 120 of the surgical visualization system 100 . Instead of being fully obscured, the critical structure 101 can be partially obscured from the view of the medical practitioner and/or the imaging device 120 .
- the surgical visualization system 100 can be used for clinical analysis and/or medical intervention.
- the surgical visualization system 100 can be used intraoperatively to provide real-time information to the medical practitioner during a surgical procedure, such as real-time information regarding proximity data, dimensions, and/or distances.
- information may not be precisely real time but nevertheless be considered to be real time for any of a variety of reasons, such as time delay induced by data transmission, time delay induced by data processing, and/or sensitivity of measurement equipment.
- the surgical visualization system 100 is configured for intraoperative identification of critical structure(s) and/or to facilitate the avoidance of the critical structure(s) 101 by a surgical device.
- a medical practitioner can avoid maneuvering a surgical device around the critical structure 101 and/or a region in a predefined proximity of the critical structure 101 during a surgical procedure.
- a medical practitioner can avoid dissection of and/or near the critical structure 101 , thereby helping to prevent damage to the critical structure 101 and/or helping to prevent a surgical device being used by the medical practitioner from being damaged by the critical structure 101 .
- the surgical visualization system 100 is configured to incorporate tissue identification and geometric surface mapping in combination with the surgical visualization system's distance sensor system 104 . In combination, these features of the surgical visualization system 100 can determine a position of a critical structure 101 within the anatomical field and/or the proximity of a surgical device 102 to the surface 105 of visible tissue 103 and/or to the critical structure 101 . Moreover, the surgical visualization system 100 includes an imaging system that includes the imaging device 120 configured to provide real-time views of the surgical site.
- the imaging device 120 can include, for example, a spectral camera (e.g., a hyperspectral camera, multispectral camera, or selective spectral camera), which is configured to detect reflected spectral waveforms and generate a spectral cube of images based on the molecular response to the different wavelengths.
- a spectral camera e.g., a hyperspectral camera, multispectral camera, or selective spectral camera
- Views from the imaging device 120 can be provided in real time to a medical practitioner, such as on a display (e.g., a monitor, a computer tablet screen, etc.).
- the displayed views can be augmented with additional information based on the tissue identification, landscape mapping, and the distance sensor system 104 .
- the surgical visualization system 100 includes a plurality of subsystems—an imaging subsystem, a surface mapping subsystem, a tissue identification subsystem, and/or a distance determining subsystem. These subsystems can cooperate to intra-operatively provide advanced data synthesis and integrated information to the medical practitioner.
- the imaging device 120 can be configured to detect visible light, spectral light waves (visible or invisible), and a structured light pattern (visible or invisible).
- Examples of the imaging device 120 includes scopes, e.g., an endoscope, an arthroscope, an angioscope, a bronchoscope, a choledochoscope, a colonoscope, a cytoscope, a duodenoscope, an enteroscope, an esophagogastro-duodenoscope (gastroscope), a laryngoscope, a nasopharyngo-neproscope, a sigmoidoscope, a thoracoscope, an ureteroscope, or an exoscope. Scopes can be particularly useful in minimally invasive surgical procedures. In open surgery applications, the imaging device 120 may not include a scope.
- the tissue identification subsystem can be achieved with a spectral imaging system.
- the spectral imaging system can rely on imaging such as hyperspectral imaging, multispectral imaging, or selective spectral imaging.
- Embodiments of hyperspectral imaging of tissue are further described in U.S. Pat. No. 9,274,047 entitled “System And Method For Gross Anatomic Pathology Using Hyperspectral Imaging” issued Mar. 1, 2016, which is hereby incorporated by reference in its entirety.
- the surface mapping subsystem can be achieved with a light pattern system.
- Various surface mapping techniques using a light pattern (or structured light) for surface mapping can be utilized in the surgical visualization systems described herein.
- Structured light is the process of projecting a known pattern (often a grid or horizontal bars) on to a surface.
- invisible (or imperceptible) structured light can be utilized, in which the structured light is used without interfering with other computer vision tasks for which the projected pattern may be confusing.
- infrared light or extremely fast frame rates of visible light that alternate between two exact opposite patterns can be utilized to prevent interference.
- Embodiments of surface mapping and a surgical system including a light source and a projector for projecting a light pattern are further described in U.S. Pat. Pub. No.
- the distance determining system can be incorporated into the surface mapping system.
- structured light can be utilized to generate a three-dimensional ( 3 D) virtual model of the visible surface 105 and determine various distances with respect to the visible surface 105 .
- the distance determining system can rely on time-of-flight measurements to determine one or more distances to the identified tissue (or other structures) at the surgical site.
- the surgical visualization system 100 also includes a surgical device 102 .
- the surgical device 102 can be any suitable surgical device. Examples of the surgical device 102 includes a surgical dissector, a surgical stapler, a surgical grasper, a clip applier, a smoke evacuator, a surgical energy device (e.g., mono-polar probes, bi-polar probes, ablation probes, an ultrasound device, an ultrasonic end effector, etc.), etc.
- the surgical device 102 includes an end effector having opposing jaws that extend from a distal end of a shaft of the surgical device 102 and that are configured to engage tissue therebetween.
- the surgical visualization system 100 can be configured to identify the critical structure 101 and a proximity of the surgical device 102 to the critical structure 101 .
- the imaging device 120 of the surgical visualization system 100 is configured to detect light at various wavelengths, such as visible light, spectral light waves (visible or invisible), and a structured light pattern (visible or invisible).
- the imaging device 120 can include a plurality of lenses, sensors, and/or receivers for detecting the different signals.
- the imaging device 120 can be a hyperspectral, multispectral, or selective spectral camera, as described herein.
- the imaging device 120 can include a waveform sensor 122 (such as a spectral image sensor, detector, and/or three-dimensional camera lens).
- the imaging device 120 can include a right-side lens and a left-side lens used together to record two two-dimensional images at the same time and, thus, generate a three-dimensional (3D) image of the surgical site, render a three-dimensional image of the surgical site, and/or determine one or more distances at the surgical site.
- the imaging device 120 can be configured to receive images indicative of the topography of the visible tissue and the identification and position of hidden critical structures, as further described herein.
- a field of view of the imaging device 120 can overlap with a pattern of light (structured light) on the surface 105 of the tissue 103 , as shown in FIG. 1 .
- the surgical visualization system 100 can be incorporated into a robotic surgical system 110 .
- the robotic surgical system 110 can have a variety of configurations, as discussed herein.
- the robotic surgical system 110 includes a first robotic arm 112 and a second robotic arm 114 .
- the robotic arms 112 , 114 each include rigid structural members 116 and joints 118 , which can include servomotor controls.
- the first robotic arm 112 is configured to maneuver the surgical device 102
- the second robotic arm 114 is configured to maneuver the imaging device 120 .
- a robotic control unit of the robotic surgical system 110 is configured to issue control motions to the first and second robotic arms 112 , 114 , which can affect the surgical device 102 and the imaging device 120 , respectively.
- one or more of the robotic arms 112 , 114 can be separate from the main robotic system 110 used in the surgical procedure.
- at least one of the robotic arms 112 , 114 can be positioned and registered to a particular coordinate system without a servomotor control.
- a closed-loop control system and/or a plurality of sensors for the robotic arms 112 , 114 can control and/or register the position of the robotic arm(s) 112 , 114 relative to the particular coordinate system.
- the position of the surgical device 102 and the imaging device 120 can be registered relative to a particular coordinate system.
- robotic surgical systems examples include the OttavaTM robotic-assisted surgery system (Johnson & Johnson of New Brunswick, N.J.), da Vinci® surgical systems (Intuitive Surgical, Inc. of Sunnyvale, Calif.), the HugoTM robotic-assisted surgery system (Medtronic PLC of Minneapolis, Minn.), the Versius® surgical robotic system (CMR Surgical Ltd of Cambridge, UK), and the Monarch® platform (Auris Health, Inc. of Redwood City, Calif.).
- Embodiments of various robotic surgical systems and using robotic surgical systems are further described in U.S. Pat. Pub. No. 2018/0177556 entitled “Flexible Instrument Insertion Using An Adaptive Force Threshold” filed Dec. 28, 2016, U.S. Pat. Pub.
- the surgical visualization system 100 also includes an emitter 106 .
- the emitter 106 is configured to emit a pattern of light, such as stripes, grid lines, and/or dots, to enable the determination of the topography or landscape of the surface 105 .
- projected light arrays 130 can be used for three-dimensional scanning and registration on the surface 105 .
- the projected light arrays 130 can be emitted from the emitter 106 located on the surgical device 102 and/or one of the robotic arms 112 , 114 and/or the imaging device 120 .
- the projected light array 130 is employed by the surgical visualization system 100 to determine the shape defined by the surface 105 of the tissue 103 and/or motion of the surface 105 intraoperatively.
- the imaging device 120 is configured to detect the projected light arrays 130 reflected from the surface 105 to determine the topography of the surface 105 and various distances with respect to the surface 105 .
- the imaging device 120 can include an optical waveform emitter 123 , such as by being mounted on or otherwise attached on the imaging device 120 .
- the optical waveform emitter 123 is configured to emit electromagnetic radiation 124 (near-infrared (NIR) photons) that can penetrate the surface 105 of the tissue 103 and reach the critical structure 101 .
- the imaging device 120 and the optical waveform emitter 123 can be positionable by the robotic arm 114 .
- the optical waveform emitter 123 is mounted on or otherwise on the imaging device 122 but in other embodiments can be positioned on a separate surgical device from the imaging device 120 .
- a corresponding waveform sensor 122 (e.g., an image sensor, spectrometer, or vibrational sensor) of the imaging device 120 is configured to detect the effect of the electromagnetic radiation received by the waveform sensor 122 .
- the wavelengths of the electromagnetic radiation 124 emitted by the optical waveform emitter 123 are configured to enable the identification of the type of anatomical and/or physical structure, such as the critical structure 101 .
- the identification of the critical structure 101 can be accomplished through spectral analysis, photo-acoustics, and/or ultrasound, for example.
- the wavelengths of the electromagnetic radiation 124 can be variable.
- the waveform sensor 122 and optical waveform emitter 123 can be inclusive of a multispectral imaging system and/or a selective spectral imaging system, for example. In other instances, the waveform sensor 122 and optical waveform emitter 123 can be inclusive of a photoacoustic imaging system, for example.
- the distance sensor system 104 of the surgical visualization system 100 is configured to determine one or more distances at the surgical site.
- the distance sensor system 104 can be a time-of-flight distance sensor system that includes an emitter, such as the emitter 106 as in this illustrated embodiment, and that includes a receiver 108 . In other instances, the time-of-flight emitter can be separate from the structured light emitter.
- the emitter 106 can include a very tiny laser source, and the receiver 108 can include a matching sensor.
- the distance sensor system 104 is configured to detect the “time of flight,” or how long the laser light emitted by the emitter 106 has taken to bounce back to the sensor portion of the receiver 108 . Use of a very narrow light source in the emitter 106 enables the distance sensor system 104 to determining the distance to the surface 105 of the tissue 103 directly in front of the distance sensor system 104 .
- the receiver 108 of the distance sensor system 104 is positioned on the surgical device 102 in this illustrated embodiment, but in other embodiments the receiver 108 can be mounted on a separate surgical device instead of the surgical device 102 .
- the receiver 108 can be mounted on a cannula or trocar through which the surgical device 102 extends to reach the surgical site.
- the receiver 108 for the distance sensor system 104 can be mounted on a separate robotically-controlled arm of the robotic system 110 (e.g., on the second robotic arm 114 ) than the first robotic arm 112 to which the surgical device 102 is coupled, can be mounted on a movable arm that is operated by another robot, or be mounted to an operating room (OR) table or fixture.
- the imaging device 120 includes the receiver 108 to allow for determining the distance from the emitter 106 to the surface 105 of the tissue 103 using a line between the emitter 106 on the surgical device 102 and the imaging device 120 .
- the distance d e can be triangulated based on known positions of the emitter 106 (on the surgical device 102 ) and the receiver 108 (on the imaging device 120 ) of the distance sensor system 104 .
- the three-dimensional position of the receiver 108 can be known and/or registered to the robot coordinate plane intraoperatively.
- the position of the emitter 106 of the distance sensor system 104 can be controlled by the first robotic arm 112 , and the position of the receiver 108 of the distance sensor system 104 can be controlled by the second robotic arm 114 .
- the surgical visualization system 100 can be utilized apart from a robotic system. In such instances, the distance sensor system 104 can be independent of the robotic system.
- d e is emitter-to-tissue distance from the emitter 106 to the surface 105 of the tissue 103
- d t is device-to-tissue distance from a distal end of the surgical device 102 to the surface 105 of the tissue 103
- the distance sensor system 104 is configured to determine the emitter-to-tissue distance d e .
- the device-to-tissue distance d t is obtainable from the known position of the emitter 106 on the surgical device 102 , e.g., on a shaft thereof proximal to the surgical device's distal end, relative to the distal end of the surgical device 102 .
- the device-to-tissue distance d t can be determined from the emitter-to-tissue distance d e .
- the shaft of the surgical device 102 can include one or more articulation joints and can be articulatable with respect to the emitter 106 and jaws at the distal end of the surgical device 102 .
- the articulation configuration can include a multi-joint vertebrae-like structure, for example.
- a three-dimensional camera can be utilized to triangulate one or more distances to the surface 105 .
- d w is camera-to-critical structure distance from the optical waveform emitter 123 located on the imaging device 120 to the surface of the critical structure 101
- d A is a depth of the critical structure 101 below the surface 105 of the tissue 103 (e.g., the distance between the portion of the surface 105 closest to the surgical device 102 and the critical structure 101 ).
- the time-of-flight of the optical waveforms emitted from the optical waveform emitter 123 located on the imaging device 120 are configured to determine the camera-to-critical structure distance d w .
- the depth d A of the critical structure 101 relative to the surface 105 of the tissue 103 can be determined by triangulating from the distance d w and known positions of the emitter 106 on the surgical device 102 and the optical waveform emitter 123 on the imaging device 120 (and, thus, the known distance d x therebetween) to determine the distance d y , which is the sum of the distances d e and d A .
- time-of-flight from the optical waveform emitter 123 can be configured to determine the distance from the optical waveform emitter 123 to the surface 105 of the tissue 103 .
- a first waveform (or range of waveforms) can be utilized to determine the camera-to-critical structure distance d w and a second waveform (or range of waveforms) can be utilized to determine the distance to the surface 105 of the tissue 103 .
- the different waveforms can be utilized to determine the depth of the critical structure 101 below the surface 105 of the tissue 103 .
- the distance d A can be determined from an ultrasound, a registered magnetic resonance imaging (MRI), or computerized tomography (CT) scan.
- the distance d A can be determined with spectral imaging because the detection signal received by the imaging device 120 can vary based on the type of material, e.g., type of the tissue 103 .
- the type of material e.g., type of the tissue 103 .
- fat can decrease the detection signal in a first way, or a first amount
- collagen can decrease the detection signal in a different, second way, or a second amount.
- a surgical device 162 in another embodiment of a surgical visualization system 160 illustrated in FIG. 3 , includes the optical waveform emitter 123 and the waveform sensor 122 that is configured to detect the reflected waveforms.
- the optical waveform emitter 123 is configured to emit waveforms for determining the distances d t and d w from a common device, such as the surgical device 162 , as described herein.
- the distance d A from the surface 105 of the tissue 103 to the surface of the critical structure 101 can be determined as follows:
- the surgical visualization system 100 includes a control system configured to control various aspects of the surgical visualization system 100 .
- FIG. 4 illustrates one embodiment of a control system 133 that can be utilized as the control system of the surgical visualization system 100 (or other surgical visualization system described herein).
- the control system 133 includes a control circuit 132 configured to be in signal communication with a memory 134 .
- the memory 134 is configured to store instructions executable by the control circuit 132 , such as instructions to determine and/or recognize critical structures (e.g., the critical structure 101 of FIG. 1 ), instructions to determine and/or compute one or more distances and/or three-dimensional digital representations, and instructions to communicate information to a medical practitioner.
- the memory 134 can store surface mapping logic 136 , imaging logic 138 , tissue identification logic 140 , and distance determining logic 141 , although the memory 134 can store any combinations of the logics 136 , 138 , 140 , 141 and/or can combine various logics together.
- the control system 133 also includes an imaging system 142 including a camera 144 (e.g., the imaging system including the imaging device 120 of FIG. 1 ), a display 146 (e.g., a monitor, a computer tablet screen, etc.), and controls 148 of the camera 144 and the display 146 .
- the camera 144 includes an image sensor 135 (e.g., the waveform sensor 122 ) configured to receive signals from various light sources emitting light at various visible and invisible spectra (e.g., visible light, spectral imagers, three-dimensional lens, etc.).
- the display 146 is configured to depict real, virtual, and/or virtually-augmented images and/or information to a medical practitioner.
- the image sensor 135 is a solid-state electronic device containing up to millions of discrete photodetector sites called pixels.
- the image sensor 135 technology falls into one of two categories: Charge-Coupled Device (CCD) and Complementary Metal Oxide Semiconductor (CMOS) imagers and more recently, short-wave infrared (SWIR) is an emerging technology in imaging.
- CCD Charge-Coupled Device
- CMOS Complementary Metal Oxide Semiconductor
- SWIR short-wave infrared
- Another type of the image sensor 135 employs a hybrid CCD/CMOS architecture (sold under the name “sCMOS”) and consists of CMOS readout integrated circuits (ROICs) that are bump bonded to a CCD imaging substrate.
- sCMOS hybrid CCD/CMOS architecture
- ROICs CMOS readout integrated circuits
- CCD and CMOS image sensors 135 are sensitive to wavelengths in a range of about 350 nm to about 1050 nm, such as in a range of about 400 nm to about 1000 nm.
- CMOS sensors are, in general, more sensitive to IR wavelengths than CCD sensors.
- Solid state image sensors 135 are based on the photoelectric effect and, as a result, cannot distinguish between colors. Accordingly, there are two types of color CCD cameras: single chip and three-chip.
- Single chip color CCD cameras offer a common, low-cost imaging solution and use a mosaic (e.g., Bayer) optical filter to separate incoming light into a series of colors and employ an interpolation algorithm to resolve full color images. Each color is, then, directed to a different set of pixels.
- Three-chip color CCD cameras provide higher resolution by employing a prism to direct each section of the incident spectrum to a different chip. More accurate color reproduction is possible, as each point in space of the object has separate RGB intensity values, rather than using an algorithm to determine the color.
- Three-chip cameras offer extremely high resolutions.
- the control system 133 also includes an emitter (e.g., the emitter 106 ) including a spectral light source 150 and a structured light source 152 each operably coupled to the control circuit 133 .
- a single source can be pulsed to emit wavelengths of light in the spectral light source 150 range and wavelengths of light in the structured light source 152 range.
- a single light source can be pulsed to provide light in the invisible spectrum (e.g., infrared spectral light) and wavelengths of light on the visible spectrum.
- the spectral light source 150 can be, for example, a hyperspectral light source, a multispectral light source, and/or a selective spectral light source.
- the tissue identification logic 140 is configured to identify critical structure(s) (e.g., the critical structure 101 of FIG. 1 ) via data from the spectral light source 150 received by the image sensor 135 of the camera 144 .
- the surface mapping logic 136 is configured to determine the surface contours of the visible tissue (e.g., the tissue 103 ) based on reflected structured light.
- the distance determining logic 141 is configured to determine one or more distance(s) to the visible tissue and/or the critical structure. Output from each of the surface mapping logic 136 , the tissue identification logic 140 , and the distance determining logic 141 is configured to be provided to the imaging logic 138 , and combined, blended, and/or overlaid by the imaging logic 138 to be conveyed to a medical practitioner via the display 146 of the imaging system 142 .
- the control circuit 132 can have a variety of configurations.
- FIG. 5 illustrates one embodiment of a control circuit 170 that can be used as the control circuit 132 configured to control aspects of the surgical visualization system 100 .
- the control circuit 170 is configured to implement various processes described herein.
- the control circuit 170 includes a microcontroller that includes a processor 172 (e.g., a microprocessor or microcontroller) operably coupled to a memory 174 .
- the memory 174 is configured to store machine-executable instructions that, when executed by the processor 172 , cause the processor 172 to execute machine instructions to implement various processes described herein.
- the processor 172 can be any one of a number of single-core or multicore processors known in the art.
- the memory 174 can include volatile and non-volatile storage media.
- the processor 172 includes an instruction processing unit 176 and an arithmetic unit 178 .
- the instruction processing unit 176 is configured to receive instructions from the memory 174 .
- FIG. 6 illustrates one embodiment of a combinational logic circuit 180 configured to control aspects of the surgical visualization system 100 using logic such as one or more of the surface mapping logic 136 , the imaging logic 138 , the tissue identification logic 140 , and the distance determining logic 141 .
- the combinational logic circuit 180 includes a finite state machine that includes a combinational logic 182 configured to receive data associated with a surgical device (e.g. the surgical device 102 and/or the imaging device 120 ) at an input 184 , process the data by the combinational logic 182 , and provide an output 184 to a control circuit (e.g., the control circuit 132 ).
- a surgical device e.g. the surgical device 102 and/or the imaging device 120
- FIG. 7 illustrates one embodiment of a sequential logic circuit 190 configured to control aspects of the surgical visualization system 100 using logic such as one or more of the surface mapping logic 136 , the imaging logic 138 , the tissue identification logic 140 , and the distance determining logic 141 .
- the sequential logic circuit 190 includes a finite state machine that includes a combinational logic 192 , a memory 194 , and a clock 196 .
- the memory 194 is configured to store a current state of the finite state machine.
- the sequential logic circuit 190 can be synchronous or asynchronous.
- the combinational logic 192 is configured to receive data associated with a surgical device (e.g.
- the sequential logic circuit 190 can include a combination of a processor (e.g., processor 172 of FIG. 5 ) and a finite state machine to implement various processes herein.
- the finite state machine can include a combination of a combinational logic circuit (e.g., the combinational logic circuit 192 of FIG. 7 ) and the sequential logic circuit 190 .
- FIG. 8 illustrates another embodiment of a surgical visualization system 200 .
- the surgical visualization system 200 is generally configured and used similar to the surgical visualization system 100 of FIG. 1 , e.g., includes a surgical device 202 and an imaging device 220 .
- the imaging device 220 includes a spectral light emitter 223 configured to emit spectral light in a plurality of wavelengths to obtain a spectral image of hidden structures, for example.
- the imaging device 220 can also include a three-dimensional camera and associated electronic processing circuits.
- the surgical visualization system 200 is shown being utilized intraoperatively to identify and facilitate avoidance of certain critical structures, such as a ureter 201 a and vessels 201 b, in an organ 203 (a uterus in this embodiment) that are not visible on a surface 205 of the organ 203 .
- the surgical visualization system 200 is configured to determine an emitter-to-tissue distance d e from an emitter 206 on the surgical device 202 to the surface 205 of the uterus 203 via structured light.
- the surgical visualization system 200 is configured to extrapolate a device-to-tissue distance d t from the surgical device 202 to the surface 205 of the uterus 203 based on the emitter-to-tissue distance d e .
- the surgical visualization system 200 is also configured to determine a tissue-to-ureter distance d A from the ureter 201 a to the surface 205 and a camera-to ureter distance d w from the imaging device 220 to the ureter 201 a.
- the surgical visualization system 200 is configured to determine the distance d w with spectral imaging and time-of-flight sensors, for example.
- the surgical visualization system 200 can determine (e.g. triangulate) the tissue-to-ureter distance d A (or depth) based on other distances and/or the surface mapping logic described herein.
- a surgical visualization system includes a control system configured to control various aspects of the surgical visualization system.
- the control system can have a variety of configurations.
- FIG. 9 illustrates one embodiment of a control system 600 for a surgical visualization system, such as the surgical visualization system 100 of FIG. 1 , the surgical visualization system 200 of FIG. 8 , or other surgical visualization system described herein.
- the control system 600 is a conversion system that integrates spectral signature tissue identification and structured light tissue positioning to identify a critical structure, especially when those structure(s) are obscured by tissue, e.g., by fat, connective tissue, blood tissue, and/or organ(s), and/or by blood, and/or to detect tissue variability, such as differentiating tumors and/or non-healthy tissue from healthy tissue within an organ.
- the control system 600 is configured for implementing a hyperspectral imaging and visualization system in which a molecular response is utilized to detect and identify anatomy in a surgical field of view.
- the control system 600 includes a conversion logic circuit 648 configured to convert tissue data to usable information for surgeons and/or other medical practitioners. For example, variable reflectance based on wavelengths with respect to obscuring material can be utilized to identify the critical structure in the anatomy.
- the control system 600 is configured to combine the identified spectral signature and the structural light data in an image.
- the control system 600 can be employed to create of three-dimensional data set for surgical use in a system with augmentation image overlays. Techniques can be employed both intraoperatively and preoperatively using additional visual information.
- the control system 600 is configured to provide warnings to a medical practitioner when in the proximity of one or more critical structures.
- Various algorithms can be employed to guide robotic automation and semi-automated approaches based on the surgical procedure and proximity to the critical structure(s).
- a projected array of lights is employed by the control system 600 to determine tissue shape and motion intraoperatively.
- flash Lidar may be utilized for surface mapping of the tissue.
- the control system 600 is configured to detect the critical structure, which as mentioned above can include one or more critical structures, and provide an image overlay of the critical structure and measure the distance to the surface of the visible tissue and the distance to the embedded/buried critical structure(s).
- the control system 600 can measure the distance to the surface of the visible tissue or detect the critical structure and provide an image overlay of the critical structure.
- the control system 600 includes a spectral control circuit 602 .
- the spectral control circuit 602 can be a field programmable gate array (FPGA) or another suitable circuit configuration, such as the configurations described with respect to FIG. 6 , FIG. 7 , and FIG. 8 .
- the spectral control circuit 602 includes a processor 604 configured to receive video input signals from a video input processor 606 .
- the processor 604 can be configured for hyperspectral processing and can utilize C/C++ code, for example.
- the video input processor 606 is configured to receive video-in of control (metadata) data such as shutter time, wave length, and sensor analytics, for example.
- the processor 604 is configured to process the video input signal from the video input processor 606 and provide a video output signal to a video output processor 608 , which includes a hyperspectral video-out of interface control (metadata) data, for example.
- the video output processor 608 is configured to provides the video output signal to an image overlay controller 610 .
- the video input processor 606 is operatively coupled to a camera 612 at the patient side via a patient isolation circuit 614 .
- the camera 612 includes a solid state image sensor 634 .
- the patient isolation circuit 614 can include a plurality of transformers so that the patient is isolated from other circuits in the system.
- the camera 612 is configured to receive intraoperative images through optics 632 and the image sensor 634 .
- the image sensor 634 can include a CMOS image sensor, for example, or can include another image sensor technology, such as those discussed herein in connection with FIG. 4 .
- the camera 612 is configured to output 613 images in 14 bit/pixel signals. A person skilled in the art will appreciate that higher or lower pixel resolutions can be employed.
- the isolated camera output signal 613 is provided to a color RGB fusion circuit 616 , which in this illustrated embodiment employs a hardware register 618 and a Nios2 co-processor 620 configured to process the camera output signal 613 .
- a color RGB fusion output signal is provided to the video input processor 606 and a laser pulsing control circuit 622 .
- the laser pulsing control circuit 622 is configured to control a laser light engine 624 .
- the laser light engine 624 is configured to output light in a plurality of wavelengths ( ⁇ 1 , ⁇ 2 , ⁇ 3 . . . ⁇ n) including near infrared (NIR).
- the laser light engine 624 can operate in a plurality of modes. For example, the laser light engine 624 can operate in two modes. In a first mode, e.g., a normal operating mode, the laser light engine 624 is configured to output an illuminating signal. In a second mode, e.g., an identification mode, the laser light engine 624 is configured to output RGBG and NIR light. In various embodiments, the laser light engine 624 can operate in a polarizing mode.
- Light output 626 from the laser light engine 624 is configured to illuminate targeted anatomy in an intraoperative surgical site 627 .
- the laser pulsing control circuit 622 is also configured to control a laser pulse controller 628 for a laser pattern projector 630 configured to project a laser light pattern 631 , such as a grid or pattern of lines and/or dots, at a predetermined wavelength ( ⁇ 2 ) on an operative tissue or organ at the surgical site 627 .
- the camera 612 is configured to receive the patterned light as well as the reflected light output through the camera optics 632 .
- the image sensor 634 is configured to convert the received light into a digital signal.
- the color RGB fusion circuit 616 is also configured to output signals to the image overlay controller 610 and a video input module 636 for reading the laser light pattern 631 projected onto the targeted anatomy at the surgical site 627 by the laser pattern projector 630 .
- a processing module 638 is configured to process the laser light pattern 631 and output a first video output signal 640 representative of the distance to the visible tissue at the surgical site 627 .
- the data is provided to the image overlay controller 610 .
- the processing module 638 is also configured to output a second video signal 642 representative of a three-dimensional rendered shape of the tissue or organ of the targeted anatomy at the surgical site.
- the first and second video output signals 640 , 642 include data representative of the position of the critical structure on a three-dimensional surface model, which is provided to an integration module 643 .
- the integration module 643 is configured to determine the distance (e.g., distance d A of FIG. 1 ) to a buried critical structure (e.g., via triangularization algorithms 644 ), and the distance to the buried critical structure can be provided to the image overlay controller 610 via a video out processor 646 .
- the foregoing conversion logic can encompass the conversion logic circuit 648 intermediate video monitors 652 and the camera 624 / laser pattern projector 630 positioned at the surgical site 627 .
- Preoperative data 650 can be employed to register or align certain three-dimensional deformable tissue in various instances.
- Such preoperative data 650 can be provided to the integration module 643 and ultimately to the image overlay controller 610 so that such information can be overlaid with the views from the camera 612 and provided to the video monitors 652 .
- Embodiments of registration of preoperative data are further described in U.S. Pat. Pub. No. 2020/0015907 entitled “Integration Of Imaging Data” filed Sep. 11, 2018, which is hereby incorporated by reference herein in its entirety.
- the video monitors 652 are configured to output the integrated/augmented views from the image overlay controller 610 .
- a medical practitioner can select and/or toggle between different views on one or more displays.
- the medical practitioner can toggle between (A) a view in which a three-dimensional rendering of the visible tissue is depicted and (B) an augmented view in which one or more hidden critical structures are depicted over the three-dimensional rendering of the visible tissue.
- the medical practitioner can toggle on distance measurements to one or more hidden critical structures and/or the surface of visible tissue, for example.
- the various surgical visualization systems described herein can be utilized to visualize various different types of tissues and/or anatomical structures, including tissues and/or anatomical structures that may be obscured from being visualized by EMR in the visible portion of the spectrum.
- the surgical visualization system can utilize a spectral imaging system, as mentioned above, which can be configured to visualize different types of tissues based upon their varying combinations of constituent materials.
- a spectral imaging system can be configured to detect the presence of various constituent materials within a tissue being visualized based on the absorption coefficient of the tissue across various EMR wavelengths.
- the spectral imaging system can be configured to characterize the tissue type of the tissue being visualized based upon the particular combination of constituent materials.
- FIG. 10 shows a graph 300 depicting how the absorption coefficient of various biological materials varies across the EMR wavelength spectrum.
- the vertical axis 302 represents absorption coefficient of the biological material in cm ⁇ 1
- the horizontal axis 304 represents EMR wavelength in ⁇ m.
- a first line 306 in the graph 300 represents the absorption coefficient of water at various EMR wavelengths
- a second line 308 represents the absorption coefficient of protein at various EMR wavelengths
- a third line 310 represents the absorption coefficient of melanin at various EMR wavelengths
- a fourth line 312 represents the absorption coefficient of deoxygenated hemoglobin at various EMR wavelengths
- a fifth line 314 represents the absorption coefficient of oxygenated hemoglobin at various EMR wavelengths
- a sixth line 316 represents the absorption coefficient of collagen at various EMR wavelengths.
- Different tissue types have different combinations of constituent materials and, therefore, the tissue type(s) being visualized by a surgical visualization system can be identified and differentiated between according to the particular combination of detected constituent materials.
- a spectral imaging system of a surgical visualization system can be configured to emit EMR at a number of different wavelengths, determine the constituent materials of the tissue based on the detected absorption EMR absorption response at the different wavelengths, and then characterize the tissue type based on the particular detected combination of constituent materials.
- FIG. 11 shows an embodiment of the utilization of spectral imaging techniques to visualize different tissue types and/or anatomical structures.
- a spectral emitter 320 e.g., the spectral light source 150 of FIG. 4
- an imaging system to visualize a surgical site 322 .
- the EMR emitted by the spectral emitter 320 and reflected from the tissues and/or structures at the surgical site 322 is received by an image sensor (e.g., the image sensor 135 of FIG. 4 ) to visualize the tissues and/or structures, which can be either visible (e.g., be located at a surface of the surgical site 322 ) or obscured (e.g., underlay other tissue and/or structures at the surgical site 322 ).
- an imaging system e.g., the imaging system 142 of FIG. 4
- the visualized tissues and structures can be displayed on a display screen associated with or coupled to the imaging system (e.g., the display 146 of the imaging system 142 of FIG. 4 ), on a primary display (e.g., the primary display 819 of FIG.
- non-sterile display e.g., the non-sterile displays 807 , 809 of FIG. 19
- a display of a surgical hub e.g., the display of the surgical hub 806 of FIG. 19
- a device/instrument display e.g., the display of the surgical hub 806 of FIG. 19
- the imaging system can be configured to tailor or update the displayed surgical site visualization according to the identified tissue and/or structure types. For example, as shown in FIG. 11 , the imaging system can display a margin 330 associated with the tumor 324 being visualized on a display screen associated with or coupled to the imaging system, on a primary display, on a non-sterile display, on a display of a surgical hub, on a device/instrument display, and/or on another display.
- the margin 330 can indicate the area or amount of tissue that should be excised to ensure complete removal of the tumor 324 .
- the surgical visualization system's control system e.g., the control system 133 of FIG. 4
- the imaging system has identified multiple abnormalities 328 within the field of view (FOV). Accordingly, the control system can adjust the displayed margin 330 to a first updated margin 332 having sufficient dimensions to encompass the abnormalities 328 . Further, the imaging system has also identified the artery 326 partially overlapping with the initially displayed margin 330 (as indicated by a highlighted region 334 of the artery 326 ). Accordingly, the control system can adjust the displayed margin to a second updated margin 336 having sufficient dimensions to encompass the relevant portion of the artery 326 .
- FOV field of view
- Tissues and/or structures can also be imaged or characterized according to their reflective characteristics, in addition to or in lieu of their absorptive characteristics described above with respect to FIG. 10 and FIG. 11 , across the EMR wavelength spectrum.
- FIG. 12 , FIG. 13 , and FIG. 14 illustrate various graphs of reflectance of different types of tissues or structures across different EMR wavelengths.
- FIG. 12 is a graphical representation 340 of an illustrative ureter signature versus obscurants.
- FIG. 13 is a graphical representation 342 of an illustrative artery signature versus obscurants.
- FIG. 14 is a graphical representation 344 of an illustrative nerve signature versus obscurants.
- Select wavelengths for spectral imaging can be identified and utilized based on the anticipated critical structures and/or obscurants at a surgical site (e.g., “selective spectral” imaging). By utilizing selective spectral imaging, the amount of time required to obtain the spectral image can be minimized such that the information can be obtained in real-time and utilized intraoperatively.
- the wavelengths can be selected by a medical practitioner or by a control circuit based on input by a user, e.g., a medical practitioner. In certain instances, the wavelengths can be selected based on machine learning and/or big data accessible to the control circuit via, e.g., a cloud or surgical hub.
- FIG. 15 illustrates one embodiment of spectral imaging to tissue being utilized intraoperatively to measure a distance between a waveform emitter and a critical structure that is obscured by tissue.
- FIG. 15 shows an embodiment of a time-of-flight sensor system 404 utilizing waveforms 424 , 425 .
- the time-of-flight sensor system 404 can be incorporated into a surgical visualization system, e.g., as the sensor system 104 of the surgical visualization system 100 of FIG. 1 .
- the time-of-flight sensor system 404 includes a waveform emitter 406 and a waveform receiver 408 on the same surgical device 402 (e.g., the emitter 106 and the receiver 108 on the same surgical device 102 of FIG. 1 ).
- the emitted wave 400 extends to a critical structure 401 (e.g., the critical structure 101 of FIG. 1 ) from the emitter 406 , and the received wave 425 is reflected back to by the receiver 408 from the critical structure 401 .
- the surgical device 402 in this illustrated embodiment is positioned through a trocar 410 that extends into a cavity 407 in a patient.
- the trocar 410 is used in this in this illustrated embodiment, other trocars or other access devices can be used, or no access device may be used.
- the waveforms 424 , 425 are configured to penetrate obscuring tissue 403 , such as by having wavelengths in the NIR or SWIR spectrum of wavelengths.
- a spectral signal e.g., hyperspectral, multispectral, or selective spectral
- a photoacoustic signal is emitted from the emitter 406 , as shown by a first arrow 407 pointing distally, and can penetrate the tissue 403 in which the critical structure 401 is concealed.
- the emitted waveform 424 is reflected by the critical structure 401 , as shown by a second arrow 409 pointing proximally.
- the received waveform 425 can be delayed due to a distance d between a distal end of the surgical device 402 and the critical structure 401 .
- the waveforms 424 , 425 can be selected to target the critical structure 401 within the tissue 403 based on the spectral signature of the critical structure 401 , as described herein.
- the emitter 406 is configured to provide a binary signal on and off, as shown in FIG. 16 , for example, which can be measured by the receiver 408 .
- the time-of-flight sensor system 404 is configured to determine the distance d.
- a time-of-flight timing diagram 430 for the emitter 406 and the receiver 408 of FIG. 15 is shown in FIG. 16 .
- the delay is a function of the distance d and the distance d is given by:
- the time-of-flight of the waveforms 424 , 425 corresponds to the distance d in FIG. 15 .
- additional emitters/receivers and/or pulsing signals from the emitter 406 can be configured to emit a non-penetrating signal.
- the non-penetrating signal can be configured to determine the distance from the emitter 406 to the surface 405 of the obscuring tissue 403 .
- a depth of the critical structure 401 can be determined by:
- FIG. 17 illustrates another embodiment of a time-of-flight sensor system 504 utilizing waves 524 a, 524 b, 524 c, 525 a, 525 b, 525 c is shown.
- the time-of-flight sensor system 504 can be incorporated into a surgical visualization system, e.g., as the sensor system 104 of the surgical visualization system 100 of FIG. 1 .
- the time-of-flight sensor system 504 includes a waveform emitter 506 and a waveform receiver 508 (e.g., the emitter 106 and the receiver 108 of FIG. 1 ).
- the waveform emitter 506 is positioned on a first surgical device 502 a (e.g., the surgical device 102 of FIG.
- the waveform receiver 508 is positioned on a second surgical device 502 b.
- the surgical devices 502 a, 502 b are positioned through first and second trocars 510 a, 510 b, respectively, which extend into a cavity 507 in a patient.
- the trocars 510 a, 510 b are used in this in this illustrated embodiment, other trocars or other access devices can be used, or no access device may be used.
- the emitted waves 524 a, 524 b, 524 c extend toward a surgical site from the emitter 506 , and the received waves 525 a, 525 b, 525 c are reflected back to the receiver 508 from various structures and/or surfaces at the surgical site.
- the different emitted waves 524 a, 524 b, 524 c are configured to target different types of material at the surgical site.
- the wave 524 a targets obscuring tissue 503
- the wave 524 b targets a first critical structure 501 a (e.g., the critical structure 101 of FIG. 1 ), which is a vessel in this illustrated embodiment
- the wave 524 c targets a second critical structure 501 b (e.g., the critical structure 101 of FIG. 1 ), which is a cancerous tumor in this illustrated embodiment.
- the wavelengths of the waves 524 a, 524 b, 524 c can be in the visible light, NIR, or SWIR spectrum of wavelengths.
- visible light can be reflected off a surface 505 of the tissue 503 , and NIR and/or SWIR waveforms can penetrate the surface 505 of the tissue 503 .
- a spectral signal e.g., hyperspectral, multispectral, or selective spectral
- a photoacoustic signal can be emitted from the emitter 506 .
- the waves 524 b, 524 c can be selected to target the critical structures 501 a, 501 b within the tissue 503 based on the spectral signature of the critical structure 501 a, 501 b, as described herein.
- Photoacoustic imaging is further described in various U.S. patent applications, which are incorporated by reference herein in the present disclosure.
- the emitted waves 524 a, 524 b, 524 c are reflected off the targeted material, namely the surface 505 , the first critical structure 501 a, and the second structure 501 b, respectively.
- the received waveforms 525 a, 525 b, 525 c can be delayed due to distances d 1a , d 2a , d 3a , d 1b , d 2b , d 2c .
- the various distances d 1a , d 2a , d 3a , d 1b , d 2b , d 2c can be calculated from the known position of the emitter 506 and the receiver 508 .
- the positions can be known when the surgical devices 502 a, 502 b are robotically-controlled.
- Knowledge of the positions of the emitter 506 and the receiver 508 , as well as the time of the photon stream to target a certain tissue and the information received by the receiver 508 of that particular response can allow a determination of the distances d 1a , d 2a , d 3a , d 1b , d 2b , d 2c .
- the distance to the obscured critical structures 501 a, 501 b can be triangulated using penetrating wavelengths. Because the speed of light is constant for any wavelength of visible or invisible light, the time-of-flight sensor system 504 can determine the various distances.
- the receiver 508 can be rotated such that a center of mass of the target structure in the resulting images remains constant, e.g., in a plane perpendicular to an axis of a select target structure 503 , 501 a, or 501 b.
- Such an orientation can quickly communicate one or more relevant distances and/or perspectives with respect to the target structure.
- the surgical site is displayed from a viewpoint in which the critical structure 501 a is perpendicular to the viewing plane (e.g., the vessel is oriented in/out of the page).
- Such an orientation can be default setting; however, the view can be rotated or otherwise adjusted by a medical practitioner.
- the medical practitioner can toggle between different surfaces and/or target structures that define the viewpoint of the surgical site provided by the imaging system.
- the receiver 508 can be mounted on the trocar 510 b (or other access device) through which the surgical device 502 b is positioned. In other embodiments, the receiver 508 can be mounted on a separate robotic arm for which the three-dimensional position is known. In various instances, the receiver 508 can be mounted on a movable arm that is separate from a robotic surgical system that controls the surgical device 502 a or can be mounted to an operating room (OR) table or fixture that is intraoperatively registerable to the robot coordinate plane. In such instances, the position of the emitter 506 and the receiver 508 can be registerable to the same coordinate plane such that the distances can be triangulated from outputs from the time-of-flight sensor system 504 .
- TOF-NIRS near-infrared spectroscopy
- 16/729,796 entitled “Adaptive Surgical System Control According To Surgical Smoke Particulate Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,803 entitled “Adaptive Visualization By A Surgical System” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,807 entitled “Method Of Using Imaging Devices In Surgery” filed Dec. 30, 2019, U.S. Prov. Pat. App. No. 63/249,652 entitled “Surgical Devices, Systems, and Methods Using Fiducial Identification and Tracking” filed on Sep. 29, 2021, U.S. Prov. Pat. App. No.
- a surgical hub can be a component of a comprehensive digital medical system capable of spanning multiple medical facilities and configured to provide integrated and comprehensive improved medical care to a vast number of patients.
- the comprehensive digital medical system includes a cloud-based medical analytics system that is configured to interconnect to multiple surgical hubs located across many different medical facilities.
- the surgical hubs are configured to interconnect with one or more elements, such as one or more surgical instruments that are used to conduct medical procedures on patients and/or one or more visualization systems that are used during performance of medical procedures.
- the surgical hubs provide a wide array of functionality to improve the outcomes of medical procedures.
- the data generated by the various surgical devices, visualization systems, and surgical hubs about the patient and the medical procedure may be transmitted to the cloud-based medical analytics system. This data may then be aggregated with similar data gathered from many other surgical hubs, visualization systems, and surgical instruments located at other medical facilities. Various patterns and correlations may be found through the cloud-based analytics system analyzing the collected data. Improvements in the techniques used to generate the data may be generated as a result, and these improvements may then be disseminated to the various surgical hubs, visualization systems, and surgical instruments. Due to the interconnectedness of all of the aforementioned components, improvements in medical procedures and practices may be found that otherwise may not be found if the many components were not so interconnected.
- FIG. 18 illustrates one embodiment of a computer-implemented interactive surgical system 700 that includes one or more surgical systems 702 and a cloud-based system (e.g., a cloud 704 that can include a remote server 713 coupled to a storage device 705 ).
- a cloud-based system e.g., a cloud 704 that can include a remote server 713 coupled to a storage device 705 .
- Each surgical system 702 includes at least one surgical hub 706 in communication with the cloud 704 .
- the surgical system 702 includes a visualization system 708 , a robotic system 710 , and an intelligent (or “smart”) surgical instrument 712 , which are configured to communicate with one another and/or the hub 706 .
- the intelligent surgical instrument 712 can include imaging device(s).
- the surgical system 702 can include an M number of hubs 706 , an N number of visualization systems 708 , an O number of robotic systems 710 , and a P number of intelligent surgical instruments 712 , where M, N, O, and P are integers greater than or equal to one that may or may not be equal to any one or more of each other.
- M, N, O, and P are integers greater than or equal to one that may or may not be equal to any one or more of each other.
- Data received by a surgical hub from a surgical visualization system can be used in any of a variety of ways.
- the surgical hub can receive data from a surgical visualization system in use with a patient in a surgical setting, e.g., in use in an operating room during performance of a surgical procedure.
- the surgical hub can use the received data in any of one or more ways, as discussed herein.
- the surgical hub can be configured to analyze received data in real time with use of the surgical visualization system and adjust control one or more of the surgical visualization system and/or one or more intelligent surgical instruments in use with the patient based on the analysis of the received data.
- Such adjustment can include, for example, adjusting one or operational control parameters of intelligent surgical instrument(s), causing one or more sensors of one or more intelligent surgical instruments to take a measurement to help gain an understanding of the patient's current physiological condition, and/or current operational status of an intelligent surgical instrument, and other adjustments. Controlling and adjusting operation of intelligent surgical instruments is discussed further below. Examples of operational control parameters of an intelligent surgical instrument include motor speed, cutting element speed, time, duration, level of energy application, and light emission.
- 16/729,729 entitled “Surgical Systems For Proposing And Corroborating Organ Portion Removals” filed Dec. 30 , 2019 , U.S. patent application Ser. No. 16/729,778 entitled “Surgical System For Overlaying Surgical Instrument Data Onto A Virtual Three Dimensional Construct Of An Organ” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,751 entitled “Surgical Systems For Generating Three Dimensional Constructs Of Anatomical Organs And Coupling Identified Anatomical Structures Thereto” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,740 entitled “Surgical Systems Correlating Visualization Data And Powered Surgical Instrument Data” filed Dec. 30, 2019, U.S. patent application Ser. No.
- 16/729,737 entitled “Adaptive Surgical System Control According To Surgical Smoke Cloud Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,796 entitled “Adaptive Surgical System Control According To Surgical Smoke Particulate Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,803 entitled “Adaptive Visualization By A Surgical System” filed Dec. 30, 2019, and U.S. patent application Ser. No. 16/729,807 entitled “Method Of Using Imaging Devices In Surgery” filed Dec. 30, 2019, and in U.S. patent application Ser. No. 17/068,857 entitled “Adaptive Responses From Smart Packaging Of Drug Delivery Absorbable Adjuncts” filed Oct. 13, 2020, U.S.
- the surgical hub can be configured to cause visualization of the received data to be provided in the surgical setting on a display so that a medical practitioner in the surgical setting can view the data and thereby receive an understanding of the operation of the imaging device(s) in use in the surgical setting.
- information provided via visualization can include text and/or images.
- FIG. 19 illustrates one embodiment of a surgical system 802 including a surgical hub 806 (e.g., the surgical hub 706 of FIG. 18 or other surgical hub described herein), a robotic surgical system 810 (e.g., the robotic surgical system 110 of FIG. 1 or other robotic surgical system herein), and a visualization system 808 (e.g., the visualization system 100 of FIG. 1 or other visualization system described herein).
- the surgical hub 806 can be in communication with a cloud, as discussed herein.
- FIG. 19 shows the surgical system 802 being used to perform a surgical procedure on a patient who is lying down on an operating table 814 in a surgical operating room 816 .
- the robotic system 810 includes a surgeon's console 818 , a patient side cart 820 (surgical robot), and a robotic system surgical hub 822 .
- the robotic system surgical hub 822 is generally configured similar to the surgical hub 822 and can be in communication with a cloud. In some embodiments, the robotic system surgical hub 822 and the surgical hub 806 can be combined.
- the patient side cart 820 can manipulate an intelligent surgical tool 812 through a minimally invasive incision in the body of the patient while a medical practitioner, e.g., a surgeon, nurse, and/or other medical practitioner, views the surgical site through the surgeon's console 818 .
- An image of the surgical site can be obtained by an imaging device 824 (e.g., the imaging device 120 of FIG.
- the robotic system surgical hub 822 can be used to process the images of the surgical site for subsequent display to the surgeon through the surgeon's console 818 .
- a primary display 819 is positioned in the sterile field of the operating room 816 and is configured to be visible to an operator at the operating table 814 .
- a visualization tower 818 can positioned outside the sterile field.
- the visualization tower 818 includes a first non-sterile display 807 and a second non-sterile display 809 , which face away from each other.
- the visualization system 808 guided by the surgical hub 806 , is configured to utilize the displays 807 , 809 , 819 to coordinate information flow to medical practitioners inside and outside the sterile field.
- the surgical hub 806 can cause the visualization system 808 to display a snapshot and/or a video of a surgical site, as obtained by the imaging device 824 , on one or both of the non-sterile displays 807 , 809 , while maintaining a live feed of the surgical site on the primary display 819 .
- the snapshot and/or video on the non-sterile display 807 and/or 809 can permit a non-sterile medical practitioner to perform a diagnostic step relevant to the surgical procedure, for example.
- the surgical hub 806 is configured to route a diagnostic input or feedback entered by a non-sterile medical practitioner at the visualization tower 818 to the primary display 819 within the sterile field, where it can be viewed by a sterile medical practitioner at the operating table 814 .
- the input can be in the form of a modification to the snapshot and/or video displayed on the non-sterile display 807 and/or 809 , which can be routed to the primary display 819 by the surgical hub 806 .
- the surgical hub 806 is configured to coordinate information flow to a display of the intelligent surgical instrument 812 , as is described in various U.S. Patent Applications that are incorporated by reference herein in the present disclosure.
- a diagnostic input or feedback entered by a non-sterile operator at the visualization tower 818 can be routed by the surgical hub 806 to the display 819 within the sterile field, where it can be viewed by the operator of the surgical instrument 812 and/or by other medical practitioner(s) in the sterile field.
- the intelligent surgical instrument 812 and the imaging device 824 which is also an intelligent surgical tool, is being used with the patient in the surgical procedure as part of the surgical system 802 .
- Other intelligent surgical instruments 812 a that can be used in the surgical procedure, e.g., that can be removably coupled to the patient side cart 820 and be in communication with the robotic surgical system 810 and the surgical hub 806 , are also shown in FIG. 19 as being available.
- Non-intelligent (or “dumb”) surgical instruments 817 e.g., scissors, trocars, cannulas, scalpels, etc., that cannot be in communication with the robotic surgical system 810 and the surgical hub 806 are also shown in FIG. 19 as being available for use.
- An intelligent surgical device can have an algorithm stored thereon, e.g., in a memory thereof, configured to be executable on board the intelligent surgical device, e.g., by a processor thereof, to control operation of the intelligent surgical device.
- the algorithm can be stored on a surgical hub, e.g., in a memory thereof, that is configured to communicate with the intelligent surgical device.
- the algorithm is stored in the form of one or more sets of pluralities of data points defining and/or representing instructions, notifications, signals, etc. to control functions of the intelligent surgical device.
- data gathered by the intelligent surgical device can be used by the intelligent surgical device, e.g., by a processor of the intelligent surgical device, to change at least one variable parameter of the algorithm.
- a surgical hub can be in communication with an intelligent surgical device, so data gathered by the intelligent surgical device can be communicated to the surgical hub and/or data gathered by another device in communication with the surgical hub can be communicated to the surgical hub, and data can be communicated from the surgical hub to the intelligent surgical device.
- the surgical hub can be configured to communicate the changed at least one variable, alone or as part of the algorithm, to the intelligent surgical device and/or the surgical hub can communicate an instruction to the intelligent surgical device to change the at least one variable as determined by the surgical hub.
- the at least one variable parameter is among the algorithm's data points, e.g., are included in instructions for operating the intelligent surgical device, and are thus each able to be changed by changing one or more of the stored pluralities of data points of the algorithm. After the at least one variable parameter has been changed, subsequent execution of the algorithm is according to the changed algorithm.
- operation of the intelligent surgical device over time can be managed for a patient to increase the beneficial results use of the intelligent surgical device by taking into consideration actual situations of the patient and actual conditions and/or results of the surgical procedure in which the intelligent surgical device is being used.
- Changing the at least one variable parameter is automated to improve patient outcomes.
- the intelligent surgical device can be configured to provide personalized medicine based on the patient and the patient's surrounding conditions to provide a smart system.
- automated changing of the at least one variable parameter may allow for the intelligent surgical device to be controlled based on data gathered during the performance of the surgical procedure, which may help ensure that the intelligent surgical device is used efficiently and correctly and/or may help reduce chances of patient harm by harming a critical anatomical structure.
- the at least one variable parameter can be any of a variety of different operational parameters.
- variable parameters include motor speed, motor torque, energy level, energy application duration, tissue compression rate, jaw closure rate, cutting element speed, load threshold, etc.
- FIG. 20 illustrates one embodiment of an intelligent surgical instrument 900 including a memory 902 having an algorithm 904 stored therein that includes at least one variable parameter.
- the algorithm 904 can be a single algorithm or can include a plurality of algorithms, e.g., separate algorithms for different aspects of the surgical instrument's operation, where each algorithm includes at least one variable parameter.
- the intelligent surgical instrument 900 can be the surgical device 102 of FIG. 1 , the imaging device 120 of FIG. 1 , the surgical device 202 of FIG. 8 , the imaging device 220 of FIG. 8 , the surgical device 402 of FIG. 15 , the surgical device 502 a of FIG. 17 , the surgical device 502 b of FIG. 17 , the surgical device 712 of FIG. 18 , the surgical device 812 of FIG.
- the surgical instrument 900 also includes a processor 906 configured to execute the algorithm 904 to control operation of at least one aspect of the surgical instrument 900 .
- the processor 906 is configured to run a program stored in the memory 902 to access a plurality of data points of the algorithm 904 in the memory 902 .
- the surgical instrument 900 also includes a communications interface 908 , e.g., a wireless transceiver or other wired or wireless communications interface, configured to communicate with another device, such as a surgical hub 910 .
- the communications interface 908 can be configured to allow one-way communication, such as providing data to a remote server (e.g., a cloud server or other server) and/or to a local, surgical hub server, and/or receiving instructions or commands from a remote server and/or a local, surgical hub server, or two-way communication, such as providing information, messages, data, etc. regarding the surgical instrument 900 and/or data stored thereon and receiving instructions, such as from a doctor; a remote server regarding updates to software; a local, surgical hub server regarding updates to software; etc.
- a remote server e.g., a cloud server or other server
- two-way communication such as providing information, messages, data, etc. regarding the surgical instrument 900 and/or data stored thereon and receiving instructions, such as from a doctor;
- the surgical instrument 900 is simplified in FIG. 20 and can include additional components, e.g., a bus system, a handle, a elongate shaft having an end effector at a distal end thereof, a power source, etc.
- the processor 906 can also be configured to execute instructions stored in the memory 902 to control the device 900 generally, including other electrical components thereof such as the communications interface 908 , an audio speaker, a user interface, etc.
- the processor 906 is configured to change at least one variable parameter of the algorithm 904 such that a subsequent execution of the algorithm 904 will be in accordance with the changed at least one variable parameter.
- the processor 906 is configured to modify or update the data point(s) of the at least one variable parameter in the memory 902 .
- the processor 906 can be configured to change the at least one variable parameter of the algorithm 904 in real time with use of the surgical device 900 during performance of a surgical procedure, which may accommodate real time conditions.
- the processor 906 can be configured to change the algorithm 904 and/or at least one variable parameter of the algorithm 904 in response to an instruction received from the surgical hub 910 .
- the processor 906 is configured to change the at least one variable parameter only after communicating with the surgical hub 910 and receiving an instruction therefrom, which may help ensure coordinated action of the surgical instrument 900 with other aspects of the surgical procedure in which the surgical instrument 900 is being used.
- the processor 906 executes the algorithm 904 to control operation of the surgical instrument 900 , changes the at least one variable parameter of the algorithm 904 based on real time data, and executes the algorithm 904 after changing the at least one variable parameter to control operation of the surgical instrument 900 .
- FIG. 21 illustrates one embodiment of a method 912 of using of the surgical instrument 900 including a change of at least one variable parameter of the algorithm 904 .
- the processor 906 controls 914 operation of the surgical instrument 900 by executing the algorithm 904 stored in the memory 902 . Based on any of this subsequently known data and/or subsequently gathered data, the processor 904 changes 916 the at least one variable parameter of the algorithm 904 as discussed above. After changing the at least one variable parameter, the processor 906 controls 918 operation of the surgical instrument 900 by executing the algorithm 904 , now with the changed at least one variable parameter.
- the processor 904 can change 916 the at least one variable parameter any number of times during performance of a surgical procedure, e.g., zero, one, two, three, etc.
- the surgical instrument 900 can communicate with one or more computer systems, e.g., the surgical hub 910 , a remote server such as a cloud server, etc., using the communications interface 908 to provide data thereto and/or receive instructions therefrom.
- one or more computer systems e.g., the surgical hub 910 , a remote server such as a cloud server, etc.
- Operation of an intelligent surgical instrument can be altered based on situational awareness of the patient.
- the operation of the intelligent surgical instrument can be altered manually, such as by a user of the intelligent surgical instrument handling the instrument differently, providing a different input to the instrument, ceasing use of the instrument, etc.
- the operation of an intelligent surgical instrument can be changed automatically by an algorithm of the instrument being changed, e.g., by changing at least one variable parameter of the algorithm.
- the algorithm can be adjusted automatically without user input requesting the change.
- Automating the adjustment during performance of a surgical procedure may help save time, may allow medical practitioners to focus on other aspects of the surgical procedure, and/or may ease the process of using the surgical instrument for a medical practitioner, which each may improve patient outcomes, such as by avoiding a critical structure, controlling the surgical instrument with consideration of a tissue type the instrument is being used on and/or near, etc.
- the visualization systems described herein can be utilized as part of a situational awareness system that can be embodied or executed by a surgical hub, e.g., the surgical hub 706 , the surgical hub 806 , or other surgical hub described herein.
- a surgical hub e.g., the surgical hub 706 , the surgical hub 806 , or other surgical hub described herein.
- characterizing, identifying, and/or visualizing surgical instruments (including their positions, orientations, and actions), tissues, structures, users, and/or other things located within the surgical field or the operating theater can provide contextual data that can be utilized by a situational awareness system to infer various information, such as a type of surgical procedure or a step thereof being performed, a type of tissue(s) and/or structure(s) being manipulated by a surgeon or other medical practitioner, and other information.
- the contextual data can then be utilized by the situational awareness system to provide alerts to a user, suggest subsequent steps or actions for the user to undertake, prepare surgical devices in anticipation for their use (e.g., activate an electrosurgical generator in anticipation of an electrosurgical instrument being utilized in a subsequent step of the surgical procedure, etc.), control operation of intelligent surgical instruments (e.g., customize surgical instrument operational parameters of an algorithm as discussed further below), and so on.
- prepare surgical devices in anticipation for their use e.g., activate an electrosurgical generator in anticipation of an electrosurgical instrument being utilized in a subsequent step of the surgical procedure, etc.
- control operation of intelligent surgical instruments e.g., customize surgical instrument operational parameters of an algorithm as discussed further below
- an intelligent surgical device including an algorithm that responds to sensed data, e.g., by having at least one variable parameter of the algorithm changed, can be an improvement over a “dumb” device that operates without accounting for sensed data
- some sensed data can be incomplete or inconclusive when considered in isolation, e.g., without the context of the type of surgical procedure being performed or the type of tissue that is being operated on.
- the algorithm may control the surgical device incorrectly or sub-optimally given the particular context-free sensed data.
- the optimal manner for an algorithm to control a surgical instrument in response to a particular sensed parameter can vary according to the particular tissue type being operated on.
- the optimal manner in which to control a surgical stapler in response to the surgical stapler sensing an unexpectedly high force to close its end effector will vary depending upon whether the tissue type is susceptible or resistant to tearing.
- the surgical instrument's control algorithm would optimally ramp down the motor in response to an unexpectedly high force to close to avoid tearing the tissue, e.g., change a variable parameter controlling motor speed or torque so the motor is slower.
- the instrument's algorithm would optimally ramp up the motor in response to an unexpectedly high force to close to ensure that the end effector is clamped properly on the tissue, e.g., change a variable parameter controlling motor speed or torque so the motor is faster. Without knowing whether lung or stomach tissue has been clamped, the algorithm may be sub-optimally changed or not changed at all.
- a surgical hub can be configured to derive information about a surgical procedure being performed based on data received from various data sources and then control modular devices accordingly.
- the surgical hub can be configured to infer information about the surgical procedure from received data and then control the modular devices operably coupled to the surgical hub based upon the inferred context of the surgical procedure.
- Modular devices can include any surgical device that is controllable by a situational awareness system, such as visualization system devices (e.g., a camera, a display screen, etc.), smart surgical instruments (e.g., an ultrasonic surgical instrument, an electrosurgical instrument, a surgical stapler, smoke evacuators, scopes, etc.).
- a modular device can include sensor(s)s configured to detect parameters associated with a patient with which the device is being used and/or associated with the modular device itself.
- the contextual information derived or inferred from the received data can include, for example, a type of surgical procedure being performed, a particular step of the surgical procedure that the surgeon (or other medical practitioner) is performing, a type of tissue being operated on, or a body cavity that is the subject of the surgical procedure.
- the situational awareness system of the surgical hub can be configured to derive the contextual information from the data received from the data sources in a variety of different ways.
- the contextual information received by the situational awareness system of the surgical hub is associated with a particular control adjustment or set of control adjustments for one or more modular devices. The control adjustments each correspond to a variable parameter.
- the situational awareness system includes a pattern recognition system, or machine learning system (e.g., an artificial neural network), that has been trained on training data to correlate various inputs (e.g., data from databases, patient monitoring devices, and/or modular devices) to corresponding contextual information regarding a surgical procedure.
- a machine learning system can be trained to accurately derive contextual information regarding a surgical procedure from the provided inputs.
- the situational awareness system can include a lookup table storing pre-characterized contextual information regarding a surgical procedure in association with one or more inputs (or ranges of inputs) corresponding to the contextual information. In response to a query with one or more inputs, the lookup table can return the corresponding contextual information for the situational awareness system for controlling at least one modular device.
- the situational awareness system includes a further machine learning system, lookup table, or other such system, which generates or retrieves one or more control adjustments for one or more modular devices when provided the contextual information as input.
- a surgical hub including a situational awareness system may provide any number of benefits for a surgical system.
- One benefit includes improving the interpretation of sensed and collected data, which would in turn improve the processing accuracy and/or the usage of the data during the course of a surgical procedure.
- Another benefit is that the situational awareness system for the surgical hub may improve surgical procedure outcomes by allowing for adjustment of surgical instruments (and other modular devices) for the particular context of each surgical procedure (such as adjusting to different tissue types) and validating actions during a surgical procedure.
- the situational awareness system may improve surgeon's and/or other medical practitioners' efficiency in performing surgical procedures by automatically suggesting next steps, providing data, and adjusting displays and other modular devices in the surgical theater according to the specific context of the procedure.
- Another benefit includes proactively and automatically controlling modular devices according to the particular step of the surgical procedure that is being performed to reduce the number of times that medical practitioners are required to interact with or control the surgical system during the course of a surgical procedure, such as by a situationally aware surgical hub proactively activating a generator to which an RF electrosurgical instrument is connected if it determines that a subsequent step of the procedure requires the use of the instrument. Proactively activating the energy source allows the instrument to be ready for use a soon as the preceding step of the procedure is completed.
- a situationally aware surgical hub can be configured to determine what type of tissue is being operated on. Therefore, when an unexpectedly high force to close a surgical instrument's end effector is detected, the situationally aware surgical hub can be configured to correctly ramp up or ramp down a motor of the surgical instrument for the type of tissue, e.g., by changing or causing change of at least one variable parameter of an algorithm for the surgical instrument regarding motor speed or torque.
- a type of tissue being operated can affect adjustments that are made to compression rate and load thresholds of a surgical stapler for a particular tissue gap measurement.
- a situationally aware surgical hub can be configured to infer whether a surgical procedure being performed is a thoracic or an abdominal procedure, allowing the surgical hub to determine whether the tissue clamped by an end effector of the surgical stapler is lung tissue (for a thoracic procedure) or stomach tissue (for an abdominal procedure).
- the surgical hub can then be configured to cause adjustment of the compression rate and load thresholds of the surgical stapler appropriately for the type of tissue, e.g., by changing or causing change of at least one variable parameter of an algorithm for the surgical stapler regarding compression rate and load threshold.
- a type of body cavity being operated in during an insufflation procedure can affect the function of a smoke evacuator.
- a situationally aware surgical hub can be configured to determine whether the surgical site is under pressure (by determining that the surgical procedure is utilizing insufflation) and determine the procedure type. As a procedure type is generally performed in a specific body cavity, the surgical hub can be configured to control a motor rate of the smoke evacuator appropriately for the body cavity being operated in, e.g., by changing or causing change of at least one variable parameter of an algorithm for the smoke evacuator regarding motor rate.
- a situationally aware surgical hub may provide a consistent amount of smoke evacuation for both thoracic and abdominal procedures.
- a type of procedure being performed can affect the optimal energy level for an ultrasonic surgical instrument or radio frequency (RF) electrosurgical instrument to operate at.
- Arthroscopic procedures for example, require higher energy levels because an end effector of the ultrasonic surgical instrument or RF electrosurgical instrument is immersed in fluid.
- a situationally aware surgical hub can be configured to determine whether the surgical procedure is an arthroscopic procedure.
- the surgical hub can be configured to adjust an RF power level or an ultrasonic amplitude of the generator (e.g., adjust energy level) to compensate for the fluid filled environment, e.g., by changing or causing change of at least one variable parameter of an algorithm for the instrument and/or a generator regarding energy level.
- a situationally aware surgical hub can be configured to determine what type of surgical procedure is being performed and then customize the energy level for the ultrasonic surgical instrument or RF electrosurgical instrument, respectively, according to the expected tissue profile for the surgical procedure, e.g., by changing or causing change of at least one variable parameter of an algorithm for the instrument and/or a generator regarding energy level.
- a situationally aware surgical hub can be configured to adjust the energy level for the ultrasonic surgical instrument or RF electrosurgical instrument throughout the course of a surgical procedure, rather than just on a procedure-by-procedure basis.
- a situationally aware surgical hub can be configured to determine what step of the surgical procedure is being performed or will subsequently be performed and then update the control algorithm(s) for the generator and/or ultrasonic surgical instrument or RF electrosurgical instrument to set the energy level at a value appropriate for the expected tissue type according to the surgical procedure step.
- a situationally aware surgical hub can be configured to determine whether the current or subsequent step of a surgical procedure requires a different view or degree of magnification on a display according to feature(s) at the surgical site that the surgeon and/or other medical practitioner is expected to need to view.
- the surgical hub can be configured to proactively change the displayed view (supplied by, e.g., an imaging device for a visualization system) accordingly so that the display automatically adjusts throughout the surgical procedure.
- a situationally aware surgical hub can be configured to determine which step of a surgical procedure is being performed or will subsequently be performed and whether particular data or comparisons between data will be required for that step of the surgical procedure.
- the surgical hub can be configured to automatically call up data screens based upon the step of the surgical procedure being performed, without waiting for the surgeon or other medical practitioner to ask for the particular information.
- a situationally aware surgical hub can be configured to determine whether a surgeon and/or other medical practitioner is making an error or otherwise deviating from an expected course of action during the course of a surgical procedure, e.g., as provided in a pre-operative surgical plan.
- the surgical hub can be configured to determine a type of surgical procedure being performed, retrieve a corresponding list of steps or order of equipment usage (e.g., from a memory), and then compare the steps being performed or the equipment being used during the course of the surgical procedure to the expected steps or equipment for the type of surgical procedure that the surgical hub determined is being performed.
- the surgical hub can be configured to provide an alert (visual, audible, and/or tactile) indicating that an unexpected action is being performed or an unexpected device is being utilized at the particular step in the surgical procedure.
- operation of a robotic surgical system can be controlled by the surgical hub based on its situational awareness and/or feedback from the components thereof and/or based on information from a cloud (e.g., the cloud 713 of FIG. 18 ).
- a cloud e.g., the cloud 713 of FIG. 18 .
- 16/729,729 entitled “Surgical Systems For Proposing And Corroborating Organ Portion Removals” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “Surgical System For Overlaying Surgical Instrument Data Onto A Virtual Three Dimensional Construct Of An Organ” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,751 entitled “Surgical Systems For Generating Three Dimensional Constructs Of Anatomical Organs And Coupling Identified Anatomical Structures Thereto” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,740 entitled “Surgical Systems Correlating Visualization Data And Powered Surgical Instrument Data” filed Dec. 30, 2019, U.S. patent application Ser. No.
- 16/729,737 entitled “Adaptive Surgical System Control According To Surgical Smoke Cloud Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,796 entitled “Adaptive Surgical System Control According To Surgical Smoke Particulate Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,803 entitled “Adaptive Visualization By A Surgical System” filed Dec. 30, 2019, and U.S. patent application Ser. No. 16/729,807 entitled “Method Of Using Imaging Devices In Surgery” filed Dec. 30, 2019.
- surgical sealing devices are provided that are configured to allow surgical access into a body cavity through a natural body orifice (e.g., a trachea, a rectum, and the like).
- the present surgical sealing devices include a seal housing that is configured to be at least partially disposed within a natural body orifice and at least one retention element configured to affix the seal housing to the natural body orifice.
- the present surgical sealing devices are designed to be inserted into a natural body orifice.
- the present surgical sealing devices provide a less traumatic and more direct access point to a natural body lumen or organ (e.g., for introduction and extraction of surgical instruments, fluid exchange, breathing apparatuses, smoke evacuation apparatuses, etc.) that would not otherwise be available through the use of conventional surgical sealing devices.
- the surgical sealing devices disclosed herein can be used to provide access to a natural body lumen, such as a colon, through a natural body orifice associated therewith. That is, the seal housing can be at least partially positioned within a natural body orifice. Given the contractive nature of a natural body orifice, however, it can be difficult maintain the seal housing within the natural body office.
- the surgical sealing devices include at least one retention element (e.g., arranged on an exterior surface of the seal housing) that enables and maintains fixation of the seal housing to the natural body orifice during device use.
- the at least one retention element can be configured to be deployed inside or outside of the patient's body.
- the seal housing can be positioned and affixed to the natural body orifice in such a way in which a distal portion of the seal housing extends into the natural body orifice, and a proximal portion extends out of the natural body orifice and into the ambient environment (e.g., positioned adjacent to and in contact with an exterior surface of the patient's body, such as the patient's skin.
- the seal housing can be designed to be entirely positioned within the natural body orifice.
- the seal housing generally includes one or more ports arranged within the seal housing to allow instruments to pass into the natural body lumen from the ambient environment through the natural body orifice.
- the one or more ports arranged through the seal housing can form pathway(s) into and through the natural body orifice. This can enable controlled fluid exchange through the natural body orifice, and consequently, into and/or out of the natural body lumen associated therewith, introduction and extraction of surgical instruments through the natural body orifice, and the like. As a result, the natural body lumen can be accessed without the need for an incision through the patient's skin.
- FIG. 22 and FIG. 23 illustrate one embodiment of a surgical sealing device 7000 that is configured to provide access into a natural body lumen or organ (e.g., a lung, a stomach, a colon, or small intestines) through a natural body orifice (e.g., esophagus, rectum, and the like). Therefore, at least a portion of the surgical sealing device 7000 is configured to be inserted into and stabilized within a natural body orifice.
- a natural body lumen or organ e.g., a lung, a stomach, a colon, or small intestines
- a natural body orifice e.g., esophagus, rectum, and the like
- the sealing device 7000 includes a seal housing 7100 with ports extending therethrough and at least one retention element on the exterior surface 7101 of the seal housing 7100 . While the at least one retention element can have a variety of configurations, in this illustrated embodiment, the at least one retention element includes first retention elements 7130 and second retention elements 7132 . The first and second retention elements 7130 , 7132 are configured to secure the seal housing 7100 within a natural body orifice.
- the surgical sealing device 7000 can be positioned within a natural body orifice, such as by deforming the seal housing 7100 , or a portion thereof (e.g., the outer body member 7104 ) and inserting the seal housing 7100 in the natural body orifice.
- the insertion of the seal housing can be performed by hand or by using an insertion tool.
- the at least one retention element is releasably positioned to thereby affix the seal housing to the natural body orifice.
- the at least one retention element can be deployed inside the natural body lumen, whereas in other embodiments, the at least one retention element can be deployed outside of the natural body lumen.
- the at least one retention member can be releasably positioned concurrently with or subsequently after the sealing housing is positioned at least partially within the natural body lumen.
- a portion of the seal housing 7100 e.g., the outer body member 7104
- the seal housing 7100 can be gripped with one or both hands (such as at opposite sides of the outer body member 7104 ) or by a removal instrument, or both, and the seal housing 7100 may be pulled proximally to withdraw the seal housing 7100 from natural body orifice.
- the at least one retention element Prior to gripping the seal housing, the at least one retention element can be moved or otherwise disengaged from tissue defining the natural body orifice or tissue positioned proximate to the natural body orifice.
- the first and second retention elements 7130 , 7132 are arranged on and extend from the exterior surface 7101 of the seal housing 7100 .
- the first and second retention elements 7130 , 7132 can have a variety of configurations. In some embodiments, the first and second retention elements can have the same or similar configurations. In other embodiments, the first and second retention elements can have different structural configurations relative to each other. It is also contemplated herein that in certain embodiments, the first retention elements or the second retention elements can be omitted.
- first and second retention elements 7130 , 7132 are each in the form of barbs that are configured to penetrate into the tissue to affix the seal housing 7100 to the natural body orifice. Further, the retention elements 7130 , 7132 can allow for twisting and deformation of the natural body orifice, which can occur naturally, while also keeping the seal housing 7100 securely lodged within the natural body orifice.
- the at least one retention element can have a structural configuration that is configured to contact and engage the tissue surrounding or adjacent to the natural body orifice without penetration. That is, the at least one retention element can have a structural configuration that is configured to frictionally engage with the tissue so to prevent the seal housing from further movement within the natural body orifice during use.
- the at least one retention element can be in the form of an expandable element (e.g., inflatable balloons), as illustrated in Figure X.
- the expandable element(s) can be inflated, and when the seal housing is to be removed from the natural body orifice, the expandable element(s) can be deflated.
- retention elements when one or more retention elements are expandable elements, these retention elements can configured to be expanded within the natural body orifice (e.g., after at least a portion of the seal housing is inserted into the natural body orifice). In other embodiments one or more retention elements can be configured to be deployed outside of the natural body lumen (e.g., after at least a portion of the seal housing is inserted into the natural body orifice). Alternatively, in certain embodiments, at least one retention element can be configured to be deployed within the natural body orifice, and at least another one retention element can be configured to be deployed outside the natural body orifice. A person skilled in the art will appreciate that the deployable position of the retention elements depends at least upon the position of the retention elements relative to the seal housing 7100 and the position of the seal housing 7100 relative to the natural body orifice when the seal housing 7100 is inserted therein.
- FIG. 24 illustrates an exemplary embodiment of a surgical sealing device 7400 that includes a sealing housing 7402 and two retention elements 7404 , 7406 that are in the form of inflatable balloons.
- the two retention elements 7404 , 7406 are each configured to move from an unexpanded to an expanded state ( FIG. 24 ).
- sealing device 7400 can be similar to sealing device 7000 ( FIG. 22 and FIG. 23 ) and therefore common features are not described in detail herein.
- the first retention element 7404 is positioned at a first end 7202 a of the seal housing 7402 and the second retention element 7406 is positioned at a second end 7202 b of the seal housing 7402 .
- both the first and second retention elements 7404 , 7406 are in their expanded state, as illustrated in FIG. 24 , they are configured to contact and frictionally engage an internal surface of the natural body orifice.
- the second end 7402 b of the seal housing 7402 can be positioned outside the natural body orifice (e.g., outside of the body of the patient).
- the second retention element 7406 can be configured to contact and frictionally engage the outer tissue surface surrounding or adjacent to the natural body orifice (e.g., an external surface of the natural body orifice).
- the seal housing 7100 of surgical sealing device 7000 can have a variety of configurations.
- the seal housing 7100 has an inner body member 7102 and an outer body member 7104 that is positioned about the inner body member 7102 .
- the outer body member can designed so as to extend distally from one end of the inner body member.
- the outer body member can be omitted.
- the inner body member 7102 and the outer body member 7104 can each have a variety of configurations.
- the inner body member 7102 has a generally cylindrical configuration.
- the outer body member 7104 includes an annular flange 7106 with an elongated cylindrical base 7110 extending therefrom. Further, the base 7110 defines a lumen 7112 extending therethrough. The lumen 7112 , as shown in FIG. 22 and FIG. 23 , at least partially houses the inner body member 7102 .
- inner body member and/or the outer body member, and/or portions thereof can have other suitable shapes and sizes (e.g., oval, elliptical, ovoid, and any combination thereof) and therefore their configurations are not limited to what is shown in the figures.
- the inner body member 7102 and the outer body member 7104 can formed as a unitary structure, permanently coupled to each other, or releasably coupled to each other.
- the inner body member 7102 can be configured to be inserted into and/or removed from the lumen 7112 (e.g., while the outer body member 7104 is at least partially positioned within a natural body orifice).
- the outer body member 7104 can be configured to provide assistance in preventing the inner body member 7102 from be pushed through the sealing housing 7100 (e.g., and into the body of the patient), and to assist in removing the inner body member 7102 from the seal housing 7100 .
- the inner body member 7102 may be needed for removing damaged or diseased tissue through the lumen 7112 of the outer body member 7104 .
- the outer body member 7104 can be configured to help prevent the inner body member 7102 from being torn or otherwise damaged by surgical instrument(s) that is/are inserted therethrough (e.g., during surgery).
- the inner body member 7102 includes ports that extend therethrough, and thus, through the seal housing 7100 . While the inner body 7102 can include two or more ports, in this illustrated embodiment the inner body member 7102 includes three ports: a first port 7114 , a second port 7116 , a third port 7118 . Each port 7114 , 7116 , 7118 defines a respective passageway 7120 , 7122 , 7124 through the seal housing 7100 .
- the ports 7114 , 7116 , 7118 can be designed as a variety of different ports that serve different functions (e.g., fluid exchange into and/or out of the natural body lumen, sealing instruments inserted therethrough, preventing fluid from escaping out of the natural body orifice and into the ambient environment, and/or the like).
- At least one port can be configured to form a seal (e.g., around an instrument inserted therethrough) and at least another one port can be configured to control the ingress and/or egress of fluid (e.g., liquid, gas, or a combination thereof) between an interior volume of the natural body orifice and an ambient environment.
- at least one port can be configured to seal and control ingress and/or egress of fluid.
- the first and second ports 7114 , 7116 are each configured to form a respective seal around an instrument inserted therethrough and the third port 7118 is configured to control the fluid ingress and egress.
- any of these ports can configured to control fluid ingress and/or egress (e.g., air into and/or out of the natural body orifice, e.g., for breathing or insufflation) and/or to form a seal (e.g., around an instrument inserted therethrough and/or when an instrument is absent, for preventing loss of fluid therethrough).
- fluid ingress and/or egress e.g., air into and/or out of the natural body orifice, e.g., for breathing or insufflation
- a seal e.g., around an instrument inserted therethrough and/or when an instrument is absent, for preventing loss of fluid therethrough.
- sealing element(s) can be positioned within the first port and/or second port to form a seal therein.
- the sealing element(s) can be in the form of a thin membrane formed of a flexible material which can be punctured or otherwise pierced by a surgical instrument.
- zero closure sealing elements such as a duck bill seal or other suitable seals for sealing in the absence of instrument can be used in association with the ports.
- the sealing elements can be positioned at any suitable location within the port.
- a first sealing element 7126 is positioned within the passageway 7120 of the first port 7114 and a second sealing element 7128 is positioned within the passageway of the second port 7116 .
- the first and second sealing elements 7126 , 7128 can the same, whereas in other embodiments, the first and second sealing elements 7126 , 7128 can be different.
- the first and second sealing elements 7126 , 7128 can be positioned in a variety of different locations within the respective passageways.
- the first sealing element 7126 is positioned proximate to the proximal end 7114 p (e.g., the end closest to the ambient environment during use) of the first port and the second sealing element 7128 is positioned proximate to the proximal end 7116 p (e.g., the end closest to the ambient environment during use) of the second sealing port 7116 .
- the first sealing element, the second sealing element, or both can be positioned at a distal end of the second port and the third port, respectively.
- the first sealing element 7126 , the second sealing element 7128 , or both can be further configured to limit the direction of airflow while also providing sealed access for the surgical instruments through the seal housing 7100 . This can prevent contamination from aerosolized viruses or contagions during treatment due to the advancement and extraction of surgical instruments through the first port 7114 and/or the second port 7116 .
- the first sealing element, the second sealing element, or both can be a one-way valve to allow exhaust to be vented to a fluid trap and particulate filter to control the expiration of contagions.
- the surgical sealing device 7000 can have a small higher pressure inlet and a larger exhaust port for controlling exhaust gases being expelled from the natural body lumen.
- fluid exchange can occur through the third port 7118 of the surgical sealing device 7000 . That is, in this illustrated embodiment, the third port 7118 is designed to allow the ingress and egress of fluid between an interior volume of the natural body orifice and an ambient environment.
- the third port 7118 can be operatively connected to a valve 7210 .
- the valve 7210 can be configured to monitor a parameter that can be used to control a fluid transfer rate through the third port 7118 .
- the monitored parameter can be a fluid transfer pressure, a fluid transfer volume, and/or a direction of the fluid transfer therethrough.
- the valve can include a sensor that is configured to sense the pressure, volume, or flow direction of the fluid as it passes through the valve, and transmit the sensed data to a controller (not shown).
- the controller can alter the valve position (e.g., partially close or open the valve relative to its current position) to change the pressure, volume, or flow direction of the fluid therethrough, and consequently, through the third port 7118 .
- suitable sensors include pressure, temperature, and flow sensors.
- a controller can be omitted, and the valve can be structurally configured to control the fluid flow therethrough by itself, and therefore alter the pressure, volume, or flow direction, if needed.
- energy devices can delivery mechanical and/or electrical energy to target tissue in order to treat the tissue (e.g., to cut the tissue, cauterize blood vessels and/or coagulate the tissue within and/or near the targeted tissue).
- the cutting, cauterization, and/or coagulation of tissue can result in fluids and/or particulates being released into the air.
- Such fluids and/or particulates emitted during a surgical procedure can constitute smoke, for example, which can comprise carbon particles and/or other particles suspended in air.
- electrosurgical systems typically employ a surgical evacuation system that captures the resultant smoke from a surgical procedure, and directs the captured smoke through a filter and a smoke exhaust port away from the clinician(s) and/or from the patient(s).
- the surgical sealing devices disclosed herein can be configured to enable simultaneous trans-seal system use. That is, the present surgical sealing devices can be configured to provide smoke evacuation control of a fluid exchange system that allows cooperative flow of fluid such that, during surgery, the body can continue to receive the intended flow of fluid (e.g., breathable air) while also allowing extraction of a portion of the fluid through a different path to direct the smoke extraction from the patient.
- a fluid exchange system that allows cooperative flow of fluid such that, during surgery, the body can continue to receive the intended flow of fluid (e.g., breathable air) while also allowing extraction of a portion of the fluid through a different path to direct the smoke extraction from the patient.
- the smoke exhaust port can be its own separate port within the seal housing or it can be combined with another port of the seal housing (e.g., a port that is connected to a breathing apparatus that inflates and deflates the lung with breathable air and/or configured for insertion and extraction of surgical instruments), or the smoke evacuator passage can be a working passage of a flexible endoscope inserted through a port of the seal housing for controlling the ingress and egress of lung gasses as needed for breathing and smoke evacuation. If the smoke evacuation is activated when the body is breathing, an additional airflow inlet can be configured as a port of the seal housing to offset the smoke evacuation air flow, resulting in enough air for lung inflation while cooperatively extracting smoke and air form the lung.
- another port of the seal housing e.g., a port that is connected to a breathing apparatus that inflates and deflates the lung with breathable air and/or configured for insertion and extraction of surgical instruments
- the smoke evacuator passage can be a working passage of a flexible
- the smoke evacuation system can be configured to pass the smoke to an externally connected smoke evacuator pump and filters, while in other embodiments, the smoke evacuation system can be arranged to use the same filters as a primary breathing exhaust system coupled to the breathing passage port of the seal housing.
- Exemplary smoke evacuator systems suitable for use with the present disclosure are described, for example, in U.S. Pat. No. 11,051,876 entitled “Surgical Evacuation Flow Paths” issued Jul. 6, 2021, U.S. Patent Publication No. 2019/0201088 entitled “Surgical Evacuation System With A Communication Circuit For Communication Between A Filter And A Smoke Evacuation Device” published Jul. 4, 2019, and U.S. Patent Publication No. 2019/0204201 entitled “Adjustments Based On Airborne Particle Properties” published Jul. 4, 2019, the disclosures of which are incorporated herein by reference in their entireties.
- FIG. 25 illustrates another embodiment of a surgical sealing device 7300 .
- the surgical sealing device 7300 can be similar to surgical sealing device 7000 ( FIG. 22 and FIG. 23 ) and therefore common features are not described in detail herein.
- the surgical sealing device 7300 is shown at least partially inserted within a natural body orifice 10 formed by tissue 12 .
- the surgical sealing device 7300 includes a seal housing 7301 having an inner body member 7302 and an outer body member 7304 that is positioned about the inner body member 7302 .
- the inner body member 7302 has three ports 7306 , 7308 , 7310 extending therethrough.
- the illustrated three ports 7306 , 7308 , 7310 include one relatively larger port 7306 (e.g., to receive an endoscope or other relatively larger diameter device), and two relatively smaller ports 7308 , 7310 (e.g., to receive relatively smaller devices, such as graspers, clip appliers, or the like).
- the seal housing 7301 includes first retention elements 7312 and second retention elements 7314 .
- the first retention elements 7312 extend outward from the elongated cylindrical base 7316 of the outer body member 7304 and the second retention elements 7314 extend from a bottom surface 7318 a of the annular flange 7318 of the outer body member 7304 .
- the first retention elements 7312 engage with an internal surface 7320 of the natural body orifice 10 and penetrate portions of the tissue 12 that define such internal surface 7320 . Since the surgical sealing device 7300 is only partially inserted into the natural body orifice 10 , the annular flange 7318 of the seal housing 7300 is positioned outside of the natural body orifice 10 .
- the second retention elements 7314 engage an outer tissue surface 7322 surrounding the natural body orifice 10 and penetrate portions of the tissue 12 that define such outer surface 7322 (e.g., external surface of the natural body lumen).
- This penetration by both the first and second retention elements 7312 , 7314 into the tissue 12 affix the seal housing 7301 to the natural body orifice 10 so as to allow one or more surgical instruments to be inserted and extracted through the natural body orifice 10 and/or fluid transfer to occur through the natural body orifice 10 .
- the surgical sealing device can include wound protectors for use with natural body orifices that enable introduction and extraction of instruments while limiting instrument to tissue interaction. This limiting of interaction between the tissue and instruments can provide reduced friction between the body wall and the insertion forces of the instruments. The arrangement can minimize damage to the surrounding tissue during manipulation or advancing or retracting of the instruments through the sealing device.
- the seal housing of the surgical sealing device can be configured as a mechanical fixation point for a flexible scope and/or instruments passing through the seal housing.
- the seal housing can be arranged such that a fixation point is formed by the seal housing being secured within the natural body orifice, which provides the flexible scope and/or instruments passing through the seal housing a resistive fixation point from which to resist internally generated forces, motions and actions from the instruments manipulating tissue within the body.
- the fixation point for the instruments would prevent inappropriate loads on the patient during movement of the instruments within the sealing device.
- the fixation point could be outside of the body and prevent excessive torque from being applied to the body by the instruments through the sealing device.
- seal housings 7100 , 7402 , 7301 in FIG. 22 and FIG. 23 , FIG. 24 , and FIG. 25 are illustrated as a separate device which to be inserted into a natural body orifice and allows instruments to be inserted therethrough and into a natural body lumen
- a seal housing can be arranged on an instrument, such as a gastroscopic bougie, as the instrument is inserted into a natural body orifice.
- a gastroscopic bougie is commonly understood to be a thin cylinder of rubber, plastic, metal or another material that a medical practitioner inserts into or through a body passageway, such as the esophagus, to diagnose or treat a condition.
- a bougie may be used to widen a passageway, guide another instrument into a passageway, or dislodge an object.
- the gastroscopic bougie can include a seal housing having retention elements which are configured to be deployed in the esophagus prior to the stomach. This arrangement would allow laparoscopic access to the stomach while the abdominal cavity is insufflated for procedures such as a tumor resection within the stomach.
- the seal housing By arranging the seal housing in the esophagus, the laparoscopic insufflation is prevented from escaping endoluminally, while also allowing bougie to manipulate the stomach and tumor through four-wire control.
- surgical systems that enable control of surgical instrument interactions between separate port devices.
- these systems have two or more port devices (e.g., multi-port devices) that include respective housings that are each configured to allow instruments from respective sets of instruments to be inserted therethrough.
- the two or more port devices are each designed to provide individualized resistive forces to respective inserted instruments and to allow the inserted instruments to work cooperatively together (e.g., for at least one surgical step of a surgical procedure or at one or more surgical sites, etc.).
- the two or more port devices are interconnected to each other (e.g., electrically or mechanically) to create an interrelationship between the inserted instruments.
- This interrelationship enables these instruments to work in combination (e.g., move concurrently or sequentially in the same or different direction relative to each other or in groups) to provide the force(s), retraction, access angle(s), and the like to carry out at least one surgical step (e.g., to provide the intended medial therapy).
- these cooperative movements between at least a portion of the inserted instruments can provide a more collaborative surgical environment within the same port or among different ports that can increase precision and help prevent collisions (e.g., of surgical instruments and/or robotic arms).
- the phrase “work cooperatively together” as used herein refers to coordinated movement between two or more inserted instruments in the same port, in separate ports, or a combination thereof based on a location, an orientation, or a motion of at least one inserted instrument of the two or more inserted instruments.
- the coordinated movement between the two or more inserted instruments can occur in the same direction at the same time, in the same direction at different times, opposing directions at the same time, opposing directions at different times, in the same plane at the same time, in the same plane at different times, in two separate planes at the same time, in two different planes at different times, or any combination thereof.
- Each port device is configured to be at least partially disposed with a body.
- a first port device can be partially inserted into a body (e.g., through a natural orifice or an opening made by an incision) and a second port device can be partially inserted into the (e.g., through a natural orifice or an opening made by an incision).
- the first and second port devices can be partially inserted within the same physiological space or different physiological spaces.
- the first port device can bridge the ambient environment with a first physiological space inside the body (e.g., thoracic cavity or abdomen cavity and the second port device can bridge the ambient environment and a second physiological space that is not directly connected to the first physiological space (e.g., through a natural orifice to inside the colon, esophagus or other physiologic tract).
- the first and second physiological spaces are directly connected to each other.
- the first port device can be partially inserted into a first abdominal quadrant and the second port device can be partially inserted into a second abdominal quadrant that is different than the first abdominal quadrant.
- each port device can be positioned and affixed to body in such a way in which a distal portion of the housing extends into the body (e.g., a physiological space), and a proximal portion extends out of the body and into the ambient environment (e.g., positioned adjacent to and in contact with an exterior surface of the patient's body, such as the patient's skin).
- the housing can be designed to be entirely positioned within the body.
- each port device generally includes ports arranged within the housing that allow instruments to be inserted therethrough into the body (e.g., a physiological space, such as a one or more cavities within the body) from the ambient environment through a natural body orifice or an opening made by an incision.
- the ports arranged through the housing can form pathway(s) into and through the body.
- At least one port of at least one port device can be configured to form a seal around an inserted instrument.
- at least one port of the first port device can be configured to form a seal around a respective inserted instrument of a first set of instruments.
- at least one port of the second port device can be configured to form a seal around a respective inserted instrument of a second set of instruments.
- sealing element(s) can be positioned within the at least one port to form a seal therein.
- the sealing element(s) can have a variety of configurations.
- the sealing element(s) can be in the form of a thin membrane formed of a flexible material which can be punctured or otherwise pierced by a surgical instrument.
- zero closure sealing elements such as a duck bill seal or other suitable seals for sealing in the absence of instrument can be used in association with the at least one port.
- the sealing elements can be positioned at any suitable location within the at least one port.
- the first port device when first and second instruments are inserted into respective ports of the first port device, can be configured to allow the first instrument to move within a first range of motion relative to the first port device and to allow the second instrument to move within a second range of motion relative to the first port device that is at least partially overlaps with the first range of motion.
- the second port device when first and second instruments are inserted into respective ports of the second port device, can be configured to allow the first instrument to move within a first range of motion relative to the second port device and to allow the second instrument to move within a second range of motion relative to the second port device that at least partially overlaps with the first range of motion.
- the respective port device provides resistive inter-device forces to respective inserted instruments (e.g., to prevent unintended contact between inserted instruments). That is, during movement of an inserted instrument, the port device can restrain movement of the inserted instrument relative to other inserted instruments in the same port device, in at least one other port device, or a combination thereof.
- the port device(s) of the surgical system are configured to interact at least one inserted instrument in such a way that limits one or more instrument motions. This limitation can be based on, for example, at least one of a location, orientation, and a motion of at least one other instrument of the same set of inserted instruments, at least one other instrument of a different set of inserted instruments, or both.
- the location, orientation, motion, or any combination thereof, of an inserted instrument can be determined, for example, by using one or more tracking device(s) or a tracking system.
- the system can include a tracking device that can be associated with one of the first port device or the second port device.
- the tracking device can be configured in a variety of ways.
- the tracking device can be configured to transmit a signal indicative of a location of the first port device relative to the second port device.
- the tracking device can be configured to transmit a signal indicative of at least one of a location, an orientation, and a motion of at least one inserted instrument in the first port device relative to the second port device.
- the tracking device can be configured to transmit a signal indicative of at least one of a location, an orientation, and a motion of at least one inserted instrument in the second port device relative to the first port device.
- the transmitted signal(s) from the tracking device can be received by a controller.
- the controller can determine at least one or more of the following: a relative location of the first port device and the second port device, at least one of the location, the orientation, and the motion of at least one inserted instrument in the first port device relative to the second port device, or at least one of the location, the orientation, and the motion of the at least one inserted instrument of in the second port device relative to the first port device based on the respective transmitted signal.
- This information is used as guidance for movement of the inserted instruments individually, as a single group, or as multiple groups.
- This guidance in combination with the resistive forces applied by the respective port devices can control instrument interaction between the inserted instruments such that the inserted instruments can work cooperatively together at one or more surgical sites and/or to perform at least one surgical step of a surgical procedure.
- An exemplary surgical system can include a variety of features as described herein and illustrated in the drawings. However, a person skilled in the art will appreciate that the surgical systems can include only some of these features and/or it can include a variety of other features known in the art.
- the surgical systems described herein are merely intended to represent certain exemplary embodiments. Moreover, while the surgical systems are shown and described in connection with a colon, a person skilled in the art will appreciate that these surgical systems can be used in connection with any other suitable natural body lumens or organs.
- Surgery is often the primary treatment for early-stage colon cancers.
- stage extentent
- Some early colon cancers stage 0 and some early stage I tumors
- most polyps can be removed during a colonoscopy.
- a local excision or colectomy a surgical procedure that removes all or part of the colon, may be required.
- nearby lymph nodes are also removed.
- a hemicolectomy, or partial colectomy can be performed if only part of the colon is removed. In a segmental resection of the colon the surgeon removes the diseased part of the colon along with a small segment of non-diseased colon on either side.
- FIG. 26 Major resections of the colon are illustrated in FIG. 26 , in which (i) A-B is a right hemicolectomy, A-C is an extended right hemicolectomy, B-C is a transverse colectomy, C-E is a left hemicolectomy, D-E is a sigmoid colectomy, D-F is an anterior resection, D-G is a (ultra) low anterior resection, D-H is an abdomino-perineal resection, A-D is a subtotal colectomy, A-E is a total colectomy, and A-H is a total procto-colectomy.
- one single entry port device may not have a large enough range of motion to move the one end of the colon to connecting portion.
- a second entry port device is therefore needed to laparoscopically insert instruments to help mobilize the colon and/or purchase the one end of the colon from a laparoscopic instrument of the first entry port device and move the one end to the connecting portion.
- the multiple port devices having multiple instrument inserted therethrough to carry out at least one surgical step or site can increase the chance of surgical errors and collisions between surgical instruments or robotic arms.
- the present surgical systems include multiple port devices (e.g., multi-port devices) that interconnect multiple groups of surgical instruments that can move together while also providing individualized resistive inter-device forces and motions to the surgical instruments.
- a first port device can be configured to receive a first set of instruments (e.g., two or more instruments) and a second port device can be configured to receive a second set of instruments (e.g., two or more instruments), and when at least one instrument from the first set and from the second set are inserted into the first and second port devices, respectively, these instruments can move together as a single group.
- at least one inserted instrument of the first set can move with at least one instrument of the second set, or vice versa.
- FIG. 27 illustrates an exemplary embodiment a surgical system 8000 that is configured to for laparoscopic and/or endoscopic access into a body through two or more interconnected multi-port devices.
- FIG. 28 schematically illustrates the surgical system 8000 being used in a surgical resection procedure on a colon 10 . For purposes of simplicity, certain components of the surgical system 8000 are not illustrated.
- the surgical system 8000 includes a first multi-port device 8100 and a second multi-port device 8200 , in which each multi-port device 8100 , 8200 is configured to be at least partially disposed within the body.
- the surgical system can include more than two multi-port devices. It is also contemplated herein that in addition to the multi-port devices, the surgical system can include one or more single port devices.
- the first multi-port device 8100 can have a variety of configurations.
- the first multi-port device 8100 includes a first housing 8101 with a first port 8102 and a second port 8104 defined therein.
- the first and second ports 8102 , 8104 are each configured to allow a respective surgical instrument to be inserted therethrough.
- a first instrument 8106 shown in more detail in FIG. 28
- a second instrument 8108 can be inserted into the second port 8104 .
- the first and second instruments 8106 , 8108 are collectively referred to herein as “a first set of instruments.”
- the first multi-port device 8100 interacts with the first instrument 8106 , the second instrument 8108 , or both.
- the first multi-port device 8100 can be configured to interact with the first instrument 8106 and the second instrument 8108 concurrently, separately, or both.
- the first multi-port device 8100 interacts with the first instrument 8106 , and during the interaction, the first multi-port device 8100 applies resistive forces to the first instrument 8106 . These resistive forces limit one or more motions of the first instrument 8106 based on at least one of a location, orientation, and a motion of the second instrument 8108 .
- the first multi-port device 8100 is configured to have a similar interaction with the second instrument 8108 .
- the first housing 8101 can be formed of one or more suitable material(s).
- a first portion of the first housing can be formed of at least one first material and a second portion of the first housing can be formed of at least one second material.
- the first portion can be more flexible than the second portion or vice versa.
- the first housing is uniformly formed of one or more suitable material(s).
- the first and second ports 8102 , 8104 can be configured to form a seal around an instrument inserted therethrough.
- a first sealing element 8103 and a second sealing element 8105 can be positioned within the first port 8102 and the second port 8104 , respectively.
- the sealing elements 8103 , 8105 can be formed of any suitable material(s).
- a person skilled in the art will understand that the amount and type of resistive forces the first multi-port device applies to any inserted instrument will depend at least upon the material(s) and structural configuration of any sealing element(s) disposed within the first and second ports of the first housing.
- first and second sealing elements 8103 , 8105 form a seal around first and second instruments 8106 , 8108 , respectively. This can allow the physiological space inside the body to remain insufflated as the first and second instruments 8106 , 8108 and/or other suitable instrument(s) are inserted and removed from the first multi-port device 8100 .
- one or more of the inserted instruments of the first multi-port device 8100 can pivotally move relative to the first housing 8101 .
- the second multi-port device 8200 can have a variety of configurations.
- the second multi-port device 8200 includes a second housing 8201 with a third port 8202 and a fourth port 8204 defined therein.
- the third and fourth ports 8202 , 8204 are each configured to allow a respective instrument to be inserted therethrough.
- a third instrument 8206 shown in more detail in FIG. 28
- a fourth instrument 8208 shown in more detail in FIG. 28
- the third and fourth instruments 8206 , 8208 are collectively referred to herein as “a second set of instruments.”
- the second multi-port device 8200 interacts with the third instrument 8206 , the fourth instrument 8208 , or both.
- the second multi-port device 8200 can be configured to interact with the third instrument 8206 and the fourth instrument 8208 concurrently, separately, or both.
- the second multi-port device 8200 can interact with the third instrument 8206 , and during this interaction, the second multi-port device 8200 applies resistive forces to the third instrument 8206 . These resistive forces limit one or more motions of the third instrument 8206 based on at least one of a location, orientation, and a motion of the fourth instrument 8208 .
- the second multi-port device 8200 is configured to have a similar interaction with the fourth instrument 8208 .
- the second housing 8201 can be formed of one or more suitable material(s).
- a first portion of the second housing can be formed of at least one first material and a second portion of the second housing can be formed of at least one second material.
- the first portion can be more flexible than the second portion or vice versa.
- the second housing is uniformly formed of one or more suitable material(s).
- the third and fourth ports 8202 , 8204 can be configured to form a seal around an instrument inserted therethrough.
- a third sealing element 8203 and a fourth sealing element 8205 can be positioned within the third port 8202 and the fourth port 8204 , respectively.
- the third and fourth sealing elements 8203 , 8205 can be formed of any suitable material(s). A person skilled in the art will understand that the amount and type of resistive forces the second multi-port device applies to any inserted instrument will depend at least upon the material(s) and structural configuration of any sealing element(s) disposed within the third and fourth ports of the second housing.
- the third and fourth sealing elements 8203 , 8205 form a seal around third and fourth instruments 8206 , 8208 , respectively. This can allow the physiological space inside the body to remain insufflated as the third and fourth instruments 8206 , 8208 and/or other suitable instrument(s) are inserted and removed from the second multi-port device 8200 .
- one or more of the inserted instruments of the second multi-port device 8200 can pivotally move relative to the second housing 8201 .
- first multi-port device 8100 and/or the second multi-port device 8200 can incorporate various tracking mechanisms, such as electromagnetic (EM) tracked tips, fiber bragg grating, various sensors, etc., to assist in tracking orientation, location, and movement of the instruments.
- EM electromagnetic
- the first multi-port device 8100 and the second multi-port device can include a first tracking device 8110 and a second tracking device 8210 , respectively.
- Each of the first and second tracking devices 8110 , 8210 can be configured to transmit a variety of signals that can be used to determine the relative location of the first and second multi-port devices 8100 , 8200 , at least one of a location, an orientation, and a motion of at least one instrument inserted into one of the first or second multi-port devices 8100 , 8200 relative to the other one of the first or second multi-port devices 8100 , 8200 or relative to at least one instrument inserted into the other one of the first or second multi-port devices 8100 , 8200 , or a combination thereof.
- the first tracking device 8110 In use, with respect to the first tracking device 8110 , as the third and fourth instruments 8206 , 8208 are inserted into the second multi-port device and moved within the body, the first tracking device 8110 is configured to transmit a first signal 8112 to a controller 8002 that includes sensed data associated with the third instrument 8206 , the fourth instrument 8208 , or the second set of instruments. That is, the first tracking device 8110 is configured to sense, or otherwise track, the third instrument 8206 , the fourth instrument 8208 , or both (e.g., the second set of instruments), as such instrument(s) is/are inserted into and moved in the body with or relative to the second multi-port device 8200 .
- the first signal 8112 or an additional signal can include sensed data associated with the second multi-port device 8200 .
- the first tracking device 8110 is also configured to transmit a second signal 8114 to the controller 8002 that includes sensed data associated with the first set of instruments and/or the first multi-port device 8100 itself.
- the controller 8002 can calculate location, position, or motion of the third instrument 8206 , the fourth instrument 8208 , or both, relative to the first set of instruments and/or the first multi-port device 8100 itself. This creates one or more interrelationships between the first and second sets of instruments, and as a result, at least a portion of the first and second sets of instruments can work cooperatively together at one or more surgical sites and/or to carry out at least one surgical step of a surgical procedure. As shown in FIG.
- the first instrument 8106 and the third instrument 8206 are working cooperatively together to handoff the free end 15 of the colon 10
- the second instrument 8108 and the fourth instrument 8208 are shown working cooperatively together to purchase the same area of the colon 10 .
- the second tracking device 8210 in use, as the first and second instruments 8106 , 8108 are arranged within the body, the second tracking device 8210 is configured to transmit a third signal 8212 to the controller 8002 that includes sensed data associated with the first instrument 8106 , the second instrument 8108 , or the first set of instruments. That is, the second tracking device 8210 is configured to sense, or otherwise track, the first instrument 8106 , the second instrument 8108 , or both (e.g., the first set of instruments), as such instrument(s) is/are inserted into and moved within the body with or relative to the first multi-port device 8100 .
- the third signal 8212 or an additional signal can include sensed data associated with the first multi-port device 8100 .
- the second tracking device 8210 is also configured to transmit a fourth signal 8214 to the controller 8002 that includes sensed data associated with the second set of instruments and/or the second multi-port device 8200 itself.
- the controller 8002 can calculate location, position, or motion of the first instrument 8106 , the second instrument 8108 , or both, relative to the second set of instruments and/or the second multi-port device 8200 itself. This also creates one or more additional interrelationships between the first and second sets of instruments, and as a result, at least a portion of the first and second sets of instruments can work cooperatively together at one or more surgical sites and/or to carry out at least one surgical step of a surgical procedure.
- the tracking mechanism of the first and second tracking devices 8110 , 8210 can be any suitable mechanism.
- the first tracking device 8110 can be configured to use magnetic sensing to detect a location, an orientation, or a motion of the third instrument 8206 , the fourth instrument 8208 , or both relative to the first multi-port device 8100 and/or to determine a location of the second multi-port device 8200 relative to the first multi-port device 8100 .
- the third instrument 8206 , the fourth instrument 8208 , or both and/or the second multi-port device 8200 includes a respective magnetic fiducial marker (not shown) that is configured to emit a respective magnetic field that can be detected by the first tracking device 8110 .
- the second tracking device 8210 can be configured to use a similar magnetic sensing mechanism to detect a location, an orientation, or a motion of at least one of the first and second instruments 8106 , 8108 relative to the second multi-port device 8200 and/or to determine a location of the first multi-port device 8100 relative to the second multi-port device 8200 .
- a magnetic tracking system is configured to output a defined directional field relative to the magnet, its orientation, and near-by metallic systems. When the magnet is a permanent magnet, the field is of a predefined intensity, size, and orientation.
- a magnetic sensor within the directional field is configured to sense from the intensity, direction of the magnet vectors, and change of those measures over time where the sensor is within the directional field and orientation of the sensor with respect to the magnet.
- the intensity and field direction can be alternated and changed as directed, which mitigates metal impacts on the field and interferences as well as increase accuracy.
- the first tracking device 8110 can be configured to use common anatomic landmarks to detect a location, an orientation, or a motion of the third instrument 8206 , the fourth instrument 8208 , or both relative to the first multi-port device 8100 and/or a location of the second multi-port device 8200 relative to the first multi-port device 8100 .
- the second tracking device 8210 can be configured to use common anatomic landmarks to detect a location, an orientation, or a motion of at least one of the first and second instruments 8106 , 8108 relative to the second multi-port device and/or a location of the first multi-port device 8100 relative to the second multi-port device 8200 .
- the use of physiologic landmarks, and the distances and focal aspects of these landmarks with respect to an imaging system enable the imaging system to use the same imaging and distance measurements to determine the location and orientation of the instruments with respect to the anatomic location. These “reference” points would enable the system to using imaging & pre-operative imaging to scale the measures allowing them to more accurately correct for focus or depth measures of the system.
- 3D imaging systems and/or Lidar imaging systems can both be used to enhance or replace the optical measurements with respect to the surgical sites.
- a structured light scan can be used to create a 3D map.
- Electromagnetic tracking of the first multi-port device 8100 , the second multi-port device 8200 and the instruments 8106 , 8108 , 8206 , 8208 e.g., using one or more fiducial markers
- a perimeter can then be created around a critical structure using manual line or guides by confocal laser endomicroscopy to provide real time histology guidance.
- a line as registered in space can be communicated to the first multi-port device 8100 and the first and second instruments 8106 , 8108 located in a different quadrant of an abdominal cavity than the second multi-port device 8200 and third and fourth instruments 8206 , 8208 , for mobilizing the colon 10 between the quadrants.
- a line as registered in space can be communicated to the second multi-port device 8200 and the third and fourth instruments 8206 , 8208 for mobilizing the colon 10 between the quadrants.
- the physical mechanical linkage angles between robotic arms holding the surgical instruments and their predefined lengths can be used to enhance a visual system's calculation of depth and focal distance between surgical instruments and a surgical site.
- the system can achieve triangulation of the instruments within a patient in order to “calibrate” or compensate for optical losses by the imaging system.
- the first tracking device 8110 can be an optical sensor that can be configured to detect a fiducial marker on the third instrument, the fourth instrument, and/or the second multi-port device.
- the second tracking device can be an optical sensor that is configured to detect a fiducial marker on the first instrument, the second instrument, and/or the first multi-port device. Any number of multi-ports and/or surgical instruments can be tracked in this way during performance of a surgical procedure.
- controlling cooperative surgical instrument interactions includes using smart device location cooperatively with scope tracking.
- a non-magnetic sensing system can be used for 3D tracking to provide X, Y, Z coordinates using a single receiver and at least one emitter.
- a time-of-flight distance sensor system discussed above, may thus be used.
- the non-magnetic sensing system can include ultrasonic sensor technology and radiofrequency (RF) sensor technology.
- a time of flight system can include an emitter and a receiver.
- the emitter includes an ultrasonic sensor (ultrasonic beacon) configured to transmit ultrasonic pulses
- the receiver includes an RF receiver configured to transmit an RF signal that commands the emitter to begin transmitting the ultrasonic pulses.
- the ultrasonic pulses are reflected back by object(s) within their range.
- the RF receiver is configured to record the ultrasonic pulses and to, based on the recorded ultrasonic pulses, calculate 3D coordinates (X, Y, Z) of the emitter.
- the sound propagation time of the ultrasonic pulses allows the RF receiver to calculate the 3D coordinates and to calculate distance to objects.
- FIG. 28 illustrates a schematic view of the surgical system 8000 being used during a colon resection procedure.
- the first tracking device 8110 of the first multi-port device 8100 can track the third instrument 8206 , the fourth instrument 8208 , or both
- the second tracking device 8210 of the second multi-port device 8200 can track the location of first instrument 8106 , the second instrument 8108 , or both, while the instruments are inserted into their respective port devices and arranged within the body.
- first and second instruments 8106 , 8108 can include first and second graspers 8107 , 8109 , respectively, and third and fourth instruments 8206 , 8208 can include third and fourth graspers 8207 , 8209 , respectively, to grasp the colon 10 and the mobilized section 12 thereof and help reattach the mobilized section 12 to the rectum 14 .
- the first and second instruments 8106 , 8108 passing through the first multi-port device 8100 are arranged in the upper left quadrant of the abdominal cavity to mobilize the transverse and descending colon 10 .
- the third and fourth instruments 8206 , 8208 passing through the second multi-port device 8200 are arranged in the lower left quadrant of the abdominal cavity to mobilize and create an incision along line IL to remove a tumor in the descending colon or sigmoid.
- Each set of instruments is accessing the abdominal cavity together through respective multi-port devices 8100 , 8200 , which allow for interrelating the instrument motions for each multi-port within its own quadrant.
- the first and second instruments 8106 , 8108 have a first range of motion shown as dashed line RA
- the third and fourth instruments 8206 , 8208 have a second range of motion shown as dashed line RB.
- the instruments 8106 , 8108 , 8206 , 8208 can interact during the handoff of the mobilization and retraction of the mobilized section 12 of the colon 10 transiting from the upper left quadrant to the lower right quadrant.
- the first tracking device 8110 transmits the first and second signals 8112 , 8114 to the controller 8002 and/or the second tracking device 8210 transmits the third and fourth signals 8212 , 8214 to the controller 8002 .
- the resulting interrelationship between the first and second multi-port devices 8100 , 8200 enables triangulation and opposed motion of the instruments 8106 , 8108 , 8206 , 8208 within their respective quadrant, as well as coordinated movement amongst at least a portion of the first and second set of instruments.
- the first and second sets of instruments work cooperatively together to interface with each other to control and/or stabilize the colon, or a portion thereof and/or to move the free end 15 toward the rectum for attachment. More specifically, as shown in FIG. 28 , the second instrument 8108 and the fourth instrument 8208 are purchasing the same area of the colon 10 , and the third instrument 8206 is ready to grasp the free end 15 of the colon 10 from the first instrument 8106 to move the free end 15 towards the rectum 14 .
- any one or more of the exemplary surgical systems, port devices and related methods described herein, and variations thereof, can be implemented in conventional surgical procedures conducted by a medical professional as well as in robotic-assisted surgical procedures.
- Various teachings herein may be readily incorporated into a robotic surgical system such as one or more of the DAVINCITM systems by Intuitive Surgical, Inc., of Sunnyvale, Calif., including their SPTM surgical system.
- Exemplary robotic surgical systems and related features, which may be combined with any one or more of the exemplary surgical access devices and methods disclosed herein, are disclosed in the following: U.S. Pat. No. 8,068,649, entitled “Method and Apparatus for Transforming Coordinate Systems in a Telemanipulation System,” issued Nov.
- surgical sealing systems are provided that generally include a sealing device having a seal housing with ports for receiving surgical instruments.
- the ports of the seal housing are designed to control or limit the motions of at least one instrument inserted through a respective port such that the instrument can stabilize another instrument inserted through a respective other port.
- Each of the ports can have a nominal size and shape and each can be configured to assume a selected size and/or shape that is different from the nominal size and/or shape.
- a nominal size and a nominal shape refer to a size and shape of a port without a force applied thereto.
- a selected size and a selected shape of a port refers to a size and shape of a port when a force is applied to the port, such as by an instrument being inserted therethrough. It will be further understood by a person skilled in the art that the selected size and the selected shape will depend on the amount of force and the direction of force applied to the port, such as by the instrument.
- each port can be constrained by the size and shape of each of the other plurality of ports.
- forces applied to one port can affect the size and shape of the other ports.
- the force can be applied by an instrument that is disposed within one port of the plurality of ports.
- the force applied thereto is therefore effective to change the size and/or shape of the ports based on the movement, direction, and force of the instrument. Since the ability to alter to the nominal shape of any one port is therefore constrained or limited by the size and/or shape of the other ports, a force applied to one instrument positioned within one of the plurality of ports is configured to stabilize at least one other instrument positioned within others of the plurality of ports.
- FIG. 29 and FIG. 30 illustrate a surgical sealing device 9000 that includes a seal housing 9002 with a predetermined size and shape and ports 9008 , 9010 , 9012 , 9014 extending therethrough before any external force is applied to the ports.
- the seal housing 9002 is illustrated in its predetermined size and shape.
- the seal housing 9002 can have a variety of configurations.
- the seal housing 9002 has an inner body member 9004 and an outer body member 9005 that is positioned about the inner body member 9004 .
- the inner body member 9004 can be flexible relative to the outer body member 9005 or vice versa.
- the outer body member 9005 can be rigid relative to the inner body member 9004 or vice versa.
- the inner body member and the outer body member are formed of the same material.
- ports 9008 , 9010 , 9012 , 9014 extend through sealing housing 9002 .
- the ports can be formed in any suitable portion(s) of the seal housing 9002 .
- all the ports 9008 , 9010 , 9012 , 9014 extend through the inner body member 9004 of the seal housing 9002 .
- the ports 9008 , 9010 , 9012 , 9014 can be movable with respect to the seal housing 9002 and each other, as discussed in more detail below.
- Such a configuration can help prevent interference between surgical instruments inserted through the various ports 9008 , 9010 , 9012 , 9014 and can facilitate instrument positioning in a body cavity to which the surgical sealing device 9000 provides access thereto.
- the sealing device 9000 can include a retractor 9006 that couples to and extends from a distal end 9002 d of the seal housing 9002 .
- the retractor 9006 can be configured to be placed in any opening within a patient's body, whether a natural body orifice or an opening made by an incision.
- the retractor 9006 can function as a support structure for the seal housing 9002 and form a pathway through the opening in a patient's body so that surgical instruments can be inserted through the ports 9008 , 9010 , 9012 , 9014 and into the interior body cavity or natural body lumen of the patient.
- the retractor can additionally function as a retention element that is configured to affix the seal housing to tissue.
- a separate retention element 9007 can be used arranged on the exterior surface of retractor 9006 , as shown in FIG. 29 , and/or the exterior surface of the seal housing 9100 .
- the ports 9008 , 9010 , 9012 , 9014 can be configured to form a seal around a surgical instrument inserted therethrough.
- at least one or more of the ports can include a sealing element, which can be positioned within the channel of the respective port.
- a sealing element can include at least one instrument seal and/or at least one channel seal, and can generally be configured to contact an instrument inserted through the sealing element's associated sealing port.
- the port 9012 can include a sealing element 9021 arranged within the channel 9013 of the port 9012
- the port 9014 can include a sealing element 9023 arranged within the channel 9015 of the port 9014 .
- one or more of the other ports can include a sealing element (e.g., sealing element(s) structurally similarly to sealing elements 9021 , 9023 ).
- the sealing element(s) can be in the form of a thin membrane formed of a flexible material which can be punctured or otherwise pierced by a surgical instrument.
- zero closure sealing elements such as a duck bill seal or other suitable seals for sealing in the absence of instrument can be used in association with the ports.
- the sealing elements can be positioned at any suitable location within the port.
- the surgical sealing device 9000 can also include an insufflation port 9016 supported by the seal housing 9002 , although a person skilled in the art will appreciate that the insufflation port 9016 can be located in other locations. A person skilled in the art will also appreciate that the insufflation port 9016 can have a variety of configurations. Generally, the insufflation port 9016 can be configured to pass an insufflation fluid into and/or out of a body cavity to which the surgical sealing device 9000 provides access to.
- FIG. 31 and FIG. 32 are schematic bottom views of the surgical sealing device 9000 with the retractor 9006 and the sealing elements 9021 , 9023 removed.
- the ports 9008 , 9010 , 9012 , 9014 can have any combination of sizes and shapes.
- the port 9008 can have a diameter D 1
- port 9010 can have a diameter D 2
- ports 9012 , 9014 can have a diameter D 3 .
- the insufflation port opening 9016 can have any diameter D 4 .
- the diameter D 3 of the ports 9012 , 9014 can define a diameter of an orbital path of instruments arranged within the ports 9012 , 9014 .
- the port can adjust from a nominal size and shape to a selected size and shape based on the movement, direction, and force of the instrument.
- the ports 9012 , 9014 can include a nominal shape 9018 , 9020 , respectively.
- the nominal shape 9018 , 9020 of the ports 9012 , 9014 is the size and shape of the ports when no instrument is arranged therein and applying a force to the ports.
- the port 9008 has a nominal size and shape 9009 when no instrument is arranged therein.
- the seal housing 9100 can have a diameter D 5 , which can be fixed or adjustable.
- Each of the plurality of ports 9012 , 9014 has a nominal size and shape 9018 , 9020 and diameter D 3 , and each is configured to assume a selected size and/or shape 9018 ′, 9020 ′ that is different from the nominal size and shape 9018 , 9020 , wherein the selected size and/or shape 9018 ′, 9020 ′ of each port is constrained by the size and shape of each of the other plurality of ports. Additionally, the altered diameter D 3 ′ of the ports 9012 , 9014 can further limit the planes in which an instrument can move. For example, as shown in FIG.
- the ports 9012 , 9014 have become narrower and oval shape, limiting an instrument within the ports to only be moveable in plane parallel to the diameter D 3 ′ of each port 9012 , 9014 . Since the limiting planes for ports 9012 , 9014 are non-parallel, the instruments within the ports 9012 , 9014 can be used to stabilize a third instrument within the port 9010 .
- An example of how the ports 9008 , 9012 , 9014 are altered from their nominal size and shapes 9009 , 9018 , 9020 to their selected size and shapes 9009 ′, 9018 ′, 9020 ′ is as follows.
- An instrument (not shown) is inserted into each respective port 9008 , 9010 , 9012 , 9014 parallel to the Y-axis.
- the port 9008 changes from a nominal size and shape 9009 to a selected size and shape 9009 ′ as a result of the instrument applying a force to the port 9008 , causing the port 9008 react and change to an elongated shape along the X-axis.
- the instrument in the port 9012 can be moved along the Z-axis. However, due to the port 9008 already being elongated along the X-axis, the port 9012 will change from the nominal size and shape 9018 to the selected size and shape 9018 ′. As illustrated in FIG. 32 , the port 9012 becomes elongated at an approximately 45 ° angle from the Z-axis, which was the intended axis of travel for the instrument. If the port 9008 was not in the selected size and shape 9009 ′, then the selected size and shape of the port 9012 can be parallel to the Z-axis since the port 9008 would not be blocking the movement of the port 9012 .
- the port 9014 operates similarly to the port 9012 where the intended direction of an instrument within the port 9014 is parallel to the Z-axis. However, similar to the port 9012 , the selected size and shape 9020 ′ of the port 9014 is limited by the selected size and shape 9009 ′ of the port 9008 . This forces the port 9014 to elongate at approximately a 135 ° angle relative to the Z-axis when moving from the nominal size and shape 9020 to the selected size and shape 9020 ′.
- the selected size and shape 9018 ′ of the port 9012 was instead parallel to the X-axis, and the selected size and shape 9009 ′ of the port 9008 remained parallel to the X-axis, then the selected size and shape of the port 9014 would be limited to moving only in the +Z axis and the +X-axis since the ⁇ Z axis would be blocked by the port 9008 and the ⁇ X-axis would be blocked by the port 9012 .
- the sealing device can include restraining elements that can further control some but not all the movements and forces of the instruments inserted into the sealing device.
- port 9010 can includes a rigid structure 9011 encapsulated by the inner body member 9004 .
- one or more ports can include rigid restraining elements while one or more other ports can include flexible restraining elements that allows some movement in predefined directions of the ports with respect to each other while preventing other movements.
- the seal housing includes restraining features positioned in at least some directions tangential to the ports to substantially prevent stretching or movement of one port relative to another. This can be done in multiple planes for the same port or in selective directions to allow the port to float in other directions to improve maintenance of the seal around the instrument being inserted through the sealing device.
- one of the inserted instruments within one of the ports of the seal housing can function as a central anchoring tool.
- the central anchoring tool can be a designated instrument within one of the ports of the seal housing which supports the remaining instruments passing through other ports within the seal housing.
- the central anchoring tool can be an instrument that does not interact with tissue directly, such as a camera or scope device passing through a port.
- the central anchoring tool can be an instrument (e.g., graspers, electrosurgical tool, etc.) that interacts with the tissue so that the additional instruments can be manipulated and supported without altering the anchor point of the seal housing.
- FIG. 33 illustrates an exemplary central anchor tool 9017 inserted into port 9014 of sealing device 9000 .
- At least one of the ports can include a threaded restraint arranged within a respective port, for example, as illustrated in FIG. 34 .
- sealing device 9200 can be similar to sealing device 9000 ( FIG. 29 ) and therefore common features are not described in detail herein. As shown a first threaded restraint 9202 is configured to be arranged in a first port 9204 and a second threaded restraint 9206 is configured to be arranged in second port 9208 .
- Each threaded restraint 9202 , 9206 is configured to fixate an instrument arranged within each respective port 9204 , 9208 to the seal housing 9209 and each of the threaded restraints 9202 , 9206 is configured to contact the outer surface of the instrument. While the threaded restraints 9202 , 9206 can have a variety of configurations, in this illustrated embodiment, each of the first and second threaded restraints 9202 , 9206 includes a generally cylindrical body 9210 , 9212 with threads 9214 , 9216 on its outer surface 9218 , 9219 . The threads 9214 , 9216 are configured to threadably engage corresponding threads 9220 , 9222 on each respective first and second ports 9204 , 9208 .
- the respective first or second threaded restraint 9202 , 9206 also rotates, thereby tightening the respective first or second threaded restraint 9202 , 9206 relative to the seal housing 9209 .
- the range of motion available to the inserted instrument decreases.
- the instrument is fixated to the seal housing 9209 . While fixated, the instrument can serve as an anchor for the other instruments within the other ports 9204 , 9208 of the seal housing 9209 .
- the sealing systems can include integrated mechanism or electronic activated restriction systems to provide selective support or floating (e.g., moving) operation.
- a fluidic coupling cylinder with a selectively sizeable valve can be employed on or in the seal housing to inhibit motion.
- a solenoid valve can be used to inhibit circular fluid motion.
- the ports can be configured to change shape and size in response to an external energy being applied to the ports.
- each of the plurality of ports 9012 , 9014 can be formed of a ferromagnetic material that is configured to be structurally altered in response to exposure to an electromagnet.
- the electromagnet can apply a magnetic flux to the ports 9012 , 9014 to cause the ports 9012 , 9014 to alter their at least their shape compared to their shape when the electromagnet is switched off.
- any one or more of the exemplary surgical sealing systems, devices and related methods described herein, and variations thereof, can be implemented in conventional surgical procedures conducted by a medical professional as well as in robotic-assisted surgical procedures.
- Various teachings herein may be readily incorporated into a robotic surgical system such as one or more of the DAVINCITM systems by Intuitive Surgical, Inc., of Sunnyvale, Calif., including their SPTM surgical system.
- Exemplary robotic surgical systems and related features, which may be combined with any one or more of the exemplary surgical access devices and methods disclosed herein, are disclosed in the following: U.S. Pat. No. 8,068,649, entitled “Method and Apparatus for Transforming Coordinate Systems in a Telemanipulation System,” issued Nov.
- FIG. 35 illustrates an exemplary embodiment of two robotic arms 9300 , 9302 , each having a surgical instrument 9304 , 9306 attached thereto.
- the robotic arms 9300 , 9302 can be wirelessly coupled to a control system 9308 having a console, with a display 9310 , a controller 9312 , and a user input device 9314 .
- seal housing 9316 is partially inserted into a patient's body 9318
- each surgical instrument 9304 , 9306 is inserted into a respective port 9320 , 9322 of the seal housing 9316 .
- the robotic arm(s) 9300 , 9302 can be configured to create a compression loading around the ports to the prevent motion of the surgical instruments 9304 , 9306 .
- the controller 9312 is configured to receive a force reading from at least one of the plurality of ports 9008 , 9010 , 9012 , 9014 (see FIG. 32 ) based on the movement, direction, and force of an instrument.
- a force sensor (not shown) can be arranged on each robotic arm 9300 , 9302 such that the force applied by each arm can be measured and sent to the controller 9312 .
- the controller 9312 can determine a selected size and shape 9018 ′, 9020 ′ of ports 9012 , 9014 (see FIG. 32 ) based on the amount of force the inserted instruments 9304 , 9306 is applying to such ports 9012 , 9014 .
- the robotic arm(s) 9300 , 9302 can be moved by the user in such a way that can alter the size and shape of the ports 9012 , 9014 to stabilize at least one other instrument (not shown) positioned within at least one of the other ports 9008 , 9010 .
- a tool driver restraint of a trocar access port can be used in combination with the surgical sealing device 9000 .
- the trocar access port can be used to limit the force applied to an instrument shaft, allowing for a robotic arm to control the forces.
- the robotic arm restraint of the trocar access port can be used to allow the tool driver restraint to provide a stabilizing force to the surgical sealing device 9000 , and not instruments inserted through the ports.
- the diameter of the trocar access port is the key rigidity factor, rather than the diameter D 5 of the surgical sealing device 9000 .
- a cannula from which multiple instruments are deployed from does not have a static end lumen. Instead, the cannula is segmented into two or more curved members. The curved members can be driven to different depths within tissue to provide for a local force reaction to the instrument that is against that respective cannula segment.
- one of the ports can further include a locking arm configured to lock a position of the at least one port relative to the seal housing.
- FIG. 36 illustrates an exemplary embodiment of a seal housing 9402 having a slot 9403 arranged therein such that a locking arm 9404 can pass through the slot 9403 and into the seal housing 9402 .
- the locking arm 9404 include locking tabs 9406 , which are configured to be selectively depressed to allow the locking arm 9405 to move relative to the seal housing 9402 .
- a port 9412 Arranged at a distal end of the locking arm 9404 is a port 9412 , with an instrument 9410 arranged within the port 9412 .
- a locking arm can include a base member having a plurality of rotatable rings.
- a top rotatable ring can contain a flexible sealing member, and one or more other rotatable rings each can have sealing arms extending therefrom and can be stacked one on top of the other beneath the sealing member.
- Each ring can be individually rotatable relative to the other rings and relative to the sealing member.
- Each of the sealing arms can include a sealing element positioned at one end thereof and configured to form a seal around an instrument inserted therethrough.
- FIG. 37 and FIG. 38 illustrate an exemplary embodiment of a locking seal 9500 arranged within at least one port 9502 of a seal housing 9504 .
- the locking seal 9500 can be in the form of a honeycomb locking structure which interacts with an instrument 9510 passing therethrough.
- the shape of the locking seal 9500 can be adjusted through the application of external energy, such as heat, light, or electrical current.
- the locking seal 9500 can deform into a first portion 9506 and a second portion 9508 . When deformed, the second portion 9508 can contact the instrument 9510 so that the instrument 9510 is locked in position to the seal housing 9504 .
- a surgical sealing device can further include changeable ports as restraining means to control some, but not all movements and forces of instruments inserted therethrough the ports of the surgical sealing device.
- the ports of the surgical sealing device can include sections that are formed from 4D printed material and then over molded into an elastomer section of a seal with a port.
- 4D printing is an additive manufacturing process through which a 3D printed object includes transformable components (e.g., hydrogel, shape memory polymer) such that the 3D printed object transforms itself into another structure over the influence of external energy input as temperature, light or other environmental stimuli.
- 4D printing is similar to 3D printing in the sense that an object is also built layer by layer, but the object can then change over time after its initial manufacture. The object will change because it is printed with materials that have the ability to change when exposed to certain factors: such as heat, magnetic, water, light or another source of energy.
- the ports including a 4D printed material initially can be in a flexible condition to allow for introduction and manipulation of instruments through the ports.
- the surgical sealing device can have an external energy applied thereto to alter the structure of the 4D printed material thus changing the geometry of the seal interface with respect to the instrument and/or lock to the seal itself.
- the 4D printed material can interlock all the ports of a surgical sealing device and instruments inserted therein to create rigid restraints allowing some movement of the instruments in predefined directions with respect to each other while preventing some movements of the instruments in other directions. The prevention of movement in some directions allows for an instrument interacting with the 4D printed material to stabilize the other instruments within the surgical sealing device.
- a honeycomb structure can be formed of 4D printed material and integrated with the pivotal seals within each of the ports of the surgical sealing device.
- the honeycomb structure can be in a triangular or hexagonal pattern that allows an instrument shaft to freely pass through the seal.
- the honeycomb structure alters its form for to make contact with the instrument shaft. Contact is made by the triangular or hexagonal honeycomb bending inward towards the instrument shaft, compressing the honeycomb structure and/or seal material against the shaft.
- the surgical sealing device can include a 3 D printed housing support structure having an elastomer structural member.
- the elastomer structural member can be pneumatically actuated between a fix and no fixed state in order to fixate instrument inserted through the ports of the surgical sealing system.
- the surgical devices disclosed herein can be designed to be disposed of after a single use, or they can be designed to be used multiple times. In either case, however, the surgical devices can be reconditioned for reuse after at least one use. Reconditioning can include any combination of the steps of disassembly of the surgical devices, followed by cleaning or replacement of particular pieces and subsequent reassembly.
- the surgical devices can be disassembled, and any number of the particular pieces or parts of the surgical devices can be selectively replaced or removed in any combination.
- the surgical devices can be reassembled for subsequent use either at a reconditioning facility, or by a surgical team immediately prior to a surgical procedure.
- reconditioning of a surgical device can utilize a variety of techniques for disassembly, cleaning/replacement, and reassembly. Use of such techniques, and the resulting reconditioned instrument, are all within the scope of the present application.
- like-named components of the embodiments generally have similar features, and thus within a particular embodiment each feature of each like-named component is not necessarily fully elaborated upon.
- linear or circular dimensions are used in the description of the disclosed systems, devices, and methods, such dimensions are not intended to limit the types of shapes that can be used in conjunction with such systems, devices, and methods.
- a person skilled in the art will recognize that an equivalent to such linear and circular dimensions can easily be determined for any geometric shape. Sizes and shapes of the systems and devices, and the components thereof, can depend at least on the anatomy of the subject in which the systems and devices will be used, the size and shape of components with which the systems and devices will be used, and the methods and procedures in which the systems and devices will be used.
- proximal and distal are used herein with reference to a user, such as a clinician, gripping a handle of an instrument. It will be appreciated that the terms “proximal” and “distal” are used herein, respectively, with reference to the top end (e.g., the end that is farthest away from the surgical site during use) and the bottom end (e.g., the end that is closest to the surgical site during use) of a surgical instrument, respectively, that is configured to be mounted to a robot. Other spatial terms such as “front” and “rear” similarly correspond respectively to distal and proximal. It will be further appreciated that for convenience and clarity, spatial terms such as “vertical” and “horizontal” are used herein with respect to the drawings. However, surgical instruments are used in many orientations and positions, and these spatial terms are not intended to be limiting and absolute.
- Values or ranges may be expressed herein as “about” and/or from/of “about” one particular value to another particular value. When such values or ranges are expressed, other embodiments disclosed include the specific value recited and/or from/of the one particular value to another particular value. Similarly, when values are expressed as approximations, by the use of antecedent “about,” it will be understood that here are a number of values disclosed therein, and that the particular value forms another embodiment. It will be further understood that there are a number of values disclosed therein, and that each value is also herein disclosed as “about” that particular value in addition to the value itself. In embodiments, “about” can be used to mean, for example, within 10% of the recited value, within 5% of the recited value or within 2% of the recited value.
- the term “substantially” is utilized herein to represent the inherent degree of uncertainty that may be attributed to any quantitative comparison, value, measurement, or other representation.
- the term “substantially” is also utilized herein to represent the degree by which a quantitative representation may vary from a stated reference without resulting in a change in the basic function of the subject matter at issue.
Abstract
Surgical sealing ports for use with surgical instruments for access of a natural body orifice are provided. In one exemplary embodiment, a surgical sealing port includes a seal housing and at least one retention element. The seal housing is configured to be at least partially disposed within a natural body orifice and defining a plurality of ports. The plurality of ports includes at least one first port configured to control the ingress and egress of fluid between an interior volume of the natural body orifice and an ambient environment, and at least one second port that is configured to form a seal around an instrument inserted therethrough. The at least one retention element is arranged on an exterior surface of the housing and configured to affix the housing to the natural body orifice. Methods for using the same are also provided.
Description
- This application claims priority to U.S. Provisional Patent Application No. 63/249,980 filed on Sep. 29, 2021, and entitled “Cooperative Access,” the disclosure of which is incorporated herein by reference in its entirety.
- The present invention relates generally to surgical devices, systems, and methods of using the same for sealing, instrument control, instrument stabilization, etc.
- Surgical systems often incorporate an imaging system, which can allow medical practitioners to view a surgical site and/or one or more portions thereof on one or more displays, e.g., a monitor, a computer tablet screen, etc. The display(s) can be local and/or remote to a surgical theater. The imaging system can include a scope with a camera that views the surgical site and transmits the view to the one or more displays viewable by medical practitioner(s).
- Imaging systems can be limited by the information that they are able to recognize and/or convey to the medical practitioner(s). For example, certain concealed structures, physical contours, and/or dimensions within a three-dimensional space may be unrecognizable intraoperatively by certain imaging systems. For another example, certain imaging systems may be incapable of communicating and/or conveying certain information to the medical practitioner(s) intraoperatively.
- Accordingly, there remains a need for improved surgical imaging.
- Surgical sealing devices are provided. In one exemplary embodiment, a surgical sealing device includes a seal housing and at least one retention element. The seal housing is configured to be at least partially disposed within a natural body orifice and defining a plurality of ports.
- The plurality of ports includes at least one first port configured to control the ingress and egress of fluid between an interior volume of the natural body orifice and an ambient environment, and at least one second port that is configured to form a seal around an instrument inserted therethrough. The at least one retention element is arranged on an exterior surface of the housing and configured to affix the housing to the natural body orifice.
- In some embodiments, the at least one first port can be operatively connected to a valve arranged outside of the seal housing.
- In some embodiments, the valve can have at least one monitored parameter that can be used to control a fluid transfer rate through the at least one first port. In some embodiments, the at least one monitored parameter can be a fluid transfer pressure and/or volume and a direction of the fluid transfer.
- The at least one retention element can have a variety of configurations. In some embodiments, the at least one retention element can be deployable inside of the natural body lumen. In other embodiments, the at least one retention element can be deployable outside of the natural body lumen. In some embodiments, the at least one retention element can be a barb extending from the exterior surface of the housing. In other embodiments, the at least one retention element can be a balloon that can be configured to be selectively inflated to contact an internal or an external surface of the natural body orifice and secure the housing thereto.
- In some embodiments, the fluid can include at least one gas or at least one liquid. In other embodiments, the fluid can include at least one gas and at least one liquid.
- In some embodiments, a control system can be configured to control the ingress and egress of fluid to create a pressure differential between the interior volume of the natural body orifice and the ambient environment.
- In some embodiments, the ports of the surgical sealing device can be bi-directional.
- Methods of accessing a natural body lumen are also provided. In one exemplary embodiment, a method includes positioning a surgical sealing device at least partially within the natural body orifice, in which the surgical sealing device has a seal housing defining a plurality of ports, releasably positioning at least one retention element configured to affix the seal housing to the natural body orifice, controlling the ingress and egress of a fluid between an interior volume of the natural body orifice and an ambient environment through at least one first port, and passing at least one surgical instrument through at least one second port such that the at least one second port forms a seal around the at least one surgical instrument. The surgical sealing device defines at least one passageway through the natural body orifice.
- In some embodiments, the method can include removing the at least one surgical instrument from the at least one second port without removing the seal housing from the natural body lumen.
- In some embodiments, the at least one first port can be operatively connected to a valve arranged outside of the seal housing. In such embodiments, the valve can have at least one monitored parameter which can be used to control a fluid transfer rate through the at least one first port. In such embodiments, the at least one monitored parameter can be a fluid transfer pressure and/or volume and a direction of the fluid transfer.
- The at least one retention element can have a variety of configurations. For example, in some embodiments, the at least one retention element can be deployable inside of the natural body lumen. In other embodiments, the at least one retention element can be deployable outside of the natural body lumen.
- In some embodiments, the fluid can include a dye. In certain embodiments, the fluid can include at least one gas or at least one liquid. In other embodiments, the fluid can include at least one gas and at least one liquid.
- The present invention is described by way of reference to the accompanying figures which are as follows:
-
FIG. 1 is a schematic view of one embodiment of a surgical visualization system; -
FIG. 2 is a schematic view of triangularization between a surgical device, an imaging device, and a critical structure ofFIG. 1 ; -
FIG. 3 is a schematic view of another embodiment of a surgical visualization system; -
FIG. 4 is a schematic view of one embodiment of a control system for a surgical visualization system; -
FIG. 5 is a schematic view of one embodiment of a control circuit of a control system for a surgical visualization system; -
FIG. 6 is a schematic view of one embodiment of a combinational logic circuit of a surgical visualization system; -
FIG. 7 is a schematic view of one embodiment of a sequential logic circuit of a surgical visualization system; -
FIG. 8 is a schematic view of yet another embodiment of a surgical visualization system; -
FIG. 9 is a schematic view of another embodiment of a control system for a surgical visualization system; -
FIG. 10 is a graph showing wavelength versus absorption coefficient for various biological materials; -
FIG. 11 is a schematic view of one embodiment of a spectral emitter visualizing a surgical site; -
FIG. 12 is a graph depicting illustrative hyperspectral identifying signatures to differentiate a ureter from obscurants; -
FIG. 13 is a graph depicting illustrative hyperspectral identifying signatures to differentiate an artery from obscurants; -
FIG. 14 is a graph depicting illustrative hyperspectral identifying signatures to differentiate a nerve from obscurants; -
FIG. 15 is a schematic view of one embodiment of a near infrared (NIR) time-of-flight measurement system being utilized intraoperatively; -
FIG. 16 shows a time-of-flight timing diagram for the system ofFIG. 15 ; -
FIG. 17 is a schematic view of another embodiment of a near infrared (NIR) time-of-flight measurement system being utilized intraoperatively; -
FIG. 18 is a schematic view of one embodiment of a computer-implemented interactive surgical system; -
FIG. 19 is a schematic view of one embodiment a surgical system being used to perform a surgical procedure in an operating room; -
FIG. 20 is a schematic view of one embodiment of a surgical system including a smart surgical instrument and a surgical hub; -
FIG. 21 is a flowchart showing a method of controlling the smart surgical instrument ofFIG. 20 ; -
FIG. 22 is a schematic view of an exemplary embodiment of a surgical sealing device; -
FIG. 23 is a cross-sectional view of the surgical sealing device ofFIG. 22 ; -
FIG. 24 is a cross-sectional view of another exemplary embodiment of a surgical sealing device; -
FIG. 25 is a cross-sectional view of another exemplary embodiment of a surgical sealing device, showing the device inserted into a natural body orifice; -
FIG. 26 is an exemplary image of a colon; -
FIG. 27 is a schematic view of an exemplary embodiment of a surgical system having first and second multi-port devices; -
FIG. 28 is a schematic view of the surgical system ofFIG. 27 , showing the first and second multi-port devices partially inserted within an abdominal cavity; -
FIG. 29 is a schematic view of an exemplary embodiment of a surgical sealing system having a sealing device with ports extending therethrough; -
FIG. 30 is a top view of the sealing device ofFIG. 29 ; -
FIG. 31 is a schematic view of the ports of the surgical sealing port ofFIG. 29 ; -
FIG. 32 is a schematic view of the altered ports of the surgical sealing port ofFIG. 31 ; -
FIG. 33 is the sealing device ofFIG. 29 , showing an instrument inserted into one port of the sealing device; -
FIG. 34 is a schematic view of an exemplary embodiment of a surgical sealing system having threaded restraints; -
FIG. 35 is a schematic of an exemplary embodiment of a surgical robotic system that includes electomechanical arms each having a surgical instrument mounted thereto, and being wirelessly coupled to a control system; -
FIG. 36 is schematic view of an embodiment of a locking arm; and -
FIG. 37 is a schematic view of one embodiment of a locking structure prior to exposure to external energy; and -
FIG. 38 is the locking structure ofFIG. 37 after exposure to external energy. - Certain exemplary embodiments will now be described to provide an overall understanding of the principles of the structure, function, manufacture, and use of the devices, systems, and methods disclosed herein. One or more examples of these embodiments are illustrated in the accompanying drawings. A person skilled in the art will understand that the devices, systems, and methods specifically described herein and illustrated in the accompanying drawings are non-limiting exemplary embodiments and that the scope of the present invention is defined solely by the claims. The features illustrated or described in connection with one exemplary embodiment may be combined with the features of other embodiments. Such modifications and variations are intended to be included within the scope of the present invention.
- Further, in the present disclosure, like-named components of the embodiments generally have similar features, and thus within a particular embodiment each feature of each like-named component is not necessarily fully elaborated upon. Additionally, to the extent that linear or circular dimensions are used in the description of the disclosed systems, devices, and methods, such dimensions are not intended to limit the types of shapes that can be used in conjunction with such systems, devices, and methods. A person skilled in the art will recognize that an equivalent to such linear and circular dimensions can easily be determined for any geometric shape. A person skilled in the art will appreciate that a dimension may not be a precise value but nevertheless be considered to be at about that value due to any number of factors such as manufacturing tolerances and sensitivity of measurement equipment. Sizes and shapes of the systems and devices, and the components thereof, can depend at least on the size and shape of components with which the systems and devices will be used.
- Surgical Visualization
- In general, a surgical visualization system is configured to leverage “digital surgery” to obtain additional information about a patient's anatomy and/or a surgical procedure. The surgical visualization system is further configured to convey data to one or more medical practitioners in a helpful manner. Various aspects of the present disclosure provide improved visualization of the patient's anatomy and/or the surgical procedure, and/or use visualization to provide improved control of a surgical tool (also referred to herein as a “surgical device” or a “surgical instrument”).
- “Digital surgery” can embrace robotic systems, advanced imaging, advanced instrumentation, artificial intelligence, machine learning, data analytics for performance tracking and benchmarking, connectivity both inside and outside of the operating room (OR), and more. Although various surgical visualization systems described herein can be used in combination with a robotic surgical system, surgical visualization systems are not limited to use with a robotic surgical system. In certain instances, surgical visualization using a surgical visualization system can occur without robotics and/or with limited and/or optional robotic assistance. Similarly, digital surgery can occur without robotics and/or with limited and/or optional robotic assistance.
- In certain instances, a surgical system that incorporates a surgical visualization system may enable smart dissection in order to identify and avoid critical structures. Critical structures include anatomical structures such as a ureter, an artery such as a superior mesenteric artery, a vein such as a portal vein, a nerve such as a phrenic nerve, and/or a tumor, among other anatomical structures. In other instances, a critical structure can be a foreign structure in the anatomical field, such as a surgical device, a surgical fastener, a clip, a tack, a bougie, a band, a plate, and other foreign structures. Critical structures can be determined on a patient-by-patient and/or a procedure-by-procedure basis. Smart dissection technology may provide, for example, improved intraoperative guidance for dissection and/or may enable smarter decisions with critical anatomy detection and avoidance technology.
- A surgical system incorporating a surgical visualization system may enable smart anastomosis technologies that provide more consistent anastomoses at optimal location(s) with improved workflow. Cancer localization technologies may be improved with a surgical visualization platform. For example, cancer localization technologies can identify and track a cancer location, orientation, and its margins. In certain instances, the cancer localization technologies may compensate for movement of a surgical instrument, a patient, and/or the patient's anatomy during a surgical procedure in order to provide guidance back to the point of interest for medical practitioner(s).
- A surgical visualization system may provide improved tissue characterization and/or lymph node diagnostics and mapping. For example, tissue characterization technologies may characterize tissue type and health without the need for physical haptics, especially when dissecting and/or placing stapling devices within the tissue. Certain tissue characterization technologies may be utilized without ionizing radiation and/or contrast agents. With respect to lymph node diagnostics and mapping, a surgical visualization platform may, for example, preoperatively locate, map, and ideally diagnose the lymph system and/or lymph nodes involved in cancerous diagnosis and staging.
- During a surgical procedure, information available to a medical practitioner via the “naked eye” and/or an imaging system may provide an incomplete view of the surgical site. For example, certain structures, such as structures embedded or buried within an organ, can be at least partially concealed or hidden from view. Additionally, certain dimensions and/or relative distances can be difficult to ascertain with existing sensor systems and/or difficult for the “naked eye” to perceive. Moreover, certain structures can move pre-operatively (e.g., before a surgical procedure but after a preoperative scan) and/or intraoperatively. In such instances, the medical practitioner can be unable to accurately determine the location of a critical structure intraoperatively.
- When the position of a critical structure is uncertain and/or when the proximity between the critical structure and a surgical tool is unknown, a medical practitioner's decision-making process can be inhibited. For example, a medical practitioner may avoid certain areas in order to avoid inadvertent dissection of a critical structure; however, the avoided area may be unnecessarily large and/or at least partially misplaced. Due to uncertainty and/or overly/excessive exercises in caution, the medical practitioner may not access certain desired regions. For example, excess caution may cause a medical practitioner to leave a portion of a tumor and/or other undesirable tissue in an effort to avoid a critical structure even if the critical structure is not in the particular area and/or would not be negatively impacted by the medical practitioner working in that particular area. In certain instances, surgical results can be improved with increased knowledge and/or certainty, which can allow a surgeon to be more accurate and, in certain instances, less conservative/more aggressive with respect to particular anatomical areas.
- A surgical visualization system can allow for intraoperative identification and avoidance of critical structures. The surgical visualization system may thus enable enhanced intraoperative decision making and improved surgical outcomes. The surgical visualization system can provide advanced visualization capabilities beyond what a medical practitioner sees with the “naked eye” and/or beyond what an imaging system can recognize and/or convey to the medical practitioner. The surgical visualization system can augment and enhance what a medical practitioner is able to know prior to tissue treatment (e.g., dissection, etc.) and, thus, may improve outcomes in various instances. As a result, the medical practitioner can confidently maintain momentum throughout the surgical procedure knowing that the surgical visualization system is tracking a critical structure, which may be approached during dissection, for example. The surgical visualization system can provide an indication to the medical practitioner in sufficient time for the medical practitioner to pause and/or slow down the surgical procedure and evaluate the proximity to the critical structure to prevent inadvertent damage thereto. The surgical visualization system can provide an ideal, optimized, and/or customizable amount of information to the medical practitioner to allow the medical practitioner to move confidently and/or quickly through tissue while avoiding inadvertent damage to healthy tissue and/or critical structure(s) and, thus, to minimize the risk of harm resulting from the surgical procedure.
- Surgical visualization systems are described in detail below. In general, a surgical visualization system can include a first light emitter configured to emit a plurality of spectral waves, a second light emitter configured to emit a light pattern, and a receiver, or sensor, configured to detect visible light, molecular responses to the spectral waves (spectral imaging), and/or the light pattern. The surgical visualization system can also include an imaging system and a control circuit in signal communication with the receiver and the imaging system. Based on output from the receiver, the control circuit can determine a geometric surface map, e.g., three-dimensional surface topography, of the visible surfaces at the surgical site and a distance with respect to the surgical site, such as a distance to an at least partially concealed structure. The imaging system can convey the geometric surface map and the distance to a medical practitioner. In such instances, an augmented view of the surgical site provided to the medical practitioner can provide a representation of the concealed structure within the relevant context of the surgical site. For example, the imaging system can virtually augment the concealed structure on the geometric surface map of the concealing and/or obstructing tissue similar to a line drawn on the ground to indicate a utility line below the surface. Additionally or alternatively, the imaging system can convey the proximity of a surgical tool to the visible and obstructing tissue and/or to the at least partially concealed structure and/or a depth of the concealed structure below the visible surface of the obstructing tissue. For example, the visualization system can determine a distance with respect to the augmented line on the surface of the visible tissue and convey the distance to the imaging system.
- Throughout the present disclosure, any reference to “light,” unless specifically in reference to visible light, can include electromagnetic radiation (EMR) or photons in the visible and/or non-visible portions of the EMR wavelength spectrum. The visible spectrum, sometimes referred to as the optical spectrum or luminous spectrum, is that portion of the electromagnetic spectrum that is visible to (e.g., can be detected by) the human eye and may be referred to as “visible light” or simply “light.” A typical human eye will respond to wavelengths in air that are from about 380 nm to about 750 nm. The invisible spectrum (e.g., the non-luminous spectrum) is that portion of the electromagnetic spectrum that lies below and above the visible spectrum . The invisible spectrum is not detectable by the human eye. Wavelengths greater than about 750 nm are longer than the red visible spectrum, and they become invisible infrared (IR), microwave, and radio electromagnetic radiation. Wavelengths less than about 380 nm are shorter than the violet spectrum, and they become invisible ultraviolet, x-ray, and gamma ray electromagnetic radiation.
-
FIG. 1 illustrates one embodiment of asurgical visualization system 100. Thesurgical visualization system 100 is configured to create a visual representation of acritical structure 101 within an anatomical field. Thecritical structure 101 can include a single critical structure or a plurality of critical structures. As discussed herein, thecritical structure 101 can be any of a variety of structures, such as an anatomical structure, e.g., a ureter, an artery such as a superior mesenteric artery, a vein such as a portal vein, a nerve such as a phrenic nerve, a vessel, a tumor, or other anatomical structure, or a foreign structure, e.g., a surgical device, a surgical fastener, a surgical clip, a surgical tack, a bougie, a surgical band, a surgical plate, or other foreign structure. As discussed herein, thecritical structure 101 can be identified on a patient-by-patient and/or a procedure-by-procedure basis. Embodiments of critical structures and of identifying critical structures using a visualization system are further described in U.S. Pat. No. 10,792,034 entitled “Visualization Of Surgical Devices” issued Oct. 6, 2020, which is hereby incorporated by reference in its entirety. - In some instances, the
critical structure 101 can be embedded intissue 103. Thetissue 103 can be any of a variety of tissues, such as fat, connective tissue, adhesions, and/or organs. Stated differently, thecritical structure 101 may be positioned below asurface 105 of thetissue 103. In such instances, thetissue 103 conceals thecritical structure 101 from the medical practitioner's “naked eye” view. Thetissue 103 also obscures thecritical structure 101 from the view of animaging device 120 of thesurgical visualization system 100. Instead of being fully obscured, thecritical structure 101 can be partially obscured from the view of the medical practitioner and/or theimaging device 120. - The
surgical visualization system 100 can be used for clinical analysis and/or medical intervention. In certain instances, thesurgical visualization system 100 can be used intraoperatively to provide real-time information to the medical practitioner during a surgical procedure, such as real-time information regarding proximity data, dimensions, and/or distances. A person skilled in the art will appreciate that information may not be precisely real time but nevertheless be considered to be real time for any of a variety of reasons, such as time delay induced by data transmission, time delay induced by data processing, and/or sensitivity of measurement equipment. Thesurgical visualization system 100 is configured for intraoperative identification of critical structure(s) and/or to facilitate the avoidance of the critical structure(s) 101 by a surgical device. For example, by identifying thecritical structure 101, a medical practitioner can avoid maneuvering a surgical device around thecritical structure 101 and/or a region in a predefined proximity of thecritical structure 101 during a surgical procedure. For another example, by identifying thecritical structure 101, a medical practitioner can avoid dissection of and/or near thecritical structure 101, thereby helping to prevent damage to thecritical structure 101 and/or helping to prevent a surgical device being used by the medical practitioner from being damaged by thecritical structure 101. - The
surgical visualization system 100 is configured to incorporate tissue identification and geometric surface mapping in combination with the surgical visualization system'sdistance sensor system 104. In combination, these features of thesurgical visualization system 100 can determine a position of acritical structure 101 within the anatomical field and/or the proximity of asurgical device 102 to thesurface 105 ofvisible tissue 103 and/or to thecritical structure 101. Moreover, thesurgical visualization system 100 includes an imaging system that includes theimaging device 120 configured to provide real-time views of the surgical site. Theimaging device 120 can include, for example, a spectral camera (e.g., a hyperspectral camera, multispectral camera, or selective spectral camera), which is configured to detect reflected spectral waveforms and generate a spectral cube of images based on the molecular response to the different wavelengths. Views from theimaging device 120 can be provided in real time to a medical practitioner, such as on a display (e.g., a monitor, a computer tablet screen, etc.). The displayed views can be augmented with additional information based on the tissue identification, landscape mapping, and thedistance sensor system 104. In such instances, thesurgical visualization system 100 includes a plurality of subsystems—an imaging subsystem, a surface mapping subsystem, a tissue identification subsystem, and/or a distance determining subsystem. These subsystems can cooperate to intra-operatively provide advanced data synthesis and integrated information to the medical practitioner. - The
imaging device 120 can be configured to detect visible light, spectral light waves (visible or invisible), and a structured light pattern (visible or invisible). Examples of theimaging device 120 includes scopes, e.g., an endoscope, an arthroscope, an angioscope, a bronchoscope, a choledochoscope, a colonoscope, a cytoscope, a duodenoscope, an enteroscope, an esophagogastro-duodenoscope (gastroscope), a laryngoscope, a nasopharyngo-neproscope, a sigmoidoscope, a thoracoscope, an ureteroscope, or an exoscope. Scopes can be particularly useful in minimally invasive surgical procedures. In open surgery applications, theimaging device 120 may not include a scope. - The tissue identification subsystem can be achieved with a spectral imaging system. The spectral imaging system can rely on imaging such as hyperspectral imaging, multispectral imaging, or selective spectral imaging. Embodiments of hyperspectral imaging of tissue are further described in U.S. Pat. No. 9,274,047 entitled “System And Method For Gross Anatomic Pathology Using Hyperspectral Imaging” issued Mar. 1, 2016, which is hereby incorporated by reference in its entirety.
- The surface mapping subsystem can be achieved with a light pattern system. Various surface mapping techniques using a light pattern (or structured light) for surface mapping can be utilized in the surgical visualization systems described herein. Structured light is the process of projecting a known pattern (often a grid or horizontal bars) on to a surface. In certain instances, invisible (or imperceptible) structured light can be utilized, in which the structured light is used without interfering with other computer vision tasks for which the projected pattern may be confusing. For example, infrared light or extremely fast frame rates of visible light that alternate between two exact opposite patterns can be utilized to prevent interference. Embodiments of surface mapping and a surgical system including a light source and a projector for projecting a light pattern are further described in U.S. Pat. Pub. No. 2017/0055819 entitled “Set Comprising A Surgical Instrument” published Mar. 2, 2017, U.S. Pat. Pub. No. 2017/0251900 entitled “Depiction System” published Sep. 7, 2017, and U.S. patent application Ser. No. 16/729,751 entitled “Surgical Systems For Generating Three Dimensional Constructs Of Anatomical Organs And Coupling Identified Anatomical Structures Thereto” filed Dec. 30, 2019, which are hereby incorporated by reference in their entireties.
- The distance determining system can be incorporated into the surface mapping system. For example, structured light can be utilized to generate a three-dimensional (3D) virtual model of the
visible surface 105 and determine various distances with respect to thevisible surface 105. Additionally or alternatively, the distance determining system can rely on time-of-flight measurements to determine one or more distances to the identified tissue (or other structures) at the surgical site. - The
surgical visualization system 100 also includes asurgical device 102. Thesurgical device 102 can be any suitable surgical device. Examples of thesurgical device 102 includes a surgical dissector, a surgical stapler, a surgical grasper, a clip applier, a smoke evacuator, a surgical energy device (e.g., mono-polar probes, bi-polar probes, ablation probes, an ultrasound device, an ultrasonic end effector, etc.), etc. In some embodiments, thesurgical device 102 includes an end effector having opposing jaws that extend from a distal end of a shaft of thesurgical device 102 and that are configured to engage tissue therebetween. - The
surgical visualization system 100 can be configured to identify thecritical structure 101 and a proximity of thesurgical device 102 to thecritical structure 101. Theimaging device 120 of thesurgical visualization system 100 is configured to detect light at various wavelengths, such as visible light, spectral light waves (visible or invisible), and a structured light pattern (visible or invisible). Theimaging device 120 can include a plurality of lenses, sensors, and/or receivers for detecting the different signals. For example, theimaging device 120 can be a hyperspectral, multispectral, or selective spectral camera, as described herein. Theimaging device 120 can include a waveform sensor 122 (such as a spectral image sensor, detector, and/or three-dimensional camera lens). For example, theimaging device 120 can include a right-side lens and a left-side lens used together to record two two-dimensional images at the same time and, thus, generate a three-dimensional (3D) image of the surgical site, render a three-dimensional image of the surgical site, and/or determine one or more distances at the surgical site. Additionally or alternatively, theimaging device 120 can be configured to receive images indicative of the topography of the visible tissue and the identification and position of hidden critical structures, as further described herein. For example, a field of view of theimaging device 120 can overlap with a pattern of light (structured light) on thesurface 105 of thetissue 103, as shown inFIG. 1 . - As in this illustrated embodiment, the
surgical visualization system 100 can be incorporated into a roboticsurgical system 110. The roboticsurgical system 110 can have a variety of configurations, as discussed herein. In this illustrated embodiment, the roboticsurgical system 110 includes a firstrobotic arm 112 and a secondrobotic arm 114. Therobotic arms structural members 116 andjoints 118, which can include servomotor controls. The firstrobotic arm 112 is configured to maneuver thesurgical device 102, and the secondrobotic arm 114 is configured to maneuver theimaging device 120. A robotic control unit of the roboticsurgical system 110 is configured to issue control motions to the first and secondrobotic arms surgical device 102 and theimaging device 120, respectively. - In some embodiments, one or more of the
robotic arms robotic system 110 used in the surgical procedure. For example, at least one of therobotic arms robotic arms surgical device 102 and theimaging device 120 can be registered relative to a particular coordinate system. - Examples of robotic surgical systems include the Ottava™ robotic-assisted surgery system (Johnson & Johnson of New Brunswick, N.J.), da Vinci® surgical systems (Intuitive Surgical, Inc. of Sunnyvale, Calif.), the Hugo™ robotic-assisted surgery system (Medtronic PLC of Minneapolis, Minn.), the Versius® surgical robotic system (CMR Surgical Ltd of Cambridge, UK), and the Monarch® platform (Auris Health, Inc. of Redwood City, Calif.). Embodiments of various robotic surgical systems and using robotic surgical systems are further described in U.S. Pat. Pub. No. 2018/0177556 entitled “Flexible Instrument Insertion Using An Adaptive Force Threshold” filed Dec. 28, 2016, U.S. Pat. Pub. No. 2020/0000530 entitled “Systems And Techniques For Providing Multiple Perspectives During Medical Procedures” filed Apr. 16, 2019, U.S. Pat. Pub. No. 2020/0170720 entitled “Image-Based Branch Detection And Mapping For Navigation” filed Feb. 7, 2020, U.S. Pat. Pub. No. 2020/0188043 entitled “Surgical Robotics System” filed Dec. 9, 2019, U.S. Pat. Pub. No. 2020/0085516 entitled “Systems And Methods For Concomitant Medical Procedures” filed Sep. 3, 2019, U.S. Pat. No. 8,831,782 entitled “Patient-Side Surgeon Interface For A Teleoperated Surgical Instrument” filed Jul. 15, 2013, and Intl. Pat. Pub. No. WO 2014151621 entitled “Hyperdexterous Surgical System” filed Mar. 13, 2014, which are hereby incorporated by reference in their entireties.
- The
surgical visualization system 100 also includes anemitter 106. Theemitter 106 is configured to emit a pattern of light, such as stripes, grid lines, and/or dots, to enable the determination of the topography or landscape of thesurface 105. For example, projectedlight arrays 130 can be used for three-dimensional scanning and registration on thesurface 105. The projectedlight arrays 130 can be emitted from theemitter 106 located on thesurgical device 102 and/or one of therobotic arms imaging device 120. In one aspect, the projectedlight array 130 is employed by thesurgical visualization system 100 to determine the shape defined by thesurface 105 of thetissue 103 and/or motion of thesurface 105 intraoperatively. Theimaging device 120 is configured to detect the projectedlight arrays 130 reflected from thesurface 105 to determine the topography of thesurface 105 and various distances with respect to thesurface 105. - As in this illustrated embodiment, the
imaging device 120 can include anoptical waveform emitter 123, such as by being mounted on or otherwise attached on theimaging device 120. Theoptical waveform emitter 123 is configured to emit electromagnetic radiation 124 (near-infrared (NIR) photons) that can penetrate thesurface 105 of thetissue 103 and reach thecritical structure 101. Theimaging device 120 and theoptical waveform emitter 123 can be positionable by therobotic arm 114. Theoptical waveform emitter 123 is mounted on or otherwise on theimaging device 122 but in other embodiments can be positioned on a separate surgical device from theimaging device 120. A corresponding waveform sensor 122 (e.g., an image sensor, spectrometer, or vibrational sensor) of theimaging device 120 is configured to detect the effect of the electromagnetic radiation received by thewaveform sensor 122. The wavelengths of theelectromagnetic radiation 124 emitted by theoptical waveform emitter 123 are configured to enable the identification of the type of anatomical and/or physical structure, such as thecritical structure 101. The identification of thecritical structure 101 can be accomplished through spectral analysis, photo-acoustics, and/or ultrasound, for example. In one aspect, the wavelengths of theelectromagnetic radiation 124 can be variable. Thewaveform sensor 122 andoptical waveform emitter 123 can be inclusive of a multispectral imaging system and/or a selective spectral imaging system, for example. In other instances, thewaveform sensor 122 andoptical waveform emitter 123 can be inclusive of a photoacoustic imaging system, for example. - The
distance sensor system 104 of thesurgical visualization system 100 is configured to determine one or more distances at the surgical site. Thedistance sensor system 104 can be a time-of-flight distance sensor system that includes an emitter, such as theemitter 106 as in this illustrated embodiment, and that includes areceiver 108. In other instances, the time-of-flight emitter can be separate from the structured light emitter. Theemitter 106 can include a very tiny laser source, and thereceiver 108 can include a matching sensor. Thedistance sensor system 104 is configured to detect the “time of flight,” or how long the laser light emitted by theemitter 106 has taken to bounce back to the sensor portion of thereceiver 108. Use of a very narrow light source in theemitter 106 enables thedistance sensor system 104 to determining the distance to thesurface 105 of thetissue 103 directly in front of thedistance sensor system 104. - The
receiver 108 of thedistance sensor system 104 is positioned on thesurgical device 102 in this illustrated embodiment, but in other embodiments thereceiver 108 can be mounted on a separate surgical device instead of thesurgical device 102. For example, thereceiver 108 can be mounted on a cannula or trocar through which thesurgical device 102 extends to reach the surgical site. In still other embodiments, thereceiver 108 for thedistance sensor system 104 can be mounted on a separate robotically-controlled arm of the robotic system 110 (e.g., on the second robotic arm 114) than the firstrobotic arm 112 to which thesurgical device 102 is coupled, can be mounted on a movable arm that is operated by another robot, or be mounted to an operating room (OR) table or fixture. In some embodiments, theimaging device 120 includes thereceiver 108 to allow for determining the distance from theemitter 106 to thesurface 105 of thetissue 103 using a line between theemitter 106 on thesurgical device 102 and theimaging device 120. For example, the distance de can be triangulated based on known positions of the emitter 106 (on the surgical device 102) and the receiver 108 (on the imaging device 120) of thedistance sensor system 104. The three-dimensional position of thereceiver 108 can be known and/or registered to the robot coordinate plane intraoperatively. - As in this illustrated embodiment, the position of the
emitter 106 of thedistance sensor system 104 can be controlled by the firstrobotic arm 112, and the position of thereceiver 108 of thedistance sensor system 104 can be controlled by the secondrobotic arm 114. In other embodiments, thesurgical visualization system 100 can be utilized apart from a robotic system. In such instances, thedistance sensor system 104 can be independent of the robotic system. - In
FIG. 1 , de is emitter-to-tissue distance from theemitter 106 to thesurface 105 of thetissue 103, and dt is device-to-tissue distance from a distal end of thesurgical device 102 to thesurface 105 of thetissue 103. Thedistance sensor system 104 is configured to determine the emitter-to-tissue distance de. The device-to-tissue distance dt is obtainable from the known position of theemitter 106 on thesurgical device 102, e.g., on a shaft thereof proximal to the surgical device's distal end, relative to the distal end of thesurgical device 102. In other words, when the distance between theemitter 106 and the distal end of thesurgical device 102 is known, the device-to-tissue distance dt can be determined from the emitter-to-tissue distance de. In some embodiments, the shaft of thesurgical device 102 can include one or more articulation joints and can be articulatable with respect to theemitter 106 and jaws at the distal end of thesurgical device 102. The articulation configuration can include a multi-joint vertebrae-like structure, for example. In some embodiments, a three-dimensional camera can be utilized to triangulate one or more distances to thesurface 105. - In
FIG. 1 , dw is camera-to-critical structure distance from theoptical waveform emitter 123 located on theimaging device 120 to the surface of thecritical structure 101, and dA is a depth of thecritical structure 101 below thesurface 105 of the tissue 103 (e.g., the distance between the portion of thesurface 105 closest to thesurgical device 102 and the critical structure 101). The time-of-flight of the optical waveforms emitted from theoptical waveform emitter 123 located on theimaging device 120 are configured to determine the camera-to-critical structure distance dw. - As shown in
FIG. 2 , the depth dA of thecritical structure 101 relative to thesurface 105 of thetissue 103 can be determined by triangulating from the distance dw and known positions of theemitter 106 on thesurgical device 102 and theoptical waveform emitter 123 on the imaging device 120 (and, thus, the known distance dx therebetween) to determine the distance dy, which is the sum of the distances de and dA. Additionally or alternatively, time-of-flight from theoptical waveform emitter 123 can be configured to determine the distance from theoptical waveform emitter 123 to thesurface 105 of thetissue 103. For example, a first waveform (or range of waveforms) can be utilized to determine the camera-to-critical structure distance dw and a second waveform (or range of waveforms) can be utilized to determine the distance to thesurface 105 of thetissue 103. In such instances, the different waveforms can be utilized to determine the depth of thecritical structure 101 below thesurface 105 of thetissue 103. - Additionally or alternatively, the distance dA can be determined from an ultrasound, a registered magnetic resonance imaging (MRI), or computerized tomography (CT) scan. In still other instances, the distance dA can be determined with spectral imaging because the detection signal received by the
imaging device 120 can vary based on the type of material, e.g., type of thetissue 103. For example, fat can decrease the detection signal in a first way, or a first amount, and collagen can decrease the detection signal in a different, second way, or a second amount. - In another embodiment of a
surgical visualization system 160 illustrated inFIG. 3 , asurgical device 162, and not theimaging device 120, includes theoptical waveform emitter 123 and thewaveform sensor 122 that is configured to detect the reflected waveforms. Theoptical waveform emitter 123 is configured to emit waveforms for determining the distances dt and dw from a common device, such as thesurgical device 162, as described herein. In such instances, the distance dA from thesurface 105 of thetissue 103 to the surface of thecritical structure 101 can be determined as follows: -
d A =d w −d t - The
surgical visualization system 100 includes a control system configured to control various aspects of thesurgical visualization system 100.FIG. 4 illustrates one embodiment of acontrol system 133 that can be utilized as the control system of the surgical visualization system 100 (or other surgical visualization system described herein). Thecontrol system 133 includes acontrol circuit 132 configured to be in signal communication with amemory 134. Thememory 134 is configured to store instructions executable by thecontrol circuit 132, such as instructions to determine and/or recognize critical structures (e.g., thecritical structure 101 ofFIG. 1 ), instructions to determine and/or compute one or more distances and/or three-dimensional digital representations, and instructions to communicate information to a medical practitioner. As in this illustrated embodiment, thememory 134 can storesurface mapping logic 136,imaging logic 138,tissue identification logic 140, and distance determininglogic 141, although thememory 134 can store any combinations of thelogics control system 133 also includes an imaging system 142 including a camera 144 (e.g., the imaging system including theimaging device 120 ofFIG. 1 ), a display 146 (e.g., a monitor, a computer tablet screen, etc.), and controls 148 of thecamera 144 and thedisplay 146. Thecamera 144 includes an image sensor 135 (e.g., the waveform sensor 122) configured to receive signals from various light sources emitting light at various visible and invisible spectra (e.g., visible light, spectral imagers, three-dimensional lens, etc.). Thedisplay 146 is configured to depict real, virtual, and/or virtually-augmented images and/or information to a medical practitioner. - In an exemplary embodiment, the
image sensor 135 is a solid-state electronic device containing up to millions of discrete photodetector sites called pixels. Theimage sensor 135 technology falls into one of two categories: Charge-Coupled Device (CCD) and Complementary Metal Oxide Semiconductor (CMOS) imagers and more recently, short-wave infrared (SWIR) is an emerging technology in imaging. Another type of theimage sensor 135 employs a hybrid CCD/CMOS architecture (sold under the name “sCMOS”) and consists of CMOS readout integrated circuits (ROICs) that are bump bonded to a CCD imaging substrate. CCD andCMOS image sensors 135 are sensitive to wavelengths in a range of about 350nm to about 1050nm, such as in a range of about 400nm to about 1000nm. A person skilled in the art will appreciate that a value may not be precisely at a value but nevertheless considered to be about that value for any of a variety of reasons, such as sensitivity of measurement equipment and manufacturing tolerances. CMOS sensors are, in general, more sensitive to IR wavelengths than CCD sensors. Solidstate image sensors 135 are based on the photoelectric effect and, as a result, cannot distinguish between colors. Accordingly, there are two types of color CCD cameras: single chip and three-chip. Single chip color CCD cameras offer a common, low-cost imaging solution and use a mosaic (e.g., Bayer) optical filter to separate incoming light into a series of colors and employ an interpolation algorithm to resolve full color images. Each color is, then, directed to a different set of pixels. Three-chip color CCD cameras provide higher resolution by employing a prism to direct each section of the incident spectrum to a different chip. More accurate color reproduction is possible, as each point in space of the object has separate RGB intensity values, rather than using an algorithm to determine the color. Three-chip cameras offer extremely high resolutions. - The
control system 133 also includes an emitter (e.g., the emitter 106) including a spectrallight source 150 and a structuredlight source 152 each operably coupled to thecontrol circuit 133. A single source can be pulsed to emit wavelengths of light in the spectrallight source 150 range and wavelengths of light in the structuredlight source 152 range. - Alternatively, a single light source can be pulsed to provide light in the invisible spectrum (e.g., infrared spectral light) and wavelengths of light on the visible spectrum. The spectral
light source 150 can be, for example, a hyperspectral light source, a multispectral light source, and/or a selective spectral light source. Thetissue identification logic 140 is configured to identify critical structure(s) (e.g., thecritical structure 101 ofFIG. 1 ) via data from the spectrallight source 150 received by theimage sensor 135 of thecamera 144. Thesurface mapping logic 136 is configured to determine the surface contours of the visible tissue (e.g., the tissue 103) based on reflected structured light. With time-of-flight measurements, thedistance determining logic 141 is configured to determine one or more distance(s) to the visible tissue and/or the critical structure. Output from each of thesurface mapping logic 136, thetissue identification logic 140, and thedistance determining logic 141 is configured to be provided to theimaging logic 138, and combined, blended, and/or overlaid by theimaging logic 138 to be conveyed to a medical practitioner via thedisplay 146 of the imaging system 142. - The
control circuit 132 can have a variety of configurations.FIG. 5 illustrates one embodiment of acontrol circuit 170 that can be used as thecontrol circuit 132 configured to control aspects of thesurgical visualization system 100. Thecontrol circuit 170 is configured to implement various processes described herein. Thecontrol circuit 170 includes a microcontroller that includes a processor 172 (e.g., a microprocessor or microcontroller) operably coupled to amemory 174. Thememory 174 is configured to store machine-executable instructions that, when executed by theprocessor 172, cause theprocessor 172 to execute machine instructions to implement various processes described herein. Theprocessor 172 can be any one of a number of single-core or multicore processors known in the art. Thememory 174 can include volatile and non-volatile storage media. Theprocessor 172 includes aninstruction processing unit 176 and anarithmetic unit 178. Theinstruction processing unit 176 is configured to receive instructions from thememory 174. - The
surface mapping logic 136, theimaging logic 138, thetissue identification logic 140, and thedistance determining logic 141 can have a variety of configurations.FIG. 6 illustrates one embodiment of acombinational logic circuit 180 configured to control aspects of thesurgical visualization system 100 using logic such as one or more of thesurface mapping logic 136, theimaging logic 138, thetissue identification logic 140, and thedistance determining logic 141. Thecombinational logic circuit 180 includes a finite state machine that includes acombinational logic 182 configured to receive data associated with a surgical device (e.g. thesurgical device 102 and/or the imaging device 120) at aninput 184, process the data by thecombinational logic 182, and provide anoutput 184 to a control circuit (e.g., the control circuit 132). -
FIG. 7 illustrates one embodiment of asequential logic circuit 190 configured to control aspects of thesurgical visualization system 100 using logic such as one or more of thesurface mapping logic 136, theimaging logic 138, thetissue identification logic 140, and thedistance determining logic 141. Thesequential logic circuit 190 includes a finite state machine that includes acombinational logic 192, amemory 194, and aclock 196. Thememory 194 is configured to store a current state of the finite state machine. Thesequential logic circuit 190 can be synchronous or asynchronous. Thecombinational logic 192 is configured to receive data associated with a surgical device (e.g. thesurgical device 102 and/or the imaging device 120) at an input 426, process the data by thecombinational logic 192, and provide an output 499 to a control circuit (e.g., the control circuit 132). In some embodiments, thesequential logic circuit 190 can include a combination of a processor (e.g.,processor 172 ofFIG. 5 ) and a finite state machine to implement various processes herein. In some embodiments, the finite state machine can include a combination of a combinational logic circuit (e.g., thecombinational logic circuit 192 ofFIG. 7 ) and thesequential logic circuit 190. -
FIG. 8 illustrates another embodiment of asurgical visualization system 200. Thesurgical visualization system 200 is generally configured and used similar to thesurgical visualization system 100 ofFIG. 1 , e.g., includes asurgical device 202 and animaging device 220. Theimaging device 220 includes aspectral light emitter 223 configured to emit spectral light in a plurality of wavelengths to obtain a spectral image of hidden structures, for example. Theimaging device 220 can also include a three-dimensional camera and associated electronic processing circuits. Thesurgical visualization system 200 is shown being utilized intraoperatively to identify and facilitate avoidance of certain critical structures, such as aureter 201 a andvessels 201 b, in an organ 203 (a uterus in this embodiment) that are not visible on asurface 205 of theorgan 203. - The
surgical visualization system 200 is configured to determine an emitter-to-tissue distance de from anemitter 206 on thesurgical device 202 to thesurface 205 of theuterus 203 via structured light. Thesurgical visualization system 200 is configured to extrapolate a device-to-tissue distance dt from thesurgical device 202 to thesurface 205 of theuterus 203 based on the emitter-to-tissue distance de. Thesurgical visualization system 200 is also configured to determine a tissue-to-ureter distance dA from theureter 201 a to thesurface 205 and a camera-to ureter distance dw from theimaging device 220 to theureter 201 a. As described herein, e.g., with respect to thesurgical visualization system 100 ofFIG. 1 , thesurgical visualization system 200 is configured to determine the distance dw with spectral imaging and time-of-flight sensors, for example. In various embodiments, thesurgical visualization system 200 can determine (e.g. triangulate) the tissue-to-ureter distance dA (or depth) based on other distances and/or the surface mapping logic described herein. - As mentioned above, a surgical visualization system includes a control system configured to control various aspects of the surgical visualization system. The control system can have a variety of configurations.
FIG. 9 illustrates one embodiment of acontrol system 600 for a surgical visualization system, such as thesurgical visualization system 100 ofFIG. 1 , thesurgical visualization system 200 ofFIG. 8 , or other surgical visualization system described herein. Thecontrol system 600 is a conversion system that integrates spectral signature tissue identification and structured light tissue positioning to identify a critical structure, especially when those structure(s) are obscured by tissue, e.g., by fat, connective tissue, blood tissue, and/or organ(s), and/or by blood, and/or to detect tissue variability, such as differentiating tumors and/or non-healthy tissue from healthy tissue within an organ. - The
control system 600 is configured for implementing a hyperspectral imaging and visualization system in which a molecular response is utilized to detect and identify anatomy in a surgical field of view. Thecontrol system 600 includes aconversion logic circuit 648 configured to convert tissue data to usable information for surgeons and/or other medical practitioners. For example, variable reflectance based on wavelengths with respect to obscuring material can be utilized to identify the critical structure in the anatomy. Moreover, thecontrol system 600 is configured to combine the identified spectral signature and the structural light data in an image. For example, thecontrol system 600 can be employed to create of three-dimensional data set for surgical use in a system with augmentation image overlays. Techniques can be employed both intraoperatively and preoperatively using additional visual information. In various embodiments, thecontrol system 600 is configured to provide warnings to a medical practitioner when in the proximity of one or more critical structures. Various algorithms can be employed to guide robotic automation and semi-automated approaches based on the surgical procedure and proximity to the critical structure(s). - A projected array of lights is employed by the
control system 600 to determine tissue shape and motion intraoperatively. Alternatively, flash Lidar may be utilized for surface mapping of the tissue. - The
control system 600 is configured to detect the critical structure, which as mentioned above can include one or more critical structures, and provide an image overlay of the critical structure and measure the distance to the surface of the visible tissue and the distance to the embedded/buried critical structure(s). Thecontrol system 600 can measure the distance to the surface of the visible tissue or detect the critical structure and provide an image overlay of the critical structure. - The
control system 600 includes aspectral control circuit 602. Thespectral control circuit 602 can be a field programmable gate array (FPGA) or another suitable circuit configuration, such as the configurations described with respect toFIG. 6 ,FIG. 7 , andFIG. 8 . Thespectral control circuit 602 includes aprocessor 604 configured to receive video input signals from avideo input processor 606. Theprocessor 604 can be configured for hyperspectral processing and can utilize C/C++ code, for example. Thevideo input processor 606 is configured to receive video-in of control (metadata) data such as shutter time, wave length, and sensor analytics, for example. Theprocessor 604 is configured to process the video input signal from thevideo input processor 606 and provide a video output signal to avideo output processor 608, which includes a hyperspectral video-out of interface control (metadata) data, for example. Thevideo output processor 608 is configured to provides the video output signal to animage overlay controller 610. - The
video input processor 606 is operatively coupled to acamera 612 at the patient side via apatient isolation circuit 614. Thecamera 612 includes a solidstate image sensor 634. Thepatient isolation circuit 614 can include a plurality of transformers so that the patient is isolated from other circuits in the system. Thecamera 612 is configured to receive intraoperative images throughoptics 632 and theimage sensor 634. Theimage sensor 634 can include a CMOS image sensor, for example, or can include another image sensor technology, such as those discussed herein in connection withFIG. 4 . Thecamera 612 is configured tooutput 613 images in 14 bit/pixel signals. A person skilled in the art will appreciate that higher or lower pixel resolutions can be employed. The isolatedcamera output signal 613 is provided to a colorRGB fusion circuit 616, which in this illustrated embodiment employs ahardware register 618 and aNios2 co-processor 620 configured to process thecamera output signal 613. A color RGB fusion output signal is provided to thevideo input processor 606 and a laserpulsing control circuit 622. - The laser
pulsing control circuit 622 is configured to control alaser light engine 624. Thelaser light engine 624 is configured to output light in a plurality of wavelengths (λ1, λ2, λ3 . . . λn) including near infrared (NIR). Thelaser light engine 624 can operate in a plurality of modes. For example, thelaser light engine 624 can operate in two modes. In a first mode, e.g., a normal operating mode, thelaser light engine 624 is configured to output an illuminating signal. In a second mode, e.g., an identification mode, thelaser light engine 624 is configured to output RGBG and NIR light. In various embodiments, thelaser light engine 624 can operate in a polarizing mode. -
Light output 626 from thelaser light engine 624 is configured to illuminate targeted anatomy in an intraoperativesurgical site 627. The laserpulsing control circuit 622 is also configured to control alaser pulse controller 628 for alaser pattern projector 630 configured to project alaser light pattern 631, such as a grid or pattern of lines and/or dots, at a predetermined wavelength (λ2) on an operative tissue or organ at thesurgical site 627. Thecamera 612 is configured to receive the patterned light as well as the reflected light output through thecamera optics 632. Theimage sensor 634 is configured to convert the received light into a digital signal. - The color
RGB fusion circuit 616 is also configured to output signals to theimage overlay controller 610 and avideo input module 636 for reading thelaser light pattern 631 projected onto the targeted anatomy at thesurgical site 627 by thelaser pattern projector 630. Aprocessing module 638 is configured to process thelaser light pattern 631 and output a firstvideo output signal 640 representative of the distance to the visible tissue at thesurgical site 627. The data is provided to theimage overlay controller 610. Theprocessing module 638 is also configured to output asecond video signal 642 representative of a three-dimensional rendered shape of the tissue or organ of the targeted anatomy at the surgical site. - The first and second video output signals 640, 642 include data representative of the position of the critical structure on a three-dimensional surface model, which is provided to an
integration module 643. In combination with data from the video outprocessor 608 of thespectral control circuit 602, theintegration module 643 is configured to determine the distance (e.g., distance dA ofFIG. 1 ) to a buried critical structure (e.g., via triangularization algorithms 644), and the distance to the buried critical structure can be provided to theimage overlay controller 610 via a video outprocessor 646. The foregoing conversion logic can encompass theconversion logic circuit 648 intermediate video monitors 652 and thecamera 624 /laser pattern projector 630 positioned at thesurgical site 627. -
Preoperative data 650, such as from a CT or MRI scan, can be employed to register or align certain three-dimensional deformable tissue in various instances. Suchpreoperative data 650 can be provided to theintegration module 643 and ultimately to theimage overlay controller 610 so that such information can be overlaid with the views from thecamera 612 and provided to the video monitors 652. Embodiments of registration of preoperative data are further described in U.S. Pat. Pub. No. 2020/0015907 entitled “Integration Of Imaging Data” filed Sep. 11, 2018, which is hereby incorporated by reference herein in its entirety. - The video monitors 652 are configured to output the integrated/augmented views from the
image overlay controller 610. A medical practitioner can select and/or toggle between different views on one or more displays. On afirst display 652 a, which is a monitor in this illustrated embodiment, the medical practitioner can toggle between (A) a view in which a three-dimensional rendering of the visible tissue is depicted and (B) an augmented view in which one or more hidden critical structures are depicted over the three-dimensional rendering of the visible tissue. On asecond display 652 b, which is a monitor in this illustrated embodiment, the medical practitioner can toggle on distance measurements to one or more hidden critical structures and/or the surface of visible tissue, for example. - The various surgical visualization systems described herein can be utilized to visualize various different types of tissues and/or anatomical structures, including tissues and/or anatomical structures that may be obscured from being visualized by EMR in the visible portion of the spectrum. The surgical visualization system can utilize a spectral imaging system, as mentioned above, which can be configured to visualize different types of tissues based upon their varying combinations of constituent materials. In particular, a spectral imaging system can be configured to detect the presence of various constituent materials within a tissue being visualized based on the absorption coefficient of the tissue across various EMR wavelengths. The spectral imaging system can be configured to characterize the tissue type of the tissue being visualized based upon the particular combination of constituent materials.
-
FIG. 10 shows agraph 300 depicting how the absorption coefficient of various biological materials varies across the EMR wavelength spectrum. In thegraph 300, thevertical axis 302 represents absorption coefficient of the biological material in cm−1, and thehorizontal axis 304 represents EMR wavelength in μm. Afirst line 306 in thegraph 300 represents the absorption coefficient of water at various EMR wavelengths, asecond line 308 represents the absorption coefficient of protein at various EMR wavelengths, athird line 310 represents the absorption coefficient of melanin at various EMR wavelengths, afourth line 312 represents the absorption coefficient of deoxygenated hemoglobin at various EMR wavelengths, afifth line 314 represents the absorption coefficient of oxygenated hemoglobin at various EMR wavelengths, and asixth line 316 represents the absorption coefficient of collagen at various EMR wavelengths. Different tissue types have different combinations of constituent materials and, therefore, the tissue type(s) being visualized by a surgical visualization system can be identified and differentiated between according to the particular combination of detected constituent materials. Accordingly, a spectral imaging system of a surgical visualization system can be configured to emit EMR at a number of different wavelengths, determine the constituent materials of the tissue based on the detected absorption EMR absorption response at the different wavelengths, and then characterize the tissue type based on the particular detected combination of constituent materials. -
FIG. 11 shows an embodiment of the utilization of spectral imaging techniques to visualize different tissue types and/or anatomical structures. InFIG. 11 , a spectral emitter 320 (e.g., the spectrallight source 150 ofFIG. 4 ) is being utilized by an imaging system to visualize asurgical site 322. The EMR emitted by thespectral emitter 320 and reflected from the tissues and/or structures at thesurgical site 322 is received by an image sensor (e.g., theimage sensor 135 ofFIG. 4 ) to visualize the tissues and/or structures, which can be either visible (e.g., be located at a surface of the surgical site 322) or obscured (e.g., underlay other tissue and/or structures at the surgical site 322). In this embodiment, an imaging system (e.g., the imaging system 142 ofFIG. 4 ) visualizes atumor 324, anartery 326, and various abnormalities 328 (e.g., tissues not confirming to known or expected spectral signatures) based upon the spectral signatures characterized by the differing absorptive characteristics (e.g., absorption coefficient) of the constituent materials for each of the different tissue/structure types. The visualized tissues and structures can be displayed on a display screen associated with or coupled to the imaging system (e.g., thedisplay 146 of the imaging system 142 ofFIG. 4 ), on a primary display (e.g., theprimary display 819 ofFIG. 19 ), on a non-sterile display (e.g., thenon-sterile displays FIG. 19 ), on a display of a surgical hub (e.g., the display of thesurgical hub 806 ofFIG. 19 ), on a device/instrument display, and/or on another display. - The imaging system can be configured to tailor or update the displayed surgical site visualization according to the identified tissue and/or structure types. For example, as shown in
FIG. 11 , the imaging system can display amargin 330 associated with thetumor 324 being visualized on a display screen associated with or coupled to the imaging system, on a primary display, on a non-sterile display, on a display of a surgical hub, on a device/instrument display, and/or on another display. Themargin 330 can indicate the area or amount of tissue that should be excised to ensure complete removal of thetumor 324. The surgical visualization system's control system (e.g., thecontrol system 133 ofFIG. 4 ) can be configured to control or update the dimensions of themargin 330 based on the tissues and/or structures identified by the imaging system. In this illustrated embodiment, the imaging system has identifiedmultiple abnormalities 328 within the field of view (FOV). Accordingly, the control system can adjust the displayedmargin 330 to a first updatedmargin 332 having sufficient dimensions to encompass theabnormalities 328. Further, the imaging system has also identified theartery 326 partially overlapping with the initially displayed margin 330 (as indicated by a highlightedregion 334 of the artery 326). Accordingly, the control system can adjust the displayed margin to a second updatedmargin 336 having sufficient dimensions to encompass the relevant portion of theartery 326. - Tissues and/or structures can also be imaged or characterized according to their reflective characteristics, in addition to or in lieu of their absorptive characteristics described above with respect to
FIG. 10 andFIG. 11 , across the EMR wavelength spectrum. For example,FIG. 12 ,FIG. 13 , andFIG. 14 illustrate various graphs of reflectance of different types of tissues or structures across different EMR wavelengths.FIG. 12 is agraphical representation 340 of an illustrative ureter signature versus obscurants.FIG. 13 is agraphical representation 342 of an illustrative artery signature versus obscurants.FIG. 14 is agraphical representation 344 of an illustrative nerve signature versus obscurants. The plots inFIG. 12 ,FIG. 13 , andFIG. 14 represent reflectance as a function of wavelength (nm) for the particular structures (ureter, artery, and nerve) relative to the corresponding reflectances of fat, lung tissue, and blood at the corresponding wavelengths. These graphs are simply for illustrative purposes and it should be understood that other tissues and/or structures could have corresponding detectable reflectance signatures that would allow the tissues and/or structures to be identified and visualized. - Select wavelengths for spectral imaging can be identified and utilized based on the anticipated critical structures and/or obscurants at a surgical site (e.g., “selective spectral” imaging). By utilizing selective spectral imaging, the amount of time required to obtain the spectral image can be minimized such that the information can be obtained in real-time and utilized intraoperatively. The wavelengths can be selected by a medical practitioner or by a control circuit based on input by a user, e.g., a medical practitioner. In certain instances, the wavelengths can be selected based on machine learning and/or big data accessible to the control circuit via, e.g., a cloud or surgical hub.
-
FIG. 15 illustrates one embodiment of spectral imaging to tissue being utilized intraoperatively to measure a distance between a waveform emitter and a critical structure that is obscured by tissue.FIG. 15 shows an embodiment of a time-of-flight sensor system 404 utilizingwaveforms 424, 425. The time-of-flight sensor system 404 can be incorporated into a surgical visualization system, e.g., as thesensor system 104 of thesurgical visualization system 100 ofFIG. 1 . The time-of-flight sensor system 404 includes awaveform emitter 406 and awaveform receiver 408 on the same surgical device 402 (e.g., theemitter 106 and thereceiver 108 on the samesurgical device 102 ofFIG. 1 ). The emitted wave 400 extends to a critical structure 401 (e.g., thecritical structure 101 ofFIG. 1 ) from theemitter 406, and the receivedwave 425 is reflected back to by thereceiver 408 from thecritical structure 401. Thesurgical device 402 in this illustrated embodiment is positioned through atrocar 410 that extends into acavity 407 in a patient. Although thetrocar 410 is used in this in this illustrated embodiment, other trocars or other access devices can be used, or no access device may be used. - The
waveforms 424, 425 are configured to penetrate obscuringtissue 403, such as by having wavelengths in the NIR or SWIR spectrum of wavelengths. A spectral signal (e.g., hyperspectral, multispectral, or selective spectral) or a photoacoustic signal is emitted from theemitter 406, as shown by afirst arrow 407 pointing distally, and can penetrate thetissue 403 in which thecritical structure 401 is concealed. The emitted waveform 424 is reflected by thecritical structure 401, as shown by asecond arrow 409 pointing proximally. The receivedwaveform 425 can be delayed due to a distance d between a distal end of thesurgical device 402 and thecritical structure 401. Thewaveforms 424, 425 can be selected to target thecritical structure 401 within thetissue 403 based on the spectral signature of thecritical structure 401, as described herein. Theemitter 406 is configured to provide a binary signal on and off, as shown inFIG. 16 , for example, which can be measured by thereceiver 408. - Based on the delay between the emitted wave 424 and the received
wave 425, the time-of-flight sensor system 404 is configured to determine the distance d. A time-of-flight timing diagram 430 for theemitter 406 and thereceiver 408 ofFIG. 15 is shown inFIG. 16 . The delay is a function of the distance d and the distance d is given by: -
- where c=the speed of light; t=length of pulse; q1=accumulated charge while light is emitted; and q2=accumulated charge while light is not being emitted.
- The time-of-flight of the
waveforms 424, 425 corresponds to the distance d inFIG. 15 . In various instances, additional emitters/receivers and/or pulsing signals from theemitter 406 can be configured to emit a non-penetrating signal. The non-penetrating signal can be configured to determine the distance from theemitter 406 to thesurface 405 of the obscuringtissue 403. In various instances, a depth of thecritical structure 401 can be determined by: -
d A =d w −d t - where dA=the depth of the
critical structure 401; dw=the distance from theemitter 406 to the critical structure 401 (d inFIG. 15 ); and dt,=the distance from the emitter 406 (on the distal end of the surgical device 402) to thesurface 405 of the obscuringtissue 403. -
FIG. 17 illustrates another embodiment of a time-of-flight sensor system 504 utilizingwaves flight sensor system 504 can be incorporated into a surgical visualization system, e.g., as thesensor system 104 of thesurgical visualization system 100 ofFIG. 1 . The time-of-flight sensor system 504 includes awaveform emitter 506 and a waveform receiver 508 (e.g., theemitter 106 and thereceiver 108 ofFIG. 1 ). Thewaveform emitter 506 is positioned on a firstsurgical device 502 a (e.g., thesurgical device 102 ofFIG. 1 ), and thewaveform receiver 508 is positioned on a secondsurgical device 502 b. Thesurgical devices second trocars cavity 507 in a patient. Although thetrocars emitter 506, and the receivedwaves receiver 508 from various structures and/or surfaces at the surgical site. - The different emitted
waves wave 524 atargets obscuring tissue 503, thewave 524 b targets a firstcritical structure 501 a (e.g., thecritical structure 101 ofFIG. 1 ), which is a vessel in this illustrated embodiment, and thewave 524 c targets a secondcritical structure 501 b (e.g., thecritical structure 101 ofFIG. 1 ), which is a cancerous tumor in this illustrated embodiment. The wavelengths of thewaves surface 505 of thetissue 503, and NIR and/or SWIR waveforms can penetrate thesurface 505 of thetissue 503. In various aspects, as described herein, a spectral signal (e.g., hyperspectral, multispectral, or selective spectral) or a photoacoustic signal can be emitted from theemitter 506. Thewaves critical structures tissue 503 based on the spectral signature of thecritical structure - The emitted waves 524 a, 524 b, 524 c are reflected off the targeted material, namely the
surface 505, the firstcritical structure 501 a, and thesecond structure 501 b, respectively. The receivedwaveforms - In the time-of-
flight sensor system 504, in which theemitter 506 and thereceiver 508 are independently positionable (e.g., on separatesurgical devices emitter 506 and thereceiver 508. For example, the positions can be known when thesurgical devices emitter 506 and thereceiver 508, as well as the time of the photon stream to target a certain tissue and the information received by thereceiver 508 of that particular response can allow a determination of the distances d1a, d2a, d3a, d1b, d2b, d2c. In one aspect, the distance to the obscuredcritical structures flight sensor system 504 can determine the various distances. - In a view provided to the medical practitioner, such as on a display, the
receiver 508 can be rotated such that a center of mass of the target structure in the resulting images remains constant, e.g., in a plane perpendicular to an axis of aselect target structure FIG. 17 , the surgical site is displayed from a viewpoint in which thecritical structure 501 a is perpendicular to the viewing plane (e.g., the vessel is oriented in/out of the page). Such an orientation can be default setting; however, the view can be rotated or otherwise adjusted by a medical practitioner. In certain instances, the medical practitioner can toggle between different surfaces and/or target structures that define the viewpoint of the surgical site provided by the imaging system. - As in this illustrated embodiment, the
receiver 508 can be mounted on thetrocar 510 b (or other access device) through which thesurgical device 502 b is positioned. In other embodiments, thereceiver 508 can be mounted on a separate robotic arm for which the three-dimensional position is known. In various instances, thereceiver 508 can be mounted on a movable arm that is separate from a robotic surgical system that controls thesurgical device 502 a or can be mounted to an operating room (OR) table or fixture that is intraoperatively registerable to the robot coordinate plane. In such instances, the position of theemitter 506 and thereceiver 508 can be registerable to the same coordinate plane such that the distances can be triangulated from outputs from the time-of-flight sensor system 504. - Combining time-of-flight sensor systems and near-infrared spectroscopy (NIRS), termed TOF-NIRS, which is capable of measuring the time-resolved profiles of NIR light with nanosecond resolution can be found in “Time-Of-Flight Near-Infrared Spectroscopy For Nondestructive Measurement Of Internal Quality In Grapefruit,” Journal of the American Society for Horticultural Science, May 2013 vol. 138 no. 3 225-228, which is hereby incorporated by reference in its entirety.
- Embodiments of visualization systems and aspects and uses thereof are described further in U.S. Pat. Pub. No. 2020/0015923 entitled “Surgical Visualization Platform” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015900 entitled “Controlling An Emitter Assembly Pulse Sequence” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015668 entitled “Singular EMR Source Emitter Assembly” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015925 entitled “Combination Emitter And Camera Assembly” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/00015899 entitled “Surgical Visualization With Proximity Tracking Features” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/00015903 entitled “Surgical Visualization Of Multiple Targets” filed Sep. 11, 2018, U.S. Pat. No. 10,792,034 entitled “Visualization Of Surgical Devices” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015897 entitled “Operative Communication Of Light” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015924 entitled “Robotic Light Projection Tools” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015898 entitled “Surgical Visualization Feedback System” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015906 entitled “Surgical Visualization And Monitoring” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015907 entitled “Integration Of Imaging Data” filed Sep. 11, 2018, U.S. Pat. No. 10,925,598 entitled “Robotically-Assisted Surgical Suturing Systems” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015901 entitled “Safety Logic For Surgical Suturing Systems” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015914 entitled “Robotic Systems With Separate Photoacoustic Receivers” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2020/0015902 entitled “Force Sensor Through Structured Light Deflection” filed Sep. 11, 2018, U.S. Pat. Pub. No. 2019/0201136 entitled “Method Of Hub Communication” filed Dec. 4, 2018, U.S. patent application Ser. No. 16/729,772 entitled “Analyzing Surgical Trends By A Surgical System” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,747 entitled “Dynamic Surgical Visualization Systems” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,744 entitled “Visualization Systems Using Structured Light” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “System And Method For Determining, Adjusting, And Managing Resection Margin About A Subject Tissue” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,729 entitled “Surgical Systems For Proposing And Corroborating Organ Portion Removals” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “Surgical System For Overlaying Surgical Instrument Data Onto A Virtual Three Dimensional Construct Of An Organ” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,751 entitled “Surgical Systems For Generating Three Dimensional Constructs Of Anatomical Organs And Coupling Identified Anatomical Structures Thereto” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,740 entitled “Surgical Systems Correlating Visualization Data And Powered Surgical Instrument Data” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,737 entitled “Adaptive Surgical System Control According To Surgical Smoke Cloud Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,796 entitled “Adaptive Surgical System Control According To Surgical Smoke Particulate Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,803 entitled “Adaptive Visualization By A Surgical System” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,807 entitled “Method Of Using Imaging Devices In Surgery” filed Dec. 30, 2019, U.S. Prov. Pat. App. No. 63/249,652 entitled “Surgical Devices, Systems, and Methods Using Fiducial Identification and Tracking” filed on Sep. 29, 2021, U.S. Prov. Pat. App. No. 63/249,658 entitled “Surgical Devices, Systems, and Methods for Control of One Visualization with Another” filed on Sep. 29, 2021, U.S. Prov. Pat. App. No. 63/249,870 entitled “Methods and Systems for Controlling Cooperative Surgical Instruments” filed on Sep. 29, 2021, U.S. Prov. Pat. App. No. 63/249,881 entitled “Methods and Systems for Controlling Cooperative Surgical Instruments with Variable Surgical Site Access Trajectories” filed on Sep. 29, 2021, U.S. Prov. Pat. App. No. 63/249,877 entitled “Methods and Systems for Controlling Cooperative Surgical Instruments” filed on Sep. 29, 2021, and U.S. Prov. Pat. App. No. 63/249,980 entitled “Cooperative Access” filed on Sep. 29, 2021, which are hereby incorporated by reference in their entireties.
- Surgical Hubs
- The various visualization or imaging systems described herein can be incorporated into a system that includes a surgical hub. In general, a surgical hub can be a component of a comprehensive digital medical system capable of spanning multiple medical facilities and configured to provide integrated and comprehensive improved medical care to a vast number of patients. The comprehensive digital medical system includes a cloud-based medical analytics system that is configured to interconnect to multiple surgical hubs located across many different medical facilities. The surgical hubs are configured to interconnect with one or more elements, such as one or more surgical instruments that are used to conduct medical procedures on patients and/or one or more visualization systems that are used during performance of medical procedures. The surgical hubs provide a wide array of functionality to improve the outcomes of medical procedures. The data generated by the various surgical devices, visualization systems, and surgical hubs about the patient and the medical procedure may be transmitted to the cloud-based medical analytics system. This data may then be aggregated with similar data gathered from many other surgical hubs, visualization systems, and surgical instruments located at other medical facilities. Various patterns and correlations may be found through the cloud-based analytics system analyzing the collected data. Improvements in the techniques used to generate the data may be generated as a result, and these improvements may then be disseminated to the various surgical hubs, visualization systems, and surgical instruments. Due to the interconnectedness of all of the aforementioned components, improvements in medical procedures and practices may be found that otherwise may not be found if the many components were not so interconnected.
- Examples of surgical hubs configured to receive, analyze, and output data, and methods of using such surgical hubs, are further described in U.S. Pat. Pub. No. 2019/0200844 entitled “Method Of Hub Communication, Processing, Storage And Display” filed Dec. 4, 2018, U.S. Pat. Pub. No. 2019/0200981 entitled “Method Of Compressing Tissue Within A Stapling Device And Simultaneously Displaying The Location Of The Tissue Within The Jaws” filed Dec. 4, 2018, U.S. Pat. Pub. No. 2019/0201046 entitled “Method For Controlling Smart Energy Devices” filed Dec. 4, 2018, U.S. Pat. Pub. No. 2019/0201114 entitled “Adaptive Control Program Updates For Surgical Hubs” filed Mar. 29, 2018, U.S. Pat. Pub. No. 2019/0201140 entitled “Surgical Hub Situational Awareness” filed Mar. 29, 2018, U.S. Pat. Pub. No. 2019/0206004 entitled “Interactive Surgical Systems With Condition Handling Of Devices And Data Capabilities” filed Mar. 29, 2018, U.S. Pat. Pub. No. 2019/0206555 entitled “Cloud-based Medical Analytics For Customization And Recommendations To A User” filed Mar. 29, 2018, and U.S. Pat. Pub. No. 2019/0207857 entitled “Surgical Network Determination Of Prioritization Of Communication, Interaction, Or Processing Based On System Or Device Needs” filed Nov. 6, 2018, which are hereby incorporated by reference in their entireties.
-
FIG. 18 illustrates one embodiment of a computer-implemented interactivesurgical system 700 that includes one or moresurgical systems 702 and a cloud-based system (e.g., acloud 704 that can include aremote server 713 coupled to a storage device 705). Eachsurgical system 702 includes at least onesurgical hub 706 in communication with thecloud 704. In one example, as illustrated inFIG. 18 , thesurgical system 702 includes avisualization system 708, arobotic system 710, and an intelligent (or “smart”)surgical instrument 712, which are configured to communicate with one another and/or thehub 706. The intelligentsurgical instrument 712 can include imaging device(s). Thesurgical system 702 can include an M number ofhubs 706, an N number ofvisualization systems 708, an O number ofrobotic systems 710, and a P number of intelligentsurgical instruments 712, where M, N, O, and P are integers greater than or equal to one that may or may not be equal to any one or more of each other. Various exemplary intelligent surgical instruments and robotic systems are described herein. - Data received by a surgical hub from a surgical visualization system can be used in any of a variety of ways. In an exemplary embodiment, the surgical hub can receive data from a surgical visualization system in use with a patient in a surgical setting, e.g., in use in an operating room during performance of a surgical procedure. The surgical hub can use the received data in any of one or more ways, as discussed herein.
- The surgical hub can be configured to analyze received data in real time with use of the surgical visualization system and adjust control one or more of the surgical visualization system and/or one or more intelligent surgical instruments in use with the patient based on the analysis of the received data. Such adjustment can include, for example, adjusting one or operational control parameters of intelligent surgical instrument(s), causing one or more sensors of one or more intelligent surgical instruments to take a measurement to help gain an understanding of the patient's current physiological condition, and/or current operational status of an intelligent surgical instrument, and other adjustments. Controlling and adjusting operation of intelligent surgical instruments is discussed further below. Examples of operational control parameters of an intelligent surgical instrument include motor speed, cutting element speed, time, duration, level of energy application, and light emission. Examples of surgical hubs and of controlling and adjusting intelligent surgical instrument operation are described further in previously mentioned U.S. patent application Ser. No. 16/729,772 entitled “Analyzing Surgical Trends By A Surgical System” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,747 entitled “Dynamic Surgical Visualization Systems” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,744 entitled “Visualization Systems Using Structured Light” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “System And Method For Determining, Adjusting, And Managing Resection Margin About A Subject Tissue” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,729 entitled “Surgical Systems For Proposing And Corroborating Organ Portion Removals” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “Surgical System For Overlaying Surgical Instrument Data Onto A Virtual Three Dimensional Construct Of An Organ” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,751 entitled “Surgical Systems For Generating Three Dimensional Constructs Of Anatomical Organs And Coupling Identified Anatomical Structures Thereto” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,740 entitled “Surgical Systems Correlating Visualization Data And Powered Surgical Instrument Data” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,737 entitled “Adaptive Surgical System Control According To Surgical Smoke Cloud Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,796 entitled “Adaptive Surgical System Control According To Surgical Smoke Particulate Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,803 entitled “Adaptive Visualization By A Surgical System” filed Dec. 30, 2019, and U.S. patent application Ser. No. 16/729,807 entitled “Method Of Using Imaging Devices In Surgery” filed Dec. 30, 2019, and in U.S. patent application Ser. No. 17/068,857 entitled “Adaptive Responses From Smart Packaging Of Drug Delivery Absorbable Adjuncts” filed Oct. 13, 2020, U.S. patent application Ser. No. 17/068,858 entitled “Drug Administration Devices That Communicate With Surgical Hubs” filed Oct. 13, 2020, U.S. patent application Ser. No. 17/068,859 entitled “Controlling Operation Of Drug Administration Devices Using Surgical Hubs” filed Oct. 13, 2020, U.S. patent application Ser. No. 17/068,863 entitled “Patient Monitoring Using Drug Administration Devices” filed Oct. 13, 2020, U.S. patent application Ser. No. 17/068,865 entitled “Monitoring And Communicating Information Using Drug Administration Devices” filed Oct. 13, 2020, and U.S. patent application Ser. No. 17/068,867 entitled “Aggregating And Analyzing Drug Administration Data” filed Oct. 13, 2020, which are hereby incorporated by reference in their entireties.
- The surgical hub can be configured to cause visualization of the received data to be provided in the surgical setting on a display so that a medical practitioner in the surgical setting can view the data and thereby receive an understanding of the operation of the imaging device(s) in use in the surgical setting. Such information provided via visualization can include text and/or images.
-
FIG. 19 illustrates one embodiment of asurgical system 802 including a surgical hub 806 (e.g., thesurgical hub 706 ofFIG. 18 or other surgical hub described herein), a robotic surgical system 810 (e.g., the roboticsurgical system 110 ofFIG. 1 or other robotic surgical system herein), and a visualization system 808 (e.g., thevisualization system 100 ofFIG. 1 or other visualization system described herein). Thesurgical hub 806 can be in communication with a cloud, as discussed herein.FIG. 19 shows thesurgical system 802 being used to perform a surgical procedure on a patient who is lying down on an operating table 814 in asurgical operating room 816. Therobotic system 810 includes a surgeon'sconsole 818, a patient side cart 820 (surgical robot), and a robotic systemsurgical hub 822. The robotic systemsurgical hub 822 is generally configured similar to thesurgical hub 822 and can be in communication with a cloud. In some embodiments, the robotic systemsurgical hub 822 and thesurgical hub 806 can be combined. Thepatient side cart 820 can manipulate an intelligentsurgical tool 812 through a minimally invasive incision in the body of the patient while a medical practitioner, e.g., a surgeon, nurse, and/or other medical practitioner, views the surgical site through the surgeon'sconsole 818. An image of the surgical site can be obtained by an imaging device 824 (e.g., theimaging device 120 ofFIG. 1 or other imaging device described herein), which can be manipulated by thepatient side cart 820 to orient theimaging device 824. The robotic systemsurgical hub 822 can be used to process the images of the surgical site for subsequent display to the surgeon through the surgeon'sconsole 818. - A
primary display 819 is positioned in the sterile field of theoperating room 816 and is configured to be visible to an operator at the operating table 814. In addition, as in this illustrated embodiment, avisualization tower 818 can positioned outside the sterile field. Thevisualization tower 818 includes a firstnon-sterile display 807 and a secondnon-sterile display 809, which face away from each other. Thevisualization system 808, guided by thesurgical hub 806, is configured to utilize thedisplays surgical hub 806 can cause thevisualization system 808 to display a snapshot and/or a video of a surgical site, as obtained by theimaging device 824, on one or both of thenon-sterile displays primary display 819. The snapshot and/or video on thenon-sterile display 807 and/or 809 can permit a non-sterile medical practitioner to perform a diagnostic step relevant to the surgical procedure, for example. - The
surgical hub 806 is configured to route a diagnostic input or feedback entered by a non-sterile medical practitioner at thevisualization tower 818 to theprimary display 819 within the sterile field, where it can be viewed by a sterile medical practitioner at the operating table 814. For example, the input can be in the form of a modification to the snapshot and/or video displayed on thenon-sterile display 807 and/or 809, which can be routed to theprimary display 819 by thesurgical hub 806. - The
surgical hub 806 is configured to coordinate information flow to a display of the intelligentsurgical instrument 812, as is described in various U.S. Patent Applications that are incorporated by reference herein in the present disclosure. A diagnostic input or feedback entered by a non-sterile operator at thevisualization tower 818 can be routed by thesurgical hub 806 to thedisplay 819 within the sterile field, where it can be viewed by the operator of thesurgical instrument 812 and/or by other medical practitioner(s) in the sterile field. - The intelligent
surgical instrument 812 and theimaging device 824, which is also an intelligent surgical tool, is being used with the patient in the surgical procedure as part of thesurgical system 802. Other intelligentsurgical instruments 812 a that can be used in the surgical procedure, e.g., that can be removably coupled to thepatient side cart 820 and be in communication with the roboticsurgical system 810 and thesurgical hub 806, are also shown inFIG. 19 as being available. Non-intelligent (or “dumb”)surgical instruments 817, e.g., scissors, trocars, cannulas, scalpels, etc., that cannot be in communication with the roboticsurgical system 810 and thesurgical hub 806 are also shown inFIG. 19 as being available for use. - Operating Intelligent Surgical Instruments
- An intelligent surgical device can have an algorithm stored thereon, e.g., in a memory thereof, configured to be executable on board the intelligent surgical device, e.g., by a processor thereof, to control operation of the intelligent surgical device. In some embodiments, instead of or in addition to being stored on the intelligent surgical device, the algorithm can be stored on a surgical hub, e.g., in a memory thereof, that is configured to communicate with the intelligent surgical device.
- The algorithm is stored in the form of one or more sets of pluralities of data points defining and/or representing instructions, notifications, signals, etc. to control functions of the intelligent surgical device. In some embodiments, data gathered by the intelligent surgical device can be used by the intelligent surgical device, e.g., by a processor of the intelligent surgical device, to change at least one variable parameter of the algorithm. As discussed above, a surgical hub can be in communication with an intelligent surgical device, so data gathered by the intelligent surgical device can be communicated to the surgical hub and/or data gathered by another device in communication with the surgical hub can be communicated to the surgical hub, and data can be communicated from the surgical hub to the intelligent surgical device. Thus, instead of or in addition to the intelligent surgical device being configured to change a stored variable parameter, the surgical hub can be configured to communicate the changed at least one variable, alone or as part of the algorithm, to the intelligent surgical device and/or the surgical hub can communicate an instruction to the intelligent surgical device to change the at least one variable as determined by the surgical hub.
- The at least one variable parameter is among the algorithm's data points, e.g., are included in instructions for operating the intelligent surgical device, and are thus each able to be changed by changing one or more of the stored pluralities of data points of the algorithm. After the at least one variable parameter has been changed, subsequent execution of the algorithm is according to the changed algorithm. As such, operation of the intelligent surgical device over time can be managed for a patient to increase the beneficial results use of the intelligent surgical device by taking into consideration actual situations of the patient and actual conditions and/or results of the surgical procedure in which the intelligent surgical device is being used. Changing the at least one variable parameter is automated to improve patient outcomes. Thus, the intelligent surgical device can be configured to provide personalized medicine based on the patient and the patient's surrounding conditions to provide a smart system. In a surgical setting in which the intelligent surgical device is being used during performance of a surgical procedure, automated changing of the at least one variable parameter may allow for the intelligent surgical device to be controlled based on data gathered during the performance of the surgical procedure, which may help ensure that the intelligent surgical device is used efficiently and correctly and/or may help reduce chances of patient harm by harming a critical anatomical structure.
- The at least one variable parameter can be any of a variety of different operational parameters. Examples of variable parameters include motor speed, motor torque, energy level, energy application duration, tissue compression rate, jaw closure rate, cutting element speed, load threshold, etc.
-
FIG. 20 illustrates one embodiment of an intelligentsurgical instrument 900 including amemory 902 having analgorithm 904 stored therein that includes at least one variable parameter. Thealgorithm 904 can be a single algorithm or can include a plurality of algorithms, e.g., separate algorithms for different aspects of the surgical instrument's operation, where each algorithm includes at least one variable parameter. The intelligentsurgical instrument 900 can be thesurgical device 102 ofFIG. 1 , theimaging device 120 ofFIG. 1 , thesurgical device 202 ofFIG. 8 , theimaging device 220 ofFIG. 8 , thesurgical device 402 ofFIG. 15 , thesurgical device 502 a ofFIG. 17 , thesurgical device 502 b ofFIG. 17 , thesurgical device 712 ofFIG. 18 , thesurgical device 812 ofFIG. 19 , theimaging device 824 ofFIG. 19 , or other intelligent surgical instrument. Thesurgical instrument 900 also includes aprocessor 906 configured to execute thealgorithm 904 to control operation of at least one aspect of thesurgical instrument 900. To execute thealgorithm 904, theprocessor 906 is configured to run a program stored in thememory 902 to access a plurality of data points of thealgorithm 904 in thememory 902. - The
surgical instrument 900 also includes acommunications interface 908, e.g., a wireless transceiver or other wired or wireless communications interface, configured to communicate with another device, such as asurgical hub 910. Thecommunications interface 908 can be configured to allow one-way communication, such as providing data to a remote server (e.g., a cloud server or other server) and/or to a local, surgical hub server, and/or receiving instructions or commands from a remote server and/or a local, surgical hub server, or two-way communication, such as providing information, messages, data, etc. regarding thesurgical instrument 900 and/or data stored thereon and receiving instructions, such as from a doctor; a remote server regarding updates to software; a local, surgical hub server regarding updates to software; etc. - The
surgical instrument 900 is simplified inFIG. 20 and can include additional components, e.g., a bus system, a handle, a elongate shaft having an end effector at a distal end thereof, a power source, etc. Theprocessor 906 can also be configured to execute instructions stored in thememory 902 to control thedevice 900 generally, including other electrical components thereof such as thecommunications interface 908, an audio speaker, a user interface, etc. - The
processor 906 is configured to change at least one variable parameter of thealgorithm 904 such that a subsequent execution of thealgorithm 904 will be in accordance with the changed at least one variable parameter. To change the at least one variable parameter of thealgorithm 904, theprocessor 906 is configured to modify or update the data point(s) of the at least one variable parameter in thememory 902. Theprocessor 906 can be configured to change the at least one variable parameter of thealgorithm 904 in real time with use of thesurgical device 900 during performance of a surgical procedure, which may accommodate real time conditions. - Additionally or alternatively to the
processor 906 changing the at least one variable parameter, theprocessor 906 can be configured to change thealgorithm 904 and/or at least one variable parameter of thealgorithm 904 in response to an instruction received from thesurgical hub 910. In some embodiments, theprocessor 906 is configured to change the at least one variable parameter only after communicating with thesurgical hub 910 and receiving an instruction therefrom, which may help ensure coordinated action of thesurgical instrument 900 with other aspects of the surgical procedure in which thesurgical instrument 900 is being used. - In an exemplary embodiment, the
processor 906 executes thealgorithm 904 to control operation of thesurgical instrument 900, changes the at least one variable parameter of thealgorithm 904 based on real time data, and executes thealgorithm 904 after changing the at least one variable parameter to control operation of thesurgical instrument 900. -
FIG. 21 illustrates one embodiment of amethod 912 of using of thesurgical instrument 900 including a change of at least one variable parameter of thealgorithm 904. Theprocessor 906controls 914 operation of thesurgical instrument 900 by executing thealgorithm 904 stored in thememory 902. Based on any of this subsequently known data and/or subsequently gathered data, theprocessor 904changes 916 the at least one variable parameter of thealgorithm 904 as discussed above. After changing the at least one variable parameter, theprocessor 906controls 918 operation of thesurgical instrument 900 by executing thealgorithm 904, now with the changed at least one variable parameter. Theprocessor 904 can change 916 the at least one variable parameter any number of times during performance of a surgical procedure, e.g., zero, one, two, three, etc. During any part of themethod 912, thesurgical instrument 900 can communicate with one or more computer systems, e.g., thesurgical hub 910, a remote server such as a cloud server, etc., using thecommunications interface 908 to provide data thereto and/or receive instructions therefrom. - Situational Awareness
- Operation of an intelligent surgical instrument can be altered based on situational awareness of the patient. The operation of the intelligent surgical instrument can be altered manually, such as by a user of the intelligent surgical instrument handling the instrument differently, providing a different input to the instrument, ceasing use of the instrument, etc. Additionally or alternatively, the operation of an intelligent surgical instrument can be changed automatically by an algorithm of the instrument being changed, e.g., by changing at least one variable parameter of the algorithm. As mentioned above, the algorithm can be adjusted automatically without user input requesting the change. Automating the adjustment during performance of a surgical procedure may help save time, may allow medical practitioners to focus on other aspects of the surgical procedure, and/or may ease the process of using the surgical instrument for a medical practitioner, which each may improve patient outcomes, such as by avoiding a critical structure, controlling the surgical instrument with consideration of a tissue type the instrument is being used on and/or near, etc.
- The visualization systems described herein can be utilized as part of a situational awareness system that can be embodied or executed by a surgical hub, e.g., the
surgical hub 706, thesurgical hub 806, or other surgical hub described herein. In particular, characterizing, identifying, and/or visualizing surgical instruments (including their positions, orientations, and actions), tissues, structures, users, and/or other things located within the surgical field or the operating theater can provide contextual data that can be utilized by a situational awareness system to infer various information, such as a type of surgical procedure or a step thereof being performed, a type of tissue(s) and/or structure(s) being manipulated by a surgeon or other medical practitioner, and other information. The contextual data can then be utilized by the situational awareness system to provide alerts to a user, suggest subsequent steps or actions for the user to undertake, prepare surgical devices in anticipation for their use (e.g., activate an electrosurgical generator in anticipation of an electrosurgical instrument being utilized in a subsequent step of the surgical procedure, etc.), control operation of intelligent surgical instruments (e.g., customize surgical instrument operational parameters of an algorithm as discussed further below), and so on. - Although an intelligent surgical device including an algorithm that responds to sensed data, e.g., by having at least one variable parameter of the algorithm changed, can be an improvement over a “dumb” device that operates without accounting for sensed data, some sensed data can be incomplete or inconclusive when considered in isolation, e.g., without the context of the type of surgical procedure being performed or the type of tissue that is being operated on. Without knowing the procedural context (e.g., knowing the type of tissue being operated on or the type of procedure being performed), the algorithm may control the surgical device incorrectly or sub-optimally given the particular context-free sensed data. For example, the optimal manner for an algorithm to control a surgical instrument in response to a particular sensed parameter can vary according to the particular tissue type being operated on. This is due to the fact that different tissue types have different properties (e.g., resistance to tearing, ease of being cut, etc.) and thus respond differently to actions taken by surgical instruments. Therefore, it may be desirable for a surgical instrument to take different actions even when the same measurement for a particular parameter is sensed. As one example, the optimal manner in which to control a surgical stapler in response to the surgical stapler sensing an unexpectedly high force to close its end effector will vary depending upon whether the tissue type is susceptible or resistant to tearing. For tissues that are susceptible to tearing, such as lung tissue, the surgical instrument's control algorithm would optimally ramp down the motor in response to an unexpectedly high force to close to avoid tearing the tissue, e.g., change a variable parameter controlling motor speed or torque so the motor is slower. For tissues that are resistant to tearing, such as stomach tissue, the instrument's algorithm would optimally ramp up the motor in response to an unexpectedly high force to close to ensure that the end effector is clamped properly on the tissue, e.g., change a variable parameter controlling motor speed or torque so the motor is faster. Without knowing whether lung or stomach tissue has been clamped, the algorithm may be sub-optimally changed or not changed at all.
- A surgical hub can be configured to derive information about a surgical procedure being performed based on data received from various data sources and then control modular devices accordingly. In other words, the surgical hub can be configured to infer information about the surgical procedure from received data and then control the modular devices operably coupled to the surgical hub based upon the inferred context of the surgical procedure. Modular devices can include any surgical device that is controllable by a situational awareness system, such as visualization system devices (e.g., a camera, a display screen, etc.), smart surgical instruments (e.g., an ultrasonic surgical instrument, an electrosurgical instrument, a surgical stapler, smoke evacuators, scopes, etc.). A modular device can include sensor(s)s configured to detect parameters associated with a patient with which the device is being used and/or associated with the modular device itself.
- The contextual information derived or inferred from the received data can include, for example, a type of surgical procedure being performed, a particular step of the surgical procedure that the surgeon (or other medical practitioner) is performing, a type of tissue being operated on, or a body cavity that is the subject of the surgical procedure. The situational awareness system of the surgical hub can be configured to derive the contextual information from the data received from the data sources in a variety of different ways. In an exemplary embodiment, the contextual information received by the situational awareness system of the surgical hub is associated with a particular control adjustment or set of control adjustments for one or more modular devices. The control adjustments each correspond to a variable parameter. In one example, the situational awareness system includes a pattern recognition system, or machine learning system (e.g., an artificial neural network), that has been trained on training data to correlate various inputs (e.g., data from databases, patient monitoring devices, and/or modular devices) to corresponding contextual information regarding a surgical procedure. In other words, a machine learning system can be trained to accurately derive contextual information regarding a surgical procedure from the provided inputs. In another example, the situational awareness system can include a lookup table storing pre-characterized contextual information regarding a surgical procedure in association with one or more inputs (or ranges of inputs) corresponding to the contextual information. In response to a query with one or more inputs, the lookup table can return the corresponding contextual information for the situational awareness system for controlling at least one modular device. In another example, the situational awareness system includes a further machine learning system, lookup table, or other such system, which generates or retrieves one or more control adjustments for one or more modular devices when provided the contextual information as input.
- A surgical hub including a situational awareness system may provide any number of benefits for a surgical system. One benefit includes improving the interpretation of sensed and collected data, which would in turn improve the processing accuracy and/or the usage of the data during the course of a surgical procedure. Another benefit is that the situational awareness system for the surgical hub may improve surgical procedure outcomes by allowing for adjustment of surgical instruments (and other modular devices) for the particular context of each surgical procedure (such as adjusting to different tissue types) and validating actions during a surgical procedure. Yet another benefit is that the situational awareness system may improve surgeon's and/or other medical practitioners' efficiency in performing surgical procedures by automatically suggesting next steps, providing data, and adjusting displays and other modular devices in the surgical theater according to the specific context of the procedure. Another benefit includes proactively and automatically controlling modular devices according to the particular step of the surgical procedure that is being performed to reduce the number of times that medical practitioners are required to interact with or control the surgical system during the course of a surgical procedure, such as by a situationally aware surgical hub proactively activating a generator to which an RF electrosurgical instrument is connected if it determines that a subsequent step of the procedure requires the use of the instrument. Proactively activating the energy source allows the instrument to be ready for use a soon as the preceding step of the procedure is completed.
- For example, a situationally aware surgical hub can be configured to determine what type of tissue is being operated on. Therefore, when an unexpectedly high force to close a surgical instrument's end effector is detected, the situationally aware surgical hub can be configured to correctly ramp up or ramp down a motor of the surgical instrument for the type of tissue, e.g., by changing or causing change of at least one variable parameter of an algorithm for the surgical instrument regarding motor speed or torque.
- For another example, a type of tissue being operated can affect adjustments that are made to compression rate and load thresholds of a surgical stapler for a particular tissue gap measurement. A situationally aware surgical hub can be configured to infer whether a surgical procedure being performed is a thoracic or an abdominal procedure, allowing the surgical hub to determine whether the tissue clamped by an end effector of the surgical stapler is lung tissue (for a thoracic procedure) or stomach tissue (for an abdominal procedure). The surgical hub can then be configured to cause adjustment of the compression rate and load thresholds of the surgical stapler appropriately for the type of tissue, e.g., by changing or causing change of at least one variable parameter of an algorithm for the surgical stapler regarding compression rate and load threshold.
- As yet another example, a type of body cavity being operated in during an insufflation procedure can affect the function of a smoke evacuator. A situationally aware surgical hub can be configured to determine whether the surgical site is under pressure (by determining that the surgical procedure is utilizing insufflation) and determine the procedure type. As a procedure type is generally performed in a specific body cavity, the surgical hub can be configured to control a motor rate of the smoke evacuator appropriately for the body cavity being operated in, e.g., by changing or causing change of at least one variable parameter of an algorithm for the smoke evacuator regarding motor rate. Thus, a situationally aware surgical hub may provide a consistent amount of smoke evacuation for both thoracic and abdominal procedures.
- As yet another example, a type of procedure being performed can affect the optimal energy level for an ultrasonic surgical instrument or radio frequency (RF) electrosurgical instrument to operate at. Arthroscopic procedures, for example, require higher energy levels because an end effector of the ultrasonic surgical instrument or RF electrosurgical instrument is immersed in fluid. A situationally aware surgical hub can be configured to determine whether the surgical procedure is an arthroscopic procedure. The surgical hub can be configured to adjust an RF power level or an ultrasonic amplitude of the generator (e.g., adjust energy level) to compensate for the fluid filled environment, e.g., by changing or causing change of at least one variable parameter of an algorithm for the instrument and/or a generator regarding energy level. Relatedly, a type of tissue being operated on can affect the optimal energy level for an ultrasonic surgical instrument or RF electrosurgical instrument to operate at. A situationally aware surgical hub can be configured to determine what type of surgical procedure is being performed and then customize the energy level for the ultrasonic surgical instrument or RF electrosurgical instrument, respectively, according to the expected tissue profile for the surgical procedure, e.g., by changing or causing change of at least one variable parameter of an algorithm for the instrument and/or a generator regarding energy level. Furthermore, a situationally aware surgical hub can be configured to adjust the energy level for the ultrasonic surgical instrument or RF electrosurgical instrument throughout the course of a surgical procedure, rather than just on a procedure-by-procedure basis. A situationally aware surgical hub can be configured to determine what step of the surgical procedure is being performed or will subsequently be performed and then update the control algorithm(s) for the generator and/or ultrasonic surgical instrument or RF electrosurgical instrument to set the energy level at a value appropriate for the expected tissue type according to the surgical procedure step.
- As another example, a situationally aware surgical hub can be configured to determine whether the current or subsequent step of a surgical procedure requires a different view or degree of magnification on a display according to feature(s) at the surgical site that the surgeon and/or other medical practitioner is expected to need to view. The surgical hub can be configured to proactively change the displayed view (supplied by, e.g., an imaging device for a visualization system) accordingly so that the display automatically adjusts throughout the surgical procedure.
- As yet another example, a situationally aware surgical hub can be configured to determine which step of a surgical procedure is being performed or will subsequently be performed and whether particular data or comparisons between data will be required for that step of the surgical procedure. The surgical hub can be configured to automatically call up data screens based upon the step of the surgical procedure being performed, without waiting for the surgeon or other medical practitioner to ask for the particular information.
- As another example, a situationally aware surgical hub can be configured to determine whether a surgeon and/or other medical practitioner is making an error or otherwise deviating from an expected course of action during the course of a surgical procedure, e.g., as provided in a pre-operative surgical plan. For example, the surgical hub can be configured to determine a type of surgical procedure being performed, retrieve a corresponding list of steps or order of equipment usage (e.g., from a memory), and then compare the steps being performed or the equipment being used during the course of the surgical procedure to the expected steps or equipment for the type of surgical procedure that the surgical hub determined is being performed. The surgical hub can be configured to provide an alert (visual, audible, and/or tactile) indicating that an unexpected action is being performed or an unexpected device is being utilized at the particular step in the surgical procedure.
- In certain instances, operation of a robotic surgical system, such as any of the various robotic surgical systems described herein, can be controlled by the surgical hub based on its situational awareness and/or feedback from the components thereof and/or based on information from a cloud (e.g., the
cloud 713 ofFIG. 18 ). - Embodiments of situational awareness systems and using situational awareness systems during performance of a surgical procedure are described further in previously mentioned U.S. patent application Ser. No. 16/729,772 entitled “Analyzing Surgical Trends By A Surgical System” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,747 entitled “Dynamic Surgical Visualization Systems” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,744 entitled “Visualization Systems Using Structured Light” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “System And Method For Determining, Adjusting, And Managing Resection Margin About A Subject Tissue” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,729 entitled “Surgical Systems For Proposing And Corroborating Organ Portion Removals” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,778 entitled “Surgical System For Overlaying Surgical Instrument Data Onto A Virtual Three Dimensional Construct Of An Organ” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,751 entitled “Surgical Systems For Generating Three Dimensional Constructs Of Anatomical Organs And Coupling Identified Anatomical Structures Thereto” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,740 entitled “Surgical Systems Correlating Visualization Data And Powered Surgical Instrument Data” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,737 entitled “Adaptive Surgical System Control According To Surgical Smoke Cloud Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,796 entitled “Adaptive Surgical System Control According To Surgical Smoke Particulate Characteristics” filed Dec. 30, 2019, U.S. patent application Ser. No. 16/729,803 entitled “Adaptive Visualization By A Surgical System” filed Dec. 30, 2019, and U.S. patent application Ser. No. 16/729,807 entitled “Method Of Using Imaging Devices In Surgery” filed Dec. 30, 2019.
- Surgical Sealing Devices for a Natural Body Orifice
- In certain embodiments, surgical sealing devices are provided that are configured to allow surgical access into a body cavity through a natural body orifice (e.g., a trachea, a rectum, and the like). In general, the present surgical sealing devices include a seal housing that is configured to be at least partially disposed within a natural body orifice and at least one retention element configured to affix the seal housing to the natural body orifice. Unlike conventional surgical sealing devices that are typically inserted into an incision, the present surgical sealing devices are designed to be inserted into a natural body orifice. As a result, the present surgical sealing devices provide a less traumatic and more direct access point to a natural body lumen or organ (e.g., for introduction and extraction of surgical instruments, fluid exchange, breathing apparatuses, smoke evacuation apparatuses, etc.) that would not otherwise be available through the use of conventional surgical sealing devices.
- In use, as discussed in more detail below, the surgical sealing devices disclosed herein can be used to provide access to a natural body lumen, such as a colon, through a natural body orifice associated therewith. That is, the seal housing can be at least partially positioned within a natural body orifice. Given the contractive nature of a natural body orifice, however, it can be difficult maintain the seal housing within the natural body office. As a result, the surgical sealing devices include at least one retention element (e.g., arranged on an exterior surface of the seal housing) that enables and maintains fixation of the seal housing to the natural body orifice during device use. The at least one retention element can be configured to be deployed inside or outside of the patient's body.
- The seal housing can be positioned and affixed to the natural body orifice in such a way in which a distal portion of the seal housing extends into the natural body orifice, and a proximal portion extends out of the natural body orifice and into the ambient environment (e.g., positioned adjacent to and in contact with an exterior surface of the patient's body, such as the patient's skin. Alternatively, the seal housing can be designed to be entirely positioned within the natural body orifice.
- Further, the seal housing generally includes one or more ports arranged within the seal housing to allow instruments to pass into the natural body lumen from the ambient environment through the natural body orifice. The one or more ports arranged through the seal housing can form pathway(s) into and through the natural body orifice. This can enable controlled fluid exchange through the natural body orifice, and consequently, into and/or out of the natural body lumen associated therewith, introduction and extraction of surgical instruments through the natural body orifice, and the like. As a result, the natural body lumen can be accessed without the need for an incision through the patient's skin.
-
FIG. 22 andFIG. 23 illustrate one embodiment of asurgical sealing device 7000 that is configured to provide access into a natural body lumen or organ (e.g., a lung, a stomach, a colon, or small intestines) through a natural body orifice (e.g., esophagus, rectum, and the like). Therefore, at least a portion of thesurgical sealing device 7000 is configured to be inserted into and stabilized within a natural body orifice. - The
sealing device 7000 includes aseal housing 7100 with ports extending therethrough and at least one retention element on theexterior surface 7101 of theseal housing 7100. While the at least one retention element can have a variety of configurations, in this illustrated embodiment, the at least one retention element includesfirst retention elements 7130 andsecond retention elements 7132. The first andsecond retention elements seal housing 7100 within a natural body orifice. - In use, the
surgical sealing device 7000 can be positioned within a natural body orifice, such as by deforming theseal housing 7100, or a portion thereof (e.g., the outer body member 7104) and inserting theseal housing 7100 in the natural body orifice. The insertion of the seal housing can be performed by hand or by using an insertion tool. The at least one retention element is releasably positioned to thereby affix the seal housing to the natural body orifice. In some embodiments, the at least one retention element can be deployed inside the natural body lumen, whereas in other embodiments, the at least one retention element can be deployed outside of the natural body lumen. The at least one retention member can be releasably positioned concurrently with or subsequently after the sealing housing is positioned at least partially within the natural body lumen. To withdraw thesurgical sealing device 7000 from the natural body orifice, a portion of the seal housing 7100 (e.g., the outer body member 7104) can be gripped with one or both hands (such as at opposite sides of the outer body member 7104) or by a removal instrument, or both, and theseal housing 7100 may be pulled proximally to withdraw theseal housing 7100 from natural body orifice. Prior to gripping the seal housing, the at least one retention element can be moved or otherwise disengaged from tissue defining the natural body orifice or tissue positioned proximate to the natural body orifice. - As shown in
FIG. 22 andFIG. 23 , the first andsecond retention elements exterior surface 7101 of theseal housing 7100. The first andsecond retention elements - In this illustrated embodiment, the first and
second retention elements seal housing 7100 to the natural body orifice. Further, theretention elements seal housing 7100 securely lodged within the natural body orifice. - In other embodiments, the at least one retention element can have a structural configuration that is configured to contact and engage the tissue surrounding or adjacent to the natural body orifice without penetration. That is, the at least one retention element can have a structural configuration that is configured to frictionally engage with the tissue so to prevent the seal housing from further movement within the natural body orifice during use. By way of example, in some embodiments, the at least one retention element can be in the form of an expandable element (e.g., inflatable balloons), as illustrated in Figure X. In use, once the seal housing is inserted (e.g., partially or fully) within the natural body orifice, the expandable element(s) can be inflated, and when the seal housing is to be removed from the natural body orifice, the expandable element(s) can be deflated.
- In some embodiments, when one or more retention elements are expandable elements, these retention elements can configured to be expanded within the natural body orifice (e.g., after at least a portion of the seal housing is inserted into the natural body orifice). In other embodiments one or more retention elements can be configured to be deployed outside of the natural body lumen (e.g., after at least a portion of the seal housing is inserted into the natural body orifice). Alternatively, in certain embodiments, at least one retention element can be configured to be deployed within the natural body orifice, and at least another one retention element can be configured to be deployed outside the natural body orifice. A person skilled in the art will appreciate that the deployable position of the retention elements depends at least upon the position of the retention elements relative to the
seal housing 7100 and the position of theseal housing 7100 relative to the natural body orifice when theseal housing 7100 is inserted therein. -
FIG. 24 illustrates an exemplary embodiment of asurgical sealing device 7400 that includes a sealinghousing 7402 and tworetention elements retention elements FIG. 24 ). Aside from the differences described in detail below, sealingdevice 7400 can be similar to sealing device 7000 (FIG. 22 andFIG. 23 ) and therefore common features are not described in detail herein. As shown, thefirst retention element 7404 is positioned at a first end 7202 a of theseal housing 7402 and thesecond retention element 7406 is positioned at a second end 7202 b of theseal housing 7402. Further, when both the first andsecond retention elements FIG. 24 , they are configured to contact and frictionally engage an internal surface of the natural body orifice. In embodiments where only a portion of thesurgical sealing device 7400 is positioned within the natural body orifice, thesecond end 7402 b of theseal housing 7402 can be positioned outside the natural body orifice (e.g., outside of the body of the patient). In such embodiments, thesecond retention element 7406 can be configured to contact and frictionally engage the outer tissue surface surrounding or adjacent to the natural body orifice (e.g., an external surface of the natural body orifice). - Referring back to
FIG. 22 andFIG. 23 , theseal housing 7100 ofsurgical sealing device 7000 can have a variety of configurations. For example, in this illustrated embodiment, theseal housing 7100 has aninner body member 7102 and anouter body member 7104 that is positioned about theinner body member 7102. In other embodiments, the outer body member can designed so as to extend distally from one end of the inner body member. In certain embodiments, the outer body member can be omitted. - The
inner body member 7102 and theouter body member 7104 can each have a variety of configurations. In this illustrated embodiment, theinner body member 7102 has a generally cylindrical configuration. Theouter body member 7104 includes anannular flange 7106 with an elongatedcylindrical base 7110 extending therefrom. Further, thebase 7110 defines alumen 7112 extending therethrough. Thelumen 7112, as shown inFIG. 22 andFIG. 23 , at least partially houses theinner body member 7102. A person skilled in the art will appreciate that the inner body member and/or the outer body member, and/or portions thereof, can have other suitable shapes and sizes (e.g., oval, elliptical, ovoid, and any combination thereof) and therefore their configurations are not limited to what is shown in the figures. - The
inner body member 7102 and theouter body member 7104 can formed as a unitary structure, permanently coupled to each other, or releasably coupled to each other. For example, in some embodiments, theinner body member 7102 can be configured to be inserted into and/or removed from the lumen 7112 (e.g., while theouter body member 7104 is at least partially positioned within a natural body orifice). In certain embodiments, theouter body member 7104 can be configured to provide assistance in preventing theinner body member 7102 from be pushed through the sealing housing 7100 (e.g., and into the body of the patient), and to assist in removing theinner body member 7102 from theseal housing 7100. For example, during surgery, removal of theinner body member 7102 may be needed for removing damaged or diseased tissue through thelumen 7112 of theouter body member 7104. Further, in addition, or alternatively, theouter body member 7104 can be configured to help prevent theinner body member 7102 from being torn or otherwise damaged by surgical instrument(s) that is/are inserted therethrough (e.g., during surgery). - As further shown in
FIG. 22 andFIG. 23 , theinner body member 7102 includes ports that extend therethrough, and thus, through theseal housing 7100. While theinner body 7102 can include two or more ports, in this illustrated embodiment theinner body member 7102 includes three ports: afirst port 7114, asecond port 7116, athird port 7118. Eachport respective passageway seal housing 7100. Theports - In some embodiments, at least one port can be configured to form a seal (e.g., around an instrument inserted therethrough) and at least another one port can be configured to control the ingress and/or egress of fluid (e.g., liquid, gas, or a combination thereof) between an interior volume of the natural body orifice and an ambient environment. In certain embodiments, at least one port can be configured to seal and control ingress and/or egress of fluid. For purposes of this discussion, the first and
second ports third port 7118 is configured to control the fluid ingress and egress. A person skilled in the art that any of these ports can configured to control fluid ingress and/or egress (e.g., air into and/or out of the natural body orifice, e.g., for breathing or insufflation) and/or to form a seal (e.g., around an instrument inserted therethrough and/or when an instrument is absent, for preventing loss of fluid therethrough). - In some embodiments, sealing element(s) can be positioned within the first port and/or second port to form a seal therein. In some embodiments, the sealing element(s) can be in the form of a thin membrane formed of a flexible material which can be punctured or otherwise pierced by a surgical instrument. In addition, or alternatively, zero closure sealing elements such as a duck bill seal or other suitable seals for sealing in the absence of instrument can be used in association with the ports. The sealing elements can be positioned at any suitable location within the port.
- As shown in
FIG. 22 andFIG. 23 , afirst sealing element 7126 is positioned within thepassageway 7120 of thefirst port 7114 and asecond sealing element 7128 is positioned within the passageway of thesecond port 7116. In some embodiments, the first andsecond sealing elements second sealing elements second sealing elements first sealing element 7126 is positioned proximate to theproximal end 7114 p (e.g., the end closest to the ambient environment during use) of the first port and thesecond sealing element 7128 is positioned proximate to theproximal end 7116 p (e.g., the end closest to the ambient environment during use) of thesecond sealing port 7116. In other embodiments, the first sealing element, the second sealing element, or both, can be positioned at a distal end of the second port and the third port, respectively. - In some embodiments, the
first sealing element 7126, thesecond sealing element 7128, or both can be further configured to limit the direction of airflow while also providing sealed access for the surgical instruments through theseal housing 7100. This can prevent contamination from aerosolized viruses or contagions during treatment due to the advancement and extraction of surgical instruments through thefirst port 7114 and/or thesecond port 7116. Additionally, the first sealing element, the second sealing element, or both can be a one-way valve to allow exhaust to be vented to a fluid trap and particulate filter to control the expiration of contagions. In another exemplary embodiment, thesurgical sealing device 7000 can have a small higher pressure inlet and a larger exhaust port for controlling exhaust gases being expelled from the natural body lumen. - In addition to the insertion and extraction of one or more surgical instruments through the first and
second ports third port 7118 of thesurgical sealing device 7000. That is, in this illustrated embodiment, thethird port 7118 is designed to allow the ingress and egress of fluid between an interior volume of the natural body orifice and an ambient environment. - In certain embodiments, as shown in
FIG. 22 , thethird port 7118 can be operatively connected to avalve 7210. Thevalve 7210 can be configured to monitor a parameter that can be used to control a fluid transfer rate through thethird port 7118. The monitored parameter can be a fluid transfer pressure, a fluid transfer volume, and/or a direction of the fluid transfer therethrough. For example, the valve can include a sensor that is configured to sense the pressure, volume, or flow direction of the fluid as it passes through the valve, and transmit the sensed data to a controller (not shown). If at any time during use, the controller determines that the sensed data is outside of a predetermined range(s), the controller can alter the valve position (e.g., partially close or open the valve relative to its current position) to change the pressure, volume, or flow direction of the fluid therethrough, and consequently, through thethird port 7118. Non-limiting examples of suitable sensors include pressure, temperature, and flow sensors. In other embodiments, a controller can be omitted, and the valve can be structurally configured to control the fluid flow therethrough by itself, and therefore alter the pressure, volume, or flow direction, if needed. - During an electrosurgical procedure, energy devices can delivery mechanical and/or electrical energy to target tissue in order to treat the tissue (e.g., to cut the tissue, cauterize blood vessels and/or coagulate the tissue within and/or near the targeted tissue). The cutting, cauterization, and/or coagulation of tissue can result in fluids and/or particulates being released into the air. Such fluids and/or particulates emitted during a surgical procedure can constitute smoke, for example, which can comprise carbon particles and/or other particles suspended in air. As a result, electrosurgical systems typically employ a surgical evacuation system that captures the resultant smoke from a surgical procedure, and directs the captured smoke through a filter and a smoke exhaust port away from the clinician(s) and/or from the patient(s).
- For example, surgical procedures on a lung can require inhalation and expulsion of breathable air and exhaustion of smoke that is generated during the procedure. In such instances, cooperative control of the smoke evaluation and breathing apparatus can be helpful. As such, the surgical sealing devices disclosed herein can be configured to enable simultaneous trans-seal system use. That is, the present surgical sealing devices can be configured to provide smoke evacuation control of a fluid exchange system that allows cooperative flow of fluid such that, during surgery, the body can continue to receive the intended flow of fluid (e.g., breathable air) while also allowing extraction of a portion of the fluid through a different path to direct the smoke extraction from the patient.
- In some embodiments, the smoke exhaust port can be its own separate port within the seal housing or it can be combined with another port of the seal housing (e.g., a port that is connected to a breathing apparatus that inflates and deflates the lung with breathable air and/or configured for insertion and extraction of surgical instruments), or the smoke evacuator passage can be a working passage of a flexible endoscope inserted through a port of the seal housing for controlling the ingress and egress of lung gasses as needed for breathing and smoke evacuation. If the smoke evacuation is activated when the body is breathing, an additional airflow inlet can be configured as a port of the seal housing to offset the smoke evacuation air flow, resulting in enough air for lung inflation while cooperatively extracting smoke and air form the lung. In some embodiments, the smoke evacuation system can be configured to pass the smoke to an externally connected smoke evacuator pump and filters, while in other embodiments, the smoke evacuation system can be arranged to use the same filters as a primary breathing exhaust system coupled to the breathing passage port of the seal housing. Exemplary smoke evacuator systems suitable for use with the present disclosure are described, for example, in U.S. Pat. No. 11,051,876 entitled “Surgical Evacuation Flow Paths” issued Jul. 6, 2021, U.S. Patent Publication No. 2019/0201088 entitled “Surgical Evacuation System With A Communication Circuit For Communication Between A Filter And A Smoke Evacuation Device” published Jul. 4, 2019, and U.S. Patent Publication No. 2019/0204201 entitled “Adjustments Based On Airborne Particle Properties” published Jul. 4, 2019, the disclosures of which are incorporated herein by reference in their entireties.
-
FIG. 25 illustrates another embodiment of asurgical sealing device 7300. Aside from the differences described in detail below, thesurgical sealing device 7300 can be similar to surgical sealing device 7000 (FIG. 22 andFIG. 23 ) and therefore common features are not described in detail herein. Thesurgical sealing device 7300 is shown at least partially inserted within anatural body orifice 10 formed bytissue 12. Thesurgical sealing device 7300 includes aseal housing 7301 having aninner body member 7302 and an outer body member 7304 that is positioned about theinner body member 7302. Theinner body member 7302 has threeports ports smaller ports 7308, 7310 (e.g., to receive relatively smaller devices, such as graspers, clip appliers, or the like). - Further, the
seal housing 7301 includesfirst retention elements 7312 andsecond retention elements 7314. As shown, thefirst retention elements 7312 extend outward from the elongated cylindrical base 7316 of the outer body member 7304 and thesecond retention elements 7314 extend from abottom surface 7318a of the annular flange 7318 of the outer body member 7304. Thefirst retention elements 7312 engage with aninternal surface 7320 of thenatural body orifice 10 and penetrate portions of thetissue 12 that define suchinternal surface 7320. Since thesurgical sealing device 7300 is only partially inserted into thenatural body orifice 10, the annular flange 7318 of theseal housing 7300 is positioned outside of thenatural body orifice 10. As a result, thesecond retention elements 7314 engage anouter tissue surface 7322 surrounding thenatural body orifice 10 and penetrate portions of thetissue 12 that define such outer surface 7322 (e.g., external surface of the natural body lumen). This penetration by both the first andsecond retention elements tissue 12 affix theseal housing 7301 to thenatural body orifice 10 so as to allow one or more surgical instruments to be inserted and extracted through thenatural body orifice 10 and/or fluid transfer to occur through thenatural body orifice 10. - In some embodiments, the surgical sealing device can include wound protectors for use with natural body orifices that enable introduction and extraction of instruments while limiting instrument to tissue interaction. This limiting of interaction between the tissue and instruments can provide reduced friction between the body wall and the insertion forces of the instruments. The arrangement can minimize damage to the surrounding tissue during manipulation or advancing or retracting of the instruments through the sealing device.
- In some embodiments, the seal housing of the surgical sealing device can be configured as a mechanical fixation point for a flexible scope and/or instruments passing through the seal housing. The seal housing can be arranged such that a fixation point is formed by the seal housing being secured within the natural body orifice, which provides the flexible scope and/or instruments passing through the seal housing a resistive fixation point from which to resist internally generated forces, motions and actions from the instruments manipulating tissue within the body. The fixation point for the instruments would prevent inappropriate loads on the patient during movement of the instruments within the sealing device. The fixation point could be outside of the body and prevent excessive torque from being applied to the body by the instruments through the sealing device.
- While the
seal housings FIG. 22 andFIG. 23 ,FIG. 24 , andFIG. 25 are illustrated as a separate device which to be inserted into a natural body orifice and allows instruments to be inserted therethrough and into a natural body lumen, in other embodiments a seal housing can be arranged on an instrument, such as a gastroscopic bougie, as the instrument is inserted into a natural body orifice. A gastroscopic bougie is commonly understood to be a thin cylinder of rubber, plastic, metal or another material that a medical practitioner inserts into or through a body passageway, such as the esophagus, to diagnose or treat a condition. A bougie may be used to widen a passageway, guide another instrument into a passageway, or dislodge an object. The gastroscopic bougie can include a seal housing having retention elements which are configured to be deployed in the esophagus prior to the stomach. This arrangement would allow laparoscopic access to the stomach while the abdominal cavity is insufflated for procedures such as a tumor resection within the stomach. By arranging the seal housing in the esophagus, the laparoscopic insufflation is prevented from escaping endoluminally, while also allowing bougie to manipulate the stomach and tumor through four-wire control. - Surgical Systems with Port Devices for Instrument Control
- In certain embodiments, surgical systems that enable control of surgical instrument interactions between separate port devices are provided. In general, these systems have two or more port devices (e.g., multi-port devices) that include respective housings that are each configured to allow instruments from respective sets of instruments to be inserted therethrough. The two or more port devices are each designed to provide individualized resistive forces to respective inserted instruments and to allow the inserted instruments to work cooperatively together (e.g., for at least one surgical step of a surgical procedure or at one or more surgical sites, etc.). The two or more port devices are interconnected to each other (e.g., electrically or mechanically) to create an interrelationship between the inserted instruments. This interrelationship enables these instruments to work in combination (e.g., move concurrently or sequentially in the same or different direction relative to each other or in groups) to provide the force(s), retraction, access angle(s), and the like to carry out at least one surgical step (e.g., to provide the intended medial therapy). As a result, these cooperative movements between at least a portion of the inserted instruments can provide a more collaborative surgical environment within the same port or among different ports that can increase precision and help prevent collisions (e.g., of surgical instruments and/or robotic arms).
- A person skilled in the art will understand that the phrase “work cooperatively together” as used herein refers to coordinated movement between two or more inserted instruments in the same port, in separate ports, or a combination thereof based on a location, an orientation, or a motion of at least one inserted instrument of the two or more inserted instruments. Similarly, a person skilled in the art will understand that the coordinated movement between the two or more inserted instruments can occur in the same direction at the same time, in the same direction at different times, opposing directions at the same time, opposing directions at different times, in the same plane at the same time, in the same plane at different times, in two separate planes at the same time, in two different planes at different times, or any combination thereof.
- Each port device is configured to be at least partially disposed with a body. For example, a first port device can be partially inserted into a body (e.g., through a natural orifice or an opening made by an incision) and a second port device can be partially inserted into the (e.g., through a natural orifice or an opening made by an incision). The first and second port devices can be partially inserted within the same physiological space or different physiological spaces. In some embodiments, the first port device can bridge the ambient environment with a first physiological space inside the body (e.g., thoracic cavity or abdomen cavity and the second port device can bridge the ambient environment and a second physiological space that is not directly connected to the first physiological space (e.g., through a natural orifice to inside the colon, esophagus or other physiologic tract). In other embodiments, the first and second physiological spaces are directly connected to each other. For example, in one embodiment, the first port device can be partially inserted into a first abdominal quadrant and the second port device can be partially inserted into a second abdominal quadrant that is different than the first abdominal quadrant.
- The housing of each port device can be positioned and affixed to body in such a way in which a distal portion of the housing extends into the body (e.g., a physiological space), and a proximal portion extends out of the body and into the ambient environment (e.g., positioned adjacent to and in contact with an exterior surface of the patient's body, such as the patient's skin). Alternatively, the housing can be designed to be entirely positioned within the body.
- Further, the housing of each port device generally includes ports arranged within the housing that allow instruments to be inserted therethrough into the body (e.g., a physiological space, such as a one or more cavities within the body) from the ambient environment through a natural body orifice or an opening made by an incision. The ports arranged through the housing can form pathway(s) into and through the body.
- In some embodiments, at least one port of at least one port device can be configured to form a seal around an inserted instrument. In one embodiment, at least one port of the first port device can be configured to form a seal around a respective inserted instrument of a first set of instruments. Alternatively, or in addition, at least one port of the second port device can be configured to form a seal around a respective inserted instrument of a second set of instruments.
- In certain embodiments, sealing element(s) can be positioned within the at least one port to form a seal therein. The sealing element(s) can have a variety of configurations. In some embodiments, the sealing element(s) can be in the form of a thin membrane formed of a flexible material which can be punctured or otherwise pierced by a surgical instrument. Alternatively, or in addition, zero closure sealing elements such as a duck bill seal or other suitable seals for sealing in the absence of instrument can be used in association with the at least one port. The sealing elements can be positioned at any suitable location within the at least one port.
- In some embodiments, when first and second instruments are inserted into respective ports of the first port device, the first port device can be configured to allow the first instrument to move within a first range of motion relative to the first port device and to allow the second instrument to move within a second range of motion relative to the first port device that is at least partially overlaps with the first range of motion. Alternatively, or in addition, when first and second instruments are inserted into respective ports of the second port device, the second port device can be configured to allow the first instrument to move within a first range of motion relative to the second port device and to allow the second instrument to move within a second range of motion relative to the second port device that at least partially overlaps with the first range of motion.
- In use, as discussed in more detail below, the respective port device provides resistive inter-device forces to respective inserted instruments (e.g., to prevent unintended contact between inserted instruments). That is, during movement of an inserted instrument, the port device can restrain movement of the inserted instrument relative to other inserted instruments in the same port device, in at least one other port device, or a combination thereof. The port device(s) of the surgical system are configured to interact at least one inserted instrument in such a way that limits one or more instrument motions. This limitation can be based on, for example, at least one of a location, orientation, and a motion of at least one other instrument of the same set of inserted instruments, at least one other instrument of a different set of inserted instruments, or both.
- The location, orientation, motion, or any combination thereof, of an inserted instrument can be determined, for example, by using one or more tracking device(s) or a tracking system. In some embodiments, the system can include a tracking device that can be associated with one of the first port device or the second port device. The tracking device can be configured in a variety of ways. In certain embodiments, the tracking device can be configured to transmit a signal indicative of a location of the first port device relative to the second port device. Alternatively, or in addition, the tracking device can be configured to transmit a signal indicative of at least one of a location, an orientation, and a motion of at least one inserted instrument in the first port device relative to the second port device. Alternatively, or in addition, the tracking device can be configured to transmit a signal indicative of at least one of a location, an orientation, and a motion of at least one inserted instrument in the second port device relative to the first port device.
- The transmitted signal(s) from the tracking device can be received by a controller. In general, depending on the data of the received signal, the controller can determine at least one or more of the following: a relative location of the first port device and the second port device, at least one of the location, the orientation, and the motion of at least one inserted instrument in the first port device relative to the second port device, or at least one of the location, the orientation, and the motion of the at least one inserted instrument of in the second port device relative to the first port device based on the respective transmitted signal. This information is used as guidance for movement of the inserted instruments individually, as a single group, or as multiple groups. This guidance in combination with the resistive forces applied by the respective port devices can control instrument interaction between the inserted instruments such that the inserted instruments can work cooperatively together at one or more surgical sites and/or to perform at least one surgical step of a surgical procedure.
- An exemplary surgical system can include a variety of features as described herein and illustrated in the drawings. However, a person skilled in the art will appreciate that the surgical systems can include only some of these features and/or it can include a variety of other features known in the art. The surgical systems described herein are merely intended to represent certain exemplary embodiments. Moreover, while the surgical systems are shown and described in connection with a colon, a person skilled in the art will appreciate that these surgical systems can be used in connection with any other suitable natural body lumens or organs.
- Surgery is often the primary treatment for early-stage colon cancers. The type of surgery used depends on the stage (extent) of the cancer, its location in the colon, and the goal of the surgery. Some early colon cancers (
stage 0 and some early stage I tumors) and most polyps can be removed during a colonoscopy. However, if the cancer has progressed, a local excision or colectomy, a surgical procedure that removes all or part of the colon, may be required. In certain instances, nearby lymph nodes are also removed. A hemicolectomy, or partial colectomy, can be performed if only part of the colon is removed. In a segmental resection of the colon the surgeon removes the diseased part of the colon along with a small segment of non-diseased colon on either side. Usually, about one-fourth to one-third of the colon is removed, depending on the size and location of the cancer. Major resections of the colon are illustrated inFIG. 26 , in which (i) A-B is a right hemicolectomy, A-C is an extended right hemicolectomy, B-C is a transverse colectomy, C-E is a left hemicolectomy, D-E is a sigmoid colectomy, D-F is an anterior resection, D-G is a (ultra) low anterior resection, D-H is an abdomino-perineal resection, A-D is a subtotal colectomy, A-E is a total colectomy, and A-H is a total procto-colectomy. Once the resection is complete, the remaining intact sections of colon are then reattached. - During a laparoscopic-assisted colectomy procedure, it is often difficult to obtain an adequate operative field. Often times, dissections are made deep in the pelvis which makes it difficult to obtain adequate visualization of the area. As a result, the lower rectum must be lifted and rotated to gain access to the veins and arteries around both sides of the rectum during mobilization. During manipulation of the lower rectum, bunching of tissue and/or overstretching of tissue can occur. Additionally, a tumor within the rectum can cause adhesions in the surrounding pelvis, and as a result, this can require freeing the rectal stump and mobilizing the mesentery and blood supply before transection and removal of the tumor.
- After a colectomy, the remaining healthy portions of the colon must be reattached to one another to create a path for waste to leave the body. However, when using laparoscopic instruments to perform the colectomy, one single entry port device may not have a large enough range of motion to move the one end of the colon to connecting portion. As such, a second entry port device is therefore needed to laparoscopically insert instruments to help mobilize the colon and/or purchase the one end of the colon from a laparoscopic instrument of the first entry port device and move the one end to the connecting portion. The multiple port devices having multiple instrument inserted therethrough to carry out at least one surgical step or site can increase the chance of surgical errors and collisions between surgical instruments or robotic arms.
- The present surgical systems include multiple port devices (e.g., multi-port devices) that interconnect multiple groups of surgical instruments that can move together while also providing individualized resistive inter-device forces and motions to the surgical instruments. For example, a first port device can be configured to receive a first set of instruments (e.g., two or more instruments) and a second port device can be configured to receive a second set of instruments (e.g., two or more instruments), and when at least one instrument from the first set and from the second set are inserted into the first and second port devices, respectively, these instruments can move together as a single group. Alternatively, or in addition, at least one inserted instrument of the first set can move with at least one instrument of the second set, or vice versa.
-
FIG. 27 illustrates an exemplary embodiment asurgical system 8000 that is configured to for laparoscopic and/or endoscopic access into a body through two or more interconnected multi-port devices.FIG. 28 schematically illustrates thesurgical system 8000 being used in a surgical resection procedure on acolon 10. For purposes of simplicity, certain components of thesurgical system 8000 are not illustrated. - As shown, the
surgical system 8000 includes a firstmulti-port device 8100 and a secondmulti-port device 8200, in which eachmulti-port device - The first
multi-port device 8100 can have a variety of configurations. For example, in some embodiments, as shown inFIG. 27 andFIG. 28 , the firstmulti-port device 8100 includes afirst housing 8101 with afirst port 8102 and asecond port 8104 defined therein. The first andsecond ports FIG. 28 ) can be inserted into thefirst port 8102 and a second instrument 8108 (show in more detail inFIG. 28 ) can be inserted into thesecond port 8104. The first andsecond instruments - In use, the first
multi-port device 8100 interacts with thefirst instrument 8106, thesecond instrument 8108, or both. The firstmulti-port device 8100 can be configured to interact with thefirst instrument 8106 and thesecond instrument 8108 concurrently, separately, or both. By way of example, the firstmulti-port device 8100 interacts with thefirst instrument 8106, and during the interaction, the firstmulti-port device 8100 applies resistive forces to thefirst instrument 8106. These resistive forces limit one or more motions of thefirst instrument 8106 based on at least one of a location, orientation, and a motion of thesecond instrument 8108. A person skilled in the art will understand that the firstmulti-port device 8100 is configured to have a similar interaction with thesecond instrument 8108. - The
first housing 8101 can be formed of one or more suitable material(s). In some embodiments, a first portion of the first housing can be formed of at least one first material and a second portion of the first housing can be formed of at least one second material. In such embodiments, the first portion can be more flexible than the second portion or vice versa. In other embodiments, the first housing is uniformly formed of one or more suitable material(s). A person skilled in the art will understand that the amount and type of resistive forces the first multi-port device applies to any inserted instrument will depend at least upon the material(s) and structural configuration of the first housing and the amount of force and the direction of force applied to the respective port by the inserted instrument. - The first and
second ports first sealing element 8103 and asecond sealing element 8105 can be positioned within thefirst port 8102 and thesecond port 8104, respectively. The sealingelements - In use, the first and
second sealing elements second instruments second instruments multi-port device 8100. In certain embodiments, one or more of the inserted instruments of the firstmulti-port device 8100 can pivotally move relative to thefirst housing 8101. - The second
multi-port device 8200 can have a variety of configurations. For example, in some embodiments, as shown inFIG. 27 , the secondmulti-port device 8200 includes asecond housing 8201 with athird port 8202 and afourth port 8204 defined therein. The third andfourth ports FIG. 28 ) can be inserted into thethird port 8202 and a fourth instrument 8208 (shown in more detail inFIG. 28 ) can be inserted into thefourth port 8204. The third andfourth instruments - In use, the second
multi-port device 8200 interacts with thethird instrument 8206, thefourth instrument 8208, or both. The secondmulti-port device 8200 can be configured to interact with thethird instrument 8206 and thefourth instrument 8208 concurrently, separately, or both. By way of example, the secondmulti-port device 8200 can interact with thethird instrument 8206, and during this interaction, the secondmulti-port device 8200 applies resistive forces to thethird instrument 8206. These resistive forces limit one or more motions of thethird instrument 8206 based on at least one of a location, orientation, and a motion of thefourth instrument 8208. A person skilled in the art will understand that the secondmulti-port device 8200 is configured to have a similar interaction with thefourth instrument 8208. - The
second housing 8201 can be formed of one or more suitable material(s). In some embodiments, a first portion of the second housing can be formed of at least one first material and a second portion of the second housing can be formed of at least one second material. In such embodiments, the first portion can be more flexible than the second portion or vice versa. In other embodiments, the second housing is uniformly formed of one or more suitable material(s). A person skilled in the art will understand that the amount and type of resistive forces the second multi-port device applies to any inserted instrument will depend at least upon the material(s) and structural configuration of the second housing and the amount of force and the direction of force applied to the respective port by the inserted instrument. - The third and
fourth ports third sealing element 8203 and afourth sealing element 8205 can be positioned within thethird port 8202 and thefourth port 8204, respectively. The third andfourth sealing elements - In use, the third and
fourth sealing elements fourth instruments fourth instruments multi-port device 8200. In certain embodiments, one or more of the inserted instruments of the secondmulti-port device 8200 can pivotally move relative to thesecond housing 8201. - Further, the first
multi-port device 8100 and/or the secondmulti-port device 8200 can incorporate various tracking mechanisms, such as electromagnetic (EM) tracked tips, fiber bragg grating, various sensors, etc., to assist in tracking orientation, location, and movement of the instruments. For example, the firstmulti-port device 8100 and the second multi-port device can include afirst tracking device 8110 and asecond tracking device 8210, respectively. Each of the first andsecond tracking devices multi-port devices multi-port devices multi-port devices multi-port devices - In use, with respect to the
first tracking device 8110, as the third andfourth instruments first tracking device 8110 is configured to transmit afirst signal 8112 to acontroller 8002 that includes sensed data associated with thethird instrument 8206, thefourth instrument 8208, or the second set of instruments. That is, thefirst tracking device 8110 is configured to sense, or otherwise track, thethird instrument 8206, thefourth instrument 8208, or both (e.g., the second set of instruments), as such instrument(s) is/are inserted into and moved in the body with or relative to the secondmulti-port device 8200. Alternatively, or in addition, thefirst signal 8112 or an additional signal can include sensed data associated with the secondmulti-port device 8200. Thefirst tracking device 8110 is also configured to transmit asecond signal 8114 to thecontroller 8002 that includes sensed data associated with the first set of instruments and/or the firstmulti-port device 8100 itself. - Once the first and second transmitted
signals controller 8002, thecontroller 8002, based on these signals, can calculate location, position, or motion of thethird instrument 8206, thefourth instrument 8208, or both, relative to the first set of instruments and/or the firstmulti-port device 8100 itself. This creates one or more interrelationships between the first and second sets of instruments, and as a result, at least a portion of the first and second sets of instruments can work cooperatively together at one or more surgical sites and/or to carry out at least one surgical step of a surgical procedure. As shown inFIG. 28 , and as described in more detail below, thefirst instrument 8106 and thethird instrument 8206 are working cooperatively together to handoff thefree end 15 of thecolon 10, and thesecond instrument 8108 and thefourth instrument 8208 are shown working cooperatively together to purchase the same area of thecolon 10. - Similarly, with respect to the
second tracking device 8210, in use, as the first andsecond instruments second tracking device 8210 is configured to transmit athird signal 8212 to thecontroller 8002 that includes sensed data associated with thefirst instrument 8106, thesecond instrument 8108, or the first set of instruments. That is, thesecond tracking device 8210 is configured to sense, or otherwise track, thefirst instrument 8106, thesecond instrument 8108, or both (e.g., the first set of instruments), as such instrument(s) is/are inserted into and moved within the body with or relative to the firstmulti-port device 8100. Alternatively, or in addition, thethird signal 8212 or an additional signal can include sensed data associated with the firstmulti-port device 8100. Thesecond tracking device 8210 is also configured to transmit afourth signal 8214 to thecontroller 8002 that includes sensed data associated with the second set of instruments and/or the secondmulti-port device 8200 itself. - Once the third and fourth transmitted
signals controller 8002, thecontroller 8002, based on these signals, can calculate location, position, or motion of thefirst instrument 8106, thesecond instrument 8108, or both, relative to the second set of instruments and/or the secondmulti-port device 8200 itself. This also creates one or more additional interrelationships between the first and second sets of instruments, and as a result, at least a portion of the first and second sets of instruments can work cooperatively together at one or more surgical sites and/or to carry out at least one surgical step of a surgical procedure. - The tracking mechanism of the first and
second tracking devices first tracking device 8110 can be configured to use magnetic sensing to detect a location, an orientation, or a motion of thethird instrument 8206, thefourth instrument 8208, or both relative to the firstmulti-port device 8100 and/or to determine a location of the secondmulti-port device 8200 relative to the firstmulti-port device 8100. In such instances, thethird instrument 8206, thefourth instrument 8208, or both and/or the secondmulti-port device 8200 includes a respective magnetic fiducial marker (not shown) that is configured to emit a respective magnetic field that can be detected by thefirst tracking device 8110. Alternatively, or in addition, thesecond tracking device 8210 can be configured to use a similar magnetic sensing mechanism to detect a location, an orientation, or a motion of at least one of the first andsecond instruments multi-port device 8200 and/or to determine a location of the firstmulti-port device 8100 relative to the secondmulti-port device 8200. In some embodiment, a magnetic tracking system is configured to output a defined directional field relative to the magnet, its orientation, and near-by metallic systems. When the magnet is a permanent magnet, the field is of a predefined intensity, size, and orientation. Since the field is vector directional, a magnetic sensor within the directional field is configured to sense from the intensity, direction of the magnet vectors, and change of those measures over time where the sensor is within the directional field and orientation of the sensor with respect to the magnet. When the magnet is an electro-magnet, the intensity and field direction can be alternated and changed as directed, which mitigates metal impacts on the field and interferences as well as increase accuracy. “DESIGN OF A MAGNETIC FIELD-BASED MULTI DEGREE-OF-FREEDOM ORIENTATION SENSOR USING THE DISTRBUTED-MULTIPLE-POLE MODEL” from Proceedings of IMECE2007 2007 ASME International Mechanical Engineering Congress and Exposition Nov. 11-15, 2007, Seattle, Wash., USA illustrates and describes multi-degree freedom magnetic field tracking. - For another example, the
first tracking device 8110 can be configured to use common anatomic landmarks to detect a location, an orientation, or a motion of thethird instrument 8206, thefourth instrument 8208, or both relative to the firstmulti-port device 8100 and/or a location of the secondmulti-port device 8200 relative to the firstmulti-port device 8100. Alternatively, or in addition, thesecond tracking device 8210 can be configured to use common anatomic landmarks to detect a location, an orientation, or a motion of at least one of the first andsecond instruments multi-port device 8100 relative to the secondmulti-port device 8200. In some embodiments, the use of physiologic landmarks, and the distances and focal aspects of these landmarks with respect to an imaging system enable the imaging system to use the same imaging and distance measurements to determine the location and orientation of the instruments with respect to the anatomic location. These “reference” points would enable the system to using imaging & pre-operative imaging to scale the measures allowing them to more accurately correct for focus or depth measures of the system. In certain embodiments, 3D imaging systems and/or Lidar imaging systems can both be used to enhance or replace the optical measurements with respect to the surgical sites. - For yet another example, a structured light scan can be used to create a 3D map. Electromagnetic tracking of the first
multi-port device 8100, the secondmulti-port device 8200 and theinstruments multi-port device 8100 and the first andsecond instruments multi-port device 8200 and third andfourth instruments colon 10 between the quadrants. Alternatively, or in addition, a line as registered in space can be communicated to the secondmulti-port device 8200 and the third andfourth instruments colon 10 between the quadrants. - Alternatively, for yet another example, the physical mechanical linkage angles between robotic arms holding the surgical instruments and their predefined lengths can be used to enhance a visual system's calculation of depth and focal distance between surgical instruments and a surgical site. By using the linkage angles and predefined length, the system can achieve triangulation of the instruments within a patient in order to “calibrate” or compensate for optical losses by the imaging system.
- For still another example, the
first tracking device 8110 can be an optical sensor that can be configured to detect a fiducial marker on the third instrument, the fourth instrument, and/or the second multi-port device. Alternatively, or in addition, the second tracking device can be an optical sensor that is configured to detect a fiducial marker on the first instrument, the second instrument, and/or the first multi-port device. Any number of multi-ports and/or surgical instruments can be tracked in this way during performance of a surgical procedure. - In some embodiments, controlling cooperative surgical instrument interactions includes using smart device location cooperatively with scope tracking. In general, a non-magnetic sensing system can be used for 3D tracking to provide X, Y, Z coordinates using a single receiver and at least one emitter. A time-of-flight distance sensor system, discussed above, may thus be used.
- For example, the non-magnetic sensing system can include ultrasonic sensor technology and radiofrequency (RF) sensor technology. A time of flight system can include an emitter and a receiver. To facilitate controlling cooperative surgical imaging interactions, the emitter includes an ultrasonic sensor (ultrasonic beacon) configured to transmit ultrasonic pulses, and the receiver includes an RF receiver configured to transmit an RF signal that commands the emitter to begin transmitting the ultrasonic pulses. The ultrasonic pulses are reflected back by object(s) within their range. The RF receiver is configured to record the ultrasonic pulses and to, based on the recorded ultrasonic pulses, calculate 3D coordinates (X, Y, Z) of the emitter. The sound propagation time of the ultrasonic pulses allows the RF receiver to calculate the 3D coordinates and to calculate distance to objects.
-
FIG. 28 illustrates a schematic view of thesurgical system 8000 being used during a colon resection procedure. As explained above, thefirst tracking device 8110 of the firstmulti-port device 8100 can track thethird instrument 8206, thefourth instrument 8208, or both, and thesecond tracking device 8210 of the secondmulti-port device 8200 can track the location offirst instrument 8106, thesecond instrument 8108, or both, while the instruments are inserted into their respective port devices and arranged within the body. Further, the first andsecond instruments second graspers fourth instruments fourth graspers colon 10 and the mobilizedsection 12 thereof and help reattach the mobilizedsection 12 to therectum 14. - As shown in
FIG. 28 , the first andsecond instruments multi-port device 8100 are arranged in the upper left quadrant of the abdominal cavity to mobilize the transverse and descendingcolon 10. The third andfourth instruments multi-port device 8200 are arranged in the lower left quadrant of the abdominal cavity to mobilize and create an incision along line IL to remove a tumor in the descending colon or sigmoid. Each set of instruments is accessing the abdominal cavity together through respectivemulti-port devices second instruments fourth instruments - Due to the location of the first and second
multi-port devices instruments section 12 of thecolon 10 transiting from the upper left quadrant to the lower right quadrant. Prior to and/or during the handoff, thefirst tracking device 8110 transmits the first andsecond signals controller 8002 and/or thesecond tracking device 8210 transmits the third andfourth signals controller 8002. The resulting interrelationship between the first and secondmulti-port devices 8100, 8200 (e.g., by way of the first and/or second tracking devices) enables triangulation and opposed motion of theinstruments free end 15 toward the rectum for attachment. More specifically, as shown inFIG. 28 , thesecond instrument 8108 and thefourth instrument 8208 are purchasing the same area of thecolon 10, and thethird instrument 8206 is ready to grasp thefree end 15 of thecolon 10 from thefirst instrument 8106 to move thefree end 15 towards therectum 14. - Any one or more of the exemplary surgical systems, port devices and related methods described herein, and variations thereof, can be implemented in conventional surgical procedures conducted by a medical professional as well as in robotic-assisted surgical procedures. Various teachings herein may be readily incorporated into a robotic surgical system such as one or more of the DAVINCI™ systems by Intuitive Surgical, Inc., of Sunnyvale, Calif., including their SP™ surgical system. Exemplary robotic surgical systems and related features, which may be combined with any one or more of the exemplary surgical access devices and methods disclosed herein, are disclosed in the following: U.S. Pat. No. 8,068,649, entitled “Method and Apparatus for Transforming Coordinate Systems in a Telemanipulation System,” issued Nov. 29, 2011; U.S. Pat. No. 8,517,933, entitled “Retraction of Tissue for Single Port Entry, Robotically Assisted Medical Procedures,” issued Aug. 27, 2013; U.S. Pat. No. 8,545,515, entitled “Curved Cannula Surgical System,” issued Oct. 1, 2013; U.S. Pat. No. 8,551,115, entitled “Curved Cannula Instrument,” issued Oct. 8, 2013; U.S. Pat. No. 8,623,028, entitled “Surgical Port Feature,” issued Jan. 7, 2014, the disclosure of which is incorporated by reference herein; U.S. Pat. No. 8,771,180, entitled “Retraction of Tissue for Single Port Entry, Robotically Assisted Medical Procedures,” issued Jul. 8, 2014, the disclosure of which is incorporated by reference herein; U.S. Pat. No. 8,888,789, entitled “Curved Cannula Surgical System Control,” issued Nov. 18, 2014; U.S. Pat. No. 9,254,178, entitled “Curved Cannula Surgical System,” issued Feb. 9, 2016; U.S. Pat. No. 9,283,050, entitled “Curved Cannula Surgical System,” issued Mar. 15, 2016; U.S. Pat. No. 9,320,416, entitled “Surgical Instrument Control and Actuation,” issued Apr. 26, 2016, the disclosure of which is incorporated by reference herein; U.S. Pat. No. 9,339,341, entitled “Direct Pull Surgical Gripper,” issued May 17, 2016; U.S. Pat. No. 9,358,074, entitled “Multi-Port Surgical Robotic System Architecture,” issued Jun. 7, 2016; U.S. Pat. No. 9,572,481, entitled “Medical System with Multiple Operating Modes for Steering a Medical Instrument Through Linked Body Passages,” issued Feb. 21, 2017; U.S. Pat. No. 9,636,186, entitled “Multi-User Medical Robotic System for Collaboration or Training in Minimally Invasive Surgical Procedures,” issued May 2, 2017; U.S. Pat. Pub. No. 2014/0066717, entitled “Surgical Port Feature,” published Mar. 6, 2014, issued as U.S. Pat. No. 10,245,069 on Apr. 2, 2019, the disclosure of which is incorporated by reference herein; U.S. Pat. Pub. No. 2017/0128041, entitled “Laparoscopic Ultrasound Robotic Surgical System,” published May 11, 2017; and U.S. Pat. Pub. No. 2017/0128144, entitled “Laparoscopic Ultrasound Robotic Surgical System,” published May 11, 2017, the disclosure of which is incorporated by reference herein; and U.S. Pat. Pub. No. 2017/0128145, entitled “Laparoscopic Ultrasound Robotic Surgical System,” published May 11, 2017. The disclosure of each of these references is incorporated by reference herein.
- Surgical Sealing Systems for Instrument Stabilization
- In various surgical procedures, a surgeon may need to direct two or more surgical instruments into a body cavity simultaneously in order to gain access to and provide effective treatment to tissue. It is generally desirable, however, to minimize the number of surgical openings that need to be formed in the patient (e.g., in a patient's abdominal wall) to thereby mitigate tissue trauma, cosmetic damage, and post-operation recovery time for the patient. Accordingly, surgical sealing systems are provided that generally include a sealing device having a seal housing with ports for receiving surgical instruments.
- In general, the ports of the seal housing are designed to control or limit the motions of at least one instrument inserted through a respective port such that the instrument can stabilize another instrument inserted through a respective other port. Each of the ports can have a nominal size and shape and each can be configured to assume a selected size and/or shape that is different from the nominal size and/or shape. A person skilled in the art will understand that a nominal size and a nominal shape refer to a size and shape of a port without a force applied thereto. Similarly, a person skilled in the art will understand that a selected size and a selected shape of a port refers to a size and shape of a port when a force is applied to the port, such as by an instrument being inserted therethrough. It will be further understood by a person skilled in the art that the selected size and the selected shape will depend on the amount of force and the direction of force applied to the port, such as by the instrument.
- The selected size and/or shape of each port can be constrained by the size and shape of each of the other plurality of ports. As a result, forces applied to one port can affect the size and shape of the other ports. The force can be applied by an instrument that is disposed within one port of the plurality of ports. The force applied thereto is therefore effective to change the size and/or shape of the ports based on the movement, direction, and force of the instrument. Since the ability to alter to the nominal shape of any one port is therefore constrained or limited by the size and/or shape of the other ports, a force applied to one instrument positioned within one of the plurality of ports is configured to stabilize at least one other instrument positioned within others of the plurality of ports.
-
FIG. 29 andFIG. 30 illustrate asurgical sealing device 9000 that includes aseal housing 9002 with a predetermined size and shape andports FIG. 29 andFIG. 30 , theseal housing 9002 is illustrated in its predetermined size and shape. Theseal housing 9002 can have a variety of configurations. For example, in this illustrated embodiment, theseal housing 9002 has aninner body member 9004 and anouter body member 9005 that is positioned about theinner body member 9004. In certain embodiments, theinner body member 9004 can be flexible relative to theouter body member 9005 or vice versa. Stated differently, theouter body member 9005 can be rigid relative to theinner body member 9004 or vice versa. In one embodiment, the inner body member and the outer body member are formed of the same material. - While any number of ports can be formed in the
seal housing 9002, in this illustrated embodiment, fourports housing 9002. The ports can be formed in any suitable portion(s) of theseal housing 9002. For example, as shown inFIG. 29 andFIG. 30 , all theports inner body member 9004 of theseal housing 9002. Further, theports seal housing 9002 and each other, as discussed in more detail below. Such a configuration can help prevent interference between surgical instruments inserted through thevarious ports surgical sealing device 9000 provides access thereto. - In some embodiments, as shown in
FIG. 29 andFIG. 30 , thesealing device 9000 can include aretractor 9006 that couples to and extends from adistal end 9002d of theseal housing 9002. Theretractor 9006 can be configured to be placed in any opening within a patient's body, whether a natural body orifice or an opening made by an incision. As such, theretractor 9006 can function as a support structure for theseal housing 9002 and form a pathway through the opening in a patient's body so that surgical instruments can be inserted through theports separate retention element 9007 can be used arranged on the exterior surface ofretractor 9006, as shown inFIG. 29 , and/or the exterior surface of the seal housing 9100. - The
ports port 9012 can include asealing element 9021 arranged within thechannel 9013 of theport 9012, and theport 9014 can include asealing element 9023 arranged within thechannel 9015 of theport 9014. While not illustrated, a person skilled in the art will appreciate that one or more of the other ports can include a sealing element (e.g., sealing element(s) structurally similarly to sealingelements 9021, 9023). - In some embodiments, the sealing element(s) can be in the form of a thin membrane formed of a flexible material which can be punctured or otherwise pierced by a surgical instrument. In addition, or alternatively, zero closure sealing elements such as a duck bill seal or other suitable seals for sealing in the absence of instrument can be used in association with the ports. The sealing elements can be positioned at any suitable location within the port.
- The
surgical sealing device 9000 can also include aninsufflation port 9016 supported by theseal housing 9002, although a person skilled in the art will appreciate that theinsufflation port 9016 can be located in other locations. A person skilled in the art will also appreciate that theinsufflation port 9016 can have a variety of configurations. Generally, theinsufflation port 9016 can be configured to pass an insufflation fluid into and/or out of a body cavity to which thesurgical sealing device 9000 provides access to. -
FIG. 31 andFIG. 32 are schematic bottom views of thesurgical sealing device 9000 with theretractor 9006 and thesealing elements ports port 9008 can have a diameter D1,port 9010 can have a diameter D2, andports insufflation port opening 9016 can have any diameter D4. The diameter D3 of theports ports - When an instrument is inserted into one of the
ports FIG. 31 , theports nominal shape nominal shape ports port 9008 has a nominal size andshape 9009 when no instrument is arranged therein. In certain embodiments, the seal housing 9100 can have a diameter D5, which can be fixed or adjustable. - Each of the plurality of
ports shape shape 9018′, 9020′ that is different from the nominal size andshape shape 9018′, 9020′ of each port is constrained by the size and shape of each of the other plurality of ports. Additionally, the altered diameter D3′ of theports FIG. 32 , theports port ports ports port 9010. - An example of how the
ports shapes 9009′, 9018′, 9020′ is as follows. An instrument (not shown) is inserted into eachrespective port port 9008 is pivoted along the X-axis, theport 9008 changes from a nominal size andshape 9009 to a selected size andshape 9009′ as a result of the instrument applying a force to theport 9008, causing theport 9008 react and change to an elongated shape along the X-axis. As theport 9008 is in the selected size andshape 9009′, the instrument in theport 9012 can be moved along the Z-axis. However, due to theport 9008 already being elongated along the X-axis, theport 9012 will change from the nominal size andshape 9018 to the selected size andshape 9018′. As illustrated inFIG. 32 , theport 9012 becomes elongated at an approximately 45° angle from the Z-axis, which was the intended axis of travel for the instrument. If theport 9008 was not in the selected size andshape 9009′, then the selected size and shape of theport 9012 can be parallel to the Z-axis since theport 9008 would not be blocking the movement of theport 9012. - Additionally, the
port 9014 operates similarly to theport 9012 where the intended direction of an instrument within theport 9014 is parallel to the Z-axis. However, similar to theport 9012, the selected size andshape 9020′ of theport 9014 is limited by the selected size andshape 9009′ of theport 9008. This forces theport 9014 to elongate at approximately a 135° angle relative to the Z-axis when moving from the nominal size andshape 9020 to the selected size andshape 9020′. - In certain embodiments, if the selected size and
shape 9018′ of theport 9012 was instead parallel to the X-axis, and the selected size andshape 9009′ of theport 9008 remained parallel to the X-axis, then the selected size and shape of theport 9014 would be limited to moving only in the +Z axis and the +X-axis since the −Z axis would be blocked by theport 9008 and the −X-axis would be blocked by theport 9012. - In some embodiments, the sealing device can include restraining elements that can further control some but not all the movements and forces of the instruments inserted into the sealing device. For example, as shown in
FIG. 30 ,port 9010 can includes arigid structure 9011 encapsulated by theinner body member 9004. In other embodiments, one or more ports can include rigid restraining elements while one or more other ports can include flexible restraining elements that allows some movement in predefined directions of the ports with respect to each other while preventing other movements. In certain embodiments, the seal housing includes restraining features positioned in at least some directions tangential to the ports to substantially prevent stretching or movement of one port relative to another. This can be done in multiple planes for the same port or in selective directions to allow the port to float in other directions to improve maintenance of the seal around the instrument being inserted through the sealing device. - In certain embodiments, one of the inserted instruments within one of the ports of the seal housing can function as a central anchoring tool. The central anchoring tool can be a designated instrument within one of the ports of the seal housing which supports the remaining instruments passing through other ports within the seal housing. In some embodiments, the central anchoring tool can be an instrument that does not interact with tissue directly, such as a camera or scope device passing through a port. Alternatively, the central anchoring tool can be an instrument (e.g., graspers, electrosurgical tool, etc.) that interacts with the tissue so that the additional instruments can be manipulated and supported without altering the anchor point of the seal housing.
FIG. 33 illustrates an exemplarycentral anchor tool 9017 inserted intoport 9014 of sealingdevice 9000. - In certain embodiments, at least one of the ports can include a threaded restraint arranged within a respective port, for example, as illustrated in
FIG. 34 . Aside from the differences described in detail below, sealingdevice 9200 can be similar to sealing device 9000 (FIG. 29 ) and therefore common features are not described in detail herein. As shown a first threadedrestraint 9202 is configured to be arranged in afirst port 9204 and a second threadedrestraint 9206 is configured to be arranged insecond port 9208. Each threadedrestraint respective port seal housing 9209 and each of the threadedrestraints restraints restraints cylindrical body threads outer surface threads threads second ports - During use, as an instrument is inserted into and rotated within the
first port 9204 or thesecond port 9208, the respective first or second threadedrestraint restraint seal housing 9209. As the threadedrestraint restraint seal housing 9209. While fixated, the instrument can serve as an anchor for the other instruments within theother ports seal housing 9209. - In other embodiments, the sealing systems can include integrated mechanism or electronic activated restriction systems to provide selective support or floating (e.g., moving) operation. For example, a fluidic coupling cylinder with a selectively sizeable valve can be employed on or in the seal housing to inhibit motion. In certain embodiments, a solenoid valve can be used to inhibit circular fluid motion.
- In some embodiments, the ports can be configured to change shape and size in response to an external energy being applied to the ports. For example, each of the plurality of
ports ports ports - Any one or more of the exemplary surgical sealing systems, devices and related methods described herein, and variations thereof, can be implemented in conventional surgical procedures conducted by a medical professional as well as in robotic-assisted surgical procedures. Various teachings herein may be readily incorporated into a robotic surgical system such as one or more of the DAVINCI™ systems by Intuitive Surgical, Inc., of Sunnyvale, Calif., including their SP™ surgical system. Exemplary robotic surgical systems and related features, which may be combined with any one or more of the exemplary surgical access devices and methods disclosed herein, are disclosed in the following: U.S. Pat. No. 8,068,649, entitled “Method and Apparatus for Transforming Coordinate Systems in a Telemanipulation System,” issued Nov. 29, 2011; U.S. Pat. No. 8,517,933, entitled “Retraction of Tissue for Single Port Entry, Robotically Assisted Medical Procedures,” issued Aug. 27, 2013; U.S. Pat. No. 8,545,515, entitled “Curved Cannula Surgical System,” issued Oct. 1, 2013; U.S. Pat. No. 8,551,115, entitled “Curved Cannula Instrument,” issued Oct. 8, 2013; U.S. Pat. No. 8,623,028, entitled “Surgical Port Feature,” issued Jan. 7, 2014, the disclosure of which is incorporated by reference herein; U.S. Pat. No. 8,771,180, entitled “Retraction of Tissue for Single Port Entry, Robotically Assisted Medical Procedures,” issued Jul. 8, 2014, the disclosure of which is incorporated by reference herein; U.S. Pat. No. 8,888,789, entitled “Curved Cannula Surgical System Control,” issued Nov. 18, 2014; U.S. Pat. No. 9,254,178, entitled “Curved Cannula Surgical System,” issued Feb. 9, 2016; U.S. Pat. No. 9,283,050, entitled “Curved Cannula Surgical System,” issued Mar. 15, 2016; U.S. Pat. No. 9,320,416, entitled “Surgical Instrument Control and Actuation,” issued Apr. 26, 2016, the disclosure of which is incorporated by reference herein; U.S. Pat. No. 9,339,341, entitled “Direct Pull Surgical Gripper,” issued May 17, 2016; U.S. Pat. No. 9,358,074, entitled “Multi-Port Surgical Robotic System Architecture,” issued Jun. 7, 2016; U.S. Pat. No. 9,572,481, entitled “Medical System with Multiple Operating Modes for Steering a Medical Instrument Through Linked Body Passages,” issued Feb. 21, 2017; U.S. Pat. No. 9,636,186, entitled “Multi-User Medical Robotic System for Collaboration or Training in Minimally Invasive Surgical Procedures,” issued May 2, 2017; U.S. Pat. Pub. No. 2014/0066717, entitled “Surgical Port Feature,” published Mar. 6, 2014, issued as U.S. Pat. No. 10,245,069 on Apr. 2, 2019, the disclosure of which is incorporated by reference herein; U.S. Pat. Pub. No. 2017/0128041, entitled “Laparoscopic Ultrasound Robotic Surgical System,” published May 11, 2017; and U.S. Pat. Pub. No. 2017/0128144, entitled “Laparoscopic Ultrasound Robotic Surgical System,” published May 11, 2017, the disclosure of which is incorporated by reference herein; and U.S. Pat. Pub. No. 2017/0128145, entitled “Laparoscopic Ultrasound Robotic Surgical System,” published May 11, 2017. The disclosure of each of these references is incorporated by reference herein.
-
FIG. 35 illustrates an exemplary embodiment of tworobotic arms surgical instrument robotic arms control system 9308 having a console, with adisplay 9310, acontroller 9312, and auser input device 9314. As shown, sealhousing 9316 is partially inserted into a patient'sbody 9318, and eachsurgical instrument respective port seal housing 9316. In certain embodiment, the robotic arm(s) 9300, 9302 can be configured to create a compression loading around the ports to the prevent motion of thesurgical instruments - In some embodiments, the
controller 9312 is configured to receive a force reading from at least one of the plurality ofports FIG. 32 ) based on the movement, direction, and force of an instrument. For example, a force sensor (not shown) can be arranged on eachrobotic arm controller 9312. Based on the measured force readings, thecontroller 9312 can determine a selected size andshape 9018′, 9020′ ofports 9012, 9014 (seeFIG. 32 ) based on the amount of force the insertedinstruments such ports shape 9018′, 9020′, the robotic arm(s) 9300, 9302 can be moved by the user in such a way that can alter the size and shape of theports other ports - In certain embodiments, a tool driver restraint of a trocar access port can be used in combination with the
surgical sealing device 9000. The trocar access port can be used to limit the force applied to an instrument shaft, allowing for a robotic arm to control the forces. The robotic arm restraint of the trocar access port can be used to allow the tool driver restraint to provide a stabilizing force to thesurgical sealing device 9000, and not instruments inserted through the ports. In this embodiment, the diameter of the trocar access port is the key rigidity factor, rather than the diameter D5 of thesurgical sealing device 9000. In certain embodiments, a cannula from which multiple instruments are deployed from does not have a static end lumen. Instead, the cannula is segmented into two or more curved members. The curved members can be driven to different depths within tissue to provide for a local force reaction to the instrument that is against that respective cannula segment. - In certain embodiments, one of the ports can further include a locking arm configured to lock a position of the at least one port relative to the seal housing.
FIG. 36 illustrates an exemplary embodiment of aseal housing 9402 having aslot 9403 arranged therein such that alocking arm 9404 can pass through theslot 9403 and into theseal housing 9402. As shown, thelocking arm 9404 include lockingtabs 9406, which are configured to be selectively depressed to allow the locking arm 9405 to move relative to theseal housing 9402. Arranged at a distal end of thelocking arm 9404 is aport 9412, with aninstrument 9410 arranged within theport 9412. Due to the arrangement of thelocking arm 9404, theport 9412 can be moved relative to theseal housing 9402. Other suitable configurations of a locking arm are also contemplated herein. For example, another configuration of the locking arm can include a base member having a plurality of rotatable rings. A top rotatable ring can contain a flexible sealing member, and one or more other rotatable rings each can have sealing arms extending therefrom and can be stacked one on top of the other beneath the sealing member. Each ring can be individually rotatable relative to the other rings and relative to the sealing member. Each of the sealing arms can include a sealing element positioned at one end thereof and configured to form a seal around an instrument inserted therethrough. -
FIG. 37 andFIG. 38 illustrate an exemplary embodiment of alocking seal 9500 arranged within at least oneport 9502 of aseal housing 9504. The lockingseal 9500 can be in the form of a honeycomb locking structure which interacts with aninstrument 9510 passing therethrough. The shape of thelocking seal 9500 can be adjusted through the application of external energy, such as heat, light, or electrical current. As illustrated inFIG. 38 , after exposure to external energy, the lockingseal 9500 can deform into afirst portion 9506 and asecond portion 9508. When deformed, thesecond portion 9508 can contact theinstrument 9510 so that theinstrument 9510 is locked in position to theseal housing 9504. - In certain embodiments, a surgical sealing device can further include changeable ports as restraining means to control some, but not all movements and forces of instruments inserted therethrough the ports of the surgical sealing device. The ports of the surgical sealing device can include sections that are formed from 4D printed material and then over molded into an elastomer section of a seal with a port. 4D printing is an additive manufacturing process through which a 3D printed object includes transformable components (e.g., hydrogel, shape memory polymer) such that the 3D printed object transforms itself into another structure over the influence of external energy input as temperature, light or other environmental stimuli. 4D printing is similar to 3D printing in the sense that an object is also built layer by layer, but the object can then change over time after its initial manufacture. The object will change because it is printed with materials that have the ability to change when exposed to certain factors: such as heat, magnetic, water, light or another source of energy.
- In some embodiments, the ports including a 4D printed material initially can be in a flexible condition to allow for introduction and manipulation of instruments through the ports. At defined conditions, the surgical sealing device can have an external energy applied thereto to alter the structure of the 4D printed material thus changing the geometry of the seal interface with respect to the instrument and/or lock to the seal itself. Additionally, the 4D printed material can interlock all the ports of a surgical sealing device and instruments inserted therein to create rigid restraints allowing some movement of the instruments in predefined directions with respect to each other while preventing some movements of the instruments in other directions. The prevention of movement in some directions allows for an instrument interacting with the 4D printed material to stabilize the other instruments within the surgical sealing device.
- An example of how a 4D printed material would interact with an instrument within a port is as follows. A honeycomb structure can be formed of 4D printed material and integrated with the pivotal seals within each of the ports of the surgical sealing device. The honeycomb structure can be in a triangular or hexagonal pattern that allows an instrument shaft to freely pass through the seal. When needed or activated by heat, pressure, light or an energy source, the honeycomb structure alters its form for to make contact with the instrument shaft. Contact is made by the triangular or hexagonal honeycomb bending inward towards the instrument shaft, compressing the honeycomb structure and/or seal material against the shaft.
- In certain embodiments, the surgical sealing device can include a 3D printed housing support structure having an elastomer structural member. The elastomer structural member can be pneumatically actuated between a fix and no fixed state in order to fixate instrument inserted through the ports of the surgical sealing system.
- The surgical devices disclosed herein can be designed to be disposed of after a single use, or they can be designed to be used multiple times. In either case, however, the surgical devices can be reconditioned for reuse after at least one use. Reconditioning can include any combination of the steps of disassembly of the surgical devices, followed by cleaning or replacement of particular pieces and subsequent reassembly. In particular, the surgical devices can be disassembled, and any number of the particular pieces or parts of the surgical devices can be selectively replaced or removed in any combination. Upon cleaning and/or replacement of particular parts, the surgical devices can be reassembled for subsequent use either at a reconditioning facility, or by a surgical team immediately prior to a surgical procedure. Those skilled in the art will appreciate that reconditioning of a surgical device can utilize a variety of techniques for disassembly, cleaning/replacement, and reassembly. Use of such techniques, and the resulting reconditioned instrument, are all within the scope of the present application.
- Further, in the present disclosure, like-named components of the embodiments generally have similar features, and thus within a particular embodiment each feature of each like-named component is not necessarily fully elaborated upon. Additionally, to the extent that linear or circular dimensions are used in the description of the disclosed systems, devices, and methods, such dimensions are not intended to limit the types of shapes that can be used in conjunction with such systems, devices, and methods. A person skilled in the art will recognize that an equivalent to such linear and circular dimensions can easily be determined for any geometric shape. Sizes and shapes of the systems and devices, and the components thereof, can depend at least on the anatomy of the subject in which the systems and devices will be used, the size and shape of components with which the systems and devices will be used, and the methods and procedures in which the systems and devices will be used.
- It will be appreciated that the terms “proximal” and “distal” are used herein with reference to a user, such as a clinician, gripping a handle of an instrument. It will be appreciated that the terms “proximal” and “distal” are used herein, respectively, with reference to the top end (e.g., the end that is farthest away from the surgical site during use) and the bottom end (e.g., the end that is closest to the surgical site during use) of a surgical instrument, respectively, that is configured to be mounted to a robot. Other spatial terms such as “front” and “rear” similarly correspond respectively to distal and proximal. It will be further appreciated that for convenience and clarity, spatial terms such as “vertical” and “horizontal” are used herein with respect to the drawings. However, surgical instruments are used in many orientations and positions, and these spatial terms are not intended to be limiting and absolute.
- Values or ranges may be expressed herein as “about” and/or from/of “about” one particular value to another particular value. When such values or ranges are expressed, other embodiments disclosed include the specific value recited and/or from/of the one particular value to another particular value. Similarly, when values are expressed as approximations, by the use of antecedent “about,” it will be understood that here are a number of values disclosed therein, and that the particular value forms another embodiment. It will be further understood that there are a number of values disclosed therein, and that each value is also herein disclosed as “about” that particular value in addition to the value itself. In embodiments, “about” can be used to mean, for example, within 10% of the recited value, within 5% of the recited value or within 2% of the recited value.
- For purposes of describing and defining the present teachings, it is noted that unless indicated otherwise, the term “substantially” is utilized herein to represent the inherent degree of uncertainty that may be attributed to any quantitative comparison, value, measurement, or other representation. The term “substantially” is also utilized herein to represent the degree by which a quantitative representation may vary from a stated reference without resulting in a change in the basic function of the subject matter at issue.
- One skilled in the art will appreciate further features and advantages of the invention based on the above-described embodiments. Accordingly, the invention is not to be limited by what has been particularly shown and described, except as indicated by the appended claims. All publications and references cited herein are expressly incorporated herein by reference in their entirety. Any patent, publication, or information, in whole or in part, that is said to be incorporated by reference herein is only to the extent that the incorporated material does not conflict with existing definitions, statements, or other disclosure material set forth in this document. As such the disclosure as explicitly set forth herein supersedes any conflicting material incorporated herein by reference.
Claims (20)
1. A surgical sealing device, comprising:
a seal housing having a plurality of ports and configured to be at least partially disposed within a natural body orifice, the plurality of ports including;
at least one first port configured to control the ingress and egress of fluid between an interior volume of the natural body orifice and an ambient environment, and
at least one second port that is configured to form a seal around an instrument inserted therethrough; and
at least one retention element arranged on an exterior surface of the housing and configured to affix the housing to the natural body orifice.
2. The surgical sealing device of claim 1 , wherein the at least one first port is operatively connected to a valve arranged outside of the seal housing.
3. The surgical sealing device of claim 2 , wherein the valve has at least one monitored parameter which is used to control a fluid transfer rate through the at least one first port.
4. The surgical sealing device of claim 3 , wherein the at least one monitored parameter is a fluid transfer pressure and/or volume and a direction of the fluid transfer.
5. The surgical sealing device of claim 1 , wherein the at least one retention element is deployable inside of the natural body lumen.
6. The surgical sealing device of claim 1 , wherein the at least one retention element is deployable outside of the natural body lumen.
7. The surgical sealing device of claim 1 , wherein the at least one retention element is a barb extending from the exterior surface of the housing.
8. The surgical sealing device of claim 1 , wherein the at least one retention element is a balloon configured to be selectively inflated to contact an internal or an external surface of the natural body orifice and secure the housing thereto.
9. The surgical sealing device of claim 1 , wherein the fluid comprises at least one gas or at least one liquid.
10. The surgical sealing device of claim 1 , wherein a control system is configured to control the ingress and egress of fluid to create a pressure differential between the interior volume of the natural body orifice and the ambient environment.
11. A method for accessing a body cavity , the method comprising:
positioning a surgical sealing device at least partially within a natural body orifice, the surgical sealing device defining at least one passageway through the natural body orifice, the surgical sealing device having a seal housing with a plurality of ports;
releasably positioning at least one retention element configured to affix the seal housing to the natural body orifice;
controlling the ingress and egress of a fluid between an interior volume of the natural body orifice and an ambient environment through at least one first port; and
passing at least one surgical instrument through at least one second port such that the at least one second port forms a seal around the at least one surgical instrument.
12. The method of claim 11 , further comprising removing the at least one surgical instrument from the at least one second port without removing the seal housing from the natural body lumen.
13. The method of claim 11 , wherein the at least one first port is operatively connected to a valve arranged outside of the seal housing.
14. The method of claim 11 , further comprising monitoring at least one parameter of the valve which is used to control a fluid transfer rate through the at least one first port.
15. The method of claim 14 , wherein the at least one monitored parameter is a fluid transfer pressure and/or volume and a direction of the fluid transfer.
16. The method of claim 11 , further comprising deploying the at least one retention element inside of the natural body lumen.
17. The method of claim 11 , further comprising deploying the at least one retention element outside of the natural body lumen.
18. The method of claim 11 , wherein the fluid comprises a dye.
19. The method of claim 11 , wherein the fluid comprises at least one gas or at least one liquid.
20. The method of claim 11 , wherein the fluid comprises at least one gas and at least one liquid.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/491,375 US20230107857A1 (en) | 2021-09-29 | 2021-09-30 | Surgical sealing devices for a natural body orifice |
PCT/IB2022/059082 WO2023052932A1 (en) | 2021-09-29 | 2022-09-26 | Surgical sealing devices for a natural body orifice |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202163249980P | 2021-09-29 | 2021-09-29 | |
US17/491,375 US20230107857A1 (en) | 2021-09-29 | 2021-09-30 | Surgical sealing devices for a natural body orifice |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230107857A1 true US20230107857A1 (en) | 2023-04-06 |
Family
ID=85705851
Family Applications (12)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/491,437 Active US11937799B2 (en) | 2021-09-29 | 2021-09-30 | Surgical sealing systems for instrument stabilization |
US17/491,383 Active 2041-10-28 US11937798B2 (en) | 2021-09-29 | 2021-09-30 | Surgical systems with port devices for instrument control |
US17/491,375 Pending US20230107857A1 (en) | 2021-09-29 | 2021-09-30 | Surgical sealing devices for a natural body orifice |
US17/449,771 Pending US20230096880A1 (en) | 2021-09-29 | 2021-10-01 | Coordinated Instrument Control Systems |
US17/449,765 Active US11723642B2 (en) | 2021-09-29 | 2021-10-01 | Cooperative access hybrid procedures |
US17/449,772 Pending US20230096715A1 (en) | 2021-09-29 | 2021-10-01 | Surgical Systems and Methods for Selectively Pressurizing a Natural Body Lumen |
US17/449,767 Pending US20230095278A1 (en) | 2021-09-29 | 2021-10-01 | Surgical Anchoring Systems for Endoluminal Access |
US17/449,769 Pending US20230097151A1 (en) | 2021-09-29 | 2021-10-01 | Instrument Control Surgical Imaging Systems |
US17/493,526 Pending US20230094881A1 (en) | 2021-09-29 | 2021-10-04 | Surgical systems with devices for both intraluminal and extraluminal access |
US17/493,545 Pending US20230101376A1 (en) | 2021-09-29 | 2021-10-04 | Surgical systems for independently insufflating two separate anatomic spaces |
US17/493,535 Pending US20230101757A1 (en) | 2021-09-29 | 2021-10-04 | Surgical Systems with Intraluminal and Extraluminal Cooperative Instruments |
US18/337,971 Pending US20230404562A1 (en) | 2021-09-29 | 2023-06-20 | Cooperative access hybrid procedures |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/491,437 Active US11937799B2 (en) | 2021-09-29 | 2021-09-30 | Surgical sealing systems for instrument stabilization |
US17/491,383 Active 2041-10-28 US11937798B2 (en) | 2021-09-29 | 2021-09-30 | Surgical systems with port devices for instrument control |
Family Applications After (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/449,771 Pending US20230096880A1 (en) | 2021-09-29 | 2021-10-01 | Coordinated Instrument Control Systems |
US17/449,765 Active US11723642B2 (en) | 2021-09-29 | 2021-10-01 | Cooperative access hybrid procedures |
US17/449,772 Pending US20230096715A1 (en) | 2021-09-29 | 2021-10-01 | Surgical Systems and Methods for Selectively Pressurizing a Natural Body Lumen |
US17/449,767 Pending US20230095278A1 (en) | 2021-09-29 | 2021-10-01 | Surgical Anchoring Systems for Endoluminal Access |
US17/449,769 Pending US20230097151A1 (en) | 2021-09-29 | 2021-10-01 | Instrument Control Surgical Imaging Systems |
US17/493,526 Pending US20230094881A1 (en) | 2021-09-29 | 2021-10-04 | Surgical systems with devices for both intraluminal and extraluminal access |
US17/493,545 Pending US20230101376A1 (en) | 2021-09-29 | 2021-10-04 | Surgical systems for independently insufflating two separate anatomic spaces |
US17/493,535 Pending US20230101757A1 (en) | 2021-09-29 | 2021-10-04 | Surgical Systems with Intraluminal and Extraluminal Cooperative Instruments |
US18/337,971 Pending US20230404562A1 (en) | 2021-09-29 | 2023-06-20 | Cooperative access hybrid procedures |
Country Status (2)
Country | Link |
---|---|
US (12) | US11937799B2 (en) |
EP (2) | EP4281001A1 (en) |
Family Cites Families (129)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4470407A (en) | 1982-03-11 | 1984-09-11 | Laserscope, Inc. | Endoscopic device |
US4445892A (en) | 1982-05-06 | 1984-05-01 | Laserscope, Inc. | Dual balloon catheter device |
US5631973A (en) | 1994-05-05 | 1997-05-20 | Sri International | Method for telemanipulation with telepresence |
US5575810A (en) | 1993-10-15 | 1996-11-19 | Ep Technologies, Inc. | Composite structures and methods for ablating tissue to form complex lesion patterns in the treatment of cardiac conditions and the like |
US5505700A (en) | 1994-06-14 | 1996-04-09 | Cordis Corporation | Electro-osmotic infusion catheter |
US5855583A (en) * | 1996-02-20 | 1999-01-05 | Computer Motion, Inc. | Method and apparatus for performing minimally invasive cardiac procedures |
US5830224A (en) * | 1996-03-15 | 1998-11-03 | Beth Israel Deaconess Medical Center | Catheter apparatus and methodology for generating a fistula on-demand between closely associated blood vessels at a pre-chosen anatomic site in-vivo |
US5876373A (en) | 1997-04-04 | 1999-03-02 | Eclipse Surgical Technologies, Inc. | Steerable catheter |
US6200312B1 (en) * | 1997-09-11 | 2001-03-13 | Vnus Medical Technologies, Inc. | Expandable vein ligator catheter having multiple electrode leads |
US6086532A (en) * | 1997-09-26 | 2000-07-11 | Ep Technologies, Inc. | Systems for recording use of structures deployed in association with heart tissue |
US7169141B2 (en) | 1998-02-24 | 2007-01-30 | Hansen Medical, Inc. | Surgical instrument |
US7214230B2 (en) * | 1998-02-24 | 2007-05-08 | Hansen Medical, Inc. | Flexible instrument |
ATE308276T1 (en) | 1998-03-31 | 2005-11-15 | Transvascular Inc | TISSUE-PENETRATING CATHETER WITH TRANSDUCER FOR IMAGING AND ASSOCIATED METHODS OF APPLICATION |
US6004271A (en) | 1998-05-07 | 1999-12-21 | Boston Scientific Corporation | Combined motor drive and automated longitudinal position translator for ultrasonic imaging system |
US20030074011A1 (en) * | 1998-09-24 | 2003-04-17 | Super Dimension Ltd. | System and method of recording and displaying in context of an image a location of at least one point-of-interest in a body during an intra-body medical procedure |
US8527094B2 (en) | 1998-11-20 | 2013-09-03 | Intuitive Surgical Operations, Inc. | Multi-user medical robotic system for collaboration or training in minimally invasive surgical procedures |
US6503195B1 (en) | 1999-05-24 | 2003-01-07 | University Of North Carolina At Chapel Hill | Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction |
US6610007B2 (en) | 2000-04-03 | 2003-08-26 | Neoguide Systems, Inc. | Steerable segmented endoscope and method of insertion |
US8414505B1 (en) | 2001-02-15 | 2013-04-09 | Hansen Medical, Inc. | Catheter driver system |
US7766894B2 (en) | 2001-02-15 | 2010-08-03 | Hansen Medical, Inc. | Coaxial catheter system |
US7699835B2 (en) | 2001-02-15 | 2010-04-20 | Hansen Medical, Inc. | Robotically controlled surgical instruments |
US20030135204A1 (en) | 2001-02-15 | 2003-07-17 | Endo Via Medical, Inc. | Robotically controlled medical instrument with a flexible section |
WO2002089872A2 (en) | 2001-05-06 | 2002-11-14 | Stereotaxis, Inc. | System and methods for advancing a catheter |
US20040176751A1 (en) * | 2002-08-14 | 2004-09-09 | Endovia Medical, Inc. | Robotic medical instrument system |
WO2005058137A2 (en) | 2003-12-12 | 2005-06-30 | University Of Washington | Catheterscope 3d guidance and interface system |
US8052636B2 (en) * | 2004-03-05 | 2011-11-08 | Hansen Medical, Inc. | Robotic catheter system and methods |
US9943372B2 (en) | 2005-04-18 | 2018-04-17 | M.S.T. Medical Surgery Technologies Ltd. | Device having a wearable interface for improving laparoscopic surgery and methods for use thereof |
US11259870B2 (en) | 2005-06-06 | 2022-03-01 | Intuitive Surgical Operations, Inc. | Interactive user interfaces for minimally invasive telesurgical systems |
JP4999012B2 (en) | 2005-06-06 | 2012-08-15 | インチュイティブ サージカル,インコーポレイテッド | Laparoscopic ultrasonic robotic surgical system |
EP1906858B1 (en) | 2005-07-01 | 2016-11-16 | Hansen Medical, Inc. | Robotic catheter system |
US7666220B2 (en) | 2005-07-07 | 2010-02-23 | Nellix, Inc. | System and methods for endovascular aneurysm treatment |
EP1971280B1 (en) | 2006-01-05 | 2018-03-07 | Children's Medical Center Corporation | Instrument port for minimally invasive cardiac surgery |
US8961406B2 (en) | 2009-03-06 | 2015-02-24 | Ethicon Endo-Surgery, Inc. | Surgical access devices and methods providing seal movement in predefined movement regions |
US8425410B2 (en) | 2008-09-30 | 2013-04-23 | Ethicon Endo-Surgery, Inc. | Surgical access device with protective element |
US20100228096A1 (en) * | 2009-03-06 | 2010-09-09 | Ethicon Endo-Surgery, Inc. | Methods and devices for providing access into a body cavity |
US8092536B2 (en) | 2006-05-24 | 2012-01-10 | Disc Dynamics, Inc. | Retention structure for in situ formation of an intervertebral prosthesis |
CN104688281B (en) | 2006-06-13 | 2017-04-19 | 直观外科手术操作公司 | Minimally invasive surgical system |
US8517933B2 (en) | 2006-06-13 | 2013-08-27 | Intuitive Surgical Operations, Inc. | Retraction of tissue for single port entry, robotically assisted medical procedures |
US20080243142A1 (en) * | 2007-02-20 | 2008-10-02 | Gildenberg Philip L | Videotactic and audiotactic assisted surgical methods and procedures |
US9592100B2 (en) | 2007-12-31 | 2017-03-14 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Method and apparatus for encoding catheters with markers for identifying with imaging systems |
US10368838B2 (en) | 2008-03-31 | 2019-08-06 | Intuitive Surgical Operations, Inc. | Surgical tools for laser marking and laser cutting |
US8727967B2 (en) | 2008-07-18 | 2014-05-20 | Boston Scientific Scimed, Inc. | Endoscope with guide |
EP2349032B1 (en) | 2008-10-13 | 2017-12-06 | Applied Medical Resources Corporation | Single port access system |
US8574153B2 (en) | 2009-03-20 | 2013-11-05 | Covidien Lp | Flexible port seal |
US9078695B2 (en) * | 2009-06-05 | 2015-07-14 | Ethicon Endo-Surgery, Inc. | Methods and devices for accessing a body cavity using a surgical access device with modular seal components |
US8241209B2 (en) | 2009-06-05 | 2012-08-14 | Ethicon Endo-Surgery, Inc. | Active seal components |
US8623028B2 (en) | 2009-09-23 | 2014-01-07 | Intuitive Surgical Operations, Inc. | Surgical port feature |
US8888789B2 (en) | 2009-09-23 | 2014-11-18 | Intuitive Surgical Operations, Inc. | Curved cannula surgical system control |
US8551115B2 (en) | 2009-09-23 | 2013-10-08 | Intuitive Surgical Operations, Inc. | Curved cannula instrument |
US20110071541A1 (en) | 2009-09-23 | 2011-03-24 | Intuitive Surgical, Inc. | Curved cannula |
US8521331B2 (en) | 2009-11-13 | 2013-08-27 | Intuitive Surgical Operations, Inc. | Patient-side surgeon interface for a minimally invasive, teleoperated surgical instrument |
US11344285B2 (en) | 2009-12-16 | 2022-05-31 | Boston Scientific Scimed, Inc. | Multi-lumen-catheter retractor system for a minimally-invasive, operative gastrointestinal treatment |
US8926508B2 (en) | 2009-12-17 | 2015-01-06 | Covidien Lp | Access assembly with dual anchor and seal capabilities |
US9339341B2 (en) | 2010-02-08 | 2016-05-17 | Intuitive Surgical Operations, Inc. | Direct pull surgical gripper |
WO2011101754A1 (en) | 2010-02-18 | 2011-08-25 | Koninklijke Philips Electronics N.V. | System and method for tumor motion simulation and motion compensation using tracked bronchoscopy |
US20110295074A1 (en) | 2010-05-28 | 2011-12-01 | Ethicon Endo-Surgery, Inc. | Methods and Devices for Providing Multiple Devices Access to a Surgical Site Through a Single Port |
US9011324B2 (en) | 2010-11-24 | 2015-04-21 | Covidien Lp | Access assembly including one or more foldable caps |
CN102571548B (en) | 2010-12-21 | 2015-05-20 | 上海贝尔股份有限公司 | Network node for optical transmission network |
US9572481B2 (en) | 2011-05-13 | 2017-02-21 | Intuitive Surgical Operations, Inc. | Medical system with multiple operating modes for steering a medical instrument through linked body passages |
EP2829218B1 (en) | 2012-03-17 | 2017-05-03 | Waseda University | Image completion system for in-image cutoff region, image processing device, and program therefor |
EP3620128B1 (en) | 2012-06-01 | 2022-07-27 | Intuitive Surgical Operations, Inc. | Multi-port surgical robotic system architecture |
JP2014132980A (en) | 2013-01-10 | 2014-07-24 | Advanced Healthcare Kk | Trocar and surgery support system |
US9269682B2 (en) * | 2013-02-27 | 2016-02-23 | Taiwan Semiconductor Manufacturing Company, Ltd. | Method of forming bump structure |
US10383699B2 (en) | 2013-03-15 | 2019-08-20 | Sri International | Hyperdexterous surgical system |
US9274047B2 (en) | 2013-05-24 | 2016-03-01 | Massachusetts Institute Of Technology | Methods and apparatus for imaging of occluded objects |
JP6305088B2 (en) | 2014-02-07 | 2018-04-04 | オリンパス株式会社 | Surgical system and method of operating the surgical system |
CA2935506A1 (en) | 2014-02-21 | 2015-08-27 | 3Dintegrated Aps | A set comprising a surgical instrument |
EP3125809B1 (en) | 2014-03-28 | 2020-09-09 | Intuitive Surgical Operations, Inc. | Surgical system with haptic feedback based upon quantitative three-dimensional imaging |
WO2015149041A1 (en) | 2014-03-28 | 2015-10-01 | Dorin Panescu | Quantitative three-dimensional visualization of instruments in a field of view |
US9629659B2 (en) | 2014-07-09 | 2017-04-25 | Covidien Lp | Instrument fixation device for depth and angle fixation |
EP3166468A4 (en) | 2014-07-10 | 2018-03-07 | M.S.T. Medical Surgery Technologies Ltd. | Improved interface for laparoscopic surgeries - movement gestures |
EP3202344B1 (en) | 2014-09-30 | 2019-03-27 | FUJIFILM Corporation | Endoscopic surgical device |
EP3282996A1 (en) | 2015-04-15 | 2018-02-21 | Covidien LP | Methods for exchanging instruments using a surgical port assembly |
US9636184B2 (en) | 2015-05-15 | 2017-05-02 | Auris Surgical Robotics, Inc. | Swivel bed for a surgical robotics system |
US9949700B2 (en) | 2015-07-22 | 2018-04-24 | Inneroptic Technology, Inc. | Medical device approaches |
US10765304B2 (en) | 2015-09-28 | 2020-09-08 | Bio-Medical Engineering (HK) Limited | Endoscopic systems, devices, and methods for performing in vivo procedures |
US10136799B2 (en) | 2015-09-28 | 2018-11-27 | Bio-Medical Engineering (HK) Limited | Endoscopic systems, devices, and methods |
DK178899B1 (en) | 2015-10-09 | 2017-05-08 | 3Dintegrated Aps | A depiction system |
WO2017109912A1 (en) | 2015-12-24 | 2017-06-29 | オリンパス株式会社 | Medical manipulator system and image display method for same |
EP3415071A4 (en) | 2016-02-10 | 2019-11-20 | Olympus Corporation | Endoscope system |
WO2017207565A1 (en) | 2016-05-31 | 2017-12-07 | Koninklijke Philips N.V. | Image-based fusion of endoscopic image and ultrasound images |
US10709511B2 (en) | 2016-08-16 | 2020-07-14 | Ethicon Llc | Control of jaw or clamp arm closure in concert with advancement of device |
US10543048B2 (en) | 2016-12-28 | 2020-01-28 | Auris Health, Inc. | Flexible instrument insertion using an adaptive insertion force threshold |
US10262453B2 (en) | 2017-03-24 | 2019-04-16 | Siemens Healthcare Gmbh | Virtual shadows for enhanced depth perception |
EP3651656A4 (en) | 2017-07-13 | 2021-03-24 | MITRX, Inc. | Devices and methods for accessing the left atrium for cardiac procedures |
US10555778B2 (en) | 2017-10-13 | 2020-02-11 | Auris Health, Inc. | Image-based branch detection and mapping for navigation |
US10405884B2 (en) | 2017-10-23 | 2019-09-10 | Conmed Corporation | Devices for performing minimally invasive surgery having rotating multiport access |
US20190206555A1 (en) | 2017-12-28 | 2019-07-04 | Ethicon Llc | Cloud-based medical analytics for customization and recommendations to a user |
US20190200981A1 (en) | 2017-12-28 | 2019-07-04 | Ethicon Llc | Method of compressing tissue within a stapling device and simultaneously displaying the location of the tissue within the jaws |
US10898622B2 (en) | 2017-12-28 | 2021-01-26 | Ethicon Llc | Surgical evacuation system with a communication circuit for communication between a filter and a smoke evacuation device |
US10892995B2 (en) | 2017-12-28 | 2021-01-12 | Ethicon Llc | Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs |
US11076921B2 (en) | 2017-12-28 | 2021-08-03 | Cilag Gmbh International | Adaptive control program updates for surgical hubs |
US11612444B2 (en) | 2017-12-28 | 2023-03-28 | Cilag Gmbh International | Adjustment of a surgical device function based on situational awareness |
US20190201140A1 (en) | 2017-12-28 | 2019-07-04 | Ethicon Llc | Surgical hub situational awareness |
US11937769B2 (en) | 2017-12-28 | 2024-03-26 | Cilag Gmbh International | Method of hub communication, processing, storage and display |
US11659023B2 (en) | 2017-12-28 | 2023-05-23 | Cilag Gmbh International | Method of hub communication |
US11051876B2 (en) | 2017-12-28 | 2021-07-06 | Cilag Gmbh International | Surgical evacuation flow paths |
US11069012B2 (en) | 2017-12-28 | 2021-07-20 | Cilag Gmbh International | Interactive surgical systems with condition handling of devices and data capabilities |
US11589888B2 (en) | 2017-12-28 | 2023-02-28 | Cilag Gmbh International | Method for controlling smart energy devices |
US10667875B2 (en) | 2018-06-27 | 2020-06-02 | Auris Health, Inc. | Systems and techniques for providing multiple perspectives during medical procedures |
US11304692B2 (en) | 2018-07-16 | 2022-04-19 | Cilag Gmbh International | Singular EMR source emitter assembly |
CA3106405A1 (en) | 2018-07-16 | 2020-01-23 | Lumendi Ltd. | Method and apparatus for manipulating the side wall of a body lumen or body cavity so as to provide increased visualization of the same and/or increased access to the same and/or for stabilizing instruments relative to the same |
WO2020028286A1 (en) | 2018-08-02 | 2020-02-06 | Boston Scientific Scimed, Inc. | Devices and methods for treatment of body lumens |
US11197728B2 (en) | 2018-09-17 | 2021-12-14 | Auris Health, Inc. | Systems and methods for concomitant medical procedures |
EP3870021B1 (en) | 2018-10-26 | 2022-05-25 | Intuitive Surgical Operations, Inc. | Mixed reality systems and methods for indicating an extent of a field of view of an imaging device |
US20200306004A1 (en) | 2019-03-27 | 2020-10-01 | GYRUS ACMI, INC.,d/b/a Olympus Surgical Technologies America | Surgical protection system |
JP2022527834A (en) | 2019-04-08 | 2022-06-06 | オーリス ヘルス インコーポレイテッド | Systems, methods, and workflows for accompanying procedures |
WO2021053553A1 (en) | 2019-09-19 | 2021-03-25 | Auris Health, Inc. | Coordinated movements of robotic tools |
US20210196383A1 (en) | 2019-12-30 | 2021-07-01 | Ethicon Llc | Surgical systems correlating visualization data and powered surgical instrument data |
US11759283B2 (en) | 2019-12-30 | 2023-09-19 | Cilag Gmbh International | Surgical systems for generating three dimensional constructs of anatomical organs and coupling identified anatomical structures thereto |
US11284963B2 (en) | 2019-12-30 | 2022-03-29 | Cilag Gmbh International | Method of using imaging devices in surgery |
US11219501B2 (en) | 2019-12-30 | 2022-01-11 | Cilag Gmbh International | Visualization systems using structured light |
US20210196108A1 (en) | 2019-12-30 | 2021-07-01 | Ethicon Llc | Adaptive surgical system control according to surgical smoke cloud characteristics |
US11744667B2 (en) | 2019-12-30 | 2023-09-05 | Cilag Gmbh International | Adaptive visualization by a surgical system |
US20210199557A1 (en) | 2019-12-30 | 2021-07-01 | Ethicon Llc | Adaptive surgical system control according to surgical smoke particulate characteristics |
US20210196384A1 (en) | 2019-12-30 | 2021-07-01 | Ethicon Llc | Dynamic surgical visualization systems |
US11832996B2 (en) | 2019-12-30 | 2023-12-05 | Cilag Gmbh International | Analyzing surgical trends by a surgical system |
US11776144B2 (en) | 2019-12-30 | 2023-10-03 | Cilag Gmbh International | System and method for determining, adjusting, and managing resection margin about a subject tissue |
US11896442B2 (en) | 2019-12-30 | 2024-02-13 | Cilag Gmbh International | Surgical systems for proposing and corroborating organ portion removals |
US20210345952A1 (en) | 2020-05-06 | 2021-11-11 | Janssen Pharmaceuticals, Inc. | Controlling operation of drug administration devices using surgical hubs |
US20210345953A1 (en) | 2020-05-06 | 2021-11-11 | Janssen Pharmaceuticals, Inc. | Monitoring and communicating information using drug administration devices |
US20210350897A1 (en) | 2020-05-06 | 2021-11-11 | Janssen Pharmaceuticals, Inc. | Aggregating and analyzing drug administration data |
US20210350896A1 (en) | 2020-05-06 | 2021-11-11 | Janssen Pharmaceuticals, Inc. | Patient monitoring using drug administration devices |
US11607216B2 (en) | 2020-05-06 | 2023-03-21 | Janssen Pharmaceuticals, Inc. | Adaptive responses from smart packaging of drug delivery absorbable adjuncts |
US20210350895A1 (en) | 2020-05-06 | 2021-11-11 | Janssen Pharmaceuticals, Inc. | Drug administration devices that communicate with surgical hubs |
US20210393338A1 (en) | 2020-06-22 | 2021-12-23 | Auris Health, Inc. | Medical instrument driving |
US11478140B1 (en) * | 2020-09-15 | 2022-10-25 | Raytrx, Llc | Wireless laparoscopic device with gimballed camera |
JP2024501364A (en) | 2020-12-07 | 2024-01-11 | フロンド・メディカル・インコーポレーテッド | Method and system for localization of body cavity medical devices |
US20230110791A1 (en) | 2021-09-29 | 2023-04-13 | Cilag Gmbh International | Instrument Control Imaging Systems for Visualization of Upcoming Surgical Procedure Steps |
-
2021
- 2021-09-30 US US17/491,437 patent/US11937799B2/en active Active
- 2021-09-30 US US17/491,383 patent/US11937798B2/en active Active
- 2021-09-30 US US17/491,375 patent/US20230107857A1/en active Pending
- 2021-10-01 US US17/449,771 patent/US20230096880A1/en active Pending
- 2021-10-01 US US17/449,765 patent/US11723642B2/en active Active
- 2021-10-01 US US17/449,772 patent/US20230096715A1/en active Pending
- 2021-10-01 US US17/449,767 patent/US20230095278A1/en active Pending
- 2021-10-01 US US17/449,769 patent/US20230097151A1/en active Pending
- 2021-10-04 US US17/493,526 patent/US20230094881A1/en active Pending
- 2021-10-04 US US17/493,545 patent/US20230101376A1/en active Pending
- 2021-10-04 US US17/493,535 patent/US20230101757A1/en active Pending
-
2022
- 2022-09-26 EP EP22786999.7A patent/EP4281001A1/en active Pending
- 2022-09-26 EP EP22786490.7A patent/EP4251077A1/en active Pending
-
2023
- 2023-06-20 US US18/337,971 patent/US20230404562A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
US11937798B2 (en) | 2024-03-26 |
US11723642B2 (en) | 2023-08-15 |
US20230107005A1 (en) | 2023-04-06 |
US20230098538A1 (en) | 2023-03-30 |
US20230095278A1 (en) | 2023-03-30 |
US20230404562A1 (en) | 2023-12-21 |
US11937799B2 (en) | 2024-03-26 |
US20230096880A1 (en) | 2023-03-30 |
US20230096715A1 (en) | 2023-03-30 |
US20230100415A1 (en) | 2023-03-30 |
US20230097151A1 (en) | 2023-03-30 |
US20230101757A1 (en) | 2023-03-30 |
EP4281001A1 (en) | 2023-11-29 |
US20230101376A1 (en) | 2023-03-30 |
US20230094881A1 (en) | 2023-03-30 |
EP4251077A1 (en) | 2023-10-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230101192A1 (en) | Methods and Systems for Controlling Cooperative Surgical Instruments with Variable Surgical Site Access Trajectories | |
US20230095730A1 (en) | Methods and Systems for Controlling Cooperative Surgical Instruments | |
US20230109848A1 (en) | Surgical devices, systems, and methods using fiducial identification and tracking | |
US20230102358A1 (en) | Surgical devices, systems, and methods using fiducial identification and tracking | |
US20230096691A1 (en) | Methods and Systems for Controlling Cooperative Surgical Instruments | |
US11937799B2 (en) | Surgical sealing systems for instrument stabilization | |
EP4221629B1 (en) | Surgical devices and systems using multi-source imaging | |
US20230116781A1 (en) | Surgical devices, systems, and methods using multi-source imaging | |
WO2023052931A1 (en) | Surgical sealing systems for instrument stabilization | |
WO2023052932A1 (en) | Surgical sealing devices for a natural body orifice | |
EP4216846A1 (en) | Surgical systems with port devices for instrument control | |
WO2023052929A1 (en) | Surgical devices, systems, and methods using multi-source imaging | |
WO2023052939A1 (en) | Surgical devices, systems, and methods using multi-source imaging | |
EP4262574A1 (en) | Surgical systems with devices for both intraluminal and extraluminal access | |
WO2023052951A1 (en) | Surgical systems with intraluminal and extraluminal cooperative instruments | |
EP4216845A1 (en) | Surgical systems for independently insufflating two separate anatomic spaces | |
WO2023052949A1 (en) | Surgical devices, systems, and methods using fiducial identification and tracking |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
AS | Assignment |
Owner name: CILAG GMBH INTERNATIONAL, SWITZERLAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHELTON, FREDERICK E., IV;REEL/FRAME:058742/0521 Effective date: 20211029 |