WO2009094465A1 - Système d'imagerie chirurgicale de canal cholédoque commun - Google Patents

Système d'imagerie chirurgicale de canal cholédoque commun Download PDF

Info

Publication number
WO2009094465A1
WO2009094465A1 PCT/US2009/031712 US2009031712W WO2009094465A1 WO 2009094465 A1 WO2009094465 A1 WO 2009094465A1 US 2009031712 W US2009031712 W US 2009031712W WO 2009094465 A1 WO2009094465 A1 WO 2009094465A1
Authority
WO
WIPO (PCT)
Prior art keywords
image data
fluorescent
visual
cbd
light
Prior art date
Application number
PCT/US2009/031712
Other languages
English (en)
Inventor
Ramon Berguer
Michael Robert Gluszczak
Original Assignee
Lifeguard Surgical Systems
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/011,484 external-priority patent/US20090192390A1/en
Priority claimed from US12/011,490 external-priority patent/US9072445B2/en
Application filed by Lifeguard Surgical Systems filed Critical Lifeguard Surgical Systems
Priority to JP2010544420A priority Critical patent/JP2011510705A/ja
Priority to CA2713113A priority patent/CA2713113A1/fr
Priority to EP09703731A priority patent/EP2254456A1/fr
Priority to CN2009801103002A priority patent/CN102006818A/zh
Publication of WO2009094465A1 publication Critical patent/WO2009094465A1/fr

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/313Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
    • A61B1/3132Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes for laparoscopy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00043Operational features of endoscopes provided with output arrangements
    • A61B1/00045Display arrangement
    • A61B1/0005Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/043Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0638Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0071Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/063Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/7425Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image

Definitions

  • the present invention relates to surgical imaging systems.
  • gall bladder surgical imaging systems In particular, gall bladder surgical imaging systems.
  • FIG. 1 is a diagram illustrating a surgical instrument used during laparoscopic surgery according to an embodiment of the invention
  • FIG. 2 is a diagram illustrating the bile duct anatomy
  • FIG. 3 is a diagram illustrating an intraoperative cholangiogram (IOC).
  • FIG. 4 is a block diagram illustrating an add-on configuration of a common bile duct imaging system according to an embodiment of the invention
  • FIG. 5 is a block diagram illustrating a standalone configuration of a common bile duct imaging system according to an embodiment of the invention
  • FIG. 6 is a diagram illustrating an optical layout for a laparoscopic lighting system according to an embodiment of the invention.
  • FIG. 7 is a diagram illustrating an optical layout for a laparoscopic camera system according to an embodiment of the invention.
  • FIG. 8 is a block diagram illustrating a prior art implementation of a surgical instrument for injecting liquid into the gallbladder
  • FIG. 9 is a block diagram illustrating overlaying of visual light images with fluorescent emission light images into a single display according to an embodiment of the invention.
  • FIG. 10 is a block diagram that illustrates a computer system upon which an embodiment may be implemented.
  • FIG. 11 is a diagram illustrating a laparoscope with an integral light source according to an embodiment of the invention.
  • An embodiment introduces a fluorescent contrast agent into the CBD via direct injection into the gallbladder, the cystic duct, the CBD, or via intravenous injection and excretion of the contrast agent by the liver into the bile.
  • a light source illuminates a light path in a laparoscope. The light source transmits both a visible light and an infrared (IR) light (otherwise known as a fluorescent excitation light) into a patient's abdominal cavity via the laparoscope.
  • the fluorescent contrast agent is excited by the narrow band light energy and produces light emission in a certain wavelength band.
  • a camera assembly on the laparoscope can be communicatively connected to camera controller via an electronic cable, or wirelessly via Bluetooth (or any wireless technology) or a wireless local area network.
  • the camera assembly contains both a visible light detection camera and an IR light detection camera.
  • the cameras attached to the laparoscope detect visible light images and fluorescent emission light images.
  • the visible light image and fluorescent image signals from the camera assembly are processed to combine the fluorescent emission light image signals and visible image signals into a single display signal in order to overlay (or combine) the two images in their proper alignment.
  • the system adjusts the display characteristics, such as color, of the fluorescent emission light image so it contrasts well with the visual light image so the surgeon can easily distinguish between the two images.
  • the display signal is sent to a video monitor where the surgeon views the visible light image and the fluorescent image as a single overlaid (or combined) image.
  • the surgeon can instruct the system to display the fluorescent image in a desired color so the fluorescent image is properly contrasted to the visible image.
  • the overlay image can be turned on or off by the user via a switch or software control.
  • the system can handle multiple displays with different combinations of images.
  • a sensor may be included in the camera housing which allows the user to know which direction the ground or sky is. This allows the surgeon to select and display the orientation of the camera as referenced to the sky or the ground. This could be very helpful in NOTES type of operations as well (discussed below).
  • the system can record the combined visual and fluorescent images on an external or internal digital recording device such as CD, DVD, optical disk, hard disk, or flash memory.
  • the system has an Ethernet connection to allow Internet or intranet connectivity so that recordings may be made to a server or transmitted over the Internet or intranet.
  • FIG. 1 As mentioned above, during gallbladder surgery, the surgeon inserts several tubes 101, called trocars or ports, into the abdominal cavity.
  • a 10mm diameter optical scope, a laparoscope 102 is inserted into one of the ports.
  • the laparoscope is attached to a video camera that allows the surgeon and the surgical team to view the inside of the abdominal cavity on a video screen.
  • Long, slender instruments 103, 104, 105 are passed through the other ports to grasp, dissect, and cut the tissue.
  • FIG. 2 illustrates the bile duct anatomy.
  • the common bile duct (CBD) 201 carries the bile from the liver 202 to the intestine 203 for digestion.
  • the gallbladder 204 is a side pouch that stores bile, and squeezes into the CBD 201 during meals.
  • the gallbladder 204 is attached to the CBD 201 by the cystic duct 205.
  • the cystic duct 205 must be clearly identified by the surgeon, clipped or ligated, and then cut with scissors. If the surgeon mistakes the CBD 201 for the cystic duct 205, a CBD injury will occur. If the surgeon uses electrocautery energy to coagulate bleeding near the CBD 201 he may injure the CBD 201.
  • the only way to see the CBD at present is to do an intraoperative cholangiogram (IOC).
  • IOC intraoperative cholangiogram
  • the IOC picture 301 is displayed on a black and white screen and can be printed or saved.
  • Performing an IOC is not considered standard of care and is not done in all operations due to the cost, time, and trouble of performing it.
  • x-ray exposure to the patient and surgical staff is a concern.
  • An embodiment images the bile duct during gallbladder surgery and presents the CBD image as a real-time display for the surgeon.
  • This device can reduce the CBD injury rate by at least 50% or perhaps more, thereby saving approximately 2000 patients per year (in the U.S.) from the pain and suffering resulting from a CBD injury and speed up all procedures since the CBD can be quickly identified and avoided.
  • Embodiments can be built as either an add-on to current laparoscopic systems or as an integrated standalone system.
  • the embodiments allow the surgeon to see the CBD in its proper position during gallbladder surgery.
  • FIG. 4 shows an embodiment of an add-on configuration that integrates with current laparoscopic light sources and video systems.
  • a fluorescent imaging module 404 introduces IR light 407 into the existing fiberoptic lighting system 403 and through the light channel of the laparoscope 406.
  • An infrared detection coupler 405 is added to the laparoscope 406 between the laparoscope and visible light camera 409.
  • the infrared detection coupler 405 contains a camera that is capable of detecting an IR signal from a fluorescent marker or tissue auto-fluorescence.
  • the infrared detection coupler 405 is communicatively connected to the fluorescent imaging module 404.
  • the connectors may be electronic cables, fiberoptic cables, a wireless transmission system, or any combination and/or quantity thereof.
  • connection cables may be disposable or reusable and may need to be sterilized if they contact the sterile surgical field.
  • the IR image may be transmitted via an optical path to a remote IR camera (that may be located near the fluorescent imaging module 404). This may be necessary in case the size of an IR camera is not compatible with the coupler 405 size specifications.
  • the light source 403 transmits visible light through the fiberoptics in the laparoscope 406.
  • the fluorescent imaging module 404 transmits IR light (fluorescent excitation light) through the fiberoptics in the laparoscope 406 at the same time.
  • the camera controller 402 receives visible light image signals (the actual view of the surgical field using visible light) from the existing camera 409 mounted to the laparoscope 406.
  • the camera controller 402 processes the visible light image signals into visible image display signals and sends the visible image display signals to the fluorescent imaging module 404.
  • the fluorescent imaging module 404 receives IR (fluorescent) light image signals from the infrared detection coupler 405.
  • the fluorescent imaging module 404 digitally processes the fluorescent emission light image signals using a computer system or dedicated microprocessor to create a pleasing and natural graphics display of the CBD.
  • the fluorescent imaging module 404 can use any known technique to combine the fluorescent emission light image signals and visible image display signals into a single display signal in order to overlay the two images in their proper alignment. This can include a simple reliance on a common focus point where the two cameras are aligned before surgery and the two image signals are combined in a straightforward manner, or using software to automatically detect common reference points within the two image signals in order to properly align the two images.
  • the video output signal 408 is sent to a video monitor 401 where the surgeon views the visible light image and the fluorescent image as a single overlaid image.
  • the surgeon can instruct the fluorescent imaging module 404 to display the fluorescent image in a desired color, shape, or texture so the fluorescent image is properly contrasted to the visible image.
  • the add-on system may need to replace one of the components of current laparoscopic systems, either the camera head 409, the camera controller 402, or the light source 403. In that case, the system interfaces with the remaining components either at the input or output of those devices.
  • FIG. 5 illustrates an embodiment that is a standalone CBD imaging system that integrates the IR light source, IR detection system, visible light source, and visible image detection system into a complete and standalone laparoscopic imaging system with enhanced optical capabilities.
  • the embodiment incorporates both a visible light camera and an IR light camera into a single camera enclosure 505 that attaches to the laparoscope 504 or is integrated into the laparoscope 504.
  • the light source 503 transmits both visible light and IR light to fiberoptics in the laparoscope 504.
  • the visible and IR light sources can be integrated into the laparoscope 504 itself or into a trocar to eliminate the need for fiberoptic cables to be connected from the camera controller 502 to the laparoscope 504, thus, making the laparoscope assembly lighter and easier to maneuver.
  • the light source 503 is instructed by the camera controller 502 to illuminate the light path in the laparoscope 504.
  • the light source 503 transmits both (depending on the request) a visible light and an IR light to the laparoscope 504.
  • the camera controller 504 receives signals from cameras in the laparoscope 504.
  • the camera assembly 505 can be communicatively connected to camera controller 504 via an electronic cable, fiberoptic cable, wirelessly via Bluetooth (or any wireless technology) or a wireless local area network, or any combination and/or quantity thereof.
  • the camera assembly 505 contains both a visible light detection camera and an IR light detection camera.
  • the cameras in the laparoscope 504 detect visible light images and fluorescent emission light images.
  • the camera assembly 505 can contain other types of detectors that can accomplish the visible light image and fluorescent emission light image detection as cameras.
  • the visible light image and fluorescent image signals from the camera assembly 505 are processed by the camera controller 504.
  • the camera controller 504 can use any known technique to combine the fluorescent emission light image signals and visible image signals into a single display signal in order to overlay the two images in their proper alignment.
  • the two cameras since the two cameras are in an integral camera assembly 505, the cameras will have very little parallax error and can be factory aligned.
  • the two image signals are then combined in a straightforward manner.
  • the cameras can also be aligned to a common focus point before surgery. Alternatively, software can be used to automatically detect common reference points within the two image signals in order to properly align the two images.
  • the camera controller 504 adjusts the display characteristics, such as color, of the fluorescent emission light image so it contrasts well with the visual light image so the surgeon can easily distinguish between the two images.
  • the display signal is sent to a video monitor 501 where the surgeon views the visible light image and the fluorescent image as a single overlaid image.
  • the surgeon can instruct the camera controller 504 to display the fluorescent image in a desired color, shape, and texture so the fluorescent image is properly contrasted to the visible image.
  • the UV, visible, or IR fluorescence detector may be the same CCD device used for the detection of visible light.
  • a single CCD can be used to detect both IR and visible light.
  • the CCD may be controlled via a controller circuit to allow the detection of the emitted light signal either simultaneously or alternating with the visible light (interlaced detection). This detection may require the use of passive or active filters and a switching mechanism. Both the visible and the fluorescent emission light signals from the CCD would then be carried to an electronic circuit that would separate the fluorescent emission light signal and the visible light signal for separate digital processing.
  • Modern laparoscopic cameras usually have three CCD chips (red, blue, and green).
  • a three-chip device can be used as described in the previous paragraph to detect both the visible and fluorescent emission light signals.
  • Another alternative is to build a four-chip, five-chip, or greater number of chips, laparoscopic camera.
  • Such a camera would contain three CCD chips for visible light detection plus any additional CCDs for detection of the fluorescent signal.
  • the separate dedicated CCDs for the detection of the fluorescent emission light would be optimized for detecting light in the IR, NIR, visible or UV wavelengths.
  • the detection could require active or passive filtering, and a switching controller.
  • the advantage would be that the fluorescent emission light detector could be activated and filtered separately from the visible light controller.
  • the entire assembly would attach to the laparoscope, endoscope, thoracoscope, or cystoscope either via a retractable housing on the viewing end, by being permanently designed as a component of the endoscope head, or by being miniaturized and placed on the tip of the endoscope in a "chip on the tip" configuration.
  • a separate collar, separator, or beam splitting box would not be needed. All optical manipulations would be carried out within the camera housing.
  • the camera would be connected to its controller box via an electronic cable or wirelessly via Bluetooth (or any wireless technology) or a wireless local area network.
  • FIG. 11 illustrates an embodiment of a laparoscope 1101 with an integral light source 1102 and cameras 1103 attached.
  • the light source 1102 could be: a standard white light bulb, filtered light, lamp, LED, laser, etc.
  • the light source 1102 may be powered by: an electric cord, an internal battery, or inductively coupled.
  • Inside the body of the light source 1102 a lens system shapes the light beam to wide angle or narrow angle, which is selectable by the user.
  • a version of the light source may be cylindrical in nature and have a plurality of flat surfaces around it circumference. This shape has resistance to rolling because of the flat surfaces and helps prevent the light source 1102 from rolling off of a table when not attached to the laparoscope 1101.
  • light from a broadband source 602 (this is used for the visual cameras) is combined with light that is used for navigation and targeting of the CBD 603, 604.
  • the goal is to identify the CBD so as not to physically damage it during an operation on the gallbladder or removal of the gallbladder.
  • the light used for identifying the CBD can be: monochromatic, comprised of multiple monochromatic sources, or be polychromatic. It may be randomly polarized, linearly polarized or circular polarized.
  • the light source may be coherent or incoherent. Also, the light source may be constant wave or pulsed.
  • the light sources reside in an enclosure 601 (light box).
  • optical fiber 606 (this could be a bundle of fibers).
  • the optical fiber 606 is connected to the light box 606 on one end and to a connector on the laparoscope on the other end.
  • the connector on the laparoscope has a fiber bundle attached to it.
  • Organic materials have optical properties which are specific to that individual material. The system uses these unique properties to identify the CBD. In this case, the system detects fluorescence of the bile in the CBD, the bile in the CBD with a fluorescent dye added to the bile, or the auto-fluorescence of the tissue(s) itself.
  • the organic material absorbs a photon and then emits a photon at a longer wavelength (Stokes shifted).
  • the emission is called fluorescent emission light and this can be collected by the laparoscope.
  • the laparoscope also collects visual light as an image which can be seen by the human eye or preferably a camera.
  • the visual light is split off by the beamsplitter 704 and directed to cameras that detect visual images 702.
  • the cameras can be individual chips and the number of cameras can vary depending on the application.
  • a focusing assembly (not shown) may be placed in front of the cameras 702, 703 in order to correct any beam distortion that occurs in the light path.
  • the light is split off with beamsplitters to specific cameras.
  • the compact housing 701 is optional and may be used in the standalone embodiment described above in FIG. 5. If the add-on embodiment described in FIG. 4 is used, the compact housing 701 may not be implemented.
  • the CBD imaging system involves the following steps:
  • a light source that could be ultraviolet, infrared, or visible to excite the fluorescent material.
  • the fluorescent agent can be any agent that fluoresces in the ultraviolet, visible, or infrared (IR) range.
  • the agent can be an optically active substance such as Indocyanine green (ICG), fluorescein, methylene blue, isosulfan blue, or any new fluorescent or color-based visualization media and markers.
  • ICG Indocyanine green
  • fluorescein fluorescein
  • methylene blue methylene blue
  • isosulfan blue or any new fluorescent or color-based visualization media and markers.
  • the fluorescent agent can be administered intravenously before or during the surgery if it is excreted into the bile (such as ICG).
  • an administration kit comprised of a biomarker, a biocompatible solution for infusion, and the necessary tubing and instructions are provided.
  • the time of preoperative IV administration of ICG is 40-60 minutes before the start of surgery.
  • the ICG can be infused as part of a chemical "cocktail" that can optimize, enhance or change the ICG's optical properties.
  • the fluorescent contrast agent can be placed into the CBD via direct injection into the gallbladder 204, the cystic duct 205, or the CBD 201. Injecting the agent into the gallbladder has the advantages of ease, no need for prior dissection, and safety, as the gallbladder is away from the CBD.
  • a specialized instrument 801 exists to inject liquid into the gallbladder 802 and then into the CBD (as described in U.S. Patent No. 5,224,931).
  • a new laparoscopic instrument can be used specifically to inject fluorescent contrast material into the gallbladder.
  • Such an instrument could have a 5mm diameter shaft, jaws to hold the gallbladder, and a channel to inject the fluorescent material.
  • This injection conduit may be separate from the jaws, or may traverse the jaws such that when the gallbladder is grasped, the fluorescent material can be injected directly into the gallbladder without spillage (much like a snake bite).
  • the fluorescent material could also be introduced into the CBD via the cystic duct 205 (the duct that connects the gallbladder to the CBD) instead of via the gallbladder 204.
  • the cystic duct is dissected free in a standard manner for a standard intraoperative cholangiogram (IOC).
  • IOC intraoperative cholangiogram
  • An IOC catheter is placed into the cystic duct, secured, and the contrast agent is injected into the cystic duct and then into CBD.
  • This last embodiment will result in imaging of the CBD, however it requires the previous successful dissection of the cystic duct, hence, exposing the patient to some, if not most, of the risk of the procedure prior to imaging the CBD.
  • Excitation of the fluorescent contrast agent with a light energy source can be excited by light in different wavelengths including ultraviolet (UV), visual, or infrared (IR).
  • the energy source can be one or more broad spectrum lamps, one or more lasers, or one or more light-emitting diodes (LEDs).
  • the source will be referred herein as the narrow band energy source.
  • a narrow wavelength band in the UV, IR, or visible range is used to excite a specific fluorescent molecule.
  • the narrow band energy source can be part of the laparoscopic light source or be enclosed in a separate housing with various methods used to direct the light to the tissues.
  • the narrow band energy source couples to the laparoscopic light source via an optical coupling box, thereby combining the visible and narrow band light in the existing fiberoptic cable that connects to the laparoscope.
  • the narrow band light source can project the light onto the tissues via a completely separate lighting system such as a second laparoscope, a special light probe, or via one or more optically active trocars.
  • the narrow band light source can produce light energy in one or more narrow wavelengths and its intensity and wavelength can be adjustable by the user.
  • the narrow band energy source can be used to vary the type of visible light projected upon the surgical field.
  • Light in one or multiple wavelengths, with or without white light can be used to illuminate the surgical field. This effect can be used to enhance the contrast, depth, and differentiation of various tissues depending on their optical reflective, absorptive properties, and autofluorescence.
  • the color, intensity, and spatial distribution of the light can be controlled and varied by the user to achieve various shadowing effects so as to enhance depth perception.
  • a specialized electronic controller box is needed for this and the user can use a joystick, switch, or knobs to control the lighting factors mentioned.
  • the use of combinations of various colors and intensities of light, along with varying the spatial distribution of the source of the light can assist the surgeon with depth perception and tissue differentiation.
  • the ICG infusion combined with the light generated from the IR laser/LED light source from the light box (described above), generates enough fluorescence to be imaged by existing laparoscopic camera systems without a having to add on an IR light detection camera to the laparoscope.
  • the embodiment would add the ICG infusion/instrument delivery and the IR laser/LED light box as described above, but with no additional camera systems. The surgeon will be able to view the surgical field using the existing laparoscopic camera and monitor, and also view the fluorescent image of the CBD in the surgical field.
  • the fluorescent contrast agent is excited by the narrow band light energy and produces light emission in a certain wavelength band.
  • This emitted energy can be captured by the endoscope, laparoscope, thoracoscope, cystoscope, surgical microscope, or a second optical probe introduced into the body cavity for this purpose.
  • the light energy passing through the above-mentioned capture devices is then isolated, if needed, via a beam splitter or other light filtering device and directed to a detector. Methods for detecting the fluorescent contrast agent are discussed above.
  • Certain filters may be used to filter non-desirable wavelengths of light from the collected light energy to enhance the detection of the fluorescent substance.
  • the filters may be static or changeable, and may be controlled by an electronic controller.
  • the fluorescent emission light signal is passed through a microprocessor or computer to extract the critical tissue image information.
  • This process may use software algorithms to enhance the image, to change the size, shape, and texture of the image, to change the color of the image, and/or to change the image to a computer generated graphic. All these parameters may adjustable by the user or set up into a predetermined set of choices to accommodate different user's preferences.
  • Displaying the live surgical image and the fluorescent image. Referring to FIG. 9, a series of images showing visible light images and fluorescent emission light images is shown. The digital output from the processed fluorescent emission light signal is digitally combined with the visual light image in order to create a seamless overlay of both images. The combining and/or overlaying of the images can be performed by software in a computer or microprocessor. The parameters of the overlay and the presence of each image layer is user selectable.
  • the combined visual/fluorescent image is displayed on an existing standard laparoscopic CRT, display, video monitor, flat panel display, projector, or head- mounted display.
  • the combined digital image is output in a format compatible with standard monitors on the market today.
  • the overlay image can be turned on or off by the user via a switch or software control which could alternatively be voice activated.
  • the overlay image presents the images in a manner that the surgeon can see the location of the CBD via the fluorescent emission from any normal visual angle while he is working. Some surgeons may prefer to have two monitors, one without the overlay image and one with the overlay image.
  • the system can handle multiple displays with different combinations of images.
  • the system can also display an overlay image with the visual light image shown in a picture in a picture mode where either image can be shown as the main image and the other as the smaller image in the sub-picture display.
  • a visible light image 901 of tissue over a bile duct and an artery is shown without an overlay.
  • the fluorescent image 902 of the bile duct and artery is shown, also without an overlay.
  • the two types of images do not convey enough information to the surgeon alone.
  • the combination of the two images allows the surgeon to picture what is under the tissue as well as the tissue itself.
  • the normal and enhanced bile duct images are displayed together in a natural overlaid manner 903 on the surgical image so the CBD is visible to the surgeon despite being under the overlying tissue.
  • the visible light image may be altered in color and/or intensity to highlight the fluorescent image.
  • the fluorescent image can be changed to any desirable color by the user.
  • the fluorescent image is easily enhanced due to the fluorescent image being only what is fluorescent in the body cavity.
  • the software for image processing allows the user to configure and control the CBD visualization system before, during, and after surgery.
  • the control may be carried out via a computer keyboard, a specialized key pad, touch screen, foot-pedal, voice control, a head-up display, etc.
  • the control may be provided to the surgeon in a sterile enclosure such as a plastic cover, on the floor as a foot pedal, or may be used by the circulating nurse in a non-sterile setting.
  • the computer used for the digital processing of images and control of the image detection can include software and hardware for recording the combined visual and fluorescent images on an external or internal digital recording device such as CD, DVD, optical disk, hard disk, or flash memory.
  • the capacity to print static combined images onto photo paper can be included in the system.
  • the system can provide an Ethernet connection to allow Internet or intranet connectivity so that recordings may be made to a server or transmitted over the Internet or intranet for training purposes.
  • NOTES Natural Orifice Translumenal Endoscopic Surgery
  • the bile duct vision system operates in an identical manner to the laparoscopic application described above.
  • the fluorescent excitation light is introduced into the fiberoptic system of the flexible endoscope.
  • a beam-splitter collar and separate fluorescent excitation camera system attached to the endoscope would be used to capture the fluorescent image.
  • the fluorescent image would be processed and both images displayed in: overlay mode, picture in a picture, or side by side formats (all described above), to the surgical team.
  • the fluorescent excitation source and camera are integrated into the endoscopic equipment system.
  • the ICG or other fluorescent or color marker would be introduced into the common bile duct either via IV injection prior to surgery or by direct injection into the gallbladder during surgery. The direct injection could be done with existing endoscopic injection needle catheters, a percutaneous needle, or a newly designed instrument or catheter for the injection.
  • the displayed images are expanded past the two-dimensional arena.
  • the embodiment displays a three-dimensional image to the surgeon.
  • the surgeon or assistant has the ability to rotate the images using a remote control or using a command device on the laparoscope, endoscope, thoracoscope, cystoscope, etc.
  • FIG 10 is a block diagram that illustrates a computer system 1000 upon which an embodiment of the invention may be implemented.
  • Computer system 1000 includes a bus 1002 or other communication mechanism for communicating information, and a processor 1004 coupled with bus 1002 for processing information.
  • Computer system 1000 also includes a main memory 1006, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1002 for storing information and instructions to be executed by processor 1004.
  • Main memory 1006 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1004.
  • Computer system 1000 further includes a read only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static information and instructions for processor 1004.
  • ROM read only memory
  • a storage device 1010 such as a magnetic disk or optical disk, is provided and coupled to bus 1002 for storing information and instructions.
  • Computer system 1000 may be coupled via bus 1002 to a display 1012, such as a cathode ray tube (CRT), projection, head-mounted display or flat panel display for displaying information to a computer user.
  • An input device 1014 is coupled to bus 1002 for communicating information and command selections to processor 1004.
  • cursor control 1016 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1004 and for controlling cursor movement on display 1012.
  • This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
  • the invention is related to the use of computer system 1000 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006. Such instructions may be read into main memory 1006 from another machine-readable medium, such as storage device 1010. Execution of the sequences of instructions contained in main memory 1006 causes processor 1004 to perform the process steps described herein. In alternative embodiments, hardwired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
  • machine -readable medium refers to any medium that participates in providing data that causes a machine to operation in a specific fashion.
  • various machine-readable media are involved, for example, in providing instructions to processor 1004 for execution.
  • Such a medium may take many forms, including but not limited to storage media and transmission media.
  • Storage media includes both non-volatile media and volatile media.
  • Non- volatile media includes, for example, optical or magnetic disks, such as storage device 1010.
  • Volatile media includes dynamic memory, such as main memory 1006.
  • Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 1002.
  • Machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD/DVD, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
  • Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to processor 1004 for execution.
  • the instructions may initially be carried on a magnetic disk of a remote computer.
  • the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
  • a modem local to computer system 1000 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
  • An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 1002.
  • Bus 1002 carries the data to main memory 1006, from which processor 1004 retrieves and executes the instructions.
  • the instructions received by main memory 1006 may optionally be stored on storage device 1010 either before or after execution by processor 1004.
  • Computer system 1000 also includes a communication interface 1018 coupled to bus 1002.
  • Communication interface 1018 provides a two-way data communication coupling to a network link 1020 that is connected to a local network 1022.
  • communication interface 1018 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line.
  • ISDN integrated services digital network
  • communication interface 1018 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
  • LAN local area network
  • Wireless links may also be implemented.
  • communication interface 1018 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
  • Network link 1020 typically provides data communication through one or more networks to other data devices.
  • network link 1020 may provide a connection through local network 1022 to a host computer 1024 or to data equipment operated by an Internet Service Provider (ISP) 1026.
  • ISP 1026 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the "Internet" 1028.
  • Internet 1028 uses electrical, electromagnetic or optical signals that carry digital data streams.
  • Computer system 1000 can send messages and receive data, including program code, through the network(s), network link 1020 and communication interface 1018.
  • a server 1030 might transmit a requested code for an application program through Internet 1028, ISP 1026, local network 1022 and communication interface 1018.
  • the received code may be executed by processor 1004 as it is received, and/or stored in storage device 1010, or other non-volatile storage for later execution. In this manner, computer system 1000 may obtain application code in the form of a carrier wave.
  • embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Endoscopes (AREA)

Abstract

L'invention porte sur un procédé et sur un appareil pour imager des caractéristiques d'un canal cholédoque commun (CBD) dans un patient, lequel procédé consiste à introduire un agent de contraste fluorescent dans le CBD. Une source de lumière transmet à la fois une lumière visible et une lumière fluorescente dans la cavité abdominale d'un patient par l'intermédiaire du laparoscope. Des caméras fixées au laparoscope ou intégrées dans celui-ci détectent des images de lumière visible et des images de lumière d'émission par fluorescence. Les signaux d'images de lumière visible et d'images fluorescentes sont traités pour combiner les signaux d'images de lumière d'émission par fluorescence et les signaux d'images visibles en un signal d'affichage unique. Le système ajuste les caractéristiques d'affichage, telles que la couleur, de l'image de lumière d'émission par fluorescence, de telle sorte qu'elle contraste bien avec l'image de lumière visible, de façon à ce que le chirurgien puisse facilement faire la distinction entre les deux images. Le signal d'affichage est envoyé à un écran vidéo où le chirurgien voit l'image de lumière visible et l'image fluorescente sous la forme d'une image en superposition unique.
PCT/US2009/031712 2008-01-24 2009-01-22 Système d'imagerie chirurgicale de canal cholédoque commun WO2009094465A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2010544420A JP2011510705A (ja) 2008-01-24 2009-01-22 総胆管外科手術の画像化システム
CA2713113A CA2713113A1 (fr) 2008-01-24 2009-01-22 Systeme d'imagerie chirurgicale de canal choledoque commun
EP09703731A EP2254456A1 (fr) 2008-01-24 2009-01-22 Système d'imagerie chirurgicale de canal cholédoque commun
CN2009801103002A CN102006818A (zh) 2008-01-24 2009-01-22 胆总管手术成像系统

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US12/011,484 US20090192390A1 (en) 2008-01-24 2008-01-24 Common bile duct surgical imaging system
US12/011,484 2008-01-24
US12/011,490 2008-01-24
US12/011,490 US9072445B2 (en) 2008-01-24 2008-01-24 Common bile duct surgical imaging system

Publications (1)

Publication Number Publication Date
WO2009094465A1 true WO2009094465A1 (fr) 2009-07-30

Family

ID=40481821

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/031712 WO2009094465A1 (fr) 2008-01-24 2009-01-22 Système d'imagerie chirurgicale de canal cholédoque commun

Country Status (5)

Country Link
EP (1) EP2254456A1 (fr)
JP (1) JP2011510705A (fr)
CN (1) CN102006818A (fr)
CA (1) CA2713113A1 (fr)
WO (1) WO2009094465A1 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012075696A1 (fr) * 2010-12-10 2012-06-14 广州宝胆医疗器械科技有限公司 Système endoscope de cholécystoscopie à fonction de balayage thermique infrarouge
WO2012075706A1 (fr) * 2010-12-10 2012-06-14 广州宝胆医疗器械科技有限公司 Système de cholécystoscopie intégrant un dispositif de balayage thermique infrarouge
JP2013507182A (ja) * 2009-10-07 2013-03-04 インテュイティブ サージカル オペレーションズ, インコーポレイテッド 臨床画像上に強調された画像化データを表示するための方法および装置
EP2698101A1 (fr) * 2012-08-15 2014-02-19 Aspect Imaging Ltd. Système d'imagerie par résonance magnétique (IRM) pour générer une image de rendu
EP2698100A1 (fr) * 2012-08-15 2014-02-19 Aspect Imaging Ltd. Système d'imagerie pour générer une image de rendu
JP2020006244A (ja) * 2010-07-02 2020-01-16 インテュイティブ サージカル オペレーションズ, インコーポレイテッド 手術システム及び強調画像表示生成方法
US20210298584A1 (en) * 2018-12-10 2021-09-30 Olympus Corporation Image recording apparatus, image recording method, and endoscope system
US11717375B2 (en) 2010-07-02 2023-08-08 Intuitive Surgical Operations, Inc. Methods and systems for alternate image display

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5385350B2 (ja) * 2011-08-16 2014-01-08 富士フイルム株式会社 画像表示方法および装置
TW201505603A (zh) * 2013-07-16 2015-02-16 Seiko Epson Corp 資訊處理裝置、資訊處理方法及資訊處理系統
JP6484336B2 (ja) * 2015-06-17 2019-03-13 オリンパス株式会社 撮像装置
JP2017164007A (ja) * 2016-03-14 2017-09-21 ソニー株式会社 医療用画像処理装置、医療用画像処理方法、プログラム
KR101998592B1 (ko) * 2017-09-20 2019-07-10 인더스마트 주식회사 근적외선 형광 검출장치 및 방법
CN107811705A (zh) * 2017-11-27 2018-03-20 湖北得康科技有限公司 一种新型的内窥镜系统
EP3917378A4 (fr) * 2019-01-28 2022-09-14 MediBeacon Inc. Systèmes et procédés de surveillance transdermique du dfg à domicile
CN109893092B (zh) * 2019-02-20 2024-03-29 广州乔铁医疗科技有限公司 可扫描腹腔内部的腹腔镜外视镜装置
CN111166276A (zh) * 2020-01-24 2020-05-19 复旦大学 经腹腔-腹腔镜卵巢近红外荧光成像检测系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999001749A1 (fr) * 1997-07-03 1999-01-14 Smith & Nephew, Inc. Systeme d'imagerie par fluorescence
WO2005034747A1 (fr) * 2003-09-15 2005-04-21 Beth Israel Deaconess Medical Center Systemes d'imagerie medicale
US20070135803A1 (en) * 2005-09-14 2007-06-14 Amir Belson Methods and apparatus for performing transluminal and other procedures

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999001749A1 (fr) * 1997-07-03 1999-01-14 Smith & Nephew, Inc. Systeme d'imagerie par fluorescence
WO2005034747A1 (fr) * 2003-09-15 2005-04-21 Beth Israel Deaconess Medical Center Systemes d'imagerie medicale
US20070135803A1 (en) * 2005-09-14 2007-06-14 Amir Belson Methods and apparatus for performing transluminal and other procedures

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3109822A1 (fr) * 2009-10-07 2016-12-28 Intuitive Surgical Operations, Inc. Procédés et appareil d'affichage de données d'imagerie améliorée sur une image clinique
EP4191518A1 (fr) * 2009-10-07 2023-06-07 Intuitive Surgical Operations, Inc. Procédés et appareil d'affichage de données d'imagerie améliorées sur une image clinique
JP2013507182A (ja) * 2009-10-07 2013-03-04 インテュイティブ サージカル オペレーションズ, インコーポレイテッド 臨床画像上に強調された画像化データを表示するための方法および装置
EP3965057A1 (fr) * 2009-10-07 2022-03-09 Intuitive Surgical Operations, Inc. Procédés et appareil d'affichage de données d'imagerie améliorée sur une image clinique
EP3731176A1 (fr) * 2009-10-07 2020-10-28 Intuitive Surgical Operations, Inc. Procédés et appareil d'affichage de données d'imagerie améliorée sur une image clinique
JP2020006244A (ja) * 2010-07-02 2020-01-16 インテュイティブ サージカル オペレーションズ, インコーポレイテッド 手術システム及び強調画像表示生成方法
JP7049302B2 (ja) 2010-07-02 2022-04-06 インテュイティブ サージカル オペレーションズ, インコーポレイテッド 手術システムの作動方法
US11717375B2 (en) 2010-07-02 2023-08-08 Intuitive Surgical Operations, Inc. Methods and systems for alternate image display
WO2012075696A1 (fr) * 2010-12-10 2012-06-14 广州宝胆医疗器械科技有限公司 Système endoscope de cholécystoscopie à fonction de balayage thermique infrarouge
WO2012075706A1 (fr) * 2010-12-10 2012-06-14 广州宝胆医疗器械科技有限公司 Système de cholécystoscopie intégrant un dispositif de balayage thermique infrarouge
EP2698100A1 (fr) * 2012-08-15 2014-02-19 Aspect Imaging Ltd. Système d'imagerie pour générer une image de rendu
EP2698101A1 (fr) * 2012-08-15 2014-02-19 Aspect Imaging Ltd. Système d'imagerie par résonance magnétique (IRM) pour générer une image de rendu
US20210298584A1 (en) * 2018-12-10 2021-09-30 Olympus Corporation Image recording apparatus, image recording method, and endoscope system
US12003891B2 (en) * 2018-12-10 2024-06-04 Olympus Corporation Image recording apparatus, image recording method, and endoscope system

Also Published As

Publication number Publication date
EP2254456A1 (fr) 2010-12-01
CN102006818A (zh) 2011-04-06
JP2011510705A (ja) 2011-04-07
CA2713113A1 (fr) 2009-07-30

Similar Documents

Publication Publication Date Title
US9072445B2 (en) Common bile duct surgical imaging system
US20090192390A1 (en) Common bile duct surgical imaging system
EP2254456A1 (fr) Système d'imagerie chirurgicale de canal cholédoque commun
CN103298391B (zh) 一次性内窥镜接入装置及可携式显示器
US20130211246A1 (en) METHODS AND DEVICES FOR GASTROINTESTINAL SURGICAL PROCEDURES USING NEAR INFRARED (nIR) IMAGING TECHNIQUES
US20070015967A1 (en) Autosteering vision endoscope
US20110245602A1 (en) Flexible endoscope with full-length lumen
JP2011152202A (ja) 画像取得装置、観察装置、および観察システム
JP6031040B2 (ja) トロカールシステム
EP3858278A1 (fr) Néphroscope comprenant une partie distale flexible et articulable
US9814369B2 (en) Pivoting three-dimensional video endoscope
Brandão et al. Imaging Equipment and Operating Room Set‐Up
CN107811705A (zh) 一种新型的内窥镜系统
Frank et al. Technological aspects of minimal access surgery
US20230095278A1 (en) Surgical Anchoring Systems for Endoluminal Access
US11903557B2 (en) Endoscope for imaging in nonvisible light
CN209770309U (zh) 一种激光手术内窥镜
US20040215057A1 (en) Portable, reusable visualization system
JP2575107B2 (ja) 内視鏡用焼灼装置
US20220240961A1 (en) Endoscope assembly having a surgical instrument and endoscope system having the same
US12036418B2 (en) Surgical devices for treating body tissue and diagnosing patients
US20230248209A1 (en) Assistant device, endoscopic system, assistant method, and computer-readable recording medium
US20210196974A1 (en) Surgical devices for treating body tissue and diagnosing patients
CN208259757U (zh) 一种激光切割内镜
WO2015193892A1 (fr) Dispositif d'éclairage pour cholécystectomie

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980110300.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09703731

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2713113

Country of ref document: CA

Ref document number: 2010544420

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2009703731

Country of ref document: EP