WO2009094465A1 - Système d'imagerie chirurgicale de canal cholédoque commun - Google Patents
Système d'imagerie chirurgicale de canal cholédoque commun Download PDFInfo
- Publication number
- WO2009094465A1 WO2009094465A1 PCT/US2009/031712 US2009031712W WO2009094465A1 WO 2009094465 A1 WO2009094465 A1 WO 2009094465A1 US 2009031712 W US2009031712 W US 2009031712W WO 2009094465 A1 WO2009094465 A1 WO 2009094465A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image data
- fluorescent
- visual
- cbd
- light
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/313—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
- A61B1/3132—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes for laparoscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0071—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/063—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/7425—Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
Definitions
- the present invention relates to surgical imaging systems.
- gall bladder surgical imaging systems In particular, gall bladder surgical imaging systems.
- FIG. 1 is a diagram illustrating a surgical instrument used during laparoscopic surgery according to an embodiment of the invention
- FIG. 2 is a diagram illustrating the bile duct anatomy
- FIG. 3 is a diagram illustrating an intraoperative cholangiogram (IOC).
- FIG. 4 is a block diagram illustrating an add-on configuration of a common bile duct imaging system according to an embodiment of the invention
- FIG. 5 is a block diagram illustrating a standalone configuration of a common bile duct imaging system according to an embodiment of the invention
- FIG. 6 is a diagram illustrating an optical layout for a laparoscopic lighting system according to an embodiment of the invention.
- FIG. 7 is a diagram illustrating an optical layout for a laparoscopic camera system according to an embodiment of the invention.
- FIG. 8 is a block diagram illustrating a prior art implementation of a surgical instrument for injecting liquid into the gallbladder
- FIG. 9 is a block diagram illustrating overlaying of visual light images with fluorescent emission light images into a single display according to an embodiment of the invention.
- FIG. 10 is a block diagram that illustrates a computer system upon which an embodiment may be implemented.
- FIG. 11 is a diagram illustrating a laparoscope with an integral light source according to an embodiment of the invention.
- An embodiment introduces a fluorescent contrast agent into the CBD via direct injection into the gallbladder, the cystic duct, the CBD, or via intravenous injection and excretion of the contrast agent by the liver into the bile.
- a light source illuminates a light path in a laparoscope. The light source transmits both a visible light and an infrared (IR) light (otherwise known as a fluorescent excitation light) into a patient's abdominal cavity via the laparoscope.
- the fluorescent contrast agent is excited by the narrow band light energy and produces light emission in a certain wavelength band.
- a camera assembly on the laparoscope can be communicatively connected to camera controller via an electronic cable, or wirelessly via Bluetooth (or any wireless technology) or a wireless local area network.
- the camera assembly contains both a visible light detection camera and an IR light detection camera.
- the cameras attached to the laparoscope detect visible light images and fluorescent emission light images.
- the visible light image and fluorescent image signals from the camera assembly are processed to combine the fluorescent emission light image signals and visible image signals into a single display signal in order to overlay (or combine) the two images in their proper alignment.
- the system adjusts the display characteristics, such as color, of the fluorescent emission light image so it contrasts well with the visual light image so the surgeon can easily distinguish between the two images.
- the display signal is sent to a video monitor where the surgeon views the visible light image and the fluorescent image as a single overlaid (or combined) image.
- the surgeon can instruct the system to display the fluorescent image in a desired color so the fluorescent image is properly contrasted to the visible image.
- the overlay image can be turned on or off by the user via a switch or software control.
- the system can handle multiple displays with different combinations of images.
- a sensor may be included in the camera housing which allows the user to know which direction the ground or sky is. This allows the surgeon to select and display the orientation of the camera as referenced to the sky or the ground. This could be very helpful in NOTES type of operations as well (discussed below).
- the system can record the combined visual and fluorescent images on an external or internal digital recording device such as CD, DVD, optical disk, hard disk, or flash memory.
- the system has an Ethernet connection to allow Internet or intranet connectivity so that recordings may be made to a server or transmitted over the Internet or intranet.
- FIG. 1 As mentioned above, during gallbladder surgery, the surgeon inserts several tubes 101, called trocars or ports, into the abdominal cavity.
- a 10mm diameter optical scope, a laparoscope 102 is inserted into one of the ports.
- the laparoscope is attached to a video camera that allows the surgeon and the surgical team to view the inside of the abdominal cavity on a video screen.
- Long, slender instruments 103, 104, 105 are passed through the other ports to grasp, dissect, and cut the tissue.
- FIG. 2 illustrates the bile duct anatomy.
- the common bile duct (CBD) 201 carries the bile from the liver 202 to the intestine 203 for digestion.
- the gallbladder 204 is a side pouch that stores bile, and squeezes into the CBD 201 during meals.
- the gallbladder 204 is attached to the CBD 201 by the cystic duct 205.
- the cystic duct 205 must be clearly identified by the surgeon, clipped or ligated, and then cut with scissors. If the surgeon mistakes the CBD 201 for the cystic duct 205, a CBD injury will occur. If the surgeon uses electrocautery energy to coagulate bleeding near the CBD 201 he may injure the CBD 201.
- the only way to see the CBD at present is to do an intraoperative cholangiogram (IOC).
- IOC intraoperative cholangiogram
- the IOC picture 301 is displayed on a black and white screen and can be printed or saved.
- Performing an IOC is not considered standard of care and is not done in all operations due to the cost, time, and trouble of performing it.
- x-ray exposure to the patient and surgical staff is a concern.
- An embodiment images the bile duct during gallbladder surgery and presents the CBD image as a real-time display for the surgeon.
- This device can reduce the CBD injury rate by at least 50% or perhaps more, thereby saving approximately 2000 patients per year (in the U.S.) from the pain and suffering resulting from a CBD injury and speed up all procedures since the CBD can be quickly identified and avoided.
- Embodiments can be built as either an add-on to current laparoscopic systems or as an integrated standalone system.
- the embodiments allow the surgeon to see the CBD in its proper position during gallbladder surgery.
- FIG. 4 shows an embodiment of an add-on configuration that integrates with current laparoscopic light sources and video systems.
- a fluorescent imaging module 404 introduces IR light 407 into the existing fiberoptic lighting system 403 and through the light channel of the laparoscope 406.
- An infrared detection coupler 405 is added to the laparoscope 406 between the laparoscope and visible light camera 409.
- the infrared detection coupler 405 contains a camera that is capable of detecting an IR signal from a fluorescent marker or tissue auto-fluorescence.
- the infrared detection coupler 405 is communicatively connected to the fluorescent imaging module 404.
- the connectors may be electronic cables, fiberoptic cables, a wireless transmission system, or any combination and/or quantity thereof.
- connection cables may be disposable or reusable and may need to be sterilized if they contact the sterile surgical field.
- the IR image may be transmitted via an optical path to a remote IR camera (that may be located near the fluorescent imaging module 404). This may be necessary in case the size of an IR camera is not compatible with the coupler 405 size specifications.
- the light source 403 transmits visible light through the fiberoptics in the laparoscope 406.
- the fluorescent imaging module 404 transmits IR light (fluorescent excitation light) through the fiberoptics in the laparoscope 406 at the same time.
- the camera controller 402 receives visible light image signals (the actual view of the surgical field using visible light) from the existing camera 409 mounted to the laparoscope 406.
- the camera controller 402 processes the visible light image signals into visible image display signals and sends the visible image display signals to the fluorescent imaging module 404.
- the fluorescent imaging module 404 receives IR (fluorescent) light image signals from the infrared detection coupler 405.
- the fluorescent imaging module 404 digitally processes the fluorescent emission light image signals using a computer system or dedicated microprocessor to create a pleasing and natural graphics display of the CBD.
- the fluorescent imaging module 404 can use any known technique to combine the fluorescent emission light image signals and visible image display signals into a single display signal in order to overlay the two images in their proper alignment. This can include a simple reliance on a common focus point where the two cameras are aligned before surgery and the two image signals are combined in a straightforward manner, or using software to automatically detect common reference points within the two image signals in order to properly align the two images.
- the video output signal 408 is sent to a video monitor 401 where the surgeon views the visible light image and the fluorescent image as a single overlaid image.
- the surgeon can instruct the fluorescent imaging module 404 to display the fluorescent image in a desired color, shape, or texture so the fluorescent image is properly contrasted to the visible image.
- the add-on system may need to replace one of the components of current laparoscopic systems, either the camera head 409, the camera controller 402, or the light source 403. In that case, the system interfaces with the remaining components either at the input or output of those devices.
- FIG. 5 illustrates an embodiment that is a standalone CBD imaging system that integrates the IR light source, IR detection system, visible light source, and visible image detection system into a complete and standalone laparoscopic imaging system with enhanced optical capabilities.
- the embodiment incorporates both a visible light camera and an IR light camera into a single camera enclosure 505 that attaches to the laparoscope 504 or is integrated into the laparoscope 504.
- the light source 503 transmits both visible light and IR light to fiberoptics in the laparoscope 504.
- the visible and IR light sources can be integrated into the laparoscope 504 itself or into a trocar to eliminate the need for fiberoptic cables to be connected from the camera controller 502 to the laparoscope 504, thus, making the laparoscope assembly lighter and easier to maneuver.
- the light source 503 is instructed by the camera controller 502 to illuminate the light path in the laparoscope 504.
- the light source 503 transmits both (depending on the request) a visible light and an IR light to the laparoscope 504.
- the camera controller 504 receives signals from cameras in the laparoscope 504.
- the camera assembly 505 can be communicatively connected to camera controller 504 via an electronic cable, fiberoptic cable, wirelessly via Bluetooth (or any wireless technology) or a wireless local area network, or any combination and/or quantity thereof.
- the camera assembly 505 contains both a visible light detection camera and an IR light detection camera.
- the cameras in the laparoscope 504 detect visible light images and fluorescent emission light images.
- the camera assembly 505 can contain other types of detectors that can accomplish the visible light image and fluorescent emission light image detection as cameras.
- the visible light image and fluorescent image signals from the camera assembly 505 are processed by the camera controller 504.
- the camera controller 504 can use any known technique to combine the fluorescent emission light image signals and visible image signals into a single display signal in order to overlay the two images in their proper alignment.
- the two cameras since the two cameras are in an integral camera assembly 505, the cameras will have very little parallax error and can be factory aligned.
- the two image signals are then combined in a straightforward manner.
- the cameras can also be aligned to a common focus point before surgery. Alternatively, software can be used to automatically detect common reference points within the two image signals in order to properly align the two images.
- the camera controller 504 adjusts the display characteristics, such as color, of the fluorescent emission light image so it contrasts well with the visual light image so the surgeon can easily distinguish between the two images.
- the display signal is sent to a video monitor 501 where the surgeon views the visible light image and the fluorescent image as a single overlaid image.
- the surgeon can instruct the camera controller 504 to display the fluorescent image in a desired color, shape, and texture so the fluorescent image is properly contrasted to the visible image.
- the UV, visible, or IR fluorescence detector may be the same CCD device used for the detection of visible light.
- a single CCD can be used to detect both IR and visible light.
- the CCD may be controlled via a controller circuit to allow the detection of the emitted light signal either simultaneously or alternating with the visible light (interlaced detection). This detection may require the use of passive or active filters and a switching mechanism. Both the visible and the fluorescent emission light signals from the CCD would then be carried to an electronic circuit that would separate the fluorescent emission light signal and the visible light signal for separate digital processing.
- Modern laparoscopic cameras usually have three CCD chips (red, blue, and green).
- a three-chip device can be used as described in the previous paragraph to detect both the visible and fluorescent emission light signals.
- Another alternative is to build a four-chip, five-chip, or greater number of chips, laparoscopic camera.
- Such a camera would contain three CCD chips for visible light detection plus any additional CCDs for detection of the fluorescent signal.
- the separate dedicated CCDs for the detection of the fluorescent emission light would be optimized for detecting light in the IR, NIR, visible or UV wavelengths.
- the detection could require active or passive filtering, and a switching controller.
- the advantage would be that the fluorescent emission light detector could be activated and filtered separately from the visible light controller.
- the entire assembly would attach to the laparoscope, endoscope, thoracoscope, or cystoscope either via a retractable housing on the viewing end, by being permanently designed as a component of the endoscope head, or by being miniaturized and placed on the tip of the endoscope in a "chip on the tip" configuration.
- a separate collar, separator, or beam splitting box would not be needed. All optical manipulations would be carried out within the camera housing.
- the camera would be connected to its controller box via an electronic cable or wirelessly via Bluetooth (or any wireless technology) or a wireless local area network.
- FIG. 11 illustrates an embodiment of a laparoscope 1101 with an integral light source 1102 and cameras 1103 attached.
- the light source 1102 could be: a standard white light bulb, filtered light, lamp, LED, laser, etc.
- the light source 1102 may be powered by: an electric cord, an internal battery, or inductively coupled.
- Inside the body of the light source 1102 a lens system shapes the light beam to wide angle or narrow angle, which is selectable by the user.
- a version of the light source may be cylindrical in nature and have a plurality of flat surfaces around it circumference. This shape has resistance to rolling because of the flat surfaces and helps prevent the light source 1102 from rolling off of a table when not attached to the laparoscope 1101.
- light from a broadband source 602 (this is used for the visual cameras) is combined with light that is used for navigation and targeting of the CBD 603, 604.
- the goal is to identify the CBD so as not to physically damage it during an operation on the gallbladder or removal of the gallbladder.
- the light used for identifying the CBD can be: monochromatic, comprised of multiple monochromatic sources, or be polychromatic. It may be randomly polarized, linearly polarized or circular polarized.
- the light source may be coherent or incoherent. Also, the light source may be constant wave or pulsed.
- the light sources reside in an enclosure 601 (light box).
- optical fiber 606 (this could be a bundle of fibers).
- the optical fiber 606 is connected to the light box 606 on one end and to a connector on the laparoscope on the other end.
- the connector on the laparoscope has a fiber bundle attached to it.
- Organic materials have optical properties which are specific to that individual material. The system uses these unique properties to identify the CBD. In this case, the system detects fluorescence of the bile in the CBD, the bile in the CBD with a fluorescent dye added to the bile, or the auto-fluorescence of the tissue(s) itself.
- the organic material absorbs a photon and then emits a photon at a longer wavelength (Stokes shifted).
- the emission is called fluorescent emission light and this can be collected by the laparoscope.
- the laparoscope also collects visual light as an image which can be seen by the human eye or preferably a camera.
- the visual light is split off by the beamsplitter 704 and directed to cameras that detect visual images 702.
- the cameras can be individual chips and the number of cameras can vary depending on the application.
- a focusing assembly (not shown) may be placed in front of the cameras 702, 703 in order to correct any beam distortion that occurs in the light path.
- the light is split off with beamsplitters to specific cameras.
- the compact housing 701 is optional and may be used in the standalone embodiment described above in FIG. 5. If the add-on embodiment described in FIG. 4 is used, the compact housing 701 may not be implemented.
- the CBD imaging system involves the following steps:
- a light source that could be ultraviolet, infrared, or visible to excite the fluorescent material.
- the fluorescent agent can be any agent that fluoresces in the ultraviolet, visible, or infrared (IR) range.
- the agent can be an optically active substance such as Indocyanine green (ICG), fluorescein, methylene blue, isosulfan blue, or any new fluorescent or color-based visualization media and markers.
- ICG Indocyanine green
- fluorescein fluorescein
- methylene blue methylene blue
- isosulfan blue or any new fluorescent or color-based visualization media and markers.
- the fluorescent agent can be administered intravenously before or during the surgery if it is excreted into the bile (such as ICG).
- an administration kit comprised of a biomarker, a biocompatible solution for infusion, and the necessary tubing and instructions are provided.
- the time of preoperative IV administration of ICG is 40-60 minutes before the start of surgery.
- the ICG can be infused as part of a chemical "cocktail" that can optimize, enhance or change the ICG's optical properties.
- the fluorescent contrast agent can be placed into the CBD via direct injection into the gallbladder 204, the cystic duct 205, or the CBD 201. Injecting the agent into the gallbladder has the advantages of ease, no need for prior dissection, and safety, as the gallbladder is away from the CBD.
- a specialized instrument 801 exists to inject liquid into the gallbladder 802 and then into the CBD (as described in U.S. Patent No. 5,224,931).
- a new laparoscopic instrument can be used specifically to inject fluorescent contrast material into the gallbladder.
- Such an instrument could have a 5mm diameter shaft, jaws to hold the gallbladder, and a channel to inject the fluorescent material.
- This injection conduit may be separate from the jaws, or may traverse the jaws such that when the gallbladder is grasped, the fluorescent material can be injected directly into the gallbladder without spillage (much like a snake bite).
- the fluorescent material could also be introduced into the CBD via the cystic duct 205 (the duct that connects the gallbladder to the CBD) instead of via the gallbladder 204.
- the cystic duct is dissected free in a standard manner for a standard intraoperative cholangiogram (IOC).
- IOC intraoperative cholangiogram
- An IOC catheter is placed into the cystic duct, secured, and the contrast agent is injected into the cystic duct and then into CBD.
- This last embodiment will result in imaging of the CBD, however it requires the previous successful dissection of the cystic duct, hence, exposing the patient to some, if not most, of the risk of the procedure prior to imaging the CBD.
- Excitation of the fluorescent contrast agent with a light energy source can be excited by light in different wavelengths including ultraviolet (UV), visual, or infrared (IR).
- the energy source can be one or more broad spectrum lamps, one or more lasers, or one or more light-emitting diodes (LEDs).
- the source will be referred herein as the narrow band energy source.
- a narrow wavelength band in the UV, IR, or visible range is used to excite a specific fluorescent molecule.
- the narrow band energy source can be part of the laparoscopic light source or be enclosed in a separate housing with various methods used to direct the light to the tissues.
- the narrow band energy source couples to the laparoscopic light source via an optical coupling box, thereby combining the visible and narrow band light in the existing fiberoptic cable that connects to the laparoscope.
- the narrow band light source can project the light onto the tissues via a completely separate lighting system such as a second laparoscope, a special light probe, or via one or more optically active trocars.
- the narrow band light source can produce light energy in one or more narrow wavelengths and its intensity and wavelength can be adjustable by the user.
- the narrow band energy source can be used to vary the type of visible light projected upon the surgical field.
- Light in one or multiple wavelengths, with or without white light can be used to illuminate the surgical field. This effect can be used to enhance the contrast, depth, and differentiation of various tissues depending on their optical reflective, absorptive properties, and autofluorescence.
- the color, intensity, and spatial distribution of the light can be controlled and varied by the user to achieve various shadowing effects so as to enhance depth perception.
- a specialized electronic controller box is needed for this and the user can use a joystick, switch, or knobs to control the lighting factors mentioned.
- the use of combinations of various colors and intensities of light, along with varying the spatial distribution of the source of the light can assist the surgeon with depth perception and tissue differentiation.
- the ICG infusion combined with the light generated from the IR laser/LED light source from the light box (described above), generates enough fluorescence to be imaged by existing laparoscopic camera systems without a having to add on an IR light detection camera to the laparoscope.
- the embodiment would add the ICG infusion/instrument delivery and the IR laser/LED light box as described above, but with no additional camera systems. The surgeon will be able to view the surgical field using the existing laparoscopic camera and monitor, and also view the fluorescent image of the CBD in the surgical field.
- the fluorescent contrast agent is excited by the narrow band light energy and produces light emission in a certain wavelength band.
- This emitted energy can be captured by the endoscope, laparoscope, thoracoscope, cystoscope, surgical microscope, or a second optical probe introduced into the body cavity for this purpose.
- the light energy passing through the above-mentioned capture devices is then isolated, if needed, via a beam splitter or other light filtering device and directed to a detector. Methods for detecting the fluorescent contrast agent are discussed above.
- Certain filters may be used to filter non-desirable wavelengths of light from the collected light energy to enhance the detection of the fluorescent substance.
- the filters may be static or changeable, and may be controlled by an electronic controller.
- the fluorescent emission light signal is passed through a microprocessor or computer to extract the critical tissue image information.
- This process may use software algorithms to enhance the image, to change the size, shape, and texture of the image, to change the color of the image, and/or to change the image to a computer generated graphic. All these parameters may adjustable by the user or set up into a predetermined set of choices to accommodate different user's preferences.
- Displaying the live surgical image and the fluorescent image. Referring to FIG. 9, a series of images showing visible light images and fluorescent emission light images is shown. The digital output from the processed fluorescent emission light signal is digitally combined with the visual light image in order to create a seamless overlay of both images. The combining and/or overlaying of the images can be performed by software in a computer or microprocessor. The parameters of the overlay and the presence of each image layer is user selectable.
- the combined visual/fluorescent image is displayed on an existing standard laparoscopic CRT, display, video monitor, flat panel display, projector, or head- mounted display.
- the combined digital image is output in a format compatible with standard monitors on the market today.
- the overlay image can be turned on or off by the user via a switch or software control which could alternatively be voice activated.
- the overlay image presents the images in a manner that the surgeon can see the location of the CBD via the fluorescent emission from any normal visual angle while he is working. Some surgeons may prefer to have two monitors, one without the overlay image and one with the overlay image.
- the system can handle multiple displays with different combinations of images.
- the system can also display an overlay image with the visual light image shown in a picture in a picture mode where either image can be shown as the main image and the other as the smaller image in the sub-picture display.
- a visible light image 901 of tissue over a bile duct and an artery is shown without an overlay.
- the fluorescent image 902 of the bile duct and artery is shown, also without an overlay.
- the two types of images do not convey enough information to the surgeon alone.
- the combination of the two images allows the surgeon to picture what is under the tissue as well as the tissue itself.
- the normal and enhanced bile duct images are displayed together in a natural overlaid manner 903 on the surgical image so the CBD is visible to the surgeon despite being under the overlying tissue.
- the visible light image may be altered in color and/or intensity to highlight the fluorescent image.
- the fluorescent image can be changed to any desirable color by the user.
- the fluorescent image is easily enhanced due to the fluorescent image being only what is fluorescent in the body cavity.
- the software for image processing allows the user to configure and control the CBD visualization system before, during, and after surgery.
- the control may be carried out via a computer keyboard, a specialized key pad, touch screen, foot-pedal, voice control, a head-up display, etc.
- the control may be provided to the surgeon in a sterile enclosure such as a plastic cover, on the floor as a foot pedal, or may be used by the circulating nurse in a non-sterile setting.
- the computer used for the digital processing of images and control of the image detection can include software and hardware for recording the combined visual and fluorescent images on an external or internal digital recording device such as CD, DVD, optical disk, hard disk, or flash memory.
- the capacity to print static combined images onto photo paper can be included in the system.
- the system can provide an Ethernet connection to allow Internet or intranet connectivity so that recordings may be made to a server or transmitted over the Internet or intranet for training purposes.
- NOTES Natural Orifice Translumenal Endoscopic Surgery
- the bile duct vision system operates in an identical manner to the laparoscopic application described above.
- the fluorescent excitation light is introduced into the fiberoptic system of the flexible endoscope.
- a beam-splitter collar and separate fluorescent excitation camera system attached to the endoscope would be used to capture the fluorescent image.
- the fluorescent image would be processed and both images displayed in: overlay mode, picture in a picture, or side by side formats (all described above), to the surgical team.
- the fluorescent excitation source and camera are integrated into the endoscopic equipment system.
- the ICG or other fluorescent or color marker would be introduced into the common bile duct either via IV injection prior to surgery or by direct injection into the gallbladder during surgery. The direct injection could be done with existing endoscopic injection needle catheters, a percutaneous needle, or a newly designed instrument or catheter for the injection.
- the displayed images are expanded past the two-dimensional arena.
- the embodiment displays a three-dimensional image to the surgeon.
- the surgeon or assistant has the ability to rotate the images using a remote control or using a command device on the laparoscope, endoscope, thoracoscope, cystoscope, etc.
- FIG 10 is a block diagram that illustrates a computer system 1000 upon which an embodiment of the invention may be implemented.
- Computer system 1000 includes a bus 1002 or other communication mechanism for communicating information, and a processor 1004 coupled with bus 1002 for processing information.
- Computer system 1000 also includes a main memory 1006, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1002 for storing information and instructions to be executed by processor 1004.
- Main memory 1006 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1004.
- Computer system 1000 further includes a read only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static information and instructions for processor 1004.
- ROM read only memory
- a storage device 1010 such as a magnetic disk or optical disk, is provided and coupled to bus 1002 for storing information and instructions.
- Computer system 1000 may be coupled via bus 1002 to a display 1012, such as a cathode ray tube (CRT), projection, head-mounted display or flat panel display for displaying information to a computer user.
- An input device 1014 is coupled to bus 1002 for communicating information and command selections to processor 1004.
- cursor control 1016 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1004 and for controlling cursor movement on display 1012.
- This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
- the invention is related to the use of computer system 1000 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006. Such instructions may be read into main memory 1006 from another machine-readable medium, such as storage device 1010. Execution of the sequences of instructions contained in main memory 1006 causes processor 1004 to perform the process steps described herein. In alternative embodiments, hardwired circuitry may be used in place of or in combination with software instructions to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
- machine -readable medium refers to any medium that participates in providing data that causes a machine to operation in a specific fashion.
- various machine-readable media are involved, for example, in providing instructions to processor 1004 for execution.
- Such a medium may take many forms, including but not limited to storage media and transmission media.
- Storage media includes both non-volatile media and volatile media.
- Non- volatile media includes, for example, optical or magnetic disks, such as storage device 1010.
- Volatile media includes dynamic memory, such as main memory 1006.
- Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 1002.
- Machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD/DVD, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to processor 1004 for execution.
- the instructions may initially be carried on a magnetic disk of a remote computer.
- the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
- a modem local to computer system 1000 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
- An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 1002.
- Bus 1002 carries the data to main memory 1006, from which processor 1004 retrieves and executes the instructions.
- the instructions received by main memory 1006 may optionally be stored on storage device 1010 either before or after execution by processor 1004.
- Computer system 1000 also includes a communication interface 1018 coupled to bus 1002.
- Communication interface 1018 provides a two-way data communication coupling to a network link 1020 that is connected to a local network 1022.
- communication interface 1018 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line.
- ISDN integrated services digital network
- communication interface 1018 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
- LAN local area network
- Wireless links may also be implemented.
- communication interface 1018 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
- Network link 1020 typically provides data communication through one or more networks to other data devices.
- network link 1020 may provide a connection through local network 1022 to a host computer 1024 or to data equipment operated by an Internet Service Provider (ISP) 1026.
- ISP 1026 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the "Internet" 1028.
- Internet 1028 uses electrical, electromagnetic or optical signals that carry digital data streams.
- Computer system 1000 can send messages and receive data, including program code, through the network(s), network link 1020 and communication interface 1018.
- a server 1030 might transmit a requested code for an application program through Internet 1028, ISP 1026, local network 1022 and communication interface 1018.
- the received code may be executed by processor 1004 as it is received, and/or stored in storage device 1010, or other non-volatile storage for later execution. In this manner, computer system 1000 may obtain application code in the form of a carrier wave.
- embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Optics & Photonics (AREA)
- Endoscopes (AREA)
Abstract
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010544420A JP2011510705A (ja) | 2008-01-24 | 2009-01-22 | 総胆管外科手術の画像化システム |
CA2713113A CA2713113A1 (fr) | 2008-01-24 | 2009-01-22 | Systeme d'imagerie chirurgicale de canal choledoque commun |
EP09703731A EP2254456A1 (fr) | 2008-01-24 | 2009-01-22 | Système d'imagerie chirurgicale de canal cholédoque commun |
CN2009801103002A CN102006818A (zh) | 2008-01-24 | 2009-01-22 | 胆总管手术成像系统 |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/011,484 US20090192390A1 (en) | 2008-01-24 | 2008-01-24 | Common bile duct surgical imaging system |
US12/011,484 | 2008-01-24 | ||
US12/011,490 | 2008-01-24 | ||
US12/011,490 US9072445B2 (en) | 2008-01-24 | 2008-01-24 | Common bile duct surgical imaging system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2009094465A1 true WO2009094465A1 (fr) | 2009-07-30 |
Family
ID=40481821
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2009/031712 WO2009094465A1 (fr) | 2008-01-24 | 2009-01-22 | Système d'imagerie chirurgicale de canal cholédoque commun |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP2254456A1 (fr) |
JP (1) | JP2011510705A (fr) |
CN (1) | CN102006818A (fr) |
CA (1) | CA2713113A1 (fr) |
WO (1) | WO2009094465A1 (fr) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012075696A1 (fr) * | 2010-12-10 | 2012-06-14 | 广州宝胆医疗器械科技有限公司 | Système endoscope de cholécystoscopie à fonction de balayage thermique infrarouge |
WO2012075706A1 (fr) * | 2010-12-10 | 2012-06-14 | 广州宝胆医疗器械科技有限公司 | Système de cholécystoscopie intégrant un dispositif de balayage thermique infrarouge |
JP2013507182A (ja) * | 2009-10-07 | 2013-03-04 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | 臨床画像上に強調された画像化データを表示するための方法および装置 |
EP2698101A1 (fr) * | 2012-08-15 | 2014-02-19 | Aspect Imaging Ltd. | Système d'imagerie par résonance magnétique (IRM) pour générer une image de rendu |
EP2698100A1 (fr) * | 2012-08-15 | 2014-02-19 | Aspect Imaging Ltd. | Système d'imagerie pour générer une image de rendu |
JP2020006244A (ja) * | 2010-07-02 | 2020-01-16 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | 手術システム及び強調画像表示生成方法 |
US20210298584A1 (en) * | 2018-12-10 | 2021-09-30 | Olympus Corporation | Image recording apparatus, image recording method, and endoscope system |
US11717375B2 (en) | 2010-07-02 | 2023-08-08 | Intuitive Surgical Operations, Inc. | Methods and systems for alternate image display |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5385350B2 (ja) * | 2011-08-16 | 2014-01-08 | 富士フイルム株式会社 | 画像表示方法および装置 |
TW201505603A (zh) * | 2013-07-16 | 2015-02-16 | Seiko Epson Corp | 資訊處理裝置、資訊處理方法及資訊處理系統 |
JP6484336B2 (ja) * | 2015-06-17 | 2019-03-13 | オリンパス株式会社 | 撮像装置 |
JP2017164007A (ja) * | 2016-03-14 | 2017-09-21 | ソニー株式会社 | 医療用画像処理装置、医療用画像処理方法、プログラム |
KR101998592B1 (ko) * | 2017-09-20 | 2019-07-10 | 인더스마트 주식회사 | 근적외선 형광 검출장치 및 방법 |
CN107811705A (zh) * | 2017-11-27 | 2018-03-20 | 湖北得康科技有限公司 | 一种新型的内窥镜系统 |
EP3917378A4 (fr) * | 2019-01-28 | 2022-09-14 | MediBeacon Inc. | Systèmes et procédés de surveillance transdermique du dfg à domicile |
CN109893092B (zh) * | 2019-02-20 | 2024-03-29 | 广州乔铁医疗科技有限公司 | 可扫描腹腔内部的腹腔镜外视镜装置 |
CN111166276A (zh) * | 2020-01-24 | 2020-05-19 | 复旦大学 | 经腹腔-腹腔镜卵巢近红外荧光成像检测系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999001749A1 (fr) * | 1997-07-03 | 1999-01-14 | Smith & Nephew, Inc. | Systeme d'imagerie par fluorescence |
WO2005034747A1 (fr) * | 2003-09-15 | 2005-04-21 | Beth Israel Deaconess Medical Center | Systemes d'imagerie medicale |
US20070135803A1 (en) * | 2005-09-14 | 2007-06-14 | Amir Belson | Methods and apparatus for performing transluminal and other procedures |
-
2009
- 2009-01-22 CN CN2009801103002A patent/CN102006818A/zh active Pending
- 2009-01-22 JP JP2010544420A patent/JP2011510705A/ja not_active Withdrawn
- 2009-01-22 EP EP09703731A patent/EP2254456A1/fr not_active Withdrawn
- 2009-01-22 CA CA2713113A patent/CA2713113A1/fr not_active Abandoned
- 2009-01-22 WO PCT/US2009/031712 patent/WO2009094465A1/fr active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999001749A1 (fr) * | 1997-07-03 | 1999-01-14 | Smith & Nephew, Inc. | Systeme d'imagerie par fluorescence |
WO2005034747A1 (fr) * | 2003-09-15 | 2005-04-21 | Beth Israel Deaconess Medical Center | Systemes d'imagerie medicale |
US20070135803A1 (en) * | 2005-09-14 | 2007-06-14 | Amir Belson | Methods and apparatus for performing transluminal and other procedures |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3109822A1 (fr) * | 2009-10-07 | 2016-12-28 | Intuitive Surgical Operations, Inc. | Procédés et appareil d'affichage de données d'imagerie améliorée sur une image clinique |
EP4191518A1 (fr) * | 2009-10-07 | 2023-06-07 | Intuitive Surgical Operations, Inc. | Procédés et appareil d'affichage de données d'imagerie améliorées sur une image clinique |
JP2013507182A (ja) * | 2009-10-07 | 2013-03-04 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | 臨床画像上に強調された画像化データを表示するための方法および装置 |
EP3965057A1 (fr) * | 2009-10-07 | 2022-03-09 | Intuitive Surgical Operations, Inc. | Procédés et appareil d'affichage de données d'imagerie améliorée sur une image clinique |
EP3731176A1 (fr) * | 2009-10-07 | 2020-10-28 | Intuitive Surgical Operations, Inc. | Procédés et appareil d'affichage de données d'imagerie améliorée sur une image clinique |
JP2020006244A (ja) * | 2010-07-02 | 2020-01-16 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | 手術システム及び強調画像表示生成方法 |
JP7049302B2 (ja) | 2010-07-02 | 2022-04-06 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | 手術システムの作動方法 |
US11717375B2 (en) | 2010-07-02 | 2023-08-08 | Intuitive Surgical Operations, Inc. | Methods and systems for alternate image display |
WO2012075696A1 (fr) * | 2010-12-10 | 2012-06-14 | 广州宝胆医疗器械科技有限公司 | Système endoscope de cholécystoscopie à fonction de balayage thermique infrarouge |
WO2012075706A1 (fr) * | 2010-12-10 | 2012-06-14 | 广州宝胆医疗器械科技有限公司 | Système de cholécystoscopie intégrant un dispositif de balayage thermique infrarouge |
EP2698100A1 (fr) * | 2012-08-15 | 2014-02-19 | Aspect Imaging Ltd. | Système d'imagerie pour générer une image de rendu |
EP2698101A1 (fr) * | 2012-08-15 | 2014-02-19 | Aspect Imaging Ltd. | Système d'imagerie par résonance magnétique (IRM) pour générer une image de rendu |
US20210298584A1 (en) * | 2018-12-10 | 2021-09-30 | Olympus Corporation | Image recording apparatus, image recording method, and endoscope system |
US12003891B2 (en) * | 2018-12-10 | 2024-06-04 | Olympus Corporation | Image recording apparatus, image recording method, and endoscope system |
Also Published As
Publication number | Publication date |
---|---|
EP2254456A1 (fr) | 2010-12-01 |
CN102006818A (zh) | 2011-04-06 |
JP2011510705A (ja) | 2011-04-07 |
CA2713113A1 (fr) | 2009-07-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9072445B2 (en) | Common bile duct surgical imaging system | |
US20090192390A1 (en) | Common bile duct surgical imaging system | |
EP2254456A1 (fr) | Système d'imagerie chirurgicale de canal cholédoque commun | |
CN103298391B (zh) | 一次性内窥镜接入装置及可携式显示器 | |
US20130211246A1 (en) | METHODS AND DEVICES FOR GASTROINTESTINAL SURGICAL PROCEDURES USING NEAR INFRARED (nIR) IMAGING TECHNIQUES | |
US20070015967A1 (en) | Autosteering vision endoscope | |
US20110245602A1 (en) | Flexible endoscope with full-length lumen | |
JP2011152202A (ja) | 画像取得装置、観察装置、および観察システム | |
JP6031040B2 (ja) | トロカールシステム | |
EP3858278A1 (fr) | Néphroscope comprenant une partie distale flexible et articulable | |
US9814369B2 (en) | Pivoting three-dimensional video endoscope | |
Brandão et al. | Imaging Equipment and Operating Room Set‐Up | |
CN107811705A (zh) | 一种新型的内窥镜系统 | |
Frank et al. | Technological aspects of minimal access surgery | |
US20230095278A1 (en) | Surgical Anchoring Systems for Endoluminal Access | |
US11903557B2 (en) | Endoscope for imaging in nonvisible light | |
CN209770309U (zh) | 一种激光手术内窥镜 | |
US20040215057A1 (en) | Portable, reusable visualization system | |
JP2575107B2 (ja) | 内視鏡用焼灼装置 | |
US20220240961A1 (en) | Endoscope assembly having a surgical instrument and endoscope system having the same | |
US12036418B2 (en) | Surgical devices for treating body tissue and diagnosing patients | |
US20230248209A1 (en) | Assistant device, endoscopic system, assistant method, and computer-readable recording medium | |
US20210196974A1 (en) | Surgical devices for treating body tissue and diagnosing patients | |
CN208259757U (zh) | 一种激光切割内镜 | |
WO2015193892A1 (fr) | Dispositif d'éclairage pour cholécystectomie |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980110300.2 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09703731 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2713113 Country of ref document: CA Ref document number: 2010544420 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009703731 Country of ref document: EP |