US10295468B2 - Fluorescent image system - Google Patents
Fluorescent image system Download PDFInfo
- Publication number
- US10295468B2 US10295468B2 US15/553,858 US201615553858A US10295468B2 US 10295468 B2 US10295468 B2 US 10295468B2 US 201615553858 A US201615553858 A US 201615553858A US 10295468 B2 US10295468 B2 US 10295468B2
- Authority
- US
- United States
- Prior art keywords
- light
- fluorescent
- image
- mirror
- red
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 230000005284 excitation Effects 0.000 claims abstract description 23
- 238000012632 fluorescent imaging Methods 0.000 claims description 45
- 238000003384 imaging method Methods 0.000 claims description 34
- 239000000463 material Substances 0.000 claims description 14
- ZGXJTSGNIOSYLO-UHFFFAOYSA-N 88755TAZ87 Chemical compound NCC(=O)CCC(O)=O ZGXJTSGNIOSYLO-UHFFFAOYSA-N 0.000 claims description 4
- MOFVSTNWEDAEEK-UHFFFAOYSA-M indocyanine green Chemical compound [Na+].[O-]S(=O)(=O)CCCCN1C2=CC=C3C=CC=CC3=C2C(C)(C)C1=CC=CC=CC=CC1=[N+](CCCCS([O-])(=O)=O)C2=CC=C(C=CC=C3)C3=C2C1(C)C MOFVSTNWEDAEEK-UHFFFAOYSA-M 0.000 claims description 4
- 229960004657 indocyanine green Drugs 0.000 claims description 4
- GNBHRKFJIUUOQI-UHFFFAOYSA-N fluorescein Chemical compound O1C(=O)C2=CC=CC=C2C21C1=CC=C(O)C=C1OC1=CC(O)=CC=C21 GNBHRKFJIUUOQI-UHFFFAOYSA-N 0.000 claims description 3
- 239000000203 mixture Substances 0.000 claims description 2
- 239000000126 substance Substances 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 15
- 238000001228 spectrum Methods 0.000 description 9
- 238000000034 method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 239000003086 colorant Substances 0.000 description 3
- 201000010099 disease Diseases 0.000 description 3
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000000701 chemical imaging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000000799 fluorescence microscopy Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000002271 resection Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00186—Optical arrangements with imaging filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/063—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0071—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
- G01J2003/102—Plural sources
- G01J2003/104—Monochromatic plural sources
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
- G01J2003/102—Plural sources
- G01J2003/106—Plural sources the two sources being alternating or selectable, e.g. in two ranges or line:continuum
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/44—Raman spectrometry; Scattering spectrometry ; Fluorescence spectrometry
- G01J3/4406—Fluorescence spectrometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1734—Sequential different kinds of measurements; Combining two or more methods
- G01N2021/1736—Sequential different kinds of measurements; Combining two or more methods with two or more light sources
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1738—Optionally different kinds of measurements; Method being valid for different kinds of measurement
- G01N2021/174—Optionally different kinds of measurements; Method being valid for different kinds of measurement either absorption-reflection or emission-fluorescence
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N2021/6417—Spectrofluorimetric devices
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N2021/6463—Optics
- G01N2021/6471—Special filters, filter wheel
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10064—Fluorescence image
Definitions
- the invention relates a fluorescent imaging system capable of imaging a normal light image and fluorescent image at the same time. Simultaneous imaging of both is made possible by illuminating the scene with a light mixed with a fluorescence excitation light and a white light composed of three narrow-band monochromatic lights which are red, green and blue.
- an imaging device including an endoscope or a laparoscope includes a light source, a lens and a sensor (camera) for acquiring the light reflected from the object.
- imaging device takes the reflected light from the object where the light source is usually a white light.
- the use of a fluorescent imaging system is increasing as it helps diagnose specific diseases by imaging the fluorescent emission from the object illuminated by an excitation light having a particular wavelength.
- the fluorescent material can be present within a living body or may be injected from outside the body. Fluorescence due to the intrinsic fluorescent material is called autofluorescence. Autofluorescence changes by the biological condition or disease. Measuring the change of it can help diagnose the disease. Injected fluorescent material can also be helpful as the distribution of fluorescence changes by the biological condition.
- a normal light image which is a reflection of white light is the primary image, and fluorescent image serves only as a supplementary.
- fluorescent image serves only as a supplementary.
- the natural reflected image is more frequently used, and seldom required only the fluorescent image.
- a conventional imaging method to obtain a normal light image, a reflected image, and a fluorescent image uses mirrors to change the sources and light path mechanically, or beam splitters to separately obtain each image, along with multiple light sources and multi-mode cameras.
- the method using mirrors is described in the U.S. Pat. No. 7,722,534.
- Such methods have disadvantages like low durability and may show early mechanical failure due to the complex structure, and only a limited amount of light received as the images are acquired in a time-sharing manner.
- Using a beam splitter also suffers from a reduced amount of input light as it divides and distributes light for multiple targets.
- the previous method for obtaining a normal light image and fluorescent image together cannot help but to rely on such complicated methods as the wavelength of the emitted fluorescent light lies inside the spectrum of the white light which is continuous over the spectrum range.
- the illumination source is a white light having continuous spectrum, simultaneous acquisition of the normal light image and the fluorescent image is impossible.
- the wavelength of the white light source ranges between 350 ⁇ 750 nm and sometimes expands further over 750 nm including infra-red-light range.
- the emitted fluorescent light mixes with the reflected white light, and it cannot be separated.
- Proposed fluorescent imaging system provides a white light source composed of three narrow-band monochromatic lights which are red, green and blue, further includes the excitation light which is proper to excite the fluorescent material.
- the invention illuminates the object with white light having a segmented spectrum, not with normal continuous white light. So the reflected light by the light source according to this invention is segmented in spectrum, and the emitted fluorescent light image can be separated from the normal light image as it does not lie in between the wavelength of the light source, which results in the simultaneous acquisition of both images.
- the fluorescent imaging system comprises a mixed light source consisting of white light which includes red, green and blue monochromatic light and a fluorescent excitation light; at least one monochromatic mirror for separating a monochromatic light of particular wavelength from the mixed light source; a fluorescent mirror for separating the light of fluorescent wavelength; natural light imaging devices for photographing the monochromatic light images from the monochromatic mirrors; and a fluorescent imaging device for photographing the fluorescent image from the fluorescent mirror.
- a mixed light source consisting of white light which includes red, green and blue monochromatic light and a fluorescent excitation light
- at least one monochromatic mirror for separating a monochromatic light of particular wavelength from the mixed light source
- a fluorescent mirror for separating the light of fluorescent wavelength
- natural light imaging devices for photographing the monochromatic light images from the monochromatic mirrors
- a fluorescent imaging device for photographing the fluorescent image from the fluorescent mirror.
- the invention is characterized in that the mixed light source, the normal light imaging device, and the fluorescent imaging device comprises a red-light mirror, green-light mirror, and blue-light mirror that separate red, green, and blue monochromatic light, respectively. It also comprises a fluorescent mirror at the front, back, or in between the red, green, and blue-light mirror where the position of the fluorescent mirror is determined according to the wavelength of fluorescence. However, some of the monochromatic light mirrors may be omitted or integrated together according to the wavelength of fluorescence.
- the monochromatic light mirror is characterized in that it comprises only a red-light mirror for separating red light but may be omitted with a green-light mirror and blue-light mirror if the fluorescent wavelength is longer than the visible light.
- the monochromatic light mirror is characterized in that it comprises only a fluorescent mirror for separating fluorescent light but may be omitted with a red-light mirror, green-light mirror and blue-light mirror if the fluorescent wavelength is shorter than the visible light.
- the fluorescent imaging system proficiently delivers an imaging system which simultaneously captures a normal light image and fluorescent image without relying on the complex time-sharing scheme or mechanical device for splitting particular spectrum. It uses reconstructed white light combined with fluorescent excitation light for illumination where the red, green and blue light combined does not cover the whole spectrum, unlike the normal white light whose wavelength range covers all the 380 ⁇ 780 nm range.
- the fluorescent excitation light may be placed in the vacant spectrum range to separately handles fluorescence without interfering with the normal light image.
- the monochromatic lights combined to make white light can be varied as needed, so that variety of fluorescent materials having different characteristic wavelengths may be incorporated into the fluorescent imaging system.
- multispectral imaging may be realized because multiple fluorescent materials can be used at the same time although limited by the precision of the optical device.
- the concept of the present invention which can arrange a plurality of dichroic filter and mirrors to acquire multiple fluorescent images simultaneously, is not limited in the field of the laparoscopic device and can apply to other general optical medical devices.
- FIG. 1 is a schematic diagram showing a detailed structure of a mixed light source in the fluorescent imaging system according to the present invention.
- FIG. 2 is a graph showing a principle of the reconstructed white light illumination from RGB monochromatic light in the fluorescent imaging system according to the present invention.
- FIG. 3 is a CIE chromaticity diagram illustrating the RGB gamut in the fluorescent imaging system according to the present invention.
- FIG. 4 is a schematic diagram showing a detailed configuration of the imaging device in the fluorescent imaging system according to the present invention.
- FIG. 5 is a schematic diagram showing a first embodiment of the fluorescent imaging system according to the present invention.
- FIG. 6 is a schematic diagram showing a second embodiment of the fluorescent imaging system according to the present invention.
- FIG. 7 is a schematic diagram showing a third embodiment of the fluorescent imaging system according to the present invention.
- FIG. 8 is a schematic diagram showing a fourth embodiment of the fluorescent imaging system according to the present invention.
- FIG. 9 is a schematic diagram showing the concept of illuminating and acquiring images for the fluorescent imaging system when two fluorescent materials are in use according to the present invention.
- the fluorescent imaging system comprises mainly of a mixed light source 50 and an imaging system 100 .
- the mixed light source 50 comprises a reconstructed white light with red, green, and blue monochromatic lights combined and a fluorescent excitation light.
- FIG. 1 is a diagram diagram showing a detailed structure of a mixed light source 50 according to the present invention.
- a controller 10 controls red-light source 1 , green-light source 2 , and blue-light source 3 to produce red, green, and blue monochromatic lights.
- each red, green, and blue light sources 1 , 2 , 3 having narrow bandwidth may be produced by narrow-band sources such as laser or LED, or by filtering using a narrow band-pass optical filter and a continuous white light source.
- human recognizes the light having a wavelength of 380 ⁇ 780 nm between the UV and IR as shown in FIG. 2 .
- the human eye is known to aware more selectively with red, green, and blue light in this visible range and the brain recognizes various colors in combination of these three colors.
- light coordinated inside the triangle may be obtained in combination of the three colors, red, green, and blue. That is, red, green, and blue light can be properly mixed to make white light even though there may be slight differences or shift in each wavelength range.
- a reconstructed white light having vacant wavelength regions for fluorescent excitation light and fluorescent emission light may be made using two or more red, green and blue light in combination.
- a variety of color coordinates may be selected to get similar white light because LEDs have narrow bandwidth having the half-width less than 20 nm.
- White light mixed with general R+G+B LEDs renders color quite correctly, but the white light using LEDs having narrow bandwidth according to the present invention may be hard to render natural white light having high color rendering index (CRI).
- CRI color rendering index
- the color rendering quality may be improved by combining more than three monochromatic lights or may be compensated by alternately illuminating with white light.
- the mixed light source 50 is a combination of red light ranging 590 ⁇ 750 nm, green light ranging 480 ⁇ 570 nm, and blue light ranging 370 ⁇ 460 nm. It may have a variety of combination as follows.
- an intensity control device for each monochromatic light of red, green, and blue to adjust the color temperature of the mixed light source 50 .
- the monochromatic lights generated from the red-light source 1 , the green-light source 2 , and the blue-light source 3 is reflected by each monochromatic light mirror 21 , 22 , 23 , which is a dichroic mirror, then transmitted to the mixing apparatus 51 .
- the mixed light source 50 comprises at least one fluorescent excitation light sources 41 , 42 , 43 , 44 that applies to the specific fluorescent material.
- the fluorescent excitation light sources 41 , 42 , 43 , 44 are respectively equipped with a dedicated optical filter and a source-side fluorescent mirror 31 , 32 , 33 according to the wavelength of the excitation light.
- the mixed light source according to the present invention provides such mixed light source that has a reconstructed white light and a fluorescent excitation light suitable for the fluorescent material in use.
- the reconstructed white light is made by mixing red, green, and blue monochromatic light having narrow bandwidth devoid of some spectrum range for the fluorescence excitation and imaging.
- the imaging system 100 takes a normal light image, fluorescent image, and the mixture of both by separating visible light and fluorescent light reflected from the object illuminated by the mixed light source 50 .
- the imaging system 100 according to the present invention comprises a monochromatic mirror, an imaging-side fluorescent mirror, a normal light imaging device, and a fluorescent imaging device.
- the monochromatic mirror separates at least one monochromatic light among the red, green, and blue monochromatic light from the reflected mixed light 50 .
- the monochromatic mirror can be arranged in multiple places according to the location of the natural imaging device.
- the monochromatic light mirror in an embodiment of the present invention comprises a pair of blue-light mirrors 71 , 72 , green-light mirrors 73 , 74 , and red-light mirrors 75 , 76 that reflect the monochromatic light separately according to its corresponding wavelength.
- Each monochromatic light mirror according to the present invention may be omitted or integrated according to the wavelength of fluorescence.
- the fluorescent mirrors 61 , 62 , 63 at the imaging system separate the fluorescence light and transmit it to the fluorescent imaging devices.
- a total of three fluorescent mirrors 61 , 62 , 63 is comprised in the imaging system in the embodiment of the present invention.
- the normal light imaging device 81 takes image by combining each separated monochromatic light from the blue-light mirrors 71 , 72 , green-light mirrors 73 , 74 , and red-light mirror 75 , 76 .
- the fluorescent imaging devices 82 , 83 , 84 , 85 take images from the emitted fluorescent light from the fluorescent mirrors 61 , 62 , 63 and may be comprised of a plurality of mirrors depending on the number of fluorescent materials used.
- FIG. 5 is a diagram showing a first embodiment of the fluorescent imaging system according to the present invention, and it may correspond in particular to a case of imaging the fluorescence of the indocyanine green and the normal light image.
- the indocyanine green has an excitation wavelength of 780 nm and an emission wavelength of 850 nm, longer beyond visible light wavelength.
- the imaging device 100 may have only the red-light mirror 75 , so the normal light imaging device 81 receives the reflected white light mixed with RGB light, and the fluorescent imaging device 85 receives the transmitted fluorescent light through the red-light mirror 75 , both at the same time.
- FIG. 6 is a diagram showing a second embodiment of the fluorescent imaging system according to the present invention, and the fluorescent mirror 84 is placed between the red-light mirror 75 and the green-light mirror 73 as the emission wavelength of the fluorescence is in between the red-light and the green-light.
- This second embodiment may apply to the fluorescent material 5-ALA, to get the fluorescent image and normal light image simultaneously.
- the 5-ALA has an excitation wavelength of 380 ⁇ 440 nm and an emission wavelength of 635 nm.
- the excitation light source is placed in the shorter wavelength range before the blue-light source 3
- the fluorescent mirror 63 is placed between the red-light mirror 75 and the green-light mirror 73 .
- FIG. 7 is a diagram showing a third embodiment of the fluorescent imaging system according to the present invention; it may correspond in particular to a case of imaging the fluorescence of the fluorescein and the normal light image.
- the fluorescein has an excitation wavelength of 494 nm and an emission wavelength of 521 nm.
- the excitation light enters in between the green-light source 2 and the blue-light source 3 in the second embodiment of the white light mixer, and the fluorescent mirror 62 is located between the green-light mirror 73 and the blue-light mirror 71 .
- FIG. 8 is a diagram showing a fourth embodiment of the fluorescent imaging system according to the present invention, and all monochromatic light mirrors may be omitted except the fluorescent mirror 61 when the emission wavelength of the fluorescence is shorter than that of the blue-light.
- FIG. 9 is a view showing the concept of illuminating and acquiring images for the fluorescent imaging system when two fluorescent materials are in use according to the present invention, and this concept demonstrates simultaneous imaging of the fluorescence of 5-ALA and indocyanine green along with the normal light image.
- the fluorescent imaging system may provide a simultaneous imaging system of the normal light image and the fluorescent image by combining the fluorescent excitation light suitable for the fluorescent material with the reconstructed white light from the monochromatic red, green, and blue light rather than with the continuous white light.
Abstract
Description
Claims (7)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2015-0027418 | 2015-02-26 | ||
KR1020150027418A KR101606828B1 (en) | 2015-02-26 | 2015-02-26 | Fluorescence image system |
PCT/KR2016/000966 WO2016137129A1 (en) | 2015-02-26 | 2016-01-29 | Fluorescent image system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180052107A1 US20180052107A1 (en) | 2018-02-22 |
US10295468B2 true US10295468B2 (en) | 2019-05-21 |
Family
ID=55662049
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/553,858 Active 2036-02-01 US10295468B2 (en) | 2015-02-26 | 2016-01-29 | Fluorescent image system |
Country Status (3)
Country | Link |
---|---|
US (1) | US10295468B2 (en) |
KR (1) | KR101606828B1 (en) |
WO (1) | WO2016137129A1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190061337A (en) | 2017-11-27 | 2019-06-05 | 이학근 | Non-radiation based disease tissue detection medical imaging apparatus and methods |
US11209367B2 (en) * | 2018-08-27 | 2021-12-28 | Yale University | Multi-color imaging using salvaged fluorescence |
JPWO2020095671A1 (en) | 2018-11-07 | 2021-10-21 | ソニーグループ株式会社 | Image acquisition system and image acquisition method |
US11694324B2 (en) * | 2019-03-28 | 2023-07-04 | Hamamatsu Photonics K.K. | Inspection apparatus and inspection method |
CN113229783A (en) * | 2021-05-13 | 2021-08-10 | 珠海维尔康生物科技有限公司 | Image acquisition system, method and device for fluorescence imaging |
WO2023219807A1 (en) * | 2022-05-12 | 2023-11-16 | Verily Life Sciences Llc | Endoscope having simultaneous multi-modal imaging |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6122042A (en) * | 1997-02-07 | 2000-09-19 | Wunderman; Irwin | Devices and methods for optically identifying characteristics of material objects |
JP2005065976A (en) | 2003-08-22 | 2005-03-17 | Olympus Corp | Endoscopic apparatus |
US6915154B1 (en) * | 1999-09-24 | 2005-07-05 | National Research Council Of Canada | Method and apparatus for performing intra-operative angiography |
US7722534B2 (en) | 2000-07-14 | 2010-05-25 | Novadaq Technologies, Inc. | Compact fluorescence endoscopy video system |
KR20110088676A (en) | 2010-01-29 | 2011-08-04 | 한국전기연구원 | Combined apparatus for detection of multi-spectrum optical imaging coming out of organic body and light therapy |
US8046055B2 (en) | 2004-06-30 | 2011-10-25 | Hamamatsu Photonics K.K. | Lymph node detector |
KR20120015849A (en) | 2010-08-13 | 2012-02-22 | 국립암센터 | Sentinel lymph nodes marker comprising albumin labeled with a radioisotope, a near infrared fluorescent dye, and a visible dye |
US20150018690A1 (en) | 2013-07-12 | 2015-01-15 | Korea Electrotechnology Research Institute | Apparatus and method for detecting nir fluorescence at sentinel lymph node |
-
2015
- 2015-02-26 KR KR1020150027418A patent/KR101606828B1/en active IP Right Grant
-
2016
- 2016-01-29 US US15/553,858 patent/US10295468B2/en active Active
- 2016-01-29 WO PCT/KR2016/000966 patent/WO2016137129A1/en active Application Filing
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6122042A (en) * | 1997-02-07 | 2000-09-19 | Wunderman; Irwin | Devices and methods for optically identifying characteristics of material objects |
US6915154B1 (en) * | 1999-09-24 | 2005-07-05 | National Research Council Of Canada | Method and apparatus for performing intra-operative angiography |
US7722534B2 (en) | 2000-07-14 | 2010-05-25 | Novadaq Technologies, Inc. | Compact fluorescence endoscopy video system |
JP2005065976A (en) | 2003-08-22 | 2005-03-17 | Olympus Corp | Endoscopic apparatus |
US8046055B2 (en) | 2004-06-30 | 2011-10-25 | Hamamatsu Photonics K.K. | Lymph node detector |
KR101173325B1 (en) | 2004-06-30 | 2012-08-10 | 하마마츠 포토닉스 가부시키가이샤 | Lymph node detector |
KR20110088676A (en) | 2010-01-29 | 2011-08-04 | 한국전기연구원 | Combined apparatus for detection of multi-spectrum optical imaging coming out of organic body and light therapy |
US20110270092A1 (en) | 2010-01-29 | 2011-11-03 | Korea Electrotechnology Research Institute | Combined apparatus for detection of multispectral optical image emitted from living body and for light therapy |
KR20120015849A (en) | 2010-08-13 | 2012-02-22 | 국립암센터 | Sentinel lymph nodes marker comprising albumin labeled with a radioisotope, a near infrared fluorescent dye, and a visible dye |
US20130309169A1 (en) | 2010-08-13 | 2013-11-21 | National Cancer Center | Sentinel Lymph Node Marker Capable of Multi-Mode Imaging |
US20150018690A1 (en) | 2013-07-12 | 2015-01-15 | Korea Electrotechnology Research Institute | Apparatus and method for detecting nir fluorescence at sentinel lymph node |
KR20150007679A (en) | 2013-07-12 | 2015-01-21 | 한국전기연구원 | Apparatus and method for detecting NIR fluorescence at Sentinel Lymph Node |
Non-Patent Citations (1)
Title |
---|
International Search Report (in English and Korean) and Written Opinion (in Korean) of the International Searching Authority issued in PCT/KR2016/000966, dated May 25, 2016, ISA/KR. |
Also Published As
Publication number | Publication date |
---|---|
KR101606828B1 (en) | 2016-03-29 |
US20180052107A1 (en) | 2018-02-22 |
WO2016137129A1 (en) | 2016-09-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10295468B2 (en) | Fluorescent image system | |
JP6334755B2 (en) | Imaging system for combined full color reflection and near infrared imaging | |
CN103987309B (en) | Endoscope apparatus | |
US8007433B2 (en) | Electronic endoscope | |
JP6906593B2 (en) | A method for emulating an image processor, a fluorescence observation device and a first type fluorescence observation device in a second type fluorescence observation device. | |
CN103732117B (en) | Endoscope apparatus | |
US20180180477A1 (en) | Optical filter system and fluorescence detection system | |
US9113814B2 (en) | Endoscope apparatus capable of providing narrow band imaging and image processing method of the endoscope apparatus | |
EP2821003A1 (en) | Endoscope system and method for operating the same | |
US11805989B2 (en) | Optical distribution connector and endoscopic system | |
CN107518867A (en) | Light supply apparatus and endoscopic system | |
CN109068968B (en) | Light source device for endoscope | |
US20160302652A1 (en) | Fluorescence observation apparatus | |
CN109788893A (en) | Endoscopic system | |
WO2016203983A1 (en) | Endoscopic device | |
KR102372603B1 (en) | Medical system providing functional image | |
EP4275577A1 (en) | Method, processor, and medical fluorescence observation device using two color images and color cameras for fluorescence and white-light | |
CN106231984A (en) | Image processing system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NATIONAL CANCER CENTER, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, SEOK KI;KIM, SEONG CHEON;PARK, SUN UP;REEL/FRAME:043406/0299 Effective date: 20170810 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |