US11140318B2 - Laser endoscope device - Google Patents

Laser endoscope device Download PDF

Info

Publication number
US11140318B2
US11140318B2 US15/999,626 US201715999626A US11140318B2 US 11140318 B2 US11140318 B2 US 11140318B2 US 201715999626 A US201715999626 A US 201715999626A US 11140318 B2 US11140318 B2 US 11140318B2
Authority
US
United States
Prior art keywords
imaging
image
living body
stain
laser
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US15/999,626
Other languages
English (en)
Other versions
US20210227133A1 (en
Inventor
Akira Mizoguchi
Koji Tanaka
Yuji Toiyama
Kyosuke Tanaka
Shujie WANG
Aika KAITO
Kousyoku SAI
Kazushi Kimura
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mie University NUC
Original Assignee
Mie University NUC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mie University NUC filed Critical Mie University NUC
Assigned to MIE UNIVERSITY reassignment MIE UNIVERSITY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KIMURA, KAZUSHI, KAITO, Aika, SAI, KOUSYOKU, TANAKA, Kyosuke, WANG, Shujie, MIZOGUCHI, AKIRA, TANAKA, KOJI, TOIYAMA, Yuji
Publication of US20210227133A1 publication Critical patent/US20210227133A1/en
Application granted granted Critical
Publication of US11140318B2 publication Critical patent/US11140318B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
    • H04N5/23238—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064—Constructional details of the endoscope body
    • A61B1/00071—Insertion part of the endoscope body
    • A61B1/0008—Insertion part of the endoscope body characterised by distal tip features
    • A61B1/00082—Balloons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064—Constructional details of the endoscope body
    • A61B1/00071—Insertion part of the endoscope body
    • A61B1/0008—Insertion part of the endoscope body characterised by distal tip features
    • A61B1/00096—Optical elements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/00154—Holding or positioning arrangements using guiding arrangements for insertion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00172—Optical arrangements with means for scanning
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00188—Optical arrangements with focusing or zooming features
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00193—Optical arrangements adapted for stereoscopic vision
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/042—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by a proximal camera, e.g. a CCD camera
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/063—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0655—Control therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0661—Endoscope light sources
    • A61B1/0669—Endoscope light sources at proximal end of an endoscope
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/273—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the upper alimentary canal, e.g. oesophagoscopes, gastroscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062—Arrangements for scanning
    • A61B5/0068—Confocal scanning
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4887—Locating particular structures in or on the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61K—PREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES
    • A61K49/00—Preparations for testing in vivo
    • A61K49/001—Preparation for luminescence or biological staining
    • A61K49/006—Biological staining of tissues in vivo, e.g. methylene blue or toluidine blue O administered in the buccal area to detect epithelial cancer cells, dyes used for delineating tissues during surgery
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/26—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes using light guides
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H04N5/2254—
    • H04N5/2256—
    • H04N9/07—
    • H04N2005/2255—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes

Definitions

  • the present invention relates to a laser endoscope device that images the interior of a living body.
  • Patent Literature 1 describes a method for staining a predetermined cell group in the living body and then applying multi-photon laser light to the stained cell group to image the cell morphology in the living body. According to the method described above, since the stained cell group emits fluorescence when the multi-photon laser light is applied thereto, a sharp image of the cell morphology in the living body can be obtained. Whether or not a lesion, such as cancer cells, is present can therefore be precisely checked.
  • Patent Literature 1 International Publication No. WO 2014/157703
  • Patent Literature 1 in which the obtained image is an image of a local region in the living body, only allows checking of whether or not a lesion is present in the imaged region. Further, from the standpoint of a patient who undergoes the examination, the patient cannot make sure whether or not a lesion is present in the region other than the imaged region and is therefore still anxious about his/her condition.
  • the present invention solves the problems described above, and an object of the present invention is to provide a laser endoscope device capable of imaging a cell morphology in a living body over a wide range with no missing part.
  • a laser endoscope device includes an imaging unit that includes an imaging head inserted into a living body and applies laser light to the living body via the imaging head to image the living body, a control unit that controls the imaging head in such a way that it scans while keeping a fixed distance from a cell surface of the living body, and an image processing unit that processes an image captured by the imaging unit, wherein the imaging unit images a plurality of imaging regions to be imaged as the imaging head moves in such a way that adjacent imaging regions have identical portions, and the image processing unit causes images of glands and/or crypts in the plurality of imaging regions to overlap with each other with the identical portions being aligned to generate a merged image.
  • a laser endoscope device includes an imaging unit that includes an imaging head inserted into a living body and applies laser light to the living body via the imaging head to image the living body, a control unit that controls the imaging head in such a way that it scans the entire inner circumference of the digestive tract while keeping a fixed distance from the inner wall surface of digestive tract of the living body and at the same time moves in the direction of circumference of the digestive tract, and an image processing unit that processes an image captured by the imaging unit, wherein the imaging unit images a plurality of imaging regions to be imaged as the imaging head moves in such a way that adjacent imaging regions have identical portions, and the image processing unit causes the plurality of imaging regions to overlap with each other with the identical portions being aligned to generate a merged panoramic image of entire inner circumference in the imaging range moved in the direction of the circumference of the digestive tract.
  • cell morphology n inside a living body can be imaged over a wide range with no missing part.
  • the plurality of images obtained by the imaging have stable quality, whereby a merged image having a small amount of unevenness can be obtained when the plurality of images are merged with each other.
  • the state of inner wall of digestive tract can be grasped exhaustively based on panoramic images.
  • the laser is multiphoton laser or confocal laser.
  • the imaging head includes an objective lens and a focal point changer capable of changing a focal point position of the objective lens in a direction of depth from a cell surface of the living body.
  • the control unit may change the focal point position by operating the focal point changer.
  • the imaging unit may image the imaging regions at a predetermined depth out of depths deeper than or equal to 10 ⁇ m but shallower than or equal to 1000 ⁇ m below an inner wall surface inside the living body.
  • the image processing unit may generate the merged image at the predetermined depth.
  • the cell morphology inside a living body at a predetermined depth out of the depths deeper than or equal to 10 ⁇ m but shallower than or equal to 1000 ⁇ m below an inner wall surface can be imaged over a wide range with no missing part.
  • control unit may control the movement of the imaging head in such a way that the imaging head scans the living body with a fixed distance from the imaging head to the living body maintained.
  • the plurality of images obtained by the imaging have stable quality, whereby a merged image having a small amount of unevenness can be obtained when the plurality of images are merged with each other.
  • the imaging head may include an objective lens so disposed as to face the living body and a spacer provided around a space between the objective lens and the living body, and the control unit may control the movement of the imaging head in such a way that the spacer is in contact with the living body to maintain the fixed distance.
  • the distance between the living body and the objective lens is fixed, so that the living body can be precisely brought into focus through the lens, whereby a sharp image can be obtained.
  • the living body may be a digestive tract
  • the control unit may control the imaging head in such a way that the imaging head moves along an inner circumference of the digestive tract
  • the imaging unit may image a plurality of imaging regions to be imaged as the imaging head moves in such a way that imaging regions adjacent to each other in the circumferential direction have identical portions
  • the image processing unit may cause the plurality of imaging regions to overlap with each other with the identical portions being aligned to generate a panoramic image.
  • the panoramic image allows exhaustive grasp of the state of the inner wall of the digestive tract.
  • a laser endoscope device may include a stain supplier that supplies a stain into the living body for selectively staining a cell group inside the living body in a chromatic color, wherein the control unit may control the imaging head in such a way that it revolves around an axis of digestive tract of the living body, the imaging unit may image a plurality of imaging regions to be imaged as the imaging head revolves in such a way that imaging regions adjacent to each other in the revolutional direction have identical portions, and the image processing unit may cause the plurality of imaging regions to overlap with each other with the identical portions being aligned to generate the merged image.
  • a laser endoscope device may include a stain supplier that supplies a stain into the living body for selectively staining a cell group inside the living body in a chromatic color as well as first and second balloons which are disposed in front of and behind the imaging head in the axial direction of digestive tract of the living body and expand to form a closed space inside the digestive tract
  • the stain supplier may include a supply port which supplies a fluid into the closed space and a recovery port which recovers the fluid flowing into the closed space
  • the control unit may control the imaging head in the closed space in such a way that it revolves around an axis of the digestive tract
  • the imaging unit may image a plurality of imaging regions to be imaged as the imaging head revolves in such a way that imaging regions adjacent to each other in the revolutional direction have identical portions
  • the image processing unit may cause the plurality of imaging regions to overlap with each other with the identical portions being aligned using the gland, the crypt or solitary lymphatic nodule in the imaging regions as marks to generate the
  • sharp images of stained cell groups can be obtained.
  • the state of inner wall of digestive tract can be grasped exhaustively.
  • control unit may control the imaging head in such a way that the imaging head orbits around an axis of the digestive tract.
  • the imaging can be performed with no missing part with each imaging region and the position on the inner wall of the digestive tract related to each other.
  • control unit may control the imaging head in such a way that the imaging head helically moves around the axis of the digestive tract.
  • the inner wall of the digestive tract can be continuously imaged in a short period.
  • control unit may control the imaging head in such a way that it moves along a tract longitudinal direction of the digestive tract.
  • the imaging unit may image a plurality of imaging regions to be imaged as the imaging head moves in such a way that imaging regions adjacent to each other in the tract longitudinal direction have identical portions.
  • the image processing unit may cause the plurality of imaging regions to overlap with each other with the identical portions being aligned to generate a the merged image.
  • the position (coordinates) where a lesion is present in the tract longitudinal direction of the digestive tract can be grasped.
  • the stain supplier may supply a stain that specifically stains cancer cells and a stain that specifically stains ordinary cells into the living body.
  • the imaging unit may image a plurality of imaging regions at different depths as the focal point position is changed.
  • the image processing unit may place the plurality of images obtained by the imaging performed by the imaging unit in correspondence with the focal point positions to generate a stereoscopic image of the interior of the living body or a cross-sectional image of the stereoscopic image.
  • the control unit may determine degrees of cancer development based on the stereoscopic image or the cross-sectional image by comparing the penetration depth of the stain that specifically stains cancer cells with that of the stain that specifically stains ordinary cells.
  • cell morphology inside a living body at a predetermined depth can be grasped and degrees of cancer development can be determined.
  • control unit may have a first focal point changeable mode in which the focal point position is changed by a first interval and a second focal point changeable mode in which the focal point position is changed by a second interval smaller than the first interval, and in a case where the imaging is performed in the first focal point changeable mode and an resultant image obtained by the imaging contains a portion suspicious of a lesion, the control unit may perform the imaging in the second focal point changeable mode in a vicinity of a focal point position where the image of the portion suspicious of a lesion has been captured.
  • the imaging can be performed exhaustively with the imaging period shortened.
  • control unit may store an image of healthy cells having no lesion in advance and compare any of the images obtained in the first focal point changeable mode with the image of healthy cells in terms of at least one of morphology and brightness to evaluate the suspicion of a lesion.
  • suspicion of a lesion can be objectively evaluated in a short period.
  • control unit may increase power of the laser light as compared with power in the imaging and applies the laser light having the increased power to the cells having a lesion to remove the cells having a lesion.
  • the cells having a lesion can be reliably removed in an early stage of the lesion.
  • the laser light may be multi-photon laser light.
  • tissue cells below the surface of the living body at a depth of about 1 mm at the deepest can be reliably imaged.
  • the laser endoscope device may further include a stain supplier that supplies a stain for selectively staining a cell group in the living body in a chromatic color into the living body, and the imaging unit may image the cell group stained with the stain supplied from the stain supplier.
  • a stain supplier that supplies a stain for selectively staining a cell group in the living body in a chromatic color into the living body
  • the imaging unit may image the cell group stained with the stain supplied from the stain supplier.
  • a sharp image of the stained cell group can be obtained.
  • the laser endoscope device may further include a stain supplier that supplies stains for staining a cell group in the living body in at least two selective chromatic colors different from each other in accordance with a cell type into the living body, and the imaging unit may image the cell group stained with the stains supplied from the stain supplier in the at least two colors.
  • a stain supplier that supplies stains for staining a cell group in the living body in at least two selective chromatic colors different from each other in accordance with a cell type into the living body
  • the imaging unit may image the cell group stained with the stains supplied from the stain supplier in the at least two colors.
  • a sharp image of the cell group stained in the at least two colors can be obtained. Further, for example, a plurality of types of tissue in the inner wall of the digestive tract can be simultaneously checked in a single image.
  • a laser endoscope device includes a stain supplier that supplies stains for staining a cell group in a living body in at least two selective chromatic colors different from each other in accordance with a cell type into the living body and an imaging unit that images the cell group stained with the stains supplied from the stain supplier by applying laser light to the cell group.
  • a sharp image of the cell group stained in the at least two colors can be obtained. Further, for example, a plurality tissue cells in the inner wall of the digestive tract can be simultaneously checked in a single image.
  • the stain may be a stain containing a curcumin-based compound and Acid Red or two stains formed of a stain containing a curcumin-based compound and a stain containing Acid Red.
  • the cell group in the living body can be reliably stained in two colors, whereby a sharp image can be obtained.
  • the stain may be a stain containing a curcumin-based compound and FastGreen FCF or two stains formed of a stain containing a curcumin-based compound and a stain containing FastGreen FCF.
  • the cell group in the living body can be reliably stained in two colors, whereby a sharp image can be obtained.
  • a laser endoscope device includes a stain supplier that supplies into a living body a stain for specifically staining in a chromatic color a cancer cell surrounding cell group other than cancer cells and located around the cancer cells in a cell group in the living body and an imaging unit that applies laser light to the cell group located in the living body and stained with the stain supplied from the stain supplier to capture an image that allows visual discrimination of the cancer cell surrounding cell group.
  • a sharp image of the cancer cell surrounding cell group located around the cancer cells can be obtained.
  • the stain may be a stain containing RoseBengal that specifically stains a cancer cell surrounding cell group other than the cancer cells located around cancer cells among the cell groups inside the living body in a chromatic color.
  • a sharp image of the cancer cell surrounding cell group located around the cancer cells can be reliably obtained.
  • a laser endoscope device includes an imaging unit that includes an imaging head inserted into a living body and applies laser light to the living body via the imaging head to image the living body and a control unit that controls operation of the imaging head.
  • the imaging head includes an objective lens and a focal point changer capable of changing a focal point position of the objective lens in a depth direction from a cell surface of the living body.
  • the control unit causes the focal point changer to operate to change the focal point position.
  • the imaging unit images a plurality of imaging regions at different depths from a mucosa surface in the living body as the focal point position is changed.
  • the cell morphology in the living body at a predetermined depth can be grasped.
  • the imaging unit may image the imaging regions over a predetermined depth range out of depths deeper than or equal to 0 ⁇ m but shallower than or equal to 1000 ⁇ m below the mucosa surface in the living body and stores each of the captured images and the depth information with the captured image and the depth information related to each other
  • the laser endoscope device may further include an image processing unit that processes the images captured by the imaging unit, and the image processing unit may place the plurality of images obtained by the imaging performed by the imaging unit in correspondence with the focal point positions to generate a stereoscopic image of the interior of the living body.
  • the cell morphology in the living body at the depths deeper than or equal to 0 ⁇ m but shallower than or equal to 1000 ⁇ m below the mucosa surface can be grasped.
  • the laser endoscope device may further include a stain supplier that supplies a stain for selectively staining a cell group in the living body in a chromatic color into the living body, and the imaging unit may image the cell group stained with the stain supplied from the stain supplier.
  • a sharp image of the stained cell group can be obtained.
  • the laser endoscope device may further include a stain supplier that supplies stains for staining a cell group in the living body in at least two selective chromatic colors different from each other in accordance with a cell type into the living body, and the imaging unit may image the cell group stained with the stains supplied from the stain supplier in the at least two colors.
  • a sharp image of the cell group stained in the at least two colors can be obtained. Further, for example, a plurality of types of tissue in the inner wall of the digestive tract can be simultaneously checked in a single image.
  • the laser endoscope device may further include a stain supplier that supplies into the living body a stain for specifically staining in a chromatic color a cancer cell surrounding cell group other than cancer cells and located around the cancer cells in a cell group in the living body, and the imaging unit may image the cancer cell surrounding cell group stained with the stain supplied from the stain supplier.
  • a stain supplier that supplies into the living body a stain for specifically staining in a chromatic color a cancer cell surrounding cell group other than cancer cells and located around the cancer cells in a cell group in the living body
  • the imaging unit may image the cancer cell surrounding cell group stained with the stain supplied from the stain supplier.
  • a sharp image of the cancer cell surrounding cell group located around the cancer cells can be obtained.
  • the image processing unit may cut the plurality of images at a position containing the stained cell group to generate a cross-sectional image of the stained cell group, and the control unit may evaluate whether the cell group displayed in the cross-sectional image is suspicious of a lesion based on a depth to which the cell group has been stained.
  • suspicion of a lesion can be objectively evaluated.
  • a laser endoscope device capable of imaging a cell morphology in a living body over a wide range with no missing part.
  • the primary configuration of the present invention allows non-coincidental wide-range exhaustive detection of a microscopic lesion, such as ultra-early-stage cancer (diameter ranging from 0.2 mm to 1 mm) the presence of which cannot be detected with an existing endoscope because the size of the lesion is too small.
  • a microscopic lesion such as ultra-early-stage cancer (diameter ranging from 0.2 mm to 1 mm) the presence of which cannot be detected with an existing endoscope because the size of the lesion is too small.
  • FIG. 1 is a diagrammatic view showing the arrangement of the cells of the large intestine, which is an example of the digestive tract.
  • FIG. 2 diagrammatically shows cancer cells that develop in the digestive tract.
  • FIG. 3 is a diagrammatic view showing that the inner wall of the digestive tract is imaged under a multiphoton laser microscope.
  • FIG. 4 shows images of epithelial cells, glandular cells, and other parts stained with a stain containing curcumin and then imaged under the multiphoton laser microscope.
  • FIG. 5 shows images of capillaries, connective tissue, and other parts stained with a stain containing Acid Red and then imaged under the multiphoton laser microscope.
  • FIG. 6 shows images of the inner wall of the digestive tract double-stained with a stain containing curcumin and a stain containing Acid Red and then imaged under the multiphoton laser microscope.
  • FIG. 7 shows images of the inner wall of the digestive tract stained with a stain containing Rose Bengal and then imaged under the multiphoton laser microscope.
  • FIG. 8 is a diagrammatic view showing that the inner wall of the digestive tract is imaged over the entire circumference thereof under the multiphoton laser microscope.
  • FIG. 9 is a merged image of the inner wall of the digestive tract stained with the stain containing Acid Red.
  • FIG. 10A is a merged image of the inner wall of the digestive tract stained with the stain containing curcumin and the stain containing Acid Red.
  • FIG. 10B shows an example of a stereoscopic image reconstructed from the panoramic image of the inner wall of the digestive tract.
  • FIG. 11 shows a state after an insertion tube is inserted into a digestive tract in a laser endoscope device according to a first embodiment.
  • FIG. 12 shows an example of a stain supplier for supplying a stain in the laser endoscope device according to the first embodiment.
  • FIG. 13 The section (a) of FIG. 13 shows that the inner wall of the digestive tract is planarized by using the laser endoscope device according to the first embodiment, and the section (b) of FIG. 13 is a diagrammatic view showing a front-end-side end portion of the laser endoscope device.
  • FIG. 14 is a schematic view showing the entirety of an endoscope in the laser endoscope device according to the first embodiment.
  • FIG. 15 is a block diagram showing the control configuration of the laser endoscope device according to the first embodiment.
  • FIG. 16 is a diagrammatic view showing that the inner wall of the digestive tract is imaged under the laser microscope according to the first embodiment.
  • FIG. 17A describes the action of the laser endoscope device according to the first embodiment.
  • FIG. 17B describes the action of the laser endoscope device according to the first embodiment.
  • FIG. 17C describes the action of the laser endoscope device according to the first embodiment.
  • FIG. 17D describes the action of the laser endoscope device according to the first embodiment.
  • FIG. 17E describes the action of the laser endoscope device according to the first embodiment.
  • FIG. 18 is a flowchart showing an example of the action of the laser endoscope device.
  • FIG. 19 is a diagrammatic view showing that a laser endoscope device according to Variation 1 of the first embodiment is used to generate a panoramic image.
  • FIG. 20 is a diagrammatic view showing that a laser endoscope device according to Variation 2 of the first embodiment is used to image the interior of a living body.
  • FIG. 21 is a diagrammatic view showing that a laser endoscope device according to Variation 3 of the first embodiment is used to image the interior of a living body.
  • FIG. 22 is a diagrammatic view showing that a laser endoscope device according to Variation 4 of the first embodiment is used to image the interior of a living body.
  • FIG. 23 is a diagrammatic view showing that a laser endoscope device according to Variation 5 of the first embodiment is used to image the interior of a living body.
  • FIG. 24 is a diagrammatic view showing that a laser endoscope device according to Variation 6 of the first embodiment is used to image the interior of a living body.
  • FIG. 25 is a diagrammatic view showing that a laser endoscope device according to Variation 7 of the first embodiment is used to image the interior of a living body.
  • FIG. 26 is a diagrammatic view showing that a laser endoscope device according to Variation 8 of the first embodiment is used to image the interior of a living body.
  • FIG. 27 is a diagrammatic view showing that a laser endoscope device according to Variation 9 of the first embodiment is used to image the interior of a living body.
  • FIG. 28 is a diagrammatic view showing that a laser endoscope device according to Variation 10 of the first embodiment is used to stain the interior of a living body.
  • FIG. 29 is a diagrammatic view showing that a laser endoscope device according to Variation 11 of the first embodiment is used to image the interior of a living body.
  • FIG. 30 is a diagrammatic view showing that a laser endoscope device according to Variation 12 of the first embodiment is used to image the interior of a living body.
  • FIG. 31 is a diagrammatic view showing that the laser endoscope device according to Variation 12 of the first embodiment is used to image the interior of a living body.
  • FIG. 32A is a diagrammatic view showing that the inner wall of the digestive tract is imaged over the entire circumference thereof under the multiphoton laser microscope.
  • FIG. 32B shows a panoramic image illustrating a cell morphology in a position below the inner wall surface (mucosa surface) at a depth of 50 ⁇ m.
  • FIG. 33 shows an endoscope of a laser endoscope device according to a second embodiment.
  • FIG. 34A shows three-dimensional data images showing not only a cell morphology over a predetermined depth range from an inner wall surface (mucosa surface) but an extracted color region stained with both a curcumin dye and an Acid Red dye.
  • FIG. 34B shows three-dimensional data images showing not only the cell morphology over the predetermined depth range from the inner wall surface (mucosa surface) but an extracted color region stained with the curcumin dye.
  • FIG. 34C shows three-dimensional data images showing not only the cell morphology over the predetermined depth range from the inner wall surface (mucosa surface) but an extracted color region stained with the Acid Red dye.
  • FIG. 35 is a block diagram showing the control configuration of a laser endoscope device according to a third embodiment.
  • FIG. 36A shows an image illustrating a cell morphology in a position below an inner wall surface (mucosa surface) at a depth of 50 ⁇ m and representing an extracted color region stained with the curcumin dye.
  • FIG. 36B shows an image illustrating the cell morphology in the position below the inner wall surface (mucosa surface) at the depth of 50 ⁇ m and representing an extracted color region stained with the Acid Red dye.
  • FIG. 36C shows an image illustrating the cell morphology in the position below the inner wall surface (mucosa surface) at the depth of 50 ⁇ m and representing an extracted color region stained with both the curcumin dye and the Acid Red dye.
  • FIG. 37 shows a stomach cancer cell group stained with the curcumin dye.
  • FIG. 38 is an image of a cell group in a living body captured along the direction perpendicular to an inner wall surface (mucosa surface) under a confocal laser microscope.
  • FIG. 39 is an image of a cell group in a living body captured obliquely left downward with respect to an inner wall surface (mucosa surface) under the confocal laser microscope.
  • FIG. 40 is an image of the cell group in the living body captured obliquely right downward with respect to the inner wall surface (mucosa surface) under the confocal laser microscope.
  • FIG. 41 is an image of the cell group in the living body captured obliquely left downward with respect to the inner wall surface (mucosa surface) under the confocal laser microscope.
  • FIG. 42 is an image of a living cell stained with a stain solved by using an optimized solving method and captured with the confocal laser microscope, the section (a) showing an image of healthy large intestine mucosa and the section (b) showing an image showing colorectal cancer.
  • FIG. 43 is a schematic view showing a front-end-side end portion of an endoscope of a laser endoscope device according to a fourth embodiment.
  • FIG. 44 is a schematic view showing the entire endoscope.
  • FIG. 45 is a block diagram showing the control configuration of the laser endoscope device.
  • FIG. 46 shows images of inner planes of an unstained colorectal mucosa captured under the confocal laser microscope.
  • FIG. 47 shows images of inner planes of the unstained colorectal mucosa captured under the multiphoton laser microscope.
  • the present invention is based on findings 1, 2, 3, 4, 5, and 6. Out of the findings, the finding 1 on which the present invention is based and a primary configuration of the invention associated with the finding 1 will first be described.
  • the interior of a living body contains the digestive tract, the respiratory system, the renal/urinary system, the utero-ovarian reproductive system, and other organs, the cerebrospinal nervous system, and other body sites.
  • the digestive tract may include the esophagus, the stomach, the small intestine, and the large intestine.
  • FIG. 1 is a diagrammatic view showing the arrangement of the cells of the large intestine, which is an example of a digestive tract 112 .
  • the inner wall of the large intestine is formed of a gland 130 , which secretes mucus, and an epithelium 120 , which is located in a portion closer to an inner wall surface (mucosa surface) 113 than the gland 130 and absorbs water when coming into contact with food.
  • the epithelium 120 is formed of a plurality of epithelial cells 121 arranged along the inner wall surface 113 .
  • the epithelial cells 121 each have a nucleus 125 and cytoplasm 126 .
  • the gland 130 is so shaped that part of the epithelium 120 is recessed in the form of a pot.
  • the gland 130 is formed of a plurality of glandular cells 131 , and the glandular cells 131 each have a nucleus 135 and cytoplasm 136 .
  • the recessed portions of the gland 130 are called crypts of the gland 130 .
  • a basement membrane 137 , capillaries 132 , and connective tissue 133 are formed in the portion inside the epithelial cells 121 and the portion around the glandular cells 131 .
  • a thin layer of the mucus secreted from the gland 130 is formed on the surfaces of the epithelial cells 121 , and the epithelial cells 121 are protected by the mucus layer.
  • the sizes of the nuclei 125 and 135 , the arrangement of the nuclei 125 and 135 , and the distances from the nuclei 135 to the basement membrane 137 in the internal structure of a living body are important evaluation factors in pathological diagnosis of cancer and other diseases.
  • FIG. 2 diagrammatically shows a cancer cell population 152 , which develops in the digestive tract 112 .
  • the early-stage cancer cell population 152 which develops in the digestive tract 112 , is generally believed to develop in a position below the inner wall surface (mucosa surface) 113 of the digestive tract 112 at a depth of about 1 mm or smaller. If the early-stage cancer cell population 152 , which has not yet reached and penetrated a muscular layer of mucosa 160 , can be found over a wide range with no missing cancer cell population, the number of conditions leading to an advanced cancer, which is a state in which the cancer cell population proliferates beyond the muscular layer of mucosa 160 and spreads to another organ, can be reduced.
  • a lesion such as the cancer cell population 152 as a representative example
  • the present inventors have imaged a cell morphology in the living body under a multiphoton laser microscope (FV1000MPE manufactured by Olympus Corporation).
  • a multiphoton laser microscope is a fluorescence microscope using a multiphoton excitation process.
  • a laboratory mouse was used as the living body.
  • FIG. 3 is a diagrammatic view showing that the inner wall of the digestive tract 112 is imaged under the multiphoton laser microscope.
  • an objective lens 16 of the multiphoton laser microscope is so disposed as to face the inner wall surface 113 of the digestive tract 112 , as shown in FIG. 3 .
  • the objective lens 16 is so disposed that the focal point of the objective lens 16 coincides with the inner wall surface (mucosa surface) 113 .
  • the epithelial cells 121 and other parts are imaged as shown in the section (a) of FIG. 3 , which is a diagrammatic view taken along the line a-a in FIG. 3 .
  • the objective lens 16 is so disposed that the focal point of the objective lens 16 coincides with a position below the inner wall surface (mucosa surface) 113 at a depth of 10 ⁇ m or greater.
  • the glandular cells 131 , the capillaries 132 , and the connective tissue 133 are imaged as shown in the section (b) of FIG. 3 , which is a diagrammatic view taken along the line b-b in FIG. 3 .
  • Changing the position of the focal point of the objective lens 16 of the multiphoton laser microscope as described above allows the epithelial cells 121 , the glandular cells 131 , the capillaries 132 , and the connective tissue 133 in the digestive tract 112 to be imaged.
  • the present inventors stained the living body (laboratory mouse) in a chromatic color with a stain containing an edible dye before the imaging was performed.
  • a stain allows selective staining of the epithelial cells 121 , the glandular cells 131 , the capillaries 132 , and the connective tissue 133 of the digestive tract 112 .
  • An edible dye is a natural dye or an artificial dye that is allowed to be administered to a person (food coloring dye, for example).
  • the images shown in FIG. 4 show the epithelial cells 121 , the glandular cells 131 , and other parts stained with a stain containing curcumin and then imaged under the multiphoton laser microscope.
  • the wavelength of the laser light was 780 nm, and the magnification of the objective lens was 10 times in the section (a) of FIGS. 4 and 25 times in the section (b) of FIG. 4 .
  • the images shown in FIG. 5 show the capillaries 132 , the connective tissue 133 , and other parts stained with a stain containing Acid Red (red #106) and then imaged under the multiphoton laser microscope.
  • the wavelength of the laser light was 840 nm, and the magnification of the objective lens was 10 times in the section (a) of FIG.
  • the stain containing curcumin can be a curcumin solution (undiluted liquid 5%) diluted with a physiological saline solution at a ratio ranging from 1/5 to 1/5000, and the staining period ranges from about 2 to 5 minutes.
  • FIG. 4 shows monochromatic images that are inherently color images, and the portions corresponding to the stained epithelium and gland can be displayed in a green fluorescent color, whereas the capillaries and the connective tissue can be displayed in non-fluorescent dark green.
  • the fluorescent color is expressed by converting the color of the actual fluorescence into a visually recognizable color with the aid of image correction.
  • Sharp images of the cell groups can be obtained, as shown in FIGS. 4 and 5 , by staining the cell groups in the living body with the stains.
  • the present inventors have made a new attempt: That is, two types of stains were used to selectively stain the cell groups in at least two different chromatic colors in accordance with the type of cells in each cell group before the imaging was performed. Specifically, the living body was stained with the stain containing curcumin and the stain containing Acid Red. Selectively staining cell groups in the living body in at least two different chromatic colors with two types of stains in accordance with the type of cells is hereinafter referred to as “double staining.”
  • the images shown in FIG. 6 show the inner wall of the digestive tract 112 double-stained with a stain containing curcumin and a stain containing Acid Red and then imaged under the multiphoton laser microscope.
  • the section (a) shows an image of a healthy digestive tract 112
  • the section (b) shows an image of the digestive tract 112 having the early-stage colorectal cancer cell population 152 formed therein.
  • the magnification of the image shown in the section (a) is greater than the magnification of the image shown in the section (b) by a factor of 1.5.
  • the stain containing curcumin was a curcumin solution (5% undiluted liquid) diluted with a physiological saline solution at a ratio of 1/10.
  • the stain containing Acid Red was an Acid Red solution (10 mg/mL of undiluted liquid) with no change.
  • the staining period ranged from 2 to 5 minutes in both cases.
  • the stain containing curcumin may be a curcumin solution (5% undiluted liquid) diluted with a physiological saline solution at a ratio ranging from 1/5 to 1/5000
  • the stain containing Acid Red may be an Acid Red solution (10 mg/mL of undiluted liquid) with no change or having a concentration of 100% or diluted at a ratio of 1/1 to 1/1000.
  • Double-staining and then imaging the cell group in the living body allows a plurality of types of tissue, such as the epithelium, the gland, and the capillaries, or the connective tissue in the inner wall of the digestive tract 112 to be simultaneously checked in a single image, as shown in the section (a) of FIG. 6 .
  • comparison of the shape and brightness of the cell group between the sections (a) and (b) allows checking whether the digestive tract 112 is healthy or a lesion, such as cancer, has developed in the digestive tract 112 , as shown in the section (b) of FIG. 6 .
  • the stains for double-staining are not limited to those described above and can be a stain containing curcumin and a stain containing FastGreen FCF.
  • the stain containing curcumin may be a curcumin solution (5% undiluted liquid) diluted with a physiological saline solution at a ratio of 1/10
  • the stain containing FastGreen FCF may be a FastGreen FCF solution (10 mg/mL of undiluted liquid) with no change.
  • the staining period may range from 2 to 5 minutes in both cases.
  • the stain containing curcumin may be a curcumin solution (5% undiluted liquid) diluted with a physiological saline solution at a ratio ranging from 1/5 to 1/5000
  • the stain containing FastGreen FCF may be a FastGreen FCF solution (10 mg/mL of undiluted liquid) with no change or having a concentration of 100% or diluted at a ratio of 1/1 to 1/1000.
  • the present inventors have used a stain that specifically stains a cancer cell surrounding cell group other than the cancer cells located around the cancer cell population 152 in a chromatic color to selectively stain the cell group in the living body and imaged the cancer cell surrounding cell group.
  • a stain containing RoseBengal was used to stain the living body.
  • the section (a) of FIG. 7 shows an image illustrating fluorescence emitted only from cancer cells imaged by using GFP, which is a green fluorescence protein.
  • the section (b) of FIG. 7 shows an image of the inner wall of the digestive tract 112 stained with the stain containing RoseBengal and then imaged under the multiphoton laser microscope.
  • the section (c) of FIG. 7 is the image shown in the section (a) and the image shown in the section (b) merged with each other and allows only the cancer cell surrounding cell group to be clearly identified because the actual image shown in the section (a) is displayed in the green fluorescent color and the actual image shown in the section (b) is displayed in the red fluorescent color.
  • the fluorescence from the cancer cell surrounding cell group which is located around the cancer cell population 152 shown in the section (a) out of the cell groups in the living body, is obtained, as shown in the section (b) of FIG. 7 , imaging the cell group around the cancer cell population 152 allows checking of whether cancer has developed in the digestive tract 112 .
  • Using the obtained image is effective in determining the range of treatment for preventing the cancer from developing again after the cancer cells are removed as well as the range over which the cancer cells are treated.
  • the patient can be treated in a safer manner by determining a treatment reference, for example, the cell group around the cancer cells shown in the section (b) of FIG. 7 is so treated that the cancer cells and the cell group around the cancer cells and over the half the length of the cell group from the cancer cells are removed.
  • the present inventors have still further attempted to image the cell morphology in the living body under the multiphoton laser microscope and overlap a plurality of captured images with each other to create a merged image.
  • FIG. 8 is a diagrammatic view showing that the inner wall of the digestive tract 112 is imaged over the entire circumference thereof under a multiphoton laser microscope 102 .
  • An imaging head 11 for radiating a laser light L is inserted along an inner wall surface 113 of the widened digestive tract 112 , and the imaging head 11 can then be moved to image a plurality of imaging regions P, as shown in FIG. 8 .
  • the imaging can be so performed that imaging regions P 1 and P 2 adjacent to each other out of the plurality of imaging regions P partially have identical portions. Identical portions Ps, belonging to the adjacent imaging regions P 1 and P 2 , are successively aligned with each other to create a merged image.
  • FIG. 9 is a merged image of the inner wall of the digestive tract 112 stained with the stain containing Acid Red.
  • FIG. 10A is a merged image of the inner wall of the digestive tract 112 stained with the stain containing curcumin and the stain containing Acid Red.
  • FIG. 10B shows an example of a stereoscopic image reconstructed from the panoramic image of the inner wall of the digestive tract 112 .
  • Creating a merged image that is a plurality of overlapped images allows grasp of the cell morphology in the living body over a wide range with no missing part, as shown in FIGS. 9 and 10A . Still further, it is conceivable to create a panoramic image of the inner wall of the digestive tract 112 by moving the imaging head 11 along the inner circumference of the digestive tract 112 and performing imaging with the imaging head 11 revolving over 360°, as shown in FIG. 8 . Moreover, stereoscopic reconstruction of the panoramic image into a tunnel-shaped image allows the position (coordinates) where a lesion is present in the digestive tract 112 to be readily visualized and grasped, as shown in FIG. 10B .
  • the imaging described above allows exhaustive detection of a lesion in the living body.
  • the primary configuration of the present invention allows non-coincidental wide-range exhaustive detection of a microscopic lesion, such as ultra-early-stage cancer (diameter ranging from 0.2 mm to 1 mm) the presence of which cannot be detected with an existing endoscope because the size of the lesion is too small.
  • a microscopic lesion such as ultra-early-stage cancer (diameter ranging from 0.2 mm to 1 mm) the presence of which cannot be detected with an existing endoscope because the size of the lesion is too small.
  • a laser endoscope device is a device capable of imaging a lesion having developed in the digestive tract, the respiratory system, the renal/urinary system, the utero-ovarian reproductive system, the cerebrospinal nervous system, and other body sites over a wide range with no missing part.
  • the laser endoscope device can not only perform the imaging but treat the lesion having developed in the living body.
  • the present embodiment will be described with reference to the digestive tract 112 in the living body.
  • the configuration of the laser endoscope device for imaging preparation will first be described.
  • the laser endoscope device includes an insertion tube that widens the digestive tract 112 and a stain supplier that supplies a stain to stain the cell group in the inner wall of the digestive tract 112 .
  • the section (a) of FIG. 11 shows a state after an insertion tube 20 has been inserted into the digestive tract 112 .
  • the insertion tube 20 has a supply port 42 , through which fluid is supplied, and a recovery port 43 , through which the supplied fluid is recovered, as shown in the section (a) of FIG. 11 .
  • the insertion tube 20 is further provided with a first balloon 21 and a second balloon 22 .
  • the first balloon 21 and the second balloon 22 bulge and shrink when the fluid (gas or liquid) is injected into and discharged from the balloons 21 and 22 .
  • the first balloon 21 is provided in a position shifted from the supply port 42 toward the front end of the insertion tube 20
  • the second balloon 22 is provided in a position shifted from the recovery port 43 toward the rear side of the insertion tube 20 (opposite the front end). Causing the first balloon 21 and the second balloon 22 to bulge in the digestive tract 112 creates a closed space S sandwiched between the first balloon 21 and the second balloon 22 in the insertion tube 20 .
  • the section (b) of FIG. 11 and FIG. 12 show an example of a stain supplier 40 for supplying a stain 45 .
  • the stain 45 is supplied into the space S, for example, from the stain supplier 40 , which stores the stain 45 , via the insertion tube 20 and the supply port 42 , as shown in FIG. 12 .
  • the stain 45 may, for example, be a single stain formed of the stain containing a curcumin-based compound or the stain containing Acid Red. It is, however, desirable to use two stains, the stain containing a curcumin-based compound and the stain containing Acid Red. Staining the cell group in the living body in two colors by using the two stains 45 allows a sharper image to be obtained.
  • Curcumin-based compounds include not only curcumin, of course, but highly water-soluble curcuminoid (mixture of several types of curcumin derivatives).
  • the stain 45 may instead be a single stain containing both a curcumin-based compound and Acid Red. Still instead, the stain 45 may be a single stain containing both a curcumin-based compound and FastGreen FCF or two stains formed of the stain containing a curcumin-based compound and the stain containing FastGreen FCF.
  • the stain 45 is not necessarily formed of two stains and may be formed of a single-color stain.
  • the stain 45 may be a stain containing RoseBengal. Before the staining, the interior of the digestive tract 112 may be cleaned and the mucus in the digestive tract 112 may be removed via the supply port 42 and the recovery port 43 .
  • gas is, for example, supplied via the supply port 42 to cause the digestive tract 112 to bulge, so that the inner wall of the digestive tract 112 is stretched and planarized, as shown in the section (a) of FIG. 13 . It is desirable that the irregularities of the planarized inner wall surface 113 have a height difference, for example, smaller than or equal to 0.2 mm.
  • the living body is now ready to be imaged with the laser endoscope device.
  • Planarizing the inner wall of the digestive tract 112 allows precise grasp of the states of the inner wall surface 113 and the cell group in a position below the inner wall surface 113 at a predetermined depth. Further, since the inner wall of the digestive tract 112 is imaged with the laser light L directly applied thereto instead of imaging via a bag-shaped element that bulges the digestive tract 112 , the inner wall surface 113 and other parts can be precisely grasped.
  • the medium that causes the digestive tract 112 to bulge is not limited to gas and can instead be distilled water, a physiological saline solution, or any other liquid.
  • the liquid needs to transmit the laser light to be used and light having a certain wavelength.
  • the medium it is desirable to increase the concentration of the stain as compared with the case where the medium is gas.
  • a pressure sensor may be provided in a position between the first balloon 21 and the second balloon.
  • the pressure sensor is preferably formed of a plurality of pressure sensors provided at equal intervals.
  • the section (b) of FIG. 13 is a schematic view showing a front-end-side end portion of an endoscope 2 of the laser endoscope device 1 in FIG. 15 .
  • FIG. 14 is a schematic view showing the entire endoscope 2 .
  • FIG. 15 is a block diagram showing the control configuration of the laser endoscope device 1 .
  • the laser endoscope device 1 includes an imaging unit 10 , which includes the endoscope 2 , a control unit 50 , and an image processing unit 70 , as shown in FIG. 15 .
  • the laser endoscope device 1 further includes a laser oscillator 60 and an optical part 65 .
  • the laser light L emitted from the laser oscillator 60 is reflected off a dichroic mirror 66 , which is the optical part 65 , further reflected off a mirror 19 in the endoscope 2 , and applied to the living body.
  • Living cells irradiated with the laser light L produce fluorescence, and the fluorescence is reflected off the mirror 19 , passes through the dichroic mirror 66 , and is detected with a photodetector 35 .
  • the light detected with the photodetector 35 is converted into an electric signal, and the image processing unit 70 forms an image according to the electric signal.
  • the photodetector 35 is formed of a plurality of photodetectors, and a color separation optical filter is disposed in a position on the upstream side of the photodetector 35 for color separation.
  • the laser oscillator 60 to be used is configured to have a pulse width ranging from several tens to several hundreds of femtosecond and a pulse frequency ranging from several tens to several hundreds of megahertz.
  • the laser light L in the present embodiment is two-photon laser light, which is a kind of multiphoton laser light, and the laser oscillator 60 uses, for example, a pulse laser capable of emitting light having a wavelength of 800 nm and a power of 3.2 W at the maximum. In the imaging operation, the laser outputs laser light having a power ranging from 0.16 to 0.32 W.
  • Setting the wavelength at 800 nm or longer can prevent photons that belong to the ultraviolet region (wavelength shorter than 400 nm) from being produced in the half-wavelength light produced in the multiphoton excitation process.
  • the laser oscillator 60 can adjust the intensity of the laser light L.
  • the dichroic mirror 66 which is the optical part 65 , reflects light having the same wavelength as that of the laser light L and transmits light having the other wavelengths.
  • the laser light L emitted from the laser oscillator 60 is therefore reflected off the dichroic mirror 66 toward the mirror 19 .
  • the fluorescence produced in the living cells is reflected off the mirror 19 , then passes through the dichroic mirror 66 , and reaches the photodetector 35 .
  • the optical part 65 can instead be formed, for example, of a prism or a 4/ ⁇ plate.
  • the imaging unit 10 includes the endoscope 2 and the photodetector 35 and images the cell morphology in the living body with the laser light L applied to the interior of the living body.
  • the photodetector 35 detects the fluorescence produced when the laser light L is applied and converts the fluorescence into an electric signal according to the intensity of the fluorescence.
  • the photodetector 35 can, for example, be a photomultiplier or a CCD semiconductor image sensor.
  • the endoscope 2 includes an inner tube 12 and an outer tube 13 , which surrounds part of the outer surface of the inner tube 12 , as shown in FIG. 14 .
  • the inner tube 12 and part of the outer tube 13 are inserted into the living body.
  • the inner tube 12 has a length, for example, of 50 mm and an outer diameter ranging from, for example, 3 to 10 mm.
  • a linear-motion actuator is attached to the inner tube 12 , and the inner tube 12 is movable relative to the outer tube 13 in the axial direction X by about 25 mm.
  • An ultrasonic motor is further attached to the inner tube 12 , and the inner tube 12 is revolvable relative to the outer tube 13 over 360°.
  • the action of the inner tube 12 in the axial direction X or the revolutional direction R is controlled by the control unit 50 .
  • the imaging head 11 is provided at a front-end-side end portion of the inner tube 12 of the endoscope 2 .
  • the imaging head 11 is inserted along with the inner tube 12 into the living body in such a way that the imaging head 11 passes by the insertion tube 20 , as shown in the section (b) of FIG. 13 .
  • the imaging head 11 is so controlled as to move in the living body based on the actions in the axial direction X and the revolutional direction R of the inner tube 12 .
  • the imaging head 11 includes the objective lens 16 , a focal point changer 18 , a spacer 17 , and the mirror 19 .
  • the mirror 19 is a part that redirects the laser light L outputted from the laser oscillator 60 toward the objective lens 16 or redirects the fluorescence emitted from the living cells toward the photodetector 35 , as described above.
  • the objective lens 16 is so provided as to face the inner wall surface 113 of the living body.
  • the objective lens 16 has, for example, a diameter of 10 mm, a magnification of 10 times, a resolution of 5 ⁇ m, and an imaging field of view of 3 mm ⁇ 3 mm.
  • the objective lens 16 instead has a diameter of 12 mm, a magnification of 40 times, a resolution of 10 ⁇ m, and a field of view of 7.5 mm ⁇ 7.5 mm. The wider the imaging field of view, the better.
  • the objective lens 16 may still instead be so configured that part of a lens having either of the diameters described above is cut or the diameter of the objective lens 16 is reduced to a value ranging from 3 mm to 5 mm so that the objective lens is readily inserted into the living body with the same resolution maintained.
  • the focal point changer 18 is, for example, a piezoelectric actuator or an electromagnetic actuator and moves the objective lens 16 in the optical axis direction to change the position of the focal point of the objective lens 16 .
  • the focal point changer 18 operates under the control of the control unit 50 and can adjust the focal point over a depth range from 0 to 1000 ⁇ m below the inner wall surface (mucosa surface) 113 . Changing the position of the focal point allows imaging of the state of the living body at a predetermined depth below the cell surface of the digestive tract 112 .
  • the focal point below the inner wall surface (mucosa surface) 113 may be adjusted over a depth range from 0 to 75 ⁇ m.
  • the spacer 17 has, for example, an annular shape and is provided around the space between the objective lens 16 and the inner wall surface 113 .
  • the spacer 17 is a part not only for preventing the objective lens 16 from coming into contact with the inner wall of the living body but for maintaining a fixed distance between the objective lens 16 and the inner wall surface 113 .
  • the distance between the objective lens 16 and the inner wall surface (mucosa surface) 113 is set at an appropriate value, for example, a value greater than or equal to 1 mm but smaller than or equal to 10 mm by exchanging the spacer 17 to another before the imaging starts or adding a distance changeable mechanism using an actuator or any other device.
  • the control unit 50 controls the movement of the imaging head 11 (inner tube 12 ) with the spacer 17 being in contact with the inner wall surface 113 and maintains the fixed distance from the objective lens 16 to the inner wall surface 113 .
  • the control unit 50 is formed, for example, of a CPU, a ROM, and a RAM.
  • the control unit 50 controls the action of the imaging head 11 via the inner tube 12 .
  • the control unit 50 controls the movement of the imaging head 11 not only in the circumferential direction along the inner circumference of the inner wall of the digestive tract 112 but in the tract longitudinal direction of the digcstive tract 112 (along axis of digestive tract).
  • the control unit 50 further changes the position of the objective lens 16 in the optical axis direction by controlling the action of the focal point changer 18 to control the position where the focus is achieved in the living body.
  • the control unit 50 can further adjust the laser output by controlling the laser oscillator 60 .
  • the image processing unit 70 stores the converted electric signal (fluorescence intensity) from the photodetector 35 and the coordinate position of the imaging unit 10 sent from the control unit 50 with the electric signal and the coordinate position related to each other and processes the data on the fluorescence intensity and the coordinate position to generate a digital image.
  • the generated digital image is, for example, displayed on a monitor, printed out, or recorded on a storage device.
  • the coordinate position of the imaging unit 10 may be expressed, for example, in the form of the distance from a reference location on the patient (throat or anus, for example) and the angle of revolution of the imaging head 11 .
  • the control unit 50 controls the movement of the imaging head 11 in such a way that the imaging head 11 scans the inner wall surface 113 of the living body with the fixed distance from the imaging head 11 to the inner wall surface 113 maintained.
  • the imaging unit 10 images a plurality of imaging regions P, which are imaged as the imaging head 11 moves, in such a way that adjacent imaging regions P 1 and P 2 partially overlap with each other, as shown in FIG. 16 .
  • the image processing unit 70 successively overlaps the region Pa, where the adjacent imaging regions P 1 and P 2 overlap with each other, with another region Pa to generate a merged image.
  • the cell morphology in the living body can thus be imaged over a wide range with no missing part.
  • the control unit 50 controls the imaging head 11 in such a way that the imaging head 11 moves over 360° along the inner circumference of the digestive tract 112 (or orbits around axis of digestive tract 112 ), as shown in FIG. 16 .
  • the imaging unit 10 then images a plurality of imaging regions P, which are imaged as the imaging head 11 moves, in such a way that adjacent imaging regions P 1 and P 2 have identical portions in the circumferential direction.
  • the image processing unit 70 successively causes the identical portions Pa, belonging to the adjacent imaging regions P 1 and P 2 , to be aligned with each other to generate a panoramic image.
  • the state of the inner wall of the digestive tract 112 can thus be exhaustively grasped.
  • the control unit 50 moves the imaging head 11 by a predetermined distance along the tract longitudinal direction of the digestive tract 112 , and the imaging unit 10 performs imaging in such a way that an imaging region P 11 to be imaged after the movement and the imaging region P 1 adjacent to the imaging region P 11 in the tract longitudinal direction have identical portions.
  • the image processing unit 70 then successively causes identical portions Pb, belonging the two imaging regions P 1 and P 11 to be aligned with each other.
  • the imaging unit 10 then performs the imaging over 360° along the inner circumference of the digestive tract 112 , and the image processing unit 70 overlaps the regions that overlap with each other in the circumferential and tract longitudinal directions to generate a panoramic image extending in the tract longitudinal direction.
  • the state of the inner wall of the digestive tract 112 can thus be exhaustively grasped also in the tract longitudinal direction.
  • the control unit 50 controls the operation of the focal point changer 18 of the imaging head 11 to change the position of the focal point of the objective lens 16 , and the imaging unit 10 images a plurality of imaging regions at different depths as the position of the focal point is changed.
  • the image processing unit 70 then places the plurality of images obtained by the imaging in correspondence with the position of the focal point to generate a stereoscopic image of the cell morphology in the living body.
  • the cell morphology in the living body over a predetermined depth range can thus be imaged as well as the inner wall surface 113 of the living body.
  • the inner wall of the digestive tract 112 is planarized, as shown in the section (a) of FIG. 17A .
  • the insertion tube 20 is first inserted into the digestive tract 112 , as shown in the section (b) of FIG. 17A .
  • the first balloon 21 is so bulged as to come into contact with the inner wall surface 113 of the digestive tract 112 , as shown in the section (c) of FIG. 17A .
  • the first balloon 21 is formed of three balloons.
  • the second balloon 22 which is located on the rear side of the insertion tube 20 , is then so bulged as to come into contact with the inner wall surface 113 of the digestive tract 112 , as shown in the section (d) of FIG. 17A .
  • the second balloon 22 is also formed of three balloons. The action described above forms the closed space S between the first balloon 21 and the second balloon 22 . Air is then blown out of the supply port 42 into the closed space S to bulge the interior of the digestive tract 112 . Wrinkles and other irregularities present on the inner wall of the digestive tract 112 are thus stretched and planarized.
  • the step of planarizing the inner wall may be carried out after a staining step, which will be descried later.
  • a cleaning liquid is then supplied into the closed space S via the supply port 42 , as shown in the section (e) of FIG. 17B .
  • the inner wall surface 113 of the digestive tract 112 is thus cleaned.
  • the cleaning liquid is then sucked and recovered via the recovery port 43 .
  • a pronase liquid is then supplied via the supply port 42 into the closed space S, as shown in the section (f) of FIG. 17B . Excess of the mucus having adhered to the inner wall surface 113 of the digestive tract 112 is thus removed. The pronase liquid is then sucked and recovered via the recovery port 43 .
  • a stain A (stain containing a curcumin-based compound, for example) is then supplied via the supply port 42 into the closed space S to fill the closed space S with the stain A, as shown in the section (g) of FIG. 17B .
  • the stain A is then left for 2 to 5 minutes, and the space S is then cleaned with the cleaning liquid.
  • a predetermined cell group in the inner wall of the digestive tract 112 is thus stained with the stain A.
  • the predetermined cell group refers to a plurality of cells contained in the epithelial cells 121 , the glandular cells 131 , the capillaries 132 , or the connective tissue 133 .
  • a stain B (stain containing Acid Red, for example) is then supplied via the supply port 42 into the closed space S to fill the closed space S with the stain B, as shown in the section (h) of FIG. 17B .
  • the stain B is then left for 2 to 5 minutes, and the space S is then cleaned with the cleaning liquid.
  • the predetermined cell group in the inner wall of the digestive tract 112 is thus stained with the stain B, so that the inner wall of the digestive tract 112 is double stained.
  • employing the method for filling the space S with the stain A or B allows the inner wall of the digestive tract 112 to be double stained with only a small amount of staining unevenness.
  • the endoscope 2 is then inserted into the closed space S, as shown in the section (i) of FIG. 17C .
  • the imaging head 11 provided at the front end of the endoscope 2 performs the imaging with the fixed distance between the inner wall surface 113 and the objective lens 16 maintained by changing the position of the focal point of the objective lens 16 to the depth of 0 ⁇ m, 30 ⁇ m, 60 ⁇ m, 90 ⁇ m, 120 ⁇ m, and 150 ⁇ m below the inner wall surface (mucosa surface) 113 .
  • the position corresponding to the depth of 0 ⁇ m can be determined with the aid of an autofocus function with which the endoscope 2 is equipped.
  • the imaging is performed by changing the position of the focal point of the objective lens 16 to the depth of 0 ⁇ m, 25 ⁇ m, 50 ⁇ m, and 75 ⁇ m below the inner wall surface (mucosa surface) 113 .
  • the depth intervals that change as described above are presented only by way of example, and finer or coarser intervals may be employed.
  • Imaging is then performed with the imaging head 11 caused to revolve over 360° along the inner wall surface 113 , as shown in the section (j) of FIG. 17C .
  • the imaging is so performed that the imaging regions P 1 and P 2 adjacent to each other in the circumferential direction have identical portions.
  • the imaging of the identical portions allows acquisition of a first panoramic image.
  • the imaging head 11 is moved by a predetermined distance along the tract longitudinal direction of the digestive tract 112 .
  • the imaging head 11 is then caused to revolve over 360° again to acquire a second panoramic image.
  • the first and second panoramic images are so imaged that the imaging regions P 1 and P 11 , which are adjacent to each other in the tract longitudinal direction of the insertion tube 20 , have identical portions, and the identical portions in the circumferential and longitudinal directions of the digestive tract are accurately aligned with each other with the aid of image processing into a seamless merged image.
  • the actions described above are repeated multiple times (5 times in the present embodiment).
  • the endoscope 2 including the imaging head 11 is moved to a point behind the second balloon 22 , as shown in the section (k) of FIG. 17C .
  • the first balloon 21 is caused to shrink, as shown in the section ( 1 ) of FIG. 17D .
  • the insertion tube 20 is then pulled rearward with the position of the second balloon 22 maintained, as shown in the section (m) of FIG. 17D .
  • the first balloon 21 is then caused to bulge, as shown in the section (n) of FIG. 17D .
  • the second balloon 22 is caused to shrink, as shown in the section (o) of FIG. 17E , and the insertion tube 20 is then pulled rearward with the position of the first balloon 21 maintained, as shown in the section (p) of FIG. 17E .
  • the second balloon 22 is then caused to bulge, as shown in the section (q) of FIG. 17E .
  • Another closed space S 1 adjacent to the previously formed closed space S in the tract longitudinal direction is thus formed.
  • the actions shown in the section (d) of FIG. 17A to the section (k) of FIG. 17C are performed again for the closed space S 1 .
  • the imaging allows the imaging to be performed over the length, for example, of 300 mm in the tract longitudinal direction.
  • the overall length of the large intestine may be imaged in four separate sets of imaging operation.
  • the action of the laser endoscope device 1 described above allows exhaustive, efficient imaging of the state of the inner wall of the digestive tract 112 in the inner circumferential direction and the tract longitudinal direction of the digestive tract 112 .
  • the laser endoscope device 1 is further configured to efficiently detect a lesion, such as cancer cells, in the depth direction.
  • the control unit 50 has the following two focal point changeable modes (see FIG. 15 ). Specifically, the control unit 50 has a first focal point changeable mode 51 , in which the focal point position is changed by a first interval, and a second focal point changeable mode 52 , in which the focal point position is changed by a second interval, which is smaller than the first interval.
  • the first focal point changeable mode 51 is a mode for changing the focal point position in such a way that the laser light L is focused, for example, in the positions below the inner wall surface (mucosa surface) 113 of the living body at the depth of 0 ⁇ m, 30 ⁇ m, 60 ⁇ m, 90 ⁇ m, and 120 ⁇ m.
  • the second focal point changeable mode 52 is a mode for changing the focal point position by a narrower interval, for example, a 5- ⁇ m interval. The intervals are variable and can be changed by rewriting a program.
  • the control unit 50 stores a reference image of a lesion-free healthy cell for each internal organ. Since the reference image of a healthy cells varies in accordance with the type of laser light with which the cell is irradiated (multiphoton laser light or confocal laser light) and the depth from the surface of the cell membrane of an organ and further varies, in the case where a stain is used, in accordance with the type of the stain, it is preferable to prepare in advance reference images according to imaging conditions.
  • FIG. 18 is a flowchart showing an example of the action of the laser endoscope device 1 .
  • the control unit 50 first causes the imaging unit 10 to perform imaging in the depth direction in the first focal point changeable mode 51 over a certain depth range, in which the imaging is performed at the coarse imaging intervals (S 11 ).
  • the magnification is set at a small value (lower than or equal to 10 times, for example), and a trial image is acquired for evaluation.
  • the image to be evaluated may be an image captured only at a fixed depth in non-depth-changing imaging or may be an image of the mucosa surface.
  • the control unit 50 compares the image obtained in the first focal point changeable mode 51 with the reference image of healthy cells stored in advance in terms of at least one of the shape and the brightness and evaluates suspicion of a lesion (S 12 ). In a case where there is no suspicion of a lesion, the examination is terminated (S 13 ).
  • the control unit 50 causes the imaging unit 10 to perform imaging in the second focal point changeable mode 52 in the vicinity of the focal point position where the image containing the portion suspicious of a lesion was captured (S 14 ).
  • the magnification is set at a large value (40 times, for example).
  • the image to be evaluated may be an image captured only at a fixed depth in non-depth-changing imaging or may be an image of the surface as along as the image allows diagnosis of the examination target.
  • the control unit 50 compares the image obtained in the first focal point changeable mode 51 with the reference image of healthy cells stored in advance in terms of at least one of the shape and the brightness and evaluates suspicion of a lesion (S 15 ). In a case where there is no suspicion of a lesion, the examination is terminated (S 16 ).
  • the control unit 50 increases the power of the laser light L as compared with the power in the imaging and applies the laser light L having the increased power to the cells having a lesion to remove (evaporate) the cells having a lesion (S 17 ).
  • the power of the laser light used to remove the cells is 10 to 20 times the power in the imaging or ranges from 2 to 3 W.
  • the comparison in terms of shape, brightness, or any other factor may be automatically made with a computer.
  • the evaluation made by the computer shows a location suspicious of a lesion
  • the result of the evaluation is preferably checked by a medical doctor.
  • the tomographic imaging described above allows exhaustive imaging with the imaging period shortened. Further, a cell having a lesion can be reliably removed in an early stage of the lesion.
  • the diagnosis and removal may be performed before the shift of the imaging space S described with reference to FIGS. 17A to 17E , or the lesion may be removed after the imaging of the target organ and in another opportunity by forming a series of imaging spaces S based on the coordinates of the resultant images.
  • the timing when the lesion is removed can be determined based, for example, on the physical strength of the patient, the condition of the diseased site, and the performance of the laser endoscope device 1 .
  • FIG. 19 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 1 of the first embodiment is used to generate a panoramic image.
  • the control unit 50 in the Variation 1 controls the imaging head 11 attached to an arm 15 in such a way that the imaging head 11 helically revolves around the axis of the digestive tract 112 .
  • the imaging unit 10 images a plurality of imaging regions P to be imaged as the imaging head 11 revolves in such a way that imaging regions P 1 and P 2 adjacent to each other partially overlap with each other in the direction of revolution R.
  • the image processing unit 70 successively overlaps a region Pa, where the adjacent imaging regions P 1 and P 2 overlap with each other, with another region Pa to generate a panoramic image.
  • the state of the inner wall of the digestive tract 112 can thus be exhaustively imaged.
  • FIG. 20 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 2 of the first embodiment is used to image the interior of a living body.
  • a pair of wheels 17 a are attached to the arm 15 on the front end side of the endoscope 2 in place of the spacer 17 .
  • rolling the pair of wheels 17 a with the wheels 17 a being in contact with the inner wall surface 113 allows the objective lens 16 to be moved with a fixed distance from the objective lens 16 to the inner wall surface 113 maintained.
  • an imaging target such as the epithelial cells 121 , the glandular cells 131 , the capillaries 132 , and the connective tissue 133 , can be precisely brought into focus.
  • FIG. 21 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 3 of the first embodiment is used to image the interior of a living body.
  • a pressing member 23 is provided at the rear of the imaging head 11 (side opposite the side via which the imaging head 11 radiates the laser light L), Fluid is introduced into the pressing member 23 so that the pressing member bulges, and the pressing member 23 presses the inner wall on the side opposite the imaging region, whereby the spacer 17 is in contact with the inner wall of the imaging region.
  • the fixed distance between the objective lens 16 and the inner wall surface 113 can thus be maintained, whereby an imaging target can be precisely brought into focus.
  • FIG. 22 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 4 of the first embodiment is used to image the interior of a living body.
  • a support roller 24 is provided at the rear of the imaging head 11 in place of the pressing member 23 shown in Variation 3.
  • An extension mechanism 25 is then used to press the support roller 24 against the inner wall on the side opposite the imaging region to cause the spacer 17 to be in contact with the inner wall of the imaging region.
  • the fixed distance between the objective lens 16 and the inner wall surface 113 can thus be maintained, whereby an imaging target can be precisely brought into focus.
  • FIG. 23 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 5 of the first embodiment is used to image the interior of a living body.
  • a sliding member 26 is provided at the rear of the imaging head 11 in place of the support roller 24 shown in Variation 4.
  • the extension mechanism 25 is then used to press the sliding member 26 against the inner wall on the side opposite the imaging region to cause the spacer 17 to be in contact with the inner wall of the imaging region.
  • the fixed distance between the objective lens 16 and the inner wall surface 113 can thus be maintained, whereby an imaging target can be precisely brought into focus.
  • FIG. 24 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 6 of the first embodiment is used to image the interior of a living body.
  • the imaging head 11 is supported by a joint mechanism 27 , which flexibly moves, as shown in the section (a) of FIG. 24 .
  • another joint mechanism 28 is provided at the rear of the imaging head 11 and supports the imaging head 11 .
  • protruding or recessed sites 113 a such as colorectal semilunar folds present in the digestive tract 112 , can be imaged, as shown in the section (b) of FIG. 24 .
  • using the autofocus function allows the fixed distance between the objective lens 16 and the inner wall surface 113 to be maintained.
  • FIG. 25 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 7 of the first embodiment is used to image the interior of a living body.
  • the front end of the endoscope 2 is inserted into the first balloon 21 , and the imaging head 11 is supported by a joint mechanism 27 , which is provided in a halfway position on the inner tube 12 of the endoscope 2 (between first balloon 21 and second balloon 22 ).
  • the joint mechanism 28 shown in Variation 6 is not necessary, whereby the structure of the endoscope 2 can be simplified as compared with the structure in Variation 6.
  • FIG. 26 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 8 of the first embodiment is used to image the interior of a living body.
  • the imaging head 11 is provided with a gyro sensor 29 .
  • Information on the position and attitude of the imaging head 11 in the imaging operation can therefore be acquired. Further, captured image data can be displayed in a 3D form.
  • the imaging head 11 can quickly and accurately return to the portion suspicious of a lesion and can perform the imaging in the second focal point changeable mode 52 , in which the imaging is performed at the fine imaging intervals.
  • a GPS function may be added in place of the gyro sensor 29 .
  • the inner tube 12 of the endoscope 2 is provided with a pressure sensor 30 . Measuring the pressure in the closed space S with the pressure sensor 30 and feeding the measured pressure back allows appropriate adjustment of the pressure in the space S.
  • FIG. 27 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 9 of the first embodiment is used to image the interior of a living body.
  • the imaging head 11 is provided with an extendable/shrinkable spacer 31 for adjusting the distance between the objective lens 16 and the inner wall surface 113 .
  • the section (a) of FIG. 27 shows a state in which the extendable/shrinkable spacer 31 is extended, and the section (b) of FIG. 27 shows a state in which the extendable/shrinkable spacer 31 is shrunk.
  • the expansion and shrinkage of the extendable/shrinkable spacer 31 allows precise adjustment of the distance between the objective lens 16 and the inner wall surface 113 .
  • the extendable/shrinkable spacer 31 can be formed, for example, of an actuator.
  • FIG. 28 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 10 of the first embodiment is used to stain the interior of a living body.
  • the insertion tube 20 is provided with a plurality of discharge ports 42 a . Spraying a stain via the discharge ports 42 a toward the inner wall so that the stain is applied onto the inner wall allows the inner wall to be stained. As a result, the amount of the stain to be used can be reduced as compared with the method in which the space S is filled with the stain. Even a stain using a dye that a living body tolerates by a small amount can therefore be used with no anxiety.
  • FIG. 29 is a diagrammatic view showing an example in which a laser endoscope device 1 according to Variation 11 of the first embodiment is used to image the interior of a living body.
  • the gap between the pair of wheels 17 a of the imaging head 11 shown in Variation 2 is increased so that an actuator or any other component that is not shown can move the mirror 19 and the objective lens 16 in the axial direction X of the endoscope 2 .
  • an actuator or any other component that is not shown can move the mirror 19 and the objective lens 16 in the axial direction X of the endoscope 2 .
  • FIGS. 30 and 31 are diagrammatic views showing an example in which a laser endoscope device 1 according to Variation 1 of the first embodiment is used to image the interior of a living body.
  • the gap between the pair of wheels 17 a of the imaging head 11 shown in Variation 2 is increased so that a plurality of (in the present variation, 5 sets of) mirrors 19 and objective lenses 16 are provided between the pair of wheels 17 a .
  • the imaging head 11 is so configured that the region between the first balloon 21 and the second balloon 22 can be imaged in a single 360°-revolution action, as shown in the sections (a) and (b) of FIG. 31 .
  • the interior of the living body can therefore be efficiently imaged.
  • the endoscope 2 , the insertion tube 20 , the inner tube 12 , the outer tube 13 , and other components are each drawn in a linear shape.
  • the endoscope 2 , the insertion tube 20 , the inner tube 12 , the outer tube 13 , and other components are each flexible, and that an optical fiber or any other component is used as a laser light guide.
  • the imaging head 11 or any other component of the imaging head 11 only needs to have an appropriate joint structure and a structure that fixes the arm 15 or any other component in the L-letter shape or any other shape, for example, with a wire.
  • the endoscope 2 , the insertion tube 20 , the arm 15 , the spacer 17 , the balloons 21 and 22 , and other components are each made of a metal, resin, or rubber material. Since these components directly come into contact with a living organ, such as the large intestine and the stomach, the surface of each of the components is processed with extreme care and finished with extreme precision.
  • the finding 2, on which the present invention is based, and a primary configuration of the invention associated with the finding 2 will next be described.
  • the finding 2 will be described with reference to a case where a cell morphology in a living body is imaged under the multiphoton laser microscope (FV1000MPE manufactured by Olympus Corporation) and a plurality of captured images are overlapped with each other to create a panoramic image.
  • a laboratory mouse was used as the living body.
  • FIG. 32A is a diagrammatic view showing that the inner wall of the digestive tract 112 is imaged over the entire circumference thereof under the multiphoton laser microscope 102 .
  • the method for creating a panoramic image is roughly the same as the method for creating the image shown in FIG. 10A , which is related to the finding 1. That is, the imaging head 11 performs imaging while moving along the inner circumference of the digestive tract 112 and revolving over 360°, and the resultant images are merged with one another to obtain a panoramic image.
  • FIG. 32B shows a panoramic image illustrating the cell morphology in a position below the inner wall surface (mucosa surface) 113 at a depth of 50 ⁇ m.
  • the stain containing curcumin and the stain containing Acid Red (red #106) were used.
  • FIG. 32B indicates that a plurality of crypts 138 (or glands 130 ) are arranged at roughly regular intervals.
  • the imaging regions P are arranged in correspondence with the direction of the hour hand of a timepiece shown in FIG. 32A , and a solitary lymphatic nodule, in which a plurality of lymphocytes gather, is formed in the 8-o'clock direction.
  • the solitary lymphatic nodule is not at present as bad as a lesion, such as cancer, but FIG. 32B shows that the crypts 138 in the glands 130 disappear in the region where the solitary lymphatic nodule is formed.
  • the present inventors have assumed that the region where the solitary lymphatic nodule is formed is used as a coordinate mark in the panoramic image, and that when a lesion is found, the position of the lesion can be identified by the mark.
  • the present inventors have further assumed that even if no solitary lymphatic nodule is present, the position where a lesion is present can be clearly identified with respect to a predetermined position in the panoramic image. An embodiment based on the finding 2 will be described below.
  • FIG. 33 shows an endoscope 2 of the laser endoscope device 1 A.
  • the endoscope 2 of the laser endoscope device 1 A has roughly the same configuration as that of the endoscope 2 shown in the first embodiment and includes the inner tube 12 and the outer tube 13 , which surrounds part of the outer surface of the inner tube 12 .
  • a linear-motion actuator is attached to the inner tube 12 , and the inner tube 12 is movable relative to the outer tube 13 in the axial direction X.
  • An ultrasonic motor is further attached to the inner tube 12 , and the inner tube 12 is revolvable relative to the outer tube 13 over 360°.
  • the action of the inner tube 12 in the axial direction X or the revolutional direction R is controlled by the control unit 50 .
  • the endoscope of the laser endoscope device 1 A further includes an angle detector 81 , which detects the angle of the inner tube 12 in the revolutional direction R, and a linear scale 82 , which detects the position of the inner tube 12 in the axial direction X. Since the endoscope 2 includes the angle detector 81 and the linear scale 82 , the distance from a solitary lymphatic nodule to a lesion in the axial direction X and the angle between the solitary lymphatic nodule and the lesion in the revolutional direction R can be grasped with respect, for example, to the position of the solitary lymphatic nodule, so that the position of the lesion can be identified.
  • the position where the lesion is present can be characterized with respect to a predetermined position, for example, the anus in the case of the large intestine, and the mouse in the case of the stomach.
  • a coordinate reference can be provided in a panoramic image, whereby the position where a lesion is present in the digestive tract 112 can be visualized and grasped. Further, the coordinate reference can show evidence that the 360°-revolution imaging has been performed, whereby the fact that the acquired image is a full-circumference image with no missing part can be presented to the patient.
  • the finding 3, on which the present invention is based, and a primary configuration of the invention associated with the finding 3 will next be described.
  • the finding 3 will be described with reference to a case where a cell morphology in a living body is imaged under the multiphoton laser microscope (FV1000MPE manufactured by Olympus Corporation) while changing the focal point position and a plurality of captured images are cut in a predetermined position to create a cross-sectional image (tomographic image).
  • FV1000MPE manufactured by Olympus Corporation
  • a laboratory mouse was used as the living body.
  • FIGS. 34A, 34B, and 34C show images illustrating the cell morphology over a predetermined depth range from the inner wall surface (mucosa surface), specifically, three-dimensional data images obtained by performing imaging at 2- ⁇ m intervals from the mucosa surface (depth 0 ) to a depth of 150 ⁇ m and layering the captured 75 images in total on each other.
  • depth 0 the inner wall surface
  • the section (a) shows an image of the cell group in a plan view viewed in the direction perpendicular to the inner wall surface 113
  • the section (b) shows a cross-sectional image of the section (a) taken along the line b-b
  • the section (c) shows a cross-sectional image of the section (a) taken along the line c-c.
  • both the stain containing curcumin and the stain containing Acid Red (red #106) were used.
  • the staining period was set at 5 minutes.
  • the staining period is the period for which the stain is caused to be in contact with the cell group and the dye of the stain is allowed to penetrate into the cells themselves or the gaps between the cells.
  • FIGS. 34A to 34C show images obtained by imaging the same cell group at the same time and filtering the images to extract different colors (wavelengths).
  • FIG. 34A shows images representing the extracted color region stained both with the curcumin dye and the Acid Red dye.
  • FIG. 34B shows images representing the extracted color region stained with the curcumin dye.
  • FIG. 34C shows images representing the extracted color region stained with the Acid Red dye.
  • FIGS. 34A to 34C show monochromatic images that are inherently color images, and the difference in the tendency of the staining performed by the stains causes the region stained with the curcumin dye to be displayed in a green fluorescent color and the region stained with the Acid Red dye to be displayed in a pale red or near orange fluorescent color, whereby the difference in color is more distinctively expressed.
  • FIGS. 34A to 34C show cancer tissue and healthy mucosa tissue and indicate that the dyes differ from each other in terms of permeability.
  • the curcumin dye shows higher permeability in the cancer tissue than in the healthy mucosa tissue, as shown in FIG. 34B .
  • the depth to which the tissue is stained is about 40 ⁇ m in the cancer tissue, whereas the depth is about 20 ⁇ m in the healthy mucosa tissue.
  • the Acid Red dye shows lower permeability in the cancer tissue than in the healthy mucosa tissue, as shown in FIG. 34C .
  • the depth to which the tissue is stained is about 40 ⁇ m in the cancer tissue, whereas the depth is about 70 ⁇ m in the healthy mucosa tissue.
  • the permeability of a dye varies depending on whether the cell morphology is cancer tissue or healthy mucosa tissue. It is believed based on the characteristic described above that measurement of the depth to which a cell group displayed in a cross-sectional image is stained allows identification of the cell group, a healthy cell group or a cancer cell group. A third embodiment based on the finding 3 will be described below.
  • FIG. 35 is a block diagram showing the control configuration of the laser endoscope device 1 B.
  • the laser endoscope device 1 B has roughly the same configuration as that of the laser endoscope device 1 shown in the first embodiment and includes the imaging unit 10 , which includes the endoscope 2 , and the control unit 50 , the image processing unit 70 , the laser oscillator 60 , and the optical part 65 .
  • the laser endoscope device 1 B further includes the stain supplier 40 (see FIG. 12 ), which supplies a stain into a living body.
  • the stain supplier 40 see FIG. 12
  • double staining in which cell groups in a living body are selectively stained in at least two different chromatic colors in accordance with the type of cells, is employed.
  • the imaging unit 10 applies laser light to a stained cell group and changes the focal point position (from 0 to 1000 ⁇ m, for example) to image a plurality of imaging regions P at different depths.
  • the image processing unit 70 places the plurality of images obtained by the imaging performed by the imaging unit 10 in correspondence with the focal point position to generate a stereoscopic image.
  • the generated stereoscopic image is cut at a predetermined on-image position containing the stained cell group to generate a cross-sectional image of the stained cell groups.
  • the control unit 50 evaluates whether the cell group displayed in the cross-sectional image is suspicious of a lesion based on the depth to which the cell group has been stained. For example, when the depth to which the cell group has been stained with the curcumin dye is (at least 1.5 times, for example) greater than the depth to which the healthy mucosa tissue has been stained, the control unit 50 determines that cancer cells have developed, whereas when the two depths are similar to each other (difference is smaller than 1.5 times, for example), the control unit 50 determines that no cancer cells have developed.
  • the control unit 50 determines that cancer cells have developed, whereas when the two depths are similar to each other (difference is at least 0.6 times, for example), the control unit 50 determines that no cancer cells have developed. It is noted that after whether or not cancer cells are present is evaluated based, for example, on single or double staining, the evaluation described above based on a cross-sectional image increase the reliability of the overall evaluation.
  • the laser endoscope device 1 B includes the imaging unit 10 , which includes the imaging head 11 , which is inserted into a living body, and images the living body by applying the laser light to the living body via the imaging head 11 , the control unit 50 , which controls the operation of the imaging head 11 , and the image processing unit 70 , which processes an image captured by the imaging unit 10 .
  • the imaging head 11 includes the objective lens 16 and the focal point changer 18 capable of changing the focal point position of the objective lens 16 in the depth direction of the living body.
  • the control unit 50 causes the focal point changer 18 to operate to change the focal point position, and the imaging unit 10 images a plurality of imaging regions P at different depths as the focal point position is changed.
  • the image processing unit 70 then cuts the plurality of images obtained by the imaging performed by the imaging unit 10 at a predetermined position to generate a cross-sectional image of the interior of the living body.
  • Generation of a cross-sectional image by using the laser endoscope device 1 B allows evaluation of whether or not tissue is cancerous also in the depth direction in the living body.
  • the image processing unit only needs to display a currently captured image and relies on another device in terms of generation of a panoramic image and a stereoscopic image, whereby the burden on the endoscope device can be reduced.
  • the finding 4 will first be described with reference to a case where living cells are placed in a tray and imaged under the multiphoton laser microscope (FV1000MPE manufactured by Olympus Corporation). Living tissue extracted from the interior of a human body was used as the living cells.
  • FV1000MPE multiphoton laser microscope
  • FIGS. 36A, 36B, and 36C show images illustrating a cell morphology in a position below the inner wall surface (mucosa surface) 113 at a depth of 50 ⁇ m.
  • both the stain containing curcumin and the stain containing Acid Red (red #106) were used as the stain for staining the cell group.
  • the staining period was set at 5 minutes.
  • the living cells to be imaged were set at a temperature roughly equal to the body temperature (37° C.)
  • FIGS. 36A to 36C show images obtained by imaging the same cell group at the same time and filtering the images to extract different colors (wavelengths).
  • FIG. 36A shows an image representing the extracted color region stained with the curcumin dye.
  • FIG. 36B shows an image representing the extracted color region stained with the Acid Red dye.
  • FIG. 36C shows an image representing the extracted color region stained with both the curcumin dye and the Acid Red dye.
  • FIGS. 36A to 36C show monochromatic images that are inherently color images, and the difference in the tendency of the staining performed by the stains causes the region stained with the curcumin dye to be displayed in a green fluorescent color and the region stained with the Acid Red dye to be displayed in a pale red or near orange fluorescent color, whereby the difference in color is more distinctively expressed.
  • the region indicated with the arrow I is a region where the nuclei 135 of the glandular cells 131 are arranged in one row along the basement membrane 137 , which means that the glandular cells 131 are healthy cells.
  • the regions indicated with the arrows II are each a region where two nuclei 135 are present between the center (lumen) of the gland 130 and the basement membrane 137 .
  • the regions indicated with the arrows II are not malignant tumor but are regions that each starts transforming into a cancerous region.
  • FIG. 37 shows a stomach cancer cell group stained with the curcumin dye.
  • the glands 130 or the nuclei 135 in the glandular cells 131 cannot be identified, as shown in FIG. 37 .
  • imaging the stained cell group under the multiphoton laser microscope allows clear grasp of the forms of the glands 130 , the basement membranes 137 , the glandular cells 131 , and the nuclei 135 below the inner wall surface (mucosa surface) 113 at depths greater than or equal to 10 ⁇ m but smaller than or equal to 1000 ⁇ m.
  • Grasp of the arrangement of the nuclei 135 in the glandular cells 131 , the distances between the basement membrane 137 and the nuclei 135 , the shape and size of the nuclei 135 , and other factors allows accurate pathological diagnosis of whether or not cancerous tissue is developing.
  • a multiphoton laser microscope is typically expensive, and it is desirable to develop a method that allows pathological diagnosis reasonably priced for a patient.
  • the present inventors have attempted to grasp the cell morphology under a confocal laser microscope.
  • living body staining in which living body dye is applied on a mucosa surface
  • tissue of the inner wall surface (mucosa surface) itself is imaged under a confocal laser microscope has been reported, but there is no case in the past where a cell group below the inner wall surface 113 at a depth of 20 ⁇ m or deeper is imageable.
  • the finding 5 will be described with reference to a case where a cell morphology in a living body is imaged under the confocal laser microscope (FV1000 manufactured by Olympus Corporation). A laboratory mouse, was used as the living body.
  • FV1000 confocal laser microscope
  • the stain for staining the cell group the stain containing curcumin was used.
  • the staining period was set at 5 minutes, which is longer than the staining period in related art.
  • the staining period is desirably longer than or equal to 3 minutes but shorter than or equal to 20 minutes. The reason for this is that a staining period shorter than 3 minutes does not allow the stain to penetrate into the cell tissue, and that a staining period linger than 20 minutes causes the entire cells to be stained, resulting in a difficulty in distinction between a cancer cell group and a healthy cell group.
  • FIG. 38 shows an image of a cell group in a living body captured along the direction perpendicular to the inner wall surface (mucosa surface) 113 under a confocal laser microscope.
  • the depth of the imaging region P from the inner wall surface (mucosa surface) 113 is about 5 ⁇ m in the region indicated by the arrow III and about 10 ⁇ m in the region indicated by the arrow IV.
  • the cytoplasm 126 of each of the epithelial cells 121 is stained with the curcumin dye (green in actual color image).
  • the cytoplasm 126 is stained with the curcumin dye, and the nuclei 125 of the epithelial cells 121 are expressed in black. Since the nuclei 125 have roughly the same size as that of the nuclei 125 in the other region, and the shapes of the nuclei 125 in the two regions do not differ from each other, it is shown that the region indicated by the arrow IV contains healthy cells.
  • FIG. 39 shows an image of a cell group in a living body captured obliquely left downward with respect to the inner wall surface (mucosa surface) 113 under the confocal laser microscope.
  • the depth of the imaging region P is about 5 ⁇ m in the region indicated by the arrow V, about 10 ⁇ m in the region indicated by the arrow VI, and about 50 ⁇ m in the region indicated by the arrow VII.
  • the cytoplasm 126 of each of the epithelial cells 121 is stained with the curcumin dye (green in actual color image).
  • the cytoplasm 126 is stained with the curcumin dye, and the nuclei 125 of the epithelial cells 121 are expressed in black.
  • the region indicated by the arrow VI contains healthy cells.
  • the glandular cells 131 are stained with the curcumin dye and can therefore be visually recognized.
  • FIG. 40 shows an image of the cell group in the living body captured obliquely right downward with respect to the inner wall surface (mucosa surface) 113 under the confocal laser microscope.
  • the depth of the imaging region P is about 5 ⁇ m in the region indicated by the arrow VIII, and about 30 ⁇ m in the region indicated by the arrow IX.
  • the cytoplasm 136 of each of the glandular cells 131 is stained with the curcumin dye (green in actual color image), whereby the positions of the outer circumference of the gland 130 and the basement membrane 137 can be visually recognized. Further, the nuclei 135 of each of the glandular cells 131 are expressed in black.
  • the plurality of nuclei 135 are arranged along the outer circumference of the basement membrane 137 with a roughly fixed distance to the outer circumference maintained.
  • the fact that the nuclei 135 are regularly arranged in each of the glands 130 as described above shows that the region indicated by the arrow IX contains healthy cells.
  • FIG. 41 shows an image of the cell group in the living body captured obliquely left downward with respect to the inner wall surface (mucosa surface) 113 under the confocal laser microscope.
  • the depth of the imaging region P is about 5 ⁇ m in the region indicated by the arrow X, about 30 ⁇ m in the region indicated by the arrow XI, and about 60 ⁇ m in the region indicated by the arrow XII.
  • the cytoplasm 126 of each of the glandular cells 131 is stained with the curcumin dye (green in actual color image), whereby the positions of the outer circumference of the gland 130 and the basement membrane 137 can be visually recognized.
  • the plurality of arrowed nuclei 135 are arranged along the outer circumference of the basement membrane 137 with a roughly fixed distance to the outer circumference maintained.
  • the fact that the nuclei 135 are regularly arranged in each of the glands 130 as described above shows that the region indicated by the arrow XI contains healthy cells. In the region indicated by the arrow XII, the capillaries 132 are heavily stained with the curcumin dye.
  • a confocal laser microscope allows evaluation of whether an examination target is suspicious of a lesion by appropriately adjusting the focal point position and setting the staining period and based on the sizes of the nuclei 125 and 135 , the state of the arrangement of the nuclei 125 and 135 , and whether the distances between the nuclei 135 and the basement membrane 137 are uniform.
  • the finding 6 will be described with reference to another case where a cell morphology in a living body is imaged under the confocal laser microscope (FV1000 manufactured by Olympus Corporation). A laboratory mouse was used as the living body. The staining period for which the living cells are stained with a stain was set at 5 minutes.
  • a stain for staining a cell group a stain containing curcumin solved in an optimized method was used.
  • the 5% solution was stored as a stock liquid, and the stock liquid was diluted with a physiological saline solution by a factor ranging from 10 to 1000, and the resultant liquid was used to stain a living body.
  • the optimized solving method allowed a high-definition cell image shown below to be obtained.
  • FIG. 42 is an image of living cells stained with a stain solved by using the optimized solving method and captured with the confocal laser microscope.
  • the section (a) shows an image of healthy large intestine mucosa
  • the section (b) shows an image showing colorectal cancer.
  • the depth of the imaging region is about 50 jam below the mucosa surface.
  • the shape, size and arrangement of the nuclei 135 are roughly uniform, and the distances between the nuclei 135 and the basement membrane 137 are also roughly fixed, such as those in the regions indicated by the arrows XIII.
  • the nuclei are each drawn in the form of a sesame-seed-shaped dark portion.
  • the distribution pattern of the structure (crypts) of the glands 130 is roughly uniform, such as the structure in the regions indicated by the arrows XIV.
  • the crypts are each expressed in the form of a dark portion in the vicinity of the center of the broken-line circle.
  • the capillaries 132 show a regular traveling pattern around the crypts.
  • the shape, size, and the arrangement of the nuclei of the glandular cells are non-uniform, and the distances between the nuclei of the glandular cells and the basement membrane are also non-uniform. Further, no gland structure (crypts) is recognized, and the capillaries are poor in traveling regularity because no crypt is present.
  • the on-image analysis of the regularity of the nuclei and crypts allows tremendous improvement in the cancer pathological diagnosis accuracy and speed.
  • a rough center of each of the nuclei or the crypts are determined based on an image, the determined centers are connected to each other with line segments, and the lengths of the line segments are compared with each other for detection of disorder of the regularity.
  • the disorder of the regularity can also be detected by determining the areas of the regions surrounded by the line segments.
  • the detected disorders of the regularity may be grouped, or the distribution of the disorders may be graphed to help final diagnosis performed by a medical doctor by indicating a group that does not fall within a certain range as a group suspicious of cancer. These tasks can be done in a short period.
  • Optimizing the solving method in living body staining using curcumin increased the loadability of the stain into cells and permeability of the stain into tissue and allowed cells to be stained with no unevenness, and the cell structure was successfully visualized even with the confocal laser microscope.
  • the major and minor diameters are determined in a bitmap, the major and minor diameters are drawn in the form of line segments, and the intersections of the line segments can be used as the centers.
  • a crypt having a shape close to a line segment can be so handled in the bitmap that the center of the line segment is the center of the crypt.
  • the regular arrangement of the nuclei around a crypt can be used to reduce the image area handled as the nuclei.
  • the length of the line segment that connects centers adjacent to each other can be determined in the bitmap.
  • the figures described above show monochromatic images, in an actual image, the fluorescence emitted from a stain can be used, and the dark portion can be determined also by using the color information.
  • the glands shown in FIG. 10A can each be handled as a roughly circular image when the gland contains healthy cells, disorder in the regularity of the line segments that connect the centers of the glands with each other can be used to digitally determine disorder in the regularity.
  • the calculation of the disorder of the regularity is processing a tremendous amount of data, but a computer can be used to detect the disorder in the regularity in a short period.
  • FIG. 43 is a schematic view showing a front-end-side end portion of the endoscope 2 of the laser endoscope device 1 C in FIG. 45 .
  • FIG. 44 is a schematic view showing the entire endoscope 2 .
  • FIG. 45 is a block diagram showing the control configuration of the laser endoscope device 1 C.
  • the laser endoscope device 1 C includes the imaging unit 10 , which includes the endoscope 2 , the control unit 50 , and the image processing unit 70 , as shown in FIG. 45 .
  • the laser endoscope device 1 C further includes the laser oscillator 60 and the optical part 65 .
  • the laser endoscope device 1 C further includes the stain supplier 40 (see FIG. 12 ), which supplies a stain into a living body.
  • the stain described in the finding 5 or 6 described above is used.
  • Laser light L 1 emitted from the laser oscillator 60 C is reflected off a dichroic mirror 66 C, which is an optical part 65 C, further reflected off a mirror 19 C in the endoscope 2 , and applied to the living body.
  • Living cells irradiated with the laser light L 1 produce fluorescence, and the fluorescence is reflected off the mirror 19 C, passes through the dichroic mirror 66 C, and is detected with a photodetector 35 C.
  • the light detected with the photodetector 35 C is converted into an electric signal, and the image processing unit 70 forms an image according to the electric signal.
  • the photodetector 35 C is formed of a plurality of photodetectors, and a color separation optical filter is disposed in a position on the upstream side of the photodetector 35 C for color separation.
  • the actions of the components described above and the functions and roles of each part are roughly the same as those shown in FIG. 15 but are distinguished therefrom by adding “C” to the numbers of the components of the confocal laser device because a confocal laser device differs in principle from a multiphoton laser device.
  • the laser oscillator 60 C includes a plurality of types of wavelength changeable laser each capable of changing the wavelength stepwise over a wavelength range of 405 to 980 nm, and the wavelength is selected in accordance with the characteristics of a fluorescence reaction that occurs in a measurement target.
  • the lasers may each operate in pulses or continuous oscillation.
  • the operation frequency is at least several tens of kilohertz, and the duty ranges from 5% to 50%, and the frequency and duty ranges are so selected in consideration of the imaging sweep frequency that a sharp image is obtained.
  • the laser light L 1 in the present embodiment is confocal laser light
  • the laser oscillator 60 C uses, for example, a laser capable of emitting light having a wavelength of 405 nm and a power of 30 mW at the maximum.
  • the power of the laser light emitted from the laser in the imaging operation ranges from 5 to 10 mW, but not necessarily.
  • the laser oscillator 60 C can adjust the intensity of the laser light L 1 in accordance with the degree of staining and the degree of fluorescence.
  • a dichroic mirror 66 C which is the optical part 65 , reflects light having the same wavelength as that of the laser light L 1 and transmits light having the other wavelengths.
  • the laser light L 1 emitted from the laser oscillator 60 C is therefore reflected off the dichroic mirror 66 C toward the mirror 19 C.
  • the fluorescence produced in the living cells is reflected off the mirror 19 C, then passes through the dichroic mirror 66 C, and reaches the photodetector 35 C.
  • the optical part 65 C can instead be formed, for example, of a prism or a 4/ ⁇ plate.
  • the imaging unit 10 includes the endoscope 2 and the photodetector 35 C and images the cell morphology in the living body with the laser light L 1 applied to the interior of the living body.
  • the photodetector 35 C detects the fluorescence produced when the laser light L 1 is applied and converts the fluorescence into an electric signal according to the intensity of the fluorescence.
  • the photodetector 35 C can, for example, be a photomultiplier or a CCD semiconductor image sensor.
  • a pinhole or any other component is provided as a part that provides the confocal laser function.
  • the endoscope 2 includes the inner tube 12 and the outer tube 13 , which surrounds part of the outer surface of the inner tube 12 , as shown in FIG. 44 .
  • the inner tube 12 and part of the outer tube 13 are inserted into the living body.
  • the inner tube 12 has a length, for example, of 50 mm and an outer diameter ranging from, for example, 3 to 10 mm.
  • a linear-motion actuator is attached to the inner tube 12 , and the inner tube 12 is movable relative to the outer tube 13 in the axial direction X by about 25 mm.
  • An ultrasonic motor is further attached to the inner tube 12 , and the inner tube 12 is revolvable relative to the outer tube 13 over 360°.
  • the action of the inner tube 12 in the axial direction X or the revolutional direction R is controlled by the control unit 50 .
  • the imaging head 11 is provided at a front-end-side end portion of the inner tube 12 of the endoscope 2 .
  • the imaging head 11 is inserted along with the inner tube 12 into the living body in such a way that the imaging head 11 passes by the insertion tube 20 , as shown in FIG. 43 .
  • the imaging head 11 is so controlled as to move in the living body based on the actions in the axial direction X and the revolutional direction R of the inner tube 12 .
  • the imaging head 11 includes an objective lens 16 C, the focal point changer 18 , the spacer 17 , and the mirror 19 C.
  • the mirror 19 C is a part that redirects the laser light L 1 outputted from the laser oscillator 60 C toward the objective lens 16 C or redirects the fluorescence emitted from the living cells toward the photodetector 35 C, as described above.
  • the objective lens 16 C is so provided as to face the inner wall surface 113 of the living body.
  • the objective lens 16 has, for example, a diameter of 10 mm, a magnification of 10 times, a resolution of 5 ⁇ m, and an imaging field of view of 3 mm ⁇ 3 mm.
  • the objective lens 16 instead has a diameter of 12 mm, a magnification of 40 times, a resolution of 10 ⁇ m, and a field of view of 7.5 mm ⁇ 7.5 mm. The wider the imaging field of view, the better.
  • the objective lens 16 C may still instead be so configured that part of a lens having either of the diameters described above is cut or the diameter of the objective lens 16 C is reduced to a value ranging from 3 mm to 5 mm so that the objective lens is readily inserted into the living body with the same resolution maintained.
  • the objective lens 16 C may be so disposed as to incline with respect to the inner wall surface 113 . Performing the imaging with the objective lens 16 C inclining allows the cell morphology of the epithelium 120 and the gland 130 to be simultaneously imaged.
  • the focal point changer 18 is, for example, a piezoelectric actuator or an electromagnetic actuator and moves the objective lens 16 C in the optical axis direction to change the position of the focal point of the objective lens 16 C.
  • the focal point changer 1 R operates under the control of the control unit 50 and can adjust the focal point over a depth range from 0 to 75 ⁇ m below the inner wall surface (mucosa surface) 113 . Changing the position of the focal point allows imaging of the state of the living body at a predetermined depth below the inner wall surface 113 of the digestive tract 112 .
  • the spacer 17 has, for example, an annular shape and is provided around the space between the objective lens 16 C and the inner wall surface 113 .
  • the spacer 17 is a part not only for preventing the objective lens 16 C from coming into contact with the inner wall of the living body but for maintaining a fixed distance between the objective lens 16 C and the inner wall surface 113 .
  • the distance between the objective lens 16 C and the inner wall surface (mucosa surface) 113 is set at an appropriate value, for example, a value greater than or equal to 1 mm but smaller than or equal to 10 mm by exchanging the spacer 17 to another before the imaging starts or adding a distance changeable mechanism using an actuator or any other device.
  • the control unit 50 controls the movement of the imaging head 11 (inner tube 12 ) with the spacer 17 being in contact with the inner wall surface 113 and maintains the fixed distance from the objective lens 16 C to the inner wall surface 113 .
  • the control unit 50 is formed, for example, of a CPU, a ROM, and a RAM.
  • the control unit 50 controls the action of the imaging head 11 via the inner tube 12 .
  • the control unit 50 controls the movement of the imaging head 11 not only in the circumferential direction along the inner circumference of the inner wall of the digestive tract 112 but in the tract longitudinal direction of the digestive tract 112 (along axis of digestive tract).
  • the control unit 50 further changes the position of the objective lens 16 C in the optical axis direction by controlling the action of the focal point changer 18 to control the position where the focus is achieved in the living body.
  • the control unit 50 can further adjust the laser output by controlling the laser oscillator 60 C.
  • the image processing unit 70 stores the converted electric signal (fluorescence intensity) from the photodetector 35 C and the coordinate position of the imaging unit 10 sent from the control unit 50 with the electric signal and the coordinate position related to each other and processes the data on the fluorescence intensity and the coordinate position to generate a digital image.
  • the generated digital image is, for example, displayed on a monitor, printed out, or recorded on a storage device.
  • the coordinate position of the imaging unit 10 may be expressed, for example, in the form of the distance from a reference location on the patient (throat or anus, for example) and the angle of revolution of the imaging head 11 .
  • the confocal laser endoscope device 1 C includes the imaging unit 10 , which includes the imaging head 11 , which is inserted into a living body, and images the living body by applying the laser light to the living body via the imaging head 11 , and the control unit 50 , which controls the operation of the imaging head 11 .
  • the imaging head includes 10 , the objective lens 16 C, and the focal point changer 18 , which is capable of changing the focal point position of the objective lens 10 C in the depth direction of the living body, and the control unit 50 causes the focal point changer 18 to operate in such a way that the focal point position has a predetermined depth deeper than or equal to 10 ⁇ m but shallower than or equal to 100 ⁇ m (desirably deeper than or equal to 10 ⁇ m but shallower than or equal to 70 ⁇ m) below the surface of the mucosa in the living body.
  • the imaging unit 10 applies the laser light to a cell group located in the living body and exposed to and stained with a stain that selectively stains the cell group in a chromatic color for at least 2 minutes, preferably 5 minutes or longer, and the imaging unit 10 images the stained cell group at a predetermined depth.
  • a method for controlling the focal point with a fixed positional relationship between the objective lens 16 C and the mucosa surface maintained will be described.
  • Reference character 171 in FIG. 45 denotes a second laser oscillator, which emits continuous parallelized light as reference light, for example, having a wavelength of 680 nm and a power of about 5 mW.
  • a beam splitter, a half-silvered mirror, or any other component causes the light from the second laser oscillator 171 to travel along the optical path of the light from the laser oscillator 60 C.
  • the optical path L 2 of the light from the second laser oscillator 171 is drawn with a broken line slightly shifted from the optical path of the light from the laser oscillator 60 C for ease of understanding.
  • the reference light L 2 described above travels roughly the same path as that of the laser light L 1 for examination but travels along a different optical path beyond a beam splitter 173 and enters a focal point control optical unit 174 .
  • the focal point control optical unit 174 has an optical part configuration capable of detecting the amount of change in the focal point position.
  • Reference character 175 denotes a photodetector that is typically divided into 2 or 4 blocks. The light detected with the thus configured photodetector is converted, for example, with a differential amplifier into an electric signal proportional to a change in the positional relationship between the objective lens 16 C and the mucosa surface.
  • the control of the position of the objective lens described above is used, for example, in an optical disk device and is fully applicable to an endoscope device.
  • the laser light L 1 for imaging and the reference light L 2 preferably have different wavelengths so that the two light beams are readily separated from each other. Separating the wavelengths of the two light beams by at least 100 nm achieves optical characteristics of the imaging system and the focal point control system that allow the two light beams to be satisfactorily separate from each other.
  • applying bias voltage to the control system allows fine adjustment of the focal point position. Changing the bias voltage stepwise allows automatic control of the position where the laser light L 1 is focused in the depth direction.
  • the transmittance or reflectance of the optical parts 11 C, 35 C; 65 C, 66 C, 172 , 173 , and 174 greatly depends on the wavelength of the laser light beams L 1 and L 2 . Modularizing the optical parts in accordance with the wavelengths of the laser light beams and preparing a plurality of types of modules can therefore readily handle a situation in which the wavelengths of the laser light beams are changed in accordance with the stain to be used or a body site to be examined.
  • a sufficient staining period allows acquisition of images at the depths deeper than or equal to 10 ⁇ m but shallower than or equal to 70 ⁇ m below the inner wall surface (mucosa surface) 113 of the living body.
  • a lesion can be readily found, and selecting the wavelengths and the intensities of the laser light beams allows acquisition of images without load of the laser light on the patient.
  • the staining is performed with a stain, such as curcumin.
  • a stain such as curcumin.
  • visualization of a cell morphology over a depth range from 10 ⁇ m to 1000 ⁇ m below the mucosa surface and detection of cancer with no missing part based on a full-circumference panoramic image of the digestive tract are also achieved from an unstained digestive tract mucosa.
  • the cell morphology may include the cytoplasm of individual cells, the shapes of nuclei, the pattern in accordance with which crypts of glands are arranged, and a capillary traveling pattern.
  • the detection described above is achievable by the fact that a certain amount of fluorescence is emitted from flavin adenine dinucleotide (FAD), nicotinamide adenine dinucleotide (NAD), or any other chemical substance in a cell excited with laser light.
  • FAD flavin adenine dinucleotide
  • NAD nicotinamide adenine dinucleotide
  • a problem with the unstained digestive tract mucosa is, however, requirement of radiation of a large amount of excitation laser light, which is about 20 times greater than or equal to the amount of light necessary for imaging of a living body stained with curcumin or any other stain, and the large amount of excitation laser light could greatly damage the living cells. The damage can, however, be reduced by increasing the sensitivity of the detection system.
  • FIG. 46 shows observation under the confocal laser microscope.
  • FIG. 46 shows images of inner planes of an unstained laboratory mouse colorectal mucosa captured under the confocal laser microscope.
  • An image of the surface at an arbitrary location (a) and an image of the interior 10 ⁇ m below the surface at the location (b) are shown in the upper and lower sections in the left column. Further, an image of the surface at a location shifted by about 100 ⁇ m from the location described above (c) and an image of the interior 10 ⁇ m below the surface at the location (d) are shown in the upper and lower sections.
  • An image (d) which is the combination of the images (b) and (d) of the interior 10 ⁇ m below the surface aligned with each other with the aid of the crypt arrangement pattern as an alignment mark, is further shown.
  • the scale bars each represent 100 ⁇ m.
  • FIG. 47 shows observation under the multiphoton laser microscope.
  • FIG. 47 shows images of inner planes of the unstained laboratory mouse colorectal mucosa captured under the multiphoton laser microscope.
  • An image of the surface at an arbitrary location (a) and an image of the interior 25 ⁇ m below the surface at the location (b) are shown in the left column. Further, an image of the surface at a location shifted by about 400 ⁇ m from the location described above (c) and an image of the interior 25 ⁇ m below the surface at the location (d) are shown in the right column.
  • An image (e) which is the combination of the images (b) and (d) of the interior 25 ⁇ m below the surface aligned with each other with the aid of the crypt arrangement pattern as an alignment mark, is further shown.
  • the operation described above can be continuously performed to generate a panoramic image.
  • the arrow e 1 in the image (b) and the star mark e 2 in the image (d) correspond to the arrow e 1 and the star mark e 2 in the merged image (e), respectively.
  • the scale bars each represent 100 ⁇ m.
  • an image (f) which is the image (e) but captured at a zoom magnification of 2
  • the epithelial cells and the cytoplasm of the glandular cells appear bright.
  • the nuclei 135 indicated by the arrows appear dark.
  • the scale bar in the image (f) represents 100 ⁇ m.
  • the cancer detection method described in the embodiments in which cells are stained with curcumin or any other stain can be used as long as nuclei or crypts can be grasped in an image.
  • the detection may be based on comparison in terms of shape and brightness of the cells or may be comparison in terms of line segments created by using the nuclei or crypts in the image or the area surrounded by the line segments.
  • two types of stain are sequentially used for the double staining, but not necessarily.
  • a plurality of dyes may be mixed with one another in advance to produce a mixed stain containing the plurality of dyes, and the mixed stain may be used to perform simultaneous staining.
  • a living body is stained in double staining using stains of two colors before the imaging, but not necessarily.
  • a living body may be stained in a multi-staining using stains of at least two colors before the imaging.
  • a stain A containing a dye A 1 is used to stain the cell group, and the stain A is then recovered.
  • a stain B containing a dye B 1 is then used to stain the cell group, and the stain B is then recovered.
  • a stain C 1 containing a dye C 1 is then used to stain the cell group, and the stain C 1 is then recovered.
  • the cell group can thus be stained in multi-staining. In this case, each of the stains reliably comes into contact with the cell group, whereby the cells are stained with improved reliability.
  • Another method for performing multi-staining may include producing a mixture liquid ABC, which is a mixture of a plurality of dyes A 1 , B 1 , and C 1 mixed with one another in advance and staining cells with the mixture liquid ABC.
  • the staining can be performed in a short period.
  • the simplified staining is staining using a prescribed oral cleaning liquid containing a mucosa cleaning agent, a stain, or any other substance.
  • multi-photon laser light is used as the laser light of the laser endoscope device 1 , but not necessarily, and the confocal laser light 1 C may be used.
  • the spacer 17 in the imaging head 11 in the embodiments of the present invention is not limited to an annular spacer.
  • the spacer 17 may instead be a plurality of members so provided as to surround the space between the objective lens 16 and the inner wall surface 113 or may be a pair of members that sandwich the space between the objective lens 16 and the inner wall surface 113 .
  • control unit 50 may be used to control the focal point changer 18 to cause it to control the focal point, for example, by using the reference laser light described above for imaging with the focus maintained. Instead, the control unit 50 may use a wobble signal that drives the objective lens in a fixed cycle in accordance with a sinusoidal wave or a sawtooth wave with the wobble signal related to obtained images for imaging with the imaging position aligned with a desired position.
  • the imaging is performed while identifying the depth position below the inner wall surface (mucosa surface) 113 of the digestive tract 112 , the depth information and the image information are stored with the two types of information related to each other, and the images captured at the same depth position are merged with each other to generate a merged image, but not necessarily.
  • a plurality of images different from one another in terms of depth position and imaging region P may be acquired without recognition of the depth position, and similar images or related images may be extracted from the plurality of images and merged with one another to generate a merged image.
  • cells in a living body are stained with a stain and then imaged by using the laser endoscope device 1 , but not necessarily, and using the laser endoscope device based on multiphoton laser light allows imaging of the cell morphology in the living body with no staining of the cells with a stain.
  • a compound generally present in the cells (NAD: nicotinamide adenine dinucleotide, for example) or any other compound produces light having a wavelength half the wavelength of the multiphoton laser light in the cells, and the produced light impinges on the NAD or any other compound, which then produces autologous fluorescence, whereby an image of the cell morphology in the living body can be acquired with no exogeneous staining.
  • NAD nicotinamide adenine dinucleotide, for example
  • the tract longitudinal direction (axial direction) of the digestive tract is not limited to a linear direction, and the present invention is applicable to a case where the tract longitudinal direction is a curved direction.
  • the laser endoscope devices 1 to 1 C can also visualize luminal organs (such as bronchus, urinary bladder, and urinary duct) other than digestive tracts, and can further visualize the kidney, the liver, the brain, the retina, and other cell structures although there is a restriction on the visualized range of 1 mm or smaller in depth below the surface.
  • luminal organs such as bronchus, urinary bladder, and urinary duct
  • the terms of laser microscope and laser endoscope are used.
  • the laser microscope and laser endoscope are handled as an endoscope having a microscope function
  • the laser microscope and laser endoscope are handled as an endoscope having a microscope function.
  • the laser endoscope devices according to the embodiments of the present invention are used to image or treat a lesion having developed in the digestive tract, the respiratory system, the renal/urinary system, the utero-ovarian reproductive system, the cerebrospinal nervous system, and other body sites over a wide range with no missing part.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Optics & Photonics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Astronomy & Astrophysics (AREA)
  • General Physics & Mathematics (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Oncology (AREA)
  • Epidemiology (AREA)
  • Gastroenterology & Hepatology (AREA)
  • Endoscopes (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
  • Laser Surgery Devices (AREA)
US15/999,626 2016-02-23 2017-02-23 Laser endoscope device Active 2038-07-11 US11140318B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2016-032520 2016-02-23
JP2016032520 2016-02-23
JPJP2016-032520 2016-02-23
PCT/JP2017/006962 WO2017146184A1 (fr) 2016-02-23 2017-02-23 Dispositif d'endoscope laser

Publications (2)

Publication Number Publication Date
US20210227133A1 US20210227133A1 (en) 2021-07-22
US11140318B2 true US11140318B2 (en) 2021-10-05

Family

ID=59685570

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/999,626 Active 2038-07-11 US11140318B2 (en) 2016-02-23 2017-02-23 Laser endoscope device

Country Status (5)

Country Link
US (1) US11140318B2 (fr)
EP (1) EP3420885B1 (fr)
JP (1) JP6738100B2 (fr)
CN (1) CN108697315B (fr)
WO (1) WO2017146184A1 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112019004863T5 (de) * 2018-09-27 2021-06-10 Hoya Corporation Elektronisches endoskopsystem und datenverarbeitungsvorrichtung
CN109744983B (zh) * 2019-01-31 2024-05-10 北京超维景生物科技有限公司 变焦式腔体内窥镜探测装置及激光扫描腔体内窥镜
CN113891673A (zh) 2019-05-27 2022-01-04 国立大学法人三重大学 病变的检测方法
KR20220007667A (ko) * 2019-07-10 2022-01-18 사이버넷 시스템 가부시키가이샤 화상 해석 장치 및 화상 해석 방법
WO2021038729A1 (fr) * 2019-08-27 2021-03-04 株式会社島津製作所 Dispositif et procédé d'aide au traitement
CN110710951B (zh) * 2019-11-01 2020-11-10 东南大学苏州医疗器械研究院 内窥镜插管辅助插入系统及方法、内窥镜系统
US11943539B2 (en) * 2019-12-30 2024-03-26 Matterport, Inc. Systems and methods for capturing and generating panoramic three-dimensional models and images
KR102516406B1 (ko) * 2022-10-14 2023-04-03 (주) 브이픽스메디칼 내시현미경에 의해 획득되는 이미지를 스티칭하기 위해 위치 정보를 캘리브레이션하는 방법 및 장치

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020135694A1 (en) * 1992-09-11 2002-09-26 Williams Ronald R. Dental video camera
US20030107652A1 (en) * 1992-09-11 2003-06-12 Williams Ronald R. Dental video camera
US20030142206A1 (en) * 2002-01-28 2003-07-31 Williams Ronald R. Cable with built in-frame grabber for a dental video camera
JP2006187386A (ja) 2005-01-04 2006-07-20 Olympus Corp 内視鏡装置、動体検出方法、及びそのプログラム
JP2009545737A (ja) 2006-08-04 2009-12-24 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 蛍光ベースのＤＮＡイメージサイメトリーを用いたｉｎｖｉｖｏでの癌の検出及び／又は診断方法
WO2014157645A1 (fr) 2013-03-29 2014-10-02 ソニー株式会社 Dispositif d'observation à balayage laser et procédé de balayage laser
WO2014157703A1 (fr) 2013-03-29 2014-10-02 国立大学法人三重大学 Tache vitale
US20180020932A1 (en) * 2015-03-20 2018-01-25 East Carolina University Multi-spectral physiologic visualization (mspv) using laser imaging methods and systems for blood flow and perfusion imaging and quantification in an endoscopic design
US20180368656A1 (en) * 2017-05-24 2018-12-27 Camplex, Inc. Surgical visualization systems and displays
US20190285638A1 (en) * 2016-05-18 2019-09-19 Mie University Cancer test device, cancer test method, and staining agent for use in cancer test

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0130862D0 (en) * 2001-12-22 2002-02-06 P W Allen & Company Ltd Method of examining potential cellular abnormalities
JP2010042182A (ja) * 2008-08-18 2010-02-25 Fujifilm Corp レーザ治療装置
US20120101372A1 (en) * 2010-10-25 2012-04-26 Fujifilm Corporation Diagnosis support apparatus, diagnosis support method, lesioned part detection apparatus, and lesioned part detection method
US9205234B2 (en) * 2012-03-27 2015-12-08 Terry D. Hardin Device for a biological treatment
US9107578B2 (en) * 2013-03-31 2015-08-18 Gyrus Acmi, Inc. Panoramic organ imaging
CN103393392B (zh) * 2013-06-19 2015-08-26 西安电子科技大学 深度与强度可调式的探头激光共聚焦显微内窥镜系统
US10537226B2 (en) * 2013-12-23 2020-01-21 California Institute Of Technology Rotational scanning endoscope
US10080484B2 (en) * 2014-01-31 2018-09-25 University Of Washington Multispectral wide-field endoscopic imaging of fluorescence
CN105013073B (zh) * 2015-08-10 2018-09-25 重庆天如生物科技有限公司 黏膜染色系统

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020135694A1 (en) * 1992-09-11 2002-09-26 Williams Ronald R. Dental video camera
US20030107652A1 (en) * 1992-09-11 2003-06-12 Williams Ronald R. Dental video camera
US20030142206A1 (en) * 2002-01-28 2003-07-31 Williams Ronald R. Cable with built in-frame grabber for a dental video camera
JP2006187386A (ja) 2005-01-04 2006-07-20 Olympus Corp 内視鏡装置、動体検出方法、及びそのプログラム
JP2009545737A (ja) 2006-08-04 2009-12-24 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 蛍光ベースのＤＮＡイメージサイメトリーを用いたｉｎｖｉｖｏでの癌の検出及び／又は診断方法
US20090326359A1 (en) 2006-08-04 2009-12-31 Koninklijke Philips Electronics N.V. Method of in vivo detection and/or diagnosis of cancer using fluorescence based dna image cytometry
WO2014157645A1 (fr) 2013-03-29 2014-10-02 ソニー株式会社 Dispositif d'observation à balayage laser et procédé de balayage laser
WO2014157703A1 (fr) 2013-03-29 2014-10-02 国立大学法人三重大学 Tache vitale
US20160041100A1 (en) * 2013-03-29 2016-02-11 Mie University Vital stain
US20160299170A1 (en) * 2013-03-29 2016-10-13 Sony Corporation Laser scanning observation device and laser scanning method
US20180020932A1 (en) * 2015-03-20 2018-01-25 East Carolina University Multi-spectral physiologic visualization (mspv) using laser imaging methods and systems for blood flow and perfusion imaging and quantification in an endoscopic design
US20190285638A1 (en) * 2016-05-18 2019-09-19 Mie University Cancer test device, cancer test method, and staining agent for use in cancer test
US20180368656A1 (en) * 2017-05-24 2018-12-27 Camplex, Inc. Surgical visualization systems and displays

Also Published As

Publication number Publication date
JPWO2017146184A1 (ja) 2018-12-13
EP3420885A1 (fr) 2019-01-02
WO2017146184A1 (fr) 2017-08-31
US20210227133A1 (en) 2021-07-22
EP3420885B1 (fr) 2022-12-21
EP3420885A4 (fr) 2020-02-19
CN108697315A (zh) 2018-10-23
CN108697315B (zh) 2021-09-03
JP6738100B2 (ja) 2020-08-12

Similar Documents

Publication Publication Date Title
US11140318B2 (en) Laser endoscope device
US11852632B2 (en) Cancer test device, cancer test method, and staining agent for use in cancer test
Wang et al. Functional imaging of colonic mucosa with a fibered confocal microscope for real-time in vivo pathology
Oh et al. Optical fibers for high-resolution in vivo microendoscopic fluorescence imaging
US20180177399A1 (en) Method and device for multi-spectral photonic imaging
EP2575597B1 (fr) Appareil pour fournir une imagerie optique de structures et de compositions
US20110137178A1 (en) Devices and methods for imaging particular cells including eosinophils
US20090326359A1 (en) Method of in vivo detection and/or diagnosis of cancer using fluorescence based dna image cytometry
JP2008521453A (ja) エンドスコープ
CN112816449B (zh) 一种双波长双尺度纳米药物活体成像系统及时序控制方法
US20220108461A1 (en) Multi-Modal System for Visualization and Analysis of Surgical Specimens
JP2010179042A (ja) 光構造観察装置及びその構造情報処理方法、光構造観察装置を備えた内視鏡システム
CN107361725B (zh) 快速组织分子成像装置
KR101978838B1 (ko) 다중 파장 내시경 시스템 및 이를 이용한 영상 처리 방법
Zheng et al. Multi-laser scanning confocal fluorescent endoscopy scheme for subcellular imaging
EP2228003A1 (fr) Dispositif endoscopique multifonctions et procédés employant ledit dispositif
Huang et al. Multimodal Optical Imaging by Microendoscope
Just et al. OCT in the field of laryngology: further perspectives
Fang et al. A pilot study of using multiphoton microscopy to diagnose schwannoma
JP2014057898A (ja) テザー付きカプセル内視鏡の食道内配置の監視
CN118044783A (zh) 测量信号和确定3d表示的方法及图像捕获和处理装置
Namati et al. Endoscopic techniques for optical imaging

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

AS Assignment

Owner name: MIE UNIVERSITY, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MIZOGUCHI, AKIRA;TANAKA, KOJI;TOIYAMA, YUJI;AND OTHERS;SIGNING DATES FROM 20180919 TO 20180927;REEL/FRAME:047327/0453

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction