US10722155B2 - Method and device for generating image showing concentration distribution of biological substances in biological tissue - Google Patents

Method and device for generating image showing concentration distribution of biological substances in biological tissue Download PDF

Info

Publication number
US10722155B2
US10722155B2 US14/894,119 US201414894119A US10722155B2 US 10722155 B2 US10722155 B2 US 10722155B2 US 201414894119 A US201414894119 A US 201414894119A US 10722155 B2 US10722155 B2 US 10722155B2
Authority
US
United States
Prior art keywords
image
light
wavelength range
filter
optical filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/894,119
Other versions
US20160120449A1 (en
Inventor
Toru Chiba
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hoya Corp
Original Assignee
Hoya Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hoya Corp filed Critical Hoya Corp
Assigned to HOYA CORPORATION reassignment HOYA CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHIBA, TORU
Publication of US20160120449A1 publication Critical patent/US20160120449A1/en
Assigned to HOYA CORPORATION reassignment HOYA CORPORATION CHANGE OF ADDRESS Assignors: HOYA CORPORATION
Application granted granted Critical
Publication of US10722155B2 publication Critical patent/US10722155B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A61B5/14551Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/044Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for absorption imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0638Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0646Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14546Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring analytes not otherwise provided for, e.g. ions, cytochromes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A61B5/1459Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters invasive, e.g. introduced into the body by a catheter
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7225Details of analog processing, e.g. isolation amplifier, gain or sensitivity adjustment, filtering, baseline or drift compensation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10068Endoscopic image

Definitions

  • the present invention relates to a method and a device for generating an image showing concentration distribution of biological substances in a biological tissue.
  • spectral endoscope device having a function of photographing spectroscopic image.
  • information concerning spectral property e.g., reflection spectrum
  • the reflection spectrum of a biological tissue reflects information concerning types or densities of components contained in the vicinity of a surface layer of a biological tissue being a measurement target.
  • an absorbance calculated from the reflection spectrum of a biological tissue equals to an absorbance obtained by linearly superimposing absorbances of a plurality of substances that compose the biological tissue.
  • composition and amount of substances in a lesion biological tissue differ from those in a healthy biological tissue. It is reported in many of the earlier studies that abnormalities of lesions represented by such as cancer are particularly deeply related to a condition of blood, especially to an overall amount of blood or oxygen saturation. Qualifying and quantifying two focused biological tissues by using spectroscopic feature values within the visible range that the two focused biological tissues have is a frequently used method in the field of spectrographic analysis. Therefore, it is possible to estimate existence of some kind of lesions in a biological tissue by comparing a spectral characteristic of blood in a biological tissue that includes lesions with a spectral characteristic of blood in a biological tissue that does not include lesions.
  • a spectral image is composed of a series of image information taken using light of different wavelengths, and more detailed spectral information of a biological tissue can be obtained from the spectral image having higher wavelength resolutions (i.e., larger number of wavelengths used to acquire image information).
  • Patent Document 1 discloses an exemplary configuration of a spectral endoscope device which acquires spectral images in a wavelength range of 400-800 nm at 5 nm intervals.
  • Patent Document 1 Japanese Patent Provisional Publication No. 2012-245223A
  • the present invention is made in view of the above situation, and the object of the present invention is to provide a method and a device capable of acquiring image information showing distributions of biological substances, such as oxygen saturation distribution, in a short time.
  • a method for generating a distribution image showing a molar concentration ratio between a first biological substance and a second biological substance included in a biological tissue of which an absorption spectrum within a predetermined wavelength range has a first isosbestic point, a second isosbestic point, a third isosbestic point and a fourth isosbestic point in ascending order of wavelength comprising: a step of acquiring first imaging data G 1 by taking an image of the biological tissue using light extracted from white light using a first optical filter configured to collectively selectively extract light in a first wavelength range demarcated by the first isosbestic point and the second isosbestic point, light in a second wavelength range demarcated by the second isosbestic point and the third isosbestic point, and light in a third wavelength range demarcated by the third isosbestic point and the fourth isosbestic point; a step of acquiring second imaging data G 2 by taking an image of the biological
  • the step of generating the distribution image on the basis of the first imaging data G 1 and the second imaging data G 2 may further comprise: a step of acquiring an absorbance A 1 of the biological tissue in a transmission wavelength range of the first optical filter on the basis of the first imaging data G 1 ; a step of acquiring an absorbance A 2 of the biological tissue in a transmission wavelength range of the second optical filter on the basis of the second imaging data G 2 ; and a step of generating the distribution image on the basis of the absorbance A 1 and the absorbance A 2 .
  • a 1 ⁇ G 1 (EXPRESSION 2)
  • the step of acquiring the absorbance A 2 may include a step for calculating the absorbance A 2 using Expression 3 or Expression 4.
  • a 2 ⁇ log G 2 (EXPRESSION 3)
  • a 2 ⁇ G 2 (EXPRESSION 4)
  • the constant k may be 1.
  • the above method may further comprise a step of acquiring third imaging data R 3 by taking an image of the biological tissue using light extracted from the white light using a third optical filter configured to selectively extract light in a fourth wavelength range in which an absorbance of the biological tissue is sufficiently low compared to an absorbance in the predetermined wavelength range
  • a 1 ⁇ SR (EXPRESSION 7)
  • the step of acquiring the absorbance A 2 may include: a step of calculating a second standardized reflectivity SR 2 by dividing the second imaging data G 2 by the third imaging data R 3 ; and a step of calculating the absorbance A 2 using Expression 8 or Expression 9.
  • a 2 ⁇ log SR 2 (EXPRESSION
  • the above method may further comprise: a step of acquiring a first baseline image data BL 1 by taking an image of a colorless color reference board using light extracted from the white light using the first optical filter; and a step of acquiring a second baseline image data BL 2 by taking an image of the reference board using light extracted from the white light using the second optical filter, and the step of calculating the first standardized reflectivity SR 1 may include a step of dividing the first imaging data G 1 by the first baseline image data BL 1 , and the step of calculating the second standardized reflectivity SR 2 may include a step of dividing the second imaging data G 2 by the second baseline image data BL 2 .
  • the fourth wavelength range may be 650 nm band
  • the third imaging data R 3 may be imaging data taken by a light-receiving element, to which an R filter is provided, included in an image pick-up device provided with an RGB color filter.
  • the constant k may be determined such that the index X, acquired on the basis of the first imaging data G 1 and the second imaging data G 2 acquired by taking images of a biological tissue of which the molar concentration ratio is known, becomes closest to a theoretical index X.
  • the measured index X for each of a plurality of biological tissues, each having a known molar concentration ratio that is different from each other may be acquired and the constant k may be determined such that a calibration curve showing a relationship between the known molar concentration ratio and the measured index X becomes closest to a reference line showing a relationship between the known molar concentration ratio and the theoretical index X.
  • the light extracted from the white light using the first optical filter in the step of acquiring the first imaging data G 1 may be dimmed such that an exposure when acquiring the first imaging data G 1 and an exposure when acquiring the second imaging data G 2 become equivalent.
  • the two types of biological substances may be oxyhemoglobin and deoxyhemoglobin, and the molar concentration ratio of the first biological substance and the second biological substance included in the biological tissue may be oxygen saturation.
  • the predetermined wavelength range may be a Q band of hemoglobin
  • the first imaging data G 1 and the second imaging data G 2 may be imaging data taken by a light-receiving element, to which a G filter is provided, included in an image pick-up device provided with an RGB color filter.
  • a device for generating a distribution image showing a molar concentration ratio between a first biological substance and a second biological substance included in a biological tissue of which an absorption spectrum within a predetermined wavelength range has a first isosbestic point, a second isosbestic point, a third isosbestic point and a fourth isosbestic point in ascending order of wavelength comprising: a light source which emits white light; a first optical filter configured to collectively selectively extract light in a first wavelength range demarcated by the first isosbestic point and the second isosbestic point, light in a second wavelength range demarcated by the second isosbestic point and the third isosbestic point, and light in a third wavelength range demarcated by the third isosbestic point and the fourth isosbestic point from the white light; a second optical filter configured to selectively extract light in the second wavelength range from the white light; a switching means configured to switch
  • the above device may be an endoscope device comprising an endoscope provided at a tip portion.
  • image information showing distributions of biological substances such as oxygen saturation distribution
  • image information showing distributions of biological substances can be acquired in a short time.
  • FIG. 1 shows an absorption spectrum of hemoglobin at Q band.
  • FIG. 2 is a block chart illustrating an endoscope device according to the embodiment of the present invention.
  • FIG. 3 shows transmission spectra of color filters which are accommodated in an image pick-up device.
  • FIG. 4 is an external view of a rotating filter.
  • FIG. 5 is a flowchart explaining an image generating process according to the embodiment of the present invention.
  • FIG. 6 shows exemplary calibration curves used to determine a correction coefficient k.
  • FIG. 7 shows exemplary endoscopic images generated using an endoscope device according to the embodiment of the present invention.
  • (a) is a normal observation image
  • (b) is an oxygen saturation distribution image.
  • An endoscope device is a device that quantitatively analyzes biological information (e.g., oxygen saturation) of an object on the basis of a plurality of images taken using light of different wavelengths and displays the analysis result as images.
  • biological information e.g., oxygen saturation
  • a characteristic that a spectral property of blood i.e., spectral property of hemoglobin continuously changes in accordance with the oxygen saturation is used.
  • FIG. 1 shows an absorption spectrum of hemoglobin at wavelengths of around 550 nm.
  • Hemoglobin has a strong absorption band, derived from porphyrin, called Q band at wavelengths of around 550 nm.
  • the absorption spectrum of hemoglobin changes in accordance with the oxygen saturation (ratio of oxyhemoglobin to the overall hemoglobin).
  • a waveform shown in a solid line in FIG. 1 is an absorption spectrum of hemoglobin when the oxygen saturation is 100% (i.e., an absorption spectrum of oxyhemoglobin HbO), and a waveform shown in a long-dashed line is an absorption spectrum of hemoglobin when the oxygen saturation is 0% (i.e., an absorption spectrum of deoxyhemoglobin Hb).
  • Waveforms shown in short-dashed lines are absorption spectra of hemoglobin (a mixture of oxyhemoglobin and deoxyhemoglobin) at oxygen saturations of between 0% and 100% (10, 20, 30, .
  • oxyhemoglobin and deoxyhemoglobin show peak wavelengths that differ from each other. Specifically, oxyhemoglobin has an absorption peak P 1 at a wavelength of around 542 nm, and an absorption peak P 3 at a wavelength of around 576 nm. On the other hand, deoxyhemoglobin has an absorption peak P 2 at a wavelength of around 556 nm. Since FIG.
  • wavelength range R 1 a wavelength range between isosbestic points E 1 and E 2 is referred to as wavelength range R 1
  • a wavelength range between isosbestic points E 2 and E 3 is referred to as wavelength range R 2
  • a wavelength range between isosbestic points E 3 and E 4 is referred to as wavelength range R 3
  • a wavelength range between isosbestic points E 1 and E 4 is referred to as wavelength range R 0 (i.e., a combination of wavelengths ranges of R 1 , R 2 and R 3 ).
  • absorbances A R1 and A R3 of hemoglobin at wavelength ranges R 1 and R 3 linearly increases with oxyhemoglobin concentration (oxygen saturation)
  • absorbance A R2 of hemoglobin at wavelength range R 2 linearly increases with deoxyhemoglobin concentration (1—“oxygen saturation”). Therefore, an index X, defined by the following Expression 10, linearly increases with oxyhemoglobin concentration (oxygen saturation).
  • X ( A R1 +A R3 ) ⁇ A R2 (EXPRESSION 10)
  • the oxygen saturation can be calculated from the index X by experimentally acquiring a quantitative relationship between the oxygen saturation and the index X.
  • FIG. 2 is a block chart illustrating an endoscope device 1 according to the embodiment of the present invention.
  • the endoscope device 1 of the present embodiment comprises an electronic endoscope 100 , a processor 200 and a monitor 300 .
  • the electronic endoscope 100 and the monitor 300 are detachably connected to the processor 200 .
  • the processor 200 includes therein a light source unit 400 and an image processor unit 500 .
  • the electronic endoscope 100 has an insertion tube 110 to be inserted into a body cavity.
  • the electronic endoscope 100 is provided with a light guide 131 which extends over the full length of the electronic endoscope 100 .
  • One end portion of the light guide 131 (a tip portion 131 a ) is arranged close to a tip portion of the insertion tube 110 (an insertion tube tip portion 111 ), and the other end portion of the light guide 131 (a proximal end portion 131 b ) is connected to the processor 200 .
  • the processor 200 includes therein the light source unit 400 comprising a light source lamp 430 , e.g., a Xenon lamp which generates a large amount of white light WL.
  • the illumination light IL generated by the light source unit 400 is incident on the end portion 131 b of the light guide 131 .
  • the light which is incident on the proximal end portion 131 b of the light guide 131 is guided to the tip portion 131 a through the light guide 131 , and is emitted from the tip portion 131 a .
  • a light distribution lens 132 is arranged to face the tip portion 131 a of the light guide 131 .
  • the illumination light IL emitted from the tip portion 131 a of the light guide 131 passes through the light distribution lens 132 , and illuminates the biological tissue T near the insertion tube tip portion 111 .
  • An objective optical system 121 and an image pick-up device 141 is provided at the insertion tube tip portion 111 .
  • a portion of light which is reflected or scattered by the surface of the biological tissue T (return light) is incident on the objective optical system 121 and condensed, and forms an image on a light-receiving surface of the image pick-up device 141 .
  • the image pick-up device 141 of the present embodiment is a color image photographing CCD (Charge Coupled Device) image sensor comprising a color filter 141 a on a light-receiving surface thereof, but other types of image pick-up device such as CMOS (Complementary Metal Oxide Semiconductor) image sensor may also be used.
  • CCD Charge Coupled Device
  • the color filter 141 a is a so-called on-chip filter, in which an R filter that transmits red light, a G filter that transmits green light, and a B filter that transmits blue light are arranged, which is directly formed on each light-receiving element of the image pick-up device 141 .
  • Each of the R filter, G filter and B filter has a spectral property shown in FIG. 3 . That is, the R filter of the present embodiment is a filter that transmits light having wavelengths of longer than about 570 nm, the G filter is a filter that transmits light having wavelengths of between about 470-620 nm, and the B filter is a filter that transmits light having wavelengths of shorter than about 530 nm.
  • the image pick-up device 141 is controlled to drive in synchronization with a signal processing circuit 550 which will be described later, and periodically (e.g., at 1/30 seconds interval) outputs imaging signals corresponding to an image formed on the light-receiving surface.
  • the imaging signals which are outputted from the image pick-up device 141 are sent to the image processor unit 500 of the processor 200 via a cable 142 .
  • the image processor unit 500 comprises an A/D conversion circuit 510 , a temporary memory 520 , a controller 530 , a video memory 540 and a signal processing circuit 550 .
  • the A/D conversion circuit 510 executes A/D conversion to the image signals transmitted from the image pick-up device 141 of the electronic endoscope 100 via the cable 142 to output digital image data.
  • the digital image data outputted from the A/D conversion circuit 510 is transmitted to and stored in the temporary memory 520 .
  • the digital image data includes R digital image data (R imaging signal) which is imaged by the light-receiving element to which the R filter is provided, G digital image data (G imaging signal) which is taken by the light-receiving element to which the G filter is provided, and B digital image data (B imaging signal) which is taken by the light-receiving element to which the B filter is provided.
  • the controller 530 processes a piece of or a plurality of pieces of image data stored in the temporary memory 520 to generate one piece of display image data, and transmits the display image data to the video memory 540 .
  • the controller 530 generates display image data such as display image data generated from a piece of digital image data, display image data in which a plurality of pieces of image data are arranged, or display image data in which healthy regions and lesion regions are identified or a graph of a reflection spectrum of the biological tissue T corresponding to a specific pixel (x, y) is displayed by generating a reflection spectrum of the biological tissue T for each pixel (x, y) on the basis of a plurality of pieces of digital image data, and stores them in the video memory 540 .
  • the signal processing circuit 550 generates video signals having a predetermined format (e.g., a format which conforms to NTSC or DVI standard) on the basis of the display image data stored in the video memory 540 , and outputs the video signals.
  • the video signals outputted from the signal processing circuit 550 is inputted to the monitor 300 .
  • endoscopic images taken by the electronic endoscope 100 and the like are displayed on the monitor 300 .
  • the processor 200 has both a function as a video processor for processing the image signals outputted from the image pick-up device 141 of the electronic endoscope 100 , and a function as a light source device for supplying illumination light IL to the light guide 131 of the electronic endoscope 100 to illuminate the biological tissue T being an object.
  • the light source unit 400 comprises a collimator lens 440 , a rotating filter 410 , a filter control unit 420 and a condenser lens 450 .
  • the white light WL emitted from the light source 430 is converted by the collimator lens 440 into a collimated beam, transmits through the rotating filter 410 , and then is incident on the end portion 131 b of the light guide 131 by the condenser lens 450 .
  • the rotating filter 410 is a circular plate type optical unit comprising a plurality of optical filters, and is configured such that a transmission wavelength range thereof changes in accordance with the rotation angle thereof.
  • the rotation angle of the rotating filter 410 is controlled by the filter control unit 420 connected to the controller 530 .
  • the spectrum of the illumination light supplied to the light guide 131 through the rotating filter 410 can be switched by the controller 530 controlling the rotation angle of the rotating filter 410 via the filter control unit 420 .
  • FIG. 4 is an external view (front view) of the rotating filter 410 .
  • the rotating filter 410 comprises a substantially circular plate shaped frame 411 , and four fan-shaped optical filters 415 , 416 , 417 , and 418 .
  • the rotating filter 410 comprises a substantially circular plate shaped frame 411 , and four fan-shaped optical filters 415 , 416 , 417 , and 418 .
  • the central axis of the frame 411 four fan-shaped windows 414 a , 414 b , 414 c , and 414 d are formed at regular intervals, and the optical filters 415 , 416 , 417 , and 418 are fit into each of the windows 414 a , 414 b , 414 c , and 414 d , respectively.
  • the optical filters of the present embodiment are all dielectric multilayer film filters, other types of optical filters (e.g., absorbing type optical filters or etalon filters in which dielectric multilayers
  • a boss hole 412 is formed on the central axis of the frame 411 .
  • An output axis of a servo motor (not shown) included in the filter control unit 420 is inserted and fixed to the boss hole 412 , and the rotating filter 410 rotates along with the output axis of the servo motor.
  • FIG. 4 shows a state in which the white light WL is incident on the optical filter 415 .
  • the optical filter on which the white light WL is incident changes to 415 , 416 , 417 , 418 in this order, and thus the spectrum of the illumination light IL that transmits the rotating filter 410 can be switched.
  • the optical filters 415 and 416 are optical band-pass filters that selectively transmit light of 550 nm band. As shown in FIG. 1 , the optical filter 415 is configured to transmit light which is inside the wavelength range between isosbestic points E 1 and E 4 (i.e., wavelength range R 0 ) with low loss, and to cut off light which is outside the wavelength range. Also, the optical filter 416 is configured to transmit light which is inside the wavelength range between isosbestic points E 2 and E 3 (i.e., wavelength range R 2 ) with low loss, and to cut off light which is outside the wavelength range.
  • isosbestic points E 1 and E 4 i.e., wavelength range R 0
  • the optical filter 416 is configured to transmit light which is inside the wavelength range between isosbestic points E 2 and E 3 (i.e., wavelength range R 2 ) with low loss, and to cut off light which is outside the wavelength range.
  • the transmission wavelength ranges of the optical filters 415 and 416 are included in a transmission wavelength range of the G filter of the color filter 141 a ( FIG. 3 ). Therefore, an image which is formed by light that transmitted through the optical filter 415 or 416 is taken by the light-receiving element to which the G filter is provided, and is acquired as the G digital image data (G imaging signal).
  • the optical filter 417 is designed to selectively transmit only light of 650 nm band (630-650 nm) being a wavelength range in which an absorbance of hemoglobin in the biological tissue T is low.
  • the transmission wavelength range of the optical filter 417 is included in a transmission wavelength range of the R filter of the color filter 141 a ( FIG. 3 ). Therefore, an image which is formed by light that transmitted through the optical filter 417 is taken by the light-receiving element to which the R filter is provided, and is acquired as the R digital image data (R imaging signal).
  • the image data acquired by using the illumination light of 650 nm band is used in a standardization process which will be explained later.
  • the optical filter 418 is an ultraviolet cut filter, and the illumination light IL (i.e., a white light) that transmitted through the optical filter 418 is used for taking normal observation images. It is noted that the rotating filter 410 may be configured without the optical filter 418 to leave the window 414 d of the frame 411 open.
  • a dimmer filter 419 is provided over the optical filter 415 .
  • the dimmer filter 419 does not have wavelength dependency throughout the visible light range and thus only decreases a light amount of the illumination light IL without changing the spectrum thereof.
  • the light amount of the illumination light IL that transmitted through the optical filter 415 and the dimmer filter 419 are adjusted to a light amount substantially equivalent to a light amount of the illumination light IL that transmitted through the optical filter 416 by using the dimmer filter 419 .
  • images can be taken with a proper exposure with the same exposure time in both a case where the illumination light IL that passed through the optical filter 415 is used and a case where the illumination light IL that passed through the optical filter 416 is used.
  • a metal mesh having a fine mesh size is used as the dimmer filter 419 .
  • other types of dimmer filter such as a half mirror type may be used.
  • transmittances of the optical filters 415 and 416 themselves may be adjusted instead of using the dimmer filter.
  • dimmer filters may also be provided to the windows 414 c and 414 d .
  • central angles of the windows 414 a , 414 b , 414 c , and 414 d i.e., aperture areas
  • the exposure time may be changed for each optical filter instead of using the dimmer filter.
  • a through hole 413 is formed at the periphery of the frame 411 .
  • the through hole 413 is formed at a position that is same as a position of boundary between the windows 414 a and 414 d in the rotating direction of the frame 411 .
  • a photo interrupter 422 for detecting the through hole 413 is arranged such that the photo interrupter 422 surrounds a portion of the periphery of the frame 411 .
  • the photo interrupter 422 is connected to the filter control unit 420 .
  • the endoscope device 1 of the present embodiment has four operation modes of a normal observation mode, a spectral analysis (oxygen saturation distribution image displaying) mode, a baseline measuring mode and a calibration mode.
  • the normal observation mode is an operation mode in which a color image is taken using a white light that transmitted through the optical filter 418 .
  • the spectral analysis mode is a mode in which a spectral analysis is carried out on the basis of the digital image data taken using illumination light that transmitted through the optical filters 415 , 416 and 417 , and a distribution image of biomolecules in a biological tissue (e.g., oxygen saturation distribution image) is displayed.
  • the baseline measuring mode is a mode in which an image of a color reference board such as a colorless diffusion board (e.g., frosted glass) or reference reflection board is taken as an object using illumination light that passed through the optical filters 415 , 416 and 417 , before (or after) executing the actual endoscopic observation, to acquire data to be used in a standardization process which will be described later.
  • the calibration mode is a process in which a spectral analysis is carried out for a sample of which properties such as the oxygen saturation is known, and a parameter (correction coefficient k which will be described later) is adjusted such that there is no difference between the analysis result and the theoretical value.
  • the controller 530 controls the filter control unit 420 to immobilize the rotating filter 410 at a position where the white light WL is incident on the optical filter 418 . Then, the digital image data taken by the image pick-up device 141 is converted to video signals after performing image processes as necessary, and is displayed on the monitor 300 .
  • the controller 530 controls the filter control unit 420 to drive the rotating filter 410 to rotate at constant rotation speed while sequentially taking images of the biological tissue T using illumination light that transmitted through the optical filters 415 , 416 , 417 and 418 . Then, an image indicating distribution of biomolecules in the biological tissue is generated on the basis of digital image data acquired using each of the optical filters 415 , 416 and 417 . Then, a display image in which the distribution image and a normal observation image acquired by using the optical filter 418 are arranged is generated and converted to video signals, and is displayed on the monitor 300 .
  • the filter control unit 420 detects a rotational phase of the rotating filter 410 on the basis of timing the photo interrupter 422 detects the through hole 413 , compares the rotational phase to a phase of a timing signal supplied by the controller 530 , and adjusts the rotational phase of the rotating filter 410 .
  • the timing signal from the controller 530 is synchronized with a driving signal for the image pick-up device 141 . Therefore, the rotating filter 410 is driven to rotate at a substantially constant rotation speed in synchronization with the driving of the image pick-up device 141 .
  • the rotation of the rotating filter 410 is controlled such that the optical filter 415 , 416 , 417 or 418 (window 414 a, b, c or d ) on which the white light WL is to be incident switches each time one image (three frames: R, G and B) is taken by the image pick-up device 141 .
  • the controller 530 controls the filter control unit 420 to rotate the rotating filter 410 while sequentially taking images of the color reference board using the illumination light IL that transmitted through the optical filters 415 , 416 and 417 .
  • Each piece of the G digital image data taken using the illumination light IL that transmitted through the optical filters 415 and 416 is stored in an internal memory 531 of the controller 530 as baseline image data BL 415 (x, y) and BL 416 (x, y), respectively.
  • the R digital image data taken using the illumination light IL that transmitted through the optical filter 417 is stored in the internal memory 531 of the controller 530 as baseline image data BL 417 (x, y).
  • FIG. 5 is a flow chart explaining the image generation process.
  • the filter control unit 420 drives the rotating filter 410 to rotate at constant rotation speed. Then, from the light source unit 400 , the illumination light IL that transmitted through the optical filters 415 , 416 , 417 and 418 are sequentially supplied, and an image is sequentially taken using each of the illumination light IL (S 1 ).
  • G digital image data G 415 (x, y) taken using the illumination light IL that transmitted through the optical filter 415 G digital image data G 416 (x, y) taken using the illumination light IL that transmitted through the optical filter 416 , R digital image data R 417 (x, y) taken using the illumination light IL that transmitted through the optical filter 417 , and R digital image data R 418 (x, y), G digital image data G 418 (x, y) and B digital image data B 418 (x, y) taken using the illumination light IL that transmitted through the optical filter (ultraviolet cut filter) 418 are stored in an internal memory 532 of the controller 530 .
  • the image processor unit 500 executes a pixel selection process S 2 for selecting pixels to be targets of the following analyzing processes (processes S 3 -S 7 ) by using the R digital image data R 418 (x, y), G digital image data G 418 (x, y) and B digital image data B 418 (x, y) acquired in the process S 1 .
  • the image generating process of the present embodiment is configured to select pixels that are appropriate to the analyzing process (i.e., pixels to which the spectral property of hemoglobin is recorded) and to execute the analyzing process to the selected pixels.
  • the above three conditional expressions are set on the basis of a value size relation, G component ⁇ B component ⁇ R component, in a transmission spectrum of blood. It is noted that the pixel selection process S 2 may be executed using one or two of the above three conditional expressions (e.g., using Expression 12 and Expression 13 by focusing on a red color that is specific to blood).
  • the standardization process of the present embodiment includes a first standardization process S 3 for correcting properties of the endoscope device 1 itself (e.g., transmittances of the optical filters and light receiving sensitivities of the image pick-up devices) and a second standardization process S 4 for correcting reflectivity variations due to differences in surface states of the biological tissue T being an object and due to angles of incidence of the illumination light IL to the biological tissue T.
  • a first standardization process S 3 for correcting properties of the endoscope device 1 itself (e.g., transmittances of the optical filters and light receiving sensitivities of the image pick-up devices)
  • a second standardization process S 4 for correcting reflectivity variations due to differences in surface states of the biological tissue T being an object and due to angles of incidence of the illumination light IL to the biological tissue T.
  • the image processor unit 500 calculates a standardized reflectivity SR 415 (x, y) using the following Expression 14 by using the G digital image data G 415 (x, y) taken using the illumination light IL that transmitted through the optical filter 415 , the R digital image data R 417 (x, y) taken using the illumination light IL that transmitted through the optical filter 417 , and the baseline image data BL 415 (x, y) and BL 417 (x, y).
  • SR 415 ⁇ ( x , y ) G 415 ⁇ ( x , y ) / BL 415 ⁇ ( x , y ) R 417 ⁇ ( x , y ) / BL 417 ⁇ ( x , y ) ( EXPRESSION ⁇ ⁇ 14 )
  • SR 416 ⁇ ( x , y ) G 416 ⁇ ( x , y ) / BL 416 ⁇ ( x , y ) R 417 ⁇ ( x , y ) / BL 417 ⁇ ( x , y ) ( EXPRESSION ⁇ ⁇ 15 )
  • a 415 (x, y) and A 416 (x, y) of the biological tissue T with respect to the illumination light IL that transmitted through the optical filters 415 and 416 are calculated using the following Expressions 16 and 17 (S 5 ).
  • a 415 ( x,y ) ⁇ log[ SR 415 ( x,y )] (EXPRESSION 16)
  • a 416 ( x,y ) ⁇ log[ SR 416 ( x,y )] (EXPRESSION 17)
  • absorbances A 415 (x, y) and A 416 (x, y) can be approximately calculated using the following Expressions 18 and 19.
  • a 415 ( x,y ) ⁇ SR 415 ( x,y ) (EXPRESSION 18)
  • a 416 ( x,y ) ⁇ SR 416 ( x,y ) (EXPRESSION 19)
  • the spectral analysis can be executed simply by eliminating the above mentioned standardization processes (S 3 , S 4 ).
  • the absorbances A 415 (x, y) and A 416 (x, y) are calculated using the following Expressions 20 and 21.
  • a 415 ( x,y ) ⁇ log G 415 ( x,y ) (EXPRESSION 20)
  • a 416 ( x,y ) ⁇ log G 416 ( x,y ) (EXPRESSION 21)
  • the absorbances A 415 (x, y) and A 416 (x, y) can be approximately calculated using the following Expressions 22 and 23, respectively.
  • a 415 ( x,y ) ⁇ G 415 ( x,y ) (EXPRESSION 22)
  • a 416 ( x,y ) ⁇ G 416 ( x,y ) (EXPRESSION 23)
  • absorbances A R1 (x, y), A R2 (x, y) and A R3 (x, y) of the biological tissue T with respect to the wavelength ranges R 1 , R 2 and R 3 and the absorbances A 415 (x, y) and A 416 (x, y) of the biological tissue T with respect to the illumination light IL that transmitted through the optical filters 415 and 416 have relationships expressed in the following Expressions 24 and 25.
  • a R1 ( x,y )+ A R3 ( x,y ) A 415 ( x,y ) ⁇ kA 416 ( x,y ) (EXPRESSION 24)
  • a R2 ( x,y ) kA 416 ( x,y ) (EXPRESSION 25)
  • k is a constant (correction coefficient). Since the width of the transmission wavelength ranges of the optical filters 415 and 416 differ significantly, the light amounts that transmit through the two filters also differ significantly. Therefore, as mentioned above, the dimmer filter 419 is provided over the optical filter 415 , which has a large transmitting light amount, to control the light amount so that a proper exposure can be obtained with the same exposure time even if the optical filter is switched. As a result, a quantitative relationship between the absorbance A 415 (x, y) acquired using the optical filter 415 and the absorbance A 416 (x, y) acquired using the optical filter 416 is broken.
  • the transmittances of the optical filters 415 and 416 within the transmission wavelength ranges are not 100% and the optical filters 415 and 416 have transmission losses that vary depending thereon. Furthermore, there are errors in the transmission wavelength ranges of the optical filters 415 and 416 . Therefore, even if the dimmer filter 419 is not used, the quantitative relationship between the absorbance A 415 (x, y) and the absorbance A 416 (x, y) includes a constant error.
  • the correction coefficient k is a constant for correcting the error of the quantitative relationship between the absorbance A 415 (x, y) and the absorbance A 416 (x, y). A method for acquiring the correction coefficient k will be described later. It is noted that, in case this correction is not executed, the correction coefficient k is set at 1.
  • Expression 27 can be obtained by arranging Expression 26 using Expressions 16 and 17.
  • index X can be calculated from the G digital image data G 415 (x, y) and G 416 (x, y), R digital image data R 417 (x, y), and the baseline image data BL 415 (x, y), BL 416 (x, y) and BL 417 (x, y) by using Expression 27 (S 6 ).
  • index X can also be approximately calculated using the following Expression 28.
  • X ⁇ log[ SR 415 ( x,y )]+2 k log[ SR 416 ( x,y )] ⁇ SR 415 ( x,y )+2 kSR 416 ( x,y ) (EXPRESSION 28)
  • a value list indicating the quantitative relationship between the oxygen saturation and the index X experimentally acquired in advance is stored in a non-volatile memory 532 provided to the controller 530 .
  • the controller 530 refers to this value list to acquire an oxygen saturation SatO 2 (x, y) which corresponds to a value of the index X calculated using Expression 27 or 28. Then, the controller 530 generates image data (oxygen saturation distribution image data) of which pixel value of each pixel (x, y) is a value obtained by multiplying the acquired oxygen saturation SatO 2 (x, y) by a predetermined value (S 7 ).
  • the controller 530 generates normal observation image data from the R digital image data R 418 (x, y), G digital image data G 418 (x, y) and B digital image data B 418 (x, y) acquired using the illumination light IL (white light) that transmitted through the optical filter (ultraviolet cut filter) 418 .
  • FIG. 7 shows display examples of image data generated by the controller 530 .
  • FIG. 7 ( a ) is an exemplary displayed image of the normal observation image data
  • FIG. 7 ( b ) is an exemplary display image of the oxygen saturation distribution image data.
  • the controller 530 generates screen image data for arranging and displaying the normal observation image and the oxygen saturation distribution image on a single screen from the generated oxygen saturation distribution image data and normal observation image data, and stores the screen data in the video memory 540 . It is noted that the controller 530 can generate a variety of screen images such as a screen image that only displays the oxygen saturation distribution image, a screen image that only displays the normal observation image, or a screen image on which associated information such as patient's ID information or observation condition is superimposed on the oxygen saturation distribution image and/or the normal observation image in accordance with the user's operations.
  • a method for determining the correction coefficient k in the calibration mode will be described.
  • a theoretically calculated index X and a measured index X are compared, and the correction coefficient k is determined such that the measured index X becomes closest to the theoretically calculated index X.
  • FIG. 6 shows exemplary calibration curves used to determine the correction coefficient k in the embodiment of the present invention.
  • FIG. 6 ( a ) is an example of a common calibration curve of which the horizontal axis is the theoretical index X and the vertical axis is the measured index X acquired by the above explained analyzing process.
  • the filled circles are plots of the measured values, and the broken line Ma is a straight line fitted to the measured value by a least-square method. Further, the solid line shows a reference line Ref representing plots in case measured values equivalent to the theoretical values are obtained.
  • the measured index X is acquired by the analyzing process using a sample of a biological tissue of which the oxygen saturation is known (e.g., blood). Further, the theoretical index X defined by Expression 26 is calculated using transmission spectra of the optical filters 415 and 416 to be actually used and a reflection spectrum (or absorption spectrum) of blood. Specifically, the theoretical index X is calculated using Expression 26 by using a value obtained by multiplying the transmission spectrum of the optical filter 415 (optical filter 416 ) by the reflection spectrum of blood and integrating the product as the absorbance A 415 (absorbance A 416 ).
  • a discrepancy between the Reference line Ref and the measured value Ma is expressed as a gradient of the calibration curve.
  • a phenomenon of which sufficient sensitivity cannot be obtained is due to an inappropriate quantitative relationship between the absorbance A 415 (x, y) and the absorbance A 416 (x, y) in Expression 26, caused by the use of the dimmer filter 419 .
  • an appropriate value as the correction coefficient k an error caused by the dimmer filter 419 can be corrected, and thus a state in which an error between the measured index X and the theoretical index X is minimized and the measured index X has the highest correlational relationship with the theoretical index X can be achieved.
  • FIG. 6 ( b ) is a variation of the calibration curve.
  • the horizontal axis is the oxygen saturation of a sample
  • the vertical axis is the index X.
  • the filled circles are plots of the measured values
  • the broken line Ma is a straight line fitted to the measured value by a least-square method.
  • the solid line Mb shows the theoretically calculated values. It is noted that the oxygen saturations of the sample are correctly measured values acquired from an ideal spectrometry. Being a curve obtained by changing the horizontal scale of the calibration curve shown in FIG. 6 ( a ) , this calibration curve is substantially equivalent to the curve of FIG. 6 ( a ) , but there is an advantage that a correct relationship with the oxygen saturation can be easily read.
  • the above-explained method for determining the correction coefficient k using the calibration curve is a method in which analysis results of a plurality of samples having different oxygen saturations are used, the correction coefficient k can also be determined using an analysis result from only one sample.
  • the absorbances A R1 (x, y), A R2 (x, y) and A R3 (x, y) change in accordance with the change in the oxygen saturation, but a sum Y of these absorbances (shown in Expression 29) is substantially constant. Furthermore, since the sum Y of the absorbances is in proportion to a total amount of hemoglobin (a sum of oxyhemoglobin HbO 2 and deoxyhemoglobin Hb) in a biological tissue, it is reasonable to use the sum Y as an index for the total amount of hemoglobin.
  • the controller 530 can extract pixels of which the index Y, calculated using Expression 29 and indicating the total amount of hemoglobin, is greater than a predetermined reference value (first reference value) and the index X, calculated using Expression 25 and indicating the oxygen saturation, is smaller than a predetermined reference value (second reference value); generate, for example, lesion region highlighting image data in which highlighting process is executed to pixels corresponding to the extracted pixels in the normal observation image data; and display the lesion region highlighting image along with the normal observation image and/or the oxygen saturation distribution image (or alone) on the monitor 300 .
  • Exemplary highlighting process includes a process for increasing pixel values of corresponding pixels, a process for changing color phases (for example, a process for increasing the R component to change to a reddish color or a process for rotating the color phase for a predetermined angle), and a process for making the corresponding pixels blink (or periodically changing the color phase).
  • a process for increasing pixel values of corresponding pixels for example, a process for increasing the R component to change to a reddish color or a process for rotating the color phase for a predetermined angle
  • a process for making the corresponding pixels blink or periodically changing the color phase
  • the controller 530 may be configured to calculate an index Z (x, y) indicating a probability of being a malignant tumor on the basis of a deviation from an average of the index X (x, y) and a deviation from an average of the index Y (x, y), and to generate image data with the index Z (x, y) as pixel values (malign probability image data) instead of the lesion region highlighting image data.
  • the pixel value of the oxygen saturation distribution image is calculated by acquiring an oxygen saturation value from the value list in accordance with a value of the index X and by multiplying the oxygen saturation by a predetermined constant, but the present invention is not limited to this configuration. Since the index X is a value that monotonically increases with the oxygen saturation, the index X itself (or the index X multiplied by a predetermined constant) may be used as a pixel value of the oxygen saturation distribution image.
  • the image pick-up device 141 of the present embodiment is explained as an image pick-up device for taking color images comprising primary color filters R, G, B on its front face, but the image pick-up device is not limited to this configuration.
  • an image pick-up device for taking color images comprising complementary color filters Y, Cy, Mg, G may be used.
  • the image pick-up device 141 of the present embodiment is explained as a pick-up device for taking color images comprising an on-chip color filter 141 a , but the image pick-up device is not limited to this configuration.
  • an image pick-up device for taking black-and-white images may be used to configure an image pick-up device comprising a so-called frame sequential type color filter.
  • the color filter 141 a is not limited to an on-chip configuration but may be positioned on a light path between the light source 430 and the image pick-up device 141 .
  • the rotating filter 410 is used, but the present invention is not limited to this configuration.
  • Other types of wavelength variable filter of which transmission wavelength can be switched may also be used.
  • the rotating filter 410 may be provided at the image pick-up device side (for example, between the objective optical system 121 and the image pick-up device 141 ) and configured to filter a return light from an object.
  • a configuration in which the rotating filter 410 is rotated at constant rotation speed while taking images at predetermined time intervals in the spectral analysis mode is adopted, but the present invention is not limited to this configuration.
  • a device may be configured such that the rotating position of the rotating filter 410 changes step by step at predetermined time intervals and images are taken while the rotation of the rotating filter is stopped.
  • the present invention is applied to an electronic endoscope device being a form of a digital camera, but the present invention can also be applied to systems that use other types of digital camera (e.g., digital single lens reflex camera or digital video camera).
  • digital camera e.g., digital single lens reflex camera or digital video camera.
  • the present invention is applied to a digital still camera, observation of surface tissue or observation of brain tissue during craniotomy (e.g., a quick inspection of cerebral blood flow) can be performed.

Abstract

Generating an image of a molar concentration ratio between a first and second biological substance, an absorption spectrum of the first and second biological substance within a predetermined wavelength range including a first, second, third, and fourth isosbestic point, acquiring first imaging data of the tissue using light extracted from white light using a first filter to collectively selectively extract light in a first wavelength range demarcated by the first and second isosbestic point, light in a second wavelength range demarcated by the second and third isosbestic point, and light in a third wavelength range demarcated by the third and fourth isosbestic point; acquiring second imaging data by taking an image of the tissue using light from the white light using a second optical filter to selectively extract light in the second wavelength range; and generating the distribution image on the basis of the first and second imaging data.

Description

TECHNICAL FIELD
The present invention relates to a method and a device for generating an image showing concentration distribution of biological substances in a biological tissue.
BACKGROUND ART
Recently, an endoscope device having a function of photographing spectroscopic image (spectral endoscope device) has been proposed. By using such a spectral endoscope device, it is possible to obtain information concerning spectral property (e.g., reflection spectrum) of a biological tissue such as a mucous membrane of a digestive organ. It is known that the reflection spectrum of a biological tissue reflects information concerning types or densities of components contained in the vicinity of a surface layer of a biological tissue being a measurement target. Specifically, it is known that an absorbance calculated from the reflection spectrum of a biological tissue equals to an absorbance obtained by linearly superimposing absorbances of a plurality of substances that compose the biological tissue.
It is known that composition and amount of substances in a lesion biological tissue differ from those in a healthy biological tissue. It is reported in many of the earlier studies that abnormalities of lesions represented by such as cancer are particularly deeply related to a condition of blood, especially to an overall amount of blood or oxygen saturation. Qualifying and quantifying two focused biological tissues by using spectroscopic feature values within the visible range that the two focused biological tissues have is a frequently used method in the field of spectrographic analysis. Therefore, it is possible to estimate existence of some kind of lesions in a biological tissue by comparing a spectral characteristic of blood in a biological tissue that includes lesions with a spectral characteristic of blood in a biological tissue that does not include lesions.
A spectral image is composed of a series of image information taken using light of different wavelengths, and more detailed spectral information of a biological tissue can be obtained from the spectral image having higher wavelength resolutions (i.e., larger number of wavelengths used to acquire image information). Patent Document 1 discloses an exemplary configuration of a spectral endoscope device which acquires spectral images in a wavelength range of 400-800 nm at 5 nm intervals.
PRIOR ART DOCUMENT Patent Document
(Patent Document 1) Japanese Patent Provisional Publication No. 2012-245223A
SUMMARY OF THE INVENTION Problem to be Solved
However, in order to acquire spectral images having high wavelength resolutions, such as the spectral images disclosed in Patent Document 1, lots of images need to be taken while changing an image pick-up wavelength. Furthermore, a large amount of calculation is necessary to analyze lots of images and thus it takes time to analyze them. That is, relatively complicated photographing operations and calculations needs to be repeated to obtain effective diagnosis support information. Accordingly, there is a problem that it takes time to obtain the effective diagnosis support information.
The present invention is made in view of the above situation, and the object of the present invention is to provide a method and a device capable of acquiring image information showing distributions of biological substances, such as oxygen saturation distribution, in a short time.
Means for Solving the Problem
According to an embodiment of the present invention, there is provided a method for generating a distribution image showing a molar concentration ratio between a first biological substance and a second biological substance included in a biological tissue of which an absorption spectrum within a predetermined wavelength range has a first isosbestic point, a second isosbestic point, a third isosbestic point and a fourth isosbestic point in ascending order of wavelength, comprising: a step of acquiring first imaging data G1 by taking an image of the biological tissue using light extracted from white light using a first optical filter configured to collectively selectively extract light in a first wavelength range demarcated by the first isosbestic point and the second isosbestic point, light in a second wavelength range demarcated by the second isosbestic point and the third isosbestic point, and light in a third wavelength range demarcated by the third isosbestic point and the fourth isosbestic point; a step of acquiring second imaging data G2 by taking an image of the biological tissue using light extracted from the white light using a second optical filter configured to selectively extract light in the second wavelength range; and a step of generating the distribution image on the basis of the first imaging data G1 and the second imaging data G2.
Also, in the above method, the step of generating the distribution image on the basis of the first imaging data G1 and the second imaging data G2 may further comprise: a step of acquiring an absorbance A1 of the biological tissue in a transmission wavelength range of the first optical filter on the basis of the first imaging data G1; a step of acquiring an absorbance A2 of the biological tissue in a transmission wavelength range of the second optical filter on the basis of the second imaging data G2; and a step of generating the distribution image on the basis of the absorbance A1 and the absorbance A2.
Also, in the above method, the step of acquiring the absorbance A1 may include a step of calculating the absorbance A1 using Expression 1 or Expression 2; and
A 1=−log G 1  (EXPRESSION 1)
A 1 =−G 1  (EXPRESSION 2)
the step of acquiring the absorbance A2 may include a step for calculating the absorbance A2 using Expression 3 or Expression 4.
A 2=−log G 2  (EXPRESSION 3)
A 2 =−G 2  (EXPRESSION 4)
Also, in the above method, the step of generating the distribution image on the basis of the absorbance A1 and the absorbance A2 may include: a step of calculating an index X using Expression 5; and
X=A 1−2kA 2  (EXPRESSION 5)
(where k is a constant)
a step for generating the distribution image on the basis of the index X.
Also, in the above method, the constant k may be 1.
Also, the above method may further comprise a step of acquiring third imaging data R3 by taking an image of the biological tissue using light extracted from the white light using a third optical filter configured to selectively extract light in a fourth wavelength range in which an absorbance of the biological tissue is sufficiently low compared to an absorbance in the predetermined wavelength range, and the step of acquiring the absorbance A1 may include: a step of calculating a first standardized reflectivity SR1 by dividing the first imaging data G1 by the third imaging data R3; and a step of calculating the absorbance A1 using Expression 6 or Expression 7, and
A 1=−log SR  (EXPRESSION 6)
A 1 =−SR  (EXPRESSION 7)
the step of acquiring the absorbance A2 may include: a step of calculating a second standardized reflectivity SR2 by dividing the second imaging data G2 by the third imaging data R3; and a step of calculating the absorbance A2 using Expression 8 or Expression 9.
A 2=−log SR 2  (EXPRESSION 8)
A 2 =−SR 2  (EXPRESSION 9)
Also, the above method may further comprise: a step of acquiring a first baseline image data BL1 by taking an image of a colorless color reference board using light extracted from the white light using the first optical filter; and a step of acquiring a second baseline image data BL2 by taking an image of the reference board using light extracted from the white light using the second optical filter, and the step of calculating the first standardized reflectivity SR1 may include a step of dividing the first imaging data G1 by the first baseline image data BL1, and the step of calculating the second standardized reflectivity SR2 may include a step of dividing the second imaging data G2 by the second baseline image data BL2.
Also, in the above method, the fourth wavelength range may be 650 nm band, and the third imaging data R3 may be imaging data taken by a light-receiving element, to which an R filter is provided, included in an image pick-up device provided with an RGB color filter.
Also, in the above method, the constant k may be determined such that the index X, acquired on the basis of the first imaging data G1 and the second imaging data G2 acquired by taking images of a biological tissue of which the molar concentration ratio is known, becomes closest to a theoretical index X.
Also, in the above method, the measured index X for each of a plurality of biological tissues, each having a known molar concentration ratio that is different from each other, may be acquired and the constant k may be determined such that a calibration curve showing a relationship between the known molar concentration ratio and the measured index X becomes closest to a reference line showing a relationship between the known molar concentration ratio and the theoretical index X.
Also, in the above method, the light extracted from the white light using the first optical filter in the step of acquiring the first imaging data G1 may be dimmed such that an exposure when acquiring the first imaging data G1 and an exposure when acquiring the second imaging data G2 become equivalent.
Also, in the above method, the two types of biological substances may be oxyhemoglobin and deoxyhemoglobin, and the molar concentration ratio of the first biological substance and the second biological substance included in the biological tissue may be oxygen saturation.
Also, in the above method, the predetermined wavelength range may be a Q band of hemoglobin, and the first imaging data G1 and the second imaging data G2 may be imaging data taken by a light-receiving element, to which a G filter is provided, included in an image pick-up device provided with an RGB color filter.
Further, according to an embodiment of the present invention, there is provided a device for generating a distribution image showing a molar concentration ratio between a first biological substance and a second biological substance included in a biological tissue of which an absorption spectrum within a predetermined wavelength range has a first isosbestic point, a second isosbestic point, a third isosbestic point and a fourth isosbestic point in ascending order of wavelength, comprising: a light source which emits white light; a first optical filter configured to collectively selectively extract light in a first wavelength range demarcated by the first isosbestic point and the second isosbestic point, light in a second wavelength range demarcated by the second isosbestic point and the third isosbestic point, and light in a third wavelength range demarcated by the third isosbestic point and the fourth isosbestic point from the white light; a second optical filter configured to selectively extract light in the second wavelength range from the white light; a switching means configured to switch between the first optical filter and the second optical filter; an image pick-up device configured to take an image of the biological tissue using the light emitted by the light source; and an image processor unit configured to generate the distribution image on the basis of imaging data generated by the image pick-up device.
Also, the above device may be an endoscope device comprising an endoscope provided at a tip portion.
Effects of the Invention
According to the present invention, image information showing distributions of biological substances, such as oxygen saturation distribution, can be acquired in a short time.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 shows an absorption spectrum of hemoglobin at Q band.
FIG. 2 is a block chart illustrating an endoscope device according to the embodiment of the present invention.
FIG. 3 shows transmission spectra of color filters which are accommodated in an image pick-up device.
FIG. 4 is an external view of a rotating filter.
FIG. 5 is a flowchart explaining an image generating process according to the embodiment of the present invention.
FIG. 6 shows exemplary calibration curves used to determine a correction coefficient k.
FIG. 7 shows exemplary endoscopic images generated using an endoscope device according to the embodiment of the present invention. (a) is a normal observation image, and (b) is an oxygen saturation distribution image.
EMBODIMENTS FOR CARRYING OUT THE INVENTION
In the following, an embodiment according to the present invention is described with reference to the accompanying drawings.
An endoscope device according to the embodiment of the present invention described below is a device that quantitatively analyzes biological information (e.g., oxygen saturation) of an object on the basis of a plurality of images taken using light of different wavelengths and displays the analysis result as images. In a quantitative analysis of the oxygen saturation described below, a characteristic that a spectral property of blood (i.e., spectral property of hemoglobin) continuously changes in accordance with the oxygen saturation is used.
(Principles for Calculation of Spectral Property of Hemoglobin and Oxygen Saturation)
Before explaining a detailed configuration of an endoscope device according to the embodiment of the present invention, principles for calculation of the spectral property of hemoglobin and the oxygen saturation used in the embodiment will be described.
FIG. 1 shows an absorption spectrum of hemoglobin at wavelengths of around 550 nm. Hemoglobin has a strong absorption band, derived from porphyrin, called Q band at wavelengths of around 550 nm. The absorption spectrum of hemoglobin changes in accordance with the oxygen saturation (ratio of oxyhemoglobin to the overall hemoglobin). A waveform shown in a solid line in FIG. 1 is an absorption spectrum of hemoglobin when the oxygen saturation is 100% (i.e., an absorption spectrum of oxyhemoglobin HbO), and a waveform shown in a long-dashed line is an absorption spectrum of hemoglobin when the oxygen saturation is 0% (i.e., an absorption spectrum of deoxyhemoglobin Hb). Waveforms shown in short-dashed lines are absorption spectra of hemoglobin (a mixture of oxyhemoglobin and deoxyhemoglobin) at oxygen saturations of between 0% and 100% (10, 20, 30, . . . , 90%).
As shown in FIG. 1, at Q band, oxyhemoglobin and deoxyhemoglobin show peak wavelengths that differ from each other. Specifically, oxyhemoglobin has an absorption peak P1 at a wavelength of around 542 nm, and an absorption peak P3 at a wavelength of around 576 nm. On the other hand, deoxyhemoglobin has an absorption peak P2 at a wavelength of around 556 nm. Since FIG. 1 shows a two-component absorption spectrum in which a sum of a concentration of each component (oxyhemoglobin and deoxyhemoglobin) is constant, isosbestic points E1, E2, E3 and E4, where absorbances are constant regardless of the concentration of each component (i.e., oxygen saturation), appear. In the following description, a wavelength range between isosbestic points E1 and E2 is referred to as wavelength range R1, a wavelength range between isosbestic points E2 and E3 is referred to as wavelength range R2, and a wavelength range between isosbestic points E3 and E4 is referred to as wavelength range R3. Further, a wavelength range between isosbestic points E1 and E4 is referred to as wavelength range R0 (i.e., a combination of wavelengths ranges of R1, R2 and R3).
As shown in FIG. 1, between neighboring isosbestic points, absorbance of hemoglobin monotonically increases or decreases with the oxygen saturation. Further, between neighboring isosbestic points, absorbance of hemoglobin almost linearly changes with the oxygen saturation.
Specifically, absorbances AR1 and AR3 of hemoglobin at wavelength ranges R1 and R3 linearly increases with oxyhemoglobin concentration (oxygen saturation), and absorbance AR2 of hemoglobin at wavelength range R2 linearly increases with deoxyhemoglobin concentration (1—“oxygen saturation”). Therefore, an index X, defined by the following Expression 10, linearly increases with oxyhemoglobin concentration (oxygen saturation).
X=(A R1 +A R3)−A R2  (EXPRESSION 10)
Therefore, the oxygen saturation can be calculated from the index X by experimentally acquiring a quantitative relationship between the oxygen saturation and the index X.
(Configuration of Endoscope Device)
FIG. 2 is a block chart illustrating an endoscope device 1 according to the embodiment of the present invention. The endoscope device 1 of the present embodiment comprises an electronic endoscope 100, a processor 200 and a monitor 300. The electronic endoscope 100 and the monitor 300 are detachably connected to the processor 200. Also, the processor 200 includes therein a light source unit 400 and an image processor unit 500.
The electronic endoscope 100 has an insertion tube 110 to be inserted into a body cavity. The electronic endoscope 100 is provided with a light guide 131 which extends over the full length of the electronic endoscope 100. One end portion of the light guide 131 (a tip portion 131 a) is arranged close to a tip portion of the insertion tube 110 (an insertion tube tip portion 111), and the other end portion of the light guide 131 (a proximal end portion 131 b) is connected to the processor 200. The processor 200 includes therein the light source unit 400 comprising a light source lamp 430, e.g., a Xenon lamp which generates a large amount of white light WL. The illumination light IL generated by the light source unit 400 is incident on the end portion 131 b of the light guide 131. The light which is incident on the proximal end portion 131 b of the light guide 131 is guided to the tip portion 131 a through the light guide 131, and is emitted from the tip portion 131 a. At the insertion tube tip portion 111 of the electronic endoscope 100, a light distribution lens 132 is arranged to face the tip portion 131 a of the light guide 131. The illumination light IL emitted from the tip portion 131 a of the light guide 131 passes through the light distribution lens 132, and illuminates the biological tissue T near the insertion tube tip portion 111.
An objective optical system 121 and an image pick-up device 141 is provided at the insertion tube tip portion 111. A portion of light which is reflected or scattered by the surface of the biological tissue T (return light) is incident on the objective optical system 121 and condensed, and forms an image on a light-receiving surface of the image pick-up device 141. The image pick-up device 141 of the present embodiment is a color image photographing CCD (Charge Coupled Device) image sensor comprising a color filter 141 a on a light-receiving surface thereof, but other types of image pick-up device such as CMOS (Complementary Metal Oxide Semiconductor) image sensor may also be used. The color filter 141 a is a so-called on-chip filter, in which an R filter that transmits red light, a G filter that transmits green light, and a B filter that transmits blue light are arranged, which is directly formed on each light-receiving element of the image pick-up device 141. Each of the R filter, G filter and B filter has a spectral property shown in FIG. 3. That is, the R filter of the present embodiment is a filter that transmits light having wavelengths of longer than about 570 nm, the G filter is a filter that transmits light having wavelengths of between about 470-620 nm, and the B filter is a filter that transmits light having wavelengths of shorter than about 530 nm.
The image pick-up device 141 is controlled to drive in synchronization with a signal processing circuit 550 which will be described later, and periodically (e.g., at 1/30 seconds interval) outputs imaging signals corresponding to an image formed on the light-receiving surface. The imaging signals which are outputted from the image pick-up device 141 are sent to the image processor unit 500 of the processor 200 via a cable 142.
The image processor unit 500 comprises an A/D conversion circuit 510, a temporary memory 520, a controller 530, a video memory 540 and a signal processing circuit 550. The A/D conversion circuit 510 executes A/D conversion to the image signals transmitted from the image pick-up device 141 of the electronic endoscope 100 via the cable 142 to output digital image data. The digital image data outputted from the A/D conversion circuit 510 is transmitted to and stored in the temporary memory 520. The digital image data (imaging signals) includes R digital image data (R imaging signal) which is imaged by the light-receiving element to which the R filter is provided, G digital image data (G imaging signal) which is taken by the light-receiving element to which the G filter is provided, and B digital image data (B imaging signal) which is taken by the light-receiving element to which the B filter is provided.
The controller 530 processes a piece of or a plurality of pieces of image data stored in the temporary memory 520 to generate one piece of display image data, and transmits the display image data to the video memory 540. For example, the controller 530 generates display image data such as display image data generated from a piece of digital image data, display image data in which a plurality of pieces of image data are arranged, or display image data in which healthy regions and lesion regions are identified or a graph of a reflection spectrum of the biological tissue T corresponding to a specific pixel (x, y) is displayed by generating a reflection spectrum of the biological tissue T for each pixel (x, y) on the basis of a plurality of pieces of digital image data, and stores them in the video memory 540. The signal processing circuit 550 generates video signals having a predetermined format (e.g., a format which conforms to NTSC or DVI standard) on the basis of the display image data stored in the video memory 540, and outputs the video signals. The video signals outputted from the signal processing circuit 550 is inputted to the monitor 300. As a result, endoscopic images taken by the electronic endoscope 100 and the like are displayed on the monitor 300.
As described above, the processor 200 has both a function as a video processor for processing the image signals outputted from the image pick-up device 141 of the electronic endoscope 100, and a function as a light source device for supplying illumination light IL to the light guide 131 of the electronic endoscope 100 to illuminate the biological tissue T being an object.
Other than the above-mentioned light source 430, the light source unit 400 comprises a collimator lens 440, a rotating filter 410, a filter control unit 420 and a condenser lens 450. The white light WL emitted from the light source 430 is converted by the collimator lens 440 into a collimated beam, transmits through the rotating filter 410, and then is incident on the end portion 131 b of the light guide 131 by the condenser lens 450.
The rotating filter 410 is a circular plate type optical unit comprising a plurality of optical filters, and is configured such that a transmission wavelength range thereof changes in accordance with the rotation angle thereof. The rotation angle of the rotating filter 410 is controlled by the filter control unit 420 connected to the controller 530. The spectrum of the illumination light supplied to the light guide 131 through the rotating filter 410 can be switched by the controller 530 controlling the rotation angle of the rotating filter 410 via the filter control unit 420.
FIG. 4 is an external view (front view) of the rotating filter 410. The rotating filter 410 comprises a substantially circular plate shaped frame 411, and four fan-shaped optical filters 415, 416, 417, and 418. Around the central axis of the frame 411, four fan-shaped windows 414 a, 414 b, 414 c, and 414 d are formed at regular intervals, and the optical filters 415, 416, 417, and 418 are fit into each of the windows 414 a, 414 b, 414 c, and 414 d, respectively. It is noted that, although the optical filters of the present embodiment are all dielectric multilayer film filters, other types of optical filters (e.g., absorbing type optical filters or etalon filters in which dielectric multilayers are used as reflecting layers) may also be used.
Also, a boss hole 412 is formed on the central axis of the frame 411. An output axis of a servo motor (not shown) included in the filter control unit 420 is inserted and fixed to the boss hole 412, and the rotating filter 410 rotates along with the output axis of the servo motor.
FIG. 4 shows a state in which the white light WL is incident on the optical filter 415. However, as the rotating filter 410 rotates in a direction indicated by an arrow, the optical filter on which the white light WL is incident changes to 415, 416, 417, 418 in this order, and thus the spectrum of the illumination light IL that transmits the rotating filter 410 can be switched.
The optical filters 415 and 416 are optical band-pass filters that selectively transmit light of 550 nm band. As shown in FIG. 1, the optical filter 415 is configured to transmit light which is inside the wavelength range between isosbestic points E1 and E4 (i.e., wavelength range R0) with low loss, and to cut off light which is outside the wavelength range. Also, the optical filter 416 is configured to transmit light which is inside the wavelength range between isosbestic points E2 and E3 (i.e., wavelength range R2) with low loss, and to cut off light which is outside the wavelength range.
The transmission wavelength ranges of the optical filters 415 and 416 (FIG. 1) are included in a transmission wavelength range of the G filter of the color filter 141 a (FIG. 3). Therefore, an image which is formed by light that transmitted through the optical filter 415 or 416 is taken by the light-receiving element to which the G filter is provided, and is acquired as the G digital image data (G imaging signal).
The optical filter 417 is designed to selectively transmit only light of 650 nm band (630-650 nm) being a wavelength range in which an absorbance of hemoglobin in the biological tissue T is low. The transmission wavelength range of the optical filter 417 is included in a transmission wavelength range of the R filter of the color filter 141 a (FIG. 3). Therefore, an image which is formed by light that transmitted through the optical filter 417 is taken by the light-receiving element to which the R filter is provided, and is acquired as the R digital image data (R imaging signal). The image data acquired by using the illumination light of 650 nm band is used in a standardization process which will be explained later.
Also, the optical filter 418 is an ultraviolet cut filter, and the illumination light IL (i.e., a white light) that transmitted through the optical filter 418 is used for taking normal observation images. It is noted that the rotating filter 410 may be configured without the optical filter 418 to leave the window 414 d of the frame 411 open.
To the window 414 a, a dimmer filter 419 is provided over the optical filter 415. The dimmer filter 419 does not have wavelength dependency throughout the visible light range and thus only decreases a light amount of the illumination light IL without changing the spectrum thereof. The light amount of the illumination light IL that transmitted through the optical filter 415 and the dimmer filter 419 are adjusted to a light amount substantially equivalent to a light amount of the illumination light IL that transmitted through the optical filter 416 by using the dimmer filter 419. Thus, images can be taken with a proper exposure with the same exposure time in both a case where the illumination light IL that passed through the optical filter 415 is used and a case where the illumination light IL that passed through the optical filter 416 is used.
In the present embodiment, a metal mesh having a fine mesh size is used as the dimmer filter 419. Apart from the metal mesh, other types of dimmer filter such as a half mirror type may be used. Further, transmittances of the optical filters 415 and 416 themselves may be adjusted instead of using the dimmer filter. Further, dimmer filters may also be provided to the windows 414 c and 414 d. Further, central angles of the windows 414 a, 414 b, 414 c, and 414 d (i.e., aperture areas) may be changed to adjust transmitting light amounts. Further, the exposure time may be changed for each optical filter instead of using the dimmer filter.
At the periphery of the frame 411, a through hole 413 is formed. The through hole 413 is formed at a position that is same as a position of boundary between the windows 414 a and 414 d in the rotating direction of the frame 411. Around the frame 411, a photo interrupter 422 for detecting the through hole 413 is arranged such that the photo interrupter 422 surrounds a portion of the periphery of the frame 411. The photo interrupter 422 is connected to the filter control unit 420.
The endoscope device 1 of the present embodiment has four operation modes of a normal observation mode, a spectral analysis (oxygen saturation distribution image displaying) mode, a baseline measuring mode and a calibration mode. The normal observation mode is an operation mode in which a color image is taken using a white light that transmitted through the optical filter 418. The spectral analysis mode is a mode in which a spectral analysis is carried out on the basis of the digital image data taken using illumination light that transmitted through the optical filters 415, 416 and 417, and a distribution image of biomolecules in a biological tissue (e.g., oxygen saturation distribution image) is displayed. The baseline measuring mode is a mode in which an image of a color reference board such as a colorless diffusion board (e.g., frosted glass) or reference reflection board is taken as an object using illumination light that passed through the optical filters 415, 416 and 417, before (or after) executing the actual endoscopic observation, to acquire data to be used in a standardization process which will be described later. The calibration mode is a process in which a spectral analysis is carried out for a sample of which properties such as the oxygen saturation is known, and a parameter (correction coefficient k which will be described later) is adjusted such that there is no difference between the analysis result and the theoretical value.
In the normal observation mode, the controller 530 controls the filter control unit 420 to immobilize the rotating filter 410 at a position where the white light WL is incident on the optical filter 418. Then, the digital image data taken by the image pick-up device 141 is converted to video signals after performing image processes as necessary, and is displayed on the monitor 300.
In the spectral analysis mode, the controller 530 controls the filter control unit 420 to drive the rotating filter 410 to rotate at constant rotation speed while sequentially taking images of the biological tissue T using illumination light that transmitted through the optical filters 415, 416, 417 and 418. Then, an image indicating distribution of biomolecules in the biological tissue is generated on the basis of digital image data acquired using each of the optical filters 415, 416 and 417. Then, a display image in which the distribution image and a normal observation image acquired by using the optical filter 418 are arranged is generated and converted to video signals, and is displayed on the monitor 300.
In the spectral analysis mode, the filter control unit 420 detects a rotational phase of the rotating filter 410 on the basis of timing the photo interrupter 422 detects the through hole 413, compares the rotational phase to a phase of a timing signal supplied by the controller 530, and adjusts the rotational phase of the rotating filter 410. The timing signal from the controller 530 is synchronized with a driving signal for the image pick-up device 141. Therefore, the rotating filter 410 is driven to rotate at a substantially constant rotation speed in synchronization with the driving of the image pick-up device 141. Specifically, the rotation of the rotating filter 410 is controlled such that the optical filter 415, 416, 417 or 418 (window 414 a, b, c or d) on which the white light WL is to be incident switches each time one image (three frames: R, G and B) is taken by the image pick-up device 141.
In the baseline measuring mode, the controller 530 controls the filter control unit 420 to rotate the rotating filter 410 while sequentially taking images of the color reference board using the illumination light IL that transmitted through the optical filters 415, 416 and 417. Each piece of the G digital image data taken using the illumination light IL that transmitted through the optical filters 415 and 416 is stored in an internal memory 531 of the controller 530 as baseline image data BL415 (x, y) and BL416 (x, y), respectively. Further, the R digital image data taken using the illumination light IL that transmitted through the optical filter 417 is stored in the internal memory 531 of the controller 530 as baseline image data BL417 (x, y).
Next, an image generation process executed by the image processor unit 500 in the spectral analysis mode will be described. FIG. 5 is a flow chart explaining the image generation process.
When the spectral analysis mode is selected by a user's operation, as described above, the filter control unit 420 drives the rotating filter 410 to rotate at constant rotation speed. Then, from the light source unit 400, the illumination light IL that transmitted through the optical filters 415, 416, 417 and 418 are sequentially supplied, and an image is sequentially taken using each of the illumination light IL (S1). Specifically, G digital image data G415 (x, y) taken using the illumination light IL that transmitted through the optical filter 415, G digital image data G416 (x, y) taken using the illumination light IL that transmitted through the optical filter 416, R digital image data R417 (x, y) taken using the illumination light IL that transmitted through the optical filter 417, and R digital image data R418 (x, y), G digital image data G418 (x, y) and B digital image data B418 (x, y) taken using the illumination light IL that transmitted through the optical filter (ultraviolet cut filter) 418 are stored in an internal memory 532 of the controller 530.
Then, the image processor unit 500 executes a pixel selection process S2 for selecting pixels to be targets of the following analyzing processes (processes S3-S7) by using the R digital image data R418 (x, y), G digital image data G418 (x, y) and B digital image data B418 (x, y) acquired in the process S1. Even if the oxygen saturations or blood flow rates are calculated from color information of pixels corresponding to portions which do not contain blood or portions which colors of tissues are dominantly influenced by substances other than hemoglobin, meaningful values cannot be obtained and thus the values becomes mere noises. Calculating and providing such noises not only disturbs diagnosis by the doctor but also causes a bad effect by applying useless load to the image processor unit 500 to deteriorate processing speed. Therefore, the image generating process of the present embodiment is configured to select pixels that are appropriate to the analyzing process (i.e., pixels to which the spectral property of hemoglobin is recorded) and to execute the analyzing process to the selected pixels.
In the pixel selection process S2, only pixels which satisfy all the conditions expressed in Expression 11, Expression 12 and Expression 13 are selected as the targets of the analyzing process.
B 418(x,y)/G 418(x,y)>a 1  (EXPRESSION 11)
R 418(x,y)/G 418(x,y)>a 2  (EXPRESSION 12)
R 418(x,y)/B 418(x,y)>a 3  (EXPRESSION 13)
where a1, a2 and a3 are positive constants.
The above three conditional expressions are set on the basis of a value size relation, G component<B component<R component, in a transmission spectrum of blood. It is noted that the pixel selection process S2 may be executed using one or two of the above three conditional expressions (e.g., using Expression 12 and Expression 13 by focusing on a red color that is specific to blood).
Then, the image processor unit 500 executes the standardization process. The standardization process of the present embodiment includes a first standardization process S3 for correcting properties of the endoscope device 1 itself (e.g., transmittances of the optical filters and light receiving sensitivities of the image pick-up devices) and a second standardization process S4 for correcting reflectivity variations due to differences in surface states of the biological tissue T being an object and due to angles of incidence of the illumination light IL to the biological tissue T.
In the standardization process, the image processor unit 500 calculates a standardized reflectivity SR415 (x, y) using the following Expression 14 by using the G digital image data G415 (x, y) taken using the illumination light IL that transmitted through the optical filter 415, the R digital image data R417 (x, y) taken using the illumination light IL that transmitted through the optical filter 417, and the baseline image data BL415 (x, y) and BL417 (x, y). It is noted that a component that is dependent on the properties of the endoscope device 1 (instrumental function) is removed by dividing each of the digital image data G415 (x, y) and R417 (x, y) by the respective baseline image data BL415 (x, y) and BL417 (first standardization process S3). Also, the reflectivity variations due to differences in surface states of the biological tissue T and angles of incidence of the illumination light to the biological tissue T is corrected by dividing the G digital image data G415 (x, y) by the R digital image data R417 (x, y) (second standardization process S4).
SR 415 ( x , y ) = G 415 ( x , y ) / BL 415 ( x , y ) R 417 ( x , y ) / BL 417 ( x , y ) ( EXPRESSION 14 )
Similarly, a standardized reflectivity SR416 (x, y) is calculated using the following Expression 15.
SR 416 ( x , y ) = G 416 ( x , y ) / BL 416 ( x , y ) R 417 ( x , y ) / BL 417 ( x , y ) ( EXPRESSION 15 )
Absorbances A415 (x, y) and A416 (x, y) of the biological tissue T with respect to the illumination light IL that transmitted through the optical filters 415 and 416 are calculated using the following Expressions 16 and 17 (S5).
A 415(x,y)=−log[SR 415(x,y)]  (EXPRESSION 16)
A 416(x,y)=−log[SR 416(x,y)]  (EXPRESSION 17)
It is noted that the absorbances A415 (x, y) and A416 (x, y) can be approximately calculated using the following Expressions 18 and 19.
A 415(x,y)=−SR 415(x,y)  (EXPRESSION 18)
A 416(x,y)=−SR 416(x,y)  (EXPRESSION 19)
Furthermore, the spectral analysis can be executed simply by eliminating the above mentioned standardization processes (S3, S4). In this case, the absorbances A415 (x, y) and A416 (x, y) are calculated using the following Expressions 20 and 21.
A 415(x,y)=−log G 415(x,y)  (EXPRESSION 20)
A 416(x,y)=−log G 416(x,y)  (EXPRESSION 21)
Also, in this case, the absorbances A415 (x, y) and A416 (x, y) can be approximately calculated using the following Expressions 22 and 23, respectively.
A 415(x,y)=−G 415(x,y)  (EXPRESSION 22)
A 416(x,y)=−G 416(x,y)  (EXPRESSION 23)
Furthermore, as is obvious from the relationships between the absorption wavelength ranges R1, R2 and R3 of hemoglobin and the transmission wavelength ranges of the optical filters 415 and 416 shown in FIG. 1, absorbances AR1 (x, y), AR2 (x, y) and AR3 (x, y) of the biological tissue T with respect to the wavelength ranges R1, R2 and R3 and the absorbances A415 (x, y) and A416 (x, y) of the biological tissue T with respect to the illumination light IL that transmitted through the optical filters 415 and 416 have relationships expressed in the following Expressions 24 and 25.
A R1(x,y)+A R3(x,y)=A 415(x,y)−kA 416(x,y)  (EXPRESSION 24)
A R2(x,y)=kA 416(x,y)  (EXPRESSION 25)
Therefore, the index X (Expression 10) is expressed by the following Expression 26.
( EXPRESSION 26 ) X ( x , y ) = [ A R 1 ( x , y ) + A R 3 ( x , y ) ] - A R 2 ( x , y ) = [ A 415 ( x , y ) - kA 416 ( x , y ) ] - kA 416 ( x , y ) = A 415 ( x , y ) - 2 kA 416 ( x , y )
Here, k is a constant (correction coefficient). Since the width of the transmission wavelength ranges of the optical filters 415 and 416 differ significantly, the light amounts that transmit through the two filters also differ significantly. Therefore, as mentioned above, the dimmer filter 419 is provided over the optical filter 415, which has a large transmitting light amount, to control the light amount so that a proper exposure can be obtained with the same exposure time even if the optical filter is switched. As a result, a quantitative relationship between the absorbance A415 (x, y) acquired using the optical filter 415 and the absorbance A416 (x, y) acquired using the optical filter 416 is broken. Also, the transmittances of the optical filters 415 and 416 within the transmission wavelength ranges are not 100% and the optical filters 415 and 416 have transmission losses that vary depending thereon. Furthermore, there are errors in the transmission wavelength ranges of the optical filters 415 and 416. Therefore, even if the dimmer filter 419 is not used, the quantitative relationship between the absorbance A415 (x, y) and the absorbance A416 (x, y) includes a constant error. The correction coefficient k is a constant for correcting the error of the quantitative relationship between the absorbance A415 (x, y) and the absorbance A416 (x, y). A method for acquiring the correction coefficient k will be described later. It is noted that, in case this correction is not executed, the correction coefficient k is set at 1.
Further, the following Expression 27 can be obtained by arranging Expression 26 using Expressions 16 and 17.
( EXPRESSION 27 ) X = - log [ SR 415 ( x , y ) ] + 2 k log [ SR 416 ( x , y ) ] = - log [ G 415 ( x , y ) / BL 415 ( x , y ) R 417 ( x , y ) / BL 417 ( x , y ) ] + 2 k log [ G 416 ( x , y ) / BL 416 ( x , y ) R 417 ( x , y ) / BL 417 ( x , y ) ] = - { [ log G 415 ( x , y ) - log BL 415 ( x , y ) ] - [ log R 417 ( x , y ) - log BL 417 ( x , y ) ] } + 2 k { [ log G 416 ( x , y ) - log BL 416 ( x , y ) ] - [ log R 417 ( x , y ) - log BL 417 ( x , y ) ] } = - [ log G 415 ( x , y ) - log BL 415 ( x , y ) ] + 2 k [ log G 416 ( x , y ) - log BL 416 ( x , y ) ] + ( 1 - 2 k ) [ log R 417 ( x , y ) - log BL 417 ( x , y ) ]
Therefore, the value of index X can be calculated from the G digital image data G415 (x, y) and G416 (x, y), R digital image data R417 (x, y), and the baseline image data BL415 (x, y), BL416 (x, y) and BL417 (x, y) by using Expression 27 (S6).
Further, the index X can also be approximately calculated using the following Expression 28.
X=−log[SR 415(x,y)]+2k log[SR 416(x,y)]≅−SR 415(x,y)+2kSR 416(x,y)  (EXPRESSION 28)
A value list indicating the quantitative relationship between the oxygen saturation and the index X experimentally acquired in advance is stored in a non-volatile memory 532 provided to the controller 530. The controller 530 refers to this value list to acquire an oxygen saturation SatO2 (x, y) which corresponds to a value of the index X calculated using Expression 27 or 28. Then, the controller 530 generates image data (oxygen saturation distribution image data) of which pixel value of each pixel (x, y) is a value obtained by multiplying the acquired oxygen saturation SatO2 (x, y) by a predetermined value (S7).
Also, the controller 530 generates normal observation image data from the R digital image data R418 (x, y), G digital image data G418 (x, y) and B digital image data B418 (x, y) acquired using the illumination light IL (white light) that transmitted through the optical filter (ultraviolet cut filter) 418. FIG. 7 shows display examples of image data generated by the controller 530. FIG. 7 (a) is an exemplary displayed image of the normal observation image data, and FIG. 7 (b) is an exemplary display image of the oxygen saturation distribution image data.
Further, the controller 530 generates screen image data for arranging and displaying the normal observation image and the oxygen saturation distribution image on a single screen from the generated oxygen saturation distribution image data and normal observation image data, and stores the screen data in the video memory 540. It is noted that the controller 530 can generate a variety of screen images such as a screen image that only displays the oxygen saturation distribution image, a screen image that only displays the normal observation image, or a screen image on which associated information such as patient's ID information or observation condition is superimposed on the oxygen saturation distribution image and/or the normal observation image in accordance with the user's operations.
Next, a method for determining the correction coefficient k in the calibration mode will be described. In the present embodiment, a theoretically calculated index X and a measured index X are compared, and the correction coefficient k is determined such that the measured index X becomes closest to the theoretically calculated index X.
FIG. 6 shows exemplary calibration curves used to determine the correction coefficient k in the embodiment of the present invention. FIG. 6 (a) is an example of a common calibration curve of which the horizontal axis is the theoretical index X and the vertical axis is the measured index X acquired by the above explained analyzing process. The filled circles are plots of the measured values, and the broken line Ma is a straight line fitted to the measured value by a least-square method. Further, the solid line shows a reference line Ref representing plots in case measured values equivalent to the theoretical values are obtained.
The measured index X is acquired by the analyzing process using a sample of a biological tissue of which the oxygen saturation is known (e.g., blood). Further, the theoretical index X defined by Expression 26 is calculated using transmission spectra of the optical filters 415 and 416 to be actually used and a reflection spectrum (or absorption spectrum) of blood. Specifically, the theoretical index X is calculated using Expression 26 by using a value obtained by multiplying the transmission spectrum of the optical filter 415 (optical filter 416) by the reflection spectrum of blood and integrating the product as the absorbance A415 (absorbance A416).
A discrepancy between the Reference line Ref and the measured value Ma is expressed as a gradient of the calibration curve. A phenomenon of which sufficient sensitivity cannot be obtained, that is, a phenomenon of which the gradient is small, is due to an inappropriate quantitative relationship between the absorbance A415 (x, y) and the absorbance A416 (x, y) in Expression 26, caused by the use of the dimmer filter 419. By selecting an appropriate value as the correction coefficient k, an error caused by the dimmer filter 419 can be corrected, and thus a state in which an error between the measured index X and the theoretical index X is minimized and the measured index X has the highest correlational relationship with the theoretical index X can be achieved.
FIG. 6 (b) is a variation of the calibration curve. In the calibration curve shown in FIG. 6 (b), the horizontal axis is the oxygen saturation of a sample, and the vertical axis is the index X. The filled circles are plots of the measured values, and the broken line Ma is a straight line fitted to the measured value by a least-square method. Further, the solid line Mb shows the theoretically calculated values. It is noted that the oxygen saturations of the sample are correctly measured values acquired from an ideal spectrometry. Being a curve obtained by changing the horizontal scale of the calibration curve shown in FIG. 6 (a), this calibration curve is substantially equivalent to the curve of FIG. 6 (a), but there is an advantage that a correct relationship with the oxygen saturation can be easily read.
It is noted that, although the above-explained method for determining the correction coefficient k using the calibration curve is a method in which analysis results of a plurality of samples having different oxygen saturations are used, the correction coefficient k can also be determined using an analysis result from only one sample.
Also, focusing on the absorption wavelength ranges R1, R2 and R3 of hemoglobin (i.e., the transmission wavelength of the optical filter 415), the absorbances AR1 (x, y), AR2 (x, y) and AR3 (x, y) change in accordance with the change in the oxygen saturation, but a sum Y of these absorbances (shown in Expression 29) is substantially constant. Furthermore, since the sum Y of the absorbances is in proportion to a total amount of hemoglobin (a sum of oxyhemoglobin HbO2 and deoxyhemoglobin Hb) in a biological tissue, it is reasonable to use the sum Y as an index for the total amount of hemoglobin.
Y(x,y)=A R1(x,y)+A R2(x,y)+A R3(x,y)=A 415  (EXPRESSION 29)
It is known that, in a tissue of a malignant tumor, the total amount of hemoglobin is greater than that of a healthy tissue due to angiogenesis and the oxygen saturation is lower than that of a healthy tissue due to notable oxygen metabolism. Therefore, the controller 530 can extract pixels of which the index Y, calculated using Expression 29 and indicating the total amount of hemoglobin, is greater than a predetermined reference value (first reference value) and the index X, calculated using Expression 25 and indicating the oxygen saturation, is smaller than a predetermined reference value (second reference value); generate, for example, lesion region highlighting image data in which highlighting process is executed to pixels corresponding to the extracted pixels in the normal observation image data; and display the lesion region highlighting image along with the normal observation image and/or the oxygen saturation distribution image (or alone) on the monitor 300.
Exemplary highlighting process includes a process for increasing pixel values of corresponding pixels, a process for changing color phases (for example, a process for increasing the R component to change to a reddish color or a process for rotating the color phase for a predetermined angle), and a process for making the corresponding pixels blink (or periodically changing the color phase).
Further, for example, the controller 530 may be configured to calculate an index Z (x, y) indicating a probability of being a malignant tumor on the basis of a deviation from an average of the index X (x, y) and a deviation from an average of the index Y (x, y), and to generate image data with the index Z (x, y) as pixel values (malign probability image data) instead of the lesion region highlighting image data.
The above is an explanation of an embodiment of the present invention and specific examples of the embodiment. However, the present invention is not limited to the above configuration and various modifications are possible within the technical ideas of the present invention.
In the above embodiment, the pixel value of the oxygen saturation distribution image is calculated by acquiring an oxygen saturation value from the value list in accordance with a value of the index X and by multiplying the oxygen saturation by a predetermined constant, but the present invention is not limited to this configuration. Since the index X is a value that monotonically increases with the oxygen saturation, the index X itself (or the index X multiplied by a predetermined constant) may be used as a pixel value of the oxygen saturation distribution image.
Further, the image pick-up device 141 of the present embodiment is explained as an image pick-up device for taking color images comprising primary color filters R, G, B on its front face, but the image pick-up device is not limited to this configuration. For example, an image pick-up device for taking color images comprising complementary color filters Y, Cy, Mg, G may be used.
Further, the image pick-up device 141 of the present embodiment is explained as a pick-up device for taking color images comprising an on-chip color filter 141 a, but the image pick-up device is not limited to this configuration. For example, an image pick-up device for taking black-and-white images may be used to configure an image pick-up device comprising a so-called frame sequential type color filter. Also, the color filter 141 a is not limited to an on-chip configuration but may be positioned on a light path between the light source 430 and the image pick-up device 141.
Further, in the above embodiment, the rotating filter 410 is used, but the present invention is not limited to this configuration. Other types of wavelength variable filter of which transmission wavelength can be switched may also be used.
Further, in the above embodiment, a configuration in which the rotating filter 410 is provided at the light source side and the illumination light IL is filtered, but the present invention is not limited to this configuration. The rotating filter 410 may be provided at the image pick-up device side (for example, between the objective optical system 121 and the image pick-up device 141) and configured to filter a return light from an object.
Further, in the above embodiment, a configuration in which the rotating filter 410 is rotated at constant rotation speed while taking images at predetermined time intervals in the spectral analysis mode is adopted, but the present invention is not limited to this configuration. For example, a device may be configured such that the rotating position of the rotating filter 410 changes step by step at predetermined time intervals and images are taken while the rotation of the rotating filter is stopped.
Further, the above embodiment is an example in which the present invention is applied to an electronic endoscope device being a form of a digital camera, but the present invention can also be applied to systems that use other types of digital camera (e.g., digital single lens reflex camera or digital video camera). For example, if the present invention is applied to a digital still camera, observation of surface tissue or observation of brain tissue during craniotomy (e.g., a quick inspection of cerebral blood flow) can be performed.
DESCRIPTION OF SYMBOLS
  • 1 spectral endoscope device
  • 100 electronic endoscope
  • 110 insertion tube
  • 111 insertion tube tip portion
  • 121 objective optical system
  • 131 light guide
  • 131 a tip portion
  • 131 b end portion
  • 132 lens
  • 141 image pick-up device
  • 141 a color filter
  • 142 cable
  • 200 processor for electronic endoscope
  • 300 monitor
  • 400 light source unit
  • 410 rotating filter
  • 420 filter control unit
  • 430 light source
  • 440 collimator lens
  • 450 condenser lens
  • 500 image processor unit
  • 510 A/D conversion circuit
  • 520 temporary memory
  • 530 controller
  • 540 video memory
  • 550 signal processing circuit

Claims (3)

What is claimed is:
1. A device that generates a distribution image showing a molar concentration ratio between a first biological substance and a second biological substance included in a biological tissue of which an absorption spectrum within a predetermined wavelength range has a first isosbestic point, a second isosbestic point, a third isosbestic point and a fourth isosbestic point, wherein the wavelengths of the first, second, third and fourth isosbestic points are about 528 nm, about 546 nm, about 570 nm, and about 584 nm respectively, the device comprising:
a light source which emits white light;
a first optical filter configured to selectively transmit, from the white light, light within a wavelength range from the first isosbestic point to the fourth isosbestic point, and not to transmit light outside the wavelength range, the wavelength range including a first wavelength range from the first isosbestic point to the second isosbestic point, a second wavelength range from the second isosbestic point to the third isosbestic point, and a third wavelength range from the third isosbestic point to the fourth isosbestic point;
a second optical filter configured to selectively transmit light within the second wavelength range from the white light, and not to transmit light outside the second wavelength range;
a controller configured to sequentially insert the first optical filter and the second optical filter one after another, into a light path of the white light emitted by the light source;
an image pick-up device configured to take a first image of the biological tissue using the light transmitted through the first optical filter and a second image of the biological tissue using the light transmitted through the second optical filter; and
an image processor configured to generate the distribution image on the basis of the first image and the second image;
wherein the first and second biological substances are oxyhemoglobin and deoxyhemoglobin,
wherein the molar concentration ratio of the first biological substance and the second biological substance included in the biological tissue is oxygen saturation,
wherein the first optical filter has a transmission wavelength range of about 528 nm-584 nm and the second optical filter has a transmission wavelength range of about 546 nm-570 nm, and
wherein the image processor generates the distribution image on the basis of the first image and the second image by acquiring a first absorbance of the biological tissue in a transmission wavelength range of the first optical filter on the basis of the first image, acquiring a second absorbance of the biological tissue in a transmission wavelength range of the second optical filter on the basis of the second image, and calculating an index X, as X=A1−2kA2 where k is a constant, A1 is the first absorbance, A2 is the second absorbance; and generating the distribution image on the basis of the index X.
2. The device according to claim 1 comprising an endoscope device including an endoscope provided with the image pick-up device at a tip portion of the endoscope.
3. The device according to claim 1,
wherein the predetermined wavelength range is a Q band of hemoglobin, and
wherein the first image and the second image are images taken by a light-receiving element, to which a G filter is provided, included in the device provided with an RGB color filter.
US14/894,119 2013-05-30 2014-05-28 Method and device for generating image showing concentration distribution of biological substances in biological tissue Active 2037-03-05 US10722155B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013114703 2013-05-30
JP2013-114703 2013-05-30
PCT/JP2014/064055 WO2014192781A1 (en) 2013-05-30 2014-05-28 Method and device for generating image showing concentration distribution of biological substances in biological tissue

Publications (2)

Publication Number Publication Date
US20160120449A1 US20160120449A1 (en) 2016-05-05
US10722155B2 true US10722155B2 (en) 2020-07-28

Family

ID=51988806

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/894,119 Active 2037-03-05 US10722155B2 (en) 2013-05-30 2014-05-28 Method and device for generating image showing concentration distribution of biological substances in biological tissue

Country Status (5)

Country Link
US (1) US10722155B2 (en)
EP (1) EP3005933B8 (en)
JP (1) JP6356122B2 (en)
CN (1) CN105324064B (en)
WO (1) WO2014192781A1 (en)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014036759A (en) 2012-08-17 2014-02-27 Hoya Corp Electronic endoscope system and light source device for endoscope
JP6356122B2 (en) 2013-05-30 2018-07-11 Hoya株式会社 Method and apparatus for operating apparatus for generating image showing concentration distribution of biological substance in biological tissue
JP6204314B2 (en) * 2014-09-03 2017-09-27 Hoya株式会社 Electronic endoscope system
JP6356051B2 (en) * 2014-11-21 2018-07-11 Hoya株式会社 Analytical apparatus and method of operating analytical apparatus
JP6336949B2 (en) * 2015-01-29 2018-06-06 富士フイルム株式会社 Image processing apparatus, image processing method, and endoscope system
WO2016121811A1 (en) * 2015-01-29 2016-08-04 富士フイルム株式会社 Image processing device, image processing method, and endoscope system
JP2016152872A (en) * 2015-02-20 2016-08-25 Hoya株式会社 Light source apparatus
KR102548196B1 (en) * 2015-02-25 2023-06-29 아웃센스 다이아그나스틱스 엘티디. Bodily emission analysis
JP6584147B2 (en) * 2015-05-28 2019-10-02 Hoya株式会社 Imaging device
WO2017051779A1 (en) * 2015-09-24 2017-03-30 Hoya株式会社 Analysis device
WO2017078085A1 (en) * 2015-11-02 2017-05-11 Hoya株式会社 Endoscope system and analyzing device
WO2017119239A1 (en) * 2016-01-08 2017-07-13 Hoya株式会社 Endoscope device
JP6437943B2 (en) * 2016-03-07 2018-12-12 富士フイルム株式会社 Endoscope system, processor device, and operation method of endoscope system
JP6570484B2 (en) 2016-07-04 2019-09-04 Hoya株式会社 Analysis equipment
WO2018037505A1 (en) * 2016-08-24 2018-03-01 Hoya株式会社 Endoscope system
EP3915488A1 (en) 2016-08-30 2021-12-01 Outsense Diagnostics Ltd. Bodily emission analysis
CN109475282B (en) * 2016-09-02 2021-08-31 Hoya株式会社 Endoscope system
DE112017004411T5 (en) 2016-09-02 2019-05-23 Hoya Corporation ELECTRONIC ENDOSCOPY SYSTEM
US10827914B2 (en) 2016-09-02 2020-11-10 Hoya Corporation Endoscope system and characteristic amount calculation method
US10905318B2 (en) 2016-10-14 2021-02-02 Hoya Corporation Endoscope system
WO2018131631A1 (en) * 2017-01-16 2018-07-19 Hoya株式会社 Endoscope system and image display device
EP3590412A4 (en) * 2017-03-03 2020-06-03 Fujifilm Corporation Endoscope system, processor device, and endoscope system operation method
JP6774550B2 (en) * 2017-03-03 2020-10-28 富士フイルム株式会社 Endoscope system, processor device, and how to operate the endoscope system
WO2018163570A1 (en) 2017-03-06 2018-09-13 富士フイルム株式会社 Endoscope system and method of operating same
CN107907523B (en) * 2017-10-13 2020-02-14 中国科学院上海技术物理研究所 Cryopreservation serum analysis method for constant-low-temperature equidistant spiral multipoint ultraviolet spectrum
WO2020045619A1 (en) * 2018-08-31 2020-03-05 Hoya株式会社 Endoscope system, and method of operating endoscope system
JP7187379B2 (en) 2019-04-25 2022-12-12 ミドリ電子株式会社 INSULATION MONITORING DEVICE, ACCURACY TESTING DEVICE FOR INSULATION MONITORING DEVICE, ACCURACY TESTING METHOD AND PROGRAM FOR INSULATION MONITORING DEVICE
US11191460B1 (en) * 2020-07-15 2021-12-07 Shani Biotechnologies LLC Device and method for measuring blood components

Citations (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3972614A (en) * 1974-07-10 1976-08-03 Radiometer A/S Method and apparatus for measuring one or more constituents of a blood sample
JPS559755A (en) 1978-07-08 1980-01-23 Hitoshi Hatano Mannmade gatheringgplace for fish
US4324556A (en) * 1980-03-25 1982-04-13 The United States Of America As Represented By The Secretary Of The Navy Portable COHB analyzer
JPS583731A (en) 1981-06-30 1983-01-10 Aida Eng Ltd Fine blanking working machine press
JPS607857A (en) 1983-06-27 1985-01-16 テルモ株式会社 Abdominal membrane dialytic device
US5198977A (en) * 1990-11-27 1993-03-30 Jesse Salb System and method for localization of functional activity in the human brain
JPH0679594A (en) 1992-08-27 1994-03-22 Hitachi Cable Ltd Jig grind processing method for metal mold plate
US5408998A (en) * 1994-03-10 1995-04-25 Ethicon Endo-Surgery Video based tissue oximetry
US5494032A (en) * 1991-07-12 1996-02-27 Sandia Corporation Oximeter for reliable clinical determination of blood oxygen saturation in a fetus
JP2001314370A (en) 2000-05-08 2001-11-13 Olympus Optical Co Ltd Light source
JP2002095635A (en) 2000-07-21 2002-04-02 Olympus Optical Co Ltd Endoscope system
JP2002175702A (en) 2000-12-07 2002-06-21 Olympus Optical Co Ltd Light source device
US20020086432A1 (en) * 2000-12-28 2002-07-04 Tam Lisa A. Portable co-oximeter
US20020175993A1 (en) 2001-05-16 2002-11-28 Olympus Optical Co., Ltd. Endoscope system using normal light and fluorescence
US20030060684A1 (en) 2001-09-21 2003-03-27 Fuji Photo Optical Co., Ltd. Endoscope having red component cut filter
JP2003093343A (en) 2001-09-21 2003-04-02 Fuji Photo Optical Co Ltd Endoscope system
US20030158470A1 (en) 2000-09-18 2003-08-21 Sti Medical Systems, Inc. Dual mode real-time screening and rapid full-area, selective-spectral, remote imaging and analysis device and process
US20030176768A1 (en) 2000-07-21 2003-09-18 Kazuhiro Gono Endoscope apparatus
US20040075812A1 (en) * 2002-01-18 2004-04-22 Kardon Randy H. Device and method for optical imaging of retinal function
JP3559755B2 (en) 2000-07-27 2004-09-02 オリンパス株式会社 Endoscope device
JP3607857B2 (en) 2000-07-27 2005-01-05 オリンパス株式会社 Endoscope device
US20050027166A1 (en) 2003-06-17 2005-02-03 Shinya Matsumoto Endoscope system for fluorescent observation
US20060018031A1 (en) 2004-07-23 2006-01-26 Yoshiharu Takasugi Illumination optical system, illumination apparatus using the illumination optical system, and observation system provided with the illumination optical system or the illumination apparatus
JP2007029453A (en) 2005-07-27 2007-02-08 Olympus Medical Systems Corp Lighting device and observation device
WO2008093745A1 (en) 2007-01-31 2008-08-07 Olympus Corporation Fluorescence observation device for organism tissue
US20080312533A1 (en) * 2005-03-16 2008-12-18 Or-Nim Medical Ltd. Noninvasive Measurements in a Human Body
US20090069653A1 (en) 2007-09-12 2009-03-12 Canon Kabushiki Kaisha Measurement apparatus
US20090137908A1 (en) 2007-11-26 2009-05-28 Patwardhan Sachin V Multi-spectral tissue imaging
US20090225277A1 (en) * 2008-03-05 2009-09-10 Tamir Gil Snapshot Spectral Imaging of the Eye
WO2010044432A1 (en) 2008-10-17 2010-04-22 オリンパスメディカルシステムズ株式会社 Endoscope system and endoscopic image processing device
US20100140461A1 (en) * 2006-12-13 2010-06-10 Georgia Tech Research Corporation Systems and methods for real time multispectral imaging
US20100168584A1 (en) 2007-12-25 2010-07-01 Olympus Corporation Biological observation apparatus, biological observation method, and endoscopic apparatus
JP2011010998A (en) 2009-07-06 2011-01-20 Fujifilm Corp Lighting device for endoscope and endoscope apparatus
US7949387B2 (en) 2004-03-19 2011-05-24 Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College Method for evaluating relative oxygen saturation in body tissues
WO2011080996A1 (en) 2009-12-28 2011-07-07 オリンパス株式会社 Image processing device, electronic apparatus, program, and image processing method
WO2011099322A1 (en) 2010-02-10 2011-08-18 Hoya株式会社 Electronic endoscope system
US20110230715A1 (en) 2010-03-19 2011-09-22 Takaaki Saito electronic endoscope system, an electronic endoscope processor, and a method of acquiring blood vessel information
US20110237915A1 (en) 2010-03-26 2011-09-29 Hiroshi Yamaguchi Electronic endoscope system and processor unit thereof, and method for obtaining blood vessel information
US20110254937A1 (en) 2010-04-15 2011-10-20 Olympus Corporation Image processing device and program
WO2011162111A1 (en) 2010-06-25 2011-12-29 オリンパスメディカルシステムズ株式会社 Endoscope device
WO2012047806A1 (en) 2010-10-08 2012-04-12 Edwards Lifesciences Corporation System, method and computer program product for optical measurement of blood parameters
EP2449950A1 (en) 2010-11-09 2012-05-09 Fujifilm Corporation Endoscopic diagnosis system
US20120157768A1 (en) 2010-12-15 2012-06-21 Fujifilm Corporation Endoscope system, processor of endoscope system, and image producing method
EP2468187A1 (en) 2010-12-21 2012-06-27 Fujifilm Corporation Endoscope system and processor apparatus thereof, and method for generating images
WO2012090552A1 (en) 2010-12-27 2012-07-05 富士フイルム株式会社 Endoscopic diagnosis apparatus
JP2012143348A (en) 2011-01-11 2012-08-02 Fujifilm Corp Spectrometric system and spectrometry
US20120253158A1 (en) * 2011-04-01 2012-10-04 Hiroshi Yamaguchi Blood information measuring method and apparatus
US20120302847A1 (en) 2011-05-24 2012-11-29 Satoshi Ozawa Endoscope system and method for assisting in diagnostic endoscopy
JP2012235962A (en) 2011-05-13 2012-12-06 Hoya Corp Electric endoscope device
JP2012245223A (en) 2011-05-30 2012-12-13 Hoya Corp Electronic endoscope apparatus and spectral image optimization method
US20130039147A1 (en) 2010-01-25 2013-02-14 Russell S. Witte Ultrasonic/photoacoustic imaging devices and methods
JP2013039215A (en) 2011-08-15 2013-02-28 Fujifilm Corp Endoscope system, light source device, and control method of endoscope system
WO2013047054A1 (en) 2011-09-29 2013-04-04 Hoya株式会社 Diagnostic system
JP2013063097A (en) 2011-09-15 2013-04-11 Fujifilm Corp Endoscope system and light source device
US20130158413A1 (en) * 2011-12-15 2013-06-20 Nellcor Puritan Bennett Llc Optical measurement of physiological blood parameters
US20130162790A1 (en) 2010-02-10 2013-06-27 Hoya Corporation Electronic endoscope system
US20130245419A1 (en) 2012-03-13 2013-09-19 Canon Kabushiki Kaisha Subject information obtaining device, subject information obtaining method, and non-transitory computer-readable storage medium
JP5362149B1 (en) 2012-03-30 2013-12-11 オリンパスメディカルシステムズ株式会社 Endoscope device
US20130345517A1 (en) 2012-06-20 2013-12-26 Fujifilm Corporation Light source apparatus and endoscope system
US20140012113A1 (en) * 2012-07-06 2014-01-09 Fujifilm Corporation Endoscope system, processor device thereof, and method for controlling endoscope system
EP2689712A1 (en) 2012-07-24 2014-01-29 Fujifilm Corporation Endoscope system, processor device of endoscope system, and method for controlling display of endoscope image
EP2702938A1 (en) 2012-09-04 2014-03-05 Fujifilm Corporation Endoscope system, processor device thereof, and image processing method
CN103654687A (en) 2012-09-21 2014-03-26 富士胶片株式会社 Endoscope system, light source device for endoscope and manufacturing method of endoscope images
CN103654690A (en) 2012-09-26 2014-03-26 富士胶片株式会社 Endoscope system and motion control method thereof, and processor device
CN103796566A (en) 2011-09-05 2014-05-14 富士胶片株式会社 Endoscope system and image display method
US20140235973A1 (en) 2011-09-15 2014-08-21 The Trustees Of Columbia University In The City Of New York Measurement of a fluorescent analyte using tissue excitation
WO2014192781A1 (en) 2013-05-30 2014-12-04 Hoya株式会社 Method and device for generating image showing concentration distribution of biological substances in biological tissue
JP2014230647A (en) 2013-05-29 2014-12-11 Hoya株式会社 Display device, display method, and display program
JP2014233344A (en) 2013-05-31 2014-12-15 Hoya株式会社 Optical filter element, wavelength variable optical bandpass filter module, wavelength variable light source apparatus, and spectroscopic endoscope apparatus
US20150238126A1 (en) * 2014-02-27 2015-08-27 Fujifilm Corporation Endoscope System, Endoscope System Processor Device, Operation Method for Endoscope System, and Operation Method for Endoscope System Processor Device
US20150238127A1 (en) * 2014-02-27 2015-08-27 Fujifilm Corporation Endoscope system, endoscope system processor device, operation method for endoscope system, and operation method for endoscope system processor device
US20160058348A1 (en) * 2014-08-29 2016-03-03 Fujifilm Corporation Light source device for endoscope and endoscope system
US9370297B2 (en) 2012-08-17 2016-06-21 Hoya Corporation Electronic endoscope system and light source for endoscope

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0679594B2 (en) * 1987-08-11 1994-10-12 オリンパス光学工業株式会社 Electronic endoscopic device
JP5395725B2 (en) * 2010-04-05 2014-01-22 富士フイルム株式会社 Electronic endoscope system
JP5419930B2 (en) * 2011-07-04 2014-02-19 富士フイルム株式会社 Electronic endoscope system, light source device, and method of operating electronic endoscope system

Patent Citations (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3972614A (en) * 1974-07-10 1976-08-03 Radiometer A/S Method and apparatus for measuring one or more constituents of a blood sample
JPS559755A (en) 1978-07-08 1980-01-23 Hitoshi Hatano Mannmade gatheringgplace for fish
US4324556A (en) * 1980-03-25 1982-04-13 The United States Of America As Represented By The Secretary Of The Navy Portable COHB analyzer
JPS583731A (en) 1981-06-30 1983-01-10 Aida Eng Ltd Fine blanking working machine press
JPS607857A (en) 1983-06-27 1985-01-16 テルモ株式会社 Abdominal membrane dialytic device
US5198977A (en) * 1990-11-27 1993-03-30 Jesse Salb System and method for localization of functional activity in the human brain
US5494032A (en) * 1991-07-12 1996-02-27 Sandia Corporation Oximeter for reliable clinical determination of blood oxygen saturation in a fetus
JPH0679594A (en) 1992-08-27 1994-03-22 Hitachi Cable Ltd Jig grind processing method for metal mold plate
US5408998A (en) * 1994-03-10 1995-04-25 Ethicon Endo-Surgery Video based tissue oximetry
JP2001314370A (en) 2000-05-08 2001-11-13 Olympus Optical Co Ltd Light source
JP2002095635A (en) 2000-07-21 2002-04-02 Olympus Optical Co Ltd Endoscope system
US20030176768A1 (en) 2000-07-21 2003-09-18 Kazuhiro Gono Endoscope apparatus
US7892169B2 (en) 2000-07-21 2011-02-22 Olympus Corporation Endoscope apparatus
JP3583731B2 (en) 2000-07-21 2004-11-04 オリンパス株式会社 Endoscope device and light source device
JP3607857B2 (en) 2000-07-27 2005-01-05 オリンパス株式会社 Endoscope device
JP3559755B2 (en) 2000-07-27 2004-09-02 オリンパス株式会社 Endoscope device
US20030158470A1 (en) 2000-09-18 2003-08-21 Sti Medical Systems, Inc. Dual mode real-time screening and rapid full-area, selective-spectral, remote imaging and analysis device and process
JP2002175702A (en) 2000-12-07 2002-06-21 Olympus Optical Co Ltd Light source device
US20020086432A1 (en) * 2000-12-28 2002-07-04 Tam Lisa A. Portable co-oximeter
US20020175993A1 (en) 2001-05-16 2002-11-28 Olympus Optical Co., Ltd. Endoscope system using normal light and fluorescence
US20030060684A1 (en) 2001-09-21 2003-03-27 Fuji Photo Optical Co., Ltd. Endoscope having red component cut filter
JP2003093343A (en) 2001-09-21 2003-04-02 Fuji Photo Optical Co Ltd Endoscope system
US20040075812A1 (en) * 2002-01-18 2004-04-22 Kardon Randy H. Device and method for optical imaging of retinal function
US20050027166A1 (en) 2003-06-17 2005-02-03 Shinya Matsumoto Endoscope system for fluorescent observation
US7949387B2 (en) 2004-03-19 2011-05-24 Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College Method for evaluating relative oxygen saturation in body tissues
US20060018031A1 (en) 2004-07-23 2006-01-26 Yoshiharu Takasugi Illumination optical system, illumination apparatus using the illumination optical system, and observation system provided with the illumination optical system or the illumination apparatus
JP2006039043A (en) 2004-07-23 2006-02-09 Olympus Corp Illumination optical system, illuminating device using the illumination optical system, and observation system using the illumination optical system or the illuminating device using the illumination optical system
US20080312533A1 (en) * 2005-03-16 2008-12-18 Or-Nim Medical Ltd. Noninvasive Measurements in a Human Body
JP2007029453A (en) 2005-07-27 2007-02-08 Olympus Medical Systems Corp Lighting device and observation device
US20100140461A1 (en) * 2006-12-13 2010-06-10 Georgia Tech Research Corporation Systems and methods for real time multispectral imaging
US20100106013A1 (en) 2007-01-31 2010-04-29 Olympus Corporation Fluorescence observation device for organism tissue
WO2008093745A1 (en) 2007-01-31 2008-08-07 Olympus Corporation Fluorescence observation device for organism tissue
US20090069653A1 (en) 2007-09-12 2009-03-12 Canon Kabushiki Kaisha Measurement apparatus
US20090137908A1 (en) 2007-11-26 2009-05-28 Patwardhan Sachin V Multi-spectral tissue imaging
US20100168584A1 (en) 2007-12-25 2010-07-01 Olympus Corporation Biological observation apparatus, biological observation method, and endoscopic apparatus
US20090225277A1 (en) * 2008-03-05 2009-09-10 Tamir Gil Snapshot Spectral Imaging of the Eye
US20100331624A1 (en) 2008-10-17 2010-12-30 Olympus Medical Systems Corp. Endoscope system and endoscopic image processing apparatus
WO2010044432A1 (en) 2008-10-17 2010-04-22 オリンパスメディカルシステムズ株式会社 Endoscope system and endoscopic image processing device
JP2011010998A (en) 2009-07-06 2011-01-20 Fujifilm Corp Lighting device for endoscope and endoscope apparatus
US20120116159A1 (en) 2009-07-06 2012-05-10 Akira Mizuyoshi Lighting device for endoscope and endoscope device
WO2011080996A1 (en) 2009-12-28 2011-07-07 オリンパス株式会社 Image processing device, electronic apparatus, program, and image processing method
US20120327205A1 (en) 2009-12-28 2012-12-27 Olympus Corporation Image processing device, electronic apparatus, information storage device, and image processing method
US8913111B2 (en) 2009-12-28 2014-12-16 Olympus Corporation Image processing device, electronic apparatus, information storage device, and image processing method
US20130039147A1 (en) 2010-01-25 2013-02-14 Russell S. Witte Ultrasonic/photoacoustic imaging devices and methods
WO2011099322A1 (en) 2010-02-10 2011-08-18 Hoya株式会社 Electronic endoscope system
US20130162790A1 (en) 2010-02-10 2013-06-27 Hoya Corporation Electronic endoscope system
US20110230715A1 (en) 2010-03-19 2011-09-22 Takaaki Saito electronic endoscope system, an electronic endoscope processor, and a method of acquiring blood vessel information
US20110237915A1 (en) 2010-03-26 2011-09-29 Hiroshi Yamaguchi Electronic endoscope system and processor unit thereof, and method for obtaining blood vessel information
US8681208B2 (en) 2010-04-15 2014-03-25 Olympus Corporation Image processing device and program
JP2011224038A (en) 2010-04-15 2011-11-10 Olympus Corp Image processing device and program
US20110254937A1 (en) 2010-04-15 2011-10-20 Olympus Corporation Image processing device and program
US20120215066A1 (en) 2010-06-25 2012-08-23 Olympus Medical Systems Corp. Endoscope apparatus
WO2011162111A1 (en) 2010-06-25 2011-12-29 オリンパスメディカルシステムズ株式会社 Endoscope device
WO2012047806A1 (en) 2010-10-08 2012-04-12 Edwards Lifesciences Corporation System, method and computer program product for optical measurement of blood parameters
US20130310668A1 (en) 2010-10-08 2013-11-21 Edwards Lifesciences Corporation System, method and computer program product for optical measurement of blood parameters
EP2449950A1 (en) 2010-11-09 2012-05-09 Fujifilm Corporation Endoscopic diagnosis system
US20120116192A1 (en) 2010-11-09 2012-05-10 Takaaki Saito Endoscopic diagnosis system
JP2012100800A (en) 2010-11-09 2012-05-31 Fujifilm Corp Endoscopic diagnostic apparatus
US20120157768A1 (en) 2010-12-15 2012-06-21 Fujifilm Corporation Endoscope system, processor of endoscope system, and image producing method
EP2468187A1 (en) 2010-12-21 2012-06-27 Fujifilm Corporation Endoscope system and processor apparatus thereof, and method for generating images
WO2012090552A1 (en) 2010-12-27 2012-07-05 富士フイルム株式会社 Endoscopic diagnosis apparatus
US9414741B2 (en) 2010-12-27 2016-08-16 Fujifilm Corporation Endoscopic diagnosis system
US20130289373A1 (en) 2010-12-27 2013-10-31 Fujifilm Corporation Endoscopic diagnosis system
JP2012143348A (en) 2011-01-11 2012-08-02 Fujifilm Corp Spectrometric system and spectrometry
US20120253158A1 (en) * 2011-04-01 2012-10-04 Hiroshi Yamaguchi Blood information measuring method and apparatus
JP2012235962A (en) 2011-05-13 2012-12-06 Hoya Corp Electric endoscope device
US20120302847A1 (en) 2011-05-24 2012-11-29 Satoshi Ozawa Endoscope system and method for assisting in diagnostic endoscopy
JP2012245223A (en) 2011-05-30 2012-12-13 Hoya Corp Electronic endoscope apparatus and spectral image optimization method
JP2013039215A (en) 2011-08-15 2013-02-28 Fujifilm Corp Endoscope system, light source device, and control method of endoscope system
US20140152790A1 (en) 2011-09-05 2014-06-05 Fujifilm Corporation Endoscope system and operating method thereof
CN103796566A (en) 2011-09-05 2014-05-14 富士胶片株式会社 Endoscope system and image display method
CN103070658A (en) 2011-09-15 2013-05-01 富士胶片株式会社 Endoscope system and light source device
JP2013063097A (en) 2011-09-15 2013-04-11 Fujifilm Corp Endoscope system and light source device
US20140235973A1 (en) 2011-09-15 2014-08-21 The Trustees Of Columbia University In The City Of New York Measurement of a fluorescent analyte using tissue excitation
US20140185907A1 (en) 2011-09-29 2014-07-03 Hoya Corporation Diagnostic system
WO2013047054A1 (en) 2011-09-29 2013-04-04 Hoya株式会社 Diagnostic system
US20130158413A1 (en) * 2011-12-15 2013-06-20 Nellcor Puritan Bennett Llc Optical measurement of physiological blood parameters
US20130245419A1 (en) 2012-03-13 2013-09-19 Canon Kabushiki Kaisha Subject information obtaining device, subject information obtaining method, and non-transitory computer-readable storage medium
US9277190B2 (en) 2012-03-30 2016-03-01 Olympus Corporation Endoscope apparatus
JP5362149B1 (en) 2012-03-30 2013-12-11 オリンパスメディカルシステムズ株式会社 Endoscope device
US20130345517A1 (en) 2012-06-20 2013-12-26 Fujifilm Corporation Light source apparatus and endoscope system
US20140012113A1 (en) * 2012-07-06 2014-01-09 Fujifilm Corporation Endoscope system, processor device thereof, and method for controlling endoscope system
EP2689712A1 (en) 2012-07-24 2014-01-29 Fujifilm Corporation Endoscope system, processor device of endoscope system, and method for controlling display of endoscope image
US9370297B2 (en) 2012-08-17 2016-06-21 Hoya Corporation Electronic endoscope system and light source for endoscope
US9591966B2 (en) 2012-08-17 2017-03-14 Hoya Corporation Electronic endoscope system and light source for endoscope
US20140066733A1 (en) 2012-09-04 2014-03-06 Fujifilm Corporation Endoscope system, processor device thereof, and image processing method
EP2702938A1 (en) 2012-09-04 2014-03-05 Fujifilm Corporation Endoscope system, processor device thereof, and image processing method
CN103654687A (en) 2012-09-21 2014-03-26 富士胶片株式会社 Endoscope system, light source device for endoscope and manufacturing method of endoscope images
CN103654690A (en) 2012-09-26 2014-03-26 富士胶片株式会社 Endoscope system and motion control method thereof, and processor device
JP2014230647A (en) 2013-05-29 2014-12-11 Hoya株式会社 Display device, display method, and display program
CN105324064A (en) 2013-05-30 2016-02-10 Hoya株式会社 Method and device for generating image showing concentration distribution of biological substances in biological tissue
WO2014192781A1 (en) 2013-05-30 2014-12-04 Hoya株式会社 Method and device for generating image showing concentration distribution of biological substances in biological tissue
EP3005933A1 (en) 2013-05-30 2016-04-13 Hoya Corporation Method and device for generating image showing concentration distribution of biological substances in biological tissue
US20160120449A1 (en) 2013-05-30 2016-05-05 Hoya Corporation Method and device for generating image showing concentration distribution of biological substances in biological tissue
JP2014233344A (en) 2013-05-31 2014-12-15 Hoya株式会社 Optical filter element, wavelength variable optical bandpass filter module, wavelength variable light source apparatus, and spectroscopic endoscope apparatus
US20150238126A1 (en) * 2014-02-27 2015-08-27 Fujifilm Corporation Endoscope System, Endoscope System Processor Device, Operation Method for Endoscope System, and Operation Method for Endoscope System Processor Device
US20150238127A1 (en) * 2014-02-27 2015-08-27 Fujifilm Corporation Endoscope system, endoscope system processor device, operation method for endoscope system, and operation method for endoscope system processor device
US20160058348A1 (en) * 2014-08-29 2016-03-03 Fujifilm Corporation Light source device for endoscope and endoscope system

Non-Patent Citations (27)

* Cited by examiner, † Cited by third party
Title
European Search Report issued in European Patent Application No. 15183306.8, dated Feb. 5, 2016.
European Search Report issued in European Patent Application No. 15195635.6, dated Apr. 18, 2016.
Extended European Search Report issued in European Patent Appl. No. 14805121.2, dated Mar. 20, 2017.
Extended European Search Report issued in European Patent Appl. No. 16175262.1, dated Nov. 17, 2016.
Furukawa,"In vivo absorption spectroscopy for absolute measurement", OSA, 3(10), 2012 (Year: 2012). *
International Search Reporting (ISR) in International Application PCT/JP2016/058112, dated Jun. 7, 2016.
Office Action in U.S. Appl. No. 15/295,048, dated Nov. 22, 2016.
Office Action issued in China Patent Appl. No. 201310358808.2, dated Jan. 16, 2017, along with an English translation thereof.
Office Action issued in China Patent Appl. No. 201310358808.2, dated Jun. 24, 2016, along with an English translation thereof.
Office Action issued in China Patent Appl. No. 201310358808.2, dated Nov. 4, 2015, along with an English translation thereof.
Office Action issued in China Patent Appl. No. 201510549104.2, dated Apr. 18, 2017, along with an english translation thereof.
Office Action issued in European Patent Appl. No. 15183306.8, dated Jan. 24, 2017.
Office Action issued in Japan Patent Appl. No. 2012-180902, dated Dec. 26, 2016, along with an English translation thereof.
Office Action issued in Japan Patent Appl. No. 2012-180902, dated May 24, 2016, along with an English translation thereof.
Office Action issued in Japan Patent Appl. No. 2014-179036, dated Feb. 23, 2017.
Office Action issued in related U.S. Appl. No. 14/837,300, dated Oct. 10, 2018.
Office Action issued in related U.S. Appl. No. 14/936,965, dated Dec. 15, 2017.
Office Action issued in U.S. Appl. No. 14/837,300, dated Apr. 13, 2018.
Office Action issued in U.S. Appl. No. 15/295,048, dated Apr. 12, 2017.
Pierce, M., "Optical Contrast agents and imaging systems for detection and diagnosis of cancer", Int J Cancer, 2010. *
Robles, "Assessing hemoglobin concentration using spectroscopic optical coherence tomography for feasibility of tissue diagnostics", OSA, 1(1), 2010 (Year: 2010). *
ThermoFisher Scientific, "Overview of Filters and Light Sources". *
U.S. Appl. No. 14/837,300 to Toru Chiba, filed Aug. 27, 2015.
U.S. Appl. No. 14/936,965 to Toru Chiba, filed Nov. 10, 2015.
U.S. Appl. No. 15/295,048 to Fumika Yokouchi et al., filed Oct. 17, 2016.
U.S. Appl. No. 15/308,479 to Fumika Yokouchi, filed Nov. 2, 2016.
US 9,560,957 B2, 02/2017, Yokouchi et al. (withdrawn)

Also Published As

Publication number Publication date
JPWO2014192781A1 (en) 2017-02-23
EP3005933B1 (en) 2018-10-03
CN105324064B (en) 2017-10-27
US20160120449A1 (en) 2016-05-05
EP3005933B8 (en) 2019-01-02
EP3005933A1 (en) 2016-04-13
CN105324064A (en) 2016-02-10
JP6356122B2 (en) 2018-07-11
WO2014192781A1 (en) 2014-12-04
EP3005933A4 (en) 2017-04-19

Similar Documents

Publication Publication Date Title
US10722155B2 (en) Method and device for generating image showing concentration distribution of biological substances in biological tissue
US10031070B2 (en) Analyzing device and analyzing method based on images of biological tissue captured under illumination of light with different illumination wavelength ranges
US20190069768A1 (en) Calculation system
JP6204314B2 (en) Electronic endoscope system
US10925527B2 (en) Endoscope apparatus
JP6783721B2 (en) Analysis equipment
WO2013047054A1 (en) Diagnostic system
JP6284451B2 (en) Endoscope device
CN109310305B (en) Endoscope system and feature amount calculation method
CN111989023A (en) Endoscope system and method for operating endoscope system
US10791973B2 (en) Analysis device and method of analysis
US10441147B2 (en) Endoscope system and analyzing apparatus
JP6517441B2 (en) Endoscope system
CN117918771A (en) Endoscope system and method for operating same

Legal Events

Date Code Title Description
AS Assignment

Owner name: HOYA CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHIBA, TORU;REEL/FRAME:037141/0788

Effective date: 20151124

AS Assignment

Owner name: HOYA CORPORATION, JAPAN

Free format text: CHANGE OF ADDRESS;ASSIGNOR:HOYA CORPORATION;REEL/FRAME:038799/0210

Effective date: 20160401

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4