WO2013001994A1 - Dispositif d'acquisition d'image spectrale et procédé d'acquisition d'image spectrale - Google Patents

Dispositif d'acquisition d'image spectrale et procédé d'acquisition d'image spectrale Download PDF

Info

Publication number
WO2013001994A1
WO2013001994A1 PCT/JP2012/064460 JP2012064460W WO2013001994A1 WO 2013001994 A1 WO2013001994 A1 WO 2013001994A1 JP 2012064460 W JP2012064460 W JP 2012064460W WO 2013001994 A1 WO2013001994 A1 WO 2013001994A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
spectral
control
variable
light
Prior art date
Application number
PCT/JP2012/064460
Other languages
English (en)
Japanese (ja)
Inventor
俊明 渡邉
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Priority to JP2013522559A priority Critical patent/JP6120770B2/ja
Publication of WO2013001994A1 publication Critical patent/WO2013001994A1/fr
Priority to US14/097,360 priority patent/US9347830B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J3/2823—Imaging spectrometer
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/12—Generating the spectrum; Monochromators
    • G01J3/26—Generating the spectrum; Monochromators using multiple reflection, e.g. Fabry-Perot interferometer, variable interference filters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/645—Specially adapted constructive features of fluorimeters
    • G01N21/6456—Spatial resolved fluorescence measurements; Imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J2003/283—Investigating the spectrum computer-interfaced
    • G01J2003/284—Spectral construction
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N2021/6417—Spectrofluorimetric devices
    • G01N2021/6423—Spectral mapping, video display

Definitions

  • the present invention relates to a spectral image acquisition apparatus and a spectral image acquisition method for acquiring a subject image having a desired wavelength in an observation apparatus such as an endoscope, a microscope, or a monitoring camera.
  • Special light observations include, for example, highlighting capillary blood vessels on the surface of the mucosa by acquiring a narrow-band light image of light of about 400 nm that is easily absorbed by hemoglobin in blood, or light of about 550 nm that is easily absorbed by hemoglobin.
  • a fluorescent substance such as narrow-band light observation (NBI) or indocyanine green (ICG) is injected intravenously, and the vicinity is about 800 nm.
  • NBI narrow-band light observation
  • ICG indocyanine green
  • the etalon-type spectroscopic element has a characteristic that when light of a desired wavelength is transmitted, a small amount of light other than the desired wavelength (for example, 1) is caused by scattering or diffraction on the substrate or the reflection film. %)). For this reason, in a conventional spectral image acquisition device in which an etalon-type spectroscopic element is incorporated in the imaging system, an image is acquired including leakage light other than the desired wavelength, and the leakage light becomes noise in the spectral image. There is a problem that the S / N of the spectral image is lowered and adversely affects the observation.
  • the present invention has been made in view of such conventional problems, and a spectral image acquisition apparatus and a spectral image that can reduce the influence of leakage light as much as possible and acquire a spectral image of a desired wavelength at a high S / N.
  • the purpose is to provide an acquisition method.
  • a spectral image acquisition apparatus has a pair of optical substrates disposed opposite to each other on an optical path of light from a subject, and at least one of a surface interval and an angle between the pair of optical substrates.
  • a variable spectral element whose spectral characteristics are variable by changing the above, a transmission wavelength setting unit for setting a wavelength of light transmitted by the variable spectral element within a wavelength band constituting light from the subject, and A first control for controlling the variable spectroscopic element so that a transmission peak exists in the vicinity of a wavelength set via a transmission wavelength setting unit; and transmission within a wavelength band constituting light from the subject.
  • a variable spectroscopic element that switches between a second control for controlling the variable spectroscopic element so as to have a spectral characteristic that does not cause a peak by changing a surface interval or an angle between the pair of optical substrates.
  • a control unit an image acquisition unit that acquires an image of light transmitted through the variable spectral element, and a first image acquired by the image acquisition unit when the variable spectral element control unit performs the first control.
  • an image correction processing unit that acquires a difference from the second image acquired by the image acquisition unit when the variable spectral element control unit performs the second control.
  • variable spectroscopic element control unit may change the angle between the pair of optical substrates in the wavelength band of light from the subject in the second control. It is preferable to incline to a predetermined non-parallel angle at which the transmission peak of the spectroscopic element disappears.
  • variable spectroscopic element control unit may determine a surface interval between the pair of optical substrates in the wavelength band of light from the subject in the second control. It is preferable to widen to a predetermined distance where the transmission peak of the variable spectroscopic element disappears.
  • variable spectral element control unit may deviate a surface interval and an angle between the pair of optical substrates from a wavelength band of light from the subject in the second control. It is preferable to control to a predetermined distance and angle at which the transmission peak of the variable spectral element shifts to a predetermined wavelength range.
  • variable spectral element control unit is configured so that the first image and the second image can be acquired alternately by the image acquisition unit. It is preferable to switch between the first control and the second control.
  • the spectral image acquisition apparatus of the present invention further includes a second image acquisition timing setting unit for setting acquisition timings of the first image and the second image by the image acquisition unit,
  • the element control unit preferably switches between the first control and the second control in synchronization with the timing set via the second image acquisition timing setting unit.
  • the spectral image acquisition method is a variable spectral element in which spectral characteristics are variable by changing at least one of a surface interval and an angle between a pair of optical substrates disposed opposite to each other on an optical path of light from a subject.
  • a spectral image acquisition method for acquiring an image by switching the control over the light, wherein a wavelength of light transmitted by the variable spectral element is set within a wavelength band constituting light from the subject, and transmitted in the vicinity of the set wavelength
  • First control for controlling the variable spectroscopic element to have a spectral characteristic such that a peak exists, and first control for controlling the variable spectroscopic element to have a spectral characteristic in which a transmission peak does not exist in a wavelength band constituting light from the subject.
  • the control of 2 is switched by changing the surface interval or angle between the pair of optical substrates, and each of the first control and the second control is performed. A first image acquired when the first control is performed and a second image acquired when the second control is performed The difference is acquired.
  • the transmission peak of the variable spectroscopic element disappears within the wavelength band of the light from the subject in the angle between the pair of optical substrates. It is preferable to incline to a predetermined non-parallel angle.
  • the transmission peak of the variable spectroscopic element disappears within the wavelength band of the light from the subject in the distance between the pair of optical substrates. It is preferable to widen to a predetermined distance.
  • the surface interval and the angle between the pair of optical substrates may be changed to a predetermined wavelength range that is out of the wavelength band of light from the subject. It is preferable to control to a predetermined distance and angle at which the transmission peak of the spectroscopic element shifts.
  • the first image acquired first after acquiring the second image is used as a reference image, and acquired after acquiring the reference image for the subject in the reference image.
  • the amount of displacement of the subject in the first image is detected, and when the detected amount of displacement of the subject exceeds a predetermined threshold, the first control is switched to the second control. It is preferable that the second control is switched to the first control after acquiring the second image and acquiring the second image.
  • the first control and the second control are switched at a timing at which the first image and the second image can be alternately acquired. Is preferred.
  • the acquisition timing of the first image and the second image is set, and the first control and the second control are synchronized with the set timing. Is preferably switched.
  • a spectral image acquisition device and a spectral image acquisition method that can reduce the influence of leakage light as much as possible and acquire a spectral image of a desired wavelength with a high S / N.
  • FIG. 1 is a block diagram schematically showing an overall configuration of a spectral image acquisition apparatus that performs a spectral image acquisition method according to an embodiment of the present invention. It is a block diagram which shows the common structure in the endoscope apparatus using the spectral image acquisition apparatus which performs the spectral image acquisition method of each Example of this invention. BRIEF DESCRIPTION OF THE DRAWINGS It is explanatory drawing which shows an example of the optical characteristic in special light observation using the endoscope apparatus provided with the spectral image acquisition apparatus which performs the spectral image acquisition method of Example 1 of this invention, (a) is a spectrum of illumination light.
  • (B) is a diagram showing the surface spacing and angle between a pair of optical substrates constituting the variable spectral element in the first control, and (c) is the spectral transmittance of the variable spectral element in the first control.
  • (D) is a graph showing the surface spacing and angle between a pair of optical substrates constituting the variable spectral element in the second control, and (e) is the spectral transmission of the variable spectral element in the second control.
  • (F) is a graph showing the spectrum of the spectral image after the correction processing by the image correction processing unit.
  • the graph which shows a spectrum (b) is a figure which shows the surface space
  • FIG. 1 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs a spectral image acquisition method according to a second modification of Example 1;
  • the graph which shows a spectrum (b) is a figure which shows the surface space
  • FIG. 1 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs a spectral image acquisition method according to a third modification of the first embodiment.
  • the graph which shows a spectrum (b) is a figure which shows the surface space
  • FIG. 6 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs a spectral image acquisition method according to Modification Example 4 of Example 1;
  • the graph which shows a spectrum (b) is a figure which shows the surface space
  • the spectral image acquisition apparatus of the present invention has a pair of optical substrates disposed opposite to each other on an optical path of light from a subject, and changes spectral characteristics by changing at least one of a surface interval and an angle between the pair of optical substrates.
  • variable spectral element in which the variable spectral element is variable, a transmission wavelength setting unit for setting a wavelength of light transmitted by the variable spectral element within a wavelength band constituting light from the subject, and the transmission wavelength setting unit First control for controlling the variable spectroscopic element to have a spectral characteristic in which a transmission peak exists in the vicinity of a set wavelength, and a spectral characteristic in which a transmission peak does not exist in a wavelength band constituting light from the subject.
  • a variable spectroscopic element control unit that switches the second control for controlling the variable spectroscopic element by changing a surface interval or an angle between the pair of optical substrates;
  • An image acquisition unit that acquires an image by the light, a first image acquired by the image acquisition unit when the variable spectral element control unit performs the first control, and the variable spectral element control unit
  • an image correction processing unit that acquires a difference from the second image acquired by the image acquisition unit when the control 2 is performed.
  • the etalon-type spectroscopic element transmits a predetermined amount (for example, about 1%) of a small amount of light other than the desired wavelength when transmitting light having a desired wavelength.
  • a predetermined amount for example, about 1%) of a small amount of light other than the desired wavelength when transmitting light having a desired wavelength.
  • the present applicant has investigated and analyzed the relationship between the plane distance and angle between the pair of optical substrates constituting the etalon-type spectroscopic element and the leakage light. As a result, when the surface interval and angle between the pair of optical substrates are set to a distance and angle at which a transmission peak does not exist, and to a distance and angle at which a predetermined transmission peak exists, over substantially the same wavelength band. It has been found that approximately the same amount of leakage light occurs.
  • the applicant of the present invention is a first control in which the variable spectral element control unit controls the variable spectral element to have a spectral characteristic in which a transmission peak exists in the vicinity of the wavelength set via the transmission wavelength setting unit.
  • the second control for controlling the variable spectroscopic element is switched to a spectral characteristic in which a transmission peak does not exist in the wavelength band constituting the light from the subject, and the image correction processing unit is the first variable spectroscopic element control unit.
  • the difference between the first image acquired by the image acquisition unit during the control and the second image acquired by the image acquisition unit when the variable spectral element control unit performs the second control is acquired.
  • the present inventors have come up with the idea of correcting the spectral image. According to the spectral image acquisition apparatus and the spectral image acquisition method of the present invention, it is possible to reduce the influence of leakage light as much as possible and acquire a spectral image of a desired wavelength with high S / N.
  • FIG. 1 is a block diagram schematically showing the overall configuration of a spectral image acquisition apparatus that performs a spectral image acquisition method according to an embodiment of the present invention.
  • the spectral image acquisition device of FIG. 1 includes a variable spectral element 1, a transmission wavelength setting unit 2, a variable spectral element control unit 3, an image acquisition unit 4, and an image correction processing unit 5.
  • reference numeral 10 denotes a subject such as a living tissue.
  • the variable spectroscopic element 1 has a pair of optical substrates opposed to each other on the optical path of light from the subject 10, and the spectral characteristics can be varied by changing at least one of the surface interval and the angle between the pair of optical substrates. This is configured as an etalon type variable spectroscopic element.
  • the transmission wavelength setting unit 2 is configured such that the operator can set the wavelength of light transmitted by the variable spectral element 1 within the wavelength band constituting the light from the subject 10 by, for example, screen input or the like. .
  • variable spectroscopic element control unit 3 makes a pair of spectral characteristics such that the spectral characteristic of the variable spectroscopic element 1 is a spectral characteristic that does not cause a transmission peak to exist in the wavelength band constituting the light from the subject 10. It controls at least one of the surface interval and the angle between the optical substrates.
  • the image acquisition unit 4 includes, for example, a solid-state image sensor such as a CCD or a CMOS, and is configured to acquire an image by light transmitted through the variable spectral element 1.
  • a solid-state image sensor such as a CCD or a CMOS
  • the image correction processing unit 5 includes the first image acquired by the image acquisition unit 4 when the variable spectral element control unit 3 performs the first control, and the variable spectral element control unit 3 performs the second control. A difference from the second image acquired by the image acquisition unit 4 is acquired.
  • a spectral image acquisition method in the case of acquiring a subject image with light of a desired wavelength using the spectral image acquisition apparatus of FIG. 1 configured as described above will be described.
  • the operator sets the wavelength of light desired to be transmitted by the variable spectral element 1 via the transmission wavelength setting unit 2.
  • the wavelength information set via the transmission wavelength setting unit 2 is transmitted to the variable spectral element control unit 3.
  • the variable spectroscopic element control unit 3 includes a pair of optical substrates so that the spectral characteristic of the variable spectroscopic element 1 has a spectral characteristic such that a transmission peak exists in the vicinity of the wavelength set via the transmission wavelength setting unit 2.
  • the second control for controlling at least one of the surface interval and the angle between the pair of optical substrates is switched at a predetermined timing.
  • variable spectral element 1 Light from the subject 10 enters the variable spectral element 1.
  • the variable spectroscopic element control unit 3 performs the first control
  • the variable spectroscopic element 1 has a spectral characteristic in which a transmission peak exists in the vicinity of the wavelength set via the transmission wavelength setting unit 2.
  • the surface interval is held at a predetermined distance while the angle between the pair of optical substrates is held in parallel.
  • the variable spectroscopic element 1 in this state light having a wavelength set via the transmission wavelength setting unit 2 is transmitted, and leakage light having other wavelengths is transmitted.
  • the variable spectroscopic element control unit 3 performs the second control
  • the variable spectroscopic element 1 has a pair of spectral characteristics so that a transmission peak does not exist in the wavelength band constituting the light from the subject 10.
  • the surface interval and angle between the optical substrates are maintained. From the variable spectral element 1 in this state, substantially the same amount of leaked light is transmitted as when the variable spectral element control unit 3 performs the first control.
  • the light transmitted through the variable spectroscopic element 1 enters the image acquisition unit 4.
  • the image acquisition unit 4 acquires a subject image.
  • the image acquired by the image acquisition unit 4 when the variable spectral element control unit 3 performs the first control is the first image (spectral image), and the variable spectral element control unit 3 performs the second control.
  • the image acquired by the image acquisition unit 4 at this time is referred to as a second image (reference image).
  • the first image includes a component due to light having a desired wavelength set via the transmission wavelength setting unit 2 and a component due to leakage light having other wavelengths.
  • the second image includes substantially the same amount of components that are substantially the same as the leakage light in the first image.
  • the image correction processing unit 5 acquires a difference between the first image and the second image. The leaked light component is substantially removed from the acquired difference image.
  • the influence of leakage light can be reduced as much as possible, and a spectral image of a desired wavelength can be acquired with high S / N.
  • the variable spectral element control unit 3 sets the angle between the pair of optical substrates within the wavelength band of light from the subject 10 in the second control. It is preferable to incline to a predetermined non-parallel angle at which the transmission peak of the variable spectral element 1 disappears.
  • the variable spectral element control unit 3 determines the surface interval between the pair of optical substrates in the second control by using the wavelength band of light from the subject 10. The transmission peak of the variable spectroscopic element 1 may be extended to a predetermined distance.
  • variable spectral element control unit 3 determines the surface interval and angle between the pair of optical substrates in the second control. You may control to the predetermined
  • the first image acquired by the image acquisition unit 4 after acquiring the second image is used as a reference image, and the subject in the reference image is used.
  • 10 includes an image shift amount detection unit 6 that detects a position shift amount of the subject 10 in the first image acquired by the image acquisition unit 4 after acquiring the reference image, and the variable spectral element control unit 3
  • the first control is switched to the second control, and after the image acquisition unit 4 acquires the second image, the second control is performed. It is preferable to switch the control to the first control.
  • the first image spectral image
  • the second image reference
  • the image shift amount detection unit 6 is provided, and the variable spectroscopic element control unit 3 performs the first operation when the position shift amount of the subject 10 detected by the image shift amount detection unit 6 exceeds a predetermined threshold.
  • the first control is switched to the second control, and after the image acquisition unit 4 acquires the second image, the second control is switched to the first control. In this way, a spectral image of a desired wavelength can be obtained with a high frame rate, high efficiency, and high S / N.
  • the first control and the second control may be switched. In this way, a spectral image of a desired wavelength can be reliably obtained with a high S / N even for the fast moving subject 10.
  • the second image acquisition timing setting unit for the operator to set the acquisition timing of the first image and the second image by the image acquisition unit 4. 7, and the variable spectral element control unit 3 may switch between the first control and the second control in synchronization with the timing set via the second image acquisition timing setting unit 7. . In this way, a spectral image of a desired wavelength can be obtained efficiently and with a high S / N for various observation applications.
  • FIG. 2 is a block diagram showing a common configuration in an endoscope apparatus using a spectral image acquisition apparatus that performs the spectral image acquisition method of each embodiment of the present invention.
  • reference numeral 10 denotes a living tissue as a subject.
  • the light source unit 11 includes, for example, a light source 11a1, a light guide 11a2, and the like, and irradiates the subject 10 with light in a predetermined wavelength band corresponding to an observation application such as a visible wavelength band and a near-infrared excitation wavelength band. It is configured. In the following embodiments, for the sake of convenience, light in a predetermined visible wavelength band is irradiated.
  • the input unit 12 includes, for example, an input screen that can be displayed and input on a display device of a personal computer connected to the endoscope body, and corresponds to the transmission wavelength setting unit 2 in the spectral image acquisition device of FIG. It has a function.
  • the variable spectroscopic element control unit 13 is configured similarly to the variable spectroscopic element control unit 3 in the spectral image acquisition apparatus of FIG.
  • the imaging unit 14 includes a lens 14a, a variable spectral element 14b, and an imaging element 14c.
  • the lens 14a forms an image of light from the subject 10 on the imaging surface of the imaging device 14c.
  • the imaging element 14c is composed of, for example, a CCD or a CMOS, and captures an image by light transmitted through the variable spectral element 14b.
  • the variable spectral element 14 b is disposed on the optical path from the subject 10.
  • the variable spectroscopic element 14b corresponds to the variable spectroscopic element 1 in the spectroscopic image acquisition apparatus of FIG. 1, and includes a pair of optical substrates 14b1 and 14b2 provided with a dielectric multilayer film as a reflective film on a pair of surfaces. It is configured as an etalon-type variable spectroscopic element in which spectral characteristics are variable by changing the surface interval or angle between the pair of optical substrates 14b1 and 14b2 via the variable spectroscopic element control unit 13.
  • an etalon-type variable spectroscopic element is a spectroscopic element that uses light interference, and the wavelength of light that can be transmitted or reflected is changed by changing the distance between a pair of mirror surfaces arranged to face each other. It is a spectroscopic element that can be changed.
  • the image processing unit 15 includes a central processing unit, a storage area, and software of a personal computer connected to the endoscope main body, and includes an image generation unit 15a, a spectral image memory 15b, a reference image memory 15c, An image calculation unit 15d is provided.
  • the image generation unit 15a performs a predetermined image conversion process on the image signal captured by the image sensor 14c to generate an image.
  • the image sensor 14 c and the image generation unit 15 a correspond to the image acquisition unit 4 in the spectral image acquisition device of FIG. 1.
  • the spectral image memory 15b is a storage area for storing a first image (spectral image) acquired by the imaging device 14c and the image generation unit 15a when the variable spectral element control unit 13 performs the first control.
  • the reference image memory 15c is a storage area for storing the second image (reference image) acquired by the imaging element 14c and the image generation unit 15a when the variable spectral element control unit 13 performs the second control.
  • the image calculation unit 15d corresponds to the image correction processing unit 5 in the spectral image acquisition apparatus in FIG. 1, and a predetermined first image stored in the spectral image memory 15b and a predetermined image stored in the reference image memory 15c. The difference from the second image is calculated.
  • the display unit 16 is composed of, for example, a display device connected to a personal computer, and displays an image calculated by the image calculation unit 15d.
  • FIG. 3 is an explanatory diagram showing an example of optical characteristics in special light observation using an endoscope apparatus equipped with a spectral image acquisition apparatus that performs the spectral image acquisition method of Example 1 of the present invention.
  • (B) is a graph showing the surface interval and angle between a pair of optical substrates constituting the variable spectral element in the first control
  • (c) is a graph showing the spectrum of the variable spectral element in the first control.
  • the graph which shows a spectral transmittance (d) is a figure which shows the surface space
  • the basic configuration shown in FIG. 2 is common to the following embodiments.
  • the light source unit 11 includes a xenon light source and emits light in a visible wavelength band of 400 nm to 700 nm.
  • the variable spectroscopic element control unit 13 has a visible wavelength band of 400 nm to 700 nm reflected by the biological tissue 10 as shown in FIGS. 3 (b) and 3 (c).
  • the pair of optical substrates 14b1 and 14b2 in the variable spectroscopic element 14b are controlled to be a predetermined distance so that the spectral characteristics have a transmission peak with a predetermined half-value width such as 20 nm in a predetermined narrow band within To do.
  • the imaging element 14c captures an image of light transmitted through the variable spectral element 14b for which the first control is performed by the variable spectral element control unit 13.
  • the image generation unit 15a performs a predetermined image conversion process on the signal captured by the image sensor 14c to generate a first image.
  • variable spectroscopic element control unit 13 causes the variable spectroscopic element 14b to reflect visible light of 400 nm to 700 nm reflected by the subject 10, as shown in FIGS. 3 (d) and 3 (e).
  • the pair of optical substrates 14b1 and 14b2 in the variable spectroscopic element 14b is controlled to a predetermined angle that is not parallel to each other so that the transmission characteristic within the wavelength band disappears.
  • the imaging element 14c captures an image of light transmitted through the variable spectral element 14b for which the second control is performed by the variable spectral element control unit 13.
  • the image generation unit 15a performs a predetermined image conversion process on the signal captured by the image sensor 14c, and generates a second image.
  • the image calculation unit 15d includes the gradation value of each pixel in the first image acquired by the imaging element 14c and the image generation unit 15a when the variable control element control unit 13 performs the first control, and variable spectroscopy.
  • the first control is performed by the element control unit 13
  • the gradation value of the leaked light in the second image obtained in the second control is substantially the same as the gradation value of the leaked light in the first image obtained in the first control. For this reason, when the difference between the gradation values of the two images is taken, the gradation value of the leakage light is removed from the first image.
  • the spectral image acquisition apparatus and the spectral image acquisition method of the first embodiment it is possible to acquire a spectral image of narrow band light with a high S / N from which a component of leakage light is removed.
  • Control for obtaining a spectral characteristic that does not cause a transmission peak to exist in the wavelength band is not limited to the example of FIG. 3, and for example, a modified example of the first embodiment described next with reference to FIGS. Controls such as 1 to 3 may be used.
  • FIG. 4 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs the spectral image acquisition method according to the first modification of the first embodiment.
  • the graph which shows the spectrum of illumination light (b) is a figure which shows the surface space
  • the graph which shows the spectral transmittance of an element, (d) is a figure which shows the surface space
  • the variable spectral element control unit 13 determines the surface interval between the pair of optical substrates 14b1 and 14b2 from 400 nm reflected by the subject 10 in the second control. It is configured to control to a predetermined distance (for example, 10 ⁇ m) at which the transmission peak of the variable spectroscopic element 14b disappears within the wavelength band of visible light of 700 nm. In order to eliminate the transmission peak of the variable spectroscopic element 14b within the wavelength band of light from the subject 10, the surface distance between the pair of optical substrates 14b1 and 14b2 is set while holding the pair of optical substrates 14b1 and 14b2 in parallel.
  • the distance may be larger than the coherence length (coherence distance) in the wavelength band constituting the light from the subject 10 (here, the visible wavelength band of 400 nm to 700 nm).
  • the light from the subject 10 is composed of light of various phases, the phases are not uniform, and the coherence length is short.
  • the distance between the surfaces of the pair of optical substrates 14b1 and 14b2 is about several ⁇ m to several tens of ⁇ m, light in the visible wavelength band of 400 nm to 700 nm cannot resonate and no transmission peak exists. For this reason, even if the second control by the variable spectroscopic element control unit 13 is as in the first modification, light other than leakage light can be shielded from the light incident on the variable spectroscopic element 14b.
  • the second image acquired by the image sensor 14c and the image generation unit 15a is an image of only the component of the leaked light
  • the image calculation unit 15d has the pixel levels of the first image and the second image.
  • the tone value difference is calculated, the gradation value of the leaked light is removed from the first image.
  • Other configurations and operational effects are substantially the same as those of the spectral image acquisition apparatus and spectral image acquisition method of the first embodiment.
  • FIG. 5 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs the spectral image acquisition method according to the second modification of the first embodiment.
  • the graph which shows the spectrum of illumination light (b) is a figure which shows the surface space
  • variable spectroscopic element control unit 13 holds the pair of optical substrates 14b1 and 14b2 in parallel in the second control while holding the pair of optical substrates 14b1 and 14b2 in parallel.
  • the transmission peak of the variable spectroscopic element 14b is shifted to a predetermined wavelength region (in this case, 740 nm) that deviates from the wavelength band of visible light of 400 nm to 700 nm reflected by the subject 10 between the surfaces of 14b2. It is configured to spread to a predetermined distance.
  • the variable spectral element 14b has a predetermined wavelength range (excluding the wavelength band of light from the subject 10) outside the wavelength range (
  • the spectral characteristic has a transmission peak at 740 nm in FIG. 5C, but the light incident on the variable spectral element 14b is light in the visible wavelength band of 400 nm to 700 nm reflected by the subject 10, There is no light in the wavelength region longer than the light in the visible wavelength band of 400 nm to 700 nm.
  • the second control by the variable spectroscopic element control unit 13 is as in the second modification, light other than leakage light can be blocked out of the light incident on the variable spectroscopic element 14b.
  • the second image acquired by the image sensor 14c and the image generation unit 15a is an image of only the component of the leaked light
  • the image calculation unit 15d has the pixel levels of the first image and the second image.
  • the tone value difference is calculated, the gradation value of the leaked light is removed from the first image.
  • Other configurations and operational effects are substantially the same as those of the spectral image acquisition apparatus and spectral image acquisition method of the first embodiment.
  • FIG. 6 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs the spectral image acquisition method according to the third modification of the first embodiment.
  • the graph which shows the spectrum of illumination light (b) is a figure which shows the surface space
  • the variable spectral element 14b has a predetermined wavelength range (a wavelength range outside the wavelength band of the light from the subject 10) that is outside the wavelength range (
  • the spectral characteristic has a transmission peak at 380 nm in FIG. 6C, but the light incident on the variable spectral element 14b is light in the visible wavelength band of 400 nm to 700 nm reflected by the subject 10, There is no light in the shorter wavelength region than the light in the visible wavelength band of 400 nm to 700 nm.
  • the second control by the variable spectroscopic element control unit 13 is as in the third modification, light other than leakage light can be shielded from the light incident on the variable spectroscopic element 14b.
  • the second image acquired by the image sensor 14c and the image generation unit 15a is an image of only the component of the leaked light, and the image calculation unit 15d has the pixel levels of the first image and the second image.
  • the tone value difference is calculated, the gradation value of the leaked light is removed from the first image.
  • Other configurations and operational effects are substantially the same as those of the spectral image acquisition apparatus and spectral image acquisition method of the first embodiment.
  • FIG. 7 is an explanatory diagram illustrating an example of optical characteristics in special light observation using an endoscope apparatus including a spectral image acquisition apparatus that performs the spectral image acquisition method according to the fourth modification of the first embodiment.
  • the graph which shows the spectrum of illumination light (b) is a figure which shows the surface space
  • variable spectral element control unit 13 holds the pair of optical substrates 14b1 and 14b2 in parallel in the second control, while holding the pair of optical substrates 14b1 and 14b2 in parallel.
  • 14b2 between a predetermined wavelength range (here, 380 nm) deviating to a shorter wavelength side than a wavelength band of visible light of 400 nm to 700 nm reflected by the subject 10, and a predetermined deviating value to a long wavelength side. It is configured to control to a predetermined distance in which the two transmission peaks of the variable spectroscopic element 14b are shifted to a wavelength region (here, 740 nm).
  • the variable spectral element 14b has a predetermined wavelength region (a wavelength region outside the wavelength band of the light from the subject 10 that is out of the short wavelength side). For example, 380 nm in FIG. 7C) and two transmission peaks in a predetermined wavelength band (for example, 740 nm in FIG. 7C) that is longer than the wavelength band of light from the subject 10.
  • the light incident on the variable spectroscopic element 14b is light in the visible wavelength band of 400 nm to 700 nm reflected by the subject 10, and is shorter than the light in the visible wavelength band of 400 nm to 700 nm.
  • the second control by the variable spectroscopic element control unit 13 is performed as in the fourth modification, light other than leakage light can be shielded from the light incident on the variable spectroscopic element 14b.
  • the second image acquired by the image sensor 14c and the image generation unit 15a is an image of only the component of the leaked light, and the image calculation unit 15d has the pixel levels of the first image and the second image.
  • the tone value difference is calculated, the gradation value of the leaked light is removed from the first image.
  • Other configurations and operational effects are substantially the same as those of the spectral image acquisition apparatus and spectral image acquisition method of the first embodiment.
  • the first control and the second control by the variable spectral element control unit 13 are performed every time the imaging element 14c captures an image of one frame.
  • the image sensor 14c and the image generation unit 15a are alternately switched to acquire the first image (narrowband image) and the second image (reference image), but the second image (reference image).
  • the timing for obtaining the value is not limited to this.
  • the image sensor 14c and the image generation unit 15a acquire the respective narrowband images as the first image and then the second image (see The variable spectroscopic element control unit 13 performs the first control and the second control at the timing of acquiring a set of a plurality of narrowband images each having a different wavelength and a reference image. And may be switched. Further, for example, the frequency with which the first image (narrowband image) and the second image (reference image) are acquired may be varied depending on the subject 10.
  • the image sensor 14c and the image generation unit 15a alternately switch the first image (narrowband image) and the second image (reference image).
  • first image “narrowband image”
  • second image reference image
  • the timing for acquiring these second images (reference images) exemplified may be incorporated in the apparatus, or the timing at which the operator acquires the second images (reference images) can be set.
  • the timing setting unit 7 is provided in the input unit 12, and the variable spectroscopic element control unit 13 switches between the first control and the second control in synchronization with the timing set via the second image acquisition timing setting unit. You may do it.
  • FIG. 8 is a block diagram illustrating an overall configuration of an endoscope apparatus using a spectral image acquisition apparatus that performs the spectral image acquisition method according to the second embodiment of the present invention.
  • the spectral image acquisition apparatus of the second embodiment includes an image shift amount detection unit 15e in the image processing unit 15.
  • the image shift amount detection unit 15e corresponds to the image shift amount detection unit 6 in FIG. 1 and is acquired first by the image acquisition unit (the image sensor 14c and the image generation unit 15a) after acquiring the second image (reference image).
  • the first image is used as a reference image, and the positional deviation amount of the subject 10 in the first image acquired by the image acquisition unit after acquiring the reference image with respect to the subject 10 in the reference image is detected.
  • the edge of the subject 10 in the image is detected, and the positional deviation amount of the coordinate where the edge is detected is detected by the number of pixels, or the gradation change amount on the predetermined coordinate of the image is detected. Etc., such that it is performed by a known method.
  • the variable spectroscopic element control unit 13 determines that the position shift amount of the subject 10 detected by the image shift amount detection unit 15e exceeds a predetermined threshold (for example, an edge shift amount of about 1 to several pixels).
  • the first control is switched to the second control, and after the image acquisition unit (the image sensor 14c and the image generation unit 15a) acquires the second image, the second control is switched to the first control. .
  • the image calculation unit 15d performs the first image. Even if the difference between the second image and the second image is calculated, the leaked light component included in the spectral image cannot be removed.
  • the first image spectral image
  • the second image reference A single image is sufficient.
  • the second image cannot be acquired efficiently, and the first image and the second image The position of the subject 10 in the center is likely to be shifted, or the second image is likely to be acquired more than necessary, and the accuracy of removing leaked light in the spectral image is likely to be reduced, and the frame rate is likely to be reduced.
  • the position of the subject has moved to an extent that adversely affects the calculation of the difference between the first image and the second image in the image calculation unit 15d. Since only one second image can be acquired at other times and the first image can be acquired at other times, the leaked light can be obtained with high accuracy regardless of the speed of movement of the subject.
  • the removed spectral image can be acquired at a high frame rate.
  • the image calculation unit 15d as the image correction processing unit includes the first image (spectral image) and the second image.
  • the imaging conditions for example, the exposure time
  • the difference between the first image and the second image generated by the image generation unit 15a may be simply taken.
  • the image calculation unit 15d serving as the image correction processing unit After performing a predetermined correction calculation process on the second image (reference image) so that the image (spectral image) and the second image (reference image) are acquired under substantially the same imaging conditions, It is good to perform a difference calculation.
  • the predetermined correction calculation processing for example, when the exposure time when capturing the first image (spectral image) is 20 msec and the exposure time when capturing the second image (reference image) is 10 msec, image generation is performed.
  • a corrected second image (corrected reference image) obtained by doubling the gradation value of each pixel of the second image (reference image) generated by the unit 15a may be generated. Thereafter, a difference between the first image (spectral image) and the corrected second image is acquired.
  • the gradation values for fixed noise that is not related to the length of the exposure time such as lead-out noise (noise generated when reading an electric signal from the image sensor 14c) are left as they are (( In other words, it is desirable to correct the image in the above example (not doubled).
  • the embodiments and examples of the spectral image acquisition apparatus and the spectral image acquisition method of the present invention have been described.
  • the spectral image acquisition apparatus and the spectral image acquisition method of the present invention are not limited thereto, and are described above. It may be a combination of the form and the characteristic configuration in each example.
  • an example suitable for observing reflected light of a specific narrow band wavelength within the visible wavelength band by an endoscope has been described.
  • the spectral image acquisition device and the spectral image acquisition method of the present invention can also be used in infrared fluorescence observation.
  • variable spectroscopic element control unit has a spectral characteristic in which the spectral characteristic of the variable spectroscopic element has a transmission peak near the fluorescence wavelength in the first control, and the variable spectroscopic element in the second control.
  • the surface interval and angle between a pair of optical substrates are controlled so that the spectral characteristics of the optical spectrum are such that the transmission peak of the variable spectral element does not exist in the wavelength band of the excitation wavelength reflected by the subject and the fluorescence wavelength emitted from the subject.
  • the spectral image acquisition apparatus and spectral image acquisition method of the present invention can be applied not only to an endoscope but also to an observation apparatus that performs spectral observation such as a microscope or a monitoring camera.
  • the spectral image acquisition apparatus and spectral image acquisition method of the present invention are useful for an observation apparatus that observes a subject using a spectral image using an etalon-type variable spectral element.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Endoscopes (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)

Abstract

L'invention a pour but de proposer un dispositif d'acquisition d'image spectrale dans lequel l'effet de fuite lumineuse est réduit autant que possible et une image spectrale d'une longueur d'onde désirée peut être acquise à un rapport S/B élevé. A cet effet, l'invention comprend : un élément spectral (1) dans lequel l'intervalle ou l'angle entre une paire de substrats optiques est changé et des caractéristiques spectrales sont variables ; une unité de réglage de longueur d'onde de transparence (2) destinée à régler la longueur d'onde de lumière émise par l'élément spectral (1) ; un contrôleur d'élément spectral (3) destiné à changer l'intervalle de surface et l'angle entre la paire de substrats optiques et ainsi commuter entre une première commande destinée à commander l'élément spectral (1) à une caractéristique spectrale dans laquelle un pic de transmission est présent proche de la longueur d'onde réglée par l'unité de réglage (2), et une seconde commande destinée à commander l'élément spectral (1) à une caractéristique spectrale empêchant des pics de transmission d'être présents dans une bande de longueur d'onde constituant une lumière provenant d'un sujet (10) ; une unité d'acquisition d'image (4) destinée à acquérir une image de lumière pénétrant l'élément spectral (1) ; et un processeur de correction d'image (5) destiné à acquérir la différence entre une première image acquise par l'unité d'acquisition (4) lorsque la première commande est réalisée par le contrôleur (3) et une seconde image acquise par l'unité d'acquisition (4) lorsque la seconde commande est réalisée par le contrôleur (3).
PCT/JP2012/064460 2011-06-28 2012-06-05 Dispositif d'acquisition d'image spectrale et procédé d'acquisition d'image spectrale WO2013001994A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2013522559A JP6120770B2 (ja) 2011-06-28 2012-06-05 分光画像取得装置
US14/097,360 US9347830B2 (en) 2011-06-28 2013-12-05 Apparatus and method for obtaining spectral image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011142816 2011-06-28
JP2011-142816 2011-06-28

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/097,360 Continuation US9347830B2 (en) 2011-06-28 2013-12-05 Apparatus and method for obtaining spectral image

Publications (1)

Publication Number Publication Date
WO2013001994A1 true WO2013001994A1 (fr) 2013-01-03

Family

ID=47423894

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/064460 WO2013001994A1 (fr) 2011-06-28 2012-06-05 Dispositif d'acquisition d'image spectrale et procédé d'acquisition d'image spectrale

Country Status (3)

Country Link
US (1) US9347830B2 (fr)
JP (1) JP6120770B2 (fr)
WO (1) WO2013001994A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014173919A (ja) * 2013-03-07 2014-09-22 Seiko Epson Corp 分光測定装置
JP2015161511A (ja) * 2014-02-26 2015-09-07 セイコーエプソン株式会社 光学モジュール、及び電子機器

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6432770B2 (ja) 2014-11-12 2018-12-05 ソニー株式会社 画像処理装置、画像処理方法、並びにプログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08285688A (ja) * 1995-04-13 1996-11-01 Masanori Okuyama スペクトル画像分析装置
JPH0933345A (ja) * 1995-07-07 1997-02-07 Vaisala Oy Ｎｄｉｒ測定装置に使用されるショートエタロン・ファブリー・ペロー干渉計を制御する方法
JP2006084425A (ja) * 2004-09-17 2006-03-30 Tokyo Institute Of Technology マルチスペクトル画像処理方法及びマルチスペクトル皮膚画像による診断方法
JP2006343686A (ja) * 2005-06-10 2006-12-21 Seiko Epson Corp 光学デバイス
JP2010249808A (ja) * 2009-03-24 2010-11-04 Olympus Corp 分光透過率可変素子を備えた分光イメージング装置及び分光イメージング装置における分光透過率可変素子の調整方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7633629B2 (en) * 2007-02-05 2009-12-15 Palo Alto Research Center Incorporated Tuning optical cavities

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08285688A (ja) * 1995-04-13 1996-11-01 Masanori Okuyama スペクトル画像分析装置
JPH0933345A (ja) * 1995-07-07 1997-02-07 Vaisala Oy Ｎｄｉｒ測定装置に使用されるショートエタロン・ファブリー・ペロー干渉計を制御する方法
JP2006084425A (ja) * 2004-09-17 2006-03-30 Tokyo Institute Of Technology マルチスペクトル画像処理方法及びマルチスペクトル皮膚画像による診断方法
JP2006343686A (ja) * 2005-06-10 2006-12-21 Seiko Epson Corp 光学デバイス
JP2010249808A (ja) * 2009-03-24 2010-11-04 Olympus Corp 分光透過率可変素子を備えた分光イメージング装置及び分光イメージング装置における分光透過率可変素子の調整方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014173919A (ja) * 2013-03-07 2014-09-22 Seiko Epson Corp 分光測定装置
JP2015161511A (ja) * 2014-02-26 2015-09-07 セイコーエプソン株式会社 光学モジュール、及び電子機器

Also Published As

Publication number Publication date
US9347830B2 (en) 2016-05-24
US20140092390A1 (en) 2014-04-03
JP6120770B2 (ja) 2017-04-26
JPWO2013001994A1 (ja) 2015-02-23

Similar Documents

Publication Publication Date Title
JP6728070B2 (ja) マルチスペクトルイメージングのための方法及び手段
US11224335B2 (en) Image capturing system and electronic endoscope system
JP2008229024A (ja) 蛍光観察装置
JP5506472B2 (ja) 蛍光内視鏡装置
JP2010227255A (ja) 画像処理装置、撮像装置、画像処理プログラムおよび画像処理方法
JP5462084B2 (ja) 画像処理装置及びプログラム
JP2012157383A (ja) 内視鏡装置
WO2014199984A1 (fr) Système de microscope destiné à la chirurgie
WO2017119239A1 (fr) Dispositif d'endoscope
CN110087528B (zh) 内窥镜系统以及图像显示装置
JP2008128675A (ja) 分光装置
JP6284451B2 (ja) 内視鏡装置
JP6120770B2 (ja) 分光画像取得装置
JP2002272744A (ja) 画像診断装置
JP5489785B2 (ja) 蛍光内視鏡装置
WO2018070474A1 (fr) Système endoscope
JP4919780B2 (ja) 蛍光観察装置
JP5242078B2 (ja) 蛍光内視鏡装置
JP6570484B2 (ja) 分析装置
US20180092519A1 (en) Infrared fluorescence observation device
JP6099518B2 (ja) 内視鏡システム及び作動方法
JP5990141B2 (ja) 内視鏡システム及びプロセッサ装置並びに作動方法
JP6584147B2 (ja) 撮像装置
JP6535701B2 (ja) 撮像装置
JP2012245224A (ja) 電子内視鏡装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12803663

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013522559

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12803663

Country of ref document: EP

Kind code of ref document: A1