WO2017195863A1 - Dispositif d'imagerie - Google Patents

Dispositif d'imagerie Download PDF

Info

Publication number
WO2017195863A1
WO2017195863A1 PCT/JP2017/017866 JP2017017866W WO2017195863A1 WO 2017195863 A1 WO2017195863 A1 WO 2017195863A1 JP 2017017866 W JP2017017866 W JP 2017017866W WO 2017195863 A1 WO2017195863 A1 WO 2017195863A1
Authority
WO
WIPO (PCT)
Prior art keywords
light source
image
selected light
imaging
light sources
Prior art date
Application number
PCT/JP2017/017866
Other languages
English (en)
Japanese (ja)
Inventor
一 長原
池田　哲夫
大崎　誠
Original Assignee
国立大学法人九州大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国立大学法人九州大学 filed Critical 国立大学法人九州大学
Publication of WO2017195863A1 publication Critical patent/WO2017195863A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01—Arrangements or apparatus for facilitating the optical investigation
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G03B15/02—Illuminating scene
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G03B15/02—Illuminating scene
    • G03B15/03—Combinations of cameras with lighting apparatus; Flash units
    • G03B15/05—Combinations of cameras with electronic flash apparatus; Electronic flash units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene

Definitions

  • the present invention relates to an image pickup apparatus that picks up images by switching light sources having a plurality of different wavelength bands.
  • Hyperspectral imaging can extract or visualize features that cannot be identified by humans by using more spectral information than general RGB cameras. Because of these advantages, hyperspectral imaging has been applied in various fields such as remote sensing, food, agriculture, and space. Hyperspectral imaging is also used in the medical field. In the medical field, it is very important to distinguish between normal and abnormal parts of body tissue, for example to identify abnormal parts during surgery and minimize the burden on the patient by performing treatment only on those parts. Can do. Furthermore, if much information obtained by hyperspectral imaging is used, more detailed identification is possible and the success rate of the operation can be increased.
  • the three elements required for a hyperspectral camera are spatial resolution, spectral resolution, and shooting speed. Since the clearer image can be acquired as the spatial resolution is higher, more detailed information about the object can be acquired. Also, the higher the spectral resolution, the more spectral information can be used, so that the object identification accuracy can be improved. Spectral information can be used in real time if the shooting speed is high, and the application destinations are expanded. Therefore, although it is most desirable to obtain a high spatial resolution and high spectral resolution spectral image at high speed, these elements are generally in a trade-off relationship. Improvement in high resolution and imaging speed is a very important factor in hyperspectral imaging, and in particular, improvement in technology relating to acquisition of spectral images with high spatial resolution is strongly desired.
  • the line spectroscopy method (see, for example, Non-Patent Document 1) is a technique for obtaining a hyperspectral image by dispersing light that has passed through a slit into a line shape with an optical element such as a prism or a grating.
  • an optical element such as a prism or a grating.
  • this line spectroscopic method has a high spectral resolution, but when observing an object as a two-dimensional image, the spatial resolution is low and a long photographing time is required.
  • the target reflected light is simply spectrally separated by an optical element and acquired by an image sensor, the spectrally separated light interferes on the sensor.
  • this interference is prevented by passing through a slit, and this is why spatial information can be acquired only one dimension at a time.
  • Non-patent Documents 2 and 3 disclose techniques for acquiring a two-dimensional spectral image at high speed using the line spectroscopic method.
  • Non-Patent Document 2 is to acquire a two-dimensional spectroscopic image at high speed using an optical element using a hole array mask
  • the technique shown in Non-Patent Document 3 has a spatial resolution in a hyperspectral camera.
  • a two-dimensional spectral image with a high spatial resolution and a high spectral resolution is acquired by combining a high camera.
  • Non-Patent Document 2 has a problem that the spatial resolution is low.
  • the technique shown in Non-Patent Document 3 requires a beam splitter, a hole array mask, and the like in addition to two cameras, which increases the size of the apparatus and complicates the setting of the position and angle of the spectroscopic element, the camera, and the like. There is a problem that it ends up.
  • a spectral image is obtained by installing a filter that passes only light in a specific wavelength region in front of a CCD camera or the like.
  • a spectral image with a high spatial resolution can be obtained by using a CCD camera with a high resolution, the spectral resolution is generally not high due to the characteristics of the filter.
  • a filter wheel since the filter is physically rotated, there is a problem in switching speed, and there is a problem that the apparatus is also increased in size.
  • a liquid crystal tunable filter since the wavelength range to transmit is electrically controlled, the switching speed is faster than that of the filter wheel, but the production cost is high.
  • Non-Patent Document 6 As a technique for acquiring a spectral image with a high spatial resolution by a filter method, a technique shown in Non-Patent Document 6 is disclosed.
  • the technique shown in Non-Patent Document 6 acquires a spectral image with a high spatial resolution by using matrix factorization of an RGB image with a high spatial resolution and a spectral image.
  • this apparatus requires a mechanical movable part, and it takes time for imaging compared with the case of only electrical control. In addition, there is a problem that it takes time for matrix calculation.
  • Non-Patent Document 7 As an inexpensive method, there is an active illumination method used in the present application for obtaining a hyperspectral image by switching while switching illuminations having different spectra (see, for example, Non-Patent Document 7). Since switching of illumination is electrically controlled in the same manner as the liquid crystal tunable filter, a target two-dimensional spectral image can be acquired at high speed. However, unlike the line spectroscopic method or the filter method, it is affected by environmental light such as other illumination or sunlight, so it cannot be used outdoors. Further, since a plurality of illuminations having different colors are switched, color flicker occurs depending on the photographing speed. In general, in order to obtain spectral information, it is necessary to switch between illuminations having different spectra, which causes a change in color and flicker.
  • Non-Patent Document 8 is disclosed as a technique related to the active illumination method.
  • the technique shown in Non-Patent Document 8 is a technique that realizes high-speed acquisition of a two-dimensional spectral image using an inexpensive and practical hyperspectral imaging apparatus using an LED.
  • Multispectralspectfilterwheel cameras Geometric distortion model and compensation algorithms, IEEE Transactions on Image Processing, Vol. 17, No. 12, pp. 2368-2380 (2008).
  • hyperspectral imaging is mainly used to distinguish between normal and abnormal parts of body tissue. Acquisition of a target two-dimensional spectral image is the center, and when using it in surgery, it is important to acquire a spectral image at high speed.
  • the active illumination technique can obtain a two-dimensional spectroscopic image at a high speed and at a low cost, but the occurrence of flicker hinders surgery, and in the medical field. There is a problem that usability deteriorates.
  • Non-Patent Document 8 realizes high-speed acquisition of a two-dimensional spectral image using an active illumination method, but does not consider the color of illumination to be switched. That is, when the illumination colors are different, there is a problem that flicker occurs when the illumination is switched.
  • the present invention provides an imaging apparatus capable of reducing the occurrence of flicker by combining a plurality of light sources having different wavelength bands in an active illumination system and reducing a color difference between light sources having a required wavelength.
  • An imaging apparatus includes a plurality of light sources that emit light at different wavelengths, and a selection unit that selects a plurality of light sources that emit light at a specific wavelength specified based on characteristics of an imaging target among the light sources as a selection light source. And, other than the selected light source, the light source having a wavelength that reduces the color difference between the selected light source and the other selected light source by combining the selected light sources with the selected light source.
  • An imaging unit that images an imaging target object by sequentially switching the light source for each selected light source by a light source obtained by synthesizing the selected selected light source and the extracted non-selected light source. are provided.
  • a plurality of light sources that emit light at a specific wavelength specified based on characteristics of the imaging target are selected from a plurality of light sources that emit light at different wavelengths, and are selected when they are combined.
  • the non-selected light source is extracted so that the color difference between the selected light sources is reduced, and the selected light source and the extracted light source are combined.
  • An image pickup apparatus includes an image removal unit that removes an image picked up by a non-selection light source extracted by the extraction unit from an image picked up by the image pickup unit, and a residual image after the removal process by the image removal unit.
  • Display control means for displaying an image.
  • the image captured by the extracted non-selected light source is removed from the captured image, and the remaining image is displayed.
  • a hyperspectral image captured at a wavelength can be displayed with high accuracy in real time.
  • the extraction unit extracts a non-selected light source having a wavelength band in the vicinity of another selected light source with respect to the one selected light source as a non-selected light source to be combined with the one selected light source. It is.
  • the extraction unit serves as a non-selected light source that combines a non-selected light source having a wavelength band in the vicinity of another selected light source with respect to the one selected light source. Since the color difference between one selected light source and the other selected light source is suppressed and switching is performed with illumination that looks like the same color for humans, the occurrence of flicker can be reduced. Play.
  • the extraction unit extracts a non-selected light source having a wavelength band other than the vicinity of the other selected light source according to the external light in the imaging environment.
  • the extraction unit extracts the non-selected light source having a wavelength band other than the vicinity of the other selected light source according to the external light in the imaging environment. As a result, it is possible to display an image that is easy for a human to visually recognize.
  • the extraction unit extracts the light source based on a wavelength band and light intensity of the non-selected light source.
  • the extraction unit extracts the light source based on the wavelength band and the light intensity of the non-selected light source, the color difference between one selected light source and another selected light source is calculated. There is an effect that it can be made smaller and the occurrence of flicker can be remarkably reduced.
  • the extraction unit extracts the light source based on the light intensity in consideration of photosensitive characteristics.
  • the extraction unit extracts the light source based on the light intensity considering the photosensitive characteristic, the color difference between one selected light source and the other selected light source is further reduced.
  • the extraction unit extracts the light source based on the light intensity considering the photosensitive characteristic.
  • the imaging apparatus according to the present embodiment synthesizes illumination that looks the same color to the human eye even if the spectrum is different, in order to reduce flicker that occurs when switching illumination in the active illumination method of hyperspectral imaging. To do.
  • the same color reference: Miyazaki, D., Saneshige, T., Baba, M., Furukawa, R., Aoyama, M. and Hiura, S
  • etamerism-based shading illusion 14th IAPR International Conference on Machine Vision Applications (MVA), IEEE, pp. 255-258 (2015).
  • FIG. 1 is a hardware configuration diagram of the imaging apparatus according to the present embodiment.
  • the imaging apparatus 1 includes an imaging element 11, a CPU 12, a RAM 13, a ROM 14, an input / output I / F 15, a display 16, and a light source 17.
  • the imaging device 11 converts imaging information captured from the camera lens into an electrical signal.
  • Various programs, data, and the like are stored in the ROM 14.
  • Various programs are read into the RAM 13 as necessary and executed by the CPU 12.
  • the input / output I / F 15 is an interface for receiving input from a shutter, a touch panel, various switches, etc., and outputting data to a display, an external memory, or the like.
  • the light source 17 is illumination that irradiates the imaging object, and includes, for example, a plurality of LEDs having different wavelength bands.
  • the hardware configuration is merely an example, and can be changed as necessary.
  • the imaging process shown in FIG. 1 is executed until the imaging process, and a separately connected computer may be used for the image editing process after imaging.
  • FIG. 2 is a functional block diagram of the imaging apparatus according to the present embodiment.
  • the imaging apparatus 1 is configured to realize a function until the imaging object 27 is imaged, and information such as a specific wavelength specified based on the characteristics of the imaging object 27 is input information 26.
  • information such as a specific wavelength specified based on the characteristics of the imaging object 27 is input information 26.
  • the light source information storage unit 23 Based on the information input to the input unit 21 from the input unit 21 that inputs information 26 and the light source information storage unit 23 that stores information about a plurality of light sources that emit light at different wavelengths prepared in advance.
  • a light source selection unit 22 that selects a plurality of pieces of information about the light source as a selected light source, and information on a non-selected light source other than the selected light source selected by the light source selection unit 22 is acquired from the light source information storage unit 23 and combined with the selected light source
  • a light source extraction unit 24 that identifies and extracts a non-selected light source that minimizes the color difference between the selected light sources, and the light source 17 selects the selected light source and the light source extraction selected by the light source selection unit 22.
  • a non-selected source extracted in section 24 in the synthesized light source, illuminating the imaged object 27 sequentially switches the light source to be used for each selected light source.
  • the imaging apparatus 1 is configured to realize a function after imaging the imaging object 27, and an imaging information storage unit 28 that stores imaging information in which an image of the imaging object 27 is converted into an electrical signal by the imaging element 11; Based on information stored in the non-selected light source and the light source information storage unit 23 related to the non-selected light source, an image removing unit 29 that removes information related to the non-selected light source from the imaging information, and the remaining image is displayed on the display 16. Display control unit 30.
  • the LED combination pattern can be expressed by the following m ⁇ n matrix P.
  • the luminance value I of an image captured using illumination having a spectrum of L ′ is
  • Q is the spectrum of the spectral sensitivity characteristic of the camera
  • R is the spectrum of the spectral reflectance of the subject.
  • the LED combination pattern matrix is a square matrix.
  • the following equation (8) is established, so that a spectral image at the dominant wavelength of each LED can be obtained from the captured image.
  • a spectral image can be acquired by an active illumination method even in a place where there is an influence of ambient light.
  • the ambient light is regarded as a kind of LED having a specific spectrum, and illumination is created by combining n + 1 kinds of LEDs. By photographing with this illumination switched, a spectral image can be acquired as in the case where there is no influence of ambient light.
  • a spectral image can be acquired by creating a plurality of illuminations by combining LEDs and switching and photographing them. That is, it is possible to acquire a spectral image captured by a selected light source having a specific wavelength by the processing of the light source selection unit 22.
  • Each spectral image can be acquired by switching the illumination as described above, but flicker occurs when the color difference is large between the switched illuminations. Conversely, in order to reduce flicker, the color difference between the illuminations should be as small as possible.
  • the color of illumination is expressed as a numerical value based on the XYZ color system defined by the CIE (International Lighting Commission). The numerical value is converted into a numerical value on the color coordinate in the L * U * V * color system similarly determined by CIE, and the color difference is handled as the Euclidean distance on the color coordinate.
  • the color difference By treating the color difference as the Euclidean distance, it is possible to optimize the combination of LEDs that minimize the color difference.
  • n types of LEDs are sufficient, but by combining extra LEDs that are not directly related to spectral image acquisition, the color difference between illuminations can be reduced.
  • FIG. 3 and 4 are first image diagrams of the spectrum and color difference of LED illumination.
  • FIG. 3 shows the spectrum of the selected light source
  • FIG. 4 shows the spectrum of the selected light source and the non-selected light source when the color difference is reduced.
  • FIG. 3 when the color difference between a plurality of selected light sources is large, flicker occurs by switching between them.
  • FIG. 4 it is possible to reduce the color difference between the selected light sources by deliberately combining the extra non-selected light sources. In the state shown in FIG. 4, flicker can be reduced even when the selected light source is switched.
  • FIG. 5 is a second image diagram of the spectrum and color difference of LED illumination.
  • FIG. 5 shows the spectra of the selected light source and the non-selected light source when the color difference is reduced with respect to the selected light source of FIG.
  • a non-selected light source having a wavelength band in the vicinity of (a light source in the vicinity of the light source B of the illumination 1 in FIG. 5) is specified and synthesized.
  • a non-selected light source having a wavelength band in the vicinity of (a light source in the vicinity of the light source A of the illumination 2 in FIG. 5) is specified and synthesized.
  • an XYZ color system that can express the wavelength range has been defined.
  • a color is expressed by a mixed color amount of non-existing primal stimuli such as X, Y, and Z.
  • the color matching functions are x ⁇ ( ⁇ ), y ⁇ ( ⁇ ), z ⁇ ( ⁇ ) (“x ⁇ ”, “y ⁇ ”, “z ⁇ ” respectively, where the wavelength is ⁇ .
  • X, Y, and Z are represented by equations (9), (10), and (11), respectively.
  • Formula (12) shows a case where i is a discretization of Formula (9), Formula (10), and Formula (11).
  • L * is a lightness index, and the color in the chromaticity diagram is determined by u * and v * .
  • the color difference is defined as the Euclidean distance on the L * u * v * coordinates.
  • LEDs that satisfy the conditions necessary for acquiring a spectral image using these color coordinates a combination that minimizes the color difference is obtained.
  • LEDs that are non-selected light sources that are not directly related to spectral image acquisition are combined, but the LEDs can be handled in the same manner as ambient light.
  • n types of LEDs are prepared and spectral images at two specific wavelengths are acquired.
  • the spectra of the narrow-band LEDs having two specific wavelengths selected by the light source selection unit 22 as the main wavelengths are L ⁇ 1 and L ⁇ 2 , respectively, and the spectra of the LEDs of the non-selected light sources that are not directly related to spectral image acquisition are L ex And When L ex is the spectrum of the remaining LED combinations, L ex is
  • the range that P and P ′ can take is set to 0 to 1, and is treated as a mixture ratio of each LED, and a lower limit is set to the ratio of L ⁇ 1 and L ⁇ 2 in order to suppress a decrease in the SN ratio of the spectral image.
  • a combination in which 50% or more of the target L ⁇ 1 and L ⁇ 2 LEDs are included in the illumination may be obtained.
  • the condition number of P ′ may be limited to 5 or less in order to obtain the inverse matrix of P stably.
  • the light source extraction unit 24 can extract a non-selected light source that minimizes the color difference between the selected light sources when combined with the selected light source. At this time, it is possible to realize higher performance flickerless hyperspectral imaging by considering the light intensity and human photosensitive characteristics as described above.
  • the above is the description of the configuration and functions of the imaging apparatus according to the present embodiment.
  • FIG. 6 is a flowchart illustrating the operation of the imaging apparatus according to the present embodiment.
  • the input unit 21 inputs, as input information 26, information on a specific wavelength that is a target specified according to the imaging object 27 (S1).
  • the light source selection unit 22 selects a light source whose main wavelength is the wavelength closest to the specific wavelength (S2).
  • the light source extraction unit 24 optimizes the light source to be used so that the color difference between the selected selected light sources is minimized (S3).
  • the imaging object 27 is irradiated with the optimized light source 17 and imaged by the imaging device 11 (S4).
  • the image removing unit 32 removes the image of the wavelength added at the time of optimization from the image obtained by imaging (S5).
  • the display control unit 33 displays the remaining image information on the display 16 (S6), and the process ends.
  • the imaging apparatus when a plurality of light sources that emit light at a specific wavelength specified based on the characteristics of the imaging target are selected from a plurality of light sources that emit light at different wavelengths and combined.
  • the non-selected light source is extracted so that the color difference between the selected light sources is reduced, and the selected light source and the extracted light source are combined.
  • the occurrence of flicker can be reduced by suppressing the color difference between the illuminations (between one selected light source and another selected light source) and switching the illumination so that it appears to the same color for humans. That is, by reducing the occurrence of flicker, for example, an abnormal part can be accurately identified during surgery, and the burden on the patient can be minimized by performing treatment only on that part.
  • the control part which controls a shutter speed for every light source to image.
  • LED spectrum measurement In the following experiment, LED illumination was used as a light source. LED lighting may have different characteristics from those described in the data sheet. In order to know the correct spectral characteristics, the spectrum of the LED used for illumination was measured. Measurement was performed in a dark room, and 27 types of LEDs were measured one by one with a spectroscope. The spectrometer used was a Jaz spectrometer module from Ocean Optics. Since some of the measured LEDs had similar spectral characteristics, 15 types of LEDs were selected from 27 types of LEDs. The spectrum of 15 types of selected LEDs is shown in FIG.
  • a spectral image of an adult male arm was obtained using a liquid crystal tunable filter (LCTF).
  • the liquid crystal tunable filter used is Varispe of CRi, and the measurement wavelength range is 400-720 nm.
  • a spectral image at 653 nm was acquired. This is because in the wavelength region near the red light, the light traveling inside the human body is absorbed by the reduced hemoglobin in the vein, so that the reflected light of the vein portion becomes weak and the vein portion appears dark in the spectroscopic image.
  • Photographing was performed in a dark room, an Apogee cooled CCD camera Alta260 was used for photographing, and an artificial solar illuminating lamp SOLAX XC-100E from Celic was used as a light source.
  • the temperature of the CCD sensor during photographing is -20 degrees, and the exposure time is 2 seconds. Since the captured image contains noise, the noise image captured under the same conditions with the shutter closed was subtracted. The results are shown in FIG. It can be confirmed that the veins appear dark in the image.
  • a spectral image of the arm was acquired by a simple active illumination method. Illumination was created using a red light LED with a dominant wavelength of 653 nm and an infrared light LED with a dominant wavelength of 834 nm. Eight LEDs were arranged on a breadboard and switched using an arduino.
  • the combination pattern matrix P of LEDs in a simple active illumination system is a unit matrix. Photographing was performed in a dark room, and a cooled CCD camera Alta260 manufactured by Apogee was used in the same manner as the filter system. The sensor temperature is -20 degrees and the exposure time is 0.04 seconds.
  • a 653 nm spectral image acquired by a simple active illumination method is shown in FIG. It can be confirmed that the vein appears dark like the image by the filter method.
  • FIG. 10 shows a result of comparison of flicker at the time of switching the LED illumination.
  • FIG. 10 (A) reproduces the state of switching by arranging two types of illumination images created as simple LED illumination
  • FIG. 10 (B) is created as flickerless LED illumination according to the present invention.
  • the state of switching is reproduced by arranging three types of illumination images. As is clear from FIGS. 5A and 5B, it can be confirmed that flicker is suppressed as compared with simple LED illumination.
  • FIG. 8C shows a 653 nm spectral image acquired by the flickerless active LED illumination method.
  • the value of the color matching function and the spectrum value of the LED values in increments of 10 nm from 390 nm to 830 nm were used. As with the other images, it can be confirmed that the veins appear dark.
  • Hemoglobin includes oxygenated hemoglobin HbO 2 bonded to oxygen and reduced hemoglobin Hb not bonded to oxygen.
  • the proportion of hemoglobin that is oxyhemoglobin is called oxygen saturation and serves as an index for knowing the oxygen concentration in the blood.
  • the light absorption characteristics of each hemoglobin are shown in FIG. As shown in FIG. 11, there is a large difference in absorbance near red light, but there is almost no difference in absorbance near infrared light.
  • I 653 and I 834 represent a spectral image at 653 nm and a spectral image at 834 nm, respectively, and IR 653 and IR 834 represent a spectral image at 653 nm and a spectral image at 834 nm of the standard white plate, respectively.
  • the spectral reflectance of the standard white plate is constant in the measurement wavelength range.
  • FIG. 12 shows a 653 nm spectroscopic image obtained from equation (18) and an 834 nm spectroscopic image obtained from equation (19), respectively.
  • 12A is a 653 nm spectral image
  • FIG. 12B is an 834 nm spectral image.
  • FIG. 13 shows an image photographed by a normal RGB camera and an image of the difference in spectral reflectance obtained from equation (20).
  • FIG. 13A is an image taken by an RGB camera
  • FIG. 13B is an image of a difference in spectral reflectance.
  • the normal part contains a lot of oxyhemoglobin, so the difference in spectral reflectance between the two wavelengths is large and the image appears bright.
  • the proportion of deoxyhemoglobin increases, so the difference in spectral reflectance between the two wavelengths decreases and the image appears dark.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Analytical Chemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Biochemistry (AREA)
  • Signal Processing (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Multimedia (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Exposure Control For Cameras (AREA)
  • Stroboscope Apparatuses (AREA)
  • Studio Devices (AREA)

Abstract

Le problème décrit par la présente invention est de fournir un dispositif d'imagerie apte à réduire l'apparition de papillotement dans un système d'éclairage actif en combinant une pluralité de sources de lumière dont les bandes de longueur d'onde sont différentes les unes des autres et en réduisant une différence de couleur entre les sources de lumière de longueurs d'onde requises. La solution selon l'invention concerne un dispositif d'imagerie qui comprend : une pluralité de sources de lumière (17) qui émettent de la lumière ayant des longueurs d'onde différentes ; une unité de sélection de source de lumière (22) qui sélectionne, parmi les sources de lumière (17), une pluralité de sources de lumière sélectionnées dont chacune émet de la lumière ayant une longueur d'onde spécifiée qui est spécifiée sur la base des caractéristiques d'un objet (27) à imager ; une unité d'extraction de source de lumière (24) qui extrait, parmi des sources de lumière non sélectionnées autres que les sources de lumière sélectionnées, une source qui a une longueur d'onde permettant, lorsque ladite source de lumière non sélectionnée et ladite source parmi la pluralité de sources de lumière sélectionnées sont combinées, de réduire une différence de couleur entre ladite source de lumière sélectionnée et les autres sources de lumière sélectionnées ; la source de lumière (17) qui éclaire l'objet (27) à imager, en utilisant une source de lumière obtenue en combinant ladite source de lumière sélectionnée parmi les sources de lumière sélectionnées et la source de lumière non sélectionnée extraite tout en commutant séquentiellement la source de lumière pour chacune des sources de lumière sélectionnées ; et un élément d'imagerie (11) qui image l'objet (27) à imager, à l'aide de la source de lumière d'éclairage.
PCT/JP2017/017866 2016-05-11 2017-05-11 Dispositif d'imagerie WO2017195863A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-095231 2016-05-11
JP2016095231A JP2017203682A (ja) 2016-05-11 2016-05-11 撮像装置

Publications (1)

Publication Number Publication Date
WO2017195863A1 true WO2017195863A1 (fr) 2017-11-16

Family

ID=60267931

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/017866 WO2017195863A1 (fr) 2016-05-11 2017-05-11 Dispositif d'imagerie

Country Status (2)

Country Link
JP (1) JP2017203682A (fr)
WO (1) WO2017195863A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109406450B (zh) * 2018-10-18 2021-05-28 山东大学 多次吸收式微量气体检测系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004198255A (ja) * 2002-12-18 2004-07-15 Minolta Co Ltd 照明装置
JP2005069965A (ja) * 2003-08-27 2005-03-17 Pixart Technology:Kk 測色装置
JP2008102137A (ja) * 2004-01-23 2008-05-01 Olympus Corp カメラ

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004198255A (ja) * 2002-12-18 2004-07-15 Minolta Co Ltd 照明装置
JP2005069965A (ja) * 2003-08-27 2005-03-17 Pixart Technology:Kk 測色装置
JP2008102137A (ja) * 2004-01-23 2008-05-01 Olympus Corp カメラ

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MAKOTO OSAKI ET AL.: "Flickerless Active LED Shomei ni yoru Hyper Spectrum Imaging", KENKYU HOKOKU COMPUTER VISION AND IMAGE MEDIA(CVIM, 5 May 2016 (2016-05-05), pages 1 - 7, Retrieved from the Internet <URL:http://id.nii.ac.jp/1001/00159126> [retrieved on 20170418] *

Also Published As

Publication number Publication date
JP2017203682A (ja) 2017-11-16

Similar Documents

Publication Publication Date Title
Park et al. Multispectral imaging using multiplexed illumination
Monno et al. A practical one-shot multispectral imaging system using a single image sensor
Nguyen et al. Training-based spectral reconstruction from a single RGB image
US11089278B2 (en) Image-processing device, fluorescence observation device and method for emulating a first type of fluorescence observation device on a second type of fluorescence observation device
JP5976676B2 (ja) レンズ部の縦の色収差を利用したイメージングシステム及びその操作方法
US8976239B2 (en) System and apparatus for color correction in transmission-microscope slides
US9787915B2 (en) Method and apparatus for multi-spectral imaging
Soria et al. Multispectral single-sensor RGB-NIR imaging: New challenges and opportunities
JP2023123641A (ja) 個別の狭帯域同期照明によるカラー画像形成
CN106895916B (zh) 一种单次曝光拍摄获取多光谱图像的方法
US20110304820A1 (en) Method and device for imaging a target
WO2017195863A1 (fr) Dispositif d&#39;imagerie
JP2010193378A (ja) 調整装置及び調整方法、並びに撮像装置
Tanriverdi et al. Hyperspectral imaging: Color reconstruction based on medical data
Párraga et al. Accurate mapping of natural scenes radiance to cone activation space: a new image dataset
JP2022006624A (ja) 校正装置、校正方法、校正プログラム、分光カメラ、及び情報処理装置
Ohsaki et al. Hyperspectral imaging using flickerless active LED illumination
EP3691258B1 (fr) Système et procédé d&#39;acquisition d&#39;images
EP4275580A1 (fr) Procédé, processeur et dispositif d&#39;observation de la fluorescence médicale utilisant deux images couleur pour enregistrer la fluorescence
EP4275578A1 (fr) Procédé, processeur et dispositif d&#39;observation médical par fluorescence utilisant une fonction de conversion de couleur dépendant de la couleur
EP4275581A1 (fr) Procédé, processeur et dispositif d&#39;observation de fluorescence médicale pour basculer des images
EP4275577A1 (fr) Procédé, processeur et d&#39;observation de fluorescence médicale utilisant deux images couleur et des caméras couleur pour la fluorescence et la lumière blanche
Nieves Hyperspectral Imaging
JP6896053B2 (ja) 特に顕微鏡および内視鏡のための、蛍光発光性蛍光体のｈｄｒモノクローム画像を作成するためのシステムおよび方法
CN112335233B (zh) 图像生成装置以及摄像装置

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17796221

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17796221

Country of ref document: EP

Kind code of ref document: A1