JP5764472B2 - Endoscopic diagnosis device - Google Patents

Description

  The present invention relates to an endoscope diagnosis apparatus that captures autofluorescence emitted from an autofluorescent substance contained in an observation region of a subject (living body) and acquires an autofluorescence image.

  Conventionally, normal light (white light) emitted from the light source device is guided to the distal end of the endoscope and irradiated on the subject's observation area, and the reflected light is imaged to obtain a normal light image (white light image). In addition, an endoscope that performs normal light observation (white light observation) is used. On the other hand, in recent years, in addition to normal light observation, excitation light (special light) for autofluorescence observation is irradiated to the observation area of the subject, and the autofluorescence emitted from the autofluorescent material is imaged and the autofluorescence image ( An endoscopic diagnostic apparatus that acquires a special light image) and performs autofluorescence observation (special light observation) is used.

  For example, Patent Document 1 describes an endoscope diagnostic apparatus that can acquire both a normal light image and a special light image by alternately performing normal light observation and special light observation. Yes.

  Patent Document 2 discloses an endoscope diagnostic apparatus that performs fluorescence observation including autofluorescence observation, and that can perform switching between normal light observation and fluorescence observation (special light observation). Is described.

  Patent Document 3 describes an endoscope diagnostic apparatus that can perform autofluorescence observation and has a plurality of excitation light sources.

  Patent Document 4 discloses an endoscope diagnostic apparatus that can perform autofluorescence observation, and that distinguishes between normal tissue and abnormal tissue of a subject using autofluorescence. Have been described.

JP 2009-297290 A JP 2011-62408 A JP 2006-187598 A JP 2002-512067 A

  However, Patent Documents 1 to 4 describe an endoscopic diagnostic apparatus that can perform special light observation, in particular, autofluorescence observation, in addition to normal light observation, but the wavelength band of the excitation light source, The intensity ratio of the excitation light source is fixed regardless of the subject (observation site) and observation conditions, and the thickness and blood volume of the mucous membrane and the type and amount of the autofluorescent substance differ depending on the observation site and the state of the lesion. On the other hand, autofluorescence observation was not performed under optimal observation conditions.

  An object of the present invention is to perform autofluorescence observation under the optimal observation conditions corresponding to the observation site and the state of the lesion. Therefore, by performing pre-photographing (pre-photometry) together with normal light observation during normal light observation, It is an object of the present invention to provide an endoscope diagnostic apparatus characterized by measuring observation conditions optimal for fluorescence observation and performing autofluorescence observation based on the measured optimal observation conditions.

  In order to solve the above-described problems, the present invention has two observation modes, a normal light observation mode for performing normal light observation and an autofluorescence observation mode for performing autofluorescence observation, and is used by switching between them. A mirror diagnostic apparatus, which has a normal light source for irradiating white light, an excitation light source for irradiating two or more excitation lights having different center wavelengths, and the living tissue is irradiated with excitation light from the light source unit. An imaging unit that captures autofluorescence emitted from an autofluorescent substance contained in the living tissue to acquire an autofluorescence image, and autofluorescence based on the autofluorescence image acquired by pre-imaging by the imaging unit. Contrast calculation means for calculating the contrast of the image, and the calculated contrast of the autofluorescence image is determined by the type of excitation light simultaneously irradiated from the excitation light source and the ratio of the irradiation intensity thereof. A plurality of storage units that store together with the imaging conditions, and imaging condition determination means that determines imaging conditions for main imaging based on the contrast of the autofluorescence image stored in the storage unit, and the normal light observation mode In the case of switching, the normal light and the excitation light are alternately emitted repeatedly in order for each of a plurality of preset imaging conditions, and pre-imaging is performed by the imaging unit. An autofluorescence image is acquired, and the contrast calculation means calculates the contrast of a plurality of autofluorescence images acquired by pre-photographing, stores the contrast in the storage unit together with the imaging conditions, and is switched to the autofluorescence observation mode. In this case, the imaging condition determining unit determines the imaging condition for the main photographing based on the contrast of the most recent autofluorescent images stored in the storage unit. To provide an endoscope diagnostic equipment.

The contrast calculation means calculates the contrast by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (1) from the high pixel value L _max and the low pixel value L _{min in the} histogram. It is preferable to be calculated.

The contrast calculation by the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (2) from the high pixel value L _max and the low pixel value L _{min in the} histogram. It is preferable to calculate by doing.

The contrast calculation in the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (3) from the high pixel value L _max and the low pixel value L _{min in the} histogram. It is preferable to be calculated.

The contrast calculation in the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (4) from the high pixel value L _max and the low pixel value L _{min in the} histogram. It is preferable to be calculated.

The contrast calculation by the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (5) from the high pixel value L _max and the low pixel value L _{min in the} histogram. It is preferable to be calculated.

The contrast calculation by the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (6) from the high pixel value L _max and the low pixel value L _{min in the} histogram. It is preferable to be calculated.

Further, the low pixel value L _min is an average value of the low value 10% in the histogram after removing the high value 5% from the histogram, and the high pixel value L _max is the high value 5% from the histogram. It is preferable that the average value is a high value of 10% in the histogram after removal.

  The contrast calculation by the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and removing an average value of 30% from the histogram after removing a high value of 10% from the histogram. It is preferable to be calculated as follows.

  Further, the contrast calculating means calculates a plurality of contrasts by changing a ratio of irradiation intensities of the plurality of excitation light sources, and the imaging condition determining means calculates these contrasts by a quadratic curve using a least square method. It is preferable to perform fitting and determine the ratio of the irradiation intensity of the excitation light source that gives the maximum peak as an imaging condition optimal for autofluorescence observation of the target region of the subject.

  Moreover, it is preferable that the autofluorescence image used for the contrast calculation in the contrast calculation means is an autofluorescence image output at a low resolution on the imaging device.

  Moreover, it is preferable that the autofluorescence image used for the contrast calculation in the contrast calculation means is an autofluorescence image in which only the center region of the captured image is output from the imaging device.

  Moreover, it is preferable that the said autofluorescence image is a synthesized image produced | generated by the image process part based on the image signal of the normal light imaged in the said imaging part, and the image signal of autofluorescence.

  In addition, the light source unit includes a first excitation light source and a second excitation light source as the excitation light source, and an irradiation intensity of the first excitation light source and the second excitation light source is set to 1: 0. The first imaging condition, the second imaging condition in which the irradiation intensity of the first excitation light source and the second excitation light source is 0.5: 0.5, and the first excitation light source and the second excitation Imaging is performed based on a third imaging condition in which the irradiation intensity with the light source is set to 0: 1, and the contrast calculation unit includes a first contrast for the first imaging condition and a second contrast for the second imaging condition. And a third contrast with respect to the third imaging condition, and the imaging condition determining means captures an image with the highest contrast among the first contrast, the second contrast, and the third contrast. Determine the conditions And, based on the determined imaging conditions, it is preferable that autofluorescence is performed.

  Preferably, the plurality of excitation light sources having different wavelength bands include a first excitation light source having a center wavelength of 405 ± 10 nm and a second excitation light source having a center wavelength of 445 ± 10 nm.

  According to the present invention, when the fluorescence characteristics that differ depending on the observation site of the subject and the state of the lesion (such as the degree of progress) are measured as pre-photographing during normal light observation, and switched to autofluorescence observation Since autofluorescence observation can be performed based on the optimal observation conditions, a captured image with good diagnostic ability can be obtained from the beginning of autofluorescence observation.

1 is an external view showing an embodiment of an overall configuration of an endoscope diagnostic apparatus according to the present invention. It is a block diagram of this embodiment which shows the internal structure of the endoscope diagnostic apparatus shown in FIG. It is a conceptual diagram showing the front-end | tip part of the endoscope insertion part of the endoscope diagnostic apparatus shown in FIG. It is a conceptual diagram of the rotation filter provided in front of the image pick-up element of the endoscope diagnostic apparatus shown in FIG. It is explanatory drawing explaining an example of the contrast calculation in the contrast calculation means of the endoscope diagnostic apparatus shown in FIG. It is explanatory drawing explaining the other example of the contrast calculation in the contrast calculation means of the endoscope diagnostic apparatus shown in FIG. It is explanatory drawing which shows the timing of illumination with normal light observation and pre imaging | photography in the normal light observation mode of the endoscope diagnostic apparatus shown in FIG. It is explanatory drawing which shows the timing of the actual operation | movement of laser light sources LD1 and LD2 in the normal light observation mode of the endoscope diagnostic apparatus shown in FIG.

  An endoscope diagnostic apparatus according to the present invention will be described in detail below based on a preferred embodiment shown in the accompanying drawings.

FIG. 1 is an external view of an embodiment showing an overall configuration of an endoscope diagnosis apparatus according to the present invention, and FIG. 2 is a block diagram of the embodiment showing an internal configuration thereof.
The endoscopic diagnostic apparatus 10 shown in these drawings includes a light source device 12 that emits a plurality of excitation lights for normal light and autofluorescence observation, and guides light emitted from the light source device 12 to an observation area of a subject. An endoscope body 14 that irradiates and images reflected light or autofluorescence from a subject, a processor device 16 that performs image processing on an image captured by the endoscope body 14 and outputs an endoscope image, and a processor device 16 includes a display device 18 that displays an endoscopic image output from 16 and an input device 20 that receives an input operation.

  Here, the endoscope diagnosis apparatus 10 irradiates a subject with normal light (white light), images the reflected light, and displays (observes) a normal light image (white light image) (normal light observation mode (white). Auto-fluorescence observation, which irradiates the subject with excitation light (special light) for auto-fluorescence observation and images the auto-fluorescence excited by the excitation light and displays the auto-fluorescence image (special light image) Mode (special light observation mode). Then, in the normal light observation mode, together with the normal light observation, the optimum imaging conditions (the combination of excitation light with different center wavelengths, the irradiation intensity of the excitation light, the irradiation time, etc.) are determined. Perform pre-photographing (pre-photometry). Each mode is appropriately switched based on an instruction input from the selector switch 66 (described later) of the endoscope body 14 or the input device 20.

Although details will be described later, the endoscope diagnosis apparatus 10 of the present invention includes a plurality of imaging conditions used for pre-imaging in a storage unit 72 described later of the processor device 16 in advance, and in the normal light observation mode, As described above, pre-photographing (autofluorescence image capturing) is performed based on a plurality of imaging conditions stored in the storage unit 72 described later, together with normal light observation.

(Light source device)
The light source device 12 includes a light source control unit 22, two types of laser light sources LD 1 and LD 2 that emit laser beams having different center wavelengths, a combiner (multiplexer) 24, and a coupler (demultiplexer) 26. ing.

  In the present embodiment, the laser light sources LD1 and LD2 emit narrowband light in a predetermined wavelength range (for example, center wavelength ± 10 nm) having center wavelengths of 405 nm and 445 nm, respectively. The laser light source LD1 is a light source that irradiates excitation light for simultaneously emitting autofluorescence from a plurality of autofluorescent substances, for example, FAD (Flavin Adenin Dinucleotide), porphyrin (PAD), and the like included in the observation region of the subject. . The laser light source LD2 also functions as a light source for irradiating excitation light for simultaneously emitting autofluorescence from a plurality of autofluorescent materials or the like included in the observation area of the subject, as with the above-described LD1, and as will be described later. Also, it functions as a light source for generating excitation light for generating white light (pseudo white light) from the phosphor.

For example, FAD emits autofluorescence in a wavelength range of about 450 to 550 nm when irradiated with excitation light having a predetermined center wavelength included in a wavelength range of about 330 to 400 nm. Porphyrin emits autofluorescence of about 610 to 640 nm when irradiated with excitation light having a predetermined center wavelength included in a wavelength range of about 350 to 550 nm.
The amount of these autofluorescent substances contained in the observed area of the subject varies depending on the observation site, and also varies depending on whether the observed area is a lesion, the degree of progression of the lesion, and each individual. The contrast of the observed autofluorescence image differs depending on the center wavelength of the excitation light and the irradiation intensity.

Moreover, although porphyrin and FAD were mentioned as an autofluorescent substance, an autofluorescent substance is not necessarily limited to these.
For example, other autofluorescent materials include NADH and collagen, which emit autofluorescence upon receiving excitation light having a wavelength range of about 250 to 400 nm and about 200 to 400 nm, respectively.

The laser light sources LD1 and LD2 are individually subjected to on / off control, light intensity control based on irradiation intensity and irradiation time (that is, imaging conditions) by a light source control unit 22 controlled by a control unit 70 of the processor device 16 described later, Further, in the case of pre-photographing in the normal light observation mode, as described above, the control unit 50 reads out a plurality of imaging conditions stored in the storage unit 72 described later, and light source control is performed based on the plurality of imaging conditions. The amount of light is controlled by the unit 22. Note that the irradiation time of the laser light sources LD1 and LD2 may be about 1/30 sec, for example, and the imaging time of the imaging element 58 described later is also about the same.
Further, when the mode is switched to the autofluorescence observation mode, the imaging condition determination unit 71 (to be described later) selects the autofluorescence image stored in the storage unit 72 (to be described later) out of the plurality of imaging conditions used for the pre-imaging. The imaging condition most suitable for the autofluorescence observation is determined, and the light amount control is performed by the light source control unit 22 based on the imaging condition. It is also possible to add a new imaging condition via the input device 20 described later.
As the laser light sources LD1 and LD2, broad type InGaN laser diodes can be used, and InGaNAs laser diodes, GaNAs laser diodes, and the like can also be used.

  The normal light source for generating normal light in the normal light observation mode is not limited to the combination of excitation light and phosphor, and any light source that emits white light may be used. For example, a xenon lamp, a halogen lamp, a white light An LED (light emitting diode) or the like can also be used. The excitation light source used to generate the excitation light for autofluorescence observation used in pre-photographing in the autofluorescence observation mode and the normal light observation mode is not limited to the laser light source (semiconductor laser). Various light sources capable of emitting excitation light with sufficient intensity capable of emitting autofluorescence, for example, a combination of a white light source and a band limiting filter can be used.

In addition, the wavelength of the excitation light in the normal light observation mode (center wavelength, narrow-band light wavelength range) is not particularly limited, and all excitation light having a wavelength capable of generating pseudo white light from the phosphor can be used. It is. The wavelength of the excitation light used for the pre-photographing of the autofluorescence observation mode and the normal light observation mode is not particularly limited, and excitation light having a wavelength that can simultaneously excite a plurality of autofluorescent substances to emit autofluorescence, For example, light having a central wavelength of 405 ± 10 nm or light having a central wavelength of 445 nm ± 10 nm can be suitably used.
The wavelength of the excitation light of the present invention is not limited to the above example, and for example, light having a center wavelength of 473 ± 10 nm can be suitably used.

  Further, the present invention is not limited to irradiating a subject with excitation light of one kind of central wavelength and simultaneously emitting autofluorescence from a plurality of autofluorescent materials, but for simultaneously emitting a plurality of autofluorescence from the light source device 12. A configuration may be employed in which a plurality of excitation lights having different center wavelengths are simultaneously irradiated. In the present embodiment, the normal light source and the excitation light source are configured as a common light source, but the normal light source and the excitation light source may be provided separately.

  In the normal light observation mode, the light source control unit 22 controls the laser light sources LD1 and LD2, the combiner 24, and the coupler 26 so as to alternately perform normal light observation and pre-imaging as described above. Specifically, during normal light observation, the light source control unit 22 turns off the laser light source LD1, turns on the laser light source LD2, controls the combiner 24 and the coupler 26, and narrowband light from the laser light source LD2 is described later. Control is performed so as to irradiate from optical fibers 48A and 48B, which will be described later, provided with phosphors 54A and 54B. The control unit 22 turns on the laser light sources LD1 and LD2 based on one of the plurality of imaging conditions so that the plurality of imaging conditions are photographed one by one, and the combiner 24 and the coupler 26 are turned on. Is controlled so that the narrow-band light emitted from the laser light sources LD1 and LD2 is combined and emitted from optical fibers 46A and 46B described later.

  In the case of the autofluorescence observation mode, as in the case of the pre-photographing in the normal light observation mode, the irradiation intensity and the irradiation time (that is, the imaging conditions) determined by the imaging condition determination means 71 of the control unit 70 described later are used. Based on this, the laser light sources LD1 and LD2 are turned on (including the case where either one of LD1 and LD2 is turned off, of course), and the combiner 24 and the coupler 26 are controlled so that the narrow light beams emitted from these laser light sources LD1 and LD2 are controlled. Control is performed so that the band lights are combined and irradiated from optical fibers 46A and 46B described later.

  Laser light emitted from each of the laser light sources LD1 and LD2 is input to the corresponding optical fiber via a condenser lens (not shown), combined by a combiner 24, and demultiplexed into four systems of light by a coupler 26. Is transmitted to the connector portion 32A. The combiner 24 and the coupler 26 are configured by a half mirror, a reflection mirror, or the like. Further, the combiner 24 and the coupler 26 are controlled by the light source controller 22, and the laser light emitted from each of the laser light sources LD1 and LD2 is controlled to be emitted from a desired optical fiber. However, the present invention is not limited thereto, and the laser light from each of the laser light sources LD1 and LD2 may be sent directly to the connector portion 32A without using the combiner 24 and the coupler 26.

(Endoscope body)
Subsequently, the endoscope main body 14 has four lines (four lights) of light (normal light or autofluorescence observation (including pre-photographing)) from the tip of the endoscope insertion portion 28 inserted into the subject. This is an electronic endoscope having an illumination optical system that emits (excitation light) and an imaging optical system of one system (single eye) that captures an endoscopic image of the observation region. The endoscope main body 14 includes an endoscope insertion unit 28, an operation unit 30 that performs an operation for bending and observing the distal end of the endoscope insertion unit 28, and the endoscope diagnostic device 10 with the light source device 12 and Connector portions 32A and 32B that are detachably connected to the processor device 16 are provided.

  The endoscope insertion portion 28 includes a flexible soft portion 34, a bending portion 36, and a distal end portion (hereinafter also referred to as an endoscope distal end portion) 38.

  The bending portion 36 is provided between the flexible portion 34 and the distal end portion 38 and is configured to be bent by a rotation operation of the angle knob 40 disposed in the operation portion 30. The bending portion 36 can be bent in an arbitrary direction and an arbitrary angle depending on a portion of the subject in which the endoscope main body 14 is used, and the endoscope distal end portion 38 can be directed to a desired observation portion. it can.

  Although not shown, various channels such as a forceps channel for inserting a tissue collection treatment instrument and the like and a channel for air supply / water supply are provided inside the operation unit 30 and the endoscope insertion unit 28. It has been.

  As shown in FIG. 3, two systems of illumination windows 42 </ b> A and 42 </ b> B that irradiate light to the observation region, and reflected light or autofluorescence 1 from the observation region are imaged on the distal end surface of the endoscope distal end portion 38. In addition to the system observation window 44, a forceps port 45 and the like are arranged.

Two systems of optical fibers 46A and 48A are housed behind the illumination window 42A. The optical fibers 46A and 48A are laid from the light source device 12 to the endoscope distal end portion 38 via the connector portion 32A. An optical system such as a lens 50A is attached to the tip of the optical fiber 46A (on the illumination window 42A side). On the other hand, a phosphor 54A is disposed at the tip of the optical fiber 48A, and an optical system such as a lens 52A is attached to the tip of the phosphor 54A.

  Similarly, in the back of the illumination window 42B, there are two systems, an optical fiber 46B having an optical system such as a lens 50B at the tip, and an optical fiber 48B having an optical system such as a phosphor 54B and a lens 52B at the tip. An optical fiber is housed.

The phosphors 54A and 54B absorb a part of blue laser light (for example, center wavelength 445 ± 10 nm) from the laser light source LD2 and excite and emit green to yellow light (for example, YAG-based fluorescent material). Or a fluorescent material such as BAM (BaMgAl ₁₀ O ₁₇ ). When excitation light for normal light observation is irradiated onto the phosphors 54A and 54B, green to yellow excitation emission light (fluorescence) emitted from the phosphors 54A and 54B and the phosphors 54A and 54B are transmitted without being absorbed. Combined with the blue laser light, white light (pseudo white light) is generated.

  The illumination optical systems on the illumination window 42A side and the illumination window 42B side have the same configuration and operation, and illumination unevenness can be prevented by irradiating the illumination light from the illumination windows 42A and 42B simultaneously. Different illumination lights can be irradiated from the illumination windows 42A and 42B. An equivalent function can be realized even in an illumination optical system that emits four systems of illumination light.

  On the other hand, an optical system such as a lens 56 is attached to the back of the observation window 44, and a rotary filter 74 is provided to the back of the lens 56. The light transmitted through the rotary filter 74 is attached to an image sensor 58 such as a CCD (Carge1 Coupled Device) image line or a CMOS (Charge Metal-Oxide Semiconductor) image sensor that acquires image information of an observation area provided at the tip of the filter. It has been. Since the image sensor 58 is used for each frame by dividing time, it is used for both normal light observation (including pre-photographing) and autofluorescence observation. Note that the imaging unit according to the present invention includes an observation window 44, a lens 56, a rotary filter 74, an imaging device 58, a scope cable 62 described later, an A / D converter 64 described later, and an image processing unit 68 described later. .

Further, as shown in FIG. 4, the rotary filter 74 is installed during normal light observation, and is installed during transmission of the reflected light from the subject tissue as it is, pre-imaging and autofluorescence observation. And an excitation light blocking unit 78 that cuts excitation light that is reflected light from the subject tissue. The rotation filter 74 is adjusted so as to rotate once in one frame to be described later. The transmission unit 76 is used for normal light observation, the excitation light blocking unit 78 is used for pre-imaging and autofluorescence observation, and the image sensor 58 is used. It is controlled by a rotating means (not shown) so as to come to the front.
The excitation light blocking unit 78 is a band pass filter that transmits light in a wavelength band from 450 nm to 640 nm, for example.

  The imaging element 58 receives normal light (reflected light) and autofluorescence on a light receiving surface (imaging surface), photoelectrically converts the received light, and outputs an imaging signal (analog signal). A plurality of sets of pixels are arranged on a matrix, with a set of three colors of G and B pixels. On the light receiving surface of the image sensor 58, the reflected light in the wavelength range of 370 to 720 nm of the visible light from the observation region is divided into three wavelength regions corresponding to the R pixel, G pixel, and B pixel, respectively. R, G, and B color filters (not shown) having spectral transmission characteristics that transmit light are provided.

Further, at the time of pre-photographing in the normal light observation mode, the image sensor 58 may perform binning processing to reduce the number of pixels and output the image data of the autofluorescence image. You may output only the imaging data of the autofluorescence image acquired in the part.
The pre-photographing is merely for the purpose of determining the imaging conditions, not for obtaining an autofluorescence image or the like, and if the data capacity of the imaging data to be output is reduced, an image to be described later This is because the contrast calculation unit 69 of the processing unit 68 can also calculate the contrast quickly.

  Note that it is not essential to simultaneously capture R, G, and B images using a color image sensor as the image sensor 58, and a monochrome image sensor and R, G, and B colors may be used. In combination with a color filter, R, G, and B color images may be taken in a frame sequential manner.

  The light guided from the light source device 12 by the optical fibers 46A and 46B and 48A and 48B is irradiated from the endoscope distal end portion 38 toward the observation area of the subject. Then, the reflected light from the observation region irradiated with light or the autofluorescence emitted from the autofluorescent material in the observation region is imaged on the light receiving surface of the image sensor 58 by the lens 56, and is imaged by the image sensor 58. Photoelectrically converted and imaged. The imaging element 58 outputs an imaging signal (analog signal) of the observed area of the imaged subject.

  In normal light observation, excitation light for normal light observation emitted from the laser light source LD2 is guided by the optical fibers 48A and 48B and applied to the phosphors 54A and 54B, and white light emitted from the phosphors 54A and 54B. Light is emitted from the illumination windows 42A and 42B to the observation area of the subject. Then, the reflected light from the observation area of the subject irradiated with white light is collected by the lens 56 and dispersed by a color filter (not shown), and normal light is imaged by the image sensor 58.

  On the other hand, in the case of pre-photographing and autofluorescence observation, excitation light for autofluorescence observation emitted from the laser light sources LD1 and LD2 is guided by the optical fibers 46A and 46B based on the set imaging conditions. The light is irradiated from the distal end portion 38 of the endoscope toward the observation area of the subject. Then, the combined light of autofluorescence simultaneously emitted from a plurality of autofluorescent materials included in the observation region of the subject irradiated with the excitation light is collected by the lens 56 and is excited by the excitation light blocking unit 78 with the excitation light component (center wavelength). 405 ± 10 nm, reflected light of 445 ± 10 nm) is cut, and autofluorescence is imaged by the image sensor 58.

At the time of pre-photographing, as described above, autofluorescence is imaged with a rotation number based on all imaging conditions stored in advance in the storage unit 72, and the autofluorescence is captured by the contrast calculation means 69 of the image processing unit 68 described later. The contrast of the image is calculated and stored in the storage unit 72 together with the imaging conditions.
Further, during autofluorescence observation, based on the contrast of a series of autofluorescence images stored in the storage unit 72 described above, the autofluorescence of the target region of the subject is detected by an imaging condition determination unit 71 described later of the control unit 70. Imaging conditions optimal for observation are determined, and the laser light sources LD1 and LD2 are controlled by the light source control unit 22 based on the determined optimal imaging conditions, and optimal autofluorescence observation is performed.

  The excitation light for autofluorescence observation in this embodiment is a combination of the laser light (LD1) with the center wavelength of 405 ± 10 nm and the laser light (LD2) with the center wavelength of 445 ± 10 nm as described above, and the autofluorescence image is Then, through the excitation light blocking unit 78, the combined light in the wavelength range of about 460 to 640 nm is received and imaged. Therefore, the autofluorescence image mainly contains autofluorescence components of FAD and porphyrin.

  Note that image signals (analog signals) of images (normal light image and autofluorescence image) output from the image sensor 58 are input to the A / D converter 64 through the scope cable 62, respectively. The A / D converter 64 converts an image signal (analog signal) from the image sensor 58 into an image signal (digital signal). The converted image signal is input to the image processing unit 68 of the processor device 16 via the connector unit 32B.

(Processor unit)
Subsequently, the processor device 16 includes an image processing unit 68, a control unit 70, and a storage unit 72. The image processing unit 68 includes a contrast calculation unit 69, and the control unit 70 includes an imaging condition determination unit 71. . The display device 18 and the input device 20 are connected to the control unit 70. As described above, the input device 20 switches the imaging mode (normal light observation mode and autofluorescence observation mode) as well as the input device 20 as described above. It is also possible to additionally set a new imaging condition via.
The processor device 16 controls the light source control unit 22 of the light source device 12 based on an instruction input from the changeover switch 66 of the endoscope main body 14 or the input device 20, and an image signal input from the endoscope main body 14. Are processed, a display image is generated, stored in the storage unit 72, and output to the display device 18.

In both the normal light observation mode and the autofluorescence observation mode, the image processing unit 68 performs the A / D converter 64 of the endoscope main body 14 according to the image type of the normal light image and the autofluorescence image. The image signal (image data) supplied from is subjected to predetermined image processing suitable for each of the normal light image and the autofluorescence image, and the normal light image signal (normal light image) and the autofluorescence image signal (autofluorescence) Image).
The autofluorescence image signal (autofluorescence image) is generated by synthesizing the above-described normal light image signal and autofluorescence image signal supplied from the endoscope body 14 by the image processing unit 68. It is an image signal (composite image).

  The image signal processed by the image processing unit 68 is sent to the control unit 70. In the control unit 70, at least one of the normal light image and the autofluorescence image is displayed on the display device 18 based on the normal light image signal and the autofluorescence image signal according to the observation mode. Further, under the control of the control unit 70, the normal light image signal and the autofluorescence image signal are stored in the storage unit 72 including a memory or a storage device, for example, in units of one (one frame) image as necessary. Is done.

Further, the image processing unit 68 includes a contrast calculating unit 69. When the endoscope diagnosis apparatus 10 is set to the normal light observation mode, the image signal of normal light during normal light observation and the pre-shooting time are displayed. The contrast of the autofluorescence image (that is, the composite image) is calculated based on the autofluorescence image signal at.

すると、自家蛍光画像のコントラストが求められる。 As shown in FIG. 5, the contrast calculation unit 69 calculates the contrast by creating a histogram corresponding to the pixel value and the number of pixels from the autofluorescence image signal (autofluorescence image data). 5% is cut off, and from the histogram of the remaining image data (see the dotted line in FIG. 5), the average value of the upper 10% pixel values (average luminance value) _Lmax and the average value of the lower 10% pixel values (Average value of luminance values) L _min is calculated.
After calculating L _max and L _min , Micson contrast formula (1) is calculated based on these values.

Then, the contrast of an autofluorescence image is calculated | required.

  The contrast of the image signal processed by the image processing unit 68 and the autofluorescence image calculated by the contrast calculation unit 69 is stored in the storage unit 72 through the control unit 70 together with the imaging condition of the autofluorescence image.

As shown in FIG. 6, the contrast calculation unit 69 calculates the contrast by creating a histogram corresponding to the pixel value and the number of pixels from the image data of the autofluorescence image as shown in FIG. The contrast of the autofluorescence image may be obtained by taking the average value of the upper 30% pixel values from the histogram of the remaining image data (see the dotted line frame in FIG. 6).
As described above, the calculated contrast of the autofluorescence image is stored in the storage unit 72 through the control unit 70 together with the autofluorescence image data, the imaging condition of the autofluorescence image, and the like.

としてもよく、また、（１）式の各Ｌに対して対数（常用対数、自然対数どちらでも可）をとって、

としてもよく、また、同様に、（２）式の各Ｌに対して対数（常用対数、自然対数どちらでも可）をとって、

としてもよい。 Note that the contrast calculation in the contrast calculation means 69 is performed by taking a simple difference between L _max and L _{min in} addition to the above-described equation (1).

Also, taking a logarithm (either common logarithm or natural logarithm is acceptable) for each L in the equation (1),

Similarly, taking a logarithm (either common logarithm or natural logarithm is acceptable) for each L in equation (2),

It is good.

としてもよい。
上述の他にも、Ｌ_ｍａｘとＬ_ｍｉｎとの単純な比率（Ｌ_ｍａｘ／Ｌ_ｍｉｎ）を

としてもよく、また、Ｌ_ｍａｘを、そのまま用いて、

としてもよい。
また、前述の画素値と画素の数に対応するヒストグラムの全面積、つまり、自家蛍光画像の全画素数と、自家蛍光画像の全画素値の積算値とを用いて、画素値の平均値を算出し、その平均値を自家蛍光画像のコントラストとしてもよい。 Further, each L in the equation (1) is set to a power of x (x is an arbitrary number),

It is good.
In addition to the above, a simple ratio (L _max / L _min ) between L _max and L _min

It is also possible to use L _max as it is,

It is good.
Further, using the total area of the histogram corresponding to the above-described pixel value and the number of pixels, that is, the total number of pixels of the autofluorescence image and the integrated value of all the pixel values of the autofluorescence image, the average value of the pixel values is calculated. The average value may be calculated as the contrast of the autofluorescence image.

In addition, the autofluorescence image used for the above-described contrast calculation is subjected to processing such as binning (or, if there is a low-resolution image sensor in addition to a high-resolution image sensor, A captured low-resolution autofluorescence image may be used, or an autofluorescence image obtained by extracting only the central region of the captured autofluorescence image may be used. Since the number of pixels used to calculate contrast is reduced, processing can be performed quickly.
The contrast calculation method in the contrast calculation unit 69 can be switched through the input device 20.

  The contrast calculation based on the autofluorescence image data is performed based on the captured autofluorescence image, that is, the number of pre-stored imaging conditions, and is stored in the storage unit 72 together with the autofluorescence image data.

The control unit 70 is based on an instruction from the selector switch 66 of the endoscope body 14 or the input device 20, for example, an instruction such as an observation mode (switching between the normal light observation mode and the autofluorescence observation mode). And the operation of the light source controller 22 of the light source device 12 is controlled.
In addition, the control unit 70 stores the display image that has been subjected to image processing by the image processing unit 68 and can be displayed in the storage unit 72, and displays the display image on the display device 18 as required by an instruction from the input device 20 or the like. .

Then, the control unit 70 performs pre-photographing (autofluorescence image capturing) based on a plurality of imaging conditions set and stored in advance in the storage unit 72 during pre-photographing in the normal light observation mode, and performs image processing. The storage unit 72 stores the autofluorescence image corresponding to the imaging condition calculated by the unit 68 and the contrast calculation unit 69 and its contrast.
In addition, when the control unit 70 is switched from the normal light observation mode to the autofluorescence observation mode, the imaging condition determination unit 71 has the highest contrast among the plurality of the latest autofluorescence images stored in the storage unit 72. By determining the imaging condition based on the autofluorescence image and controlling the light source control unit 22 based on the determined imaging condition, it is possible to perform autofluorescence observation under the optimal imaging condition for the observation region of the subject. .

In addition, the contrast calculating unit 69 calculates a plurality of contrasts by changing the intensity ratio of the excitation light (ratio of irradiation intensity between LD1 and LD2; the total is 1.0), and the imaging condition determining unit 71 The contrast may be fitted with a quadratic curve using the least square method, and the intensity ratio of the excitation light that gives the maximum peak may be determined as an optimal imaging condition for autofluorescence observation of the target region of the subject. .
The above is the configuration of the endoscope diagnosis apparatus 10 of the present invention.

  Next, the operation of the endoscope diagnosis apparatus 10 of the present invention will be described for each observation mode.

(Normal light observation mode)
In the normal light observation mode of the present invention, normal light observation and autofluorescence pre-photographing are alternately performed within one frame. In the case of normal light observation in the normal light observation mode, the laser light source LD1 is turned off and the laser light source LD2 is turned on under the control of the light source control unit 22. Laser light having a central wavelength of 445 ± 10 nm emitted from the laser light source LD2 is applied to the phosphors 54A and 54B, and white light is emitted from the phosphors 54A and 54B. The white light emitted from the phosphors 54A and 54B is irradiated onto the subject, the reflected light is received by the image sensor 58, and a normal light image including R, G, and B channel image signals is captured. The normal light image is displayed in color on the display device 18 based on the R, G, and B channel image signals.

Further, in the case of pre-photographing in the normal light observation mode, for example, if three imaging conditions are stored in advance in the storage unit 72 and pre-photographing is performed based on these three imaging conditions (for example, the first imaging mode) Imaging condition: LD1 · 405 nm (excitation intensity 1.0), second imaging condition: LD1 · 405 nm (0.5) + LD2 · 445 nm (0.5), and third imaging condition: LD2 · 445 (1 0.0)), and pre-photographing (autofluorescence image capturing) is sequentially performed with a rotation number for each of the three imaging conditions with normal light observation in between.
Based on the first imaging condition to the third imaging condition, light emission, irradiation intensity, and irradiation time of the laser light sources LD1 and LD2 are controlled through the light source controller 22, and the excitation light emitted from the laser light sources LD1 and LD2 is applied to the subject. Then, the autofluorescence of the subject based on the excitation light is received by the image sensor 58 through the excitation light blocking unit 78, and R, G, and B channel image signals are output.
The auto-fluorescent image signal output by the image sensor 58 for each imaging condition is imaged either before or after the pre-imaging, and the normal light image signal (normal light image signal) stored in the storage unit 72 and image processing. The image is synthesized in the unit 68, and an autofluorescence image (synthesized image) corresponding to the imaging condition is generated.

In addition, the synthesis of the autofluorescence image signal and the normal light image signal in the image processing unit 68 is performed, for example, by combining the autofluorescence image signal with the G channel of the composite image, the R channel and the B channel of the normal light image, Each is performed by assigning to the R channel and B channel of the composite image.
Thus, the autofluorescence images corresponding to the first to third imaging conditions are displayed in pseudo color on the display device 18 based on the R, G, and B channel image signals.

  In the normal light observation mode, the combination of the normal light observation and the pre-photographing described above is one frame, and the pre-photographing based on the normal light observation and the first imaging condition (excitation light 1) is performed at the timing shown in FIG. Imaging is repeatedly performed in three frames of pre-imaging based on light observation and the second imaging condition (excitation light 2) and pre-imaging based on normal light observation and the third imaging condition (excitation light 3).

When the operation in the normal light observation mode in the graph of FIG. 7 is expressed by the actual operation of the laser light sources LD1 and LD2 of the light source device 12, it is as shown in the graph of FIG.
First, in the first frame, white light (that is, LD2 + phosphor) is emitted and pre-photographing is performed under the first imaging condition. Next, in the second frame, white light is emitted and pre-imaging is performed under the second imaging condition. Shooting is performed, and finally, in the third frame, white light emission and pre-shooting under the third imaging condition are performed, and these are sequentially repeated.
The current value in the graph of FIG. 8 corresponds to the irradiation intensity of the laser light sources LD1 and LD2. Further, since the white light is emitted by the laser light source LD2 + phosphor, the laser light source LD2 actually operates also in the portion of the dashed line in the graph of FIG.

The image processing unit 68 performs image processing on the autofluorescence image corresponding to the first imaging condition to the third imaging condition among the captured images captured in the normal light observation mode, and the contrast calculation unit 69 performs processing of the autofluorescence image. The contrast is calculated, and the autofluorescence image and the contrast corresponding to the first to third imaging conditions are stored in the storage unit 72 through the control unit 70 .

  In the above example, the normal light observation and the pre-photographing are alternately switched as one frame, and the first frame: normal light observation / imaging under the first imaging condition, and the second frame: normal light observation / second imaging. Imaging under conditions, third frame: The imaging was repeated in the order of normal light observation and imaging under the third imaging condition. For example, all the imaging conditions from the first imaging condition to the third imaging condition are set once. In other words, imaging may be repeated in the order of normal light observation, imaging under the first imaging condition, imaging under the second imaging condition, and imaging under the third imaging condition. Pre-imaging in a frame is performed for each of two imaging conditions, that is, first frame: normal light observation / imaging under first imaging condition / imaging under second imaging condition, second frame: normal light observation / third imaging condition , Imaging under the first imaging condition, third frame: normal light view · Imaging in the imaging-third imaging condition in the second imaging condition, may be performed in repeated imaging in the order.

(Autofluorescence observation mode)
When the normal light observation mode is switched to the autofluorescence observation mode, the control unit 70 acquires the latest contrast based on the above-described imaging conditions (from the first imaging condition to the third imaging condition) from the storage unit 72 and determines the imaging condition. By means 71, the imaging condition with the highest contrast is determined. Note that the contrast is calculated in the contrast calculation unit 69 of the image processing unit 68 based on the autofluorescence image corresponding to the imaging condition as described above.
In Table 1 below, since the contrast of the first imaging condition is the highest, the first imaging condition is determined.

  The control unit 70 controls the irradiation intensity and irradiation time of the laser light sources LD1 and LD2 through the light source control unit 22 based on the determined imaging condition (first imaging condition in the example of Table 1), and enters the autofluorescence observation mode. Transition.

  In the autofluorescence observation mode, normally, normal light observation and autofluorescence observation are alternately performed, and an autofluorescence image is acquired together with the normal light image. Of course, the imaging condition in the autofluorescence observation in this case is the imaging condition determined by the imaging condition determining means 71 as described above.

  First, in the normal light observation, as described above, the subject is irradiated with white light, and a normal light image including R, G, and B channel image signals is captured. Then, the normal light image signal is stored in the storage unit 72 under the control of the control unit 70.

Subsequently, in autofluorescence observation, the light source controller 22 controls the emission of the laser light sources LD1 and LD2 based on the imaging condition (for example, the first imaging condition) determined by the imaging condition determination means 71, the irradiation intensity, and The irradiation time is controlled. When laser light (excitation light) emitted from the laser light sources LD1 and LD2 is irradiated to the observation region of the subject, autofluorescence is simultaneously emitted from FAD and porphyrin included in the observation region. Then, the combined light of both autofluorescences is received by the image sensor 58 and the autofluorescence is imaged.

Autofluorescence imaging data (analog data) is converted into image data (digital data) by an A / D converter 64 , input to an image processing unit 68, image processed by an image processing unit 68, and a normal light image. And converted into a display image and output to the display device 18 and the storage unit 72 through the control unit 70. The autofluorescence image displayed on the display device 18 is an autofluorescence image that is easy to observe with high contrast because it was imaged under the optimal imaging conditions determined based on pre-imaging.

Note that the endoscope diagnostic apparatus 10 of the present invention cannot perform pre-imaging for all imaging conditions stored in advance in the storage unit 72 in the pre-imaging in the normal light observation mode. In some cases, contrast for all imaging conditions is not calculated.
In that case, when switched to the autofluorescence observation mode, the imaging condition determining means 71 acquires the contrast of the autofluorescence image calculated and stored so far, and the imaging condition determining means 71 obtains the imaging condition with the highest contrast. Autofluorescence observation may be performed based on the determined imaging condition, autofluorescence observation may be performed based on a predetermined imaging condition corresponding to the imaging region to be observed, The imaging conditions of the latest autofluorescence observation mode may be stored in the storage unit 72, and autofluorescence observation may be performed based on the latest imaging conditions.

  As mentioned above, although the endoscope diagnostic apparatus 10 of this invention was demonstrated in detail, this invention is not limited to the said embodiment, In the range which does not deviate from the summary of this invention, various improvement and change are performed. May be.

DESCRIPTION OF SYMBOLS 10 Endoscope diagnostic apparatus 12 Light source apparatus 14 Endoscope main body 16 Processor apparatus 18 Display apparatus 20 Input apparatus 22 Light source control part 24 Combiner (multiplexer)
26 Coupler
28 Endoscope insertion part 30 Operation part 32A, 32B Connector part 34 Soft part 36 Bending part 38 End part (Endoscope end part)
40 Angle knob 42A, 42B Illumination window 44 Observation window 45 Forceps port 46A, 46B, 48A, 48B Optical fiber 50A, 50B, 52A, 52B, 56 Lens 54A, 54B Phosphor 58 Image sensor 62 Scope cable 64 A / D converter 66 changeover switch 68 image processing unit 69 contrast calculation unit 70 control unit 71 imaging condition determination unit 72 storage unit 74 rotating filter 76 transmission unit 78 excitation light blocking unit LD1, LD2 laser light source

Claims (15)

An endoscopic diagnostic device having two observation modes, a normal light observation mode for performing normal light observation and an autofluorescence observation mode for performing autofluorescence observation, and switching between them,
A light source unit including a normal light source that emits white light and an excitation light source that emits two or more excitation lights having different center wavelengths;
An imaging unit that captures autofluorescence emitted from an autofluorescent material contained in the living tissue by irradiating the living tissue with excitation light from the light source unit, and acquires an autofluorescence image;
Contrast calculation means for calculating the contrast of the autofluorescence image based on the autofluorescence image acquired by pre-shooting by the imaging unit;
A storage unit that stores a plurality of contrasts of the calculated autofluorescence image together with an imaging condition that is a type of excitation light simultaneously irradiated from an excitation light source and a ratio of irradiation intensity thereof,
An imaging condition determining means for determining an imaging condition for main imaging based on the contrast of the autofluorescence image stored in the storage unit,
When the normal light observation mode is switched, the normal light and the excitation light are alternately and repeatedly irradiated with the excitation light in order for each of a plurality of preset imaging conditions. To obtain a self-fluorescent image by performing pre-photographing, and by using the contrast calculation means, calculate the contrast of a plurality of autofluorescent images obtained by pre-photographing, and store the contrast together with the imaging conditions in the storage unit,
An endoscope that, when switched to the autofluorescence observation mode, determines the imaging conditions for the main imaging based on the contrast of the most recent autofluorescence images stored in the storage unit by the imaging condition determination means Diagnostic device. Contrast calculation by the contrast calculation means is performed by creating a histogram from the pixel values of the autofluorescence image and calculating the following equation (1) from the high pixel value L _max and the low pixel value L _{min in the} histogram. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated.

The calculation of the contrast in the contrast calculation means is to create a histogram from the pixel values of the autofluorescence image and calculate the following equation (2) from the high pixel value L _max and the low pixel value L _{min in the} histogram. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated by:

The calculation of the contrast in the contrast calculation means is to create a histogram from the pixel values of the autofluorescence image and calculate the following expression (3) from the high pixel value L _max and the low pixel value L _{min in the} histogram. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated by:

The calculation of the contrast in the contrast calculation means is to create a histogram from the pixel values of the autofluorescence image and calculate the following equation (4) from the high pixel value L _max and the low pixel value L _{min in the} histogram. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated by:

The calculation of the contrast in the contrast calculation means is to create a histogram from the pixel values of the autofluorescence image and calculate the following equation (5) from the high pixel value L _max and the low pixel value L _{min in the} histogram. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated by:

The calculation of the contrast in the contrast calculation means is to create a histogram from the pixel values of the autofluorescence image and calculate the following equation (6) from the high pixel value L _max and the low pixel value L _{min in the} histogram. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated by:

The low pixel value L _min is an average value of the low value 10% in the histogram after removing the high value 5% from the histogram, and the high pixel value L _max is the high value 5% excluded from the histogram. The endoscope diagnosis apparatus according to any one of claims 2 to 7, wherein the endoscope diagnosis apparatus has an average value of 10%, which is a high value in a later histogram.   The calculation of the contrast in the contrast calculation means creates a histogram from the pixel values of the autofluorescence image, and uses the average value of 30% of the high value of the histogram after removing the high value of 10% from the histogram as the contrast. The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is calculated as described above.   The contrast calculating means calculates a plurality of contrasts by changing a ratio of irradiation intensities of the plurality of excitation light sources, and the imaging condition determining means fits these contrasts with a quadratic curve using a least square method. 10. The endoscopy according to claim 1, wherein a ratio of the irradiation intensity of the excitation light source that gives the maximum peak is determined as an optimum imaging condition for autofluorescence observation of the target region of the subject. Mirror diagnostic device.   The autofluorescence image used for the calculation of the contrast in the contrast calculation means is an autofluorescence image output at a low resolution in the imaging device. Endoscopic diagnostic device.   The autofluorescence image used for the contrast calculation in the contrast calculation means is an autofluorescence image in which only the central region of the captured image is output from the imaging device. An endoscopic diagnostic device according to claim 1.   The self-fluorescent image is a composite image generated by an image processing unit based on an image signal of normal light and an image signal of autofluorescence captured by the imaging unit. The endoscopic diagnostic apparatus according to any one of the above. The light source unit includes a first excitation light source and a second excitation light source as the excitation light source, and the irradiation intensity of the first excitation light source and the second excitation light source is 1: 0. Imaging conditions,
A second imaging condition in which an irradiation intensity of the first excitation light source and the second excitation light source is 0.5: 0.5; and an irradiation intensity of the first excitation light source and the second excitation light source Image based on the third imaging condition of 0: 1
The contrast calculation means calculates a first contrast for the first imaging condition, a second contrast for the second imaging condition, and a third contrast for the third imaging condition;
The imaging condition determining means determines an imaging condition having the highest contrast among the first contrast, the second contrast, and the third contrast, and based on the determined imaging condition, autofluorescence observation The endoscope diagnosis apparatus according to claim 1, wherein the endoscope diagnosis apparatus is performed.   The plurality of pumping light sources having different wavelength bands include a first pumping light source having a center wavelength of 405 ± 10 nm and a second pumping light source having a center wavelength of 445 ± 10 nm. The endoscope diagnosis apparatus according to any one of the above.

Images