JP2003164414A - Method and device for displaying fluoroscopic image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display fluoroscopic images which enable reducing identification time when an observer identifies the nature of tissue according to the images, without reducing the accuracy of identifying the nature of the tissue. <P>SOLUTION: A CCD imaging device 101 is used to obtain a narrow-band fluoroscopic image and a broad-band fluoroscopic image from a fluoroscopic image Zj produced by fluorescence emitted from an observed part 1 being irradiated with excitation light Le. A fluoroscopic arithmetic value calculating part 303 calculates a fluoroscopic arithmetic value as a division value of pixel values between images. A fluoroscopic image generating part 304, using two different kinds of gradient functions, creates two fluoroscopic images for which color information is created according to the fluoroscopic arithmetic value, and displays the images on a monitor 90. The fluoroscopic images are pseudo color images reflecting the nature of the tissue, with one of the images suited for observing normal areas and the other for observing affected areas. The observer changes the fluoroscopic image of interest as necessary according to observation purposes. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention acquires a fluorescence image based on fluorescence emitted from an observation section by irradiation of excitation light and an auxiliary image based on re-radiation light emitted from the observation section by irradiation of light. However, the present invention relates to a fluorescence diagnostic image display method and apparatus for displaying a fluorescence diagnostic image based on the fluorescence image and the auxiliary image.

[0002]

2. Description of the Related Art Conventionally, when a living body observation section is irradiated with excitation light of a predetermined wavelength band, the fluorescence intensity emitted from normal tissue and diseased tissue are different from each other, so that the living body observation section is excited with a predetermined wavelength. A fluorescence diagnostic image display device has been proposed which displays the localization / infiltration range of lesion tissue as a fluorescence diagnostic image by irradiating light and receiving fluorescence emitted from a living body observation part. Fluorescent diagnostic images are created based on drug fluorescence emitted from living tissue that has previously absorbed a fluorescent diagnostic agent, and based on autofluorescence emitted from biological tissue without using a fluorescent diagnostic agent. However, fluorescence diagnostic images created mainly from autofluorescence are currently used. Normally, when excitation light is applied to a living body observation part, strong autofluorescence is emitted from normal tissue and weak autofluorescence is emitted from diseased tissue. Therefore, the lesion state can be determined by measuring the fluorescence intensity. In many cases, this type of fluorescence diagnostic image display device has an endoscope inserted inside the body cavity,
It is built into a colposcope or surgical microscope.

By the way, since the living body part has irregularities, the distance from the excitation light irradiation system to the living body observation part is not uniform,
The illuminance of the excitation light in the portion irradiated with the excitation light of the living body is generally non-uniform. On the other hand, the intensity of fluorescence emitted from normal tissue is almost proportional to the illuminance of excitation light, and the illuminance of excitation light decreases in inverse proportion to the square of the distance. For this reason, there is a case where the lesion tissue located nearer than the normal tissue far from the light source receives strong fluorescence, and if the observer makes a determination based on only the fluorescence intensity, the lesion state is erroneously determined. It is possible.

In order to reduce such a problem, a narrow band fluorescence image near a wavelength band of 480 nm in which the difference between the fluorescence intensity emitted from a normal tissue and the fluorescence intensity emitted from a diseased tissue is large, and a fluorescence in a wide visible wavelength band. A fluorescent endoscope apparatus that captures an image and obtains a fluorescence calculation value by dividing a pixel value of a narrow band fluorescence image by a pixel value of a wide band fluorescence image, and displays a pseudo color image based on the fluorescence calculation value. Proposed. That is, by obtaining the calculated fluorescence value, the term of the fluorescence intensity depending on the distance between the excitation light source and the fluorescence receiving section and the living body observation section is canceled, and a display in which only the difference in the shape of the fluorescence spectrum is reflected is obtained. .

On the other hand, the fluorescence calculation value based on the ratio of the light intensity of the excitation light received by the site of the living tissue and the light intensity of the fluorescence emitted from the site by the reception of this excitation light, that is, the excitation light is irradiated. A method has also been proposed in which the tissue property of the observation part is identified by obtaining a value that reflects the fluorescence yield, which is a value that is not affected by the distance and angle. However, when obtaining a value that reflects the above fluorescence yield, the excitation light is not uniformly absorbed by various living tissues, so even if the intensity distribution of the reflected excitation light is measured, the living tissue receives the light. It does not mean that the intensity distribution of the excitation light is correctly measured.

Therefore, as one measure for obtaining the fluorescence yield, near-infrared light that is uniformly absorbed by various living tissues is irradiated to the living tissues as a reference light, and the reflected near-infrared light is IR. Imaged as a reflection image, the light intensity was used as a substitute for the light intensity of the excitation light received by the living tissue, and the fluorescence calculation value obtained by dividing the pixel value of the fluorescence image by the pixel value of the IR reflection image was calculated. A fluorescent diagnostic image display device has been proposed which displays a pseudo color image based on values. That is, by obtaining the calculated fluorescence value, the term of the fluorescence intensity depending on the distance between the excitation light source and the fluorescence receiving section and the living body observation section is canceled, and a display in which only the difference in fluorescence yield is reflected is obtained. .

Further, in order to display an image including information on the shape of the observation part together with information on the fluorescence emitted from the observation part irradiated with the excitation light, the pixel value of the narrow band fluorescence image is set to the pixel value of the wide band fluorescence image. Creates color information based on the fluorescence calculation value divided by the pixel value or the fluorescence calculation value obtained by dividing the fluorescence image pixel value by the reference light reflection image pixel value, and the brightness information based on the reference light image pixel value. The present inventors have also proposed a fluorescence diagnostic image display device that creates a fluorescence diagnostic image by synthesizing both information. Usually, the fluorescence calculation value obtained from the normal tissue is larger than the fluorescence calculation value obtained from the diseased tissue.

In the above fluorescent diagnostic image display device, binary display or gradation display is often used as the display form of the fluorescent diagnostic image. For example, when using the binarized display, if the fluorescence calculation value is smaller than the normal boundary value set based on the fluorescence calculation value obtained from the fluorescence acquired from the existing normal tissue, it is displayed in pink. When the calculated fluorescence value is equal to or higher than the normal boundary value, it can be displayed in green. Or, if the fluorescence calculation value is larger than the lesion boundary value set based on the fluorescence calculation value obtained from the fluorescence acquired from the existing lesion tissue, it is displayed in yellow and the fluorescence calculation value is less than or equal to the lesion boundary value. Can be displayed in red. Further, when gradation display is used, the calculated fluorescence value can be displayed as continuous or discontinuous color change.

Further, for example, if a fluorescence diagnostic image is created by the additive color mixing method based on the pixel values of the narrow band fluorescence image and the broad band fluorescence image, the shape of the fluorescence spectrum and the fluorescence intensity are reflected in the hue. Diagnostic images can be created. Alternatively, if a fluorescence diagnostic image is created by a color mixing method based on the fluorescence image and the pixel value of the IR reflection image, the fluorescence yield and fluorescence intensity can be created to create a fluorescence diagnostic image reflected in its hue. .

[0010]

In recent years, in various medical fields, diagnostics using the above fluorescent diagnostic images have been tried,
As a result, it has become clear that the fluorescent diagnostic images having different display states have advantages and disadvantages.

For example, when a fluorescence diagnostic image by gradation display is displayed, the observer can know the stepwise tissue property of each region of the observation part. But in a short time,
Area where the calculated fluorescence value is quite large and can be regarded as normal tissue (hereinafter referred to as normal area)
And the calculated fluorescence value is not so large, it is difficult to distinguish it from a region that may be a lesion tissue. Similarly, a region where the calculated fluorescence value is considerably small and can be regarded as a lesion tissue (hereinafter referred to as a lesion region),
There is a problem that it is difficult in a short time to distinguish a region that has a possibility that a normal tissue is not so small as the calculated fluorescence value. On the other hand, when the fluorescence diagnostic image by the binarized display is displayed, it is possible to identify a region having a desired tissue property in a short time, but it is not possible to know the delicate tissue property of each region, The accuracy of identifying the tissue property is reduced.

Considering, for example, a case where a medical examination is performed using a fluorescence diagnostic image, it is not necessary to observe the state of a normal region in detail during the medical examination, and the observation time for one subject is limited. Therefore, the binarized display in which the normal region is displayed in green and the region having a possible lesion is displayed in pink or the like is desirable.

However, if a lesion area is found during the medical examination, it is desirable to observe the properties of the lesion area in detail, but from the fluorescence diagnostic image by the binarized display, the area displayed in pink is normal. Although not an area,
There is a problem that it is not possible to know whether it is a region close to a normal region or a region that is likely to be a lesion.

Further, in the conventional fluorescence diagnostic image display device, when displaying a fluorescence diagnostic image by gradation display, for example, a region suspected of a lesion is found and more detailed gradation display observation is performed. Even if you want to,
There is also a problem that it is not possible to observe a fluorescence diagnostic image having a desired display state.

In view of the above-mentioned problems of the prior art, the present invention acquires a fluorescence image based on fluorescence emitted from an observation section by irradiation of excitation light and re-emits it from the observation section by irradiation of light. Obtaining an auxiliary image based on radiant light, to generate a fluorescence diagnostic image reflecting the ratio of the pixel value of the fluorescent image and the pixel value of the auxiliary image, in the fluorescent diagnostic image display method and device to display, the observer, When identifying a tissue property based on a fluorescence diagnostic image, a fluorescence diagnostic image display method capable of displaying a fluorescence diagnostic image capable of shortening the identification time without reducing the identification accuracy of the tissue property, and The purpose is to provide a device.

[0016]

The fluorescence diagnostic image display method according to the present invention obtains a fluorescence image based on fluorescence emitted from an observation section irradiated with excitation light, and the observation section is irradiated with light. Acquiring an auxiliary image based on the re-radiated light emitted from, to generate a fluorescence diagnostic image based on the ratio of the pixel value of the fluorescence image and the pixel value of the auxiliary image, the fluorescence diagnosis to display the fluorescence diagnostic image In the image display method, to generate a plurality of different types of fluorescence diagnostic image of different display state,
The present invention is characterized in that at least two types of fluorescent diagnostic images having different display states are simultaneously displayed.

The fluorescence diagnostic image display apparatus according to the present invention includes a fluorescence image acquisition means for irradiating an observation part with excitation light and acquiring a fluorescence image based on fluorescence emitted from the observation part by the irradiation of the excitation light. Auxiliary image acquisition means for irradiating the observation part with light and acquiring an auxiliary image based on the re-radiation light emitted from the observation part by the irradiation of the light, and a pixel value of the fluorescence image and a pixel value of the auxiliary image. In a fluorescent diagnostic image display device including a fluorescent diagnostic image generating unit that generates a fluorescent diagnostic image based on a ratio, and a display unit that displays the fluorescent diagnostic image, the fluorescent diagnostic image generating unit is a plurality of different display states. A type of generating the fluorescent diagnostic images of different types, wherein the display means simultaneously displays at least two types of fluorescent diagnostic images of different display states. A.

The term "re-radiation light" as used herein means the light emitted from the observation section when it is irradiated with light, and specifically, the reflected light reflected by the observation section or the surface of the observation section. It means scattered light scattered in the vicinity and then emitted, or fluorescence emitted from the observation part. Also, "pixel value"
Is not limited to the signal value corresponding to one image pickup pixel in the image pickup device or the like, but is also a signal value obtained by adding signal values of a plurality of image pickup pixels by binning processing or the like, or a signal value between a plurality of neighboring image pickup pixels. It also includes signal values obtained by performing addition processing and subtraction processing from. Note that "generating a fluorescence diagnostic image based on the ratio of the pixel value of the fluorescent image and the pixel value of the auxiliary image" means that the display color or the display density based on the divided value of the pixel value of the fluorescent image and the auxiliary image. Is set to generate a fluorescence diagnostic image, or to generate a fluorescence diagnostic image by the additive color mixing method based on the pixel values of the fluorescence image and the auxiliary image. The above-mentioned divided value is not limited to the value obtained by ordinary division, and, for example, the inventors of the present invention have proposed Japanese Patent Application Nos. 2000-134495 and
As filed in 001-18242, in order to prevent the divergence of the divided value, the offset value is added to the pixel value and then the divided value is also included. Further, it is preferable that the fluorescence image and the auxiliary image used when generating the fluorescence diagnostic image are images of substantially the same observation part taken at substantially the same time. Note that "displaying two types of fluorescence diagnostic images at the same time" means displaying two types of fluorescence diagnostic images side by side using one monitor or a plurality of monitors.

As one of the display states, gradation display using a predetermined gradation function can be used. The remaining one
Any one of the display states may be used. For example, gradation display using different gradation functions, binary display, or uniform / gradation display combining uniform display and gradation display can be used. . Further, it is also possible to use an additive color mixture display or the like in which additive color mixture is directly performed without calculating the calculated fluorescence value.

As one of the display states, a binarized display using a predetermined threshold value can be used. The remaining one display state may be any, for example, binary display using different threshold values, gradation display, uniform display,
Gradation display, additive color mixing display, and the like can also be used. The uniform / gradation display or the additive color mixture display may be combined, or the uniform / gradation display and the additive color mixture display may be combined.

The display state may be switched by a switching signal input from the outside or a switching signal generated at a predetermined time interval in the device. In this case, for example, the display may be switched from gradation display to another display form, that is, binarized display, uniform / gradation display, mixed color display, or a predetermined floor. The gradation display using the tone function may be switched to the gradation display using another gradation function, that is, the gradation display may be switched in the same display form.

Various combinations of the fluorescence image and the auxiliary image are conceivable. For example, as the fluorescence image, a narrow band fluorescence image based on fluorescence in a narrow wavelength band in the fluorescence is used, and as the auxiliary image, the observation part is irradiated with excitation light, and the fluorescence emitted from the observation part. A broadband fluorescence image based on the fluorescence of a wide wavelength band of may be used. At this time, the excitation light for obtaining the fluorescence image and the excitation light for obtaining the auxiliary image may be the same or different.

As another combination, as the fluorescence image, a fluorescence image based on fluorescence of a predetermined wavelength band in the fluorescence or fluorescence of the entire wavelength band is used, and the auxiliary light is used as a reference light to the observation unit. Alternatively, a reference light reflection image based on the reflected light reflected by the observation unit may be used. If a normal image that is a normal color image is displayed at the same time as the fluorescence diagnostic image, a brightness image when the normal image is generated can be used as the auxiliary image.

The fluorescence diagnostic image display device can also be incorporated into an endoscope device having an endoscope insertion portion to be inserted into a living body.

[0025]

According to the fluorescent diagnostic image display method and apparatus of the present invention, a plurality of types of fluorescent diagnostic images having different display states are generated and at least two types of fluorescent diagnostic images having different display states are simultaneously displayed. The observer can identify the tissue property based on at least two fluorescence diagnostic images with different display states. For example, if one of the two images is a fluorescence diagnostic image using a binarized display, it is possible to distinguish the observation area and the other area having the desired properties in a short time, and the other one If is a fluorescence diagnostic image using a gradation function, it is possible to know the stepwise tissue property of each region of the observation part. That is, by simultaneously arranging fluorescence diagnostic images of different display forms and displaying them on a monitor or the like, it is possible to shorten the identification time without lowering the identification accuracy of the tissue property.

[0026]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First, referring to FIG. 1 to FIG. 4, a first application of the fluorescence diagnostic image display apparatus according to the present invention
A fluorescent endoscope apparatus, which is a specific embodiment of the present invention, will be described. FIG. 1 is a schematic configuration diagram of a fluorescence endoscope apparatus, FIG. 2 is an explanatory diagram of a fluorescence diagnostic image, and FIGS. 3 and 4 are schematic diagrams of an optical filter and a switching filter mounted in the present fluorescence endoscope apparatus. is there.

This fluorescence endoscope apparatus is a normal image mode for displaying a normal image 2 which is a normal color image, or a fluorescent image generated by the fluorescence emitted from the observation section by irradiating the living body observation section with excitation light. , Fluorescent diagnostic image mode that displays a fluorescent diagnostic image that is a pseudo color image generated based on the IR reflected image by the reflected light reflected by the observing unit by irradiating the observing unit with reference light that is near infrared light It works.
In the fluorescent diagnostic image mode, as shown in FIG. 2, two fluorescent diagnostic images 3 and 4 gradation-displayed by using different gradation functions are displayed side by side on the monitor 90. Two
Switching between the two modes is performed by an input operation from the input device 61.

In the normal image mode, the frame sequential light (R
Light Lr, G light Lg, and B light Lb) are reflected and reflected by the observation unit 1 to form a normal image by the CCD image sensor 101 provided at the tip of the scope unit 10 and the normal color signal processing. The displayed normal image 2 is displayed on the monitor 90. In the fluorescence diagnostic image mode, a narrow-band fluorescence image and a broad-band fluorescence image are acquired from the fluorescence emitted from the observation unit 1 irradiated with the excitation light Le using the CCD image sensor 101, and the pixel values of both fluorescence images are acquired. The color information is created based on the fluorescence calculation value that is the division value of the reference light L that is the near infrared light.
Brightness information is created based on the pixel values of the IR reflected image Zs obtained by the reflected light of the observation unit 1 irradiated with s with the CCD image pickup device 101, and the fluorescence diagnostic image 3 in which both the image information are combined and 4 is displayed on the monitor 90.

The fluorescent endoscope apparatus according to the first embodiment of the present invention is equipped with a CCD image pickup device 101 at the tip thereof, and a scope section 10 inserted into a suspected lesion of a patient and a normal image pickup apparatus. A light source that emits field-sequential light (R light Lr, G light Lg, and B light Lb) that is illumination light, a light source that emits excitation light Le for fluorescent image capturing, and a reference light Ls for IR reflected image capturing.
An illumination unit 20 including a light source that emits, calculates a fluorescence calculation value from pixel values of a narrow band fluorescence image and a wide band fluorescence image, creates color information based on the fluorescence calculation value, and creates a pixel value of an IR reflection image. Fluorescence image processing unit 30 that creates luminance information based on the fluorescence diagnostic image signal and generates and outputs the fluorescence diagnostic image signal, generation of the normal image signal, and the normal image signal and the fluorescence diagnostic image signal output from the fluorescence image processing unit 30. Image processing unit 40, C for converting the video signal into a video signal and outputting it
CCD drive unit for controlling the operation of the CD image pickup device 101
50, a controller 60 for controlling the operation of each unit, an input device 61 connected to the controller 60, and a monitor 90 as display means for displaying the normal image 2 or the fluorescence diagnostic images 3 and 4. The illumination unit 20, the fluorescence image processing unit 30, the normal image processing unit 40, the CCD driving unit 50, and the controller 60 constitute a processor unit 91, and the scope unit 10 and the processor unit 91.
The processor unit 91 and the monitor 90 are connected to each other by connectors (not shown) so that they can be separated from each other.

The scope section 10 includes a light guide 102 and a CCD cable 103 which extend to the tip inside. An illumination lens 104 and an objective lens 105 are provided at the tip of the light guide 102 and the CCD cable 103, that is, at the tip of the scope section 10. CCD cable 103
A mosaic filter 106, in which minute band-pass filters are combined in a mosaic pattern, is on-chip at the tip of the C
A CD image pickup device 101 is connected, and a prism 107 is attached to the CCD image pickup device 101. Further, between the prism 107 and the objective lens 105, an excitation light cut filter 108 that cuts light having a wavelength of 420 nm or less is attached.

The CCD image pickup device 101 is a frame transfer type CCD image pickup device having a light receiving portion for converting a picked-up optical image into signal charges and a storage portion for temporarily storing and transferring the signal charges. The light guide 102 is a light guide 102a for field sequential light and a light guide for excitation light.
The light guide 102c and the light guide 102c for reference light are bundled and integrated in a cable shape, and each light guide is connected to the illumination unit 20.

The cable 103 includes a drive line 103a to which a drive signal for the CCD image pickup device 101 is transmitted and a CCD image pickup device.
An output line 103b for reading out an image signal from 101 is combined. One end of the drive line 103a is connected to the CCD drive unit 50, and one end of the output line 103b is connected to the fluorescence image processing unit 30 and the normal image processing unit 40.

As shown in FIG. 3, the mosaic filter 106 includes a narrow band filter 106a that transmits light in the wavelength band of 430 nm to 530 nm and an all wavelength band filter 106b that transmits light in the entire wavelength band, which are alternately combined. The band-pass filters correspond to the pixels of the CCD image sensor 101 on a one-to-one basis.

The illumination unit 20 includes a white light source 201 for emitting white light, a white light source power source 202, and white light for R light Lr and G light.
A switching filter 204 for sequentially performing color separation on the light Lg and the B light Lb, a filter rotating unit 205 for rotating the switching filter 204, a GaN-based semiconductor laser 206 and a semiconductor laser for emitting excitation light Le having a wavelength of 410 nm for capturing a fluorescent image. Power source 207, reference light Ls that is near infrared light for capturing an IR reflected image
A reference light source 209 for emitting light, and a reference light source power supply 210 electrically connected to the reference light source 209.

As shown in FIG. 4, the switching filter 204 includes an R filter 204a that transmits R light Lr, a G filter 204b that transmits G light Lg, and a B filter that transmits B light Lb.
And a mask portion 204d having a light shielding function. By the mask portion 204d, frame sequential light (R light Lr,
While G light Lg or B light Lb) is not irradiated, C
In the CD image pickup device 101, the signal charge is transferred from the light receiving portion to the storage portion.

The CCD drive unit 50 is a CCD image pickup device.
It outputs an operation control signal for controlling the operation timing of 101.

The fluorescence image processing unit 30 includes a signal processing circuit 301 for performing a process process of an image signal picked up by the CCD image pickup device 101 when the excitation light Le is irradiated, and an image signal outputted from the signal processing circuit 301. A / to digitize
The D conversion circuit 302 receives the digitized image signal at the pixel corresponding to the narrow band fluorescent filter 106a of the mosaic filter 106 and the narrow band fluorescence image composed of the image signal received at the pixel corresponding to the full wavelength band filter 106b. An image memory 303 to store in a different storage area with a broadband fluorescence image composed of image signals, and a pixel value of a narrowband fluorescence image captured by adjacent pixels stored in the image memory 303 The fluorescence calculation value calculation unit 304 for calculating the fluorescence calculation value divided by, and the color information corresponding to the fluorescence calculation value for each of the two types of gradation functions input from the controller 60 (from the large to the small fluorescence calculation value). (Green to yellow to red is assigned to each change), and the brightness information is created based on the pixel value of the IR reflection image stored in the image memory 308 described later, and the color information and the brightness information are combined. To generate a fluorescence diagnostic image signal, that is, to generate two fluorescence diagnostic image signals corresponding to two kinds of gradation functions, and output the fluorescence diagnostic image signal to a video signal processing circuit 405 described later. A signal processing circuit 306 that performs a process process on an image signal received by a pixel corresponding to the full wavelength band filter 106b of the mosaic filter 106 among the image signals captured by the CCD image sensor 101 when the reference light Ls is emitted. , The signal processing circuit 3
An A / D conversion circuit 307 for digitizing the image signal output from 06 and an image memory 308 for storing an IR reflection image composed of the digitized image signal are provided.

The normal image processing unit 40 includes R light Lr, G
A signal processing circuit 401 which, when irradiated with the light Lg or the B light Lb, processes the image signal received by the pixel corresponding to the full wavelength band filter 106b of the mosaic filter 106.
An A / D conversion circuit 402 for digitizing the image signal output from the signal processing circuit 401, an image memory 403 for storing the digitized image signal as an image (R image, G image and B image) for each color A normal image generation unit 404 that generates a normal image signal from an image of each color stored in the image memory, and when displaying a normal image, the normal image signal output from the normal image generation unit 404 is a video signal. When the fluorescent diagnostic image is displayed after being converted into a video signal, the video signal processing circuit 405 is provided which converts the fluorescent diagnostic image signal output from the fluorescent diagnostic image generation unit 305 into a video signal and outputs the video signal. ing. The controller 60 is connected to each part and controls the operation timing.

The operation of the fluorescent endoscope apparatus according to the present invention will be described below. In the normal image mode, frame sequential light irradiation, normal image capturing, and normal image 2 display are performed, and in the fluorescence diagnostic image mode, excitation light Le or reference light Ls is irradiated and a fluorescent image capturing or IR. The capturing of the reflection image is performed in a time division manner, and fluorescence diagnostic images 3 and 4 based on the fluorescence image and the IR reflection image are displayed.

First, the operation in the normal image mode will be described. Prior to imaging, the observer inserts the scope unit 10 into the body cavity of the subject and guides the distal end of the scope unit 10 to the vicinity of the observation unit 1.

First, the operation for acquiring the R image will be described. The white light source power source 202 is driven based on a signal from the controller 60, and white light is emitted from the white light source 201. White light is condensed by the condenser lens 203 and passes through the switching filter 204. In the switching filter 204, the R filter 204a is arranged on the optical path based on the signal from the controller 60. Therefore, the white light becomes R light Lr when passing through the switching filter 204. The R light Lr is incident on the light guide 102a, guided to the tip of the scope unit 10, and then emitted from the illumination lens 104 to the observation unit 1.

The reflected light of the R light Lr reflected by the observation section 1 is condensed by the condenser lens 105, reflected by the prism 107, and imaged as an R light reflected image Zr on the CCD image pickup element 101. . Among the image signals output from the CCD image pickup device 101, the all wavelength band filter of the mosaic filter 106
Only the signal received by the pixel corresponding to 106b is processed by the signal processing circuit 401 of the normal image processing unit 40 and output as the R image signal, and the remaining signals are discarded. The R image signal is converted into a digital signal by the A / D conversion circuit 402 and stored in the R image storage area of the image memory 403. After that, the G image and the B image are acquired by the same operation, and are stored in the G image storage area and the B image storage area of the image memory 403, respectively.

The R, G and B images are image memories
Once stored in 403, the normal image generation unit 404 generates and outputs a normal image signal from the three-color image at the display timing. The video signal processing circuit 405 converts the normal image signal into a video signal and outputs it to the monitor 90. A normal image 2 which is a color image is displayed on the monitor 90.

Next, the operation for displaying the fluorescence diagnostic image will be described. The observer uses the input device 61 to select the fluorescence diagnostic image mode. At this time, the gradation function for displaying the fluorescence diagnostic image is also set at the same time. As the gradation function, a linear type shown by a solid line in FIG. 5, a gamma type shown by a dotted line (γ = 2.5), a gamma type shown by a dashed line (γ = 0.4), or a sigmoid shown by a dashed line. Various gradation functions such as types are stored in the controller 60 in advance. The observer can select a desired gradation function from these gradation functions via the input device 61.
The controller 60 uses the selection result as the fluorescence diagnostic image generation unit.
Output to 305.

When the linear type gradation function is selected, the fluorescence diagnostic image in which the calculated fluorescence value is linearly reflected in the display gradation color (green to yellow to red) is displayed. When the gamma type (γ = 0.4) is selected and the calculated fluorescence value is small, the change in gradation color is small with respect to the change in the calculated fluorescence value. A fluorescent diagnostic image in which the change in gradation color with respect to the change in the calculated fluorescence value becomes large is displayed. For this reason, the fluorescence diagnostic image generated using this gradation function is used when a detailed observation of the tissue properties of a region with a large fluorescence calculation value, that is, a region with a high possibility of being a normal tissue, is performed. It is a fluorescence diagnostic image suitable for.

When the gamma type (γ = 2.5) is selected and the calculated fluorescence value is small, the change in gradation color is large with respect to the change in the calculated fluorescence value, and the calculated fluorescence value is As the value increases, the change in gradation color with respect to the change in the fluorescence calculation value decreases. Therefore, the fluorescence diagnostic image using this gradation function is suitable for detailed observation of the tissue properties of a region with a small fluorescence calculation value, that is, a lesion region that is likely to be a lesion tissue. It is a fluorescence diagnostic image.

When the sigmoid type is selected,
When the fluorescence calculation value is small or large, the change of the gradation color is small with respect to the change of the fluorescence calculation value, and in the meantime, the change of the gradation color with respect to the change of the fluorescence calculation value is large. To be done. Therefore, a fluorescence diagnostic image using this gradation function is a region where the fluorescence calculation value is neither small nor large, that is, a normal region,
This is a fluorescence diagnostic image suitable for detailed observation of the tissue properties of a region that cannot be said to be a lesion region (hereinafter referred to as an intermediate region). In the present embodiment, the observer sets the gamma type (γ = 0.4) and the gamma type (γ = 2.5) as the gradation function.

After the above settings are completed, the actual image pickup is started. First, the excitation light source power supply 207 is driven based on a signal from the controller 60, and the GaN-based semiconductor laser 20
Excitation light Le having a wavelength of 410 nm is emitted from 6. The excitation light Le passes through the lens 208, enters the light guide 102b, is guided to the tip of the scope unit 10, and then is an illumination lens.
The observation unit 1 is irradiated from 104.

The fluorescence from the observing section 1 generated by the irradiation of the excitation light Le is condensed by the condenser lens 105, reflected by the prism 107, transmitted through the mosaic filter 106, and passed through the CCD image sensor 101. Is imaged as a fluorescence image Zj. At this time, since the reflected light of the excitation light Le is cut by the excitation light cut filter 108, the CCD image sensor
It never hits 101.

In the CCD image pickup device 101, the fluorescent image Zj is received, photoelectrically converted, converted into an image signal according to the intensity of light, and output.

The signal output from the CCD image pickup device 101 is processed by the signal processing circuit 301 of the fluorescence image processing unit 30 and converted into a digital signal by the A / D conversion circuit 302, and the narrow band filter 106a. Is stored in the storage area of the image memory 303. The fluorescence calculation value calculation unit 304 obtains and stores a fluorescence calculation value obtained by dividing the pixel value of the narrow band fluorescence image by the pixel value of the broad band fluorescence image for each adjacent pixel.

Next, the operation for picking up the IR reflection image Zs of the reference light Ls will be described. Based on the signal from the controller 60, the reference light source power supply 210 is driven, and the reference light Ls that is near infrared light is emitted from the reference light source. The reference light Ls passes through the lens 211, is incident on the light guide 102c, is guided to the tip of the scope portion, and then is irradiated from the illumination lens 104 to the observation portion 1.

The reflected light of the reference light Ls reflected by the observation section 1 is condensed by the condenser lens 105, reflected by the prism 107, transmitted through the mosaic filter 106, and IR reflected by the CCD image sensor 101. An image Zs is formed. In the CCD image pickup device 101, the IR reflected image Zs is received, photoelectrically converted, converted into an image signal according to the intensity of light, and output.

The signal output from the CCD image pickup device 101 is processed by the signal processing circuit 306 of the fluorescence image processing unit 30, and only the signal received by the pixel corresponding to the full band filter 106b is processed and output. , A / D conversion circuit 30
It is converted into a digital signal at 7 and stored in the image memory 308 as an IR reflection image.

When the IR reflection image is stored in the image memory 308, in the fluorescence diagnostic image generation unit 305, first, for each pixel,
Using a preset gradation function, create color information corresponding to the fluorescence calculation value (green to yellow to red are assigned to the change of the fluorescence calculation value from large to small), and create an image. Luminance information is created from the pixel values of the IR reflection image stored in the memory 308, a fluorescence diagnostic image signal is generated from these color information and brightness information, and is output to the video signal processing circuit 405. The fluorescence diagnostic image signal includes an image signal generated using the gamma type (γ = 0.4) as a gradation function and an image signal generated using the gamma type (γ = 2.5). 2 types of image signals are output. The video signal processing circuit 405 converts the two types of fluorescence diagnostic image signals into video signals and outputs the video signals to the monitor 90. The monitor 90 has a gamma type (γ = 0.
4) and a fluorescent diagnostic image 3 which is a pseudo color image and a gamma type (γ = 2.
The fluorescence diagnostic image 4 generated by using 5) is displayed.
The observer uses the gamma type (γ = 0.4) as the gradation function.
When the scope portion 10 is moved while observing the fluorescence diagnostic image 3 generated using, and a lesion area is found,
By focusing on the fluorescence diagnostic image 4 generated using the gamma type (γ = 2.5) displayed side by side,
The tissue property of the lesion area can be observed in detail.

As is clear from the above description, in the fluorescence endoscope apparatus according to the present embodiment, the fluorescence diagnostic images 3 and 4 in which the display colors are assigned to the calculated fluorescence values by using different gradation functions, Since the images are displayed side by side on the monitor 90, the observer can appropriately select an image of interest according to the purpose of observation. Therefore, the tissue property identification time is shortened, and the identification can be performed based on the two fluorescence diagnostic images, so that the identification accuracy is also improved. Further, since the gradation display is used, the observer can know the stepwise texture of each region of the observation part.

Further, since each fluorescence diagnostic image is displayed in pseudo color in which the brightness changes according to the pixel value of the IR reflection image, it is displayed as an image with unevenness of the observation part and a sense of distance.

In this embodiment, since the calculated fluorescence value reflects the difference in the shape of the fluorescence spectrum,
The tissue property of each region can be identified based on the difference in the shape of the fluorescence spectrum of the fluorescence emitted from the normal region and the shape of the fluorescence spectrum emitted from the unknown region.

Next, with reference to FIGS. 6 and 7, a fluorescent endoscope apparatus according to a second specific embodiment of the present invention will be described. FIG. 6 is a schematic configuration diagram of the fluorescence endoscope device, and FIG. 7 is a schematic diagram of an optical filter mounted in the present fluorescence endoscope device.

This fluorescence endoscope apparatus is a normal image which is a normal color image, a fluorescent image of fluorescent light emitted from the observation section by irradiating the living body observation section with excitation light, and a near infrared ray in the observation section. The three fluorescent diagnostic images, which are pseudo color images generated based on the IR reflection image by the reflected light reflected by the observation unit by irradiating the reference light which is light, are simultaneously displayed on the monitor. Therefore, the normal image, the fluorescence image, and the IR reflection image are captured in time division.

When a fluorescence diagnostic image is generated, a broad band fluorescence image is acquired from the fluorescence emitted from the observation section 1 irradiated with the excitation light Le, and the reference light L which is a near infrared light.
An IR reflection image is acquired from the reflected light of the observation unit 1 irradiated with s, and the fluorescence calculation value obtained by dividing the pixel value of the broadband fluorescence image by the pixel value of the IR reflection image is calculated for each pixel. The color information is created based on the above, the brightness information is created based on the pixel value of the IR reflection image, and the fluorescence diagnostic image is created based on both image information. As the fluorescence diagnostic image, a fluorescence diagnostic image 5 binarized using a normal boundary value described later, a fluorescence diagnostic image 6 binarized using a lesion boundary value described later, and a sigmoid type floor are displayed. The fluorescent diagnostic image 7 is displayed in gradation using the tone function. In FIG. 6, the same elements as those in FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted unless particularly necessary.

The fluorescent endoscope apparatus according to the second embodiment of the present invention is equipped with a CCD image pickup device 101 at the tip thereof, and a scope section 11 inserted into a suspected lesion of a patient and a normal image pickup apparatus. An illumination unit 21 including a light source that emits white light Lw that is illumination light, a light source that emits excitation light Le for capturing a fluorescent image, and a light source that emits reference light Ls for capturing an IR reflected image, a broadband fluorescent image Calculating a fluorescence calculation value from the pixel value of the pixel value and the IR reflection image, creating color information from the fluorescence calculation value, and creating brightness information from the pixel value of the IR reflection image,
A fluorescence image processing unit 31 for generating and outputting a fluorescence diagnostic image signal, generation of a normal image signal, and conversion of the normal image signal and the fluorescence diagnostic image signal output from the fluorescence image processing unit 31 into a video signal for output. Normal image processing unit 41, CCD driving unit 51 for controlling the operation of CCD image pickup device 101, controller 62 for controlling the operation of each unit, input device 61 connected to controller 62, normal image 2 and fluorescence diagnostic image 5 It is composed of a monitor 92 for displaying ~ 7. The illumination unit 21, the fluorescence image processing unit 31, the normal image processing unit 41, the CC
The D drive unit 51 and the controller 62 are the processor unit
The scope section 11, the processor section 93, the processor section 93, and the monitor 92 are connected to each other by connectors (not shown) so as to be freely connected and separated.

The scope section 11 includes a light guide 102 and a CCD cable 103 which extend to the tip inside. An illumination lens 104 and an objective lens 105 are provided at the tip of the light guide 102 and the CCD cable 103, that is, at the tip of the scope section 11. CCD cable 103
At the tip of the C, an on-chip mosaic filter 111 in which minute band-pass filters are combined in a mosaic pattern is provided.
A CD image pickup device 101 is connected, and a prism 107 is attached to the CCD image pickup device 101. Further, between the prism 107 and the objective lens 105, an excitation light cut filter 108 that cuts light having a wavelength of 420 nm or less is attached.

As shown in FIG. 7, the mosaic filter 111 transmits G in the wavelength band of 520 nm to 600 nm.
A filter 111a, a Cy filter 111b that transmits light in the wavelength band of 430 nm to 600 nm, and a Ye filter 111c that transmits light in the wavelength band of 520 nm or more are combined, and each band filter is a pixel of the CCD image sensor 101. There is a one-to-one correspondence with.

The illumination unit 21 includes a white light source 201 which emits white light Lw, a white light source power source 202, a GaN semiconductor laser 206 which emits excitation light Le, and a semiconductor laser power source 207.
, A reference light source 209 that emits the reference light Ls, and a reference light source power supply 210.

The fluorescent image processing unit 31 processes the signal processed by the signal imaged by the CCD image sensor 101 when the excitation light Le is irradiated, and outputs the image signal obtained by the signal processing circuit 301. A / D conversion circuit 302 for digitizing, image memory 311 for temporarily storing the digitized image signal, operation / image memory for calculating and storing a broadband fluorescence image from the image signal stored in the image memory 311 312, the pixel value of the broadband fluorescence image stored in the calculation / image memory 312 is stored in the image memory 308
A fluorescence calculation value calculation unit 313 that calculates a fluorescence calculation value divided by the pixel value of the IR reflection image, and image signals for the three fluorescence diagnostic images 5 to 7 are generated, and each image signal is a video signal processing circuit.
The fluorescence diagnostic image generation unit 314 for outputting to the 405 and the reference light Ls
, A signal processing circuit 306 that performs a process process of a signal imaged when irradiated, an A / D conversion circuit 307 that digitizes the image signal obtained by the signal processing circuit 306, among the digitized image signals, The mosaic filter 111 includes an Ye filter 111c and an image memory 308 for storing an IR reflection image which is an image signal received by a pixel corresponding to the Ye filter 111c.

The fluorescence diagnostic image generation unit 314 allocates the uniform color information of green based on the normal boundary value S1 input from the controller 62 when the calculated fluorescence value is larger than the normal boundary value S1. When the calculated value is equal to or less than the normal boundary value S1, the color information is created by allocating the uniform color information of yellow, and the brightness information is created from the pixel value of the IR reflection image stored in the image memory 308. An image signal for the fluorescence diagnostic image 5 is generated from the color information and the luminance information, and the lesion boundary value
Based on S2, if the calculated fluorescence value is greater than or equal to the lesion boundary value S2, assign yellow uniform color information, and if the calculated fluorescence value is less than the lesion boundary value S2, assign red uniform color information. The color information is created, the brightness information is created from the pixel values of the IR reflection image stored in the image memory 308, and the image signal for the fluorescence diagnostic image 6 is created based on the color information and the brightness information. Using a sigmoid type gradation function, color information is created based on the calculated fluorescence value, and brightness information is created from the pixel values of the IR reflection image stored in the image memory 308. Based on this, an image signal for the fluorescence diagnostic image 7 is generated and each image signal is output to the video signal processing circuit 405.

In the present embodiment, the observer presets a normal boundary value S1, a lesion boundary value S2, and a gradation function, which will be described later. Calculation / image memory
In 312, the pixel value of the broadband fluorescence image is set to the pixel value of the image signal received by the pixel corresponding to the Cy filter 111b of the mosaic filter 111 for each adjacent pixel, and the Ye filter 11
It is calculated by adding the pixel values of the image signal received by the pixel corresponding to 1c and subtracting the pixel value of the image signal received by the pixel corresponding to G filter 111a from the added value.

The normal image processing unit 41 outputs signal from the signal processing circuit 411 which performs process processing on the signal received by the pixel corresponding to each micro filter of the mosaic filter 111 when the white light Lw is emitted, and the signal processing circuit 411. An A / D conversion circuit 402 for digitizing the image signal thus generated, an image memory 403 for storing the digitized image signal, a normal image generator 412 for generating a normal image signal from the image signal stored in the image memory, When displaying a normal image, the normal image signal output from the normal image generating unit 412 is converted into a video signal and output, and when displaying a fluorescence diagnostic image, the fluorescence diagnostic image generating unit described above is displayed. A video signal processing circuit 405 for converting the fluorescence diagnostic image signal output from 314 into a video signal and outputting the video signal is provided. The controller 62 is connected to each part and controls the operation timing.

The operation of the fluorescence endoscope apparatus according to the present invention will be described below. Prior to imaging, the observer is
11 is inserted into the body cavity of the subject, and the tip of the scope section 11 is guided to the vicinity of the observation section 1. In addition, the observer uses the input device
Using 61, the normal boundary value S1, the lesion boundary value S2, and the kind of gradation function are set. Note that the sigmoid type shown in FIG. 5 is selected as the gradation function. Here, the normal boundary value S1 and the lesion boundary value S2 will be described.

When a fluorescence diagnostic image is displayed by a binarized display in which the normal region, which is a region where the calculated fluorescence value is large and does not need to be observed in detail, and the other regions are displayed in different colors, a threshold value is displayed. Input the normal boundary value S1 as defined by the following.

Normal boundary value S1 = normal Av−α normal St (where α is a coefficient of 0 or more) where normal Av is the average of fluorescence calculation values obtained from known normal tissues which are known to be normal tissues in advance. Normal St is the standard deviation. Further, α may be set according to the diagnostic probability desired by the observer, and for example, if 1 is set as α, 70 to 80%
The normal region can be detected with the diagnostic probability of. The diagnosis probability improves when α is set to a smaller value.

On the other hand, when a fluorescence diagnostic image is displayed by a binarized display in which the fluorescence calculation value is small and the lesion area, which is a highly likely lesion tissue, and the other areas are displayed in different colors. Inputs a lesion boundary value S2 as defined by the following equation as a threshold.

Lesion boundary value S2 = lesion Av + β lesion St (where β is a coefficient of 0 or more) where the lesion Av is an average value of fluorescence calculation values acquired from known lesion tissues which are known to be lesion tissues in advance. Yes, the lesion St is its standard deviation. Further, β may be set according to the diagnosis probability desired by the observer. Generally, the fluorescence calculation value in the lesioned tissue varies depending on the type and progress of the lesion, and it is difficult to determine β unconditionally, but 80% or more of the lesioned portions desired by the observer to be uniformly displayed. It is desirable to set β so that uniform display is performed.

In the present fluorescence endoscope apparatus, white light Lw
Of the normal light, the excitation light Le, the reference light Ls, and the normal image, the fluorescent image, and the IR reflected image.
The normal image 2 and the fluorescence diagnostic images 5 to 7 are simultaneously displayed on the monitor 92 as shown in FIG. After the exposure for capturing each image, the image signal is shifted from the light receiving unit of the CCD image pickup device 101 to the storage unit, and the image signal of each image is read out from the storage unit while the next image is exposed. ing.

First, the operation for displaying a normal image will be described. The white light source power source 202 is driven based on a signal from the controller 62, and the white light source 201 emits white light Lw. The white light Lw is condensed by the condenser lens 203, is incident on the light guide 102a, is guided to the tip of the scope section 11, and is then irradiated from the illumination lens 104 to the observation section 1.

The reflected light of the white light Lw reflected by the observation section 1 is condensed by the condenser lens 105, reflected by the prism 107, and reflected as a white light reflection image Zw (normal image) on the CCD image pickup element 101. It is imaged. The signal output from the CCD image pickup device 101 is the signal processing circuit of the normal image processing unit 41.
At 411, the signal is processed and output, then converted into a digital signal by the A / D conversion circuit 402, and stored in the image memory 403 for each pixel. In the normal image generation unit 412 according to the display timing, 3 corresponding to each micro filter
RGB signals are calculated from the color image signals, and normal image signals are generated and output based on the RGB signals. The video signal processing circuit 405 converts the normal image signal into a video signal and outputs it to the monitor 92. The monitor 92 displays the normal image 2 which is a color image.

Next, the operation when displaying the fluorescence diagnostic image will be described. First, the operation when acquiring a fluorescence image will be described. The controller 62 outputs the normal boundary value, lesion boundary value, and gradation function selection result input via the input device 61 to the fluorescence diagnostic image generation unit 314.

First, the observing section 1 is irradiated with the excitation light Le based on the signal from the controller 62. The fluorescence image Zj received by the CCD image pickup device 101 is converted into an image signal and outputted, and the signal processing circuit 30 of the fluorescence image processing unit 31.
In 1, the process is applied and output as an image signal,
It is converted into a digital signal by the A / D conversion circuit 302 and stored in the image memory 311.

In the calculation / image memory 312, for each adjacent pixel, the pixel value of the image signal received by the pixel corresponding to the Cy filter 111b of the mosaic filter 111 is the pixel value of the image signal received by the pixel corresponding to the Ye filter 111c. The values are added, and the pixel value of the image signal received by the pixel corresponding to the G filter 111a is subtracted from the added value to create and store a broadband fluorescence image.

Next, the operation when acquiring an IR reflection image will be described. The reference light Ls is applied to the observation unit 1, and the reflected light of the reference light Ls reflected by the observation unit 1 is the CCD image sensor 101.
An IR reflected image Zs is formed on the image, converted into an image signal, and output.

The signal output from the CCD image pickup device 101 is output to the signal processing circuit 306 of the fluorescence image processing unit 31 by 5
Ye filter that transmits light in the wavelength band of 20 nm or more 11
Only the signal received by the pixel corresponding to 1c is processed and output as an image signal, and the A / D conversion circuit 307
Is converted into a digital signal by and is stored in the image memory 308 as an IR reflection image.

The fluorescence calculation value calculation unit 313 divides the pixel value of the broadband fluorescence image stored in the calculation / image memory 312 by the pixel value of the IR reflection image stored in the image memory 308 for each corresponding pixel. The calculated fluorescence value is calculated.

In the fluorescence diagnostic image generation unit 314, color information is created based on the normal boundary value S1 input from the controller 62 and the image signal for the fluorescence diagnostic image 5 which is binarized and displayed, and the lesion boundary value S2. Based on the image signal for the fluorescence diagnostic image 6 to be binarized and displayed based on the color information and the gradation function (sigmoid type) input from the controller 62, the color information is created from the fluorescence operation value. An image signal for the fluorescent diagnostic image 7 displayed in gradation is generated and output to the video signal processing circuit 405. On the monitor 92, the fluorescence diagnostic images 5 to 7 are displayed side by side with the normal image 2. In the fluorescence diagnostic image 5, the normal area is displayed in green and the unknown area is displayed in yellow.

In the fluorescence diagnostic image 6, the lesion area is displayed in red and the unknown area is displayed in yellow.
Further, the fluorescence diagnostic image 7 is displayed in gradation from green (large fluorescence calculation value) to red (small fluorescence calculation value). The observer
By focusing on the fluorescence diagnostic image 5, it is possible to easily identify the normal region, and by focusing on the fluorescent diagnostic image 6, it is possible to easily identify the lesion region.
Furthermore, by paying attention to the fluorescence diagnostic image 7, it is possible to observe in detail the tissue properties of the intermediate region which is neither the normal region nor the lesion region. In particular, the fluorescence diagnostic image 7
Since the sigmoid type is used as the gradation function, it is suitable for observing the texture of this intermediate region. In addition, it is possible to display only one of the normal image 2 and the fluorescence diagnostic images 5 to 7 by an input operation from the input device 61.

As is clear from the above description, in the fluorescence endoscope apparatus according to the present embodiment, the fluorescence diagnostic images 5 and 6 binarized by different thresholds and the fluorescence diagnostic images displayed in gradation are displayed. Since the image 7 and the image 7 are displayed side by side on the monitor 92, the observer can appropriately select the image of interest according to the observation purpose. Therefore, the time for identifying the tissue property is shortened, and the identification can be performed based on the three diagnostic images, so that the identification accuracy is also improved. Further, since the gradation display is used, the observer can know the stepwise tissue property of each region of the observation part. In addition, since the brightness varies depending on the pixel value of the IR reflection image, it is possible to display the fluorescence diagnostic image with the unevenness of the observation part and the sense of distance.

In the present embodiment, since the calculated fluorescence value reflects the difference in fluorescence yield, it is necessary to identify each region based on the difference in fluorescence yield of fluorescence emitted from each region. You can

In each of the embodiments, each set value such as the normal boundary value, the lesion boundary value or the kind of the gradation function can be switched by the input operation of the observer. Therefore, the kind of the observation section or the individual difference, A desired fluorescence diagnostic image can be appropriately displayed according to age difference and the like. Further, when the gradation display is performed by discontinuous display, it is preferable that the number of gradations can be changed.

It is desirable that the switching operation of the normal boundary value, the lesion boundary value, the gradation function, etc., and the switching operation of the display state between the fluorescence diagnostic images can be performed at any time while the fluorescence diagnostic images are displayed. . Further, at every predetermined time, a switching signal is automatically generated, and if a sequential switching function for switching the displayed fluorescence diagnostic image is provided, it is possible that the most appropriate set value of the fluorescence diagnostic image is unknown. Also, the desired fluorescence diagnostic image can be selected from among the displayed images, further improving the convenience of the apparatus.

Further, in each of the embodiments, the input device 61
Although it is configured to be provided in the processor unit, the present invention is not limited to this, and may be provided in a hand operation unit provided in a normal scope unit. In this case, the operator of the scope unit can switch various settings. It can also be configured as a foot switch, further improving the usability of the input device. Further, various settings may be input from separate input devices provided in the respective convenient parts. In each embodiment,
The normal image, the fluorescence image, and the auxiliary image are picked up by one image pickup device, but they may be picked up by separate image pickup devices. In such a case, it is desirable to attach an optical filter having a transmission wavelength range suitable for an image to be acquired to each image sensor.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a fluorescence endoscope apparatus according to a first specific embodiment of the present invention.

FIG. 2 is an explanatory diagram of a fluorescence diagnostic image.

FIG. 3 is a schematic configuration diagram of an optical filter.

FIG. 4 is a schematic configuration diagram of a switching filter.

FIG. 5 is an explanatory diagram of a gradation function

FIG. 6 is a schematic configuration diagram of a fluorescence endoscope apparatus according to a second specific embodiment of the present invention.

FIG. 7 is a schematic configuration diagram of an optical filter.

FIG. 8 is an explanatory diagram of imaging timing.

[Explanation of symbols]

1 Observation department 2 Normal image 3,4,5,6,7 Fluorescence diagnostic image 10,11 Scope part 20,21 Lighting unit 30,31 Fluorescence image processing unit 40,41 Normal image processing unit 50,51 CCD drive unit 60,62 controller 90,92 monitor 101 image sensor 106,111 Mosaic filter 304,313 Fluorescence calculation value calculator 305,314 Fluorescence diagnostic image generator

Front page continuation (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/225 H04N 5/225 C 5C022 2 7/18 7/18 M 5C054 9/04 9/04 Z 5C065 F term (reference) ) 2G043 AA03 CA09 EA01 FA01 GA21 GB18 HA01 HA05 JA02 KA01 KA02 KA05 KA09 LA03 MA16 NA01 NA02 NA05 NA06 2H040 GA02 GA11 2H052 AA09 AF14 AF17 AF21 AF25 4C061 BB02 BB08 CC06 DD03 FF46 HH51 LL02 MM03 MM05 MM07 NN01 NN05 NN07 QQ02 QQ03 QQ04 QQ07 QQ09 RR05 RR14 RR18 RR26 SS04 SS21 TT02 WW08 WW10 WW17 YY02 5B057 AA07 BA02 BA29 CA08 CA16 CB08 CB16 CE11 CH01 DA16 5C022 AA09 AB15 AC42 AC55 AC69 5C054 CC07 CD03 CH02 EA01 EA03 EA05 ED07 504160 GB02 EE06 FB07 BB07 BB07 CA02 CB07

Claims (4)

[Claims] 1. A fluorescence image based on fluorescence emitted from an observation unit irradiated with excitation light is acquired, and an auxiliary image based on re-radiation light emitted from the observation unit irradiated with light is acquired. A fluorescent diagnostic image display method for generating a fluorescent diagnostic image based on a ratio of a pixel value of the fluorescent image and a pixel value of the auxiliary image, and displaying the fluorescent diagnostic image, A method for displaying a fluorescent diagnostic image, wherein a diagnostic image is generated and at least two types of fluorescent diagnostic images having different display states are simultaneously displayed. 2. A fluorescence image acquisition unit for irradiating the observation section with excitation light, and acquiring a fluorescence image based on fluorescence emitted from the observation section by the irradiation of the excitation light, and irradiating the observation section with light. Auxiliary image acquisition means for acquiring an auxiliary image based on re-radiation light emitted from the observation section by irradiation of the light, and a fluorescence diagnostic image based on the ratio of the pixel value of the fluorescence image and the pixel value of the auxiliary image. In a fluorescent diagnostic image display device including a fluorescent diagnostic image generating unit for generating and a display unit for displaying the fluorescent diagnostic image, the fluorescent diagnostic image generating unit generates a plurality of types of fluorescent diagnostic images with different display states. The fluorescent diagnostic image display device is characterized in that the display means simultaneously displays at least two types of fluorescent diagnostic images having different display states. 3. The fluorescent diagnostic image display apparatus according to claim 2, wherein one of the display states is gradation display using a predetermined gradation function. 4. The fluorescence diagnostic image display apparatus according to claim 2, wherein one of the display states is a binarized display using a predetermined threshold value.