JP2004024656A - Fluorescent endoscope equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent overlook of diagnostic information obtained based on a fluorescent image in fluorescent diagnostic equipment. <P>SOLUTION: The equipment is provided with: an imaging means which respectively receives normal light reflected by a biological tissue 1 irradiated with the normal light and fluorescent light occurring from the biological tissue 1 irradiated with exciting light to image a normal image and a fluorescent image; a diagnostic information obtaining means 20 for obtaining diagnostic information on the biological tissue 1 based on the fluorescent image; a display means 30 for displaying the normal image as a visible image; and a diagnostic supporting means 40 which displays the diagnostic information by giving visual change to this normal image when this display means 30 displays the normal image. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a fluorescence endoscope apparatus, and more particularly to a fluorescence endoscope apparatus that displays diagnostic information based on a fluorescence image obtained by receiving fluorescence generated from a living tissue by irradiation of excitation light.
[0002]
[Prior art]
Conventionally, endoscope apparatuses for observing living tissue in a body cavity are widely known, and a normal image is obtained by imaging living tissue in a body cavity illuminated by normal light such as white light used for normal observation. An electronic endoscope that displays this normal image as a visible image on a television screen has been widely put into practical use. In addition to illuminating and observing the living tissue in the body cavity with normal light, the fluorescent image is captured together with the normal image by receiving autofluorescence generated from the living tissue by the irradiation of excitation light. A fluorescent endoscope apparatus that displays on a television screen is also known.
[0003]
Some of the above-described fluorescence endoscope apparatuses have a function of acquiring diagnostic information based on a fluorescence image. For example, the fluorescence endoscope apparatus has a fluorescence intensity in a wavelength region near 480 nm generated from a living tissue by irradiation with excitation light near a wavelength of 410 nm. Normalized fluorescence intensity expressed as a ratio to the fluorescence intensity in the wavelength region ranging from 430 nm to 730 nm, the intensity of the fluorescence generated from the living tissue upon irradiation with the excitation light, and the near-infrared light that is the reference light Based on the fluorescence yield expressed by the ratio with the intensity of near infrared light reflected by the irradiated biological tissue, the diagnostic information indicating the lesioned part of the biological tissue is obtained, and the diagnostic information of the lesioned part is There has also been proposed a fluorescence endoscope apparatus for diagnosing a tissue property of a living body by displaying a region in a color-coded manner such as red on the fluorescent image display screen.
[0004]
In the fluorescence endoscope apparatus for diagnosing the tissue characteristics of the living body, the fluorescent image including the diagnostic information is displayed on a different area on the same screen together with the normal image, or switched to the normal image on the same screen. Or display on another display screen different from the normal image display screen, and switch between the normal observation mode for observing the normal image and the fluorescence observation mode for observing the fluorescent image to observe the tissue characteristics of the living body. Diagnosis is performed. In addition, this method of observing by switching the display mode provides a high diagnostic ability when conducting detailed examinations, but on the other hand, the time required for diagnosis is long, so when screening many patients in a short time. It is not a suitable method.
[0005]
[Problems to be solved by the invention]
By the way, in the diagnosis using the fluorescence endoscope apparatus, generally, observation is performed based on the display of a normal image, and when a suspicious tissue is found, the display mode is switched and the diagnosis is performed using the fluorescence image. This normal image diagnosis has the following advantages. In other words, it is possible to utilize knowledge based on the clinical experience of doctors, make use of diagnostic ability not only for cancer lesions but also for various inflammations and various diseases, and diagnostic ability for types of cancer that are difficult to confirm with fluorescent images. You can save it.
[0006]
On the other hand, diagnosis based on fluorescence images has the following advantages. That is, it is possible to take advantage of the diagnostic ability for a lesion having a small spread, a lesion having a small change and difficult to view in a normal image.
[0007]
On the other hand, in diagnosis based on normal images, observations based on fluorescent images such as sites with small lesions, or sites where diseased features do not appear on the surface of living tissue, but are already lesioned, etc. However, there is a problem that a recognized lesion may be overlooked in normal image observation.
[0008]
Further, in the diagnosis based on the fluorescence image, since the observation region is specified in the normal observation mode and then switched to the fluorescence observation mode, the specified observation region is diagnosed. There is a problem that it may be overlooked.
[0009]
The present invention has been made in view of the above circumstances. Fluorescence endoscopy can be used to efficiently screen lesions by making use of the high diagnostic ability of fluorescence images while performing diagnosis with abundant clinical experience using normal images. The object is to provide a mirror device.
[0010]
[Means for Solving the Problems]
The fluorescence endoscope apparatus of the present invention receives normal light reflected by a biological tissue irradiated with normal light and fluorescence generated from the biological tissue irradiated with excitation light, respectively, and receives a normal image and fluorescence. Imaging means for picking up an image, diagnostic information acquisition means for acquiring diagnostic information of living tissue based on the fluorescent image, display means for displaying the normal image as a visible image, and displaying the normal image by the display means At this time, it is characterized by comprising diagnostic support means for displaying diagnostic information by giving a visual change to the normal image.
[0011]
The diagnostic information acquisition means acquires information indicating the position of a lesioned part of biological tissue as diagnostic information, and the diagnosis support means indicates the position of the lesioned part by displaying a mark in a normal image. can do. Further, the diagnostic information acquisition means acquires information indicating the position of the lesioned part of the living tissue as the diagnostic information, and the diagnosis support means sets the normal position so that the position of the lesioned part is located at the center of the normal image. The display position of the image can be moved. Further, the diagnostic information acquisition means acquires information indicating the region of the lesioned part of the living tissue as diagnostic information, and the diagnostic support means makes the ratio of the lesioned part in the displayed normal image constant. As described above, the display magnification of the normal image can be changed.
[0012]
The imaging means may acquire the normal image and the fluorescent image so that the region of the biological tissue indicated by the fluorescent image includes the region of the biological tissue indicated by the normal image and is larger than this region.
[0013]
The visual change may be in any form as long as it gives a change that causes the displayed normal image to recognize diagnostic information.
[0014]
【The invention's effect】
According to the fluorescence endoscope apparatus of the present invention, when the normal image is displayed by the display means, the diagnostic information acquired based on the fluorescent image is displayed by giving a visual change to the normal image. Therefore, even when the displayed normal image is being observed, the diagnostic information acquired based on the fluorescent image is easily recognized, and diagnosis for various inflammations and various diseases that have superiority in diagnosis using the normal image The ability to take advantage of both the ability and the ability to diagnose lesions that are difficult to see with normal images and those that have a small spread with normal images, which has superiority in diagnosis using fluorescent images. It is possible to efficiently screen a lesion by taking advantage of the high diagnostic ability of the fluorescence image while performing the above.
[0015]
The diagnostic information acquisition means acquires information indicating the position of the lesioned part of the living tissue as the diagnostic information, and the diagnosis support means indicates the position of the lesioned part by displaying a mark in the normal image. Or, the diagnostic information acquisition means acquires information indicating the position of the lesioned part of the living tissue as diagnostic information, and the diagnosis support means sets the position of the lesioned part to the center of the normal image. It is assumed that the display position of the image is moved, or the diagnostic information acquisition means acquires information indicating the region of the lesioned part of the living tissue as diagnostic information, and the diagnosis support means is included in the displayed normal image. If the display magnification of this normal image is changed so that the ratio of the occupying lesion is constant, the diagnosis acquired based on the fluorescence image even when the displayed normal image is being observed Distribution is recognized more reliably, it can be screened more efficiently lesion.
[0016]
Further, if the imaging means acquires the normal image and the fluorescent image so that the region of the biological tissue indicated by the fluorescent image includes the region of the biological tissue indicated by the normal image and is larger than this region. The diagnostic information can be acquired from a range wider than the range of the biological tissue indicated by the normal image, and the lesion can be screened more efficiently.
[0017]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a conceptual diagram showing a schematic configuration of a fluorescence endoscope apparatus according to a first embodiment of the present invention, FIG. 2 is a cross-sectional view showing a cross section of a bundle fiber, and FIG. 3 is a diagram showing irradiation timing of each laser beam, FIG. 4 is a diagram showing the displayed normal image, FIG. 5 is a diagram showing the position and area of the lesioned part in the living tissue, which is diagnostic information shown by the fluorescence image, and FIG. 6 is the lesioned part displayed in the regular image. FIG. 7 is a diagram showing a state where the lesion is moved to the center of the displayed normal image, FIG. 8 is a diagram showing a state where the display magnification of the normal image is changed, and FIG. 9 is a diagram showing fluorescence. FIG. 10 is a diagram showing diagnostic information of a peripheral region included in the observation region and deviating from the normal observation region, FIG. 10 is a diagram showing diagnostic information displayed in a normal image when a lesion is present in the peripheral region, and FIG. Various cases of displaying diagnostic information with visual changes in normal images Shows an aspect.
[0018]
The fluorescence endoscope apparatus according to the first embodiment of the present invention has the normal light reflected by the biological tissue 1 irradiated with normal light and the fluorescence generated from the biological tissue 1 irradiated with excitation light. Imaging means 10 for receiving a normal image and a fluorescent image, diagnostic information acquisition means 20 for acquiring diagnostic information of the living tissue 1 based on the fluorescent image, and display means 30 for displaying the normal image as a visible image And a diagnostic support means 40 for displaying diagnostic information by giving a visual change to the normal image when the normal image is displayed by the display means 30.
[0019]
The diagnostic information acquisition means 20 acquires information indicating the position of the lesioned part of the biological tissue 1 as the diagnostic information, or acquires information indicating the area of the lesioned part of the biological tissue 1.
[0020]
The display unit 30 inputs a first input terminal 31 for inputting an output of a normal image from the imaging unit and a second visual change signal that is an output that gives a visual change to the normal image from the diagnosis support unit 40. And an input terminal 32.
[0021]
The diagnosis support means 40 includes a visual change signal output unit 41 that outputs a visual change signal that indicates a lesion area as a mark by a contour in a normal image to the second input terminal 32 of the display means 30, and a position of the lesion area. An angle signal output unit 42 that outputs an angle signal that moves the display position of the normal image so as to be positioned at the center of the normal image to a distal angle adjustment unit 61 that will be described later, and a lesion portion that occupies the displayed normal image An illumination light zoom lens unit 58 and a zoom signal output unit 43 that outputs a zoom signal to the imaging zoom lens unit 11 are provided to change the display magnification of the normal image so that the ratio is constant. The angle signal is a signal for changing the bending angle of the endoscope distal end portion 60.
[0022]
The imaging unit 10 transmits the imaging zoom lens unit 11 having a zoom function for entering fluorescence and normal light, the half mirror 12 that transmits and reflects fluorescence and normal light at a predetermined ratio, and the half mirror 12. An excitation light cut filter 13 that blocks excitation light included in the fluorescence, a fluorescence imaging unit 14 that receives fluorescence through the excitation light cut filter 13 and captures a fluorescence image, and receives normal light reflected by the half mirror 12 and receives light. And a normal imaging unit 15 that captures an image. This imaging means 10 is configured such that the fluorescence observation region E2 of the biological tissue 1 indicated by the fluorescent image is the same as that of the biological tissue 1 indicated by the normal image by making the light receiving region of the fluorescence imaging unit 14 larger than the light reception region of the normal imaging unit 15. The normal image and the fluorescence image are acquired so as to include the normal observation region E1 and be larger than the normal observation region E1.
[0023]
Furthermore, the endoscope apparatus includes a distal end angle adjusting unit 61 that changes the bending angle of the endoscope distal end portion 60 and an irradiation unit 50 that irradiates the living tissue 1 with normal light and excitation light. .
[0024]
The irradiation means 50 includes a red laser 51 that emits red light serving as a light source for normal light, a green laser 52 that emits green light, a blue laser 53 laser that emits blue light, and an excitation light laser 54 that emits excitation light. A near-infrared laser 55 that emits near-infrared light, a collimator lens 56 that converges each laser beam emitted from each laser and makes it incident on a bundle fiber 57 described later, and converges through each collimator lens 56. A bundle fiber 57 formed by bundling a large number of fibers for propagating the laser beam to the endoscope distal end portion 60, and emitting the laser beam outputted from the bundle fiber 57 with a widening spread angle, An illumination light zoom lens unit 58 that can change the spread angle of the luminous flux in conjunction with zooming of the imaging zoom lens unit 11; It is provided.
[0025]
In the illumination light zoom lens unit 58, the normal observation region E1 of the biological tissue 1 is acquired as a normal image by the imaging unit 10, and the fluorescence observation region E2 of the biological tissue 1 wider than the normal observation region E1 is acquired as a fluorescent image. As described above, the normal observation region E1 of the living tissue 1 is irradiated with red light, green light, and blue light, and the fluorescence observation region E2 of the living tissue 1 wider than the normal observation region E1 is irradiated with excitation light and near-infrared light. In order to irradiate light as described above from the illumination light zoom lens unit 58, the following method may be applied. For example, as shown in FIG. 2, a fiber in which red light, green light, and blue light are incident is disposed only in the center C of the cross section D of the bundle fiber 57, and a fiber in which excitation light and near infrared light are incident. Can be dispersed throughout the cross section D. In addition, for example, a lens whose refractive power greatly changes with respect to light in a specific wavelength region is used in the lens system of the illumination light zoom lens unit 58, and a light beam of short wavelength excitation light and long wavelength near infrared light. May be emitted at a larger angle than the luminous flux of red light, green light and blue light.
[0026]
The control of the imaging timing of the imaging means 10, the control of the irradiation timing of each laser beam from the irradiation means 50, the supply of power to each part, etc. are performed by a controller (not shown).
[0027]
Next, the operation in the first embodiment will be described.
[0028]
Hereinafter, the operation of the fluorescence endoscope apparatus will be described in accordance with the irradiation timing of each laser beam shown in FIG.
[0029]
First of all. When none of the lasers is lit, the fluorescent dark signal image captured by the fluorescent imaging unit 14 is stored in the fluorescent imaging unit 14 and the normal dark captured by the normal imaging unit 15 is stored. A signal image is stored in the normal imaging unit 15.
[0030]
Next, the red laser 51 is turned on to irradiate the normal observation region E1 of the living tissue 1 with red light, and the normal imaging unit 15 receives and images the red light reflected by the normal observation region E1. A red image is obtained by subtracting the normal dark signal image from the obtained image. Subsequently, the green laser 52 is turned on to irradiate the normal observation region E1 of the living tissue 1 with green light, and the normal imaging unit 15 receives and captures the green light reflected by the normal observation region E1. The green image is obtained by subtracting the normal dark signal image from the obtained image. Further, the blue laser 53 is turned on, and the normal imaging unit 15 irradiates the normal observation region E1 of the living tissue 1 with blue light, and receives and captures the blue light reflected by the normal observation region E1. A blue image is obtained by subtracting the normal dark signal image from the image.
[0031]
A normal image obtained by combining the red image, the green image, and the blue image obtained as described above is output from the normal imaging unit 15 to the first input terminal 31 of the display means 30, and the normal image as shown in FIG. An image is displayed. The presence of a lesion is not observed in this normal image observation.
[0032]
Next, the near-infrared light laser 55 is turned on to irradiate the fluorescence observation region E2 of the living tissue 1 with near-infrared light, and the fluorescence imaging unit 14 reflects the near-infrared light reflected on the fluorescence observation region E2. The near-infrared image is acquired by subtracting the fluorescent dark signal image from the image obtained by receiving and imaging the light. Subsequently, the excitation light laser 54 was turned on to irradiate the fluorescence observation region E2 of the living tissue 1 with excitation light, and the fluorescence imaging unit 14 received and imaged the fluorescence generated from the fluorescence observation region E2. A fluorescent image is obtained by subtracting the fluorescent dark signal image from the image. The acquired near-infrared image and fluorescence image are output to the diagnostic information acquisition means 20.
[0033]
The diagnostic information acquisition means 20 that has received the near-infrared image and the fluorescence image receives the excitation light and receives the fluorescence image acquired based on the fluorescence generated from the living tissue and the near-infrared light that is the reference light. Based on the fluorescence yield obtained by calculating the intensity ratio with the near-infrared image acquired based on the near-infrared light reflected by the irradiated biological tissue, the biological tissue as shown in FIG. The diagnostic information which shows the lesioned part B1 in 1 is acquired. That is, the diagnostic information acquisition unit 20 acquires diagnostic information indicating the position of the lesioned part B1 in the biological tissue 1 and diagnostic information indicating the region of the lesioned part B1 in the biological tissue 1. The diagnostic information is output from the diagnostic information acquisition unit 20 to the diagnostic support unit 40.
[0034]
The diagnosis support means 40 that has acquired the information on the position and area of the lesioned part B1 in the biological tissue 1 uses the visual change signal output part 41 to generate a visual change signal for displaying the information on the position and area of the lesioned part in the normal image. The visual change signal is generated and output to the second input terminal 32 of the display means 30. In addition, the angle signal output unit 42 generates an angle signal for moving the display position of the normal image by adjusting the bending angle of the endoscope distal end 60 so that the position of the lesion is located at the center of the normal image. Then, this angle signal is output to the tip angle adjusting unit 61. Further, the zoom signal output unit 43 creates a zoom signal for changing the display magnification of the normal image so that the ratio of the lesioned portion in the displayed normal image is constant, and the zoom signal is generated by the zoom lens unit of the illumination light. 58 and the imaging zoom lens unit 11.
[0035]
The display means 30 to which the visual change signal is input displays the outline of the lesioned part B1 indicating the position and region of the lesioned part B1 in the normal image as shown in FIG.
[0036]
As shown in FIG. 7, the distal end angle adjusting unit 61 that receives the angle signal adjusts the bending angle of the endoscope distal end 60 so that the position of the lesioned part B1 is positioned at the center of the displayed normal image. Move.
[0037]
The imaging zoom lens unit 11 to which the zoom signal is inputted displays the normal image so that the ratio of the lesioned part B1 in the normal image is constant (for example, 10%) as shown in FIG. Change the magnification. At this time, the illumination light zoom lens unit 58 to which the zoom signal is input also performs zoom adjustment according to the zoom adjustment of the imaging zoom lens unit 11 to change the spread angle of the laser beam.
[0038]
Here, as shown in FIG. 9, a lesioned part B2 and a lesioned part B3 are present in a peripheral region F that is included in the fluorescence observation region E2 indicated by the fluorescence image and deviates from the normal observation region E1 indicated by the normal image. In this case, the diagnostic information indicating the positions of the lesioned part B2 and the lesioned part B3 is displayed by giving triangular marks Y2 and Y3 which are visual changes to the normal image as shown in FIG.
[0039]
As described above, the diagnostic information acquired based on the fluorescence image is displayed by giving a visual change to the normal image, so the diagnostic information can be easily recognized even while the normal image is being observed. It is possible to prevent oversight of the diagnostic information acquired based on the fluorescence image.
[0040]
If a plurality of lesions are found based on the fluorescence image, the lesion closest to the center or the largest lesion is treated as main diagnostic information, and the visual information is based on the diagnostic information of the lesion. Change can be applied to a normal image. Further, a lesion part of interest may be selected from a plurality of lesion parts, and this lesion part may be handled as the main diagnostic information. Furthermore, all of the plurality of lesions may be displayed with marks such as the outline, and the lesion currently being noticed may be selected, and then this lesion may be handled as the main diagnostic information.
[0041]
In addition, the mark shows the lesioned part B only with a triangle mark Y as shown in FIG. 11A, or surrounds the lesioned part B with a circle P1 as shown in FIG. As shown in c), the region of the lesioned part can be displayed in a solid color, or the region of the lesioned part B can be displayed semi-transparently as shown in FIG. In addition, the mark can be blinked, surrounded by a figure such as a square shape, or displayed in an easily distinguishable color that is different from the color of the surrounding area. It may be.
[0042]
In addition, the mark is not limited to the position or region of the lesion, but may indicate other diagnostic information.
[0043]
In addition, the method of changing the display magnification of the normal image may be a digital method of changing the display magnification of the image by reducing the number of captured pixels for display.
[0044]
Moreover, the said imaging means is good also as what combines the fluorescence imaging part 14 and the normal imaging part 15 by one imaging part.
[0045]
Hereinafter, a fluorescence endoscope apparatus according to a second embodiment of the present invention will be described with reference to FIGS. 12, 13, and 14. FIG. 12 is a block diagram showing a schematic configuration of the fluorescence endoscope apparatus according to the second embodiment, FIG. 13 is an enlarged block diagram showing details of the video signal processing circuit, and FIG. 14 is obtained from filters having two different wavelength transmission bands. It is a figure which shows schematic structure of the transmission filter which becomes.
[0046]
The fluorescence endoscope apparatus according to the second embodiment of the present invention includes two light sources that respectively emit white light Lw for normal images that is normal light and excitation light Lr for fluorescent images that is excitation light. Illumination unit 110, image detection unit 300 which is an imaging means for fluorescence images that receives autofluorescence generated from living tissue 10 by irradiation of this excitation light and captures a fluorescence image composed of two-dimensional image data, and image detection Based on the two-dimensional image data representing the fluorescence image output from the unit 300, a calculation such as distance correction is performed to calculate a calculation image, and the data of each pixel of the calculation image is compared with a reference value stored in advance. The image calculation unit 400, which is a diagnostic information acquisition means for acquiring a signal corresponding to the comparison result as diagnostic information, and the communication reflected by the living tissue illuminated with the white light Lw. The normal image pickup element 107 which is an imaging unit that receives white light as light and picks up a normal image, and converts the two-dimensional image data representing the normal image into a video signal for display, and outputs from the image calculation unit 400 Display signal processing unit 500, which is a diagnosis support means for displaying the diagnostic information to be displayed by visually changing the normal image, a control computer 190 connected to each unit for controlling operation timing, and display signal processing A monitor unit 600 that is a display means for displaying a normal image given a visual change based on diagnostic information by the unit 500, and a foot switch 140 for switching a diagnostic mode.
[0047]
The normal image pickup element 107 is disposed in an endoscope insertion unit 100 that is inserted into a patient's examination site, and includes an illumination unit 110, an image detection unit 300, an image calculation unit 400, a display signal processing unit 500, and a control. The computer 190 constitutes the image signal processing unit 1, and information transmission between the normal image pickup device 107 and the image signal processing unit 1 is performed via a light guide 101, a CCD cable 102, an image fiber 103, and the like which will be described later. It is done.
[0048]
The endoscope insertion unit 100 includes a light guide 101 extending to the tip, a CCD cable 102, and an image fiber 103 therein. An illumination lens 104 and an objective lens 105 are provided at the distal end portions of the light guide 101 and the CCD cable 102, that is, the distal end portion of the endoscope insertion portion 100. The image fiber 103 is a quartz glass fiber, and has a condensing lens 106 at the tip thereof, and a fluorescent image Zr formed on the end surface of the image fiber 103 by the condensing lens 106 is propagated through the image fiber 103. The A normal image imaging element 107 is connected to the distal end portion of the CCD cable 102, and a prism 108 is attached to the normal image imaging element 107. In the light guide 101, a white light light guide 101a that is a multi-component glass fiber and an excitation light light guide 101b that is a quartz glass fiber are bundled and integrated into a cable shape, and the white light light guide 101a and the excitation light light guide are integrated. 101 b is connected to the lighting unit 110. One end of the CCD cable 102 is connected to the display signal processing unit 500, and one end of the image fiber 103 is connected to the image detection unit 300.
[0049]
The illumination unit 110 includes a white light source 111 that emits white light Lw, a white light source power source 112 that is electrically connected to the white light source 111, and a white light condensing lens that condenses the white light emitted from the white light source 111. 113, a GaN-based semiconductor laser 114 that emits the excitation light Lr, a semiconductor laser power source 115 that is electrically connected to the GaN-based semiconductor laser 114, and an excitation light that condenses the excitation light emitted from the GaN-based semiconductor laser 114 Condensing lens 116 is provided.
[0050]
An image fiber 103 is connected to the image detection unit 300, a fluorescent lens 301 that propagates a fluorescent image Zj propagated through the image fiber 103 toward a fluorescent condensing lens 305, which will be described later, and the vicinity of the excitation light from the fluorescent image Zj. Excitation light cut filter 302 that cuts nearby wavelengths, transmission filter 303 that cuts out a desired wavelength band from the fluorescence image Zj that has passed through the excitation light cut filter 302, filter rotation device 304 that rotates the transmission filter 303, and the transmission filter A fluorescent condensing lens 305 that forms a fluorescent image Zj that has passed through 303; a fluorescent image high-sensitivity imaging device 306 that receives and images the fluorescent image Zj formed by the fluorescent condensing lens 305; A fluorescent image captured by the high-sensitivity element 306 is converted into a digital value to obtain a two-dimensional image. And an A / D converter 307 to be output as data.
[0051]
The transmission filter 303 includes two types of optical filters 303a and 303b as shown in FIG. 14. The optical filter 303a is a bandpass filter that transmits light having a wavelength from 430 nm to 730 nm, and the optical filter 303b is 430 nm. To 530 nm light.
[0052]
The image calculation unit 400 includes an image data memory 401 that stores fluorescence image signal data obtained by digitizing a fluorescence image captured through two types of optical filters 303a and 303b, and each pixel of the fluorescence image stored in the image data memory 401. 2 stored in the reference value memory 402 and the image data memory 401 storing a predetermined reference value RE for determining whether the region of the living tissue represented is a diseased tissue or a normal tissue. According to the result of calculating the value for each pixel by calculating the ratio of the pixel value for each pixel of the fluorescence images in two different wavelength bands, and comparing this value with the reference value RE of the reference value memory 402 An inter-image calculation unit 403 that generates and outputs the calculated image is provided.
[0053]
The reference value RE is a value set based on a fluorescence image acquired by imaging a normal tissue that is clearly normal or a lesion tissue that is clearly lesioned.
[0054]
The display signal processing unit 500 includes an A / D converter 501 that digitizes a video signal obtained by the normal image pickup device 107, a normal image data memory 502 that stores a digitized normal image, and a normal image data memory 502. Is provided with a video signal processing circuit 503 for converting the signal output from the video signal into a video signal. Note that the video signal processing circuit 503 receives the diagnostic information output from the inter-image arithmetic unit 403 when converting the signal output from the normal image data memory 502 into a video signal, and based on the diagnostic information, the video signal processing circuit 503 The video signal is created so as to give a visual change to the normal image output from the normal image data memory 502.
[0055]
Next, the operation of the fluorescence imaging apparatus according to the second embodiment configured as described above will be described.
[0056]
First, the endoscope insertion unit 100 is inserted to the vicinity of the body tissue 10 in the body while displaying a normal image representing the body tissue imaged by receiving illumination light. Next, when the foot switch 140 is pressed, the diagnosis mode is switched, and normal light and excitation light are alternately irradiated. When normal light is irradiated, a normal image is captured, and excitation light irradiation is performed. A fluorescence image is captured by receiving the fluorescence generated from the received biological tissue 10, and a normal image that is visually changed by diagnostic information based on the fluorescence image is displayed on the monitor unit 600. The control for obtaining the normal image and the fluorescence image alternately is performed by the control computer 190.
[0057]
Here, the effect | action at the time of acquiring the diagnostic information based on a fluorescence image is demonstrated.
[0058]
Based on a command signal from the control computer 190, the excitation light source power supply 115 is driven, and excitation light Lr having a wavelength of 410 nm is emitted from the GaN-based semiconductor laser 114. The excitation light Lr passes through the excitation light condensing lens 116, enters the excitation light light guide 101 b, is guided to the distal end portion of the endoscope insertion unit 100, and then irradiates the living tissue 10 through the illumination lens 104. Is done.
[0059]
The autofluorescence generated from the living tissue 10 by the irradiation of the excitation light Lr is collected by the condenser lens 106, is incident on the tip of the image fiber 103 as a fluorescent image Zj, propagates through the image fiber 103, and is excited through the fluorescent lens 301. The light enters the light cut filter 302.
[0060]
The fluorescent image Zj that has passed through the excitation light cut filter 302 is incident on the transmission filter 303. The excitation light cut filter 302 is a long pass filter that blocks light having a wavelength of less than 420 nm and transmits light having a wavelength of 420 nm or more. That is, the excitation light cut filter 302 transmits light in substantially the entire wavelength region of fluorescence generated from the living tissue when irradiated with excitation light. Since the wavelength of the excitation light Lr is 410 nm, the excitation light reflected by the living tissue 10 is cut by the excitation light cut filter 302 and does not enter the transmission filter 303.
[0061]
Further, based on a command from the control computer 190, the filter rotating device 304 is also driven, and the fluorescent image Zj incident on the transmission filter 303 is transmitted through the optical filter 303a and then imaged by the fluorescent condensing lens 305. A fluorescent image is picked up by the fluorescent image high-sensitivity image pickup device 306, and after passing through the optical filter 303b, is imaged by the fluorescent light collecting lens 305, and the fluorescent image is picked up by the fluorescent image high-sensitivity image pickup device 306. The signals representing the respective fluorescence images captured by the fluorescence image high-sensitivity image sensor 306 are input to the A / D conversion circuit 307, converted into digital data, and stored in the image data memory 401.
[0062]
The inter-image operation unit 403 performs an operation according to the ratio of each pixel value of each fluorescent image stored in the image data memory 401, and the calculated value and the reference value RE stored in advance in the reference value memory 402. Are compared to determine whether each pixel is a normal tissue or a diseased tissue, and based on the determination, an arithmetic image that is diagnostic information is acquired. The reference value RE stored in the reference value memory 402 is used to determine whether the tissue is a normal tissue or a diseased tissue. The reference value RE is used as a threshold value, and the threshold value and the ratio of each pixel value in each pixel are determined. This is performed by comparison with the calculated operation value.
[0063]
Next, the operation when acquiring a normal image will be described. During normal image display, the white light source power source 112 is driven based on a command signal from the control computer 190, and white light Lw is emitted from the white light source 111. The white light Lw enters the white light light guide 101a through the white light condensing lens 113, is guided to the distal end portion of the endoscope insertion unit 100, and is then irradiated from the illumination lens 104 onto the living tissue 10. . The reflected light of the white light Lw is collected by the objective lens 105, reflected by the prism 108, and imaged on the normal image pickup device 107. A normal image received and imaged by the normal image imaging element 107 is input to the A / D converter 501, digitized, and stored in the normal image data memory 502. The normal image stored in the normal image data memory 502 is converted into a video signal by the video signal processing circuit 503, is input to the monitor unit 600, and is displayed on the monitor unit 600 as a visible image.
[0064]
Here, the video signal processing circuit 503, when converting a normal image signal into a video signal, is displayed as a visible image based on the diagnostic information represented by the calculation image output from the inter-image calculation unit 403. Give visual changes to images. The visual change is substantially the same as in the first embodiment. For example, by changing the display color of the lesion tissue area, the lesion tissue can be recognized instantly. That is, the diagnostician can efficiently screen the lesioned part by making use of the high diagnostic ability of the fluorescent image while making a diagnosis with abundant clinical experience using the normal image. The above series of operations is controlled by the control computer 190.
[0065]
Here, the video signal processing circuit 503 that gives a visual change to a normal image displayed as a visible image based on the diagnostic information represented by the calculation image output from the inter-image calculation unit 403 will be described in detail.
[0066]
As shown in FIG. 13, the video signal processing circuit 503 includes a visual change signal generation unit 150, an image synthesis unit 151, a zoom processing unit 152, and a video signal generation unit 153 described below.
[0067]
The visual change signal generation unit 150 generates a visual change signal output unit that outputs a contour mark signal that is generated based on the calculation image input from the inter-image calculation unit 403 and that indicates a lesion by a mark with a contour whose display color is changed. 141, and an angle signal that is generated based on the calculation image input from the inter-image calculation unit 403 and moves the display position of the normal image so that the position of the lesion is located at the center of the normal image. The ratio of the lesion portion in the displayed normal image generated based on the angle signal output unit 142 to be output to the distal end angle adjusting unit 161 described later through 190 and the calculation image input from the inter-image calculation unit 403 is And a zoom signal output unit 143 that outputs a zoom signal for changing the display magnification of the normal image so as to be constant.
[0068]
The image composition unit 151 receives a signal representing a normal image output from the normal image data memory 502 and the contour mark signal output from the visual change signal output unit 141 of the visual change signal generation unit 150. Based on the above, image synthesis is performed in which a lesion is indicated by a mark with a contour whose display color is changed.
[0069]
Based on the angle signal output from the angle signal output unit 142 of the visual change signal generation unit 150 and input through the control computer 190, the distal end angle adjustment unit 161 sets the position of the lesion to the center of the displayed normal image. The bending angle of the tip of the scope unit 100 is adjusted so as to be positioned.
[0070]
The zoom shift processing unit 152 receives the signal representing the normal image that has been subjected to the image synthesis output from the image synthesis unit 151 and the zoom signal output from the zoom signal output unit 143 of the visual change signal generation unit 150. The display magnification of the normal image is digitally adjusted (so-called digital zoom) so that the ratio of the lesioned portion in the normal image is constant (for example, 20%) with respect to the normal image on which the image synthesis is performed. Change). In addition, the zoom shift processing unit 152 can digitally change the display magnification of the normal image and can shift the position of the lesion displayed in the normal image so as to be positioned at the center of the normal image.
[0071]
The video signal generation unit 153 converts the normal image output from the zoom processing unit 152 to which a visual change is given, into a video signal and outputs the video signal.
[0072]
As described above, the video signal processing circuit 503 performs image synthesis that indicates a lesion part with a contour mark on a signal that represents a normal image input from the normal image data memory 502, or outputs an angle signal to output a lesion signal. The display magnification of this normal image is changed digitally so that the position of the part is located in the center of the normal image, or the ratio of the lesioned part in the normal image is constant, and the normal image is displayed in the normal image A normal image given a visual change obtained by shifting the position of the lesioned part so as to be positioned at the center of the normal image is converted into a video signal and output. The video signal is input to the monitor unit 600 and displayed as a visible image.
[0073]
Note that image composition, angle signal output, and display magnification change by the video signal processing circuit 503 do not have to be executed all at the same time, and only one of these three functions is selected and executed. Or, two of these three functions may be executed in combination.
[0074]
A fluorescence endoscope apparatus according to a third embodiment of the present invention will be described below with reference to FIGS. FIG. 15 is a block diagram showing a schematic configuration of the fluorescence endoscope apparatus according to the third embodiment, FIG. 16 is a diagram showing a schematic configuration of a mosaic filter arranged in the CCD image sensor, and FIG. 17 is red light and green light. FIG. 18 is a diagram showing a schematic configuration of a switching filter composed of a combination of three types of filters that respectively transmit blue light, FIG. 18 is a diagram showing marks given to a living tissue, and FIGS. 19 to 22 are normal images or fluorescence diagnostic images. It is a figure which shows the lesion site | part and mark area | region shown by these.
[0075]
In the fluorescence endoscope apparatus of the third embodiment, a living tissue is sequentially irradiated with illumination light (Lr, Lg, Lb), and the reflected light reflected by the living tissue is attached to the distal end of the fluorescence endoscope. A normal image display function for capturing an image of a living tissue on a monitor as a color image, and fluorescence emitted from the living tissue by irradiating the living tissue with excitation light. Two fluorescent images captured in two predetermined wavelength bands are obtained by a CCD image sensor attached to the tip, and these fluorescent images are calculated to obtain the ratio of the signal intensity of the fluorescent image in each of the predetermined wavelength bands. A corresponding fluorescence diagnostic image is acquired as diagnostic information, and this diagnostic information is superimposed on the normal image and displayed on a monitor to have a diagnostic support function for screening diagnosis. When displaying the fluorescent diagnostic information, only the diagnostic information indicated by the fluorescent diagnostic image is displayed so as to be superimposed on the normal image currently being observed acquired after the fluorescent diagnostic image is acquired. When the images are superimposed, the fluorescence diagnosis image is subjected to shape correction processing and rotation correction processing so that the living tissue region displayed by the normal image and the living tissue region displayed by the fluorescence diagnosis image substantially coincide with each other. In addition, the fluorescence diagnostic image is displayed on the monitor so as to overlap the normal image. When displaying the normal image and the fluorescent diagnostic image on the monitor, the outline of the lesion site indicated by the superimposing mode or the fluorescent diagnostic image in which the fluorescent diagnostic image is made translucent and the superimposed diagnostic image superimposed on the normal image is displayed. A contour superposition mode for displaying a contour superimposition diagnostic image superimposed on a normal image can be selected. Note that if the diagnostic information does not include information indicating the lesion site, the fluorescent diagnostic image is not displayed superimposed on the normal image.
[0076]
The fluorescence endoscope apparatus according to the third embodiment includes a CCD imaging element 205 at the tip, and a scope unit 200 inserted into a site suspected of being a patient's lesion, which irradiates a living tissue when capturing a normal image. Illumination unit 210 including a light source that emits illumination light, and a light source that emits excitation light that irradiates living tissue when a fluorescent image is captured, a CCD driver 220 that controls the operation of the CCD image sensor, and a color image of a captured normal image Normal image processing unit 130 that performs image processing to acquire the diagnostic information, and diagnostic information that acquires diagnostic information according to the ratio of the signal intensity of the fluorescent image in two predetermined wavelength bands obtained by capturing the fluorescent image as a fluorescent diagnostic image Acquisition unit 230, control of the operation timing of each part, correction processing of fluorescence diagnostic images when performing screening for diagnosis, display control, etc. Diagnosis support means 240 for displaying diagnostic information acquired as a fluorescence diagnostic image by giving a visual change to the normal image when displaying a normal image, and the normal image given the visual change as a visible image It comprises a monitor 150 for display and an input unit 260 for inputting a signal for switching the mode.
[0077]
The scope unit 200 includes a light guide 201 and a CCD cable 202 extending to the tip. An illumination lens 206 and an objective lens 207 are provided at the distal ends of the light guide 201 and the CCD cable 202, that is, at the distal end of the scope unit 200. The light guide 201 is bundled with a light guide 201 a for illumination light and a light guide 201 b for excitation light, and is integrated into a cable shape. Each light guide is connected to the illumination unit 210. A CCD image sensor 205 on which a mosaic filter 204 composed of minute band filters combined in a mosaic pattern is connected to the tip of the CCD cable 202 is connected. A prism 208 is attached to the CCD image sensor 205. It has been.
[0078]
As shown in FIG. 16, the mosaic filter 204 includes a narrowband filter 204 a that transmits light in a wavelength band of 430 nm to 530 nm and a wideband filter 204 b that transmits light in a wavelength band of 430 nm to 700 nm alternately. The band-pass filter has a one-to-one correspondence with the pixels of the CCD image sensor 205. Note that when acquiring a normal image, only an image captured through the broadband filter 204b is used.
[0079]
A drive line 203a for transmitting drive signals for the CCD cable 202 and the CCD image pickup device 205 and output lines 203b and 203c for reading signal charges from the CCD image pickup device 205 are combined. The drive line 203a is connected to the CCD driver 220 for output. The line 203 b is connected to the diagnostic information acquisition unit 230, and the output line 203 c is connected to the normal image processing unit 130.
[0080]
The illumination unit 210 includes a white light source 221 composed of a xenon lamp that emits white light, a light source power source 222 that is electrically connected to the white light source 221, and a condensing lens that collects white light emitted from the white light source. 223, a switching filter 224 for sequentially separating white light into R light that is red light, G light that is green light, and B light that is blue light, and a filter rotation unit 225 that rotates the switching filter 224. 17, the switching filter 224 includes an R filter 224a that transmits R light, a G filter 224b that transmits G light, a B filter 224c that transmits B light, and a mask portion 224d having a light shielding function. It is configured. Further, the illumination unit 210 includes a GaN-based semiconductor laser 211 that emits excitation light Le when capturing a fluorescent image, a power source 212 for excitation light source that is electrically connected to the GaN-based semiconductor laser 211, And a lens 213.
[0081]
The CCD driver 220 outputs an operation control signal for controlling the operation timing of the CCD image sensor 205.
[0082]
The diagnostic information acquisition unit 230 includes a signal processing circuit 231 that performs process processing of a signal imaged by the CCD image sensor 205, an A / D conversion circuit 232 that digitizes an image signal obtained by the signal processing circuit 231, and digitization. The image signal obtained by classifying the stored image signal as an image signal corresponding to the narrow band filter 204a and the wide band filter 204b of the mosaic filter 201 and the narrow band filter 204a stored in the image memory 233 are transmitted. A fluorescence diagnostic image generation circuit 234 that creates a fluorescence diagnostic image from a narrow wavelength band image signal (hereinafter referred to as a narrowband image signal) and a wide wavelength band image signal (hereinafter referred to as a broadband image signal) transmitted through the wideband filter 204b. I have. The fluorescence diagnostic image means an image representing specific diagnostic information, unlike an image representing a simple fluorescence intensity distribution or an image representing a difference in the spectral intensity distribution of fluorescence.
[0083]
The normal image processing unit 130 includes a signal processing circuit 131 that performs process processing of a signal imaged by the CCD image sensor 205, an A / D conversion circuit 132 that digitizes an image signal obtained by the signal processing circuit 131, and a digitalized image processing unit 130. A normal image memory 133 for storing the image signal for each color. Here, as the image signal representing the normal image, only the signal transmitted through the wide band filter 204b of the mosaic filter 201 is employed.
[0084]
The diagnosis support unit 240 is connected to each unit, controls the operation timing of each unit, and performs a correction process on the fluorescent diagnostic image when performing diagnostic screening, and a display that controls display operation in diagnostic screening. A control unit 242 is provided. The correction unit 241 of the diagnosis support unit 240 includes a storage unit 243 that stores the fluorescence diagnostic image input from the diagnostic information acquisition unit 230, a shape correction unit 244 that applies a shape correction process to the fluorescence diagnostic image, and a rotation correction process to the fluorescence diagnostic image. And an orientation correction unit 245 for performing a correction fluorescence diagnostic image based on the fluorescence diagnosis image. The display control unit 242 also generates a superimposed diagnostic image generation unit 247 that generates a superimposed diagnostic image based on the corrected fluorescence diagnostic image created by the correction unit 241 and the normal image input from the normal image processing unit 130, and the correction. A contour superimposed diagnostic image generation unit 248 that generates a contour superimposed diagnostic image based on the fluorescent diagnostic image and the normal image is provided.
[0085]
The superimposition diagnosis image and the contour superimposition diagnosis image output from the diagnosis support means 240 are converted into a video signal by the video signal processing circuit 135 and output.
[0086]
The operation of the fluorescence endoscope apparatus according to the third embodiment will be described below.
[0087]
Prior to the acquisition of the image, the observer inserts the scope unit 200 into the body cavity of the subject and guides the distal end of the scope unit 200 to the vicinity of the living tissue 10. In the present embodiment, as shown in FIG. 18, the first mark 12 and the second mark 13 are provided near the lesion site 11 in the living tissue 10. The first mark 12 and the second mark 13 are provided in the vicinity of the lesioned part 11 in advance at the time of prior endoscopy, and are provided using a bioadhesive mixed with a white pigment that is harmless to the living body. The first mark 12 is formed with two dots, and the second mark 13 is formed with one dot.
[0088]
Detailed description will be given below regarding irradiation of the excitation light Le, imaging of the fluorescence image Zj, and acquisition of the fluorescence diagnostic image.
[0089]
When the diagnostician gives an instruction to acquire a fluorescence diagnostic image via the input unit 260, the excitation light source power source 212 is driven based on the signal from the diagnosis support unit 240, and excitation light Le having a wavelength of 410 nm is emitted from the GaN-based semiconductor laser 211. It is injected. The excitation light Le passes through the lens 213, enters the light guide 201, is guided to the distal end of the scope unit, and is then irradiated from the illumination lens 206 toward the living tissue 10.
[0090]
Fluorescence generated from the living tissue 10 by being irradiated with the excitation light Le is collected by the condenser lens 207, reflected by the prism 208, and formed as a fluorescent image Zj on the CCD image sensor 205 through the mosaic filter 204. The
[0091]
In the CCD image sensor 205, the fluorescent image Zj is received and photoelectrically converted, and an electrical signal corresponding to the intensity of the light is output to the diagnostic information acquisition unit 230.
[0092]
The signal output from the CCD image sensor 205 is processed by the signal processing circuit 231 of the diagnostic information acquisition unit 230 and output as an image signal, converted into a digital signal by the A / D conversion circuit 232, and narrow-band. The image signal and the broadband image signal are divided and stored in the storage area of the image memory 233. The fluorescence diagnostic image generation circuit 234 calculates the intensity ratio between the narrowband image signal and the wideband image signal for each adjacent pixel to obtain a fluorescence diagnostic image.
[0093]
When the diagnostician acquires the fluorescent diagnostic image, the diagnostician observes the normal image so that the first mark 12 and the second mark 13 have an appropriate size in the approximate center of the acquired fluorescent diagnostic image. The position of the tip of the scope unit 200 is adjusted. When the first mark 12 and the second mark 13 are displayed at desired positions as shown in FIG. 19, the diagnostician operates the input unit 260 to input an instruction to store the fluorescence diagnostic image. The diagnosis support means 240 transfers the fluorescence diagnosis image acquired when this instruction is input from the fluorescence diagnosis image generation circuit 234 to the storage unit 243 and stores it. At this time, additional information that can specify the fluorescence diagnostic image, for example, a subject name, an imaging region name, an imaging date and time, and the like are stored together with the fluorescence diagnostic image.
[0094]
Next, normal image observation will be described. Note that the observation of the normal image described below is performed after the fluorescence diagnostic image is stored in the storage unit, and the normal image may be observed immediately after the fluorescence diagnostic image is acquired. If so, it may be performed several weeks after the fluorescence diagnostic image is acquired.
[0095]
First, an operation when acquiring an R image representing a red component of a normal image will be described. The light source power source 222 is driven by the signal from the diagnosis support means 240 based on the instruction of the diagnostician via the input unit 260, and white light is emitted from the white light source 221. The white light is collected by the condenser lens 223 and passes through the switching filter 224. In the switching filter 224, the rotation is synchronized so that the R filter 224a is arranged on the optical path based on the signal from the diagnosis support means 240. For this reason, white light becomes R light Lr when passing through the switching filter 224. The R light Lr is incident on the light guide 101, guided to the tip of the scope unit 200, and then irradiated to the living tissue 10 from the illumination lens 206.
[0096]
The reflected light of the R light (Lr) reflected by the living tissue 10 is collected by the condenser lens 207, reflected by the prism 208, and formed on the CCD image sensor 205 as an R light reflected image Zr.
[0097]
In the CCD image sensor 204, the R light reflection image Zr is received through the broadband filter 204a of the mosaic filter, and is converted into an electric signal corresponding to the intensity of light by photoelectric conversion and output. The output signal of the R image output from the CCD image sensor 205 is processed by the signal processing circuit 131 of the normal image processing unit 130 and is output as an R image representing the red component of the normal image. The A / D conversion circuit It is converted into a digital signal at 132 and stored in the R image storage area of the normal image memory 133.
[0098]
Thereafter, the G filter 224b that transmits G light and the B filter 224c that transmits B light are sequentially arranged on the optical path, and the G image representing the green component of the normal image and the blue component of the normal image are represented by the same operation as described above. B images are acquired and stored in the G image storage area and the B image storage area of the normal image memory 133, respectively.
[0099]
When a three-color image (normal image) is stored in the normal image memory 133, it is output from the normal image processing unit 130 in accordance with the display timing, converted into a video signal by the video signal processing circuit 135, and displayed on the monitor 150. Displayed as an image.
[0100]
When the above-described color image, which is a normal image of the lesion site 16 of the biological tissue 10 to which the first mark 12 and the second mark 13 are given, is displayed, the diagnostician displays the first mark 12 and the second mark 13 in this color. The position of the tip of the scope unit 100 is adjusted so that it is displayed in the approximate center of the image. When a desired color image (hereinafter, referred to as a normal image 15) as shown in FIG. 20 is displayed, when the diagnostician gives a diagnosis screening instruction through the input unit 260, the correction unit 241 displays the above-described normal image. The fluorescence diagnostic image 14 corresponding to the normal image 15 already acquired with reference to 15 additional information (subject name, imaging region name, imaging date and time) is read from the storage unit 243.
[0101]
Note that the lesion site 11 is reduced to the lesion site 16 due to the effect of medication, but the magnification of the normal image 15 is larger than the magnification of the fluorescence diagnostic image 14 as shown in FIG. Even if the diagnostic image 14 is observed while being superimposed on the normal image 15, it is difficult to easily recognize the reduction of the lesion site. Therefore, when the diagnostician inputs a diagnostic screening instruction, the display mode is designated at the same time. In other words, a superimposing mode for creating a superimposed diagnostic image for translucently displaying the fluorescent diagnostic image and superimposing it on the normal image, or a contour superimposed diagnostic image for displaying the contour of the lesion site of the fluorescent diagnostic image superimposed on the normal image. Select the outline superposition mode to be created.
[0102]
When the above instruction is input to the correction unit 241 of the diagnosis support unit 240, a fluorescence diagnostic image is input, and first, the magnification correction unit 244 performs magnification correction processing. First, the first mark area where the first mark of the normal image is imaged and the second mark area where the second mark is imaged are identified, and the distance between the first mark area and the second mark area (hereinafter referred to as the inter-mark distance). Description). Similar to the above, the inter-mark distance is also calculated in the fluorescence diagnostic image. Thereafter, the magnification of the fluorescent diagnostic image is changed so that the inter-mark distance calculated in the normal image and the inter-mark distance calculated in the fluorescent diagnostic image are substantially equal to each other and stored in the storage unit 243 as the corrected fluorescent diagnostic image. If the corrected fluorescence diagnostic image and the normal image at this time are displayed, an image as shown in FIG.
[0103]
Next, rotation correction processing is performed in the azimuth correction unit 245. The orientation of the second mark area with respect to the first mark area in the normal image (hereinafter referred to as the inter-mark orientation) and the orientation of the second mark area with respect to the first mark area in the corrected fluorescence diagnostic image are calculated. The corrected fluorescent diagnostic image is rotated and stored in the storage unit 243 again so that the inter-mark azimuth and the inter-mark azimuth of the corrected fluorescent diagnostic image are substantially equal (see FIG. 21C). The orientation of the second mark area with respect to the first mark area means the orientation of the second mark area with respect to the first mark area when the first mark area and the second mark area are displayed on the monitor. ing.
[0104]
Next, the corrected fluorescence diagnostic image is superimposed on the normal image and displayed. When the superimposition mode is selected as the display mode, the superimposition diagnostic image generation unit 247 reads the corrected fluorescence diagnostic image from the storage unit 243, reads the normal image from the image memory 133, and makes the corrected fluorescence diagnostic image translucent. The superimposed diagnostic image is created by superimposing on the normal image. When the corrected fluorescence diagnostic image is superimposed on the normal image, the positions of the first mark region and the second mark region of the normal image are changed so that the first mark region and the second mark region of the corrected fluorescent diagnostic image that are translucent are used. Is superimposed so as to substantially match the position of. This superimposed diagnostic image is output from the display control unit 242 to the video signal processing circuit 135. The superimposed diagnostic image is converted into a video signal, output to the monitor 150, and displayed as a superimposed diagnostic image 17 as shown in FIG. By observing the superimposed diagnostic image 17, the diagnostician can easily identify that the lesion site 16 is smaller than the lesion site 11.
[0105]
When the contour superimposition mode is selected as the display mode, the contour superimposition diagnostic image generation unit 247 reads the corrected fluorescence diagnostic image from the storage unit 243 and reads the normal image from the image memory 133. Based on the lesion site indicated by the corrected fluorescence diagnostic image, a contour image including the contour of the lesion site and the first mark region and the second mark region is created, and this contour image is superimposed on the normal image to generate the contour superimposed diagnostic image. create. When the corrected fluorescence diagnostic image is superimposed on the normal image, the positions of the first mark area and the second mark area of the contour image are substantially coincident with the positions of the first mark area and the second mark area of the normal image. Is superimposed on. The display control unit 242 outputs the contour superimposed diagnostic image to the video signal processing circuit 135. The contour superimposed diagnostic image is converted into a video signal, output to the monitor 150, and displayed as a contour superimposed diagnostic image 18 as shown in FIG. The diagnostician can easily identify that the lesioned part 16 is smaller than the lesioned part 11 by observing the contour superimposed diagnostic image 18.
[0106]
When the fluorescent diagnostic image is displayed over the normal image, the diagnostic information indicated by the fluorescent diagnostic image corresponds to the change in the ratio of the signal intensity of the wideband image signal and the signal intensity of the narrowband image signal. In this case, a pseudo color that clearly shows the difference in the display color between the fluorescence emitted from normal tissue and the fluorescence emitted from the lesion site is displayed. It is preferable to set. For example, the pseudo-color display so that the fluorescence emitted from the normal tissue is white and the fluorescence emitted from the lesion site is pink or other colors allows the observer to easily recognize the lesion site. .
[0107]
As is apparent from the above description, in the fluorescence endoscope apparatus according to the third embodiment, first, the fluorescence diagnosis is performed so that the distance between marks in the fluorescence diagnosis image is substantially equal to the distance between marks in the normal image. A magnification correction process is performed on the image, and then a rotation diagnosis process is performed on the fluorescence diagnostic image so that the inter-mark azimuth in the fluorescence diagnostic image is substantially equal to the inter-mark azimuth in the normal image to create a corrected fluorescence diagnostic image, Since this corrected fluorescence diagnostic image is displayed on the monitor in an overlapping manner with the normal image, the magnification and orientation of the corrected fluorescence diagnostic image, which is diagnostic information displayed on the normal image, are substantially the same, and the lesion site can be easily confirmed. This improves diagnostic efficiency.
[0108]
In the second embodiment and the third embodiment, the fluorescence observation region on the biological tissue in which the fluorescent image is captured includes the normal observation region on the biological tissue in which the normal image is captured, And it may be made larger than this region.
[Brief description of the drawings]
FIG. 1 is a conceptual diagram showing a schematic configuration of a fluorescence endoscope apparatus according to an embodiment of the present invention.
FIG. 2 is a cross-sectional view showing a cross section of a bundle fiber;
FIG. 3 is a diagram showing the irradiation timing of each laser beam.
FIG. 4 is a diagram showing a displayed normal image
FIG. 5 is a diagram showing the position and area of a lesion in a living tissue that is diagnostic information
FIG. 6 is a diagram showing a mark by a contour of a lesion displayed in a normal image
FIG. 7 is a diagram showing a state in which a lesion is moved to the center of a displayed normal image
FIG. 8 is a diagram illustrating a state in which the display magnification of a normal image is changed.
FIG. 9 is a diagram showing diagnostic information of a peripheral region that is included in the fluorescence observation region and deviates from the normal observation region.
FIG. 10 is a diagram showing diagnostic information displayed in a normal image when a lesion is present in the peripheral area
FIGS. 11A and 11B are diagrams showing various modes when displaying diagnostic information by giving visual changes to a normal image. FIGS.
FIG. 12 is a block diagram showing a schematic configuration of the fluorescence endoscope apparatus according to the second embodiment.
FIG. 13 is an enlarged block diagram showing details of a video signal processing circuit.
FIG. 14 is a diagram showing a schematic configuration of a transmission filter including filters of two wavelength transmission bands.
FIG. 15 is a block diagram showing a schematic configuration of a fluorescence endoscope apparatus according to a third embodiment.
FIG. 16 is a diagram showing a schematic configuration of a mosaic filter arranged in a CCD image sensor.
FIG. 17 is a diagram showing a schematic configuration of a switching filter including a combination of three types of filters.
FIG. 18 is a diagram showing marks given to living tissue
FIG. 19 is a diagram showing a lesion site and a mark area.
FIG. 20 shows a lesion site and a mark area.
FIG. 21 shows a lesion site and a mark area.
FIG. 22 shows a lesion site and a mark area.
[Explanation of symbols]
1 Living tissue
10 Imaging means
20 Diagnostic information acquisition means
30 Display means
40 Diagnosis support means
50 Irradiation means

Claims (5)

Imaging means for receiving normal light reflected by a biological tissue irradiated with normal light and fluorescence generated from the biological tissue irradiated with excitation light, respectively, and capturing a normal image and a fluorescent image, and the fluorescence Diagnostic information acquisition means for acquiring diagnostic information of the living tissue based on an image, display means for displaying the normal image as a visible image, and when displaying the normal image by the display means, the diagnostic information, A fluorescence endoscope apparatus comprising: a diagnosis support means for displaying the normal image by giving a visual change. The diagnostic information acquisition unit acquires information indicating a position of a lesioned part of the living tissue as the diagnostic information, and the diagnosis support unit displays a mark of the position of the lesioned part in the normal image. 2. The fluorescence endoscope apparatus according to claim 1, wherein The diagnostic information acquisition unit acquires information indicating a position of a lesioned part of the living tissue as the diagnostic information, and the diagnosis support unit positions the position of the lesioned part at the center of the normal image. The fluorescence endoscope apparatus according to claim 1 or 2, wherein the display position of the normal image is moved to the position. The diagnostic information acquisition unit acquires information indicating a region of a lesioned part of the living tissue as the diagnostic information, and the diagnosis support unit determines a ratio of the lesioned part in the displayed normal image. The fluorescence endoscope apparatus according to any one of claims 1 to 3, wherein the display magnification of the normal image is changed so as to be constant. The imaging means acquires the normal image and the fluorescent image so that a region of the biological tissue indicated by the fluorescent image includes the region of the biological tissue indicated by the normal image and is larger than the region. The fluorescence endoscope apparatus according to claim 1, wherein the fluorescence endoscope apparatus is provided.

Images