JP6203124B2 - Endoscope apparatus and method for operating endoscope apparatus - Google Patents

Description

  The present invention relates to an endoscope apparatus that can correspond to a plurality of types of fluorescent agents and generates an observation image by assigning different color signals to a fluorescence image and a reference light image, and an operation method of the endoscope apparatus.

  Endoscopic apparatuses are widely used in the medical field, and not only normal observation in which observation is performed by irradiating white light, but also fluorescence observation in which fluorescence is observed by irradiating excitation light.

  For example, International Publication No. WO10 / 109707 receives a central wavelength of excitation light that can optimally excite each fluorescent agent in a fluorescence observation apparatus, and a central wavelength of excitation light and a detection wavelength band of fluorescence. Acquisition of the combination of fluorescent agents and image processing such as coloring each image signal different from each other are described. And it is supposed that the crosstalk phenomenon which arises when observing fluorescence emitted according to a plurality of fluorescent probes can be reduced in various combinations of fluorescent probes.

  In Japanese Patent Laid-Open No. 2007-29453, several matrix coefficients are registered in advance. The matrix coefficients selected in the image signal output from the synchronization memory are selected and used according to the observation mode. Multiplication is described. And in an illuminating device and an observation apparatus, it is supposed that it can prevent that an optical member is damaged by the heat resulting from the light radiate | emitted from a light source.

  Furthermore, JP2011-191271A discloses a fluorescence endoscope apparatus that assigns a different hue to each of the fluorescent dye 1 and the fluorescent dye 2. And even if the type of spectral image and the exposure time are small, each fluorescence can be separated from the multiple fluorescence image with minimal density error, and the image with each fluorescence separated can be displayed with less noise. It is supposed to be possible.

International Publication No. WO10 / 109707 JP 2007-29453 A JP 2011-191271 A

  In fluorescence observation using a fluorescent agent, the wavelength band of the excitation light used varies depending on the type of fluorescent agent administered to the subject and the combination of fluorescent agents.

  Further, the reference light image to be displayed superimposed on the fluorescent image is obtained not only according to which wavelength band the reference light is used depending on the type and combination of the fluorescent agent, but also according to the wavelength band of the reference light. The form information of the subject is different.

  Furthermore, depending on the type and combination of fluorescent agents to be administered and the reference light to be used, there are many kinds of display colors to be given to the fluorescent image and the reference light image to make a picture. A pattern exists.

  However, in the techniques of the above-mentioned publications, the user manually performs the selection of the excitation light wavelength, the reference light wavelength, and the display color, and thus the operation is complicated. Thus, it is desired to improve usability and display an appropriate image with a simple operation.

  The present invention has been made in view of the above circumstances, and can be used to display an appropriate image according to a fluorescent drug to be administered without requiring a complicated operation, and can improve diagnostic performance. An object of the present invention is to provide a method for operating an endoscope apparatus.

An endoscope apparatus according to an aspect of the present invention can generate excitation light of a plurality of wavelength bands corresponding to a plurality of types of fluorescent agents having different excitation wavelengths, and further, a plurality of wavelength bands for irradiating a subject a of the reference light can be generated, and at least two of said fluorescent agent is administered to illuminate a subject, the light source unit for generating the excitation light of the reference light and the at least two wavelength bands, Fluorescence emitted from the fluorescent agent irradiated with the excitation light is imaged to generate a fluorescence imaging signal, and light from the subject irradiated with the reference light is imaged to represent the form of the subject An imaging unit that generates a reference light imaging signal, and a matrix function that performs a color matrix operation for generating an observation image by assigning different color signals to the fluorescence imaging signal and the reference light imaging signal and combining them. And parts, wherein a type of plural kinds of the fluorescent agent to be administered to a subject, and an input unit for inputting a medication information indicating the union information relates to a combination, among the excitation light of the plurality of wavelength bands, the input First excitation light in a wavelength band corresponding to the first fluorescent drug of the type indicated by the drug information input to the unit, and the first fluorescence indicated by the drug information input to the input unit A second excitation light in a wavelength band corresponding to a second fluorescent agent different from the agent, and a wavelength for exciting the first fluorescent agent from the reference light in the plurality of wavelength bands; and Reference light having a wavelength band different from the wavelength for exciting the second fluorescent agent and sandwiched between the wavelength band of the first excitation light and the wavelength band of the second excitation light is selected. Te, wherein the first wavelength band selected And excitation light, wherein the second excitation light, and a light source control unit for controlling the light source unit to generate said reference light, based on the medicine information, the matrix a color matrix to be used in the color matrix calculation A matrix setting unit set in the calculation unit.

Operation method of the endoscope apparatus according to an aspect of the present invention, Ri generatable der excitation light of a plurality of wavelength bands corresponding to the fluorescent agent of a plurality of types having different excitation wavelengths, further for irradiating the subject the light source unit is capable of generating a reference beam of the plurality of wavelength bands, wherein the at least two kinds of the fluorescent agent is administered to illuminate a subject, the excitation light of the reference light and the at least two wavelength bands And the imaging unit images fluorescence emitted from the fluorescent agent irradiated with the excitation light to generate a fluorescence imaging signal, and images light from the subject irradiated with the reference light. A color matrix that generates a reference light imaging signal representing the form of the subject, and in which a matrix calculation unit assigns different color signals to the fluorescence imaging signal and the reference light imaging signal and combines them to generate an observation image. Performs a scan operation, the input unit, the type of a plurality of types of the fluorescent agent is administered to the inputted subject, the drug information indicating the union information relates to a combination, a light source control unit that controls the light source unit are input to the matrix setting unit for setting a color matrix to be used in the color matrix calculation, the light source control unit, out of the excitation light of the plurality of wavelength bands by the drug information input from the input unit The second fluorescent agent different from the first fluorescent agent, which is indicated by the first excitation light in the wavelength band corresponding to the first fluorescent agent of the type shown and the agent information input from the input unit And a second excitation light having a wavelength for exciting the first fluorescent agent and the second fluorescent agent being excited from the reference light having the plurality of wavelength bands. That the wavelength of a different wavelength band, said first select the reference light in a wavelength band that is sandwiched between the wavelength band of the wavelength band of the excitation light and the second excitation light, the wavelength band selected said first pump light, and the second excitation light, and controls the light source unit to generate said reference light, said matrix setting unit, based on the drug information input from the input unit The color matrix used for the color matrix calculation is set in the matrix calculation unit.

  According to the endoscope apparatus and the operation method of the endoscope apparatus of the present invention, it is possible to display an appropriate image according to the administered fluorescent drug without requiring a complicated operation, thereby improving the diagnostic performance. it can.

The block diagram which shows the structure of the endoscope apparatus in Embodiment 1 of this invention. The chart which shows the example of the excitation wavelength set and color matrix which are determined when the fluorescent agent to be administered is one kind in the first embodiment. The chart which shows the example of the excitation wavelength set and color matrix which are determined when the fluorescent agent to be administered is a combination of two types in the first embodiment. The figure which shows the example of the display screen of the monitor in the said Embodiment 1.

Embodiments of the present invention will be described below with reference to the drawings.
[Embodiment 1]

  1 to 4 show the first embodiment of the present invention, and FIG. 1 is a block diagram showing the configuration of the endoscope apparatus 1.

  The endoscope apparatus 1 of the present embodiment is molecular imaging corresponding to observation using a plurality of types of fluorescent agents (including a case where observation is performed using a plurality of types of fluorescent agents individually and simultaneously). This is a fluorescent endoscope device.

  As shown in FIG. 1, an endoscope apparatus 1 includes an electronic endoscope (hereinafter abbreviated as “endoscope”) 2 that is inserted into a body cavity of a subject and performs imaging to acquire an imaging signal; An image signal is generated by performing signal processing on the light source device 3 including a light source that generates light to irradiate the subject and supplies the light to the endoscope 2 and an imaging signal acquired by the endoscope 2. The video processor 4 as a signal processing unit, a monitor 5 as a display unit (or display device) that inputs an image signal processed by the video processor 4 and displays it as an endoscopic image, and the video processor 4 are connected. And a keyboard 6 which is an input unit for performing operation input to the endoscope apparatus 1.

  The light source device 3 can generate excitation light of a plurality of wavelength bands corresponding to a plurality of types of fluorescent agents having different excitation wavelengths, and at least one for irradiating a subject to which at least one type of fluorescent agent has been administered. It is a light source unit that generates excitation light in a wavelength band. Specifically, the light source device 3 includes a light source unit 10, an LED control circuit 13 that controls light emission of the light source unit 10, and a condenser lens 14 that condenses the light emitted from the light source unit 10. . Here, the condenser lens 14 is configured separately from the light source unit 10, but the light source unit 10 may include the condenser lens 14.

  The light source unit 10 generates each light including white light, excitation light, and reference light as light for irradiating the subject via the endoscope 2 and is configured as a light emitting element that generates white light. White light LED (Light Emitting Diode) 11a that is a light source, excitation light LED 11b that is a light source configured as a light emitting element that generates excitation light, and a light source that is configured as a light emitting element that generates reference light A light LED 11c, a mirror 12a, a first dichroic prism 12b that is an optical element (selective optical element) that selectively reflects or transmits light according to the wavelength of incident light, and a second that is a selective optical element. And a dichroic prism 12c.

  Here, the excitation light LED 11b includes a plurality of LEDs that can respectively generate excitation light in a plurality of wavelength bands corresponding to a plurality of types of fluorescent agents having different excitation wavelengths. The reference light LED 11c uses, as reference light, light in a wavelength band that does not excite the fluorescent agent administered to the observation target, and further generates light in a wavelength band as close as possible to the excitation light as reference light. ing. This is for acquiring a subject image in a state close to observation with excitation light, as will be described later. The reference light LED 11c is preferably configured to be able to selectably generate light in a plurality of wavelength bands in order to correspond to a plurality of types of fluorescent agents.

  The white light LED 11a is an LED that emits white light including red light, green light, and blue light, or an R-LED that emits red light, a G-LED that emits green light, and blue light. It has a multi-color LED configuration including a B-LED that emits light.

  In the normal observation mode to be described later in this embodiment, for example, frame sequential illumination is performed. However, when the white light LED 11a emits white light, an illumination filter (not shown) (for example, in the circumferential direction of the rotary turret plate) is used. A red color filter, a green color filter, and a blue color filter are sequentially arranged along the illumination filter) and the like, and red light, green light, and blue light are irradiated in order. Moreover, when the white light LED 11a is comprised by R-LED, G-LED, and B-LED, these LED are light-emitted in order and a surface sequential illumination will be performed.

  When the white light LED 11a is composed of a plurality of color LEDs, the reference light LED 11c may be used also as one or more of R-LED, G-LED, and B-LED ( As a specific example, reference light having a wavelength of 550 nm shown in FIGS. 2 and 3 may be emitted by a G-LED.

  The LED control circuit 13 emits light by controlling the presence or absence of current supply to these LEDs 11a, 11b, and 11c (or, in the case where the LEDs 11a, 11b, and 11c are composed of a plurality of LEDs, each of these LEDs). In addition to controlling the presence or absence of light, the amount of light emitted during light emission is controlled by controlling the current to be supplied by, for example, PWM (pulse width control). The operation of the LED control circuit 13 is performed based on control by a light control circuit 36 described later and a wavelength set set by a wavelength set selection circuit 42 described later.

  In such a configuration, the white light emitted from the white light LED 11a is reflected by the mirror 12a, passes through the first dichroic prism 12b, and is further reflected by the second dichroic prism 12c. Incident.

  Further, the excitation light emitted from the excitation light LED 11b is reflected by the first dichroic prism 12b, is reflected by the second dichroic prism 12c, and then enters the condenser lens.

  Further, the reference light emitted from the reference light LED 11 c is transmitted through the second dichroic prism 12 c and then enters the condenser lens 14.

  The light incident on the condenser lens 14 in this manner is collected by the condenser lens 14 and is incident on the incident end portion of the light guide 20 extending from the endoscope 2.

  The endoscope 2 is configured by extending an elongated insertion portion for insertion into a body cavity of a subject from the operation portion on the hand side toward the distal end side. The endoscope 2 includes a light guide (LG) 20, an illumination lens 21, an objective lens 22, an imaging unit 23, a scope ID memory 28, and a mode switch 29.

  The light guide 20 is a transmission optical system that transmits the light incident on the incident end via the condenser lens 14 to the distal end side of the insertion portion.

  The illumination lens 21 is an illumination optical system that irradiates the light emitted from the irradiation end of the light guide 20 toward the observation target portion 90 of the subject.

  The objective lens 22 is an objective optical system that forms an image of light from the observation target region 90 on an imaging element 25 (described later) in the imaging unit 23.

  The imaging unit 23 captures fluorescence emitted from the fluorescent agent irradiated with excitation light to generate a fluorescence imaging signal (fluorescence image), and also captures light from the subject and represents reference light representing the form of the subject An imaging signal (reference light image) is generated, and includes an imaging actuator 24, an imaging element 25, an amplification unit 26, and an A / D conversion unit 27.

  The imaging actuator 24 has a plurality of optical filters that allow light of different wavelength bands to pass, and switches which optical filter is positioned on the optical path of the light incident from the objective lens 22 to thereby change the specific wavelength band. It is possible to selectively transmit only the light.

  Specifically, the optical filter used in the fluorescence observation mode described later (this fluorescence observation mode is one of the special light observation modes) cuts light in the wavelength band of excitation light, The excitation light cut filter has a spectral transmittance characteristic for transmitting light. Therefore, an image acquired by irradiating excitation light in the fluorescence observation mode is a fluorescence image that does not include a reflection component of excitation light.

  The imaging actuator 24 replaces the plurality of optical filters in accordance with the light generated from the light source device 3 in the surface order. The imaging actuator 24 can also retract all the optical filters from the optical path of the light incident from the objective lens 22, and in this case, no band limitation is performed. The retraction of all the optical filters from the optical path is performed, for example, in a normal observation mode described later.

  The image pickup device 25 photoelectrically converts the light that has passed through the image pickup actuator 24 and outputs it as an image pickup signal. For example, the image pickup device 25 is configured as a monochrome image pickup device. It may be a plate color image sensor or the like).

  The amplifying unit 26 amplifies the imaging signal output from the imaging element 25.

  The A / D conversion unit 27 converts the analog imaging signal amplified by the amplification unit 26 into a digital signal.

  The scope ID memory 28 stores information including ID information unique to the endoscope 2, information such as the number of pixels of the image sensor 25, and information for fluorescence observation that defines recommended use conditions in fluorescence observation. Storing. Here, the information for fluorescence observation includes light amount ratio information (or intensity ratio information) of excitation light and reference light recommended when performing fluorescence observation in the fluorescence observation mode using the endoscope 2. The light source device 3 sets the light amount ratio between the excitation light and the reference light according to the light amount ratio information.

  The mode switch 29 is an operation switch for switching the observation mode of the endoscope apparatus 1. Examples of observation modes that can be switched by the mode changeover switch 29 include a normal observation mode in which normal light observation (normal observation) is performed by irradiating white light, and a fluorescence observation mode in which fluorescence observation is performed by irradiating excitation light. . Here, when observation is performed in the fluorescence observation mode, it is assumed that at least one of the plurality of types of fluorescent agents is administered to the observation target portion 90 of the subject. In the fluorescence observation mode in the present embodiment, for example, the light source device 3 alternately generates excitation light and reference light in time series, and the imaging element 25 obtains the fluorescence imaging signal and the reference light obtained at the time of excitation light irradiation. The reference light imaging signal obtained at the time of irradiation is alternately imaged in time series.

  The video processor 4 includes a mode switching circuit 31, an image sensor control circuit 32, a white balance circuit 33, a selector 34, a timing generator 35, a dimming circuit 36, a white light image processing circuit 37, and a special light image. A processing circuit 38, a synthesis circuit 39, a color matrix determination circuit 41, and a wavelength set selection circuit 42 are provided.

  The mode switching circuit 31 reads necessary information from the scope ID memory 28 and transmits it to each unit in the video processor 4, and the driving mode of the image sensor control circuit 32 according to the observation mode set by the mode switching switch 29. And the operation mode of the light control circuit 36 is switched.

  The imaging element control circuit 32 controls and drives the imaging unit 23 in the drive mode switched by the mode switching circuit 31 according to the observation mode. For example, the imaging actuator 24 inserts and removes the optical filter on the optical path of the light incident from the objective lens 22 under the control of the imaging element control circuit 32. Further, for example, the image sensor 25 sets the exposure start timing and the exposure end timing under the control of the image sensor control circuit 32, and reads the image signal after exposure.

  When the image pickup signal output from the image pickup unit 23 is an RGB image pickup signal obtained in the normal observation mode, the white balance circuit 33 has an RGB signal intensity ratio of the image pickup signal related to the white subject of 1: 1: 1. Thus, the gain is adjusted to adjust the color balance.

  The selector 34 outputs to the white light image processing circuit 37 when the imaging signal input via the white balance circuit 33 is an imaging signal obtained in the normal observation mode, and the imaging obtained in the fluorescence observation mode. If it is a signal, it is output to the special light image processing circuit 38.

  The timing generator 35 supplies timing signals to the image sensor control circuit 32, the white balance circuit 33, the selector 34, etc., and operates them in synchronization.

  The dimming circuit 36 is an operation mode switched by the mode switching circuit 31 according to the observation mode, and the LED control circuit 13 sends the LEDs 11a, 11b, and 11c to the LEDs 11a, 11b, and 11c based on the imaging signal input through the white balance circuit 33. Set the output current. For example, in the normal observation mode, the light control circuit 36 sets a current output from the LED control circuit 13 to the white light LED 11a based on the brightness of the subject obtained from the imaging signal. Further, in the case of the fluorescence observation mode, for example, the dimming circuit 36 is controlled by the LED control circuit 13 based on the fluorescence observation information read from the scope ID memory 28 (for example, the light amount ratio information as described above). The electric current output to excitation light LED11b and reference light LED11c is set.

  The white light image processing circuit 37 performs various types of image processing such as color adjustment processing and gamma correction on the image signals of the RGB channels input from the selector 34 in the normal observation mode.

  The special light image processing circuit 38 is a matrix operation unit that performs a color matrix operation for assigning different color signals to the fluorescent image pickup signal and the reference light image pickup signal obtained from the image pickup unit 23 and combining them to generate an observation image.

  Specifically, the special light image processing circuit 38 synchronizes the reference light imaging signal and the fluorescence imaging signal obtained in time series by assigning them to any one of the three channel inputs, and further by the color matrix determination circuit 41. A special light image in which the fluorescence image and the reference light image are superimposed is generated by assigning to any channel of the output RGB image using the determined color matrix.

  Here, the color matrix is a matrix in which the fluorescence imaging signal is assigned to which of the RGB images, the reference light imaging signal is assigned to which of the other RGB images, and gain adjustment is performed. The color matrix is stored in advance in the storage unit in the special light image processing circuit 38 in accordance with the types and combinations of fluorescent agents to be administered to the subject. Any one is selected and determined by the color matrix determination circuit 41.

  The synthesizing circuit 39 applies a mask image (a mask such as black outside the endoscope image) to the white light image output from the white light image processing circuit 37 or the special light image output from the special light image processing circuit 38. And character information are combined as necessary and output to the monitor 5. In the fluorescence observation mode, the synthesis circuit 39 also includes a color image 5a (see FIG. 4) that is a special light image in which a fluorescence image and a reference light image are superimposed, and a fluorescence monochrome image 5b (FIG. 4) based on the fluorescence imaging signal. Are displayed side by side, a process of combining these images is also performed.

  The color matrix determination circuit 41 is a matrix setting unit that sets a color matrix used for color matrix calculation in the special light image processing circuit 38 based on drug information input from the keyboard 6 by a user operation.

  Here, the information to be input by the user for the determination and selection by the color matrix determination circuit 41 and the wavelength set selection circuit 42 is the type of fluorescent agent to be administered (plural types), as will be described in detail later. In the case of administering the fluorescent agent, the combination of the types of fluorescent agents is included. The same applies hereinafter), and the setting operation to be performed by the user is extremely simple. Thus, the keyboard 6 functions as an input unit for inputting drug information indicating the type of fluorescent drug to be administered to the subject.

  Specifically, the color matrix determination circuit 41 indicates which color matrix is used in accordance with the type of fluorescent drug indicated by the drug information (see the “color matrix” column in FIGS. 2 and 3 described later). Are stored in advance, and one of the color matrices stored in the storage unit in the special light image processing circuit 38 is selected by referring to the table. The special light image processing circuit 38 is set.

  For example, when the keyboard 6 inputs that there is only one type of fluorescent drug to be administered by a user operation, the input fluorescent imaging signal is, for example, the Bin channel and Gin channel of the three input channels Rin, Gin, and Bin. It is handled as an input, and the input reference imaging signal is handled as an Rin channel imaging signal (see the “excitation wavelength set” column in FIG. 2 described later).

  Further, when the keyboard 6 inputs that the combination of two types of fluorescent drugs to be administered by user operation, one of the input fluorescent imaging signals is treated as an input of the Bin channel, and the input fluorescent imaging signal The other one is handled as an input of the Gin channel, and the input reference imaging signal is handled as an imaging signal of the Rin channel (see the “excitation wavelength set” column in FIG. 3 described later).

  Furthermore, when the keyboard 6 inputs that the combination of the fluorescent drugs to be administered is a three-type combination by the user operation, the three input fluorescence imaging signals are treated as imaging signals for the three input channels Rin, Gin, and Bin. It is like that.

When the above-described special light image processing circuit 38 receives (Rin, Gin, Bin), the special light image processing circuit 38 performs a matrix operation as shown in the following Equation 1 using the color matrix M (matrix components m11 to m33). An output 3-channel image (Rout, Gout, Bout) is calculated.

  The color matrix determination circuit 41 determines the color matrix M used in the calculation of the special light image processing circuit 38 according to the type of the fluorescent agent input by the keyboard 6 as described later.

  The wavelength set selection circuit 42 selects the excitation light of the wavelength band corresponding to the type of fluorescent agent indicated by the medicine information input from the keyboard 6 from the excitation light of the plurality of wavelength bands that can be generated by the light source device 3. And a light source controller that controls the light source device 3 so as to generate excitation light of a selected wavelength band.

  Specifically, the wavelength set selection circuit 42 selects which wavelength band of the excitation light LED 11b and which wavelength band of the reference light LED 11c are combined in the fluorescence observation mode based on the drug information. The LED control circuit 13 is set. As a result, the LED control circuit 13 sequentially emits irradiation light based on the set wavelength set.

  For this purpose, the wavelength set selection circuit 42 determines which wavelength band of excitation light and reference light of which wavelength band to use according to the type of fluorescent drug indicated by the drug information (that is, which LED is used for excitation light emission). A table for determining which LED is used for reference light emission) is stored in advance (see “excitation wavelength set” column in FIGS. 2 and 3 to be described later).

  In the configuration as described above, when the normal observation mode is set, the R-LED, G-LED, and B-LED of the white light LED 11a emit red light, green light, and blue light, for example, frame by frame sequentially. Then, a red light image, a green light image, and a blue light image are sequentially acquired. Then, when the images of the three primary colors are prepared by imaging three consecutive frames, a color image is generated by performing synchronization.

  Further, when the fluorescence observation mode is set, an excitation light cut filter corresponding to the fluorescent agent is inserted by the imaging actuator 24 in a certain frame and irradiated with excitation light. Then, the excitation light component in the reflected light and fluorescence of the excitation light from the observation target portion 90 of the subject is cut by the excitation light cut filter, and only the fluorescence optical image is formed on the image sensor 25. In this manner, a fluorescence imaging signal obtained by exposing the fluorescence optical image is output from the imaging device 25. When only one type of fluorescent agent is used, acquisition of the fluorescence imaging signal is performed continuously for two frames. In the subsequent frame, the excitation light cut filter is retracted by the imaging actuator 24 and the reference light is irradiated. Thereby, an optical image of the reference light from the observation target region 90 of the subject is formed on the image sensor 25, and a reference light imaging signal is output from the image sensor 25. By repeating such a series of frame operations, a fluorescence imaging signal (first time), a fluorescence imaging signal (second time), and a reference light imaging signal are acquired in a frame sequence. The acquired fluorescence imaging signal and reference light imaging signal are combined as a color image using a color matrix to be described later and displayed on the monitor 5, or only the fluorescence imaging signal can be displayed on the monitor 5 as a fluorescence monochrome image. It has become.

  Note that when two types of fluorescent agents are used, for example, imaging is repeatedly performed in the frame order of the first fluorescent image, the second fluorescent image, and the reference light image. Further, when three types of fluorescent agents are used, for example, imaging is repeatedly performed in the frame order of the first fluorescent image, the second fluorescent image, and the third fluorescent image.

  Next, FIG. 2 is a chart showing an example of an excitation wavelength set and a color matrix determined when there is one kind of fluorescent agent to be administered.

  When the keyboard 6 inputs by user operation that the fluorescent agent to be administered is only Cy3 (or FITC), the wavelength of the excitation light EX1 (Bin) (or EX2 (Gin)) is 500 nm, and the reference light Ref (Rin ) Is set to the LED control circuit 13 by the wavelength set selection circuit 42 automatically. Here, the reference light wavelength of 550 nm hardly excites Cy3 and FITC (that is, a wavelength band other than the excitation lights EX1 and EX2), but is a wavelength relatively close to the excitation light wavelength of 500 nm.

  Since the object is observed differently depending on the wavelength of the light used, the wavelength set selection circuit 42 generates light in the wavelength band other than the excitation lights EX1 and EX2 in the selected wavelength band as the reference light Ref. When the light source device 3 is controlled, the light source device 3 is further controlled to generate light in a wavelength band as close as possible to the excitation light in the selected wavelength band.

  Then, a color matrix 1 (see Equation 2 below) that assigns the fluorescence image FL to the output Rout channel and the reference light image Ref to the output Gout channel and the output Bout channel, respectively, is supplied by the color matrix determination circuit 41 to the special light image processing circuit. 38 is automatically set. The reason why the fluorescent image FL is assigned to the output Rout channel is that red is a color with high visibility.

As a result, the special light image processing circuit 38 uses the color matrix 1, which is a specific example of the color matrix M described above, to perform an operation as shown in the following Equation 2 and output three-channel images (Rout, Gout, Bout). Is calculated.

  As described above, the color matrix 1 shown in Expression 2 adds the fluorescence imaging signal (first time) and the fluorescence imaging signal (second time) acquired continuously for two frames as described above to obtain Rout, and 1 is added to the reference light imaging signal. Gout and Bout are obtained by giving gains of 5 times and 3.5 times, respectively. Therefore, the monitor 5 displays an image in which a red fluorescent image is superimposed on a green-blue reference light image that is stronger than green.

  Here, for example, green reference light having a wavelength of 550 nm is easily absorbed by hemoglobin, and the amount of reflected light from the blood vessel portion is reduced. In this case, the signal values of the other color components are relatively high compared to the green component, resulting in a reddish color similar to the cancer tissue shown by the fluorescence image, and a so-called false positive state occurs. May end up.

  Therefore, as a color matrix used for the matrix calculation, a matrix in which a coefficient corresponding to a blue component or a green component indicating a background reference image is increased, that is, a matrix capable of suppressing false positives is used.

  Next, as described above, when the keyboard 6 inputs that the fluorescent agent to be administered is only Cy5 (or Cy5.5) by the user operation, the wavelength of the excitation light EX1 (Bin) (or EX2 (Gin)) As the wavelength of the reference light Ref (Rin), the wavelength of 550 nm, which is green light, is automatically set to the LED control circuit 13 by the wavelength set selection circuit 42, and the color matrix 1 described above is the color matrix determination circuit. 41 is automatically set to the special light image processing circuit 38. Here, the reference light wavelength of 550 nm hardly excites Cy5 and Cy5.5 (that is, a wavelength band other than the excitation lights EX1 and EX2), but is a wavelength relatively close to the excitation light wavelength of 600 nm.

  Furthermore, when the keyboard 6 inputs only Cy7 (or Alexa750) to be administered by the user operation, the wavelength of the excitation light EX1 (Bin) (or EX2 (Gin)) is 700 nm, the reference light Ref The wavelength set selection circuit 42 automatically sets the wavelength of 800 nm, which is near infrared light, as the wavelength of (Rin). Here, the reference light wavelength of 800 nm hardly excites Cy7 and Alexa 750 (that is, a wavelength band other than the excitation lights EX1 and EX2), but is a wavelength relatively close to the excitation light wavelength of 700 nm.

  The assignment from the input channel to the output channel is the same as that of the color matrix 1 described above, but the color matrix 2 having a different gain (in other words, a variation of the color matrix 1) is converted into a special light image processing circuit by the color matrix determination circuit 41. 38 is automatically set.

As a result, the special light image processing circuit 38 uses the color matrix 2, which is a specific example of the color matrix M described above, to perform an operation as shown in the following Equation 3 and output three-channel images (Rout, Gout, Bout). Is calculated.

  As described above, the color matrix 2 shown in Expression 3 adds the fluorescent imaging signal (first time) and the fluorescent imaging signal (second time) acquired continuously for two frames as described above to obtain Rout, and adds 2 to the reference light imaging signal. A gain of 1.times. And 2.36.times. Are respectively given as Gout and Bout. Therefore, the monitor 5 displays an image in which a red fluorescent image is superimposed on a green-blue reference light image.

  Next, FIG. 3 is a chart showing an example of an excitation wavelength set and a color matrix determined when the fluorescent agents to be administered are a combination of two types.

  When the fluorescent drugs to be administered are a plurality of types of combinations, the drug information input from the keyboard 6 includes combination information regarding the combination of the fluorescent drugs, and the wavelength set selection circuit 42 includes a plurality of light sources 3 that can be generated. A light source that generates excitation light of a plurality of selected wavelength bands by selecting excitation light of a plurality of wavelength bands corresponding to the plurality of types of fluorescent agents indicated by the combination information from the excitation light of the wavelength bands The device 3 will be controlled.

  When the user inputs the fact that the fluorescent agent to be administered is (Cy3 or FITC) and (Cy5 or Cy5.5), the keyboard 6 has a wavelength of 500 nm as the wavelength of the first excitation light EX1 (Bin), the second The wavelength set selection circuit 42 automatically sets the wavelength of 600 nm as the wavelength of the excitation light EX2 (Gin) and the wavelength of 550 nm as green light as the wavelength of the reference light Ref (Rin). Here, the reference light wavelength of 550 nm hardly excites Cy3, FITC, Cy5, and Cy5.5 (that is, a wavelength band other than the excitation lights EX1 and EX2), but is relatively in the excitation light wavelengths of 500 nm and 600 nm. The wavelength is close.

  Furthermore, a color matrix 3 (see Equation 4 below) that assigns the first fluorescent image FL1 to the output Rout channel, the second fluorescent image FL2 to the output Gout channel, and the reference light image Ref to the output Bout channel, respectively. The color matrix determination circuit 41 automatically sets the special light image processing circuit 38. Here, two types of fluorescent images are assigned to the primary colors of red and green, which have higher visibility.

As a result, the special light image processing circuit 38 uses the color matrix 3 which is a specific example of the above-described color matrix M to perform an operation as shown in the following Expression 4, and outputs an output 3-channel image (Rout, Gout, Bout). Is calculated.

  In the color matrix 3 shown in Expression 4, the first fluorescent imaging signal is set as Rout as it is (gain of 1), the second fluorescent imaging signal is set as Gout as it is (gain of 1), and 3.5 times the reference light imaging signal. The gain is given as Bout. Therefore, the monitor 5 displays an image in which the first fluorescent image of red and the second fluorescent image of green are superimposed on the blue reference light image.

  Similarly, when the user inputs the fact that the fluorescent agent to be administered is (Cy3 or FITC) and (Cy7 or Alexa750), the keyboard 6 inputs a wavelength of 500 nm as the wavelength of the first excitation light EX1 (Bin). A wavelength of 700 nm as the wavelength of the excitation light EX2 (Gin) of 2 and a wavelength of 550 nm, which is green light as the wavelength of the reference light Ref (Rin), are automatically set to the LED control circuit 13 by the wavelength set selection circuit 42. The color matrix 3 is automatically set to the special light image processing circuit 38 by the color matrix determination circuit 41. Here, the reference light wavelength of 550 nm hardly excites Cy3, FITC, Cy7, and Alexa750 (that is, a wavelength band other than the excitation lights EX1 and EX2), but is relatively close to the excitation light wavelength of 500 nm. And a wavelength that is not so far from the excitation light wavelength 700 nm (since it is between the excitation light wavelength 500 nm and the excitation light wavelength 700 nm, at least the wavelength closer to the excitation light wavelength 700 nm than the short wavelength side of the excitation light wavelength 500 nm) It has become.

  Further, when the keyboard 6 inputs (Cy5 or Cy5.5) and (Cy7 or Alexa750) that the fluorescent agent to be administered is input by a user operation, a wavelength of 600 nm as the wavelength of the first excitation light EX1 (Bin), The wavelength set selection circuit 42 automatically sets the wavelength of 700 nm as the wavelength of the second excitation light EX2 (Gin) and the wavelength of 800 nm as the wavelength of the reference light Ref (Rin) to the LED control circuit 13. Is done. Here, the reference light wavelength of 800 nm hardly excites Cy5, Cy5.5, Cy7, and Alexa750 (that is, a wavelength band other than the excitation lights EX1 and EX2), but one of the two excitation light wavelengths. The wavelength is relatively close to 700 nm.

  The assignment from the input channel to the output channel is the same as that of the color matrix 3 described above, but the color matrix 4 having a different gain (in other words, a variation of the color matrix 3) is converted into a special light image processing circuit by the color matrix determination circuit 41. 38 is automatically set.

As a result, the special light image processing circuit 38 uses the color matrix 4 which is a specific example of the above-described color matrix M to perform an operation as shown in the following Expression 5, and outputs an output 3-channel image (Rout, Gout, Bout). Is calculated.

  In the color matrix 4 shown in Equation 5, the first fluorescent imaging signal is set as Rout as it is (gain of 1), the second fluorescent imaging signal is set as Gout as it is (gain of 1), and 2.36 times the reference light imaging signal. The gain is given as Bout. Accordingly, the monitor 5 displays an image in which the first fluorescent image of red and the second fluorescent image of green are superimposed on the dark blue reference light image as compared with the case where the color matrix 3 is used. The

  Although not specifically illustrated, when the fluorescent agent to be administered is a combination of three types, for example, (Cy3 or FITC) and (Cy5 or Cy5.5) and (Cy7 or Alexa750), the first excitation light The wavelength set selection circuit 42 sets a wavelength of 500 nm as the wavelength of EX1 (Bin), a wavelength of 600 nm as the wavelength of the second excitation light EX2 (Gin), and a wavelength of 700 nm as the wavelength of the third excitation light EX3 (Rin). It is automatically set in the control circuit 13.

  Furthermore, the first fluorescent image FL1 (corresponding to Bin) is output to the output Rout channel, the second fluorescent image FL2 (corresponding to Gin) is output to the output Gout channel, and the third fluorescent image FL3 (corresponding to Rin) is output to the output Bout channel. ) Are automatically set in the special light image processing circuit 38 by the color matrix determination circuit 41. The color matrix determining circuit 41 automatically sets the color matrix to be assigned to each other (other than the diagonal components from the upper right to the lower left). Here, the three diagonal components (that is, gain) from the upper right to the lower left are appropriately determined according to the light intensity of the three fluorescent imaging signals to be acquired and the importance at the time of observation.

  In addition, even if there are combinations of four or more fluorescent agents to be administered, colors other than the primary color (for example, yellow obtained by mixing red and green, etc.) if the above-described false positive does not occur. It is also possible to display on the monitor 5 using.

  Although an example in which an image in which a fluorescent image and a reference light image are superimposed is described above has been described, a fluorescent monochrome image may be output to the monitor 5 and displayed according to a user's selection setting. .

  FIG. 4 is a diagram showing an example of the display screen of the monitor 5.

  In the example shown in FIG. 4, the color image 5a, the fluorescent monochrome image 5b, and the color image 5a in which the fluorescent image and the reference light image are superimposed on the display screen of the monitor 5 using the color matrix as described above. RGB channel assignment information 5c, which is information relating to the color signals assigned to the fluorescence imaging signal and the reference light imaging signal, is displayed.

  The fluorescent monochrome image 5b is an image smaller than the color image 5a in the example shown in FIG. 4, and the fluorescent light emitting portion 51 is displayed in monochrome.

  In the color image 5a, a fluorescent light emitting portion 51 is displayed in a superimposed manner in red on a green-blue reference light portion 52 representing the form of the subject.

  The RGB channel assignment information 5c displays information indicating that the fluorescence image FL is assigned to the R channel and the reference light image Ref is assigned to the G channel and the B channel. The RGB channel allocation information 5c is generated as display information by the synthesis circuit 39 in accordance with the color matrix set in the special light image processing circuit 38. That is, the synthesis circuit 39 gives information related to the color signal that the special light image processing circuit 38 assigns to the fluorescent image and the reference light image to the monitor 5 as a display unit according to the color matrix set by the color matrix determination circuit 41. It is a display control unit that performs display control.

  Further, the captured fluorescent image of the subject can be recorded (filed) in an image recording apparatus (not shown) as well as output to the monitor 5 and displayed.

  According to the first embodiment, since the excitation light is automatically selected and generated from the excitation light of a plurality of wavelength bands based on the inputted drug information, the user selects the excitation light. Thus, it becomes possible to display an image corresponding to the administered fluorescent drug without requiring a complicated operation. In particular, the labor required for setting the excitation light when administering a plurality of types of fluorescent agents can be greatly reduced.

  Furthermore, since the color matrix used by the special light image processing circuit 38 is automatically set based on the medicine information, it is necessary for the user to set each display color assignment to the fluorescent image portion and the reference image portion. Thus, an appropriately pictured image is displayed without requiring a complicated operation, and the diagnosis can be improved.

  In addition, since the information regarding the color signal to be assigned to the fluorescent image and the reference light image is displayed on the monitor 5, the user can select which display color portion is the fluorescent image and which display without having to call the setting screen. It can be easily confirmed whether the color portion is a reference image.

  As for the reference light, light in a wavelength band other than the excitation light is automatically set based on the inputted drug information, so that complicated operations are reduced.

  At this time, since light in a wavelength band close to the excitation wavelength band of the administered fluorescent agent is automatically set as reference light, it is possible to observe an object image close to observation with excitation light with reference light. This makes it possible to further improve diagnosis.

  In addition, when the wavelength of the reference light is a wavelength that is easily absorbed by a living body, for example, hemoglobin, the use of a color matrix with a large signal amplification factor of the reference image can suppress the occurrence of false positives. Thus, the diagnosis can be further improved.

  Although the endoscope apparatus has been mainly described above, an operation method for operating the endoscope apparatus as described above may be used, or a processing program for causing a computer to execute the operation method, the processing program The recording medium may be a non-temporary recording medium that can be read by a computer.

  Further, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope in the implementation stage. In addition, various aspects of the invention can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components from all the components shown by embodiment. Furthermore, the constituent elements over different embodiments may be appropriately combined. Thus, it goes without saying that various modifications and applications are possible without departing from the spirit of the invention.

DESCRIPTION OF SYMBOLS 1 ... Endoscope apparatus 2 ... Endoscope 3 ... Light source apparatus 4 ... Video processor 5 ... Monitor 5a ... Color image 5b ... Fluorescent monochrome image 5c ... RGB channel allocation information 6 ... Keyboard 10 ... Light source unit 11a ... White light LED
11b ... Excitation light LED
11c ... Reference light LED
DESCRIPTION OF SYMBOLS 12a ... Mirror 12b ... 1st dichroic prism 12c ... 2nd dichroic prism 13 ... LED control circuit 14 ... Condenser lens 20 ... Light guide 21 ... Illumination lens 22 ... Objective lens 23 ... Imaging part 24 ... Imaging actuator 25 ... Imaging element DESCRIPTION OF SYMBOLS 26 ... Amplifying part 27 ... A / D conversion part 28 ... Scope ID memory 29 ... Mode changeover switch 31 ... Mode changeover circuit 32 ... Image sensor control circuit 33 ... White balance circuit 34 ... Selector 35 ... Timing generator 36 ... Dimming circuit 37 ... White light image processing circuit 38 ... Special light image processing circuit 39 ... Composition circuit 41 ... Color matrix determination circuit 42 ... Wavelength set selection circuit 51 ... Fluorescent light emission part 52 ... Reference light part 90 ... Observation target part

Claims (4)

Excitation light in a plurality of wavelength bands corresponding to a plurality of types of fluorescent agents having different excitation wavelengths can be generated, and reference light in a plurality of wavelength bands for irradiating the subject can be generated, and at least 2 the type of the fluorescent agent is administered in order to irradiate the object, a light source unit that generates the excitation light of the reference light and the at least two wavelength bands,
Fluorescence emitted from the fluorescent agent irradiated with the excitation light is imaged to generate a fluorescence imaging signal, and light from the subject irradiated with the reference light is imaged to represent the form of the subject An imaging unit that generates a reference light imaging signal;
A matrix calculation unit that performs color matrix calculation for assigning different color signals to the fluorescent imaging signal and the reference light imaging signal and generating an observation image;
An input unit for inputting drug information indicating types of the plurality of types of the fluorescent drugs to be administered to the subject and combination information on combinations ;
The first excitation light of the wavelength band corresponding to the first fluorescent agent of the type indicated by the drug information input to the input unit from the excitation light of the plurality of wavelength bands, and the input to the input unit The second excitation light in the wavelength band corresponding to the second fluorescent drug different from the first fluorescent drug indicated by the drug information is selected, and the reference light in the plurality of wavelength bands is selected. From the wavelength band for exciting the first fluorescent agent and the wavelength for exciting the second fluorescent agent, the wavelength band of the first excitation light and the wavelength of the second excitation light Selecting the reference light in the wavelength band sandwiched between the bands, and generating the first excitation light , the second excitation light, and the reference light in the selected wavelength band. A light source controller to control;
A matrix setting unit for setting a color matrix to be used for the color matrix calculation in the matrix calculation unit based on the drug information;
An endoscope apparatus characterized by comprising: In the case where a wavelength that is easily absorbed by hemoglobin in the subject is selected as the wavelength of the reference light, the matrix setting unit sets the signal amplification factor of the reference light imaging signal as the wavelength of the reference light. The endoscope apparatus according to claim 1, wherein a color matrix that is larger than when a wavelength different from a wavelength that is easily absorbed by hemoglobin in the subject is selected is set in the matrix calculation unit. A display control unit configured to perform control to display information on a color signal assigned to the fluorescence imaging signal and the reference light imaging signal on the display unit according to the color matrix set by the matrix setting unit; The endoscope apparatus according to claim 1, further comprising: A light source unit capable of generating excitation light in a plurality of wavelength bands corresponding to a plurality of types of fluorescent agents having different excitation wavelengths, and further capable of generating reference light in a plurality of wavelength bands for irradiating the subject, Generating the reference light and the excitation light in at least two wavelength bands to irradiate the subject administered with at least two types of the fluorescent agents;
  The imaging unit images fluorescence emitted from the fluorescent agent irradiated with the excitation light to generate a fluorescence imaging signal, and images light from the subject irradiated with the reference light to capture the subject. A reference light imaging signal representing the form of
  A matrix calculation unit performs a color matrix calculation to generate an observation image by assigning different color signals to the fluorescence imaging signal and the reference light imaging signal,
  A light source control unit for controlling the light source unit; and a color matrix calculation for drug information indicating the types of the plurality of types of the fluorescent drugs to be administered to the subject and combination information relating to the combination. Input to the matrix setting section to set the color matrix to be used for
  The light source control unit includes first excitation light in a wavelength band corresponding to a first fluorescent agent of a type indicated by the drug information input from the input unit, among the excitation light in the plurality of wavelength bands. Selecting a second excitation light in a wavelength band corresponding to a second fluorescent agent different from the first fluorescent agent indicated by the agent information input from the input unit, and the plurality of wavelengths A wavelength band different from a wavelength for exciting the first fluorescent agent and a wavelength for exciting the second fluorescent agent, out of the reference light in the band, the wavelength band of the first excitation light and the first A reference light in a wavelength band sandwiched between two excitation light wavelength bands is selected, and the first excitation light, the second excitation light, and the reference light in the selected wavelength band are generated. Controlling the light source unit as
  The matrix setting unit sets a color matrix to be used for the color matrix calculation in the matrix calculation unit based on the drug information input from the input unit.
  An operating method of an endoscope apparatus characterized by the above.

Images