JP4315489B2 - Endoscope device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
[0002]
[Industrial application fields]
The present invention relates to an endoscope apparatus that observes the inside of a body cavity or the like.
[0003]
[Prior art]
In recent years, by inserting a scope into a body cavity, the gastrointestinal tract such as the esophagus, stomach, small intestine, and large intestine, and the trachea such as the lung are observed, and various treatment tools are inserted using the treatment instrument channel as necessary. Endoscopic devices capable of therapeutic treatment are widely used. In particular, an endoscope apparatus using an electronic imaging device such as a charge coupled device (CCD), that is, an electronic endoscope, can display a moving image on a color monitor in real time, and there is little fatigue of an operator who operates the endoscope. Widely used for.
[0004]
As an endoscope monitor, four signals consisting of R, G, B signals indicating the red component, green component, and blue component of the image and a synchronization signal are input, and the R, G, B signals are converted into red, green, and blue signals. It is the mainstream to display on a cathode ray tube in correspondence with the phosphor dots that emit light.
[0005]
Infrared endoscopes, which are electronic endoscopes that enable observation of infrared light using devices that are sensitive to near-infrared light as electronic imaging devices, are a major factor in light absorption in the body. Because it uses near-infrared light that is less absorbed by hemoglobin and water, it is useful for imaging submucosal blood vessels, which is difficult when using visible light. The infrared endoscope apparatus is configured to allow observation while switching between a normal image, that is, a visible image and an infrared image.
[0006]
In observation using an infrared endoscope apparatus, a method of intravenously injecting a drug called indocyanine green (ICG) having an absorption peak in near-infrared light having a wavelength of near 805 nm in blood as a contrast medium has been performed. . By intravenously injecting ICG, the blood vessel portion in the submucosal layer is shaded, and the running state of the blood vessel can be clearly observed as compared with the case where no drug is used.
[0007]
In an infrared endoscope apparatus that has been generally used conventionally, observation is performed at a single wavelength near 805 nm, and only a monochrome, that is, a single-tone infrared image can be obtained.
[0008]
Thus, for example, Japanese Patent Laid-Open No. 6-335451 proposes a color display infrared endoscope apparatus that displays infrared light images in a plurality of wavelength bands by assigning them to different color components of a monitor. In JP-A-6-335451, an image having a wavelength near 900 nm is assigned to the green component of the monitor.
[0009]
[Problems to be solved by the invention]
However, a wavelength near 900 nm is less absorbed by ICG, and an image having a wavelength near 900 nm, which is less absorbed by ICG, is assigned to a green component that greatly affects human contrast, and a wavelength near 805 nm, which is much absorbed by ICG. If the image is assigned to another color, the contrast of the infrared image at the time of ICG administration will deteriorate.
[0010]
The present invention has been made in view of the above circumstances,
An endoscope apparatus capable of observing an infrared image at the time of ICG administration with good contrast is provided.
[0011]
[Means for Solving the Problems]
An endoscope apparatus according to an aspect of the present invention includes: Light source means for selectively irradiating light in the first wavelength band and light in the second wavelength band; imaging means for imaging the subject irradiated by the light source means; Based on a color balance setting instruction means for instructing calculation of a correction coefficient for correcting a color balance of an image picked up by the image pickup means, and a single input instruction to the color balance setting instruction means, the first After selecting the light in the wavelength band, calculating a first color balance correction coefficient for correcting the image in the first wavelength band, and after completing the calculation of the first color balance correction coefficient, the second wavelength Control means for performing control for selecting light in a band and calculating a second color balance correction coefficient for correcting an image in the second wavelength band; It is what has.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
[0013]
(First embodiment)
1 to 20 relate to a first embodiment of the present invention, and FIG. 1 is a block diagram for explaining the overall configuration of an endoscope apparatus.
FIG. 2 is an explanatory diagram illustrating the configuration of an infrared visible switching filter,
FIG. 3 is an explanatory diagram for explaining the light transmission characteristics of the visible light transmission filter and the infrared light transmission filter,
FIG. 4 is an explanatory diagram for explaining the configuration of the RGB rotation filter.
FIG. 5 is an explanatory diagram for explaining the light transmission characteristics of the R filter, the G filter, and the B filter,
FIG. 6 is an explanatory diagram for explaining the configuration of the CCD.
FIG. 7 is an explanatory diagram for explaining the arrangement of the infrared light cut filter,
FIG. 8 is an explanatory diagram for explaining the light transmission characteristics of an infrared light cut filter;
FIG. 9 is a block diagram illustrating the configuration of the color balance correction circuit.
FIG. 10 is a block diagram illustrating the configuration of an image processing circuit.
FIG. 11 is a block diagram illustrating the configuration of the color tone adjustment circuit;
FIG. 12 shows an example of screen display.
FIG. 13 is an explanatory diagram for explaining an internal memory map of the CPU.
FIG. 14 is a flowchart for explaining the flow of filter switching processing.
FIG. 15 is a flowchart for explaining the flow of color balance setting.
FIG. 16 is a flowchart for explaining the flow of color tone setting.
FIG. 17 is a flowchart for explaining the flow of laser irradiation operation;
FIG. 18 is a flowchart for explaining the flow of image recording operation.
FIG. 19 is an explanatory diagram for explaining the transmission characteristics of ICG.
FIG. 20 is an explanatory diagram for explaining visual spatial frequency characteristics.
It is.
[0014]
As shown in FIG. 1, the endoscope apparatus according to the present embodiment is obtained with a light source device 1 that is a light source means for emitting observation light, a scope 2 for insertion into a body cavity, and a scope 2. A processor 3 that performs signal processing of the image signal, a monitor 4 that displays an image, a digital filing device 5 that records a digital image, a photography device 6 that records an image as a photograph, and a laser light source device that generates a treatment laser beam 7 is mainly composed.
[0015]
The light source device 1 includes a lamp 8 such as a xenon lamp that emits light, an infrared visible switching filter 9 that is provided on the illumination optical path of the lamp 8 and restricts a transmission wavelength, a motor 10 for switching the infrared visible switching filter 9, An RGB rotation filter 11, a motor 12 for rotationally driving the RGB rotation filter 11, an illumination light stop 13 for limiting the amount of irradiation light, and the like are provided.
[0016]
The scope 2 includes a light guide fiber 14 that transmits illumination light incident from the light source device 1 to the distal end of the scope 2, a CCD 15 that is an imaging unit that images light from a subject, and a scope determination element that stores information such as the type of the scope 2. 19 etc.
[0017]
Also, an image recording device such as a filter changeover switch 16 for instructing the switching of the infrared / visible changeover filter 9 to a position where a user of an operation unit (not shown) on the proximal side of the scope 2 can easily push it, an image recording device such as the digital filing device 5 and the photography device 6. A release switch 17 for instructing recording on the laser, a laser irradiation switch 18 for instructing irradiation of treatment laser light, and the like are provided.
[0018]
The processor 3 includes two preprocessing circuits 20, two A / D conversion circuits 21, two color balance correction circuits 22, a multiplexer 23, three simultaneous memories 24r, 24g, 24b, an image processing circuit 25, and a color tone adjustment circuit. 26, three D / A conversion circuits 27r, 27g, 27b, an encoding circuit 28, a dimming circuit 29, an exposure time control circuit 30, and a CPU 31 for controlling each part of the processor 3.
[0019]
A color balance setting switch 32, an image processing setting switch 33, and a color tone setting switch 34 are disposed on a front panel (not shown) operated by the operator of the processor 3.
[0020]
The CPU 31 can detect the states of the color balance setting switch 32, the image processing setting switch 33, and the color tone setting switch 34.
[0021]
Further, the CPU 31 can detect the respective states of the filter switch 16, the release switch 17 and the laser irradiation switch 18 of the scope 2, and can read information stored in the scope discriminating element 19. ing.
[0022]
A control signal (not shown) is output from the CPU 31 to each part of the processor 3 so as to control each part of the processor 3. Further, the CPU 31 gives an image recording instruction signal, which is a control signal for instructing image recording to the digital filing device 5 and the photography device 6, and a control signal for the light source device 1 for instructing to switch the filter of the infrared visible switching filter 9. A filter switching instruction signal or the like is output.
[0023]
From the lamp 8 of the light source device 1 shown in FIG. 1, light in a wavelength region including the visible region and the near infrared region is emitted. The light emitted from the lamp 8 passes through the infrared visible switching filter 9, the illumination light stop 13, and the RGB rotation filter 11 and enters the light guide fiber 14 of the scope 2.
[0024]
As shown in FIG. 2, the infrared visible switching filter 9 has two filters, a visible light transmitting filter 35 that transmits visible light and an infrared light transmitting filter 36 that transmits infrared light. By rotating the infrared visible switching filter 9, the filter inserted in the optical path can be switched. As shown in FIG. 3, the visible light transmission filter 35 and the infrared light transmission filter 36 transmit light having a wavelength in the visible region and light having a wavelength in the near infrared region, respectively.
[0025]
The illumination light diaphragm 13 limits the amount of light emitted from the light source device 1 in accordance with the dimming signal output from the dimming circuit 29 of the processor 3 so that the image captured by the CCD 15 does not become saturated. It is for making.
[0026]
As shown in FIG. 4, the RGB rotation filter 11 is provided with three filters such as an R filter 37, a G filter 38, and a B filter 39 that limit the wavelength band of light to be transmitted, and is rotated by the motor 12. Thus, light of different wavelength bands is sequentially transmitted.
[0027]
As shown in FIG. 5, the R filter 37, the G filter 38, and the B filter 39 transmit red, green, and blue light at wavelengths in the visible region, respectively. That is, when the visible light transmission filter 35 is inserted in the optical path, the RGB rotation filter 11 sequentially transmits red, green, and blue light.
[0028]
Further, as shown in FIG. 5, the R filter 37, the G filter 38, and the B filter 39 transmit not only light having a wavelength in the visible region but also light having a wavelength in the infrared region. When the light transmission filter 36 is inserted in the optical path, light in the wavelength bands of 805 ± 15 nm, 805 ± 15 nm, and 930 ± 20 nm are transmitted instead of red, green, and blue.
[0029]
The light incident on the light guide fiber 14 of the scope 2 is applied to the subject such as the digestive tract from the distal end of the scope 2. Light scattered and reflected by the subject enters the CCD 15 at the tip of the scope 2. The CCD 15 is driven in synchronism with the rotation of the RGB rotation filter 11, and image signals corresponding to the irradiation lights of the R filter 37, G filter 38 and B filter 39 are sequentially output to the processor 3.
[0030]
As shown in FIG. 6, the charges accumulated in the CCD 15 are vertically transferred downward from the light receiving area 40, and then the charges of the odd-numbered pixels and the charges of the even-numbered pixels are horizontally transferred through separate paths. The charge detection unit converts the charge into a voltage and outputs the voltage to the processor 3.
[0031]
In this specification, for the sake of convenience, a path through which image signals corresponding to pixels in odd columns of the CCD 15 pass is referred to as an A channel, and a path through which image signals corresponding to pixels in even columns pass through is referred to as a B channel.
[0032]
That is, an A channel image signal and a B channel image signal are output from the CCD 15 to the processor 3.
[0033]
In the light receiving area 40 of the CCD 15, as shown in FIG. 7, infrared light cut filters 42 are arranged in even-numbered columns (shaded portions in FIG. 7) with a width corresponding to the pixel columns of the CCD.
[0034]
As shown in FIG. 8, the infrared light cut filter 42 greatly attenuates light having a wavelength near 810 nm, which is an infrared light component of the treatment laser light, and transmits almost all light in the visible light band. It has become.
[0035]
Accordingly, the A-channel image signal read from the odd-numbered pixels where the infrared light cut filter 42 of the CCD 15 is not disposed can include an infrared light component, and the even-numbered columns where the infrared light cut filter is disposed. The B channel image signal read out from this pixel contains almost no infrared light component of the treatment laser beam.
[0036]
The CCD 15 incorporates a so-called electronic shutter (not shown) that adjusts the charge accumulation time, and adjusts the exposure time of an image obtained by adjusting the time from charge sweep-out to read-out. Can be done.
[0037]
The two image signals of the A channel and the B channel input to the processor 3 are first input to separate preprocess circuits 20, respectively, subjected to processing such as CDS (correlated double sampling), and output.
[0038]
The two systems of image signals output from the A-channel and B-channel preprocess circuits 20 are converted from analog signals to digital signals by separate A / D conversion circuits 21, respectively, and are sent to separate color balance correction circuits 22. Entered.
[0039]
Each color balance correction circuit 22 has the same configuration, and as shown in FIG. 9, color balance correction coefficient storage memories 43r and 43g, which are nonvolatile memories for storing three color balance correction coefficients, respectively. 43b, a selector 44 for selecting a color balance correction coefficient, and a multiplier 45.
[0040]
The selector 44 has the color balance correction coefficient storage memory 43r when the R filter 37 is inserted in the optical path, the color balance correction coefficient storage memory 43g when the G filter 38 is inserted in the optical path, and the B filter 39 has the B filter 39. The color balance correction coefficient storage memory 43b is selected at the timing of insertion into the optical path.
[0041]
The multiplier 45 multiplies the input image signal by the color balance correction coefficient selected by the selector 44 and outputs the result.
[0042]
The color balance correction coefficient calculated by the CPU 31 is written in each color balance correction coefficient storage memory 43r, 43g, 43b.
[0043]
In the color balance correction coefficient storage memories 43r, 43g, and 43b of the A channel color balance correction circuit 22, either the infrared image or the visible image color balance correction coefficient corresponds to the switching of the infrared visible switching filter 9. The color balance correction coefficient for the visible image is always written in the color balance correction coefficient storage memories 43r, 43g, and 43b of the B channel color balance correction circuit 22. Yes.
[0044]
The image signal output from each color balance correction circuit 22 is taken out of the A channel and B channel image signals alternately by the multiplexer 23 in the normal state (when the laser beam is irradiated and when the visible light is observed). The images at the timing when the R filter 37, the G filter 38, and the B filter 39 are inserted into the optical path are returned to the arrangement of the pixels on the light receiving area 40, and are distributed and stored in the synchronization memories 24r, 24g, and 24b, respectively.
[0045]
During infrared light observation, the multiplexer 23 always reads the output signal from the color balance correction circuit 22 of the A channel, and the image signal corresponding to the pixels in the even columns on the light receiving area 40 of the CCD 15 is A corresponding to the same pixel. The image signal of the pixel of the channel is read out twice and is interpolated and stored in the synchronization memories 24r, 24g, and 24b.
[0046]
At the time of laser light irradiation, an output signal from the color balance correction circuit 22 for the B channel is always read, and for image signals corresponding to odd-numbered pixels on the light receiving area 40 of the CCD 15, an image of the B channel pixels corresponding to the same pixel is used. The signals are read out twice and interpolated and stored in the synchronization memories 24r, 24g, and 24b.
[0047]
The images stored in each of the synchronization memories 24r, 24g, and 24b are read out at the same time, so that the R filter 37, the G filter 38, and the B filter 39 are sequentially inserted into the optical path. Is done.
[0048]
An output signal from the A channel color balance correction circuit 22 is input to the light control circuit 29.
[0049]
The dimming circuit 29 creates a dimming signal for keeping the brightness of the obtained image approximately constant according to the magnitude of the input image signal. The dimming signal controls the illumination light stop 13 of the light source device 1 to adjust the amount of light emitted from the light source device 1.
[0050]
The dimming circuit 29 is controlled by a control signal (not shown) from the CPU 31 and opens the illumination light diaphragm 13 during treatment laser irradiation as will be described later.
[0051]
An output signal from the B channel color balance correction circuit 22 is input to the exposure time control circuit 30.
[0052]
The exposure time control circuit 30 outputs an electronic shutter control signal for controlling the exposure time of the electronic shutter of the CCD 15 according to the magnitude of the input image signal in order to keep the brightness of the obtained image approximately constant. It is like that.
[0053]
The exposure time control circuit 30 is controlled by a control signal (not shown) from the CPU 31 and controls the exposure time so that the exposure time is maximized except during treatment laser irradiation as will be described later.
[0054]
As shown in FIG. 10, the image processing circuit 25 includes a dye amount calculation circuit 46, an enhancement coefficient calculation circuit 47, a delay circuit 48 that adjusts the timing of an image signal, a dye enhancement circuit 49 that performs color enhancement, a structure enhancement circuit 50, A graph creation circuit 51 for creating a graph of the amount of dye to be displayed on the monitor 4 and an image composition circuit 52 are configured.
[0055]
The image processing circuit 25 receives image signals synchronized by the synchronization memories 24r, 24g, and 24b.
[0056]
In this specification, for the sake of convenience, the three signals constituting the image signal at each point in the path from the synchronization memories 24r, 24g, 24b to the monitor 4 are referred to as a signal R, a signal G, and a signal B. In the case of a visible image, the signals R, G, and B mean a red component signal, a green component signal, and a blue component signal, respectively. In the case of a visible image, signals transmitted through respective cables that transmit signals R, G, and B are also referred to as signals R, G, and B for convenience in the case of an infrared image. In addition, the frame sequential images are also referred to as signals R, G, and B for convenience.
[0057]
The image processing circuit 25 calculates a dye amount in a dye amount calculation circuit 46 based on the input image signal.
[0058]
In the dye amount calculation circuit 46, in accordance with the infrared visible switching signal from the CPU 31, a dye amount indicating a hemoglobin amount for a visible image (hereinafter simply referred to as a hemoglobin amount) and an ICG amount for an infrared image Is calculated for each pixel (hereinafter simply referred to as ICG amount).
[0059]
Assuming that the magnitudes of the signals R, G, and B of the image signal input to the dye amount calculation circuit 46 are Rin, Gin, and Bin, the equation for obtaining the hemoglobin amount IHb is as follows:
IHb = log (Rin / Gin)
The equation for obtaining the ICG amount IIcg is
IIcg = log (Bin / Rin)
It is represented by
[0060]
In addition to the dye amount such as the hemoglobin amount and the ICG amount for each pixel, the dye amount calculation circuit 46 also outputs an average dye amount that is an average value of the dye amount for one frame of the image.
[0061]
The pigment amount and the average pigment amount calculated by the pigment amount calculation circuit 46 are input to the enhancement coefficient calculation circuit 47, and an enhancement coefficient based on the difference between the pigment amount and the average pigment amount is calculated for each pixel. In the case of a visible image, the enhancement coefficient α for each pixel is
α = IHb−Ave (IHb)
In the case of an infrared image, the emphasis coefficient α is similarly expressed by IIcg instead of IHb in the above formula. Here, Ave (IHb) indicates an average value for one frame of an IHb image.
[0062]
The dye enhancement circuit 49 receives the image signal whose timing is adjusted through the delay circuit 48, the enhancement coefficient α, and the dye enhancement level designated by the CPU 31, and performs color enhancement based on the amount of dye for each pixel.
[0063]
The relational expression between the input signal and the output signal of the dye enhancement circuit 49 is
Rout = Rin × exp (h × kR × α)
Gout = Gin × exp (h × kG × α)
Bout = Bin × exp (h × kB × α)
It is represented by However, Rin, Gin, and Bin are the magnitudes of the signals R, G, and B of the image signal input to the dye enhancement circuit 49, and Rout, Gout, and Bout are the image signals output from the dye enhancement circuit 49. The magnitude of each of the signals R, G, and B. Further, kR, kG, and kB are coefficients determined by the absorption rate for each color of the target dye, and these values are different for the visible image and the infrared image. The values of kR, kG, and kB are switched between a visible image value and an infrared image value in accordance with an infrared / visible switching signal from the CPU 31. H is a coefficient representing the degree of enhancement, and is determined by the dye enhancement level set by the CPU 31. Α is an enhancement coefficient.
[0064]
By performing color enhancement with the dye enhancement circuit 49, an image is formed in which the apparent hemoglobin amount IHb is increased during enhancement based on the hemoglobin amount IHb, and the apparent ICG amount IIcg is increased during enhancement based on the ICG amount IIcg. An image like this is formed.
[0065]
Further, by emphasizing the image signal with the enhancement coefficient α, which is the difference between the pigment amount calculated by the enhancement factor calculation circuit 47 and the average pigment amount, it is possible to effectively enhance even an image with a biased color distribution. It has become.
[0066]
The image signal output from the dye enhancement circuit 49 is enhanced by a spatial filter so as to enhance a fine pattern on the biological mucous membrane by the structure enhancement circuit 50. The strength of structure enhancement in the structure enhancement circuit 50 is determined by the structure enhancement level output from the CPU 31.
[0067]
The average dye amount calculated by the dye amount calculating circuit 46 is also input to the graph creating circuit 51. The graph creation circuit 51 refers to the infrared / visible switching signal from the CPU 31 to determine whether the input pigment amount is the hemoglobin amount IHb or the ICG amount IIcg, the horizontal axis represents time, and the vertical axis represents An image signal displaying a graph with the average dye amount being input at that time is output.
[0068]
The image composition circuit 52 superimposes the image signal output from the graph creation circuit 51 on the image signal output from the structure enhancement circuit 50 and outputs the image signal. The output signal of the image composition circuit 52 becomes the output signal of the image processing circuit 25.
[0069]
As shown in FIG. 11, the color tone adjustment circuit 26 includes three color tone adjustment coefficient storage memories 53r, 53g, 53b, which are nonvolatile memories for storing color tone adjustment coefficients, and three multipliers 54r, 54g, 54b, 3 It consists of two gamma correction circuits 55r, 55g and 55b.
[0070]
An output signal from the image processing circuit 25 is input to the color tone adjustment circuit 26.
[0071]
The CPU 31 writes color tone adjustment coefficients corresponding to the signals R, G, and B of the input image signal of the color tone adjustment circuit 26 in the color tone adjustment coefficient storage memories 53r, 53g, and 53b.
[0072]
The signals R, G, and B of the input image signal are respectively multiplied by the tone adjustment coefficients stored in the tone adjustment coefficient storage memories 53r, 53g, and 53b by the multipliers 54r, 54g, and 54b, respectively, and the tone set by the user is set. Is converted to
[0073]
The signals output from the multipliers 54r, 54g, and 54b are output after being subjected to gamma correction, that is, conversion for correcting the gamma characteristic of the monitor 4, by the gamma correction circuits 55r, 55g, and 55b, respectively.
[0074]
Image signals R, G, and B output from the color tone adjustment circuit 26 are converted into analog signals by the D / A conversion circuits 27r, 27g, and 27b, respectively, and output to the monitor 4, and the subject image is output to the monitor 4. Is displayed. Further, the image signal encoded by the encoding circuit 28 is sent to the digital filing device 5 and the photography device 6, and an image is recorded in each device in accordance with an image recording instruction signal from the CPU 31.
[0075]
FIG. 12 is an example of the screen display of the monitor 4 when an infrared image is displayed. An infrared image is displayed in an octagon on the right side of the screen, and a character string “IR Observation” is displayed in the lower right side of the screen indicating that the image being displayed is an infrared image. Also, a graph with the horizontal axis representing time and the vertical axis representing the ICG amount (average dye amount) is displayed at the lower left of the image. With this graph, the time change of the ICG amount can be known quantitatively, and the degree of decrease in the ICG amount with respect to the elapsed time after ICG administration can be quantitatively known. ICG is selectively taken up by the liver when injected intravenously, and the state of liver function can be known from the uptake speed. Therefore, the liver function can be checked by quantitatively knowing how the ICG amount decreases with respect to the elapsed time.
[0076]
The CPU 31 has a non-volatile memory area inside and stores setting values such as various coefficients used in the color balance correction circuit 22, the image processing circuit 25, and the color tone adjustment circuit 26.
[0077]
FIG. 13 is a part of the internal memory map of the CPU 31.
[0078]
The color balance correction coefficient is stored when the user sets the color balance according to the procedure described later.
[0079]
The dye enhancement level, the structure enhancement level, and the color tone adjustment level are updated each time the user changes the setting value (setting level) by operating the front panel.
[0080]
The color adjustment coefficient is a value stored in the CPU 31 in advance, and when the user changes the color adjustment level, the color adjustment coefficient corresponding to the set level is output to the color adjustment circuit 26.
[0081]
As described above, the internal memory of the CPU 31 serves as a storage unit for the color balance correction amount, the color tone adjustment value, and the image processing setting value.
[0082]
Further, the CPU 31 outputs an instruction signal for switching filters and setting various setting values during the vertical blanking period so as not to disturb the image. Further, the CPU 31 can determine whether or not the connected scope is an infrared scope by reading information stored in the scope determining element 19 incorporated in the scope 2. The infrared scope described here is one in which an infrared cut filter 42 is partially disposed in front of the light receiving surface 40 of the CCD 15 as shown in FIG. The scope that does not support infrared is a scope that is not suitable for infrared light observation because an infrared cut filter is disposed on the entire light receiving surface of the CCD.
[0083]
When the filter switch 16 is pressed, a filter switch request signal is sent. When detecting the filter switching request signal, the CPU 31 executes processing according to the flowchart shown in FIG. Reference numerals S1 to S11 are reference numerals assigned to the processing steps.
[0084]
First, in step S1, it is determined whether or not the currently connected scope 2 is an infrared scope. If the scope 2 is a scope that does not support infrared, the process ends without doing anything.
[0085]
In step S1, if the currently connected scope 2 is an infrared scope, as shown in step S2, a filter switching instruction signal is sent to the light source device 1, and the visible light transmission filter 35 transmits the infrared light transmission filter. 36, or the infrared light transmission filter 36 is switched to the visible light transmission filter 35.
[0086]
Next, in step S3, it is determined whether the filter inserted in the optical path at this time is the infrared light transmission filter 36 or the visible light transmission filter 35. As shown in S4, the infrared color balance correction coefficient is written into the color balance correction coefficient storage memory 43 of the A channel color balance correction circuit 22, and as shown in step S5, the infrared image enhancement level ( Dye enhancement level and structure enhancement level) and an infrared visible switching signal, and as shown in step S6, the infrared color tone adjustment coefficient is written in the color tone adjustment coefficient storage memory 54. As shown in step S7, the multiplexer 23 constantly The A channel signal is selected and the process is terminated.
[0087]
Since the A channel signal is a pixel signal that transmits infrared light, an infrared image of the subject can be captured well. However, since the signals of the same pixel are arranged for two pixels in the horizontal direction, the resolution in the horizontal direction is deteriorated as compared with a normal image.
[0088]
If it is determined in step S3 that the visible light transmission filter 35 is inserted in the optical path, the color balance correction coefficient for visible light is stored in the color balance correction coefficient storage memory 43 for the A channel as shown in step S8. As shown in step S9, the visible image enhancement level and the infrared visible switching signal are sent to the image processing circuit 25, and the visible color adjustment coefficient is written in the color adjustment coefficient storage memory 54 as shown in step S10. As shown in step S11, the multiplexer 23 is set so that the A channel signal and the B channel signal are alternately input for each pixel, and the processing is terminated.
[0089]
By this filter switching process, the CPU 31 reads various setting values from the internal memory and switches them according to the switching between the visible light transmission filter 35 and the infrared light transmission filter 36, so that the user can select the desired value without requiring any troublesome operations. It is possible to observe with the image.
[0090]
Further, by switching the multiplexer 23, a high-resolution image using all the pixels of the CCD is obtained during visible light observation, and a bright infrared image using pixels where the infrared light cut filter 42 is not arranged during infrared observation. Is obtained.
[0091]
When setting the color balance, the user presses the color balance setting switch 32 arranged on the front panel of the processor 3 in a state where the reference color object is imaged. The reference color object here is an object that has a reflectance defined at a near-infrared wavelength of visible light to about 1000 nm and serves as a color reference. When the color balance setting switch 32 is pressed, a color balance setting request signal is sent to the CPU 31. When the color balance setting request signal is sent, the CPU 31 performs processing according to the flowchart shown in FIG. Reference numerals S12 to S21 are reference numerals assigned to the processing steps.
[0092]
First, in step S12, if the infrared light transmission filter 36 is inserted in the optical path, as shown in step S13, filter switching processing (FIG. 14 The visible light transmission filter 35 is inserted into the optical path.
[0093]
Next, as shown in step S14, the CPU 31 takes in the visible image signals of the A channel and the B channel after A / D conversion.
[0094]
Next, as shown in step S15, the ratio of the brightness of each image of the signals R, G, and B of the A channel and the B channel is set to a predetermined value, and the A channel and the B channel are amplified. Visible color balance correction coefficients for the A channel and B channel are calculated so as to correct the variation such as the rate, and are stored in the internal memory of the CPU 31.
[0095]
Next, as shown in step S16, the color balance correction coefficient calculated in step 15 is stored in the color balance correction coefficient storage memories 43r, 43g, and 43b.
[0096]
Next, in step S17, the connected scope 2 is determined, and if the scope 2 is not an infrared scope, the process ends.
[0097]
In step S17, when the connected scope 2 is an infrared scope, first, as shown in step S18, filter switching processing (see FIG. 14) is performed, and the filter inserted into the optical path is changed to infrared. Switch to the light transmission filter 36.
[0098]
Next, as shown in step S19, the infrared image of the A channel is taken into the CPU 31.
[0099]
Next, as shown in step S20, the brightness ratio of each infrared image captured at the timing when each of the R filter 37, the G filter 38, and the B filter 39 is inserted into the optical path is set to a predetermined value. The A channel infrared color balance correction coefficient is calculated and stored in the internal memory of the CPU 31.
[0100]
Next, as shown in step S21, filter switching processing (see FIG. 14) is performed to switch to a visible image.
[0101]
In this manner, the color balance correction setting for visible light and the color balance correction setting for infrared can be easily performed by simply pressing the color balance setting switch 32.
[0102]
When the user changes the color tone level by using the color tone setting switch 34, a color tone setting request signal is sent to the CPU 31. The color tone setting request signal includes information on which level of the signals R, G, and B is set. When detecting the color tone setting request signal, the CPU 31 executes processing according to the flowchart shown in FIG. Reference numerals S22 to S26 are reference numerals given to the processing steps.
[0103]
First, if the infrared light transmission filter 36 is inserted in the optical path in step S22, the changed set value is stored in the internal memory of the CPU 31 as an infrared color tone adjustment level as shown in step S23. As shown in step S24, the tone adjustment coefficients for the respective colors of the signals R, G, B corresponding to the changed levels are stored in the tone adjustment coefficient storage memories 53r, 53, g, 53b, respectively, and the process is terminated. .
[0104]
If the visible light transmission filter 35 is inserted in the optical path in step S22, the input set value is stored in the internal memory of the CPU 31 as a visible light color adjustment level as shown in step S25. As shown in step S26, the tone adjustment coefficients for the respective colors of the signals R, G, B corresponding to the changed levels are stored in the tone adjustment coefficient storage memories 53r, 53g, 53b, respectively, and the process is terminated.
[0105]
In this way, the color tone setting switch 34 serves as both a visible image switch and an infrared image switch with one switch, and changes the color tone adjustment level corresponding to the filter inserted at that time.
[0106]
When the user changes the setting value (image enhancement level) of the image processing by the image processing setting switch 33, an image processing setting request signal is sent to the CPU 31. When the image processing setting request signal is sent to the CPU 31, the changed infrared or visible image enhancement level (pigment enhancement level, structure enhancement level) is stored in the internal memory of the CPU 31 in the same manner as when changing the tone level. The stored enhancement level is sent to the image processing circuit. As described above, the image processing setting switch 33 also serves as a switch for visible image and infrared image with one switch, and changes the image enhancement level corresponding to the filter inserted at that time.
[0107]
When the laser irradiation switch 18 is pressed, a laser irradiation request signal is sent to the CPU 31. When detecting the laser irradiation request signal, the CPU 31 executes processing according to the flowchart shown in FIG. Reference numerals S27 to S37 are reference numerals given to the processing steps.
[0108]
First, in step S27, it is determined whether the filter inserted in the optical path is the visible light transmission filter 35 or the infrared light transmission filter 36. If the filter is the infrared transmission filter 36, as shown in step S38. Then, a warning message is displayed on the monitor 4 and the process is terminated.
[0109]
This is because when the laser is irradiated while performing infrared observation, halation occurs in the image and the operability is hindered.
[0110]
If the visible light transmission filter 35 is inserted in the optical path in step S27, it is determined in step S28 whether or not the connected scope 2 is an infrared scope.
[0111]
If the scope 2 is not an infrared scope in step S28, the process proceeds to step 32 for starting laser light irradiation without performing the processing shown in steps S29 to 31.
[0112]
If the scope 2 is an infrared scope in step S28, a B channel signal is input to the multiplexer 23 as shown in step S29, and a control signal (not shown) is dimmed as shown in step S30. The light is sent to the circuit 29, the illumination light diaphragm 13 is opened, and the maximum light quantity is always emitted from the light source device 3, and a control signal (not shown) is sent to the exposure time control circuit 30 as shown in step S31. To obtain an image with moderate brightness.
[0113]
Next, as shown in step S32, a laser irradiation start instruction signal for instructing laser irradiation is sent to the laser light source device 7, and the laser light source device 7 starts laser light irradiation.
[0114]
Next, as shown in step S33, the process waits until the laser irradiation switch 18 is released.
[0115]
In step S33, when the laser irradiation switch 18 is released, as shown in step S34, a laser beam irradiation stop instruction signal is sent to the laser light source device 7 to stop the laser beam irradiation. Stop irradiation.
[0116]
Next, as shown in step S35, the CPU 31 starts dimming by the dimming circuit 29, and as shown in step S36, the exposure time control circuit 3O sends a control signal so that the maximum exposure time is reached.
[0117]
Next, as shown in step S37, the input by the multiplexer 23 is controlled to be an A channel and B channel alternate input, and the process is terminated.
[0118]
In this way, by combining light control and electronic shutter, when laser light is not irradiated, the exposure time can be maximized to minimize the amount of light from the light source device, thereby reducing the influence on the living body. At the time of light irradiation, by controlling the brightness with the electronic shutter with the light quantity of the light source device being maximized, the influence of the laser light on the image is relatively reduced, and halation can be suppressed.
[0119]
Further, by switching the multiplexer 23, when the laser beam is not irradiated, a high resolution image using all the pixels of the CCD is obtained, and when the laser beam is irradiated, a laser using the pixel in which the infrared light cut filter 42 is disposed. An image with little halation due to light can be obtained.
[0120]
When the release switch 17 is pressed, an image recording request signal is sent to the CPU 31. When the CPU 31 detects the image recording request signal, it executes processing according to the flowchart shown in FIG. Reference numerals S39 to S43 are reference numerals given to the processing steps.
[0121]
First, as shown in step S39, an image recording instruction signal is sent to each image recording device, that is, the digital filing device 5 and the photography device 6.
[0122]
Thereby, each image recording apparatus records an image according to the instruction of the image recording instruction signal.
[0123]
Further, the digital filing device 5 communicates with the processor 3 to receive information such as patient data, the type of scope, the type of filter inserted, the setting value of image processing and tone adjustment, and the like as image header information. Record with.
[0124]
Next, in step S40, it is determined whether or not the connected scope 2 is an infrared scope. If it is not an infrared scope, the process ends.
[0125]
In step S40, when the scope 2 is an infrared scope, filter switching processing (see FIG. 14) is performed as shown in step 41, and an image recording instruction signal is sent again to each image recording apparatus as shown in step S42. As shown in step S43, the filter switching process is performed again to return to the original filter, and the process ends.
[0126]
By such processing, the user can record both the visible image and the infrared image only by pressing the release switch 17 once.
[0127]
In the present embodiment, a wavelength of 805 nm is displayed as a red component and a green component, and a wavelength of 930 nm is displayed as a blue component on the monitor 4 at the time of infrared light observation.
The transmission characteristics of ICG are as shown in the graph of FIG. In this graph, the horizontal axis represents wavelength and the vertical axis represents transmittance. In this graph, the curve indicated as “ICG” is the characteristic of ICG, the curve indicated as “HS” is the characteristic of human serous fluid, and is indicated as “ICG + HS”. The curves are the synthesized characteristics of ICG and human serum.
[0128]
In this graph, the curve labeled “ICG” has the lowest transmittance at a wavelength slightly shorter than 800 nm, and shows that light absorption by ICG alone is large at this wavelength.
[0129]
ICG alone has the lowest transmittance at a wavelength slightly shorter than 800 nm, but ICG administered into the living body seems to be a curve marked as “ICG + HS” due to the effect of binding with protein, etc. In addition, the wavelength at which the transmittance is lowest shifts slightly to the longer wavelength side, and the effective maximum absorption wavelength of ICG at wavelengths in the visible region or near infrared region is around 805 nm.
[0130]
Further, at a wavelength near 930 nm, as shown in the graph of FIG. 19, light absorption by ICG is small.
[0131]
Therefore, when ICG is intravenously injected into the subject, an image with a wavelength of 805 nm is absorbed by the ICG, and the blood vessel portion becomes dark, resulting in a high contrast image. In addition, an image with a wavelength of 930 nm is an image with low contrast because light is not absorbed so much by ICG and the blood vessel portion is not so dark.
[0132]
Since the wavelength of 805 nm is assigned to the green component and the red component of the monitor 4 and the wavelength of 930 nm is assigned to the blue component of the monitor 4, an image in which the blood vessel part is stained blue is observed on the monitor 4. It is like that.
[0133]
Here, assigning an image of 805 nm to the green component and the red component of the monitor 4 is important for obtaining an image with a high contrast feeling. This is due to human visual characteristics.
[0134]
FIG. 20 is a graph showing visual spatial frequency characteristics, where the horizontal axis represents spatial frequency and the vertical axis represents relative contrast sensitivity. In the figure, the curve indicated by “(y−b)” indicates the relative contrast sensitivity with respect to the striped pattern caused by the color difference between yellow and blue, and the curve indicated by “(r−g)” indicates the red color. The relative contrast sensitivity with respect to the striped pattern generated by the color difference between green and green, the curve indicated by “Br (brightness)” indicates the relative contrast sensitivity known to the striped pattern generated by the light and darkness.
[0135]
From this graph, it can be seen that a higher spatial frequency can be recognized when there is light and dark than when only a change in hue. That is, the human eye cannot see a fine structure only by a change in hue, and in order to see a fine thing such as a blood vessel structure, a change in luminance is necessary in the image.
Of the red, green, and blue components, the effect on luminance is greatest for the green component and smallest for the blue component.
[0136]
Therefore, in order to display a fine structure with good contrast on the monitor 4 which is a color monitor, it is effective to assign an image having a wavelength with much light absorption by the target dye, that is, ICG, to the green component of the monitor 4.
[0137]
Further, when an image of a target dye, that is, an image having a wavelength that absorbs a lot of light by ICG, is also assigned to the red component of the monitor 4, a color component such as a blue component is left at a location where the light is absorbed by the ICG, and the contrast is high. An image can be obtained.
[0138]
A normal endoscopic image, that is, a visible image, can observe a relatively fine part of the blood vessel with high contrast, because the hemoglobin that is a pigment in the living body absorbs a lot of light of blue and green wavelengths. This is because the change in luminance of the obtained image is relatively large.
[0139]
The characteristics of ICG are as shown in FIG. 19, but the ICG derivative-labeled antibody also exhibits a light absorption characteristic similar to ICG. Therefore, by observing the subject on which the ICG derivative-labeled antibody has been dispersed in advance with infrared light, the lesion part where the ICG derivative-labeled antibody is accumulated is recognized as a blue stained part on the monitor 4 in the same manner as when ICG is administered. Can do.
[0140]
In this embodiment, paying attention to the light absorption characteristics of ICG or ICG derivative-labeled antibody, light having a wavelength near 805 nm, which is the maximum absorption peak in the body of ICG or ICG derivative-labeled antibody, and a relatively low absorption rate of 930 nm The presence location of ICG or ICG derivative-labeled antibody, which is observed using light having a wavelength of 1, can be effectively observed by looking at the color of the endoscopic image. Therefore, it is not necessary to use an expensive high-sensitivity element, and the accumulation of ICG or ICG derivative-labeled antibody can be confirmed and the presence or absence of a lesion can be confirmed at a reduced cost.
[0141]
In this embodiment, the present invention is applied to a field sequential endoscope apparatus. However, by providing infrared transmission characteristics to a mosaic filter of a simultaneous endoscope apparatus, the same as in this embodiment is applied. An effect can also be obtained.
[0142]
In addition, the technology to change various setting values according to filter switching is not limited to switching between infrared light and visible light, but can be applied to switching light including infrared light, visible light, ultraviolet light, fluorescence, etc. Alternatively, it may be applied to switching between a plurality of types of visible light having different characteristics.
[0143]
Further, when the filter is switched, in order to recognize the type of filter currently inserted in the optical path, it may be automatically recognized from the image quality of the image whether it is an infrared image or a visible image.
[0144]
Instead of the color tone adjustment circuit 26, the CPU 31 multiplies the color balance correction coefficient and the color tone adjustment coefficient, and stores the product in the color balance correction coefficient storage memory. Adjustment may also be used to reduce costs.
[0145]
Further, in the dye amount calculation circuit 46 of the image processing circuit 25, the luminance value of the image is obtained instead of the ICG amount when the infrared light transmission filter 36 is inserted, and the contrast is increased by the dye enhancement circuit 49 based on the average luminance value of the image. By performing the conversion, the contrast of the infrared image may be adjusted and observed.
[0146]
Further, the image processing circuit 25 is not limited to the one incorporated in the processor 3 as in the present embodiment, and may be an external device. In this case, the image signal and the control signal may be sent via a cable. .
[0147]
In addition, it is convenient that the graph representing the pigment amount can be set so that the user can display or not.
[0148]
Further, a luminance signal and a color signal may be created from the signals R, G, and B in the middle of the processing, and the image signal may be output from the processor 3 as a composite signal and input to the monitor 4.
[0149]
The monitor 4 to be displayed is not limited to a cathode ray tube type, and a plasma display or a liquid crystal display may be used.
[0150]
In addition, communication is performed between the CPU 31 of the processor 3 and the light source device 1 to determine whether or not the light source is compatible with infrared observation, and branch processing similar to the infrared scrub determination in the present embodiment is performed. You may go.
[0151]
Further, a filter changeover switch 16 is provided on the front panel of the light source device 1, and communication between the light source device 1 and the CPU 31 of the processor 3 is performed to make a filter change request and perform the same processing as in the present embodiment. May be.
[0152]
In addition, the antibody of the ICG derivative-labeled antibody is not limited to a cancer target such as CEA antibody, and for example, an antibody targeting Helicobacter pylori may be used to diagnose the presence of Helicobacter pylori.
[0153]
The effects of the present embodiment described above are listed below.
[0154]
A light source device 1 having a lamp 8 as light source means for emitting light in a first wavelength band including a wavelength of 805 nm and light in a second wavelength band including a wavelength of 930 nm not including a wavelength of 805 nm;
A CCD 15 which is an image pickup means for picking up an image of a first wavelength band, that is, a wavelength band including 805 nm, and an image of a second wavelength band, that is, a wavelength band including 930 nm, of the subject irradiated with light emitted from the light source means; ,
An image of the first wavelength band, that is, a wavelength band including 805 nm, captured by the imaging unit is displayed as a green component, and an image of the second wavelength band, that is, a wavelength band including 930 nm, is displayed as at least a red component or a blue component. A monitor 4 which is a display means connected to the processor 3 which performs signal processing so as to display as one color component;
By having
An image in a wavelength band including a wavelength of 805 nm, which has a lot of absorption by ICG, is assigned to a green component having a large influence on human contrast, and an infrared image at the time of ICG administration can be observed with good contrast.
[0155]
Further, since the display means for displaying the image in the wavelength band including 930 nm as the red component or the blue component of the display means is provided, it is possible to clearly distinguish the high ICG density portion and the low ICG density portion by color.
[0156]
Further, since the display means for displaying the image of the wavelength band including 805 nm on both the green component and the red component of the display means is provided, the contrast of the displayed image is greatly increased.
[0157]
Further, color balance correction is different between an image captured using the visible light transmission filter 35 serving as the first wavelength limiting unit and an image captured using the infrared light transmission filter 36 serving as the second wavelength limiting unit. Since the color balance is corrected using the coefficients, the color balance is appropriately corrected when either wavelength limiting unit is used.
[0158]
Two color balances for the visible light transmission filter 35 that is the first wavelength limiting means and the infrared light transmission filter 36 that is the second wavelength limiting means, with one instruction from the color balance setting instruction means. Since the correction amount is obtained, the color balance can be easily set.
[0159]
In addition, a color tone adjustment coefficient different between an image captured using the visible light transmission filter 35 serving as the first wavelength limiting unit and an image captured using the infrared light transmission filter 36 serving as the second wavelength limiting unit. Since the color tone is adjusted using the color tone, the color tone is appropriately adjusted regardless of which wavelength limiting means is used.
[0160]
Also, different set values are used for an image captured using the visible light transmission filter 35 serving as the first wavelength limiting unit and an image captured using the infrared light transmission filter 36 serving as the second wavelength limiting unit. Since the image processing is performed by using either of the wavelength limiting means, the image processing is appropriately performed.
[0161]
In addition, an image picked up using the visible light transmission filter 35 serving as the first wavelength limiting means and the infrared light transmission filter 36 serving as the second wavelength limiting means in response to a single instruction from the image recording instruction means. Since both of the images picked up using the recording are recorded, both images when using the respective wavelength limiting means can be recorded by a simple operation.
[0162]
In addition, since the dye amount calculation circuit 46 for obtaining the dye amount of the subject is provided and the time change of the calculated dye amount is displayed, the change in the dye amount can be notified quantitatively.
[0163]
In addition, since the infrared light cut filter 42 which is a wavelength limiting means for partially removing the laser light is provided by partially covering the light receiving area 40 which is the light receiving surface of the CCD 15 which is the image pickup means, it is affected by the treatment laser light. An image with little halation is created.
[0164]
Since the light amount of the light source is increased in accordance with the irradiation instruction of the treatment laser light to the subject and the exposure time of the CCD 15 as the imaging means is shortened, the influence of the treatment laser light on the image is reduced.
[0165]
Wavelength limiting means for guiding light having a wavelength including 805 nm, which is the wavelength of a substantial absorption peak of a drug such as ICG. For example, wavelength limiting means for guiding light having a wavelength including 930 nm not including G filter 38 and 805 nm. For example, since the B filter 39 is provided, the accumulation degree of the medicine such as ICG can be easily known from the obtained image.
[0166]
(Second Embodiment)
21 to 22 relate to the second embodiment of the present invention, FIG. 21 is an explanatory diagram for explaining the light transmission characteristics of the R filter, the G filter, and the B filter, and FIG. 22 is a visible infrared switching filter and RGB rotation. It is explanatory drawing explaining the relationship between the state of a filter, and the synchronous memory which operate | moves.
[0167]
Note that the configuration and operation of parts not described in this embodiment are the same as the configuration and operation of parts described in the first embodiment.
[0168]
The R filter 37, the G filter 38, and the B filter 39 of the present embodiment have transmission characteristics indicated by curves indicated as “R”, “G”, and “B” in FIG.
[0169]
The light transmission characteristics when the visible light transmission filter 35 is combined with the R filter 37, the G filter 38, and the B filter 39 according to the present embodiment are the same as those of the first embodiment, but the infrared light transmission is performed. When the filter 36 is combined, the R filter 37 transmits a wavelength of 805 ± 15 nm and the G filter 38 transmits a wavelength of 930 ± 20 nm.
[0170]
FIG. 22 shows a correspondence relationship between which of the three simultaneous memories 24r, 24g, and 24b is to store the image signal in synchronization with the switching of the infrared visible switching filter 9 and the rotation of the RGB rotation filter 11. Is shown.
[0171]
In the multiplexer 23, when the visible light transmission filter 35 is inserted, the image when the R filter 37 is inserted is simultaneously stored in the synchronization memory 24r and the image when the G filter 38 is inserted is simultaneously inserted as in the first embodiment. The image when the B filter 39 is inserted is stored in the synchronization memory 24b. However, when the infrared light transmission filter 36 is inserted, the image when the R filter 37 is inserted is stored in the synchronization memory 24r and the synchronization memory 24g, and the image when the G filter 38 is inserted is stored in the synchronization memory 24b. To do.
[0172]
Since the infrared image obtained in the present embodiment also has the same color tone as in the first embodiment, a wavelength of 805 nm is displayed as the red component and green component of the monitor 4, and a wavelength of 930 nm is displayed as the blue component. Therefore, as in the first embodiment, the present embodiment can provide the same effects as the first embodiment, such as being able to observe ICG and ICG derivative-labeled antibodies with good contrast.
[0173]
In addition, since the R filter 37, G filter 38, and B filter 29 used in the present embodiment have a relatively small number of rising edges and falling edges, the types of interference films deposited on the filter can be reduced. A filter can be created at low cost.
[0174]
(Third embodiment)
FIGS. 23 to 26 relate to the third embodiment of the present invention, FIG. 23 shows the light transmission characteristics of the visible light transmission filter and the infrared light transmission filter, and FIG. 24 shows the light transmission characteristics of the R filter, the G filter, and the B filter. FIG. 25 is a block diagram for explaining the configuration of the expansion multiplexer, and FIG. 26 is an explanatory diagram for explaining the light absorption property of hemoglobin.
Note that the configuration and operation of parts not described in this embodiment are the same as the configuration and operation of parts described in the first embodiment.
[0175]
The infrared visible switching filter 9 of the present embodiment has the transmission characteristics shown in FIG. 23, and the infrared light transmission filter 36 transmits not only infrared light but also light in a wavelength region corresponding to blue of visible light. To do.
The RGB rotation filter 11 exhibits the transmission characteristics shown in FIG. 24, and the B filter 39 does not transmit at least a wavelength of 1000 nm or less of the near infrared light. Further, an expansion multiplexer 56 shown in FIG. 25 is arranged between the synchronization memories 24r, 24g, 24b and the image processing circuit 25 according to the first embodiment.
[0176]
In this embodiment, the transmission characteristics when the R filter 37, the G filter 38, and the B filter 39 are combined with the visible light transmission filter 35 are the same as those in the first embodiment, but the infrared light transmission filter When combined with 36, the R filter 37 transmits the wavelength region of 805 ± 15 nm, the G filter 38 transmits the wavelength region of 930 ± 20 nm, and the B filter 39 transmits the blue wavelength region of visible light.
[0177]
The average value calculation circuit 57 of the expansion multiplexer 56 calculates the average value of the image signal when the R filter 37 and the B filter 39 are inserted for each pixel. The two selectors 58 and 59 are switched in synchronization with switching of the infrared / visible switching filter 9 by a control signal (not shown) from the CPU 31. When the visible light transmission filter 35 is inserted, the selector 58 selects the signal G of the input image signal, and the selector 59 selects the signal B of the input image signal. Accordingly, the input image signals R, G, and B are output as output image signal signals R, G, and B, respectively. When the infrared light transmission filter 36 is inserted, the selector 58 selects the output from the average value calculation circuit 57 and the selector 59 selects the signal G of the input image signal. Therefore, the signal R of the input image signal is output as it is as the signal R of the output image signal, but the signal G of the input image signal and the signal B of the input image signal are averaged as the signal G of the output image signal. The value is output, and the signal G of the input image signal is output as the signal B of the output image signal. The infrared image finally displayed on the monitor 4 is an image having a wavelength of 805 ± 15 nm as a red component of the monitor 4, an image having an average value of 805 ± 15 nm and a blue wavelength as a green component, and 930 as a blue component. An image with a wavelength of ± 20 nm is displayed.
[0178]
Hemoglobin has a light absorption characteristic as shown in FIG. In the figure, the curve labeled “Hb” represents the characteristics of hemoglobin not bound to oxygen, and the curve labeled “HbO 2” represents the characteristics of hemoglobin bound to oxygen. In the wavelength range of visible light, it is a dye that exhibits large absorption in the wavelength range of 380 to 590 nm, that is, the wavelength range from blue to green.
[0179]
In the present embodiment, when observing an infrared image, an image having a wavelength near 805 nm where the absorption of light by the ICG or ICG derivative-labeled antibody is large and an image in the blue wavelength band where absorption by hemoglobin is large are used as the green component of the monitor 4. Since the display is made, not only the thick blood vessels under the mucosa that can be observed at 805 nm but also the fine blood vessels on the surface of the mucosa that can be observed with blue light can be observed with good contrast.
[0180]
The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the invention.
[0181]
[Appendix]
(Additional item 1)
Light source means for emitting light in a first wavelength band including a wavelength of 805 nm and light in a second wavelength band not including a wavelength of 805 nm;
Imaging means for capturing an image of a first wavelength band and an image of a second wavelength band of a subject irradiated with light emitted from the light source means;
Display means for displaying an image of the first wavelength band captured by the imaging means as a green component, and displaying an image of the second wavelength band as at least one color component of a red component or a blue component;
An endoscope apparatus characterized by comprising:
[0182]
(Appendix 2)
The second wavelength band is a wavelength band including a wavelength of 930 nm;
The endoscope apparatus according to appendix 1, characterized by:
[0183]
(Additional Item 3)
The display means displays the image of the first wavelength band as a red component;
The endoscope apparatus according to appendix 1 or appendix 2 characterized by the above.
[0184]
(Appendix 4)
The display means displays an image of at least a part of a wavelength band of 380 nm to 590 nm and an image of the first wavelength band as a green component;
The endoscope apparatus according to any one of supplementary items 1 to 3, characterized in that:
[0185]
(Appendix 5)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
A first wavelength limiting unit and a second wavelength limiting unit, which are two wavelength limiting units that are selectively used to limit the transmission wavelength of light inserted on an optical path between the light source unit and the imaging unit. When,
A color balance correction unit that is a unit that corrects the color balance by, for example, multiplying the magnitude of the signal of each color component of the image captured by the imaging unit by a color balance correction coefficient that is a coefficient for correcting the color balance;
First correction coefficient storage means for storing a first color balance correction coefficient used for correcting the color balance of the image of the subject imaged by the imaging means when using the first wavelength limiting means;
Second correction coefficient storage means for storing a second color balance correction coefficient used for correcting the color balance of the image of the subject imaged by the imaging means when using the second wavelength limiting means;
An endoscope apparatus characterized by comprising:
[0186]
(Appendix 6)
A reference color object having a reference color;
Color balance setting instruction means for giving an instruction to calculate the color balance correction coefficient;
In response to a single instruction from the color balance setting instruction unit, an image of the reference color object is captured in a state where the first wavelength limiting unit is used, and the first color balance correction coefficient is calculated. Control means for taking an image of the reference color object in a state where the second wavelength limiting means is used and obtaining the second color balance correction amount;
The endoscope apparatus according to appendix 5, characterized by comprising:
[0187]
(Appendix 7)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
A first wavelength limiting unit and a second wavelength limiting unit, which are two wavelength limiting units that are selectively used to limit the transmission wavelength of light inserted on an optical path between the light source unit and the imaging unit. When,
A color tone adjusting unit that adjusts the color tone of the image by, for example, multiplying the magnitude of the image signal of each color component of the image captured by the imaging unit by a color tone adjustment coefficient that is a coefficient specified by the user;
First color tone adjustment coefficient storage means for storing the color tone adjustment coefficient used when adjusting the color tone of an image captured when the first wavelength limiting means is used;
Second color tone adjustment coefficient storage means for storing the color tone adjustment coefficient used when adjusting the color tone of an image captured when the second wavelength limiting means is used;
An endoscope apparatus characterized by comprising:
[0188]
(Appendix 8)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
A first wavelength limiting unit and a second wavelength limiting unit, which are two wavelength limiting units that are selectively used to limit the transmission wavelength of light inserted on an optical path between the light source unit and the imaging unit. When,
Image processing means for performing image processing such as tone enhancement according to a setting value set by a user on an image captured by the imaging means;
First setting value storage means for storing the setting value used when the image processing is performed on an image picked up by the image pickup means when the first wavelength limiting means is used;
Second setting value storage means for storing the setting value used when the image processing is performed on an image picked up by the image pickup means when the second wavelength limiting means is used;
An endoscope apparatus characterized by comprising:
[0189]
(Appendix 9)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
A first wavelength limiting unit and a second wavelength limiting unit, which are two wavelength limiting units that are selectively used to limit the transmission wavelength of light inserted on an optical path between the light source unit and the imaging unit. When,
Image recording means for recording an image picked up by the image pickup means;
Image recording instruction means for instructing recording of an image on the image recording means;
In response to a single instruction from the image recording instruction unit, the image captured by the imaging unit using the first wavelength limiting unit is recorded on the image recording unit, and the second wavelength limiting unit Control means for recording an image picked up by the image pickup means using the image recording means,
An endoscope apparatus characterized by comprising:
[0190]
(Appendix 10)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
Dye amount calculation means for obtaining the amount of dye contained in the subject from the image obtained by the imaging means;
Display means for displaying the temporal change of the dye amount calculated by the dye amount calculating means;
An endoscope apparatus characterized by comprising:
[0191]
(Appendix 11)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
Laser light source means for generating laser light for treatment;
A wavelength limiting unit that partially covers a light receiving surface of the imaging unit and removes light having a wavelength of laser light generated by the laser light source unit;
A first image captured at a portion of the light receiving surface of the imaging means covered by the wavelength limiting means and a second image captured at a portion of the light receiving surface of the imaging means not covered by the wavelength limiting means. Display means for displaying both or displaying either the first image or the second image;
An endoscope apparatus characterized by comprising:
[0192]
(Appendix 12)
The light source means sequentially outputs light having different wavelengths;
The endoscope apparatus according to appendix 11, characterized by:
[0193]
(Additional Item 13)
Light source means for emitting light;
Imaging means for imaging the subject irradiated by the light source means;
Laser light source means for generating laser light for treatment;
Laser light irradiation instruction means for instructing irradiation of the laser light to the subject;
A light amount control means for increasing the amount of light output from the light source means during laser light irradiation in accordance with an instruction from the laser light irradiation instruction means;
An exposure time control means for shortening the exposure time of the imaging means during laser light irradiation according to an instruction from the laser light irradiation instruction means;
An endoscope apparatus characterized by comprising:
[0194]
(Appendix 14)
A light source means for irradiating a living body to which a drug that specifically accumulates in a specific lesion site by an antigen-antibody reaction has been administered in advance;
Imaging means for imaging the subject irradiated by the light source means;
A first wavelength limiting unit that guides a wavelength in a first wavelength band that is inserted in an optical path between the light source unit and the imaging unit and includes an effective maximum absorption peak wavelength of the drug;
A first light that is selectively inserted with the first wavelength limiting means on the optical path between the light source means and the imaging means and guides a wavelength in a second wavelength band that does not include an effective maximum absorption peak wavelength of the drug. Two wavelength limiting means;
Display means for displaying an image picked up by the image pickup means;
An endoscope apparatus characterized by comprising:
[0195]
(Prior art relating to Supplementary Items 5 to 14)
The color balance is set before the inspection of the electronic endoscope is started. To set the color balance, the user presses a switch for setting the color balance in a state where the user is imaging a reference color object that is a white reference. In the endoscope apparatus, the color balance is set so that the reference color object becomes a predetermined color on the monitor according to the switch. By setting the color balance in this way, it is possible to correct variations (individual differences) in the wavelength characteristics of the light source lamp, light guide, CCD, etc., and always perform observation with a constant color tone.
[0196]
In addition, the preference of the color of the endoscopic image varies depending on the user, and there are various such as a person who likes a reddish image and a person who likes a bluish image. In order to provide an image according to the user's preference, the endoscope apparatus is provided with a color tone setting switch for setting the color tone of the image, and the color of the endoscope image is set according to the user's preference. Can be adjusted to color.
[0197]
At the time of endoscopic observation, there are cases where a diagnostic drug is not used, but observation may be performed while spraying a drug useful for diagnosis. An ICG derivative-labeled antibody has both a property as an ICG that emits fluorescence and a property as an antibody, and binds to a specific antigen by an antigen-antibody reaction. Since the antigen-antibody reaction is extremely sensitive and at the same time excellent in specificity, an ICG derivative-labeled antibody has attracted attention as a marker indicating a specific lesion such as cancer. By spraying an ICG derivative-labeled antibody into a body cavity and examining the presence or absence of fluorescence, the presence or absence of a lesion corresponding to the antibody can be known.
[0198]
In addition, an image processing circuit for more effectively diagnosing an image obtained by an electronic endoscope has been put into practical use, and is effective in detecting minute lesions. In the image processing circuit, IHb color enhancement processing that enhances the color according to the amount of hemoglobin that affects the subtle color tone of the mucous membrane, adaptive structure enhancement processing that enhances the mucosal structure, or contrast enhancement processing that increases the contrast of the image Depending on the user's preference, the target part, etc., the setting value such as which process is enabled and the level (strength) of the emphasis process is set by the user. It can be set by switching.
[0199]
In addition, a digital filing device, a photography device, a video printer, and the like are connected to the endoscope device as an image recording device, and an image is recorded on various image recording devices by the user pressing the release switch of the scope. Is done.
[0200]
As a treatment using an endoscope apparatus, a laser treatment using near-infrared light is spreading due to the appearance of a small high-power semiconductor laser. By irradiating laser light having a wavelength of about 810 nm emitted from a semiconductor laser through a light guide inserted into a channel of the scope, incision and coagulation of the irradiated portion can be performed.
[0201]
(Problems of the prior art according to Appendix 4)
When an infrared image is observed with an infrared endoscope, there is a problem that fine blood vessels on the mucosal surface that can be seen in normal observation (visible light observation) cannot be seen. (Problems of the prior art related to Supplementary Item 5 through Supplementary Item 6)
In addition, in the conventional infrared endoscope, the color balance corrected for the visible image is also applied to the infrared image, so the color of the infrared image varies depending on the individual such as the light source and the scope. I have.
[0202]
(Problems of the prior art according to Appendix 7)
In conventional infrared endoscopes, the color tone settings set for the visible image were also applied to the infrared image, so the color tone set for the visible image and the color tone set for the infrared image were different. In this case, it is necessary for the user to switch the color tone setting each time the infrared image and the visible image are switched.
[0203]
(Problems of the related art according to Appendix 8)
In conventional infrared endoscopes, the image processing set for the visible image is also applied to the infrared image, so the contents of the image processing desired to be performed on the visible image and the image processing desired to be performed on the infrared image. When the contents are different, it is necessary for the user to switch the image enhancement setting every time the infrared image and the visible image are switched.
[0204]
(Problems of the prior art according to Appendix 9)
If you want to record both visible and infrared images on a digital filing device, etc. while performing infrared observation, switch the release while the infrared image is displayed, and switch the filter once to display the visible image. It is necessary to perform complicated operations such as displaying the image and switching the release again, and switching the filter to return to the infrared image display.
[0205]
(Problems of the prior art according to Appendix 10)
Conventionally, the change in the concentration of ICG administered into the body is subjectively determined by looking at the contrast and color of the infrared image, and there is no means for quantitatively knowing it.
[0206]
(Problems of the prior art according to Supplementary Item 11 through Supplementary Item 13)
In an ordinary endoscope, an infrared light cut filter is disposed in front of the image sensor, but in an infrared endoscope, the infrared cut filter is removed in order to efficiently receive infrared light. For this reason, when an infrared laser for treatment is used, halation occurs in a wide range of the image due to a powerful laser beam, which hinders observation and hinders operability of laser therapy.
[0207]
(Problems of the prior art related to Supplementary Item 14)
Conventionally, a fluorescence endoscope apparatus has been required to make a diagnosis using an ICG derivative-labeled antibody. However, since the fluorescence emitted from the ICG derivative-labeled antibody is very weak, an extremely high-sensitive and expensive image sensor such as an image intensifier is required for the fluorescence endoscope apparatus.
[0208]
(Problems to be solved in Appendix 4)
Fine blood vessels on the mucosal surface are also displayed with good contrast.
[0209]
(Problems to be solved in Supplementary Items 5 and 6)
An endoscope apparatus capable of observing both a visible image and an infrared image with a stable color balance is provided.
[0210]
(Problem to be solved in Appendix 7)
Provided is an endoscope apparatus capable of easily setting a favorite color tone for both a visible image and an infrared image.
[0211]
(Problem to be solved in Appendix 8)
Provided is an endoscope apparatus capable of easily setting appropriate image processing for both a visible image and an infrared image.
[0212]
(Problem to be solved in Appendix 9)
An endoscope apparatus capable of easily recording both an infrared image and a visible image in a recording apparatus is provided.
[0213]
(Problem to be solved in Supplementary Item 10)
Provided is an endoscope apparatus capable of quantitatively knowing temporal changes in the amount of pigment such as ICG.
[0214]
(Problems to be solved in Additional Item 11 to Additional Item 13)
Provided is an endoscope apparatus that can safely perform treatment with an infrared laser even when an infrared endoscope is used.
[0215]
(Problem to be solved in Additional Item 14)
An endoscope apparatus capable of observing an ICG derivative-labeled antibody without using an expensive high-sensitivity image sensor is provided.
[0216]
(Operational effect of supplementary item 2)
Since the display means for displaying the image of the wavelength band including 930 nm as the red component or the blue component of the display means is provided, it is possible to clearly distinguish the high ICG density portion and the low ICG density portion by color.
[0217]
(Operational effect of additional item 3)
Since the display means for displaying the image of the wavelength band including 805 nm on both the green component and the red component of the display means is provided, the contrast of the displayed image is greatly increased.
[0218]
(Operational effect of item 4)
Since not only the wavelength band including 805 nm but also the wavelength band including at least part of 400 to 590 nm is assigned as the green component of the display means, not only the submucosal blood vessels but also the fine blood vessels on the mucosal surface are displayed with good contrast. .
[0219]
(Operational effect of additional item 5)
For an image captured using the first wavelength limiting unit, the color balance is corrected using the first color balance correction amount, and for an image captured using the second wavelength limiting unit. Since the color balance is corrected by using the second color balance correction amount, the color balance is appropriately corrected when either wavelength limiting unit is used.
[0220]
(Operational effect of additional item 6)
Since two color balance correction amounts for the first wavelength limiting unit and the second wavelength limiting unit are obtained in accordance with an instruction from the color balance setting instruction unit, the color balance can be easily set.
[0221]
(Operational effect of additional item 7)
A color tone is adjusted using the first color tone adjustment value for an image captured using the first wavelength limiting unit, and a second color is applied to the image captured using the second wavelength limiting unit. Since the color tone is adjusted using the color tone adjustment value, the color tone is appropriately adjusted when either wavelength limiting unit is used.
[0222]
(Operational effect of supplementary item 8)
An image captured using the first wavelength limiting unit is subjected to image processing using the first image processing setting value, and an image captured using the second wavelength limiting unit is Since the image processing is performed using the image processing setting value of 2, the image processing is appropriately performed when either wavelength limiting unit is used.
[0223]
(Operational effect of supplementary item 9)
In response to an instruction from the image recording instruction means, both the image picked up using the first wavelength limiting means and the image picked up using the second wavelength limiting means are recorded. An image when the wavelength limiting means is used can be recorded by a simple operation.
[0224]
(Operational effect of additional item 10)
Since the dye amount calculating means for obtaining the dye amount of the subject is provided and the change with time of the calculated dye amount is displayed, the change in the dye amount can be notified quantitatively.
[0225]
(Operations and effects of supplementary items 11 to 12)
Since the wavelength limiting means for partially covering the light receiving surface of the imaging means and removing the laser light is provided, an image with less halation is created without being affected by the treatment laser light.
[0226]
(Operational effect of additional item 13)
Since the light amount of the light source is increased in accordance with the irradiation instruction of the treatment laser light to the subject and the exposure time of the imaging means is shortened, the influence of the treatment laser light on the image is reduced.
[0227]
(Operational effect of supplementary item 14)
Since the wavelength limiting means for guiding the wavelength including the substantial absorption peak of the drug and the wavelength not including the drug are provided, the degree of drug accumulation can be easily known from the obtained image.
[0228]
【The invention's effect】
Light source means for emitting light in a first wavelength band including a wavelength of 805 nm and light in a second wavelength band not including a wavelength of 805 nm;
Imaging means for capturing an image of a first wavelength band and an image of a second wavelength band of a subject irradiated with light emitted from the light source means;
Display means for displaying an image of the first wavelength band captured by the imaging means as a green component, and displaying an image of the second wavelength band as at least one color component of a red component or a blue component;
By having
An image in a wavelength band including a wavelength of 805 nm, which has a lot of absorption by ICG, is assigned to a green component having a large influence on human contrast, and an infrared image at the time of ICG administration can be observed with good contrast.
[Brief description of the drawings]
FIG. 1 to FIG. 20 relate to a first embodiment of the present invention, and FIG. 1 is a block diagram for explaining the overall configuration of an endoscope apparatus.
FIG. 2 is an explanatory diagram illustrating the configuration of an infrared visible switching filter
FIG. 3 is an explanatory diagram for explaining light transmission characteristics of a visible light transmission filter and an infrared light transmission filter;
FIG. 4 is an explanatory diagram illustrating the configuration of an RGB rotation filter
FIG. 5 is an explanatory diagram for explaining light transmission characteristics of an R filter, a G filter, and a B filter;
FIG. 6 is an explanatory diagram for explaining the configuration of a CCD.
FIG. 7 is an explanatory diagram for explaining the arrangement of infrared light cut filters.
FIG. 8 is an explanatory diagram for explaining light transmission characteristics of an infrared light cut filter.
FIG. 9 is a block diagram illustrating the configuration of a color balance correction circuit.
FIG. 10 is a block diagram illustrating a configuration of an image processing circuit
FIG. 11 is a block diagram illustrating a configuration of a color tone adjustment circuit.
FIG. 12 is a diagram showing an example of a screen display
FIG. 13 is an explanatory diagram for explaining an internal memory map of a CPU.
FIG. 14 is a flowchart for explaining the flow of filter switching processing;
FIG. 15 is a flowchart for explaining the flow of color balance setting.
FIG. 16 is a flowchart illustrating a flow of color tone setting
FIG. 17 is a flowchart for explaining the flow of laser irradiation operation;
FIG. 18 is a flowchart for explaining the flow of an image recording operation.
FIG. 19 is an explanatory diagram for explaining the transmission characteristics of ICG.
FIG. 20 is an explanatory diagram for explaining visual spatial frequency characteristics.
FIG. 21 to FIG. 22 relate to a second embodiment of the present invention, and FIG. 21 is an explanatory diagram for explaining light transmission characteristics of an R filter, a G filter, and a B filter.
FIG. 22 is an explanatory diagram for explaining the relationship between the state of the visible infrared switching filter and the RGB rotation filter and the operating synchronization memory;
FIG. 23 to FIG. 26 relate to a third embodiment of the present invention, and FIG. 23 is a light transmission characteristic of a visible light transmission filter and an infrared light transmission filter.
FIG. 24 shows light transmission characteristics of an R filter, a G filter, and a B filter.
FIG. 25 is a block diagram illustrating the configuration of an expansion multiplexer
FIG. 26 is an explanatory diagram for explaining the light absorption characteristics of hemoglobin.
[Explanation of symbols]
1. Light source device
2 ... Scope
3 ... Processor
4 ... Monitor
5. Digital filing device
6 ... Photography device
7 ... Laser light source device
8 ... Lamp
9. Infrared / visible switching filter
10 ... Motor
11 ... RGB rotation filter
12 ... Motor
13 ... Lighting diaphragm
14 ... Light guide fiber
15 ... CCD
16 ... Filter changeover switch
17 ... Release switch
18 ... Laser irradiation switch
19 ... Scope discrimination element
20 ... Preprocess circuit
21. A / D conversion circuit
22 ... Color balance correction circuit
23. Multiplexer
24 ... Simultaneous memory
25. Image processing circuit
26. Color tone adjustment circuit
27 ... D / A conversion circuit
28: Coding circuit
29. Light control circuit
30. Exposure time control circuit
31 ... CPU
32 ... Color balance setting switch
33. Image processing setting switch
34 ... Color tone setting switch
35. Visible light transmission filter
36. Infrared light transmission filter
37 ... R filter
38 ... G filter
39 ... B filter
40: Light receiving area
41 ... Horizontal transfer register
42 ... Infrared light cut filter
43 ... Correction coefficient storage memory
44 ... Selector
45 ... Multiplier
46 ... Dye amount calculation circuit
47. Emphasis coefficient calculation circuit
48 ... Delay circuit
49 ... Dye enhancement circuit
50. Structure enhancement circuit
51. Graph creation circuit
52. Image composition circuit
53. Color tone adjustment coefficient storage memory
54. Multiplier
55. Gamma correction circuit
56 ... Expansion multiplexer
57. Average value calculation circuit
58 ... Selector
59 ... Selector

Claims (2)

Light source means for selectively irradiating light in the first wavelength band and light in the second wavelength band;
Imaging means for imaging the subject irradiated by the light source means;
Color balance setting instruction means for instructing calculation of a correction coefficient for correcting color balance of an image captured by the imaging means;
Based on a single input instruction to the color balance setting instruction means, the light of the first wavelength band is selected, and a first color balance correction coefficient for correcting an image in the first wavelength band is calculated. After the calculation of the first color balance correction coefficient is completed, the light of the second wavelength band is selected, and the second color balance correction coefficient for correcting the image in the second wavelength band is calculated. Control means for controlling;
An endoscope apparatus characterized by comprising: First correction coefficient storage means for storing a first color balance correction coefficient for correcting a color balance of an image picked up by the image pickup means when selecting light in the first wavelength band;
Second correction coefficient storage means for storing a second color balance correction coefficient for correcting a color balance of an image picked up by the image pickup means when selecting light of the second wavelength band;
When the light of the first wavelength band is selected, the first color balance correction coefficient is used, and when the light of the second wavelength band is selected, the image is picked up by the imaging means using the second color balance correction coefficient. Color balance correction means for correcting the color balance of the image,
The endoscope apparatus according to claim 1, further comprising :

Images