KR100927286B1 - Endoscopy device and image processing device - Google Patents

Abstract

By the timing signal from the timing circuit unit 29 of the video processor 20, the normal light CCD 11 is driven through the normal light CCD control unit 25, and at the same time, the fluorescent CCD 12 is driven through the fluorescent CCD control unit 26. ) Is driven. Then, the imaging signal from the normal light CCD 11 by the RGB plane sequential method is processed by the video circuit section 27 for the normal light image to generate a normal color image, while the imaging signal from the fluorescent CCD 12 is generated. Is processed by the fluorescent image video circuit portion 28, and the image pickup signal of the subject which has been excited with blue illumination light and has passed through the fluorescence transmission filter 13 is extracted, and a fluorescent image of the subject is generated. The normal color image and the fluorescent image of the subject are synthesized by the image synthesizing circuit section 30 and output to the monitor 2, and the normal light image and the fluorescent image are displayed in parallel or overlapping.

Endoscope, image processing, fluorescent image, normal color image, RGB plane sequence, video circuit

Description

Endoscopy device and image processing device {ENDOSCOPE AND IMAGE PROCESSING DEVICE}

The present invention relates to an endoscope apparatus and an image processing apparatus capable of obtaining an observation image by normal light and an observation image by fluorescence.

In observation of biological tissues by endoscopy, in addition to normal endoscope observation using visible light, there are fluorescence observations in which excitation light is irradiated and observation is performed by a fluorescence image. In fluorescence observation, when light (excitation light) having a wavelength of 400 nm to 480 nm is irradiated to living tissue, normal tissue strongly generates fluorescence in the range of approximately 480 nm to 630 nm, and affected areas such as cancer cells are fluorescent. This weakening is used, and it is known as a technique which can detect abnormal sites, such as early cancer, which are difficult to visualize by normal endoscope observation.

Background Art Conventionally, an endoscope apparatus used for fluorescence diagnostics, as disclosed in, for example, Japanese Unexamined Patent Application Publication No. 4-150845, arranges an excitation filter that transmits only excitation light in an illumination light path generated from a light source, Between the objective optical system at the tip of the insertion end of the endoscope and the solid-state image sensor, a filter for transmitting fluorescence that transmits only light having a wavelength of fluorescence is disposed.

In the conventional apparatus as disclosed in Japanese Patent Laid-Open No. 4-150845, the illumination light irradiated onto the subject is only excitation light, and the light incident on the solid-state imaging element becomes only fluorescence. The endoscope observation by normal light cannot be performed.

For this reason, when endoscope observation is conventionally performed in order to visually observe the position and state of an affected part, it is necessary to replace the endoscope device for fluorescence observation and the endoscope device for ordinary light observation alternately each time. It was a big burden for both the patient and the doctor.

Therefore, for example, Japanese Patent Laid-Open No. 9-66023 proposes a video processor device for fluorescence observation electronic endoscope that can easily perform normal endoscope observation and fluorescence observation. In such an apparatus, however, both the normal light observation image and the fluorescence observation image can be displayed on the monitor, but the normal light observation image and the fluorescence observation image captured at the same timing cannot be observed at the same time. The problem arises that the contrast between the normal light observation image and the fluorescence observation image is not easy, such that the same site cannot be observed.

When both the normal light observation image and the fluorescence observation image are displayed on the monitor, when either the CCD for normal light observation or the CCD for fluorescence observation fails, one image is noisy. There is also a problem that it becomes an image or nothing is output, and it is not possible to easily recognize on the monitor screen which CCD has failed.

In addition, the observation of living tissue using an endoscope apparatus includes narrowband light observation (NBI: Narrow) in which the narrowband light, which is light having a narrower band than the irradiation light in the normal observation, is observed in addition to the above-described normal observation and fluorescence observation. Band Imaging) and infrared light observation which observes by irradiating near-infrared light which is light which has a near-infrared band in vivo.

In narrowband light observation, it is possible to observe the blood vessels of the mucosal superficial layer with higher contrast. In infrared light observation, a drug having a characteristic of absorbing light in the near-infrared band called indocyanine green (ICG) is introduced into the blood vessel. By injecting, it becomes possible to observe the blood circulation of the lower mucosa which is not normally observed.

The apparatus which can switch such a plurality of observation modes is the image processing apparatus which can switch four observation modes of normal observation, fluorescence observation, narrow band light observation, and infrared light observation, for example in Unexamined-Japanese-Patent No. 2005-013611. It is disclosed as.

However, in fluorescence observation, since self-fluorescence generated by biological tissues in vivo is weak, imaging of self-fluorescence generated by biological tissues in vivo usually observes, for example, the rotational speed of the rotary filter provided in the light source device. By lowering compared to the above, the exposure time is performed after prolonged time as compared with normal observation.

Therefore, for example, when the observation mode of the endoscope device is switched from normal observation to fluorescence observation, that is, when the rotational speed of the rotary filter becomes a rotational speed suitable for fluorescence observation from a rotational speed suitable for normal observation. In the period up to this point, a problem arises such that a still image not suitable for recording is output. Such a problem is not considered in Japanese Unexamined Patent Publication No. 2005-013611.

The present invention has been made in view of the above circumstances, and an endoscope capable of easily contrasting an image for observing ordinary light with an image for fluorescence observation, and also reporting an abnormality in an image processing system on a monitor for image display. An object of the present invention is to provide an image processing apparatus capable of outputting a still image suitable for recording when the observation mode is switched.

<Start of invention>

Means for solving the problem

In order to achieve the above object, the endoscope apparatus according to the first invention includes an endoscope having normal light imaging means for imaging an object image by ordinary light with an electronic shutter and fluorescent imaging means for imaging a fluorescent image from the subject; In the endoscope apparatus provided with the image processing apparatus which signal-processes the imaging signal from the said normal light image pickup means and the said fluorescent image pickup means, and produces | generates a normal light image and a fluorescent image, the said image processing apparatus is the said normal light image pickup means. Signal processing for normal light image processing means for processing the normal light image pickup control means for driving the image pickup device, the fluorescent image pickup control means for driving the fluorescent image pickup means, and the image pickup signal from the normal light image pickup means, and generating the normal light image. Means for processing an image pickup signal including a fluorescent image of the subject, and generating a fluorescent image; Includes a processing means, the normal light image pickup control means and the fluorescence imaging control means will be driven at the same time.

An endoscope apparatus according to a second aspect of the invention includes an endoscope having normal light imaging means for imaging a subject image by ordinary light, a fluorescent imaging means for imaging a fluorescent image from the subject, a normal light imaging means of the endoscope, and In an endoscope apparatus having an image processing apparatus for signal-processing an imaging signal from a fluorescent imaging means and generating a normal light image and a fluorescent image, said image processing apparatus is a normal light imaging driving means for driving said normal light imaging means. And a fluorescence imaging driving means for driving the fluorescence imaging means, a signal processing means for normal light images for signal processing an imaging signal from the normal light imaging means, and generating the normal light image, and the fluorescent image. Signal processing means for fluorescence images for signal processing an image pickup signal and generating said fluorescence image, said normal light image and said fluorescence image Image synthesizing means for synthesizing, normal light image processing monitoring means for monitoring a signal processing system of the normal light image from a drive signal of the normal light image capturing driving means to an output signal of the signal processing means for normal light image, and the And a fluorescence image processing monitoring means for monitoring a signal processing system of the fluorescence image from the drive signal of the fluorescence imaging driving means to the output signal of the fluorescence image signal processing means.

An image processing apparatus according to a third aspect of the present invention includes an imaging means for imaging an object, outputting an imaging signal based on the image of the imaged subject, and one or a plurality of storage means for storing the imaging signal output from the imaging means. And write signal generation means for outputting a write signal for writing the image pickup signal to the storage means to the storage means, and first observation for generating a first observation image based on the image pickup signal output from the image pickup means. A switching signal for switching between a mode and a second observation mode for generating a second observation image different from the first observation image based on an image pickup signal output from the image pickup means, the image pickup means and the storage means. By stopping the output of the write signal on the basis of the switching signal generating means and the switching signal, Write-prohibiting means for stopping writing of the imaging signal to the storage means, and after the predetermined time has elapsed after the switching signal is output, the output of the writing signal to the storage means is resumed, thereby It has a write prohibition canceling means for releasing the stop of writing to the storage means.

An image processing apparatus according to a fourth aspect of the present invention includes one or a plurality of imaging means for imaging an object and outputting an imaging signal based on the image of the imaged subject, and one or storing an imaging signal output from the imaging means. A plurality of storage means, write signal generation means for outputting a write signal for writing the image pickup signal to the storage means to the storage means, irradiated light having a first band to the subject, and the second A first image pick-up in which the subject is imaged by a first exposure time when light source means for irradiating irradiation light having a second band different from the irradiation light and irradiation light having the first band is irradiated on the subject Mode and a second imaging mode in which the subject is imaged by a second exposure time when irradiated light having the second band is irradiated onto the subject. On the basis of the switching signal generating means for outputting a switching signal for switching to the imaging means, the storage means, and the switching signal, the output of the write signal is stopped to the storage means. The image capturing by resuming the output of the write signal after the write prohibition means for stopping writing and the irradiation light irradiated by the light source means is switched from one irradiation light to another irradiation light after the switching signal is output. And write inhibiting means for releasing stop of writing of the signal to the storage means.

An image processing apparatus according to a fifth aspect of the present invention includes a plurality of imaging means for photographing a subject and outputting an imaging signal based on the image of the photographed subject, and one or a plurality of storing the imaging signal output from the imaging means. A storage device, write signal generation means for outputting a write signal for writing the image pickup signal to the storage means to the storage means, and the image pickup means outputs from the image pickup means by imaging the first image of the subject; Outputting a switching signal for switching the output state with the first imaging signal to be outputted and the second imaging signal outputted from the imaging means by the imaging means imaging the second image of the subject different from the first image; The first imaging signal by stopping the output of the write signal based on the switching signal generating means and the switching signal. Or write-inhibiting means for stopping writing of the second imaging signal to the storage means, and after the switching signal is output, the imaging signal output from the imaging means is switched from one imaging signal to another imaging signal. And a write prohibition canceling means for releasing the stop of writing to the storage means of the first imaging signal or the second imaging signal by resuming the output of the writing signal.

1 is a block diagram showing a configuration of an endoscope apparatus according to a first embodiment of the present invention.

2 is an explanatory diagram showing a configuration of an in-phase, RGB rotation filter;

3 is an explanatory diagram showing in-phase, fluorescence wavelength bands, and respective filter characteristics.

4 is a block diagram showing a configuration of an endoscope apparatus according to a second embodiment of the present invention.

5 is an explanatory diagram showing a configuration of an in-phase, RGB rotation filter;

6 is a block diagram showing the configuration of an endoscope apparatus according to a third embodiment of the present invention.

7 is an explanatory diagram showing a configuration of an objective optical system in front of an in-phase and fluorescent CCD.

8 is a configuration diagram showing a configuration of an endoscope apparatus according to a fourth embodiment of the present invention.

9 is a diagram illustrating the configuration of an in-phase, RGB rotation filter of FIG. 8.

FIG. 10 is a block diagram showing the configuration of an in-phase, first image output detection circuit or second image output detection circuit in FIG. 8; FIG.

FIG. 11 is a diagram showing a Cr-Cb color plane for explaining the action of an in-phase and noise image detection unit of FIG. 10; FIG.

FIG. 12 is a first diagram showing an in-phase, monitor display example illustrating the operation of the video processor of FIG. 8; FIG.

FIG. 13 is a second diagram illustrating an example of monitor display for explaining the operation of the video processor of FIG. 8;

FIG. 14 is a third diagram showing an example of monitor display for explaining the action of the video processor of FIG. 8;

FIG. 15 is a fourth diagram showing an in-phase, monitor display example explaining the operation of the video processor of FIG. 8; FIG.

FIG. 16 is a fifth diagram illustrating an example of monitor display for explaining the operation of the video processor of FIG. 8.

FIG. 17 is a sixth diagram showing an in-phase, monitor display example explaining the operation of the video processor of FIG. 8; FIG.

18 is a seventh diagram showing an example of monitor display for explaining the operation of the video processor of FIG. 8;

FIG. 19 is an eighth diagram showing a monitor display example illustrating the operation of the video processor of FIG. 8 in phase;

20 is a ninth diagram showing an in-phase, monitor display example explaining the operation of the video processor of FIG. 8;

FIG. 21 is a tenth diagram showing an example of monitor display for explaining the operation of the video processor of FIG. 8;

Fig. 22 is an eleventh diagram showing an in-phase, monitor display example illustrating the operation of the video processor of Fig. 8;

FIG. 23 is a twelfth diagram showing a monitor display example for explaining the operation of the video processor of FIG. 8;

FIG. 24 is a thirteenth diagram showing a monitor display example for explaining the operation of the video processor of FIG. 8;

FIG. 25 is a fourteenth view showing a monitor display example for explaining the operation of the video processor of FIG. 8;

FIG. 26 is a block diagram showing a configuration of a modification of the in-phase, first image output detection circuit or second image output detection circuit in FIG. 10; FIG.

Fig. 27 is a diagram showing a Cr-Cb color plane for explaining a modification of the action of the in-phase, noise image detection unit in Fig. 10;

FIG. 28 is a diagram showing the configuration of a first modification of the video processor of FIG. 8;

29 is a diagram showing the configuration of a second modification example of the video processor of FIG. 8.

FIG. 30 is a diagram showing the configuration of a third modification example of the video processor of FIG. 8.

FIG. 31 is a diagram showing the configuration of a fourth modified example of the video processor of FIG. 8;

32 is a diagram showing the configuration of a fifth modification example of the video processor of FIG. 8.

The figure which concerns on the 5th Embodiment of this invention and shows the structure of the principal part of an endoscope apparatus.

Fig. 34 is a diagram showing an internal configuration of an in-phase and endoscope device.

Fig. 35 is a diagram showing the configuration of a rotary filter installed in the light source unit included in the in-phase and endoscope apparatus;

Fig. 36 is a diagram showing the transmission characteristics of an RGB filter installed in the in-phase, rotary filter shown in Fig. 35;

FIG. 37 is a view showing transmission characteristics of a fluorescence observation filter installed in the in-phase, rotary filter shown in FIG. 35; FIG.

FIG. 38 is a diagram illustrating a configuration of a band switching filter installed in a light source unit included in an in-phase and endoscope device; FIG.

Fig. 39 is a diagram showing the transmission characteristics of a normal / fluorescence observation filter and an infrared light observation filter installed in the in-phase, band switching filter shown in Fig. 38;

40 is a diagram showing transmission characteristics of a narrow-band light observing filter installed in a phase change filter shown in FIG. 38;

Fig. 41 is a diagram showing the transmission characteristics of the excitation light cut filter provided in the electronic endoscope included in the in-phase and endoscope apparatus.

Fig. 42 is a diagram showing an example of a setting screen of a processor included in an in-phase and endoscope apparatus;

FIG. 43 is a diagram showing an example of the configuration of an image capturing unit provided in an electronic endoscope included in an in-phase and endoscope apparatus; FIG.

FIG. 44 is a diagram showing another example of the configuration of the imaging unit provided in the electronic endoscope included in the in-phase and endoscope apparatus; FIG.

45 is a flowchart showing an example of processing performed in a processor when the observation mode in the in-phase and endoscope apparatus is switched from one observation mode to another.

Fig. 46 is a diagram showing states of writing and reading out of an image pickup signal in a memory unit when the observation mode in the in-phase and endoscope apparatus is switched from one observation mode to another.

Fig. 47 is a diagram showing an example different from Fig. 42 of the setting screen of the processor included in the in-phase, endoscope device;

FIG. 48 is a flowchart showing an example different from FIG. 45 of the processing performed in the processor when the observation mode in the in-phase, endoscope apparatus is switched from one observation mode to another.

Fig. 49 is a flowchart showing an example of freeze processing performed by a processor included in an in-phase and endoscope apparatus;

Fig. 50 is a diagram showing states of writing and reading out of an image pickup signal in a synchronization circuit when the observation mode in the in-phase and endoscope apparatus is switched from one observation mode to another.

<Best Mode for Carrying Out the Invention>

EMBODIMENT OF THE INVENTION Hereinafter, embodiment of this invention is described with reference to drawings.

[First form]

In Fig. 1, reference numeral 1 denotes an endoscope apparatus, and the endoscope apparatus 1 includes an electronic endoscope 10 capable of observing normal light of a subject by visible light and fluorescence by fluorescence generated from the subject, and an electronic endoscope. And a video processor 20 as an image processing apparatus for driving normalization and generating a normal light image and a fluorescent image by signal processing the normal light observation image and the fluorescence observation image captured by the electronic endoscope 10. have. The monitor 2 is connected to the video processor 20, and the normal light observation image 3 and the fluorescence observation image 4 are displayed on the screen of the monitor 2.

The electronic endoscope 10 includes a flexible insertion portion 10a that is inserted into a body cavity and the like, and an operation portion 10b provided on the proximal side of the insertion portion 10a, and extends from a side portion of the operation portion 10b. The code 10c is connected to the video processor 20. At the distal end of the inserting portion 10a, the imaging element 11 which is a normal light imaging means and the imaging element 12 which is a fluorescent imaging means are arranged side by side facing forward. As the imaging element 11 for normal light imaging, for example, a charge coupled device (CCD) for monochrome is used in a solid-state imaging element corresponding to the electronic shutter function, and as the imaging element 12 for fluorescent imaging, For example, a high-sensitivity solid-state imaging device capable of capturing fluorescence from a weak living body is used.

In addition, below, the imaging element 11 for normal light imaging is mainly described as the normal light CCD 11, and the imaging element 12 for fluorescent imaging is mainly described as the fluorescent CCD 12.

In these normal light CCD 11 and the fluorescent CCD 12, a fluorescence transmission filter 13 which transmits only light having a wavelength of 520 nm to 700 nm is disposed on the entire surface of one fluorescent CCD 12. In front of the other normal light CCD 11, no fluorescence transmission filter is disposed. And an objective optical system (not shown) is arrange | positioned in front of these CCDs 11 and 12, and the image of the object of the front is imaged on the imaging surface of each CCD 11 and 12. FIG.

In addition, one objective optical system common to both the normal light CCD 11 and the fluorescent CCD 12 may be disposed.

In addition, along with the objective optical system at the tip of the insertion section 10a, an exit end of the light guide fiber bundle for illumination (hereinafter simply referred to as "light guide") 14 is disposed through the illumination optical system (not shown). The light guide 14 is connected to the video processor 20 from the insertion section 10a via the universal code 10c, guides the illumination light incident on the incidence end from the light source provided in the video processor 20, and the endoscope Illumination light is irradiated from the exit end of the tip toward the observation range of the objective optical system.

The video processor 20 includes a light source system for supplying illumination light to the light guide 14, and various signal processing circuit systems for CCD driving and signal processing. As a light source system for supplying the illumination light, for example, a light source unit 21 having a xenon lamp, a dimming circuit, or the like is provided, and an RGB rotation filter in the illumination light path between the light source unit 21 and the incident end of the light guide 14. 22 is arrange | positioned.

The light emitted from the light source 21 passes through the RGB rotation filter 22, is guided by the light guide 14, and is emitted from the tip of the insertion portion 10a of the electronic endoscope 10. As shown in Fig. 2, the RGB rotation filter 22 is formed by forming a fan-shaped filter 22a, 22b, 22c of red (R), green (G), and blue (B), respectively. And rotated at constant speed by the motor 23 controlled through the light source unit 21. As a result, the subject in front of the tip of the insertion portion 10a of the electronic endoscope 10 is repeatedly illuminated in sequence by the illumination light of three colors of red, green, and blue.

In addition, the wavelength region of the light transmitted by each filter 22a, 22b, 22c is, for example, red (R): 580 nm to 650 nm, green (G): 500 nm to 580 nm, and blue (B): 400 nm-500 nm.

Moreover, as the various signal processing circuit systems of the video processor 20, the driving and control of the normal light CCD control unit 25 and the fluorescent CCD 12 as normal light imaging control means for driving and controlling the normal light CCD 11 are performed. Video circuit for normal light image as signal processing means for normal light image processing the imaging signal from the fluorescence CCD control section 26 and the normal light CCD 11 as fluorescence imaging control means for controlling and generating a normal light image (27) A fluorescent image video circuit portion 28 serving as a fluorescent image signal processing means for processing a captured image signal from the fluorescent CCD 12 and generating a fluorescent image, and generating a timing signal for synchronously operating each portion; The timing circuit unit 29 is provided with an image synthesizing circuit unit 30 for synthesizing a normal light image and a fluorescent image and outputting the same to the monitor 2.

The normal light CCD control unit 25 drives the normal light CCD 11 and controls the imaging by the illumination light irradiated to the subject through the RGB rotation filter 22. In addition, when the amount of illumination light is increased in accordance with the fluorescence observation, exposure control by the electronic shutter of the normal light CCD 11 is performed, and the exposure amount is adjusted so that a normal light image of appropriate brightness is obtained.

The fluorescent CCD control unit 26 drives the fluorescent CCD 12 and captures an image of a subject including an image by fluorescence generated from the subject by illumination light irradiated onto the subject through the RCB rotation filter 22. To control. At this time, when the fluorescent image of sufficient brightness is not obtained even if the amount of illumination light is maximized, the gain of the fluorescent CCD 12 is controlled to adjust to obtain a fluorescent image of appropriate brightness.

The video circuit unit 27 for ordinary light image processes the imaging signal transmitted from the CCD 11 for normal light, and generates a normal color video signal of the subject. On the other hand, the fluorescent image video circuit unit 28 extracts an imaging signal by light having a wavelength passing through the fluorescence transmission filter 13 among the imaging signals transmitted from the fluorescence CCD 12, and the fluorescent image of the subject. Create

The timing circuit unit 29 generates a timing signal and generates a normal light CCD control unit 25, a fluorescent CCD control unit 26, a normal light image video circuit unit 27, a fluorescent image video circuit unit 28, and RGB rotation. The timing signal is supplied to the light source unit 21 that controls the motor 23 that rotates the filter 22. Based on this timing signal, the normal light CCD control section 25 and the fluorescent CCD control section 26 are driven simultaneously, and the normal light CCD 11 and the fluorescent CCD 12 are driven by the normal light picked up at the same timing. The subject image and the fluorescent image can be obtained. Moreover, each process of the normal light video circuit part 27 and the fluorescent video video circuit part 28, and rotation of the RGB rotation filter 22 by the motor 23 are controlled by synchronization.

The image synthesizing circuit unit 30 synthesizes the normal light image from the video circuit unit 27 for normal light image and the fluorescent image from the video circuit unit 28 for fluorescent image, and either one of the normal light image and the fluorescent image or A composite image composed of both is output to the monitor 2, and the composite image is displayed on the screen of the monitor 2. In FIG. 1, the example which displays the normal light observation image 3 and the fluorescence observation image 4 in parallel on the screen of the monitor 2 is shown.

In the endoscope observation by the endoscope apparatus 1 by the above structure, the lamp light emission of the light source part 21 and the RGB rotation filter by the motor 23 based on the timing signal from the timing circuit part 29 of the video processor 20. Rotation of (22) is controlled, and the subject is repeatedly illuminated by the illumination light of three colors of red, green, and blue. In addition, by the timing signal from the timing circuit unit 29, the normal light CCD 11 is driven through the normal light CCD control unit 25, and at the same time, the fluorescent CCD 12 is driven through the fluorescent CCD control unit 26. Driven.

As a result, in the normal light CCD 11, image pickup by a so-called RGB plane sequential method is performed, and an image pickup signal by the RGB plane sequential method is input to the video circuit unit 27 for normal light image. In the video circuit unit 27 for normal light image, the R, G, and B signals are synchronized by removing the noise by the pre-process or color balance correction, and processing such as gamma correction and color correction is performed. Generates a color image signal.

On the other hand, the imaging signal from the fluorescent CCD 12 is input to the fluorescent image video circuit unit 28. The fluorescent image video circuit unit 28 extracts only a signal when the subject is illuminated with blue illumination light (wavelength 400 nm to 500 nm) of the red, green, and blue illumination light by the RGB rotation filter 22, and the subject is extracted. Produces a fluorescent image. That is, the image obtained by the fluorescent CCD 12 is only an image by the light of the wavelength which can permeate | transmit the fluorescent transmission filter 13, As shown in FIG. 3, the wavelength 400nm contained in blue illumination light Light having a wavelength of 520 nm to 700 nm is excited from the subject by the excitation light of ˜500 nm, and the fluorescent image is generated from the subject image picked up by the fluorescent CCD 12 through the fluorescence transmission filter 13.

In this case, since the fluorescence generated from the living body is weak, in order to obtain a clear fluorescence image, it is necessary to increase the light amount of the illumination light rather than the normal light observation. However, in the electronic endoscope 10 of the present embodiment, illumination light is common in ordinary light observation and fluorescence observation, and when the amount of illumination light is increased in accordance with fluorescence observation, the illumination light becomes too bright for a normal light image, and the appropriate amount of illumination light is obtained. May not be.

Therefore, the normal light CCD control unit 25 performs electronic shutter control of the normal light CCD 11 to adjust the exposure amount so that a normal light image having an appropriate brightness is obtained. A well-known general control is sufficient for the adjustment method of the exposure amount by an electronic shutter, and shortens the charge accumulation time of the normal light CCD 11 with respect to too bright illumination light, keeping the color balance constant for each color light of RGB. Control to adjust the amount of light contributing to imaging, that is, the brightness of the image to an appropriate amount of light.

In addition, when sufficient brightness is not obtained even if illumination amount is maximized, the fluorescent CCD control part 26 controls the gain of the fluorescent CCD 12, so that the fluorescent image of a suitable brightness may be obtained. For example, when the fluorescent CCD 12 uses a high-sensitivity image pickup device having a charge multiplication mechanism using ionization of a charge multiplicantion device (CMD) inside the device, the fluorescent CCD control unit 26 is connected to the device. By controlling the control pulse or the applied voltage to increase the amplification factor of the signal in the element, the lack of the amount of illumination light is compensated for so as to obtain a fluorescent image of appropriate brightness.

The color image generated by the video circuit unit 27 for ordinary light image and the fluorescent image generated by the video circuit unit 28 for fluorescent image are inputted to the image synthesizing circuit unit 30 to be synthesized to process the fluorescent image and the normal light image. One or both composite images are generated. This synthesized image is output from the image synthesizing circuit unit 30 to the monitor 2, for example, as shown in FIG. 1, the normal light observation image 3 and the fluorescence observation image on the screen of the monitor 2. (4) is displayed in parallel.

In addition, although the normal light observation image 3 and the fluorescence observation image 4 are displayed in parallel in FIG. 1, the display method is not limited to this, The normal light observation image 3 and the fluorescence observation image 4 are shown. May be displayed overlaid.

As described above, in the endoscope device 1 of the present embodiment, since the normal light observation image and the fluorescence observation image can be obtained at the same time, the operation for switching the normal light observation and the fluorescence observation, which have been required so far, is eliminated, and the operability of the observer It is possible to reduce the burden caused by the switching operation. Moreover, since images of different observation modes obtained at the same timing can be viewed, there is an advantage that it is easy to contrast the fluorescence observation image with the normal light observation image. It can contribute to the improvement of diagnostic ability.

Furthermore, by performing exposure control of the ordinary light imaging element and gain control of the fluorescence imaging element, both the normal light observation image and the fluorescence observation image can be made an image of appropriate brightness with respect to a common illumination light, and the structure of a light source system The system cost can be reduced by simplifying the operation.

[Second form]

Next, a second embodiment of the present invention will be described. 2nd aspect provides the illumination system which emits blue excitation light for fluorescence observation in a system different from the illumination system for normal light observation about the 1st aspect mentioned above. In addition, the same number is attached | subjected about the member and circuit part which operate | move similarly to 1st aspect, and the description is abbreviate | omitted.

As shown in FIG. 4, the endoscope apparatus 40 of a 2nd aspect drives the electron endoscope 50 which can observe a normal light and fluorescence observation, and this electron endoscope 50, and from the electron endoscope 50, And a video processor 60 for signal-processing the normal light observation image and the fluorescence observation image to display the normal light observation image and the fluorescence observation image on the monitor 2. Similar to the electronic endoscope 10 of the first aspect, the electronic endoscope 50 includes a flexible insertion portion 50a and an operation portion 50b provided on the proximal side of the insertion portion 50a. Is connected to the video processor 60 via a universal code 50c extending from the side.

At the distal end of the insertion end 50a of the electronic endoscope 50, the normal light CCD 11 and the fluorescent CCD 12 are arranged side by side facing forward, and 520 is placed on the front surface of one fluorescent CCD 12. The fluorescence transmission filter 13 which transmits only the light of wavelength of nm-700 nm is arrange | positioned, and the fluorescence transmission filter is not arrange | positioned in front of the other normal light CCD 11. In addition, parallel to the exit end of the light guide 14 that irradiates the illumination light toward the observation range of the objective optical system of both CCDs 11 and 12, blue excitation light from an optical path of a system separate from the light guide 14. A blue LED 51 for emitting light as illumination light is disposed.

The video processor 60 corresponding to the electronic endoscope 50 includes the CCD controller 25 for ordinary light and the fluorescent lamp for driving and controlling the CCD 11 for ordinary light with respect to the video processor 20 of the first embodiment. The fluorescence CCD control unit 26 which drives and controls the CCD 12 and the image synthesizing circuit unit 30 which synthesizes a normal light image and a fluorescence image and outputs them to the monitor 2 are the same, but the light source unit 21 The RGB rotation filter 61 disposed in the illumination light path between the incidence ends of the light guides 14 and the video circuit part 62 for normal light image which processes the imaging signal from the CCD 11 for normal light, and produces | generates a normal light image. ), A functional configuration of a fluorescent image video circuit portion 63 for processing an imaging signal from the fluorescent CCD 12 and generating a fluorescent image, and a timing circuit portion 64 for generating a timing signal for synchronously operating the respective portions. Slightly different.

As shown in Fig. 5, the RGB rotation filter 61 is fluorescent in addition to the three-color filters 61a, 61b, 61c for observing the normal light of red (R), green (G), and blue (B). The blue filter 61d for observation is provided adjacent to the blue filter 61c for normal light observation, and the red filter 61a, and it forms and arrange | positions each in a fan shape. Thus, when the RGB rotation filter 61 is rotated at the same speed by the motor 23, the red filter 61a, the green filter 61b, and the blue filters 61c, 61d are sequentially inserted onto the optical path, As a result, the subjects in front of the tip of the insertion section 50a via the light guide 14 are three in total in the order of red, green, blue (for normal light observation), and blue (for fluorescence observation). The illumination light is repeatedly illuminated, and the blue illumination light is continuously irradiated twice. In addition, the wavelength range of the light which each filter 61a-61d transmits is the same as that of a 1st form.

In addition, the blue LED 51 disposed at the distal end portion of the insertion end 50a of the electronic endoscope 50 emits light at the timing at which the blue filter 61d for fluorescence observation of the RGB rotation filter 61 is inserted onto the optical path. In addition, the amount of illumination light is increased to secure the amount of illumination light required for fluorescence observation. The emission timing of the blue LED 51 is controlled by the timing circuit unit 64 of the video processor 60.

The timing signal from the timing circuit unit 64 includes the normal light CCD control unit 25, the fluorescent CCD control unit 26, the normal light image video circuit unit 62, the fluorescent image video circuit unit 63, and the RGB rotation filter ( It is supplied to the light source part 21 which controls the motor 23 which rotates 61, and the CCD control part 25 and the fluorescent CCD control part 26 for normal light are driven simultaneously. Then, each captured image signal of the subject image and the fluorescent image captured by the normal light at the same timing is output to the video circuit unit 62 for normal light image and the video circuit unit 63 for fluorescent image, and the video circuit unit 62 for normal light image. And the processing in the fluorescent image video circuit unit 63 and the rotation of the RGB rotation filter 61 by the motor 23 are controlled in synchronization with the timing signal from the timing circuit unit 64.

As a result, in the normal light CCD 11, similarly to the first embodiment, imaging is performed by the RGB plane sequential method, and in the normal light video circuit unit 62, a normal color video signal of a subject is obtained. However, in the video circuit part 62 for normal light image, the video signal imaged at the timing of the red filter 61a of the RGB rotation filter 61, the green filter 61b, and the blue filter 61c for normal light observation is used. By synchronizing, a normal light image is generated, and a video signal captured at the timing illuminated by the blue filter 61d and blue LED 51 for fluorescence observation is not used.

On the other hand, from the fluorescent CCD 12, it is illuminated by the blue filter 61d for fluorescence observation and the blue LED 51 of the RCB rotation filter 61, is excited from a subject, and permeate | transmits the fluorescent transmission filter 13 The imaging signal by fluorescence which can be performed, and the imaging signal of the subject illuminated by the RGB rotation filter 61 are transmitted to the video circuit part 63 for fluorescent images.

In the fluorescent image video circuit unit 63, the red filter of the RGB rotation filter 61 is used without using an image pickup signal at a timing illuminated by the blue filter 61c for normal light observation of the RGB rotation filter 61. A fluorescent image is generated by synchronizing the imaging signal at the timing illuminated by the 61a) and the green filter 61b with the imaging signal by fluorescence. In the image synthesizing circuit unit 30, similarly to the first embodiment, the image signal output from the video circuit unit 62 for normal light image and the video circuit unit 63 for fluorescent image is synthesized, and the fluorescence observation image and the normal light observation image are combined. One or both of the synthesized images are generated and output to the monitor 2.

In the endoscope device 40 of the second aspect, similarly to the first aspect, the normal light observation image and the fluorescence observation image can be obtained at the same time, and the switching operation of the normal light observation and the fluorescence observation, which have been required so far, is not necessary, and the observer Improves the operability. In addition, since images of different observation modes obtained at the same timing can be viewed, an advantage of easy contrast between the fluorescence observation image and the normal light observation image can be obtained.

In the endoscope device 40 of the second aspect, the blue LED 51 is emitted at the timing of the blue filter 61d for fluorescence observation to increase the amount of illumination light, so that the control is simpler than in the first aspect. Therefore, the brightness of both the normal light observation image and the fluorescence observation image can be adapted.

[Third form]

Next, a third embodiment of the present invention will be described. The third aspect changes the objective optical system of the fluorescent CCD 12 of the electron endoscope 50 with respect to the second aspect, and changes the function of a part of the video processor 60 with the change of the objective optical system. It is. Hereinafter, the same code | symbol is attached | subjected about the member and circuit part similar to a 1st, 2nd aspect, and description is abbreviate | omitted.

As shown in FIG. 6, the endoscope apparatus 70 of a 3rd form drives the electron endoscope 80 and the electron endoscope 80 which can observe a normal light and a fluorescence observation, and from the electron endoscope 80 is carried out. A video processor 90 is configured to signal-process the normal light observation image and the fluorescence observation image and to display a composite image on the monitor 2. The electronic endoscope 80 includes a flexible insertion portion 80a and an operation portion 80b provided on the proximal end of the insertion portion 80a, similarly to the electronic endoscopes 10 and 50 of the first and second aspects. And a universal code 80c extending from the side of the operation unit 80b.

At the distal end of the insertion end 80a of the electron endoscope 80, the normal light CCD 11 and the fluorescent CCD 12 are arranged in the forward direction, and the observation range of the objective optical system of both CCDs 11 and 12 is arranged. The blue LED 51 which emits blue excitation light as the illumination light and emits this blue excitation light is arranged in the emission end of the light guide 14 which irradiates the illumination light toward.

As shown in Fig. 7, the objective optical system 81 on the front surface of the fluorescent CCD 12 divides the reflected light from the subject into two in the divider 82, and divides the two images by the lenses 83 and 84. It has a structure which forms an image on the imaging surface of the fluorescent CCD 12. On the entire surface of the fluorescent CCD 12, two filters, a first fluorescent transmission filter 85 and a second fluorescent transmission filter 86, are disposed. The first fluorescence transmission filter 85 has a characteristic of transmitting only a wavelength of 520 nm to 580 nm in the filter characteristics of FIG. 3 described in the first embodiment, and the second fluorescence transmission filter 86 is 580 nm. It has the property of transmitting only a wavelength of ˜700 nm.

The first fluorescence transmission filter 85 is a half region of the imaging surface of the fluorescence CCD 12 on the side formed by the lens 83, and the second fluorescence transmission filter 86 is connected to the lens 84. Each of the first and second fluorescent transmission filters 85 and 86 occupies an area of half of the fluorescent CCD 12, such as the other half of the image pickup surface of the fluorescent CCD 12 on the side formed by the same. The front surface of the fluorescent CCD 12 is disposed.

The video processor 90 has the same configuration as that of the light source system (the light source unit 21, the RGB rotation filter 61, and the motor 23) with respect to the second aspect, and generates the fluorescent image in the signal processing circuit system. Synthesis is slightly different. That is, the subject image picked up by the normal light CCD 11 is imaged by the normal light image video circuit 62 in the same manner as the second embodiment, and a normal light image is generated, but the fluorescent light 12 by the fluorescent light 12 The picked-up subject image is imaged by the video circuit part 91 for fluorescent images.

The image generated by the fluorescent image video circuit portion 91 is a fluorescent image at a wavelength of 520 nm to 580 nm obtained by half of the image passing through the first fluorescent filter 85, and the other half is the second fluorescent light transmission. It becomes a fluorescent image in the wavelength of 580 nm-700 nm obtained by passing through the solvent filter 86. In these fluorescent images, for example, a 520 nm to 580 nm fluorescent image is assigned to a G image, and a 580 nm to 700 nm fluorescent image is allocated to an R image and output to the image combining circuit unit 92.

In the image synthesizing circuit unit 92, the normal light image generated by the normal light image video circuit unit 62 and the fluorescent image generated by the fluorescent image video circuit unit 91 are synthesized and output to the monitor 2 for display. . The synthesized image output to the monitor 2 is, for example, as shown in FIG. 6, the fluorescence observation image 4a obtained by passing through the normal light observation image 3 and the first fluorescent transmission filter 85. ) May be a display image in which three of the fluorescence observation images 4b obtained through the second fluorescence transmission filter 86 are arranged, or may be a display image similar to the first and second aspects.

As described above, according to the endoscope apparatus 70 of the third aspect, the normal light observation image and the fluorescence observation image can be obtained at the same time as in the first and second aspects. No switching operation is required, and the operability of the observer is improved. In addition, since images of different observation modes obtained at the same timing can be viewed, an advantage of easy contrast between the fluorescence observation image and the normal light observation image can be obtained. In the third embodiment, since two types of fluorescence having different wavelengths as shown in Fig. 3 can be obtained as respective images, the diagnostic ability of the observer can be improved.

In the objective optical system 81 described in the third embodiment, the reflected light from the subject is divided into two in the divider 82 as shown in FIG. 7, and the two images are separated by the lenses 83 and 84 for the fluorescent CCD. Although the image is formed in (12), the first fluorescence transmission filter 85 and the second fluorescence transmission filter 86 are arranged in a mosaic shape on the front surface of the fluorescence CCD 12, and the fluorescence image video circuit portion ( By controlling the reading in 91, the fluorescent image obtained by passing through the first fluorescent transmission filter 85 and the fluorescent image obtained through the second fluorescent transmission filter 86 may be separated and imaged. ．

[Fourth form]

Next, a fourth embodiment of the present invention will be described. As shown in FIG. 8, the endoscope apparatus 101 of a 4th form drives the electron endoscope 103 and the electron endoscope 103 which can observe normal light and fluorescence observation which have the flexible insertion part 102. As shown in FIG. And a video processor 105 for signal-processing the normal light observation image and the fluorescence observation image from the electronic endoscope 103 to display the normal light observation image and the fluorescence observation image on the monitor 104.

At the distal end of the insertion section 102 of the electronic endoscope 103, the first and second two solid-state imaging elements, the normal light CCD 106 as the normal light imaging means, and the fluorescent CCD 107 as the fluorescence imaging means are all included. It is arranged to face forward. As both the normal light CCD 106 and the fluorescent CCD 107, for example, a charge coupling device (CCD) for monochrome is used.

The objective optical systems 108 and 109 are disposed in front of the two ordinary light CCDs 106 and the fluorescent CCD 107, respectively, so that the image of the object in front of the two normal light CCDs 106 and the fluorescent CCD 107 is respectively disposed. It is formed. In addition, you may comprise so that one objective optical system may be shared by both the normal light CCD 106 and the fluorescent CCD 107.

Between the fluorescent CCD 107 and the objective optical system 109, a fluorescence transmission filter 110 that transmits only light having a wavelength of 520 nm to 600 nm is disposed. Such a filter is not disposed in front of the normal light CCD 106.

Moreover, the exit end of the light guide fiber bundle 111 for illumination which irradiates an illumination light toward the observation range of both objective optical systems 108 and 109 is arrange | positioned in parallel with both objective optical systems 108 and 109.

In the video processor 105, a light source lamp 121 made of, for example, a xenon lamp for supplying illumination light to the light guide fiber bundle 111 for illumination is disposed, and the light source lamp 121 and the light guide fiber bundle for illumination ( An RGB rotation filter 122 is disposed in the illumination light path between the incident ends of 111.

As shown in FIG. 9, three color filters of red (R), green (G), and blue (B) are formed in a fan shape in the RGB rotation filter 122, and the motor 123 By rotating at constant speed.

In addition, the wavelength range of the light which each color filter transmits is as follows, for example. Red (R): 580 nm-650 nm. Green (G): 500 nm-580 nm. Blue (B): 400 nm-500 nm.

As a result, the subject in front of the tip of the insertion part 102 is repeatedly illuminated by three colors of illumination light of red, green, and blue via the light guide fiber bundle 111 for illumination.

The normal light CCD 106 is driven by the normal light CCD driver 115 which is a normal light image pickup drive means, and the image pickup signal is a normal light image signal processing means in the video processor 105 through the selector 117. It is output to the image video circuit 124.

On the other hand, the fluorescence CCD 107 provided with the fluorescence transmission filter 110 in front is driven by the fluorescence CCD driver 116 which is a fluorescence imaging driving means, and the imaging signal is used for the fluorescence image in the video processor 105. It is output to the fluorescent image video circuit 126 which is a signal processing means.

In addition, the imaging signal of the fluorescent CCD 107 can be output to the normal video circuit 124 via the selector 117.

Then, the normal light CCD 106 and the fluorescent CCD 107 are driven (the normal light CCD driver 115 and the fluorescent CCD driver 116 are driven), the normal image video circuit 124 and the fluorescent image video. Processing in the circuit 126 and rotation of the motor 123 for rotating the RGB rotation filter 122 are controlled in synchronization with the output signal from the timing circuit 125.

As a result, in the normal light CCD 106, image pickup is performed by a so-called RGB plane sequential method, and in the normal image video circuit 124, a normal color video signal of a subject is obtained.

On the other hand, the image signal captured by the fluorescent CCD 107 and transmitted to the fluorescent image video circuit 126 is therefore only an image signal when the subject is illuminated with blue illumination light (wavelengths 400 nm to 500 nm). Extracted. That is, since the image obtained by the fluorescent CCD 107 is only an image by the light of the wavelength which can permeate | transmit the fluorescent transmission filter 110, it is based on the excitation light of wavelength 400nm-500nm contained in blue illumination light. The fluorescent image excited from the subject is extracted by the fluorescent image video circuit 126.

The fluorescence image signal output from the fluorescence image video circuit 126 and the color image signal output from the normal image video circuit 124 are input to the image composition circuit 128 which is an image composition means provided with the notification means, The image synthesizing circuit 128 performs an image synthesizing process so that the composite image composed of one or both of the fluorescent image and the normal image is displayed on the monitor 104.

The color image signal output from the normal image video circuit 124 is also output to the first image output detection circuit 131 which is a normal light image processing monitoring means, and is further output from the fluorescent image video circuit 126. The image signal is also output to the second image output detection circuit 132 which is a fluorescent image processing monitoring means.

The first image output detection circuit 131 and the second image output detection circuit 132 have the same configuration, and detect the output of each image signal, and based on the detection result, switching control of the selector, and normal image video. Process control in the circuit 124 and the fluorescent image video circuit 126 and image composition control in the image synthesis circuit 128 are performed.

Specifically, as shown in FIG. 10, the first image output detection circuit 131 (or the second image output detection circuit 132) is a color image signal output from the image video circuit 124. The image sampling unit 141 for sampling the RB, the RCB average value calculating unit 142 for calculating the average value of the R / G / B / images sampled by the image sampling unit 141, and the RGB average value calculating unit 142. An image non-output detection unit 143 that detects non-output of an image based on the color, a color difference signal calculator 144 that calculates a color difference signal from an R / G / B / image sampled by the image sampling unit 141, and a color difference signal calculator ( The CrCb average value calculating unit 145 for calculating the average value of the color difference signal calculated by 144, the noise image detecting unit 146 for detecting the noise image based on the calculation result of the CrCb average value calculating unit 145, and the image non-output detecting unit 143 Detection result and noise image detection unit 146 OR circuit part 147 which takes OR of a detection result and outputs it as an output abnormality occurrence signal of an image output detection circuit is comprised.

The image sampling unit 141 samples the R, G, and B data values from the endoscope image portion excluding the character region, and outputs them to the RGB average value calculator 142 and the color difference signal calculator 144.

The RGB average value calculating unit 142 calculates an average value of one screen of R, C, and B data values and outputs the average value to the image non-output detection unit 143.

When the image non-output detection unit 143 detects that the average value of the R, G, and B data is all "0" for a plurality of screens, the image non-output signal is assumed to be non-output and outputs the image non-output signal to the OR circuit unit 147.

In addition, the color difference signal calculator 144 calculates the color difference signals Cr and Cb from the R, G, and B data values, and the CrCb average value calculator 145 calculates the average value of Cr and Cb for one screen, thereby making the noise image detector 146 )

Cr = 0.5R-0.419G-0.081B

Cb = -0.169R-0.331G + 0.5B

The noise image detection unit 146 detects whether or not it is a noise image based on which position of the Cr-Cb color plane coordinates shown in FIG. 11 based on the average value of Cr and Cb, and detects the detection result by OR circuit unit. Output to (147).

In general, since various color components are randomly generated in the noise image, since the average value of Cr and Cb is distributed near the origin of the Cr-Cb color plane coordinates, in the present embodiment, the Cr-Cb color of FIG. The noise image generation signal is output to the OR circuit unit 147 as a noise image when it is located within the dotted line of the plane coordinates.

When the OR circuit unit 147 determines that the image signal is not normally output by the image non-output signal from the image non-output detection unit 143 or the noise image generation signal from the noise image detection unit 146, an output abnormality generation signal is output. Output to the selector 117, the normal image video circuit 124, the fluorescent image video circuit 126, and the image synthesis circuit 128.

According to the output abnormality occurrence signal, for example, when there is an abnormality in the fluorescent image, only the normal light image is displayed on the monitor 104. When there is an abnormality in the normal light image, the fluorescent image is normally displayed through the selector 117. The image is output to the video circuit 124 and a pseudo normal light image is generated from the fluorescent image and displayed on the monitor 104. 12 to 25 show display examples of the monitor 104. In addition, this display may be selectable.

The pseudo normal image is an image generated by outputting the output of the fluorescent CCD 107 to the normal image video circuit 124 and generated as a normal image. The fluorescent transmission that cuts excitation light on the entire surface of the fluorescent CCD 107 is performed. Since the dragon filter 110 is provided, the color tone of blue is slightly different from that of a normal image, but it is a level without problem as an emergency image.

(1) FIG. 12 is a display example in which the normal light image and the fluorescent image are both normal, and the monitor 104 displays the normal light image and the fluorescent image.

(2) FIG. 13 is a display example in which a normal light image is normal and a fluorescence image is abnormal. A normal light image is displayed on the monitor 104, and a normal light image is also displayed in a region where a fluorescent image is displayed. Here, the image synthesizing circuit 128 has a notifying means, and by means of the notifying means of the image synthesizing circuit 128, for example, the border of the normal light image in the region where the fluorescent image is displayed is made a thick border, thereby making it possible to produce a fluorescent image. Notice more than this.

In addition, this notification enables the operator to easily recognize that a problem has occurred in fluorescence observation, so that appropriate response can be made, and the patient can determine whether a problem occurs in the hand technique only by the image of the monitor 104. Do not be anxious because you can not judge.

(3) FIG. 14 shows a normal light image in the center region of the monitor 104 as a display example when the normal light image is normal and the fluorescent image is abnormal. The notification means of the image synthesizing circuit 128 notifies that the fluorescent image is abnormal by this display mode.

(4) FIG. 15 is a display example in which the normal light image is normal and the fluorescence image is abnormal. The display means of the image synthesizing circuit 128 displays the normal light image on the monitor 104 and displays the fluorescent image. A message indicating that fluorescence cannot be observed is displayed in this displayed area.

As the message, in addition to "Cannot observe fluorescence", the message may be "Cancel fluorescence observation", "Only normal light observation can be used", "No fluorescence observation" or "normal light observation". .

(5) FIG. 16 is a display example in which a normal light image is normal and a fluorescence image is abnormal. The display means of the image synthesizing circuit 128 displays a normal light image on the monitor 104 and displays a fluorescent image. Color bars are displayed in the displayed area.

(6) FIG. 17 is a display example in which a normal light image is normal and a fluorescence image is abnormal. An enlarged image of a normal light image is displayed in the center region of the monitor 104 by the notifying means of the image synthesizing circuit 128. FIG. do.

(7) FIG. 18 is a display example in which a normal light image is abnormal and a fluorescence image is normal. The display unit 104 displays a fluorescent image on the monitor 104 by means of the image synthesizing circuit 128, and displays a normal light image. A fluorescent image is also displayed in this displayed area. Here, the notification means of the image synthesizing circuit 128 informs that the normal light image is abnormal by, for example, making the border of the fluorescent image in the region where the normal light image is displayed as a thick border.

(8) FIG. 19 is a display example in which the normal light image is abnormal and the fluorescent image is normal, and is generated based on the fluorescent image instead of the normal light image and the fluorescent image by the notification means of the image synthesizing circuit 128. FIG. The pseudo normal light image is displayed, respectively, and the border of the pseudo normal light image is made a thick border, and it is known that the normal light image is abnormal.

(9) FIG. 20 is a display example in which the normal light image is abnormal and the fluorescent image is normal, and an enlarged image of the fluorescent image is displayed in the center region of the monitor 104 by the notifying means of the image synthesizing circuit 128. FIG. In addition, by making the edge of the enlarged fluorescent image a thick edge, it is known that the normal light image is abnormal.

(10) FIG. 21 is a display example in which the normal light image is abnormal and the fluorescent image is normal. The display means of the image synthesizing circuit 128 displays the pseudo normal light image on the monitor 104 and the fluorescent light is displayed. A message indicating that fluorescence cannot be observed is displayed in the area where the image is displayed. Moreover, by making the border of a pseudo normal light image into a thick border, it is notified that a normal light image is abnormal.

(11) FIG. 22 is a display example in which a normal light image is abnormal and a fluorescence image is normal. The display unit 104 displays a fluorescent image on the monitor 104 by the notification means of the image combining circuit 128, and displays a normal light image. A message indicating that normal light cannot be observed is displayed in this displayed area.

(12) FIG. 23 is a display example in which a normal light image is abnormal and a fluorescence image is normal, and a pseudo normal light image is displayed on the monitor 104 by the notification means of the image synthesizing circuit 128. A message indicating that fluorescence cannot be observed is displayed in the area where the normal light image is displayed. Moreover, by making the border of a pseudo normal light image into a thick border, it is notified that a normal light image is abnormal.

(13) FIG. 24 is a display example in which a normal light image is abnormal and a fluorescence image is normal. The display unit 104 displays a pseudo normal light image on the monitor 104 by the notification means of the image combining circuit 128. Color bars are displayed in the area where the image is displayed. Moreover, by making the border of a pseudo normal light image into a thick border, it is notified that a normal light image is abnormal.

(14) FIG. 25 is a display example in which the normal light image is abnormal and the fluorescent image is normal, and the false normal image or the fluorescent image is displayed in the center area of the monitor 104 by the notifying means of the image synthesizing circuit 128. FIG. The enlarged image is displayed. Moreover, by making the edge of the enlarged pseudo normal light image or the fluorescent image into a thick frame, it is notified that the normal light image is abnormal.

As described above, in the present embodiment, when a failure or the like occurs in one CCD, the operator is notified in the display form of the monitor display that a failure or the like has occurred. It becomes possible, and also does not give anxiety about a patient.

In addition, when a malfunction or the like occurs in the normal light CCD 106, the normal light observation can be continued by the pseudo normal light image using the fluorescent CCD 107, so that the operator is close to the usual familiar image. The treatment can be handled under the circumstances.

In addition, as shown in FIG. 26, the image sampling unit 141 for sampling the color image signal output from the normal image video circuit 124 and the R / C / B / sampled by the image sampling unit 141. R / R from the RGB average value calculator 142 for calculating the average value of the image, the image non-output detector 143 for detecting the non-output of the image based on the calculation result of the RGB average value calculator 142, and the RGB average value calculator 142. A color difference signal calculator 144 that calculates a color difference signal from an average value of G / B / images, a noise image detector 146 that detects a noise image based on a calculation result of the color difference signal calculator 144, and an image non-output detector ( OR circuit section 147 which takes an OR of the detection result of 143 and the detection result of noise image detection section 146 and outputs it as an output abnormality occurrence signal of the image output detection circuit, and includes the first image output detection circuit 131 (or Second image output May be configured to output circuit 132), it is possible to reduce the circuit scale.

In this configuration, the color difference signal calculating unit 144 calculates the average R-Y and B-Y in one screen of the R, G, and B data values after sampling, not Cr or Cb.

R-Y = 0.7R-0.59G-0.11B

B-Y = -0.3R-0.59G-0.89B

In addition, although it is assumed that it is a noise image when it is located within the dotted line of Cr-Cb color plane coordinate in FIG. The noise image detection unit 146 may detect the noise image generation when detecting a distribution skewed to one side on the Cr-Cb color plane coordinates.

In order to improve the accuracy of noise image detection and image non-output detection, the image may be divided into blocks, an average value may be calculated for each block, and noise image detection and image non-output detection may be performed. It may be performed by frequency analysis.

In the present embodiment, the selector 117 is used, but the selector can be omitted by configuring as shown in FIG.

In the present embodiment, the first image output detection circuit 131 and the second image output the color image signal output from the normal image video circuit 124 and the fluorescent image signal output from the fluorescent image video circuit 126. The signal is processed by the output detection circuit 132 to detect abnormality of the normal light CCD 106 or the fluorescent CCD 107. However, the present invention is not limited thereto, and as the first modification of the video processor 105, As shown in FIG. 29, the drive signal which detects the drive signal of the normal light CCD driver 115 which drives the normal light CCD 106, and the fluorescent CCD driver 116 which drives the fluorescent CCD 107, respectively. The detection circuits 151 and 152 are provided in place of the image output detection circuit, and the failure of the CCD is detected by monitoring the driving states of the normal light CCD driver 115 and the fluorescent CCD driver 116, and the image output detection circuit Like It is also possible to control the selector and the like.

As a second modification of the video processor 105, as shown in FIG. 30, the CCD output detection circuit 161 which detects the imaging signals from the normal light CCD 106 and the fluorescent CCD 107, respectively, 162 is provided in place of the image output detection circuit, and by directly monitoring the output states of the normal light CCD driver 115 and the fluorescent CCD driver 116, a failure of the CCD or the like is detected, and a selector or the like similarly to the image output detection circuit. May be controlled.

By the way, in the endoscope apparatus 101 of this embodiment, as shown in FIG. 31, the probe 172 is inserted through the treatment instrument channel 171 of the electronic endoscope 103, etc., and the affected part is processed, for example. Therapeutic laser device 173 or the like is used.

When the treatment by the treatment laser device 173 is performed, a laser beam is irradiated to the affected part from the tip of the probe 172. In general, since the fluorescence from the living body is weak, the gain of the imaging signal from the fluorescent CCD 107 is set higher than the gain of the imaging signal from the normal light CCD 106, and when the laser light is irradiated to the affected part, the fluorescence The image from the CCD 107 causes halation or becomes an image in which noise is amplified.

Thus, in the video processor 105 shown in FIG. 31, a communication interface (hereinafter referred to as communication I / F) 174 for inputting an operation signal of the treatment laser device 173 is provided, and the communication I / F 174 is provided. When it is detected that the treatment laser device 173 has been manipulated, the image synthesizing circuit 128 is controlled, and the fluorescent image is erased from the monitor display as shown in FIG. At this time, the image size can be enlarged and displayed in a full screen. However, some operators may not like changing the screen size. Therefore, if the screen size can be specified in a menu or the like, According to the device can be. In addition, the screen switching itself at the time of use of the treatment laser device 173 may be made available to a user from a menu or the like. The same operation is made not only in the treatment laser device 173 but also in the use of the electric scalpel.

In the configuration shown in Fig. 31, since the switching to the normal light image is automatically performed when the therapeutic laser device 173 or the electric scalpel is used, it is possible to prevent the operator from displaying a noise-amplified image without any trouble. can do.

In the video processor 105 of the present embodiment, the light source means is incorporated, but as shown in FIG. 32, the light source device 181 may be provided separately from the video processor 105. This kind of light source When the device 181 monitors the lighting state of the light source lamp 121 by the CPU 190 or the like, and detects that the light source lamp 121 does not light due to a failure or the like, the emergency light 191 is inserted into the optical path to illuminate the illumination light. Supply of. The lighting monitoring of the light source lamp 121 is performed by monitoring the current value flowing through the light source lamp 121.

In the configuration of FIG. 32, when the CPU 190 performs switching control to the emergency light 191, the switching signal from the CPU 190 passes through the image I / F 174 of the video processor 105 through the image synthesizing circuit 128. The image combining circuit 128 cancels simultaneous display of the normal light image and the fluorescent image on the basis of the switching signal, and monitors only the normal light image as shown in FIG. Also in this case, the screen size at this time can be specified in a menu or the like.

Further, based on this switching signal, the image synthesizing circuit 128 may display the normal light image in the display area of the fluorescent image as shown in FIG. 13, and display the same normal light image in two screens. . In this case, since neither the screen size nor the image position changes, the operator does not move the viewpoint, thereby reducing fatigue of the operator.

[Fifth form]

Next, a fifth embodiment of the present invention will be described. As shown in FIG. 33, the endoscope apparatus 201 as an image processing apparatus includes the electronic endoscope 202 which image | photographs a subject, the light source part 203 as a light source means which supplies illumination light to the electronic endoscope 202, The monitor 207 displaying an image of the subject based on the processor 206, the image signal output from the processor 206, and the image of the subject displayed on the monitor 207 as display means (hereinafter also referred to as an endoscope image). Monitor image photographing apparatus 208A for photographing the image, an image filing apparatus 208B connected to the processor 206, and recording image information and the like, and the processor 206 for performing image processing. The main part includes a keyboard 209 for outputting an instruction signal and inputting patient data.

In addition, the processor 206 performs image processing on the image processing block 204 that performs signal processing on the image pickup signal output from the electronic endoscope 202, and the signal output from the image processing block 204, and performs an image processing. It is comprised with the image processing block 205 which outputs as a signal, and the image recording part not shown which records the image signal output from the image processing block 205. FIG.

The electronic endoscope 202 has a thin and long flexible insert 211, for example, and a thick operating portion 212 is successively provided at the rear end of the inserting portion 211, and the rear end of the operating portion 212. The flexible universal cord 213 extends from the side of the side. In addition, the connector 214 provided at the end of the universal cord 213 has a structure that can be detachably connected to the connector receiving portion 215 of the processor 206.

The insertion end 211 of the electronic endoscope 202 has a rigid tip portion 216, a bendable curved portion 217 adjacent to the tip portion 216, and a long flexible portion 218 having flexibility, at the tip side. It is installed sequentially from.

The bending operation knob 219 provided in the operation part 212 of the electronic endoscope 202 has the structure which can bend the bending part 217 to a left-right direction or an up-down direction according to the rotation movement operation by a user. In addition, the operation unit 212 of the electronic endoscope 202 is provided with an insertion port 220 communicating with a treatment instrument channel (not shown) provided in the insertion unit 211.

In the apex part of the operation part 212 of the electronic endoscope 202, it has switches, such as a freeze switch which performs a freeze instruction | measurement, a release switch which performs a release instruction | indication, and an observation mode switching switch which performs an observation mode switching instruction | command. The scope switch 210 which is comprised is provided.

For example, when a freeze instruction is performed by operating the scope switch 210, the instruction signal is output from the scope switch 210. As shown in FIG. 34, the instruction signal output from the scope switch 210 is input to a control circuit 240 described later included in the processor 206. The control circuit 240 controls the memory unit 239 to be described later so that a freeze image is displayed based on the instruction signal output from the scope switch 210.

When the electronic endoscope 202 and the processor 206 are connected, the scope ID memory 248 provided inside the electronic endoscope 202 is, for example, an observation mode (normal image) to which the electronic endoscope 202 can respond. , Self-fluorescence observation, narrow band light observation and infrared light observation), the adaptation site of the electronic endoscope 202 (upper digestive tract, lower digestive tract and bronchus), and the variation of the description of the electronic endoscope 202 (model difference and individual difference) Information, such as a correction parameter, is output to the control circuit 240 and the CPU 256.

When the electronic endoscope 202 and the processor 206 are connected, the identification information circuit 243 provided inside the electronic endoscope 202 may, for example, transmit information such as model information to the control circuit 240 and the CPU ( 256).

The white balance adjustment circuit 238 provided in the image processing block 204 of the processor 206 corrects the fluctuation of color tone generated by the electronic endoscope 202, for example, from variations in substrates such as transmission characteristics of the optical system. Signal processing is performed.

Here, the recording method of the endoscope image displayed on the monitor 207 will be described.

The user operates the keyboard 209 and the front panel 255 of the processor 206 and the like to output an instruction signal for the freeze instruction to the control circuit 240. The control circuit 240 performs control corresponding to the freeze instruction based on the instruction signal.

In addition, the user outputs an instruction signal for performing a release instruction by operating the keyboard 209, the front panel 255 of the processor 206, and the like. If the freeze image is not displayed on the basis of the instruction signal, the CPU 256 controls the display state of the freeze image through the control circuit 240 and provides the monitor image photographing apparatus 208A. And outputs a control signal based on the release instruction. The monitor image photographing device 208A performs the photographing of the endoscope image displayed on the monitor 207 based on the control signal output from the CPU 256.

Here, the method of image processing is demonstrated.

The user operates the keyboard 209 and the front panel 255 of the processor 206 and the like to output an instruction signal for performing an image processing instruction. The CPU 256 is based on the instruction signal, based on the IHb processing block 244, the IHb calculation circuit 261, the IHb average value calculation circuit 262, the luminance detection circuit 267, the invalid area detection circuit 268, and the like. By controlling the above, image processing corresponding to the image processing instruction is performed. The user can also stop image processing performed by each of the IHb processing blocks 244 at a desired timing, for example, by manipulating the keyboard 209, the front panel 255 of the processor 206, and the like. .

In addition, the user outputs an instruction signal for performing an observation mode switching instruction by operating the scope switch 210 of the electronic endoscope 202. The control circuit 240 moves the rotary filter 227 and the band switching filter 280 by controlling the moving motor 231 and the motor 281 which will be described later based on the instruction signal. For example, the observation mode is switched from the normal observation mode to the fluorescence observation mode.

Here, the electronic endoscope 202 and the light source unit 203 will be described.

As shown in FIG. 34, the front-end | tip part 216 of the electronic endoscope 202 is comprised with the illumination lens 221 and the imaging part 230. As shown in FIG.

As illustrated in FIG. 43, the imaging unit 230 is provided at the imaging positions of the objective optical systems 222a and 222b for forming an image of a subject and the objective optical system 222a, and is formed by the objective optical system 222a. The CCD 230a serving as the imaging means and the objective optical system 222b for imaging the image of the imaged subject, and the CCD 230a for imaging the image of the subject imaged by the objective optical system 222b. On the other hand, the CCD 230b serving as the imaging means capable of high sensitivity imaging, the switching unit 230c for switching the driving states of the CCD 230a and the CCD 230b based on the switching signal output from the control circuit 240; And the excitation light cut filter 232 disposed on the entire surface of the imaging surface of the CCD 230b. In addition, the excitation light cut filter 232 has a function of blocking 390-450 nm excitation light to extract fluorescence.

In the present embodiment, the switching unit 230c drives the CCD 230a when the observation mode of the endoscope device 201 is switched to the normal observation mode, and the observation mode of the endoscope device 201 observes fluorescence. In the case of switching to the mode, the CCD 230b is driven.

Moreover, the emission end which is one end of the light guide 223 which consists of a fiber bundle is arrange | positioned at the rear end side of the illumination lens 221. The light guide 223 is provided to penetrate the insertion portion 211, the operation portion 212, and the inside of the universal cord 213, and the other end of the light guide 223 is disposed inside the connector 214. . The light guide 223 has such a configuration, so that the illumination light emitted from the light source unit 203 in the processor 206 is the same as that of the light guide 223 when the connector 214 is connected to the processor 206. After entering the incidence end, the light exits from the exit end disposed on the rear end side of the illumination lens 221 to illuminate the subject.

The light source unit 203 has a lamp 224 made of, for example, a xenon lamp that emits illumination light including visible light. The illumination light emitted from the lamp 224 is incident on the rotary filter 227 rotated by the motor 226 through the diaphragm 225 disposed on the light path of the lamp 224. And the illumination light which permeate | transmits through the rotation filter 227 is condensed by the condensing lens, and is incident on the incidence end of the light guide 223. In addition, the aperture 225 has a configuration for driving in accordance with the driving state of the aperture motor 225a controlled by the control circuit 240.

As shown in FIG. 35, the rotation filter 227 is disposed on the inner circumferential side of the concentric circle, and the fluorescence observation filter 229 is disposed on the outer circumferential side of the concentric circle. It has a structure called. In addition, the rotary filter 227, along with the motor 226 for rotating the rotary filter 227, is moved to the optical path of the lamp 224, which is the direction indicated by the arrow P in FIG. 34, by the motor 231 for movement. It is moved in the direction orthogonal to it. That is, when the instruction to switch the observation mode is made, the moving motor 231 switches the filter arranged on the optical path of the lamp 224 by moving the motor 226 and the rotary filter 227. In addition, in this embodiment, the control circuit 240 arrange | positions the RGB filter 228 on the optical path of the lamp 224, when the normal observation mode, narrowband light observation mode, or infrared light observation mode is selected as an observation mode. A switching signal for performing the control to perform the control; and a switching signal for performing the control of arranging the fluorescence observation filter 229 on the optical path of the lamp 224 when the fluorescence observation mode is selected as the observation mode, It is assumed that the motor 231 is output to the mobile motor 231, respectively.

The RGB filter 228 is comprised with the R filter 228a, the G filter 228b, and the B filter 228c which each filter has the transmission characteristic shown in FIG. Specifically, the R filter 228a transmits the red wavelength band from 600 nm to 700 nm, and the G filter 228b transmits the green wavelength band from 500 nm to 600 nm, and the B filter. 228c has a structure that transmits a blue wavelength band from 400 nm to 500 nm.

In addition to the above-described configuration, the R filter 228a and the C filter 228b have a configuration that transmits a wavelength band of 790-820 nm for infrared light observation. In addition to the above-described configuration, the B filter 228c has a configuration that transmits a wavelength band of 900 to 980 nm for infrared light observation. Therefore, in the normal observation mode, the processor 206 uses the imaging signal based on the image of the subject imaged under the illumination light transmitted through the R filter 228a, and the image of the subject imaged under the illumination light transmitted through the G filter 228b. By synthesizing the image pickup signal based on the image and the image pickup signal based on the image of the subject imaged under the illumination light passing through the B filter 228c, the subject is visually observed as the image of the subject. The observation image for normal observation which is an image which shows the image substantially similar to one image is produced | generated.

The fluorescence observation filter 229 includes a G2 filter 229a, an E filter 229b, and an R2 filter 229c in which each filter has a transmission characteristic shown in FIG. Specifically, the G2 filter 229a transmits a wavelength band from 540 nm to 560 nm, the E filter 229 b transmits a wavelength band from 400 nm to 470 nm, and the R2 filter 229 c And transmits a wavelength band from 600 nm to 620 nm.

37, the transmittances of the G2 filter 229a and the R2 filter 229c are set lower than those of the E filter 229b. Therefore, in the fluorescence observation mode, the processor 206 uses the imaging signal (hereinafter abbreviated as G2 signal) and the R2 filter 229c based on the image of the subject imaged under the illumination light passing through the G2 filter 229a. Processing such as synthesis is performed on an imaging signal (hereinafter abbreviated as R2 signal) based on the image of the subject imaged under the illumination light having passed through, and a fluorescence signal which is an imaging signal based on the fluorescence image generated by the subject. By doing so, as the image of the subject, an observing image for fluorescence observation is generated in which the image of fluorescence generated from the subject is a pseudo-colored image.

The band switching filter 280 is comprised with the normal / fluorescence observation filter 280a, the narrow band light observation filter 280b, and the infrared light observation filter 280c, as shown in FIG. In addition, the normal / fluorescence observation filter 280a and the infrared light observation filter 280c have the transmission characteristic as shown in FIG. In addition, the narrow band light observation filter 280b is comprised by the three-season filter which permeate | transmits three discrete bands in one filter.

The excitation light cut filter 232 in the electron endoscope 202 is configured with a transmission characteristic as shown in FIG. 41 in which the transmission band does not overlap with the transmission characteristic of the E filter 229b shown in FIG. 37. .

The band switching filter 280 is rotationally driven by the motor 281 by the filter switching instruction signal from the CPU 256. In the band switching filter 280, when the normal observation and the fluorescence observation are performed by the rotational drive of the motor 281, the normal / fluorescence observation filter 280a is disposed on the optical path of the lamp 224. When the narrow band light observation is performed, the narrow band light observation filter 280b is disposed on the optical path of the lamp 224. When the infrared light observation is performed, the infrared light observation filter 280c is the lamp 224. It has a structure arrange | positioned on the optical path of.

When the observation is normally performed by the combination of the rotary filter 227 and the band switching filter 280 disposed on the optical path of the lamp 224, the light having the bands of red, green, and blue is the light source unit 203. It is emitted sequentially. In addition, when narrow-band light observation is performed, the band of 600 nm-630 nm, the band of 530 nm-660 nm, and 400 by the combination of the transmission characteristic shown in FIG. 36, and the transmission characteristic shown in FIG. Light having a band from nm to 430 nm is sequentially emitted from the light source unit 203.

On the other hand, when infrared light observation is performed, a band from 790 nm to 820 nm, a band from 790 nm to 820 nm, and 900 by a combination of the transmission characteristics shown in FIG. 36 and the transmission characteristics shown in FIG. 39. Light having a band from nm to 980 nm is sequentially emitted from the light source unit 203.

And when fluorescence observation is performed, the band from 540 nm to 560 nm, the band from 390 nm to 450 nm, and 600 nm by the combination of the transmission characteristics shown in FIG. 37 and the transmission characteristics shown in FIG. 39. Light having a band from 620 nm is sequentially emitted from the light source unit 203. In addition, light having a band from 390 nm to 450 nm is excitation light for exciting self-fluorescence from living tissue.

Illumination light incident on the light guide 223 of the electronic endoscope 202 is irradiated to a subject such as a living tissue from the distal end portion 216 of the electronic endoscope 202. The light scattered, reflected, and emitted by the subject is imaged and picked up by the imaging unit 230 provided in the tip portion 216 of the electronic endoscope 202.

In addition, the illumination light incident on the light guide 223 of the electronic endoscope 202 is guided to the tip portion 216 by the light guide 223 and then passes through the illumination lens 221 attached to the irradiation window of the tip surface. Then, the subject is irradiated. In this case, in the normal observation mode, it becomes illumination light of plane order of R (red), G (green), and B (blue). In addition, in fluorescence observation mode, it becomes illumination light of the surface sequence of G2, E, and R2.

The CCD 230a and 230b are driven in synchronization with the rotation of the rotary filter 227 by applying the CCD drive signal by the CCD driver 233. In addition, the CCDs 230a and 230b photoelectrically convert images formed by the objective optical systems 222a and 222b, respectively, and output them as an image pickup signal. Thereby, the processor 206 outputs the imaging signal corresponding to the irradiation light which permeate | transmitted the RGB filter 228 and the fluorescence observation filter 229 which the rotation filter 227 has, respectively.

In addition, the control circuit 240 or the CPU 256 can control the CCD driver 233 to perform the operation of the electronic shutter which variably controls the charge accumulation time by the CCDs 230a and 230b.

Here, the processor 206 will be described.

The time-series image pickup signals output from the CCDs 230a and 230b are input to the amplifier 234 provided in the image processing block 204 and then amplified to a predetermined signal level, for example, between 0 and 1 volt. .

In this case, the time-series captured image signal is a color signal of R, G, and B in the normal observation mode, and is a G2 signal, a fluorescence signal, and an R2 signal in the fluorescence observation mode. Moreover, in narrowband observation mode and infrared observation mode, it becomes a signal according to each illumination light.

The captured image signal output from the amplifier 234 is converted into a digital signal by the A / D converter 235 and output to the auto gain control circuit (hereinafter abbreviated as AGC circuit) 236. Then, the gain is controlled by the AGC circuit 236 and output so that the image pickup signal output from the A / D converter 235 is at an appropriate signal level.

The imaging signal output from the AGC circuit 236 is input to the selector 237 of one input and three outputs. The pick-up signal sent in time series is selected by the white balance adjustment circuit in order, while the selector 237 switches each of the color signals R, G, and B, or the G2 signal, the fluorescent signal, and the R2 signal, respectively. 238). The white balance adjustment circuit 238 adjusts the gain, that is, white balance, so that the signal level of each of the color signals of R, G, and B is the same when the white subject as the reference is picked up. In addition, the captured image signal output from the white balance adjustment circuit 238 is a part of the freeze image generating means and is input to the memory unit 239 as the storage means. The white balance adjustment may be automatically performed by reading the adjustment value for white balance from the scope ID memory 248 provided in the electronic endoscope 202.

Image signals, such as color signals of R, G, and B, which are input in time series, are transferred to R, G, and B memories 239r, 239g, and 239b as freeze memories, which constitute the memory unit 239. Each is stored.

By the memory unit 239 having the above-described configuration, in the normal observation mode, the R color signal is stored in the R memory 239r and the G color signal is stored in the G memory 239g. The color signals of B are stored in the B memory 239b, respectively. In the fluorescence observation mode, the G2 signal is stored in the R memory 239r, the fluorescence signal is stored in the G memory 239g, and the R2 signal is stored in the B memory 239b, respectively.

In addition, A / D conversion by the A / D converter 235, switching of the selector 237, control during white balance adjustment, and R, G, and B memories 239r, 239g, and 239b of the memory unit 239. The writing and reading of the imaging signals, such as the color signals of R, G, and B, respectively, are controlled by the control circuit 240. That is, the imaging signal output from the white balance adjustment circuit 238 is written into the memory unit 239 based on the write signal output from the control circuit 240 to the memory unit 239. The image pickup signal written in the memory unit 239 is read out from the memory unit 239 based on the read signal outputted from the control circuit 240 to the memory unit 239.

In addition, the control circuit 240 sends a reference signal to the synchronization signal generation circuit (abbreviated as SSG in FIG. 34) 241, and the synchronization signal generation circuit 241 generates a synchronization signal in synchronization with it. In addition, the control circuit 240 performs control to prohibit writing to the R, G, and B memories 239r, 239g, and 239b, so that the still image is displayed on the monitor 207. In addition, the write inhibit control of the R, G, and B memories 239r, 239g, and 239b can also be performed by the synchronization circuit 253.

In addition, the image pickup signal output from the A / D converter 235 is metered by the photometric circuit 242 and then input to the control circuit 240.

The control circuit 240 compares the average value obtained by integrating the signal metered by the photometric circuit 242 with a reference value when the brightness is appropriate, and outputs a dimming signal based on the result of the comparison. To drive. Then, the control circuit 240 emits from the light source unit 203 so that the difference between the average value and the reference value is reduced by controlling the aperture amount of the aperture 225 driven in conjunction with the aperture motor 225a. Adjust the amount of illumination light.

The aperture motor 225a is provided with a rotary encoder (not shown) for detecting the aperture position corresponding to the aperture amount of the aperture 225, and the detection signal of the rotary encoder is supplied to the control circuit 240. Is entered. The control circuit 240 can detect the position of the diaphragm 225 by the detection signal output from the rotary encoder. In addition, the control circuit 240 is connected to the CPU 256. Therefore, the CPU 256 can confirm the position of the diaphragm 225 detected by the control circuit 240.

Here, description will be given of the image processing which becomes effective in the normal observation mode.

In the case of the normal observation mode, each of the color signals of R, C, and B read out from the R, G, and B memories 239r, 239g, and 239b constitutes the image processing block 205. It inputs into the IHb process block 244 which performs processing, such as calculation of the value (henceforth IHb abbreviation) which correlates with the amount of hemoglobin as the amount of pigment used.

In the present embodiment, the IHb processing block 244 calculates, for example, the value of IHb in each pixel in the ROI set in the setting screen of the processor 206 as shown in FIG. 42, and calculates the IHb value of the IHb. An IHb processing circuit unit 245 which performs a pseudo image generation process for displaying an IHb image, which is an image displayed based on the value, as a pseudo color image, and an invalid area for detecting an invalid region not suitable for image processing with respect to the set region of interest. It is comprised with the area detection part 246. Specifically, the IHb calculation circuit 261 calculates the value of IHb in each pixel by performing the calculation based on the following expression (1).

In Equation 1, R represents data of the R image in the region excluding the invalid region in the region of interest, and G represents the G image in the region excluding the invalid region in the region of interest. It is assumed to represent data.

The signal output from the IHb processing block 244 is output after the gamma correction is performed by the gamma correction circuit 250, and is then subjected to structural enhancement by the subsequent image processing circuit 251. The signal output from the rear-end image processing circuit 251 is superimposed on the character superimposition circuit 252 with data on a patient having a living tissue as a subject and an average value of IHb calculated by the IHb processing block 244. Then, it is synchronized by the synchronization circuit 253. The synchronizing circuit 253 has three frame memories (not shown) internally, and sequentially writes the signal data of the surface sequence into the frame memory, and then simultaneously reads the signals of the surface sequence, thereby synchronizing the RGB signals. Outputs the signal of.

The signals synchronized by the synchronizing circuit 253 are respectively input to three D / A converters of the D / A converter 254, and then converted into analog RGB signals and the like, and the monitor 207 and the monitor image. It outputs to the imaging device 208A and the image filing device 208B, respectively.

The processor 206 is also configured to perform a process of outputting a high definition image (hi-vision image) separately from the character superimposition circuit 252, the synchronization circuit 253, and the D / A conversion unit 254 described above. A character superimposition circuit 252a having a configuration substantially the same as that of the character superimposition circuit 252, a synchronization circuit 253a having a configuration substantially similar to that of the synchronization circuit 253, a D / A converter 254, It has the D / A conversion part 254a which has substantially the same structure.

The index image generation unit 251a performs processing based on the signal output from the rear-end image processing circuit 251, and outputs the signal after performing the processing to the character superimposition circuit 252.

The detection circuit 257 performs a process based on the signals output from the image capturing unit 230 and the identification information circuit 243, and outputs the signal after the processing to the ROI setting circuit 263.

The ROI setting circuit 263 performs processing based on the signals output from the CPU 256 and the detection circuit 257, and transmits the signal after performing the processing to the? Correction circuit 250 and the subsequent image processing circuit ( 251, the IHb calculating circuit 261, the IHb average value calculating circuit 262, and the image combining / color matrix circuit 265.

The pseudo image generating circuit 264 performs processing based on signals output from the CPU 256, the IHb calculating circuit 261, and the invalid area display circuit 269, and performs image combining / color matrix on the signal after the processing. Output is made to the circuit 265.

The invalid area display circuit 269 performs a process based on the signal output from the CPU 256 and the invalid area detection circuit 268, and outputs a signal after performing the process to the pseudo image generating circuit 264.

The speaker 270 emits a predetermined sound based on the control of the CPU 256, for example, to notify the state of the processor 206 or the like.

The control circuit 240 controls the writing and reading of the frame memory in the synchronization circuit 253 and the D / A conversion in the D / A converter 254. In addition, the CPU 256 controls the operations of the gamma correction circuit 250, the rear-end image processing circuit 251, and the character superimposition circuit 252.

The monitor image photographing apparatus 208A has an example in which image recording is performed by photographing a monitor (not shown) displaying an image or the like having a configuration substantially the same as that of the monitor 207, and an image displayed on the monitor. For example, it is comprised with the photography device which is not shown in figure which is a camera.

Then, the user operates an unillustrated switch or keyboard 209 provided on the front panel 255 of the processor 206 to display the image of the subject captured in the normal observation mode on the monitor 207. The CPU 256 can output an instruction signal for instructing the display of the IHb image on the monitor 207. The CPU 256 controls the IHb processing block 244 or the like based on the instruction signal output by performing an operation of a switch or keyboard 209 (not shown) provided in the front panel 255 of the processor 206. Is done.

Here, image processing that becomes effective in each observation mode other than the normal observation mode will be described.

In the case where the additional fluorescence observation mode of the endoscope apparatus 201 is set, the CCD 230b drives and the CCD 230a stops driving. Therefore, CCD 230b can image the image of the self-fluorescence generate | occur | produced from a subject in fluorescence observation mode. In addition, at a timing approximately equal to the timing at which switching from one observation mode other than the fluorescence observation mode to the fluorescence observation mode is performed, the light source unit 203 adjusts the rotational speed of the rotation filter 227 in one observation mode. Set to half. As a result, the CCD 230b picks up an image of the self-fluorescence generated from the subject by a long exposure time compared to one observation mode other than the fluorescence observation mode, and outputs the captured image of the self-fluorescence as an imaging signal. do.

Further, in the fluorescence observation mode, the respective color signals of R, G, and B written in the R, G, and B memories 239r, 239g, and 239b correspond to the exposure time in the fluorescence observation mode, for example, The same signal is read twice from each of the R, G, and B memories 239r, 239g, and 239b.

The read-out G2 signal, fluorescence signal, and R2 signal are output to the rear-end image processing circuit 251 through the image combining / color matrix circuit 265, the surface sequential circuit 266, and the like. Then, the rear-end image processing circuit 251 uses a color matrix to provide the monitor 207 with, for example, a G2 signal as red, a fluorescent signal as green, and an R2 signal whose signal level is 0.5 times as blue. Processing is performed so that the pseudo color is displayed.

In the case where the additional narrowband observation mode or the infrared observation mode of the endoscope apparatus 201 is set, the CCD 230a is driven and the CCD 230b is stopped from driving. And when it sets to each additional narrowband observation mode or infrared observation mode which the endoscope apparatus 201 has, it exposes by exposure time substantially the same as the exposure time in normal observation mode. Therefore, CCD 230a picks up the image of a subject by the exposure time substantially the same as the exposure time in a normal observation mode, and outputs the image of the imaged subject as an imaging signal. In addition, in the case where the additional narrowband observation mode or the infrared observation mode which the endoscope apparatus 201 has is set, the image of a subject is color-displayed on the monitor 207 by each color signal and a color matrix.

Here, a description will be given of the case where the observation mode in the endoscope apparatus 201 is switched from one observation mode to another.

For example, a description will be given below of the case where one observation mode described above is a normal observation mode and the other observation mode described above is a fluorescence observation mode.

The control circuit 240 outputs the write signal to the memory unit 239 before performing the process shown in step S1 in FIG. 45. The memory unit 239 can write an image pickup signal while a write signal output from the control circuit 240 is input.

When the control circuit 240 detects that switching from the normal observation mode to the fluorescence observation mode is performed in the processing shown in step S1 of FIG. 45, the control circuit 240 performs the synchronization circuit ( By outputting a switching signal to step 253, control is performed to generate and output still images.

Subsequently, the control circuit 240 drives the CCD 230b as one CCD and the other to the switching unit 230c of the imaging unit 230 in the processing shown in step S3 of FIG. 45. A switching signal is output to control for driving the CCD 230a as the CCD to stop driving. The switching unit 230c switches the driving states of the CCDs 230a and 230b based on the switching signal output from the control circuit 240. In addition, the control circuit 240 performs the process shown in step S3 of FIG. 45 described above, and stops output of the write signal to the memory unit 239. Therefore, the memory unit 239 stops writing of the imaging signal at the timing when the input of the write signal output from the control circuit 240 is stopped. In addition, in the process shown by step S4 of FIG. 45, the control circuit 240 changes the rotation speed of the rotation filter 227, and makes it the rotation speed of half of normal observation mode, for example.

The control circuit 240 counts a predetermined time in the processing shown in steps S5 and S6 of FIG. 45. In addition, when switching from normal observation mode to fluorescence observation mode is performed, the said predetermined time shall be 3 second, for example.

When the control circuit 240 detects that the predetermined time has elapsed, the control circuit 240 resumes output of the write signal to the memory unit 239, and the synchronization circuit 253 in the process shown in step S7 of FIG. 45. By outputting a switch completion signal with respect to &quot; Therefore, the memory unit 239 releases the stop of writing of the imaging signal at the timing when the input of the write signal output from the control circuit 240 is resumed.

Thereafter, the control circuit 240 resumes output of the moving image to the synchronizing circuit 253 in the processing shown in step S8 of FIG. 45, and the rear-end image processing circuit 251 as the display image size changing means. ), A process suitable for outputting a moving image, such as changing the image size and adjusting the masking size displayed on the monitor 207, for example.

In addition, the process of changing the image size performed by the rear-end image processing circuit 251 is performed by changing the "display size for fluorescence observation" of the setting screen of the processor 206 shown in FIG. 42, for example. The image size displayed on 207 can be set to a desired size.

Here, the processing of the generation of the still image and the switching of the moving image performed by the synchronization circuit 253 will be described.

In the case of time series Nos. 1 to 4 shown in FIG. 50, i.e., in the normal observation mode, the synchronization circuit 253 has respective colors of R, G, and B for three frame memories (not shown) installed therein. After sequentially writing an image pickup signal having a signal, the image signal is simultaneously read, and then the synchronized RGB signal is output.

For example, when the switching signal output from the control circuit 240 is input at the timing of the time series number 4 shown in FIG. 50 when the processing shown in step S2 of FIG. 45 is performed, that is, normal observation. When switching from the mode to the fluorescence observation mode is performed, the synchronization circuit 253 is not shown at the timing of the time series No. 4 shown in FIG. 50 to which a switching signal output from the control circuit 240 is input. Writing of the imaging signals to the two frame memories is stopped, and still images are generated and output.

The control circuit 240 outputs the switching signal to the synchronization circuit 253 at the timing of the time series number 4 shown in FIG. 50, for example, at the timing of the time series number 5 shown in FIG. 50. The process shown after step S3 of FIG. 45 is started. With the operation of the above-described control circuit 240, the synchronization circuit 253, for example, from time series Nos. 5 to 10 shown in FIG. 50, i.e., a switching completion signal from the control circuit 240, is output. In the period up to this point, writing of the imaging signal to the three frame memories (not shown) is continued and the still image generated at the timing of time series No. 4 shown in FIG. 50 is continuously output.

Subsequently, the control circuit 240 outputs the switching completion signal to the synchronization circuit 253 at the timing of the time series number 11 shown in FIG. 50, for example, the time series number 11 shown in FIG. 50. In timing, the process shown after step S7 of FIG. 45 is started. The synchronization circuit 253 is based on the switching completion signal output from the control circuit 240 at the timing of time series No. 11 shown in FIG. 50, that is, the timing at which the switching completion signal from the control circuit 240 is input. Stops the writing of the imaging signal to three frame memories (not shown) and stops output of the still image generated at the timing of time series No. 4 shown in FIG. The synchronizing circuit 253 sequentially writes an imaging signal composed of a G2 signal, a fluorescence signal, and an R2 signal to three frame memories (not shown) as the synchronizing memory provided therein, and then writes the corresponding corresponding information. By simultaneously reading out the image pickup signal, the synchronized signal is output. Thereby, the monitor 207 displays an image of self fluorescence as a moving picture.

The synchronization circuit 253 is not limited to releasing the stop of writing of the imaging signal to three frame memories (not shown) at the timing at which the switching completion signal from the control circuit 240 is input. The synchronization circuit 253 is provided with respect to three frame memories (not shown), for example, at a predetermined timing suitable for an observation mode such as fluorescence observation after the switching completion signal from the control circuit 240 is input. The stop of writing may be cancelled.

As described above, when the switching from one observation mode to another observation mode is performed, a process of displaying a still image on the monitor 207 is performed, so that, for example, one of the imaging units 230 has one. Noise generated when switching from CCD to another CCD is performed, and color change until the rotational speed of the rotation filter 227 changes to a predetermined rotational speed can be prevented. As a result, the processor 206 of the present embodiment can output a still image suitable for recording when switching from one observation mode to another observation mode is performed.

In addition, when one observation mode is a fluorescence observation mode and the other observation mode is a normal observation mode, the control circuit 240 switches the switching part 230c of the imaging part 230 in the process shown by step S3 of FIG. Is controlled to drive the CCD 230a as one CCD and to stop driving the CCD 230b as the other CCD. In addition, when switching from the fluorescence observation mode to the normal observation mode is performed, the control circuit 240 doubles the rotational speed of the rotation filter 227 in the processing shown in step S4 of FIG. 45, for example. In the processing shown in Step S5 and Step S6 of FIG. 45, it is assumed that a predetermined time is counted, for example, 1.5 seconds.

In addition, as part of the freeze image generating means, the synchronizing circuit 253 as the storage means has a configuration of generating and outputting images of odd fields and even fields in order to display an image on the monitor 207. And the still image output from the synchronization circuit 253 in the process shown by step S2 of FIG. 45 may be output in the state where the shift | offset | difference of the image of an odd field and an even field occurred. In the case as described above, for example, the synchronization circuit 253 causes the memory unit 239 to perform a process of generating a still image in advance before performing the process shown in step S2 of FIG. A still image with little deviation can be generated and output. By the above-described processing performed by the synchronization circuit 253, the still image generated by the memory unit 239 may be an image when a normal freeze instruction is given, or an image immediately before switching to the fluorescence observation mode. It may be followed.

In addition, the still image output from the synchronization circuit 253 in the process shown by step S2 of FIG. 45 may be an image which applied the image in the odd field to the image in the even field.

In addition, the process shown in FIG. 45 demonstrated above is not limited to what is applied when the electronic endoscope 202 has the imaging part 230 with two CCD as shown in FIG. For example, it may be applied in the case where the electronic endoscope 202 has an imaging unit 230A provided with one CCD as shown in FIG. 44.

In addition, as shown in FIG. 44, the imaging unit 230A has the same sensitivity as that of the objective optical system 222c and the CCD 230b to form an image of a subject, and the image pickup unit 230A is positioned at the imaging position of the objective optical system 222c. And an CCD 230d as an imaging means and an excitation light cut filter 232 disposed on the entire surface of the imaging surface of the CCD 230d, which is configured to capture an image of a subject formed by the objective optical system 222c. . In addition, when the electronic endoscope 202 is comprised with the imaging part 230A, the control circuit 240 shall not perform the process shown by step S3 of FIG. In addition, when the electronic endoscope 202 is comprised with the imaging part 230A, the control circuit 240 is an image size and masking size with respect to the synchronization circuit 253 in the process shown by step S8 of FIG. The output of the moving image is resumed without causing the adjustment processing to be performed.

Here, the processing performed by the processor 206 when the freeze instruction is performed by the scope switch 210 or the like immediately after the observation mode in the endoscope device 201 is switched from one observation mode to another observation mode. A description will be given.

In the memory unit 239, the imaging signal output from the imaging unit 230 is written in time series in accordance with the rotational speed of the rotation filter 227. Immediately after the observation mode in the endoscope device 201 is switched from one observation mode to another, when the freeze instruction is performed in the scope switch 210 or the like, the color difference detection circuit 247 includes a memory unit 239. After detecting an image pick-up signal having the smallest color difference among the image pick-up signals written in the above), a process of displaying a still image based on the image pick-up signal on the monitor 207 as a freeze image, that is, a freeze process is performed.

Specifically, for example, as shown in FIG. 46, when the freeze instruction is performed at the timing of F2, that is, the timing at which the time series number is 21, the color difference detection circuit 247 has a time series number from 13 to 20. FIG. After detecting the image pickup signal having the smallest color difference among the image pickup signals written in the memory unit 239 during the preliminary period, the prefreeze process is performed to display the still image based on the image pickup signal on the monitor 207 as a freeze image. Do it.

For example, as shown in FIG. 46, the time series number is a timing of F1, that is, immediately after the observation mode in the endoscope apparatus 201 is switched from one observation mode to another. When the timing is 12, the color difference detection circuit 247 invalidates the freeze instruction and does not perform the freeze processing. Specifically, the color difference detection circuit 247 invalidates the freeze instruction even when the freeze instruction is performed at the timing of the time series number 5 to 18 in FIG. 46, and monitors the freeze image. The prefreeze process for display in () is not performed.

As a part of the freeze image generating means, the color difference detecting circuit 247 as the color difference detecting means performs the above-described processing, for example, as shown by Δ in FIG. 46, which is likely to generate noise. While the time series number is from 5 to 10, at a timing when the time series number is 4, the still image based on the image pickup signal written in the memory unit 239, or the switching of the CCD in the image pickup unit 230 is not completed. None of the still images based on the image pickup signal written in the memory unit 239 is displayed on the monitor 207 as a freeze image. As a result, the processor 206 of the present embodiment invalidates the freeze instruction when the freeze instruction is issued immediately after switching from one observation mode to another observation mode is performed. Output of an image not suitable for recording can be prevented.

In addition, the color difference detection circuit 247 is not limited to determining the period in which the freeze instruction is invalidated by the time series number, but may be determined by a predetermined time, for example.

Specifically, when the color difference detection circuit 247 detects that the switching from one observation mode to another observation mode via the control circuit 240 is performed in the processing shown in step S11 of FIG. 48, the step of FIG. 48 is performed. In the process shown in S12, it is determined whether the exposure time has changed. In other words, the color difference detection circuit 247 normally observes the observation mode in the endoscope apparatus 201 from the normal observation mode to the fluorescence observation mode or the fluorescence observation mode in the processing shown in step S12 of FIG. 48. When detecting switching to the mode, it is determined that the exposure time has been changed.

And the color difference detection circuit 247 sets the period to invalidate a freeze instruction to 3 second, when the process shown by step S13 of FIG. 48 detects that exposure time changed. In addition, in the process shown by step S14 of FIG. 48, when the exposure time is not changed, the color difference detection circuit 247 sets the period to invalidate a freeze instruction to 0.1 second.

The color difference detection circuit 247 invalidates the freeze instruction in the processing shown in step S15 of FIG. 48 and switches from one observation mode to another in the processing shown in step S16 of FIG. 48. The count of time elapsed after this is started.

Then, when the color difference detection circuit 247 detects that the period of invalidating the freeze instruction has elapsed in the process shown in step S17 of FIG. 48, the color difference detection circuit 247 issues a freeze instruction in the process shown in step S18 of FIG. 48. It is effective.

The prefreeze processing performed by the color difference detection circuit 247 is, for example, a set value between 1 and 7, which is displayed as "freeze level" on the setting screen of the processor 206 shown in FIG. 47. As a result, the processing level value can be set.

For example, when the processing level value is set to 1 and the freeze operation is performed at the timing of F2 shown in Fig. 46, the color difference detection circuit 247 stores the memory unit while the time series numbers are from 16 to 20. After detecting an image pick-up signal having the smallest color difference with respect to the image pick-up signal written in (239), a prefreeze process is performed so that the monitor 207 displays a still image based on the image pick-up signal as a freeze image.

In addition, for example, when the processing level value is set as 2, and the freeze operation is performed at the timing of F2 shown in Fig. 46, the color difference detection circuit 247 performs the process while the time series number is from 13 to 20. After detecting the image pickup signal having the smallest color difference by using the image pickup signal written in the memory unit 239, the freeze process is performed to display the still image based on the image pickup signal on the monitor 207 as a freeze image. .

Further, for example, when the processing level value is set as 3, and the freeze operation is performed at the timing of F2 shown in FIG. 46, the color difference detection circuit 247 performs the time while the time series number is from 10 to 20. After detecting the image pickup signal having the smallest color difference by using the image pickup signal written in the memory unit 239, the freeze process is performed to display the still image based on the image pickup signal on the monitor 207 as a freeze image. .

In this manner, the color difference detection circuit 247 performs the freeze processing while increasing or decreasing the period in which the imaging signal to be targeted is written among the imaging signals written in the memory unit 239 according to the set processing level value. And the color difference detection circuit 247 may perform the process of increasing or decreasing the period which invalidates a freeze instruction according to the process level value set as mentioned above.

In addition, the color difference detection circuit 247 is, for example, a predetermined period of time in the middle, and immediately after, for example, a period during which the freeze instruction is invalidated, from one observation mode to another observation mode is performed. While setting in advance as the period from time series No. 5 to 14 shown in FIG. 46, you may have the structure which determines the processing level of a freeze process at the timing which a freeze instruction was performed.

Specifically, the color difference detection circuit 247 holds the first processing level value in the freeze processing set by the operator or the like in the processing shown in step S21 of FIG. 49. And the color difference detection circuit 247 sets the 2nd processing level value as an initial value of a temporary freeze level value in the process shown by step S22 of FIG. 49, and makes a freeze instruction invalid period. As a setting, a predetermined period of time in the middle and immediately after the switching from one observation mode to another is set.

Then, when the color difference detection circuit 247 detects that switching from one observation mode to another observation mode is performed through the control circuit 240 in the processing shown in step S23 of FIG. 49, the color difference detection circuit 247 of FIG. In the process shown in step S24, the count of the time elapsed after switching from one observation mode to another observation mode is performed. In addition, in the process shown by step S25 of FIG. 49, the chrominance detection circuit 247 performs a predetermined time (for example, 0.1 second) after switching from one observation mode to another observation mode. 2 Increase the processing level value.

When the color difference detection circuit 247 detects that the freeze instruction is performed in the process shown in step S26 of FIG. 49, in the process shown in step S27 of FIG. 49, the first process level value and the freeze instruction are performed. The second processing level value of the true timing is compared. And when the color difference detection circuit 247 detects that a 1st process level value is larger than a 2nd process level value, in the process shown by step S28 of FIG. 49, the prefreeze process based on a 1st process level value Is done. Further, when the color difference detection circuit 247 detects that the first processing level value is equal to or less than the second processing level value, the color difference detection circuit 247 performs the freeze processing based on the second processing level value in the processing shown in step S29 of FIG. 49. Do it.

As described above, the endoscope apparatus 201 of this embodiment can output the still image suitable for recording, when switching from one observation mode to another observation mode is performed.

In addition, this invention is not limited to each embodiment mentioned above, A various change, modification, etc. are possible in the range which does not change the summary of this invention.

Claims (24)

An endoscope having normal light imaging means for imaging an object image by normal light with an electronic shutter, and fluorescent imaging means for imaging a fluorescent image from the subject, An image processing apparatus for signal-processing the image pickup signal from the normal light image pickup means and the fluorescent image pickup means, and generating a normal light image and a fluorescent image An endoscope device having a The image processing apparatus, Normal light imaging control means for driving the normal light imaging means; Fluorescent imaging control means for driving the fluorescent imaging means; Signal processing means for normal light images for signal processing an image pickup signal from the fluorescence imaging means, and generating the normal light image; Signal processing means for signal processing an image pickup signal including a fluorescent image of the subject, and generating the fluorescent image; And said normal light imaging control means and said fluorescence imaging control means are driven at the same time. The method of claim 1, A common illumination light including excitation light of a wavelength at which the subject generates fluorescence with respect to the normal light imaging means and the fluorescence imaging means, The normal light imaging control means, An endoscope apparatus characterized by controlling the exposure amount of the normal light image pickup means through the electronic shutter to optimize the brightness of the normal light image. The method according to claim 1 or 2, A common illumination light including excitation light of a wavelength at which the subject generates fluorescence with respect to the normal light imaging means and the fluorescence imaging means, The fluorescence imaging control means controls the gain of the fluorescence imaging means to optimize the brightness of the fluorescent image. The method of claim 1, A common illumination light including excitation light of a wavelength at which the subject generates fluorescence with respect to the normal light imaging means and the fluorescence imaging means, The endoscope apparatus further comprises irradiating the excitation light to the subject from an optical path of a separate system in accordance with the irradiation timing of the excitation light. The method of claim 1, A plurality of fluorescence transmission filters having different filter characteristics from each other are provided on the front surface of the fluorescence imaging means. The signal processing means for fluorescent image, An endoscope apparatus characterized by generating a plurality of fluorescent images by the light transmitted through each of the plurality of fluorescence transmission filters. An endoscope having normal light imaging means for imaging a subject image by normal light and fluorescent imaging means for imaging a fluorescent image from the subject, An image processing apparatus for signal-processing the imaging signals from the normal light image pickup means and the fluorescent image pickup means of the endoscope, and generating a normal light image and a fluorescent image An endoscope device having a The image processing apparatus, Normal light image pickup drive means for driving the normal light image pickup means, Fluorescent imaging driving means for driving the fluorescent imaging means; Signal processing means for normal light images for signal-processing an imaging signal from said normal light image pickup means and generating said normal light image; Signal processing means for fluorescent images for signal processing an image pickup signal including the fluorescent image and generating the fluorescent image; Image synthesizing means for synthesizing the ordinary light image and the fluorescent image; Normal light image processing monitoring means for monitoring a signal processing system of the normal light image from a drive signal of the normal light imaging driving means to an output signal of the signal processing means for normal light images; And an fluorescence image processing monitoring means for monitoring a signal processing system of said fluorescence image from the drive signal of said fluorescence imaging driving means to the output signal of said fluorescence image signal processing means. The method of claim 6, The image synthesizing means, And a notification means for notifying the monitoring result of said normal light image processing monitoring means and said fluorescent image processing monitoring means on said composite image. The method according to claim 6 or 7, The normal light image processing monitoring means and the fluorescent image processing monitoring means, An endoscope apparatus characterized by monitoring output states of the signal processing means for normal light image and the signal processing means for fluorescent image. The method according to claim 6 or 7, The normal light image processing monitoring means and the fluorescent image processing monitoring means, And an output state of a drive signal of said normal light image pickup drive means and a drive signal of said fluorescent image pickup drive means. The method according to claim 6 or 7, The normal light image processing monitoring means and the fluorescent image processing monitoring means, An endoscope apparatus characterized by monitoring the input state of the signal processing means for normal light image and the signal processing means for fluorescent image. The method of claim 7, wherein The image processing apparatus, Has a peripheral device motion detection means for detecting an operating state of a peripheral device to be connected, The notification means of the image synthesizing means, An endoscope apparatus characterized by notifying a result of monitoring of said peripheral device motion detection means on said composite image. The method of claim 11, The peripheral device, An endoscope apparatus, characterized in that the medical treatment device for performing the treatment. The method of claim 11, The peripheral device, An endoscope apparatus, characterized in that the light source device for supplying the normal light. Imaging means for imaging an object and outputting an imaging signal based on the captured image of the subject; One or a plurality of storage means for storing an imaging signal outputted from the imaging means, Write signal generation means for outputting a write signal for writing the image pickup signal to the storage means to the storage means; A first observation mode for generating a first observation image based on an imaging signal output from the imaging means, and a second observation image different from the first observation image based on an imaging signal output from the imaging means. The switching signal generating means for outputting a switching signal for switching the second observation mode to the imaging means and the storage means; Write inhibiting means for stopping writing of the image pickup signal to the storage means by stopping output of the write signal based on the switching signal; After the switching signal is output, after a predetermined time has elapsed, the write prohibition canceling means for releasing the stop of writing of the image pickup signal to the storage means by resuming the output of the write signal to the storage means. An image processing apparatus comprising: One or a plurality of imaging means for photographing a subject and outputting an imaging signal based on the image of the photographed subject; One or a plurality of storage means for storing an imaging signal outputted from the imaging means, Write signal generation means for outputting a write signal for writing the image pickup signal to the storage means to the storage means; Light source means for irradiating the subject with irradiated light having a first band and irradiated light having a second band different from the second irradiated light; When irradiated light having the first band is irradiated onto the subject, a first imaging mode in which the subject is imaged by a first exposure time, and when irradiated light having the second band is irradiated onto the subject Switching signal generation means for outputting a switching signal for switching the second imaging mode in which the subject is imaged by a second exposure time to the imaging means and the storage means; Write inhibiting means for stopping writing of the image pickup signal to the storage means by stopping output of the write signal based on the switching signal; After the switching signal is output, after the irradiation light irradiated by the light source means is switched from one irradiation light to another irradiation light, the output of the writing signal is resumed, thereby writing of the imaging signal to the storage means. Write inhibit release means for releasing stop An image processing apparatus comprising: A plurality of imaging means for photographing a subject and outputting an imaging signal based on the image of the photographed subject; One or a plurality of storage means for storing an imaging signal outputted from the imaging means, Write signal generation means for outputting a write signal for writing the image pickup signal to the storage means to the storage means; The imaging means by imaging the first image of the subject by the imaging means, and imaging the first imaging signal output from the imaging means and the second image of the subject different from the first image by the imaging means. Switching signal generating means for outputting a switching signal for switching an output state with the second imaging signal outputted from the camera; Write prohibiting means for stopping writing of the first imaging signal or the second imaging signal to the storage means by stopping output of the writing signal based on the switching signal; After the switching signal is output, after the imaging signal outputted from the imaging means is switched from one imaging signal to another imaging signal, the output of the write signal is resumed, whereby the first imaging signal or the second imaging signal is resumed. Write inhibiting means for releasing stop of writing to said memory means An image processing apparatus comprising: The method of claim 14, Freeze image generation means for generating a still image based on the captured image signal written in the storage means; Further comprising freeze instruction means for performing freeze instruction for generating the still image with respect to the freeze image generation means, The freeze image generating means, And the freeze instruction issued by the freeze instruction means for the predetermined time period is invalidated. The method of claim 15, Freeze image generation means for generating a still image based on the captured image signal written in the storage means; Further comprising freeze instruction means for performing freeze instruction for generating the still image with respect to the freeze image generation means, The freeze image generating means, And the freeze instruction issued by the freeze instruction means is invalidated until the irradiation light irradiated by the light source means is switched from one irradiation light to another irradiation light. The method of claim 16, Freeze image generation means for generating a still image based on the first image pickup signal or the second image pickup signal written in the storage means; Further comprising freeze instruction means for performing freeze instruction for generating the still image with respect to the freeze image generation means, The freeze image generating means, And the freeze instruction issued by the freeze instruction means is invalidated until the image pickup signal output from the image pickup means is switched from one image pickup signal to another image pickup signal. The method according to any one of claims 14 to 19, And further comprising display image size changing means for performing a process for changing the image size displayed on the display means immediately after the stop of writing of the image pickup signal output from the image pickup means to the storage means is released. Image processing apparatus. The method according to any one of claims 17 to 19, The freeze image generating means, It has a color difference detection means which detects the imaging signal with the smallest color difference among the imaging signals written in the said storage means, and performs the freeze process for displaying the still image based on the imaging signal on the said display means. An image processing apparatus. The method of claim 15, The storage means, Having a synchronizing circuit for synchronizing and outputting the imaging signal written in time series, The synchronization circuit, On the basis of the switching signal output from the switching signal generating means, writing of the imaging signal is stopped, and the switching signal generating means is provided after the irradiation light irradiated by the light source means is switched from one irradiation light to another irradiation light. And stopping the writing of the image pickup signal on the basis of the switching completion signal outputted from the control panel. The method of claim 21, During the period of invalidating the freeze instruction, An image processing apparatus characterized in that the image pickup signal to be detected in the freeze processing can be increased or decreased in accordance with a period written in the storage means. The method of claim 19, The freeze image generating means, Having a freeze memory and controlling the freeze memory according to the first to second exposure times, The synchronization circuit, And a synchronizing memory, wherein said write prohibition releasing means resumes writing, and controls said synchronizing memory in accordance with said first to second exposure times.

Images