JP3461499B2 - Image processing device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention displays a moving image in a first display area of a single display means and simultaneously displays a still image generated from the moving image signal in a second area of the display means. The present invention relates to an image processing device capable of displaying.

[0002]

2. Description of the Related Art In recent years, endoscopes have come into wide use in the medical field and industrial field. recently,
An electronic endoscope with an image sensor built in at the distal end of an elongated insertion section has been put to practical use, and an electronic endoscope system that processes an image signal obtained by photoelectric conversion by the image sensor and displays it on a monitor is also widespread. ing.

For example, in Japanese Patent Laid-Open No. 63-189122,
Disclosed is an electronic endoscope system that can be used with both a frame-sequential type electronic endoscope and a simultaneous type electronic endoscope. On the other hand, there is also a proposal in which a plurality of image pickup devices are incorporated in an electronic endoscope so that a stereoscopic image can be obtained. In order to enhance the insertion operation of the electronic endoscope and the function of diagnosis, it is desirable that a plurality of images can be displayed on the same screen.

[0004]

However, conventionally, it is not possible to simultaneously display a moving image currently displayed and a still image corresponding to this moving image on the same display means.

The present invention has been made in view of the above points, and displays an observation moving image under inspection in the first area of the display means, and a still image corresponding to this moving image is displayed in the first area of the display means. It is an object of the present invention to provide an image processing device capable of simultaneously displaying in two areas and improving the diagnostic ability.

[0006]

In order to achieve the above object, the image processing apparatus according to the present invention has a moving image signal input means for inputting a predetermined moving image signal and an input from the moving image signal input means. With respect to the moving image signal, a release input unit for inputting a release signal indicating a desired timing, and a still unit for generating a predetermined still image signal from the moving image signal based on the release signal input from the release input unit. An image signal generating means, an image file device for recording a still image corresponding to a still image signal generated by the release signal, and a moving image signal input when the release signal is input by the release input means. A moving image corresponding to the moving image signal input from the means is displayed in the first area of the display means, and based on the release signal. Corresponding to made the still image signal, a still image is recorded in the image file device, or a screen display control means for displaying the still image input from the image filing apparatus in the second area of said display means characterized by including, also, the screen display control means includes a feature that displays the still image to be displayed on the second region, with the video display area of approximately the same to be displayed on the first region To do.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be specifically described below with reference to the drawings. 1 to 3 relate to a first embodiment of the present invention, FIG. 1 shows a structure on the distal end side of an electronic endoscope in the first embodiment, and FIG. 2 shows a structure of the first embodiment. Shows a schematic configuration of the electronic endoscope system,
FIG. 3 shows an example of image display on the high-definition monitor. Figure 2
As shown in FIG. 1, the electronic endoscope system 1 according to the first embodiment
Are an electronic endoscope 2 having a plurality of image pickup elements built-in, and an endoscope image control apparatus (hereinafter, simply referred to as a control apparatus) 3 to which the electronic endoscope 2 is connected and which has a signal processing means. , And a high-definition monitor 4 connected to the control device 3.

The electronic endoscope 2 is for a large intestine, for example, and has an elongated insertion portion 5 as shown in FIG. 1, and a tip end portion 6 of the insertion portion 5 has five CCDs as a plurality of image pickup elements.
(Charge-coupled devices) 7a to 7e (three shown in FIG. 1) are housed. That is, the direct-viewing objective lens system 8 is arranged so that the axial direction of the insertion portion 5 is the same as or parallel to the optical axis direction thereof.
a is attached, and the first CCD 7a is disposed at the image forming position of the direct-viewing objective lens system 8a to form a direct-viewing type image pickup system. This first CCD 7a is a direct-view CCD,
The number of pixels is, for example, 1000 × 1000 (= 1 million) pixels. The number of pixels of the other CCDs 7b to 7e is, for example, 375 × 375 (= 141000) pixels.

The direct-view type image pickup system has a viewing angle of, for example, 150 ° and an observation depth of 3 to 100 mm. Four side-view imaging systems are provided for the above-mentioned direct-view imaging system so that four side-view directions orthogonal to the direct-viewing direction can be observed. That is, the upper-view (abbreviated as UP) and lower-view (abbreviated as DOWN) objective lens systems 8b and 8c are attached, and UP and DOWN C are attached at respective image forming positions.
CDs 7b and 7c are arranged. In addition, objective lenses for right-side viewing (abbreviated as RIGHT) and left-side viewing (abbreviated as LEFT) are arranged in the direction perpendicular to the plane of FIG. 1, and for RIGHT and LEFT at each imaging position. CCD
7d and 7e are arranged.

Objective lens system 8 for UP and DOWN
Reference numerals b and 8c are wide-angle lenses, which are capable of observing the UP direction, the DOWN direction and their rear sides at a viewing angle of 100 °, and the observation distance is, for example, 3 to 50 mm. The RIGHT lens system and the LEFT lens system are also centered in the right-side and left-side viewing directions, for example, 100 for the field of view.
It is formed by a wide-angle lens having an angle of °, and the rear side in right-side view and left-side view can also be observed. The four side objective lenses 8b, 8c, etc. are provided on the same cross section, and the CCD
7b to 7e are also provided on the same cross section. (However,
It does not necessarily have to be provided on the same cross section. Moreover, FIG.
Although not shown in the figure, a light guide (not shown) is provided so as to illuminate the direct view and the four side view directions. )
The CCDs 7i (i = a to e) are connected to drive circuits 9i as shown in FIG. 2, and the image signals photoelectrically converted by the CCDs 7i are read out by the drive signals output from the drive circuits 9i. After the pre-processing process, the sample hold process, the A / D conversion process, etc., are performed, the image data is temporarily stored in the image memory 11i.

The image signal data stored in each image memory 11i is input to the image synthesizing circuit 12 and subjected to image synthesizing signal processing so that five images are stored in the video signal for one frame of the high-definition monitor 4. After that, it is input to the video process circuit 13 for converting it into a video signal that can be displayed on the high-definition monitor 4. Then, the high-definition video signal output from the video process circuit 13 is input to the high-definition monitor 4, and as shown in FIG.
Five images picked up by the CD 7i are simultaneously displayed on the monitor screen 4A of the high-definition monitor 4.

In this embodiment, an endoscopic image 14a taken by the direct-view CCD 7a is displayed in a large size in the center of the monitor screen 4A, and UP is displayed on the right and left sides of the image 14a.
Images 14b and 14c captured by CCDs 7b and 7c for DOWN and DOWN, and CCs for RIGHT and LEFT
The endoscopic images 14d and 14e captured by D7d and 7e are displayed at the same time. Each endoscopic image 14
As shown in FIG. 3, i is an octagonal shape with four corners cut out.

According to the first embodiment, since the high-definition monitor 4 is used as the image display means,
Even when the images picked up by the plurality of CCDs 7a to 7e are displayed at the same time, it is possible to display the images with less reduction in resolution as compared with the conventional example. Further, according to this embodiment, since the side-viewing direction can be observed at a wide angle, it is possible to observe the folds on the inner wall of the large intestine while the direct-viewing imaging system is directed in the tube direction of the large intestine. Therefore, it is possible to reduce the number of operations for changing the direction for observation after the insertion. Furthermore, since images can be obtained not only in the direct view but also in the four side-view directions, it is easy to smoothly perform the insertion operation of the insertion section 5 without guiding the inner wall against the inner wall and to guide the observation to a desired position and direction. Becomes

FIG. 4 shows an electronic endoscope system 21 according to a second embodiment of the present invention, FIG. 5 shows the distal end side of the electronic endoscope 22 in this system 21, and FIGS. An example is shown. In this electronic endoscope 22, a normal observation CCD 26a is arranged in the focal plane of a direct-viewing objective lens system 25a in a distal end portion 24 of an insertion portion 23, and each of the UP and DOWN objective lens systems 25b and 25c is connected. CCD 26 at the image position
b and 26c are provided. That is, the front end portion 23 is provided with three imaging systems. The two image pickup systems of the three image pickup systems have sensitivity in a specific wavelength range. For example, UP objective lens system 25b and DOW
Spectral filters 28 and 29 are provided in the N objective lens system 25c so as to have sensitivity in a specific wavelength region.

In this embodiment, the filter 28 is a visible light removing filter, which allows the CCD 26b to pass only infrared light and has sensitivity only in this infrared region. On the other hand, the filter 29 is a spectral filter that passes only the green wavelength, and the CCD 26c has sensitivity only to the green. Incidentally, the CCD 26a is for taking an image in a normal visible range. In general, infrared light observation is indispensable for blood vessel observation on the mucous membrane when observing the inside of the body through an endoscope, and green light observation is for detailed observation of the contour on the mucous membrane. Is considered useful.

As described above, the system 21 shown in FIG. 4 is constructed by using the electronic endoscope 5 having the image pickup system which enables the observation function in the specific wavelength range. Since the filters 28 and 29 are provided as shown in FIG. 5, the CCD 26b '(see FIG.
The CCD 26b of FIG. 5 has a filter 28 added thereto, and the CCD 26c '(the CCD 26c of FIG. 5 with a filter 29 added) has a sensitivity to green light.

The CCDs 26a, 26b 'and 26c' are respectively input to a video processor 31j (j = a to c) and subjected to signal processing to generate a video signal.
The video signal output of each video processor 31j is input to the display position selection circuit 32. The display position selection circuit 32 is composed of a video memory, and the display position and the display angle of view can be arbitrarily changed by the control signal 33 by changing the writing and reading timings of the video memory.

The video signal output of the display position selection circuit 32 is a high-definition video signal output, which is input to the high-definition monitor 34 and displayed. FIG. 6 is a display example of an image on the high-definition monitor screen 34A according to the second embodiment, and the central image 35a is the CCD 2 for normal light observation.
6a, the image 35b on the right side of this image 35a is an infrared image by the CCD 26b ', and the image 35c on the left side is a green light image by the CCD 26c'.

Further, FIG. 7A shows a high-definition monitor screen 3
4A shows a case where two images are displayed. The monitor screen 34A has an aspect ratio (ratio of vertical and horizontal display sizes) of about 9:16, and shows the images 36a and 36b having the same angle of view displayed on the left and right in the center division on the monitor screen 34A. The selection setting of the display mode according to FIG. 6 or 7 can be performed by the control signal 33, and for example, the user can perform the selection by using the display mode selection switch.

In FIG. 7A, for example, the image 36 on the left side is displayed.
a is an image by normal light, and the image 36b on the right side is an image obtained with another specific wavelength. In the conventional monitor according to the NTSC format, the screen 37 has an aspect ratio of 3: 4, and when both are displayed with the same angle of view and displayed without vignetting, a small angle of view is obtained as shown in FIG. 7 (b).
The reduction or deterioration of the resolution due to the display becomes unavoidable, which makes it very difficult to see. On the other hand, in the second embodiment, since the display screen is horizontally long and the number of scanning lines is much larger, it is possible to display without lowering the resolution. Therefore, it is very effective for diagnosis.

FIG. 8 shows an electronic endoscope system 41 according to a third embodiment of the present invention. The system 41 includes an electronic endoscope 42 having two image pickup systems, a control device 43 that includes a means for performing signal processing while supplying illumination light to the electronic endoscope 42, and from the control device 43. It is composed of a high-definition monitor 44 that displays the output high-definition standard video signal.

In the electronic endoscope 42, the light guides 45a and 45b are inserted into the elongated insertion portions, and the illumination light emitted to the proximal end face is transmitted and emitted from the distal end face. That is, the lamps 46a and 46b in the control device 43 are
Illumination light emitted from the lenses 47a and 47, respectively.
b, and the openings 49 of the light-shielding blade members 48a and 48b.
light guides 45a and 45b through a and 49b, respectively.
Is irradiated to the end face on the near side of. And the light guide 45
The light is transmitted by a and 45b and is emitted from the front end surface to the front side of the subject 50.

The affected area or the like illuminated by the illumination light emitted from the tip surfaces of the light guides 45a and 45b is photoelectrically converted by the CCDs 52a and 52b disposed on the focal planes thereof by the objective lenses 51a and 51b attached to the tip portions. An image is formed on the conversion surface and photoelectrically converted. Each of the CCDs 52a and 52b includes a processor 53a as a signal processing unit in the control device 43,
The image signals are photoelectrically converted and converted into video signals, which are input to the display position selection circuit 54.
With this display position selection circuit 54, the two CCDs 5
The images picked up by 2a and 52b are converted into a video signal that has been combined into an image so as to form one image, which is output to the high-definition monitor 44. For example, two images 55a and 55b have the same angle of view on the monitor screen 44A. Is displayed on the left and right.

The outputs (for example, the luminance signal output) of the processors 53a and 53b are the dimming circuits 56a and 56a, respectively.
56b to generate dimming signals, drive dimming control rotary solenoids 57a and 57b, and dimming signals to drive the solenoids 57a and 57b.
The light is automatically adjusted so that the amount of illumination light supplied to the light guides 45a and 45b through 9a and 49b becomes appropriate. That is, the dimming circuits 56a and 56b integrate the luminance signal for one frame period, compare the level of the integrated value with the reference level, and pass the solenoids 57a and 57b through the solenoids 57a and 57b in the direction in which the compared difference signal becomes smaller. And light-shielding blade member 48
The rotation directions of a and 48b are controlled.

A light control section 5 including the light-shielding blade member 48a.
8a is as shown in FIG. As shown in FIG. 9, the blade member 48a has a solenoid 5 at the base end of its arm.
It is attached to the rotary drive shaft of 7a and can rotate (rotate) in the direction of arrow A or B. Therefore, when rotating in the direction of arrow A from the state of FIG. 9, the amount of illumination light supplied to the proximal end face of the light guide 45a decreases, and when rotating in the direction of arrow B, it increases conversely. This rotation angle is controlled according to the amount of deviation of the dimming circuit 56a or 56b from the reference level, and its rotation direction differs depending on whether it is higher or lower than the reference level.
The output of 3a or 53b is controlled to be maintained at a level corresponding to the reference level, that is, the illumination light amount to the subject 50 side is controlled to be a light amount suitable for constant observation. The other light control section 58b has the same configuration.

Since this embodiment has a function of performing automatic light control, an image 55 displayed on the monitor screen 44A is displayed.
Images a and 55b have brightness suitable for diagnosis. Further, as in the above-described embodiment, the two images 55a and 55b can be displayed at the same angle of view without lowering the resolution, which is convenient for diagnosis and the like. It should be noted that the two images 55a and 55b may be alternately displayed in synchronization with the liquid crystal glasses or the like so that stereoscopic observation can be performed.

FIG. 10 shows an electronic endoscope system 61 according to the fourth embodiment of the present invention. This embodiment is an example for simultaneously obtaining both the simultaneous image and the frame-sequential image and displaying them on the monitor at the same time. This system 61
Is an electronic endoscope 6 having a simultaneous type and a frame sequential type imaging system.
2 and the illumination light is supplied to the electronic endoscope 62,
The control device 63 has a built-in means for performing signal processing, a high-definition monitor 64A for displaying a video signal output from the control device 63, and normal monitors 64B and 64C.

A light guide 65 is inserted into an elongated insertion portion of the electronic endoscope 62, and the illumination light radiated to the proximal end face is transmitted and emitted from the distal end face. That is, the illumination light emitted from the lamp 66 in the control device 63 is condensed by the lens 67, and is applied to the incident end surface of the light guide 65 via the rotary filter 69 that is rotationally driven by the motor 68. This rotary filter 69 has an R, G, B filter 69R, which passes R, G, B, respectively, as shown in FIG.
69G and 69B, and a translucent portion 69T provided between adjacent filters.

Therefore, through this rotary filter 69,
As shown in FIG. 12, the illumination light emitted to the end face of the light guide 65 (or the illumination light emitted from the emission end face of the light guide 65 to the subject 71 side) is R light and translucent light (that is, white light). ), G light, transmitted light, B light, and transmitted light. Since the illumination light that has passed through the translucent portion 69T becomes white light, image pickup is performed by the simultaneous image pickup system during the illumination period that passes through each translucent portion 69T. On the other hand, an image is picked up by a frame sequential image pickup system during the R, G and B light periods. In this embodiment, for example, the period from the R light irradiation to the light irradiation by the light transmitting portion 69T is set to 1/60 seconds as shown in FIG.

The subject 71 illuminated with the illumination light is imaged on CCDs 73a and 73b arranged at respective image forming positions by objective lenses 72a and 72b attached to the tip end thereof, and photoelectrically converted. A mosaic filter 74 is provided in front of the photoelectric conversion surface of the CCD 73a, and for example, each pixel is optically color-separated. These CCD 73a,
The photoelectric conversion outputs of 73b are the simultaneous processor 75, respectively.
a and the frame-sequential processor 75b, respectively, and are converted into video signals. The video outputs of the processors 75a and 75b are input to the display position selection circuit 76 to be combined with the image, converted into a high-definition standard video signal and output to the high-definition monitor 64A so that two images are simultaneously displayed on the monitor screen. It

The video outputs of the simultaneous processor 75a and the frame sequential processor 75b are input to separate monitors 64B and 64C, respectively, to display the images picked up by the simultaneous image pickup system and the frame sequential image pickup system, respectively. . The frame sequential CCD 73b accumulates charges during the RGB irradiation timing period, and executes charge reading during the timing period of the light transmitting portion 69T. The simultaneous CCD 73a accumulates electric charges in the timing period of the translucent portion 69T and reads out electric charges in the timing period of RGB irradiation.

In order to operate at this timing, the rotation sensor 77 is arranged so as to face the rotation filter 69, and the rotation cycle of the rotation filter 69 rotated by the motor 68 and the reference position are detected. Light-G-Translucency-B-
The switching timing of translucent-R ... Is detected and the detection signal is output to a CCD drive circuit (not shown) in the processors 75a and 75b to switch the charge accumulation and readout modes. Then, on the high-definition monitor 64A, an image 79a captured by the simultaneous imaging system and an image 79b captured by the frame sequential imaging system are displayed side by side with the same angle of view.

Conventionally, in the frame-sequential system, a color shift occurs with respect to a moving subject, while in the simultaneous system, a lack of resolution is accompanied in principle. According to the present embodiment, the observer may arbitrarily observe any image according to the required characteristics of the diagnosis by the electronic endoscope. FIG. 13 shows the distal end side of the electronic endoscope 81 according to the fifth embodiment of the present invention, and FIGS. 14 and 15 show a front view and a sectional view. In this embodiment, two objective optical systems 83a, 83 for direct view and side view on the UP side are provided for one CCD 82.
The optical images of b are formed adjacent to each other.

As shown in FIG. 13, a forceps port 85 is provided in the axial direction in a tip component member 84 which constitutes the distal end portion 83 of the insertion portion, and the outlet side of this forceps port 85 becomes a widened tip opening 85a. A forceps raising base 86 is attached to the inside of the opening 85a, and by pulling the raising operation wire 87, it is possible to raise from the position shown by the solid line to the position shown by the dotted line. Further, as shown in FIG. 15, a first light guide 88a and a second light guide 88b are inserted into the insertion portion for direct view (illumination), and a light guide 89 for side view is also inserted.

The front end surfaces of the light guides 88a, 88b have first and second direct-view illumination windows 90a, 9 shown in FIG.
0b is fixed so as to face the back of the lighting windows 90a and 90b.
The illumination light is emitted from the front. These lighting windows 90
A direct-viewing observation window 91 is provided between a and 90b, and a direct-viewing objective optical system (not shown) is attached to the direct-viewing objective lens frame 92. An air / water feeding nozzle 93 is provided so as to face the observation window 91, and this nozzle 93 is attached to the tip of an air / water feeding tube 93a (see FIG. 15).

As shown in FIG. 13, the side-viewing light guide 89 is fixed so that the tip side is bent and the upper side is oriented in the direction of the side surface (that is, the upper side) which is notched, and is provided in front of the tip surface. The side-view illumination lens 9 is installed in the side-view illumination window 94.
5 is attached, and the illumination light is emitted upward through the lens 95. The side-view observation window 9 is adjacent to the illumination window 94.
6 is formed and constitutes the side-view objective optical system 97.
7a is attached. A prism (roof prism) 97b is arranged to face the lens 97a, and lenses 97c and 97d are attached to the objective lens frame 98 so as to face the prism 97b in the axial direction of the insertion portion.

At the image forming position of the side-view objective optical system 97,
The photoelectric conversion surface of the CCD 82 is provided. In this case, as shown in FIG. 15, the CCD 82 has a horizontally long image area 8 in which the ratio of the horizontal (horizontal) direction to the vertical direction is 16: 9.
Images from the two objective optical systems are formed adjacent to each other on 2a in a state where the heights of both imaging rays are equal. The viewing angles of the direct-viewing and side-viewing objective optical systems are set to 140 ° and 80 °, respectively. The CCD 82 and the CCD peripheral circuit board 100 are connected by a terminal 99 on the back surface of the CCD 82, and the CCD peripheral circuit board 100 is connected to each signal line 102 of the bundling signal line 101.

Adjacent to and above the bundling signal line 101,
The side-view air / water supply tube 103 is inserted, and the air / water supply nozzle 104 attached to the tip of the tube 103 faces the outer surface of the side-view observation window 96 so that the surface of the lens 97a can be cleaned. . Incidentally, as shown in FIG.
The raising operation wire 87 is inserted through the space between the lens frames 92 and 98 and inside the guide pipe 105. still,
Reference numeral 106 denotes a channel tube.

In this embodiment, since the horizontally long CCD 82 is used, it has substantially the same function as the case where two CCDs are provided. Then, the photoelectric conversion output of the optical image formed on the CCD 82 is signal-processed by a signal processing system (not shown) so that two images are displayed on the high-definition monitor screen 34A as shown in FIG. 7A, for example. Has become. The side-view light guide 89 passes along the left side of the CCD 82 and the lens frame 98 as shown in FIG.
As shown in FIG. 3, the side-view lens 97 is in front of the prism 97b.
Its tip is oriented in a direction parallel to the optical axis of a. The electronic endoscope 81 in this embodiment is mainly suitable for the stomach.

FIG. 16 shows an electronic endoscope system 111 according to the sixth embodiment of the present invention, and this system 111 is adapted to obtain a fluorescence image. This system 1
Reference numeral 11 denotes an electronic endoscope 112, a light source device 113 that supplies illumination light to the electronic endoscope 112, and the electronic endoscope 1
Signal processing device 114 for processing signals for 12 imaging systems
And a high-definition monitor 115 that displays a video signal output from the signal processing device 114.

The electronic endoscope 112 has an elongated insertion portion 1
16 and the operation unit 1 that is connected to the rear end of the insertion unit 116.
17 and a universal cable 118 extending from the operation section 117 to the outside, and a connector 119 provided at the end of the cable 118 can be detachably attached to the light source device 113. A signal cable 121 is further extended from the connector 119, and the connector 122 attached to the end of the signal cable 121 can be attached to the signal processing device 114. In the light source device 113, there is a first for normal observation.
A lamp 124 and a second lamp 125 for excitation are provided, and the first and second lamp lighting circuits 126 and 1 are provided, respectively.
It is turned on by the power supplied from 27.

The first lamp 124 and the second lamp 1
A mirror 128 is arranged in front of the optical path of 25, and the mirror 128 is driven by a mirror drive circuit 129.
For example, in the state of FIG. 16, the illumination light of the second lamp 125 (excitation light as a function) is reflected by the mirror 128, passes through the lens 131 and the shutter 132, and then passes through the light guide 13.
The incident side end surface of No. 3 is irradiated. This light guide 133
Passes through the cable 118 and the insertion portion 116 and transmits the illumination light supplied to the incident side end face, and the transmitted illumination light is emitted forward from the end face on the tip side.

The mirror 128 in the state shown in FIG. 16 is controlled by the control signal from the control circuit 134, and the mirror drive circuit 129 is operated.
Is driven to rotate via a mirror 128 as shown by the dotted line.
Can be rotated by 45 °. When rotated in this way, the illumination light of the first lamp 124 is supplied to the light guide 133. The control circuit 134 controls the shutter 13 via the solenoid 132a.
It also controls the opening and closing of 2. Further, when the two-screen display switch 135 provided in the signal processing device 114 is turned on, the control circuit 134 displays the fluorescent observation image from the normal observation image displayed under the illumination light from the first lamp 124. Is controlled.

The CCD 137 arranged at the image forming position of the objective lens 136 provided at the tip of the insertion section 116 receives a signal through the signal line in the insertion section 116, the signal cable in the universal cable 118 and the signal line in the signal cable 121. CCD driver 138 and switch circuit 139 of the processing unit 114
Connected with. Then, by applying a CCD drive signal from the CCD driver 138, the photoelectrically converted signal is read out, passes through the switch circuit 139, and then passes through the first memory 1
41 or the second memory 142. The switch 139 and the first and second memories 141 and 142 are controlled by the control circuit 143.

The outputs of the first and second memories 141 and 142 are output to the high-definition monitor 115 via the display position selection circuit 144. The display position selection circuit 144 controls the control signal 1 by operating the display control console 145.
46, the selection operation of the display position displayed on the high-definition monitor 115 can be controlled in the same manner as described with reference to FIG. A bending operation knob 147 is provided on the operation unit 117 of the electronic endoscope 112. In the system 111, only the normal observation image is displayed on the high-definition monitor 115 unless the two-screen display switch 135 is turned on, and when the switch 135 is turned on, a fluorescent image is displayed together with the normal observation image.

Next, the operation of the system 111 will be described with reference to FIG. The two-screen display switch 135 is shown in FIG.
When the mirror 128 is OFF as shown in FIG.
6 is in the position indicated by the dotted line, and therefore the light guide 133
The illumination light of the first lamp 124 is supplied to the first lamp 124, as shown in FIG. Then, under this illumination light, the CCD 13
The image signal picked up in 7 is passed through the switch circuit 139 to the first
The image signal stored in the memory 141 and stored in the first memory 141 is displayed on the monitor 115, and in this case, it becomes a normal image as shown in FIG.

It should be noted that in this state, the shutter 132 operates as shown in FIG.
It is normally open as shown in 7 (c). In this normal image display state, as shown in FIG.
When the signal is turned on, the control circuit 134 detects this signal and controls the mirror drive circuit 129 to move the mirror 128 to the position shown in FIG.
To the position shown by the solid line. Then, the first lamp 12
4 is shielded by this mirror 128, while the second lamp 12
The illumination light (excitation light) of No. 5 is reflected by the mirror 128 and supplied to the light guide 133.

That is, as shown in FIG. 17B, the illumination lamp in this state is switched to the second lamp 125. At this time, the control circuit 143 in the signal processing device 114 puts the first memory 141 into the write-protected state and repeatedly outputs the normal image stored in the first memory 141, and the monitor 115 displays the normal moving image. The image becomes a normal image of a still image. When the illumination by the second lamp 125 is performed for a predetermined excitation period T, the shutter 132 is closed as shown in FIG. 17C and the illumination is interrupted. (The signal of the CCD 137 is once swept away after this interruption.) Therefore, the image captured by the CCD 137 after this closing is
The signal is a fluorescent image, and the signal output from the CCD 137 is stored in the second memory 142 via the switch circuit 139 switched by the control circuit 143.

The image read from the first memory 141 and the second memory 142 is displayed by the display position selection circuit 14
The image combining process is performed via 4, and two images, that is, a normal image and a fluorescent image are simultaneously displayed on the monitor 115.
Then, t seconds after the switch 135 is turned on, the mirror 1
28 returns to the position shown by the dotted line in FIG.
32 opens. At the same time, the switch circuit 139 is switched, the image taken under the illumination of the first lamp 124 is stored in the first memory 141, and the normal image becomes a moving image. At this time, the second memory 142 is write-protected, and the image stored immediately before this is repeatedly output, and the fluorescent image becomes a still image.

Thereafter, each time the two-screen display switch 135 is turned on, the above sequence is repeated and the fluorescent image is updated. If the first lamp 124 has sufficient energy as an excitation light source, the same function can be performed without providing the second lamp 125 (in this case, the mirror 128 and its drive). Circuit 129 is also not required). FIG. 18 is a system 1 according to the seventh embodiment of the present invention.
51 is shown. The system 151 is adapted to obtain a normal color image and a biological function image.

This system 151 obtains an infrared observable electronic scope 152, and various wavelength region images from the visible region to the infrared region in order to obtain images of blood flow and hemoglobin oxygen saturation as biological function images. Endoscope device 153 having a built-in light source means and signal processing means for enabling
And a processing unit 154 that performs a calculation process to obtain a hemoglobin distribution image and a hemoglobin oxygen saturation image by performing inter-image calculation of various wavelength region images obtained by the endoscope device 153, and the processing unit 154. Both the image processed and the normal color image from the endoscopic device 153 are input and the high-definition (HDT
V) It is composed of a multi-high resolution frame memory device 156 which synthesizes images so as to be output to the monitor 155 and an HDTV monitor 155.

The multi-high resolution frame memory device 1
56 is configured as shown in FIG. Endoscopic device 153
C which receives the image data from C and controls the whole device
A PU circuit 157, a control logic circuit 160 for controlling the first and second frame memory circuits 158 and 159 under the control of the CPU circuit 157, and a memory circuit 161 for processing image data input from the processing unit 154. A first frame memory circuit 158 for displaying the image data of the memory circuit 161 on the HDTV monitor 155; an interface circuit 162 for inputting the image data output from the endoscope apparatus 153 as a digital signal; HDT input image data
A data conversion circuit 163 for converting the image data of the display size for V and the image data of the endoscope device 153 to the HDTV.
From the second frame memory circuit 159 for displaying on the monitor 155, and the D / A conversion circuit 164 for synthesizing the digital image signals output from these frame memory circuits 158, 159 and converting into an analog HDTV signal for display. Composed.

The first and second frame memory circuits 15
8 and 159 are connected to the control logic circuit 160 via the system bus. The frame memory circuits 158 and 159 are connected to the memory circuit 161 via the DMA bus. In addition, these frame memory circuits 158 and 159 are D / s via the image bus.
It is connected to the A conversion circuit 164. Next, the operation of this embodiment will be described.

Electronic scope 1 capable of imaging in the infrared region
In addition to a normal color image in the living body, 52 is a combination of wavelengths necessary for calculating the absorption characteristics of hemoglobin, which is a pigment in the living body, in the wavelength range illuminated by the endoscope device 153. Then, various wavelength region images necessary for calculating the hemoglobin pigment concentration are obtained, and the endoscope apparatus 1
Output to 53.

Various wavelength region images obtained by signal processing by the endoscope device 153 are inter-image operated by the processing unit 154 to obtain a hemoglobin dye concentration image and a hemoglobin oxygen saturation image. Various biological function images processed by the processing unit 154 are input to the multi-high resolution frame memory device 156. The input biological function image is reduced by the CPU circuit 157 and data-transferred to the memory circuit 161, and the first frame memory circuit 158 is transferred from the memory circuit 161 to the DMA data bus.
Transferred to.

On the other hand, the normal moving image input from the endoscope device 153 is converted into digital data by the interface circuit 162, and the data is converted by the data conversion circuit 163 so that it can be displayed on the HDTV monitor 155. It The converted image data is transferred from the second frame memory 159 to the image bus under the control of the control logic circuit 160 via the system bus. The D / A conversion circuit 164 synthesizes the image data transferred to the image bus and outputs it as analog image data. The output image data is displayed on the monitor 155 as shown in FIG.
Is displayed.

For example, the normal color image 166A is displayed on the right side of the screen 165, and the blood flow image 166 showing the hemodynamic changes due to the hemoglobin distribution is shown as biological function information on the left side thereof.
An image 166C of B and hemoglobin oxygen saturation is displayed, and is displayed at the same time for easy comparison with a normal image. According to this embodiment, a color image 166A for normal observation and biological function information are displayed on the same high-resolution display device.
The hemodynamic changes due to the hemoglobin distribution and the images 166B and 166C of the hemoglobin oxygen saturation are displayed at the same time, so that information such as a congestion state can be obtained in the observation state of the normal image more than in the conventional example. At the same time, comparison and contrast can be performed, and it is not necessary to frequently switch various images as in the conventional case, and comparison and contrast can be easily performed, which has an effect of improving diagnostic ability.

FIG. 21 shows a system 171 according to the eighth embodiment of the present invention. This system 171 has a stereoscope 172 capable of measuring length by incorporating two image pickup devices on the left and right (having two light receiving parts), and a light source for illuminating a subject, and a stereo endoscope for outputting left and right images. Device 173
And a shape processing unit 174 that measures the shape of the designated region using the left and right image data with parallax obtained from the stereo endoscope apparatus 173, and the shape processing unit 174 obtained from the stereo endoscope. The left and right images with parallax and the shape information of the subject processed by the shape processing unit 174 are displayed on the HDTV monitor 175 on a multi-high resolution frame memory device 176 and an image synthesized by the multi-high resolution frame memory device 176. Show H
It is composed of a DTV monitor 175.

As shown in FIG. 22, the block structure of the high resolution frame memory device 176 is the same as that shown in FIG. Next, the operation of this embodiment will be described. Stereoscope 17 capable of capturing left and right images with parallax
2 captures an image of a region whose shape is to be measured, and the stereoscopic endoscope device 173 outputs two types of image signals to the shape processing unit 1.
74 and the multi-high resolution frame memory device 176.

The shape processing unit 174 is designated by the input of the part designation by the function of calculating the shape data of the object to be observed from the two types of images having parallax, as previously disclosed by the present applicant. Calculate the shape data of the part.
An image signal input from the shape processing unit 174 and the stereo endoscope apparatus 173 causes an image to be displayed on the HDTV monitor 175 by the same operation as in the seventh embodiment. Here, on the HDTV monitor 175, the stereoscope 1
When the image of the body to be observed is picked up by 72, the left and right images 177a and 177b with parallax output from the stereoscopic endoscope device 173 are displayed on the same monitor screen 175A as shown in FIG.

By being displayed on the same monitor screen 175A, it becomes easy to confirm whether the observed object image for shape measurement is within both the left and right angle of view. When the object to be observed is captured within both view angles, the freeze button provided on the operation unit of the stereoscope 172 freezes the image of the object to be observed. With respect to the region of the left and right images that require shape measurement, the mouse is used to indicate the region, and the shape processing unit 174 calculates the shape data of the range of polyps and lesions, as shown in FIG. 23 (b). A still image in which the shape data is recorded is displayed on the sub-screen 178, and a moving image of a region of which shape is measured by the moving image from the stereoscopic endoscope device 173 is displayed on the main screen 179.

Then, for example, below the sub-screen 178, the data calculated for the height H and the width W of the polyp or the like is displayed. According to this embodiment, since the left and right images with parallax are displayed on the same monitor, it is easy to check the left and right images and the operability is improved. Further, since the endoscopic image inspection can be performed together with the quantitative measurement value of the shape data of the object to be observed, the size of the lesion site can be accurately examined, which has the advantage of improving the diagnostic ability. By displaying the shape data from the previous inspection on the same monitor,
It is possible to quantitatively examine changes in the size of the region of interest.

FIG. 24 shows a system 201 according to the ninth embodiment of the present invention. Conventionally, when observing with a color image, G
By displaying the image obtained in the wavelength region of
It was possible to observe minute changes on the mucosal surface of the living body. In this case, the normal color image and the infrared image are switched and displayed. For this reason, it was difficult to make a direct comparison, so in this example, by simultaneously displaying image signals in different wavelength regions, it was possible to easily compare, and from the minute changes in the surface of the living mucous membrane surface, Even changes in deep areas can be observed, and the diagnostic ability is improved.

As shown in FIG. 24, this system 201
Is an infrared electronic scope 202 to be inserted into a living body, an endoscope device (main body) 203 configured by a light source and a camera control unit and capable of infrared observation, and records an endoscope image signal. The image file device 204, the image data from the image file device 204, and the endoscope device main body 2
A multi-high resolution frame memory device 205 for combining the image data from 03 and displaying it at a designated monitor position;
It is composed of a TV monitor 206.

Multi High Resolution Frame Memory Device 205
Is constructed as shown in FIG. Image file device 2
A CPU circuit 207 that receives the image data from 04 and controls the entire apparatus, a control logic circuit 210 that controls the first and second frame memory circuits 208 and 209 by the control 207 of the CPU circuit, and an image filing apparatus 204. A memory circuit 211 for processing the image data input further, a first frame memory circuit 208 for displaying the image data of the memory circuit 211 on the HDTV monitor 206, and an output from the endoscope apparatus main body 203. An interface circuit 212 for inputting image data as a digital signal, a data conversion circuit 213 for converting the input image data into image data of HDTV display size, and an image data of the endoscope device 203 for HDTV monitor 206. Second frame memory circuit 20 for displaying on Once, these frame memory circuit 20
8 and 209, and a D / A conversion circuit 214 for synthesizing the digital image signals and converting into an analog HDTV signal for display.

On the monitor screen 206A, as shown in FIG. 26, the normal image (visible moving image) 215, the infrared image 216 and the G image 217 can be displayed at the same time. Next, the operation of this embodiment will be described. Observation of the living body mucous membrane is performed by the infrared electronic scope 202 inserted in the living body. Here, if infrared observation is selected in the endoscope device main body 203 for the purpose of observing hemodynamics in the living body mucous membrane, the illumination light of the endoscope device main body 203 becomes infrared light and the moving image shown in FIG. The display area of the image 215 becomes an infrared image rather than a visible image.

Next, by injecting ICG intravenously, the dye concentration in the blood in the living mucous membrane fluctuates, and the part where the blood flow is fast,
The dye concentration increases rapidly after ICG intravenous injection. Therefore, the infrared image in the region of interest is frozen and recorded by the image file device 204. The recorded infrared still image is input to the multi-high resolution frame memory device 205. Then, for example, when this recording is completed, the infrared electronic scope 2
02 returns from the infrared observation mode to the normal observation mode. In the state returned to this mode, the monitor screen 206A displays the infrared image 216 as a still image on the left side and the normal image 215 as a large moving image on the right side as shown in FIG. Then, it is assumed that the region of interest is observed and a mode for observing a G image is specified, which allows observation of the fine structure of the mucous membrane surface of the living body unlike infrared light.

Multi High Resolution Frame Memory Device 205
26 mainly displays a normal moving image as shown in FIG. 26 in response to a moving image of a normal observation image and an instruction to display a G image from the endoscope apparatus main body 203, and clearly displays the fine structure of the mucous membrane surface.
Performs an operation for displaying a moving image of an image. In other words, the control logic circuit 210 operates to display only the G image of the normal image data in the G image display area of the normal image input to the second frame memory circuit 209. In addition, the normal observation moving image input from the endoscope device 203 is the interface circuit 21.
2 is converted into digital data by the data conversion circuit 2
At 13, the data is converted so that it can be displayed on the HDTV monitor 206.

The converted image data is transferred from the second frame memory circuit 209 to the image bus under the control of the control logic circuit 210 via the system bus. The D / A conversion circuit 214 synthesizes the image data transferred to the image bus and outputs it as analog image data. On the other hand, the infrared still image input from the image filing device 204 is reduced by the CPU circuit 207 and data-transferred to the memory circuit 211.
11 through the DMA data bus the first frame memory 20
8 is transferred. The image data output via the D / A conversion circuit 214 is displayed on the monitor 206 as shown in FIG.

According to this embodiment, the infrared image showing the submucosal information in the region of interest of the living mucous membrane, the G image showing the fine structure of the surface in the region of interest, and the moving image under normal observation light are displayed on the same monitor. Can be displayed, and comparison can be easily performed without switching the region of interest to various images, which has the effect of improving operability.

FIG. 27 shows a system 401 according to the tenth embodiment of the present invention. This system 401 has a C at the tip.
An infrared electronic scope 402 capable of imaging even in an infrared light region by removing an infrared cut filter of a CD (not shown)
A first light source 403 connected to the infrared electronic scope 402 and a second light source 403 connected to the infrared electronic scope 402.
Light source 404 and a camera control unit (CC which visualizes image data from the infrared electronic scope 402).
U) 405, an image file device 406 for recording an endoscope image signal, image data from this image file device 406, and image data from the camera control unit 405 are combined and displayed at a designated monitor position. It is composed of a resolution frame memory device 407 and an HDTV monitor device 408.

FIG. 28 shows a structure of the first light source 403 and the second light source 404 connected to the infrared electronic scope 402. In FIG. 28, a first light source 403 is a lamp power source 410 for driving a lamp, and an ultraviolet light amount region, a visible light amount region, and an infrared light amount region for illuminating an object to be observed by the power from the power source 410. A xenon lamp 411 that emits light in a wide range of wavelengths and a lens 41 that condenses the illumination light generated by the xenon lamp 411.
2 and an output connector 4 for connecting the electronic signal from the electronic scope 402 and the illumination light from the light source to the electronic scope 402.
13 and a rotary filter 4 for color-separating illumination light in time series
14, a drive motor 415 for rotating the rotary filter 414, and a drive circuit 4 for driving the motor 415.
16, shutter means 417 that cuts the illumination light when the scope 402 is pulled out from the output connector 413, diaphragm means 418 that adjusts the light amount of the illumination light based on the exposure control signal of the camera control unit 405, and this diaphragm means And an exposure control circuit 419 for driving 418.

Further, the first light source 403 controls the communication circuit 420 for communicating with the camera control unit 405 through the scope 402, and the exposure control circuit 419 and the drive circuit 416 based on the information from the camera control unit 405. System controller (syscon) 421 and camera control unit 4
05, a light source connector 422 for inputting a synchronization signal and information necessary for adjusting the light amount.

The second light source 404 has substantially the same structure as the first light source 403, and the different part is the first light source 403.
The rotary filter 414 'is set so that the spectral transmittance characteristics of the rotary filter 414 are different. Others have the same configuration as the first light source 403, and the same members are denoted by the same reference numerals and the description thereof is omitted. In addition, electronic scope 4
02 is connected to the output connectors 413 of the first light source 403 and the second light source 404 via the optical path switching device 424 and the signal switching device 425, respectively. Switching between these two devices 424 and 425 is controlled by the output signal of the camera control unit 405. The operation of this embodiment will be described below.

In normal observation, the infrared electronic scope 402 is color-separated by the rotary filter 414 of the first light source 403. Therefore, the infrared electronic scope 402 is used by the optical path switching device 424 and the signal switching device 425. Is connected to the first light source 403. In the infrared electronic scope 402, the illumination light, which is color-separated in time series by the rotary filter 414, is supplied to the normal RGB in the camera control unit 405.
It is recorded in the image file device 406 as a color image.

This RGB image synchronization signal is input from the camera control unit 405 to the syscon 421 of the first light source 403 via the light source connector 422. The syscon 421 drives the motor 415 by the drive circuit 416 so that the RGB rotation filter 414 is synchronized with the RGB image based on the RGB image synchronization signal so as to be synchronized with the image reading of the infrared electronic scope 402. Further, the output signal of the camera control unit 405 is output to the HDTV monitor device 408 via the multi-high resolution frame memory device 407 to display a color image.

On the other hand, in order to obtain an image of the infrared electronic scope 402 by the illumination light from the second light source 404, a control signal from the camera control unit 405 is used.
When the infrared electronic scope 402 is connected to the second light source 404 by the optical path switching device 424 and the signal switching device 425,
An image can be obtained by illuminating the second light source 404. The second light source 404 is different from the first light source 403 in the configuration of the rotary filter 414, and performs color separation not in the normal visible light amount region but in the ultraviolet light amount region and the infrared light amount region.

The color-separated image is converted into an image by the camera control unit 405, and the image level is changed from the camera control unit 405 to the infrared electronic scope 40.
The light is input from the output connector 413 to the second light source 404 via the second communication line. The input image level signal is input to the syscon 421 by the communication circuit 420. The syscon 421 transmits the image signal level obtained from the communication circuit 420 to the exposure control circuit 419, so that the diaphragm unit 41 is opened.
The drive amount of No. 8 is adjusted so that an image with proper exposure is obtained by the camera control unit 405.

Then, for example, as shown in FIG. 29, the R, G, B images 432, 433, 434 read from the image file device 406 are displayed on the upper side of the monitor screen 431, and the ultraviolet region of the ultraviolet region is displayed on the lower side. The image 435 and the two infrared images 436 and 437 are displayed simultaneously. According to this example, not only the change in the normal visible range image in the region of interest but also the change in the ultraviolet light amount region and the infrared light amount region can be observed, so that the change in natural fluorescence and the degree of progress in the living body mucosa can be observed. By making it possible to observe changes and the like on the same monitor, there is an effect of improving diagnostic ability.

As another embodiment of the combination of the light source for normal observation and the light source for special observation, the light source for special observation has an optical density of 805 nm for calculating the concentration of ICG dye injected intravenously.
The difference in logarithm between the images obtained by the filters with the center wavelengths of 900 nm and 900 nm is calculated and displayed, so that the normal visual color image is used for diagnosis and the blood flow velocity of the living body is injected intravenously. The biological function information calculated by the time-series change in the obtained dye concentration may be displayed on the same monitor. Also,
A light source for special observation may be provided with a filter for calculating the hemoglobin distribution image and the hemoglobin oxygen saturation image. Further, two normal color images of R, B and B, and fall through images such as G image and IR (infrared region) image may be simultaneously displayed at the same angle of view on the monitor screen.

FIG. 30 shows a system 501 according to the eleventh embodiment of the present invention. Conventionally, ICG is intravenously injected during infrared observation, and the region of interest is observed in time series with infrared images, and lesions are comprehensively diagnosed by switching to visible images.
In addition, in the electronic endoscope, a still image of a region requiring recording of an observed region is recorded in the image file device. Moreover, the still image was displayed on the small screen. Furthermore, during the endoscopic examination, the endoscopic examination was performed after confirming the image of the previous region of interest. Therefore, since it was not easy to compare, in this embodiment, when observing the current image, by facilitating the comparison between the current image and a still image with a time difference, it is possible to make a diagnosis based on a time-series change of the observation site. HD that can improve performance
It realizes a TV display device.

In this embodiment, in order to facilitate the time series observation of infrared rays during infrared observation, the time series infrared images after intravenous injection of ICG are displayed in time series as still image images, so that the observation site It is intended to facilitate the observation of hemodynamics of the living mucous membrane and improve the diagnostic ability by the temporal change of the ICG dye concentration and the change of the dye concentration between each site.

Next, the system 501 will be described. As shown in FIG. 30, this system 501 includes an electronic scope 502 inserted into a living body, an endoscope apparatus main body 503 configured by a light source and a camera control unit, which enables infrared observation, and a start signal. An image file device 504 for recording an endoscopic image signal, an image file device 504 for recording an endoscopic image signal, image data from the image file device 504, and an endoscope device body 503 A multi-high resolution frame memory device 505 which synthesizes image data and displays it at a designated monitor position.
And an HDTV monitor device 506. The image file device 504 records image data at designated intervals during observation after ICG intravenous injection. On the other hand, the multi-high resolution frame memory device 505 is configured as shown in FIG.

A CPU circuit 510 that receives image data from the image filing device 504 and controls the entire device.
Under the control of the CPU circuit 510, the first and second
A control logic circuit 513 for controlling the frame memories 511 and 512, and a memory circuit 514 for processing the image data input from the image filing device 504.
And a first frame memory 511 for displaying the image of the memory circuit 514 on the HDTV monitor device 506,
Interface circuit 5 for inputting image data output from the endoscope apparatus main body 503 as a digital signal
15, a data conversion circuit 516 for converting the input image data into HDTV table size image data, a second frame memory 512 for displaying the image data of the endoscope apparatus on an HDTV monitor, and a first frame memory 512. And a D / A for synthesizing the digital image signals output from the second frame memories 511 and 512 and converting them into analog HDTV signals for display.
And a conversion circuit 517.

Next, the operation of this embodiment will be described. The electronic mucosa 502 inserted into the living body allows observation of the living mucous membrane. Here, if infrared observation is selected with the endoscope device for the purpose of observing hemodynamics in the living mucous membrane, the illumination light of the endoscope device becomes infrared, and the current moving image on the monitor screen 520 shown in FIG. 32 is displayed. The display area of the image 521 becomes an infrared image rather than a visible image.

Next, by intravenously injecting ICG, the dye concentration in the blood in the living mucous membrane fluctuates, and the region where the blood flow is fast,
The dye concentration increases rapidly after ICG intravenous injection. Here, a start signal is input to the image file device 504 at the timing when the ICG is intravenously injected from the endoscope device 503 during the infrared observation mode, and infrared still images are displayed as image files at preset intervals. Recorded in device 504. The multi-high resolution frame memory device 505 receives the moving image from the endoscope device 503 and the captured infrared image from the image file device 504 at predetermined intervals.
The input infrared still image is reduced by the CPU circuit 510, data-transferred to the memory circuit 514, and transferred from the memory circuit 514 to the first frame memory 511 via the DMA data bus.

On the other hand, the infrared moving image input from the endoscope apparatus 503 is converted into digital data by the interface circuit 515, and the data is converted by the data conversion circuit 516 so that it can be displayed on the HDTV monitor 506. To be converted. The converted image data is transferred from the second frame memory 512 to the image bus under the control of the control logic circuit 513 via the system bus. The D / A conversion circuit 517 synthesizes the image data transferred to the image bus and outputs it as analog image data. The output image data is displayed on the monitor device 506 as shown in FIG.

For example, the current moving image 521 is displayed on the right side of the monitor screen 520, and the left side of the current moving image 521 is a time series of changes in the ICG concentration in the mucous membrane after intravenous injection of ICG at regular intervals (10 seconds in this case). Infrared images 522 (eg, six) are displayed simultaneously. In this way, by displaying the current moving image 521 and the time-series infrared image 522 after ICG intravenous injection on the same monitor, the change amount of the ICG concentration can be accurately determined. According to this embodiment, since the temporal change in the pigment concentration of the living mucous membrane and the change between the regions are displayed at the same time as the current moving image, each image can be easily compared, and the hemodynamics of the living mucous membrane can be compared. Since changes are observed accurately,
It has the effect of improving the diagnostic ability.

FIG. 33 shows a system 601 according to the twelfth embodiment of the present invention. This system 601 displays a plurality of still images recorded during the inspection on the same monitor as the moving image currently being observed. In the system 501 shown in FIG. 30, a release button provided on the electronic scope 502 is used. As a result, when a release signal is output to the endoscopic device 503, the endoscopic device 503 outputs the release signal to the image filing device 504. Then, the image file device 504 records a still image based on the input release signal.

The recorded image signals are input to the multi-high resolution frame memory device 506, and in the same display form as the tenth embodiment, the normal moving images are displayed in the order of release on the same monitor 506. It is displayed as shown at 34. For example, in the same case, by displaying the released image on the monitor screen 610 shown in FIG. 34 simultaneously with the current moving image 611 and the released still image 612,
The omission of imaging is eliminated and comparison with other parts can be easily performed. In FIG. 34, 1 to 6 in the released image 612 indicate the release order.

According to this embodiment, the image filing device 5
Since the still image recorded in 04 is simultaneously displayed on the monitor 506 for observation, it is easy to confirm the omission of recording, and to compare the other part displaying the still image with the current image displaying the moving image. Therefore, there is an effect that the diagnostic ability is improved. Fig. 35
Is a monitor screen 70 according to the thirteenth embodiment of the present invention.
The display example of 1 is shown.

As shown in this figure, the current image 702 and an image of the lesion or the same site (previous image) 703 found by the previous examination are sized in the same size as the area currently being observed. It is input from the device to a multi-high resolution frame memory device and simultaneously displayed on the screen of an HDTV monitor. By displaying in this way, subtle changes in the lesion can be identified without overlooking, and the diagnostic ability can be improved.

Next, a fourteenth embodiment of the present invention will be described. The present embodiment is an electronic endoscope apparatus in which a plurality of image pickup devices are mounted on the tip of an endoscope and the video signals obtained by these image pickup devices are displayed on the same high-definition monitor. The elements and the imaging optical system are arranged so that at least some of them overlap each other, and means for correcting the signal level of the overlapping part of the imaging field of view is provided.

Hereinafter, description will be made with reference to FIGS. 36 to 38. FIG. 36 shows a tip portion 802 of an electronic endoscope 801 provided with a plurality of image pickup devices and an image pickup optical system. This FIG.
At the tip portion 802, the imaging optical systems 803a to 803a
03d are arranged in different viewing directions so that they can cover from the direct viewing direction to the side viewing direction.
A CCD 8 as an image sensor is provided on the focal planes of 3a to 803d.
04a to 804d are provided.

As can be seen from FIG. 36, each image pickup optical system 80
The visual fields 805a to 805d of 3a to 803d are arranged so as to overlap with the visual fields of the imaging optical systems adjacent to each other in the peripheral portion (the overlapping portions are indicated by diagonal lines). When the images are displayed on the display screen 806 of the high-definition monitor as shown in FIG. 37, the images 807a to 807d by the CCDs 804a to 804d are displayed so as to overlap in the peripheral portion (the overlapping portion is shown by hatching). In this example, CCD8
Although 04a to 804d are arranged in zigzag, they may be arranged along a straight line.

The CCDs 804a to 804d are connected to the signal processing circuit 811 shown in FIG. 38 via cables 808 and 809. CC in the signal processing circuit 811
The CCD drive signal from the D drive circuit 812 is supplied to the cable 8
Is applied to each CCD 804a to 804d via 08,
A video signal photoelectrically converted by each of the CCDs 804a to 804d is read, and the read video signal is a cable 809.
Corresponding CCD signal processing circuit 813a via
Is input to ~ 813d.

CCD signal processing circuits 813a to 813d
Performs various signal processing (for example, clamp, knee, γ conversion, color signal processing, white balance, AGC, etc.) by the A / D converters 814a to 814d, and then temporarily converts the signals into memories 815a to 815d. Stored in each.

The video signal data stored in each of the memories 815a to 815d is the image 807a to 807 shown in FIG.
The data is sequentially read according to the positional relationship of d, and the switch means 8
It is gated at 16 and added at the adder 817. The output of the adder 817 is input to the overlapping portion detection circuit 818 and the signal level correction circuit 819.

Adjacent CCDs (eg, 804a and 804)
b, 804b and 804c, etc.) captured images 807a-80.
In the portion where 7d overlaps, both video signal data are read from the memories 815a to 815d and added,
The signal level of the overlapping portion becomes higher than that of the signal level portion that does not overlap.

The overlap portion detection circuit 818 detects the change point to detect that it is an overlap portion, and controls the signal level correction circuit 819 so that the signal level of the overlap portion and the non-overlap portion are different. Correct that it becomes continuous. For example, in the overlapping portion, the gain of the signal level correction circuit 819 is controlled to 1/2 to correct the discontinuity.

The output of the signal level correction circuit 819 is D
After being converted into an analog signal by the / A converter 820, it is input to a high-definition monitor via a signal processing circuit (not shown).

According to the fourteenth embodiment, a plurality of image pickup means are used to pick up images in a state where the surroundings overlap each other, and the images obtained by these image pickup means are connected and displayed on the high-definition monitor. Therefore, a continuous panoramic image with a wide field of view can be obtained.

Next, a fifteenth embodiment of the present invention will be described. The present embodiment is an electronic endoscope apparatus in which a plurality of image pickup devices are mounted on the tip of an endoscope and the image signals obtained by the respective devices are displayed on the same high-definition monitor. The parts are common, and the common drive signal is transmitted by the same transmission means. Hereinafter, a specific description will be given with reference to FIGS. 39 and 40.

FIG. 39 shows the distal end portion 8 of the electronic endoscope 801 '.
02 is shown. This electronic endoscope 801 ′ is the same as the electronic endoscope 801 shown in FIG. 36, except that a buffer circuit 831 is provided in the distal end portion 802, and the input end of this buffer circuit 831 is a main body device (not shown) via a cable 832. CCD drive circuit (for example, CCD drive circuit 81 in FIG. 38)
2), the drive signal supplied from the CCD drive circuit is once input to the buffer circuit 831 and is distributed by the buffer circuit 831 to be distributed to the CCDs 804a to 804a-8c.
04d.

As shown in FIG. 40, the structure of the buffer circuit 831 is such that the drive signal supplied by the cable 832 is supplied to each CC by the buffers 833a to 833d.
D 804a to 804d are distributed to drive signals and each C
It is supplied to the CDs 804a to 804d. Note that in FIG. 40, one signal line is shown for simplification, but in reality, there are a plurality of signal lines, and buffers 833a to 833 are provided for each signal line.
33d is provided and distributed.

Other configurations and operations are similar to those of the fourteenth embodiment. According to this embodiment, the CCD 804a
Since the common cable 832 is used as the transmission cable of the drive signal for driving the .about.804d, the number of cables inserted through the electronic endoscope 801 'can be reduced. That is, there is an advantage that the diameter of the insertion portion can be reduced.

Next, a sixteenth embodiment of the present invention will be described. The present embodiment relates to a signal processing circuit provided in the main body device of an electronic endoscope shown in the fourteenth or fifteenth embodiment, in which a panoramic image with a wide field of view is satisfactorily and continuously formed from video signals of a plurality of image pickup devices. The purpose is to achieve high resolution. Hereinafter, a specific description will be given with reference to FIG.

Similar to the fourteenth embodiment or the fifteenth embodiment, the video signals read from the CCDs 804a to 804d are CCD processing circuits 813a to 813, respectively.
After various signal processing is performed in 13d, the signals are converted into digital signals in A / D converters 814a to 814d and temporarily stored in the memories 815a to 815d. Memory 815
Each of the video signal data stored in a to 815d is read according to the image position displayed on the monitor screen, gated by the switch means 816, and each of the coefficient units 841a to 841a.
841d and the correlation detection position correction circuit 8
42 is input.

The correlation detection position correction circuit 842 is the CCD 804a being read from the memories 815a to 815d.
By detecting the correlation of the overlapping portions of the imaging visual fields of ˜804d,
The position correction value that maximizes the correlation is calculated, and the memory R /
It outputs to the W control circuit 843 and the level correction control circuit 844. The memory R / W control circuit 843 stores the corresponding video signal memories 815a to 815a based on the position correction value.
The timing of reading from 815d is controlled to correct the image shift in the overlapping portion of the imaging visual fields.

Further, the level correction control circuit 844 controls the coefficients of the coefficient units 841a to 841d based on the position correction value to correct the level discontinuity in the overlapping portion of the imaging visual fields. The outputs of the coefficient units 841a to a841d are added by the adder 845, and then added to the D / A converter 8
At 46, it is converted into an analog signal and output to a high-definition monitor via a signal processing circuit (not shown). This first
In the sixth embodiment, as in the fourteenth or fifteenth embodiment, an image with a wide field of view is obtained and the display position of each image is corrected, so that the continuity is good and the resolution is high. A panoramic image can be obtained.

Next, a seventeenth embodiment of the present invention will be described. This embodiment is intended to obtain a panoramic image with a wide field of view and a higher resolution. Below, FIG.
And, it will be specifically described with reference to FIG. An electronic endoscope system 901 of the seventeenth embodiment shown in FIG. 42 includes an electronic endoscope 902 having two image pickup means built therein, a light source device (not shown) for supplying illumination light to the electronic endoscope 902, and an electronic endoscope 902. The endoscope 902 includes a signal processing circuit 903 that performs signal processing for the image pickup means, and a high-definition monitor (not shown) that displays the signal-processed video signal.

At the tip portion 905 of the electronic endoscope 902, two image pickup optical systems 906a and 906b and a CCD 90 arranged on the focal plane of each image pickup optical system 906a, 906b.
Two image pickup means 7a and 907b are built in. As can be seen from the figure, the two imaging optical systems 906a and 906
b (CCDs 907a and 907b) are arranged so that their imaging fields of view overlap. 2 as shown in FIG.
In the overlapping portion 908 of the CCDs 907a and 907b, the pixel pitches P of the CCDs 907a and 907b are shifted by 1/2,
Two CCDs 907a and 907b are arranged.

In the CCDs 907a and 907b, the drive signals generated by the CCD drive circuit 911 in the signal processing circuit 903 are the cables 912a and 91 in the electronic endoscope 902.
The video signal is read by being supplied via 2b. The two video signals are respectively input to the corresponding CCD signal processing circuits 914a and 914b via cables 913a and 913b in the electronic endoscope 902, and after various signal processing, digital signals are output by A / D converters 915a and 915b. It is converted into a signal and temporarily stored in each of the memories 916a and 916b.

The respective video signal data stored in the memories 916a and 916b correspond to the CCDs 907a and 9c shown in FIG.
07b are sequentially read according to the positional relationship of 07b and input to the multiplexer (MUX) circuit 917. The MUX circuit 917 outputs the video signal as it is in the area of one CCD alone, and outputs it in the overlapping area 908 of the image.
Two video signals are time-division multiplexed and output. The output of the MUX circuit 917 is converted into an analog signal by the D / A converter 918, and is output to the high-definition monitor via a signal processing circuit (not shown).

In this embodiment, two CCDs 907 are used.
The pixels a and 907b are arranged so as to be shifted from each other by ½ pitch, and the overlapping portion 908 of the visual fields (images) is time-division multiplexed. Therefore, the resolution of the image in this portion 908 is significantly improved. It becomes possible to do.

The above-described embodiments may be partially combined to form different embodiments.
Further, the present invention can be similarly applied to a device using a TV camera having a plurality of image pickup elements instead of the electronic endoscope having a plurality of image pickup elements.

[0117]

As described above, according to the present invention, the observation moving image under inspection is displayed in the first area of the display means, and the still image corresponding to this moving image is displayed in the second area of the display means. There is an effect that it is possible to improve the diagnostic ability by enabling simultaneous display in the area. .

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing a structure on a distal end side of an electronic endoscope according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a schematic configuration of the first embodiment.

FIG. 3 is an explanatory diagram showing a display example on a monitor according to the first embodiment.

FIG. 4 is a block diagram showing a schematic configuration of a second embodiment of the present invention.

FIG. 5 is an explanatory view showing the structure of the distal end side of the electronic endoscope according to the second embodiment.

FIG. 6 is an explanatory diagram showing a display example on a monitor according to the second embodiment.

FIG. 7 is an explanatory diagram showing another display example on the monitor according to the second embodiment.

FIG. 8 is a configuration diagram of a third embodiment of the present invention.

FIG. 9 is an enlarged view of a light blocking member according to a third embodiment.

FIG. 10 is a configuration diagram of a fourth embodiment of the present invention.

FIG. 11 is a front view of a rotary filter according to a fourth embodiment.

FIG. 12 is an operation explanatory diagram of the fourth embodiment.

FIG. 13 is an explanatory diagram showing a structure on a distal end side of an electronic endoscope according to a fifth embodiment of the present invention.

14 is a front view of FIG.

15 is a cross-sectional view taken along the line AA ′ of FIG.

FIG. 16 is a configuration diagram of a sixth embodiment of the present invention.

FIG. 17 is an operation explanatory diagram of the sixth embodiment.

FIG. 18 is a schematic configuration diagram of a seventh embodiment of the present invention.

FIG. 19 is a block diagram showing a configuration of a multi-high resolution frame memory device according to a seventh embodiment.

FIG. 20 is an explanatory diagram showing a display example on a monitor according to the seventh embodiment.

FIG. 21 is a schematic configuration diagram of an eighth embodiment of the present invention.

FIG. 22 is a block diagram of a multi-high resolution frame memory device according to an eighth embodiment.

FIG. 23 is an explanatory diagram showing a display example on the monitor according to the eighth embodiment.

FIG. 24 is a schematic configuration diagram of a ninth embodiment of the present invention.

FIG. 25 is a block diagram of a multi-high resolution frame memory device according to a ninth embodiment.

FIG. 26 is an explanatory diagram showing a display example on the monitor according to the ninth embodiment.

FIG. 27 is a schematic configuration diagram of a tenth embodiment of the invention.

FIG. 28 is a configuration diagram of a main part of the tenth embodiment.

FIG. 29 is an explanatory diagram showing a display example on the monitor according to the tenth embodiment.

FIG. 30 is a schematic configuration diagram of an eleventh embodiment of the present invention.

FIG. 31 is a block diagram of a multi-high resolution frame memory device according to the eleventh embodiment.

FIG. 32 is an explanatory diagram showing a display example on the monitor in the eleventh embodiment.

FIG. 33 is a schematic configuration diagram of a twelfth embodiment of the present invention.

FIG. 34 is an explanatory diagram of a display example on the monitor according to the twelfth embodiment.

FIG. 35 is an explanatory diagram showing a display example on the monitor according to the thirteenth embodiment of the present invention.

FIG. 36 is a diagram showing a distal end portion of an electronic endoscope according to a fourteenth embodiment of the present invention.

FIG. 37 is an explanatory diagram showing a manner in which images from four CCDs are simultaneously displayed on a high-definition monitor in the fourteenth embodiment.

FIG. 38 is a block diagram showing the configuration of a signal processing circuit according to a fourteenth embodiment.

FIG. 39 is a view showing a distal end portion of an electronic endoscope according to a fifteenth embodiment of the present invention.

FIG. 40 is a circuit diagram of a buffer circuit according to a fifteenth embodiment.

FIG. 41 is a block diagram showing the configuration of a signal processing circuit according to a sixteenth embodiment of the present invention.

FIG. 42 is a schematic configuration diagram of a seventeenth embodiment of the invention.

FIG. 43 is a diagram showing a positional relationship between overlapping portions of two CCDs in the seventeenth embodiment.

[Explanation of symbols]

501 ... Electronic endoscope system 502 ... Electronic endoscope 503 ... Endoscopic device 504 ... Image file device 506 ... Hi-vision monitor

Front page continued (72) Inventor Kenji Kimura 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Industry Co., Ltd. (72) Inventor Yutaka Takahashi 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Kogyo Co., Ltd. (56) Reference JP-A-1-280440 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) A61B 1/00-1/32

Claims (2)

(57) [Claims] 1. A moving image signal input means for inputting a predetermined moving image signal, and a release input for inputting a release signal indicating a desired timing with respect to the moving image signal input from the moving image signal input means. Means, still image signal generation means for generating a predetermined still image signal from the moving image signal based on a release signal input from the release input means, and still image corresponding to the still image signal generated by the release signal. An image filing device for recording an image, and a first moving image display device for displaying a moving image corresponding to the moving image signal input from the moving image signal input device when the release signal is input by the release input device. A still image displayed in the area and recorded in the image filing device according to a still image signal generated based on the release signal. Or the image processing apparatus characterized by been a still image <br/> input from the image file apparatus and a screen display control means for displaying the second region of the display means. Wherein said screen display control unit, according to claim 1, characterized in that to display the still image to be displayed on the second region, with the video display area of approximately the same to be displayed on the first region The image processing device according to item 1.