JP2930495B2 - Stereoscopic endoscope device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic endoscope apparatus for displaying, for example, an observation image of an endoscope as a stereoscopic image.

[0002]

2. Description of the Related Art In general, for example, by using a laparoscope, which is a rigid endoscope inserted into the abdominal cavity, as a means for treating an affected part in the abdominal cavity of a patient, the abdominal cavity can be treated without performing a surgical laparotomy. Techniques have been developed for treating affected areas. When treating the affected part in the abdominal cavity under this kind of laparoscope, the field of view of the laparoscope is directed toward the affected part, and the treatment is performed while observing the affected part and a treatment tool for performing various treatments on the affected part in the field of view of the laparoscope. The operation of the tool is performed.

In addition, a two-dimensional (2D) image display for displaying an observation image two-dimensionally on a monitor screen is often performed as an image display device of an observation optical system using a laparoscope. However, in the 2D image display, it is difficult to grasp the perspective, and it is difficult to grasp the relative distance between the affected part and the treatment tool.
Work such as operation of the treatment tool and suturing of the affected part is difficult, and the work requires skill.

[0004] Therefore, by performing a three-dimensional (3D) image display in which an observation image is stereoscopically displayed on a monitor screen as an image display device of an observation optical system using a laparoscope, the relative distance between the affected part and the treatment tool is displayed. Techniques have been developed to make it easier to grasp a proper distance and to streamline operations such as operation of a treatment tool and suturing of an affected part.

[0005] Further, as a technique for displaying a 3D image for displaying an image three-dimensionally on a monitor screen, for example, as disclosed in Japanese Patent Publication No. 4-45035 and Japanese Patent Publication No. 4-46508, left and right imaging optical systems are disclosed. A system is known in which a stereoscopic image is displayed on a monitor screen from left and right images obtained by these two sets of optical systems.

In this case, when displaying a three-dimensional image on a monitor screen, left and right image signals transmitted from two sets of left and right imaging optical systems are transmitted to a display unit such as a monitor. Then, the left and right image signals are alternately switched and output for each field from the image signal processing unit on the display unit side. Further, images based on the left and right image signals output from the image signal processing unit are alternately projected on the monitor screen. At this time, the stereoscopic video is reproduced by viewing the left and right video images through shutters that open and close alternately corresponding to the left and right video images.

[0007]

The 3D image pickup device having the conventional configuration is manufactured as an independent device completely separate from the 2D image pickup device. Therefore, the imaging device to be used is completely different between the case of capturing a 3D video and the case of capturing a 2D video.
It is difficult to switch to imaging of D video,
It is also difficult to switch to 3D video imaging during video imaging.

[0008] Here, when the imaging of the 2D video and the imaging of the 3D video are selectively used as necessary, it is necessary to prepare an imaging device for the 3D video and an imaging device for the 2D video, respectively. There is a problem that the whole system becomes large.

The present invention has been made in view of the above circumstances, and its object is to easily switch between 3D video imaging and 2D video imaging, to achieve 2D video imaging and 3D video imaging. It is an object of the present invention to provide a stereoscopic endoscope apparatus that can reduce the size of the entire system even when the user uses the information as needed.

[0010]

According to the present invention, there is provided a first imaging means, and a first imaging means for processing an output from the first imaging means.
A signal processing unit, a second imaging unit configured separately from the first imaging unit, and a signal processing unit that processes an output from the second imaging unit and the first signal processing unit. Second signal processing means detachably configured, timing pulse generation means for determining operation timings of the first and second signal processing means, first signal processing means and second signal processing Detecting means for detecting whether or not the means is connected; and generating the timing pulse when the detecting means detects that the first signal processing means and the second signal processing means are not connected. Means for generating a two-dimensional image based on the output from the first imaging means and determining the operation timing so as to output the two-dimensional image to a monitor means, wherein the first signal processing means and the second signal processing means
Detecting that the signal processing means is connected, generates the three-dimensional image based on the outputs from the first and second imaging means, and determines that the operation timing is to be output to the monitor means. It is a stereoscopic endoscope apparatus characterized by the following.

[0011]

If the detecting means detects that the first signal processing means and the second signal processing means are not connected, the two-dimensional image is generated by the timing pulse generating means based on the output from the first imaging means. Is generated, and the operation timing is determined so as to output the generated signal to the monitor means, and is used as a 2D camera. If it is detected that the first signal processing means and the second signal processing means are connected, the first signal processing means
The operation timing is determined so as to generate a three-dimensional image based on the output from the second imaging means and output the generated three-dimensional image to the monitor means, so that the 3D camera can be switched to be used. Furthermore, by using some of the components in common for the first signal processing means and the second signal processing means, the entire apparatus can be downsized and the cost can be reduced.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described below with reference to FIG. FIGS. 1A and 1B show an arrangement state of an observation optical system for photographing 3D images arranged in a distal end component section 2 of an insertion section 1 of an endoscope. The observation optical system is provided with left and right imaging units (imaging means) 3 and 4 having left and right binocular parallax with respect to a subject.

Further, the right imaging unit 3 is located outside the right imaging unit 3.
A right illumination optical system 5 for illuminating the subject and a left illumination optical system 6 for illuminating the subject of the left imaging unit 4 are provided outside the left imaging unit 4, respectively.

The right imaging section 3 is provided with an objective lens 7 and a solid-state imaging device 8 such as a CCD for converting a right observation image formed by the objective lens 7 into an electric signal. Similarly, the left imaging unit 4 has an objective lens 9
And a solid-state imaging device 10 that converts a left observation image formed by the objective lens 9 into an electric signal.

Further, the right illumination optical system 5 includes an illumination lens 11 and a light guide 1 formed by an optical fiber.
The left illumination optical system 6 has an illumination lens 13.
And a light guide 14 formed by an optical fiber.

The input terminals of the solid-state imaging device 8 for the right observation image and the solid-state imaging device 10 for the left observation image are shown in FIG.
As shown in (C), for example, the endoscope is connected to left and right CCD drive circuits 15 and 16 in a video processor (not shown) to which the endoscope is detachably connected. Is connected to a signal processing circuit 18 for a video signal via a signal switch 17.

The signal processing circuit 18 is connected to a 3D monitor (display means) 19 for reproducing a video based on each video signal sent from the left and right solid-state imaging devices 8 and 10 on a video reproduction screen and displaying a stereoscopic video. ing. In addition, the left and right C
The CD drive circuits 15 and 16 are connected to a synchronization signal generator 20, respectively.

The synchronizing signal generator 20 generates a synchronizing signal in the double scan mode of 1/120 s. Based on the synchronizing signal output from the synchronizing signal generator 20, the left and right CCD driving circuits 15 and 16 operate. The left and right solid-state imaging devices 8 and 10 are driven in the double scan mode of 1/120 s, and the signal switch 17 is likewise driven by 1/12 s.
The switching operation is performed in the double scan mode of 0 s.

An illumination light control mechanism (illumination optical system control means) 21 shown in FIG. 1D is provided in the light source device of the endoscope. In this case, the light source device includes a lens 23 for condensing illumination light from the illumination lamp 22 and light guides 12 and 14.
Lenses 24 and 25 for condensing illumination light are provided on each of the incident end faces.

The light guide 12 of the right illumination optical system 5
And the incident end of the light guide 14 of the left illumination optical system 6 are arranged substantially parallel to each other while being inserted into the light source device. The optical axis direction of the lens 23 and the optical axis direction of the lenses 24 and 25 are arranged at positions substantially orthogonal to each other.

Further, at the intersection between the central portion between the optical axes of the lenses 24 and 25 and the optical axis of the lens 23, the lens 2
An optical path switching mirror that switches between a position where the illumination light from the illumination lamp 22 condensed by 3 is reflected toward the incident end face of the right light guide 12 and a position where the illumination light is reflected toward the incident end face of the left light guide 14. 26 are provided. The optical path switching mirror 26 is constituted by a mechanism such as a galvanometer used for a video disk or the like.

The mirror driver 27 of the optical path switching mirror 26 is connected to the synchronization signal generator 20. The optical path switching mirror 26 is switched in synchronization with the operation timings of the left and right solid-state imaging devices 8 and 10 based on the synchronization signal output from the synchronization signal generator 20, and is switched from the left and right illumination optical systems 5 and 6. The illumination timing of the illumination light is adjusted to the imaging operation of each of the left and right solid-state imaging devices 8 and 10. That is, during the imaging operation by the right solid-state imaging device 8, the illumination light is emitted only from the right illumination optical system 5, and the left solid-state imaging device 10
Is set so that the illumination light is emitted only from the left illumination optical system 6 during the imaging operation by.

Next, the operation of the above configuration will be described.
First, at the time of endoscopic observation, the left and right CCD driving circuits 15, based on the synchronization signal output from the synchronization signal generator 20,
16, the left and right solid-state imaging devices 8 and 10 are 1/120.
While being driven in the s double scan mode, the signal switch 17 is similarly switched in the 1/120 s double scan mode. Then, the solid-state imaging device 10 for the left image
The left and right video signals converted into electric signals by the solid-state imaging device 8 for right and right images respectively are converted into signal processing circuits 18
Are read at the field frequency of the double scan mode of 1/120 s, respectively.

When a 3D image is captured, the optical path switching mirror 26 in the light source device is driven by the left and right solid-state image pickup devices based on the synchronization signal (t = 1/120 s) shown in FIG. The switching operation is performed in synchronization with the operation timings 8 and 10. Then, the irradiation timing of the illumination light from the left and right illumination optical systems 5 and 6 is controlled in accordance with the imaging operation of each of the left and right solid-state imaging devices 8 and 10. That is, illumination light is emitted only from the right illumination optical system 5 during the imaging operation by the right solid-state imaging device 8, and illumination light is emitted only from the left illumination optical system 6 during the imaging operation by the left solid-state imaging device 10. Is done.

Further, the left and right video signals are signal-processed by a signal processing circuit 18 and then supplied to a 3D monitor 19. The left and right images are displayed on the screen of the 3D monitor 19 at a double scan of 1/120 s. At this time, the left and right images are alternately displayed for each field and displayed.
The 3D image is reproduced by viewing the left and right images on the screen of the 3D monitor 19 via a pair of left and right liquid crystal shutters or the like that alternately open and close in response to the left and right images.

Therefore, in the above configuration, the total amount of illumination light supplied from the illumination lamp 22 of the light source device is synchronized with the imaging operations of the left and right solid-state imaging devices 8 and 10 so that the left and right illumination optical systems are synchronized. Since the light is supplied alternately to 5, 6, the illumination light emitted from the illumination lamp 22 of the light source device can be effectively used. Therefore, the observation distance of the 3D image by the endoscope can be increased.

Further, at the time of the imaging operation by the right solid-state imaging device 8, the illumination light is emitted only from the right illumination optical system 5, and at the time of the imaging operation by the left solid-state imaging device 10, the illumination light is emitted only from the left illumination optical system 6. Is irradiated, the bias of the illumination light in the observation field of view of the endoscope can be prevented, and the observation field can be illuminated substantially uniformly.

FIGS. 3A and 3B show a modification of the arrangement of the observation optical system at the tip of the insertion section 1 of the endoscope. This means that the periphery of the objective lens 7 of the right imaging unit 3 and the periphery of the objective lens 9 of the left imaging unit 4 are respectively located at the light emitting ends of the light guide 12 of the right illumination optical system 5 and the light guide 14 of the left illumination optical system 6. Expanded part 1 expanded to surround it
2a and 14a are formed.

Therefore, in this case, the light guide 1
2 expansion part 12a and light guide 14 expansion part 14
Due to a, the bias of the illumination light within the observation field of view of the endoscope can be effectively prevented, and the distribution state of the illumination light within the observation field of view can be more reliably made uniform.

FIG. 4 shows a modified configuration of the illumination light control mechanism 21 in the light source device. That is, in the illumination light control mechanism 21 shown in FIG. 4, the entrance end of the light guide 12 of the right illumination optical system 5 and the entrance end of the light guide 14 of the left illumination optical system 6 inserted into the light source device are connected to the optical path switching mirror 26. Are arranged in accordance with the direction of the reflected light reflected by the light source.

Therefore, in the above configuration, the direction of the optical axis of the incident end of the light guide 12 and the light guide 1
The direction of the optical axis of the incident end of the optical path 4 coincides with the direction of the reflected light reflected by the optical path switching mirror 26 in a state where the optical path switching mirror 26 is switched to the respective switching positions. The reflected light can be perpendicularly incident on the incident end face of the light guide 12 and the incident end face of the light guide 14, respectively. Therefore, the loss of the incident light can be prevented as compared with the case where the reflected light reflected by the optical path switching mirror 26 is obliquely incident on the incident end face of the light guide 12 and the incident end face of the light guide 14, respectively.

In the above embodiment, the optical path switching mirror 2 is used.
Numeral 6 denotes a mechanism constituted by a mechanism such as a galvanometer used for a video disk or the like. For example, an optical path switching mirror 26 is attached to an actuator such as a bimorph, and an electric signal is applied to the actuator such as a bimorph to reduce distortion. By causing the light path switching mirror 26
May be switched.

FIGS. 5A to 5C show two light source units 31a and 31b provided in a light source device. One light source unit 31a has an illumination lamp 33a,
Lens 3 for condensing illumination light from this illumination lamp 33a
4a, a lens 35a for condensing illumination light on the incident end face of the light guide 12 and a shutter 36a disposed between the lenses 34a and 35a are provided.

Similarly, the other light source unit 31b has an illumination lamp 33b, a lens 34b for condensing illumination light from the illumination lamp 33b, a lens 35b and a lens 34b for condensing illumination light on the incident end face of the light guide 14. And 3
5b are provided respectively.

Further, the shutters 36a and 36b have the configuration shown in FIG.
A disk-shaped shutter plate 38 shown in (C) is provided. The shutter plate 38 is fixed to a rotation shaft 39 of a drive motor. Further, a substantially fan-shaped light transmission port 40 is formed on the plate surface of the shutter plate 38. Each of the shutters 36a and 36b is driven to rotate by the drive motor, so that the incidence of illumination light on the incident end faces of the light guides 12 and 14 is controlled with the rotation of the shutter plate 38. ing.

Further, the shutters 36a and 36b are connected to a synchronization circuit 37. Then, the shutters 36a, 3
Reference numeral 6b denotes left and right solid-state imaging devices 8, 1 based on the synchronization signals P ₁ , P ₂ of FIG.
The optical paths are rotated and driven in synchronization with the operation timing of 0, and the respective optical paths are opened and closed in a state where the irradiation timing of the illumination light from the left and right illumination optical systems 5 and 6 is synchronized with the imaging operation by the left and right solid-state imaging devices 8 and 10. It is supposed to be.

That is, the shutter 36a is open and the shutter 36b
Are respectively switched to the closed state, and the right illumination optical system 5 is operated.
Only when the left solid-state imaging device 10 performs the imaging operation, the shutter 36a is switched to the closed state and the shutter 36b is switched to the open state, so that only the left illumination optical system 6 emits the illumination light. Is set to

Therefore, in the above configuration, the illumination light supplied from the illumination lamps 33a and 33b in the left and right light source units 31a and 31b of the light source device is used for the imaging operation by the left and right solid-state imaging devices 8 and 10. Since the left and right illumination optical systems 5 and 6 can be alternately supplied in synchronization with each other, the observation distance of the 3D image by the endoscope can be extended similarly to the first embodiment, and the endoscope can be used. It is possible to prevent the bias of the illumination light in the observation visual field and to illuminate the observation visual field substantially uniformly.

In the above embodiment, the shutter 36 is synchronized with the operation timing of each of the left and right solid-state imaging devices 8 and 10.
a, 36b are opened and closed, and the irradiation timing of the illumination light from the left and right illumination optical systems 5, 6 is adjusted by the left and right solid-state imaging devices 8, 1
Although the configuration adapted to the imaging operation by 0 is shown, the illumination lamps 33a and 33b of the two light source units 31a and 31b are turned on and off alternately in accordance with the imaging operation by the left and right solid-state imaging devices 8 and 10. It may be.

FIG. 6 shows a schematic configuration of a main part of a stereoscopic endoscope apparatus according to a first embodiment of the present invention. FIG.
Reference numeral 61 denotes an image sensor (first imaging unit) in the R camera that captures a right image for capturing 3D video, and 62 denotes an image sensor (second camera) in an L camera that captures a left image for capturing 3D video. Imaging means).

Reference numeral 63 denotes a video processing device (first signal processing means) to which an R camera is connected. The video processing device 63 further has a multi-scan monitor (3D video and 2D video). (Monitor means) 64 is connected.

Reference numeral 65 denotes a 3D video unit (second video camera) for detachably connecting to the video processing device 63 for capturing 3D video.
The L camera is connected to the 3D video unit 65. The 3D video unit 65 has a unit-side connector 65a protruding therefrom. The unit-side connector 65a is detachably connected to a receiving-side main body-side connector 63a formed on the video processing device 63. I have.

Further, the video processing device 63 is provided with a detecting means for detecting a connection state of the 3D video unit 65 at a connection portion with the 3D video unit 65. When the 3D video unit 65 is connected to the video processing device 63 in a normal connection state, for example, an L-level unit connection state detection signal is output.

In the image processing device 63, a pulse generator (timing pulse generating means) 66, an image pickup device driving section 67, a preamplifier circuit 68, a preprocessing circuit 69, a gamma correction circuit 70, an A / D converter 71, A frame memory 72 and a D / A converter 73 are provided. Note that the frame memory 72 has twice the capacity in advance, and uses a half capacity when used in 2D, and uses the entire capacity when used in 3D.

Further, the image sensor 61 in the R camera is connected to the image sensor driver 67 and the preamplifier circuit 68. Further, the preamplifier circuit 68 is connected to a D / A converter 73 via a preprocess circuit 69, a γ correction circuit 70, an A / D converter 71, and a frame memory 72 in order, and a monitor 64 is connected to the D / A converter 73. Is connected. Further, the pulse generator 66 includes an image sensor driving unit 6.
7, the pre-processing circuit 69, the A / D converter 71, the frame memory 72, the D / A converter 73, and the connection state detecting means of the 3D video unit 65 are connected respectively.

Here, when the detection signal from the connection state detecting means of the 3D video unit 65 is not input to the pulse generator 66, the pulse generator 66 operates in the 2D state where the reading frequency of the frame memory 72 is 1 / 60s. Is to be retained. Furthermore, 3D
When the detection signal from the connection state detecting means of the video unit 65 is input to the pulse generator 66, the pulse generator 66 switches the reading frequency of the frame memory 72 to the 3D state of 1/120 s. Note that the imaging devices 61 and 62 are set to 1/120 s.
May be alternately driven.

Further, inside the 3D video unit 65, an image pickup device driving section 75, a preamplifier circuit 76, a preprocessing circuit 77, a γ correction circuit 78, and an A / D converter 79 are provided.

Here, the image sensor 62 in the L camera is connected to the image sensor driver 75 and the preamplifier circuit 76. Further, the preamplifier circuit 76 includes an A / D converter 79 via a preprocess circuit 77 and a γ correction circuit 78 in order.
It is connected to the.

When the 3D image unit 65 is connected to the image processing device 63, the image pickup device driving section 75, the pre-processing circuit 77, and the A / D converter 79 are connected to the pulse generator 66, The D converter 79 is connected to the frame memory 72.

Next, the operation of this embodiment having the above configuration will be described. First, when used as a 2D camera in which the 3D video unit 65 is not connected to the video processing device 63, the detection signal from the connection state detecting means of the 3D video unit 65 is not input to the pulse generator 66. Therefore, in this case, the pulse generator 66 reads the frame memory 72 at a frequency of 1/60 s 2D.
Held in state.

The image sensor driving signal supplied from the pulse generator 66 to the image sensor driving section 67 gives
The signal charges stored in the image sensor 61 in the R camera are read. The read signal is amplified by a preamplifier circuit 68 and then input to a preprocess circuit 69, where the read signal is separated into a luminance signal and a color difference signal, and preprocessing such as white balance is performed. And the pre-processing circuit 6
The output signal from 9 is γ-corrected by the γ correction circuit 70.

After that, the digital data is converted by the A / D converter 71 and stored in the frame memory 72. Further, the image signal stored in the frame memory 72 is read out at a predetermined timing (readout frequency is 1/60 s, 2D state) under the control of the pulse generator 66.
Then, the read signal is converted into an analog signal by the D / A converter 73, output to the monitor 64, and a 2D video is displayed on the monitor 64.

When the 3D video unit 65 is connected to the video processing device 63 in a normal connection state, for example, an L level unit connection state detection signal is output from the connection state detecting means of the 3D video unit 65, This detection signal is input to the pulse generator 66, and the usage state as a 3D camera is detected.

Therefore, in this case, the pulse generator 66 switches the reading frequency of the frame memory 72 to the 3D state of 1/120 s. And
From the pulse generator 66 to the image sensor driving units 67 and 75
, The signal charges stored in the image sensor 61 in the R camera and the signal charges stored in the image sensor 62 in the L camera are read out.

The read signal is supplied to a preamplifier circuit 68,
After being amplified at 76, it is input to pre-processing circuits 69 and 77, where it is separated into a luminance signal and a color difference signal, and pre-processing such as white balance is performed. The output signals from the pre-processing circuits 69 and 77 are output from the γ correction circuit 7.
0 and 78 are γ-corrected. Thereafter, digital conversion is performed by the A / D converters 71 and 79, and the right image signal from the image sensor 61 in the R camera is stored in the frame memory 72 together with the left image signal from the image sensor 62 in the L camera.

Further, under the control of the pulse generator 66, the left and right image signals stored in the frame memory 72 have a predetermined timing (the read frequency is 1/12).
0s (3D state). This read signal is converted to an analog signal by the D / A converter 73,
It is output to the monitor 64 and the screen of the monitor 64 is 1 /
The left and right images are displayed by double scanning of 120 s. At this time, the left and right images are alternately displayed on a field-by-field basis, and the left and right images on the screen of the monitor 64 are passed through a pair of left and right liquid crystal shutters that open and close alternately in response to the left and right images. , The reproduction of the 3D video is performed.

Therefore, in the above configuration, a 3D video shooting 3D detachably connected to the video processing device 63 is provided.
A D video unit 65 is provided. When the 3D video unit 65 is not connected to the video processing device 63, the video processing device 63 is used as a 2D camera.
When 5 is connected in a normal connection state, it can be used by switching to a 3D camera.
The switching operation with the camera can be easily performed.

The pulse generator 66, the frame memory 72, and the D / A converter 73 in the video processing device 63 are commonly used by the R camera and the L camera for 3D video shooting. Compared to the case where the camera and the L camera are provided independently of each other, the entire apparatus can be downsized and the cost can be reduced.

FIG. 7 shows a modification of the 3D image display device of the endoscope. In FIG. 7, reference numeral 81 denotes an R image sensor that captures a right image for capturing 3D video, and 82 denotes an L image sensor that captures a left image for capturing 3D video.

The R image sensor 81 has an image sensor driving circuit 83
And the signal processing circuit 84 are connected,
Similarly, an image sensor driving circuit 85 and a signal processing circuit 86 are connected to the image sensor 82.

Further, 87 is a controller, and 88 is a synchronization signal generator. Here, the controller 87 includes an image sensor driving circuit 83 on the R image sensor 81 side and a signal processing circuit 8.
4 are connected, and an image sensor driving circuit 85 and a signal processing circuit 86 on the L image sensor 82 side are connected respectively. The synchronization signal generator 88 also has the R image sensor 8
The image sensor driving circuit 83 and the signal processing circuit 84 on the first side are connected, and the image sensor driving circuit 85 and the signal processing circuit 86 on the L image sensor 82 are connected respectively.

Here, the signal processing circuits 84 and 86 have white balance, AGC on / off, painting /
Level, enhancement level, photometry (Peak
k) switching between photometry and average photometry (APL)).

Therefore, in the above configuration, one controller 87 controls the R image sensor 81 and the L image sensor 8
Since the second signal processing circuits 84 and 86 are controlled, the size of the entire device can be reduced, and the cost can be reduced.

FIG. 8A shows an automatic light control mechanism for automatically adjusting the light emission amount of the illumination device of the 3D image display device of the endoscope according to the subject. In FIG. 8A,
91 is an integration circuit, 92 is a comparator, 93 is a reference power supply, 95
Is a clock generation circuit, 94 is an up / down counter, 9
6 is a D / A converter, and 97 is an aperture drive circuit.

Here, the integration circuit 91 has the configuration shown in FIG. That is, the integration circuit 91 has 2
A parallel circuit in which the capacitors 91a and 91b are connected in parallel and a resistor 91r are provided. Further, the parallel circuit is provided with a switch 91c for controlling the intermittent connection of one capacitor 91b. The ON / OFF operation of the switch 91c is controlled by the controller 87. By changing the integration time constant of the integration circuit 91 in accordance with the ON / OFF operation of the switch 91c, switching between peak (Peak) photometry and average photometry (APL) is performed.

Further, by changing the integration time constant of the integration circuit 91 in accordance with the ON / OFF operation of the switch 91c, after switching between peak (Peak) photometry and average photometry (APL), the next automatic adjustment is performed. Light operation is performed. First, the R image sensor 81 and the L image sensor 8 of the 3D video display device
2 are supplied to the integration circuit 91. This integration circuit 91 integrates the video signal for a certain time. At this time,
The video signal is set at a high level when the subject is bright, and at a low level when the subject is dark.

Here, when the subject is bright, the level of the video signal increases. When the output of the integration circuit 91 becomes higher than the output of the reference power supply 93, the output of the comparator 92 becomes a negative level, the up / down counter 94 starts counting down, and the output signal of the D / A converter 96 is output. Level drops. At this time, the aperture of the illumination device is closed by the aperture drive circuit 97, and the level of the video signal decreases.

When the subject is dark, the level of the video signal becomes low. When the output of the integrating circuit 91 becomes lower than the output of the reference power supply 93, the output of the comparator 92 becomes a positive level, the up / down counter 94 starts counting up, and the output signal of the D / A converter 96 is output. Levels rise. Therefore, the aperture of the illumination device is opened by the aperture drive circuit 97, and the level of the video signal increases.

Accordingly, the aperture of the illumination device is controlled by the aperture drive circuit 97 so that the output of the integration circuit 91 and the output of the reference power supply 93 match, so that the automatic light control is performed so that the brightness of the subject becomes constant. Is done.

FIG. 9 shows a signal adjusting mechanism for adjusting the variation of the left and right video signals of the 3D video display device of the endoscope. 9, reference numeral 101 denotes a right camera having a built-in R image sensor 81; 102, a left camera having a built-in L image sensor 82; 103, a signal processing circuit 8 of the R image sensor 81;
Reference numeral 104 denotes a pre-processing circuit built in the signal processing circuit 86 of the L image sensor 82.

Further, reference numerals 105 to 107 denote R output from the pre-processing circuit 103 of the right camera 101, respectively.
Signal lines of _R video signal, the signal lines of G _R video signal, B _R signal lines of the video signal, respectively the left camera 10 108-110
These are a signal line of an _RL video signal, a signal line of a _GL video signal, and a signal line of a _BL video signal output from the preprocessing circuit 104 on the second side.

Here, the GCA circuit 111, the signal line 108 of the _GL image signal, the signal line 109 of the _GL image signal, and the signal line 110 of the _BL image signal on the left camera 102 side, respectively.
112 and 113 are provided. Further, each of the GCA circuits 111, 112, 113 has a signal line 114, 115,
116 through the right camera 101 side of the R _R video signal of the signal line 105, G _R video signal of the signal line 106, B _R video signal of the signal line 107 are connected, respectively.

[0073] Then, R _R video signal of the right camera 101, G _R video signal, B _R video signal each GCA circuits 111, 112 and 113 of the left camera 102 side as a reference is controlled, the right camera 101 R _R video signal, G _R
Video signal, and B _R video signal, R _L video signals of the left camera 102 side, G _L video signals, variation in spectral sensitivity adjustment with B _L video signals and R imaging device 81 and the L image sensor 82 in a state of aligning the It is supposed to be.

FIG. 10A shows an example of an enhancement processing circuit of a 3D video display device for an endoscope.
In FIG. 10 (A), 121 is a signal line of the image signal Y _R of the object Y taken by the right camera R imaging device 81 is built, 122 is taken by the left camera L image sensor 82 is built A signal line of the image signal Y _L of the subject Y.

Here, an enhancement generation circuit 123 is provided on the signal line 121 on the right camera side. Then, it has become to create an enhanced signal in the image signal Y _R through the signal line 121 of the right camera, and adds them both image signals Y _R, the Y _L configuration.

FIG. 10B shows a modification of the enhancement processing circuit of the 3D video display device of the endoscope. This has a structure in which to create the enhanced signal by synthesizing the image signal Y _L of the image signal of the right camera Y _R and the left camera, and adds them both image signals Y _R, the Y _L.

FIG. 11 shows an example of the white balance adjustment mechanism. In FIG. 11, reference numeral 131 denotes a right camera in which an R image sensor 81 is built, and 132 denotes an L image sensor 8
Reference numeral 134 denotes a pre-processing circuit incorporated in the signal processing circuit 84 of the R image sensor 81;
Is a pre-processing circuit built in the signal processing circuit 86 of the L image sensor 82.

[0078] Here, R _R video signal output from the right camera 101 side of the preprocessing circuit 133, G _R video signal, B and _R image signals, output from the left camera 102 side of the pre-process circuit 134 R _L video signal, G _L video signals, synthesizes the B _L video signals, R _W video signal is the composite video signal output, G _W video signal, B _W video signal is 1:
The white balance is adjusted so as to be 1: 1.

FIG. 12 shows a pre-process circuit 133,
134 shows a control circuit. In FIG. 12, 14
1 denotes a signal line R _W video signal, 142 denotes a signal line G _W video signal, 143 is a signal line B _W video signal.

[0080] Here, R _W video signal, G _W video signal and B _W video signal comparator 144a, 144b, 144c
Is supplied to each non-inverting input terminal. Also, the comparator 144
a, 144b and 144c each have a reference power source k
An output of f is provided.

Then, each of the comparators 144a, 144b, 1
The output of 44c is a counter 145a, 145b, 145
c, D / A converters 146a, 146b, GCA circuit 147a through 146c, 147b, is supplied to 147c, each of GCA circuits 147a, 147b, the output signal R _W 'video signal, G _W' from 147c video signal and B _W ´
The pre-processing circuits 133 and 134 are controlled by video signals.

FIG. 13 shows a video processor 1 constituting a controller 87 provided in a 3D image display device of an endoscope.
51 shows an operation panel 152 of the first embodiment. The operation panel 152 includes a power switch 153, a freeze switch 154, a release switch 155, a still selection switch 156, a VTR switch 157, and a photometry changeover switch 15.
8, AGC (automatic sensitivity adjustment) switch 159, color bar switch 160, white balance switch 16
1, various switches such as a red adjustment knob 162 and a blue adjustment knob 163 are provided.

Then, in accordance with the operation of various switches on the operation panel 152 of the video processor 151, 3D
Signal processing circuits 84 and 86 for the left and right cameras of the video display device
Is controlled.

FIG. 14 shows a 3D image display device 171 for an endoscope.
This shows a second modified example. In FIG. 14, 172
173 is a light source device for supplying illumination light to the endoscope 172, and 174 is a signal processing unit for imaging signals captured by the electronic endoscope.

Here, an illumination optical system 175 and the left and right image pickup devices 1 for 3D image capturing are provided at the distal end portion 172 of the endoscope.
76 and 177 are provided. In addition, the light source device 173
Is provided with a light source lamp 178 and a condenser lens 179 for condensing illumination light from the light source lamp 178 on an incident end face of a light guide forming an illumination optical system 175. Further, an RGB rotation filter 180 is provided in an optical path between the illumination optical system 175 and the condenser lens 179.

The RGB rotary filter 180 is a motor 1
81, and is driven to rotate.
With the rotation of the GB rotation filter 180, R (red), G
Illumination light of three primary colors (green) and B (blue) is formed in a plane-sequential manner.

Reference numeral 182 denotes a rotary servo circuit for controlling the rotation of the motor 181, and 183 denotes left and right image pickup devices 176, 176.
177 drivers, these are the synchronization signal generation circuit 184
It is connected to the. Then, the image of the subject illuminated in a plane-sequential manner with the illumination light of the three primary colors of R, G, and B is formed on the imaging surfaces of the left and right imaging elements 176 and 177, and the left and right imaging elements 1
The left and right video signals converted into electric signals by 76 and 177 are read by the application of a read clock signal by the driver 183. The clock signal and the rotation servo circuit 182 are synchronized with the synchronization signal from the synchronization signal generation circuit 184.

Further, output signals from the left and right imaging elements 176 and 177 are amplified by a preamplifier circuit 185, and an isolation circuit 186 for protecting a patient from electric shock or the like.
, And is input to the reset noise removal circuit 187. The signal from which the reset noise has been removed by the reset noise removing circuit 187 is subjected to a low-pass filter 188 to remove unnecessary high frequencies, and then the white balance adjusting circuit 18
At 9, white balance adjustment is performed, and further γ correction is performed by the γ correction circuit 70.

FIG. 15 shows an example of the white balance circuit. Here, an R, G, B sequential signal 191 which is a video signal from the right image sensor 176 is input to the multiplier 193, and is passed through the S / H 194 to the comparator 19.
At 5,196, the level comparison of the R signal and the B signal with respect to the G signal is performed.

When the white balance switch 161 on the operation panel 152 of the video processor 151 is turned on, the U / D counter 197 causes the comparator 19 to operate.
The operation of counting 5,196 outputs is started.

Next, the count value of the U / D counter 197 passes through the D / A converters 198 and 199, and the white balance correction of R, G and B is performed by the sequential control signal from the control circuit 189A via the switching circuit 200. Output as a signal. The R, G, and B white balance correction signals are input to the multiplier 193 in the signal line of the R, G, and B sequential signals 191 that are video signals from the right image sensor 176, and are simultaneously input to the left. Image sensor 1
R, G, and B sequential signals 192 which are video signals from 77
Is input to the multiplier 201 in the signal line. Further, in the multipliers 193 and 201, the sequential signals 191 and 191 of the original R, G and B are output.
192 is sequentially multiplied by a correction signal to obtain white balance.

Accordingly, in this case, the white balance of the left and right video signals can be controlled by one system of white balance circuit, so that the white balance of the left and right video signals is controlled by independent white balance circuits. The size of the entire apparatus can be reduced, and the cost can be reduced.

FIG. 16 shows a third example of the endoscope 3D image display device.
This shows a modification of the first embodiment. In FIG. 16, reference numeral 211 denotes a right image sensor for photographing a 3D image, which is disposed at the distal end component of the insertion unit in the electronic endoscope; 212, a left image sensor;
Reference numeral 3 denotes a light guide of the illumination optical system.

A light source device 214 includes a light source lamp 215 and a light source lamp 215 in the light source device 214.
A condensing lens 218 is provided for condensing the illumination light from the light source 213 on the incident end face of the light guide 213 of the illumination optical system. Further, an RGB rotation filter 216 is provided in the optical path between the condenser lens 218 and the light source lamp 215.

The RGB rotary filter 216 is driven to rotate by a stepping motor 217. With the rotation of the RGB rotary filter 216, the three primary colors R (red), G (green) and B (blue) are provided. Illumination light is formed in a plane sequence.

Further, the output signals from the left and right image pickup devices 211 and 212 are subjected to gain control by a GCA 220 for sensitivity correction, and then a video signal is extracted by a sample and hold circuit 221, passed through a contour emphasis circuit 232, and subjected to a γ correction circuit 222. Supplied to the side.

Here, the sample hold circuit 221 and γ
Contour emphasis circuit 2 interposed between correction circuit 222
Reference numeral 32 is connected to an emphasis amount setting circuit 233, and the emphasis amount setting circuit 233 can appropriately set an outline emphasis amount.

The left and right video signals of the analog signal subjected to the γ correction by the γ correction circuit 222 are converted into digital signals by the A / D converter 223. The video signal is switched by the multiplexer 224 in synchronization with the illumination in the color plane sequence, and is stored in the R frame memory 225, the G frame memory 226, and the B frame memory 227 corresponding to each color of red, green, and blue. Each frame memory 225, 2
The read frequency of the left and right image signals in 26 and 227 is 1
/ 120 s, and the read signal is converted to an analog signal by D / A converters 228, 229, and 230, output to a 3D monitor 231 and output to the 3D monitor 231.
The left and right images are displayed on the screen of the monitor 231 by a double scan of 1/120 s. At this time, the left and right images are 1
The left and right images on the screen of the 3D monitor 231 are viewed through a shutter such as a pair of left and right liquid crystal shutters which are alternately displayed for each field and are alternately opened and closed in correspondence with the left and right images. Reproduction is performed.

FIG. 17A shows the left and right image pickup devices 21.
1 shows an example of a control circuit of a GCA 220 for sensitivity correction which controls the gain of output signals from the output signals 1 and 212. Here, the signal line 2 of the right video signal from the right image sensor 211
The GCA 243 is interposed at 42. Further, a video signal from the left image sensor 212 passing through the signal line 241 of the left video signal is supplied to the GCA 243 via the integration circuit 244. Therefore, in this case, the GCA 243 is controlled based on the left video signal, and the sensitivity of the right video signal is corrected.

FIG. 17B shows a modification of the control circuit of the GCA 220. Here, G is applied to the left video signal signal line 241 and the right video signal signal line 242.
CAs 251 and 252 are provided respectively. Then, after the left video signal and the right video signal are added via the adder 253, the control signal integrated by the integration circuit 254 is supplied to the GCAs 251 and 252, and the GCA 251 of the left video signal and the right video signal is output. 252 is controlled.

Therefore, in this case, the GCA2 of the left video signal and the right video signal is controlled by one GCA control circuit.
51 and 252 can be controlled, so that the entire apparatus can be reduced in size and cost can be reduced.

FIG. 18 shows a schematic configuration of the contour emphasis circuit 232 and the emphasis amount setting circuit 233. Here, the contour enhancement circuit 232 includes first and second delay lines (DL) 263 and 264 connected in series, a first adder 265, a 反 転 inverter 266, a second adder 267, A multiplier 268 and a third adder 269 are provided.

Then, the input signal of the right video signal from the signal line 261 and the first and second delay lines 263,
264 and the output signal delayed through the first adder 26
5 is added. Further, the output signal from the first adder 265 is inverted by １ ／ by a に し て inverter 266, and the output signal from the 反 転 inverter 266 is output by a second adder 267. First delay line 263
Is added to the output signal from

The output signal from the second adder 267 is multiplied by a predetermined size by a multiplier 268, and then the output signal from the multiplier 268 and the third adder 2
At 69, it is added to the output signal from the first delay line 263 and output.

The power supply 27 is provided to the emphasis amount setting circuit 233.
0 and a variable resistor 271 connected to the power supply 270. The DC voltage divided by the variable resistor 271 is applied to the multiplication amount setting terminal of the multiplier 268.

Further, the output signal from the multiplier 268 is connected to the left video signal signal line 262 through the first delay line 26.
3 is added to the output signal supplied through the third adder 272 and output.

Therefore, in the above configuration, an edge enhancement (enhancement) signal is created from the right video signal, and this edge enhancement signal is added to the left video signal. Accordingly, the outline emphasis control of the left video signal and the right video signal can be performed, so that the entire apparatus can be downsized and the cost can be reduced. Although the right video signal is used as the reference signal here, the left video signal may be used as the reference signal.

FIG. 19 shows a fourth modification of the endoscope 3D image display apparatus. This is provided with an aperture control mechanism for controlling the aperture of illumination light from the light source lamp 178 in the 3D image display device 171 of the endoscope according to the second modified example of FIG.

That is, here, in the optical path between the illumination optical system 175 and the condenser lens 179, an aperture 291 is provided together with the RGB rotation filter 180. The iris 291 is connected to an auto iris circuit 292 for appropriately controlling the amount of iris of the iris 291.

Further, a white balance adjusting circuit 189 is connected to the auto iris circuit 292. In the auto iris circuit 292, an aperture control signal is generated for one of the left and right video signals. Note that a configuration may be adopted in which the left and right video signals are added and then integrated by halving to create an aperture control signal.

A correction circuit 281 is provided between the white balance adjustment circuit 189 and the low-pass filter 188 so as to perform correction so that the variation of the color image signals R, G, and B in the frame sequence becomes substantially constant. I have.

The white balance adjustment is performed by the white balance adjustment circuit 189 and the γ correction circuit 7
The plane-sequential color video signals R, G, and B that have been subjected to γ correction by 0 are input to an A / D converter 282 and converted into digital signals. The output signal from the A / D converter 282 is written into one of frame memories 283R, 283G, and 283B corresponding to frame-sequential illumination for one frame.

Then, each frame memory 283R, 28
When one frame of image data is written to 3G and 283B, they are read simultaneously. Each of the synchronized signals is again converted into an analog signal by three D / A converters 284, and is further converted into three low-pass filters 28.
After the unnecessary high frequency is removed in step 5, three output amplifiers 2
86.

Each of the R, G, and B color video signals passed through each output amplifier 286 is output from a primary color signal output terminal having an output impedance of 75Ω. Further, output signals of the three output amplifiers 286 are supplied to a matrix circuit 288,
The matrix circuit 288 converts the signal into a color difference signal and a luminance signal. A color difference signal, a luminance signal, and a synchronization signal generation circuit 184 are output from the color encoder 289.
To generate an NTSC signal by synchronizing the synchronization signals. This NTSC signal is passed through a matching resistor 75Ω to the NTS
It is supplied to the C output terminal.

FIG. 20A is a first modified example showing the arrangement of the observation optical system at the distal end of the insertion section of the endoscope.
Here, the objective lens 302 of the right imaging unit and the objective lens 303 of the left imaging unit are juxtaposed on the distal end surface 301 of the distal end component in the insertion section of the endoscope, and the left and right objective lenses 302 and 303 are arranged side by side. A pair of illumination lenses 304 and 305 are arranged on both sides of the juxtaposed portion.

FIG. 20B is a second modification showing the arrangement of the observation optical system. This is because the left and right objective lenses 302 and 30 disposed on the distal end surface 301 of the distal end component are not provided.
One illumination lens 306 is arranged on one side of the three juxtaposed portions.

FIG. 20C is a third modification showing the arrangement of the observation optical system. This is because the left and right objective lenses 302 and 30 disposed on the distal end surface 301 of the distal end component are not provided.
One illumination lens 306 is arranged between the three. It should be noted that the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made without departing from the spirit of the present invention.

[0118]

According to the present invention, when the detecting means detects that the first signal processing means and the second signal processing means are not connected, the timing pulse generating means detects the output from the first imaging means. The operation timing is determined so as to generate a two-dimensional image and output it to the monitor means, and when it is detected that the first signal processing means and the second signal processing means are connected, the first and second imaging means Since the operation timing is determined so as to generate a three-dimensional image based on the output from the device and output it to the monitor means, it is possible to easily switch between 3D video imaging and 2D video imaging, and 2D video The entire system can be downsized even when the imaging of 3D and the imaging of 3D video are selectively used as necessary.

[Brief description of the drawings]

FIG. 1A is a schematic configuration diagram showing an arrangement state of an observation optical system in a distal end component of an endoscope, FIG. 1B is a front view thereof,
(C) is a schematic configuration diagram of a 3D image display device, and (D) is a schematic configuration diagram of an illumination light control mechanism.

FIG. 2 is a timing chart showing driving signals of a mirror driving mechanism.

FIGS. 3A and 3B show a modified example of the arrangement of the observation optical system at the distal end of the insertion section of the endoscope, wherein FIG. 3A is a front view and FIG.

FIG. 4 is a schematic configuration diagram showing a modification of the illumination light control mechanism in the light source device.

5A is a schematic configuration diagram of a light source device, FIG. 5B is a timing chart showing operation timings of right and left light source units, and FIG. 5C is a front view of a shutter plate.

FIG. 6 is a schematic configuration diagram of a main part showing a stereoscopic endoscope apparatus according to the first embodiment of the present invention.

FIG. 7 is a schematic configuration diagram showing a first modification of the endoscope 3D image display device.

FIG. 8A is a schematic configuration diagram illustrating an automatic light control mechanism,
(B) is a schematic configuration diagram of an integration circuit.

FIG. 9 is a schematic configuration diagram illustrating a signal adjustment mechanism that adjusts variations in left and right video signals.

10A is a schematic configuration diagram illustrating an example of an enhancement processing circuit, and FIG. 10B is a schematic configuration diagram illustrating a modification of the enhancement processing circuit.

FIG. 11 is a schematic configuration diagram illustrating an example of a white balance adjustment mechanism.

FIG. 12 is a schematic configuration diagram showing a control circuit of a pre-process circuit.

FIG. 13 is a front view showing an operation panel of the video processor.

FIG. 14 is a schematic configuration diagram showing a second modification of the 3D image display device of the endoscope.

FIG. 15 is a schematic configuration diagram illustrating an example of a white balance circuit.

FIG. 16 is a schematic configuration diagram showing a third modification of the endoscope 3D image display device.

17A is a schematic configuration diagram illustrating an example of a GCA control circuit for sensitivity correction, and FIG. 17B is a schematic configuration diagram illustrating a modification of the GCA control circuit.

FIG. 18 is a schematic configuration diagram showing an outline emphasis circuit and an emphasis amount setting circuit.

FIG. 19 is a schematic configuration diagram showing a fourth modification of the endoscope 3D image display device.

FIG. 20 shows an arrangement state of an observation optical system at a distal end of an insertion portion of an endoscope, where (A) is a front view of a first modified example,
(B) is a front view of the second modification, and (C) is a front view of the third modification.

[Explanation of symbols]

61 Image sensor in R camera (first imager) 62 Imager in L camera (second imager) 63 Image processor (first signal processor) 64 Monitor (monitor) 65 3D image unit (first imager) 2 signal processing means) 66 pulse generator (timing pulse generation means)

────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Shingo Kato 2-43-2 Hatagaya, Shibuya-ku, Tokyo Inside the Olympus Optical Industrial Co., Ltd. (72) Inventor Shinji Yamashita 2-43-2 Hatagaya, Shibuya-ku, Tokyo Inside the Olympus Optical Co., Ltd. (72) Susumu Takahashi 2-43-2, Hatagaya, Shibuya-ku, Tokyo Inside the Olympus Optical Co., Ltd. Atsushi Kibaru 2-43-2, Hatagaya, Shibuya-ku, Tokyo Inside the Olympus Optical Co., Ltd. (72) Shinsho Yasukui, the inventor No. 2 43-2, Hatagaya, Shibuya-ku, Tokyo Inside the Olympus Optical Co., Ltd. (72) Hideki Koyanagi, 2-43-2, Hatagaya, Shibuya-ku, Tokyo No. O Olympus Optical Co., Ltd. (72) Inventor Akira Murata 2-43-2 Hatagaya, Shibuya-ku, Tokyo O-limpus Hikari Within Gaku Kogyo Co., Ltd. (72) Inventor Wataru Ohno 2-43-2 Hatagaya, Shibuya-ku, Tokyo O-limpus Optical Industry Co., Ltd. (72) Inventor Akihiro Taguchi 2-43-2 Hatagaya, Shibuya-ku, Tokyo O-limpus (56) References JP-A-63-294509 (JP, A) JP-A-1-307719 (JP, A) (58) Fields investigated (Int. Cl. ⁶ , DB name) G02B 23 / 24-23/26 A61B 1/04

Claims (1)

(57) [Claims] A first imaging unit; a first signal processing unit for performing signal processing on an output from the first imaging unit; and a second imaging unit configured separately from the first imaging unit. An imaging unit; a second signal processing unit configured to perform signal processing on an output from the second imaging unit and to be detachable from the first signal processing unit; and the first and second signal processing. Timing pulse generating means for determining the operation timing of the means; and detecting means for detecting whether or not the first signal processing means and the second signal processing means are connected. When detecting that the first signal processing means and the second signal processing means are not connected, the timing pulse generating means generates a two-dimensional image based on an output from the first imaging means, and monitors the timing signal. Should be output to When the operation timing is determined and it is detected that the first signal processing means and the second signal processing means are connected, a three-dimensional image is generated based on the output from the first and second imaging means. Wherein the operation timing is determined so as to output the output to the monitor means.