JP2007306130A - Observation system and observation video signal transmission method - Google Patents

Abstract

In a conventional observation apparatus, an imaging unit and an image processing unit are connected by a transmission line using a single cable, and when the transmission line is interrupted by disconnection or the like, the image on the display unit disappears. Observation or processing is interrupted, and the connector is replaced or the observation device is replaced.
In the observation system, two video signals for stereoscopic video imaged by first and second image sensors 33 and 34 are mixed alternately in odd-numbered or even-numbered field units by a signal composite unit 51. The two video signals in a complementary relationship are transmitted to the signal restoration unit 52 through the video signal transmission cables 27 and 28 serving as at least two transmission paths, and the video signal restored by the signal restoration unit 52 is displayed on the monitor. When one transmission line is disconnected, the video signal transmitted through the other transmission line is distributed to two video signals for the right eye and the left eye, and is displayed on a monitor as a stereoscopic video.
[Selection] Figure 3

Description

  The present invention relates to an observation apparatus for observing a stereoscopic image, and in particular, includes at least two video signal transmission paths, and converts one video signal distributed to the other video signal transmission path into a stereoscopic video signal when one is cut off. The present invention relates to an observation system for displaying and displaying and an observation video signal transmission method.

  In general, a video display such as a television broadcast is a two-dimensional plane video having no depth information. On the other hand, stereoscopic (3D) video or stereo video having video information related to the depth of an object using binocular parallax is known. As a method for displaying this stereoscopic image, a binocular stereoscopic display that requires glasses for stereoscopic viewing, a head mounted display (HMD) that is a goggle type display device, a high-vision system using polarized glasses, and high-speed liquid crystal shutter glasses are used. The flickerless time-division stereoscopic display television system used is known. A three-dimensional display technology that does not use special glasses is also known.

Since this stereoscopic video has video information regarding depth, it is suitable for remote operation such as moving an article while viewing the video, and can be operated with a sense of distance. A stereoscopic image becomes very useful video information when, for example, a lesioned part in an image captured by an endoscope is observed or surgery is performed. As such a technique, for example, Patent Document 1 discloses a stereoscopic rigid endoscope that can stereoscopically observe an object. This stereoscopic rigid endoscope is provided with at least two image pickup means, and realizes an adjustment that does not require time and effort by reducing variations among a plurality of video signals.
Japanese Patent Laid-Open No. 7-313451

  The imaging unit, the video processing unit, and the display unit (monitor), including the endoscope device disclosed in the above-mentioned publication, are not integrally configured, and the respective devices are connected by a transmission path. . An information signal including a video signal is transmitted through this transmission path. As this transmission line, for example, one video signal cable having connectors at both ends is used so that the imaging unit can be moved for connection from the imaging unit to the video processing unit.

  The video signal cable is connected to the video processing unit across the floor from an imaging unit arranged in the vicinity of the patient to be observed. With this cable, a load is constantly applied to the vicinity of the connector every time the imaging unit or the cable itself moves. Similarly, since an observer or the like moves on the cable, a foot or a caster may hook or step on the cable, and a large load may be instantaneously applied to the cable or the vicinity of the connector. It is also assumed that the wiring in the cable is disconnected due to the load applied over time. Further, when the cable is hooked, the connector may be disconnected or damaged, or the wiring in the cable may be disconnected even if the connector is not disconnected.

  When such a disconnection accident occurs, naturally, the transmission path of the video signal is interrupted, and the video displayed on the video display unit disappears. Therefore, when such a disconnection accident occurs, observation or processing must be interrupted and the cable replaced with another object, or the entire observation apparatus must be replaced.

  Therefore, according to the present invention, the imaging unit and the video processing unit are connected by a plurality of transmission lines, the distributed video signal is transmitted, and the remaining normal cable is transmitted when the transmission line is interrupted. An object of the present invention is to provide an observation system capable of generating a stereoscopic video using a video signal and a transmission method of the observation video signal.

  In order to achieve the above object, the present invention provides an imaging unit that captures two images having parallax, and a video composite unit that distributes the two captured video signals and generates two composite video signals having a complementary relationship. And redistributing the two composite video signals transmitted through the two transmission paths and the two separated transmission paths for individually transmitting the two composite video signals compositely generated by the video composite unit. A signal restoration unit that restores the two imaged video signals, and a signal restoration unit that is provided in the signal restoration unit and detects interruption of the transmission path based on the presence or absence of the two composite video signals transmitted from the two transmission paths When a video signal cut-off detection unit and a display unit that displays the captured two video signals restored by the signal restoration unit as a stereoscopic video, when one of the two transmission paths is cut off In With respect to the composite video signal transmitted by the other transmission line, to provide a viewing system for displaying a stereoscopic image by redistribution in association with the two images captured in the imaging unit.

  In the present invention, the imaging unit captures two images having parallax with respect to the observation object, and generates two composite video signals having a complementary relationship by distributing the two video signals captured by the signal composite unit. The two composite video signals transmitted separately through the two transmission paths separated by the two composite video signals generated by the video composite section and transmitted through the two transmission paths by the signal restoration section. Are redistributed and restored to the two imaged video signals, provided in the signal restoration unit by the video signal cut-off detection unit, and the presence or absence of the two composite video signals transmitted from the two transmission paths. Two images captured by the imaging unit with respect to the composite video signal transmitted on the other transmission path when one of the two transmission paths is blocked when a transmission path is detected. In association with Dispensed, it provides a transmission method of the observation image signal of the observation system, to be displayed sequentially or a different display area in a single display area as a stereoscopic image by the display unit at the same time.

  According to the present invention, the imaging unit and the video processing unit are connected by a plurality of transmission paths, the distributed video signal is transmitted, and when the transmission path is interrupted, the remaining normal cables are transmitted. It is possible to provide an observation system capable of generating a stereoscopic video using a video signal and a transmission method of the observation video signal.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing a schematic overall configuration of a surgical observation apparatus equipped with an observation system according to the present invention. 2A and 2B are cross-sectional configuration diagrams illustrating a detailed configuration of the stereoscopic imaging unit in the observation system.

  This surgical observation apparatus 1 is arranged in the vicinity of the operating table 2 and has a stereoscopic imaging unit 3 for imaging an affected part of a patient (not shown) that is placed on the operating table 2 and a stereoscopic video (two video images) from the captured video signals. Video processing unit 4 that generates a video with parallax between them, and a stereoscopic monitor 5 that displays the generated stereoscopic video at a normal double scanning speed (double speed scanning).

  The three-dimensional imaging unit 3 includes a caster 10 that is movable on the floor and includes a caster 10, an arm unit 12 that is rotatable, bent, and extendable, and is provided at the tip of the arm unit 12. The imaging optical system described later and a mirror unit 13 incorporating an imaging element are included. In this example, the stereoscopic imaging unit 3 is shown as a configuration for imaging an observation target from the outside, but of course the invention is not limited to this, and the imaging unit mounted on an endoscope inserted into a body cavity Can also be easily applied.

  The video processing unit 4 includes a first camera control unit (CCU) 21 that performs video processing to be described later, a similar second camera control unit (CCU) 22, and a light source unit 23 that emits illumination light. These are housed in a housing 24. These first and second CCUs 21 and 22 are also used in the embodiments described later, but perform various video processes such as brightness adjustment and white balance adjustment on the input video signal. In particular, since images captured by different image sensors are alternately or synthesized, it is preferable to eliminate the difference in flicker due to a luminance difference or the color of an observation target, and to eliminate a sense of incongruity when switching between images.

  Moreover, the housing | casing 24 is equipped with the caster 25, and is arrange | positioned under the seat surface of the surgical chair 26 which can move on a floor. The stereoscopic monitor 5 includes a liquid crystal display panel (LCD), for example, and is attached to a bendable support arm 27 protruding from the surgical chair 26 so that a stereoscopic image can be observed at a desired height position. . The stereoscopic monitor 5 can display a stereoscopic image by double-speed scanning. For example, the stereoscopic monitor 5 has a display performance of at least 60 frames with respect to a display performance of 30 frames per second by a general television.

FIG. 2A is a diagram illustrating a cross-sectional configuration viewed from above the mirror body portion 13, and FIG. 2B is a diagram illustrating a cross-sectional configuration viewed from the side surface direction.
The mirror unit 13 includes two systems of imaging units configured by two independent imaging optical systems 31 and 32 and two first and second imaging elements 33 and 34 in order to capture a stereoscopic image. . In the following description, in the present embodiment, the video signal captured by the first image sensor 33 is referred to as the left-eye video signals L1, L2,..., And the video signal captured by the second image sensor 34 is the video signal for the right eye. Explanation is given as R1, R2,. These first and second image sensors 33 and 34 are constituted by solid-state image sensors, for example, a CCD image sensor or a CMOS image sensor. In addition, although this embodiment demonstrates the mirror part 13 as two imaging systems, you may provide the number of more imaging systems.

  The imaging optical systems 31 and 32 have the same configuration, and the first and second deflection prisms 35 and 36 that change the direction of the incident light beam (observation image) and the image that changes the direction (rotation) of the light beam in the cross-sectional direction. A rotator 37, first and second objective lenses 38 and 39, first and second zoom lenses 40 and 41, and first and second imaging lenses 42 and 43 are housed in a housing 44. The In the imaging optical systems 31 and 32, the first and second deflecting prisms 35 and 36 and the image rotator 37 are not essential.

  Video signal outputs from the image pickup devices 33 and 34 are sent to the first and second CCUs 21 and 22 through first and second video signal transmission cables 27 and 28, respectively, which serve as video signal transmission paths. The illumination light emitted from the light source unit 23 passes through the light guide cable 29 and is emitted from the window 44 provided in the mirror unit 13 to illuminate the imaging range of the stereoscopic imaging unit 3 uniformly. Note that the stereoscopic monitor 5 preferably has a display performance of double scanning speed (double speed scanning), but is not limited to double scanning, and the display performance is inferior, but at a normal scanning speed (30 frames / second). Even if it exists, it is possible to apply. In each embodiment described below including this embodiment, a stereoscopic monitor as a display unit may be alternately displayed on a monitor screen using one unit, or may be divided by dividing one monitor screen. You may display on a display area, and you may display an image | video simultaneously using a different monitor screen (display area) by two stereoscopic monitors.

FIG. 3 shows a configuration example of the first embodiment according to the observation system of the present invention.
This observation system includes the first and second imaging elements 33 and 34 of the mirror unit 13, the signal composite unit 51 that switches the transmission path and outputs a video signal, the first and second CCUs 21 and 22, and the signal restoration unit. 52 and the stereoscopic monitor 5.

  In such a configuration, the signal composite unit 51 includes a frame memory 53 that temporarily stores the left-eye video signal from the first image sensor 33, and a frame memory 54 that temporarily stores the right-eye video signal from the second image sensor 34. The switch circuits 55 and 56 are switched simultaneously and output video signals to different transmission paths. The video signal output from the switch circuit 55 is transmitted through the first video signal transmission cable 27, processed by the first CCU 21, and then input to the switch circuit 62 of the signal restoration unit 52. The video signal output from the switch circuit 56 is transmitted through the second video signal transmission cable 28, processed by the second CCU 22, and then input to the switch circuit 61 of the signal restoration unit 52. Note that the two video signals generated by the switching of the switch circuits 55 and 56 are complementary so that the original two videos can be restored (meaning a signal obtained by combining the left and right video signals that are substantially identical in time). have. Basically, in this switching process, it is assumed that there is no video signal excluded from the video signal picked up with parallax, but there may be a video signal excluded by setting. For example, there may be a case where a video signal or the like outside the range of the observation target is excluded at the periphery of the video.

  The signal restoration unit 52 includes switch circuits 61 and 62 that are switched at the same time, frame memories 63 and 64 that store the video signals that are distributed by switching the switch circuit 61, and video signals that are distributed by switching the switch circuit 62. Frame memories 65 and 66 for storing the signals, a signal read control unit 67 for reading the video signals stored in the respective frame memories and displaying them on the stereoscopic monitor 5, and the first and second video signal transmission cables 27 and 28. The video signal detection unit 68 is configured to detect that the transmission path of the video signal is interrupted by the disconnection.

  Next, with reference to FIG.4 and FIG.5, the production | generation of the stereo image by the observation system of this embodiment is demonstrated. 4A shows an example of an interlaced video signal (left-eye video) imaged by the first image sensor 33, and FIG. 4B shows an interlaced video imaged by the second image sensor 34. 4C shows an example of a signal (video for the right eye), FIG. 4C shows an example of an interlaced video signal sent from the signal composite unit 51 to the first CCU 21, and FIG. It is a figure which shows the example of the interlace video signal transmitted to 2CCU22. FIG. 5A shows an example of a video signal that is converted into a stereoscopic video by the signal restoration unit 52 when the first and second video signal transmission cables 27 and 28 are normal and sent to the monitor. FIG. 5B shows an example of a video signal that is converted into a stereoscopic image using only the video signal sent by the first CCU 21 when the second video signal transmission cable 28 is disconnected, and sent to the monitor. ) Is a diagram illustrating an example of a video signal that is converted into a stereoscopic image using only the video signal transmitted from the second CCU 22 and transmitted to the monitor when the first video signal transmission cable 27 is disconnected. In the interlaced video signals shown in FIGS. 4 and 5, L1, L2,... Are left-frame 1/2 frame video signals, and R1, R2,.

  As shown in FIG. 4A, since the video signal for the left eye imaged by the first image sensor 33 is an interlaced video signal, the two half-frame video signals (or one field) L1 and L2 are used. A first left-eye image is formed. Thereafter, in the same manner, the images are sequentially captured and output in time series as the second left-eye video by the 1/2 frame video signals L3 and L4. Further, as shown in FIG. 4B, the video signal for the right eye imaged by the second image sensor 34 is similarly an interlaced video signal, and the first right eye is generated by the 1/2 frame video signals R1 and R2. A video is formed. These 1/2 frame video signals are temporarily stored in the frame memory 53. Thereafter, in the same manner, images are sequentially captured as second right-eye images based on the 1/2 frame image signals R3 and R4, and are output in time series.

  The signal composite unit 51 reads out these half-frame video signals taken into the frame memories 53 and 54 to the switch circuits 55 and 56 that perform switching operation according to a command from a control unit (not shown). These switch circuits 55 and 56 perform a switching operation so as to be alternately connected to the two transmission paths by the first and second video signal transmission cables 27 and 28. The switching operation is switched every period during which the 1/2 frame video signal passes through the switch circuits 55 and 56.

The case where the transmission path by the first video signal transmission cable 27 and the second video signal transmission cable 28 is normal will be described.
As shown in FIG. 4C, the video signal transmitted from the switch circuit 55 of the signal composite unit 51 to the first CCU 21 via the first video signal transmission cable 27 is a 1/2 frame video signal L1, R2, L3. R4, L5... That is, odd-numbered 1/2 frame video signals (odd field video signals) L1, L3, L5... Captured by the first image sensor 33, and even-numbered 1/2 frames captured by the second image sensor 34. The video signals (even field video signals) R2, R4... Are alternately arranged. Similarly, as shown in FIG. 4D, the video signal transmitted from the switch circuit 56 to the second CCU 56 via the second video signal transmission cable 28 is a 1/2 frame video signal R1, L2, R3, L4. R5 ... That is, odd-numbered 1/2 frame video signals R1, R3, R5... Imaged by the second image sensor 34, and even-numbered 1/2 frame video signals L2, L4. And are arranged alternately.

  The first and second CCUs 21 and 22 eliminate the difference in flicker due to the difference in luminance and the color of the observation target, thereby eliminating a sense of incongruity when the video is switched. The 1/2 frame video signals L1, R2, L3, R4, L5... Output from the first CCU 21 are input to the switch circuit 62 of the signal restoration unit 52. The switch circuit 62 distributes the input video signal for the left eye or the right eye, and stores it in the frame memories 63 and 64, respectively. For example, the right-eye video signals R2, R4,... Are stored in the frame memory 63, and the left-eye video signals L1, L3, L5,. Similarly, ½ frame video signals R1, L2, R3, L4, R5... Output from the second CCU 22 are input to the switch circuit 62 of the signal restoration unit 52. The switch circuit 61 distributes the input video signal for the left eye or the right eye, and stores it in the frame memories 65 and 66. For example, the right-eye video signals R1, R3, R5... Are stored in the frame memory 65, and the left-eye video signals L2, L4.

  Through the video signal distribution process, all the half-frame video signals captured by the first and second image sensors 33 and 34 are distributed and stored in the frame memories 63 to 66. In the case of an interlaced video signal, the right-eye 1/2 frame video signal imaged by one image sensor is separated into an odd field and an even field. Similarly, the half-frame video signal for the left eye imaged by the other image sensor is separated into an odd field and an even field. Create odd-numbered field (for right eye) and even-numbered field (for left-eye) with different image sensors as a set, and other odd-numbered field (for left-eye) and even-numbered field (for right-eye) as a set to create video signals for transmission. To do. After these sets of video signals are transmitted by cable in synchronization with the frame as a reference, each video signal is divided into odd fields and even fields and stored separately in the frame memory.

  The signal readout control unit 67 reads out the ½ frame video signal from each of the frame memories 63 to 66 stored as described above in a combination as shown in FIG. 5A and displays it on the stereoscopic monitor 5. In this example, 1/2 frame video signals are displayed on the monitor screen in the order of L1, R1, L2, R2, L3, R3, L4, R4, L5, R5. The video signals shown in FIGS. 5A to 5C are shown in half the width of the video signal shown in FIG. 4, but the video signals having the same data amount are displayed in half the time. It suggests. That is, 30 frames / second is displayed in FIG. 4, and 60 frames / second is displayed in FIG.

  However, when a disconnection accident occurs in the second video signal transmission cable 28, only the ½ frame video signals L1, R2, L3, R4, L5... Output from the first CCU 21 through the first video signal transmission cable 27. Is input to the signal restoration unit 52. Therefore, by the switching operation of the switch circuit 62, for example, the right eye video signals R2, R4... Are stored in the frame memory 63, and the left eye video signals L1, L3, L5. At this time, the video signal detection unit 68 detects that no video signal is input to the switch circuit 61, and outputs a detection signal to that effect to the signal read control unit 67. At this time, the switch circuit 61 is not driven and is in a stopped state.

  The signal readout control unit 67 generates a stereoscopic video using the 1/2 frame video signals L1, R2, L3, R4, L5... Stored in the frame memories 63, 64 according to a predetermined control program.

  Specifically, as shown in FIG. 5B, the 1/2 frame video signal is displayed on the stereoscopic monitor 5 in the order of L1, R2, L1, R2, L3, R4, L3, R4, L5, R6. . That is, the set of 1/2 frame video signals L1 and R2 is repeatedly displayed twice. Thereafter, similarly, the subsequent steps are sequentially repeated twice from the set of the 1/2 frame video signals L3 and R4. That is, one half frame video signal is substantially repeatedly displayed with a half frame period (one field period). Thus, for example, if different images of 60 frames per second (changes in time series) are displayed in the normal state, the same 60 frames are displayed even when the disconnection occurs, but the same image is repeated twice. Therefore, the display is substantially 30 frames.

  On the other hand, when a disconnection accident occurs in the first video signal transmission cable 27, only the 1/2 frame video signals R1, L2, R3, L4, R5... Output from the second CCU 22 through the second video signal transmission cable 28. Is input to the signal restoration unit 52. Therefore, by the switching operation of the switch circuit 61, for example, the right eye video signals R1, R3, R5... Are stored in the frame memory 63, and the left eye video signals L2, L4, L6. The video signal detection unit 68 detects that no video signal is input to the switch circuit 62 and outputs a detection signal to that effect to the signal read control unit 67. At this time, the switch circuit 62 is not driven and is in a stopped state.

  As described above, the signal readout control unit 67 uses the 1/2 frame video signals R1, L2, R3, L4, R5... Stored in the frame memories 65, 66 in accordance with a predetermined control program. Generate video. Specifically, as shown in FIG. 5C, the 1/2 frame video signal is displayed on the stereoscopic monitor 5 in the order of L2, R1, L2, R1, L4, R3, L4, R3, L6, R5. . A set of 1/2 frame video signals L2 and R1 is repeatedly displayed twice. Thereafter, similarly, the subsequent steps are sequentially repeated twice from the set of the 1/2 frame video signals L4 and R3. That is, one half frame video signal is substantially repeatedly displayed with a half frame period (one field period). Also in this display, for example, if different images of 60 frames per second (changes in time series) are displayed in the normal state, the same 60 frames are displayed at the time of disconnection. Since it is repeatedly displayed, the display is substantially 30 frames.

  As described above, according to the first embodiment, since the 60-frame video is substantially 30-frame video, the temporal resolution is reduced but the spatial resolution is not reduced compared to the normal time. A high-quality stereoscopic image can be obtained without degrading the image information related to the depth. Therefore, it is suitable for processing in which the movement of the observation target is slow and it is desired to maintain information about the depth. This is the high image quality mode. For example, although there is little movement of a treatment tool and peristaltic movement of a lesioned part, it is suitable for an operation that requires a sense of distance.

Next, FIG. 6 shows and describes a configuration example of the second embodiment according to the observation system of the present invention. In addition, the same referential mark is attached | subjected to the component equivalent to 1st Embodiment shown in FIG. 3 mentioned above in the component of this embodiment, and the detailed description is abbreviate | omitted.
This observation system is a system that performs progressive imaging, the first and second imaging elements 71 and 72 provided in the above-described mirror unit 13, the signal composite unit 73 that outputs a video signal by switching the transmission path, The signal restoration unit 52, first and second CCUs 21 and 22, a stereoscopic video converter 76, and a parallax barrier type stereoscopic monitor 77 are configured. As the parallax barrier method, a parallax barrier method, a lenticular method, an analysis lattice array method, and the like are known. This embodiment can be applied to any method.

  The first and second image pickup devices 71 and 72 are image pickup devices that perform image pickup by a progressive scan method. The signal composite unit 73 includes a frame memory (video memory) 74 for temporarily storing the left-eye progressive video signals L1, L2, L3, L4, L5... By the first image sensor 71 and the right-eye progressive video by the second image sensor 72. A frame memory (video memory) 75 that temporarily stores the signals R1, R2, R3, R4, R5... And a switch circuit that performs a switching operation at the same time as described above and outputs video signals to two different transmission paths. 55, 56. The progressive video signal output from the switch circuit 55 is transmitted through the first video signal transmission cable 27 serving as one transmission path, and is input to the switch circuit 62 of the signal restoration unit 52. Further, the progressive video signal output from the switch circuit 56 is transmitted through the second video signal transmission cable 28 serving as the other transmission path, and is input to the switch circuit 62 of the signal restoration unit 52.

  The signal restoration unit 52 includes switch circuits 61 and 62 that are switched at the same time, frame memories 63 and 64 that store progressive video signals distributed by switching the switch circuit 61, and progressive video that is distributed by switching the switch circuit 62. Frame memories 65 and 66 for storing signals, a progressive video signal stored in each frame memory, a read control unit 67 and a video signal detection unit 68 at a timing to be described later.

  The progressive video signal read by the read control unit 67 is input to the first CCU 21 and the second CCU 22 that perform the video processing described above. The progressive video signal that has been subjected to the video processing by the first CCU 21 and the second CCU 22 is input to the stereoscopic video converter 76, is synthesized and converted, and then displayed on the stereoscopic monitor 77 as a stereoscopic video.

  Next, with reference to FIG.7 and FIG.8, the production | generation of the stereo image by the observation system of this embodiment is demonstrated. Here, FIG. 7A shows an example of a progressive video signal (left-eye video) captured by the first image sensor 71 and output in time series, and FIG. 7B shows the second image sensor. 7 shows an example of a progressive video signal (right-eye video) that is picked up by 72 and output in time series. FIG. 7C is sent from the signal composite unit 73 to the signal restoration unit 52 (switch circuit 62). An example of a progressive video signal is shown, and FIG. 7D is a diagram showing an example of a progressive video signal sent from the signal composite unit 51 to the signal composite unit 52 (switch circuit 61). FIG. 8A shows an example of a left-eye video signal that is converted into a stereoscopic video and sent to the monitor when the first video signal transmission cable 27 is disconnected, and FIG. 8B shows the first video signal. FIG. 8C shows an example of a right-eye video signal which is converted into a stereoscopic image and sent to the monitor when the video signal transmission cable 27 is disconnected. FIG. 8C is a diagram when the second video signal transmission cable 28 is disconnected. FIG. 8D shows an example of a left-eye video signal that is converted into a stereoscopic image and sent to the monitor. FIG. 8D shows the right eye that is converted into a stereoscopic image when the second video signal transmission cable 28 is disconnected and sent to the monitor. It is a figure which shows the example of a video signal for operation. In the progressive video signals shown in FIGS. 7 and 8, L1, L2,... Are left-frame 2-frame video signals, and R1, R2,. Further, for example, in the progressive video signal L1, the odd field in each frame is denoted by L1o, and the even field is denoted by L1e.

  The progressive video signal (left-eye video) shown in FIG. 7A is picked up by the first image sensor 71, temporarily stored in the frame memory 74 of the signal composite unit 74, and similarly, the progressive video signal shown in FIG. The video signal (right-eye video) is captured by the second image sensor 72 and temporarily stored in the frame memory 75.

  The progressive video signals captured in these frame memories 74 and 75 are read out to either one of the switch circuits 55 and 56 that are switched in response to a command from a control unit (not shown). These switch circuits 55 and 56 perform a switching operation so as to be alternately connected to the two transmission paths by the first and second video signal transmission cables 27 and 28. The switching operation is simultaneously switched every period when one field (odd field or even field) in the progressive video signal passes through the switch circuits 55 and 56, and each field is output in a synchronized state. By such switching operation, the switch circuit 55 outputs progressive video signals (L1o + R1e), (L1o + R1e), (L2o + R2e), (L3o + R3e), (L4o + R4e), (L5o + R5e). That is, as shown in FIG. 7C, each frame in which the odd field in the progressive video signal imaged by the first image sensor 71 from the switch circuit 55 and the even field imaged by the second image sensor 72 are combined. A progressive video signal is sent to the first video signal transmission cable 27. Further, the switch circuit 56 outputs the switch circuit 55 progressive video signals (R1o + L1e), (R1o + L1e), (R2o + L2e), (R3o + L3e), (R4o + L4e), (R5o + L5e),... To the second video signal transmission cable 28. As shown in FIG. 7D, the progressive video of each frame in which the odd field in the progressive video signal captured by the second image sensor 72 from the switch circuit 56 and the even field captured by the first image sensor 71 are combined. A signal is sent out.

  The case where the transmission path by the first video signal transmission cable 27 and the second video signal transmission cable 28 is normal will be described.

  The progressive video signal (L1o + R1e)... Output from the switch circuit 55 of the signal composite unit 51 via the first video signal transmission cable 27 is input to the switch circuit 62 of the signal restoration unit 52. The switch circuit 62 switches the input progressive video signal to the left memory L1o, L2o, L3o, L4o, and L5o in the frame memory 65, for example, by switching one field period in the same manner as the switch circuit 55 (56) described above. The R1e, R2e, R3e, R4e, and R5e for the right eye are distributed and stored in the frame memory 66, respectively.

  Similarly, progressive video signals (R1o + L1e)... Output from the switch circuit 56 via the second video signal transmission cable 28 are input to the switch circuit 61 of the signal restoration unit 52. The switch circuit 61 is switched simultaneously with the switch circuit 62 and stores the input progressive video signal R1o, R2o, R3o, R4o, R5o for the right eye in, for example, the frame memory 63, and L1e, L2e for the left eye. , L3e, L4e, and L5e are distributed and stored in the frame memory 64, respectively.

  Next, the progressive video signals L1o, L2o, L3o, L4o, and L5o read from the frame memory 66 under the control of the read control unit 67 are input to the first CCU 21 and subjected to the video processing described above. Similarly, the progressive video signals L1e, L2e, L3e, L4e, and L5e read from the frame memory 64 are input to the second CCU 22 and subjected to the video processing described above. These progressive video signals that have undergone video processing are combined by a stereoscopic video converter 76 and output to the stereoscopic monitor 77 as progressive video signals L1, L2, L3, L4, and L5 shown in FIG.

  Similarly, the progressive video signals R1o, R2o, R3o, R4o, R5o and R1e, R2e, R3e, R4e, R5e read from the frame memory 65 and the frame memory 63 are subjected to video processing by the first CCU 21 and the second CCU 22. The Further, it is synthesized by the stereoscopic video converter 76 and outputted to the stereoscopic monitor 77 as progressive video signals R1, R2, R3, R4, R5 shown in FIG. On the stereoscopic monitor 77 that performs the parallax barrier display, the progressive video signals L1 and R1 are displayed at the same time, and a stereoscopic image due to the parallax of the left and right eyes can be viewed without requiring dedicated glasses.

  However, when a disconnection accident occurs in the second video signal transmission cable 28, the progressive video signal (L1o + R1e)... Transmitted through the first video signal transmission cable 27 is input to the switch circuit 62 of the signal restoration unit 52. . The switch circuit 62 stores, for example, the left-eye L1o, L2o, L3o, L4o, and L5o in the progressive video signal in, for example, the frame memory 65 and the right-eye R1e and R2e by switching the one-field period described above. , R3e, R4e, R5e are distributed and stored in the frame memory 66, respectively. On the other hand, the progressive video signal transmitted from the switch circuit 56 to the switch circuit 61 via the second video signal transmission cable 28 is cut off. At this time, the video signal detection unit 68 detects that there is no transmission of the progressive video signal from the second video signal transmission cable 28 and outputs the detection signal to the read control unit 67. At this time, the switch circuit 61 is not driven and is in a stopped state.

  The read control unit 67 reads the left-eye progressive video signals L1o, L2o, L3o, L4o, and L5o shown in FIG. 8A from the frame memory 65 and inputs them to the first CCU 21. The first CCU 21 performs the above-described video processing on the progressive video signals L1o to L5o and outputs the processed video signals to the stereoscopic image converter 76. At the same time, the readout control unit 67 reads out the progressive video signals R1e, R2e, R3e, R4e, and R5e for the right eye shown in FIG. 8B from the frame memory 66 and inputs them to the second CCU 22. The second CCU 22 performs the above-described video processing on the progressive video signals R1e to R5e and outputs the processed video signals to the stereoscopic image converter 76. The stereoscopic video converter 76 combines the progressive video signals L1o to L5o and R1e to R5e to display the progressive video signals L1o and R1e at the same time and visually recognize them as a stereoscopic image. it can.

  Further, when a disconnection accident occurs in the first video signal transmission cable 27, the progressive video signal (R1o + L1e)... Transmitted through the second video signal transmission cable 28 is input to the switch circuit 61 of the signal restoration unit 52. . The switching circuit 61 stores, for example, R1o, R2o, R3o, R4o, and R5o for the right eye in the progressive video signal in the frame memory 63, for example, and L1e and L2e for the left eye by switching the one-field period described above. , L3e, L4e, and L5e are distributed and stored in the frame memory 64, respectively. On the other hand, the progressive video signal transmitted from the switch circuit 55 to the switch circuit 62 via the first video signal transmission cable 27 is cut off. At this time, the video signal detection unit 68 detects that no progressive video signal is transmitted from the first video signal transmission cable 27, and outputs the detection signal to the read control unit 67. At this time, the switch circuit 62 is not driven and is in a stopped state.

  The readout control unit 67 reads out the progressive video signals L1e, L2e, L3e, L4e, and L5e for the left eye shown in FIG. 8D from the frame memory 63 and inputs them to the first CCU 21. In the first CCU 21, the above-described video processing is performed on the progressive video signals L <b> 1 e to L <b> 5 e and output to the stereoscopic image converter 76. At the same time, the read control unit 67 reads out the progressive video signals R1o, R2o, R3o, R4o, R5o for the right eye shown in FIG. 8C from the frame memory 64 and inputs them to the second CCU 22. The second CCU 22 performs the above-described video processing on the progressive video signals R1o to R5o and outputs the processed video signals to the stereoscopic image converter 76. The stereoscopic video converter 76 synthesizes the progressive video signals L1e to L5e and R1o to R5o to display the progressive video signals L1e and R1o at the same time and visually recognize them as a stereoscopic image. it can.

  As described above, according to the second embodiment, when one transmission path is interrupted, the number of video frames does not decrease, for example, 60 frames are maintained, but one frame of progressive video is maintained. Becomes a half-frame image similar to the interlaced image, so that the image quality is lowered. That is, the spatial resolution is reduced but the temporal resolution is not lowered as compared with the normal time, that is, the image quality is lowered but the high speed can be maintained. This is the high speed mode. Therefore, the movement of the observation target is fast. For example, the movement of the treatment tool and the peristaltic movement of the lesioned part are fast, but this is suitable for an operation that does not require a sense of distance in the depth direction.

Next, FIG. 9 shows a configuration example of the third embodiment according to the observation system of the present invention and will be described. In addition, the same referential mark is attached | subjected to the component equivalent to 2nd Embodiment shown in FIG. 6 mentioned above in the component of this embodiment, and the detailed description is abbreviate | omitted.
This observation system is a system that performs progressive imaging, and switches the transmission path between the first and second imaging elements 71 and 72, the first and second CCUs 21 and 22 provided in the above-described mirror unit 13, and outputs video signals. A signal composite unit 73 to be output, a signal restoration unit 52, a display mode switching unit 81 for switching between the high-quality mode and the high-speed mode described above, a stereoscopic video converter 76, and a stereoscopic monitor 77 of a parallax barrier method. Is done.

  In such a configuration, the video signals picked up by the progressive scan method picked up by the first and second image pickup devices 71 and 72 are subjected to the above-described image processing by the first and second CCUs 21 and 22, and flickering due to a luminance difference or the like. It eliminates the difference in the color of the observation target and eliminates the uncomfortable feeling when combining frames and switching images. FIG. 10A shows progressive video signals L1, L2, L3, L4, L5... Captured by the first image sensor 71. 10B shows progressive video signals R1, R2, R3, R4, R5... Captured by the second image sensor 72.

  In the signal composite section 73, the progressive video signals (L0e + L1o), (R1e + R2o), (L2e + L3o), (R3e + R4o), (L4e + L5o),... Shown in FIG. The signal is output to the signal transmission cable 27. From the switch circuit 56 that performs the same switching operation as the switch circuit 55, progressive video signals (R0e + R1o), (L1e + L2o), (R2e + R3o), (L3e + L4o), (R4e + R5o),... As shown in FIG. 2 video signal transmission cable 28.

  The case where the transmission path by the first video signal transmission cable 27 and the second video signal transmission cable 28 is normal will be described. The progressive video signals transmitted through the first and second video signal transmission cables 27 and 28 are input to the switch circuits 61 and 62 of the signal restoration unit 52.

  The switch circuit 61 distributes the input progressive video signal to the odd field and the even field by switching the one field period as described above, and stores the respective fields in the frame memories 65 and 66. For example, the frame memory 65 stores LOe, R1e, L2e, R3e, L4e. On the other hand, the frame memory 66 stores L1o, R2o, L3o, R4o, L5o.

  Similarly, R0e, L1e, R2e, L3e, R4e... Relating to even fields are stored in the frame memory 63. On the other hand, the frame memory 64 stores R1o, L2o, R3o, L4o, R5o. Thereafter, a progressive video signal is read from each of the frame memories 63 to 66 under the control of the read control unit 67, and the progressive video signal L1 as shown in FIGS. ˜L5... And R1 to R5... Are generated and displayed on the stereoscopic monitor 77.

  However, when a disconnection accident occurs in the second video signal transmission cable 28, the progressive video signals L0e to L4e..., L1o to L5o. 62. By switching by the switch circuit 62, as described above, the frame memory 65 stores LOe, R1e, L2e, R3e, L4e. On the other hand, the frame memory 66 stores L1o, R2o, L3o, R4o, L5o. At this time, the video signal detection unit 68 detects that the progressive video signal is not transmitted due to the disconnection of the second video signal transmission cable 28, and outputs the detection signal to the read control unit 67. At this time, the switch circuit 61 is not driven and is in a stopped state.

Here, the display mode switching unit 81 selects the high image quality mode.
The read control unit 67 reads out the progressive video signals from the frame memory 65 and the frame memory 66, and the left-eye progressive video signals (LOe + L1o), (LOe + L1o), (L2e + L3o), (L2e + L3o), (L2e + L3o) shown in FIG. ), (L4e + L5o)... Are generated and output to the stereoscopic video converter 76. At the same timing, the right-eye progressive video signals (R1e + R0o), (R1e + R2o), (R1e + R2o), (R3e + R4o), (R3e + R4o),... Shown in FIG. To do.

   The stereoscopic video converter 76 combines the progressive video signals for the left eye and the right eye, and displays, for example, video based on the progressive video signals (LOe + L1o), (R1e + R0o).

  Further, when a disconnection accident occurs in the first video signal transmission cable 27, the progressive video signals R0e to R4e... And R1o to R5o transmitted through the second video signal transmission cable 28 are the switch circuit of the signal restoration unit 52. 61 is input. At this time, the switch circuit 62 is not driven and is in a stopped state. Similarly, the read control unit 67 reads out the progressive video signals from the frame memory 65 and the frame memory 66, and progressive video signals for the right eye (R0e + R1o), (R2e + R3o), (R4e + R5o), and the progressive for the left eye. Video signals (L1e L0o), (L1e L2o), and (L3e + L4o) are output to the stereoscopic video converter 76, respectively. The stereoscopic video converter 76 combines the progressive video signals for the left eye and the right eye and displays them on the stereoscopic monitor 77.

However, an example in which the display mode switching unit 81 selects the high-speed mode when a disconnection accident occurs in the second video signal transmission cable 28 will be described.
The readout control unit 67 reads out the progressive video signals LOe, L1o, L2e, L3o, L4e... Shown in FIG. 11C from the frame memory 65 and the frame memory 66, and outputs them to the stereoscopic video converter 76. At the same timing, the right-eye progressive video signals R0o, R1e, R2o, R3e, R4o... Shown in FIG. 11D are generated from the frame memory 65 and the frame memory 66 and output to the stereoscopic video converter 76. .

   The stereoscopic video converter 76 combines the progressive video signals for the left eye and the right eye, and displays, for example, video based on the progressive video signals LOe and R0o on the stereoscopic monitor 77.

  As described above, according to the present embodiment, in addition to the effects of the first and second embodiments described above, by providing a display mode switching unit that switches between the high image quality mode and the high speed mode, processing such as surgery is performed. Depending on the type, it can be switched as appropriate for observation.

  In each of the embodiments described above, two video signals for transmission are created by distributing video signals in units of odd or even fields, using interlaced video signals and progressive video signal examples. An example was described. Distribution is not limited to one field, and it is also possible to distribute by pixel groups based on video signals in pixel units of the image sensor. For example, for the pixel area where the main observation object on the screen specified by the observer exists, the pixel area is divided into blocks with a small number of pixels (or high resolution), and the area of the peripheral part that is not very important May be divided into blocks in units of many (or low resolution) and distributed.

1 is a diagram illustrating a schematic overall configuration of a surgical observation apparatus equipped with an observation system according to the present invention. 2A and 2B are cross-sectional configuration diagrams illustrating a detailed configuration of the stereoscopic imaging unit in the observation system. It is a figure which shows the structural example of 1st Embodiment which concerns on the observation system of this invention. 4A to 4D are diagrams illustrating examples of interlaced video signals. FIGS. 5A to 5C are diagrams showing examples of video signals. It is a figure which shows the structural example of 2nd Embodiment which concerns on the observation system of this invention. FIGS. 7A to 7D are diagrams illustrating examples of progressive video signals. FIGS. 8A to 8D are diagrams showing examples of video signals sent to the monitor. It is a figure which shows the structural example of 3rd Embodiment which concerns on the observation system of this invention. FIGS. 10A to 10D are diagrams showing examples of progressive video signals. 11A and 11B are diagrams showing examples of progressive video signals for explaining the high-quality mode, and FIGS. 11C and 11D are progressive video signals for explaining the high-speed mode. It is a figure which shows the example of.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Surgical observation apparatus, 2 ... Operating table, 3 ... Stereo imaging part, 4 ... Image processing part, 5 ... Stereo monitor, 10, 25 ... Caster, 11 ... Mount part, 12 ... Arm part, 13 ... Mirror part , 21 ... 1st camera control unit (CCU), 22 ... 2 camera control units (CCU), 23 ... Light source unit, 24, 44 ... Housing, 25 ..., 26 ... Surgical chair, 27 ... First image Signal transmission cable, 28 ... second video signal transmission cable, 29 ... light guide cable, 31, 32 ... imaging optical system, 33, 34 ... first and second imaging elements, 35, 36 ... first and second deflection prisms , 37 ... Image rotator, 38, 39 ... First and second objective lenses, 40, 41 ... First and second zoom lenses, 42, 43 ... First and second imaging lenses, 44 ... Windows, 51 ... Signal Composite unit, 52... Signal restoration unit, 53 54,63,64,65,66 ... frame memory, 55,56,61,62 ... switching circuit, 67 ... signal reading control unit, 68 ... video signal detection unit.

Claims (14)

An imaging unit for imaging two images having parallax;
A signal composite unit that distributes two captured video signals and generates two composite video signals having a complementary relationship;
Two separate transmission paths for individually transmitting the two composite video signals compositely generated by the video composite unit;
A signal restoration unit that redistributes the two composite video signals transmitted through the two transmission paths and restores the two imaged video signals;
A video signal cutoff detector that is provided in the signal restoration unit and detects the cutoff of the transmission path based on the presence or absence of the two composite video signals transmitted from the two transmission paths;
A display unit that displays the captured two video signals restored by the signal restoration unit as a stereoscopic video,
When one of the two transmission paths is interrupted, the composite video signal transmitted through the other transmission path is redistributed in association with the two images captured by the imaging unit. An observation system characterized by displaying as a stereoscopic image. The two video signals imaged by the imaging unit are composed of a left-eye frame video signal and a right-eye frame video signal, which are interlaced and composed of odd and even field video signals,
The signal composite unit, as the two composite video signals,
A first composite video signal composed of an odd field video signal in the left-eye frame video signal and an even field video signal in the right-eye frame video signal;
A second composite video signal composed of an odd field video signal in the right-eye frame video signal and an even field video signal in the left-eye frame video signal;
The observation system according to claim 1, wherein the observation system is generated. The signal restoration unit further includes a read control unit,
The read control unit
By switching the first composite video signal transmitted to one of the two transmission paths, the first half frame by the odd field video signal in the left-eye frame video signal and the right-eye video signal are switched. Distributing the frame video signal to the third half frame by the even field video signal;
By switching the second composite video signal transmitted to the other of the two transmission paths, the second half frame by the odd field video signal in the right-eye frame video signal and the left-eye video signal are switched. Distributing the frame video signal to the fourth ½ frame by the even field video signal;
The display unit sequentially alternates the images of the left-eye frame video signal and the right-eye frame video signal every 1/2 frame in the order of the first to fourth 1/2 frames, or the display unit The observation system according to claim 2, wherein the observation system displays images simultaneously in different display areas. When one of the two transmission paths is cut off and the first composite video signal is not input, the readout control unit
By switching the second composite video signal transmitted to the other of the two transmission paths, the second half frame by the odd field video signal in the right-eye frame video signal and the left-eye video signal are switched. Distributing the frame video signal to the fourth ½ frame by the even field video signal;
4. The display unit according to claim 3, wherein the display unit performs display by updating the second and fourth ½ frames alternately or simultaneously in different display areas of the display unit in units of one frame. Observation system. When the other of the two transmission paths is blocked and the second composite video signal is not input, the readout control unit
By switching the first composite video signal transmitted to one of the two transmission paths, the first half frame by the odd field video signal in the left-eye frame video signal and the right-eye video signal are switched. Distributing the frame video signal to the third half frame by the even field video signal;
4. The display unit according to claim 3, wherein the display unit displays the first and third ½ frames alternately or simultaneously in different display areas of the display unit in units of one frame. Observation system. The two video signals picked up by the image pickup unit are each composed of a left-eye progressive video signal and a right-eye progressive video signal each forming one frame,
The signal composite unit is:
A first composite video signal composed of an odd field video signal in the left-eye progressive video signal and an even field video signal in the right-eye progressive video signal;
A second composite video signal composed of an odd field video signal in the right-eye progressive video signal and an even field video signal in the left-eye progressive video signal;
The observation system according to claim 1, wherein the observation system is generated. The signal restoration unit further includes a read control unit,
The read control unit includes the second composite video signal transmitted to the other of the two transmission lines when one of the two transmission lines is blocked and the first composite video signal is not input. By switching to
Distributing the odd-numbered field video signal in the right-eye frame video signal and the even-numbered field video signal in the left-eye frame video signal;
The observation system according to claim 6, wherein the display unit displays the odd and even field video signals alternately or simultaneously in different display areas of the display unit. The read control unit includes the first composite video signal transmitted to one of the two transmission paths when the other of the two transmission paths is blocked and the second composite video signal is not input. By switching to
Distributing the odd-numbered field video signal in the left-eye frame video signal and the even-numbered field video signal in the right-eye frame video signal;
The observation system according to claim 6, wherein the display unit alternately displays the odd and even field video signals. An imaging unit that captures two progressive images for left eye and right eye having parallax;
A signal composite unit that distributes two captured progressive video signals and generates two composite video signals having a complementary relationship;
Two separate transmission paths for individually transmitting the two composite video signals compositely generated by the video composite unit;
A signal restoration unit that redistributes the two composite video signals transmitted through the two transmission paths and restores the two imaged video signals;
A video signal cutoff detection unit provided in the signal restoration unit, which detects the cutoff of the transmission path according to the presence or absence of the two composite video signals transmitted from the two transmission paths;
A read control unit that is provided in the signal restoration unit and reads the restored two imaged video signals;
A display unit for displaying the two imaged video signals restored by the signal restoration unit as a stereoscopic video;
A display mode switching unit that switches and selects a display mode related to image quality and display speed for the restored two imaged video signals;
Consists of
When one of the two transmission paths is interrupted, the composite video signal transmitted through the other transmission path is redistributed in association with the two images captured by the imaging unit. An observation system for displaying as a stereoscopic image in a display mode selected by the display mode switching unit. The signal composite unit is:
A first composite video signal composed of an odd-numbered left-eye progressive video signal and an even-numbered right-eye progressive video signal transmitted to one of the two transmission paths;
Generating an odd-numbered right-eye progressive video signal and an even-numbered left-eye progressive video signal to be transmitted to the other transmission path of the two transmission paths;
The first composite video is formed by a frame composed of an even field video signal of a preceding frame and an odd field video signal of a succeeding frame in frames preceding and following each of the left-eye and right-eye progressive video signals.
The second composite video is formed by a frame including an even field video signal of a preceding frame and an odd field video signal of a succeeding frame in a frame in which the right-eye and left-eye progressive video signals are consecutive in the front and back. The observation system according to claim 9.   The read control unit is configured such that when one of the two transmission lines is blocked, the first composite video signal is not input, and the display mode switching unit sets the image quality mode, the two transmission lines By switching the second composite video signal transmitted to the other side, the even-numbered field video signal of the preceding frame and the odd-numbered field video signal of the succeeding frame in the successive frames before and after the left-eye progressive video signal are changed. The observation system according to claim 10, wherein the synthesized frame is displayed twice in succession. The read control unit is configured such that when one of the two transmission lines is blocked, the first composite video signal is not input, and the display mode switching unit sets the display speed mode, the two transmission lines are set. By switching the second composite video signal transmitted to the other of
In one frame of the display unit sequentially or in half frame units composed of an even field video signal of a preceding frame and an odd field video signal of a succeeding frame in consecutive frames before and after the left-eye progressive video signal The observation system according to claim 10, wherein the observation systems are simultaneously displayed in different display areas of the display unit. A first imaging device for capturing a subject image and outputting a first video signal;
A second imaging element that captures the subject image and outputs a second video signal;
First signal transmission means for transmitting a video signal;
Second signal transmission means for transmitting a video signal;
A first signal distributor that receives the first video signal and selectively outputs the first video signal to the first signal transmission unit and the second signal transmission unit;
A second signal distributor that receives the second video signal and selectively outputs the second video signal to the first signal transmission unit and the second signal transmission unit;
The subject image based on the first video signal output from the first signal transmission means and the first video signal output from the second signal transmission means, and the first signal transmission The subject image based on the second video signal output from the second signal signal and the second video signal output from the second signal transmission unit alternately or simultaneously in different display areas of the display unit, A display unit to display;
An observation system comprising: The imaging unit captures two images having parallax with respect to the observation object,
Distributing two video signals captured by the signal composite unit to generate two composite video signals having a complementary relationship;
The two composite video signals compositely generated by the video composite unit are individually transmitted through two separated transmission paths,
Redistributing the two composite video signals transmitted through the two transmission paths by the signal restoration unit to restore the two imaged video signals;
One of the two transmission paths is detected by the presence or absence of the two composite video signals provided in the signal restoration section by the video signal cutoff detection section and transmitted from the two transmission paths. When the video signal is interrupted, the composite video signal transmitted through the other transmission path is redistributed in association with the two video images captured by the imaging unit,
A method of transmitting an observation video signal of an observation system, wherein a stereoscopic image is displayed on a display unit sequentially or simultaneously in different display areas by a display unit.

Images