JP3281182B2 - Ultrasonic and endoscope combined system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an ultrasonic / endoscopic combined system in which a radial scanning type ultrasonic diagnostic apparatus and an endoscope apparatus are combined, and in particular, an ultrasonic image and an endoscope image are monitored on the same monitor. And image processing related to the image display.

[0002]

2. Description of the Related Art An ultrasonic diagnostic method that radiates an ultrasonic pulse into a living body and obtains biological information by using a reflected wave from each tissue includes:
There is an advantage that there is no irradiation disorder as in the case of diagnosis using X-rays, and that soft tissue can be diagnosed without a contrast agent.

[0003] In addition to these advantages, in recent years, with the use of higher frequencies in electronic circuits and advances in micromachining technology for ultrasonic vibrators, an ultrasonic probe that inserts a small-diameter ultrasonic probe containing a microvibrator into the body has been developed. Diagnostic technology is spreading. In particular, in the diagnosis of the heart and the digestive tract, an endoscopic approach performed by inserting an ultrasonic probe into a tube such as the esophagus and the stomach is becoming widespread in clinical settings. More recently, attempts have been made to insert an ultrasonic probe into a thin gastrointestinal tract, such as a bile duct, or even into a blood vessel, and to observe a tomographic image of an abnormal portion of a tube wall or the like.

As an ultrasonic diagnostic apparatus for diagnosing such a thin tube wall, there is, for example, a small-diameter probe system shown in FIG. The ultrasonic diagnostic apparatus shown in FIGS. 16A and 16B constitutes a part of a small-diameter ultrasonic probe (hereinafter, simply referred to as “small-diameter probe”) 100, for example, having a diameter of about 2 (mm). One ultrasonic vibrator (hereinafter, simply referred to as “vibrator”) 102 is provided in the distal end portion of the probe sheath 101.
It has.

[0005] The vibrator 102 is connected to one end of a torque cable 103 that can be bent freely as a rotating shaft. The other end of the torque cable 103 is connected to the output (rotation) axis of the motor 106 via the rotor R of the rotary transformer 105 in the probe header 104, so that the torque of the motor 106 is transmitted from the rotor R to the torque cable 103. Is transmitted to the vibrator 102 via the.

An electrode (not shown) of the vibrator 102
Is connected to one end of a signal line 107. This signal line 107 is inserted into the torque cable 103,
Transducer drive circuit 108 and amplifier 10 via stator S of rotary transformer 105 in probe header 101
9 are connected in parallel.

A description will now be given of the time of ultrasonic transmission. First, a drive pulse from the transducer drive circuit 108 is transmitted from the stator S of the rotary transformer 105 to the rotor R in a non-contact manner. The rotor R rotates integrally with the torque cable 103 as the motor 106 rotates, and the vibrator 102 also rotates.

In this rotating state, the vibrator 102 converts the driving pulse into an ultrasonic pulse and transmits / receives the ultrasonic pulse in a direction substantially perpendicular to the wall surface of the probe sheath 101. An ultrasonic pulse is scanned. As a result, an ultrasonic tomographic image of the same scanning plane substantially orthogonal to the insertion direction of the small diameter probe 100 is obtained.

At the time of ultrasonic wave reception and display, first, a weak electric signal received by the transducer 102 is transmitted from the same signal line 107 as at the time of transmission to the amplifier 109 via the rotary transformer 105 in the probe header 101. Supplied to The output side of the amplifier 109 is connected to the ultrasonic device main body 11.
A logarithmic amplifier 111 for amplitude compression constituting a receiving circuit within 0;
It is connected to a detection circuit 112 for envelope detection and an A / D converter 113, and the image data converted into a digital signal via these receiving circuits is temporarily stored in an image memory 114.

[0010] The storage address of the image data in the image memory 114 is designated by the rotation angle information from a rotation angle detector (encoder) 115 arranged adjacent to the motor 106 via a counter 116. . The image data in the image memory 114 is stored in the TV signal converter 117.
The format is converted from the ultrasonic scanning system to the standard TV scanning system via the TV monitor and displayed on the television monitor 118.

Here, as a method of rotating the vibrator, there are a method of directly rotating the vibrator, a method of rotating a minute acoustic mirror, and a method of integrally rotating the acoustic mirror and the vibrator. Proposed.

In any case, such a mechanical rotation method has a relatively simple structure and can easily realize a high frequency ultrasonic wave (20 MHz to 40 MHz).
This is the most widespread method.

Since such a small-diameter probe 100 can be inserted also into a forceps hole of an endoscope, it is necessary to examine the invasion degree information of a lesion such as a tumor specified by an endoscope. In addition, it is used in combination with an endoscope. For example, in stomach wall diagnosis, when it is desired to diagnose not only the stomach wall surface state observed as an endoscope optical image but also the state under the stomach wall surface (such as the degree of gastric infiltration), while checking the endoscope optical image on a monitor, It is possible to accurately guide the tip of the small diameter probe to a predetermined location. Moreover, since insertion or removal of the small diameter probe 100 into or from the body cavity is performed through the forceps hole, there is an advantage that pain given to the examinee is greatly reduced.

An endoscope apparatus used in combination with the small-diameter probe 100 as described above is, for example, shown in FIG. In the endoscope apparatus shown in FIG. 17, illumination light emitted from a light source 121 in an endoscope apparatus main body 120 is collected by a condenser lens (not shown), and the endoscope 1 is used.
The light is transmitted to the illumination lens 124 at the distal end through the light guide 123 in the light source 22, where the light is spread at a predetermined radiation angle to illuminate the observation region, and the reflected light from the observation region is transmitted through the imaging lens 125. Solid-state imaging device (CCD)
An image is formed on a light receiving surface 126.

An image forming signal from the CCD 126 is transmitted to the endoscope apparatus main body 120 as a time-series video signal.
The data is converted into digital signal image data by the D converter 127 and temporarily stored in the image memory 128. The image data in the image memory 128 is synthesized with supplementary information such as a patient ID and comment characters, and the synthesized signal is converted into a standard TV format signal by the TV signal converter 129 and displayed on the TV monitor 130.

[0016]

As described above, the ultrasonic diagnostic apparatus of the prior art can be combined with an endoscope apparatus to reduce the surface condition of the inner wall of a body cavity such as a stomach wall without causing new pain to a patient. It has become possible to simultaneously grasp the state of the submucosa.

However, an endoscope obtained by each of an endoscope apparatus currently used in a clinical setting and an ultrasonic diagnostic apparatus having a small-diameter probe insertable into a forceps hole of the endoscope scope. The image and the ultrasound image are displayed on separate monitors, even though the diagnosis region or the same diagnosis site that is very close to each other is visualized.

Moreover, it is generally difficult to arrange the endoscope apparatus and the ultrasonic diagnostic apparatus adjacent to each other in an examination room such as a narrow endoscope diagnostic room. For example, both monitors are often located at a distance from each other across an inspection bed.

Observing the endoscope image and the ultrasonic image on the separate monitors spaced apart from each other as described above can be performed, for example, when accurately positioning the small-diameter probe while monitoring the endoscope image. In many cases, it is troublesome to compare and observe the two images, and the usability is not always good.

The present invention has been made in view of the above-described problems, and has as its object to provide an ultrasonic / endoscopic combined system which facilitates observation of both images obtained by ultrasonic / endoscopic inspection. Aim.

[0021]

In order to achieve the above object, the invention according to claim 1 is an endoscope system for acquiring an endoscope image in a body cavity using an endoscope, and the endoscope. And an ultrasonic system having an ultrasonic system for acquiring an ultrasonic image of the body cavity with an ultrasonic probe inserted through the forceps hole, wherein the endoscopic image and the ultrasonic image are Display means for simultaneously displaying on the same monitor, and rotating at least one of the endoscope image and the ultrasonic image simultaneously displayed by the display means on the monitor so that their directions are relatively aligned. Image rotation means for causing the display means to shift at least one of the endoscopic image and the ultrasonic image displayed simultaneously by the display means on the monitor. Characterized in that it. Further, the invention according to claim 2 is an endoscope system for acquiring an endoscopic image of a body cavity by an endoscope, and the ultrasonic probe inserted into a forceps hole of the endoscope. In an ultrasonic / endoscopic combined system having an ultrasonic system for acquiring an ultrasonic image of a body cavity, a display means for simultaneously displaying a real-time endoscopic image and a real-time ultrasonic image, Image rotating means for rotating at least one of the displayed real-time endoscopic image and the real-time ultrasonic image on the monitor in a state where their directions are relatively aligned with each other, and are simultaneously displayed by the display means. Image shift means for shifting at least one of the endoscope image and the ultrasonic image on the monitor. To. The invention according to claim 3 is an endoscope system that acquires an endoscopic image of a body cavity using an endoscope, and the ultrasonic probe inserted through a forceps hole of the endoscope scope. An ultrasound / endoscope combined system having an ultrasound system for acquiring an ultrasound image in a main screen and a display area below the main screen on the same monitor as the endoscope image and the ultrasound image. Display means for simultaneously displaying the divided screens composed of the sub-screens, and at least one of the endoscopic image and the ultrasonic image simultaneously displayed by the display means in a state in which the directions thereof are relatively aligned with each other. Image rotation means for rotating on a monitor, and shifting at least one of the endoscope image and the ultrasonic image simultaneously displayed by the display means on the monitor Characterized by comprising an image shifting means for the.

[0022]

According to the first aspect of the present invention, an endoscopic image and an ultrasonic image are displayed on the same monitor, and at least one of the two images is rotated. The invention according to claim 2 displays an endoscopic image and an ultrasonic image in real time, and rotates at least one of the two images.
According to the third aspect of the present invention, the endoscopic image and the ultrasonic image are allocated and displayed on a divided screen including a main screen and a sub-screen having a display area below the main screen on the same monitor. Rotate at least one.

[0023]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of an ultrasonic / endoscope combined system according to the present invention will be described below with reference to FIGS.

FIG. 1 shows the overall configuration of an ultrasonic / endoscope combined system (hereinafter simply referred to as a “combined system”) 1. The composite system 1 is an endoscope apparatus (hereinafter, referred to as an “endoscopic system”) capable of acquiring an endoscopic image of a gastrointestinal tract such as a stomach, an esophagus, a duodenum, or a body cavity such as a bile duct and a pancreatic duct, or a blood vessel. 2) and an ultrasonic diagnostic apparatus (hereinafter referred to as “ultrasonic system”) 3 capable of acquiring an ultrasonic image of a body cavity in combination with the endoscope system 2. The image display unit 4 is connected to the output side of both image data obtained separately by the ultrasonic system 2.

The endoscope system 2 is configured by applying a normal endoscope device, and as shown in FIG. 1, an endoscope scope (hereinafter simply referred to as "scope") that can be inserted into a body cavity. 5) and an apparatus main body 6 to which the scope 5 is connected.

As shown in FIG. 2, the scope 5 has an insertion section 6 which is thin and flexible in appearance, and an operation section 7 to which the insertion section 6 is connected.

The insertion section 6 is provided therein with a water supply hole and an air supply hole (not shown) and a forceps hole 8 into which at least an ultrasonic probe (described later) is inserted.

The operating section 7 has an opening 8a as an insertion port for the forceps or the like of the forceps hole 8, and an input device 9 for assisting an operator's operation at the time of inspection. The input device 9 includes, for example, an angle knob 9a for commanding operation of an angle lock mechanism and various buttons 9b for commanding water supply and air supply. The manual operation of the angle knob 9a causes the distal end of the insertion portion 6 to bend in the vertical and horizontal directions within a predetermined angle range.

A light guide 10 for transmitting light and a signal line (coaxial cable) 11 for transmitting a video signal are inserted into the insertion section 6 and the operation section 7 in addition to the above-described configuration.
The light guide 10 and the signal line 11 are connected to the apparatus main body 6 via the connection pins 12a of the universal cord 12.

Further, as shown in FIG. 1 (not shown in FIG. 2), the scope 5 has an illumination lens 13 optically connected to the distal end of the light guide 10 and a distal end of the signal line 11. CCD electrically connected to
The imaging device includes a (solid-state imaging device) 14, an imaging lens (imaging optical system) 15 for forming reflected light from a subject on a light receiving surface of the CCD 14, and the like.

As shown in FIG. 1, the apparatus main body 6 includes a light source section 16 for generating light and an image processing section 17 for processing a video signal.
And

The light source section 16 includes a light source such as a xenon lamp (not shown) and an optical system such as a condenser lens, and supplies light generated by the light source to the light guide 10 of the scope 5 via the optical system. Has become. Light guide 10
Is incident on a subject via an illumination lens 13 and illuminates an observation site such as a tube wall, and reflected light from the observation site forms an image on a light receiving surface of a CCD 14 via an imaging lens 15. The image forming signal is supplied to the image processing unit 17 as a time-series video signal.

The image processing unit 17 converts the video signal from the scope 5 into image data as a digital signal via an A / D converter 18 and converts the image data into an image memory 19
Is stored temporarily. This image memory 19
The apparatus also receives additional information such as a patient ID and comment characters input from an input device (not shown) of the apparatus body 6, and outputs the image data to the image display unit 4 together with the additional information.

The ultrasonic system 3 is configured by applying a normal ultrasonic diagnostic apparatus, and as shown in FIG.
The apparatus includes a small-diameter ultrasonic probe (hereinafter, simply referred to as a “probe”) 20 that can be inserted into a body cavity, and an apparatus main body 21a to which the probe 20 is connected.

As shown in FIG. 2, the probe 20 has an insertion portion 22 that can be inserted into the forceps hole 8 of the scope 5 and an operation portion 21b to which the insertion portion 22 is connected. It is connected to the apparatus main body 21 via a connection pin 24a of the cord 24. Here, in this embodiment, for convenience of explanation, the operation unit 21b and the apparatus main body 21a are collectively referred to as the apparatus main body 21.

As shown in FIG. 1, the insertion section 22 includes a thin and flexible probe sheath 25 and an ultrasonic transducer 26 disposed at the distal end of the probe sheath 22.

The probe sheath 25 is, as shown in FIG.
It is a thin cylindrical body that can be inserted into the forceps hole 8 of the scope 5 and has an acoustic window (not shown) near its distal end, and an ultrasonic transducer 26 is disposed at an internal position facing the acoustic window. The ultrasonic transducer 26 converts a drive pulse from the apparatus main body 21 into an ultrasonic pulse, radiates the ultrasonic pulse through an acoustic window in a direction substantially orthogonal to the center axis of the probe sheath, and The opposite transformation is also performed.

Further, one end of a flexible torque cable 27 as a rotary shaft is connected to the ultrasonic transducer 26. The torque cable 27 is rotatably supported by a bearing (not shown) in the probe sheath 25. A signal line (including a ground line) 28 is inserted into the torque cable 27, and one end of the signal line 28 is connected to an electrode (not shown) of the ultrasonic vibrator 26,
The other end reaches the apparatus main body via the rotary transformer 29.
Signal line rotor (rotation) by rotary transformer 29
The side and the stator (fixed) side 25 can communicate with each other without being electrically in contact with each other.

The apparatus main body 21 includes a rotary transformer 29.
, An ultrasonic transmission unit 30 and an ultrasonic reception unit 31 connected in parallel to the stator side, an electric motor 32 as a rotation source connected to a torque cable 27, and an electric motor 32.
An angle detector 33 for detecting the rotation position of the image data, an image rotation control unit 34 for rotating the displayed image, an address change unit 35 for correcting the address of the image data, and an image processing unit 36 are provided.

The ultrasonic transmitter 30 is provided with a rate signal generator 40 for generating a reference clock, and the ultrasonic oscillator 2 which is energized by the reference clock from the rate signal generator 40.
6 for driving the oscillator 6.

The ultrasonic receiving unit 31 includes an amplifying unit 42 connected to the signal line 28, a logarithmic amplifier 43 for logarithmic conversion (compression) of the amplitude value, and a logarithmic amplifier 43 connected to the output side of the amplifier 42.
And a detection circuit 44 for envelope detection.

The electric motor 32 has an output shaft (rotating shaft)
Are connected to the torque cable 27, so that they rotate by minute angles in accordance with a rotation position signal from a controller (not shown). The rotational force is transmitted to the ultrasonic vibrator 26 via the torque cable 27, and the pulse emission angle of the ultrasonic vibrator also changes by a small angle in the same scanning plane. The rotation position (rotation angle) of the electric motor 32 is detected by an angle detector 33.

The angle detector 33 includes, for example, a rotary encoder 45 as a main part, measures a detection signal from the rotary encoder 45 with a counter 46, and uses the measurement result as an address signal as an address signal to the address changer 35 and the image processing unit 3.
6 respectively.

The image rotation control unit 34 rotates the ultrasonic image displayed on the image display unit 4 about the center point of the radial scanning plane, and includes a transmitter 47 for generating a clock pulse, a manual An input device (for example, two operation buttons for counterclockwise rotation and clockwise rotation) 48 for instructing an image rotation operation by an operation and a command pulse from the input device 48 to generate a clock pulse from the transmitter 47 An image rotation counter 49 for measuring (up counting or down counting) is provided.

The pulse measurement value measured by the counter 49 corresponds to a plus or minus portion of an address on an image memory (described later). That is, the counterclockwise or clockwise rotation direction of the image is set by the mode (up or down) of the counter 49, and the rotation angle of the image is set by the counter 49.
It is set by the pulse measurement value. The pulse measurement value is converted into, for example, a binary (binary) signal and output to the address changer 35.

The address changer 35 is composed of a digital adder or the like. When a binary signal is input from the angle change counter 48, the address changer 35 calculates (addition or addition) the binary signal and the address signal from the counter 46. Subtraction)
Then, the calculation result is output to the image processing unit 36 as a change address signal.

The image processing section 36 includes an A / D converter 50 for converting a detection signal from the detection circuit 44 into a digital signal,
An image memory 51 for writing the digital signal converted by the A / D converter 50 to an address in a memory space designated by an address signal from the angle detector 33, and an image written in the image memory 51. A digital scan converter (DSC) 52 for converting a data format from an ultrasonic scanning system to a standard TV scanning system is provided.

The address of the image data written in the image memory 51 is changed to a new address specified by the changed address signal when there is a changed address signal from the address changer 35. . As a result, the image data is read based on the new address, and is displayed on the screen of a display (described later) as if the ultrasonic image had been rotated.

The image display system 4 combines the image data stored in the image processing units 17 and 36 of the two systems 2 and 3 with an image combiner 53 so as to be a scanning signal for one screen, and the combined signal Is output to the display 55 via the D / A converter 54. As a result, the ultrasonic image and the endoscope image as real-time images are divided and displayed on the screen of the display 55. Here, in the present embodiment, it is assumed that a screen division format is set as a part of the main screen, and a sub-screen having an area smaller than that of the main screen is set. Is displayed (see FIG. 3).

Next, the overall operation will be described with reference to FIGS.

First, in order to diagnose the tumor site Su on the stomach surface of the subject P and the internal state (invasion degree and the like) of the tumor site Su, the composite system 1 is activated, and the endoscope system 2 and the ultra It is assumed that the sound wave system 3 operates, and the ultrasonic image and the endoscope image are temporarily stored in the image processing units 17 and 36, respectively. FIG. 3 shows both images in this memory storage state.
(A) and (b).

Next, the two images are synthesized by the image changer 53 so as to be a scanning signal of one screen, and the synthesized signal is displayed on the screen of the display 55 via the D / A converter 54. On this screen, as shown in FIG. 4A, for example, an ultrasonic image is displayed as a real screen image on the main screen M1, and an endoscopic image is displayed on the sub screen M2.

Here, due to the difference between the orientations of the two images, as shown in FIG. 4A, the tumor site S observed in the substantially lower left direction of the endoscopic image (sub-screen M2)
It is assumed that u is displayed substantially in the upper left direction on the ultrasonic image (main screen M1).

In this display state, confusion may be caused at the time of diagnosis. Therefore, the operator manually operates the input device 49 so that the directions of the tumor sites Su in both images are aligned, and the rotation of the ultrasonic image is instructed. .

Next, the address in the image memory 51 corresponding to the content of the rotation command (the direction and angle of rotation) is changed (rewritten), and the ultrasonic image is displayed on the screen as shown in FIG. It is displayed as if rotated.

As described above, in this embodiment, since both the ultrasonic image and the endoscope image are configured to be displayed on the same display screen, the conventional method in which the images are observed on separate displays (monitors) is used. The inconvenience of the above is almost eliminated, and the contrast observation of the two images becomes extremely easy. Thereby, while observing the endoscopic image on the screen, the ultrasonic probe can be accurately and easily guided to the position of a lesion site such as a tumor, and the time required for positioning the ultrasonic probe is greatly reduced. The burden on the operator is significantly reduced.

In this embodiment, at least one of the ultrasonic image and the endoscope image displayed on the same screen is provided with a rotation function, so that the orientations of the two images can be aligned. More accurate diagnosis can be performed while comparing images, and the diagnosis efficiency is greatly improved.

Although the input device of the rotation control unit in the above embodiment has two operation buttons for counterclockwise and clockwise rotation, the present invention is not limited to this. It may be a single operation lever or a rotary switch that can rotate clockwise and clockwise. In addition, the arrangement of the input device is not limited to the device main body of the ultrasonic system (the device main body or the operation unit of the probe), and is, for example, the device main body of the endoscope system or the operation unit of the scope (for example, near the angle knob). ) Or a separate operation panel.

In the above embodiment, the ultrasonic image is displayed on the main screen and the endoscope screen is displayed on the sub-screen. However, the present invention is not limited to this screen division format and image display format. For example, an endoscope image may be used for the main screen and an ultrasonic image may be used for the sub-screen, or the position and size of the sub-screen may be appropriately changed.

In the above embodiment, the ultrasonic image is rotated. However, the present invention is not limited to this, and the endoscope image is rotated about a reference point set in a plane. It is also possible to arrange an image rotation control unit for causing the image rotation to be performed.

Next, a first modification of the above embodiment will be described with reference to FIGS.

In this modification, the function of shifting the position of the image displayed on the main screen or the sub-screen and the position of the sub-screen in the up, down, left and right directions is applied in addition to the configuration of the above embodiment. Here, the same or equivalent components as those in the above embodiment are denoted by the same or equivalent reference numerals, and the description thereof is omitted.

The composite system 1a shown in FIG. 5 includes a shift control section 60 having the above-mentioned shift function. The shift control unit 60 includes an input device 61 for the operator to manually specify shift contents (shift target (image or sub-screen) and shift position, etc.), and an input device 61.
Shift setting device 6 for setting the shift content specified by
And 2.

The input device 61 is composed of a keyboard, a mouse, a trackball, and the like. The operator performs a manual operation such as moving a cursor with the input device 64 while looking at the screen of the display device 55, and designates a shift content on the screen. I can do it.

The shift setting unit 62 outputs a control signal corresponding to the shift content specified by the input unit 61 to both systems 2,
The image data is output to each of the three image processing units 17 and 36. Thereby, each of the image processing units 17 and 36
The address of the image data in the image memories 19 and 51 can be changed so as to form one screen according to the shift contents. Other configurations are the same as those of the above embodiment.

With the above configuration, when it is desired to observe a portion of the ultrasonic image displayed on the main screen that overlaps the sub-screen, the ultrasonic image is shifted upward in the screen as shown in FIG. 6A, for example. Thus, the input device 161 may be manually operated and designated. Also, as shown in FIG. 6B, the position of the sub-screen may be designated to be shifted upward in the screen.

Accordingly, in the first modification, the position of the image and the position of the sub-screen are shifted, so that the display position of the image and the sub-screen is shifted in the vertical and horizontal directions in addition to the same operation and effect as in the above-described embodiment. The image can be easily changed, and the image can be observed at the optimum display position.

The shift control section 60 can be integrally mounted on the endoscope system 2, the ultrasound system 3, the image display section 4, or any of the separate units.

Next, a second modification of the above embodiment will be described with reference to FIGS.

In the present modification, a function of overlappingly displaying a marker on an image displayed on a screen is applied in addition to the configuration of the first modification. Here, the same or equivalent components as those in the above embodiment are denoted by the same or equivalent reference numerals, and the description thereof is omitted.

The composite system 1b shown in FIG. 7 includes a marker control section 63 having a marker display function. The marker control unit 63 includes an input device 64 for specifying a marker position on the screen of the display device 55 and a marker setting device 6 for generating a marker at the position specified by the input device 64.
5 is provided.

The input device 64 is composed of a keyboard, a mouse, a trackball, and the like, and allows the operator to perform a manual operation such as moving a cursor with the input device 64 while looking at the screen of the display device 55 to specify the position of the marker. It has become.

The marker setting unit 65 outputs a control signal for generating a marker at a position on the screen designated by the input unit 64 to each of the image processing units 17 and 36 of both systems 2 and 3. I have. Thereby, the image processing units 17, 3
Each of Nos. 6 writes marker data at an address in the image memory 51 corresponding to the marker position on the screen. Other configurations are the same as those of the first modification.

With the above-described configuration, the operator can use the display 55
By simply manually specifying the position of the marker in the region of interest such as the tumor site in the ultrasonic image and the endoscope image while viewing the screen of FIG. Is displayed.

Therefore, in addition to the same operation and effect as those of the above embodiment, it is extremely easy to associate the positions of tumors and the like in both images only by checking the marker, and the burden on the doctor is significantly reduced. Explanations to the patient (eg, explanations to patients, reports of disease cases at conferences, etc.) are also easy to understand, and the persuasive power increases.

The marker control section 63 can be integrally mounted on the endoscope system 2, the ultrasound system 3, the image display section 4, or any of the separate units.

Next, a third modification of the above embodiment will be described with reference to FIGS.

In this modification, the function of simultaneously capturing both images as still images and rotating the ultrasonic image in the still images is applied in addition to the configuration of the above embodiment. Here, the same or equivalent components as those in the above embodiment are denoted by the same or equivalent reference numerals, and the description thereof is omitted.

The composite system 1c shown in FIG. 9 includes a freeze control unit 66 for instructing the ultrasonic system 3 to freeze an image.
And a buffer memory 67 for temporarily storing a still image based on an image still command from the freeze control unit 66.

The freeze control unit 66 includes an input device (not shown) including a switch for a still image, and an operator operates the input device to simultaneously display an endoscope image and an ultrasonic image displayed in real time. An image still instruction for outputting a still image is output to each of the image processing unit 17 of the endoscope system 2 and the buffer memory 67 of the ultrasonic system 3.

When the image processing unit 17 of the endoscope system 2 receives an image still command from the freeze control unit 66, the image data supplied from the endoscope 5 in real time is stored in the image memory 19 as a still image. , And the still image is output to the image display unit 4 via the image memory 51.

The buffer memory 67 of the ultrasonic system 3
Is inserted in the image processing unit 36, and is supplied in real time from the ultrasonic receiving unit 31 via the A / D converter 50 when an image still command is issued from the freeze control unit 66. Is temporarily stored as a still image, and the still image is output to the image display unit 4 via the image memory 51.

The buffer memory 67 changes the read start address of the image data on which the still image is based upon receiving a rotation command from the image rotation control unit 34 similar to the above embodiment. . That is, the image data is read based on the changed read start address and output to the image display unit 4. Therefore, in the present modification, the address changer 35 among the components of the above embodiment is omitted. Other configurations are the same as those of the above embodiment.

As described above, each of the still images from the two systems 2 and 3 is synthesized by the image synthesizer 53 of the image display unit 4 so as to form one screen, and the synthesized signal is converted into a D / A converter 54
Is displayed on the screen of the display 55 via the.

Here, the rotation processing of an ultrasonic image displayed as a still image will be described with reference to FIG.

First, consider the case where the still image shown in FIG. 10A is rotated 90 degrees counterclockwise. here,
For convenience of explanation, to obtain one (frame) image, 3
The 60-degree ultrasonic scanning plane is divided into eight directions (addresses n1... N).
8), and transmit and receive the ultrasonic beam for each direction.

Here, image data in the buffer memory 67 corresponding to the still image shown in FIG. 10A has been written to each of the eight addresses n1 to n8.

That is, in order to rotate the still image, it is only necessary to change the designation of the read start address based on the write start address. For example, the write start address n
In order to rotate the written image data 90 degrees counterclockwise with reference to 1, it is only necessary to change the read start to address n3 instead of address n1 and specify it. Thus, the still image on the screen is displayed as if it were rotated 90 degrees counterclockwise.

In the third embodiment, the ultrasonic image is rotated by using the image captured as a still image. Therefore, in addition to the same operation and effect as the above-mentioned embodiment, for example, the operation for aligning the orientation of both images is performed. Can be easily edited using a still image after the end of the examination, rather than during the examination. This eliminates the need for orientation work during the examination and shortens the restraint time for the patient.

The input device of the freeze control section 66 can be arranged on the endoscope system 2, the ultrasonic system 3, or a separate operation panel.

Next, a fourth modification of the above embodiment will be described with reference to FIG.

In general, it has been difficult to obtain a high-quality ultrasonic image under the best imaging conditions (scope position, etc.) at which an endoscopic image can be obtained. In other words, since the probe is guided by using the forceps hole of the scope, the position and direction of the probe are easily limited by the angle lock mechanism of the scope, and the scope and the probe cannot be simultaneously set to the positions of the respective optimum imaging conditions. There were many.

Therefore, in the present modification, the function of individually converting each of the endoscope image and the ultrasonic image into a still image is applied to the configuration of the above-described embodiment. Here, the same or equivalent components as those in the above embodiment are denoted by the same or equivalent reference numerals, and the description thereof is omitted.

The composite system 1d shown in FIG. 11 is provided with freeze control units 68 and 69 for making a real-time image a still image in each of the endoscope system 2 and the ultrasonic system 3. Other configurations are the same as those of the above embodiment.

The operation of the fourth modification will be described first.
It is assumed that the ultrasound image and the endoscope image are each displayed as a real-time image on the screen of the display 55 as in the above-described embodiment. Next, the operator guides the distal end of the scope 5 to a position where an optimal endoscope image can be obtained, and freezes the endoscope image with an input device (not shown) of the freeze control unit 68 at this position. That is, on the screen of the display 55, the ultrasonic image is displayed as a real-time image, and the endoscope image captured under the optimum condition is displayed as a still image.

Next, while the position of the scope 5 is maintained, the operator finely adjusts the distal end of the probe 20 to an optimum position, and at this position, the ultrasonic image is input to the input unit (not shown) of the freeze control unit 69. ) To freeze.
Immediately before the freeze operation, the orientation operation may be performed by rotating the ultrasonic image. Here, each of the endoscope image and the ultrasonic image is displayed on the screen as a still image under the optimum condition. This still image is recorded and stored by a separate recording device (not shown).

Therefore, in the third embodiment, in addition to the same operation and effect as those of the above-described embodiment, each of the scope and the probe can be simultaneously guided to a position suitable for diagnosis, thereby providing an optimal endoscope. A high-quality ultrasonic image can be obtained under conditions such as the position of a scope where a mirror image can be obtained.

The input devices of the freeze controllers 68 and 69 can be arranged on the endoscope system 2, the ultrasonic system 3, or a separate operation panel. Further, each of the input devices may be arranged separately or at an adjacent position.

Next, a fifth modification of the above embodiment will be described with reference to FIGS.

In general, an ultrasonic examination using an endoscope is started after a diagnosis site is specified by an endoscope apparatus and a probe is guided to the diagnosis site. If the ultrasonic vibrator in the probe is rotated before the guidance due to, for example, a malfunction of the ultrasonic diagnostic apparatus, the probe having a small diameter but having a fragile property may be damaged. That is, it is preferable not to rotate the ultrasonic transducer until at least the probe passes through the forceps hole of the scope.

In the present modification, a function of checking whether or not the ultrasonic transducer is rotating based on the display state of the screen is applied in addition to the configuration of the above-described embodiment. here,
The same or equivalent components as those in the above embodiment are denoted by the same or equivalent reference numerals, and the description thereof will be omitted.

The composite system 1e shown in FIG. 12 includes an ultrasonic image priority display control unit 70. The priority display control unit 70 includes the endoscope system 2, the ultrasonic system 3,
The image display unit 4 or a separate unit can be integrally mounted, and includes a mode selection unit 71 for selecting a screen mode. When the mode selection unit 71 is in the motor driving state in the ultrasonic system 3, Based on the selected screen mode, a control signal corresponding to the selected mode is output to each of the image processing units 17 and 36 of both systems 2 and 3. That is, when the motor is not rotating (when the transducer is not rotating), the endoscope mode (see FIG. 13A) is selected, and when the motor is rotating (when the transducer is rotating), the ultrasonic priority mode (see FIG. b) is selected.

The image processing units 17 and 36 of both systems 2 and 3
Each stores the image data at an address assigned on the screen corresponding to the screen mode based on the control signal corresponding to the screen mode from the mode selection unit 71, and outputs the image data to the image display unit 4. It has become. Thereby, the image display unit 4 displays the endoscope image and the ultrasonic image on a screen according to the rotation state of the ultrasonic transducer. Other configurations are the same as those of the above embodiment.

With the above configuration, when the ultrasonic vibrator is not rotating, only the endoscope image is displayed as shown in FIG. 13A, and when the ultrasonic vibrator is rotating, FIG.
As shown in (b), since the ultrasonic image is displayed on the main screen and the endoscopic image is displayed on the main screen, when the ultrasonic vibrator rotates while the tip of the probe passes through the forceps hole of the scope. Does not display an endoscope image, and furthermore, the ultrasonic image is displayed as a unique image reflecting the forceps hole, so that the operator can easily confirm the abnormal operation of the complex system only by looking at the screen.

Note that the priority display control unit 70 can be integrally mounted on any of the endoscope system 2, the ultrasonic system 3, the image display unit 4, and a separate unit.

Next, a sixth modification of the above embodiment will be described with reference to FIGS.

In this modification, a screen switching function is applied in addition to the configuration of the above embodiment. Here, the same or equivalent components as those in the above embodiment are denoted by the same or equivalent reference numerals, and the description thereof is omitted.

[0108] The composite system 1f shown in FIG. This mode switching control unit 7
Reference numeral 2 has an input device 73 for specifying a screen mode by an operator's manual operation, and a mode selector 74 for setting the screen mode specified by the input device 73. The control signal corresponding to the screen mode set by the mode selector 74 is applied to the image processing units 17 of the two systems 2 and 3.
36, and output in the same manner as in the fifth modified example.
A screen corresponding to the set screen mode is displayed on the display 55.

As shown in FIG. 15, the screen mode includes, for example, only four types of modes N1 to N4, an endoscope image only (see FIG. 15A), an endoscope image on the main screen, and a small screen on the small screen. Ultrasound image (see (b) in the same figure), ultrasound image for parent screen, endoscopic image (see (c) in the same figure) for small screen, and only ultrasound image (see (d) in the same figure) are set. Have been.

The input device 73 includes, for example, one operation button,
A rotary changeover switch (see FIG. 15E) or a plurality of operation buttons corresponding to the screen mode (see FIG. 15F)
And so on. The input device 73 can be arranged on the endoscope system 2, the ultrasonic system 3, or a separate operation panel.

Among them, one operation button has an advantage that the layout is small and the panel space is small. Each time the button is pressed, for example, the screen modes N1... N4 are sequentially changed according to a predetermined screen mode order. Selected repeatedly. The screens (see FIGS. 15A to 15D) corresponding to the selected screen modes N1 to N4 are sequentially displayed every time the button is pressed. Here, the order of the screen modes may be changed in consideration of the frequency of use of the screen and the like.

In the sixth embodiment, a plurality of screen modes can be displayed on the display 55, and the operator (doctor, laboratory technician) can arbitrarily select the screen mode. In addition to the effects, the operator can select a screen mode according to the progress of the diagnosis and the like, and the efficiency of diagnosis is greatly improved.

Note that the screen modes are not limited to the above four types. For example, a sub-screen whose size and position have been changed may be added, or one of the above four types that is used less frequently may be deleted. Of course, the number of screen modes is not limited to four.

[0114]

As described above, according to the present invention,
Since at least one of the endoscope image obtained by the endoscope system and the ultrasonic image obtained by the ultrasonic system is rotatable, the orientations of both images can be easily aligned, and both images can be easily aligned. Can be made visually easier to understand. Therefore, confusion at the time of diagnosis due to the difference in orientation between the two images can be almost avoided, and the diagnosis while comparing the two images is more accurate and easier, and the burden on the operator is greatly reduced. In particular, when the endoscope image and the ultrasonic image are configured to be displayed on the same monitor, the comparative observation of the two images is further facilitated. In addition, since the endoscope image and the ultrasound image are both displayed in real time, the positioning operation of the ultrasound probe can be performed while monitoring the endoscope image. When a tumor is present, it is possible to easily determine which tumor is being subjected to the ultrasonic examination. Furthermore, when the endoscope image and the ultrasound image are configured to be assigned to the main screen and the sub-screen of the same monitor and displayed, it is possible to perform an examination according to the amount of information required by the operator, and to improve the diagnosis efficiency. Will be improved.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram showing an entire ultrasound / endoscope combined system according to an embodiment.

FIG. 2 is a schematic perspective view showing an outline of an endoscope and an ultrasonic probe inserted into a forceps hole in the scope;

3A is an explanatory diagram of an endoscope image, and FIG. 3B is an explanatory diagram of an ultrasonic image.

FIGS. 4A and 4B are diagrams illustrating a rotation operation of an ultrasonic image, and FIG.
FIG. 4 is an explanatory diagram of a display state before rotation, and FIG. 4B is an explanatory diagram of a display state after rotation.

FIG. 5 is a schematic configuration diagram showing the entire ultrasonic / endoscope combined system according to a first modification;

6A is an explanatory diagram of a shift operation of an ultrasonic image (main screen), and FIG. 6B is an explanatory diagram of a shift operation of a sub-screen (endoscopic image).

FIG. 7 is a schematic configuration diagram showing the entire ultrasonic / endoscope combined system according to a second modification;

FIG. 8 is a diagram illustrating a display state of a marker.

FIG. 9 is a schematic configuration diagram showing an entire ultrasonic / endoscope combined system according to a third modified example.

10A and 10B are diagrams schematically illustrating a rotation operation of a still image, wherein FIG. 10A is a diagram illustrating an ultrasonic image before rotation, and FIG.
FIG. 3 is a diagram for explaining a writing and reading situation of image data in a buffer memory, and FIG. 3C is a diagram for explaining an ultrasonic image after rotation.

FIG. 11 is a schematic configuration diagram showing an entire ultrasonic / endoscope combined system according to a fourth modification;

FIG. 12 is a schematic configuration diagram showing the entire ultrasonic / endoscope combined system according to a fifth modification;

FIG. 13 is a diagram illustrating priority display of an ultrasonic image.
(A) is a screen state diagram when the vibrator is not rotating, and (b) is a screen state diagram when the vibrator is rotating.

FIG. 14 is a schematic configuration diagram showing the entire ultrasonic / endoscope combined system according to a sixth modification;

15A to 15D are explanatory diagrams of screens corresponding to a plurality of screen modes, FIG. 15E is an explanatory diagram of a rotary changeover switch, and FIG. 15F is an explanatory diagram of a plurality of operation buttons.

FIG. 16 is a schematic block diagram showing the whole of a conventional ultrasonic diagnostic apparatus.

FIG. 17 is a schematic block diagram showing the whole of a conventional endoscope apparatus.

[Explanation of symbols]

1, 1a, 1b, 1c, 1d, 1e, 1f Combined ultrasound / endoscope system 2 Endoscope system (endoscope device) 3 Ultrasound system (ultrasound diagnostic device) 4 Image display unit 5 Endoscope Scope 6 Endoscope apparatus main body 17 Image processing section (endoscope system) 20 Small-diameter ultrasonic probe 21 Ultrasonic apparatus main body 26 Ultrasonic transducer 30 Ultrasonic transmitting section 31 Ultrasonic receiving section 33 Angle detector 34 Image rotation Control unit 36 Image processing unit (endoscope system)

────────────────────────────────────────────────── ─── Continued on the front page (58) Fields investigated (Int. Cl. ⁷ , DB name) A61B 8/00-8/15 A61B 1/00-1/32 Practical file (PATOLIS) Patent file (PATOLIS)

Claims (11)

(57) [Claims] 1. An endoscope system for acquiring an endoscopic image in a body cavity by an endoscope, and an ultrasonic probe in the body cavity by an ultrasonic probe inserted into a forceps hole of the endoscope scope. An ultrasound / endoscope combined system having an ultrasound system for acquiring an image, a display means for simultaneously displaying the endoscopic image and the ultrasound image on the same monitor, and At least one of the endoscope image and the ultrasonic image is manually operated on the monitor in a state where directions of the images are relatively aligned with each other.
Image rotating means for rotating based on a command signal of an image rotating operation, and image shifting means for shifting at least one of the endoscopic image and the ultrasonic image simultaneously displayed by the display means on the monitor. An ultrasonic / endoscope combined system, comprising: 2. An endoscope system for acquiring an endoscopic image in a body cavity by an endoscope, and ultrasonic waves in the body cavity by an ultrasonic probe inserted through a forceps hole of the endoscope scope. A combined ultrasound / endoscope system having an ultrasound system for acquiring an image, a display unit for simultaneously displaying a real-time endoscopic image and a real-time ultrasound image, and the real-time displayed simultaneously by the display unit. An image to be rotated based on a command signal of an image rotation operation by a manual operation on the monitor such that at least one of the endoscope image and the real-time ultrasonic image is relatively aligned with each other in direction. A rotating unit, and an image that shifts at least one of the endoscope image and the ultrasonic image simultaneously displayed by the display unit on the monitor. A combined ultrasound / endoscope system comprising: a shift unit. 3. An endoscope system for acquiring an endoscopic image in a body cavity by an endoscope, and ultrasonic waves in the body cavity by an ultrasonic probe inserted through a forceps hole of the endoscope scope. An ultrasonic / endoscope combined system having an ultrasonic system for acquiring an image, wherein the endoscopic image and the ultrasonic image are composed of a main screen on the same monitor and a sub-screen having a display area below the main screen. Display means for allocating and simultaneously displaying the divided screens; and manually displaying on the monitor at least one of an endoscope image and an ultrasonic image simultaneously displayed by the display means in such a state that their directions are relatively aligned with each other. Image rotation by operation
Image rotating means for rotating based on an operation command signal, and image shifting means for shifting at least one of the endoscopic image and the ultrasonic image simultaneously displayed by the display means on the monitor, An ultrasonic / endoscope combined system comprising: 4. The ultrasonic system according to claim 1, wherein the ultrasonic probe is disposed near an insertion portion of the endoscope, and the ultrasonic probe is rotated and scanned to obtain an ultrasonic radial image. The combined ultrasonic / endoscope system according to any one of claims 1 to 3, wherein: 5. The ultrasound system according to claim 1, wherein the display unit performs real-time display of the endoscope image and the ultrasound image.
Endoscope combined system. 6. The display means displays an ultrasonic image on the main screen and an endoscope image on the sub-screen, or displays an endoscopic image on the main screen and an ultrasonic image on the sub-screen. The combined ultrasonic and endoscope system according to claim 3, wherein 7. The apparatus according to claim 1, wherein said image rotating means is capable of rotating at least one of said endoscopic image and said ultrasonic image in either clockwise or counterclockwise direction. Item 4. The combined ultrasonic / endoscope system according to any one of Items 3 to 7. 8. The ultrasound system according to claim 2, wherein said display means is capable of individually displaying a real-time image of said endoscopic image and said real-time image of said ultrasonic image as a still image. Endoscope combined system. Wherein said image rotation means, an input device for commanding said image rotation operation, the endoscope scope, the ultrasonic probe, the endoscope system body, the ultrasound system body, in the both body The combined ultrasound / endoscope system according to any one of claims 1, 2, 3, and 7, wherein the combined system is provided in any of the separately provided operation panels. 10. The ultrasonic wave according to claim 3, further comprising a shift unit for shifting at least one of a position of an image displayed on the main screen and the sub-screen, and a position of the sub-screen.・ Endoscope combined system. 11. The combined ultrasound / endoscope system according to claim 3, further comprising a change unit that changes a display area of the sub-screen.