JP2017006261A - Endoscope apparatus and endoscope system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To produce an effect that recording can be made according to a display mode.SOLUTION: An endoscope apparatus includes: a first processing unit that, given an endoscope image from an endoscope equipped with an image pick-up device, generates an image for display; a second processing unit that, given an ultrasonic image from an ultrasonic observation device for generating an ultrasonic image based on an ultrasonic signal from an ultrasonic vibrator, generates an image for display; a display control unit that enables the endoscope image and the ultrasonic image from the first and second processing units to be displayed in a plurality of display modes individually or in a synthesized manner; a recording image generation unit that can generate a first still image for recording based on the endoscope image and a second still image for recording based on the ultrasonic image; and a control unit that executes recording control in a first recording mode to record the image according to the setting of the display mode by the display control unit, of the first and second still images.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an endoscope apparatus and an endoscope system for recording an image obtained by an endoscope and an ultrasonic observation apparatus.

  Conventionally, endoscopes have been widely adopted in medical fields and the like. In addition, an ultrasonic endoscope that is provided with an ultrasonic transmission / reception unit that transmits / receives ultrasonic waves at the distal end of the insertion portion of the endoscope, acquires an ultrasonic image of an organ or the like, and performs observation / diagnosis or the like is also widespread. An endoscopic image obtained by the endoscope is signal-processed by a video processor and displayed on an observation monitor. Endoscopic images are recorded on various media for diagnosis and case recording by a video processor.

  In a conventional endoscope apparatus having a video processor, data after recording can be output in various formats depending on the application. For example, an endoscopic image can be recorded in a semiconductor recording device such as a USB memory, or data can be shared by transferring and recording to a server via a network. Endoscopic images recorded on various recording media can be used in various external devices. For example, in a filing device, an endoscopic image can be recorded and managed for each patient. The endoscope shape storage device can also record and manage a shape image in the organ of the endoscope insertion unit.

  In an endoscopic device, it is also possible to capture an image from an external device (hereinafter referred to as an external image) and to display it in combination with an endoscopic image being diagnosed in an examination or diagnosis. For example, it is possible to simultaneously display an endoscopic image obtained from an endoscope and a past patient's endoscopic image obtained from an external device, and obtain extremely useful information in examinations and diagnoses. Can do.

  Thus, in order to display not only the endoscopic image obtained by the endoscope but also the video signal from the external device and display it on the observation monitor, or recording it in the recording device, the video processor An external input terminal for capturing images from an external device is provided. The video processor can display the endoscopic image and the ultrasonic endoscope on the observation monitor by taking in the ultrasonic image obtained by the ultrasonic endoscope using the external input terminal. . The video processor can also generate and record a still image of an endoscopic image and an ultrasonic image by an operator's release operation.

JP 2010-82283 A

  By the way, in ultrasonic observation, generally, an endoscope image from an image sensor provided at the distal end portion of the insertion portion is used to guide the ultrasonic transducer provided at the distal end portion of the insertion portion to the examination site. . After reaching the desired examination site, the ultrasonic transducer is operated to perform ultrasonic observation. In this case, in order to transmit the ultrasonic vibration to the subject, treatment such as filling the affected part with water or inflating the balloon is performed. Accordingly, in this case, since the endoscopic image is an image that is not an organ or is unclear, display by the endoscopic image is not performed or is auxiliary displayed. Thus, in ultrasonic observation, only an endoscopic image is displayed on the observation monitor in the endoscopic observation mode, and only an ultrasonic image is mainly displayed in the ultrasonic observation mode.

  However, when the external input terminal is enabled, the video processor freezes the endoscope image from the endoscope and the image input through the external input terminal by the release operation by the endoscope. It is designed to record images. Therefore, an image that is not displayed on the observation monitor, that is, an invalid image may be recorded. In the ultrasonic observation mode, there are some that can record only an ultrasonic image. Thus, conventionally, in an endoscope apparatus operable in the endoscope observation mode and the ultrasonic observation mode, recording that does not match the display mode is performed, and a meaningless image is recorded. There was a problem that there was.

  In Patent Document 1, a path of a video signal is input in response to an input of an endoscope capture instruction signal for instructing capture of an endoscope video signal and an ultrasonic capture instruction signal for instructing capture of an ultrasound video signal. However, this proposal also does not consider recording according to the display mode.

  An object of this invention is to provide the endoscope apparatus and endoscope system which can perform recording according to a display mode.

  An endoscope apparatus according to the present invention includes a first processing unit that generates an image for display when an endoscope image is given from an endoscope that includes an imaging device, and an ultrasonic signal from an ultrasonic transducer. A second processing unit that generates an image for display by receiving the ultrasonic image from an ultrasonic observation device that generates an ultrasonic image based on the endoscope; and the endoscope from the first and second processing units A display control unit that enables display in a plurality of display modes for displaying an image and an ultrasonic image individually or in combination, a first still image for recording based on the endoscopic image, and the ultrasonic wave A recording image generation unit capable of generating a second still image for recording based on an image, and a first one that records an image corresponding to a setting of a display mode by the display control unit among the first and second still images. And a control unit that performs recording control in the recording mode.

  An endoscope system according to the present invention includes the ultrasonic transducer, the endoscope, the ultrasonic observation apparatus, and the endoscope apparatus according to claim 1.

  According to the present invention, there is an effect that recording according to the display mode can be performed.

1 is a block diagram showing an endoscope apparatus according to a first embodiment of the present invention. Explanatory drawing which shows the outline of the external appearance of the endoscope apparatus of FIG. Explanatory drawing for demonstrating the recording control by the control part. The flowchart for demonstrating operation | movement of 1st Embodiment. The flowchart for demonstrating operation | movement of 1st Embodiment. Explanatory drawing for demonstrating a screen display. Explanatory drawing for demonstrating a screen display. Explanatory drawing for demonstrating a screen display. Explanatory drawing for demonstrating a screen display. Explanatory drawing for demonstrating a screen display.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing an endoscope apparatus according to a first embodiment of the present invention. FIG. 2 is an explanatory diagram showing an outline of the appearance of the endoscope apparatus of FIG. In the present embodiment, it is possible to record a still image of an endoscopic image and an ultrasonic image corresponding to the display mode.

  As shown in FIG. 2, the endoscope apparatus 1 includes an insertion part 21 and an ultrasonic endoscope 20 for observing the inside of a living body as a subject, and an output of the ultrasonic endoscope 20. An ultrasonic observation device 70 that generates an ultrasonic image and an ultrasonic endoscope 20 are detachably connected, and an output of the ultrasonic observation device 70 is supplied to the endoscope obtained by the ultrasonic endoscope 20. And a video processor 40 that performs signal processing on the mirror image and signal processing on the ultrasonic image obtained by the ultrasonic observation apparatus 70. Video signals of the endoscopic image and the ultrasonic image generated by the video processor 40 are supplied to the observation monitor 60. A normal color monitor can be used as the monitor 60.

  In the present embodiment, an example is shown in which the ultrasonic endoscope 20 capable of endoscopic observation and ultrasonic observation is adopted. However, the endoscope for the endoscope observation provided with the image sensor is shown. An endoscope and an ultrasonic probe for ultrasonic observation may be adopted, and the output of the endoscope may be supplied to the video processor 40 and the output of the ultrasonic probe may be supplied to the ultrasonic observation apparatus 70.

  In FIG. 1, an ultrasonic endoscope 20 includes an elongated insertion portion 21 to be inserted into a body cavity. An operation unit 25 is provided at the rear end of the insertion unit 21, and a connector 27 is provided on the operation unit 25. The ultrasonic endoscope 20 and the video processor 40 are electrically connected by the connector 27 and the connector 42 provided in the video processor 40. Although FIG. 1 shows an example in which signal transmission among the ultrasonic endoscope 20, the ultrasonic observation apparatus 70, and the video processor 40 is wired, the wireless transmission may be possible.

  A light guide 22 that transmits illumination light from the light source device 30 is inserted into the insertion portion 21 and the operation portion 25 of the ultrasonic endoscope 20. The light source device 30 includes a lamp 31 and a condenser lens 32, and the illumination light from the lamp 31 is guided to the incident end of the light guide 22 by the lens 32. The light source device 30 is provided with an operation panel 33. The user can set the light source device 30 by operating the operation panel 33. Although FIG. 1 shows an example in which the video processor 40 and the light source device 30 are configured separately, the video processor and the light source device may be configured integrally.

  Further, as the light source device 30, a semiconductor light emitting element such as an LED or a laser diode may be employed instead of the lamp 31. When a semiconductor light emitting element is used, even if a semiconductor light emitting element that emits white light is used, for example, light emitted from different semiconductor light emitting elements for each RGB color component is combined to generate white light. It may be obtained. Further, a semiconductor light source may be provided at the distal end of the insertion portion 21 of the endoscope 20.

  The ultrasonic endoscope 20 transmits illumination light from the light source device 30 by the light guide 22 and emits illumination light from the distal end portion of the insertion portion 21 toward the subject. An imaging unit 23 is provided at the distal end of the insertion unit 21. The imaging unit 23 includes an optical system (not shown) that captures reflected light from a subject such as an affected part, and an imaging element (not shown) that photoelectrically converts a subject optical image incident through the optical system to obtain an imaging signal. The imaging unit 23 images a subject and acquires an imaging signal of an endoscopic image. An imaging signal from the imaging unit 23 is transmitted to the video processor 40 via the signal line 24 and the connectors 27 and 42.

  The insertion portion 21 may be a flexible type used for digestive organ observation or the like, or may be a rigid type used for surgery or the like. Further, the imaging unit 23 is not limited to the one provided at the distal end of the insertion unit 21, and an imaging element is provided in the operation unit (gripping unit) 25, and an optical image is obtained from the insertion unit distal end to the imaging element by an image guide fiber. It may be transmitted. Further, as the imaging unit 23, a camera head attached to an eyepiece of an optical endoscope (fiber scope or surgical optical tube) inserted into a body cavity may be employed.

  Further, an ultrasonic transducer portion 71 is provided at the distal end portion of the insertion portion 21 of the ultrasonic endoscope 20. The ultrasonic transducer unit 71 is arranged such that a predetermined number of ultrasonic transducers (not shown) that transmit and receive ultrasonic waves are arranged at the distal end portion of the insertion unit 21 so that a predetermined ultrasonic observation region is obtained. (Not shown). The ultrasonic transducer 71 includes, for example, an acoustic lens, a piezoelectric element, a matching layer, and the like, and is configured to acquire an ultrasonic signal that contributes to generating an internal ultrasonic tomographic image from the body wall. ing.

  Note that the ultrasonic transducer unit 71 is not limited to a convex type that acquires an ultrasonic signal by electrical scanning, and the ultrasonic transducer is mechanically scanned by rotating the ultrasonic transducer with a motor. You may employ | adopt the radial type thing which acquires a signal.

  An ultrasonic signal from the ultrasonic transducer unit 71 is transmitted to the ultrasonic observation apparatus 70 via the signal line 72 and the connector 27. The ultrasonic observation device 70 controls the ultrasonic transducer unit 71 of the ultrasonic endoscope 20 so as to transmit an ultrasonic wave having a predetermined frequency toward the target observation site and reflect it from the target observation site. An ultrasonic signal obtained by receiving the ultrasonic echo is supplied from the ultrasonic transducer 71. The ultrasonic observation apparatus 70 performs various kinds of signal processing to generate an image signal of an ultrasonic image for an ultrasonic tomographic image. An ultrasonic image from the ultrasonic observation apparatus 70 is supplied to the video processor 40 via the external input terminal 53 of the video processor 40.

  The video processor 40 includes a control unit 41 that controls each unit. The control unit 41 may be configured by a processor such as a CPU (not shown), and may operate according to a program stored in the storage unit 52 to control each unit. An imaging signal from the ultrasonic endoscope 20 is input to the video processing circuit 43 via the connector 42. The video processing circuit 43 is controlled by the control unit 41, performs predetermined analog signal processing such as amplification processing on the input imaging signal, and outputs it to the A / D conversion circuit 44. The A / D conversion circuit 44 converts the output of the video processing circuit 43 into a digital signal and then outputs the digital signal to the white balance (WB) circuit 45. The WB circuit 45 is controlled by the control unit 41, performs white balance adjustment processing on the input analog imaging signal, and then outputs it to the image processing circuit 46. The image processing circuit 46 as the first processing unit is controlled by the control unit 41 to perform predetermined image signal processing on the output of the WB circuit 45 and convert it into a video signal that can be displayed on the observation monitor 60. The video signal is output to the video signal switching circuit 47.

  The video processor 40 has an external input terminal 53. As described above, an ultrasonic image is supplied from the ultrasonic observation device 70 to the external input terminal 53. The ultrasonic image from the ultrasonic observation apparatus 70 is supplied to the video processing circuit 50 of the video processor 40 via the external input terminal 53. The video processing circuit 50 as the second processing unit is controlled by the control unit 41 to perform predetermined image signal processing on the input ultrasonic image and convert it into a video signal that can be displayed on the observation monitor 60. It is output to the rear video signal switching circuit 47.

  The display controller 49 is controlled by the control unit 41 and executes various processes related to display. For example, the display controller 49 controls the video signal switching circuit 47 so as to display on the observation monitor 60 in the display mode specified by the control unit 41. The video signal switching circuit 47 is controlled by the display controller 49 to switch the video signal so that the input endoscopic image and ultrasonic image are displayed in the designated display mode. As a result, the video signal switching circuit 47 can output video signals for individually displaying the endoscopic image and the ultrasonic image, and can output the endoscopic image and the ultrasonic image to the PIP system or the POP system. It is possible to output a video signal for displaying the synthesized image synthesized in step (b). When an external device (not shown) is connected to the external input terminal 53 and an external image is input from the external device, the display controller 49 displays the endoscopic image and the external image alone or in combination. Will be.

  The control unit 41 controls the display controller 49 to set a display mode corresponding to the observation mode. That is, in the endoscope observation mode, the control unit 41 controls the imaging unit 23 of the ultrasonic endoscope 20 to acquire an endoscope image and displays the acquired endoscope image alone or A display mode for displaying a composite image of the endoscopic image and the image input from the external input terminal 53 is set. In addition, in the ultrasonic observation mode, the control unit 41 controls the ultrasonic transducer unit 71 of the ultrasonic endoscope 20 to acquire an ultrasonic signal, and separately uses the ultrasonic image from the ultrasonic observation device 70. Or a display mode for displaying a composite image of an endoscopic image acquired by driving the imaging unit 23 and an ultrasonic image from the external input terminal 53 is set.

  The video signal from the video signal switching circuit 47 is supplied to the D / A conversion circuit 48. The D / A conversion circuit 48 converts the input digital video signal into an analog video signal and outputs it to the observation monitor 60. The observation monitor 60 displays an image corresponding to the video signal given from the D / A conversion circuit 48.

  In the present embodiment, the endoscopic image from the image processing circuit 46 and the image from the video processing circuit 50 are also supplied to the encoding circuit 51. The encoding circuit 51 serving as a recording image generation unit is controlled by the control unit 41 to encode an input image into a video signal having a predetermined image format. For example, the encoding circuit 51 converts the input image into the MPEG2 format or MPEG-4 AVC / H. H.264 format and video signals such as JPEG can be converted. Accordingly, the encoding circuit 51 can generate a still image for recording an endoscopic image and an ultrasonic image (or an external image).

  The control unit 41 can apply the image (encoded video signal) encoded by the encoding circuit 51 to the recording unit 65 for recording. Further, the video processor 40 is provided with a connector 54 as a video output terminal. An input terminal of the recording device 80 is connected to the connector 54. The control unit 41 can also record the encoded image to the recording device 80 via the connector 54 for recording.

  Further, the video processor 40 can also provide a still image of an endoscopic image and an ultrasonic image to the recording unit 65 and the recording device 80. As the recording unit 65, for example, various recording media such as an IC memory can be employed. As the recording device 80, for example, a large-capacity recording medium such as a hard disk or a DVD, or various storages such as a file server on a network can be employed.

  The ultrasonic endoscope 20 is provided with a recording operation unit 25a including a release button for performing an operation of recording an endoscopic image and an ultrasonic image according to a display mode. The recording operation unit 25a may be provided with not only a release button but also a recording setting button for performing recording corresponding to the display mode. The recording operation unit 25a generates an operation signal corresponding to the operation of the release button and the operation of the recording button. These operation signals are supplied to the control unit 41 of the video processor 40 through the signal line 26 and the connectors 27 and 42.

  The recording operation unit 25a of the ultrasonic endoscope 20 is an operation unit that can be operated relatively easily by the surgeon during the operation. Although the example in which the recording operation unit 25a is provided in the operation unit 25 of the ultrasonic endoscope 20 has been shown, a button provided on an endoscope (not shown), for example, as long as the operator can easily operate during the operation Alternatively, various scope switches or a foot switch (not shown) may be employed.

  The endoscope apparatus 1 is also provided with a keyboard 66. The keyboard 66 as an input unit can perform an instruction operation for the processing of the video processor 40, an input operation of patient information, and the like, and a recording setting key (not shown) for recording corresponding to the display mode is also provided. It has become. The keyboard 66 may be provided with a release key as well as a recording setting key. The keyboard 66 generates an operation signal corresponding to the key operation of the recording setting key and the operation of the release key. These operation signals are supplied to the control unit 41 of the video processor 40. The control unit 41 determines that the operation of the release button and the release key is the same operation, and determines that the operation of the recording setting button and the recording setting key is the same operation, and performs control. To do.

  The video processor 40 is provided with an operation panel 55. As with the keyboard 66, the operation panel 55 can set the video processor 40 based on a user operation. Further, the setting for the video processor 40 may be performed not only by the operation panel 55 and the keyboard 66 but also by an infrared remote controller or a touch panel.

(Recording control)
FIG. 3 is an explanatory diagram for explaining the recording control by the control unit 41. In the present embodiment, the control unit 41 controls recording of each unit in two recording modes, that is, an ultrasonic observation-compatible recording mode and a display-compatible recording mode, which are recording control similar to the conventional recording control, based on a user operation, for example. Be able to.

  When the recording mode is set by operating a recording setting button or a recording setting key by a user operation, the control unit 41 can give recording setting information corresponding to this setting to the storage unit 52 for storage. Note that the control unit 41 can set the endoscope observation mode and the ultrasonic observation mode as the observation mode to control each unit, and mode setting information indicating which mode is the current observation mode. The data can be given to the storage unit 52 and stored. When the release button of the recording operation unit 25 a or the release key of the keyboard 66 is operated, the control unit 41 controls recording based on the mode setting information and the recording setting information stored in the storage unit 52. It is supposed to be.

(Recording mode for ultrasonic observation)
As shown in FIG. 3, when the endoscope observation mode is set as the observation mode when the recording mode is set to the ultrasonic observation compatible recording mode as in the conventional case, the control unit 41, as shown in FIG. According to the operation, both still images of an endoscopic image and an ultrasonic image are recorded. In this case, when an external image from an external device is input to the external input terminal 53, still images of both the endoscopic image and the external image are recorded. In the ultrasonic observation compatible recording mode, when the observation mode is set to the ultrasonic observation mode, the control unit 41 performs control so as to record only the ultrasonic image.

  As described above, in the ultrasonic observation compatible recording mode, only the ultrasonic image can be recorded in the ultrasonic observation mode, and in the endoscopic observation mode, a device other than the ultrasonic observation device is connected to the external input terminal. Therefore, it is possible to record a still image of an endoscopic image and an external image. In the case where the endoscope observation mode is set when the ultrasonic observation apparatus 70 is connected to the external input terminal 53, a valid ultrasonic image is not input. An effective endoscopic image and an ineffective ultrasonic image are recorded.

  Therefore, in the present embodiment, the control unit 41 can perform recording control in the display-corresponding recording mode that is recording control corresponding to the display mode.

(Display compatible recording mode)
When the recording setting information indicates that the display-corresponding recording mode is set, the control unit 41 records only the endoscopic image in the endoscopic observation mode as shown in FIG. In the sound wave observation mode, recording control is performed so as to record only the ultrasonic image. That is, in this case, recording corresponding to the display mode is performed.

  The video processor 40 and the ultrasonic observation apparatus 70 communicate with each other via a predetermined communication path, and the control unit 41 receives an ultrasonic image from the ultrasonic observation apparatus 70 via the external input terminal 53. It is possible to determine whether or not an input has been made. The control unit 41 may set the display-corresponding recording mode in accordance with a user operation only when the ultrasound observation apparatus 70 is connected to the external input terminal 53. In addition, when the control unit 41 detects that the ultrasonic observation apparatus 70 is connected to the external input terminal 53 through communication between the ultrasonic observation apparatus 70 and the video processor 40, the recording mode is automatically displayed. The corresponding recording mode may be set.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. 4 to 7A to 7D. 4 and 5 are flowcharts for explaining the operation of the first embodiment. 6 and 7A to 7D are explanatory diagrams for explaining screen display.

  The operator first makes settings for recording using the keyboard 66 or the like. In the present embodiment, it is possible to designate an ultrasonic observation recording mode and a display-corresponding recording mode similar to the conventional one. The control unit 41 generates recording setting information based on the user's setting operation and stores it in the storage unit 52.

  FIG. 6 shows a setting screen 61 displayed on the display screen 60 a of the observation monitor 60. Note that the setting screen 61 may be displayed on the operation panel 55 to accept the operation. FIG. 6 shows an example in which each recording mode is designated by designating an image to be recorded in consideration that the user does not remember the images to be recorded in the ultrasonic observation recording mode and the display-corresponding recording mode. However, the user may directly specify the ultrasonic observation recording mode and the display-corresponding recording mode.

  In the present embodiment, in the ultrasonic observation recording mode, a still image of the ultrasonic image is recorded in the ultrasonic observation mode, and both the endoscopic image and the image from the external input terminal 53 are recorded in the endoscopic observation mode. Record still images. The setting screen 61 has an area 62 for designating a still image recorded in the ultrasonic observation mode and an area 64 for designating a still image recorded in the endoscope observation mode.

  In the areas 62 and 64, areas 63 and 65 indicating the current settings are provided, respectively. Since only the still image of the ultrasonic image is recorded in the ultrasonic observation mode, the region 63 indicates that the ultrasonic image is recorded, and the setting value of this region cannot be changed. . In the endoscope observation mode, control is performed so as to record still images of the endoscope image and the external image in the ultrasonic observation recording mode, and only the still image of the endoscope image is recorded in the display-corresponding recording mode. Control is performed as follows. On the setting screen 61, selection menus 66b and 66a for making these selections are provided. In the example of FIG. 6, it is shown that the setting for recording only the endoscopic image in the region 65 in the endoscope observation mode, that is, the display corresponding recording mode is set.

  Now, assume that the ultrasonic endoscope 20 is connected to the video processor 40 and the ultrasonic observation apparatus 70 as shown in FIG. 1 and observation of the subject by the ultrasonic endoscope 20 is started. An imaging signal from the imaging unit 23 of the ultrasonic endoscope 20 is supplied to the video processing circuit 43 of the video processor 40 via the connectors 27 and 42. The input imaging signal is subjected to predetermined analog signal processing such as amplification processing in the video processing circuit 43, converted into a digital signal by the A / D conversion circuit 44, and supplied to the WB circuit 45. After the white balance is adjusted by the WB circuit 45, the image pickup signal is given to the image processing circuit 46 and subjected to predetermined image signal processing. An endoscopic image that can be displayed on the observation monitor 60 is output by the image processing circuit 46. This endoscopic image is supplied to the observation monitor 60 via the video signal switching circuit 47 and the D / A conversion circuit 48 and displayed.

  Here, for example, it is assumed that the ultrasonic observation recording mode is designated by the recording setting information stored in the storage unit 52.

(Recording control in ultrasonic observation recording mode)
Display example 91 in FIG. 7A is an example of image display in the endoscope observation mode, and shows a display on display screen 60a of observation monitor 60 in the display mode in which only the endoscope image is displayed alone. An endoscopic image 72 imaged by the imaging unit 23 is displayed in the endoscopic image display area on the display screen 60a. A patient information display 73 is displayed in a part of the display area of the display screen 60a.

  Here, for example, it is assumed that the operator performs an operation of changing the display mode, and designates display in the PIP method in which the endoscopic image is a parent image and the external image is a child image. An external image input via the external input terminal 53 is input to the video processing circuit 50, and predetermined video signal processing is performed in the video processing circuit 50. An external image that can be displayed on the observation monitor 60 is output by the video processing circuit 50. This external image is supplied to the video signal switching circuit 47. Thus, the endoscopic image from the image processing circuit 46 and the external image from the video processing circuit 50 are input to the video signal switching circuit 47, and the control unit 41 controls the display controller 49, These images are displayed as parent-child images. In this way, a composite display of the PIP method with the endoscope image as the parent image and the external image as the child image is displayed. FIG. 7B shows a display example 92 in this case. On the display screen 60a of the observation monitor 60, the parent image 72p of the endoscopic image is displayed in the parent image display area and the external image is displayed in the child image display area. The child image 74c is displayed.

  Here, it is assumed that the operator operates the release button of the recording operation unit 25a of the ultrasonic endoscope 20, for example. The control unit 41 determines whether or not a release operation is performed in step S1 of FIG. When the release button is operated, the control unit 41 determines the current observation mode in step S2. When the observation mode is the endoscope observation mode, the control unit 41 proceeds to step S3 and determines whether or not the display recording mode is set. That is, the control unit 41 reads the recording setting information stored in the storage unit 52 and determines whether the recording mode is the display-compatible recording mode or the ultrasonic observation recording mode.

  Since the ultrasonic observation recording mode is set now, the control unit 41 shifts the processing from step S3 to step S4 to create an endoscope image file. That is, the control unit 41 controls the encoding circuit 51 to encode the output of the image processing circuit 46 in a predetermined format. The control unit 41 gives the endoscope image (still image) after the encoding process to the recording unit 65 for recording (step S5). Further, in step S6, the control unit 41 converts the external image into a file. That is, the control unit 41 controls the encoding circuit 51 to encode the output of the video processing circuit 50 in a predetermined format. The control unit 41 gives the external image (still image) after the encoding process to the recording unit 65 for recording (step S7).

  Further, the control unit 41 outputs the endoscopic image (still image) and the external image (still image) after the encoding process to the recording device 80 or the like via the connector 54. Thus, the recording device 80 records the endoscope image and the external image.

  Note that the processing in steps S <b> 6 to S <b> 8 is executed regardless of whether the ultrasonic observation apparatus 70 is connected to the external input terminal 53. Therefore, when an external image from an external device is input to the external input terminal 53, the external image is recorded. However, when the ultrasonic observation apparatus 70 is connected to the external input terminal 53. In the endoscope observation mode, since an ultrasonic image is not input, the recorded image becomes an invalid image.

  Here, it is assumed that the operator switches the observation mode from the endoscope observation mode to the ultrasonic observation mode. The control unit 41 controls the ultrasonic transducer unit 71 to perform ultrasonic observation. The ultrasonic signal from the ultrasonic transducer unit 71 is supplied to the ultrasonic observation device 70 to obtain an ultrasonic image. This ultrasonic image is supplied to the video processing circuit 50 via the external input terminal 53. Thus, in this case, the display of FIG. 7C or 7D is performed according to the display mode set by the operator.

  FIG. 7C shows a display mode in which an ultrasonic image is displayed alone without displaying an endoscopic image. The display controller 49 is controlled by the control unit 41 to control the video signal switching circuit 47 so that the ultrasonic image from the video processing circuit 50 is displayed over the entire area of the display screen 60a. Thus, as shown in the display example 93 in FIG. 7C, the ultrasonic image 74 is displayed on the entire area of the display screen 60a of the observation monitor 60.

  FIG. 7D shows a PIP display mode in which an ultrasonic image is displayed as a parent image and an endoscopic image is displayed as a child image. That is, the display controller 49 controls the video signal switching circuit 47 so that the ultrasonic image from the video processing circuit 50 is a parent image and the endoscopic image from the image processing circuit 46 is a child image. In this way, a composite display of the PIP method with the ultrasonic image as the parent image and the endoscopic image as the child image is displayed. FIG. 7D shows a display example 94 in this case. On the display screen 60a of the observation monitor 60, the parent image 74p of the ultrasonic image is displayed in the parent image display area and the endoscope is displayed in the child image display area. A child image 72c of the image is displayed.

  Here, it is assumed that the surgeon operates the release button. In this ultrasonic observation mode, the endoscopic image is not necessary for recording, and the control unit 41 proceeds from step S2 to step S11, and in steps S11 to S13, the still image of the ultrasonic image is displayed. Perform the recording process. The control unit 41 creates a file of the ultrasound image in step S11. That is, the control unit 41 controls the encoding circuit 51 to encode the output of the video processing circuit 50 in a predetermined format. Next, the control unit 41 gives the ultrasonic image (still image) after the encoding process to the recording unit 65 for recording (step S12). Further, in step S13, the control unit 41 outputs the encoded ultrasonic image (still image) to the recording device 80 or the like via the connector 54. In this way, an ultrasonic image is recorded in the recording unit 65 and the recording device 80.

(Recording control in display-compatible recording mode)
As described above, in the ultrasound observation recording mode, when the ultrasound observation apparatus 70 is connected to the external input terminal 53, the ultrasound observation is not performed in the endoscope observation mode, although it is not performed. Control is performed to record an ultrasonic image. That is, although an ultrasonic image is not displayed on the observation monitor 60, an invalid image is recorded. Therefore, in this case, it is possible to prevent invalid recording by setting the display-corresponding recording mode. However, in the display-corresponding recording mode, even when an external image from an external device is input to the external input terminal 53, the external image is not recorded. Therefore, the control unit 41 can also control the switching of the recording mode according to the flow of FIG.

  The control unit 41 determines whether or not an operation for changing the setting to the display-compatible recording mode has occurred in step S31. When the surgeon performs a setting change operation from the ultrasonic observation recording mode to the display-corresponding recording mode, the control unit 41 communicates with the ultrasonic observation device 70 in step S32, and the ultrasonic observation device 70 is externally connected. It is determined whether or not an ultrasonic image is input to the external input terminal 53 by being connected to the input terminal 53. The control unit 41 permits the change to the display-corresponding recording mode when an ultrasonic image is input to the external input terminal 53 (step S33), and otherwise does not permit the mode change (step S34).

  The control unit 41 may omit the flow of FIG. 5 and always allow the operator to change the recording mode.

  In the display-corresponding recording mode, the recording control in the ultrasonic observation mode is the same as in the ultrasonic observation recording mode. That is, in this case, only the still image of the ultrasonic image is recorded in steps S11 to S13.

  Assume that the endoscope observation mode is designated and the operator operates the release button. In this case, the control unit 41 proceeds from step S3 to step S21. In step S21, the control unit 41 instructs to file an endoscopic image. That is, the control unit 41 controls the encoding circuit 51 to encode the output of the image processing circuit 46 in a predetermined format. The control unit 41 gives the endoscopic image (still image) after the encoding process to the recording unit 65 for recording (step S22). Furthermore, the control unit 41 outputs the endoscopic image (still image) after the encoding process to the recording device 80 or the like via the connector 54. In this way, an endoscope image is recorded in the recording device 80.

  As described above, in the endoscopic observation mode in which only the endoscopic image is displayed without displaying the ultrasonic image, even if the ultrasonic observation apparatus is connected to the external input terminal 53, the invalid ultrasonic wave is displayed. Only an endoscopic image is recorded without recording an image. That is, in the display corresponding recording mode, recording corresponding to the display mode is performed.

  As described above, in this embodiment, the ultrasonic observation recording mode can be set and the display-corresponding recording mode can be set, and image recording corresponding to the display mode can be performed. For example, in the ultrasound observation, in the endoscope observation mode in which only the endoscope image is displayed, only the still image of the endoscope image is recorded, and the endoscope image necessary for recording is not displayed and the ultrasound image is displayed. Only the still image of the ultrasonic image is recorded in the displayed ultrasonic observation mode. In this way, it is possible to record an image useful for the user.

  Note that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

    DESCRIPTION OF SYMBOLS 1 ... Endoscope apparatus, 20 ... Ultrasound endoscope, 23 ... Imaging part, 25a ... Recording operation part, 27, 42, 54 ... Connector, 30 ... Light source device, 40 ... Video processor, 41 ... Control part, 46 Image processing circuit 47 Image signal switching circuit 49 Display controller 50 Image processing circuit 51 Encoding circuit 53 External input terminal 60 Observation monitor 65 Recording unit 66 Keyboard 70 Ultrasonic observation apparatus, 71 ... ultrasonic transducer part, 80 ... recording equipment.

Claims (5)

A first processing unit that receives an endoscopic image from an endoscope including an image sensor and generates an image for display;
A second processing unit that receives the ultrasonic image from an ultrasonic observation device that generates an ultrasonic image based on an ultrasonic signal from the ultrasonic transducer and generates an image for display;
A display control unit that enables display in a plurality of display modes for displaying the endoscopic image and the ultrasonic image from the first and second processing units individually or in combination, and
A recorded image generating unit capable of generating a first still image for recording based on the endoscopic image and a second still image for recording based on the ultrasonic image;
A control unit that performs recording control in a first recording mode that records an image according to setting of a display mode by the display control unit among the first and second still images;
An endoscope apparatus characterized by comprising: The control unit is capable of recording control in a second recording mode for recording both the first and second still images.
The endoscope apparatus according to claim 1, wherein the first recording mode and the second recording mode are selected based on recording setting information. The endoscope apparatus according to claim 2, wherein the control unit stores the recording setting information in a storage unit based on a user operation. The control unit does not permit a change from the second recording mode to the first recording mode when the ultrasonic image is not input to the second processing unit. The endoscope apparatus according to 3. The ultrasonic transducer;
The endoscope;
The ultrasonic observation apparatus;
The endoscope apparatus according to claim 1,
An endoscope system comprising:

Images