JP2009219547A - Medical image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a medical image processor that produces suitable synthetic images according to the situations in an endoscopic observation. <P>SOLUTION: The medical image processor is connected with both of an endoscope and a plurality of other image input devices other than the endoscope at once. This processor also produces a first image based on the imaging signal of a subject imaged by the endoscope and a second image based on the image signal output from at least one of the plurality of other image input devices. This medical image processor includes an image signal input section to receive input image signals, an image synthesizing section to combine the first and second images, a priority order setting section to set the priority order of images to be synthesized as a second image, and a control section to selectively output one of the image signals from among image signals input to the image signal input section based on the connecting condition and priority order of the plurality of image input devices. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a medical image processing apparatus, and more particularly to a medical image processing apparatus capable of simultaneously connecting an endoscope and a plurality of image input devices other than the endoscope.

  Endoscope systems configured to include an endoscope, a medical image processing apparatus, and the like have been widely used in the medical field, the industrial field, and the like. In addition, in the medical field, for example, an endoscope system is used when performing observation and various treatments on a living tissue or the like.

  In the above-described endoscope system, a printer that captures an observation image acquired by an endoscope and outputs it as a capture image, and an endoscope that generates and outputs an insertion shape image of an insertion portion of the endoscope. Peripheral devices (external devices) such as a mirror insertion shape detection device can be used together.

Further, the above-described endoscope system has a configuration for synthesizing and outputting a plurality of input images such as observation images acquired by an endoscope as PinP (picture-in-picture) images. It is possible to apply the technique described in.
Japanese Patent Laid-Open No. 7-154687

  For example, when an endoscope system and a peripheral device are used together, it is desirable that an appropriate PinP image corresponding to a device set as an image input source is generated. However, when the technique described in Patent Document 1 is applied, the user must set the image to be displayed on the main screen and the image to be displayed on the sub screen as needed while manually switching the switch. When the technique described in Patent Document 1 is applied to endoscopic observation performed using various peripheral devices, an operation of manually switching the images displayed on the main screen and the sub screen according to the observation state is performed. There is a problem that it occurs frequently and as a result places an excessive burden on the user.

  The present invention has been made in view of the above-described circumstances, and when performing endoscopic observation while using various peripheral devices, it is possible to generate a medical composite image appropriate for the observation situation. An object of the present invention is to provide an image processing apparatus.

  The medical image processing apparatus according to the present invention can simultaneously connect an endoscope having an insertion portion shaped to be inserted into a body cavity and a plurality of image input devices other than the endoscope. Image processing for generating a first image based on an imaging signal of an image of a subject imaged by a mirror and a second image based on an image signal output from at least one of the plurality of image input devices In the medical image processing apparatus including the image processing unit, an image signal input unit to which the image signal is input, and an image synthesis unit that synthesizes the first image and the second image generated by the image processing unit And a priority order setting unit that sets a priority order of images to be combined as the second image, a connection state of the plurality of image input devices, and a priority order set in the priority order setting unit, The picture A control unit that performs control for selectively outputting one image signal corresponding to the image synthesized as the second image among the image signals input to the signal input unit. And

  According to the medical image processing apparatus of the present invention, when endoscopic observation is performed using various peripheral devices, it is possible to generate an appropriate composite image according to the observation situation.

  Embodiments of the present invention will be described below with reference to the drawings.

  1 to 9 relate to an embodiment of the present invention. FIG. 1 is a diagram illustrating an example of a configuration of a main part of a medical system in which a medical image processing apparatus according to an embodiment of the present invention is used. FIG. 2 is a diagram showing an example of a setting screen in the processor of FIG. FIG. 3 is a diagram showing an example of the setting screen in the processor of FIG. 1 different from FIG. FIG. 4 is a flowchart showing an example of processing and control performed in the processor of FIG. FIG. 5 is a diagram illustrating an example of a composite image displayed on the monitor by performing processing and control according to the flowchart of FIG. 4. FIG. 6 is a diagram showing an example different from FIG. 5 of the composite image displayed on the monitor by performing the processing and control according to the flowchart of FIG. FIG. 7 is a diagram illustrating an example different from FIGS. 5 and 6 of the composite image displayed on the monitor by performing the processing and control according to the flowchart of FIG. 4. FIG. 8 is a diagram illustrating an example different from FIGS. 5, 6, and 7 of the composite image displayed on the monitor by performing the processing and control according to the flowchart of FIG. 4. FIG. 9 is a flowchart showing an example different from FIG. 4 of the processing and control performed in the processor of FIG.

  As shown in FIG. 1, the medical system 1 captures an image of a subject existing in a body cavity of a subject, converts the image into an imaging signal, and outputs the image. The imaging signal from the endoscope 2 3 that converts the video signal into a video signal and outputs the endoscope 3, the endoscope insertion shape detection device 4 having a configuration capable of detecting the insertion shape of the endoscope 2, and the processor 3 according to the user's operation. An operation instruction unit 5 that can output an instruction signal and can perform input operations on various setting screens, an external device group 6, an image input device 7a, and an image input device 7b are necessary. The part is composed.

  The external device group 6, the image input device 7a, and the image input device 7b can be connected to the processor 3 simultaneously with the endoscope 2. Further, the image input devices 7 a and 7 b generate an image relating to a subject to be observed by the endoscope 2 as observation image data (observation image signal), and can output the observation image data to the processor 3. It is configured as.

  The endoscope 2 has, as a shape that can be inserted into a body cavity of a subject, for example, an insertion portion 21 having an elongated shape, an operation portion 22 connected to the proximal end side of the insertion portion 21, and an operation portion 22 as a processor. 3 (the front surface side) of FIG. 3 and a cable 23 incorporating various signal lines for electrical connection. Further, the insertion unit 21 has an imaging unit 21a capable of imaging a subject on the distal end side. Furthermore, the operation unit 22 has a scope switch group 22a on the exterior surface that includes a plurality of switches that can perform input operations on various setting screens and output various instruction signals to the processor 3 in accordance with user operations. ing.

  The imaging unit 21 a includes an objective optical system and an imaging element that is driven according to a drive signal from the processor 3. Then, the imaging unit 21a captures an image of a subject in the field of view of the objective optical system in the imaging element, and outputs the captured image to the processor 3 as an imaging signal.

  The endoscope insertion shape detection device 4 detects the shape of the subject by detecting the shape of the probe 41 that can be inserted into a treatment instrument channel (not shown) of the endoscope 2 and the probe 41 inserted into the endoscope 2. An endoscope insertion shape detection device main body 42 capable of detecting the insertion shape (of the insertion portion 21) of the endoscope 2 inserted into the body cavity is configured.

  The probe 41 has an elongated shape (according to the shape of the insertion portion 21 of the endoscope 2) and has a predetermined interval in the longitudinal axis direction from the proximal end portion to the distal end portion. A plurality of coils (not shown) are arranged inside.

  The endoscope insertion shape detection device main body 42 generates a magnetic field in each of the plurality of coils (not shown) by driving a plurality of coils (not shown) arranged inside the probe 41 based on the control of the processor 3. The endoscope insertion shape detection device main body 42 receives the magnetic field emitted from each of the plurality of coils (not shown) at the antenna unit 42a, and based on the received result, the treatment instrument channel (not shown) of the endoscope 2 The shape of the probe 41 inserted inside is detected. Further, the endoscope insertion shape detection device main body 42 outputs insertion shape data (insertion shape image signal) corresponding to the detection result of the shape of the probe 41 to the processor 3. In the present embodiment, it is assumed that the insertion shape data is input from the back side of the processor 3.

  The antenna unit 42a is configured to have a plurality of coils (not shown), for example, as a configuration that can receive a magnetic field emitted from the probe 41.

  The processor 3 includes a drive signal output unit 31, a preprocessing unit 32, image processing units 33s and 33h, image synthesis units 34s and 34h, post processing units 35s and 35h, a selector 37, and an image storage unit 38. The CPU 39 includes a memory 39a and a CPU 39 that controls each part of the processor 3 and functions as a priority order setting unit and a control unit.

  The drive signal output unit 31 outputs a drive signal for driving the imaging element included in the imaging unit 21 a based on the control of the CPU 39.

  The preprocessing unit 32 performs each process such as an amplification process and an A / D conversion process on the imaging signal output from the imaging unit 21a, and outputs the processed imaging signal to the image processing units 33s and 33h. Output.

  Based on the control of the CPU 39, the selector 37 having a function as an image signal input unit and the insertion shape data output from the endoscope insertion shape detection device main body 42 and the captured image read from the memory 64a built in the printer 64 are displayed. Data (capture image signal) and observation image data output from the image input devices 7a and 7b are selectively output to the image storage unit 38.

  It is assumed that the observation image data from the image input devices 7a and 7b is input to the selector 37 as a digital signal converted by an A / D converter (not shown).

  The image storage unit 38 sequentially outputs each data (each image signal) selectively output from the selector 37 to the image processing unit 33s (or 33h) while temporarily storing the data. In addition, the image storage unit 38 having a function as a timing control unit has a timing at which an imaging signal output from the preprocessing unit 32 is input to the image processing unit 33 s (or 33 h) and each data output from the selector 37. Is controlled to appropriately adjust the input timing to the image processing unit 33s (or 33h).

  Specifically, the image accumulating unit 38 has a first timing when the imaging signal output from the preprocessing unit 32 is input to the image processing unit 33s (or 33h) and each data output from the selector 37 is an image. While monitoring the second timing input to the processing unit 33s (or 33h), it is detected that the time interval between the first timing and the second timing is a period of ± 3 lines. In this case, the output (writing) of each data output from the selector 37 to the image processing unit 33s (or 33h) is temporarily prohibited. Thereby, the method of the imaging signal output from the preprocessing unit 32 and the method of each data output from the selector 37 are different (for example, one is the NTSC method and the other is the PAL method). In addition, the first timing and the second timing are appropriately synchronized.

  By the way, the processor 3 of the present embodiment generates a processing system for generating an SDTV (Standard Definition TeleVision) system image as a standard image and an HDTV (High Definition TeleVision) system image as a high-quality image. The processing system for this purpose has two processing systems in parallel.

  In the processor 3, a processing system for generating an SDTV image includes an image processing unit 33 s, an image composition unit 34 s, and a post-processing unit 35 s.

  Based on the control of the CPU 39, the image processing unit 33s generates a first image from the imaging signal output from the preprocessing unit 32, generates a second image from the data read from the image storage unit 38, and generates the second image. Each image is subjected to image processing such as noise reduction processing, enlargement / reduction processing, edge enhancement processing, and contrast adjustment processing, and then output to the image composition unit 34s.

  Based on the control of the CPU 39, the image composition unit 34s synthesizes the images output from the image processing unit 33s, thereby generating a composite image having a size conforming to the SDTV system and outputting the composite image to the post-processing unit 35s.

  The post-processing unit 35 s performs each process such as a level adjustment process and a D / A conversion process on the composite image output from the image composition unit 34 s, and outputs the composite image after each process to the SDTV monitor 61. The data is output to the VTR 63 and the printer 64.

  In the processor 3, a processing system for generating an HDTV image includes an image processing unit 33h, an image composition unit 34h, and a post-processing unit 35h.

  Based on the control of the CPU 39, the image processing unit 33h generates a first image from the imaging signal output from the preprocessing unit 32, generates a second image from the data read from the image storage unit 38, and generates the second image. Each image is subjected to image processing such as noise reduction processing, enlargement / reduction processing, edge enhancement processing, and contrast adjustment processing, and then output to the image composition unit 34s.

  Based on the control of the CPU 39, the image composition unit 34h composes each image output from the image processing unit 33h to generate a composite image having a size conforming to the HDTV system and outputs the composite image to the post-processing unit 35h.

  The post-processing unit 35h performs various processes such as a level adjustment process and a D / A conversion process on the synthesized image output from the image synthesizing unit 34h, and displays the synthesized image after each process on the HDTV monitor 62. The data is output to the VTR 63 and the printer 64.

  The operation instruction unit 5 is composed of various input devices such as a keyboard, for example, and according to user operations, for example, a release instruction, a capture instruction to a printer, a recording instruction to a VTR, and an endoscope insertion shape detection device 4 Various instruction signals related to on / off instructions and the like can be output. In the present embodiment, the various instruction signals related to the capture instruction to the printer, the recording instruction to the VTR, the on / off instruction of the endoscope insertion shape detection device 4 and the like are not limited to only from the operation instruction unit 5. Suppose that it can also be output from the scope switch group 22a.

  The external device group 6 includes an SDTV monitor 61 for displaying an image corresponding to the SDTV system, an HDTV monitor 62 for displaying an image corresponding to the HDTV system, a VTR 63 capable of recording a moving image output from the processor 3, Each apparatus includes a printer 64 capable of capturing a still image output from the processor 3.

  For example, the printer 64 captures a still image (an image to be captured) acquired every time a release instruction is performed in the operation instruction unit 5 (or one of the switches included in the scope switch group 22a). A memory 64a capable of storing data is incorporated.

  Each of the devices included in the external device group 6 is an example of a device that can be set as an output destination of an image from the processor 3 and can be simultaneously connected to the back side of the processor 3. It is assumed that this is an example.

  Next, the operation of the medical system 1 will be described.

  First, the user connects each part of the medical system 1 and turns on the power of each part, thereby transitioning each part to the initial state. In the following description, the insertion shape data is not processed until the instruction signal for turning on the endoscope insertion shape detection device 4 is output to the CPU 39 immediately after each section transitions to the initial state. 3 is not output.

  Next, the user operates the operation instruction unit 5 (or any one of the switches included in the scope switch group 22a) to output an instruction signal for calling the setting screen of the processor 3.

  The CPU 39 generates a setting screen of the processor 3 based on an instruction signal from the operation instruction unit 5 (or the scope switch group 22a) and outputs the generated setting screen to any one of the SDTV monitor 61 and the HDTV monitor 62. Such control is performed on the image processing unit 33s (image processing unit 33h) and the like. Thereby, for example, a setting screen as shown in FIG. 2 is displayed on either one of the SDTV monitor 61 and the HDTV monitor 62.

  Then, the user performs an input operation on the operation instruction unit 5 (or the scope switch group 22a), and an input source of an image that is a material of a sub screen of the composite image and an output method of the composite image on the setting screen illustrated in FIG. Set the priority of the combination. Specifically, the priority order may be set as a state in which a connection location of an input source (such as a device) of an image that is a material of a composite image child screen and a composite image output method are combined. it can.

  Then, in a state where each part of the medical system 1 is connected, a setting for setting the highest priority of “rear side / HDTV” (setting for priority “1”) as shown in FIG. 2 is made. The CPU 39 controls the selector 37 to output observation image data from the image input device 7a connected to the back side of the processor 3 to the image storage unit 38 as control based on the setting of “back side / HDTV”. In addition, control for generating a composite image by the HDTV system is performed on the image processing unit 33h and the image composition unit 34h. In addition, when the priority of “back side / HDTV” is set to be the highest, the CPU 39 performs control for preventing the generation of a composite image by the SDTV method in addition to the above-described controls. And the image composition unit 34s. Therefore, when the highest priority is set for “rear side / HDTV”, for example, an image corresponding to the image of the subject imaged by the endoscope 2 is used as the main screen and image input. An HDTV composite image in which an image corresponding to the observation image data output from the device 7 a is combined as a child screen is output to the HDTV monitor 62.

  The priorities described above are applied according to the connection status of each of the SDTV monitor 61, the HDTV monitor 62, the image input device 7a, and the image input device 7b.

  For example, when the setting as shown in FIG. 2 is made and the image input device 7a is not connected to the processor 3, it has a priority lower than “back side / HDTV” ( The “front side / SDTV” setting (set as priority “2”) is valid. At this time, the CPU 39 controls the selector 37 to output the observation image data from the image input device 7b connected to the front side of the processor 3 to the image storage unit 38, and also displays a composite image by the SDTV system. Control for generation is performed on the image processing unit 33s and the image composition unit 34s. When the setting of “front side / SDTV” is valid, the CPU 39 controls the image processing unit 33h and the image combining unit 34h so as not to generate a composite image by the HDTV system in addition to the above-described controls. To do. Therefore, when the setting of “front side / SDTV” is valid, for example, an image corresponding to the image of the subject imaged by the endoscope 2 is output as the main screen and from the image input device 7b. An SDTV composite image in which an image corresponding to the observed image data is combined as a sub-screen is output to the SDTV monitor 61.

  Further, for example, when the setting as shown in FIG. 2 is made and the image input device 7b and the HDTV monitor 62 are not connected to the processor 3, one below “front side / SDTV”. “Back side / SDTV” setting (set as priority “3”) is effective. At this time, the CPU 39 controls the selector 37 to output the observation image data from the image input device 7a connected to the back side of the processor 3 to the image storage unit 38, and displays a composite image by the SDTV system. Control for generation is performed on the image processing unit 33s and the image composition unit 34s. When the setting of “back side / SDTV” is valid, the CPU 39 performs control for preventing the generation of a composite image by the HDTV system in addition to the above-described controls. To do. Therefore, when the setting of “back side / SDTV” is valid, for example, an image corresponding to the image of the subject imaged by the endoscope 2 is output as the main screen and from the image input device 7a. An SDTV composite image in which an image corresponding to the observed image data is combined as a sub-screen is output to the SDTV monitor 61.

  Further, for example, when the setting as shown in FIG. 2 is made and the image input device 7a and the SDTV monitor 61 are not connected to the processor 3, one lower side of “rear side / SDTV”. The “front side / HDTV” setting (set as priority “4”) having the following priority is valid. At this time, the CPU 39 controls the selector 37 to output observation image data from the image input device 7b connected to the back side of the processor 3 to the image storage unit 38, and displays a composite image by the HDTV system. Control for generation is performed on the image processing unit 33h and the image composition unit 34h. In addition, when the setting of “front side / HDTV” is valid, the CPU 39 controls the image processing unit 33 s and the image synthesis unit 34 s to prevent the generation of a composite image by the SDTV method in addition to each control described above. To do. Therefore, when the setting of “front side / HDTV” is valid, for example, an image corresponding to the image of the subject imaged by the endoscope 2 is output from the image input device 7b as the main screen. An HDTV composite image in which an image corresponding to the observed image data is combined as a child screen is output to the HDTV monitor 62.

  On the other hand, after the setting on the setting screen shown in FIG. 2, the user performs synthesis when various instruction signals are input on the setting screen shown in FIG. 3 by an input operation on the operation instruction unit 5 (or the scope switch group 22a). Set the image output method.

  The setting contents shown in FIG. 2 are applied when the instruction signal related to the capture instruction and the instruction signal related to the recording instruction to the VTR are not input to the CPU 39 and the endoscope insertion shape detection device 4 is off. It is what is done. Therefore, the CPU 39 is either when the instruction signal related to the capture instruction is input, when the instruction signal related to the recording instruction to the VTR is input, or when the endoscope insertion shape detection device 4 is on. In FIG. 3, the control based on the setting contents shown in FIG. 3 is preferentially performed regardless of the setting contents shown in FIG.

  Since the printer 64 is connected to the back side of the processor 3, the user selects “back side” from the “input source” item in the “capture instruction” field. Further, the user inputs the number of images to be simultaneously output on one sheet of paper (the setting value of the item “number”) as a desired number, and sets the item “output method” (SDTV method or HDTV). Set the desired output method (one of the methods).

  Note that the number of images to be simultaneously output on one page of paper in the “capture instruction” field of FIG. 3 (the setting value of the item “number of sheets”) is determined by a signal output from the CPU 39 via the selector 37 (for example, ) It is also reflected to the printer 64. Accordingly, it is assumed that the number of captured image data corresponding to the setting in the “capture instruction” field is stored in the memory 64a.

  In addition, since the endoscope insertion shape detection device main body 42 is connected to the back side of the processor 3, the user selects “back side” from the “input source” item in the “endoscope insertion shape detection device ON” column. ”And the item“ output system ”is set to a desired output system (either SDTV system or HDTV system).

  In addition, the user sets an image displayed on the sub-screen at the time of recording as an image based on the observation image data output from the image input device 7b, from the “input source” item in the “recording instruction” field. In addition to selecting “front side”, the item “output system” is set to a desired output system (either SDTV system or HDTV system).

  When the CPU 39 detects the input of two or more instruction signals at the same time in the setting screen setting shown in FIG. 3, the setting of the “capture instruction” column is most preferentially effective, and “the endoscope insertion shape detection device” The setting in the “On” field is prioritized and validated. Further, when the instruction signal related to the capture instruction is not input, the endoscope insertion shape detection device 4 is off, and the instruction signal related to the recording instruction to the VTR is input, the “recording instruction” The setting in the "" column is valid. Then, the CPU 39 performs control related to the generation of the sub-screen image in accordance with the valid setting contents.

  Note that the priority order for enabling the setting on the setting screen shown in FIG. 3 is not limited to the above-described priority order, and for example, the user may be able to change the priority order to a desired priority order.

  Further, the CPU 39 stores the setting contents made on the setting screens shown in FIGS. 2 and 3 in the memory 39a, and performs control while referring to the setting contents stored in the memory 39a as appropriate.

  On the other hand, after the setting of each item on the setting screen shown in FIGS. 2 and 3 is completed, the user inserts the insertion unit 21 into the body cavity of the subject and causes the imaging unit 21a to capture an image of a desired subject. . As a result, an image pickup signal of the desired subject image is output to the image processing units 33 s and 33 h via the preprocessing unit 32.

  The CPU 39 stores the instruction signal related to the capture instruction and the instruction signal related to the recording instruction to the VTR, and is stored in the memory 39a when the endoscope insertion shape detection device 4 is off, as shown in FIG. Control based on the settings made on the setting screen. Thereby, an HDTV system in which an image according to the image of the subject imaged by the endoscope 2 is combined as a parent screen and an image according to the observation image data output from the image input device 7a is combined as a child screen. Are output to the HDTV monitor 62.

  On the other hand, when the CPU 39 detects an input of an instruction signal related to an instruction for turning on the endoscope insertion shape detecting device 4 according to an instruction in the operation instruction unit 5 (or the scope switch group 22a), the endoscope insertion is performed. Each part of the shape detection device 4 is changed from the off state to the on state (step S1 in FIG. 4). Thus, the insertion shape data corresponding to the detection result of the shape of the probe 41 is generated in the endoscope insertion shape detection device main body 42 and the insertion shape data is input to the selector 37.

  The CPU 39 validates the setting of the “endoscope insertion shape detection device ON” column in the setting screen shown in FIG. 3 by referring to the setting contents stored in the memory 39a. Then, based on the setting, the CPU 39 performs control for generating a child screen image having a predetermined image size according to the insertion shape data (step S2 in FIG. 4). For the sake of simplicity of explanation, hereinafter, a case where a composite image is output by the SDTV system will be mainly described.

  Further, the CPU 39 uses an image of a desired subject image (hereinafter referred to as an endoscope observation image) corresponding to the imaging signal as a main screen, and an image corresponding to the insertion shape data (hereinafter referred to as an endoscope insertion shape image). Control for generating a composite image having a sub-screen as a child screen is performed on the image composition unit 34s (step S3 in FIG. 4). Then, the synthesized image generated by the image synthesizing unit 34s is displayed on the screen of the SDTV monitor 61 via the post-processing unit 35s. Note that the composite image displayed on the screen of the SDTV monitor 61 immediately after the process of step S3 in FIG. 4 is as shown in FIG. 5, for example.

  Thereafter, the CPU 39 continues to output the composite image generated by the process of step S3 in FIG. 4 until an instruction signal related to the capture instruction is input (step S4 in FIG. 4).

  When an instruction signal related to a capture instruction is output in accordance with an instruction from the operation instruction unit 5 (or the scope switch group 22a), the printer 64 causes the number of sheets corresponding to the set value of the “number of sheets” item in the “capture instruction” field. Is output to the selector 37.

  On the other hand, when the CPU 39 detects that the instruction signal related to the capture instruction is input, the CPU 39 outputs the captured image data input to the selector 37 to the image processing unit 33s via the image storage unit 38, and then the memory 39a. 4 is discriminated whether the set value of the “number of sheets” item in the “capture instruction” field is 1 (step S5 in FIG. 4).

  When the CPU 39 detects that the setting value of the “number of sheets” item in the “capture instruction” field is one, the image size of the child screen is the same as the predetermined image size described above. While setting the first image size, control is performed to generate an image of a small screen corresponding to the captured image data (step S6 and step S8 in FIG. 4).

  Thereafter, the CPU 39 newly generates a composite image having the endoscopic observation image corresponding to the imaging signal as a parent screen and the image corresponding to the captured image data (hereinafter referred to as a capture preview image) as a child screen. The control is performed on the image composition unit 34s (step S9 in FIG. 4). Then, the composite image generated by the image composition unit 34s is output to the SDTV monitor 61 via the post-processing unit 35s. In addition, when passing through step S6 and step S8 of FIG. 4, the capture preview image displayed as the sub-screen of the composite image is, for example, that one image is output on one page of paper as shown in FIG. Will be shown.

  On the other hand, when the CPU 39 detects that the setting value of the “number of sheets” item in the “capture instruction” field is not 1, the second image size is larger than the predetermined image size described above. While setting the image size, control is performed to generate a small-screen image corresponding to the captured image data (steps S7 and S8 in FIG. 4). The second image size may be a fixed size, or may be appropriately determined according to the set value of the “number of sheets” item in the “capture instruction” field.

  Thereafter, the CPU 39 controls the image composition unit 34s to newly generate a composite image having the endoscope observation image corresponding to the imaging signal as the parent screen and the capture preview image as the child screen (FIG. 4). Step S9). Then, the composite image generated by the image composition unit 34s is output to the SDTV monitor 61 via the post-processing unit 35s. Note that when the steps S7 and S8 in FIG. 4 are performed, the capture preview image displayed as the sub-screen of the composite image is output as four images simultaneously on one page of paper as shown in FIG. 7, for example. It will show that.

  The CPU 39 operates a timer (not shown) built in itself at a timing immediately after performing the process of step S9 in FIG. 4 (step S10 in FIG. 4), and a predetermined period (for example, several seconds) set in advance. Until the time elapses, the output of the composite image generated by the process of step S9 in FIG. 4 is continued (step S11 in FIG. 4). That is, when the CPU 39 detects that the instruction signal related to the capture instruction is output from the operation instruction unit 5 (or the scope switch group 22a), the CPU 39 uses the captured image data from the printer 64 as an image (via the selector 37 or the like). Control is performed to cause the combining unit 34s to output only for a predetermined period.

  When the above-described predetermined period has elapsed, the CPU 39 performs control for generating an endoscope insertion shape image having a predetermined image size as a child screen image instead of the capture preview image (step in FIG. 4). After S12), control is performed on the image composition unit 34s to generate a composite image using the endoscope observation image corresponding to the imaging signal as the parent screen and the endoscope insertion shape image as the child screen (FIG. 4 step S13). Note that the composite image displayed on the screen of the SDTV monitor 61 immediately after the process of step S13 in FIG. 4 is displayed on the screen of the SDTV monitor 61 immediately after the process of step S3 in FIG. 4 is performed. This is an image similar to the synthesized image, and is as shown in FIG. 5, for example.

  If the setting for outputting the composite image by the HDTV system has been made, the CPU 39 uses, for example, the endoscope observation image corresponding to the imaging signal as the main screen in the process shown in step S9 in FIG. Control for generating a composite image as shown in FIG. 8 using both the endoscope insertion shape image and the capture preview image as a child screen may be performed (for the image composition unit 34h). .

  The series of processing shown in FIG. 4 is performed in each unit of the processor 3, so that even if the user captures an observation image while using the endoscope insertion shape detection device 4, the user can use the printer 64. It is possible to confirm in advance what kind of image the image output from will be.

  In the series of processes shown in FIG. 4, the size of the capture preview image output as a sub-screen of the composite screen is changed between the case where the number of captured images is one and the case where the number of captured images is other than that. ing. As a result, when a plurality of images are simultaneously output from the printer 64 on one page of paper, the user can easily confirm the appearance of the subject in each of the plurality of images.

  Further, for example, the priority set on the setting screen shown in FIG. 2 is not limited to the one set in advance by the user, but is a digital signal (observation image data) output from the image input devices 7a and 7b. The signal level may be appropriately changed according to the signal level.

  Specifically, when the priority order as shown in FIG. 2 is stored in the memory 39a, the CPU 39 as the signal level detection unit selects the selector based on the setting of “back side / HDTV” having the highest priority order. Among the various signals input to 37, the signal level of the digital signal from the image input devices 7a and 7b is detected, and a comparison is made as to whether or not the signal level is equal to or higher than a predetermined threshold.

  Thereafter, when the signal level of the digital signal from the image input device 7a is equal to or higher than the predetermined threshold, the CPU 39 validates the setting of “back side / HDTV”. Further, when the signal level of the digital signal from the image input device 7a is less than the predetermined threshold value and the signal level of the digital signal from the image input device 7b is equal to or higher than the predetermined threshold value, the CPU 39 The priority of “back side / HDTV” is set to the lowest (priority “4”) and the priority of “front side / SDTV” having the second highest priority is set to the highest (priority) “1”).

  Then, the CPU 39 performs the above-described processing so that an invalid image is displayed or recorded as the signal level of the digital signal output from the image input device set as a relatively high priority is low. Can be avoided as much as possible.

  In the processing described above, the CPU 39 is not limited to changing the priority setting by comparing the signal level of the digital signal (from the image input devices 7a and 7b) input to the selector 37 with a predetermined threshold value. For example, the priority setting may be changed by detecting whether or not a digital signal indicating the blue back state is input to the selector 37 (from the image input device 7a or 7b).

  Further, the CPU 39 is not limited to changing the priority order by the above-described processing. For example, digital signals (observation image data) from each image input device are sequentially input to one decoder IC (not shown) one by one. In addition, a process may be performed in which the signal level of the digital signal input to the decoder IC is compared with a predetermined threshold, and the setting of the priority order according to the comparison result is changed. In this case, it is desirable that the priority order be changed at a timing before the child screen is displayed (for example, immediately before the child screen is displayed).

  Further, the above-described processing performed when the priority order is changed includes the digital signal (observation image data) output from the image input device 7a and the digital signal (observation image data) output from the image input device 7b. For example, capture image data (capture image signal) output from the printer 64 and insertion shape data (insertion shape) output from the endoscope insertion shape detection device main body 42. The present invention can be applied to the priority order between the image signal and the image signal.

  Incidentally, in the observation image data output from the image input device 7a or 7b, there are cases where both the SDTV method and the HDTV method are mixed. When the child screen image is generated based on the observation image data in such a state, a composite image in which the aspect ratio between the child screen image and the parent screen image is different may be output. There is sex. The processor 3 of the present embodiment is a process for adjusting the aspect ratio of the child screen image and the parent screen image to a method equivalent to the output method to the monitor in order to eliminate the possibility as described above. Each process described below may be performed together with a process according to the setting content stored in the memory 39a.

  In the following, for simplicity of explanation, among the data input to the selector 37, an image corresponding to the observation image data output from the image input device 7a or 7b is used as the sub-screen of the composite image. It shall be stated in particular.

  First, the CPU 39 determines whether or not the observation image data is in the HDTV system while referring to the observation image data input to the selector 37 (step S21 in FIG. 9).

  When the CPU 39 detects that the observation image data input to the selector 37 is not in the HDTV format (in the SDTV format), the CPU 39 performs processing in step S27 in FIG. 9 to be described later. If the CPU 39 detects that the observation image data input to the selector 37 is in the HDTV format, the CPU 39 determines whether or not the output format is set as the HDTV format based on the setting contents stored in the memory 39a. Is performed (step S22 in FIG. 9).

  After performing the process of step S22 in FIG. 9, the CPU 39 refers to each setting content stored in the memory 39a. If the setting in which HDTV is selected as the output method is valid, the CPU 39 passes through the image storage unit 38. While maintaining the aspect ratio of the input observation image data, control is performed on the image processing unit 33h to perform reduction processing on the observation image data in accordance with the sub-screen size in the HDTV system image ( Steps S23 and S24 in FIG. 9).

  Then, the CPU 39, based on the imaging signal of the desired subject image output from the image processing unit 33h and the observation image data subjected to the processing according to steps S23 and S24 of FIG. 9 by the image processing unit 33h, Control for generating a composite image using the endoscopic observation image as a parent screen and the image of the observation image data as a child screen is performed on the image composition unit 34h (step S32 in FIG. 9). The composite image generated by the image composition unit 34h is displayed on the screen of the HDTV monitor 62 via the post-processing unit 35h. At this time, it is assumed that an endoscopic observation image is displayed on the SDTV monitor 61 instead of a composite image.

  Further, the CPU 39 refers to each setting content stored in the memory 39a after performing the process of step S22 in FIG. 9, and when the setting in which SDTV is selected as the output method is valid, the image storage unit 38 After converting the aspect ratio of the observation image data input to the image processing unit 33 s to the one conforming to the SDTV system, the observation image data is subjected to a reduction process according to the small screen size in the SDTV image. Control is performed on the image processing unit 33s (steps S25 and S26 in FIG. 9).

  Then, the CPU 39, based on the imaging signal of the desired subject image output from the image processing unit 33s, and the observation image data subjected to the processing according to steps S25 and S26 of FIG. 9 by the image processing unit 33s. Control for generating a composite image using the endoscopic observation image as a parent screen and the image of the observation image data as a child screen is performed on the image composition unit 34s (step S32 in FIG. 9). The composite image generated by the image composition unit 34s is displayed on the screen of the SDTV monitor 61 via the post-processing unit 35s. At this time, it is assumed that an endoscopic observation image is displayed on the HDTV monitor 62 instead of a composite image.

  On the other hand, when the CPU 39 detects that the observation image data input to the selector 37 is the SDTV system by the process of step S21 in FIG. 9, the output system is set to the HDTV format based on the setting contents stored in the memory 39a. Is determined (step S27 in FIG. 9).

  After performing the process of step S27 in FIG. 9, the CPU 39 refers to each setting content stored in the memory 39a. If the setting in which HDTV is selected as the output method is valid, the CPU 39 passes through the image storage unit 38. After converting the aspect ratio of the observation image data input to the image processing unit 33h to the one conforming to the HDTV system, the image processing unit 33h performs a reduction process on the observation image data according to the sub-screen size in the HDTV system image. Control is performed on the image processing unit 33h (steps S28 and S29 in FIG. 9).

  Then, the CPU 39, based on the imaging signal of the desired subject image output from the image processing unit 33h, and the observation image data obtained by performing the processing according to steps S28 and S29 in FIG. 9 by the image processing unit 33h, Control for generating a composite image having the endoscopic observation image as a main screen and the image of the observation image data as a sub screen is performed on the image composition unit 34h (step S32 in FIG. 9). The composite image generated by the image composition unit 34h is displayed on the screen of the HDTV monitor 62 via the post-processing unit 35h. At this time, it is assumed that an endoscopic observation image is displayed on the SDTV monitor 61 instead of a composite image.

  Further, the CPU 39 refers to each setting content stored in the memory 39a after performing the process of step S27 of FIG. 9, and when the setting in which SDTV is selected as the output method is valid, the image storage unit 38 The control for causing the observation image data to be reduced according to the sub-screen size in the SDTV image while maintaining the aspect ratio of the observation image data input to the image processing unit 33s via the image processing. This is performed for the unit 33s (steps S30 and S31 in FIG. 9).

  Then, the CPU 39, based on the imaging signal of the desired subject image output from the image processing unit 33s, and the observation image data obtained by performing the processing according to steps S30 and S31 in FIG. 9 by the image processing unit 33s, Control for generating a composite image using the endoscopic observation image as a parent screen and the image of the observation image data as a child screen is performed on the image composition unit 34s (step S32 in FIG. 9). The composite image generated by the image composition unit 34s is displayed on the screen of the SDTV monitor 61 via the post-processing unit 35s. At this time, it is assumed that an endoscopic observation image is displayed on the HDTV monitor 62 instead of a composite image.

  Of the image processing performed in the image processing units 33 s and 33 h, noise reduction processing, edge enhancement processing, and contrast adjustment processing are data (image signal input to the selector 37) used when generating the sub-screen image. ) May be appropriately changed depending on the type of the image input device that is the input source.

  For example, when either one of the image input devices 7a or 7b is another processor, image data in a state in which noise reduction processing, edge enhancement processing, and contrast adjustment processing are unnecessary (performed in advance) Entered. At this time, the CPU 39 detects that the image data has been input to the selector 37, and performs control such that the noise reduction processing, edge enhancement processing, and contrast adjustment processing are not performed. 33h).

  Further, for example, when either one of the image input devices 7a and 7b is an ultrasonic diagnostic device, ultrasonic image data in a state that requires each of noise reduction processing, edge enhancement processing, and contrast adjustment processing is selected by the selector 37. Is input. At this time, the CPU 39 detects that the ultrasonic image data is input to the selector 37, and causes the ultrasonic image data to be subjected to noise reduction processing, edge enhancement processing, and contrast adjustment processing. The control is performed on the image processing unit 33s (or 33h).

  As described above, the processor 3 according to the present embodiment, when various instruction signals are not input, uses a combination of the input source of the image that is the material of the sub-screen of the composite image and the output method of the composite image. Accordingly, an image of the small screen can be generated. Further, when detecting the input of two or more instruction signals at the same time, the processor 3 according to the present embodiment can generate a sub-screen image of the composite image based on the set priority order. Furthermore, the processor 3 according to the present embodiment sets the size of the capture preview image output as a sub-screen of the composite screen when the printer 64 performs capture to the number of images to be simultaneously output on one page of paper. It can be changed accordingly.

  By having the configuration and operation described above, the processor 3 of the present embodiment generates an appropriate composite image according to the observation situation when performing endoscopic observation using various peripheral devices. be able to.

  Note that the present invention is not limited to the above-described embodiments, and various modifications and applications can be made without departing from the spirit of the invention.

The figure which shows an example of a structure of the principal part of the medical system with which the medical image processing apparatus which concerns on embodiment of this invention is used. The figure which shows an example of the setting screen in the processor of FIG. The figure which shows the example different from FIG. 2 of the setting screen in the processor of FIG. The flowchart which shows an example of the process and control which are performed in the processor of FIG. The figure which shows an example of the synthesized image displayed on a monitor by performing the process and control along the flowchart of FIG. The figure which shows the example different from FIG. 5 of the synthesized image displayed on a monitor by performing the process and control along the flowchart of FIG. The figure which shows the example different from FIG.5 and FIG.6 of the synthesized image displayed on a monitor by performing the process and control along the flowchart of FIG. The figure which shows the example different from FIG.5, FIG.6 and FIG.7 of the synthesized image displayed on a monitor by performing the process and control along the flowchart of FIG. 5 is a flowchart showing an example of processing and control performed in the processor of FIG. 1 different from FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Medical system, 2 ... Endoscope, 3 ... Processor, 4 ... Endoscope insertion shape detection apparatus, 5 ... Operation instruction | indication part, 6 ... External device group, 7a, 7b ... Image input device, 21 ... Insertion unit, 33h, 33s ... Image processing unit, 34h, 34s ... Image composition unit, 37 ... Selector, 38 ... Image storage unit 39 ... CPU, 61 ... SDTV monitor, 62 ... HDTV monitor, 64 ... printer

Claims (16)

An endoscope having an insertion portion that can be inserted into a body cavity and a plurality of image input devices other than the endoscope can be connected simultaneously, and an image of a subject imaged by the endoscope can be captured. A medical image processing apparatus including an image processing unit that generates a first image based on a signal and a second image based on an image signal output from at least one of the plurality of image input devices. ,
An image signal input unit to which the image signal is input;
An image synthesis unit that synthesizes the first image and the second image generated in the image processing unit;
A priority setting unit for setting a priority of an image to be synthesized as the second image;
Based on the connection state of the plurality of image input devices and the priority set in the priority setting unit, the second image is synthesized as the second image among the image signals input to the image signal input unit. A control unit that performs control for selectively outputting one image signal corresponding to an image;
A medical image processing apparatus comprising:   Further, the control unit is configured to output the first image and the first image so that the first image is output to a main screen of the display unit, and the second image is output to a sub-screen of the display unit. The medical image processing apparatus according to claim 1, wherein control for synthesizing the second image is performed on the image synthesizing unit. An operation instruction unit that outputs an instruction signal for instructing control of the plurality of image input devices;
The medical image processing apparatus according to claim 1, wherein the priority order setting unit can change the priority order setting based on the instruction signal. A signal level detection unit for detecting a signal level of each image signal input to the image signal input unit;
The medical image according to any one of claims 1 to 3, wherein the priority order setting unit can change the setting of the priority order based on a detection result of the signal level detection unit. Processing equipment.   The plurality of image input devices are turned on or off according to the instruction signal related to the on / off instruction from the operation instruction unit, and the insertion shape when the insertion unit is inserted into the body cavity is the insertion shape. 5. The medical insertion device according to claim 3, further comprising an endoscope insertion shape detection unit that generates the image as an image and outputs the insertion shape image as the image signal to the image signal input unit. Image processing device.   In the plurality of image input devices, one or a plurality of the first images are stored as captured images, and each of the captured images is used as the image signal in response to an instruction signal related to a capture instruction from the operation instruction unit. The medical image processing apparatus according to claim 3, further comprising a captured image acquisition unit that outputs to the image signal input unit.   The control unit is configured to select the image signal based on a connection state of the plurality of image input devices and a priority order set in the priority order setting unit and corresponding to an output state of the instruction signal from the operation instruction unit. Of each image signal input to the input unit, an image signal corresponding to an image synthesized as the second image is an image signal from the endoscope insertion shape detection unit, or from the capture image acquisition unit. The medical image processing apparatus according to claim 6, wherein control for preferentially outputting any one of the image signals is performed.   When the control unit detects that an instruction signal related to the capture instruction is output from the operation instruction unit, the control unit displays the second image corresponding to the image signal from the captured image acquisition unit in the display unit. The medical image processing apparatus according to claim 7, wherein control is performed so that the child screen is output only for a predetermined period.   The control unit controls the image processing unit to change the size of the second image generated according to the image signal from the captured image acquisition unit according to the number of the captured images. The medical image processing apparatus according to claim 8, wherein the medical image processing apparatus is performed.   The control unit performs control for the image processing unit to appropriately change the size of the second image in accordance with a preset output method to the display unit together with the priority order. The medical image processing apparatus according to claim 2, wherein the medical image processing apparatus is a medical image processing apparatus.   The medical image processing apparatus according to claim 10, wherein an output method to the display unit is either an HDTV method or an SDTV method.   The control unit detects whether one output method as an output method to the display unit set in advance together with the priority order is an HDTV method or an SDTV method, and based on the detection result The medical image processing apparatus according to claim 11, wherein control is performed to adjust an aspect ratio of the second image to that according to the one output method.   Further, the control unit performs image processing performed on the second image according to a type of one image input device that is an input source of the one image signal among the plurality of image input devices. The medical image processing apparatus according to claim 1, wherein control for changing a type is performed on the image processing unit.   The medical image processing according to claim 13, wherein the image processing to be changed by the control unit includes at least one of noise reduction processing, edge enhancement processing, and contrast adjustment processing. apparatus.   And a timing control unit for appropriately adjusting a first timing at which the imaging signal is input to the image processing unit and a second timing at which the image signal is input to the image processing unit. The medical image processing apparatus according to any one of claims 1 to 14.   The timing control unit temporarily outputs the image signal to the image processing unit when it detects that the time interval between the first timing and the second timing is within a predetermined period. The medical image processing apparatus according to claim 15, wherein control for prohibition is performed.

Images