WO2005084525A1

WO2005084525A1 - Image processing device

Info

Publication number: WO2005084525A1
Application number: PCT/JP2005/003880
Authority: WO
Inventors: Takechiyo Nakamitsu
Original assignee: Olympus Corporation
Priority date: 2004-03-08
Filing date: 2005-03-07
Publication date: 2005-09-15
Also published as: JP2005245961A

Abstract

An image processing device includes a CPU unit capable of controlling a graphic unit so as to display various control screens on a display unit of a concentrated operation panel. When a first endoscope camera device, an ultrasonographic device, a second endoscope camera device, and a third endoscope camera device are connected, input images from these devices are time-division-captured by a capture processing unit according to control of the CPU unit. The CPU unit generates thumbnail images from the capture image data and displays an image selection screen formed by the thumbnail images for each input channel of the system controller on the display unit of the concentrated operation panel. Thus, it is possible to appropriately and rapidly select input images which are inputted.

Description

Specification

Image processing device

Technical field

The present invention relates to an image processing device that processes a plurality of medical images.

Background art

[0002] A general endoscopic operation system includes an endoscope for performing observation, a camera head connected to the endoscope, an endoscope camera device for processing an image signal captured by the camera head, and an object. A light source device that supplies illumination light, a monitor that displays an image of a subject, an insufflation device that is used to inflate the abdominal cavity, and a high-frequency ablation device (hereinafter referred to as an electric Female).

[0003] When a procedure is started using such an endoscopic operation system, first, an endoscope is inserted into a position to be inspected. Then, illumination light from the light source device is applied to the subject via the endoscope, and the endoscope transmits an optical image of the subject to the camera head.

[0004] Subsequently, the camera head captures an optical image of the subject, and an imaging signal of the subject image is subjected to signal processing by an endoscope power camera. The endoscope camera device generates an endoscope image from an imaging signal. This endoscope image is output to a monitor from the endoscope camera device. Then, the treatment site on the endoscope image is displayed on the monitor, and various treatments are performed while observing the treatment site on the monitor.

[0005] Usually, each of these devices is mounted on a system trolley for an endoscope together with a system control device as disclosed in Japanese Patent Application Laid-Open No. 7-303654, for example, to improve operability. Used as an endoscope system.

[0006] However, in endoscopic surgery, a procedure may be performed by a plurality of operators. In such a case, since a plurality of endoscopes are inserted into the region to be inspected, it is necessary to display an image of the subject using the endoscope for each operator. However, the system controller of the conventional endoscopic surgery system cannot recognize through which channel on the system a plurality of subject images such as the endoscope power of each operator are input.

[0007] That is, as shown in FIG. 8, in the conventional endoscopic surgery system, for example, Only the buttons 1001 indicating the input channels connected to the system are displayed on the display of the channel 1000. For this reason, the main operator cannot recognize the number of input channels by the plurality of buttons 1001 and recognizes the subject image on the side monitored by another operator. Cannot be selected properly and quickly.

[0008] The present invention has been made in view of the above circumstances, and has as its object to provide an image processing apparatus that can more appropriately and quickly select a plurality of input images to be input. .

Disclosure of the invention

Means for solving the problem

[0009] The image processing apparatus of the present invention is configured such that image input means for inputting a plurality of images, image capture means for capturing the plurality of images input from the image input means, and that the image capture means captures the images. Image selection screen generation means for generating an image selection screen in which reduced images of the plurality of images are allocated for each input path of the image input means; and the reduction on the image selection screen generated by the image selection screen generation means Image selecting means for selecting an image, and image output means for outputting an image of the reduced image selected by the image selecting means to a display means.

According to the present invention, there is an effect that a plurality of input images to be input can be selected more appropriately and quickly.

Brief Description of Drawings

FIG. 1 is a configuration diagram showing a configuration of a medical endoscope system according to a first embodiment of the present invention.

[FIG. 2] A block diagram showing the configuration of the system controller in FIG.

[Fig. 3] Diagram showing an image selection screen displayed on the centralized operation panel in Fig. 1.

FIG. 4 is a diagram showing a key input screen displayed on a centralized operation panel according to Embodiment 2 of the present invention. FIG. 5 is a diagram showing an image selection screen displayed on a centralized operation panel according to Embodiment 2 of the present invention. FIG. 6 is a first diagram showing an image selection screen displayed on a centralized operation panel according to Embodiment 3 of the present invention.

FIG. 7 is a second diagram illustrating an image selection screen displayed on the centralized operation panel according to the third embodiment of the present invention. Figure 2

[Figure 8] Diagram showing image selection screen displayed on conventional centralized operation panel

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

(Example 1)

1 to 3 relate to the first embodiment of the present invention, FIG. 1 is a configuration diagram showing a configuration of a medical endoscope system, FIG. 2 is a block diagram showing a configuration of a system controller of FIG. 1, and FIG. 2 is a diagram showing an image selection screen displayed on the centralized operation panel of FIG.

As shown in FIG. 1, a first endoscope camera device 110a, a first light source device ll la, a high-frequency power cautery device (hereinafter referred to as an electric scalpel) 112, which constitutes a medical endoscope system, The device 113, the VTR 114, the ultrasonic observation device 130, the in-hospital network device 131, and the external storage device 132 are connected to a system controller 100 that is a medical image processing device that controls the entire system. On the other hand, the second endoscope camera device 110b, the second light source device llb, the third endoscope camera device 110c, and the third light source device 111c are connected to the relay unit 101.

[0015] The relay unit 101 and the system controller 100 are connected by a relay cable 102, and each device is centrally controlled by the system controller 100.

A centralized operation panel 103 operated by a nurse or the like in a non-sterile area and a remote controller (hereinafter, remote control) 104 operated by an operator in a sterile area can operate the system controller 100.

When the system controller 100 is operated by the centralized operation panel 103 and the remote controller 104, for example, the system controller 100 controls the centralized display panel 105 beside the monitor, and displays intraoperative data on the centralized display panel 105. it can.

The centralized operation panel 103 includes a display unit 103a such as a liquid crystal display and a touch sensor 103b integrally provided on the display unit (see FIG. 2). The centralized operation panel 103 has a display function of displaying the status display and operation switches of each device on the display unit 103a as a setting screen, and an operation function of operating the operation switches by touching a predetermined area of the touch sensor 103b. Have.

In the present embodiment, the centralized operation panel 103 uses the display function to Among the status displays and operation switches of the devices connected to 100, the intended one is displayed on the screen of the display unit 103a.

Each controlled device connected to the system controller 100 transmits data to the system controller 100 via a communication line. When communication with each device is established, the system controller 100 displays a display on each device on the display unit 103a of the centralized operation panel 103. In addition, when communication with each device is established, the system controller 100 enables operation input with the touch sensor 103b of the centralized operation panel 103.

Various images including the endoscope camera devices 110a and 110b are displayed on the observation monitors 118a and 118b via the system controller 100.

As shown in FIG. 2, the system controller 100 has a switcher processing unit 1. The switch processing unit 1 includes an input image input from the first endoscope camera device 110a, the VTR 114, and the ultrasonic observation device 130, and a second endoscope input via the relay unit 101 and the relay cable 102. Based on the input image input from the mirror camera device 110b and the third endoscope camera device 110c, the image is switched and output to the observation monitor 118a and the observation monitor 118b under the control of the CPU unit 2. I do.

The switcher processing unit 1, based on the control of the CPU unit 2, among the input images input, for example, an input image from the second endoscope camera device 110 b as a live observation image Output to 118a.

Further, based on the control of the CPU unit 2, the switcher processing unit 1 uses the observation monitor 118b as a live observation image, for example, the input image from the first endoscope camera device 110a among the input image. Output to

Further, the switcher processing section 1 outputs each input image data to the internal bus 3 under the control of the CPU section 2.

Each input image data output to the internal bus 3 is captured in a time-division manner by the capture processing section 4 under the control of the CPU section 2. The CPU 2 causes the internal recording unit 5 to record the image data captured by the capture processing unit 4 via the internal bus 3.

The control state information of each device such as the first endoscope camera device 110a, the first light source device ll la, the electric scalpel 112, the insufflation device 113, and the external storage device 132 is transmitted through the IZF conversion section 6. internal Output to bus 3. The control state information is monitored by the CPU 2 via the internal bus 3.

The control state information of each device such as the second endoscope camera device 110b, the second light source device ll lb, the third endoscope camera device 110c, and the third light source device 111c is stored in the relay unit 101. Is input through the IZF converter 7. The control state information is transmitted from the relay unit 101 via the relay cable 102 and output to the internal bus 3 via the serial IZF unit 12 in the system controller 100. The control state information is monitored by the CPU 2 via the internal bus 3.

The in-hospital network device 131 is connected to the system controller 100 via the LAN iZF unit 8. Various medical information (for example, medical image data such as patient preoperative examination data and CT images) via an in-hospital server (not shown) is output to the internal bus 3 via the LAN IZF unit 8. The CPU 2 monitors these various medical information via the internal bus 3.

Further, operation data from the remote control 104 is output to the internal bus 3 via the remote control IZF unit 9. Then, the CPU unit 2 controls each device based on operation data from the remote controller 104 via the internal bus 3.

The CPU unit 2 controls the graphic unit 10 to display various control screens on the display unit 103a of the centralized operation panel 103. Further, the touch sensor 103b detects an operation of a finger or the like on the control screen displayed on the display unit 103a of the centralized operation panel 103, and operates the internal bus 3 via the touch sensor IZF unit 11 to operate the finger or the like on the control screen. The operation data of is output.

Based on the operation data, the CPU unit 2 also performs various controls and instructions on the central operation panel 103. Further, the CPU unit 2 displays various data screens based on various controls and instructions on the centralized operation panel 103 or operation instructions of the remote controller 104 on the centralized display panel 105.

The centralized display panel 105 is configured to be able to display an image captured by the capture processing unit 4 as a moving image. With this configuration, the centralized display panel 105 is connected to the first endoscope camera device 110a, the ultrasonic observation device 130, the second endoscope camera device 110b, or the third endoscope similarly to the observation monitors 118a and 118b. Image from camera device 110c The image can be displayed as a live image of a moving image.

[0034] In other words, the main operator can simultaneously refer to the central display panel 105 with a moving image of a desired device as a reference moving image under endoscopic image observation by the observation monitors 118a and 118b.

The operation of the present embodiment configured as described above will be described.

The first endoscope camera device 110a and the ultrasonic observation device 130 are connected to the system controller 100. The second endoscope camera device 110b and the third endoscope camera device 110c are connected via the relay unit 101 and the relay cable 102.

Based on the control of the CPU unit 2, input images from these devices are captured in a time-division manner by the capture processing unit 4, and the captured image data is sent to the internal recording unit 5 via the internal bus 3. Be recorded.

[0038] Then, the CPU unit 2 generates a thumbnail image of the captured image data recorded in the internal recording unit 5, and displays the system controller on the display unit 103a of the centralized operation panel 103 as shown in FIG. An image selection screen 200 including thumbnail images 201 for 100 input channels is displayed.

Therefore, the main operator can determine to which channel a plurality of live images from the endoscope camera device or the like input to the system controller 100 are connected by using the image selection screen 200 by using the thumbnail image 201. It is possible to easily visually recognize it. Therefore, for example, the main surgeon instructs a nurse or the like during the procedure, and the nurse or the like activates the touch sensor 103b to display a desired live image on the selective concentration display panel 105 as a reference moving image. .

As described above, in the present embodiment, when a desired reference moving image is displayed on the centralized display panel 105 while observing an endoscope image, the thumbnail for each input channel is displayed on the display unit 103a of the centralized operation panel 103. Since the image 201 is displayed, a desired live image can be more appropriately and quickly selected as a reference moving image from a plurality of live input images input to the system.

(Example 2)

4 and 5 relate to the second embodiment of the present invention. FIG. 4 is a diagram showing a key input screen displayed on the centralized operation panel, and FIG. 5 is a diagram showing an image selection screen displayed on the centralized operation panel. It is.

Since the second embodiment is almost the same as the first embodiment, only different points will be described.

In this embodiment, as shown in FIG. 4, a key input screen 300 is displayed on the display unit 103a of the centralized operation panel 103 before the procedure, and the input image is displayed on the key input screen 300 for each input channel of the system. Is input. FIG. 4 shows a state where “CAMERA 1” indicating an input image from the first endoscope camera device 110a is input to the channel “Video A”.

When a character indicating an input image is input for each input channel of the system on such a key input screen 300, as shown in FIG. 5, the input character information is superimposed on each input channel. The image selection screen 200 having the thumbnail image 201 is displayed on the display unit 103a of the centralized operation panel 103.

Then, the main surgeon instructs a nurse or the like during the procedure to operate the touch sensor 103b to select the thumbnail image 201 on which the character information is superimposed. By this selection operation, a desired reference moving image is displayed on the central display panel 105 during observation of the endoscopic image during the procedure.

As a result, in this embodiment, in addition to the effects of the first embodiment, a desired live image can be selected more easily than in the first embodiment.

(Example 3)

6 and 7 relate to the third embodiment of the present invention. FIG. 6 is a first diagram illustrating an image selection screen displayed on the centralized operation panel, and FIG. 7 is a diagram illustrating an image selection screen displayed on the centralized operation panel. It is the 2nd figure shown.

The third embodiment is almost the same as the second embodiment, and only different points will be described.

In the present embodiment, as shown in FIG. 6, the thumbnail image 201 displayed on the image selection screen 200 is different from the first endoscope camera device 110a as in the first and second embodiments, as shown in FIG. Thumbnails of live images from the sound wave observation device 130, the second endoscope camera device 110b, and the third endoscope camera device 110c, and thumbnails of recorded images recorded on the VTR 114! And a thumbnail of a pre-operative CT image of the patient input via 131. [0050] In this case, for example, the character information to be superimposed on the thumbnail of the preoperative CT image includes the character information input on the key input screen 300, and further reads the file information storing the preoperative CT image. For example, character information such as a file name “CT001.jpg” can be included.

When an image is being recorded on the VTR 114, characters such as “recording” can be displayed on the thumbnail of the image being recorded on the VTR 114 as shown in FIG.

As described above, in this embodiment, in addition to the effects of the second embodiment, not only a live image but also a recorded image can be selected more appropriately and promptly as a reference moving image.

[0053] The present invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit of the present invention.

Claims

The scope of the claims

[1] image input means for inputting a plurality of images,

Image capturing means for capturing the plurality of images input from the image input means;

Image selection screen generation means for generating an image selection screen in which reduced images of the plurality of images captured by the image capture means are allocated for each input path of the image input means,

Image selection means for selecting the reduced image on the image selection screen generated by the image selection screen generation means;

Image output means for outputting an image of the reduced image selected by the image selection means to a display means;

An image processing apparatus comprising:

[2] The plurality of images include at least an intraoperative live image

The image processing apparatus according to claim 1, wherein:

[3] There is a character input unit for inputting character data to be superimposed on the reduced image

The image processing apparatus according to claim 1, wherein:

[4] There is a character input unit for inputting character data to be superimposed on the reduced image

3. The image processing device according to claim 2, wherein:

[5] The character data includes information for identifying the image input unit.

4. The image processing apparatus according to claim 3, wherein:

[6] The character data includes information for identifying the image input unit.

5. The image processing device according to claim 4, wherein:

[7] The image input means includes an endoscope camera device

6. The image processing device according to claim 5, wherein:

[8] The image input means includes an endoscope camera device

7. The image processing device according to claim 6, wherein:

[9] an image input step of inputting a plurality of images,

An image capture device for capturing the plurality of images input by the image input means; With yae,

An image selection screen generating step of generating an image selection screen in which reduced images of the plurality of images captured by the image capturing step are allocated for each input path of the image input means;

An image selection step of selecting the reduced image on the image selection screen generated by the image selection screen generation step;

Outputting an image of the reduced image selected by the image selecting step to a display means;

An image processing method comprising:

[10] The plurality of images include at least an intraoperative live image

10. The image processing method according to claim 9, wherein:

[11] There is a character input step of inputting character data to be superimposed on the reduced image.

10. The image processing method according to claim 9, wherein:

[12] There is a character input step of inputting character data to be superimposed on the reduced image.

11. The image processing method according to claim 10, wherein:

[13] The character data includes information for identifying the image input unit.

12. The image processing method according to claim 11, wherein:

[14] The character data includes information for identifying the image input unit.

13. The image processing method according to claim 12, wherein: