WO2011152489A1 - Image recording system, and image recording method - Google Patents

Abstract

Disclosed is an image recording system provided with an input image selecting unit which is inputted with a plurality of images respectively acquired by means of a plurality of medical devices and which can select a predetermined number of images, an image processing condition selecting unit which can select predetermined image processing conditions including those for synthesis processing with regard to the selected predetermined number of images, an image processing unit which subjects the predetermined number of images to image processing including synthesis processing on the basis of the selected conditions, and a recording unit which records the image-processed synthesized image.

Description

Image recording system and image recording method

The present invention relates to an image recording system and an image recording method capable of simultaneously recording a plurality of captured images as one image.

In recent years, Japanese Patent Application Laid-Open No. 2009-39243 discloses an endoscope observation apparatus with excellent operability that can appropriately synthesize and display images from two video scopes without requiring troublesome operations. It is disclosed.

In addition, regarding a surgical microscope system used for surgery of a minute part, etc., it is possible to record a plurality of images taken during surgery with high image quality, and when reproducing recorded images, Japanese Patent No. 4105860 discloses a surgical microscope system capable of reproducing a very close state, for example, a plurality of images in a correlated state.

Further, a medical image generation apparatus that records an ultrasound image generated by an ultrasound image generation apparatus and an endoscope image generated by an endoscope image generation apparatus using the same reference time is disclosed in -271695.

Furthermore, an image display device for an endoscope that combines images input via a plurality of input means according to a display mode and displays the combined image on a plurality of image display means corresponding to the display mode is provided in Japan. This is disclosed in Japanese Patent Laid-Open No. 6-327623.

However, none of the prior arts has been intended to improve the operability when combining and recording a plurality of medical images and improve the image quality of the composite image.

Therefore, when a plurality of captured images are recorded simultaneously as one image, a plurality of captured images can be combined and recorded in any combination, and each combination of the captured images can be recorded when reproduced and displayed on the monitor screen. Select a different cropping size (including aspect ratio) and combine it, or select and combine any of PinP (Picture In Picture) or PoutP (Picture Out Picture), Can be combined at the same resolution (high or low image quality), or captured in different formats (HD-SDI, SD-SDI, VDI, RGB, Y / C, composite video signal, etc.) Can be converted into any one of the same formats and combined, and multiple types of images can be arbitrarily combined and recorded as a single image. Image recording system is desired.

In addition, when performing surgery using a plurality of medical devices, according to the scene corresponding to the progress of the operation, the plurality of medical devices can be set to an operation state that is easy to treat and an image corresponding to the scene can be recorded. It is desirable to do.

The present invention has been made in view of the above points, and in the case of performing an operation using a plurality of medical devices, an image recording system and an image recording method capable of appropriately recording an image corresponding to the progress of the operation. Is intended to provide.

An image recording system according to an aspect of the present invention is configured to input a plurality of images respectively acquired by a plurality of medical devices and select an input image selection unit capable of selecting a predetermined number of images and the input image selection unit. An image processing condition selection unit capable of selecting a predetermined image processing condition including a combining process for the predetermined number of images, and a combining process for the predetermined number of images based on the condition selected by the image processing condition selecting unit. An image processing unit that performs image processing, an output switching unit that outputs a predetermined number of images processed by the image processing unit as a single composite image to a predetermined output destination, and a composite image output by the output switching unit And a recording unit for recording

An image recording system according to another aspect of the present invention includes a central control unit that connects a plurality of medical devices and performs central control of each medical device, and a plurality of images having a function of outputting images in the plurality of medical devices. An image selection unit that selects a predetermined number of images from the output medical device, an image recording unit that can record the predetermined number of images selected by the image selection unit, and treatment in a plurality of scenes corresponding to cases In order to perform the setting, a device setting unit that selects and sets a medical device to be operated in each of the plurality of scenes from the plurality of medical devices, and after setting by the device setting unit, one scene from the plurality of scenes is timed. A central scene selection unit, and the central control unit operates in the one scene from the plurality of medical devices according to the one scene selected from the scene selection unit. It controls the operation of the medical device, and performing control to record the image of the image output the medical device to operate in the one scene to the image recording unit.

An image recording method according to an aspect of the present invention includes: a first step of generating a scene selection signal for selecting one scene from a plurality of scenes prepared in accordance with the progress of surgery; A second step of generating a control signal for setting a medical device used in the scene selected by the scene selection signal to an operation state in synchronization with the scene selection signal from the medical device, and a plurality of images are input A third step of generating a switching control signal for switching the image selection operation of the image selection unit to be synchronized with the scene selection signal, and the image selection unit being selected by the image selection unit in synchronization with the switching control signal. And a fourth step of recording the recorded image in a preselected recording mode corresponding to the selected scene.

FIG. 1 is a block diagram of an image recording apparatus according to a first embodiment of the present invention. FIG. 2 is a front view showing a front panel of the image recording apparatus. FIG. 3 is a plan view showing an operation surface of the remote controller. FIG. 4 is a diagram showing the touch panel monitor in a state where two images are combined and displayed. FIG. 5 is a diagram showing the touch panel monitor in a state where only one image is displayed. FIG. 6 is a diagram for explaining extraction necessary when two screens are combined. FIG. 7 is a diagram showing a composite pattern of two input images A and B. FIG. 8 is a diagram illustrating a setting example in which two screens are not combined on the user setting screen in the touch panel monitor. FIG. 9 is a diagram illustrating a setting example in which two screens are combined on the user setting screen in the touch panel monitor. FIG. 10 is a block diagram showing a configuration of an image recording system according to the second embodiment of the present invention. FIG. 11 is a block diagram showing the configuration of the central control apparatus. FIG. 12A is a block diagram illustrating a configuration of a recording apparatus. FIG. 12B is a block diagram showing the configuration of the first CCU. FIG. 13 is a diagram showing a state in which combine surgery is performed. FIG. 14A is a diagram illustrating a change in devices used in a plurality of scenes when performing surgery corresponding to a case. FIG. 14B is a diagram showing an example of device settings in each scene of FIG. 14A. FIG. 15A is a diagram showing a state in which default contents are displayed by operating a scene category button. FIG. 15B is a diagram when the functions of some of the scene selection buttons in FIG. 15A are changed. FIG. 16 is a flowchart showing settings for performing the operation of FIG. 15A and operations for selecting a scene by operating a scene selection button for the set scene. FIG. 17 is a diagram illustrating a setting example of a recording mode in a case where an image is appropriately recorded on a recording device when an operation is performed using a combine surgery corresponding to a case. FIG. 18 is an explanatory diagram in the case of recording an image on a recording apparatus using a control signal. FIG. 19 is a diagram illustrating an example of an image of PinP. FIG. 20A is a flowchart showing a procedure of an image recording method when a treatment is performed while changing (selecting) a scene corresponding to a case. FIG. 20B is a flowchart illustrating a procedure of an image recording method by the recording apparatus. FIG. 21 is a flowchart showing a procedure for generating a folder corresponding to each scene and recording an image in synchronization with selection of each scene. FIG. 22 is a flowchart showing an operation procedure for changing setting contents of a medical device to be used. FIG. 23 is an explanatory diagram of FIG. FIG. 24 is a diagram showing a medical device to be changed displayed on the operation panel. FIG. 25 is an explanatory diagram of FIG. FIG. 26A is a diagram showing a configuration of a multiplexer provided in the central control apparatus. FIG. 26B is a diagram showing an image input example of a modification of FIG. 26A. FIG. 27 is a diagram illustrating a configuration of an image recording system according to a first modification of the second embodiment. FIG. 28A is an operation explanatory diagram for recording the image and the like in FIG. FIG. 28B is an operation explanatory diagram of the second modified example. FIG. 29A is an operation explanatory diagram of the third modified example. FIG. 29B is an explanatory diagram when two images are displayed in PoutP on a common HD monitor.

(First embodiment)
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 shows a block diagram of an image recording apparatus 10 of a first embodiment constituting an image recording system of the present invention, and FIG. 2 shows a front view of a front panel of the image recording apparatus 10.

In FIG. 1, an image recording apparatus 10 includes a capture unit 11, a memory 12, an image processing unit 13, a video memory 14 for channel 1, a video memory 15 for channel 2, an output switching unit 16, an internal A recording unit 17, a monitor (hereinafter simply referred to as a touch panel monitor) 18 having a touch panel, and a remote control light receiving unit 19 are provided. Furthermore, an external recording unit 20 and a remote controller 30 are provided outside. For example, a liquid crystal touch panel monitor is used as the touch panel monitor 18.

The capture unit 11 captures a plurality of input data from a plurality of (for example, eight) medical devices and performs a capture process. In the capture process, the captured data is stored in the memory 12 in a format that can be handled by the image processing unit 13.

That is, the capture unit 11 captures frame by frame and can be edited by the image processing unit 13. The image processing unit 13 may have a configuration using a personal computer. The capture unit 11 can link and paste this file to, for example, presentation software by sending it in a file format that is compatible with a personal computer and easy to edit.

The capture unit 11 has a function as input image selection means capable of selecting a predetermined number of target image signals from a plurality of input image signals based on an instruction from an operation means such as a touch panel.

The touch panel monitor 18 has a graphical user interface (GUI) for setting predetermined image processing (cutout size, synthesis pattern, resolution as parameters for at least one image to be synthesized) related to synthesis. Displayed on the screen of the monitor 18 as an image processing condition selection unit that allows a predetermined image processing condition to be selected for the image signal selected by the input image selection unit based on an instruction from the operation unit using the touch panel. It has a function.

The image processing unit 13 as an image processing unit includes an up / down converter 131, a cutout unit 132, a combining unit 133, and a format converting unit 134. The image processing unit 13 performs image processing including synthesis processing on the image signal based on the condition selected by the image processing condition selection unit.

The image processing unit 13 changes the resolution of each image signal according to the cut-out size of each image signal when the cut-out size including the aspect ratio in the combining process is set for a predetermined number of image signals to be combined. Thus, it is possible to observe with a resolution suitable for the image size in accordance with the change of the image size during the synthesis process.

The up / down converter 131 can up-convert or down-convert the resolution of data from the capture unit 11.

As will be described later with reference to FIG. 6, the cutout unit 132 is a touch panel monitor 18 or a display device (not shown) that combines a predetermined number (for example, two) of image signals set in advance by the combining unit 133 by two-screen combining. When an image is displayed on the screen, an image of an appropriate size obtained by changing the aspect ratio from the image size at the time of imaging can be cut out, and a plurality of images cut out at different aspect ratios or the same aspect ratio can be combined with the same vertical size, for example. It is to cut out.

As will be described later with reference to FIG. 7, the synthesizer 133 inputs a plurality of (for example, eight in FIG. 1) input data in various formats to be input to the capture unit 11 from a medical device such as an endoscope camera or an operating room camera (not shown). Then, a predetermined number (for example, two) of image signals are selected and combined so as to be arranged in, for example, an HD screen (16: 9).

The format conversion unit 134 converts the output obtained by combining at least one image signal as one image by the combining unit 133 into a predetermined compression format (MPEG4AVC / H.264 for moving images, JPEG for still images). Is.

The video memory 14 for the channel Ch1 is a buffer memory for temporarily storing a set of synthesized image signals for output as the channel Ch1.
Similarly, the video memory 15 for the channel Ch2 is a buffer memory for temporarily storing another set of synthesized image signals as the channel Ch2. Therefore, video memories for channels Ch3, Ch4,... May be further provided to temporarily store several sets of synthesized image signals.

The output switching unit 16 serving as an output switching unit switches which of a plurality of channels of combined image signals from the plurality of video memories 14 and 15 is output to the external recording unit 20 and the touch panel monitor 18 on the front panel. It is.

The output switching unit 16 outputs, for example, two sets of composite image signals (combined images) for the channels Ch1 and Ch2 to the external recording unit 20 and the touch panel monitor 18 to record and display them, while the internal recording unit 17 Is also output.

The internal recording unit 17 can record as many composite image signals as the number of channels. By simultaneously recording composite image signals for a plurality of channels, a plurality of sets of composite images of a plurality of types of medical images can be recorded. Can be recorded during surgery, and a plurality of sets of synthesized images can be reproduced and viewed. The external recording unit 20 and / or the internal recording unit 17 constitute recording means for recording the image signal output by the output switching unit 16.

The internal recording unit 17 is a built-in optical drive such as a hard disk (hereinafter referred to as HDD) or DVD. The external recording unit 20 is, for example, an external HDD, a USB memory, an optical disk drive, or the like.

In the above configuration, the input selection in the capture unit 11 as the input image selection means is a high-quality image such as HD-SDI (abbreviation of High-Definition-Serial-Digital Interface) or DVI (abbreviation of Digital-Visual Interface) HD image), SD-SDI (abbreviation for Standard Definition-Serial Digital Interface), Y / C, composite, etc., to output a standard image or a low image quality image (hereinafter referred to as an SD image) as one composite image signal When selecting multiple (for example, two) input images from multiple (for example, eight) input images, select two images with different image quality (specifically, resolution) or the same image quality It is possible to select two images of (resolution).

Here, the resolution means the size of the number of pixels per unit area. If the number of pixels per unit area is large, it can be said that the resolution is high (high image quality), and if it is small, the resolution is low (low image quality). When the image processing unit 13 performs composition processing, either PoutP (Picture Out Picture) or PinP (Picture In Picture) is selected and set as a composition pattern. 2, 4 and 7 show examples of PoutP.

When synthesizing two image signals of different image quality of an HD image (for example, a high-quality endoscopic image) and an SD image (for example, a low-quality endoscopic image) and outputting them as one composite image signal (1) Up-converting the resolution of a low-quality image to create a high-quality image, and then combining two high-quality images. (2) Down-converting the resolution of a high-quality image to produce a low-quality image. Then, there are a method of synthesizing two low-quality images, and (3) a method of synthesizing a high-quality endoscopic image and an operating room image captured at a low image quality with different image quality as they are. Any one of the synthesis methods can be selected and set.

Further, when, for example, a 5: 4 endoscope image and a 4: 3 endoscope image having different cutout sizes (including differences in aspect ratio) are combined and output as one composite image signal (1) A method in which a 4: 3 endoscope image is cut to a 5: 4 cut-out size, and then two 5: 4 endoscope images are combined. (2) 5: 4 endoscope A method of combining two 4: 3 endoscope images after making the 4: 3 cropped image size, (3) 5: 4 endoscope image and 4: 3 endoscope image as they are There is a method of combining with an aspect ratio size, and any of these combining methods can be selected and set.

Hereinafter, specific examples in the present embodiment will be described.
FIG. 2 shows a front view of the image recording apparatus 10. The display state of the touch panel monitor 18 in FIG. 2 is operated by operating a “start operation” button (indicated by a thick line frame) among a plurality of operation buttons displayed on the touch panel, and simultaneously displaying and synthesizing two screens. 20 or a state in which data is being written to the disc (DISC) of the internal recording unit 17.

2, reference numeral 1 denotes a front panel. A touch panel monitor 18 is disposed on the left side of the front panel 1, and a power button 2 is disposed on the lower left of the touch panel monitor 18. Further, a DVD disc tray 3 is disposed above the right portion of the front panel 1 so as to be able to project and retract with respect to the front panel front, and an eject button 4 is disposed at the lower right of the disc tray 3.

Below the right side of the front panel 1, status LEDs 5 indicating the operating status of the system, server, built-in HDD, and DVD are arranged in reciprocal (five in the figure), and the infrared remote control light receiving unit 19 and USB interface 6 are connected. A mouth is provided.

FIG. 3 shows a plan view of the operation surface of the remote controller 30.
The remote controller 30 shown in FIG. 3 is configured on the assumption that the buttons on the operation surface combine and record and reproduce two images. An image corresponding to the left screen when two screens are combined is port A (abbreviated as PORT A), and an image corresponding to the right screen is port B (abbreviated as PORT B). A capture button CAPTURE, a record button REC, a playback button PLAY, a stop button STOP, a pause button PAUSE, a fast-forward button FF, and a rewind button REW are provided for the left and right images A and B.

FIG. 4 shows a touch panel monitor display example in which two images are synthesized and output, and FIG. 5 shows a touch panel monitor display example in the case of outputting only one image. At the start of surgery, two HD images acquired by two medical devices (for example, two endoscopes) as video sources (not shown) are simultaneously input to the image recording apparatus 10 and synthesized as one image to be externally recorded. Alternatively, it can be recorded in 17 and a two-screen composite signal or an image signal of only one screen can be reproduced and viewed after the operation is completed.

FIG. 6 is a diagram for explaining the clipping required when two screens are combined.
FIG. 6 shows an example of extraction when images of two sizes (including differences in aspect ratio) are extracted from a 16: 9 input HD image. In FIG. 6, (a) shows the image size of 16: 9, (b) shows the image size cut out from the image size of (a) with the aspect ratio of 4: 3, and (c) shows (a). The image size cut out from the image size at an aspect ratio of 5: 4 is shown.

FIG. 7 is a diagram showing a synthesis pattern when two input images A and B are synthesized. In the case of HD images, in the case of HD images and SD images, the combination of HD images and SD images in the case of SD images. The pattern is shown.
In FIG. 7, (a) to (e) all show a synthesis pattern when two images are synthesized with the same vertical size, and (a) to (c) are synthesis patterns of HD images. A combination of two HD images A and B is shown.

FIG. 7A shows a case where two HD images A and B are cut out with the same aspect ratio 16: 9 and synthesized adjacent to each other. FIG. 7B shows two HD images A and B having different horizontal and vertical dimensions. When the images are cut out at a ratio of 16: 9, 5: 4 and are combined with a slight gap between the two images (in this case, a combined pattern of 16: 9, 4: 3 is also prepared), FIG. When two HD images A and B are cut out with the same aspect ratio of 5: 4, 5: 4 and combined with a constant gap between them (slightly larger gap than in the case of FIG. 7B)) ( In this case, a synthesis pattern of 4: 3, 4: 3 and a synthesis pattern of 5: 4, 4: 3 are also prepared).

FIG. 7 (d) shows a case where the HD image A and the SD image B are cut out with different aspect ratios 16: 9 and 5: 4 while maintaining the respective resolutions and synthesized with a slight gap between the images. FIG. 7 (e) shows a case where two SD images A and B are cut out with the same aspect ratio of 5: 4 and 5: 4 and combined with a slight gap between the two images.

FIG. 8 shows a setting example when two screens are not combined on the operation screen at the time of user setting in the touch panel monitor 18. Note that the display state of the touch panel monitor 18 in FIG. 8 indicates a state in which an “input switching” button (indicated by a thick frame) is operated among a plurality of operation buttons on the user setting screen displayed on the touch panel during system setting. .

In the main menu screen for user settings at the upper left of the figure, it is possible to open a pull-down menu (▽ mark) showing options for a plurality of selection items provided on the menu screen.

When the pull-down menu of the selection item “PORT A selection” of the input image A is opened, four options of SDI, DVI, VIDEO, and Y / C are displayed. SDI means a serial digital interface, but the selection of HD image or SD image in SDI can be made by pressing the 'image quality' button on the main menu screen (upper left in the figure) of user settings. The same applies to the selection item “PORT B selection” of the input image B.

When the pull-down menu of the selection item '2 screen composition' is opened, a menu screen in the upper right of the figure is opened, and it can be set by selecting whether or not two screens are combined. In the main menu screen, as shown in FIG.

When two screens are not combined, the output channel selection items 'CHANNEL1' and 'CHANNEL2' are input images A and B (ie PORT A and PORT B) or input images B and A (ie PORT B and PORT A), respectively. It can be set.

However, when “Yes” is selected as shown in FIG. 9 for the selection item “2-screen composition”, neither of the input images A and B is displayed in the output channel selection item “CHANNEL1”, and “CHANNEL2”. Can be set by selecting either input image A or B from the pull-down menu.

FIG. 9 shows a setting example when two screens are combined on the operation screen at the time of user setting in the touch panel monitor.
As shown in FIG. 9, when “Yes” is selected for the selection item “2-screen composition” on the user setting screen, when the pull-down menu for the selection item “PORT A cutout” is opened, the input image A is cut off. ”,“ 4: 3 ”, and“ 5: 4 ”, and“ 4: 3 ”is selected and set in the figure. As described above, when “4: 3” is selected as the cutout “PORT A cutout” of the input image A, only the combination pattern shown in FIG. 7 is prepared for the selection item “PORT B cutout”. Is a combination of 4: 3 and 4: 3 shown in FIG. 7C in the combined pattern.

In FIGS. 8 and 9, the selection item “video output” for the touch panel monitor 18 and the external recording unit 20 selects “CHANNEL1” as the output channel.

According to this embodiment, when a plurality of captured images are combined and recorded as one image at the same time, a plurality of captured images can be combined and recorded in any combination, and the combination is also reproduced on the monitor screen. Displayed, the images are combined with different cut-out sizes for each captured image, or any combination pattern such as PinP or PoutP is selected and combined, or the captured images with different resolutions have the same resolution (high image quality). (Or low image quality) or images taken in different formats (HD-SDI, SD-SDI, VDI, RGB, Y / C, composite video signal, etc.) in any one of the same formats It can be converted and synthesized in a unified manner, and image signals in multiple formats from multiple different input sources can be arbitrarily combined into one image. In addition, a plurality of combined image signals arbitrarily combined can be recorded as a plurality of output channels, and a plurality of channels can be selected later and freely reproduced and viewed.

(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS. 10 to 26B. FIG. 10 shows an image recording system 31 of the second embodiment.

The image recording system 31 includes a plurality of medical devices, a central control device 32 that centrally controls the plurality of medical devices, and a touch operation panel (hereinafter referred to as an operation) that is connected to the central control device 32 and performs various operations by touch operations. Panel) 33, a matrix switcher 34 as an image selection unit for selecting two images from a plurality (predetermined number) of images, and an image recording unit for recording an image selected by the matrix switcher 34 (as a moving image or a still image) And a still image recording device (hereinafter simply referred to as a recording device) 35.

The recording device 35 basically has a configuration in which a communication function and a control function are added to the image recording device 10 of the first embodiment, and an image recording operation can be controlled by the centralized control device 32. .

The central control device 32 includes a first camera control unit (abbreviated as CCU) 41a, a second CCU 41b, a first monitor 42a, a second monitor 42b, a first operating light 43a, 2 A surgical light 43b, an ultrasonic knife 44a, an electric knife 44b, an OR camera (operating field camera) 45a, a room camera 45b, an ultrasonic device 46, a PC navigation device (UPD) 47, and the like are connected. A recording device 35 is also connected to the central control device 32. Note that the CCUs 41a and 41b as image signal generation means for generating an image signal are also called processors.

The first CCUs 41a and 41b are connected to a laparoscope 40a as a first endoscope and an end scope 40b as a second endoscope, respectively. As shown in FIG. 13, the laparoscope 40 a includes a rigid insertion portion 51 a and an operation portion (gripping portion) 52 a provided at the rear end. The insertion portion 51 a places the tracker 54 in the abdomen 53 a of the patient 53. Inserted (inserted).

Further, the end scope 40b has a soft (flexible) insertion portion 51b and an operation portion 52b provided at the rear end of the insertion portion 51b. The surgeon as a user can insert the insertion portion 51b into a patient. The distal end portion 51c of the insertion portion 51b is inserted up to the intestinal tract 55 in the abdominal portion 53a.

When performing an operation for excising the lesioned part 53b in the abdominal part 53a, the operator makes the lesioned part 53b observable with the laparoscope 40a, and with the endscope 40b, the back side of the lesioned part 53b, That is, it is possible to observe the vicinity of the lesioned part 53b from the intestinal tract 55 side, and an operation with a combine surgery can be performed.

The laparoscope 40a and the end scope 40b respectively include a first imaging element 48a and a second imaging element 48b as imaging means, and the first CCUs 41a and 41b perform signal processing on the imaging elements 48a and 48b, and image signals ) Is generated.

Image signals (images) generated by the CCUs 41a and 41b are output to the matrix switcher 34.

Further, the first monitor 42 a and the second monitor 42 b forming the image display device respectively display images of the image signals generated by the CCUs 41 a and 41 b under the control of the central control device 32 and record them with the recording device 35. Images and the like can be displayed.

Also, two images can be displayed on the display screens of the first monitor 42a and the second monitor 42b by PinP under the control of the central control device 32.

It should be noted that it is also possible to connect two laparoscopes to the CCUs 41a and 41b, generate images of signals picked up by the two laparoscopes by the CCUs 41a and 41b, and display them on the monitors 42a and 42b, respectively.

The shadowless lamps 43a and 43b are provided on the ceiling of the operating room and illuminate so as not to be shadowed during observation, imaging, or the like from the upper side of the patient 53 on the operating table.

The ultrasonic knife 44a and the electric knife 44b are treatment devices that perform excision and the like using ultrasonic energy and high-frequency electric energy, respectively. Also, an ultrasonic / electric knife having both functions can be used. FIG. 13 shows a state in which, for example, the lesioned part 53b is to be excised with the ultrasonic knife 44a.

When it is set to perform the combine surgery shown in FIG. 13, the surgeon performs a treatment of excising the lesioned tissue portion with the ultrasonic scalpel 44a while observing the image acquired with the Lapalo soup 40a. In this case, since the surgeon can also observe the image acquired by the endoscope 40b from the back side of the lesioned part 53b, the identification of the lesioned part 53b and the treatment of excising only the lesioned tissue part from the lesioned part 53b are performed. It will be easier to do reliably.

That is, in addition to observing the lesioned tissue portion from the surface side of the lesioned part 53b, observing the periphery of the lesioned part 53b from the back side of the lesioned part 53b makes it easier to confirm the distribution in the depth direction of the lesioned tissue part. It becomes easy to perform treatment such as excision more smoothly.

The OR camera 45a shown in FIG. 10 is disposed between the surgical lamps 43a and 43b, and is used when taking an enlarged photograph at the time of sewing or the like. The room camera 45b is attached to the ceiling or inner wall side of the operating room and photographs the state of the operation.

An ultrasonic scope 46a is connected to the ultrasonic device 46, and an image signal of an ultrasonic tomographic image (abbreviated as an ultrasonic image) is generated from an ultrasonic echo signal acquired by the ultrasonic scope 46a.

The PC navigation device 47 is an insertion shape detection device that generates an image signal of an insertion shape image representing the shape of the insertion portion 51b of the end scope 40b using a PC. By referencing, it becomes easy to smoothly insert the insertion portion 51b to the target site. A coil (also referred to as a UPD coil) used for detecting the shape of the insertion portion is disposed in the insertion portion 51b of the end scope 40b.

This insertion shape detection device forms a navigation device that performs navigation when inserting the insertion portion 51b. In the present specification, the PC navigation device 47 is abbreviated as UPD.

In addition to this, as shown in FIG. 14B, the central control device 32 includes a first light source device and a second light source device that supply illumination light to the laparoscope 40a and the end scope 40b, respectively. Medical equipment such as a vessel and room light is connected.

At the image input end of the matrix switcher 34, the CCUs 41a and 41b as the image output medical devices having the function of generating (outputting) images (or image signals) in the plurality of medical devices described above, the ultrasonic device 46, OR Images (image signals) from the camera 45a, the room camera 45b, and the UPD 47 are input.

For example, the images of the CCUs 41a and 41b are input to the image input end of the SDI format, the images of the ultrasonic device 46 and the image of the UPD 47 are input to the image input end of the DVI format, and the image of the room camera 45b is input to the image input end of the video format. However, the image of the OR camera 45a is input to the Y / C format image input end.

Then, as will be described later, in synchronization with the change (selection) of the scene corresponding to the progress of the operation, the matrix switcher 34 switches the image output to the recording device 35 under the control of the central control device 32, and the recording device 35 records an appropriate image in each scene (for example, FIG. 17).

In the configuration example shown in FIG. 10, the matrix switcher 34 selects two images from a plurality (six) of input images, and records two images from the two image output terminals (Ch1, Ch2). Output to the image input terminal. FIG. 10 shows an example in which the matrix switcher 34 outputs an SDI format image (SD image).

In this case, the recording device 35 can also record the two images as a PinP composite image or an image (PoutP) in which two images are adjacent to each other instead of PinP. The functions of the recording device 35 are described in detail in the first embodiment.

In addition, the operation panel 33 displays a GUI when a user such as an operator performs a central operation under the control of the central control device 32 (FIGS. 15A, 15B, etc.).

As will be described later, the surgeon can operate the operation panel 33 to perform scene selection, which will be described later, by touch operation. The central control device 32 responds to the scene selection operation with the central control device 32. Control operations such as operation of a plurality of connected medical devices and change of settings are performed.

FIG. 11 shows the internal configuration of the centralized control device 32. The centralized control device 32 includes a panel IF 61 as an interface, a communication IF unit 62, a control unit 63 formed by, for example, a CPU that performs centralized control, a program storage unit 64, and an internal data storage unit 65.

The control unit 63 is connected to the operation panel 33 via the panel IF 61. Panel IF 61 forms an interface for transmitting and receiving control signals, data, and the like between control unit 63 and operation panel 33.

The control unit 63 is connected to the above-described plurality of medical devices via a plurality of communication IFs 62a, 62b,... 62n forming the communication IF unit 62, and the communication IF unit 62 is connected to the control unit 63 and the plurality of medical devices. To form a communication interface.

In FIG. 11, the communication IF 62a is connected to the first CCU 41a, the communication 62b is connected to the second CCU 41b,..., And the communication IF 62n is connected to the UPD 47.

A program storage unit 64 connected to the CPU forming the control unit 63 via a bus stores a program when the CPU controls a plurality of medical devices and the recording device 35. The CPU stores the program. The centralized control is performed according to the program stored in the unit 64.

Also, the internal data storage unit 65 connected to the CPU or the like via a bus stores information set by operating the operation panel 33, information on medical devices acquired through the communication IF unit 62, and the like. The CPU reads information necessary for the control operation and performs the control operation.

The control unit 63 mainly interprets various operation signals from the operation panel 33 and operates a plurality of medical devices in response to the signals (change from a non-operation state to an operation state or change operation settings). Control etc. Therefore, the control unit 11 has a function of a signal generation unit 63a that generates various signals such as a scene selection signal, a control signal, and a switching control signal in synchronization with scene selection, as will be described later.

FIG. 12A shows the internal configuration of the recording device 35. The capture unit 11-touch panel monitor 18 and external recording unit 20 in FIG. 12A are the components described in the first embodiment.

The recording device 35 in the present embodiment further includes a communication IF 66 connected to the communication IF of the centralized control device 32, a control unit 67 that performs a control operation, a program storage unit 68a, and an internal data storage unit 68b.

The control unit 67 communicates with the central control device 32 via the communication IF 66. Further, when a recording mode control command is input from the central control device 32 side, an image is recorded in a recording mode corresponding to the control command.

The program storage unit 68a connected to the CPU constituting the control unit 67 via a bus stores a program when the CPU performs a control operation, and the CPU performs a control operation according to the program. The internal data storage unit 68b stores data and the like to be referred to when the recording device 35 performs an operation.

The control unit 67 controls the image processing operation of the image processing unit 13 and the switching operation of the output switching unit 16 in response to a control command from the central control device 32 side. Further, as will be described later with reference to FIG. 21, the control unit 67 generates a folder for controlling the internal recording unit 17 to generate a folder having a folder name corresponding to the selected scene, for example, according to the scene selection. Control.

In the present embodiment, the control unit 67 is connected to the touch panel monitor 18, and the control unit 67 performs a control operation corresponding to the operation from the touch panel monitor 18.

In the present embodiment, as shown in FIG. 10, since the two image signals selected by the matrix switcher 34 are input to the image input terminal of the recording device 35, the image processing unit 13 of the recording device 35 is configured. The two image signals selected by the matrix switcher 34 are input via the capture unit 11. In the configuration of FIG. 12A, the capture unit 11 is set to a state where the image selection function is substantially stopped.

FIG. 12B shows a configuration of, for example, the first CCU 41a as an image output medical device having a function of generating (outputting) images in a plurality of medical devices.

The first CCU 41a includes a communication IF 141a that performs bidirectional communication connected to the communication IF 62a of the centralized control device 32 via a communication cable, and a control unit that performs bidirectional communication with the centralized control device 32 via the communication IFs 141a and 62a. 141b and an image processing circuit 141c having an input end (image input end) to which a signal picked up from the image pickup device 48a of the raparoscope 40a as the first endoscope is input. The control unit 141b includes a program storage unit 141d and an internal data storage unit 141e.

The image processing circuit 141c generates an image (signal) from the output signal from the image sensor 48a, and outputs the image (signal) from the image output end to the matrix switcher 34 and the central control device 32 (the multiplexer 34B shown in FIG. 26A). .

The laparoscope 40a is provided with scope switches SW1-SW3 for performing various instruction operations. Note that the SW4 may also be provided. The user can assign various functions such as release and freeze to the scope switches SW1 to SW3.

When the user operates the scope switches SW1-SW3, an operation signal is input to the control unit 141b, and the control unit 141b controls the operation of the image processing circuit 141c and the like corresponding to the operation.

For example, when the scope switch SW3 assigned with the freeze function is operated, the control unit 141b writes (writes) an image to a memory that temporarily stores an image (not shown) in the image processing circuit 141c. ) Is prohibited, and the image immediately before the operation is output as a still image.

When the scope switch SW1 to which the release function is assigned is operated, the control unit 141b sends a release operation signal to the central control device 32 via the communication IF 141a, and the central control device 32 is a recording device. 35 is controlled to record an image for which a release instruction operation has been performed. Note that the user causes the recording device 35 to stop the operation from the image recording (video or still image) operation or the image recording operation via the central control device 32 by operating the remote controller (102, see FIG. 27). You can also.

The image processing circuit 141c has an external image input terminal to which an external image generated by another image output medical device including the image processing circuit is input. The image processing circuit 141c reduces the image input from the external image input end into an image generated from the signal input to the image input end, and generates a PinP composite image (for example, an SD image). 141f.

In the present embodiment, the image processing circuit 141c has a function of generating an HD format image. For example, PoutP generates a PoutP image (for display) in which two SD images are arranged adjacent to each other. It has the function of the image generation unit 141g.

As will be described later, when a PinP control signal or a PinP control signal is input from the centralized control device 32 side (as a control signal in an image processing mode or an output mode for outputting a generated image), the control unit 141b receives an image processing circuit 141c. On the other hand, control is performed so as to generate and output a PinP composite image and a PoutP image.

In the present embodiment, it is easy to perform an operation corresponding to a case by an operation using the operation panel 33, and to perform an appropriate treatment according to the progress of the operation (including a confirmation action for confirming an actually treated portion). In addition, a plurality of scenes corresponding to the progress of the surgery (that is, for smoothly performing each treatment corresponding to the progress of the surgery) are prepared in advance.

In this embodiment, the surgeon as a user in advance sets the operation of the medical device and the like to be operated in a plurality of scenes and the setting contents in advance, so that the surgeon responds to the progress of the operation. By selecting one corresponding scene from a plurality of scenes in time, a medical device used directly or indirectly for treatment in that scene can be set in an easy-to-use state so that each treatment can proceed smoothly. I am doing so.

Further, in the internal data storage unit 65 in the centralized control device 35, a recording device that selects up to two images in any combination from a plurality of (for example, six) images input to the matrix switcher 34 in each scene. By setting the information to be output to 35 in advance, the recording device 35 can record an image suitable for each scene in response to the selection of each scene.

A specific example of such a plurality of scenes is shown in FIG. 14A, for example. Corresponding to a case in which the lesioned part 53b in the abdomen 53a is removed, preparation of a as a scene for introducing anesthesia, a rapaloscope (or abbreviated as rapalo) of b for inserting a rapaloscope, an intraoperative endoscope Endoscope of c to identify the excision range by (endoscope), Raparo (scope) of excision of lesioned part 53b by pararoscope, confirmation of the excision location by endoscopic endoscope There are six scenes of endoscopic endoscope and closed f for suturing. In FIG. 14A, the description of the scene is omitted (the same applies to FIGS. 14B and 17).

The setting of such a scene including a plurality of scenes and the operation of selecting one scene from the set plurality of scenes can be performed from the operation panel 33, for example.

For this reason, the operation panel 33 has functions of a scene selection unit 33a for selecting a scene and a scene number setting unit 33b as shown in FIG. The scene selection unit 33a may include the function of the scene number setting unit 33b or vice versa.

FIG. 14B shows a default setting example of a plurality of medical devices that are operated in association with each scene in FIG. 14A. In this default setting, two raparoscopes are used.

In the preparation scene a, both the shadowless lamps 43a and 43b and the room lamp are turned on, the abdominal abdomen is 12 mmHg, the CO ₂ air supply is turned off, the light source device for the raparoscope (first light source device), and the end scope The light source device (second light source device) is in a standby state, the first monitor 42a and the second monitor 42b display images of the rapaloscope 40a and the endscope 40b, the recording device 35 records an image of the rapaloscope 40a, and the first CCU 41a The initial values are 30W to 40W, the second CCU 41b is set to 30W, the room camera 45b is set to the operating state, and the ultrasonic device 46 / UPD 47 is set to OFF.

Further, in the rapaloscene of b, the first shadowless lamp 43a is set to OFF, the second shadowless lamp 43b is set to dark, the interior lamp is turned off, and the abdominal cavity is started to operate and set to a pneumothorax pressure of 15 mmHg. The first light source device is turned on and set to the illumination light amount near the center. Others are the same as the preparation scene of a.

In the intraoperative endoscopic scene of c, the room light is ON, the air-abdominal pressure by the insufflator is 10 mmHg, the CO ₂ air supply is ON, the first light source device is dark and the second light source device is ON. Illumination light quantity near the center, the first monitor 42a and the second monitor 42b are images of the Rapaloscope 40a and the image of the endscope 40b are PinP (indicated by PinP (L & E) in the drawing), and the recording device 35 is of PinP. The recording and ultrasonic device 46 / UPD 47 is set to ON.

D, e, and f laparo, intraoperative endoscope, and closed scenes are also set as shown in FIG. 14B. In this way, in each scene, a medical device used for treatment or the like is appropriately set.

In addition, settings such as the operation of the medical device in each scene shown in FIG. 14B can be performed by the operation panel 33. That is, as shown in FIG. 10, the operation panel 33 has a function of a device setting unit 33 c that sets operation and the like in a plurality of scenes.

Also, the control unit 63 in the centralized control device 32 stores information (data) corresponding to the scene selection unit 33a, the scene number setting unit 33b, and the device setting unit 33c in the internal data storage unit 65 in association with each scene.

For example, as shown in FIG. 11, the internal data storage unit 65 has a first look-up table (abbreviated as LUT) 65a storing data of each scene-used medical device.

The second LUT 65b provided in the first LUT 65a includes image selection data selected by the matrix switcher 34 in each scene from an image input from the image output medical device to the matrix switcher 34, and recording mode data for recording an image by the recording device 35. Are stored in association with each scene.

For example, when the preparation scene a as the first scene is selected by the scene selection unit 33a, the control unit 63 reads the data of the preparation scene from the first LUT 65a and uses it in the preparation scene via the communication IF unit 62. Control operations are performed so that medical devices (including image output medical devices) are set to an operation state or the like.

Further, in this case, the control unit 63 reads data related to the preparation scene from the second LUT 65b, and an image to be recorded by the recording device 35 in the preparation scene via the communication IF unit 62 is suitable for the case of the preparation scene. The switching of the matrix switcher 34 and the image recording by the recording device 35 are controlled so that the recorded image can be recorded.

Further, when the next raparo scene is selected from the preparation scene, the control unit 63 sets the medical device (including the image output medical device) used in the rapalo scene to the operation state or the like via the communication IF unit 62. The control action is performed. Similarly, the control unit 63 controls switching of the matrix switcher 34 and image recording recorded by the recording device 35. Similarly in other scenes, the control unit 63 performs a control operation.

Note that FIG. 14B shows a default medical device setting example, and the default medical device setting example can be changed by operating the device setting unit 33c of the operation panel 33.

FIG. 15A shows a display example of default setting contents displayed on the display surface of the operation panel 33 when the operation panel 33 is operated to select a scene. In FIG. 15A and subsequent figures, the intraoperative endoscope is described as an endoscope.

At the upper part of the display surface of the operation panel 33, a scene selection for selecting a scene and a category button KB for classifying medical devices that can be used in each scene are arranged. Specifically, multiple medical devices related to each scene, such as scene selection (scene selection), endoscopy, surgery, lighting facilities, audio / video, recording device, communication, indoor camera, etc. Settings etc. can be displayed by KB operation.

Also, on the left side of the center of the display surface of the operation panel 33, a scene selection button SB for selecting each scene described in FIGS. 14A and 14B is arranged.

In addition, a comment field C for displaying a comment is arranged on the upper side of the center of the display surface of the operation panel 33, and a detail display field D is arranged below the comment field C. The detail display field D has a default setting. The detailed setting contents of the medical device in the case are displayed.

In FIG. 15A, detailed setting contents when the raparoscope scene selection button SB is operated are displayed.

Specifically, the first scope switch as the first scope switch by the raparoscope described in FIG. 12B, the second scope switch 2 as the second scope switch by the end scope, and the settings of the insufflator are displayed. ing.

Also, the image selection of the matrix switcher, the output mode of the CCU, the recording mode of the recording device 35, etc. are displayed.

It should be noted that a Rapalo / End scene in which the intraoperative endoscope of c in FIG. 14B and the Rapallo scene of d are combined into one may be used. In this case, the display content of the operation panel 33 in FIG. 15A is as shown in FIG. 15B. FIG. 15B is a rapalo / end button in which the buttons of the rapaloscope and the end scope in FIG. 15A are combined. In this case, the number of scenes is 5, and the scene selection button is also 5.

FIG. 16 shows an operation for performing scene selection by setting as shown in FIG. 15A. The first step S1 is an operation for registration so that it can be used in advance.

In step S1, the user (surgeon) operates the operation panel 33 to perform detailed settings for scene selection (selection of each scene and medical equipment used in each scene), and register the detailed settings (contents thereof). To do. In addition, the user can register, for each user and each case, setting contents different from the default detailed settings registered previously.

When performing surgery, in the next step S2, when performing anesthesia for preparation for surgery, the surgeon reads out a preset (data) corresponding to the case, and clicks a preparation scene button. Push. The surgeon performs anesthesia treatment with reference to the preset.

Next, as shown in step S3, the surgeon starts treatment, and when the trocar 54 is inserted into the abdomen 53a of the patient 53, the operator presses the laparocene button SB. Then, the surgeon inserts (inserts) the laparoscope 40a into the abdomen 53a via the trocar 54 as shown in FIG. For example, an ultrasonic scalpel 44a is inserted (inserted) into the abdomen 53a through a trocar as a treatment tool used for excision.

Next, as shown in step S4, when inserting the endoscope 40b into the patient 53 through the upper digestive tract, the operator presses the endoscope scene button SB. Further, the surgeon may introduce the distal end 51c into the abdomen 53a while confirming the insertion shape of the insertion part 51b of the end scope 40b by the UPD 47. Then, the surgeon identifies the excision range with the endoscope 40b in consideration of the image by the laparoscope 40a. In this case, as shown in FIG. 14B, the Rapaloscope image and the endscope image may be displayed with PinP on the first monitor 42a so that both images can be observed on the first monitor 42a as one display device.

Next, as shown in step S5, the surgeon presses the rapaloscene button when performing excision using the rapaloscope 40a. Then, the surgeon removes the lesioned tissue portion with the ultrasonic scalpel 44a while observing an image or the like with the laparoscope 40a. Further, in this case, it becomes easy to reliably remove the lesioned tissue portion by observing the image by the endoscope 40b.

Next, as shown in step S6, the operator presses the end scope scene button when performing confirmation using the end scope 40b. Then, the operator confirms the state of the lesioned part 53b after excision by the endoscope 40b.

Next, as shown in step S7, the operator presses the close scene button when sewing. Then, the surgeon sews the abdomen 53a to end the operation, and the scene selection operation in FIG. 16 ends.

In the case of FIG. 15B, the operation is changed to the operation of the Rapallo / end scene button in which steps S4 and S5 in FIG. 16 are combined.

In FIG. 14B described above, the case where one image is recorded in the recording device 35 is illustrated in a simplified manner. However, in the present embodiment, the recording device 35 uses FIG. An image is recorded in the recording mode shown in FIG. This setting can be performed for each scene from the device setting unit 33c of the operation panel 33.

That is, in the preparation scene a, the image input ends Ch1 and Ch2 (abbreviated as Ch1 and Ch2 in FIG. 17) of the recording device 35 are the image input OFF, the room camera image, and in the raparoscene of b, the laparoscope image ( In the endoscope scene of c), room camera image, and c, it is set so that a rapaloscope image + an endoscope image (end image), an ultrasonic scope image (US image),... .

In addition, as an output mode for outputting images (signals) from the CCUs 41a and 41b and displaying them on the monitors 42a and 42b, for example, in an endscope scene, by setting the rapaloscope image and the endscope image to PinP, the surgeon can The state of both images can be confirmed by one monitor in the monitors 42a and 42b.

By performing such setting, in each scene corresponding to the progress of the operation, the surgeon operates the scene selection button SB to select the scene sequentially in time, whereby the central control device 32 is selected. Control is performed so that the medical device used in the selected scene is set to an operation state suitable for use, and control is performed so that the most appropriate image can be recorded by the recording device 35 in the selected scene.

In addition, when inputting one image from each image output medical device to the matrix switcher 34 as an image selection unit shown in FIG. 10, a PinP image is input using a PinP control command or the like as a recording mode control signal. You may do it. FIG. 18 is an explanatory diagram for inputting a PinP image.

As shown in FIG. 18, the CCUs 41a and 41b each have an image input end and an external image input end as described in FIG. 12B. Normally, an endoscope image A and an endoscope image B are input to the image input end, respectively, and an ultrasonic image of the ultrasonic device 46, an UPD 47 UPD, for example, are input to the external image input end serving as the other image input end. An image can be input.

Also, by sending a PinP control command from the centralized control device 32 to the CCUs 41a and 41b via the communication cable, the CCUs 41a and 41 can respectively receive the endoscope image A, the ultrasonic image, and the endoscope image B with PinP. Each UPD image is generated by PinP. FIG. 19 shows an example of an image obtained by combining the endoscope image A and the ultrasonic image with PinP.

The PinP image is input to the matrix switcher 34 from the CCUs 41a and 41b. The matrix switcher 34 receives a plurality of image inputs by sending a control signal of a selection control command (more specifically, a Ch1 / Ch2 selection control command) from the central control device 32 to the matrix switcher 34 via a communication cable. Two images are selected from a plurality of images (specifically, endoscopic images A and B, ultrasonic images, UPD images, OR camera images, room camera images, and PinP images A and B) input at the ends. Are output to the recording device 35 from the two image output terminals Ch1 and Ch2.

Further, the central control device 32 sends a recording mode control command (PoutP / PinP control command, control command that is not PoutP / PinP) as a recording mode control signal to the recording device 35 via a communication cable, so that the recording device 35 Performs image recording in a recording mode corresponding to the sent control signal.

For example, as shown in FIG. 18, when a PinP control command is input as a recording mode control signal in a state where the endoscope images A and B are input to the two image input ends Ch1 and Ch2 of the recording device 35. Is a recording of the PinP composite image of the endoscopic images A and B (A + B composite recording in FIG. 18), and when the PoutP control command is input, recording of the endoscopic images A and B (A in FIG. 18). The recording device 35 performs (recording + B recording). When the control command is not PoutP / PinP, the recording device 35 records the endoscope image A and the endoscope image B.

In the case of a PinP control command, a parent image that is not reduced and a child image that is superimposed on the parent image can be designated. If not specified, for example, default setting may be performed so that the image on the image input end Ch1 side is set as the parent image.

In FIG. 18, the CCUs 41a and 41b forming the image output medical device have been described as having a function of generating a PinP image. However, as will be described later, an image input to the image input terminal and an external image input terminal are used. You may make it produce | generate the image which has arrange | positioned the past image read, for example from the recording device 35, into PoutP.

Next, the operation of the image recording method performed mainly by the central control device 32 and the recording device 35 when performing surgery using a plurality of medical devices will be described.

FIG. 20A shows a procedure of an image recording method in a case where a treatment is performed while changing (selecting) a prepared scene corresponding to a case.

In the first step S11, when performing a surgery corresponding to a case in advance, the user (surgeon) operates the operation panel 33, sets an appropriate number of scenes N (= 6), and uses medical care for each scene. Make detailed settings for the device.

Thereafter, the user performs an instruction operation for registering the set content, and the data of the registered content is stored in the internal data storage unit 65 of the centralized control device 32 in association with the scene. And a user will be in the state which can perform an operation.

In the description of FIG. 20A, the first preparation scene-closed scene will be described in a simplified manner as the first scene-Nth (= 6) scene, respectively.

In step S12, the control unit 63 of the centralized control device 32 sets a scene parameter (hereinafter simply referred to as parameter) j for representing the first to Nth scenes to an initial value 0, and in the next step S13, the operation panel 33 is set. The operation input of the (j + 1) th scene button from is monitored. Note that the current parameter j is j + 1 = 1 because the loop processing is not performed.

As shown in step S14, the user performs a touch operation on the (j + 1) th scene button SB from the operation panel 33 in order to select a preparation scene as the first scene in order to start surgery.

As shown in step S15, the operation panel 33 sends a detection signal of the touch position to the control unit 63 of the centralized control device 32 by a touch operation for selecting the (j + 1) th scene button SB.

As shown in step S16, the control unit 63 determines whether or not the (j + 1) th scene button SB has been operated from the touch position. If the determination result is that the (j + 1) th scene button SB has been operated, the control unit 63 increases the value of the parameter j by 1 (j = j + 1) in step S17, and the jth scene button in the next step S18. A j-th scene selection signal corresponding to the selection of SB is generated.

If the determination result in step S16 is not the operation of the (j + 1) th scene button SB, the process returns to step S13.

As shown in step S19 following step S18, the control unit 63 specifies the medical device to be used in the jth scene stored in the internal data storage unit 65 by the jth scene selection signal, and also specifies the specified medical device. A j-th control command (control signal) for controlling settings and the like is transmitted to each specified medical device in synchronization with the j-th scene selection signal. When the loop process is performed (when j is 2 or more), the control unit 63 changes the setting of the medical device used in the (j-1) th scene in the jth scene or turns off the operation. Such control may be performed.

The medical device identified as shown in the next step S20 is set in a state corresponding to the j-th scene in synchronization with the j-th control signal, and each medical device is in an operation state corresponding to the j-th control signal. It becomes.

As shown in step S21, in the jth scene, the user performs a smooth treatment using the medical device that is in the operating state.

Also, as shown in step S22, the control unit 63 determines whether or not the parameter j has exceeded the last scene number N (= 6). If the parameter j does not exceed the number N of thins, the process returns to step S13, and the same process is continued for the next scene.

On the other hand, when the parameter j exceeds N, the control unit 63 ends the process of FIG. 20A.

FIG. 20B shows a recording method of the recording device 35 constituting the image recording unit.

In the first step S31, two images are input to the image input terminals Ch1 and Ch2 of the recording device 35 in an initial state. In step S <b> 32, the control unit 67 of the recording device 35 monitors the control signal sent from the central control device 32.

In the next step S33, when a control signal is sent, the control unit 67 determines whether or not the control signal is a control signal for recording an image. If it is not a recording control signal, the controller 67 returns to the process of step S32.

If it is a control signal for recording an image in step S34, the controller 67 generates a folder corresponding to the selected scene. The folder generation will be described in detail with reference to FIG.

When recording an image in step S35, the control unit 67 determines the recording mode.

In the case of the normal recording mode or the recording mode in which no recording mode is designated, in step S36a, the control unit 67 converts the image input to the image input end into the normal recording mode (recording for recording the input image as it is. The image processing unit 13 is controlled to record in the mode), and the image is recorded in the folder generated in the internal recording unit 17.

In the case of the PinP recording mode, in step S36b, the control unit 67 controls the image processing unit 13 to record an image in the PinP mode, and records the PinP image in the folder.

In the PoutP recording mode, in step S36c, the control unit 67 controls the image processing unit 13 to record an image in the PoutP mode, and records the PoutP image in the folder.

In step S37 after steps S36a-36c, the controller 67 determines whether or not a recording stop control signal is input. If no recording stop control signal is input, the control unit 67 returns to the process of step S35 and continues recording. Conversely, when a recording stop control signal is input, the process proceeds to step S38.

In step S38, the control unit 67 stops image recording, and determines in step S39 whether an end control signal has been input. If it is not an end control signal, the control unit 67 returns to the process of step S32, and if it is an end control signal, the control unit 67 ends the operation of FIG. 20B.

By recording an image as shown in FIG. 20A and FIG. 20B, an operator as a user can eliminate the work of setting a medical device to be used in each scene and changing the setting contents. The work of changing and setting the image to be recorded in can also be eliminated.

Therefore, according to the present embodiment, the operator can change the setting of the medical device during the operation or the operation of changing the image recorded by the recording device 35 is unnecessary, and the act of the operator can be smoothly performed. Can help to do.

FIG. 21 shows a processing procedure in which the recording device 35 generates a folder having a folder name corresponding to the selected scene in synchronization with the selection of the scene and records an image in the generated folder.

As a processing procedure of FIG. 21, a case where the operation panel 33 is set as shown in FIG. 15B will be described.

When the patient ID (123659) is input to the recording device 35 in the first step S51, the control unit 67 of the recording device 35, for example, in the root folder of the internal recording unit 17 is the examination folder with the folder name (12345). Is generated.

As shown in the next step S52, when the preparation button is selected by the surgeon and the preparation scene is selected, the control unit 67 generates a subfolder with a subfolder name of (12345_preparation) immediately below the examination folder of (12345). To do.

When recording (REC) starts as shown in the next step S53, an image being prepared from the room camera 45b is stored in the subfolder in the preparation scene.

When the operator presses the laparoscope button and selects a rapalocene as shown in the next step S54, the control unit 67 generates a subfolder with a subfolder name of (12345_rapaloscope) immediately below the examination folder (12345). .

As shown in the next step S55, the intraperitoneal image by the rapaloscope 40a is stored in the subfolder in the raparo scene.

As shown in the next step S56, when the end / raparo button is pressed by the surgeon and the end / rapalocene scene is selected, the control unit 67 has a subfolder name (12345_end / rapalo) directly under the examination folder (12345). Create subfolders.

As shown in the next step S57, the combined images of the end scope 40b and the rapaloscope 40a or the respective images are stored in the subfolder in the end / rapaloscope scene.

As shown in the next step S58, when the operator presses the laparoscope button and selects a laparo scene, the control unit 67 generates a subfolder with a subfolder name of “12345_rapalo” immediately below the examination folder (12345).

As shown in the next step S59, the image by the rapaloscope 40a is stored in the subfolder in the rapalo scene in step S58.

As shown in the next step S60, when the close button is selected by the surgeon and the close scene is selected, the control unit 67 generates a subfolder with a subfolder name of (12345_close) immediately below the examination folder (12345).

As shown in the next step S61, images from the room camera 45b and the OR camera 45a are stored in a subfolder in the close scene.

Then, the process of FIG. In the case of FIG. 15A, the contents are slightly modified from steps S56 and S37 in FIG.

As described above, in the present embodiment, images are managed by dividing and recording images to be recorded in each scene in a folder having a folder name corresponding to each scene according to each scene. .

Therefore, when a user (surgeon) refers to an image of a specific part or edits an image of a specific part after surgery, the operation can be easily performed. Specifically, when images are continuously recorded without being divided into a plurality of scenes, the image data becomes enormous, and it takes time to grasp an image of a specific part, and it takes time to edit. On the other hand, in the present embodiment, since it is divided and stored in different folders for each scene, it is possible to easily grasp or edit an image of a specific part.

Next, an operation procedure for changing the setting contents of the medical device so that it can be used in a desired scene will be described with reference to FIG. FIG. 23 shows a display example of the operation panel 33 before the change.

As shown in FIG. 22, in step S71, the user presses the scene category button KS (operation (1) in FIG. 23) to display the scene selection screen.

In the next step S72, the user operates the scroll button ScB (operation (2) in FIG. 23) to display a set value of a desired medical device. As shown in FIG. 23, the set value of the room light is displayed.

In the next step S73, the user selects the name of the medical device whose setting is to be changed (operation (3) in FIG. 23).

Then, the screen of the selected medical device is popped up as shown in step S74. FIG. 24 shows a screen in that case.

In the next step S75, the user performs an operation for changing the content to be changed. For example, in step S76, the user performs an operation to turn on all the room lights shown in FIG. 24 (operation (4) in FIG. 24).

Furthermore, in the next step S77, the user performs an operation to increase the light quantity of the light (operation (5) in FIG. 24).

Thereafter, in step S78, the user returns to the display of the scene selection screen by operating the return button (operation (6) in FIG. 24).

The scene selection screen in this case is shown in FIG.

As shown in step S79, the user confirms that the setting value of the room light has been changed with a different display color or the like (setting value portion (7) in FIG. 25).

In the next step S80, the user presses the set button SeB to change the set values of all displayed medical device scenes (operation (8) in FIG. 25).

In the next step S81, the user presses the preparation button SB to start surgery from the preparation scene (operation (9) in FIG. 25).

Although the explanation has been given in the case of the room light as the medical device when changing the setting of the medical device, the setting can be changed similarly in the case of other medical devices.

In the present embodiment, when images are output to a plurality of monitors 42a, 42b, a second matrix switcher or multiplexer 34B as an image selection unit is provided as shown in FIG. 26A, and the monitors 42a, 42b, The image displayed on 42b may be selected from a wider range of images.

It should be noted that providing this multiplexer 34B in the centralized control device 32 has an effect of simplifying image selection control and cable laying, compared to the case of providing it outside. That is, when the multiplexer 34B is provided in the central control device 32, the multiplexer 34B can be directly switched by the control unit 63 in the central control device 32. Further, as compared with the case where the multiplexer 34B is provided outside, the cable laid from the central control device 32 to the multiplexer 34B can be omitted.

The selection of an image by the multiplexer 34B is performed by the control unit 63 (see FIG. 11) as described above. The images from the first CCU 41a, the second CCU 41b, the ultrasonic device 46,..., UPD 47 are input to the plurality of image input ends in the multiplexer 34B, and the two images selected by the control unit 63 are the two image output ends Ch1, The data is output from Ch2 to the monitors 42a and 42b, respectively.

The control unit 63 controls selection (switching) of the multiplexer 34B in synchronization with the scene selection by a control signal synchronized with the scene selection.

As shown in FIG. 26B, two images (described as recording device input images Ch1 and Ch2) respectively input to the image input ends Ch1 and Ch2 of the recording device 35 are also input to the image input end of the multiplexer 34B. Anyway.

In this case, a plurality of images that are output to the recording device 35 and can be recorded can be set to be displayed on the monitors 42a and 42b as display devices. FIG. 26B shows a state in which the selection of the multiplexer 34B is controlled so that the recording device input images Ch1 and Ch2 are output to the monitors 42a and 42b.

That is, two images that are output to the recording device 35 and can be recorded may be displayed on the two monitors 42a and 42b as display devices. In other words, the control may be performed so that the plurality of images displayed on the monitors 42a and 42b and the images input to the image input terminals Ch1 and Ch2 of the recording device 35 are matched.

As described above, a scene for controlling the selection of the multiplexer 34B so that a plurality of images from a plurality of display devices and images input to a plurality of image input ends of the recording device 35 are matched is, for example, a d raparo scene in FIG. It may be performed in a specific scene.

In a scene where a specific treatment is performed such as excising the lesioned tissue portion of the lesioned part 53b while observing the image with the laparoscope 40a, the image in that case becomes an important image in the operation, and thus displayed in the scene. If the image of the apparatus and the image recorded by the recording device 35 are matched, the main image in the surgery can be recorded reliably (without being lost).

In addition, even when the surgeon performs an operation of recording a still image during the operation, the surgeon can record the still image because the image output to the recording device 35 can always be confirmed on the display device. Can be easily performed.

In addition to this, a CT image, an MRI image, or the like may be input to the matrix switcher 34 or the multiplexer 34B so that the CT image or the MRI image can be recorded or observed. Further, the matrix switcher 34 may be provided inside the central control device 32. In this case, the image selection of the matrix switcher 34 can be controlled in the same manner as described for the multiplexer 34B.

As described above, according to the present embodiment, when an operation is performed using a plurality of medical devices, an image can be appropriately selected according to the progress of the operation, and the selected image can be recorded.

Specifically, in order to perform an operation corresponding to a case, a plurality of medical devices that are actually used in each scene prepared in advance to perform a process according to the progress of the operation is suitable for use in each scene. Since each setting state can be set, the surgeon performs the operation of selecting scenes sequentially according to the progress of the operation, so that the treatment can be performed smoothly and in a short time using a treatment tool or the like in each scene. In addition, an image to be recorded from each of the plurality of images captured or displayed on the image display device in each scene is appropriately selected in synchronization with the selection of each scene, and the selected image (s) is selected. Recording can be performed by the recording device 35.

(First modification)
In the above-described second embodiment, the description has been given mainly for the case of one laparoscope 40a and one endscope 40b. However, as shown in FIG. 27, surgery is performed using two rapaloscopes 40a and 40a ′. You may make it do. FIG. 27 shows a configuration of an image recording system 31B according to a usage example.

In the image recording system 31B, the laparoscopes 40a and 40a ′ are respectively optical abdominal endoscopes 78a and 78b as optical rigid endoscopes, and camera heads 79a and 79b attached to the eyepieces. Consists of

The image recording system 31B includes a first monitor 42a, a first CCU 41a, a first light source device 85a, an electric scalpel 44b, an insufflator 91, an ultrasonic scalpel 44a, and a recording device as a plurality of medical devices mounted on the first trolley 81. The device 35 and the operation panel 33 are connected to a centralized control device 32 that performs centralized control via a communication cable that performs serial communication using USB or RS-232C, and can perform bidirectional communication.
The central control device 32 can be connected to a microphone / earphone set 82 including a microphone (abbreviated as a microphone) 82a as voice input means for an operator to input voice. The surgeon can perform voice recording in synchronization with the moving image by the recording device 35 by inputting voice to the microphone 82a.

The input voice is converted into an audio signal as an electric signal by the microphone 82a and input to the voice recognition unit 83 in the centralized control device 32. The voice recognition unit 83 performs voice recognition on the input voice signal. To generate a text file. The generated text file can be recorded in the recording device 35. In addition, the voice recognition unit 83 includes a voice reading unit that converts a text file into voice and can notify the operator by voice using the earphone 82b.

The first light source device 85a is connected to an optical abdominal endoscope 78a that forms a first endoscope via a light guide cable 86a that transmits illumination light, and the illumination light generated by the first light source device 85a is It is supplied to the light guide of the optical abdominal endoscope 78a. And illumination light illuminates 53b etc. in the abdominal part 53a of the patient 53 in which the insertion part of the optical abdominal endoscope 78a was inserted.

A first camera head 79a as an image pickup apparatus including an image pickup device is attached to the eyepiece portion of the optical abdominal endoscope 78a to form a laparoscope 40a. An optical image of an affected area or the like by the observation optical system of the optical abdominal endoscope 78a is picked up by an image pickup element in the first camera head 79a.
A signal picked up by the image pickup device is transmitted to the CCU 41a as the image processing means via the camera cable 90a, and is subjected to signal processing by the image processing circuit 141c (see FIG. 12B) in the CCU 41a to obtain an image signal (or video signal). ) Is generated.
This image signal is input to the multiplexer 34B in the centralized control device 32. The signal is output to, for example, a first monitor 42a as a display device via a cable connected to the image output terminal Ch1 of the multiplexer 34B, and an image of the image signal of the first CCU 85a is displayed on the display surface of the first monitor 42a. To do.

In addition, the central control device 32 is connected to a hospital net (not shown) in a hospital (not shown) through a cable (not shown) so that image data on the hospital net can be output and displayed on the first monitor 42a or the like. I have to.
A carbon dioxide gas cylinder 92 is connected to the insufflator 91, and carbon dioxide is supplied into the abdomen of the patient 53 via an insufflation tube 93 extending from the insufflator 91 to the patient 53 placed on the bed 80. I can be hungry.

On the second trolley 94, a second monitor 42b, a second CCU 41b, a second light source device 85b, an ultrasonic device 46, a relay unit 100, and the like are mounted.
Each medical device mounted on the second trolley 94 is connected to the relay unit 100, and each medical device can bidirectionally communicate with the central control device 32 via the relay unit 100.
The second light source device 85b is connected to the optical abdominal endoscope 78b constituting the second endoscope via a light guide cable 86b that transmits the illumination light, and the illumination light generated by the second light source device 85b is It is supplied to the light guide of the optical abdominal endoscope 78b. The illumination light illuminates a lesioned part or the like in the abdomen of the patient 53 into which the insertion part of the optical abdominal endoscope 78b is inserted.

A second camera head 79b serving as an image pickup device including an image pickup device is attached to the eyepiece portion of the optical abdominal endoscope 78b, and an optical part such as a lesion part by the observation optical system of the optical abdominal endoscope 78b. An image is picked up by the image pickup device in the second camera head 79b.
A signal picked up by the image pickup device is transmitted to the second CCU 41b as the image processing means via the camera cable 90b, and is signal-processed by an image processing circuit in the second CCU 41b to generate an image signal (image thereof). .
The image of the image signal is output to the second monitor 42b as a display device via the multiplexer 34B in the central control device 32. The image selected by the multiplexer 34B is displayed on the display surface of the second monitor 42b.

The central control device 32 and the relay unit 100 are connected by a system cable 101.

Further, the central control device 32 is connected to a surgeon remote controller (hereinafter referred to as a remote controller) 102 for the surgeon to operate the medical device from the sterilization zone.
The second CCU 41b, the second light source device 85b, and the ultrasonic device 46 are connected to the relay unit 100 via a communication cable, and transmit and receive data. The second monitor 42b and the second CCU 41b are connected to the relay unit 100 by a video cable so that image signals can be transmitted to and received from the relay unit 100.

The matrix switcher 34 is provided in the central control device 32, but may be provided in the vicinity thereof, in the relay unit 100, or in the vicinity thereof.

In this modified example, in addition to the function of the second embodiment, sound input during operation can be recorded in synchronization with an image, and can also be recorded as a text file.

FIG. 28A shows an operation explanatory diagram of image and sound recording in this modification. The horizontal axis in FIG. 28A shows the passage of time.

When the user performs a touch operation for selecting (switching) the next scene from the current scene from the operation panel 33, the touch sensor of the operation panel 33 generates a detection signal corresponding to the operation position, and the central control device 32. Send to.

The control unit 63 of the centralized control device 32 recognizes that the selection is from the current scene to the next scene, and generates a scene selection signal corresponding to the next scene. Then, a control signal for operation and setting corresponding to the selected scene is transmitted to each medical device.

In the transmitted control signal, if image and sound recording settings are made, the recording device 35 records the image and sound in synchronization with the control signal. The voice recognition unit 83 in the central control device 32 generates a text file, and the recording device 35 records the text file.

In this way, by recording as a text file, when a user inputs a finding, the text file can be used efficiently. In addition, the second embodiment has the same effects as those of the second embodiment except that the operation when the end scope 40b in the second embodiment is replaced with the laparoscope 40a ′ is different.

In FIG. 27, the configuration may be such that the raparoscope 40a ′ is replaced with the end scope 40b described above.

Further, the above-described end scope 40b may be provided in addition to the two raparoscopes 40a and 40a ′. In this case, it is preferable to add a third CCU that performs signal processing on the image sensor of the end scope 40b and a third light source device that supplies illumination light.

Even in such a case, the present modification can smoothly perform treatment using a plurality of medical devices in each scene prepared in advance for performing different treatments according to the progress of the operation. The image that needs to be recorded can be appropriately recorded in synchronization with the scene selection. In addition, in synchronization with scene selection, it is possible to select and display an image that is desired to be displayed in each scene.

It should be noted that a scene switching operation is urged under the control of the central control device 32 in the vicinity of a timing at which a text file previously recorded in the recording device 35 or the central control device 32 is converted into sound and scene switching is performed. You may make it announce (by voice).

For example, in a case where a comment is input by voice in advance in a predetermined scene to be excised, after the surgeon performs the excision in the predetermined scene, voice input of a comment is input to the next scene. If a scene switching operation is performed in a state in which the operator does not, a confirmation of whether or not to proceed to the next scene without inputting a comment may be made to the operator.

FIG. 28B shows an explanatory diagram of such an operation. For example, a detection signal for a predetermined scene selection operation is output from the operation panel 33 at time t1, and the control unit 63 in the centralized control device 32 generates a predetermined scene selection signal corresponding to the detection signal. The control unit 63 transmits a control signal corresponding to the detection signal. Further, the control unit 63 monitors voice comment input.

The surgeon performs excision in the predetermined scene. After the excision treatment, when the user performs the next scene selection operation without voice input as shown at time t2, the operation panel 33 outputs a detection signal to the centralized control device 32.

When the central control device 32 determines that there is no voice comment input, it performs a voice notification (for example, notification that there is no voice comment input, etc.).

The surgeon can smoothly input voice comments by notification.

In this way, when an action or the like performed by the surgeon in a predetermined scene is set in advance, when an operation that moves to the next scene is detected without actually performing the action or the like in the scene, A notification is made to ask the operator to confirm whether or not the operation is valid. The surgeon can perform the operation more smoothly by notification.

As a third modification, in the case of FIG. 28B described above, an image recorded in the recording device 35 is further output, for example, to an external image input end of the CCU 41a (for example, an SD image), and (centralized control device 32 From) By sending a PoutP recording mode control signal to the CCU 41a, an image captured during the operation by the Laparoscope 40a and a past image (reference image) recorded in the recording device 35 are displayed on the monitor 42a with PoutP. Alternatively, a control method may be used.

In this case, when a predetermined scene is selected, an image when the recording device 35 has appropriately performed similar treatment in the past is output to the first CCU 41a (having a function of generating an HD format image). In addition, the operation panel 33 is set in advance.

In this case, an HD monitor capable of displaying HD images is used as the monitor 42a. By using the HD monitor, it is possible to arrange and display two SD images side by side on the display surface. The operation in this case is shown in FIG. 29A.

As in the case of FIG. 28B, the medical device such as the ultrasonic scalpel 44a and the CCU 41a is set in a setting state suitable for use in the selected scene (here, a predetermined scene) by the control signal synchronized with the scene selection. One can perform a resection procedure.

In this case, an image similar to the case where the treatment is performed by the laparoscope 40a is read from the recording device 35 to the CCU 41a and is input to the external image input end. In addition, an image by the laparoscope 40a is input to the image input end of the CCU 41a.

A control signal for generating a PoutP image is applied from the centralized control device 32 to the CCU 41a, and the CCU 41a outputs the image to the monitor 42a as an HD monitor via the multiplexer 34B in the PoutP output mode. The monitor 42a displays PoutP as if two images Ia and Ib are arranged adjacent to each other as shown in FIG. 29B.

When the surgeon intends to perform resection with the laparoscope 40a, an image obtained by appropriately performing the same treatment in the past is simultaneously displayed on the display screen of the same monitor 42a in the same display form, and the image is referred to. Thus, it becomes easy to perform a treatment such as excision smoothly.

In the above-described second embodiment, the recording device 35 has been described as configured to record images input to two channels. However, the recording device 35 is configured to record images input to three or more channels. Also good. Similarly, three or more image display devices that display images may be provided.

Also, the number of image output terminals to be selected and output by the image selector such as the matrix switcher 34 or the multiplexer 34B may be three or more.

Note that the recording device 35 of the second embodiment shown in FIG. 12A has a configuration in which a communication function for communicating with the centralized control device 32 and a control function by the control unit 67 are added to the configuration of the first embodiment. However, a configuration including a part of the configuration (for example, a configuration in which the communication IF 66 in FIG. 12A is omitted) may be used.

For example, in the configuration that does not include the central control device 32 in FIG. 10 as an image recording system, for example, a matrix into which a plurality of images including two images of CCUs 41a and 41b respectively connected to a laparoscope 40a and an end scope 40b are input. A switcher 34, a recording device 35 connected to the image output terminal of the matrix switcher 34, a multiplexer 34B in FIG. 26A or 26B for controlling selection by the recording device 35, and a monitor 42a for displaying an image selected by the multiplexer 34B, A configuration similar to that of the first embodiment including 42b may be used.

Then, in response to the scene selection described above, the control unit 67 controls so that the image to be recorded by the recording device 35 can be appropriately selected, and the multiplexer 34B displays an image corresponding to the scene selection. May be. In this case, the scene selection operation may be performed by a touch operation from the touch panel monitor 18.

In such a configuration, the recording device 35 can appropriately record an image in synchronization with the selection of a scene. Further, when the image selection function of the multiplexer 34B is provided, an image to be displayed can be appropriately selected and displayed in synchronization with the scene selection. For example, when the above-described combine surgery is performed, image recording appropriately corresponding to this, for example, a PinP composite image can be recorded.

In addition, the capture unit 11 as the input image selection unit selects selection information for selecting a predetermined number of images in time order and the selected predetermined number of images so that the control unit 67 can cope with an operation of selecting scenes in time order. On the other hand, the image processing information that defines the image processing content to be image processed by the image processing unit 13 may be stored in advance in the internal data storage unit 68b (as an information storage unit).

Then, the control unit 67 sequentially reads selection information and image processing information corresponding to the touch operation from the internal data storage unit 68b in response to the touch operation from the touch panel monitor 18, and the internal recording unit according to the selection information and the image processing information. A composite image or the like recorded by a recording unit 17 or the like may be controlled (appropriately according to the progress of surgery).

Instead of setting the scene as in the first embodiment, instead, the input of the input image selection unit (corresponding to the order of the touch operation) is input to the internal data storage unit 68b as the information storage unit. Information defining image selection or the like may be stored in advance, and the control unit 67 may read out the corresponding information in response to a touch operation, and perform the above-described control in accordance with the information.

In addition, it supplements that 2nd Embodiment mentioned above contains the following description content, for example. In the image recording system 31 described above, a user such as a surgeon registers and sets in advance so that a plurality of images (or a combination of a plurality of images) can be recorded in accordance with the progress of the surgery. When the user actually operates, selection can be made so that a plurality or a single image of an appropriate combination can be recorded according to the progress.

Therefore, when the surgeon performs an operation, the image recording system 31 can provide an option for performing selection to record a plurality or a single image of an appropriate combination in accordance with the progress of the operation.

Further, the image recording system 31 is not limited to the combination of images when recording, but can be similarly applied to the combination of images when displaying.

When a user such as an operator actually performs an operation by registering and setting so that a plurality of images (or a combination of images) can be displayed in advance according to the progress of the operation. In addition, it is possible to select a suitable combination of plural or single images according to the progress.

Therefore, when the surgeon performs an operation, the image recording system 31 can provide an option for selecting to display a plurality or a single image of an appropriate combination in accordance with the progress of the operation.

Including the case where the above-described image is recorded and the case where the image is displayed, the above-described image recording system 31 is an image in at least one of recording and display according to the progress of the operation when the surgeon actually operates. It becomes possible to select the combination. Therefore, according to the image recording system 31 described above, there is an effect that it is possible to assist the surgeon to perform the operation smoothly.

The present invention is not limited to the above-described first and second embodiments and modified examples, and embodiments configured by partially combining them also belong to the present invention.

This application is filed on the basis of the priority claim of Japanese Patent Application No. 2010-128147 filed in Japan on June 3, 2010, and the above disclosure is disclosed in the present specification, claims, It shall be cited in the drawing.

Claims (20)

1. A plurality of images respectively acquired by a plurality of medical devices are input, and an input image selection unit capable of selecting a predetermined number of images;
   An image processing condition selection unit capable of selecting a predetermined image processing condition including synthesis processing for a predetermined number of images selected by the input image selection unit;
   An image processing unit that performs image processing including synthesis processing on the predetermined number of images based on the condition selected by the image processing condition selection unit;
   An output switching unit that outputs a predetermined number of images processed by the image processing unit as a single composite image to a predetermined output destination;
   A recording unit for recording the composite image output by the output switching unit;
   An image recording system comprising:
2. The image recording system according to claim 1, wherein the image processing condition includes any one of a cutout size, a composite pattern, and a resolution of a plurality of images.
3. The image processing unit changes the resolution of each image according to the cut-out size of each image when a cut-out size including an aspect ratio in the combining process is set for a predetermined number of images to be combined. The image recording system according to claim 1.
4. The image processing unit changes the resolution of each image according to the cut-out size of each image when a cut-out size including an aspect ratio in the combining process is set for a predetermined number of images to be combined. The image recording system according to claim 2.
5. A holding unit that holds a plurality of sets of composite images, each of which is a predetermined number of the plurality of images, in a plurality of output channels;
   The image recording system according to claim 1, wherein the recording unit simultaneously records a plurality of sets of composite images from the plurality of output channels input via the output switching unit.
6. Further, selection information for the input image selection unit to select a predetermined number of images in time order, and image processing information for defining image processing contents to be image-processed by the image processing unit for the predetermined number of selected images. Having an information storage unit for storing in advance;
   The image recording system according to claim 1, wherein a composite image recorded by the storage unit is controlled according to the selection information and the image processing information sequentially read from the information storage unit by a touch operation.
7. The plurality of medical devices include a rigid endoscope having a rigid insertion portion, and a flexible endoscope having a flexible insertion portion,
   The recording unit is inserted into the abdomen of the patient and inserted into the digestive tract of the patient, the first image acquired by the rigid endoscope that images the treatment target site in the abdomen, The second image acquired by the flexible endoscope that captures the vicinity of the treatment target region from the inside of the intestinal tract is recorded as a PinP composite image, and output so that the PinP composite image is displayed on the image display device The image recording system according to claim 1, wherein:
8. A central control unit that connects multiple medical devices and centrally controls each medical device;
   An image selection unit that selects a predetermined number of images from a plurality of image output medical devices having a function of outputting images in the plurality of medical devices;
   An image recording unit capable of recording the predetermined number of images selected by the image selection unit;
   In order to perform treatment in a plurality of scenes corresponding to cases, a device setting unit that selects and sets medical devices to be operated in each of the plurality of scenes from the plurality of medical devices;
   A scene selection unit that temporally selects one scene from the plurality of scenes after setting by the device setting unit;
   Have
   In accordance with the one scene selected from the scene selection unit, the central control unit controls the operation of the medical device operated in the one scene from the plurality of medical devices, and also controls the image recording unit. An image recording system for controlling the recording of an image of an image output medical device operated in the one scene.
9. In synchronization with the selection of one scene by the scene selection unit, the image recording unit generates a folder having a folder name corresponding to the selection of the one scene, and records the folder with the image recording unit after the selection of the scene. 9. The image recording system according to claim 8, wherein an image is stored in the folder.
10. The scene selection unit includes a scene number setting unit for changing and setting the number of the plurality of scenes, and the device setting unit is operated in each scene set by changing the scene number setting unit. 9. The image recording system according to claim 8, wherein the image recording system is configured to set a medical device.
11. The image recording unit can record a plurality of different images in a set recording mode including a PinP recording mode in synchronization with the selection of the one scene by the scene selection unit under the control of the central control unit. The image recording system according to claim 8, wherein:
12. The central control unit controls each of a plurality of image display devices included in the plurality of medical devices to selectively display an image to be displayed in synchronization with the selection of the one scene by the scene selection unit. The image recording system according to claim 8, wherein:
13. And a second image selection unit that selects and outputs a plurality of images output from the plurality of image output devices to a plurality of image display devices included in the plurality of medical devices,
    The central control unit selects the plurality of images to be recorded by the image recording unit in synchronization with the selection of the one scene by the scene selection unit, and the second image selection The image recording system according to claim 8, wherein the selection operation by the unit is controlled in synchronization.
14. The image recording system according to claim 8, further comprising a voice input unit for inputting voice, wherein the image recording unit records voice input from the voice input unit.
15. The image recording system according to claim 8, further comprising a notification unit that performs voice notification in synchronization with selection of a predetermined scene by the scene selection unit.
16. A first step of generating a scene selection signal for selecting one scene from a plurality of scenes prepared in accordance with the progress of surgery;
    A second step of generating a control signal for setting a medical device used in the scene selected by the scene selection signal to an operating state in synchronization with the scene selection signal from a plurality of medical devices prepared in advance; ,
    A plurality of image outputs included in the plurality of medical devices A switching control signal for switching an image selection operation of an image selection unit to which a plurality of images output from the medical devices are input in synchronization with the scene selection signal is generated. A third step,
    A fourth step of recording a plurality of images selected by the image selection unit in a recording mode selected in advance corresponding to the selected scene in synchronization with the switching control signal;
    An image recording method comprising:
17. Furthermore, it has a folder generation step for generating a different folder for each scene,
    The image recording method according to claim 16, wherein when the image is recorded in the fourth step, the image is recorded in a folder corresponding to the scene selected by the scene selection signal.
18. The image recording method according to claim 16, wherein in the fourth step, two sets of images each consisting of two images can be recorded in a PinP recording mode.
19. Further, the selection operation in the second image selection unit that selects a predetermined number of images from a plurality of images output from the plurality of image output medical devices and outputs the selected images to the predetermined number of display medical devices, 17. The image recording method according to claim 16, further comprising a step of generating a switching control signal for switching in synchronization with the scene selection signal.
20. The plurality of medical devices include a rigid endoscope having a rigid insertion portion, and a flexible endoscope having a flexible insertion portion,
    Furthermore, the first image acquired by the rigid endoscope that is inserted into the abdomen of the patient and images the region to be treated in the abdomen, and is inserted into the digestive tract of the patient, and from the inside of the intestinal tract in the abdomen The second image acquired by the flexible endoscope that captures the vicinity of the site to be treated is synchronized with the selection of a predetermined scene in the plurality of scenes, and the first image and the second image The image recording method according to claim 16, further comprising a display control step of controlling the image display device to display the image as a PinP composite image.
    
    

Images