JP2005118232A - Surgery support system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a surgery support system for properly supporting a surgery on the side of a surgical room by recording the voices of a surgeon and a supporting surgeon at a remote place on the side of the surgical room with an endoscope image and transmitting the voices to record or recorded voices and the endoscope image to the outside. <P>SOLUTION: The surgery support system 1 is provided with endoscope apparatus 30 in a first surgical room 1A. Under control of CPU 43, the endoscope apparatus 30 outputs the image signal of the endoscope and a voice signal being the voices of the surgeons fetched from an earphone microphone 33 to an image file part 11A in a second controller 14. Thus, in the image file part 11A, the image signal with voices of the the endoscope image obtained by the endoscope apparatus 30 is recorded. By using the card type terminal device 34 of the endoscope apparatus 30, the image signal and the image signal with the voices of the endoscope apparatus stored in the image file part 11A can be transmitted to PHS 34A in the hospital, the remote place etc. where the same card type terminal device is arranged. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention is capable of transmitting and receiving support information and endoscopic observation images for connecting an operating room side and a remote place through a communication line to support an operating room operator by a remote support operator. Related to a surgical operation support system.

  2. Description of the Related Art Conventionally, an endoscope system includes an endoscope with an external endoscope having a television camera attached to the eyepiece portion of the optical endoscope and an electronic endoscope having an imaging means built in the distal end portion. It is widely used as a system that displays an endoscopic image captured on the monitor on a monitor, and allows observation and treatment while viewing the image.

  This type of endoscope system includes, for example, an electronic endoscope, a light source device that supplies illumination light to the electronic endoscope, and a camera controller that includes an image signal processing circuit for displaying an endoscopic image. And a TV monitor for displaying an endoscopic image, and further, for example, an insufflation apparatus, a high-frequency cauterization apparatus, or the like can be used as a peripheral device to perform observation / treatment or surgery under endoscopic observation. .

  In such an endoscope system, even an inexperienced operator has an experienced operator observe the endoscopic image displayed on the monitor together, and the instruction of the skilled operator is given. Surgery can be performed reliably by receiving. In this endoscope system, an endoscopic image of an affected part (target region) displayed on a monitor is important, and the displayed endoscopic image indicates an affected part (target region) desired by a skilled surgeon. When the image is not a mirror image, the surgeon can perform a smooth operation by, for example, performing an endoscopic operation so as to display the endoscopic image of the affected part desired by the skilled operator, verbally or directly to the operator. .

  In such an endoscope system, when a skilled surgeon is in another place such as a remote place, there is an operator who actually performs an operation, such as a hospital with a surgeon who is a support person in a remote place. There is a system that connects the operating room with a public line and supports the operator in the operating room to perform appropriate surgery on the patient while receiving instructions from a remote operator. .

  As a related technology of the system for remotely supporting the surgery in this way, for example, the surgical information display method described in Japanese Patent Laid-Open No. 2000-270318 or Japanese Patent Laid-Open No. 2000-237206 proposed by the applicant of the present application. There is a remote surgery support system described in.

  In the surgical information display method described in Japanese Patent Laid-Open No. 2000-270318, the control content of the surgical tool is input to the controller, and the control content of the surgical tool and the endoscopic image are remotely transmitted via the controller via a communication line. A step of transmitting to the ground, and a step of displaying the control contents of the surgical tool and the endoscope image on a monitor on the remote side.

  With this configuration, it is intended to realize a surgical information display method capable of providing support for instructions and the like while confirming the state of the surgical instrument as well as observing an endoscopic image.

  Further, the remote surgery support system described in Japanese Patent Laid-Open No. 2000-237206 is obtained by an endoscope imaging unit that images a body cavity arranged in an operating room, and an endoscope imaging unit that is connected to a communication line. A video transmission device for transmitting an image signal in the body cavity to the remote room side, and an image signal insulation means for electrically isolating the endoscope imaging means from the video transmission device and transmitting the image signal. doing.

  By the way, in the conventional remote surgery support system as described above, an endoscope is provided between the operating room side and the remote site side in order to support the surgeon's operation in the operating room by the remote support operator. Support information such as image signals of images and instructions from remote support surgeons is transmitted, but the cursor is displayed on the endoscopic images displayed on both the operating room side and remote side monitors. A method is adopted in which an overlay is displayed at the same position to facilitate support. However, in the case of providing more detailed support, there may be a case where the cursor display as described above is not sufficient. Support information such as instructions from the support surgeon transmitted to the surgeon is mostly based on endoscopic images. Therefore, it is desired to use the voice of the surgeon or the support surgeon effectively. .

  In the remote operation support system, usually, when an operator cannot release his / her hand in an operation room, for example, a remote support operator or the like makes an emergency call to the operator by telephone or interphone. When a call is received, the assistant picks up the handset and the surgeon makes a call without touching the handset. In this case, the assistant is pointing the receiver toward the operator so as not to obstruct the operator, but such a system is troublesome for the assistant and the operator.

In conventional remote surgery support systems such as Japanese Patent Laid-Open No. 2000-270318 and Japanese Patent Laid-Open No. 2000-237206, means for safely and effectively performing surgery on an operating room or an operator are shown. However, it is shown that the endoscopic image of the patient and instructions from the remote support operator and the voice by the operator are transmitted and recorded wirelessly between the operating room side and the remote site side. In addition, when the surgeon performs an operation while grasping the endoscope apparatus, voice support such as instructions between the remote support operator and the operator who is actually performing the operation is more effective. It doesn't show how easy it is to do.
JP 2000-270318 A JP 2000-237206 A

  The problem to be solved is to transmit and record the endoscopic image of the patient and instructions from the remote support operator and the voice by the operator between the operating room side and the remote side. In addition, when the surgeon performs an operation while grasping the endoscope device, voice support such as instructions between the remote support operator and the operator who is actually performing the operation is provided. It has not been easier to do.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a surgical operation support system that can record the voices of an operator and a remote support operator together with an endoscopic image on the operating room side. And In addition, the present invention is configured to be able to record on the operation side, or to transmit the recorded voice and endoscope image to the outside, so that support in the operation on the operation room side can be performed more simply and appropriately. An object of the present invention is to provide a surgical operation support system that can be used.

  The operation support system of the invention of claim 1 connects an operation room and an operation support room different from the operation room through a communication line, and enables operation information to be transmitted and received via the communication line. In the system, recording means for recording sound included in the information relating to the surgery is provided at least in the operating room, and recording means for recording sound included in the information relating to the surgery is provided in at least the operating room. It is characterized by providing.

  The operation support system according to a second aspect of the present invention is the operation support system according to the first aspect, wherein at least a voice included in the information related to the operation can be transmitted and received between the operation room and the operation support room wirelessly. The communication means is provided.

  The operation support system according to claim 3 is the operation support system according to claim 2, wherein the recording means connects an image acquisition means for acquiring an image, and the image and the information acquired from the image acquisition means are connected. The image included can be recorded, and the communication unit transmits the sound recorded in the recording unit, the image captured from the image acquisition unit, and the image included in the information to the surgery support room. It is a feature.

  A surgery support system according to a fourth aspect of the present invention is the surgery support system according to the second aspect, wherein output means for playing back and outputting sound included in the information related to the surgery received by the communication means, and the operating room. It is provided in at least one of the surgery support room.

  The surgical operation support system of the present invention has an advantage that the voice of the operator and the remote support operator can be recorded together with the endoscopic image on the operating room side. In addition, the operation support system of the present invention is configured to be able to record on the operating room side or to transmit the recorded voice and endoscopic image to the outside, so that the operation support on the operating room side can be performed more easily. And it has the advantage that it can be performed appropriately.

  Embodiments of the present invention will be described below with reference to the drawings.

First embodiment

  1 to 3 show a first embodiment of a surgery support system according to the present invention, FIG. 1 is a configuration diagram showing the overall configuration of the surgery support system, and FIG. 2 is an external view of the endoscope apparatus shown in FIG. The block diagram which shows a structure. FIG. 3 is a block diagram showing an electrical configuration of the endoscope apparatus shown in FIG.

  As shown in FIG. 1, the surgery support system 1 of the present embodiment performs, for example, surgery under endoscopic observation, and a first operating room 1A serving as a base on the side to be supported, and the first operating room. The second and third operating rooms 1B, 1C... Arranged in the hospital having 1A and the first to third operating rooms 1A to 1C... Are arranged in remote locations (hereinafter referred to as conferences). 1D and a first controller 3 installed in the first operating room 1A as a control means for obtaining various medical information generated in the operating room and performing transmission control of an endoscopic observation image, etc. And a surgical section server 4 that is installed in a different place from the first operating room 1A, accumulates various medical treatment information obtained by the first controller 3, and generates a medical chart, and the surgical section server 4 Is installed in a different place and obtained by the surgical unit server 4 An in-hospital server 5 that references medical chart information, a World Wide Web server (World Wide Web server, hereinafter referred to as a WEB server) 7 that enables Internet connection via the in-hospital communication line 6, and the first controller 3 And another conference room (not shown) connected to the signal transmission device 17 via the communication line 9 and the endoscope device 30 arranged in the first operating room 1A and connected to the second controller 15. And is configured.

  In the surgical operation support system 1, the first controller 3 is connected to the second operating room 1 </ b> B, the third operating room 1 </ b> C, the conference room 1 </ b> D, and the operating unit server 4 via the operating room communication line 8. Has been. The surgical department server 4 is connected to the hospital server 5 through the hospital communication line 6.

  Each of the communication lines 6 and 8 may be any communication line such as a public line, a dedicated line, or a LAN (local communication network). Further, the in-hospital server 5 may be installed in the same place as the surgical operation section server 4. The conference room 1D is arranged in the hospital as a support room for supporting the first operating room 1A, but may be arranged in a remote place outside the hospital.

  The second controller 14 is connected to an endoscopic device 30, and obtains an image signal that is an endoscopic image by imaging a test site such as a body cavity of a patient by the endoscopic device 30. A video / light source device 11 for irradiating an examination site with illumination light through the distal end of the endoscope device 30; a display device 12 for displaying an image signal obtained by the video / light source device 11; The surgical device 13 such as a female device, a pneumoperitoneum device, and an ultrasonic surgical device, and the image file unit 11A as a recording unit that stores an audio signal from the endoscope device 30 together with an image signal, Surgical device information such as measurement information by the surgical device 13 is obtained.

  The second controller 14 is connected to a touch panel 15 as input means for inputting a control instruction or the like for the surgical apparatus 13.

  Surgery device information given from the second controller 14 and patient information obtained from a patient monitoring device 18 to be described later are integrated into the first controller 3 via a communication line and are installed at other locations. It is transmitted to the server 4 via the operating room communication line 8.

  The patient monitoring device 18 constantly detects and monitors patient information (biological information) such as a patient's blood pressure, heart rate, and blood oxygen concentration.

  Further, the image signal obtained from the video / light source device 11 and the image signal obtained from the indoor camera 20 that captures the scenery in the operating room are input to the first controller 3 via the operating room communication line 8. It is transmitted to the conference room 1D.

  Therefore, the present surgery support system 1 receives the transmitted image signal that is an endoscopic image and the image signal that captures the situation in the operating room on the conference room 1D side that is different from the first operating room 1A. By displaying it on a monitor (not shown), the operator in the conference room 1D recognizes this, and an image signal for assisting the operator in the first operating room 1A to perform an appropriate operation on the patient. Support information or the like is transmitted to the first operating room 1A via the operating room communication line 8 and displayed on the display device 19 to be described later, or in real time using a headset (not shown) having a microphone and an earphone. Support can be provided by instructing by voice.

  The image signal obtained from the video / light source device 11 and the image signal obtained from the indoor camera 20 that captures the scenery in the operating room are input to the signal transmission device 17 via the first controller 3 and communicated. It is transmitted to the outside (for example, a conference room in another remote location) via the line 9.

  Further, a display device 19 is disposed in the first operating room 1A. In addition to displaying the surgical device information obtained by the first controller 3 and the patient information obtained from the surgical section server 4 and the endoscopic image signal for surgical support from the conference room 1D, the display device 19 transmits signals. The device 17 displays information received from the outside via the communication line 9.

  The surgical department server 4 is connected to a hospital server 5 and a WEB server 7 via a hospital communication line 6. Therefore, in the hospital, since the WEB server 7 is also connected to the outside of the hospital via the Internet, it is possible to capture necessary information from outside the hospital.

  The in-hospital server 5 includes patient registration information from the in-hospital patient registration terminal 22, preoperative images such as MR, CT, and X-ray images related to the patient, and previous intraoperative images (for example, endoscopic moving images). Such medical images are accumulated. The in-hospital server 5 is supplied with an image signal of an endoscopic image obtained by the video / light source device 11 in real time, and accumulates the image signal.

  The surgery section server 4 reads registration information such as the name, date of birth, and medical record of the patient performing the surgery and a medical image related to the patient from the hospital server 5 via the hospital communication line 6. .

  The first controller 3 performs various main controls in the entire first operating room 1A. The first controller 3 controls the storage of data such as the endoscopic image and the patient information and the image signal for driving the display device 19. Display control for generating and displaying, drive control for the patient monitoring device 18 and the second controller 14, transmission control for transmitting biological information and surgical device information, etc. via the operating room communication line 8, and the signal transmission device 17 Input / output control for inputting / outputting video information including endoscopic images and support information and transmission / reception control for transmitting / receiving information via the operating room communication line 8 are performed.

  In addition, an input device 3 a is connected to the first controller 3. The input device 3a is a keyboard, a magnetic card reader, an optical card reader, an IC card reader, or the like, and uses this input device 3a to input patient information such as a patient's medical record number (ID number) and name.

  Note that the input device 3 a may be connected to the second controller 14. When the input device 3 a is connected to the second controller 14, patient information is transmitted from the second controller 14 to the first controller 3.

  The surgery support system 1 includes an endoscope device 30 connected to the video / light source device 11 of the first controller 14.

  As shown in FIG. 2, the endoscope apparatus 30 includes an objective optical system, a solid-state imaging device (hereinafter referred to as a CCD) 30a and the like at the distal end portion, and a bending portion that can be bent at the distal end side. An insertion portion 30A to be inserted into the insertion portion, a proximal end side of the insertion portion 30A, a switch for performing the bending operation of the bending portion, a switch for supplying air and water, a recording button 31 and the like (not shown) An operation unit 30B that performs various operations provided, and a universal cord 30C that extends from the side of the operation unit 30B and connects the endoscope device 30, the video / light source device 11, and the second controller 14. ,have.

  As shown in FIG. 3, the insertion unit 30A is internally provided with a signal cable for photoelectrically converting the observation image captured by the objective optical system with the CCD 30a and transmitting the photoelectrically converted imaging signal to the operation unit 30B. ing. Further, the insertion portion 30A includes a signal cable for supplying a CCD drive signal for driving the CCD 30a to the CCD 30a, a light guide (not shown), and the like. Note that the base ends of these signal cables are connected to a CCD drive circuit 37 and an image signal processing circuit 38 in an operation unit 30B described later.

  The universal cord 30C has a light guide and various signal cables (not shown) inserted therein. A connector portion (not shown) is provided at the base end portion of the universal cord 30C, and is detachably connected to the video / light source device 11 in the second controller 14 via the connector portion. It has become.

  The operation portion 30B is configured to have a grip portion on the proximal end side that is gripped and gripped by an operator. On the upper side of the operation unit 30B, a recording button 31 for recording the image signal of the endoscopic image together with the voice of the surgeon, a speaker 32 that emits voice such as instructions from a remote place, and the voice of the surgeon The earphone / microphone 33 for capturing the voice, the voice from the remote place provided by the speaker 32, the voice of the operator captured by the earphone / microphone 33, and the internal voice For example, a card-type terminal device 34 is provided as a communication means capable of communicating an image signal of an endoscopic image to a PHS (Personal Handyphone System) 34A or the like.

  The recording button 31 is arranged at a position on the operation unit 30 that is easy for an operator to operate. When the recording button 31 is pressed, the recording button 31 is captured by the earphone / microphone 33 together with an image signal obtained by the CCD 30a. This is a switch for recording an audio signal that is the voice of the surgeon in the image file section 11A described later.

  The speaker 32 is arranged on an operation unit 30B where an operator can easily hear a voice such as an instruction from a remote operator, and is electrically connected via an earphone / microphone terminal 33a to which an earphone / microphone 33 is connected. Connected. Accordingly, when the patient does not want to hear the voice of the assisting surgeon's instruction from the remote place output from the speaker 32, the earphone of the earphone / microphone 33 is used to listen to the voice of the instruction or the like from the remote place. Be able to. Note that the speaker 32 is preferably of a type that has, for example, airtightness and outputs sound by vibration by a vibrating member.

  The earphone / microphone 33 is formed by integrating an earphone 33c and a microphone 33b. Although not shown, the signal line 33d for connecting the earphone / microphone 33 and the earphone / microphone terminal 33a is wound around and stored in the operation unit 30B, and is used by pulling out only a necessary length when used. Be able to.

  The card-type terminal device 34 is a PHS card 34a, which is a PC card, and a PC card slot in which the PHS card 34a can be detachably attached. A PCMCIA (Personal Computer Memory Card International) installed in the operation unit 30B main body. Association) I / F circuit 34b.

  The card-type terminal device 34 uses PCMCIAI / images of the voice of the operator and the image signal of the endoscope image captured by the earphone / microphone 33 from the remote place, such as instructions from a remote place, emitted from the speaker 32. The signal can be converted into a signal suitable for transmission by F34b, and the converted signal can be transmitted by the PHS card 34a to the in-hospital PHS 34A or a conference room in which a similar card-type terminal device outside the hospital is arranged.

  As described above, the endoscope apparatus 30 serves as the video / light source apparatus 11, the second controller 14, and recording means for recording the image signal of the endoscopic image and the operator's audio signal via the universal code 30C. Are connected to the image file section 11A. Note that FIG. 2 omits the connection between the endoscope apparatus 30 and the video / light source apparatus 11 by a light guide or the like.

  The image file unit 11A is provided in the second controller 14 and is an image signal that is an endoscopic image obtained by the endoscope device 30 and an operator's image captured by the earphone / microphone 33. Store the audio signal.

The image file unit 11A is connected to image acquisition means such as a digital camera 23 and an ultrasonic diagnostic apparatus 24, and image signals necessary for observing and treating the patient via these image acquisition means. It can be imported. The image signal captured in the image file unit 11A is sent to the in-hospital PHS 34A or a conference room where a similar card-type terminal device outside the hospital is arranged by the card-type terminal device 34 via the endoscope device 30. The image file unit 11A may be provided in the video / light source device 11 or in the first controller 3.

  The PHS 34A is an existing PHS 34A capable of communication and data communication with weak radio waves permitted for use in the hospital.

  Next, an electrical circuit configuration of the endoscope apparatus 30 will be described with reference to FIG.

  As shown in FIG. 3, the operation unit 30B of the endoscope device 30 includes a recording button 31, a speaker 32, an earphone / microphone terminal 33a for connecting an earphone / microphone 33, a card-type terminal device 34, The detachable battery 35 that can be attached to and detached from the operation unit 30B that is a power supply source of the entire endoscope apparatus 30 and the recording of the image signal of the endoscope image and the operator's audio signal are controlled based on the operation of the recording button 31. From a recording control circuit 36, a CCD drive circuit 37 for controlling the drive of the CCD 30a, an image signal processing circuit 38 for processing an image pickup signal of the CCD 30a to obtain an image signal, an audio signal output from the speaker 32 and an earphone / microphone 33 The voice input / output control circuit 39 for controlling the input / output of the voice signal to be taken in and the circuits in the operation unit 30B are transmission paths for exchanging various signals. A video / audio input / output circuit 41 for controlling input / output of an audio signal output to the bus 40, an audio signal output to the speaker 32, an audio signal captured from the earphone / microphone 33, and an image signal of an endoscopic image, and the endoscope apparatus 30 A ROM 42 storing a program for controlling various operations of the above, a CPU 43 for controlling the entire endoscope apparatus 30, a RAM 44 used as a work area for executing the program and various processes by the CPU 43, have.

  The endoscope apparatus 30 is provided with a removable battery 35 that can be attached and detached, so that an image signal of an endoscope image, an audio signal such as an instruction from a remote place, and an audio signal output by an operator are displayed. Since it can send and receive, it is also effective for use outside the hospital. The detachable battery 35 may be omitted.

  The recording button 31 is connected to the bus 40 via the recording control circuit 36. When the recording button 31 is pressed, an operation signal generated by the recording button 31 is output to the recording control circuit 36 and the bus 40 and is output to the CPU 43 connected to the bus 40.

  The CPU 43 reads out a program stored in the ROM 42 and writes it in a predetermined area of the RAM 44. Thereafter, the CPU 43 executes recording control, audio recording control, transmission control, and the like according to the program.

  When an operation signal from the recording button 31 is output, the CPU 43 executes a corresponding program, and outputs an image signal of an endoscopic image from the image signal processing circuit 38 and an audio input / output control circuit 39 described later. A voice signal, which is the voice of the surgeon to be performed, is written in a predetermined area in the RAM 44 to prepare for recording. For example, the CPU 43 writes the image signal of the endoscope image of the still image and the voice signal of the surgeon.

  In this embodiment, the present invention is not limited to a still image, and an image signal of an endoscopic image of a moving image may be written together with an operator's audio signal.

  The voice input / output control circuit 39 takes, for example, a voice signal such as an instruction from a remote place received from the remote terminal via the card type terminal device 34 via the bus 40 and outputs it to the speaker 32, or the earphone. Control is performed so that a voice signal of the surgeon's voice captured by the earphone / microphone 33 connected to the microphone terminal 33 a is output on the bus 40.

  The voice input / output control circuit 39 always supplies a voice signal, which is the voice of the surgeon, to the image file unit 11A in the second controller 14 via the video / audio input / output circuit 41 and the universal code 30C. It is supposed to be.

  When the recording button 31 is pressed, the recording control circuit 36 reads out the image signal of the endoscopic image written in the RAM 44 and the audio signal that is the voice of the surgeon under the control of the CPU 43, The signal is converted into a signal for recording in the file portion 11A and recorded in the image file portion 11A in the second controller 14 via the video / audio input / output circuit 41. As a result, the image signal of the endoscope image with sound obtained by the endoscope apparatus 30 is recorded in the image file 11A.

  The image signal processing circuit 38 performs signal processing on the image pickup signal from the CCD 30 a to obtain an image signal, and supplies the image signal to the second controller 14 via the video / audio input / output circuit 41 at all times. Therefore, the image signal of the endoscopic image is displayed on the display device 12 in real time. Further, the image signal of the endoscopic image is supplied to the first controller 3 via the second controller 14, and the conference room 1 </ b> D via the operating room communication line 8 is controlled by the first controller 3. Etc. are transmitted.

  Further, when the CPU 43 receives an audio signal such as an instruction from a remote supporter via the card type terminal device 34, the CPU 43 controls the card type terminal device 34 to send the received audio signal to the bus. Supplied to the voice input / output control 39 via 40. The supplied audio signal can be output by the audio input / output control circuit 39 through the speaker 32 or the earphone 33c of the earphone / microphone 33.

  The video / audio input / output circuit 41 controls signal input / output by the CPU 43. For example, when recording in the image file unit 11A, the video / audio input / output circuit 41 outputs an audio signal or an image signal with audio to the image file unit 11A. On the other hand, when the video / audio input / output circuit 41 transmits the image signal of the endoscope image or the image signal with sound stored in the image file unit 11A to a remote place or the like using the card type terminal device 34, the video / audio input / output circuit 41 A signal or an image signal with sound is taken into the endoscope apparatus 30.

  Then, the card-type terminal device 34 controls the CPU 34 to control the image signal input by the video / audio input / output circuit 41 and the image signal with sound from the PHS 34A, for example, a remote where the same card-type terminal device is arranged. Send to the ground.

  Next, the operation of the present surgery support system will be described with reference to FIGS.

  When performing observation / treatment under endoscopic observation using the present surgery support system 1, the operator in the first operating room 1A uses the endoscope apparatus 30 shown in FIG. 2 to observe the patient's body cavity. -Take action.

  In this case, as shown in FIG. 3, the endoscope apparatus 30 converts an image pickup signal from the CCD 30a built in the distal end side of the insertion portion 30A into an image signal by performing signal processing in an image signal processing circuit 38. After that, this image signal is output to the second controller 14 via the video / audio input / output circuit 41 and the universal code 30C. Then, the second controller 14 records the image signal of the endoscopic image in the image file unit 11A or supplies it to the first controller 3 so that the conference room 1D is connected via the operating room communication line 8. Etc. are transmitted.

  Further, when the endoscope apparatus 30 receives an audio signal such as an instruction of a support prescriber from a remote place via the card type terminal device 34, the CPU 43 controls the card type terminal device 34. The received voice signal is supplied to the bus 40 and the voice input / output control 39, and the voice such as the instruction from the remote operator is outputted from the speaker 32 or the earphone 33c of the earphone / microphone 33. Thereby, the surgeon can hear the voice of the support surgeon's instruction from a remote place by a simple method.

  Further, the endoscope apparatus 30 captures the operator's voice by the microphone 33b of the earphone / microphone 33, and the voice signal that has been captured and converted by the voice input / output control circuit 39 is indicated by a broken line in FIG. Thus, the video / audio input / output circuit 41 and the universal code 30C are supplied to the image file unit 11A in the second controller 14 at all times.

  Now, assuming that the surgeon presses the recording button 31 of the operation unit 30B of the endoscope apparatus 30, the CPU 43 outputs the image signal of the endoscopic image from the image signal processing circuit 38 and the voice input / output control circuit 39. A voice signal, which is the surgeon's voice output from, is written in a predetermined area in the RAM 44 to prepare for recording. In this case, the image signal of the endoscope image of the still image is basically written together with the voice signal of the surgeon, but the image signal of the endoscope image of the moving image may be written together with the voice signal of the surgeon.

  The voice input / output control circuit 39 reads the image signal of the endoscopic image written in the RAM 44 and the voice signal which is the voice of the surgeon under the control of the CPU 43 and records them in the image file unit 11A. And is recorded in the image file section 11A in the second controller 14 via the video / audio input / output circuit 41. As a result, an image signal with sound of the endoscopic image obtained by the endoscope apparatus 30 is recorded in the image file 11A.

  Further, in the present surgery support system 1, when the image signal of the endoscopic image and the video signal with sound stored in the image file unit 11A are transmitted to another remote place using the card type terminal device 34, the CPU 43 The video / audio input / output circuit 41 is controlled, and the corresponding image signal and the image signal with sound are taken into the endoscope device 30 from the image file unit 11A, and the card type terminal device 34 uses the PHS 34A, For example, it transmits to a remote place where the same card type terminal device is arranged.

  Therefore, according to the present embodiment, the image signal of the endoscopic image and the audio signal that is the voice of the surgeon can be recorded in the image file unit 11A in the second controller 14, so that the endoscope The operator's clear instruction according to the image can be reliably stored together with the endoscopic image. Further, the image signal with sound recorded in the image file unit 11A can be transmitted by the card type terminal device 34 to the in-hospital PHS 34A, for example, a remote place where the same card type terminal device is arranged, etc. You can ask the support surgeon for more detailed support depending on the situation.

Second embodiment

  FIG. 4 shows a second embodiment of the surgery support system according to the present invention, and is a configuration diagram showing the overall configuration of the surgery support system. In FIG. 4, the same components as those in the first embodiment are denoted by the same reference numerals, description thereof is omitted, and only different portions are described.

  The surgical operation support system 1 of the present embodiment is configured by providing a card type terminal device 50, a controller 3A, a display device 18A, and a headset 60 in the conference room 1D, so that the first operating room 1A side and the conference room 1D side are provided. The transmission and reception of image signals and audio signals of endoscopic images relating to surgery are enabled.

  As shown in FIG. 4, in the present surgery support system 1, an endoscope apparatus 30 is provided in the first operating room 1A as in the first embodiment. Further, a headset 45 that operates in substantially the same manner as the earphone / microphone 33 of the first embodiment is attached to the head of the surgeon 100. The headset 45 includes a microphone 45 a that captures the voice of the surgeon, an earphone 45 b that outputs a voice such as an instruction from a support surgeon in the conference room 1 D, and the microphone 45 a and the earphone 45 b in the endoscope device 30. A connection cord 45c that is electrically connected to the earphone / microphone terminal 33a.

  On the other hand, the conference room 1D includes a card type terminal device 50 that enables transmission and reception of various signals to and from the card type terminal device 34 of the endoscope device 30 in the first operating room 1A, and the card type terminal device 50. Wirelessly connected to a controller 3A connected to a USB (Universal Serial Bus), a display device 18A for displaying an image signal of an endoscopic image received from the first operating room 1A received by the card type terminal device 50, and the controller 3A, A headset 60 provided with a microphone 60a that outputs the voice signal of the surgeon in the first operating room 1A received by the card type terminal device 50 through the earphone 60b and captures the voice of the support surgeon in the conference room 1D. And have.

  The controller 3A is connected to the first operating room 1A via the operating room communication line 8. The controller 3A receives an image signal of an endoscopic image for performing reception control and support of an image signal of an endoscopic image and an image signal with sound from the first operating room 1A via the operating room communication line 8. Controls transmission of voice signals such as instructions.

  Further, the controller 3A controls the display of the received endoscopic image signal on the display device 18A, the control of the audio signal such as the operator's instruction to the headset 60, and the received first operating room 1A. Controls the output of the operator's audio signal.

  The card-type terminal device 50 is configured in substantially the same manner as the card-type terminal device 34 of the first embodiment, and a PHS card 50a that is a PC card and a PC in which the PHS card 50a can be detachably attached. A card slot and a PCMCIAI / F circuit 50b.

  The card-type terminal device 34 is supplied with a voice signal such as an instruction from a support surgeon of the conference room 1D supplied by the microphone 60a of the headset 60 supplied through the controller 3A, or for example, a cursor for support. The image signal of the endoscopic image is converted into a signal suitable for transmission by the PCMCIAI / F 50b, and the converted signal is transmitted to the endoscope apparatus 30 on the first operating room 1A side by the PHS card 50a. .

  When the card-type terminal device 34 receives an image signal of an endoscopic image with sound from the endoscope device 30 on the first operating room side by the PHS card 50a, the received image signal and sound signal are received. Is converted to the original signal before being transmitted by the PCMCIAI / F 50b, and the converted signal is output to the controller 3A. In this way, the controller 3A controls the display device 18A to display the image signal of the endoscopic image received via the card type terminal device 34 and simultaneously output the received audio signal to the earphone 60b of the headset 60. .

  In the present embodiment, the controller 3A moves the cursor on the endoscopic image displayed on the display device 18A by the assisting surgeon 101 that supports the controller 3A using, for example, a mouse or a keyboard (not shown) connected to the controller 3A or the display device 18A. When an instruction such as a caution point is displayed and an instruction signal is given, the image signal of the endoscopic image on which the cursor display is superimposed is used as image information for support by the card type terminal device 50 or the operating room communication line 8. It is possible to control to transmit to one operating room 1A side.

  Other configurations are the same as those of the first embodiment.

  Next, the operation of the surgery support system of the present embodiment will be described with reference to FIG.

  The surgical operation support system 1 of the present embodiment operates in substantially the same manner as in the first embodiment, except that an image signal of an endoscopic image with sound from the endoscope device 30 in the first operating room 1A is a card type terminal device 34. Is transmitted by the card-type terminal device 50 in the conference room 1D, and the received endoscopic image of the received endoscopic image is controlled by the controller 3A. At the same time as the image signal is displayed on the display device 18A, the received audio signal is controlled to be output to the earphone 60b of the headset 60, and the surgeon 101 in the first operating room 1A supports from a remote place. Ask for help.

  The assisting surgeon 101 listens to the voice of the surgeon 100 during the operation in the first operating room 1A, and at the same time, looks at the endoscopic image displayed on the display device 18A and gives an instruction suitable for this surgical situation. Do. For example, the assisting operator 101 uses a mouse, a keyboard, or the like (not shown) to display a cursor on the endoscopic image displayed on the display device 18A and give an instruction such as a caution point.

  Thereafter, the controller 3A uses the card-type terminal device 50 to output the image signal of the endoscopic image on which the cursor display is superimposed and the audio signal of the assisting operator 101 obtained by the headset 60 to the first operating room 1A. Control to send to the side.

  Note that the image signal and audio signal of the endoscopic image for assistance may be transmitted to the first operating room 1A side through the operating room communication line 8.

  The endoscopic device 30 in the first operating room 1A receives the image signal and the audio signal of the endoscopic image transmitted from the card type terminal device 50 in the conference room 1D by the card type terminal device 34. The received image signal of the endoscopic image is supplied to the first controller 3 via the second controller 14 and displayed on the display device 19, and at the same time, the audio signal is transmitted from the earphone / microphone 33 of the endoscope device 30. By outputting through the earphone 33c or the speaker 32, the support surgeon provides appropriate support to the surgeon 100.

  Further, when the surgeon 100 presses the recording button 31 of the endoscope apparatus 30 as necessary, the CPU 43 of the endoscope apparatus 30 receives the received endoscope as in the first embodiment. The image signal and audio signal of the image are stored in the image file unit 11A.

  Therefore, according to the present embodiment, at least the card-type terminal device 50, the headset 60, the display device, and the controller 3A are provided in the conference room 1D, and surgery is performed between the first operating room 1A and the remote conference 1D. Image information and audio information can be sent and received, and the assisting assisting operator displays the cursor while viewing the endoscopic image to indicate caution points, etc., together with the endoscopic image displayed by the cursor When notes and the like are explained by voice, the image signal and voice signal of this endoscopic image are recorded in the image file section 11A on the first operating room 1A side and output, thereby Appropriate support can be provided by voice together with the mirror image. Further, even when examining after surgery, the situation of surgery and its support can be more accurately grasped by the voice memo recorded in the image file unit 11A.

  As a result, it is possible to provide simpler and more detailed support than in the case of a support method such as cursor display only, and even when examining after surgery, the situation of the surgery can be reproduced more accurately and further surgery can be performed. It can also lead to improvement. In addition, the details of the support status on the support side can be grasped, and the degree of contribution can be grasped more accurately.

  The present invention is not limited to the first and second embodiments described above, and various modifications can be made without departing from the spirit of the invention.

[Appendix]
(1) In a surgery support system in which a surgery room and a surgery support room different from this surgery room are connected by a communication line, and information related to surgery can be transmitted / received via this communication line,
A surgery support system, wherein recording means for recording a voice included in information related to the surgery is provided at least in the surgery room.

  (2) The surgery support system according to appendix (1), wherein the information related to the surgery is an endoscope image and a voice, and the recording unit records the voice together with the endoscope image.

  (3) The surgery according to appendix (1), characterized in that communication means capable of transmitting and receiving at least audio included in the information related to the surgery between the operating room and the surgery support room by radio is provided. Support system.

  (4) The surgery support system according to appendix (3), wherein the communication unit is capable of transmitting and receiving an endoscope image together with the voice to and from the surgery support room.

  (5) The surgery support system according to appendix (5), wherein the communication unit is a wireless transmission system using PHS.

  (6) The recording means can connect an image acquisition means for acquiring an image, and can record an image acquired from the image acquisition means and an image included in the information, and the communication means records in the recording means. The surgery support system according to appendix (3), wherein the voice, the image captured from the image acquisition unit, and the image included in the information are transmitted to the surgery support room.

  (7) The surgery support system according to appendix (6), wherein the image acquisition means is a digital camera or an ultrasonic diagnostic apparatus.

  (8) Additional notes (2), wherein output means for reproducing and outputting sound included in the information related to the surgery received by the communication means is provided in at least one of the operating room and the surgery support room. ) Surgery support system.

(9) The output means includes:
A speaker that is provided in the operation unit of the endoscope and reproduces and outputs a voice for support from the surgery support room;
The surgery support system according to appendix (8), characterized in that the surgery support system is configured by a microphone that is provided in the operation unit of the endoscope and captures the voice of the operator in the operating room.

  The surgical operation support system of the present invention is a surgical operation support system that connects the operating room side and the remote site side via a communication line, and supports the remote operator's instructions and the like for the operating room side operator. In addition, the surgeon supports the assisting surgeon by allowing radio signals to be transmitted and received between the operating room side and the remote site, such as image signals of endoscopic images and instructions from the surgeon or assisting surgeon. It is useful as an operation support system for looking up to the patient, and is particularly suitable for providing more detailed support.

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram which shows the 1st Example of the surgery assistance system which concerns on this invention, and shows the whole structure of this surgery assistance system. The block diagram which shows the external appearance structure of the endoscope apparatus shown in FIG. FIG. 3 is a block diagram showing an electrical configuration of the endoscope apparatus shown in FIG. 2. The block diagram which shows the 2nd Example of the surgery assistance system which concerns on this invention, and shows the whole structure of this surgery assistance system.

Explanation of symbols

1 ... Surgery support system,
1A ... First operating room,
1B ... Second operating room,
1C ... Third operating room,
1D ... Conference room,
3 ... first controller,
3A ... Controller,
3a ... input device,
4 ... surgical department server 5 ... hospital server 6 ... hospital communication line,
7 ... WEB server,
8 ... Operating room communication line 11 ... Video / light source device,
11A ... Image file part 12 ... Display device,
13 ... Surgical device,
14 ... Controller 15 Controller 15 ... Touch panel,
17 ... Signal transmission device 18 ... Patient monitoring device,
18A, 19 ... display device,
20 ... Indoor camera,
23 ... Digital camera,
24. Ultrasonic diagnostic device,
30 ... Endoscopic device,
30A ... insertion part,
30B ... operation unit,
30a ... CCD,
31 ... Record button,
32 ... Speaker,
33 ... Earphone / Microphone,
33a ... earphone / microphone jack,
33b ... Mike,
33c ... Earphone,
34 ... Card type terminal device,
45, 60 ... Headset,
45a, 60a ... microphone,
45b, 60b ... earphones,
50: Card type terminal device.
Agent Patent Attorney Susumu Ito

Claims (4)

In an operation support system that connects an operation room and an operation support room different from the operation room via a communication line, and enables transmission and reception of information about the operation via the communication line,
A surgery support system, wherein recording means for recording a voice included in information related to the surgery is provided at least in the surgery room. The surgery support system according to claim 1, further comprising a communication unit capable of wirelessly transmitting and receiving audio included in the information related to the surgery between the surgery room and the surgery support room. The recording means can connect an image acquisition means for acquiring an image, and can record an image acquired from the image acquisition means and an image included in the information, and the communication means can record audio recorded in the recording means. The surgery support system according to claim 2, wherein the image captured from the image acquisition unit and the image included in the information are transmitted to the surgery support room. The output means for reproducing and outputting the sound included in the information related to the surgery received by the communication means is provided in at least one of the operating room and the surgery support room. Surgery support system.

Images