WO2023171263A1 - Control device and medical robot - Google Patents

Abstract

The control device according to the present disclosure is provided with a physical interface (10) that is adapted to be operable by a practitioner with a body part other than a hand of the practitioner, in which the operation of a medical robot is controlled in accordance with the operation of the physical interface by the practitioner. The medical robot according to the present disclosure includes: a physical interface that is adapted to be operable by a practitioner with a body part other than a hand of the practitioner; a robot arm (120) that assists a surgery by the practitioner; and a control unit (500) that controls the operation of the robot arm in accordance with the operation of the physical interface by the practitioner.

Description

Control equipment and medical robots

The present disclosure relates to a control device and a medical robot.

Medical robots that autonomously perform operations using surgical instruments are known. For example, in endoscopic surgery, an endoscope that operates autonomously is used to photograph the inside of a patient's abdominal cavity, and the photographed images are displayed on a display. By performing surgery while looking at the captured images displayed on the display, the operator (surgeon) can concentrate both hands on operating the surgical instruments. A hands-free operation means is required as an operation means for such a medical robot.

Conventionally, in surgeries using electrically operated surgical tools such as electric scalpels, the surgeon has a method of operating the surgical tools while concentrating on the surgical procedure and using both hands exclusively for the surgical procedure. It was common practice to use a foot pedal. Therefore, consideration is being given to using foot pedals as an operating means for medical robots. Furthermore, Patent Document 1 discloses a technique in which a physical interface for operating a medical robot is attached to a surgical instrument.

Special table 2018-532527 publication

Even in normal surgeries where medical robots have not been introduced, two or more foot pedals (that is, for both feet) are often placed at the feet of the surgeon for operating other equipment. Therefore, adding a foot pedal for operating the medical robot may reduce the operability of medical devices other than the medical robot and the medical robot itself.

Furthermore, with the configuration described in Patent Document 1, it is difficult to ensure operability for normal surgical procedures. In other words, in the configuration described in Patent Document 1, although the physical interface for operating the medical robot is attached to the surgical instrument, the operator must perform complicated operations on the medical robot. , it is difficult to accurately control the operation of a medical robot unless the surgical procedure is temporarily stopped.

Furthermore, in the configuration described in Patent Document 1, there is a risk that the surgeon's fingers may touch the physical interface during a surgical procedure, and there is a risk that the medical robot will malfunction. Furthermore, in actual surgery, instruments used by the surgeon are generally frequently replaced, so it becomes necessary to attach and detach and replace the physical interface for operating the medical robot.

An object of the present disclosure is to provide a control device and a medical robot that can control the operation of a medical robot in a hands-free manner and manage risks in hands-free operation.

A control device according to the present disclosure includes a physical interface that can be operated by a surgeon with a body part other than his or her own hand, and controls the operation of a medical robot in accordance with the operation of the surgeon on the physical interface. do.

FIG. 2 is a schematic diagram showing an example of the arrangement of medical robots according to existing technology. FIG. 2 is a schematic diagram showing an example of the arrangement of medical robots according to existing technology. FIG. 2 is a schematic diagram showing an example of the arrangement of medical robots according to existing technology. 1 is a diagram schematically showing an example of the configuration of an endoscopic surgery system according to existing technology. FIG. 2 is a schematic diagram showing an example of a physical interface according to an embodiment. It is a schematic diagram for explaining the relationship between a robot arm and a surgical bed. FIG. 3 is a schematic diagram for explaining the illumination function of the physical interface according to the embodiment. 1 is a diagram schematically showing an example of the configuration of an endoscopic surgery system according to an embodiment. FIG. 2 is a functional block diagram of an example for explaining the functions of the robot arm system according to the embodiment. FIG. 3 is a schematic diagram for explaining an example of effective arrangement of physical interfaces according to the embodiment. FIG. 3 is a schematic diagram for explaining an example of effective arrangement of physical interfaces according to the embodiment. FIG. 3 is a schematic diagram showing an example of operation mode transition of a robot arm according to a first application example of the embodiment. FIG. 7 is a schematic diagram showing an example of operation mode transition of the robot arm according to a second application example of the embodiment. FIG. 2 is a schematic diagram showing an example of an emergency stop button provided on a robot arm. FIG. 7 is a schematic diagram showing an example of the arrangement of physical interfaces according to a first modification of the embodiment. FIG. 7 is a schematic diagram showing an example of a physical interface according to a first example of a first modification of the embodiment. It is a schematic diagram which shows the example of the physical interface based on the 2nd example of the 1st modification of embodiment. It is a schematic diagram which shows the example of the physical interface based on the 3rd example of the 1st modification of embodiment. FIG. 7 is a schematic diagram showing an example of the arrangement of physical interfaces according to a second modification of the embodiment. FIG. 6 is a schematic diagram showing an example of a physical interface according to a first example of a second modification of the embodiment. It is a schematic diagram which shows the example of the physical interface based on the 2nd example of the 2nd modification of embodiment.

Hereinafter, embodiments of the present disclosure will be described in detail based on the drawings. Note that in the following embodiments, the same portions are given the same reference numerals, and redundant explanation will be omitted.

Hereinafter, embodiments of the present disclosure will be described in the following order.
1. Overview of technology related to the present disclosure 1-1. Regarding existing technology 1-2. Technology related to the present disclosure 2. Embodiment 2-1-1. Physical interface example according to embodiment 2-1-2. Configuration example of medical system according to embodiment 2-1-3. Example of arrangement of physical interfaces applicable to embodiment 2-2. First application example of embodiment 2-3. Second application example of embodiment 2-4. Third application example 3 of the embodiment. First modification of the embodiment 4. Second modification of the embodiment

(1. Overview of technology related to this disclosure)

The present disclosure relates to a control device for controlling the operation of a medical robot, particularly a robot arm that assists a surgeon in surgery. A control device according to the present disclosure includes a physical interface configured to be operable by a surgeon with a body part other than his/her own hand. A physical interface is an interface that has a physical substance and is used to convert an operation by an operator (in this case, a surgeon) into an electrical signal.

(1-1. Regarding existing technology)
Prior to describing the present disclosure, in order to facilitate understanding, the configuration of a medical system using a medical robot according to existing technology will be described.

FIGS. 1A to 1C are schematic diagrams showing examples of the arrangement of medical robots according to existing technology. In the following, it is assumed that the medical robot is a robot arm that assists a surgeon during surgery.

FIG. 1A is a top view of a patient 101 lying on a surgical bed 100 and an operator 102 standing next to the surgical bed 100 for a surgical procedure. 1B is an overhead view of the state shown in FIG. 1A from diagonally above the rear of the operator 102, and FIG. 1C is an overhead view of the state shown in FIG. 1A from the opposite side of FIG. 1B.

The surgical bed 100 is provided with bed rails 110 on the side. In the example of FIGS. 1A to 1C, bed rails 110 are provided on both sides of the surgical bed 100 for each movable region. Further, as shown in FIGS. 1B and 1C, the surgical bed 100 is held at a predetermined height from the floor by a pedestal 140.

The robot arm 120 includes a plurality of joints and an arm that connects the joints. By driving a plurality of joints in a predetermined manner, the robot arm 120 can freely change its posture within the movable range of each joint.

Furthermore, in the illustrated example, the robot arm 120 is installed on a trolley 130 and is used as a floor-standing device. Although the surgical bed 100 is capable of changing the inclination for each movable region, the robot arm 120 operates independently of the inclination of each movable region of the surgical bed 100.

Next, as an application example of a medical robot based on existing technology, an endoscopic surgery system for performing surgery using an endoscope will be described. FIG. 2 is a diagram schematically showing an example of the configuration of an endoscopic surgery system 5000 according to existing technology.

FIG. 2 shows a surgeon 102 performing surgery on a patient 101 on a surgical bed 100 using an endoscopic surgery system 5000. Further, in FIG. 2, the surgical bed 100 is shown as seen from the feet or head side of the patient 101, and bed rails 110 are shown on both sides thereof. For example, instruments used in surgery are attached to the bed rail 110 using clamps or the like.

In FIG. 2, an endoscopic surgery system 5000 includes an endoscope 5001, other surgical instruments 5017, a robot arm 120 that is a medical robot that supports the endoscope 5001, and an endoscopic surgery system 5000 for endoscopic surgery. and a rack 5037 containing various devices. Rack 5037 is mounted on truck 130.

In endoscopic surgery, instead of cutting the abdominal wall and opening the abdomen, multiple cylindrical hole-opening instruments called trocars 5025a to 5025d are punctured into the abdominal wall. Then, the lens barrel 5003 of the endoscope 5001 and other surgical instruments 5017 are inserted into the body cavity of the patient 101 from the trocars 5025a to 5025d.

In the example of FIG. 2, as other surgical tools 5017, a pneumoperitoneum tube 5019, an energy treatment tool 5021, and forceps 5023 are inserted into the body cavity of the patient 101. Furthermore, the energy treatment tool 5021 is a treatment tool that performs incision and exfoliation of tissue, sealing of blood vessels, etc. using high frequency current or ultrasonic vibration. However, the surgical tool 5017 shown in FIG. 2 is just an example, and various surgical tools commonly used in endoscopic surgery, such as a lever or a retractor, may be used as the surgical tool 5017.

An image of the surgical site inside the body cavity of the patient 101 taken by the endoscope 5001 is displayed on the display device 5041. The surgeon 102 uses the energy treatment instrument 5021 and forceps 5023 to perform a treatment such as cutting off the affected area while viewing the image of the surgical site displayed on the display device 5041 in real time. Although not shown, the pneumoperitoneum tube 5019, the energy treatment instrument 5021, and the forceps 5023 are supported by the operator 102, an assistant, or the like during the surgery.

(robot arm)
Robot arm 120 includes an arm portion 5031 extending from base portion 5029. In the example of FIG. 2, the arm portion 5031 includes joint portions 5033a, 5033b, 5033c, and links 5035a, 5035b, and is driven by control from an arm control device 5045. Endoscope 5001 is supported by arm portion 5031, and its position and/or posture is controlled. Thereby, the endoscope 5001 can be stably fixed in position. The arm control device 5045 is capable of autonomously controlling the operation of the robot arm 120, for example, based on a model learned by machine learning.

Note that the position of the endoscope indicates the position of the endoscope in space, and can be expressed as three-dimensional coordinates such as coordinates (x, y, z), for example. Further, the posture of the endoscope indicates the direction in which the endoscope faces, and can be expressed as a three-dimensional vector, for example.

(Endoscope)
The endoscope 5001 will be briefly described. The endoscope 5001 includes a lens barrel 5003 whose distal end is inserted into the body cavity of the patient 101 over a predetermined length, and a camera head 5005 connected to the proximal end of the lens barrel 5003. In the illustrated example, an endoscope 5001 configured as a so-called rigid scope having a rigid tube 5003 is shown, but the endoscope 5001 is configured as a so-called flexible scope having a flexible tube 5003. Good too.

An opening into which an objective lens is fitted is provided at the tip of the lens barrel 5003. A light source device 5043 mounted on a rack 5037 is connected to the endoscope 5001, and light generated by the light source device 5043 is directed into the lens barrel by a light guide extending inside the lens barrel 5003. The light is guided to the tip and irradiated toward the observation target in the body cavity of the patient 101 via the objective lens. Note that the endoscope 5001 may be a direct-viewing mirror, a diagonal-viewing mirror, or a side-viewing mirror.

An optical system and an image sensor are provided inside the camera head 5005, and reflected light (observation light) from an observation target is focused on the image sensor by the optical system. The observation light is photoelectrically converted by the image sensor, and an electric signal corresponding to the observation light, that is, an image signal corresponding to the observation image is generated. The image signal is transmitted as RAW data to a camera control unit (CCU) 5039. Note that the camera head 5005 is equipped with a function of adjusting magnification and focal length by appropriately driving its optical system.

Note that the camera head 5005 may be provided with a plurality of image sensors, for example, in order to support stereoscopic viewing (3D display). In this case, a plurality of relay optical systems are provided inside the lens barrel 5003 in order to guide observation light to each of the plurality of image sensors.

(Various devices included in the rack)
In the example of FIG. 2, the rack 5037 includes a CCU 5039, a light source device 5043, an arm control device 5045, an input device 5047, a treatment tool control device 5049, an insufflation device 5051, a recorder 5053, and a printer 5055. It is equipped with.

The CCU 5039 is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and the like, and centrally controls the operations of the endoscope 5001 and the display device 5041. Specifically, the CCU 5039 performs various image processing, such as development processing (demosaic processing), on the image signal received from the camera head 5005 in order to display an image based on the image signal. The CCU 5039 provides the image signal subjected to the image processing to the display device 5041. Further, the CCU 5039 transmits a control signal to the camera head 5005 to control its driving. The control signal may include information regarding imaging conditions such as magnification and focal length.

The display device 5041 displays an image based on an image signal subjected to image processing by the CCU 5039 under control from the CCU 5039. If the endoscope 5001 is compatible with high resolution imaging such as 4K (horizontal pixels 3840 x vertical pixels 2160) or 8K (horizontal pixels 7680 x vertical pixels 4320), and/or 3D display. In the case where the display device 5041 is capable of high-resolution display and/or 3D display, the display device 5041 may be capable of high-resolution display and/or 3D display. If the display device 5041 is compatible with high-resolution shooting such as 4K or 8K, a more immersive feeling can be obtained by using a display device 5041 with a size of 55 inches or more. Furthermore, a plurality of display devices 5041 having different resolutions and sizes may be provided depending on the purpose.

The light source device 5043 includes a light emitting element such as an LED (light emitting diode) and a drive circuit for driving the light emitting element, and supplies irradiation light to the endoscope 5001 when photographing the surgical site.

The arm control device 5045 includes a processor such as a CPU, and operates according to a predetermined program to control the drive of the arm portion 5031 of the robot arm 120 according to a predetermined control method.

The input device 5047 is an input interface for the endoscopic surgery system 5000. The user can input various information and instructions to the endoscopic surgery system 5000 via the input device 5047. For example, the user inputs various information regarding the surgery, such as patient's physical information and information about the surgical technique, via the input device 5047. Further, for example, the user may issue an instruction to drive the arm portion 5031 or an instruction to change the imaging conditions (type of irradiation light, magnification, focal length, etc.) by the endoscope 5001 via the input device 5047. , an instruction to drive the energy treatment instrument 5021, etc. are input.

The type of the input device 5047 is not limited, and the input device 5047 may be any of various known input devices. As the input device 5047, for example, input devices such as a mouse, keyboard, touch panel, switch, lever, joystick, etc. can be applied. As the input device 5047, it is also possible to use a mixture of multiple types of input devices. Furthermore, a foot switch 5057 that is placed at the feet of an operator (for example, the operator 102) and is operated by the feet of the operator can also be applied as the input device 5047. When a touch panel is used as the input device 5047, the touch panel may be provided on the display surface of the display device 5041.

The input device 5047 is not limited to the above example. For example, the input device 5047 can be a device worn by the user, such as a glasses-type wearable device or a head mounted display (HMD). In this case, the input device 5047 can perform various inputs according to the user's gestures and line of sight detected by the devices worn by these users.

Additionally, the input device 5047 can include a camera that can detect the user's movements. In this case, the input device 5047 can perform various inputs according to the user's gestures and line of sight detected from the video captured by the camera. Furthermore, the input device 5047 can include a microphone that can pick up the user's voice. In this case, the input device 5047 can perform voice recognition based on the voice picked up by the microphone, analyze the voice of the speaker (for example, the surgeon 102), and input various operations using voice.

In this way, since the input device 5047 is configured to be able to input various information without contact, a user (for example, the operator 102) who belongs to a clean area can operate equipment belonging to a dirty area without contact. becomes possible. Further, since the user can operate the device without taking his hand off the surgical tool that he has, the user's convenience is improved.

The treatment tool control device 5049 controls the driving of the energy treatment tool 5021 for cauterizing tissue, incising, sealing blood vessels, etc. The pneumoperitoneum device 5051 inflates the body cavity of the patient 101 through the pneumoperitoneum tube 5019 in order to secure a field of view with the endoscope 5001 and a working space for the operator 102. Inject gas. The recorder 5053 is a device that can record various information regarding surgery. The printer 5055 is a device that can print various types of information regarding surgery in various formats such as text, images, or graphs.

(1-2. Technology related to this disclosure)
In the above-described configuration, a case will be considered in which the operator 102 switches the operation mode of the robot arm 120 from the autonomous operation mode to the manual operation mode and manually operates the robot arm 120 (for example, stops the operation of the robot arm 120). In this case, it is necessary to provide the endoscopic surgery system 5000 with a switching means for switching the operation mode of the robot arm 120 hands-free.

As such a switching means, it is conceivable to add a foot switch operated by the operator 102 with his/her foot to the existing foot switch 5057. However, if two or more foot switches 5057 (that is, for both feet) are already placed at the feet of the surgeon 102 for operating other equipment, a foot pedal may also be used as a means of switching the operation mode of the robot arm 120. Addition of this may reduce the operability of medical equipment other than the robot arm 120 and the robot arm 120 itself.

In addition, as a means of operating a medical robot in a situation where the surgeon's hands are exclusively used to operate surgical instruments, a method of attaching a physical interface to the surgeon's hands or the surgical instrument operated by the surgeon may be considered (for example, Patent Document 1). However, with this method, it is difficult to ensure operability for normal surgery. Furthermore, in actual surgery, instruments used by the surgeon are generally frequently replaced, so it becomes necessary to attach/detach and replace the physical interface for operating the medical robot.

A control device for controlling the robot arm 120 according to the present disclosure includes a physical interface that can be operated by a surgeon with a body part other than his or her own hand. By using the control device according to the present disclosure, the operator can control the operation of the medical robot hands-free at any time, and risk management during hands-free operation of the medical robot becomes possible. Further, by using the control device according to the present disclosure, it is possible to eliminate the need for physical interface replacement work that accompanies replacement of surgical tools during surgery.

(2. Embodiment)
Embodiments according to the present disclosure will be described.

(2-1-1. Example of physical interface according to embodiment)
FIG. 3 is a schematic diagram showing an example of a physical interface according to the embodiment. As shown in section (a) of FIG. 3, the physical interface 10 according to the embodiment is removably attached to the bed rail 110 of the surgical bed 100 by, for example, a clamp (not shown). It is configured as a switch that is activated by pressing in the direction of . The output of the physical interface 10 is transmitted to the arm control device 5045 via the cable 11, for example. Arm control device 5045 can control the operation of robot arm 120 in response to signals transmitted from physical interface 10 .

By installing the physical interface 10 in front of the surgeon 102, that is, in the direction in which the surgeon 102 faces the surgical bed 100 for surgery, the operability when the surgeon 102 operates the physical interface 10 is maximized. can be converted into Furthermore, the physical interface 10 is configured to be attachable at any position on the bed rail 110 of the surgical bed 100. For example, the physical interface 10 is removably attached to the bed rail 110 using a clamp or the like. Note that the physical interface 10 is preferably attached to the bed rail 110 of the surgical bed 100 at a position where it does not interfere with other equipment.

Furthermore, a plurality of physical interfaces 10 may be installed for one robot arm 120. In this case, each of the plurality of physical interfaces 10 may instruct one robot arm 120 to perform the same operation. In this way, by installing a plurality of physical interfaces 10 for one robot arm 120, even if a plurality of surgeons 102 are in charge of one surgery at the same time, control by the physical interface 10 can be performed easily. realizable.

The physical interface 10 according to the embodiment is provided with a surgical interface at a position where the surgeon 102 can operate the body part other than his or her own hand, more specifically, at a position below the waist 1023 of the surgeon 102. It is attached to the bed 100 (bed rail 110). Section (b) of FIG. 3 shows an example of the mounting position of the physical interface 10 according to the embodiment. In the example of section (b) in FIG. 3, the physical interface 10 is attached at a position where it can be operated depending on the body position from the knee 1021 to the thigh 1022.

By attaching the physical interface 10 in such a position, the surgeon 102 can operate the physical interface 10 in a manner different from the foot switch 5057 without using his hands, that is, while handling the surgical instrument with both hands. I can do it. Therefore, the surgeon 102 can smoothly operate the robot arm 120 even when both hands are occupied for operating the surgical instrument. That is, the surgeon 102 can smoothly operate the robot arm 120 hands-free.

Further, by using only one switch in the physical interface 10 and limiting the operation by the physical interface 10 to one type of operation such as on/off control, the operability for the operator 102 is improved.

Furthermore, by attaching the physical interface 10 to the bed rail 110, there is no need to attach or detach the physical interface 10 when replacing a surgical instrument, which occurs when attaching the physical interface 10 to a surgical instrument or hand. Furthermore, since the physical interface 10 is attached to the bed rail 110, it is possible to cleanly separate the physical interface 10 at low cost by putting it inside an existing covering cloth or covering it with a simple drape. Good economy.

(About tilt detection using physical interface)
FIG. 4 is a schematic diagram for explaining the relationship between the robot arm 120 and the surgical bed 100.

In the example of FIG. 4, the robot arm 120 has a floor-standing configuration installed on a trolley 130, and operates independently of the surgical bed 100. On the other hand, during surgery, for example, the angle of a part of the surgical bed 100 may be changed depending on, for example, the condition of the surgery. Therefore, for example, during surgery, if the inclination of the surgical bed 100 is changed while the lens barrel 5003 of the endoscope 5001 is inserted into the body cavity of the patient 101 by the robot arm 120, the lens barrel 5003 is inserted into the body cavity of the patient 101. This results in undesirable movement within the body cavity.

In order to accommodate changes in the inclination of the surgical bed 100 during surgery, the physical interface 10 according to the embodiment may include a tilt sensor that detects the inclination of the physical interface 10. Tilt information indicating the tilt detected by the tilt sensor is transmitted to the arm control device 5045 via the cable 11.

As shown in FIG. 4, since the physical interface 10 according to the embodiment is attached to the bed rail 110 of the surgical bed 100, it is possible to detect the inclination of the surgical bed 100 at the attached position. The physical interface 10 is attached to the surgical bed 100 at a position corresponding to the affected area to be operated on, and the operation of the robot arm 120 is controlled according to the output of the tilt sensor included in the physical interface 10. can be made to follow the inclination of the surgical bed 100.

Since the inclination of the surgical bed 100 is detected as a function of the physical interface 10, it is possible to link the movement of the robot arm 120 with the movement of the surgical bed 100 without collaborating with, for example, the manufacturer that provides the surgical bed 100. becomes. Furthermore, by monitoring the movement of the surgical bed 100 on the robot arm 120 (arm control device 5045) side, risk management becomes possible.

For example, if the robot arm is attached to the bed rail 110, even if the inclination of the surgical bed 100 changes, the relative positional relationship between the patient 101 and the robot arm will not change. Therefore, in this case, risk management regarding changes in the inclination of the surgical bed 100 is not necessary.

On the other hand, in a floor-standing robot arm 120 as shown in FIG. 4, when the inclination of the surgical bed 100 changes, the relative positional relationship between the patient 101 and the robot arm 120 changes. Therefore, when using a floor-standing robot arm 120, unless the robot arm 120 side changes its posture and position in accordance with the movement of the surgical bed 100, the lens barrel attached to the robot arm 120 must be moved as described above. 5003 and the like may move undesirably within the body cavity of the patient 101, and there is a risk that the patient 101 may be harmed. In the physical interface 10 according to the embodiment, this risk can be reduced by incorporating a tilt sensor and monitoring the tilt state of the surgical bed 100.

(About illumination function using physical interface)
As described above, when the physical interface 10 is attached to the bed rail 110, it is necessary to cover the physical interface 10 with a drape for clean separation or a patient covering for clean separation. When the physical interface 10 is covered with a drape or a covering cloth, there is a possibility that visibility of the physical interface 10 by the operator 102 may be deteriorated.

Therefore, in the embodiment, a light emitting section is provided for the physical interface 10 to have a lighting function.

FIG. 5 is a schematic diagram for explaining the illumination function of the physical interface 10 according to the embodiment. In the example of FIG. 5, a patient 101 is covered with a cloth 20 except for the affected area, and a surgeon 102 is shown handling surgical tools with his left hand 102hL and right hand 102hR and performing surgery.

The bed rail 110 is covered with a covering cloth 20. In the example of FIG. 5, the physical interface 10 attached to the bed rail 110 (not shown) is located inside the upholstery 20. Alternatively, if the physical interface 10 is placed outside the shroud 20, the physical interface 10 is covered with a transparent drape to keep itself clean. Therefore, it may be difficult for the operator 102 to directly visually recognize the physical interface 10. Therefore, the physical interface 10 according to the embodiment is provided with a light emitting section 12 to have an illumination function, and the light emitting section 12 is made to emit light at all times during surgery, for example.

It is preferable that the light emitting unit 12 is provided at a position where the light emitted from the physical interface 10 can be easily recognized by the operator 102 when the physical interface 10 is attached to the bed rail 110, for example. Further, it is preferable that the light emitting unit 12 emits light with such intensity that the emitted light passes through the covering cloth 20 or the drape to some extent and is easily recognized by the operator 102. Note that the intensity of the light emitted by the light emitting unit 12 is preferably such that the operator 102 does not feel glare when passing through the covering cloth 20 or drape.

(2-1-2. Configuration example of medical system according to embodiment)
Next, a configuration example of a medical system according to an embodiment will be described.

FIG. 6 is a diagram schematically showing an example of the configuration of an endoscopic surgery system 5000a according to the embodiment. In FIG. 6, an endoscopic surgery system 5000a has a physical interface 10 added to the endoscopic surgery system 5000 according to the existing technology described using FIG. The physical interface 10 is removably attached to the bed rail 110, as described above. The physical interface 10 is wired via the cable 11 to an arm control device 5045a corresponding to the arm control device 5045 in FIG.

Note that the physical interface 10 can also be connected to the arm control device 5045a by wireless communication without using the cable 11. However, considering the response to the operation of the physical interface 10 and risks such as communication errors, it is preferable that the physical interface 10 is connected to the arm control device 5045a by wire.

FIG. 7 is an example functional block diagram for explaining the functions of the robot arm system according to the embodiment.

In FIG. 7, the robot arm system 50 includes a robot arm control section 500 and a robot arm 120. Robot arm control section 500 is included in arm control device 5045a shown in FIG. Further, the physical interface (I/F) 10 includes a switch (SW) section 13, a tilt sensor 14, and a light emitting section 12.

In the physical interface 10, the switch unit 13 may have a configuration including, for example, a microswitch and an output circuit that outputs a signal according to an operation on the microswitch. A signal output from the output circuit (referred to as a switch signal) is transmitted to the arm control device 5045a via the cable 11 and received by the robot arm control section 500.

The switch signal may be, for example, a signal that simply indicates on and off. Further, for example, the switch signal may be a signal that combines a synchronization pattern and a pattern indicating on and off.

The physical interface 10 is not limited to this, and may simply be a switch that opens/closes a circuit in response to an operation. In this case, for example, the robot arm control unit 500 needs to constantly supply signals to the physical interface 10.

The tilt sensor 14 detects the tilt of the physical interface 10 and outputs tilt information indicating the detected tilt. For example, the tilt sensor 14 detects the angle of the physical interface 10 with respect to the direction of gravity, and outputs the detected angle as tilt information. As the tilt sensor 14, for example, a gyro sensor that detects tilt based on angular acceleration of three axes can be used. The tilt information output from the tilt sensor 14 is transmitted to the arm control device 5045a via the cable 11 and received by the robot arm control unit 500.

The light emitting unit 12 can use an LED (Light Emitting Diode) as a light emitting element. The light emitting unit 12 may be controlled to turn on/off the light emitted by, for example, a switch provided on the physical interface 10 . The present invention is not limited to this, and the robot arm control unit 500 may control on/off of the light emission of the light emitting unit 12. The light emitting element applied to the light emitting unit 12 is not limited to an LED as long as it can achieve the purpose of being easily recognized by the operator 102 through the covering cloth 20 or drape. Furthermore, the light emitting section 12 may have a dimming function.

In FIG. 7, the instruction recognizer 60 includes, for example, a voice recognizer, analyzes a voice signal based on the voice picked up by the microphone 61, and obtains instruction information indicating a voice instruction. In this case, the instruction recognizer 60 can recognize, for example, an utterance by the surgeon 102 to control the operation of the robot arm 120, and can acquire instruction information for instructing the operation of the robot arm 120.

For example, the instruction recognizer 60 may include a line of sight recognizer, recognize the line of sight (for example, the direction of the eyeball) based on the image captured by the camera 62, and acquire instruction information indicating instructions based on the line of sight. You can do it. In this case, the instruction recognizer 60 can recognize, for example, the line of sight of the operator 102 to control the operation of the robot arm 120, and can acquire instruction information for controlling the robot arm 120.

The instruction recognizer 60 may have both a voice recognizer and a line of sight recognizer, or may have either one of them.

The robot arm 120 includes a joint section 121 and a drive control section 122. The joint section 121 includes a joint information detection section 1210 and a joint section drive section 1211. Drive control section 122 generates a drive control signal for driving joint section 121 based on command value information supplied from command value generation section 513, which will be described later. The joint drive unit 1211 drives the joint 121 according to a drive control signal generated by the drive control unit 122. The joint information detection section 1210 detects the state of the joint section 121 using a sensor or the like and acquires joint information. Joint information detection section 1210 passes the acquired joint information to state acquisition section 510 and command value generation section 513, which will be described later.

Note that in FIG. 7, the robot arm 120 is shown to include one joint 121 for the sake of explanation, but in reality, the robot arm 120 includes a plurality of joints 121.

The robot arm control section 500 includes a state acquisition section 510, a calculation condition determination section 511, and a command value generation section 513.

The state acquisition unit 510 acquires the switch signal output from the switch unit 13 of the physical interface 10 and the tilt information output from the tilt sensor 14. Further, the state acquisition section 510 acquires each joint information output from the joint information detection section 1210 of each joint section 121. The state acquisition unit 510 passes the acquired switch signal, slope information, and each joint information to the calculation condition determination unit 511.

The calculation condition determination unit 511 acquires the switch signal, slope information, and each joint information passed from the state acquisition unit 510, and also acquires the instruction information output from the instruction recognizer 60. The calculation condition determining unit 511 determines how the robot arm 120 behaves based on each piece of information and signals acquired. The calculation condition determination unit 511 passes information indicating the determined behavior of the robot arm 120 to the force calculation unit 512.

The force calculation unit 512 has a model regarding the movement of the robot arm 120, which has been learned, for example, by machine learning. The force calculation unit 512 applies information indicating the behavior of the robot arm 120 passed from the calculation condition determination unit 511 to the model, and predicts the movement of the robot arm 120. The force calculation section 512 passes robot motion information indicating the predicted motion of the robot arm 120 to the command value generation section 513.

The command value generation unit 513 is further provided with joint information from each joint 121 in the robot arm 120. The command value generation unit 513 generates a command value for instructing the drive of each joint 121 of the robot arm 120 based on the joint information passed from each joint 121 and the robot motion information passed from the force calculation unit 512. generate. The command value generation unit 513 passes each generated command value to the drive control unit 122.

The drive control section 122 generates each drive control signal for driving each joint section 121 according to each command value passed from the command value generation section 513. The robot arm 120 executes a predetermined operation by driving each joint 121 according to each drive control signal generated by the drive control unit 122.

In this way, the physical interface 10 according to the embodiment and the robot arm control unit 500 that controls the operation of the robot arm 120 according to the output of the physical interface 10 are included, and the robot arm control unit 500 controls the operation of the robot arm 120 according to the output of the physical interface 10. A control device is configured to control the operation of the medical robot.

(2-1-3. Example of arrangement of physical interfaces applicable to the embodiment)
Next, an example of effective arrangement of the physical interface 10 according to the embodiment will be described using FIG. 8 and FIG. 9.

FIG. 8 is a schematic diagram showing an example of arrangement when one physical interface 10 according to the embodiment is arranged. Section (a) of FIG. 8 is a top view of a patient 101 lying on a surgical bed 100 and an operator 102 standing next to the surgical bed 100 for a surgical procedure. Furthermore, section (b) in the same figure is an overhead view of the state of section (a) in the same figure from diagonally above and behind the operator 102.

In the example of FIG. 8, when one physical interface 10 is arranged, the physical interface 10 is arranged at a position corresponding to the standing position of the surgeon 102 on the bed rail 110 of the surgical bed 100.

More specifically, when the operator 102 performs surgery on the patient 101 lying on the surgical bed 100, the operator 102 operates the physical interface 10 in the lower back of the operator 102 or in the body part below the waist. Preferably, the physical interface 10 is located at a location corresponding to the body part used for the purpose. In the example of FIG. 8, the physical interface 10 is placed at a position corresponding to the thigh or knee of the left leg of the operator 102. Since the physical interface 10 is detachably attached to the bed rail 110, the arrangement position can be easily adjusted.

FIG. 9 is a schematic diagram showing an arrangement example when a plurality of physical interfaces 10 are arranged. Here, it is assumed that two physical interfaces 10a and 10b are used, and that the physical interface 10a is operated by the surgeon 102, and the physical interface 10b is operated by the assistant 103 who assists the surgeon 102 in the surgery. The robot arm system 50 performs the same control on each output of these physical interfaces 10a and 10b.

Section (a) of FIG. 9 is a top view of a patient 101 lying on a surgical bed 100 and an operator 102 standing next to the surgical bed 100 for a surgical procedure. In this example, it is assumed that the assistant 103 stands in a position facing the surgeon 102 with the surgical bed 100 in between. Section (b) in the same figure is an overhead view of the state of section (a) in the same figure from diagonally above and behind the assistant 103.

The arrangement position of the physical interface 10a operated by the surgeon 102 is the same as the position described using FIG. 8. Furthermore, the position of the physical interface 10b operated by the assistant 103 is basically the same as the positional relationship between the surgeon 102 and the physical interface 10a. Specifically, the physical interface 10b may be placed on the bed rail 110 of the surgical bed 100 at a position corresponding to the standing position of the assistant 103.

Note that the arrangement position of the physical interface 10 shown in FIG. 8 and the arrangement positions of the physical interfaces 10a and 10b shown in FIG. It may be determined as appropriate depending on the situation.

(2-2. First application example of embodiment)
Next, a first application example of the physical interface 10 according to the embodiment will be described. The first application example is an example in which control of the robot arm 120 is enabled or disabled according to an instruction recognized by the instruction recognizer 60 by operating the physical interface 10 according to the embodiment. Here, a description will be given assuming that the instruction recognizer 60 acquires instruction information corresponding to the sound picked up by the microphone 61.

FIG. 10 is a schematic diagram showing an example of the operation mode transition of the robot arm 120 according to the first application example of the embodiment.

In FIG. 10, the voice recognition state 200 includes an autonomous control mode 211 that instructs autonomous control of the robot arm 120, and a manual control mode 211 that instructs autonomous control of the robot arm 120, and manually controls the robot arm 120 using, for example, a user interface (UI) provided by an input device 5047. UI operation mode 212 to be operated.

The calculation condition determination unit 511 determines the voice recognition function of the instruction recognizer 60 for the robot arm 120 based on the switch signal output from the physical interface 10 and passed from the state acquisition unit 510 in response to the physical interface (IF) operation 220. It is determined whether the corresponding control is enabled or disabled.

If the calculation condition determining unit 511 determines that the control is valid, it sets the voice recognition state 200 to a voice reception start state 210 in which voice reception is started. In the voice reception start state 210, the calculation condition determining unit 511 switches the operation mode of the robot arm 120 between the autonomous control mode 211 and the UI operation mode 212 according to the voice recognized by the instruction recognizer 60.

On the other hand, if the calculation condition determination unit 511 determines that the control is invalid, it stops the control and transitions the operation mode of the robot arm 120 to the arm direct operation mode according to the operation on the arm direct operation 231 button. . The arm direct operation button 231 is, for example, an operator provided on the robot arm 120 to operate the robot arm 120 without being controlled by the arm control device 5045a.

In the existing technology, enabling and disabling control of the robot arm 120 according to the voice recognition function is controlled according to a predetermined activation word uttered by the operator 102 or the like (for example, utterance of "start voice"). . In contrast, in the first application example of the embodiment, the activation word generated by the operator 102 or the like is changed into an operation of the physical interface 10. Therefore, it is not necessary to speak the activation word, and operability can be improved. That is, according to the first application example of the embodiment, the success rate of activation related to voice control of the operation of the robot arm 120 can be set to 100%.

Note that the calculation condition determining unit 511 determines whether the operation on the physical interface 10 is of a momentary type in which the state is on only while the operation is being performed (for example, by pressing), or an alternative type in which the state is switched on or off each time the operation is performed. may also be controlled.

More specifically, in the momentary type control, the calculation condition determining unit 511 performs control according to the voice recognition function of the instruction recognizer 60 while the operator 102 is pressing the switch unit 13 of the physical interface 10, for example. is enabled, and the voice recognition state 200 is controlled to the voice reception start state 210. Further, if the switch unit 13 of the physical interface 10 is not pressed, the calculation condition determining unit 511 disables and stops the control according to the voice recognition function, and changes the operation mode of the robot arm 120 to the arm direct operation mode 230. let

On the other hand, in the alternative type control, the calculation condition determination unit 511 switches between enabling and disabling the control according to the voice recognition function, for example, every time the surgeon 102 presses the switch unit 13 of the physical interface 10.

(2-3. Second application example of embodiment)
Next, a second application example of the physical interface 10 according to the embodiment will be described. The second application example is an example in which the instruction recognized by the instruction recognizer 60 is ignored and the robot arm 120 can be manually operated by operating the physical interface 10 according to the embodiment. Similar to the above-described first application example, the instruction recognizer 60 will be described as a case where instruction information is acquired in accordance with the sound picked up by the microphone 61.

FIG. 11 is a schematic diagram showing an example of the operation mode transition of the robot arm 120 according to the second application example of the embodiment.

In the second application example, the calculation condition determining unit 511 changes the voice recognition state 200 shown in FIG. . Once the calculation condition determining unit 511 enters the voice reception start state 210 in the voice recognition state 200, it always maintains the voice reception start state 210 regardless of whether or not there is any operation on the physical interface 10. Further, the calculation condition determination unit 511 cancels the voice reception start state 210 in response to a predetermined end word 240b (for example, utterance of “end of voice”), stops control according to the voice recognition function, and controls the robot arm 120. The operation mode is changed to arm direct operation mode 230.

Here, in the example of FIG. 11, a stop button 250 is provided as a hardware (HW) button. The stop button 250 is an operator for stopping the operation of the robot arm 120 and transitioning the operation mode to the arm direct operation mode 230 in accordance with the operation. This stop button 250 functions as risk management for the operation of the robot arm 120 in the case where a problem occurs in voice recognition.

In the second application example, the physical interface 10 is made to function as this stop button 250.

For example, a case may occur in which the instruction recognizer 60 fails to recognize a voice instructing the operator 102 to "stop the robot" and the robot arm 120 does not stop in response to the voice. In such a case, the surgeon 102 can stop the operation of the robot arm 120 by operating the physical interface 10. Therefore, according to the second application example of the embodiment, the voice recognition function can be enabled at all times with risk management in place, and operability can be improved.

For example, there may be a case where the operator 102 wants to stop the operation of the robot arm 120 with a small delay in controlling the stop of the robot arm 120 in response to voice recognition. For example, depending on the state of the voice picked up by the microphone 61, the instruction recognizer 60 may require a longer time than usual for voice recognition processing. On the other hand, the switch signal output from the physical interface 10 is a signal simply indicating on and off. Therefore, according to the second application example of the embodiment, the process of stopping the robot arm 120 can be executed faster than when the voice recognition function is used.

(2-4. Third application example of embodiment)
Next, a third application example of the physical interface 10 according to the embodiment will be described. The third application example is an example in which the physical interface 10 according to the embodiment is used as an emergency stop button to emergency stop the robot arm 120.

The robot arm 120 is generally provided with an emergency stop button on its main body to completely stop its operation. FIG. 12 is a schematic diagram showing an example of the emergency stop button 123 provided on the robot arm 120. In the example in section (a) of FIG. 12, the emergency stop button 123 is provided directly to the robot arm 120. For example, when the operator 102 detects an abnormality in the operation of the robot arm 120, by operating the emergency stop button 123, the operator 102 can stop the operation of the robot arm 120 with an extremely small delay.

Here, when the emergency stop button 123 is provided on the main body of the robot arm 120, it may be placed at a position far from the surgeon 102. Section (b) of FIG. 12 schematically shows an example in which the emergency stop button 123 is placed at a position far from the operator 102.

In the example in section (b) of FIG. 12, the robot arm 120 is covered with a vinyl cover 21, and the emergency stop button 123 is provided at the middle portion of the robot arm 120. In order to operate the emergency stop button 123, the operator 102 needs to extend his left hand 102hL from the position of the operator 102 through the upper part of the patient 101. When the surgeon 102 has both hands occupied for operating the surgical instrument, the operator 102 will stop operating the surgical instrument and operate the emergency stop button 123. Further, when operating the emergency stop button 123, the vinyl cover 21 may get in the way. Therefore, there is a possibility that a delay may occur from the time when it becomes necessary to stop the operation of the robot arm 120 until the emergency stop button 123 is actually operated. Further, in some cases, an assistant or staff other than the surgeon 102 may be forced to operate the emergency stop button 123.

In the third application example of the embodiment, since the physical interface 10 is used as the emergency stop button 123, the operator 102 can stop operating the surgical instrument even when both hands are occupied with operating the surgical instrument. It is possible to stop the operation of the robot arm 120 without having to do so. That is, in the third application example of the embodiment, the surgeon 102 can stop the operation of the robot arm 120 hands-free.

(3. First modification of the embodiment)
Next, a first modification of the embodiment of the present disclosure will be described. In the first modified example of the embodiment, a configuration in which an operation is detected using light is applied as the physical interface 10.

FIG. 13 is a schematic diagram showing an example of the arrangement of physical interfaces according to the first modification of the embodiment. In FIG. 13, a physical interface 10c according to a first modification of the embodiment is placed, for example, at the feet of a surgeon 102. It is preferable that the physical interface 10c be placed in a position where it does not interfere with the foot switch 5057 or the like.

As a configuration for detecting an operation using light, for example, distance measurement using reflection of light or detecting whether the operator 102's foot or the like is inserted into the physical interface 10c is possible based on the detection result of detecting whether or not the light is blocked. There may be a method to determine whether or not this is the case.

By using the physical interface 10c that detects operations using light, it is possible to operate the physical interface 10c non-contact and with a different operation method than the foot switch 5057. Furthermore, by installing the physical interface 10c that detects operations using light at the feet of the surgeon 102, etc., even when both hands of the surgeon 102 are used exclusively for operating the surgical instrument, the physical interface 10c can be used to detect operations using light. It is possible to operate. That is, in the first modified example of the embodiment, the surgeon 102 can operate the physical interface 10c hands-free to control the operation of the robot arm 120.

(First example of the first modification of the embodiment)
FIG. 14 is a schematic diagram showing an example of a physical interface 10c-1 according to a first example of a first modification of the embodiment.

In FIG. 14, the physical interface 10c-1 has, for example, a structure in which one of each surface of a rectangular parallelepiped is an opening. In the illustrated example, a distance measuring device 16 is provided on a surface 15, which is, for example, the top surface of an opening in a rectangular parallelepiped. The distance measuring device 16 includes, for example, a light emitting section and a light receiving section, and the light emitting section irradiates the inside of the opening with light. The distance measuring device 16 detects the object from the distance measuring device 16 based on the timing at which the emitted light 160 is emitted from the light emitting section and the timing at which the reflected light 161 from the object (not shown) is received by the light receiving section. Measure the distance to.

The distance measuring device 16 determines whether or not there is an operation on the physical interface 10c-1 based on the distance measurement result. The determination result by the distance measuring device 16 is transmitted to the arm control device 5045a via the cable 11.

For example, the distance measured when nothing is inserted into the opening of the physical interface 10c-1 is set as the initial value. If distance measurement is performed with, for example, the foot (toe) of the operator 102 inserted into the opening, the emitted light 160 will be reflected by the inserted foot, so the distance measurement result will be a shorter distance than the initial value. be obtained. In the robot arm control unit 500, the state acquisition unit 510 can detect an operation on the physical interface 10c-1 based on the distance measurement result.

Note that in the example of FIG. 14, for the sake of explanation, the physical interface 10c-1 is shown as having a rectangular parallelepiped shape, but this is not limited to this shape.

Further, here, the operation on the physical interface 10c-1 is detected by distance measurement using light, but this is not limited to this example. For example, taking FIG. 14 as an example, a light emitting section is provided on the surface 15, and a light receiving section that receives light emitted from the light emitting section is provided on a surface opposite to the surface 15 at a position corresponding to the light emitting section. The status acquisition unit 510 may detect an operation on the physical interface 10c-1 based on whether the light emitted from the light emitting unit is received by the light receiving unit.

(Second example of the first modification of the embodiment)
FIG. 15 is a schematic diagram showing an example of a physical interface 10c-2 according to a second example of the first modification of the embodiment.

In FIG. 15, the physical interface 10c-2 has a wider opening in the horizontal direction than the physical interface 10c-1 shown in FIG. It has a structure in which the opening side of the side wall that is laterally in contact with the opening is notched. Further, in the example of FIG. 15, the physical interface 10c-2 is provided with a plurality of distance measuring devices 16a to 16c each including a light emitting section and a light receiving section on the top surface 17.

Each distance measuring device 16a to 16c determines whether or not there is an operation on the physical interface 10c-1 based on the distance measurement result, similarly to the first example of the first modification of the embodiment described above. The determination results from each distance measuring device 16a to 16c are logically summed, for example, and transmitted to the arm control device 5045a via the cable 11.

According to the configuration shown in FIG. 15, for example, the surgeon 102 can cause the physical interface 10c-2 to detect the operation by sliding the foot (tip of the foot) in the lateral direction.

(Third example of first modification of embodiment)
FIG. 16 is a schematic diagram showing an example of a physical interface 10c-3 according to a third example of the first modification of the embodiment.

In FIG. 16, the physical interface 10c-3 includes a light emitting device 17-1 that emits a plurality of light beams 162, and a light receiving device 17-2 that receives each light beam 162 emitted from the light emitting device 17-1. It has a light curtain structure. The light emitting device 17-1 and the light receiving device 17-2 are installed on the floor surface corresponding to the side surface of the surgical bed 100. At this time, it is preferable to make the distance between the light emitting device 17-1 and the light receiving device 17-2 somewhat wide.

If at least one light ray 162 out of the light rays 162 emitted from the light emitting device 17-1 is not received, the light receiving device 17-2 installs a light blocking object (for example, It may be determined that the tip of the foot of the operator 102 exists. The determination result of the light receiving device 17-2 is transmitted to the arm control device 5045a via the cable 11. In the robot arm control unit 500, the state acquisition unit 510 can detect an operation on the physical interface 10c-3 based on this determination result.

According to the configuration shown in FIG. 16, since it is possible to secure a wide light irradiation range, even a person other than the surgeon 102 (assistant 103, other staff, etc.) can operate the physical interface 10c-3. becomes possible.

(4. Second modification of the embodiment)
Next, a second modification of the embodiment of the present disclosure will be described. In a second modification of the embodiment, a configuration is applied as the physical interface 10 that detects an operation using a pressure-sensitive sensor that outputs a signal according to pressure.

FIG. 17 is a schematic diagram showing an example of the arrangement of physical interfaces according to the second modification of the embodiment. In FIG. 17, a physical interface 10d according to a second modification of the embodiment is placed, for example, on the floor at the feet of the surgeon 102. It is preferable that the physical interface 10d be placed in a position where it does not interfere with the foot switch 5057 or the like. The state acquisition unit 510 can detect an operation on the physical interface 10d, for example, based on a detection result that the surgeon 102 has put his weight on the physical interface 10d.

By installing the physical interface 10d that detects operations using pressure-sensitive sensors at the feet of the surgeon 102, the physical interface 10d can be used even when both hands of the surgeon 102 are used exclusively for operating the surgical instrument. It is possible to operate. That is, by applying the second modification of the embodiment, the surgeon 102 can operate the physical interface 10d hands-free and control the operation of the robot arm 120.

Furthermore, whereas the foot switch 5057 requires stepping on a predetermined position, the physical interface 10d can be configured to have a certain area, making it easy to operate.

(First example of second modification of embodiment)
FIG. 18 is a schematic diagram showing an example of the physical interface 10d-1 according to the first example of the second modification of the embodiment. The physical interface 10d-1 shown in FIG. 18 is sized so that its pressure sensitive range is limited to one person's operation. The physical interface 10d-1 is preferably placed, for example, at the feet of the surgeon 102 when performing surgery.

The physical interface 10d-1 detects, for example, that the surgeon 102 has applied his/her weight. The detection result of the physical interface 10d-1 is transmitted to the status acquisition unit 510 via the cable 11. The status acquisition unit 510 can detect an operation on the physical interface 10d-1 based on the detection result sent from the physical interface 10d-1.

(Second example of second modification of embodiment)
FIG. 19 is a schematic diagram showing an example of a physical interface 10d-2 according to a second example of a second modification of the embodiment. The physical interface 10d-2 shown in FIG. 19 has a larger pressure sensitive range than the example shown in FIG. 18, and is sized to be operable by multiple people. It is preferable that the physical interface 10d-2 be placed, for example, over the entire area on one or both sides of the surgical bed 100 while avoiding interference with other equipment.

By applying the second example of the second modification of the embodiment, even a person other than the surgeon 102 (assistant 103, other staff, etc.) can operate the physical interface 10d-2.

Note that the effects described in this specification are merely examples and are not limiting, and other effects may also exist.

Note that the present technology can also have the following configuration.
(1)
A physical interface configured so that the operator can operate it with a body part other than his or her own hand,
controlling the operation of the medical robot according to the operator's operation on the physical interface;
Control device.
(2)
The physical interface is
configured such that the operator can operate it with his/her own waist and body parts below the waist;
The control device according to (1) above.
(3)
The physical interface is
an operation interface for operating a robot arm as the medical robot that assists the surgeon in surgery;
The control device according to (1) or (2) above.
(4)
The physical interface includes at least one operation unit that can be operated by the operator.
The control device according to any one of (1) to (3) above.
(5)
the physical interface is configured to be attachable to a rail of a surgical bed;
The control device according to any one of (1) to (4) above.
(6)
The physical interface includes a tilt detection unit that detects a tilt of the surgical bed.
The control device according to (5) above.
(7)
The physical interface includes a lighting unit that irradiates light to the outside.
The control device according to (5) or (6) above.
(8)
A plurality of the physical interfaces are installed for one medical robot,
The control device according to any one of (1) to (7) above.
(9)
Each of the plurality of physical interfaces controls the same operation with respect to one of the medical robots according to the operation;
The control device according to (8) above.
(10)
The physical interface is arranged at a position corresponding to the operator's feet, and detects the operation by the operator's feet using light.
The control device according to (1) above.
(11)
The physical interface includes a pressure-sensitive sensor that detects pressure, and is disposed at a position corresponding to the operator's feet, and the physical interface detects the operation by the operator's feet as a result of the change in the pressure detected by the pressure-sensitive sensor. Detect based on
The control device according to (1) above.
(12)
a physical interface configured such that the operator can operate it with a body part other than his/her hands;
a robot arm that assists the surgeon in surgery;
a control unit that controls the operation of the robot arm according to the operator's operation on the physical interface;
including,
Medical robot.
(13)
further comprising a voice recognition unit that performs voice recognition based on the voice of the operator,
The control unit includes:
controlling the operation of the robot arm according to the result of the voice recognition;
switching between enabling and disabling control of the operation of the robot arm according to the result of the voice recognition in accordance with the operator's operation on the physical interface;
The medical robot according to (12) above.
(14)
The control unit includes:
switching between enabling and disabling the voice recognition by the voice recognition unit according to the operator's operation on the physical interface;
The medical robot according to (13) above.
(15)
The control unit includes:
stopping the operation of the robot arm while the voice recognition by the voice recognition unit is enabled in response to the operator's operation on the physical interface;
The medical robot according to (13) above.
(16)
The control unit includes:
emergency stopping the operation of the robot arm in response to the operator's operation on the physical interface;
The medical robot according to any one of (12) to (15) above.

10, 10a, 10b, 10c, 10c-1, 10c-2, 10c-3, 10d, 10d-1, 10d-2 Physical interface 11 Cable 12 Light emitting section 13 Switch section 14 Inclination sensor 16, 16a, 16b, 16c Measurement Distance device 17-1 Light emitting device 17-2 Light receiving device 50 Robot arm system 60 Instruction recognizer 61 Microphone 100 Surgical bed 101 Patient 102 Operator 103 Assistant 110 Bed rail 120 Robot arm 121 Joint part 122 Drive control part 123 Emergency stop button 160 Emitted light 161 Reflected light 162 Light beam 200 Voice recognition state 210 Voice reception start state 211 Autonomous control mode 212 UI operation mode 220 Physical interface operation 230 Arm direct operation mode 231 Arm direct operation button 250 Stop button 500 Robot arm control unit 510 Status acquisition Unit 511 Calculation condition determination unit 512 Force calculation unit 513 Command value generation unit 1210 Joint information detection unit 1211 Joint drive unit 5003 Lens barrel 5045, 5045a Arm control device 5057 Foot switch

Claims (16)

1. A physical interface configured so that the operator can operate it with a body part other than his or her own hand,
   controlling the operation of the medical robot according to the operator's operation on the physical interface;
   Control device.
2. The physical interface is
   configured such that the operator can operate it with his/her own waist and body parts below the waist;
   The control device according to claim 1.
3. The physical interface is
   an operation interface for operating a robot arm as the medical robot that assists the surgeon in surgery;
   The control device according to claim 1.
4. The physical interface includes at least one operation unit that can be operated by the operator.
   The control device according to claim 1.
5. the physical interface is configured to be attachable to a rail of a surgical bed;
   The control device according to claim 1.
6. The physical interface includes a tilt detection unit that detects a tilt of the surgical bed.
   The control device according to claim 5.
7. The physical interface includes a lighting unit that irradiates light to the outside.
   The control device according to claim 5.
8. A plurality of the physical interfaces are installed for one medical robot,
   The control device according to claim 1.
9. Each of the plurality of physical interfaces controls the same operation with respect to one of the medical robots according to the operation;
   The control device according to claim 8.
10. The physical interface is arranged at a position corresponding to the operator's feet, and detects the operation by the operator's feet using light.
    The control device according to claim 1.
11. The physical interface includes a pressure-sensitive sensor that detects pressure, and is disposed at a position corresponding to the operator's feet, and the physical interface detects the operation by the operator's feet as a result of the change in the pressure detected by the pressure-sensitive sensor. Detect based on
    The control device according to claim 1.
12. a physical interface configured such that the operator can operate it with a body part other than his/her hands;
    a robot arm that assists the surgeon in surgery;
    a control unit that controls the operation of the robot arm according to the operator's operation on the physical interface;
    including,
    Medical robot.
13. further comprising a voice recognition unit that performs voice recognition based on the voice of the operator,
    The control unit includes:
    controlling the operation of the robot arm according to the result of the voice recognition;
    switching between enabling and disabling control of the operation of the robot arm according to the result of the voice recognition in accordance with the operator's operation on the physical interface;
    The medical robot according to claim 12.
14. The control unit includes:
    switching between enabling and disabling the voice recognition by the voice recognition unit according to the operator's operation on the physical interface;
    The medical robot according to claim 13.
15. The control unit includes:
    stopping the operation of the robot arm while the voice recognition by the voice recognition unit is enabled in response to the operator's operation on the physical interface;
    The medical robot according to claim 13.
16. The control unit includes:
    emergency stopping the operation of the robot arm in response to the operator's operation on the physical interface;
    The medical robot according to claim 12.

Images