WO2017125994A1 - Manipulator system for medical use and operation method therefor - Google Patents

Manipulator system for medical use and operation method therefor Download PDF

Info

Publication number
WO2017125994A1
WO2017125994A1 PCT/JP2016/051228 JP2016051228W WO2017125994A1 WO 2017125994 A1 WO2017125994 A1 WO 2017125994A1 JP 2016051228 W JP2016051228 W JP 2016051228W WO 2017125994 A1 WO2017125994 A1 WO 2017125994A1
Authority
WO
WIPO (PCT)
Prior art keywords
joint
state
manipulator system
arm
medical manipulator
Prior art date
Application number
PCT/JP2016/051228
Other languages
French (fr)
Japanese (ja)
Inventor
竜一 頼本
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Priority to PCT/JP2016/051228 priority Critical patent/WO2017125994A1/en
Publication of WO2017125994A1 publication Critical patent/WO2017125994A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J3/00Manipulators of master-slave type, i.e. both controlling unit and controlled unit perform corresponding spatial movements

Definitions

  • the present invention relates to a medical manipulator system and an operation method thereof.
  • a master-slave type medical manipulator system including a master arm having a joint structure operated by an operator and a slave arm having a joint structure that operates based on an operation input to the master arm is known.
  • Patent Literature 1 discloses a surgery support system including a master arm (operation input device) operated by an operator and a slave arm (surgical instrument) that is operated by the master arm and performs treatment on an affected area. It is disclosed.
  • the master arm and the slave arm have similar joint structures having the same degree of freedom.
  • the slave arm is controlled so that the joints corresponding to the joints of the master arm operate in the directions corresponding to the joints of the master arm with the corresponding displacement amount.
  • Patent Document 2 discloses a medical device including an insertion slave device to be inserted into the body, and an insertion master unit that has a similar structure to the insertion slave device and operates the insertion slave device by an input operation from an operator. A system is disclosed.
  • a master-slave medical system in which a master arm and a slave arm are configured to be similar to each other, and the master arm and the slave arm are controlled to maintain a similar relationship to each other.
  • the slave arm can follow the movement of the master arm operated by the operator. Therefore, the operator can remotely operate the slave arm while grasping the operation state (for example, shape) of the slave arm based on the operation state of the master arm.
  • the present invention has been made in view of such circumstances, and its purpose is to easily and intuitively grasp the mutual relationship between each joint of the master arm and each joint of the slave arm corresponding thereto. It is to provide a medical manipulator system capable of performing the above and a method for operating the same.
  • a medical manipulator system has one or more first joints, a slave arm having an end effector at a distal end, and one or more second joints, and is operated by an operator.
  • a master arm a notification unit that is provided at the second joint and notifies the state of the first joint corresponding to the second joint or the state of the second joint, and controls the master arm and the slave arm And a control unit that instructs the notification unit to notify the state of the first joint or the state of the second joint under a predetermined condition.
  • the controller controls a first mode for controlling the slave arm according to the movement of the master arm and a second mode for controlling the state of the second joint to match the state of the first joint. You may have.
  • the control unit issues an operation command to the first joint so that the state of the first joint corresponding to the second joint matches the state of the second joint. And the control unit determines whether or not the operation command is a command that falls within a predetermined movable range of the first joint, and the control unit determines the result of the determination as the first You may instruct
  • control unit calculates a difference between the state of the second joint corresponding to the first joint and the state of the first joint, and notifies the difference from the notification unit. You may instruct.
  • the control unit may determine whether the difference is within a predetermined range, and may notify the notification unit when the difference is within the predetermined range.
  • the control unit may determine whether the operability of the first joint is good or not based on the state of the first joint, and may notify the notification unit if the first joint is defective.
  • the control unit may determine whether the operability of the second joint is good or not based on the state of the second joint, and may notify the notification unit if the second joint is defective.
  • the notification unit may include a light emitting unit capable of emitting a plurality of colors.
  • the operation method of the medical manipulator system according to the present invention includes one or more first joints, a slave arm having an end effector at a distal end, and one or more second joints.
  • An operation method of a medical manipulator system comprising: a step of detecting a state of the first joint or a state of the second joint; and a predetermined condition on the second joint. And instructing a notifying unit provided in the second joint so as to notify the corresponding state of the first joint or the state of the second joint.
  • (10) It has a first mode for controlling the slave arm according to the movement of the master arm, and a second mode for controlling the state of the second joint to match the state of the first joint. May be.
  • the first mode is a step of outputting an operation command to the first joint so that the state of the first joint corresponding to the second joint matches the state of the second joint; Determining whether the operation command is a command within a predetermined movable range of the first joint, and notifying the result of the determination of the second joint corresponding to the first joint And a step of instructing to notify from the section.
  • the state of the first joint corresponding to the second joint and the state of the second joint can be notified (notified) to the surroundings from the notification unit provided in the second joint of the master arm. Therefore, for example, when the operator remotely operates the slave arm via the master arm, or when performing a shape synchronization operation (setting operation) for synchronizing the shape of the master arm with the shape of the slave arm, the second joint in the master arm.
  • the operator and the assistant can grasp the state (rotation angle, etc.) and the mutual relationship between the state of the second joint in the master arm and the state of the first joint in the slave arm corresponding to the second joint. .
  • the notification unit provided in the second joint reports the state of the second joint and the state of the first joint corresponding to the second joint
  • the master arm and the slave arm have many joints. Even so, the operator and the assistant can easily and intuitively grasp the state of each second joint and the state of the first joint corresponding thereto.
  • the operability of the master arm and the slave arm can be improved, and for example, the operator's consciousness can be concentrated on the treatment work on the affected area by the slave arm and the end effector. Furthermore, the shape synchronization operation for synchronizing the shape of the master arm with the shape of the slave arm can be performed easily and efficiently.
  • FIG. 1 is an overall configuration diagram showing a first embodiment of a medical manipulator system according to the present invention.
  • FIG. 2 is a perspective view around the distal end of the overtube shown in FIG. 1, showing the relationship between the overtube, the endoscope, and a slave arm.
  • It is a schematic diagram of a master arm and a slave arm.
  • It is a block diagram which shows the structure of the control system of the medical manipulator system shown in FIG.
  • It is a schematic diagram of a master arm and a slave arm, Comprising: It is a figure which shows the state from which the shape of a master arm does not correspond with the shape of a slave arm.
  • a medical manipulator system 1 includes a slave manipulator 2 that performs a treatment on a patient lying on an operating table, and a master manipulator 3 that is operated by an operator (operator).
  • a control unit (control unit) 4 that comprehensively controls the slave manipulator 2 and the master manipulator 3 is provided.
  • the slave manipulator 2 is attached to an articulated robot arm 10 installed in the vicinity of the operating table and a mounting portion 11 provided at the tip of the robot arm 10,
  • the medical overtube 12 inserted into the overtube 12, the slave arm 13 inserted into the overtube 12, and the motor unit 14 attached to the mounting portion 11.
  • the overtube 12 is a long and flexible tube, and the base end (proximal end) side is attached to the mounting portion 11.
  • the case where the overtube 12 is orally inserted into the patient's body will be described as an example.
  • the present invention is not limited to this case, and the overtube 12 is inserted into the patient's body through the anus. May be.
  • a first lumen 15 for inserting two slave arms 13 and an endoscope 5 are inserted through the overtube 12 from the proximal end to the distal end (distal end).
  • a second lumen 16 is formed.
  • the configuration of the overtube 12 is not limited to this case.
  • the slave arm 13 and the endoscope 5 may be attached to the tip of the overtube 12 so as to protrude further than the tip of the overtube 12. In this case, it is not necessary to form the first lumen 15 and the second lumen 16 in the overtube 12. Moreover, it is good also as the overtube 12 which can be bent according to operation from the outside of the body.
  • the two slave arms 13 are attached through the first lumen 15, and the tip (distal end) side protrudes from the tip of the overtube 12.
  • the dual-arm type slave manipulator 2 having two slave arms 13 will be described as an example, but the number of slave arms 13 may be one or three or more.
  • the slave arm 13 is a treatment tool having a joint structure having at least one or more first joints 20, and an end effector 21 is provided at the tip thereof.
  • the end effector 21 is a treatment unit that performs treatment on an affected part that is a treatment target site in the body, and is appropriately selected according to, for example, the state of the affected part, the content of surgery, and the like. Specifically, the end effector 21 is for observing a treatment part for performing a surgical treatment on the affected part, such as a grasping forceps, an incision knife (including an incision by energization of a high-frequency current), an electrode, or the like. And a treatment section that performs optical or ultrasonic observation.
  • a treatment part for performing a surgical treatment on the affected part such as a grasping forceps, an incision knife (including an incision by energization of a high-frequency current), an electrode, or the like.
  • a treatment section that performs optical or ultrasonic observation.
  • the end effector 21 is configured as a grasping forceps that can be opened and closed by an operation with the drive wire 22.
  • the drive wire 22 extends to the motor unit 14 through the inside of the slave arm 13.
  • the slave arm 13 includes a plurality of first joints 20 and a connecting portion 23 that connects the first joints 20 to each other. It is possible to be curved.
  • the configuration of the slave arm 13 is schematically shown, and a case where the four first joints 20 are provided is described as an example. However, the number of the first joints 20 is not limited to four, and may be two, three, or five or more.
  • first joint 20 for example, a roll joint that rotates about the roll axis along the central axis O of the slave arm 13, or a yaw that rotates about the yaw axis (or pitch axis) orthogonal to the central axis O of the slave arm 13. It is a joint (or pitch joint).
  • roll joints and yaw joints (or pitch joints) are connected so as to be arranged in an arbitrary arrangement (for example, alternately arranged). Thereby, the slave arm 13 can be bent three-dimensionally.
  • Each of the first joints 20 can be rotated by an operation using the angle wire 24.
  • the angle wire 24 extends to the motor unit 14 through the inside of the slave arm 13.
  • the motor unit 14 is detachably mounted on the mounting portion 11 of the robot arm 10, for example.
  • the motor unit 14 includes an effector actuator 25 that operates the end effector 21 by transmitting power to the end effector 21 via the drive wire 22, and each first joint 20 via the angle wire 24.
  • a joint actuator 26 that rotates each first joint 20 by transmitting power to each other.
  • the effector actuator 25 and the joint actuator 26 operate based on instructions from a slave control unit 51 described later.
  • the motor unit 14 includes a first encoder 27 that detects a rotation angle, which is one of indices indicating the state of each first joint 20.
  • the first encoder 27 outputs the detection result (the rotation angle of the first joint 20) to the slave control unit 51.
  • the first encoder 27 may be provided in each first joint 20.
  • the master manipulator 3 includes an operation input device 30 operated by an operator and a display unit 31.
  • the operation input device 30 is attached, for example, to an operation table 33 attached to an operation table 32 installed on the floor so that the height can be adjusted.
  • the operation table 33 is adjusted to a height at which the operator can place an elbow or arm while standing.
  • Two operation input devices 30 are provided corresponding to the slave arm 13 and are mounted on the operation table 33 at intervals in the shoulder width direction of the operator so that the operator can operate with both hands.
  • the operation input device 30 includes a master arm 34 whose base end (proximal end) side is attached on the operation table 33, and a grip portion 35 attached to the tip of the master arm 34. I have.
  • the master arm 34 has at least one or more second joints 36 and is a joint structure operating tool operated by an operator. As shown in FIG. 3, the master arm 34 includes a plurality of second joints 36 and a connecting portion 37 that connects the second joints 36 to each other. It is possible to be curved.
  • the master arm 34 of the present embodiment is configured to have a joint structure similar to the joint structure of the slave arm 13. That is, four second joints 36 of the master arm 34 are provided similarly to the first joint 20 of the slave arm 13, and the structure thereof is similar to the first joint 20.
  • the second joint 36 has the same degree of freedom as or more than that of the first joint 20.
  • the second joints 36 of the master arm 34 and the first joints 20 of the slave arm 13 have a corresponding relationship. ing.
  • the grip part 35 is operated while being directly gripped by, for example, an operator's fingertip.
  • the grip portion 35 is provided with an operation portion (for example, an operation button) 38 for operating the end effector 21, and the end effector 21 is operated via the effector actuator 25 by operating the operation portion 38. Is possible.
  • the operation unit 38 outputs a signal based on the input operation to the master control unit 50 described later.
  • Each second joint 36 of the master arm 34 is provided with a second encoder 39 that detects the rotation angle of the second joint 36.
  • the second encoder 39 outputs the detection result (the rotation angle of the second joint 36) to the master control unit 50.
  • each second joint 36 of the master arm 34 is provided with a notification unit 41 that notifies the surroundings of the state of the first joint 20 or the state of the second joint 36 under a predetermined condition.
  • the notification unit 41 includes a light emitting unit 40, a fixing member (not shown) for attaching the light emitting unit 40 to the second joint 36, a circuit board (not shown) of the light emitting unit 40, and the like.
  • the light emitting unit 40 emits visible light to notify the surroundings of the state of the second joint 36 to which the light emitting unit 40 is attached and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36. .
  • the joint state includes the rotation angle, rotation direction, and the like of the joint, and indicates what shape and posture the joint is in.
  • the operator and the assistant for example, the current state of the second joint 36 in the master arm 34, the current state of the first joint 20 in the slave arm 13,
  • Various information related to the state of the joint such as the mutual relationship between the second joint 36 and the first joint 20 of the slave arm 13 corresponding thereto, can be grasped. This will be described in detail later.
  • the light emitting unit 40 has one or a plurality of light emitting diodes such as LEDs, and can emit light of a single color or a plurality of colors by various light emitting methods such as lighting or blinking.
  • the light emission part 40 is controlled by the alerting
  • the display unit 31 is attached to the upper part of the operation table 32 and is disposed above the operation table 33. As a result, the operator can operate the operation input device 30 while confirming the screen of the display unit 31. Based on the video signal output via the control unit 4, for example, an image captured by the endoscope 5, various information necessary for operating the medical manipulator system 1, and the like are displayed on the display unit 31. Is done.
  • control unit 4 includes a master control unit 50, a slave control unit 51, a mode control unit 52, a notification control unit 53, a display control unit 54, and a storage unit 55. .
  • the master control unit 50 Based on the operation input to the operation input device 30, the master control unit 50 outputs a predetermined operation command (operation signal) to the slave control unit 51 so that the slave arm 13 and the end effector 21 operate. . That is, the master control unit 50 generates a predetermined operation command based on the signal from the operation unit 38 and the detection result (detection signal) from the second encoder 39, and outputs it to the slave control unit 51.
  • the slave controller 51 controls the joint actuator 26 and the effector actuator 25 based on the operation command from the master controller 50, and controls the slave arm 13 and the end effector 21.
  • the mode control unit 52 adjusts the state of the second joint 36 of the master arm 34 to the first mode for controlling the slave arm 13 according to the movement of the master arm 34 and the state of the first joint 20 of the slave arm 13.
  • the mode is switched between the second mode to be controlled.
  • the mode control unit 52 may not only include the first mode and the second mode, but may further include other modes and switch between a plurality of modes.
  • the first mode is a mode used mainly when the operator remotely operates the slave arm 13 by the master arm 34 and performs treatment on the affected part in the patient's body using the slave arm 13.
  • the first mode is a mode in which the slave arm 13 is controlled so that the slave arm 13 is similar to the master arm 34.
  • the second mode is a mode in which the posture of the slave arm 13 is maintained and the control of the slave arm 13 is stopped so as not to follow the input operation of the master arm 34, and shape synchronization is mainly one of setting operations. This mode is used when working. That is, the second mode is a mode for synchronizing the shape of the master arm 34 with the shape of the slave arm 13.
  • the notification control unit 53 instructs the light emitting unit to notify the surroundings by light emission of the state of the first joint 20 or the state of the second joint 36 under a predetermined condition set in advance. As a result, the state of the first joint 20 corresponding to the second joint 36 or the state of the second joint 36 can be notified to the surroundings.
  • the notification control unit 53 receives the detection result (detection signal) of the second encoder 39 via the master control unit 50 and the detection result (detection signal) of the first encoder 27 via the slave control unit 51. Entered. Accordingly, the notification control unit 53 accurately grasps the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36 in real time.
  • reporting control part 53 shows the state of the 1st joint 20 corresponding to the state of the 2nd joint 36 and the 2nd joint 36 in the form of light emission, for example according to the operation condition of the master arm 34 and the slave arm 13.
  • the light emitting unit 40 is controlled to notify the surroundings. The control of the light emitting unit 40 by the notification control unit 53 will be described in detail later.
  • the notification control unit 53 has information regarding a movable range predetermined for each first joint 20 of the slave arm 13.
  • the notification control unit 53 also displays information on joints including the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36 in the display control unit 54. Output.
  • the display control unit 54 causes the display unit 31 to display information transmitted from the notification control unit 53.
  • the display control unit 54 displays information required by the operator and the assistant on the display unit 31 such as an image captured by the endoscope 5 and various types of information necessary for operating the medical manipulator system 1. Let Thereby, the operator and the assistant can grasp desired information and images by visually recognizing the display unit 31.
  • the storage unit 55 stores the detection result of the first encoder 27 based on instructions from the operator and the assistant. Thereby, the state of the first joint 20 in the slave arm 13 can be stored at an arbitrary timing. That is, the shape of the slave arm 13 can be stored at an arbitrary timing. Note that the number of times to be stored in the storage unit 55 is not limited to one, but may be stored a plurality of times.
  • the operator When performing a treatment on an affected part in a patient's body, as shown in FIG. 1, the operator operates the robot arm 10 while checking the image captured by the endoscope 5 on the display unit 31, for example. After the distal end of the tube 12 is moved to the vicinity of the affected area, the tube 12 is disposed at that position. Subsequently, the operator remotely operates the slave arm 13 and the end effector 21 by operating the operation input device 30 while confirming the image by the endoscope 5 on the display unit 31, and performs appropriate treatment on the affected part. Apply.
  • the operator When performing such treatment, the operator causes the mode control unit 52 to operate the control mode of the medical manipulator system 1 in the first mode.
  • the slave arm 13 can be controlled so that the slave arm 13 is similar to the master arm 34. That is, since the slave arm 13 can be controlled according to the movement of the master arm 34, a master-slave operation can be performed. Therefore, the operator can perform an appropriate treatment for the affected part via the slave arm 13 by operating the master arm 34.
  • the master arm 34 generally does not have an actuator that operates the second joint 36. Therefore, for example, when the treatment on the affected part is temporarily interrupted and the operator removes the hand from the operation input device 30, or at the start-up stage of the system, the shape of the master arm 34 changes due to the influence of its own weight, and the slave arm 13 The shape may be different.
  • the operator uses the mode control unit 52 to control the control mode of the medical manipulator system 1 from the first mode so that the state of the second joint 36 matches the state of the first joint 20.
  • the mode is switched to the second mode, and the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 is performed.
  • the operator switches the control mode of the medical manipulator system 1 to the second mode via the mode control unit 52 (step S1 shown in FIG. 5).
  • the mode control unit 52 invalidates the operation command from the master control unit 50 to the slave control unit 51, thereby stopping the control of the slave arm 13 so as not to follow the input operation of the master arm 34. Can do. That is, the master / slave operation can be terminated.
  • the operator visually recognizes the shape of the slave arm 13 or confirms the shape of the slave arm 13 based on the image from the endoscope 5 displayed on the display unit 31. Then, the master arm 34 is operated to bring the shape of the master arm 34 closer to the shape of the slave arm 13 (step S2 shown in FIG. 5).
  • the notification control unit 53 detects the rotation angle of each second joint 36 of the master arm 34 (that is, the state of the second joint 36) detected by the second encoder 39 via the master control unit 50, and the slave control unit.
  • the rotation angle of each first joint 20 of the slave arm 13 (that is, the state of the first joint 20) detected by the first encoder 27 via 51 is grasped.
  • the notification control unit 53 compares the detected rotation angle of the first joint 20 of the slave arm 13 with the detected rotation angle of the second joint 36 of the master arm 34 to thereby detect the first joint 20.
  • An angle difference (difference) between the rotation angle and the corresponding rotation angle of the second joint 36 is calculated (step S3 shown in FIG. 5).
  • the notification control unit 53 determines whether or not this angle difference (difference) is within a predetermined angle range (within a predetermined range) (step S4 shown in FIG. 5). As a result, when the angle difference is within a predetermined angle range, the notification control unit 53 causes the light emitting unit 40 provided in the second joint 36 to emit light, thereby notifying the surroundings. (Step S5 shown in FIG. 5).
  • the notification control unit 53 controls the light emitting unit 40 to light up in blue.
  • the operator and the assistant can grasp that the rotation angle of the second joint 36 of the master arm 34 matches the rotation angle of the first joint 20 of the corresponding slave arm 13.
  • the light emitting unit 40 is lit in blue, so that the operator and the assistant are provided with the light emitting unit 40 that is lit. It can be easily and intuitively understood that the rotation angle of the second joint 36 matches the rotation angle of the first joint 20 of the corresponding slave arm 13.
  • the operator and the assistant agree with the first joint 20 of the slave arm 13 among the second joints 36 of the master arm 34 based on the presence or absence of light emission of the light emitting unit 40. It is possible to grasp the joints that are present and the joints that do not match.
  • the two second joints 36 on the hand side and the light emitting unit 40 provided in the second joint 36 closest to the grip part 35 are lit in blue (dots). Are hatched). Therefore, the operator and the assistant can grasp that the rotation angle of the remaining second joint 36 does not coincide with the rotation angle of the corresponding first joint 20 of the slave arm 13.
  • step S ⁇ b> 6 shown in FIG. 5 by confirming that all the light emitting units 40 are lit in blue (step S ⁇ b> 6 shown in FIG. 5), the shape of the master arm 34 is synchronized with the shape of the slave arm 13. The shape synchronization operation to be performed can be completed (step S7 shown in FIG. 5).
  • each second joint 36 of the master arm 34 and the corresponding first joint 20 of the slave arm 13 is determined based on whether or not the light emitting unit 40 emits light. Since it can be easily and intuitively grasped, the shape synchronization operation of matching the state of the second joint 36 with the state of the first joint 20 can be performed easily and efficiently.
  • the operator switches the control mode of the medical manipulator system 1 from the second mode to the first mode via the mode control unit 52 (step S10 shown in FIG. 8).
  • the slave control unit 51 shifts to a state controlled based on the operation command from the master control unit 50.
  • reporting control part 53 is reset by switching mode.
  • the operator After shifting to the first mode, the operator operates the operation input device 30 while confirming the image by the endoscope 5 on the display unit 31, as shown in FIGS. 13 and the end effector 21 are remotely operated.
  • the master control unit 50 outputs an operation command corresponding to the operation input to the operation unit 38 to the slave control unit 51. Since the slave control unit 51 operates the effector actuator 25 based on this operation command, the end effector 21 can be operated (opening / closing operation) via the drive wire 22 and the end effector 21 can be remotely operated. .
  • each second joint 36 of the master arm 34 rotates according to the shape of the master arm 34. Therefore, the second encoder 39 provided in each second joint 36 outputs the rotation angle of each second joint 36 to the master control unit 50. Then, the master control unit 50 operates so that the first joint 20 of the slave arm 13 corresponding to the second joint 36 matches the rotation angle of the second joint 36 based on the detection result from the second encoder 39. A command is generated and output to the slave control unit 51 (step S12 shown in FIG. 8).
  • the slave control unit 51 operates the joint actuator 26 based on the operation command from the master control unit 50, and rotates the first joint 20 of the slave arm 13 at the commanded rotation angle via the angle wire 24. Accordingly, the rotation angle of the first joint 20 of the corresponding slave arm 13 can be matched with the rotation angle of the second joint 36 of the master arm 34, and the shape of the slave arm 13 can be made different from the shape of the master arm 34. It can be made similar to high precision.
  • the operator can remotely operate the slave arm 13 and the end effector 21 via the operation input device 30, and can appropriately treat the affected area.
  • the notification control unit 53 accurately and accurately determines the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36.
  • each of the first joints 20 of the slave arm 13 has information related to a predetermined movable range.
  • the notification control unit 53 determines whether the operation command output from the master control unit 50 to the slave control unit 51 is a command that falls within the movable range while performing the master-slave operation ( Step S13 shown in FIG.
  • the notification control unit 53 determines that the operation command is valid. Thereby, as described above, the slave control unit 51 controls the slave arm 13 based on the operation command (step S14 shown in FIG. 8). Thereby, the shape of the slave arm 13 can be made similar to the shape of the master arm 34 (step S15 shown in FIG. 8).
  • the notification control unit 53 determines that the operation command is invalid. In this case, the notification control unit 53 cancels the operation command so that the slave control unit 51 does not operate according to the operation command, and causes the light emitting unit 40 to emit a determination result indicating that the movable limit is exceeded. And informing the surroundings (step S16 shown in FIG. 8).
  • the notification control unit 53 performs control so that the light emitting unit 40 provided in the second joint 36 corresponding to the first joint 20 of the slave arm 13 exceeding the movable limit is lit in red.
  • the operator and the assistant can stop or suppress the operation of the master arm 34 when the red light is lit, and the slave arm 13 can not move so as to exceed the movable limit of the first joint 20. Can be prevented from continuing to request.
  • the notification control unit 53 is in the state of the second joint 36 in the master arm 34 in both cases of the first mode and the second mode. And the state of the 1st joint 20 in the slave arm 13 corresponding to it can be grasped
  • the operability of the master arm 34 and the slave arm 13 can be improved, and the operator's consciousness can be concentrated on the treatment work on the affected area by the slave arm 13 and the end effector 21.
  • the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 can be performed easily and efficiently.
  • the light emission part 40 was lighted in blue, it is not limited to blue, You may set so that it may light with arbitrary colors. Further, the method of light emission is not limited to lighting, and may be blinking, for example.
  • the light emission intensity of the light emitting unit 40 increases. You may control. In this case, it is only necessary to rotate the second joint 36 in the direction in which the emission intensity increases, so that the shape synchronization operation can be performed more efficiently.
  • the light emitting unit 40 when the angle difference between the rotation angle of the first joint 20 of the slave arm 13 and the rotation angle of the second joint 36 of the master arm 34 corresponding thereto is within a predetermined angle range, the light emitting unit 40 is emitted in blue, but the light emitting unit 40 may emit light so as to notify the angle difference (difference). For example, the light emitting unit 40 may emit light so as to change the color and intensity of light emission according to the angle difference.
  • the operator or the assistant can set the rotation angle of the second joint 36 in the master arm 34 to the rotation angle of the first joint 20 in the corresponding slave arm 13. It is possible to grasp whether or not they match. Therefore, the shape synchronization operation can be performed efficiently as well.
  • the content of the shape synchronization work when the mode is shifted to the second mode is different from that of the first embodiment. This will be described with reference to the flowchart shown in FIG.
  • the angle range (difference) between the rotation angle of the first joint 20 of the slave arm 13 and the rotation angle of the second joint 36 of the master arm 34 corresponding to the notification control unit 53 is determined in advance. Since it is the same as that of the first embodiment until it is determined whether it is within (predetermined range) (steps S1 to S4 shown in FIG. 10), the description thereof is omitted.
  • the notification control unit 53 when the angle difference is within a predetermined angle range, causes the light emitting unit 40 provided in the second joint 36 to emit light, thereby informing the surroundings. (Step S20 shown in FIG. 10). Specifically, the notification control unit 53 controls the light emitting unit 40 to light up in blue. Thereby, the operator and the assistant can grasp that the rotation angle of the second joint 36 of the master arm 34 matches the rotation angle of the first joint 20 of the corresponding slave arm 13.
  • the operator and the assistant grasp that the second joint 36 at a position where the light emitting unit 40 is not lit in blue (hatched with dots) needs to be rotated. be able to. Therefore, the operator operates the master arm 34 so as to rotate the second joint 36 at a position where the light emitting unit 40 is not lit.
  • the notification control unit 53 determines whether or not the angle difference is small and approaches a predetermined angle range (step S21 shown in FIG. 10). As a result, when the angle difference is included in the predetermined angle range, the notification control unit 53 turns on the light emitting unit 40 that has not been turned on in blue (step S20 shown in FIG. 10).
  • the notification control unit 53 changes the light emitting unit 40 that has not been lit to a color different from blue, for example, red. Lights up (step S22 shown in FIG. 10).
  • the operator rotates the second joint 36 at a position where the light emitting unit 40 is not lit, the operator rotates the second joint 36 in the correct direction for shape synchronization by the color that the light emitting unit 40 is subsequently lit. It can be grasped whether it is rotating in the wrong direction.
  • the shape synchronization operation can be performed more efficiently.
  • step S23 shown in FIG. 10 the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 is completed. (Step S24 shown in FIG. 10).
  • the notification control unit 53 causes the rotation angle of the first joint 20 of the slave arm 13 stored in the storage unit 55 and the rotation angle of the second joint 36 of the current master arm 34 to be stored. Compare with.
  • the master control unit 50 operates such that the first joint 20 of the slave arm 13 corresponding to the second joint 36 matches the rotation angle of the second joint 36 based on the detection result from the second encoder 39. Until the command is output to the slave control unit 51 (steps S10 to S12 shown in FIG. 12), the operation of the slave arm 13 is similar to the shape of the master arm 34 (master slave operation). Since it is the same as 1st Embodiment, description is abbreviate
  • the operator when the master-slave operation is performed, when the slave arm 13 repeats the same movement, the operator stores in the storage unit 55 the rotation angle of each first joint 20 of the slave arm 13 before the change. Perform the operation. This operation can be performed, for example, by pressing a memory button (not shown) provided in the operation table 33. Thereby, the memory
  • the master-slave operation is advanced, and after the shape of the slave arm 13 is changed, when the slave arm 13 is returned again to the shape before the change by the operation of the operation input device 30, the operator stores it in the storage unit 55. Perform operations that use information. This operation can be performed, for example, by pressing a support button (not shown) provided on the operation table 33.
  • the notification control unit 53 stores the rotation angle of the first joint 20 of the slave arm 13 stored in the storage unit 55 and the current rotation angle of the second joint 36 of the master arm 34 detected by the second encoder 39. , To calculate the angular difference (difference) (step S31 shown in FIG. 12).
  • the notification control unit 53 determines whether or not the angle difference (difference) is within a predetermined angle range (within a predetermined range) (step S32 shown in FIG. 12). As a result, when the angle difference is within a predetermined angle range, the notification control unit 53 causes the light emitting unit 40 provided in the second joint 36 to emit light, thereby notifying the surroundings. (Step S33 shown in FIG. 12).
  • the notification control unit 53 controls the light emitting unit 40 to light up in blue.
  • the operator and the assistant can make the rotation angle of the first joint 20 of the slave arm 13 corresponding to the second joint 36 with the light emitting unit 40 lit coincide with the rotation angle of the first joint 20 stored before the change. I can understand what happened.
  • the operator and the assistant can store the state before the change stored in the first joint 20 of the slave arm 13 based on whether or not the light emitting unit 40 emits light (dotted line in FIG. 13). It is possible to grasp the joint that coincides with the first joint 20 and the joint that does not coincide with each other.
  • the light emitting unit 40 provided at the second joint 36 on the hand side is lit in blue (hatched with dots). Therefore, the operator and the assistant grasp that the rotation angle of the first joint 20 of the slave arm 13 corresponding to the remaining three second joints 36 does not match the stored rotation angle before the change. be able to.
  • the operator can notice that it is necessary to change the rotation angles of the remaining three first joints 20, and can quickly perform such an operation.
  • the rotation angles of the two second joints 36 out of the remaining three can be quickly adjusted to match the stored rotation angle before the change.
  • all the light emitting units 40 are finally lit in blue (step S34 shown in FIG. 12).
  • the slave arm 13 can be made to correspond with the state before a change (step S35 shown in FIG. 12).
  • the slave arm 13 can be quickly returned to the shape before change, the operability when the same movement is repeatedly performed on the slave arm 13 can be improved. Therefore, it is particularly effective when, for example, the suture is repeatedly performed on the affected area.
  • the detection result of the second encoder 39 is input to the notification control unit 53 via the master control unit 50 and the detection result of the first encoder 27 is input to the notification control unit 53 via the slave control unit 51.
  • the notification control unit 53 accurately grasps the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36 in real time.
  • the notification control unit 53 determines the current state of each first joint 20 of the slave arm 13 and the current master arm 34 based on the detection results of the first encoder 27 and the second encoder 39 regardless of the control mode.
  • the operability of the state of each second joint 36 is determined (step S40 shown in FIG. 15).
  • the master arm 34 is operated. Even if the operation command is output from the master control unit 50 to the slave control unit 51 and the joint actuator 26 is operated accordingly, it is difficult to appropriately rotate the first joint 20.
  • the notification control unit 53 can grasp from the detection result from the first encoder 27 that the first joint 20 is not operating properly. That is, the notification control unit 53 can grasp that an appropriate response is not made to the operation command. Thereby, the notification control unit 53 can determine that the first joint 20 is malfunctioning.
  • the information control part 53 makes the light emission part 40 provided in the 2nd joint 36 of the master arm 34 corresponding to the 1st joint 20 judged to be malfunctioning emit light. Then, it informs the surroundings that it is malfunctioning (step S41 shown in FIG. 15).
  • the light emitting unit 40 provided at the second joint 36 that is the second from the hand side is lit red (hatched with hatching).
  • the operator and the assistant have a problem (failure) in the second joint 36 provided with the light emitting unit 40 or the corresponding first joint 20 because the light emitting unit 40 is lit red. I can grasp that. Therefore, the operator and the assistant can appropriately take measures against the malfunction.
  • the mode may be shifted to a mode for determining a failure.
  • the light emitting unit 40 is caused to emit light in different colors so that the case where the first joint 20 fails and the case where the second joint 36 corresponding to the first joint 20 fails can be easily distinguished. good. For example, when the first joint 20 fails, the light emitting unit 40 emits light in red, and when the second joint 36 corresponding to the first joint 20 fails, the light emitting unit 40 emits light in yellow. good. By doing so, the operator and the assistant can determine whether the second joint 36 provided with the light emitting unit 40 has failed or the corresponding first joint 20 based on the color of the light emitting unit 40 lit. It is possible to easily grasp whether or not the device has failed. Instead of distinguishing between colors, for example, the difference in light emission between lighting and flashing is used to determine whether the second joint 36 provided with the light emitting unit 40 has failed or the first joint 20 corresponding thereto has failed. It may be distinguished whether a failure has occurred.
  • a test (operation check test) is performed to confirm that the master arm 34 operates properly at the time of start-up or periodic inspection. That is, each second joint 36 of the master arm 34 is rotated within the movable range, and it is confirmed that it operates properly.
  • This test is started when the operator presses a test button (not shown) provided on the operation table 33, for example.
  • step S50 when the test button is pressed, the test mode is entered and an input test is started (step S50 shown in FIG. 17). Then, the operator operates the master arm 34 so as to sequentially rotate the second joints 36 one by one (step S51 shown in FIG. 15). At this time, as described above, since the detection result of the second encoder 39 is input to the notification control unit 53 via the master control unit 50, the state of the second joint 36 of the master arm 34 is accurately determined. And grasp in real time.
  • the notification control unit 53 can grasp the second joint 36 currently being tested based on the detection result of the second encoder 39. Therefore, the notification control unit 53 controls the light emitting unit 40 provided in the second joint 36 to light up in blue, for example, during the test or after the test is finished (step S52 shown in FIG. 15).
  • the operator and the assistant can easily and intuitively grasp the second joint 36 currently being tested and the second joint 36 that has already been tested.
  • the operator and the caregiver are in the second joints 36 of the master arm 34. It is possible to grasp that the test has been completed for the three second joints 36 provided with the light emitting units 40 that are lit.
  • the input test can be performed reliably and efficiently. And all the light emission parts 40 light (step S53 shown in FIG. 17), and it can confirm that the input test was complete
  • the state of the second joint 36 currently rotated may be displayed on the display unit 31.
  • the rotation angle range information indicating how far the second joint 36 currently being tested has been rotated with respect to a predetermined movable range is displayed in a bar. It may be displayed.
  • a case where the tested angular range is displayed as a bar in the movable range is taken as an example. Therefore, in this case, it is easy to reliably perform the test over the entire movable range.
  • the light emitting unit 40 has been described as an example of the notification by the notification unit 41, but is not limited to this case, and the state of the second joint 36 of the master arm 34, and this. What is necessary is just to be able to alert
  • a sound generation unit that emits a sound with a different volume or scale
  • the present invention is limited to this case. Instead, the number of the first joints 20 and the number of the second joints 36 may be different. In such a case, for example, the first joint 20 of the slave arm 13 associated with the second joint 36 of the master arm 34 is set in advance, and the set first joint 20 is configured to rotate. Good. In any case, even if the number of the first joints 20 and the number of the second joints 36 are different, it is only necessary to set the corresponding relationship in advance. Therefore, the present invention can be applied even in such a case.
  • the present invention it is possible to easily and intuitively grasp the mutual relationship between the second joint of the master arm and the corresponding first joint of the slave arm.
  • the operativity of a master arm and a slave arm can be improved, for example, an operator's consciousness can be concentrated on the treatment work to the affected part by a slave arm and an end effector.
  • the shape synchronization operation for synchronizing the shape of the master arm with the shape of the slave arm can be performed easily and efficiently.

Abstract

The manipulator system for medical use according to the present invention is provided with a slave arm (13) that has one or more first joints (20) and has an end effector (21) on a distal end, a master arm (34) having one or more second joints (36) that is operated by an operator, a report unit (40) provided on the second joints (36) that reports a state of the first joints (20) corresponding to the second joints (36) or a state of the second joints (36) and a control unit (4) that controls the slave arm (13) and the master arm (34) and instructs the report unit (41) so as to report a state of the first joints (20) or a state of the second joints (36) on the basis of predetermined conditions.

Description

医療用マニピュレータシステム、及びその作動方法Medical manipulator system and method for operating the same
 本発明は、医療用マニピュレータシステム、及びその作動方法に関する。 The present invention relates to a medical manipulator system and an operation method thereof.
 従来、オペレータが操作する関節構造のマスタアーム、及びマスタアームに入力された操作に基づいて作動する関節構造のスレーブアームを備える、マスタスレーブ方式の医療用マニピュレータシステムが知られている。 Conventionally, a master-slave type medical manipulator system including a master arm having a joint structure operated by an operator and a slave arm having a joint structure that operates based on an operation input to the master arm is known.
 例えば、下記特許文献1には、オペレータが操作するマスタアーム(操作入力装置)と、マスタアームによって操作され、患部に対して処置を施すスレーブアーム(術具)と、を備えた手術支援システムが開示されている。
 マスタアームとスレーブアームとは、同じ自由度を有する相似の関節構造とされている。スレーブアームは、マスタアームの各関節に対応する関節が、マスタアームの各関節に対応する方向に、対応する変位量で作動するように制御されている。
For example, Patent Literature 1 below discloses a surgery support system including a master arm (operation input device) operated by an operator and a slave arm (surgical instrument) that is operated by the master arm and performs treatment on an affected area. It is disclosed.
The master arm and the slave arm have similar joint structures having the same degree of freedom. The slave arm is controlled so that the joints corresponding to the joints of the master arm operate in the directions corresponding to the joints of the master arm with the corresponding displacement amount.
 下記特許文献2には、体内に挿入される挿入スレーブ装置と、挿入スレーブ装置と相似形の構造とされ、オペレータからの入力操作によって挿入スレーブ装置を操作する挿入マスタ部と、を備えた医療用システムが開示されている。 The following Patent Document 2 discloses a medical device including an insertion slave device to be inserted into the body, and an insertion master unit that has a similar structure to the insertion slave device and operates the insertion slave device by an input operation from an operator. A system is disclosed.
 特許文献1、2に開示されているように、マスタアームとスレーブアームとが互いに相似構造とされ、且つマスタアームとスレーブアームとが互いに相似関係を維持するように制御されるマスタスレーブ方式の医療用マニピュレータシステムによれば、オペレータが操作するマスタアームの動きに、スレーブアームを追従させることができる。
 従って、オペレータは、マスタアームの作動状況に基づいて、スレーブアームの作動状況(例えば形状等)を把握しながら、スレーブアームを遠隔操作することが可能とされている。
As disclosed in Patent Documents 1 and 2, a master-slave medical system in which a master arm and a slave arm are configured to be similar to each other, and the master arm and the slave arm are controlled to maintain a similar relationship to each other. According to the manipulator system for a slave, the slave arm can follow the movement of the master arm operated by the operator.
Therefore, the operator can remotely operate the slave arm while grasping the operation state (for example, shape) of the slave arm based on the operation state of the master arm.
特許第3583777号公報Japanese Patent No. 3583777 国際公開第2010/055745号International Publication No. 2010/055745
 ところで、マスタアームとスレーブアームとが互いに相似構造とされている場合、上述したようにスレーブアームの作動状況を把握し易いという利点があるが、マスタアーム及びスレーブアームがより多関節になって自由度が高まるほど、操作する関節が増えてしまう。 By the way, when the master arm and the slave arm are similar to each other, there is an advantage that it is easy to grasp the operation state of the slave arm as described above, but the master arm and the slave arm are free to be more articulated. The higher the degree, the more joints to operate.
 従って、例えばオペレータが作業を行っている場合には、両アームの各関節の状態に一層の注意を払う必要があり、操作性の低下を招き易い。
 そのため、例えばスレーブアームによる患部への処置作業に対してオペレータの意識を集中させ難くなってしまう。また、例えば設定作業の1つとして両アームの形状を同期させる形状同期作業を行う場合には、マスタアームの各関節をどの程度、どの方向に動かすことが最適であるのかを把握することが難しくなってしまう。
Therefore, for example, when an operator is working, it is necessary to pay more attention to the state of each joint of both arms, and the operability is likely to deteriorate.
Therefore, for example, it becomes difficult to concentrate the operator's consciousness on the treatment work on the affected part by the slave arm. In addition, for example, when performing a shape synchronization operation that synchronizes the shapes of both arms as one of the setting operations, it is difficult to grasp how much and in which direction each joint of the master arm is optimally moved. turn into.
 このように、マスタアーム及びスレーブアームがより多関節になるほど、上述のような課題が生じてしまう。そのため、オペレータの作業中、或いは設定作業において、マスタアームの各関節と、それに対応するスレーブアームの各関節との相互関係を、例えばオペレータやオペレータの周囲の介助者が直感的に把握したいといった要望がある。 As described above, as the master arm and the slave arm have more joints, the above-described problems occur. Therefore, during the operator's work or in the setting work, for example, the operator or an assistant around the operator wants to intuitively understand the mutual relationship between each joint of the master arm and the corresponding joint of the slave arm. There is.
 本発明は、このような事情に考慮してなされたもので、その目的は、マスタアームの各関節と、それに対応するスレーブアームの各関節との相互関係を、容易且つ直感的に把握することができる医療用マニピュレータシステム、及びその作動方法を提供することである。 The present invention has been made in view of such circumstances, and its purpose is to easily and intuitively grasp the mutual relationship between each joint of the master arm and each joint of the slave arm corresponding thereto. It is to provide a medical manipulator system capable of performing the above and a method for operating the same.
(1)本発明に係る医療用マニピュレータシステムは、1以上の第1関節を有すると共に、遠位端にエンドエフェクタを有するスレーブアームと、1以上の第2関節を有し、操作者によって操作されるマスタアームと、前記第2関節に設けられ、前記第2関節に対応した前記第1関節の状態、又は前記第2関節の状態を報知する報知部と、前記マスタアーム及び前記スレーブアームを制御し、且つ所定条件のもと前記第1関節の状態又は前記第2関節の状態を報知するように、前記報知部に指示する制御部と、を備える。 (1) A medical manipulator system according to the present invention has one or more first joints, a slave arm having an end effector at a distal end, and one or more second joints, and is operated by an operator. A master arm, a notification unit that is provided at the second joint and notifies the state of the first joint corresponding to the second joint or the state of the second joint, and controls the master arm and the slave arm And a control unit that instructs the notification unit to notify the state of the first joint or the state of the second joint under a predetermined condition.
(2)前記制御部は、前記マスタアームの動きに応じて、前記スレーブアームを制御する第1モードと、前記第1関節の状態に前記第2関節の状態を合わせるように制御する第2モードと、を有してもよい。 (2) The controller controls a first mode for controlling the slave arm according to the movement of the master arm and a second mode for controlling the state of the second joint to match the state of the first joint. You may have.
(3)前記第1モードにおいて、前記制御部は、前記第2関節に対応する前記第1関節の状態が該第2関節の状態に一致するように、該第1関節に対して作動指令を出力し、前記制御部は、前記作動指令が予め決められた前記第1関節の可動範囲内に収まる指令であるか否かを判断し、前記制御部は、前記判断の結果を前記第1の関節に対応する前記第2関節の前記報知部から報知するよう指示してもよい。 (3) In the first mode, the control unit issues an operation command to the first joint so that the state of the first joint corresponding to the second joint matches the state of the second joint. And the control unit determines whether or not the operation command is a command that falls within a predetermined movable range of the first joint, and the control unit determines the result of the determination as the first You may instruct | indicate to alert | report from the said alerting | reporting part of the said 2nd joint corresponding to a joint.
(4)前記第2モードにおいて、前記制御部は、前記第1関節に対応する前記第2関節の状態と前記第1関節の状態との差分を算出し、該差分を前記報知部から報知するよう指示してもよい。 (4) In the second mode, the control unit calculates a difference between the state of the second joint corresponding to the first joint and the state of the first joint, and notifies the difference from the notification unit. You may instruct.
(5)前記制御部は、前記差分が所定範囲内であるか否かを判断し、所定範囲内である場合には前記報知部から報知させてもよい。 (5) The control unit may determine whether the difference is within a predetermined range, and may notify the notification unit when the difference is within the predetermined range.
(6)前記制御部は、前記第1関節の状態に基づいて、前記第1関節の作動性の良否を判断し、不良の場合には前記報知部から報知させてもよい。 (6) The control unit may determine whether the operability of the first joint is good or not based on the state of the first joint, and may notify the notification unit if the first joint is defective.
(7)前記制御部は、前記第2関節の状態に基づいて、前記第2関節の作動性の良否を判断し、不良の場合には前記報知部から報知させてもよい。 (7) The control unit may determine whether the operability of the second joint is good or not based on the state of the second joint, and may notify the notification unit if the second joint is defective.
(8)前記報知部は、複数の色を発光可能な発光部を有してもよい。 (8) The notification unit may include a light emitting unit capable of emitting a plurality of colors.
(9)本発明に係る医療用マニピュレータシステムの作動方法は、1以上の第1関節を有し、遠位端にエンドエフェクタを有するスレーブアームと、1以上の第2関節を有し、操作者によって操作されるマスタアームと、を備える医療用マニピュレータシステムの作動方法であって、前記第1関節の状態、又は前記第2関節の状態を検知する工程と、所定条件において、前記第2関節に対応した前記第1関節の状態、又は前記第2関節の状態を報知するように、前記第2関節に設けられた報知部に指示する工程と、を備える。 (9) The operation method of the medical manipulator system according to the present invention includes one or more first joints, a slave arm having an end effector at a distal end, and one or more second joints. An operation method of a medical manipulator system comprising: a step of detecting a state of the first joint or a state of the second joint; and a predetermined condition on the second joint. And instructing a notifying unit provided in the second joint so as to notify the corresponding state of the first joint or the state of the second joint.
(10)前記マスタアームの動きに応じて、前記スレーブアームを制御する第1モードと、前記第1関節の状態に前記第2関節の状態を合わせるように制御する第2モードと、を有してもよい。 (10) It has a first mode for controlling the slave arm according to the movement of the master arm, and a second mode for controlling the state of the second joint to match the state of the first joint. May be.
(11)前記第1モードは、前記第2関節に対応する前記第1関節の状態が該第2関節の状態に一致するように、該第1関節に対して作動指令を出力する工程と、前記作動指令が予め決められた前記第1関節の可動範囲内に収まる指令であるか否かを判断する工程と、前記判断の結果を前記第1の関節に対応する前記第2関節の前記報知部から報知するよう指示する工程と、を有してもよい。 (11) The first mode is a step of outputting an operation command to the first joint so that the state of the first joint corresponding to the second joint matches the state of the second joint; Determining whether the operation command is a command within a predetermined movable range of the first joint, and notifying the result of the determination of the second joint corresponding to the first joint And a step of instructing to notify from the section.
(12)前記第2モードは、前記第1関節に対応する前記第2関節の状態と前記第1関節の状態との差分を算出する工程と、前記差分を前記報知部から報知するよう指示する工程と、を有してもよい。 (12) In the second mode, a step of calculating a difference between the state of the second joint corresponding to the first joint and the state of the first joint, and instructing to notify the difference from the notification unit. You may have a process.
 本発明によれば、マスタアームの第2関節に設けられた報知部から、第2関節に対応した第1関節の状態や第2関節の状態を周囲に報知する(知らせる)ことができる。
 従って、例えば操作者がマスタアームを介してスレーブアームを遠隔操作する場合や、スレーブアームの形状にマスタアームの形状を同期させる形状同期作業(設定作業)を行う場合に、マスタアームにおける第2関節の状態(回転角度等)や、マスタアームにおける第2関節の状態と該第2関節に対応するスレーブアームにおける第1関節の状態との相互関係等を操作者及び介助者が把握することができる。
According to the present invention, the state of the first joint corresponding to the second joint and the state of the second joint can be notified (notified) to the surroundings from the notification unit provided in the second joint of the master arm.
Therefore, for example, when the operator remotely operates the slave arm via the master arm, or when performing a shape synchronization operation (setting operation) for synchronizing the shape of the master arm with the shape of the slave arm, the second joint in the master arm. The operator and the assistant can grasp the state (rotation angle, etc.) and the mutual relationship between the state of the second joint in the master arm and the state of the first joint in the slave arm corresponding to the second joint. .
 特に、第2関節に設けられた報知部から、その第2関節の状態や、その第2関節に対応する第1関節の状態を報知するので、マスタアーム及びスレーブアームが多くの関節を具備していたとしても、操作者及び介助者は各第2関節の状態、及びそれに対応した第1関節の状態を容易且つ直感的に把握することができる。 In particular, since the notification unit provided in the second joint reports the state of the second joint and the state of the first joint corresponding to the second joint, the master arm and the slave arm have many joints. Even so, the operator and the assistant can easily and intuitively grasp the state of each second joint and the state of the first joint corresponding thereto.
 従って、マスタアーム及びスレーブアームの操作性を向上することができ、例えばスレーブアーム及びエンドエフェクタによる患部への処置作業に、操作者の意識を集中させることができる。さらには、スレーブアームの形状に対してマスタアームの形状を同期させる形状同期作業を、簡便且つ効率良く行うことができる。 Therefore, the operability of the master arm and the slave arm can be improved, and for example, the operator's consciousness can be concentrated on the treatment work on the affected area by the slave arm and the end effector. Furthermore, the shape synchronization operation for synchronizing the shape of the master arm with the shape of the slave arm can be performed easily and efficiently.
本発明に係る医療用マニピュレータシステムの第1実施形態を示す全体構成図である。1 is an overall configuration diagram showing a first embodiment of a medical manipulator system according to the present invention. 図1に示すオーバーチューブの先端周辺の斜視図であって、オーバーチューブ、内視鏡及びスレーブアームの関係を示す図である。FIG. 2 is a perspective view around the distal end of the overtube shown in FIG. 1, showing the relationship between the overtube, the endoscope, and a slave arm. マスタアーム及びスレーブアームの模式図である。It is a schematic diagram of a master arm and a slave arm. 図1に示す医療用マニピュレータシステムの制御系の構成を示すブロック図である。It is a block diagram which shows the structure of the control system of the medical manipulator system shown in FIG. 図1に示す医療用マニピュレータシステムにおける第2モードの動作を示すフローチャートである。It is a flowchart which shows operation | movement of the 2nd mode in the medical manipulator system shown in FIG. マスタアーム及びスレーブアームの模式図であって、スレーブアームの形状に対してマスタアームの形状が一致していない状態を示す図である。It is a schematic diagram of a master arm and a slave arm, Comprising: It is a figure which shows the state from which the shape of a master arm does not correspond with the shape of a slave arm. 図6に示す状態から、マスタアームを操作して、スレーブアームの形状に対してマスタアームの形状を一致させた状態を示す図である。It is a figure which shows the state which operated the master arm from the state shown in FIG. 6, and made the shape of a master arm correspond with the shape of a slave arm. 図1に示す医療用マニピュレータシステムにおける第1モードの動作を示すフローチャートである。It is a flowchart which shows operation | movement of the 1st mode in the medical manipulator system shown in FIG. マスタアーム及びスレーブアームの模式図であって、スレーブアームの第1関節の可動範囲を超えるような操作をマスタアームに行っている状態を示す図である。It is a schematic diagram of a master arm and a slave arm, Comprising: It is a figure which shows the state which is performing operation which exceeds the movable range of the 1st joint of a slave arm to a master arm. 本発明に係る医療用マニピュレータシステムの第2実施形態を示す図であって、第2モードの動作を示すフローチャートである。It is a figure which shows 2nd Embodiment of the medical manipulator system which concerns on this invention, Comprising: It is a flowchart which shows operation | movement of a 2nd mode. マスタアーム及びスレーブアームの模式図であって、スレーブアームの形状に対してマスタアームの形状が一致していない状態を示す図である。It is a schematic diagram of a master arm and a slave arm, Comprising: It is a figure which shows the state from which the shape of a master arm does not correspond with the shape of a slave arm. 本発明に係る医療用マニピュレータシステムの第3実施形態を示す図であって、第1モードの動作を示すフローチャートである。It is a figure which shows 3rd Embodiment of the medical manipulator system which concerns on this invention, Comprising: It is a flowchart which shows operation | movement of a 1st mode. マスタアーム及びスレーブアームの模式図であって、記憶させたスレーブアームの形状と、現在のスレーブアームの形状との関係を示す図である。It is a schematic diagram of a master arm and a slave arm, and is a diagram showing the relationship between the stored shape of the slave arm and the current shape of the slave arm. 図13に示す状態から、マスタアームを操作して、現在のスレーブアームにおける3つの第2関節の回転角度を、記憶させたスレーブアームの第2関節の回転角度に一致させた状態を示す図である。The figure which shows the state which operated the master arm from the state shown in FIG. 13, and made the rotation angle of three 2nd joints in the present slave arm correspond with the stored rotation angle of the 2nd joint of the slave arm. is there. 本発明に係る医療用マニピュレータシステムの第4実施形態を示す図であって、関節の不具合が発生しているか否かを判断する場合の動作を示すフローチャートである。It is a figure which shows 4th Embodiment of the medical manipulator system which concerns on this invention, Comprising: It is a flowchart which shows operation | movement in the case of determining whether the malfunction of a joint has generate | occur | produced. マスタアーム及びスレーブアームの模式図であって、1つの関節に不具合が発生している状態を示す図である。It is a mimetic diagram of a master arm and a slave arm, and is a figure showing the state where trouble has occurred in one joint. 本発明に係る医療用マニピュレータシステムの第5実施形態を示す図であって、マスタアームの入力テストを行う場合の動作を示すフローチャートである。It is a figure which shows 5th Embodiment of the medical manipulator system which concerns on this invention, Comprising: It is a flowchart which shows operation | movement in the case of performing the input test of a master arm. マスタアーム及びスレーブアームの模式図であって、1つの第1関節について入力テストが終了していない状態を示す図である。It is a schematic diagram of a master arm and a slave arm, and is a diagram showing a state where an input test is not completed for one first joint. 入力テストを行っている第1関節について、テストが終了した回転角度範囲を、表示部に表示させた例を示す図である。It is a figure which shows the example which displayed the rotation angle range which the test was complete | finished about the 1st joint which is performing the input test on the display part.
(第1実施形態)
 以下、本発明に係る医療用マニピュレータシステム、及びその作動方法の第1実施形態について図面を参照して説明する。
(First embodiment)
Hereinafter, a first embodiment of a medical manipulator system and an operation method thereof according to the present invention will be described with reference to the drawings.
 図1に示すように、本実施形態の医療用マニピュレータシステム1は、手術台上に横たわっている患者に対して処置を施すスレーブマニピュレータ2と、オペレータ(操作者)が操作を行うマスタマニピュレータ3と、これらスレーブマニピュレータ2及びマスタマニピュレータ3を総合的に制御する制御ユニット(制御部)4と、を備えている。 As shown in FIG. 1, a medical manipulator system 1 according to this embodiment includes a slave manipulator 2 that performs a treatment on a patient lying on an operating table, and a master manipulator 3 that is operated by an operator (operator). A control unit (control unit) 4 that comprehensively controls the slave manipulator 2 and the master manipulator 3 is provided.
(スレーブマニピュレータ)
 スレーブマニピュレータ2は、図1及び図2に示すように、手術台の近傍に設置された多関節のロボットアーム10と、ロボットアーム10の先端に設けられた装着部11に取り付けられ、患者の体内に挿入される医療用のオーバーチューブ12と、オーバーチューブ12内に挿通されるスレーブアーム13と、装着部11に取り付けられたモータユニット14と、を備えている。
(Slave manipulator)
As shown in FIGS. 1 and 2, the slave manipulator 2 is attached to an articulated robot arm 10 installed in the vicinity of the operating table and a mounting portion 11 provided at the tip of the robot arm 10, The medical overtube 12 inserted into the overtube 12, the slave arm 13 inserted into the overtube 12, and the motor unit 14 attached to the mounting portion 11.
 オーバーチューブ12は、長尺な可撓性を有するチューブであって、基端(近位端)側が装着部11に取り付けられている。
 なお、本実施形態では、オーバーチューブ12は経口により患者の体内に挿入されている場合を例に挙げて説明するが、この場合に限定されるものではなく、経肛門により患者の体内に挿入されてもよい。
The overtube 12 is a long and flexible tube, and the base end (proximal end) side is attached to the mounting portion 11.
In the present embodiment, the case where the overtube 12 is orally inserted into the patient's body will be described as an example. However, the present invention is not limited to this case, and the overtube 12 is inserted into the patient's body through the anus. May be.
 図2に示すように、オーバーチューブ12には、基端から先端(遠位端)に亘って、2つのスレーブアーム13をそれぞれ挿通させるための第1ルーメン15と、内視鏡5を挿通させるための第2ルーメン16が形成されている。
 なお、オーバーチューブ12の構成は、この場合に限定されるものではない。例えば、オーバーチューブ12の先端に、該オーバーチューブ12の先端よりもさらに突出するようにスレーブアーム13及び内視鏡5を取り付けても構わない。この場合には、第1ルーメン15及び第2ルーメン16をオーバーチューブ12に形成する必要はない。また、体外からの操作に応じて湾曲可能なオーバーチューブ12としてもよい。
As shown in FIG. 2, a first lumen 15 for inserting two slave arms 13 and an endoscope 5 are inserted through the overtube 12 from the proximal end to the distal end (distal end). A second lumen 16 is formed.
Note that the configuration of the overtube 12 is not limited to this case. For example, the slave arm 13 and the endoscope 5 may be attached to the tip of the overtube 12 so as to protrude further than the tip of the overtube 12. In this case, it is not necessary to form the first lumen 15 and the second lumen 16 in the overtube 12. Moreover, it is good also as the overtube 12 which can be bent according to operation from the outside of the body.
 2つのスレーブアーム13は、第1ルーメン15を通して取り付けられ、その先端(遠位端)側がオーバーチューブ12の先端よりも突出している。
 なお、本実施形態では、2つのスレーブアーム13を有する双腕型のスレーブマニピュレータ2を例に挙げて説明するが、スレーブアーム13の数は1つ、或いは3つ以上であってもよい。
The two slave arms 13 are attached through the first lumen 15, and the tip (distal end) side protrudes from the tip of the overtube 12.
In the present embodiment, the dual-arm type slave manipulator 2 having two slave arms 13 will be described as an example, but the number of slave arms 13 may be one or three or more.
 スレーブアーム13は、図2及び図3に示すように、少なくとも1つ以上の第1関節20を有する関節構造とされた処置具であり、その先端にはエンドエフェクタ21が設けられている。 2 and 3, the slave arm 13 is a treatment tool having a joint structure having at least one or more first joints 20, and an end effector 21 is provided at the tip thereof.
 エンドエフェクタ21は、体内の処置対象部位である患部に対して処置を施す処置部とされ、例えば患部の状態や、手術内容等に応じて適宜選択される。
 具体的には、エンドエフェクタ21は、把持鉗子、切開ナイフ(高周波電流の通電によって切開を行うものも含む)、電極等、患部に対して外科的処置を施す処置部や、患部を観察するための光学的或いは超音波的な観察を行う処置部等が挙げられる。
The end effector 21 is a treatment unit that performs treatment on an affected part that is a treatment target site in the body, and is appropriately selected according to, for example, the state of the affected part, the content of surgery, and the like.
Specifically, the end effector 21 is for observing a treatment part for performing a surgical treatment on the affected part, such as a grasping forceps, an incision knife (including an incision by energization of a high-frequency current), an electrode, or the like. And a treatment section that performs optical or ultrasonic observation.
 図示の例では、エンドエフェクタ21は、駆動ワイヤ22による操作によって開閉自在な把持鉗子として構成されている。なお、駆動ワイヤ22は、スレーブアーム13の内側を通して、モータユニット14まで延びている。 In the illustrated example, the end effector 21 is configured as a grasping forceps that can be opened and closed by an operation with the drive wire 22. The drive wire 22 extends to the motor unit 14 through the inside of the slave arm 13.
 スレーブアーム13は、図3に示すように、複数の第1関節20と、各第1関節20同士を連結する連結部23と、を備え、各第1関節20が回転することによって、3次元的に湾曲することが可能とされている。
 なお、図3では、スレーブアーム13の構成を模式的に示していると共に、4つの第1関節20を備えている場合を例に挙げて説明している。但し、第1関節20の数は、4つに限定されるものではなく、2つ、3つ、又は5つ以上でも構わない。
As shown in FIG. 3, the slave arm 13 includes a plurality of first joints 20 and a connecting portion 23 that connects the first joints 20 to each other. It is possible to be curved.
In FIG. 3, the configuration of the slave arm 13 is schematically shown, and a case where the four first joints 20 are provided is described as an example. However, the number of the first joints 20 is not limited to four, and may be two, three, or five or more.
 第1関節20としては、例えばスレーブアーム13の中心軸線Oに沿ったロール軸回りに回転するロール関節や、スレーブアーム13の中心軸線Oに直交するヨー軸(又はピッチ軸)回りに回転するヨー関節(又はピッチ関節)とされている。
 そして、これらロール関節及びヨー関節(又はピッチ関節)が、任意の配置(例えば交互に配置)で並ぶように連結されている。これにより、スレーブアーム13は、3次元的に湾曲自在とされている。
 なお、各第1関節20は、アングルワイヤ24による操作によってそれぞれ回転可能とされている。アングルワイヤ24は、スレーブアーム13の内側を通してモータユニット14まで延びている。
As the first joint 20, for example, a roll joint that rotates about the roll axis along the central axis O of the slave arm 13, or a yaw that rotates about the yaw axis (or pitch axis) orthogonal to the central axis O of the slave arm 13. It is a joint (or pitch joint).
These roll joints and yaw joints (or pitch joints) are connected so as to be arranged in an arbitrary arrangement (for example, alternately arranged). Thereby, the slave arm 13 can be bent three-dimensionally.
Each of the first joints 20 can be rotated by an operation using the angle wire 24. The angle wire 24 extends to the motor unit 14 through the inside of the slave arm 13.
 モータユニット14は、図1に示すようにロボットアーム10の装着部11に対して例えば離脱自在に装着されている。
 このモータユニット14は、図4に示すように、駆動ワイヤ22を介してエンドエフェクタ21に動力に伝えることでエンドエフェクタ21を作動させるエフェクタアクチュエータ25と、アングルワイヤ24を介して各第1関節20に動力を伝えることで、各第1関節20を回転させる関節アクチュエータ26と、を備えている。
 なお、エフェクタアクチュエータ25及び関節アクチュエータ26は、後述するスレーブ制御部51からの指示に基づいて作動する。
As shown in FIG. 1, the motor unit 14 is detachably mounted on the mounting portion 11 of the robot arm 10, for example.
As shown in FIG. 4, the motor unit 14 includes an effector actuator 25 that operates the end effector 21 by transmitting power to the end effector 21 via the drive wire 22, and each first joint 20 via the angle wire 24. And a joint actuator 26 that rotates each first joint 20 by transmitting power to each other.
The effector actuator 25 and the joint actuator 26 operate based on instructions from a slave control unit 51 described later.
 さらに、モータユニット14は、各第1関節20の状態を示す指標の1つである回転角度をそれぞれ検知する第1エンコーダ27を備えている。第1エンコーダ27は、検知結果(第1関節20の回転角度)をスレーブ制御部51に出力する。
 なお、第1エンコーダ27は、各第1関節20にそれぞれ設けられていてもよい。
Furthermore, the motor unit 14 includes a first encoder 27 that detects a rotation angle, which is one of indices indicating the state of each first joint 20. The first encoder 27 outputs the detection result (the rotation angle of the first joint 20) to the slave control unit 51.
The first encoder 27 may be provided in each first joint 20.
(マスタマニピュレータ)
 図1に示すように、マスタマニピュレータ3は、オペレータによって操作される操作入力装置30と、表示部31と、を備えている。
(Master manipulator)
As shown in FIG. 1, the master manipulator 3 includes an operation input device 30 operated by an operator and a display unit 31.
 操作入力装置30は、例えば床面に設置された操作台32に対して、高さ調整可能に取り付けられた操作テーブル33に取り付けられている。図示の例では、操作テーブル33はオペレータが立った状態で肘や腕を乗せることができる高さに調整されている。 The operation input device 30 is attached, for example, to an operation table 33 attached to an operation table 32 installed on the floor so that the height can be adjusted. In the example shown in the figure, the operation table 33 is adjusted to a height at which the operator can place an elbow or arm while standing.
 操作入力装置30は、スレーブアーム13に対応して2つ設けられ、オペレータが両手で操作することができるように、オペレータの肩幅方向に間隔をあけて操作テーブル33上に取り付けられている。
 この操作入力装置30は、図3に示すように、基端(近位端)側が操作テーブル33上に取り付けられたマスタアーム34と、マスタアーム34の先端に取り付けられたグリップ部35と、を備えている。
Two operation input devices 30 are provided corresponding to the slave arm 13 and are mounted on the operation table 33 at intervals in the shoulder width direction of the operator so that the operator can operate with both hands.
As shown in FIG. 3, the operation input device 30 includes a master arm 34 whose base end (proximal end) side is attached on the operation table 33, and a grip portion 35 attached to the tip of the master arm 34. I have.
 マスタアーム34は、少なくとも1つ以上の第2関節36を有し、オペレータによって操作される関節構造の操作具である。
 マスタアーム34は、図3に示すように、複数の第2関節36と、各第2関節36同士を連結する連結部37と、を備え、各第2関節36が回転することによって、3次元的に湾曲することが可能とされている。
The master arm 34 has at least one or more second joints 36 and is a joint structure operating tool operated by an operator.
As shown in FIG. 3, the master arm 34 includes a plurality of second joints 36 and a connecting portion 37 that connects the second joints 36 to each other. It is possible to be curved.
 なお、図3では、マスタアーム34の構成を模式的に示している。本実施形態のマスタアーム34は、スレーブアーム13の関節構造と相似の関節構造となるように構成されている。つまり、マスタアーム34の第2関節36は、スレーブアーム13の第1関節20と同様に4つ設けられ、その構造は第1関節20と相似の構造とされている。なお、第2関節36は、第1関節20と同一又はそれ以上の自由度を有している。 In addition, in FIG. 3, the structure of the master arm 34 is shown typically. The master arm 34 of the present embodiment is configured to have a joint structure similar to the joint structure of the slave arm 13. That is, four second joints 36 of the master arm 34 are provided similarly to the first joint 20 of the slave arm 13, and the structure thereof is similar to the first joint 20. The second joint 36 has the same degree of freedom as or more than that of the first joint 20.
 このようにマスタアーム34とスレーブアーム13とは、相似の構造とされているので、マスタアーム34の各第2関節36と、スレーブアーム13の各第1関節20とは互いに対応した関係となっている。 Thus, since the master arm 34 and the slave arm 13 have similar structures, the second joints 36 of the master arm 34 and the first joints 20 of the slave arm 13 have a corresponding relationship. ing.
 グリップ部35は、例えばオペレータの指先で直接把持されながら操作される。このグリップ部35には、エンドエフェクタ21を操作するための操作部(例えば操作ボタン等)38が設けられ、この操作部38を操作することでエフェクタアクチュエータ25を介してエンドエフェクタ21を作動させることが可能とされている。
 なお、操作部38は、入力された操作に基づいた信号を後述するマスタ制御部50に出力する。
The grip part 35 is operated while being directly gripped by, for example, an operator's fingertip. The grip portion 35 is provided with an operation portion (for example, an operation button) 38 for operating the end effector 21, and the end effector 21 is operated via the effector actuator 25 by operating the operation portion 38. Is possible.
The operation unit 38 outputs a signal based on the input operation to the master control unit 50 described later.
 マスタアーム34の各第2関節36には、第2関節36の回転角度を検知する第2エンコーダ39が設けられている。第2エンコーダ39は、検知結果(第2関節36の回転角度)をマスタ制御部50に出力する。 Each second joint 36 of the master arm 34 is provided with a second encoder 39 that detects the rotation angle of the second joint 36. The second encoder 39 outputs the detection result (the rotation angle of the second joint 36) to the master control unit 50.
 さらに、マスタアーム34の各第2関節36には、所定条件のもと第1関節20の状態又は第2関節36の状態を周囲に報知する報知部41が設けられている。報知部41は、発光部40、発光部40を第2関節36に取り付けるための図示しない固定部材や発光部40の図示しない回路基板等を備えている。
 発光部40は、可視光を発光することで、自身が取り付けられている第2関節36の状態、及び該第2関節36に対応したスレーブアーム13の第1関節20の状態を周囲に報知する。
Further, each second joint 36 of the master arm 34 is provided with a notification unit 41 that notifies the surroundings of the state of the first joint 20 or the state of the second joint 36 under a predetermined condition. The notification unit 41 includes a light emitting unit 40, a fixing member (not shown) for attaching the light emitting unit 40 to the second joint 36, a circuit board (not shown) of the light emitting unit 40, and the like.
The light emitting unit 40 emits visible light to notify the surroundings of the state of the second joint 36 to which the light emitting unit 40 is attached and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36. .
 なお、関節の状態とは、関節の回転角度、回転方向等を含み、関節がどのような形状、姿勢になっているかを示すものである。これにより、オペレータ及び介助者は、発光部40による発光に基づいて、例えば、マスタアーム34における第2関節36の現在の状態、スレーブアーム13における第1関節20の現在の状態、マスタアーム34の第2関節36とそれに対応するスレーブアーム13の第1関節20との相互関係等、関節の状態に関連する各種の情報を把握することが可能とされている。これについては、後に詳細に説明する。 The joint state includes the rotation angle, rotation direction, and the like of the joint, and indicates what shape and posture the joint is in. Thereby, based on the light emission by the light emitting unit 40, the operator and the assistant, for example, the current state of the second joint 36 in the master arm 34, the current state of the first joint 20 in the slave arm 13, Various information related to the state of the joint, such as the mutual relationship between the second joint 36 and the first joint 20 of the slave arm 13 corresponding thereto, can be grasped. This will be described in detail later.
 発光部40は、例えばLED等の発光ダイオードを1つ又は複数有し、単一色或いは複数の色の光を、点灯或いは点滅等の各種の発光方式で発光することが可能とされている。なお、発光部40は、後述する報知制御部53によって制御される。 The light emitting unit 40 has one or a plurality of light emitting diodes such as LEDs, and can emit light of a single color or a plurality of colors by various light emitting methods such as lighting or blinking. In addition, the light emission part 40 is controlled by the alerting | reporting control part 53 mentioned later.
 図1に示すように、表示部31は、操作台32の上部に取り付けられており、操作テーブル33よりも上方に配置されている。これにより、オペレータは表示部31の画面を確認しながら、操作入力装置30を操作することができる。
 表示部31には、制御ユニット4を経由して出力されたビデオ信号に基づいて、例えば内視鏡5によって撮像された画像や、医療用マニピュレータシステム1の操作に必要な各種の情報等が表示される。
As shown in FIG. 1, the display unit 31 is attached to the upper part of the operation table 32 and is disposed above the operation table 33. As a result, the operator can operate the operation input device 30 while confirming the screen of the display unit 31.
Based on the video signal output via the control unit 4, for example, an image captured by the endoscope 5, various information necessary for operating the medical manipulator system 1, and the like are displayed on the display unit 31. Is done.
(制御ユニット)
 図4に示すように、制御ユニット4は、マスタ制御部50と、スレーブ制御部51と、モード制御部52と、報知制御部53と、表示制御部54と、記憶部55とを備えている。
(Controller unit)
As shown in FIG. 4, the control unit 4 includes a master control unit 50, a slave control unit 51, a mode control unit 52, a notification control unit 53, a display control unit 54, and a storage unit 55. .
 マスタ制御部50は、操作入力装置30に対して入力された操作に基づいて、スレーブアーム13及びエンドエフェクタ21が作動するように、スレーブ制御部51に所定の作動指令(作動信号)を出力する。つまり、マスタ制御部50は、操作部38からの信号、及び第2エンコーダ39からの検知結果(検知信号)に基づいて所定の作動指令を生成して、スレーブ制御部51に出力する。 Based on the operation input to the operation input device 30, the master control unit 50 outputs a predetermined operation command (operation signal) to the slave control unit 51 so that the slave arm 13 and the end effector 21 operate. . That is, the master control unit 50 generates a predetermined operation command based on the signal from the operation unit 38 and the detection result (detection signal) from the second encoder 39, and outputs it to the slave control unit 51.
 スレーブ制御部51は、マスタ制御部50からの作動指令に基づいて、関節アクチュエータ26及びエフェクタアクチュエータ25を制御し、スレーブアーム13及びエンドエフェクタ21を制御する。 The slave controller 51 controls the joint actuator 26 and the effector actuator 25 based on the operation command from the master controller 50, and controls the slave arm 13 and the end effector 21.
 モード制御部52は、マスタアーム34の動きに応じてスレーブアーム13を制御する第1モードと、スレーブアーム13の第1関節20の状態にマスタアーム34の第2関節36の状態を合わせるように制御する第2モードと、の間でモード切換を行う。
 但し、モード制御部52は、第1モード及び第2モードを備えるだけではなく、その他のモードをさらに備え、複数のモード間の切り換えを行ってもよい。
The mode control unit 52 adjusts the state of the second joint 36 of the master arm 34 to the first mode for controlling the slave arm 13 according to the movement of the master arm 34 and the state of the first joint 20 of the slave arm 13. The mode is switched between the second mode to be controlled.
However, the mode control unit 52 may not only include the first mode and the second mode, but may further include other modes and switch between a plurality of modes.
 第1モードは、主にオペレータがマスタアーム34によってスレーブアーム13を遠隔操作し、このスレーブアーム13を利用して患者の体内の患部に処置を施す場合に用いられるモードである。具体的には、第1モードは、マスタアーム34に対してスレーブアーム13が相似形となるように、スレーブアーム13を制御するモードである。
 第2モードは、スレーブアーム13の姿勢を保持して、マスタアーム34の入力操作に従わないようにスレーブアーム13の制御を停止するモードであって、主に設定作業の一つである形状同期作業を行う場合に用いられるモードである。つまり、第2モードは、スレーブアーム13の形状に対してマスタアーム34の形状を同期させるためのモードである。
The first mode is a mode used mainly when the operator remotely operates the slave arm 13 by the master arm 34 and performs treatment on the affected part in the patient's body using the slave arm 13. Specifically, the first mode is a mode in which the slave arm 13 is controlled so that the slave arm 13 is similar to the master arm 34.
The second mode is a mode in which the posture of the slave arm 13 is maintained and the control of the slave arm 13 is stopped so as not to follow the input operation of the master arm 34, and shape synchronization is mainly one of setting operations. This mode is used when working. That is, the second mode is a mode for synchronizing the shape of the master arm 34 with the shape of the slave arm 13.
 報知制御部53は、予め設定された所定条件のもと、第1関節20の状態又は第2関節36の状態を、発光によって周囲に報知するように発光部に指示する。これにより、第2関節36に対応した第1関節20の状態、又は第2関節36の状態を周囲に報知することが可能となる。
 報知制御部53には、マスタ制御部50を介して第2エンコーダ39の検知結果(検知信号)が入力されると共に、スレーブ制御部51を介して第1エンコーダ27の検知結果(検知信号)が入力される。これにより、報知制御部53は、マスタアーム34の第2関節36の状態、及び該第2関節36に対応するスレーブアーム13の第1関節20の状態を正確且つリアルタイムに把握している。
The notification control unit 53 instructs the light emitting unit to notify the surroundings by light emission of the state of the first joint 20 or the state of the second joint 36 under a predetermined condition set in advance. As a result, the state of the first joint 20 corresponding to the second joint 36 or the state of the second joint 36 can be notified to the surroundings.
The notification control unit 53 receives the detection result (detection signal) of the second encoder 39 via the master control unit 50 and the detection result (detection signal) of the first encoder 27 via the slave control unit 51. Entered. Accordingly, the notification control unit 53 accurately grasps the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36 in real time.
 そして、報知制御部53は、例えばマスタアーム34及びスレーブアーム13の作動状況に応じて、第2関節36の状態、及び第2関節36に対応する第1関節20の状態を、発光という形で周囲に知らせるように発光部40を制御する。
 なお、報知制御部53による発光部40の制御については、後にさらに詳細に説明する。
And the alerting | reporting control part 53 shows the state of the 1st joint 20 corresponding to the state of the 2nd joint 36 and the 2nd joint 36 in the form of light emission, for example according to the operation condition of the master arm 34 and the slave arm 13. The light emitting unit 40 is controlled to notify the surroundings.
The control of the light emitting unit 40 by the notification control unit 53 will be described in detail later.
 さらに、報知制御部53は、スレーブアーム13の各第1関節20に予め定められた可動範囲に関する情報を有している。また、報知制御部53は、マスタアーム34の第2関節36の状態、及び該第2関節36に対応するスレーブアーム13の第1関節20の状態を含む関節の情報を表示制御部54にも出力する。 Furthermore, the notification control unit 53 has information regarding a movable range predetermined for each first joint 20 of the slave arm 13. The notification control unit 53 also displays information on joints including the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36 in the display control unit 54. Output.
 表示制御部54は、報知制御部53から送られてきた情報を表示部31に表示させる。その他、表示制御部54は、内視鏡5によって撮像された画像や、医療用マニピュレータシステム1の操作に必要な各種の情報等、オペレータ及び介助者が必要とされる情報を表示部31に表示させる。
 これにより、オペレータ及び介助者は、表示部31を視認することで所望する情報や画像を把握することができる。
The display control unit 54 causes the display unit 31 to display information transmitted from the notification control unit 53. In addition, the display control unit 54 displays information required by the operator and the assistant on the display unit 31 such as an image captured by the endoscope 5 and various types of information necessary for operating the medical manipulator system 1. Let
Thereby, the operator and the assistant can grasp desired information and images by visually recognizing the display unit 31.
 記憶部55は、オペレータ及び介助者の指示に基づいて、第1エンコーダ27の検知結果を記憶する。これにより、スレーブアーム13における第1関節20の状態を、任意のタイミングで記憶することが可能とされる。つまり、スレーブアーム13の形状を任意のタイミングで記憶することが可能とされている。
 なお、記憶部55に記憶する回数は1回に限定されるものではなく、複数回、記憶させてもよい。
The storage unit 55 stores the detection result of the first encoder 27 based on instructions from the operator and the assistant. Thereby, the state of the first joint 20 in the slave arm 13 can be stored at an arbitrary timing. That is, the shape of the slave arm 13 can be stored at an arbitrary timing.
Note that the number of times to be stored in the storage unit 55 is not limited to one, but may be stored a plurality of times.
(医療用マニピュレータシステムの作用)
 次に、上述のように構成された医療用マニピュレータシステム1を使用する場合について説明する。
(Operation of medical manipulator system)
Next, the case where the medical manipulator system 1 configured as described above is used will be described.
 はじめに、医療用マニピュレータを使用する際の概要を簡単に説明する。
 患者の体内の患部への処置を施す場合には、図1に示すように、オペレータは内視鏡5によって撮像された画像を表示部31で確認しながら、例えばロボットアーム10を操作してオーバーチューブ12の先端を患部の近傍まで移動させた後、その位置に配置させる。
 続いて、オペレータは、内視鏡5による画像を表示部31で確認しながら、操作入力装置30を操作することでスレーブアーム13及びエンドエフェクタ21を遠隔操作し、患部に対して適切な処置を施す。
First, an outline of using a medical manipulator will be briefly described.
When performing a treatment on an affected part in a patient's body, as shown in FIG. 1, the operator operates the robot arm 10 while checking the image captured by the endoscope 5 on the display unit 31, for example. After the distal end of the tube 12 is moved to the vicinity of the affected area, the tube 12 is disposed at that position.
Subsequently, the operator remotely operates the slave arm 13 and the end effector 21 by operating the operation input device 30 while confirming the image by the endoscope 5 on the display unit 31, and performs appropriate treatment on the affected part. Apply.
 このような処置を施す場合、オペレータはモード制御部52によって、医療用マニピュレータシステム1の制御モードを第1モードで作動させる。
 これにより、マスタアーム34に対してスレーブアーム13が相似形となるようにスレーブアーム13を制御できる。つまり、マスタアーム34の動きに応じてスレーブアーム13を制御することができるので、マスタスレーブ操作を行うことができる。
 そのため、オペレータはマスタアーム34を操作することで、スレーブアーム13を介して患部に対する適切な処置を施すことができる。
When performing such treatment, the operator causes the mode control unit 52 to operate the control mode of the medical manipulator system 1 in the first mode.
As a result, the slave arm 13 can be controlled so that the slave arm 13 is similar to the master arm 34. That is, since the slave arm 13 can be controlled according to the movement of the master arm 34, a master-slave operation can be performed.
Therefore, the operator can perform an appropriate treatment for the affected part via the slave arm 13 by operating the master arm 34.
 ところで、上述したように、マスタアーム34に対してスレーブアーム13が相似形となるように制御するためには、マスタアーム34の形状とスレーブアーム13の形状とが同期していることが必要である。 By the way, as described above, in order to control the slave arm 13 to be similar to the master arm 34, it is necessary that the shape of the master arm 34 and the shape of the slave arm 13 are synchronized. is there.
 ところが、マスタアーム34は、関節アクチュエータ26によって第1関節20が作動するスレーブアーム13とは異なり、一般的に第2関節36を作動させるようなアクチュエータを有さない。そのため、例えば、患部に対する処置を一時中断して操作入力装置30からオペレータが手を離した場合や、システムの起動段階等では、マスタアーム34の形状が自重の影響等によって変化し、スレーブアーム13の形状とは異なってしまう場合がある。 However, unlike the slave arm 13 in which the first joint 20 is operated by the joint actuator 26, the master arm 34 generally does not have an actuator that operates the second joint 36. Therefore, for example, when the treatment on the affected part is temporarily interrupted and the operator removes the hand from the operation input device 30, or at the start-up stage of the system, the shape of the master arm 34 changes due to the influence of its own weight, and the slave arm 13 The shape may be different.
 このような場合には、オペレータはモード制御部52によって、医療用マニピュレータシステム1の制御モードを、第1モードから、第1関節20の状態に第2関節36の状態を合わせるように制御する第2モードに切り換えて、スレーブアーム13の形状に対してマスタアーム34の形状を同期させる形状同期作業を行う。 In such a case, the operator uses the mode control unit 52 to control the control mode of the medical manipulator system 1 from the first mode so that the state of the second joint 36 matches the state of the first joint 20. The mode is switched to the second mode, and the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 is performed.
 以下、スレーブアーム13の形状に対してマスタアーム34の形状を同期させる形状同期作業について、図5に示すフローチャートを参照しながら詳細に説明する。 Hereinafter, the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 will be described in detail with reference to the flowchart shown in FIG.
 この場合には、オペレータがモード制御部52を介して、医療用マニピュレータシステム1の制御モードを第2モードに切り換える(図5に示すステップS1)。これにより、例えば、モード制御部52がスレーブ制御部51に対するマスタ制御部50からの作動指令を無効化することで、マスタアーム34の入力操作に従わないようにスレーブアーム13の制御を停止させることができる。つまり、マスタスレーブ操作を終了することができる。 In this case, the operator switches the control mode of the medical manipulator system 1 to the second mode via the mode control unit 52 (step S1 shown in FIG. 5). Thereby, for example, the mode control unit 52 invalidates the operation command from the master control unit 50 to the slave control unit 51, thereby stopping the control of the slave arm 13 so as not to follow the input operation of the master arm 34. Can do. That is, the master / slave operation can be terminated.
 第2モードへの切り換えを行った後、オペレータは、スレーブアーム13の形状を直接視認しながら、或いは表示部31に表示された内視鏡5からの画像によってスレーブアーム13の形状を確認しながら、マスタアーム34を操作して、マスタアーム34の形状をスレーブアーム13の形状に近づける(図5に示すステップS2)。 After switching to the second mode, the operator visually recognizes the shape of the slave arm 13 or confirms the shape of the slave arm 13 based on the image from the endoscope 5 displayed on the display unit 31. Then, the master arm 34 is operated to bring the shape of the master arm 34 closer to the shape of the slave arm 13 (step S2 shown in FIG. 5).
 この際、報知制御部53は、マスタ制御部50を介して第2エンコーダ39で検知されたマスタアーム34の各第2関節36の回転角度(すなわち第2関節36の状態)と、スレーブ制御部51を介して第1エンコーダ27で検知されたスレーブアーム13の各第1関節20の回転角度(すなわち第1関節20の状態)とを把握している。
 そして、報知制御部53は、検知されたスレーブアーム13の第1関節20の回転角度と、検知されたマスタアーム34の第2関節36の回転角度とを比較することで、第1関節20の回転角度と、これに対応する第2関節36の回転角度との角度差(差分)を算出する(図5に示すステップS3)。
At this time, the notification control unit 53 detects the rotation angle of each second joint 36 of the master arm 34 (that is, the state of the second joint 36) detected by the second encoder 39 via the master control unit 50, and the slave control unit. The rotation angle of each first joint 20 of the slave arm 13 (that is, the state of the first joint 20) detected by the first encoder 27 via 51 is grasped.
Then, the notification control unit 53 compares the detected rotation angle of the first joint 20 of the slave arm 13 with the detected rotation angle of the second joint 36 of the master arm 34 to thereby detect the first joint 20. An angle difference (difference) between the rotation angle and the corresponding rotation angle of the second joint 36 is calculated (step S3 shown in FIG. 5).
 そして、報知制御部53は、この角度差(差分)が予め決められた角度範囲内(所定範囲内)であるか否かを判断する(図5に示すステップS4)。
 その結果、報知制御部53は、上記角度差が予め決められた角度範囲内である場合には、第2関節36に設けられた発光部40を発光させることで、その旨を周囲に報知させる(図5に示すステップS5)。
Then, the notification control unit 53 determines whether or not this angle difference (difference) is within a predetermined angle range (within a predetermined range) (step S4 shown in FIG. 5).
As a result, when the angle difference is within a predetermined angle range, the notification control unit 53 causes the light emitting unit 40 provided in the second joint 36 to emit light, thereby notifying the surroundings. (Step S5 shown in FIG. 5).
 具体的には、報知制御部53は、発光部40が青色に点灯するように制御する。これにより、オペレータ及び介助者は、マスタアーム34の第2関節36の回転角度が、対応するスレーブアーム13の第1関節20の回転角度に対して一致していることを把握することができる。
 特に、マスタアーム34の各第2関節36にそれぞれ発光部40が設けられているので、発光部40が青色に点灯することで、オペレータ及び介助者は、点灯した発光部40が設けられている第2関節36の回転角度が対応するスレーブアーム13の第1関節20の回転角度に一致したことを、容易且つ直感的に把握することができる。
Specifically, the notification control unit 53 controls the light emitting unit 40 to light up in blue. Thereby, the operator and the assistant can grasp that the rotation angle of the second joint 36 of the master arm 34 matches the rotation angle of the first joint 20 of the corresponding slave arm 13.
In particular, since each light emitting unit 40 is provided at each second joint 36 of the master arm 34, the light emitting unit 40 is lit in blue, so that the operator and the assistant are provided with the light emitting unit 40 that is lit. It can be easily and intuitively understood that the rotation angle of the second joint 36 matches the rotation angle of the first joint 20 of the corresponding slave arm 13.
 従って、図6に示すように、オペレータ及び介助者は、発光部40の発光の有無に基づいて、マスタアーム34の第2関節36の中で、スレーブアーム13の第1関節20に一致している関節と、一致していない関節と、を把握することができる。 Therefore, as shown in FIG. 6, the operator and the assistant agree with the first joint 20 of the slave arm 13 among the second joints 36 of the master arm 34 based on the presence or absence of light emission of the light emitting unit 40. It is possible to grasp the joints that are present and the joints that do not match.
 図示の例では、マスタアーム34の第2関節36のうち、手元側の2つの第2関節36と、グリップ部35に最も近い第2関節36に設けられた発光部40が青色に点灯(ドットでハッチングしている)している。
 従って、オペレータ及び介助者は、残り1つの第2関節36の回転角度が、対応するスレーブアーム13の第1関節20の回転角度に一致していないことを把握することができる。
In the illustrated example, among the second joints 36 of the master arm 34, the two second joints 36 on the hand side and the light emitting unit 40 provided in the second joint 36 closest to the grip part 35 are lit in blue (dots). Are hatched).
Therefore, the operator and the assistant can grasp that the rotation angle of the remaining second joint 36 does not coincide with the rotation angle of the corresponding first joint 20 of the slave arm 13.
 そこで、オペレータは、残り1つの第2関節36の回転角度を変化させることが必要であることに気付くことができ、速やかにそのような操作を行うことができる。その結果、図7に示すように、全ての発光部40が青色に点灯になったことを確認(図5に示すステップS6)することで、スレーブアーム13の形状に対するマスタアーム34の形状を同期させる形状同期作業を完了することができる(図5に示すステップS7)。 Therefore, the operator can recognize that it is necessary to change the rotation angle of the remaining one second joint 36, and can quickly perform such an operation. As a result, as shown in FIG. 7, by confirming that all the light emitting units 40 are lit in blue (step S <b> 6 shown in FIG. 5), the shape of the master arm 34 is synchronized with the shape of the slave arm 13. The shape synchronization operation to be performed can be completed (step S7 shown in FIG. 5).
 このように、形状同期作業を行う際に、発光部40の発光の有無に基づいて、マスタアーム34の各第2関節36と、それに対応するスレーブアーム13の第1関節20との相互関係を容易且つ直感的に把握できるので、第1関節20の状態に第2関節36の状態を合わせるという、形状同期作業を簡便且つ効率良く行うことができる。 In this way, when performing the shape synchronization work, the mutual relationship between each second joint 36 of the master arm 34 and the corresponding first joint 20 of the slave arm 13 is determined based on whether or not the light emitting unit 40 emits light. Since it can be easily and intuitively grasped, the shape synchronization operation of matching the state of the second joint 36 with the state of the first joint 20 can be performed easily and efficiently.
 上述の形状同期作業が終了した後、先に述べたようにオペレータは患部の処置を施す作業を行う。以下に、患部の処置を行う場合について、図8に示すフローチャートを参照しながら詳細に説明する。 After the above-described shape synchronization operation is completed, the operator performs an operation for treating the affected area as described above. Hereinafter, the case where the affected area is treated will be described in detail with reference to the flowchart shown in FIG.
 この場合には、オペレータがモード制御部52を介して、医療用マニピュレータシステム1の制御モードを、第2モードから第1モードに切り換える(図8に示すステップS10)。これにより、スレーブ制御部51がマスタ制御部50からの作動指令に基づいて制御される状態に移行する。
 なお、モード切換を行うことで、報知制御部53による発光部40の制御はリセットされる。
In this case, the operator switches the control mode of the medical manipulator system 1 from the second mode to the first mode via the mode control unit 52 (step S10 shown in FIG. 8). Thereby, the slave control unit 51 shifts to a state controlled based on the operation command from the master control unit 50.
In addition, control of the light emission part 40 by the alerting | reporting control part 53 is reset by switching mode.
 第1モードに移行した後、オペレータは、図1、図3及び図4に示すように、内視鏡5による画像を表示部31で確認しながら、操作入力装置30を操作することでスレーブアーム13及びエンドエフェクタ21を遠隔操作する。
 例えば、オペレータがグリップ部35に設けられた操作部38を操作すると、マスタ制御部50が操作部38に入力された操作に応じた作動指令をスレーブ制御部51に出力する。スレーブ制御部51は、この作動指令に基づいてエフェクタアクチュエータ25を作動させるので、駆動ワイヤ22を介してエンドエフェクタ21を作動(開閉操作)させることができ、エンドエフェクタ21を遠隔操作することができる。
After shifting to the first mode, the operator operates the operation input device 30 while confirming the image by the endoscope 5 on the display unit 31, as shown in FIGS. 13 and the end effector 21 are remotely operated.
For example, when the operator operates the operation unit 38 provided in the grip unit 35, the master control unit 50 outputs an operation command corresponding to the operation input to the operation unit 38 to the slave control unit 51. Since the slave control unit 51 operates the effector actuator 25 based on this operation command, the end effector 21 can be operated (opening / closing operation) via the drive wire 22 and the end effector 21 can be remotely operated. .
 また、オペレータがマスタアーム34を操作する(図8に示すステップS11)と、マスタアーム34の各第2関節36がマスタアーム34の形状に応じてそれぞれ回転する。そのため、各第2関節36に設けられた第2エンコーダ39は、それぞれの第2関節36の回転角度をマスタ制御部50に出力する。
 すると、マスタ制御部50は、第2エンコーダ39からの検知結果に基づいて、第2関節36に対応するスレーブアーム13の第1関節20が、第2関節36の回転角度に一致するような作動指令を生成し、スレーブ制御部51に出力する(図8に示すステップS12)。
When the operator operates the master arm 34 (step S11 shown in FIG. 8), each second joint 36 of the master arm 34 rotates according to the shape of the master arm 34. Therefore, the second encoder 39 provided in each second joint 36 outputs the rotation angle of each second joint 36 to the master control unit 50.
Then, the master control unit 50 operates so that the first joint 20 of the slave arm 13 corresponding to the second joint 36 matches the rotation angle of the second joint 36 based on the detection result from the second encoder 39. A command is generated and output to the slave control unit 51 (step S12 shown in FIG. 8).
 スレーブ制御部51は、マスタ制御部50からの作動指令に基づいて、関節アクチュエータ26を作動させ、アングルワイヤ24を介してスレーブアーム13の第1関節20をそれぞれ指令された回転角度で回転させる。
 これにより、マスタアーム34の第2関節36の回転角度に、対応するスレーブアーム13の第1関節20の回転角度を一致させることができ、マスタアーム34の形状に対してスレーブアーム13の形状を高精度に相似させることができる。
The slave control unit 51 operates the joint actuator 26 based on the operation command from the master control unit 50, and rotates the first joint 20 of the slave arm 13 at the commanded rotation angle via the angle wire 24.
Accordingly, the rotation angle of the first joint 20 of the corresponding slave arm 13 can be matched with the rotation angle of the second joint 36 of the master arm 34, and the shape of the slave arm 13 can be made different from the shape of the master arm 34. It can be made similar to high precision.
 その結果、オペレータは、操作入力装置30を介してスレーブアーム13及びエンドエフェクタ21を遠隔操作することができ、患部の処置を適切に行うことができる。 As a result, the operator can remotely operate the slave arm 13 and the end effector 21 via the operation input device 30, and can appropriately treat the affected area.
 ところで、マスタスレーブ操作を行っている間、報知制御部53は、マスタアーム34の第2関節36の状態、及び該第2関節36に対応するスレーブアーム13の第1関節20の状態を正確且つリアルタイムに把握していると共に、スレーブアーム13の各第1関節20に予め定められた可動範囲に関する情報を有している。 By the way, during the master-slave operation, the notification control unit 53 accurately and accurately determines the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36. In addition to grasping in real time, each of the first joints 20 of the slave arm 13 has information related to a predetermined movable range.
 そこで、報知制御部53は、マスタスレーブ操作を行っている間、マスタ制御部50からスレーブ制御部51に出力される作動指令が、上記可動範囲内に収まる指令であるか否かを判断する(図8に示すステップS13)。 Therefore, the notification control unit 53 determines whether the operation command output from the master control unit 50 to the slave control unit 51 is a command that falls within the movable range while performing the master-slave operation ( Step S13 shown in FIG.
 その結果、可動範囲内に収まる作動指令の場合には、報知制御部53はその作動指令が有効であると判断する。これにより、上述したようにスレーブ制御部51が作動指令に基づいてスレーブアーム13を制御する(図8に示すステップS14)。これにより、マスタアーム34の形状に対してスレーブアーム13の形状を相似させることができる(図8に示すステップS15)。 As a result, when the operation command is within the movable range, the notification control unit 53 determines that the operation command is valid. Thereby, as described above, the slave control unit 51 controls the slave arm 13 based on the operation command (step S14 shown in FIG. 8). Thereby, the shape of the slave arm 13 can be made similar to the shape of the master arm 34 (step S15 shown in FIG. 8).
 これに対して、可動範囲を超えるような作動指令の場合には、報知制御部53はその作動指令が無効であると判断する。この場合、報知制御部53は、スレーブ制御部51が作動指令にしたがって作動しないように、作動指令をキャンセルすると共に、可動限界を超えている旨の判断結果を、発光部40を発光させることで、周囲に報知させる(図8に示すステップS16)。 On the other hand, when the operation command exceeds the movable range, the notification control unit 53 determines that the operation command is invalid. In this case, the notification control unit 53 cancels the operation command so that the slave control unit 51 does not operate according to the operation command, and causes the light emitting unit 40 to emit a determination result indicating that the movable limit is exceeded. And informing the surroundings (step S16 shown in FIG. 8).
 具体的には、報知制御部53は、可動限界を超えるスレーブアーム13の第1関節20に対応する第2関節36に設けられた発光部40が赤色に点灯するように制御する。
 これにより、オペレータ及び介助者は、赤色が点灯したことを受けて、マスタアーム34の操作を停止或いは抑制することができ、第1関節20の可動限界を超えるようなスレーブアーム13の動きを無理に要求し続けることを防止することができる。
Specifically, the notification control unit 53 performs control so that the light emitting unit 40 provided in the second joint 36 corresponding to the first joint 20 of the slave arm 13 exceeding the movable limit is lit in red.
As a result, the operator and the assistant can stop or suppress the operation of the master arm 34 when the red light is lit, and the slave arm 13 can not move so as to exceed the movable limit of the first joint 20. Can be prevented from continuing to request.
 例えば、図9に示すように、グリップ部35に最も近い第2関節36を回転させることでグリップ部35を下方に移動させるようなマスタアーム34の操作を行った場合に、この第2関節36に設けられた発光部40が赤色に点灯(斜線でハッチングしている)したときには、オペレータ及び介助者は、その第2関節36に対応するスレーブアーム13の第1関節20が可動限界を超えてしまうことを容易且つ直感的に把握することができる。 For example, as shown in FIG. 9, when the master arm 34 is operated so as to move the grip portion 35 downward by rotating the second joint 36 closest to the grip portion 35, the second joint 36. When the light emitting unit 40 provided on the red light is lit in red (hatched with hatching), the operator and the assistant have exceeded the movable limit of the first joint 20 of the slave arm 13 corresponding to the second joint 36. Can be easily and intuitively understood.
 従って、マスタアーム34の操作を引き続き無理に操作することを抑制させることができ、スレーブアーム13に対して違った動きをさせることが必要なことを、オペレータや介助者に速やかに促すことができる。
 また、マスタアーム34を無理に操作することをオペレータに抑制させることができるので、マスタアーム34に例えば余計な負荷がかかることを防止でき、不具合が発生することを防止できる。同様に、スレーブアーム13の第1関節20を可動範囲内で適切に回転させることができるので、スレーブアーム13に不具合が発生することも防止できる。
Therefore, it is possible to suppress the operation of the master arm 34 from being forcibly continued, and promptly prompt the operator and the assistant that the slave arm 13 needs to be moved differently. .
In addition, since the operator can be prevented from operating the master arm 34 forcibly, it is possible to prevent, for example, an extra load from being applied to the master arm 34 and to prevent occurrence of a malfunction. Similarly, since the first joint 20 of the slave arm 13 can be appropriately rotated within the movable range, it is possible to prevent the slave arm 13 from malfunctioning.
 上述したように、本実施形態の医療用マニピュレータシステム1によれば、第1モード及び第2モードのいずれの場合であっても、報知制御部53は、マスタアーム34における第2関節36の状態、及びそれに対応するスレーブアーム13における第1関節20の状態を、正確且つリアルタイムに把握することができると共に発光部40を介して周囲に報知することができる。
 従って、オペレータ及び介助者は、マスタアーム34の第2関節36と、それに対応するスレーブアーム13の第1関節20との相互関係を容易且つ直感的に把握することができる。
As described above, according to the medical manipulator system 1 of the present embodiment, the notification control unit 53 is in the state of the second joint 36 in the master arm 34 in both cases of the first mode and the second mode. And the state of the 1st joint 20 in the slave arm 13 corresponding to it can be grasped | ascertained correctly and in real time, and can be alert | reported to the circumference | surroundings via the light emission part 40. FIG.
Therefore, the operator and the assistant can easily and intuitively grasp the mutual relationship between the second joint 36 of the master arm 34 and the corresponding first joint 20 of the slave arm 13.
 その結果、第1モードにおいて、マスタアーム34及びスレーブアーム13の操作性を向上することができ、スレーブアーム13及びエンドエフェクタ21による患部への処置作業にオペレータの意識を集中させることができる。
 また、第2モードにおいて、スレーブアーム13の形状に対して、マスタアーム34の形状を同期させる形状同期作業を簡便且つ効率良く行うことができる。
As a result, in the first mode, the operability of the master arm 34 and the slave arm 13 can be improved, and the operator's consciousness can be concentrated on the treatment work on the affected area by the slave arm 13 and the end effector 21.
In the second mode, the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 can be performed easily and efficiently.
(第1実施形態の変形例)
 上記第1実施形態では、発光部40を青色に点灯させたが、青色に限定されるものではなく任意の色で点灯するように設定して構わない。また、発光の仕方としては、点灯に限定されるものではなく、例えば点滅でも構わない。
(Modification of the first embodiment)
In the said 1st Embodiment, although the light emission part 40 was lighted in blue, it is not limited to blue, You may set so that it may light with arbitrary colors. Further, the method of light emission is not limited to lighting, and may be blinking, for example.
 また、スレーブアーム13の第1関節20の回転角度と、これに対応するマスタアーム34の第2関節36の回転角度と、の角度差が小さくなるほど、発光部40の発光強度が強くなるように制御しても構わない。この場合には、発光強度が強くなる方向に第2関節36を回転させればよいので、形状同期作業をさらに効率良く行える。 In addition, as the angular difference between the rotation angle of the first joint 20 of the slave arm 13 and the rotation angle of the second joint 36 of the master arm 34 corresponding thereto decreases, the light emission intensity of the light emitting unit 40 increases. You may control. In this case, it is only necessary to rotate the second joint 36 in the direction in which the emission intensity increases, so that the shape synchronization operation can be performed more efficiently.
 さらには、スレーブアーム13の第1関節20の回転角度と、これに対応するマスタアーム34の第2関節36の回転角度と、の角度差が予め決められた角度範囲内である場合に発光部40を青色に発光させたが、角度差(差分)を報知するように発光部40を発光させても構わない。例えば、角度差に応じて、発光の色や発光強度を変化させるように発光部40を発光させてもよい。 Furthermore, when the angle difference between the rotation angle of the first joint 20 of the slave arm 13 and the rotation angle of the second joint 36 of the master arm 34 corresponding thereto is within a predetermined angle range, the light emitting unit 40 is emitted in blue, but the light emitting unit 40 may emit light so as to notify the angle difference (difference). For example, the light emitting unit 40 may emit light so as to change the color and intensity of light emission according to the angle difference.
 この場合であっても、オペレータ又は介助者は、発光部40による発光に基づいて、マスタアーム34における第2関節36の回転角度が、対応するスレーブアーム13における第1関節20の回転角度に対して一致しているか、或いは一致していないのかといったことを把握することができる。
 従って、形状同期作業を同様に効率良く行える。
Even in this case, based on the light emitted by the light emitting unit 40, the operator or the assistant can set the rotation angle of the second joint 36 in the master arm 34 to the rotation angle of the first joint 20 in the corresponding slave arm 13. It is possible to grasp whether or not they match.
Therefore, the shape synchronization operation can be performed efficiently as well.
(第2実施形態)
 次に、本発明に係る医療用マニピュレータシステムの第2実施形態について図面を参照して説明する。なお、この第2実施形態においては、第1実施形態における構成要素と同一の部分については、同一の符号を付しその説明を省略する。
(Second Embodiment)
Next, a second embodiment of the medical manipulator system according to the present invention will be described with reference to the drawings. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.
 本実施形態では、第2モードに移行した場合の形状同期作業の内容が第1実施形態と異なる。これについて、図10に示すフローチャートを参照しながら説明する。 In the present embodiment, the content of the shape synchronization work when the mode is shifted to the second mode is different from that of the first embodiment. This will be described with reference to the flowchart shown in FIG.
 なお、報知制御部53がスレーブアーム13の第1関節20の回転角度と、これに対応するマスタアーム34の第2関節36の回転角度と、の角度差(差分)が予め決められた角度範囲内(所定範囲内)であるか否かを判断する(図10に示すステップS1~S4)ことまでは、第1実施形態と同じであるので、説明を省略する。 The angle range (difference) between the rotation angle of the first joint 20 of the slave arm 13 and the rotation angle of the second joint 36 of the master arm 34 corresponding to the notification control unit 53 is determined in advance. Since it is the same as that of the first embodiment until it is determined whether it is within (predetermined range) (steps S1 to S4 shown in FIG. 10), the description thereof is omitted.
 本実施形態では、上記角度差が予め決められた角度範囲内である場合、報知制御部53は、第2関節36に設けられた発光部40を発光させることで、その旨を周囲に報知させる(図10に示すステップS20)。
 具体的には、報知制御部53は、発光部40が青色に点灯するように制御する。これにより、オペレータ及び介助者は、マスタアーム34の第2関節36の回転角度が、対応するスレーブアーム13の第1関節20の回転角度に対して一致していることを把握することができる。
In the present embodiment, when the angle difference is within a predetermined angle range, the notification control unit 53 causes the light emitting unit 40 provided in the second joint 36 to emit light, thereby informing the surroundings. (Step S20 shown in FIG. 10).
Specifically, the notification control unit 53 controls the light emitting unit 40 to light up in blue. Thereby, the operator and the assistant can grasp that the rotation angle of the second joint 36 of the master arm 34 matches the rotation angle of the first joint 20 of the corresponding slave arm 13.
 これにより、例えば図11に示すように、発光部40が青色に点灯(ドットでハッチングしている)していない位置の第2関節36を回転させる必要があることをオペレータ及び介助者は把握することができる。
 そこで、オペレータは、発光部40が点灯していない位置の第2関節36を回転させるようにマスタアーム34を操作する。
Accordingly, for example, as shown in FIG. 11, the operator and the assistant grasp that the second joint 36 at a position where the light emitting unit 40 is not lit in blue (hatched with dots) needs to be rotated. be able to.
Therefore, the operator operates the master arm 34 so as to rotate the second joint 36 at a position where the light emitting unit 40 is not lit.
 このとき、報知制御部53は、上記角度差が小さくなり、予め決められた角度範囲に近づくか否かを判断する(図10に示すステップS21)。
 その結果、報知制御部53は、上記角度差が予め決められた角度範囲内に含まれた場合には、点灯していなかった発光部40を青色に点灯させる(図10に示すステップS20)。
At this time, the notification control unit 53 determines whether or not the angle difference is small and approaches a predetermined angle range (step S21 shown in FIG. 10).
As a result, when the angle difference is included in the predetermined angle range, the notification control unit 53 turns on the light emitting unit 40 that has not been turned on in blue (step S20 shown in FIG. 10).
 これに対して、報知制御部53は、上記角度差がさらに大きくなり、予め決められた角度範囲からさらに遠ざかる場合には、点灯していなかった発光部40を青色とは異なる色、例えば赤色に点灯させる(図10に示すステップS22)。 On the other hand, when the angle difference is further increased and the notification control unit 53 is further away from the predetermined angle range, the notification control unit 53 changes the light emitting unit 40 that has not been lit to a color different from blue, for example, red. Lights up (step S22 shown in FIG. 10).
 従って、オペレータは、発光部40が点灯していない位置の第2関節36を回転させる際に、その発光部40がその後に点灯する色によって、第2関節36を形状同期にとって正しい方向に回転させているのか、或いは間違った方向に回転させているのかを把握することができる。 Therefore, when the operator rotates the second joint 36 at a position where the light emitting unit 40 is not lit, the operator rotates the second joint 36 in the correct direction for shape synchronization by the color that the light emitting unit 40 is subsequently lit. It can be grasped whether it is rotating in the wrong direction.
 このように、本実施形態によれば、回転させるべきマスタアーム34の第2関節36を特定できるだけでなく、その第2関節36をどの方向に回転させればよいのかということまでも把握できる。従って、形状同期作業をさらに効率良く行うことができる。 Thus, according to the present embodiment, not only can the second joint 36 of the master arm 34 to be rotated be specified, but also the direction in which the second joint 36 should be rotated can be grasped. Therefore, the shape synchronization operation can be performed more efficiently.
 その結果、全ての発光部40が青色に点灯になったことを確認(図10に示すステップS23)することで、スレーブアーム13の形状に対するマスタアーム34の形状を同期させる形状同期作業を完了することができる(図10に示すステップS24)。 As a result, by confirming that all the light emitting units 40 are lit in blue (step S23 shown in FIG. 10), the shape synchronization operation for synchronizing the shape of the master arm 34 with the shape of the slave arm 13 is completed. (Step S24 shown in FIG. 10).
(第3実施形態)
 次に、本発明に係る医療用マニピュレータシステムの第3実施形態について図面を参照して説明する。なお、この第3実施形態においては、第1実施形態における構成要素と同一の部分については、同一の符号を付しその説明を省略する。
(Third embodiment)
Next, a third embodiment of the medical manipulator system according to the present invention will be described with reference to the drawings. In the third embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.
 本実施形態では、第1モードの際、報知制御部53が、記憶部55に記憶されたスレーブアーム13の第1関節20の回転角度と、現在のマスタアーム34の第2関節36の回転角度との比較を行う。以下に、図12に示すフローチャートを参照しながら詳細に説明する。 In the present embodiment, in the first mode, the notification control unit 53 causes the rotation angle of the first joint 20 of the slave arm 13 stored in the storage unit 55 and the rotation angle of the second joint 36 of the current master arm 34 to be stored. Compare with. Hereinafter, a detailed description will be given with reference to the flowchart shown in FIG.
 なお、マスタ制御部50が、第2エンコーダ39からの検知結果に基づいて、第2関節36に対応するスレーブアーム13の第1関節20が、第2関節36の回転角度に一致するような作動指令をスレーブ制御部51に出力する(図12に示すステップS10~S12)ことで、マスタアーム34の形状に対してスレーブアーム13の形状を相似させるように操作(マスタスレーブ操作)することまでは第1実施形態と同じであるので、説明を省略する。 The master control unit 50 operates such that the first joint 20 of the slave arm 13 corresponding to the second joint 36 matches the rotation angle of the second joint 36 based on the detection result from the second encoder 39. Until the command is output to the slave control unit 51 (steps S10 to S12 shown in FIG. 12), the operation of the slave arm 13 is similar to the shape of the master arm 34 (master slave operation). Since it is the same as 1st Embodiment, description is abbreviate | omitted.
 本実施形態では、マスタスレーブ操作を行っている場合、スレーブアーム13に同じ動きを繰り返しさせるときに、オペレータが、変化前におけるスレーブアーム13の各第1関節20の回転角度を記憶部55に記憶させる操作を行う。この操作としては、例えば操作テーブル33に設けられた図示しないメモリボタンを押下すること等によって行うことができる。
 これにより、記憶部55は第1エンコーダ27からの検知結果(第1関節20の回転角度)を記憶する(図12に示すステップS30)。
In the present embodiment, when the master-slave operation is performed, when the slave arm 13 repeats the same movement, the operator stores in the storage unit 55 the rotation angle of each first joint 20 of the slave arm 13 before the change. Perform the operation. This operation can be performed, for example, by pressing a memory button (not shown) provided in the operation table 33.
Thereby, the memory | storage part 55 memorize | stores the detection result (rotation angle of the 1st joint 20) from the 1st encoder 27 (step S30 shown in FIG. 12).
 その後、マスタスレーブ操作を進めて、スレーブアーム13の形状が変化した後、操作入力装置30の操作により、スレーブアーム13を再び変化前の形状に復帰させる際、オペレータは記憶部55に記憶させた情報を利用する操作を行う。この操作としては、例えば操作テーブル33に設けられた図示しないサポートボタンを押下する等によって行うことができる。 Thereafter, the master-slave operation is advanced, and after the shape of the slave arm 13 is changed, when the slave arm 13 is returned again to the shape before the change by the operation of the operation input device 30, the operator stores it in the storage unit 55. Perform operations that use information. This operation can be performed, for example, by pressing a support button (not shown) provided on the operation table 33.
 すると、報知制御部53は、記憶部55に記憶されたスレーブアーム13の第1関節20の回転角度と、第2エンコーダ39で検知されたマスタアーム34の現在の第2関節36の回転角度と、を比較することで、その角度差(差分)を算出する(図12に示すステップS31)。 Then, the notification control unit 53 stores the rotation angle of the first joint 20 of the slave arm 13 stored in the storage unit 55 and the current rotation angle of the second joint 36 of the master arm 34 detected by the second encoder 39. , To calculate the angular difference (difference) (step S31 shown in FIG. 12).
 そして、報知制御部53は、この角度差(差分)が予め決められた角度範囲内(所定範囲内)であるか否かを判断する(図12に示すステップS32)。その結果、報知制御部53は、上記角度差が予め決められた角度範囲内である場合には、第2関節36に設けられた発光部40を発光させることで、その旨を周囲に報知させる(図12に示すステップS33)。 Then, the notification control unit 53 determines whether or not the angle difference (difference) is within a predetermined angle range (within a predetermined range) (step S32 shown in FIG. 12). As a result, when the angle difference is within a predetermined angle range, the notification control unit 53 causes the light emitting unit 40 provided in the second joint 36 to emit light, thereby notifying the surroundings. (Step S33 shown in FIG. 12).
 具体的には、報知制御部53は、発光部40が青色に点灯するように制御する。これにより、オペレータ及び介助者は、発光部40が点灯した第2関節36に対応するスレーブアーム13の第1関節20の回転角度が、変化前に記憶させた第1関節20の回転角度に一致したことを把握することができる。 Specifically, the notification control unit 53 controls the light emitting unit 40 to light up in blue. As a result, the operator and the assistant can make the rotation angle of the first joint 20 of the slave arm 13 corresponding to the second joint 36 with the light emitting unit 40 lit coincide with the rotation angle of the first joint 20 stored before the change. I can understand what happened.
 従って、図13に示すように、オペレータ及び介助者は、発光部40の発光の有無に基づいて、スレーブアーム13の第1関節20の中で、記憶させた変化前の状態(図13において点線で示す状態)における第1関節20に一致した関節と、一致していない関節と、を把握することができる。 Therefore, as shown in FIG. 13, the operator and the assistant can store the state before the change stored in the first joint 20 of the slave arm 13 based on whether or not the light emitting unit 40 emits light (dotted line in FIG. 13). It is possible to grasp the joint that coincides with the first joint 20 and the joint that does not coincide with each other.
 図示の例では、マスタアーム34の第2関節36のうち、手元側の第2関節36に設けられた発光部40が青色に点灯(ドットでハッチングしている)している。従って、オペレータ及び介助者は、残り3つの第2関節36に対応するスレーブアーム13の第1関節20の回転角度が、記憶させた変化前の状態の回転角度に一致していないことを把握することができる。 In the example shown in the drawing, among the second joints 36 of the master arm 34, the light emitting unit 40 provided at the second joint 36 on the hand side is lit in blue (hatched with dots). Therefore, the operator and the assistant grasp that the rotation angle of the first joint 20 of the slave arm 13 corresponding to the remaining three second joints 36 does not match the stored rotation angle before the change. be able to.
 そこで、オペレータは、残り3つの第1関節20の回転角度を変化させることが必要であることに気付くことができ、速やかにそのような操作を行うことができる。その結果、図14に示すように、残り3つのうち2つの第2関節36の回転角度を速やかに調整して、記憶させた変化前の状態の回転角度に一致させることができる。同様にして、最後の1つの第2関節36の回転角度を速やかに調整することで、最終的に全ての発光部40が青色に点灯する(図12に示すステップS34)。これにより、スレーブアーム13を変化前の状態に一致させることができる(図12に示すステップS35)。 Therefore, the operator can notice that it is necessary to change the rotation angles of the remaining three first joints 20, and can quickly perform such an operation. As a result, as shown in FIG. 14, the rotation angles of the two second joints 36 out of the remaining three can be quickly adjusted to match the stored rotation angle before the change. Similarly, by quickly adjusting the rotation angle of the last one second joint 36, all the light emitting units 40 are finally lit in blue (step S34 shown in FIG. 12). Thereby, the slave arm 13 can be made to correspond with the state before a change (step S35 shown in FIG. 12).
 このように、本実施形態によれば、スレーブアーム13を速やかに変化前の形状に復帰させることができるので、スレーブアーム13に同じ動きを繰り返し行う際の操作性を向上することができる。
 従って、例えば患部に対して繰り返し縫合を行う場合等には、特に有効である。
Thus, according to this embodiment, since the slave arm 13 can be quickly returned to the shape before change, the operability when the same movement is repeatedly performed on the slave arm 13 can be improved.
Therefore, it is particularly effective when, for example, the suture is repeatedly performed on the affected area.
(第4実施形態)
 次に、本発明に係る医療用マニピュレータシステムの第4実施形態について図面を参照して説明する。なお、この第4実施形態においては、第1実施形態における構成要素と同一の部分については、同一の符号を付しその説明を省略する。
(Fourth embodiment)
Next, a fourth embodiment of the medical manipulator system according to the present invention will be described with reference to the drawings. In the fourth embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.
 本実施形態では、スレーブアーム13の第1関節20、又はマスタアーム34の第2関節36に不具合が生じていることを把握することができる。これについて、図15に示すフローチャートを参照しながら詳細に説明する。 In the present embodiment, it is possible to grasp that a problem has occurred in the first joint 20 of the slave arm 13 or the second joint 36 of the master arm 34. This will be described in detail with reference to the flowchart shown in FIG.
 報知制御部53には、先に述べたように、マスタ制御部50を介して第2エンコーダ39の検知結果が入力されると共に、スレーブ制御部51を介して第1エンコーダ27の検知結果が入力されている。そのため、報知制御部53は、マスタアーム34の第2関節36の状態、及び該第2関節36に対応するスレーブアーム13の第1関節20の状態を正確且つリアルタイムに把握している。 As described above, the detection result of the second encoder 39 is input to the notification control unit 53 via the master control unit 50 and the detection result of the first encoder 27 is input to the notification control unit 53 via the slave control unit 51. Has been. Therefore, the notification control unit 53 accurately grasps the state of the second joint 36 of the master arm 34 and the state of the first joint 20 of the slave arm 13 corresponding to the second joint 36 in real time.
 そこで、報知制御部53は、制御モードに関係なく、第1エンコーダ27及び第2エンコーダ39の検知結果に基づいて、現在のスレーブアーム13の各第1関節20の状態、及び現在のマスタアーム34の各第2関節36の状態の作動性の良否を判断する(図15に示すステップS40)。 Therefore, the notification control unit 53 determines the current state of each first joint 20 of the slave arm 13 and the current master arm 34 based on the detection results of the first encoder 27 and the second encoder 39 regardless of the control mode. The operability of the state of each second joint 36 is determined (step S40 shown in FIG. 15).
 例えば、スレーブアーム13の各第1関節20を回転させるためのアングルワイヤ24に弛みや引っ掛かりが生じる、或いはアングルワイヤ24が破断する等の不具合が生じた場合には、マスタアーム34の作動に伴ってマスタ制御部50からスレーブ制御部51に作動指令が出力され、それに応じて関節アクチュエータ26が作動したとしても、第1関節20を適切に回転させることが困難になってしまう。  For example, when a malfunction such as loosening or catching in the angle wire 24 for rotating each first joint 20 of the slave arm 13 or breaking of the angle wire 24 occurs, the master arm 34 is operated. Even if the operation command is output from the master control unit 50 to the slave control unit 51 and the joint actuator 26 is operated accordingly, it is difficult to appropriately rotate the first joint 20. *
 すると、報知制御部53は、第1エンコーダ27からの検知結果から、第1関節20が適切に作動していないことを把握することができる。すなわち、報知制御部53は、作動指令に対して適切な応答がされていないことを把握することができる。これにより、報知制御部53は、第1関節20が作動不良であることを判断することができる。 Then, the notification control unit 53 can grasp from the detection result from the first encoder 27 that the first joint 20 is not operating properly. That is, the notification control unit 53 can grasp that an appropriate response is not made to the operation command. Thereby, the notification control unit 53 can determine that the first joint 20 is malfunctioning.
 このように作動不良であると判断した場合、報知制御部53は、作動不良と判断した第1関節20に対応するマスタアーム34の第2関節36に設けられた発光部40を発光させることで、作動不良である旨を周囲に報知させる(図15に示すステップS41)。 Thus, when it is judged that it is malfunctioning, the information control part 53 makes the light emission part 40 provided in the 2nd joint 36 of the master arm 34 corresponding to the 1st joint 20 judged to be malfunctioning emit light. Then, it informs the surroundings that it is malfunctioning (step S41 shown in FIG. 15).
 例えば、図16に示すように、マスタアーム34の各第2関節36のうち、手元側から2番目の第2関節36に設けられた発光部40が赤色に点灯(斜線でハッチングしている)する。これにより、オペレータ及び介助者は、発光部40が赤色に点灯したことにより、この発光部40が設けられた第2関節36、又はこれに対応する第1関節20に不具合(故障)が生じていることを把握することができる。
 従って、オペレータ及び介助者が、不具合に対する処置を適切に行うことができる。
For example, as shown in FIG. 16, among the second joints 36 of the master arm 34, the light emitting unit 40 provided at the second joint 36 that is the second from the hand side is lit red (hatched with hatching). To do. As a result, the operator and the assistant have a problem (failure) in the second joint 36 provided with the light emitting unit 40 or the corresponding first joint 20 because the light emitting unit 40 is lit red. I can grasp that.
Therefore, the operator and the assistant can appropriately take measures against the malfunction.
 なお、本実施形態において、発光部40が赤色に点灯する場合に限定されるものではなく、発光の色や発光の仕方は自由に設定して構わない。また、常時不具合を判断するのではなく、例えばオペレータ又は介助者が、操作テーブル33に設けられた図示しない判定ボタン等を押下したときに、不具合を判断するモードに移行してもよい。 In addition, in this embodiment, it is not limited to the case where the light emission part 40 lights in red, You may set the light emission color and the light emission method freely. In addition, instead of always determining a failure, for example, when an operator or an assistant presses a determination button (not shown) provided on the operation table 33, the mode may be shifted to a mode for determining a failure.
 さらには、第1関節20が故障した場合と、この第1関節20に対応した第2関節36が故障した場合と、を容易に区別できるように、異なる色で発光部40を発光させても良い。例えば、第1関節20が故障した場合には、赤色で発光部40を発光させ、第1関節20に対応した第2関節36が故障した場合には、黄色で発光部40を発光させても良い。
 このようにすることで、オペレータ及び介助者は、発光部40が点灯した色に基づいて、この発光部40が設けられた第2関節36が故障したのか、又はこれに対応する第1関節20が故障したのかを、容易に把握することができる。
 なお、色で区別するのではなく、例えば点灯と点滅とによる発光の違いを利用して、発光部40が設けられた第2関節36が故障したのか、又はこれに対応する第1関節20が故障したのかを区別しても良い。
Furthermore, even if the light emitting unit 40 is caused to emit light in different colors so that the case where the first joint 20 fails and the case where the second joint 36 corresponding to the first joint 20 fails can be easily distinguished. good. For example, when the first joint 20 fails, the light emitting unit 40 emits light in red, and when the second joint 36 corresponding to the first joint 20 fails, the light emitting unit 40 emits light in yellow. good.
By doing so, the operator and the assistant can determine whether the second joint 36 provided with the light emitting unit 40 has failed or the corresponding first joint 20 based on the color of the light emitting unit 40 lit. It is possible to easily grasp whether or not the device has failed.
Instead of distinguishing between colors, for example, the difference in light emission between lighting and flashing is used to determine whether the second joint 36 provided with the light emitting unit 40 has failed or the first joint 20 corresponding thereto has failed. It may be distinguished whether a failure has occurred.
(第5実施形態)
 次に、本発明に係る医療用マニピュレータシステムの第5実施形態について図面を参照して説明する。なお、この第5実施形態においては、第1実施形態における構成要素と同一の部分については、同一の符号を付しその説明を省略する。
(Fifth embodiment)
Next, a fifth embodiment of the medical manipulator system according to the present invention will be described with reference to the drawings. In the fifth embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.
 本実施形態では、マスタアーム34における各第2関節36のテスト時に、テストが終了した各第2関節36を把握することができる。これについて、図17に示すフローチャートを参照しながら詳細に説明する。 In the present embodiment, when testing each second joint 36 in the master arm 34, it is possible to grasp each second joint 36 for which the test has been completed. This will be described in detail with reference to the flowchart shown in FIG.
 一般的に、起動時或いは定期検査等において、マスタアーム34が適切に作動することを確認するテスト(動作確認テスト)を行う。つまり、マスタアーム34の各第2関節36をそれぞれ可動範囲で回転させ、適切に作動することを確認する。
 このテストは、オペレータが例えば操作テーブル33に設けられた図示しないテストボタンを押下することで開始される。
Generally, a test (operation check test) is performed to confirm that the master arm 34 operates properly at the time of start-up or periodic inspection. That is, each second joint 36 of the master arm 34 is rotated within the movable range, and it is confirmed that it operates properly.
This test is started when the operator presses a test button (not shown) provided on the operation table 33, for example.
 本実施形態では、テストボタンを押下すると、テストモードに移行して入力テストが開始される(図17に示すステップS50)。すると、オペレータは、第2関節36を1つずつ順番に回転させるように、マスタアーム34を操作する(図15に示すステップS51)。
 このとき、報知制御部53には、先に述べたように、マスタ制御部50を介して第2エンコーダ39の検知結果が入力されているので、マスタアーム34の第2関節36の状態を正確且つリアルタイムに把握している。
In this embodiment, when the test button is pressed, the test mode is entered and an input test is started (step S50 shown in FIG. 17). Then, the operator operates the master arm 34 so as to sequentially rotate the second joints 36 one by one (step S51 shown in FIG. 15).
At this time, as described above, since the detection result of the second encoder 39 is input to the notification control unit 53 via the master control unit 50, the state of the second joint 36 of the master arm 34 is accurately determined. And grasp in real time.
 従って、報知制御部53は、第2エンコーダ39の検知結果に基づいて、現在テストしている第2関節36を把握することができる。そこで、報知制御部53は、テスト中、或いはテストの終了後に、その第2関節36に設けられている発光部40を例えば青色に点灯するように制御する(図15に示すステップS52)。 Therefore, the notification control unit 53 can grasp the second joint 36 currently being tested based on the detection result of the second encoder 39. Therefore, the notification control unit 53 controls the light emitting unit 40 provided in the second joint 36 to light up in blue, for example, during the test or after the test is finished (step S52 shown in FIG. 15).
 これにより、オペレータ及び介助者は、現在テスト中の第2関節36、及び既にテストが終了した第2関節36を容易且つ直感的に把握することができる。
 例えば、図18に示すように、3つの発光部40が青色に点灯(ドットでハッチングしている)している場合には、オペレータ及び介助者は、マスタアーム34の各第2関節36のうち、点灯している発光部40が設けられている3つの第2関節36について、テストが終了していることを把握することができる。
Accordingly, the operator and the assistant can easily and intuitively grasp the second joint 36 currently being tested and the second joint 36 that has already been tested.
For example, as shown in FIG. 18, when the three light emitting units 40 are lit in blue (hatched with dots), the operator and the caregiver are in the second joints 36 of the master arm 34. It is possible to grasp that the test has been completed for the three second joints 36 provided with the light emitting units 40 that are lit.
 従って、オペレータ及び介助者は、残り1つの第2関節36のテストがまだ終了していないことを把握できるので、入力テストを確実且つ効率良く行うことができる。そして、全ての発光部40が点灯する(図17に示すステップS53)ことで、入力テストが適切に終了したことを確認できる。 Therefore, since the operator and the assistant can grasp that the test of the remaining second joint 36 has not been completed, the input test can be performed reliably and efficiently. And all the light emission parts 40 light (step S53 shown in FIG. 17), and it can confirm that the input test was complete | finished appropriately.
 なお、入力テストの際、現在回転させている第2関節36の状態を、表示部31に表示させるようにしてもよい。
 例えば、図19に示すように、現在テストしている第2関節36について、予め決められた可動範囲(回転角度範囲)に対してどの程度まで回転させたか否かを示す回転角度範囲情報をバー表示させてもよい。図示の例では、可動範囲のうち、テストした角度範囲をバー表示させた場合を例にしている。
 従って、この場合には、可動範囲の全体に亘ってテストを確実に行い易い。
In the input test, the state of the second joint 36 currently rotated may be displayed on the display unit 31.
For example, as shown in FIG. 19, the rotation angle range information indicating how far the second joint 36 currently being tested has been rotated with respect to a predetermined movable range (rotation angle range) is displayed in a bar. It may be displayed. In the example shown in the figure, a case where the tested angular range is displayed as a bar in the movable range is taken as an example.
Therefore, in this case, it is easy to reliably perform the test over the entire movable range.
 なお、本発明の技術範囲は、上記実施形態に限定されるものではなく、本発明の趣旨を逸脱しない範囲において、種々の変更を加えることが可能である。 Note that the technical scope of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention.
 例えば、上記実施形態では、報知部41による報知の一例として発光部40を例に挙げて説明したが、この場合に限定されるものではなく、マスタアーム34の第2関節36の状態、及びこれに対応したスレーブアーム13の第1関節20の状態を周囲に報知できればよい。例えば、音量や音階が異なる音を発する音声発生部や、吹鳴部等を備えた報知部とし、音を利用して周囲に報知する構成としても構わない。 For example, in the above-described embodiment, the light emitting unit 40 has been described as an example of the notification by the notification unit 41, but is not limited to this case, and the state of the second joint 36 of the master arm 34, and this. What is necessary is just to be able to alert | report the state of the 1st joint 20 of the slave arm 13 corresponding to these. For example, a sound generation unit that emits a sound with a different volume or scale, a notification unit including a sounding unit, and the like may be used to notify the surroundings using sound.
 また、上記実施形態では、スレーブアーム13の第1関節20の数と、マスタアーム34の第2関節36の数とが、同じ場合を例に挙げて説明したが、この場合に限定されるものではなく、第1関節20の数と第2関節36の数とが異なっていてもよい。
 このような場合には、例えばマスタアーム34の第2関節36に対応付けされるスレーブアーム13の第1関節20を予め設定しておき、設定した第1関節20が回転するように構成すればよい。
 いずれにしても、第1関節20の数と第2関節36の数とが異なっていたとしても、互いの対応関係を事前に設定しておけばよい。従って、このような場合であっても、本発明を適用することができる。
In the above embodiment, the case where the number of the first joints 20 of the slave arm 13 and the number of the second joints 36 of the master arm 34 are the same has been described as an example. However, the present invention is limited to this case. Instead, the number of the first joints 20 and the number of the second joints 36 may be different.
In such a case, for example, the first joint 20 of the slave arm 13 associated with the second joint 36 of the master arm 34 is set in advance, and the set first joint 20 is configured to rotate. Good.
In any case, even if the number of the first joints 20 and the number of the second joints 36 are different, it is only necessary to set the corresponding relationship in advance. Therefore, the present invention can be applied even in such a case.
 なお、本発明のいくつかの実施形態を説明したが、これらの実施形態は、例として提示したものであり、発明の範囲を限定することは意図していない。これら実施形態は、その他の様々な形態で実施されることが可能であり、発明の要旨を逸脱しない範囲で、種々の省略、置き換え、変更、及び実施形態同士の組み合わせを行うことができる。 In addition, although several embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These embodiments can be implemented in various other forms, and various omissions, replacements, changes, and combinations of the embodiments can be performed without departing from the spirit of the invention.
 本発明によれば、マスタアームの第2関節と、それに対応するスレーブアームの第1関節との相互関係を容易且つ直感的に把握することができる。これにより、マスタアーム及びスレーブアームの操作性を向上することができ、例えばスレーブアーム及びエンドエフェクタによる患部への処置作業に、操作者の意識を集中させることができる。さらには、スレーブアームの形状に対してマスタアームの形状を同期させる形状同期作業を、簡便且つ効率良く行うことができる。 According to the present invention, it is possible to easily and intuitively grasp the mutual relationship between the second joint of the master arm and the corresponding first joint of the slave arm. Thereby, the operativity of a master arm and a slave arm can be improved, for example, an operator's consciousness can be concentrated on the treatment work to the affected part by a slave arm and an end effector. Furthermore, the shape synchronization operation for synchronizing the shape of the master arm with the shape of the slave arm can be performed easily and efficiently.
 1…医療用マニピュレータシステム
 4…制御ユニット(制御部)
 13…スレーブアーム
 20…第1関節
 21…エンドエフェクタ
 34…マスタアーム
 36…第2関節
 40…発光部
 41…報知部
DESCRIPTION OF SYMBOLS 1 ... Medical manipulator system 4 ... Control unit (control part)
DESCRIPTION OF SYMBOLS 13 ... Slave arm 20 ... 1st joint 21 ... End effector 34 ... Master arm 36 ... 2nd joint 40 ... Light emission part 41 ... Notification part

Claims (12)

  1.  1以上の第1関節を有すると共に、遠位端にエンドエフェクタを有するスレーブアームと、
     1以上の第2関節を有し、操作者によって操作されるマスタアームと、
     前記第2関節に設けられ、前記第2関節に対応した前記第1関節の状態、又は前記第2関節の状態を報知する報知部と、
     前記マスタアーム及び前記スレーブアームを制御し、且つ所定条件のもと前記第1関節の状態又は前記第2関節の状態を報知するように、前記報知部に指示する制御部と、
     を備える医療用マニピュレータシステム。
    A slave arm having one or more first joints and having an end effector at a distal end;
    A master arm having one or more second joints and operated by an operator;
    A notifying unit that is provided in the second joint and that reports the state of the first joint corresponding to the second joint or the state of the second joint;
    A control unit for controlling the master arm and the slave arm and instructing the notification unit to notify the state of the first joint or the state of the second joint under a predetermined condition;
    A medical manipulator system comprising:
  2.  請求項1に記載の医療用マニピュレータシステムにおいて、
     前記制御部は、
      前記マスタアームの動きに応じて、前記スレーブアームを制御する第1モードと、
      前記第1関節の状態に前記第2関節の状態を合わせるように制御する第2モードと、
     を有する医療用マニピュレータシステム。
    The medical manipulator system according to claim 1,
    The controller is
    A first mode for controlling the slave arm according to the movement of the master arm;
    A second mode for controlling to match the state of the second joint with the state of the first joint;
    A medical manipulator system comprising:
  3.  請求項2に記載の医療用マニピュレータシステムにおいて、
     前記第1モードにおいて、前記制御部は、前記第2関節に対応する前記第1関節の状態が該第2関節の状態に一致するように、該第1関節に対して作動指令を出力し、
     前記制御部は、前記作動指令が予め決められた前記第1関節の可動範囲内に収まる指令であるか否かを判断し、
     前記制御部は、前記判断の結果を前記第1の関節に対応する前記第2関節の前記報知部から報知するよう指示する、医療用マニピュレータシステム。
    The medical manipulator system according to claim 2,
    In the first mode, the control unit outputs an operation command to the first joint so that the state of the first joint corresponding to the second joint matches the state of the second joint,
    The control unit determines whether or not the operation command is a command that falls within a predetermined movable range of the first joint,
    The said control part is a medical manipulator system which instruct | indicates to alert | report the result of the said judgment from the said alerting | reporting part of the said 2nd joint corresponding to a said 1st joint.
  4.  請求項2又は3に記載の医療用マニピュレータシステムにおいて、
     前記第2モードにおいて、前記制御部は、前記第1関節に対応する前記第2関節の状態と前記第1関節の状態との差分を算出し、該差分を前記報知部から報知するよう指示する、医療用マニピュレータシステム。
    The medical manipulator system according to claim 2 or 3,
    In the second mode, the control unit calculates a difference between the state of the second joint corresponding to the first joint and the state of the first joint, and instructs to notify the difference from the notification unit. Medical manipulator system.
  5.  請求項4に記載の医療用マニピュレータシステムにおいて、
     前記制御部は、前記差分が所定範囲内であるか否かを判断し、所定範囲内である場合には前記報知部から報知させる、医療用マニピュレータシステム。
    The medical manipulator system according to claim 4,
    The said control part is a medical manipulator system which judges whether the said difference is in a predetermined range, and makes it alert | report from the said alerting | reporting part when it is in a predetermined range.
  6.  請求項2から5のいずれか1項に記載の医療用マニピュレータシステムにおいて、
     前記制御部は、前記第1関節の状態に基づいて、前記第1関節の作動性の良否を判断し、不良の場合には前記報知部から報知させる、医療用マニピュレータシステム。
    The medical manipulator system according to any one of claims 2 to 5,
    The control unit is a medical manipulator system that determines whether the operability of the first joint is good or not based on the state of the first joint, and notifies the notification from the notification unit in the case of failure.
  7.  請求項2から6のいずれか1項に記載の医療用マニピュレータシステムにおいて、
     前記制御部は、前記第2関節の状態に基づいて、前記第2関節の作動性の良否を判断し、不良の場合には前記報知部から報知させる、医療用マニピュレータシステム。
    The medical manipulator system according to any one of claims 2 to 6,
    The control unit is a medical manipulator system that determines whether the operability of the second joint is good or not based on the state of the second joint, and notifies the information from the notification unit when the second joint is defective.
  8.  請求項1から7のいずれか1項に記載の医療用マニピュレータシステムにおいて、
     前記報知部は、複数の色を発光可能な発光部を有する、医療用マニピュレータシステム。
    The medical manipulator system according to any one of claims 1 to 7,
    The notification unit is a medical manipulator system having a light emitting unit capable of emitting a plurality of colors.
  9.  1以上の第1関節を有し、遠位端にエンドエフェクタを有するスレーブアームと、1以上の第2関節を有し、操作者によって操作されるマスタアームと、を備える医療用マニピュレータシステムの作動方法であって、
     前記第1関節の状態、又は前記第2関節の状態を検知する工程と、
     所定条件において、前記第2関節に対応した前記第1関節の状態、又は前記第2関節の状態を報知するように、前記第2関節に設けられた報知部に指示する工程と、
     を備える医療用マニピュレータシステムの作動方法。
    Actuation of a medical manipulator system comprising: a slave arm having one or more first joints and having an end effector at a distal end; and a master arm having one or more second joints and operated by an operator A method,
    Detecting the state of the first joint or the state of the second joint;
    Instructing a notification unit provided in the second joint to notify the state of the first joint corresponding to the second joint or the state of the second joint under a predetermined condition;
    A method for operating a medical manipulator system comprising:
  10.  請求項9に記載の医療用マニピュレータシステムの作動方法において、
     前記マスタアームの動きに応じて、前記スレーブアームを制御する第1モードと、
     前記第1関節の状態に前記第2関節の状態を合わせるように制御する第2モードと、
     を有する医療用マニピュレータシステムの作動方法。
    The operation method of the medical manipulator system according to claim 9,
    A first mode for controlling the slave arm according to the movement of the master arm;
    A second mode for controlling to match the state of the second joint with the state of the first joint;
    A method for operating a medical manipulator system comprising:
  11.  請求項10に記載の医療用マニピュレータシステムの作動方法において、
     前記第1モードは、
      前記第2関節に対応する前記第1関節の状態が該第2関節の状態に一致するように、該第1関節に対して作動指令を出力する工程と、
      前記作動指令が予め決められた前記第1関節の可動範囲内に収まる指令であるか否かを判断する工程と、
      前記判断の結果を前記第1の関節に対応する前記第2関節の前記報知部から報知するよう指示する工程と、
     を有する医療用マニピュレータシステムの作動方法。
    The method of operating a medical manipulator system according to claim 10,
    The first mode is:
    Outputting an operation command to the first joint so that the state of the first joint corresponding to the second joint matches the state of the second joint;
    Determining whether the operation command is a command that falls within a predetermined movable range of the first joint;
    Instructing to notify the result of the determination from the notification unit of the second joint corresponding to the first joint;
    A method for operating a medical manipulator system comprising:
  12.  請求項10又は11に記載の医療用マニピュレータシステムの作動方法において、
     前記第2モードは、
      前記第1関節に対応する前記第2関節の状態と前記第1関節の状態との差分を算出する工程と、
      前記差分を前記報知部から報知するよう指示する工程と、
     を有する医療用マニピュレータシステムの作動方法。
    The operation method of the medical manipulator system according to claim 10 or 11,
    The second mode is:
    Calculating a difference between the state of the second joint corresponding to the first joint and the state of the first joint;
    Instructing to notify the difference from the notification unit;
    A method for operating a medical manipulator system comprising:
PCT/JP2016/051228 2016-01-18 2016-01-18 Manipulator system for medical use and operation method therefor WO2017125994A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/051228 WO2017125994A1 (en) 2016-01-18 2016-01-18 Manipulator system for medical use and operation method therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/051228 WO2017125994A1 (en) 2016-01-18 2016-01-18 Manipulator system for medical use and operation method therefor

Publications (1)

Publication Number Publication Date
WO2017125994A1 true WO2017125994A1 (en) 2017-07-27

Family

ID=59361810

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/051228 WO2017125994A1 (en) 2016-01-18 2016-01-18 Manipulator system for medical use and operation method therefor

Country Status (1)

Country Link
WO (1) WO2017125994A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024021599A1 (en) * 2022-07-29 2024-02-01 以诺康医疗科技 (苏州) 有限公司 Method and apparatus for controlling master-slave arm robot

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59146770A (en) * 1983-02-07 1984-08-22 株式会社日立製作所 Limiter for range of operation of manipulator
JPS6438274U (en) * 1987-08-31 1989-03-07
JP2004299012A (en) * 2003-03-31 2004-10-28 Toshiba Corp Medical manipulator, its control device, and control method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59146770A (en) * 1983-02-07 1984-08-22 株式会社日立製作所 Limiter for range of operation of manipulator
JPS6438274U (en) * 1987-08-31 1989-03-07
JP2004299012A (en) * 2003-03-31 2004-10-28 Toshiba Corp Medical manipulator, its control device, and control method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024021599A1 (en) * 2022-07-29 2024-02-01 以诺康医疗科技 (苏州) 有限公司 Method and apparatus for controlling master-slave arm robot

Similar Documents

Publication Publication Date Title
KR102372151B1 (en) Medical holding arm with annular LED display means
AU2019351926B2 (en) Methods and systems for providing assistance to a user of a surgical robot system
JP5017076B2 (en) Manipulator system and manipulator control method
JP6021353B2 (en) Surgery support device
US20200093552A1 (en) Surgical system and method of displaying information in the same
CN108348134B (en) Endoscope system
US20130024024A1 (en) Medical manipulator system
US11478313B2 (en) Surgical system and method of displaying information in the same
US11033347B2 (en) Surgical system
JP7411804B2 (en) Control of surgical instruments
US20220378518A1 (en) Surgical robot
JP6157785B1 (en) Medical manipulator system
WO2017125994A1 (en) Manipulator system for medical use and operation method therefor
US20120239058A1 (en) Surgical system
JP5636234B2 (en) Medical manipulator
US20220378531A1 (en) Surgical robot
JP2020096923A (en) Surgery system
US20220378530A1 (en) Surgical robot
JP6150968B1 (en) Endoscope system
GB2611255A (en) Methods and systems for providing assistance to a user of a surgical robot system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16886237

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16886237

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP