US10226308B2 - Method of controlling a medical master/slave system - Google Patents

Method of controlling a medical master/slave system Download PDF

Info

Publication number
US10226308B2
US10226308B2 US15/003,967 US201615003967A US10226308B2 US 10226308 B2 US10226308 B2 US 10226308B2 US 201615003967 A US201615003967 A US 201615003967A US 10226308 B2 US10226308 B2 US 10226308B2
Authority
US
United States
Prior art keywords
slave
master
slave apparatus
actuation mode
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US15/003,967
Other languages
English (en)
Other versions
US20160135910A1 (en
Inventor
Izumi HATTA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HATTA, Izumi
Publication of US20160135910A1 publication Critical patent/US20160135910A1/en
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION CHANGE OF ADDRESS Assignors: OLYMPUS CORPORATION
Application granted granted Critical
Publication of US10226308B2 publication Critical patent/US10226308B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B34/37—Master-slave robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70—Manipulators specially adapted for use in surgery
    • A61B34/74—Manipulators with manual electric input means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/301—Surgical robots for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes

Definitions

  • the present invention relates to a method of controlling a medical master/slave system that is used while inserted through the body cavity to apply treatments to various in-vivo tissues.
  • a master/slave system known as a surgery support system comprising a master manipulator operated by an operator and a slave manipulator for performing treatments on the basis of actuation of the master manipulator.
  • Japanese Patent No. 4608601 discloses a medical system characterized by comprising an insert slave apparatus that is inserted through the body and includes a bendable first bending portion and a bendable second bending portion located on a proximal end side of said first bending portion, a treatment slave apparatus that is inserted together with said insert slave apparatus and used in combination with said insert slave apparatus to apply treatments to sites under operation, an insert master portion that includes a movable portion, a rotatable first joint portion mounted on a distal end side of said movable portion and a rotatable second joint portion mounted on a proximal end side of said first joint portion and that is similar in shape to said insert slave apparatus with said first and second bending portions bent following rotating operation entered in said first and second joint portions, a treatment master portion which is operated by an operator and following which said treatment slave apparatus is actuated in response to an operation input to said treatment master portion, a coupling for coupling together said movable portion and said treatment master
  • the method of controlling a medical master/slave system comprising a bendable master apparatus operated by an operator and a bendable slave apparatus inserted through the body includes:
  • a reversal actuation mode in which, based on a bending state of the master apparatus, the slave apparatus is actuated in such a way as to be reversed in relation to operation of the master apparatus, and
  • the master apparatus In the transition mode from the ordinary actuation mode to the reversal actuation mode according to the inventive method of controlling the master/slave system, the master apparatus is actuated to an initial position.
  • the master apparatus In the transition mode from the reversal actuation to the ordinary actuation mode according to the inventive method of controlling the master/slave system, the master apparatus is actuated in such a way as to become similar to the slave apparatus.
  • the ordinary actuation mode makes a transition to the transition mode upon detection of a specific posture taken by the slave apparatus.
  • the ordinary actuation mode presents whether or not a transition to the transition mode is made to an operator who operates the master apparatus upon detection of a specific posture taken by the slave apparatus.
  • FIG. 1 is illustrative in schematic of the construction of the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 2 is a block diagram for the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 3 is illustrative of the master apparatus 52 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 4 is illustrative of the slave apparatus 30 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 5 is illustrative of the master apparatus 52 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 6 is illustrative of the slave apparatus 30 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 7 is illustrative of the master apparatus 52 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 8 is illustrative of the slave apparatus 30 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 9 is illustrative of an exemplary screen display on the display unit 60 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 10 is illustrative of an exemplary screen display on the display unit 60 in the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 11 is a flowchart for the control processing of the master/slave system 1 according to a specific embodiment of the invention.
  • FIG. 12 is illustrative of an operation in the reversal mode.
  • FIG. 13 is illustrative of interferences taking place in the slave apparatus 30 upon the operation shown in FIG. 12 .
  • FIG. 14 is a flowchart for the control processing of the master/slave system 1 according to another specific embodiment of the invention.
  • FIG. 15 is indicative of definitions of a world coordinate system and a camera coordinate system.
  • FIG. 16 is a flowchart for the control processing of the master/slave system 1 according to yet another specific embodiment of the invention.
  • FIG. 17 is a flowchart for the control processing of the master/slave system 1 according to a further specific embodiment of the invention.
  • FIG. 1 is illustrative in schematic of the construction of the master/slave system 1 according to a specific embodiment of the invention
  • FIG. 2 is a block diagram for the master/slave system 1 according to a specific embodiment of the invention
  • FIG. 3 is illustrative of the master apparatus 52 in the master/slave system 1 according to a specific embodiment of the invention
  • FIG. 4 is illustrative of the master apparatus 30 in the master/slave system 1 according to a specific embodiment of the invention.
  • the master/slave system 1 according to a specific embodiment of the invention, and how to control the same, is now explained with reference to the drawings.
  • the master/slave system 1 is an endoscope system of the master/slave mode comprising a master apparatus 52 in an operating assembly 50 operated by an operator O, an endoscope 4 having a flexible insert assembly 10 to be inserted into the body cavity of a patient P, for instance, a limp internal organ such as the large intestine, a slave apparatus 30 for performing a bending operation at the distal end of the insert assembly 10 , a control unit 70 for gaining control of the master apparatus 52 or slave apparatus 30 or a viewing optical system including a lighting portion 17 , an imager 40 and so on, and a display unit 60 for displaying images obtained through the endoscope 4 .
  • the operating assembly 50 includes the master apparatus 52 attached to an operating mount 51 .
  • the master apparatus 52 has a multi-joint structure.
  • the master apparatus 52 is provided to perform the bending operation of the slave apparatus 30 at the distal end of the insert assembly 10 .
  • the endoscope 4 includes a viewing optical system comprising the lighting portion 17 , imager 40 and so on for obtaining in-vivo images at the rigid distal-end portion 11 of the distal end of the slave apparatus 30 . Images obtained through the viewing optical system are processed within the control unit 70 to display them on the display unit 60 .
  • the control unit 70 is constructed of a logic element, a memory, a control program, and so on.
  • the control unit 70 drives a bending-motion motor (not shown) pursuant to an operational instruction from the master apparatus 52 to pull the proper operating wire (not shown) for bending of the slave apparatus 30 .
  • the endoscope 4 according to the embodiment described here comprises the insert assembly 10 inserted in the body, a treatment tool 39 and the imager 40 located at the rigid distal-end portion 11 positioned at the distal end of the insert assembly 10 , the operating assembly 50 operated by the operator O such as a surgeon to produce out an operational instruction (instruction), the display unit 60 for displaying images obtained through the imager 40 , and the control unit 70 for gaining control of the insert assembly 10 pursuant to the operational instruction.
  • the operating assembly 50 operated by the operator O such as a surgeon to produce out an operational instruction (instruction)
  • the display unit 60 for displaying images obtained through the imager 40
  • the control unit 70 for gaining control of the insert assembly 10 pursuant to the operational instruction.
  • the insert assembly 10 is a so-called flexible insert assembly that, as shown in FIG. 4 , includes a rigid distal-end portion 11 , a slave apparatus 30 located on a proximal end side with respect to the rigid distal-end portion 11 in such a way as to be bendable, and a flexible tubular portion 13 located on a proximal end side with respect to the slave apparatus 30 .
  • the rigid distal-end portion 11 is formed of a transparent member transparent to light emitted out of a lighting portion 17 such as an LED.
  • the rigid distal-end portion 11 is less bendable than the slave apparatus 30 .
  • This rigid distal-end portion 11 is provided with a treatment tool 39 such as an electrical knife in such a way as to be inserted through it.
  • the imager 40 has a built-in imaging device (not shown) such as a CCD.
  • the imaging device 41 is capable of acquiring images within a range of visual field, and then converting them into signals to be sent out to the control unit 70 .
  • the slave apparatus 30 used may have a configuration well known in the art.
  • the slave apparatus 30 comprises a plurality of joint rings connected together in such a way as to be mutually rotatable and arranged in an axial direction of the insert assembly 10 .
  • the distal one of such joint rings is connected with the distal ends of four operating wires (not shown) at an equiangular interval around the axis of the insert assembly 10 .
  • the operating wires are each connected at the proximal end to a slave driver 32 (see FIG. 2 ) such as a bending-motion motor mounted at the proximal end of the insert assembly 10 .
  • the proximal ends of the operating wires are pulled by the slave driver 32 to flex, viz., bend the slave apparatus 30 in any desired bow direction.
  • the control unit 70 is also designed to have a grip of the bending state of the slave apparatus 30 by a slave detector portion 31 (hereinafter called the slave detector).
  • the operating assembly 50 includes a master apparatus 52 , a mode transition button 55 , etc. mounted on an operating mount 51 .
  • the master apparatus 52 is of a multi-joint structure.
  • the master apparatus 52 is provided to bend the slave apparatus 30 in the insert assembly 10 .
  • the master apparatus 52 is provided with a master detector portion 53 by which the bending state of the master apparatus 52 may be detected.
  • the master apparatus 52 produces out an operational instruction to the control unit 70 upon operated.
  • the master apparatus 52 may produce out an operational instruction to operate the slave apparatus 30 via the control unit 70 .
  • the control unit 70 may basically perform control such that the bending state of the master apparatus 52 becomes similar to that of the slave apparatus 30 . For instance, as the master apparatus 52 is operated as shown in FIG. 5 , it causes the slave apparatus 30 to be driven as shown in FIG. 6 .
  • the bending state of the master apparatus 52 may also be controlled by a master driver portion 54 (hereinafter called the master driver 54 ) actuated in response to a control signal from the control unit 70
  • the control unit 70 is designed to generate an instruction signal for driving a slave driver portion 32 (hereinafter called the slave driver 32 ) in response to an operational signal from the master apparatus 52 . That is, the control unit 70 calculates out an amount of movement within a certain time of the master apparatus 52 on the proximal end side of the insert assembly 10 to send such an instruction signal as to achieve that amount of movement to the slave driver 32 .
  • FIGS. 9 and 10 there is an exemplary screen display on the display unit 60 in the master/slave system 1 according to the embodiment described here.
  • the direction of operation of the master apparatus 52 operated by the operator is the same as the direction of movement of a screen display on the display unit 60 , as shown in FIG. 9 .
  • Such an operability problem may be solved by the inventive master/slave system 1 that comprises not only an ordinary actuation mode in which the slave apparatus 30 is actuated in such a way as to be similar to the master apparatus 52 but also a reversal actuation mode in which the slave apparatus 30 is actuated in such a way as to be reversed relative to the master apparatus 52 .
  • the mode transition button 55 on the operating assembly 50 enables the operator to give a selective instruction to the control unit 70 as to the transition from the ordinary actuation mode to the reversal actuation mode, or from the reversal actuation mode to the ordinary actuation mode.
  • FIG. 11 is a flowchart for the control processing of the master/slave system 1 described here. Note here that this flowchart is one example of the control processing algorithm; other algorithms may be used, too, without departing from the purport of the invention.
  • Step S 100 The control process gets started in Step S 100 , and then goes to Step S 101 in which a command value is entered in the slave driver on the basis of a bending state of the master apparatus 52 detected by the detector such that the slave apparatus 30 becomes similar to the master apparatus 52 (ordinary actuation mode).
  • Step S 102 whether or not the mode transition button 55 is pressed down is determined. If the mode transition button 55 is here found to be pressed down, the control processing then goes to the next step in which the respective steps in the transition mode are executed.
  • Step S 103 the driving of the slave apparatus 30 is stopped in Step S 103 , and the master apparatus 52 is placed in an initial state in Step S 104 .
  • the “initial state of the master apparatus 52 ” means that the master apparatus 52 is in a neutral state or in such a state as shown in FIG. 3 .
  • Step S 105 on the basis of the bending state of the master apparatus 52 detected by the master detector 53 , a command value is entered into the slave driver such that the slave apparatus 30 is reversed relative to the master apparatus 52 (reversal actuation mode).
  • controlling the slave apparatus 30 in such a way as to be reversed relative to the master apparatus 52 means that a command value with the plus and minus of the ordinary command value being reversed is entered into the slave driver 32 .
  • Such a reversal actuation mode makes the direction of operation of the master apparatus 52 identical with the direction of movement of an endoscope screen display, resulting in improved operability.
  • the slave and master apparatuses 30 and 52 do not necessarily coincide in terms of spatial position as shown in FIGS. 11 and 12 . For this reason, it is assumed that although depending on the operation of the master apparatus, there may be interference occurring where the reversing portion of the slave apparatus 30 comes in collision with the rest.
  • Step S 107 the operation of the master apparatus 52 is restricted by the master driver 54 . Note here that detection of such interference as described above and control of restriction on the operation of the master apparatus 52 are left out of the flowchart.
  • whether or not such interference as collision of the slave apparatus 30 with itself occurs may be determined through a detection value obtained by a contact sensor attached to the slave apparatus 30 or, alternatively, by the magnitude of a difference between the command value to the master apparatus 52 and the amount of movement of the slave apparatus 30 .
  • the restriction imposed on the operation of the master apparatus 52 may be notified to the operator by applying an output on the master driver 54 on the master apparatus 52 side to control the slave apparatus 30 such that it does not move in such a direction as to cause the slave apparatus 30 to interfere with itself.
  • Step S 106 whether or not the mode transition button 55 is pressed down is determined. If the mode transition button 55 is here found to be pressed down, the control processing then goes to the next step for execution of the respective steps of the transition mode.
  • Step S 108 Upon transition from the reversal actuation mode to the ordinary actuation mode, the driving of the slave apparatus 30 is stopped in Step S 108 , and in Step S 109 , the master apparatus 52 is made similar to the slave apparatus 30 by the master driver 54 . After execution of the respective steps of such a transition mode as described above, the control processing returns back to Step S 101 for execution of the ordinary actuation mode.
  • the inventive master/slave system 1 and how to control the same, as described above, includes the reversal actuation mode in which, based on the bending state of the master apparatus 52 detected by the master detector 53 , the command value is entered in the slave driver 32 such that the slave apparatus 30 is reversed relative to the master apparatus 52 .
  • the inventive master/slave system, and the inventive method of controlling the same ensures that the operability of the system is improved upon the folding-back of the slave apparatus 30 .
  • the intra-mode changeover is manually made, it is to be understood that the intra-mode changeover is automatically made.
  • the world coordinate system (X w , Y w , Z w ) with reference to the flexible tubular portion 13 is introduced together with the camera coordinate system (X i , Y i , Z i ) with reference to the imager 40 .
  • FIG. 14 is a flowchart for the control processing of the master/slave system 1 according to another embodiment of the invention. Note here that this flowchart is one example of the algorithm for the control processing; other algorithms may be used, too, without departing from the purport of the invention.
  • Step S 200 The control processing gets started in Step S 200 , and then goes to Step S 201 in which, based on a bending state of the master apparatus 52 detected by the detector, a command value is entered in the slave driver such that the slave apparatus 30 becomes similar to the master apparatus 52 (ordinary actuation mode).
  • Step S 202 whether or not the angle of the Z i axis forming with the Z w axis is greater than 90° is determined. If the determination in this step S 202 is YES indicating the transition to the reversal actuation mode, the control processing then goes to Step S 203 for execution of the respective steps of the transition mode.
  • the mode changeover determination may be made on the basis of the posture of the distal end figured out by an acceleration sensor attached to the distal end of the master apparatus 52 or the slave apparatus 30 .
  • Step S 203 the driving of the slave apparatus 30 is stopped in Step S 203 , and the master apparatus 52 is placed in an initial state in Step S 204 .
  • the “initial state of the master apparatus 52 ” means that the master apparatus 52 is in a neutral state or in such a state as shown in FIG. 3 .
  • Step S 205 on the basis of the bending state of the master apparatus 52 detected by the master detector 53 , a command value is entered in the slave driver such that the slave apparatus 30 is reversed relative to the master apparatus 52 (reversal actuation mode).
  • controlling the slave apparatus 30 in such a way as to be reversed relative to the master apparatus 52 means that a command value with the plus and minus of the ordinary command value being reversed is entered in the slave driver 32 .
  • Such a reversal actuation mode makes the direction of operation of the master apparatus 52 identical with the direction of movement of an endoscopic screen display, resulting in improved operability.
  • the slave and master apparatuses 30 and 52 do not necessarily coincide in terms of spatial position as shown in FIGS. 11 and 12 . For this reason, it is assumed that although depending on the operation of the master apparatus, there may be interference occurring where the reversing portion of the slave apparatus 30 comes in collision with the rest.
  • Step S 207 the operation of the master apparatus 52 is restricted by the master driver 54 . Note here that detection of such interference as described above and control of restriction on the operation of the master apparatus 52 are left out of the flowchart.
  • whether or not such interference as collision of the slave apparatus 30 with itself occurs may be determined through a detection value obtained by a contact sensor attached to the slave sensor 30 or, alternatively, by the magnitude of a difference between the command value to the master apparatus 52 and the amount of movement of the slave apparatus 30 .
  • the restriction imposed on the operation of the master apparatus 52 may be notified to the operator by applying an output on the master driver 54 on the master apparatus 52 side to control the slave apparatus 30 such that it does not move in such a direction as to cause the slave apparatus 30 to interfere with itself.
  • Step S 206 whether or not the angle of Z i axis to the Z w axis is greater than 90° is determined. If the determination in this step S 206 is NO indicating the transition to the ordinary actuation mode, the control processing then goes to Step S 208 for execution of the respective steps of the transition mode.
  • Step S 208 the driving of the slave apparatus 30 is stopped in Step S 208 , and in Step S 209 , the master apparatus 52 is made similar to the slave apparatus 30 by the master driver 54 .
  • Step S 201 the control processing returns back to Step S 201 for execution of the ordinary actuation mode.
  • the master/slave system, and the method of controlling the same, according to such another embodiment as described above, has those similar to the advantages of the first embodiment, and enables automatic mode transition, resulting in more improved operability.
  • the intra-mode changeover is automatically made; however, in some possible cases, there may be no need for the operator to make a changeover to the reversal actuation mode. In the embodiment described here, therefore, the operator is urged to make a changeover from the ordinary actuation mode to the reversal actuation mode upon detection of a specific posture taken by the slave apparatus 30 . In other words, whether or not the mode changeover is actually made is left to the operator.
  • FIG. 16 is a flowchart for the control processing of the master/slave system 1 according to yet another embodiment of the invention. Note here that this flowchart is one example of the algorithm for the control process; other algorithms may be used, too, without departing from the purport of the invention.
  • Step S 300 The control processing gets started in Step S 300 , and then goes to Step S 301 in which, based on a bending state of the master apparatus 52 detected by the detector, a command value is entered in the slave driver such that the slave apparatus 30 becomes similar to the master apparatus 52 (ordinary actuation mode).
  • Step S 302 whether or not the angle of the Z i axis forming with the Z w axis is greater than 90° is determined. If the determination in this Step S 302 is YES, the control process then goes to Step S 303 urging the operator to select any one of the ordinary or the reversal actuation mode on the display unit 60 .
  • the mode changeover determination may be made on the basis of the posture of the distal end figured out by an acceleration sensor attached to the distal end of the master apparatus 52 or the slave apparatus 30 .
  • a screen display on the display unit 60 is used as the means for urging the operator to make the transition from the ordinary to the reversal actuation mode; however, it is to be noted that notification by way of sounds or tactile senses may be used as the means for urging the operator to make the transition from the ordinary to the reversal actuation mode.
  • Step S 304 whether or not the operator selects the reversal actuation mode is determined. If the determination in Step S 304 is NO, the control process then goes to Step S 301 for keeping on with the ordinary actuation mode. If the determination in Step S 304 is YES, on the other hand, the control process then goes to Step S 305 for a preparation to the transition to the reversal actuation mode, in which the respective steps of the transition mode are executed.
  • Step S 305 the driving of the slave apparatus 30 is stopped in Step S 305 , and the master apparatus 52 is placed in an initial state in Step S 306 .
  • the “initial state of the master apparatus 52 ” means that the master apparatus 52 is in a neutral state or in such a state as shown in FIG. 3 .
  • Step S 307 on the basis of the bending state of the master apparatus 52 detected by the master detector 53 , a command value is entered in the slave driver such that the slave apparatus 30 is reversed relative to the master apparatus 52 (reversal actuation mode).
  • controlling the slave apparatus 30 in such a way as to be reversed relative to the master apparatus 52 means that a command value with the plus and minus of the ordinary command value being reversed is entered in the slave driver 32 .
  • Such a reversal actuation mode makes the direction of operation of the master apparatus 52 identical with the direction of movement of an endoscopic screen display, resulting in improved operability.
  • the slave and master apparatuses 30 and 52 do not necessarily coincide in terms of spatial position as shown in FIGS. 11 and 12 . For this reason, it is assumed that although depending on the operation of the master apparatus, there may be interference occurring where the reversing portion of the slave apparatus 30 comes in collision with the rest.
  • Step S 307 the operation of the master apparatus 52 is restricted by the master driver 54 . Note here that detection of such interference as described above and control of restriction on the operation of the master apparatus 52 are left out of the flowchart.
  • whether or not such interference as collision of the slave apparatus 30 with itself occurs may be determined through a detection value obtained by a contact sensor attached to the slave sensor 30 or, alternatively, by the magnitude of a difference between the command value to the master apparatus 52 and the amount of movement of the slave apparatus 30 .
  • the restriction imposed on the operation of the master apparatus 52 may be notified to the operator by applying an output on the master driver 54 on the master apparatus 52 side to control the slave apparatus 30 such that it does not move in such a direction as to cause the slave apparatus 30 to interfere with itself.
  • Step S 308 whether or not the angle of the Z i axis forming with the Z w axis is greater than 90° is determined. If the determination in this step S 308 is NO indicating the transition to the ordinary actuation mode, the control processing then goes to Step S 309 for execution of the respective steps of the transition mode.
  • Step S 309 the driving of the slave apparatus 30 is stopped in Step S 309 , and in Step S 310 , the master apparatus 52 is made similar to the slave apparatus 30 by the master driver 54 .
  • Step S 301 the control processing returns back to Step S 301 for execution of the ordinary actuation mode.
  • the master/slave system, and the process of controlling it, according to such another embodiment as described above, produces those similar to the advantages of the former embodiment, and makes it possible for the operator to select mode transitions of her or his own choice, resulting in more improved operability.
  • the master apparatus 52 is designed to return back to the initial state in the transition mode from the ordinary to the reversal actuation mode. In the embodiment described here, however, such resumption of the master apparatus 52 in the initial state is dispensed with.
  • FIG. 17 is a flowchart for the control processing of the master/slave system 1 according to a further embodiment of the invention. Note here that this flowchart is one example of the algorithm for the control processing; other algorithms may be used, too, without departing from the purport of the invention.
  • Step S 400 The control processing gets started in Step S 400 , and then goes to Step S 401 in which, based on a bending state of the master apparatus 52 detected by the detector, a command value is entered in the slave driver such that the slave apparatus 30 becomes similar to the master apparatus 52 (ordinary actuation mode).
  • Step S 402 whether or not the mode transition button 55 is pressed down is determined. If the mode transition button 55 is here found to be depressed, the control processing then goes to Step S 403 .
  • Step S 405 on the basis of a bending state of the master apparatus 52 detected by the master detector 53 , a command value is entered in the slave driver such that the slave apparatus 30 is reversed relative to the master apparatus 52 (reversal actuation mode).
  • controlling the slave apparatus 30 in such a way as to be reversed in relation to the master apparatus 52 means that a command value with the plus and minus of the ordinary command value being reversed is entered in the slave driver 32 .
  • Such a reversal actuation mode makes the direction of operation of the master apparatus 52 identical with the direction of movement of a screen display of endoscopic images, resulting in improved operability.
  • the slave and master apparatuses 30 and 52 do not necessarily coincide in terms of spatial position. For this reason, it is assumed that although depending on the operation of the master apparatus, there may be interference occurring where the reversing portion of the slave apparatus 30 comes in collision with the rest.
  • Step S 407 the operation of the master apparatus 52 is restricted by the master driver 54 . Note here that detection of such interference as described above and control of restriction on the operation of the master apparatus 52 are left out of the flowchart.
  • whether or not such interference as collision of the slave apparatus 30 with itself occurs may be determined through a detection value obtained by a contact sensor attached to the slave sensor 30 or, alternatively, by the magnitude of a difference between the command value for the master apparatus 52 and the amount of movement of the slave apparatus 30 .
  • the restriction imposed on the operation of the master apparatus 52 may be notified to the operator by applying an output on the master driver 54 on the master apparatus 52 side to control the slave apparatus 30 such that it does not move in such a direction as to cause the slave apparatus 30 to interfere with itself.
  • Step S 404 whether or not the mode transition button 55 is pressed down is determined. If the mode transition button 55 is here to be depressed, the control process then goes to the next step for execution of the respective steps of the transition mode.
  • Step S 405 the driving of the slave apparatus 30 is stopped in Step S 405 , and in Step S 406 , the master apparatus 52 is allowed by the master driver 54 to become similar to the slave apparatus 30 .
  • the control process then goes back to Step S 401 for execution of the ordinary actuation mode.
  • the master/slave system, and the method of controlling the same, according to such fourth embodiment as described above, produces those similar to the advantages of the former embodiments.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Robotics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)
  • Manipulator (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
US15/003,967 2013-07-24 2016-01-22 Method of controlling a medical master/slave system Active 2034-12-03 US10226308B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013-153266 2013-07-24
JP2013153266A JP6173089B2 (ja) 2013-07-24 2013-07-24 医療用マスタースレーブシステムの制御方法
PCT/JP2014/066012 WO2015012022A1 (ja) 2013-07-24 2014-06-17 医療用マスタースレーブシステムの制御方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/066012 Continuation WO2015012022A1 (ja) 2013-07-24 2014-06-17 医療用マスタースレーブシステムの制御方法

Publications (2)

Publication Number Publication Date
US20160135910A1 US20160135910A1 (en) 2016-05-19
US10226308B2 true US10226308B2 (en) 2019-03-12

Family

ID=52393075

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/003,967 Active 2034-12-03 US10226308B2 (en) 2013-07-24 2016-01-22 Method of controlling a medical master/slave system

Country Status (5)

Country Link
US (1) US10226308B2 (ja)
EP (1) EP3025670A4 (ja)
JP (1) JP6173089B2 (ja)
CN (1) CN105407826B (ja)
WO (1) WO2015012022A1 (ja)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108348298B (zh) 2016-01-21 2021-05-14 奥林巴斯株式会社 医疗用机械手系统
EP3484401A4 (en) 2016-07-14 2020-03-18 Intuitive Surgical Operations Inc. SYSTEMS AND METHODS FOR CONTROLLING A SURGICAL INSTRUMENT

Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0576482A (ja) 1991-07-24 1993-03-30 Olympus Optical Co Ltd 処置装置
JPH05154782A (ja) 1991-12-04 1993-06-22 Toshiba Corp 遠隔操作装置
JPH07328016A (ja) 1994-06-14 1995-12-19 Olympus Optical Co Ltd 手術用マニピュレータシステム
JPH08224248A (ja) 1995-02-23 1996-09-03 Olympus Optical Co Ltd 医療用マニピュレータ
JP3339953B2 (ja) 1993-12-29 2002-10-28 オリンパス光学工業株式会社 医療用マスタースレーブ式マニピュレータ
US20030046401A1 (en) * 2000-10-16 2003-03-06 Abbott Kenneth H. Dynamically determing appropriate computer user interfaces
WO2004052171A2 (en) 2002-12-06 2004-06-24 Intuitive Surgical, Inc. Flexible wrist for surgical tool
US20040243147A1 (en) 2001-07-03 2004-12-02 Lipow Kenneth I. Surgical robot and robotic controller
US20040254680A1 (en) 2003-03-31 2004-12-16 Kabushiki Kaisha Toshiba Manipulator and its control apparatus and method
US20050166413A1 (en) * 2003-04-28 2005-08-04 Crampton Stephen J. CMM arm with exoskeleton
US20060178556A1 (en) 2001-06-29 2006-08-10 Intuitive Surgical, Inc. Articulate and swapable endoscope for a surgical robot
US20070135803A1 (en) * 2005-09-14 2007-06-14 Amir Belson Methods and apparatus for performing transluminal and other procedures
US20090326553A1 (en) 2008-06-27 2009-12-31 Intuitive Surgical, Inc. Medical robotic system providing an auxiliary view of articulatable instruments extending out of a distal end of an entry guide
WO2010055745A1 (ja) 2008-11-14 2010-05-20 オリンパスメディカルシステムズ株式会社 医療用システム
US20110245661A1 (en) 2009-10-09 2011-10-06 Olympus Medical Systems Corp. Medical device
US20110288573A1 (en) * 2008-02-14 2011-11-24 Ethicon Endo-Surgery, Inc. Robotically-controlled motorized surgical cutting and fastening instrument
US20110295270A1 (en) * 2007-01-10 2011-12-01 Ethicon Endo-Surgery, Inc. Surgical instrument with wireless communication between a control unit of a robotic system and remote sensor
US20110295269A1 (en) * 2008-09-23 2011-12-01 Ethicon Endo-Surgery, Inc. Robotically-controlled motorized surgical instrument
US20120078053A1 (en) 2009-05-29 2012-03-29 Soo Jay Louis Phee Robotic system for flexible endoscopy
CN102596064A (zh) 2009-11-13 2012-07-18 直观外科手术操作公司 弯曲套管和机器人操纵器
CN102711586A (zh) 2010-02-11 2012-10-03 直观外科手术操作公司 在机器人内窥镜的远侧尖端自动维持操作者选择的滚动取向的方法和系统
US20130079594A1 (en) 2011-09-22 2013-03-28 Olympus Corporation Industrial endoscope apparatus

Patent Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0576482A (ja) 1991-07-24 1993-03-30 Olympus Optical Co Ltd 処置装置
JPH05154782A (ja) 1991-12-04 1993-06-22 Toshiba Corp 遠隔操作装置
JP3339953B2 (ja) 1993-12-29 2002-10-28 オリンパス光学工業株式会社 医療用マスタースレーブ式マニピュレータ
JPH07328016A (ja) 1994-06-14 1995-12-19 Olympus Optical Co Ltd 手術用マニピュレータシステム
JPH08224248A (ja) 1995-02-23 1996-09-03 Olympus Optical Co Ltd 医療用マニピュレータ
US20030046401A1 (en) * 2000-10-16 2003-03-06 Abbott Kenneth H. Dynamically determing appropriate computer user interfaces
US20060178556A1 (en) 2001-06-29 2006-08-10 Intuitive Surgical, Inc. Articulate and swapable endoscope for a surgical robot
US20040243147A1 (en) 2001-07-03 2004-12-02 Lipow Kenneth I. Surgical robot and robotic controller
CN100389730C (zh) 2002-12-06 2008-05-28 直观外科手术公司 用于手术工具的柔性肘节
CN1728972A (zh) 2002-12-06 2006-02-01 直观外科手术公司 用于手术工具的柔性肘节
WO2004052171A2 (en) 2002-12-06 2004-06-24 Intuitive Surgical, Inc. Flexible wrist for surgical tool
US20040254680A1 (en) 2003-03-31 2004-12-16 Kabushiki Kaisha Toshiba Manipulator and its control apparatus and method
US20050166413A1 (en) * 2003-04-28 2005-08-04 Crampton Stephen J. CMM arm with exoskeleton
US20070135803A1 (en) * 2005-09-14 2007-06-14 Amir Belson Methods and apparatus for performing transluminal and other procedures
JP2007175502A (ja) 2005-12-27 2007-07-12 Intuitive Surgical Inc 外科手術用ロボットのための連接式で交換可能な内視鏡
US20110295270A1 (en) * 2007-01-10 2011-12-01 Ethicon Endo-Surgery, Inc. Surgical instrument with wireless communication between a control unit of a robotic system and remote sensor
US20110288573A1 (en) * 2008-02-14 2011-11-24 Ethicon Endo-Surgery, Inc. Robotically-controlled motorized surgical cutting and fastening instrument
US20090326553A1 (en) 2008-06-27 2009-12-31 Intuitive Surgical, Inc. Medical robotic system providing an auxiliary view of articulatable instruments extending out of a distal end of an entry guide
CN102076276A (zh) 2008-06-27 2011-05-25 直观外科手术操作公司 提供延伸到进入引导器远端外的可铰接器具的辅助视图的医疗机器人系统
US20110295269A1 (en) * 2008-09-23 2011-12-01 Ethicon Endo-Surgery, Inc. Robotically-controlled motorized surgical instrument
JP4608601B2 (ja) 2008-11-14 2011-01-12 オリンパスメディカルシステムズ株式会社 医療用システム
WO2010055745A1 (ja) 2008-11-14 2010-05-20 オリンパスメディカルシステムズ株式会社 医療用システム
CN102802551A (zh) 2009-05-29 2012-11-28 南洋理工大学 用于可曲式内窥镜术的机器人系统
US20120078053A1 (en) 2009-05-29 2012-03-29 Soo Jay Louis Phee Robotic system for flexible endoscopy
US20110245661A1 (en) 2009-10-09 2011-10-06 Olympus Medical Systems Corp. Medical device
CN102596064A (zh) 2009-11-13 2012-07-18 直观外科手术操作公司 弯曲套管和机器人操纵器
CN102711586A (zh) 2010-02-11 2012-10-03 直观外科手术操作公司 在机器人内窥镜的远侧尖端自动维持操作者选择的滚动取向的方法和系统
US20140200407A1 (en) 2010-02-11 2014-07-17 Intuitive Surgical Operations, Inc. Method and system for automatically maintaing an operator selected roll orieintation at a distal tip of a robotic endoscope
US20130079594A1 (en) 2011-09-22 2013-03-28 Olympus Corporation Industrial endoscope apparatus
JP2013066617A (ja) 2011-09-22 2013-04-18 Olympus Corp 内視鏡装置、映像表示方法およびプログラム

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Extended Supplementary European Search Report dated May 10, 2017 in European Patent Application No. 14 82 8871.5.
International Search Report dated Sep. 16, 2014 issued in PCT/JP2014/066012.

Also Published As

Publication number Publication date
CN105407826B (zh) 2019-02-22
WO2015012022A1 (ja) 2015-01-29
JP2015023884A (ja) 2015-02-05
EP3025670A1 (en) 2016-06-01
JP6173089B2 (ja) 2017-08-02
US20160135910A1 (en) 2016-05-19
CN105407826A (zh) 2016-03-16
EP3025670A4 (en) 2017-06-07

Similar Documents

Publication Publication Date Title
US9259283B2 (en) Medical master slave manipulator system
JP5908172B2 (ja) 手術支援システムおよび手術支援システムの制御方法
US9271797B2 (en) Robotic surgery
US12016522B2 (en) Medical safety control apparatus, medical safety control method, and medical support system
WO2017115425A1 (ja) 医療用マニピュレータシステム
WO2017145475A1 (ja) 医療用情報処理装置、情報処理方法、医療用情報処理システム
EP3020356A1 (en) Surgical assistance robot
US20140303437A1 (en) Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot
WO2017187795A1 (ja) 制御装置、制御方法及び手術システム
JP2009178416A (ja) 医療器具
EP3078317A1 (en) Method for controlling endoscope and endoscope system
WO2020095987A2 (en) Medical observation system, signal processing apparatus, and medical observation method
CN110461205A (zh) 手术成像系统、手术用图像处理设备以及用于控制成像过程的方法
US20220008156A1 (en) Surgical observation apparatus, surgical observation method, surgical light source device, and surgical light irradiation method
US10226308B2 (en) Method of controlling a medical master/slave system
WO2019181242A1 (ja) 内視鏡及びアームシステム
US20220322919A1 (en) Medical support arm and medical system
WO2020262262A1 (ja) 医療用観察システム、制御装置及び制御方法
US10251536B2 (en) Medical instrument, medical system, and mode transition method for medical instruments
JP5800609B2 (ja) 医療用マスタスレーブマニピュレータ
CN109498163B (zh) 主操作台及手术机器人
JP2006247291A (ja) 内視鏡装置および画像信号処理装置
JP2011235114A (ja) 画像信号処理装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HATTA, IZUMI;REEL/FRAME:037556/0887

Effective date: 20151219

AS Assignment

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: CHANGE OF ADDRESS;ASSIGNOR:OLYMPUS CORPORATION;REEL/FRAME:043077/0165

Effective date: 20160401

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4