WO2013005862A1 - Medical master slave manipulator - Google Patents

Medical master slave manipulator Download PDF

Info

Publication number
WO2013005862A1
WO2013005862A1 PCT/JP2012/067876 JP2012067876W WO2013005862A1 WO 2013005862 A1 WO2013005862 A1 WO 2013005862A1 JP 2012067876 W JP2012067876 W JP 2012067876W WO 2013005862 A1 WO2013005862 A1 WO 2013005862A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
master
video
slave manipulator
slave
Prior art date
Application number
PCT/JP2012/067876
Other languages
French (fr)
Inventor
Ryohei Ogawa
Kosuke Kishi
Original Assignee
Olympus Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2011150978A external-priority patent/JP5800610B2/en
Priority claimed from JP2011150977A external-priority patent/JP5800609B2/en
Application filed by Olympus Corporation filed Critical Olympus Corporation
Priority to CN201280030004.3A priority Critical patent/CN103607971B/en
Priority to EP12807156.0A priority patent/EP2729084A4/en
Publication of WO2013005862A1 publication Critical patent/WO2013005862A1/en
Priority to US14/146,187 priority patent/US9259283B2/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B34/37—Master-slave robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/372—Details of monitor hardware

Definitions

  • the present invention relates to a medical master slave manipulator including a master input device and a slave arm.
  • a medical robot system (a medical master slave manipulator) including a master input device and a slave arm has been proposed.
  • a control switch mechanism for selecting the slave arm to control an actuation is installed at the master input device.
  • a first slave arm is controlled by the master input device
  • a second slave arm is controlled by the master input device. Which of the first slave arm and the second slave arm is controlled is switched by a control switch mechanism.
  • control switch mechanism As the control switch mechanism, a voice command, a switch which is physically disposed, a foot pedal, icons or a graphic user interface selection means displayed on a display are taken.
  • a control switch mechanism is installed separately from the above-mentioned mechanism.
  • the control switch mechanism switches a mode for controlling an actuation by the master input device to an image capture mode for controlling a laparoscopic ultrasound (LUS) probe to acquire an auxiliary image, and an image operation mode for displaying and operating the auxiliary image on an original display image.
  • LMS laparoscopic ultrasound
  • auxiliary image such as an ultrasonography image or the like aquired by the LUS probe or the like is overlaid on an image of an endoscope or the like. Further, in the image operation mode, it is possible to allow the master input device to function as a pointing device.
  • Patent Document 1 Japanese Unexamined Patent Application Publication (Translation of PCT Application) No. 2009-512514
  • a moving direction of the slave arm in the displayed image may not coincide with a moving direction of the master arm in the master input device actually operated by the operator, and it may be difficult for the operator to intuitively perform the master input.
  • the displayed image is changed by the control switch mechanism, and the master input device is associated with the pointing device to operate the image information.
  • changing a control method of the slave manipulator in relation to the displayed image is not considered.
  • a medical master slave manipulator includes a master input unit configured to send an operation order; a slave manipulator operated by the master input unit; a control unit configured to transmit an operation signal to the slave manipulator based on the operation order; a display unit configured to display a video of a subject; and a video selection means configured to select the video displayed on the display unit, wherein the control unit performs conversion processing associated with the video selected by the video selection means with respect to the operation order.
  • a plurality of different videos of the subject may be displayed on the display unit, the video selection means may be configured such that an operator selects one video of the plurality of videos, and the control unit may perform conversion processing associated with the video selected by the operator via the video selection means with respect to the operation order.
  • the video selection means may include a detection unit configured to detect the video that a face of the operator is facing.
  • the video selection means may include an input means into which the video selected by the operator is input.
  • At least one of the plurality of videos may be generated through image processing of another video.
  • At least one of the plurality of videos may be generated through rotation processing of another video.
  • At least one of the plurality of videos may be generated through enlargement or reduction processing of another video.
  • the plurality of videos may be obtained by a plurality of different observation means, respectively.
  • the master input unit may include an operation unit
  • the slave manipulator may include a slave arm
  • the number of slave arms may be greater than the number of operation units, and in at least one of the conversion processings associated with the video
  • the medical master slave manipulator according to the eighth or ninth aspect of the present invention may include a plurality of the slave manipulators.
  • the medical master slave manipulator may further include an image processing unit configured to generate a first video signal according to the video of the subject and a second video signal in which image processing is performed on the first video signal, wherein one of the first video signal and the second video signal is displayed on the display unit, the video selection means includes a switch unit configured to switch the video signal displayed on the display unit, and when the switch unit switches the video signal displayed on the display unit, the control unit performs conversion processing associated with the video signal displayed on the display unit with respect to the operation order.
  • the master input unit may include an operation unit
  • the slave manipulator may include a slave arm
  • the number of slave arms is greater than the number of operation units
  • correspondence between the operation unit and the slave arm may be different from another conversion processing in conversion processing associated with the first video signal and conversion processing associated with the second video signal.
  • the medical master slave manipulator according to the eleventh aspect of the present invention may further include an observation means including a driving unit and configured to aquire the first video signal, wherein, as a predetermined update input is performed after driving the driving unit, contents of conversion processing associated with the first video signal and the first video signal are updated.
  • setting of the image processing may be updated such that substantially the same video as the video displayed on the display unit by the first video signal before being updated is displayed on the display unit.
  • the operator can intuitively operate the master input device to actuate the slave manipulator.
  • FIG. 1 A diagram showing a medical manipulator system to which a medical master slave manipulator according to a first embodiment of the present invention is applied.
  • FIG. 2 A functional block diagram of the medical master slave manipulator according to the first embodiment of the present invention.
  • FIG. 3 A flowchart showing a flow of actuations of the medical master slave manipulator according to the first embodiment of the present invention.
  • FIG. 4 A flowchart showing a determination routine in a determination unit of the medical master slave manipulator according to the first embodiment of the present invention.
  • FIG. 5 A diagram showing a medical manipulator system to which a medical master slave manipulator according to a second embodiment of the present invention is applied.
  • FIG. 6 A flowchart showing a flow of actuations of the medical master slave manipulator according to the second embodiment of the present invention.
  • FIG. 7 A diagram showing a medical manipulator system to which a medical master slave manipulator according to a third embodiment of the present invention is applied.
  • FIG. 8 A functional block diagram of the medical master slave manipulator according to the third embodiment of the present invention.
  • FIG. 9 A flowchart showing a flow of actuations of the medical master slave manipulator according to the third embodiment of the present invention.
  • FIG. 10 A diagram showing a master input unit of a medical master slave manipulator according to a fourth embodiment of the present invention.
  • FIG. 11 A functional block diagram of the medical master slave manipulator according to the fourth embodiment of the present invention.
  • FIG. 12 A flowchart showing a flow of actuations of the medical master slave manipulator according to the fourth embodiment of the present invention.
  • FIG. 13 A diargram showing a master input unit in a medical master slave manipulator of a variant according to the first to fourth embodiments of the present invention.
  • FIG. 14 A diagram showing a medical manipulator system to which a medical master slave manipulator according to a fifth embodiment of the present invention is applied.
  • FIG. 15 A functional block diagram of the medical master slave manipulator according to the fifth embodiment of the present invention.
  • FIG. 16 A flowchart showing a flow of actuations of the medical master slave manipulator according to the fifth embodiment of the present invention.
  • FIG. 17 A A diagram showing a master input unit in a medical master slave manipulator according to a sixth embodiment of the present invention.
  • FIG. 17B A diagram showing the master input unit in the medical master slave manipulator according to the sixth embodiment of the present invention.
  • FIG. 18 A flowchart showing a flow of actuations of the medical master slave manipulator according to the sixth embodiment of the present invention.
  • FIG. 19 A functional block diagram of a medical master slave manipulator according to a seventh embodiment of the present invention.
  • FIG. 20 A flowchart showing a flow of actuations when an initial video is updated in the medical master slave manipulator according to the seventh embodiment of the present invention.
  • FIG. 1 is a diagram showing a medical master slave manipulator (hereinafter, simply referred to as "a master slave manipulator") 1 of the present embodiment.
  • the master slave manipulator 1 includes a master input unit 2 having a master arm 21 and issuing an operation order, and a slave manipulator 3 having a slave arm 31.
  • the master slave manipulator 1 is a system that remotely controls the slave arm 31 so that the slave arm 31 follows an operation of the master arm 21 by an operator (surgeon) Op.
  • the operation order via the master arm 21 is transmitted to a master control unit 41 of a control unit 4, and input into a manipulator control unit 42 after conversion processing, which is to be described, according to the necessity is performed. Thereafter, an actuation signal is transmitted from the manipulator control unit 42 to the slave manipulator 3 to actuate the slave arm 31.
  • the slave manipulator 3 is installed at an operating table 100 on which a patient P is laid, and includes a plurality of slave arms 31.
  • Each of the slave arms includes a plurality of joints with multiple degrees of freedom, and is configured to enable multiaxial actuation.
  • Each of the joints with multiple degrees of freedom is individually driven by a power unit (not shown).
  • a power unit for example, a motor (a servo motor) or the like having a servo mechanism provided with an incremental encoder or a speed reducer can be employed.
  • An observation means such as an endoscope configured to acquire a video of an operative field including an area to be manipulated (a subject) is attached to one of the plurality of slave arms 31.
  • a treatment instrument (not shown) configured to perform various treatments is attached to another slave arm.
  • a well-known device can be appropriately selected and used as the observation means or the treatment instrument.
  • each of the slave arms also includes a plurality of power units (not shown) configured to drive the mounted treatment instrument or the like.
  • a servo motor for example, can also be used as the power unit.
  • the slave arm to which the treatment instrument is attached may be referred to as "a slave arm for treatment.”
  • the master input unit 2 includes a plurality of master arms 21 operated by the operator Op, and a display unit 22 on which a video obtained by the observation means is displayed.
  • Each of the master arms 21 includes a well-known configuration enabling multiaxial actuation.
  • Each of the master arms 21 includes a grip portion 21 A formed at its distal end side adjacent to the operator Op and functions as an operation unit gripped by the operator to send an operation order.
  • the display unit 22 includes a display 23 on which a video is displayed, and a detection unit (a video selection means) 24 attached to the display 23 and configured to detect a direction of the face of the operator.
  • the display 23 has two screens, a first screen 25 and a second screen 26.
  • a video of an operative field obtained by the observation means is displayed on the first screen 25.
  • a video of the operative field (hereinafter referred to as "a rotational operative field image") in which the video is rotated to a predetermined rotation angle (for example, 90 degrees) is displayed on the second screen 26.
  • a rotational operative field image in which the video is rotated to a predetermined rotation angle (for example, 90 degrees) is displayed on the second screen 26.
  • the two videos having an error corresponding to a parallax are projected to the screens 25 and 26.
  • the operator Op can three-dimensionally view the video of each of the screens 25 and 26 through a well-known 3D glasses 101 including a polarization mechanism or a shutter mechanism.
  • the detection unit 24 includes a first detection unit 24A installed at an upper side of the first screen 25, and a second detection unit 24B installed at an upper side of the second screen.
  • Each of the detection units 24A and 24B includes a light receiving element.
  • Each of the detection units 24A and 24B receives light emitted from a light emitting unit 102 attached to the 3D glasses 101 to detect the direction of the face of the operator Op.
  • a configuration of the detection unit is not limited to the
  • the detection unit may be configured not to use light reception and emission as a detection principle.
  • the detection unit may be configured to acquire, for example, an image of the face or an eyeball of the operator to detect a direction of a line of sight from the image.
  • FIG. 2 is a functional block diagram of the master slave manipulator 1.
  • An image processing unit 50 is installed between an observation means 32 and the display unit 22.
  • the image processing unit 50 is a well-known processing circuit or processing program.
  • a video signal transmitted from the observation means 32 is processed in the image processing unit 50 in a state in which the video can be displayed.
  • the processed signal is displayed on the first screen 25 of the display unit 22 via first conversion processing Prl, and displayed on the second screen 26 via second conversion processing Pr2.
  • the video acquired by the observation means 32 is displayed on the first screen 25 as it is, and the video in which the video acquired by the observation means 32 is rotated 90 degrees rightward is displayed on the second screen 26.
  • the second conversion processing Pr2 is processing of rotating the video 90 degrees rightward
  • the first conversion processing Prl is conversion processing, which is referred to as "non-conversion.”
  • the "non-conversion" is also defined as one of the conversion processings.
  • a switched image rotated by image processing maintains a 3D display that can be recognized by the operator after being switched. For example, while two images corresponding to binocular disparity are displayed on the same screen in the 3D display, the two images are re-converted to maintain the 3D display in consideration of the binocular disparity corresponding to a rotation amount upon the image processing, and are displayed on the display unit 22.
  • a determination unit 55 is installed between the detection unit 24 and the master control unit 41.
  • the determination unit 55 determines whether the face of the operator Op is facing any one of the screens 25 and 26 of the display 23 or not facing any one of the screens based on information transmitted from the detection unit 24, and transmits the determination result to the master control unit 41.
  • FIG. 3 is a flowchart showing a flow of actuations of the master slave
  • step S10 the operator Op inputs a rotation angle ⁇ (for example, 90 degrees rightward) of a rotational operative field image displayed on the second screen 26 into the image processing unit 50 via an interface (not shown) of the master input unit, and sets a conversion angle ⁇ to generate the video displayed on the second screen.
  • a rotation angle ⁇ for example, 90 degrees rightward
  • step S20 the image processing unit 50 performs the first image processing Prl with respect to the video signal and then, displays the video signal on the first screen 25. Further, simultaneously, the image processing unit 50 performs the second image processing Pr2 to the same video signal and then, displays the video signal on the second screen 26. Accordingly, in the video acquired by the observation means 32 being displayed on the first screen 25 as it is, and in the video in which the video acquired by the observation means 32 is rotated by a rotation angle ⁇ being displayed on the second screen 26, the video is displayed on the display unit 22. The processing and the display of the video by the image processing unit 50 are continued while the video signal is transmitted from the observation means 32.
  • the determination unit 55 determines again whether the face of the operator is facing any one screen of the display unit 22 or not facing any one, based on the information received from the detection unit 24.
  • FIG. 4 is a flowchart showing a determination routine of the determination unit 55.
  • step S 101 based on the information transmitted from the first detection unit 24 A, it is determined whether the face of the operator is facing the first screen 25 or not.
  • step SI 01 determines that the operator is facing the first screen 25, that is, the operator selects the video displayed on the first screen 25, and terminates the processing.
  • step SI 02 is performed.
  • step SI 02 based on the information transmitted from the second detection unit 24B, it is determined whether the operator is facing the second screen 26 or not.
  • the determination unit 55 determines that the face of the operator is facing the second screen 26, that is, the operator selects the video displayed on the second screen 26, and terminates the processing.
  • step SI 02 determination in step SI 02 is No, it is determined that the operator is not facing any one of the first screen 25 and the second screen 26, and the processing is terminated.
  • the determination unit 55 transmits that information to the image processing unit 50.
  • the image processing unit 50 in which the information is received displays a marker 103 (see FIG. 1) on the screen that it is determined that the operator is facing, and assists recognition of the operator.
  • the marker is not limited to the display on the screen, but an emission indicator such as an LED may be installed at an upper portion of the screen to assist recognition of the operator through lighting.
  • step S30 when the operator sends an operation order to the grip portion 21 A of the master input unit 2, in step S30, inquiry to the determination unit 55 about the screen that the operator Op is facing is performed from the master control unit 41 in which the input is received. Then, the information is transmitted from the determination unit 55 to the master control unit 41 based on determination contents of the determination unit 55 at that time.
  • the information including the determination contents based on the above-mentioned determination routine and conversion processing contents of the operation order by the master control unit 41 associated with the determination contents are transmitted from the determination unit 55.
  • step S31 it is verified whether the operator faces any one of the first screen 25 and the second screen 26 based on the information transmitted from the determination unit 55.
  • the processing goes to step S40.
  • the determination result is No, the processing goes to step S32.
  • step S32 the information showing that the operator is not facing any one of the first screen 25 and the second screen 26 is transmitted from the determination unit 55 to the image processing unit 50, and the processing of prompting the operator Op is performed. For example, information such as "Please face the screen,” “Please mount the 3D glasses,” or the like, is displayed on the display unit 22. Then, at this time, with respect to the operation order from the master input unit 2, the actuation of the slave manipulator 3 may be stopped. [0040]
  • step S40 whether a switch in setting of the master control unit 41 is needed or not is determined.
  • the master control unit 41 performs the conversion processing of the operation order corresponding to the first screen 25, when the information showing "the operator Op is facing the second screen 26" is transmitted from the determination unit 55, since the switch in setting of the master control unit 41 is needed, the determination result becomes Yes, and the processing goes to step S41.
  • step S41 the master control unit 41 performs initialization to match a position and an orientation of the grip portion 21 A of the master input unit 2 to a position and an orientation of a distal end of the slave arm 31 for treatment in the video displayed on the second screen 26 based on the information received from the determination unit 55.
  • the master control unit 41 calculates a difference between the position and orientation of the grip portion 21 A and the position and orientation of the distal end of the slave arm 31 for treatment in the second screen 26, and actuates a driving unit of the master input unit 2 such that the difference becomes zero, performing the initialization of the grip portion 21 A.
  • a message such as "Initialization is in process. Please keep hands away from the grip portion," or the like, is displayed on the display unit 22 to prompt the operator.
  • the "orientation" of the master arm and the slave arm means a direction of the distal end with respect to the predetermined area as a reference point.
  • position alignment and orientation alignment are well-known in the art, and a specific method thereof is not limited thereto.
  • step S42 the contents of the conversion processing of the operation order in the master control unit 41 are updated by the information from the determination unit 55. Accordingly, the master control unit 41 converts the operation order such that an actuation direction of the grip portion 21 A coincides with an actuation direction of the distal end of the slave arm 31 for treatment in the video selected by the operator Op.
  • step S43 the master control unit 41 transmits an actuation signal to the manipulator control unit 42 in which the conversion processing associated with the screen selected by the operator Op is performed with respect to the operation order. Then, the processing is terminated.
  • step S44 the master control unit 41 performs the conversion processing of the operation order with the setting at that time to transmit the actuation signal to the manipulator control unit 42. Then, the processing is terminated.
  • the master slave manipulator 1 of the present embodiment determines whether the face of the operator Op is facing any one of the screens 25 and 26 of the display unit 22 based on the information of the detection unit 24. Then, based on the determination result, the contents of the conversion processing are updated to perform the conversion processing associated with the video selected by the master control unit 41 with respect to the operation order such that the moving direction of the distal end of the slave arm 31 for treatment in the video selected by the operator Op is identical to the moving direction of the grip portion 21 A.
  • the position and orientation relation can also automatically be matched with the distal end of the slave arm 31 for treatment. Accordingly, the operator can more intuitively perform the operation.
  • the rotational operative field image displayed on the second screen 26 is generated by performing the image processing with respect to the video obtained by the observation means 32. For this reason, since the operator Op performs the manipulation at different points of view, there is no need to drive the observation means 32.
  • the operator can immediately switch the point of view of the operative field, and a series of manipulations can be smoothly performed. Furthermore, since interference with another slave arm due to driving of the observation means can be prevented, safety of the manipulation is improved.
  • the first screen 25 and the second screen 26 are displayed in parallel.
  • the operator Op can visually and approximately confirm the other screen with peripheral vision while looking at the one screen and performing the manipulation. Accordingly, the operator can perform a determination that the other confirmed screen is in a manipulator disposition from which it is easy to perform the manipulation during the manipulation, and when the operator is facing the other screen as needed, it is possible to smoothly switch the screen used for the manipulation, intuitively continue the
  • the operator may perform the initialization with manual operations.
  • the driving unit is not installed at the master input unit
  • a foot switch for switching On/Off of transmission of the operation order from the master input unit to the master control unit is installed.
  • a configuration in which the operator moves the grip portion to a desired position intended as an initial position while pushing the foot switch and pushes down again the foot switch to terminate the initialization may be provided.
  • the position and orientation of the grip portion may not be entirely matched with the position and orientation of the distal end of the slave arm.
  • the slave arm is operated based on a difference of a movement from the initial position and a priority of the initial position set by the operator, the operator can intuitively perform the operation at the setting in which the operator can most easily operate.
  • the master slave manipulator 61 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1 in that, when the screen, which is gazed, is switched, a corresponding relation between the master arm and the slave arm is switched.
  • same elements in the above description are designated by like reference numerals, and a description thereof will be omitted.
  • FIG. 5 is a diagram showing the master input unit 2 of the master slave manipulator 61.
  • three slave arms 62 A, 62B and 62C for treatment are installed at the slave manipulator 3.
  • the slave arms 62A and 62B are disposed at a position at which the operator Op can easily and intuitively perform the operation.
  • the slave arms 62B and 62C are disposed at a position at which the operator Op can easily and intuitively perform the operation.
  • Only two master arms are installed at the master input unit 2.
  • two slave arms for treatment which are easily and intuitively operated, are associated with the master arm. That is, correspondence relation between the master arm and the slave arm for treatment is varied according to the video displayed on each screen.
  • FIG. 6 is a flowchart showing a flow of actuations of a master slave manipulator 61.
  • step S 11 similar to the first embodiment, a conversion angle ⁇ for generating a second screen is set by the operator Op. Further, two slave arms for treatment operated by the master arm 21 are set to the first screen 25 and the second screen 26, respectively.
  • step S41 the initialization is performed such that the position and orientation between the distal ends of the two slave arms set in step S 11 and the grip portion 21 A of the master input unit are matched with each other.
  • step S42A correspondence relation between the master arm and the slave arm and contents of the conversion processing of the operation order are updated.
  • the contents of the conversion processing of the master control unit can be automatically updated, and the operator can intuitively operate the master arm while looking at the screen to operate the slave arm with no stress.
  • the optimal slave arm can be operated to perform the manipulation.
  • the conversion angle Oand the slave arm operated in each screen in step SI 1 a configuration in which the master control unit or the like automatically calculates a rotation angle, at which two slave arms having a different combination from the first screen are easily operated, to determine the conversion angle ⁇ , based on the positional relation between the observation means and each slave arm for treatment, may be provided.
  • the positional relation between the observation means and each slave arm for treatment may be calculated from the video acquired by the observation means, and may be calculated from the position information based on a value or the like of an encoder of the slave arm.
  • optimal correspondence between the slave arm and the master arm may be automatically calculated from the conversion angle ⁇ initially determined in step SI 1, on the basis of positional relation information between the observation means and the slave arm.
  • the positional relation between the observation means and each slave arm may be calculated from the video acquired by the observation means, and may be calculated from the position information based on the value of the encoder of the slave arm.
  • the correspondence between the slave arm and the master arm may be selected by the operator after step S40.
  • a selecting method can be
  • an input switch such as an interface or the like.
  • a third embodiment of the present invention will be described with reference to FIGS. 7 to 9.
  • a master slave manipulator 71 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1 in that a plurality of slave
  • manipulators are provided, and when the grazed screen is switched, the correspondence relation between the master arm and the slave manipulators is switched.
  • FIG. 7 is a diagram showing the entire configuration of the master slave manipulator 71.
  • the master slave manipulator 71 includes two slave manipulators designated by reference numerals 3A and 3B.
  • the master slave manipulator 71 can simultaneously perform manipulations with respect to two patients PI and P2.
  • the patients are not limited to two, but two slave manipulators can be disposed with respect to different diseased parts of one patient.
  • FIG. 8 is a functional block diagram of the master slave manipulator 71.
  • the slave manipulators 3A and 3B have observation means 32A and 32B, respectively.
  • a video acquired by the observation means 32A is displayed on the first screen 25.
  • a video acquired by the observation means 32B is displayed on the second screen 26.
  • a switch unit 72 is installed between the manipulator control unit 42 and the slave manipulators 3A and 3B.
  • the manipulator control unit 42 is selectively connected to one of the slave manipulators 3 A and 3B, and the operation signal from the manipulator control unit is transmitted to the connected slave manipulator.
  • FIG. 9 is a flowchart showing a flow of actuations of the master slave
  • step S20 videos acquired by the observation means are displayed on the first screen 25 and the second screen 26.
  • step S400 the master control unit 41 transmits an order to the switch unit 72, and switches the connection such that the slave manipulator, which is currently not connected, is connected to the manipulator control unit 42. Thereafter, the initialization of step S41 is performed.
  • the master slave manipulator 71 of the present embodiment As the operator Op is merely facing the screen more appropriate for the manipulation or operation to be performed, the contents of the conversion processing of the master control unit are automatically updated. As a result, the operator can intuitively operate the master arm while looking at the screen, and thus, can operate the slave arm of the switched slave manipulator with no stress.
  • the master slave manipulator 71 of the present embodiment includes the plurality of slave manipulators, and thus, manipulations can be appropriately performed with respect to a plurality of patients or diseased parts.
  • three or more slave manipulators may be provided.
  • a plurality of different videos of a object is a concept including the case in which the object is one and the case in which the object is plural.
  • the master slave manipulator 81 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1 in that a slave manipulator includes a plurality of observation means.
  • FIG. 10 is a diagram showing the master input unit 2 of the master slave manipulator 81.
  • FIG. 11 is a functional block diagram of the master slave manipulator 81.
  • a slave manipulator 82 includes three slave arms 82 A, 82B and 82C for treatment. The same video as the second embodiment is displayed on the first screen 25 and the second screen 26.
  • the slave manipulator includes two observation means, a first endoscope 83 and a second endoscope 84.
  • a video acquired by the first endoscope 83 is displayed on the first screen 25.
  • a video acquired by the second endoscope 84 is displayed on the second screen 26. Accordingly, the video displayed on the second screen 26 is not the video in which the image processing is performed on the video of the first screen.
  • FIG. 12 is a flowchart showing a flow of actuations of a master slave manipulator 81.
  • the master slave manipulator 81 in step SUA, only two slave arms operated by the master arm are set in the first screen 25 and the second screen 26, without setting a rotation angle ⁇ .
  • the contents of the conversion processing in step S42A are
  • the conversion processing contents of the master control unit are automatically updated.
  • the operator can intuitively operate the master arm while looking at the screen and thus operate the slave arm with no stress.
  • the master slave manipulator 81 of the present embodiment includes two observation means, the first endoscope 83 and the second endoscope 84, various operative field images other than the rotational operative field image can be displayed on the second screen 26.
  • the video acquired in one direction in which the tissue is manipulated is displayed on the first screen 25, and the video acquired in a direction opposite to the one direction in which the same tissue is manipulated is displayed on the second screen, so that each sequence of the manipulation can be performed at an appropriate angle while switching the screen used in the manipulation.
  • the example in which the three slave arms for treatment are installed has been described.
  • the number of slave arms for treatment may be two or fewer or may be four or more, and presence or absence of correspondence relation switching between the master arm and the slave arm for treatment in step S42A may be set according to the number.
  • the example in which the two observation means are installed has been described.
  • a configuration in which one observation means including a plurality of observation units is used and a video acquired by each observation unit is displayed on a display unit may be provided.
  • the endoscopes of the observation means may not have the same structure.
  • one endoscope may be a direct vision type endoscope and the other endoscope may be a lateral vision type endoscope.
  • FIG. 14 is a diagram showing a medical manipulator system to which a medical master slave manipulator (hereinafter, simply referred to as "a master slave manipulator") 1001 of the present embodiment is applied.
  • the master slave manipulator 1001 includes a master input unit 1002 having a master arm 1021 and issuing an operation order, and a slave manipulator 1003 having a slave arm 1031.
  • the master slave manipulator 1001 is a system for remotely controlling the slave arm 1031 to follow an operation of the master arm 1021 by an operator (surgeon) Op.
  • the operation order via the master arm 1021 is transmitted to a master control unit 1041 of a control unit 1004 and input into a
  • manipulator control unit 1042 after conversion processing (described later) is performed according to the necessity. Thereafter, an actuation signal is transmitted from the manipulator control unit 1042 to the slave manipulator 1003 to actuate the slave arm 1031.
  • the slave manipulator 1003 includes a plurality of slave arms 1031, and is installed at an operating table 1100 on which the patient P is laid.
  • Each of the slave arms has a plurality of joints with multiple degrees of freedom, and is configured to enable a multi-axis actuation.
  • Each of the joints with multiple degrees of freedom is individually driven by a power unit (not shown).
  • a power unit for example, a motor (a servo motor) having a servo mechanism provided with an incremental encoder, a speed reducer or the like can be used.
  • An observation means such as an endoscope for acquiring a video of an operative field including an area to be manipulated (a subject) is attached to one of the plurality of slave arms 1031.
  • a treatment instrument (not shown) for performing various treatments is attached to another slave arm.
  • the observation means or the treatment instrument may be a well-known device appropriately selected and used.
  • the slave arms include a plurality of power units (not shown) for driving the mounted treatment instruments or the like.
  • a servo motor for example, can also be employed as the power unit.
  • the slave arm to which the treatment instrument is attached may be referred to as "a slave arm for treatment.”
  • the master input unit 1002 includes a plurality of master arms 1021 operated by the operator Op, and a display unit 1022 on which the video acquired by the
  • Each of the master arms 1021 includes a well-known structure to enable multiaxial actuation.
  • Each of the master arms 1021 includes a grip portion (an operation unit) 1021 A disposed at a distal end thereof near the operator Op and gripped by the operator.
  • FIG. 15 is a functional block diagram of the master slave manipulator 1001.
  • the display unit 1022 includes a display 1023 on which a video is displayed, and a switch unit (a video selection means) 1024 configured to switch the video displayed on the display 1023.
  • a video of an operative field acquired by the observation means is displayed on the display 1023.
  • two videos having deviation corresponding to a parallax error are projected on the display 1023.
  • the operator Op can be any one of the videos having deviation corresponding to a parallax error.
  • 3D glasses 1101 including a polarization mechanism, a shutter mechanism or the like.
  • the switch unit 1024 selectively connects the video signal transmitted f om an image processing unit (described later) to the display 1023 to display the predetermined video on the display 1023.
  • the switch unit 1024 is actuated as the operator Op steps on the foot switch 1025 shown in FIG. 14.
  • the input mechanism for actuating the switch unit 1024 is not particularly limited, but various switches can be appropriately selected and used.
  • An image processing unit 1050 is installed between an observation means 1032 and a display unit 1022.
  • the image processing unit 1050 is a well-known processing circuit or processing program.
  • the video signal transmitted from the observation means 1032 is processed in a state in which the video can be displayed in the image processing unit 1050, and then a video signal is generated.
  • the processed video signal is displayed on the display 1023 of the display unit 1022.
  • An input conversion switch unit 1055 is installed between the foot switch 1025 and the master control unit 1041.
  • the input conversion switch unit 1055 transmits the conversion processing contents to the master control unit 1041 such that the slave arm 1031 displayed on the display 1023 is intuitively operated by the master arm 1021 based on the information transmitted from the foot switch 1025.
  • FIG. 16 is a flowchart showing a flow of actuations of the master slave manipulator 1001.
  • step SI 010 the operator Op sets conditions of the video intended to be displayed when the foot switch 1025 is pushed down.
  • a video (a switched video) in which a video (an initial video) of the operative field acquired by the observation means is rotated 90 degrees rightward is displayed.
  • the operator Op inputs the rotation angle ⁇ (90 degrees rightward) into the master input unit 1002 via an interface (not shown) to set generation conditions of the switched video.
  • the input generation conditions of the switched video are transmitted to the image processing unit 1050 and the input conversion switch unit 1055.
  • the contents of the conversion processing (hereinafter referred to "switch conversion processing") are automatically calculated to match the moving direction of the master arm with the moving direction of the slave arm upon display of the switched video, and temporarily stored in a storage unit such as ROM or RAM.
  • the image processing unit 1050 When the video signal is transmitted from the observation means 1032, in step SI 020, the image processing unit 1050 performs processing for displaying the initial video with respect to the video signal to generate an initial video signal (a first video signal), and displays the signal on the display 1023 as it is. Simultaneously, image processing in response to the generation conditions input with respect to the initial video signal in step S 1010 is performed, and a switched video signal (a second video signal) for displaying the switched video is generated. That is, while the image processing unit 1050 normally generates the initial video signal and the switched video signal, at first, only the initial video is displayed on the display 1023 by the setting of the switch unit 1024.
  • the operator operates the master arm 1021 while looking at the video displayed on the display 1023.
  • the operation order to the master arm 1021 is transmitted to the manipulator control unit 1042, in which a predetermined initial conversion is performed in the master control unit 1041, and transmitted to the slave manipulator 1003 to actuate the slave arm 1031.
  • the master control unit 1041 continues the processing of the operation order by the initial conversion until the foot switch 1025 is pushed down.
  • step SI 031 the switch unit 1024 changes the setting such that the switched video signal generated at the image processing unit 1050 is transmitted to the display 1023. Then, the switched image is displayed on the display 1023.
  • the signal of the foot switch 1025 is also transmitted to the input conversion switch unit 1055. Accordingly, in step S1032, the input conversion switch unit 1055 transmits temporarily stored switch conversion processing to the master control unit 1041.
  • the master control unit 1041 in which the information is received from the input conversion switch unit 1055 performs, in step SI 040, initialization to match a position and an orientation of a grip portion 1021 A of the master input unit 1002 with a position and an orientation of a distal end of the slave arm 1031 for treatment displayed in the switched video.
  • the master control unit 1041 calculates a difference between the position and orientation of the grip portion 1021 A and the position and orientation of the distal end of the slave arm 1031 for treatment in the switched video, and actuates the driving unit of the master input unit 1002 such that the difference becomes zero, performing the initialization of the grip portion 1021 A.
  • a message such as "Initialization is in process. Please keep hands away from the grip portion," and so on, may be displayed on the display unit 1022 to prompt the operator.
  • the "position" of the master arm and slave arm is a three-dimensional position represented by an XYZ coordinate system of a predetermined area (for example, the grip portion 1021 A and the fdistal end of the treatment instrument, and so on) of the master arm and the slave arm.
  • the "orientation" of the master arm and the slave arm means a direction of the distal end with respect to the predetermined area as a reference point.
  • the position and orientation matching is a conventional technique, and a specific method thereof is not limited to the above.
  • step SI 041 the contents of the conversion processing of the operation order in the master control unit 1041 are updated to the switch conversion processing received from the input conversion switch unit 1055. Accordingly, the master control unit 1041 converts the operation order such that an actuation direction of the grip portion 1021 A coincides with an actuation direction of the distal end of the slave arm 1031 for treatment in the switched video selected by the operator Op.
  • step SI 042 the master control unit 1041 transmits the actuation signal to the manipulator control unit 1042 in which the conversion processing related to the screen selected by the operator Op is performed with respect to the operation order. Then, the processing is terminated.
  • the video of the display 1023 is switched to the initial video. Then, after the initialization of the master arm 1021, the conversion processing of the master control unit 1041 is updated to the initial conversion.
  • the master slave manipulator 1001 of the present embodiment when the operator Op pushes down the foot switch 1025, the video of the display 1023 is switched by the switch unit 1024 to the switched video of the condition previously set by the operator Op. Further, the contents of the conversion processing of the master control unit 1041 are updated to perform the switch conversion processing related to the switched video such that a moving direction of the distal end of the slave arm 1031 for treatment in the switched video is equal to a moving direction of the grip portion 1021 A.
  • the contents of the conversion processing of the master control unit can be automatically adjusted, and the operator can intuitively operate the grip portion while looking at the desired video, and thus intuitively operating the slave manipulator with no stress.
  • the switched video is generated by performing the image processing on the video acquired by the observation means 1032. For this reason, it is not necessary for the operator Op to drive the observation means 1032 to perform the manipulation at different view points. Accordingly, a time lag generated according to the switching of the view point is removed, and the operator can smoothly perform a series of
  • the operator may perform the initialization with manual operations. For example, without installing the driving unit at the master input unit 1002, a switch for switching On/Off of transmission of the operation order from the master input unit to the master control unit is installed. Then, a configuration in which the operator moves the grip portion 1021 A to a desired position intended as the initial position while pushing the switch and pushes down the foot switch 1025 once more to complete the initialization may be provided. In this case, the position and orientation of the grip portion may not completely match the position and orientation of the distal end of the slave arm. However, since the slave arm is operated based on a difference value of a movement from the initial position with a priority of the initial position set by the operator, the operator can intuitively perform the operation at the setting in which the operator can most easily operate.
  • the image processing which becomes the generation conditions of the switched video, is not limited to the above-mentioned rotation processing but may be enlargement processing, reduction processing or the like.
  • the intuitive operation can be continuously performed.
  • information of the motion scale ratio may be included in the switch conversion processing.
  • a plurality of image processings may be combined to set the generation conditions of the switched video.
  • switched videos may be set.
  • the initial video and each switched video may be sequentially switched by pushing the foot switch 1025.
  • the switched video may be generated and displayed on the display 1023 when the foot switch 1025 is pushed down.
  • the switched image in which the rotation processing is performed according to the image processing maintains the 3D display so that the operator can visually confirm the image after the switching.
  • the 3D display while two images corresponding to binocular disparity are displayed on the same screen, in consideration of the binocular disparity corresponding to the rotation amount upon the image processing, the two images are re-converted to maintain the 3D display, and are displayed on a display device.
  • the master slave manipulator 1061 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1001 in that correspondence relation between the master arm and the slave arm is switched when the video of the display unit is switched.
  • same elements in the above description are designated by same reference numerals, and a description thereof will not be repeated here.
  • FIGS. 17A and 17B are diagrams showing the master input unit 1002 of the master slave manipulator 1061. As shown in the display 1023, three slave arms 1062A, 1062B and 1062C for treatment are installed at the slave manipulator 1003.
  • the slave arms 1062A and 1062B are disposed at a position at which the intuitive operation is easily performed by the operator Op.
  • the switched video in which the initial video is rotated 90 degrees rightward is displayed on the display 1023, as shown in FIG. 17B, the slave arms 1062B and 1062C are disposed at a position at which the intuitive operation is easily performed by the operator Op.
  • the two slave arms for treatment and the two master arms which are easily and intuitively operated, are related to each other in the initial video and the switched video, respectively. That is, according to the video displayed on the display 1023 of the display unit 1022, correspondence relation between the master arms and the slave arms for treatment is varied.
  • FIG. 18 is a flowchart showing a flow of actuations of the master slave manipulator 1061.
  • step S 101 OA similar to the sixth embodiment, a conversion angle ⁇ which is the generation conditions of the switched video is set.
  • two slave arms for treatment operated by the master arm 1021 are set by the operator Op in the initial video and the switched video, respectively.
  • step SI 040 the initialization is performed such that the positions and orientations between the distal ends of the two slave arms and the grip portions set in step S 101 OA are matched.
  • step S 1041 A correspondence relation between the master arm and the slave arm and the contents of the conversion processing of the operation order are updated.
  • the slave arm can be optimally operated to perform the manipulation.
  • the master control unit or the like may automatically calculate a rotation angle at which the two slave arms differently combined than the first screen are easily operated, based on the positional relation between the observation means and each of the slave arms for treatment, and determine a conversion angle ⁇ .
  • the positional relation between the observation means and each of the slave arms for treatment may be calculated from the initial video and the switched video acquired by the observation means, and may be calculated from the position information based on a value or the like of the encoder of the slave arm.
  • the optimal correspondence between the slave arm and the master arm may be automatically calculated from the conversion angle ⁇ determined in step SI 01 OA based on the positional relation information between the observation means and the slave arm.
  • the positional relation between the observation means and each of the slave arms may be calculated from the video acquired by the observation means, and may be calculated from the position information based on a value or the like of the encoder of the slave arm.
  • the correspondence between the slave arm and the master arm may be selected again by the operator after the switched video is displayed in step S 1031.
  • An alternative method may be performed by an input switch such as an interface or the like.
  • the master slave manipulator 1071 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1001 in that the switched video is generated based on an initial video before the driving when the observation means is driven.
  • FIG. 19 is a functional block diagram of the master slave manipulator 1071.
  • the overall configuration of the master slave manipulator 1071 is basically similar to that of the master slave manipulator 1001 of the fifth embodiment.
  • An observation means 1072 of the master slave manipulator 1071 includes a driving unit 1073. Then, as the driving unit 1073 is driven, a field of vision of the acquired video can be rotated.
  • the observation means 1072 also includes a rotation amount detection unit 1074 constituted by a rotary encoder, and so on. Then, a rotation angle of the observation means 1072 according to the driving of the driving unit 1073 can be detected.
  • the signal of the foot switch 1025 is also transmitted to the image processing unit 1050, in addition to the switch unit 1024 and the input conversion switch unit 1055.
  • the operation not according to the driving of the observation means 1072 is basically similar to the fifth embodiment.
  • the operator Op drives the driving unit 1073 by the operation order from the master arm 1021 or the like, rotates the observation means 1072, and searches for the video that becomes an appropriate operative field, updating the initial video.
  • FIG. 20 is a flowchart showing a flow of updating the initial video.
  • the observation means 1072 is rotated, and search for an appropriate video as an operative field is performed.
  • step SI 052 the operator Op performs a predetermined update input in which the foot switch 1025 is combined with the operation of another input means.
  • step S1053 the image processing unit 1050, in which the updated input is received, updates the setting thereof such that the video acquired by the observation means 1072 becomes the initial video upon reception of the updated input.
  • step SI 054 the input conversion switch unit 1055 calculates the contents of the input conversion processing corresponding to the initial video after the update to transmit the contents to the master control unit 1041.
  • the master control unit 1041 updates the contents of the initial conversion such that the contents of the received input conversion processing become the initial conversion.
  • step SI 055 the image processing unit 1050 updates the generation conditions such that a difference of a rotation angle of the initial video before and after the update becomes the generation conditions of the switched video, based on the information of the rotation amount detection unit 1074. After that, the image processing is performed with respect to the signal of the initial video after the update, and a signal that can display substantially the same video as the initial video before the update is generated as a signal of the switched video.
  • step S1056 the input conversion switch unit 1055 calculates the conversion processing corresponding to the switched video after the update, and temporarily stores the conversion processing as the switch conversion processing to the storage unit.
  • the initialization of the master arm 1021 is performed to correspond to the initial video after the update. Then, a series of processings are terminated.
  • steps SI 053 to SI 056 are not particularly limited but may be appropriately varied. Further, these steps may be performed after step SI 057.
  • Configurations other than those described above are basically same as the fifth embodiment. That is, when the operator Op pushes down the foot switch 1025, the switched video having the same angle as the initial video before the update, which is generated by performing the image processing on the initial video after the update, is displayed on the display. Then, the switch conversion processing corresponding to the switched video is transmitted to the master control unit 1041 to be applied thereto.
  • the observation means 1072 is driven, when the foot switch 1025 is pushed down without performing the predetermined operation, the observation means 1072 is stopped, and the setting of the initial video is updated such that the video having the same angle as the initial video which is generated by performing the image processing on the video acquired by the observation means 1072 becomes the initial video.
  • the initial video most frequently used in the manipulation can be appropriately updated to the desired video.
  • the image processing unit 1050 and the input conversion switch unit 1055 are automatically set such that the initial video before the update becomes the switched video. For this reason, as only the foot switch 1025 is operated, the switched video easily returns to substantially the same video as the initial video before the update.
  • a predetermined operation may be performed after an enlargement reduction operation in which an observation optical system is driven. For example, if the predetermined operation is performed when the video becomes n times the initial video, the n-times video is updated to the initial video and the image processing is performed on the updated initial video so that the video reduced to 1/n times becomes the switched video. In this way, a plurality of appropriate magnifications are set while driving the observation optical system, and the video with the plurality of magnifications can be appropriately switched, and manipulation is performed.
  • the manipulation can be performed on the video in a previous state more than the state before the latest driving, and the manipulation can be more appropriately performed as a plurality of videos are used.
  • the image processing is not limited to the above-mentioned rotation processing.
  • the video in which the enlargement processing is performed on the video of the first screen 25 may be displayed on the second screen 26.
  • the intuitive operation can be performed as the motion scale ratio between the master arm and the slave arm is varied.
  • the motion scale ratio may be varied. Accordingly, when the manipulation is performed while looking at any one of the screens, a relation between the movement amount of the master arm and the movement of the slave arm may not be varied.
  • the reduction processing may be performed, rather than the enlargement processing.
  • the operation unit may not include the master arm.
  • a position and an orientation of the operation unit or the operator's hands may be acquired by a motion sensor such as a camera or a position sensor.
  • the detection unit detects which one of the screens the face of the operator faces, and the contents of the initialization or the conversion processing are updated based on the screen.
  • the detection unit may be configured to detect whether the face of the operator is facing any one of the screens based on the position or orientation of the operator.
  • the screen on which the video selected by the operator to perform the manipulation is displayed may be input by an input means such as a switch or the like.
  • the conversion processing 8 contents are automatically updated based on the video selected by the operator, and the video is intentionally or unintentionally selected in the former case and intentionally selected in the latter case.
  • the input means is not limited to the foot switch but may be installed at any place.
  • a screen of a display having one screen may be divided into two display regions, which function as a first screen and a second screen.
  • a head mount display may be used.
  • two or more screens may be installed to display different operative field images on the respective screens.
  • the configuration of the display of the display unit may be variously modified.
  • the head mount display may be used.
  • the display having two or more screens or display regions may be used.
  • some of the plurality of switched videos can be previously displayed on the display as the next candidate (and an n candidate). For this reason, the switching of the image can be more smoothly performed.
  • the switched video of the next candidate can be substantially confirmed with the eye at the peripheral field of vision, and thus, it is more preferable.
  • an environment for pseudo driving of the observation means can be made to.
  • eleven sheets of switched videos are set at a rotation angle of 30 degrees and the videos are configured to be sequentially displayed by an input mechanism such as a rotation knob or the like, it is possible to perform the video adjustment as if the observation means is rotated in real time. Since the switched video is generated by the image processing, even when the switched image is enlarged within a certain range, the entire load applied to the master slave manipulator is hardly increased. Further, in the above-mentioned fifth to seventh embodiments of the present embodiment, even when the observation means cannot be rotated 360 degrees due to restriction of the mechanism, the angle of the video can be adjusted regardless of the restriction.
  • the operator can intuitively operate the master input device to actuate the slave manipulator.
  • switch unit video selection means

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Robotics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Manipulator (AREA)
  • Endoscopes (AREA)

Abstract

A medical master slave manipulator (1) includes a master input unit (2) configured to send an operation order, a slave manipulator (3) operated by the master input unit, a control unit (4) configured to transmit an operation signal to the slave manipulator based on the operation order, a display unit (22) configured to display a subject, and a video selection means configured to select the video displayed on the display unit (22), wherein the control unit performs conversion processing associated with the video selected by the video selection means with respect to the operation order.

Description

DESCRIPTION
Title of the Invention
MEDICAL MASTER SLAVE MANIPULATOR
[Technical Field]
[0001]
The present invention relates to a medical master slave manipulator including a master input device and a slave arm.
Priority is claimed on Japanese Patent Application No. 2011-150977, filed on July 7, 2011 , and Japanese Patent Application 2011 - 150978 filed on July 7, 2011 , the disclosures of which are incorporated by reference herein.
[Background Art]
[0002]
In medical fields, a medical robot system (a medical master slave manipulator) including a master input device and a slave arm has been proposed. In a medical robot system disclosed in Patent Document 1, a control switch mechanism for selecting the slave arm to control an actuation is installed at the master input device. In a first mode, a first slave arm is controlled by the master input device, and in a second mode, a second slave arm is controlled by the master input device. Which of the first slave arm and the second slave arm is controlled is switched by a control switch mechanism.
As the control switch mechanism, a voice command, a switch which is physically disposed, a foot pedal, icons or a graphic user interface selection means displayed on a display are taken.
[0003]
In addition, in the medical robot system of Patent Document 1, a control switch mechanism is installed separately from the above-mentioned mechanism. The control switch mechanism switches a mode for controlling an actuation by the master input device to an image capture mode for controlling a laparoscopic ultrasound (LUS) probe to acquire an auxiliary image, and an image operation mode for displaying and operating the auxiliary image on an original display image.
In the image operation mode, another auxiliary image such as an ultrasonography image or the like aquired by the LUS probe or the like is overlaid on an image of an endoscope or the like. Further, in the image operation mode, it is possible to allow the master input device to function as a pointing device.
[Prior Art Document]
[Patent Document]
[0004]
[Patent Document 1] Japanese Unexamined Patent Application Publication (Translation of PCT Application) No. 2009-512514
[Disclosure of Invention]
[Problems to be Solved by Invention]
[0005]
When medical treatments or the like are performed via a master slave manipulator, an image of an area to be treated is obtained by an endoscope or the like attached to the slave arm, and an operator performs the treatments while looking at the image displayed on a display. At this time, a moving direction of the slave arm in the displayed image may not coincide with a moving direction of the master arm in the master input device actually operated by the operator, and it may be difficult for the operator to intuitively perform the master input.
[0006]
In the medical robot system of Patent Document 1 , the displayed image is changed by the control switch mechanism, and the master input device is associated with the pointing device to operate the image information. However, changing a control method of the slave manipulator in relation to the displayed image is not considered.
[0007] In consideration of the above-mentioned circumstances, it is an object of the present invention to provide a medical master slave manipulator capable of allowing an operator to intuitively operate a master input device to actuate a slave manipulator.
[Means for Solving the Problems]
[0008]
According to a first aspect of the present invention, a medical master slave manipulator includes a master input unit configured to send an operation order; a slave manipulator operated by the master input unit; a control unit configured to transmit an operation signal to the slave manipulator based on the operation order; a display unit configured to display a video of a subject; and a video selection means configured to select the video displayed on the display unit, wherein the control unit performs conversion processing associated with the video selected by the video selection means with respect to the operation order.
[0009]
According to a second aspect of the present invention, in the medical master slave manipulator according to the first aspect of the present invention, a plurality of different videos of the subject may be displayed on the display unit, the video selection means may be configured such that an operator selects one video of the plurality of videos, and the control unit may perform conversion processing associated with the video selected by the operator via the video selection means with respect to the operation order.
[0010]
According to a third aspect of the present invention, in the medical master slave manipulator according to the second aspect of the present invention, the video selection means may include a detection unit configured to detect the video that a face of the operator is facing.
[0011]
According to a fourth aspect of the present invention, in the medical master slave manipulator according to the second aspect of the present invention, the video selection means may include an input means into which the video selected by the operator is input. [0012]
According to a fifth aspect of the present invention, in the medical master slave manipulator according to any one of the second to fourth aspects of the present invention, at least one of the plurality of videos may be generated through image processing of another video.
[0013]
According to a sixth aspect of the present invention, in the medical master slave manipulator according to the fifth aspect of the present invention, at least one of the plurality of videos may be generated through rotation processing of another video.
[0014]
According to a seventh aspect of the present invention, in the medical master slave manipulator according to the fifth aspect of the present invention, at least one of the plurality of videos may be generated through enlargement or reduction processing of another video.
[0015]
According to an eighth aspect of the present invention, in the medical master slave manipulator according to any one of the second to fourth aspects of the present invention, the plurality of videos may be obtained by a plurality of different observation means, respectively.
[0016]
According to a ninth aspect of the present invention, in the medical master slave manipulator according to any one of the second to eighth aspects of the present invention, the master input unit may include an operation unit, the slave manipulator may include a slave arm, the number of slave arms may be greater than the number of operation units, and in at least one of the conversion processings associated with the video,
correspondence between the operation unit and the slave arm may be different from another conversion processing.
[0017] According to a tenth aspect of the present invention, the medical master slave manipulator according to the eighth or ninth aspect of the present invention may include a plurality of the slave manipulators.
[0018]
According to an eleventh aspect of the present invention, in the medical master slave manipulator according to the first aspect of the present invention, the medical master slave manipulator may further include an image processing unit configured to generate a first video signal according to the video of the subject and a second video signal in which image processing is performed on the first video signal, wherein one of the first video signal and the second video signal is displayed on the display unit, the video selection means includes a switch unit configured to switch the video signal displayed on the display unit, and when the switch unit switches the video signal displayed on the display unit, the control unit performs conversion processing associated with the video signal displayed on the display unit with respect to the operation order.
[0019]
According to a twelfth aspect of the present invention, in the medical master slave manipulator according to the eleventh aspect of the present invention, the master input unit may include an operation unit, the slave manipulator may include a slave arm, the number of slave arms is greater than the number of operation units, and
correspondence between the operation unit and the slave arm may be different from another conversion processing in conversion processing associated with the first video signal and conversion processing associated with the second video signal.
[0020]
According to a thirteenth aspect of the present invention, the medical master slave manipulator according to the eleventh aspect of the present invention may further include an observation means including a driving unit and configured to aquire the first video signal, wherein, as a predetermined update input is performed after driving the driving unit, contents of conversion processing associated with the first video signal and the first video signal are updated. [0021]
According to a fourteenth aspect of the present invention, in the medical master slave manipulator according to the thirteenth aspect of the present invention, when the first video signal is updated, setting of the image processing may be updated such that substantially the same video as the video displayed on the display unit by the first video signal before being updated is displayed on the display unit.
[Effect of Invention]
[0022]
According to the above-mentioned medical master slave manipulator, the operator can intuitively operate the master input device to actuate the slave manipulator. [Brief Description of Drawings]
[0023]
[FIG. 1] A diagram showing a medical manipulator system to which a medical master slave manipulator according to a first embodiment of the present invention is applied.
[FIG. 2] A functional block diagram of the medical master slave manipulator according to the first embodiment of the present invention.
[FIG. 3] A flowchart showing a flow of actuations of the medical master slave manipulator according to the first embodiment of the present invention.
[FIG. 4] A flowchart showing a determination routine in a determination unit of the medical master slave manipulator according to the first embodiment of the present invention.
[FIG. 5] A diagram showing a medical manipulator system to which a medical master slave manipulator according to a second embodiment of the present invention is applied.
[FIG. 6] A flowchart showing a flow of actuations of the medical master slave manipulator according to the second embodiment of the present invention. [FIG. 7] A diagram showing a medical manipulator system to which a medical master slave manipulator according to a third embodiment of the present invention is applied.
[FIG. 8] A functional block diagram of the medical master slave manipulator according to the third embodiment of the present invention.
[FIG. 9] A flowchart showing a flow of actuations of the medical master slave manipulator according to the third embodiment of the present invention.
[FIG. 10] A diagram showing a master input unit of a medical master slave manipulator according to a fourth embodiment of the present invention.
[FIG. 11] A functional block diagram of the medical master slave manipulator according to the fourth embodiment of the present invention.
[FIG. 12] A flowchart showing a flow of actuations of the medical master slave manipulator according to the fourth embodiment of the present invention.
[FIG. 13] A diargram showing a master input unit in a medical master slave manipulator of a variant according to the first to fourth embodiments of the present invention.
[FIG. 14] A diagram showing a medical manipulator system to which a medical master slave manipulator according to a fifth embodiment of the present invention is applied.
[FIG. 15] A functional block diagram of the medical master slave manipulator according to the fifth embodiment of the present invention.
[FIG. 16] A flowchart showing a flow of actuations of the medical master slave manipulator according to the fifth embodiment of the present invention.
[FIG. 17 A] A diagram showing a master input unit in a medical master slave manipulator according to a sixth embodiment of the present invention.
[FIG. 17B] A diagram showing the master input unit in the medical master slave manipulator according to the sixth embodiment of the present invention.
[FIG. 18] A flowchart showing a flow of actuations of the medical master slave manipulator according to the sixth embodiment of the present invention. [FIG. 19] A functional block diagram of a medical master slave manipulator according to a seventh embodiment of the present invention.
[FIG. 20] A flowchart showing a flow of actuations when an initial video is updated in the medical master slave manipulator according to the seventh embodiment of the present invention.
[Best Mode for Carrying out the Invention]
[0024]
Hereinafter, a first embodiment of the present invention will be described. FIG. 1 is a diagram showing a medical master slave manipulator (hereinafter, simply referred to as "a master slave manipulator") 1 of the present embodiment. The master slave manipulator 1 includes a master input unit 2 having a master arm 21 and issuing an operation order, and a slave manipulator 3 having a slave arm 31. The master slave manipulator 1 is a system that remotely controls the slave arm 31 so that the slave arm 31 follows an operation of the master arm 21 by an operator (surgeon) Op. The operation order via the master arm 21 is transmitted to a master control unit 41 of a control unit 4, and input into a manipulator control unit 42 after conversion processing, which is to be described, according to the necessity is performed. Thereafter, an actuation signal is transmitted from the manipulator control unit 42 to the slave manipulator 3 to actuate the slave arm 31.
[0025]
As shown in FIG. 1, the slave manipulator 3 is installed at an operating table 100 on which a patient P is laid, and includes a plurality of slave arms 31. Each of the slave arms includes a plurality of joints with multiple degrees of freedom, and is configured to enable multiaxial actuation. Each of the joints with multiple degrees of freedom is individually driven by a power unit (not shown). As the power unit,, for example, a motor (a servo motor) or the like having a servo mechanism provided with an incremental encoder or a speed reducer can be employed.
[0026] An observation means (not shown) such as an endoscope configured to acquire a video of an operative field including an area to be manipulated (a subject) is attached to one of the plurality of slave arms 31. A treatment instrument (not shown) configured to perform various treatments is attached to another slave arm. A well-known device can be appropriately selected and used as the observation means or the treatment instrument. In addition, each of the slave arms also includes a plurality of power units (not shown) configured to drive the mounted treatment instrument or the like. A servo motor, for example, can also be used as the power unit. In addition, in the following description, among the slave arms, the slave arm to which the treatment instrument is attached may be referred to as "a slave arm for treatment."
[0027]
The master input unit 2 includes a plurality of master arms 21 operated by the operator Op, and a display unit 22 on which a video obtained by the observation means is displayed. Each of the master arms 21 includes a well-known configuration enabling multiaxial actuation. Each of the master arms 21 includes a grip portion 21 A formed at its distal end side adjacent to the operator Op and functions as an operation unit gripped by the operator to send an operation order.
[0028]
The display unit 22 includes a display 23 on which a video is displayed, and a detection unit (a video selection means) 24 attached to the display 23 and configured to detect a direction of the face of the operator.
The display 23 has two screens, a first screen 25 and a second screen 26. A video of an operative field obtained by the observation means is displayed on the first screen 25. A video of the operative field (hereinafter referred to as "a rotational operative field image") in which the video is rotated to a predetermined rotation angle (for example, 90 degrees) is displayed on the second screen 26. In the present embodiment, the two videos having an error corresponding to a parallax are projected to the screens 25 and 26. The operator Op can three-dimensionally view the video of each of the screens 25 and 26 through a well-known 3D glasses 101 including a polarization mechanism or a shutter mechanism.
[0029]
The detection unit 24 includes a first detection unit 24A installed at an upper side of the first screen 25, and a second detection unit 24B installed at an upper side of the second screen. Each of the detection units 24A and 24B includes a light receiving element. Each of the detection units 24A and 24B receives light emitted from a light emitting unit 102 attached to the 3D glasses 101 to detect the direction of the face of the operator Op.
In addition, a configuration of the detection unit is not limited to the
above-mentioned configuration but various well-known mechanisms can be appropriately selected and employed. The detection unit may be configured not to use light reception and emission as a detection principle. The detection unit may be configured to acquire, for example, an image of the face or an eyeball of the operator to detect a direction of a line of sight from the image.
[0030]
FIG. 2 is a functional block diagram of the master slave manipulator 1. An image processing unit 50 is installed between an observation means 32 and the display unit 22. The image processing unit 50 is a well-known processing circuit or processing program. A video signal transmitted from the observation means 32 is processed in the image processing unit 50 in a state in which the video can be displayed. The processed signal is displayed on the first screen 25 of the display unit 22 via first conversion processing Prl, and displayed on the second screen 26 via second conversion processing Pr2. In the present embodiment, the video acquired by the observation means 32 is displayed on the first screen 25 as it is, and the video in which the video acquired by the observation means 32 is rotated 90 degrees rightward is displayed on the second screen 26. That is, the second conversion processing Pr2 is processing of rotating the video 90 degrees rightward, and the first conversion processing Prl is conversion processing, which is referred to as "non-conversion." In the present embodiment, the "non-conversion" is also defined as one of the conversion processings.
In addition, a switched image rotated by image processing maintains a 3D display that can be recognized by the operator after being switched. For example, while two images corresponding to binocular disparity are displayed on the same screen in the 3D display, the two images are re-converted to maintain the 3D display in consideration of the binocular disparity corresponding to a rotation amount upon the image processing, and are displayed on the display unit 22.
[0031]
A determination unit 55 is installed between the detection unit 24 and the master control unit 41. The determination unit 55 determines whether the face of the operator Op is facing any one of the screens 25 and 26 of the display 23 or not facing any one of the screens based on information transmitted from the detection unit 24, and transmits the determination result to the master control unit 41.
[0032]
The actuation of the master slave manipulator 1 configured as described above will be described.
FIG. 3 is a flowchart showing a flow of actuations of the master slave
manipulator 1.
First, in step S10, the operator Op inputs a rotation angle Θ (for example, 90 degrees rightward) of a rotational operative field image displayed on the second screen 26 into the image processing unit 50 via an interface (not shown) of the master input unit, and sets a conversion angle Θ to generate the video displayed on the second screen.
[0033]
When the video signal is transmitted from the observation means 32, in step S20, the image processing unit 50 performs the first image processing Prl with respect to the video signal and then, displays the video signal on the first screen 25. Further, simultaneously, the image processing unit 50 performs the second image processing Pr2 to the same video signal and then, displays the video signal on the second screen 26. Accordingly, in the video acquired by the observation means 32 being displayed on the first screen 25 as it is, and in the video in which the video acquired by the observation means 32 is rotated by a rotation angle Θ being displayed on the second screen 26, the video is displayed on the display unit 22. The processing and the display of the video by the image processing unit 50 are continued while the video signal is transmitted from the observation means 32.
[0034]
During the actuation of the master slave manipulator 1, the determination unit 55 determines again whether the face of the operator is facing any one screen of the display unit 22 or not facing any one, based on the information received from the detection unit 24.
[0035]
FIG. 4 is a flowchart showing a determination routine of the determination unit 55. In step S 101 , based on the information transmitted from the first detection unit 24 A, it is determined whether the face of the operator is facing the first screen 25 or not.
When the determination in step SI 01 is Yes, the determination unit 55 determines that the operator is facing the first screen 25, that is, the operator selects the video displayed on the first screen 25, and terminates the processing. When the determination in step S101 is No, step SI 02 is performed.
[0036]
In step SI 02, based on the information transmitted from the second detection unit 24B, it is determined whether the operator is facing the second screen 26 or not. When the determination in step SI 02 is Yes, the determination unit 55 determines that the face of the operator is facing the second screen 26, that is, the operator selects the video displayed on the second screen 26, and terminates the processing. When the
determination in step SI 02 is No, it is determined that the operator is not facing any one of the first screen 25 and the second screen 26, and the processing is terminated.
[0037] In addition, when it is determined that the operator is facing any one of the first screen 25 and the second screen 26, the determination unit 55 transmits that information to the image processing unit 50. The image processing unit 50 in which the information is received displays a marker 103 (see FIG. 1) on the screen that it is determined that the operator is facing, and assists recognition of the operator. Here, the marker is not limited to the display on the screen, but an emission indicator such as an LED may be installed at an upper portion of the screen to assist recognition of the operator through lighting.
[0038]
Returning to FIG. 3, when the operator sends an operation order to the grip portion 21 A of the master input unit 2, in step S30, inquiry to the determination unit 55 about the screen that the operator Op is facing is performed from the master control unit 41 in which the input is received. Then, the information is transmitted from the determination unit 55 to the master control unit 41 based on determination contents of the determination unit 55 at that time. Here, the information including the determination contents based on the above-mentioned determination routine and conversion processing contents of the operation order by the master control unit 41 associated with the determination contents are transmitted from the determination unit 55.
[0039]
Next, in step S31 , it is verified whether the operator faces any one of the first screen 25 and the second screen 26 based on the information transmitted from the determination unit 55. When the determination result is Yes, the processing goes to step S40. When the determination result is No, the processing goes to step S32.
In step S32, the information showing that the operator is not facing any one of the first screen 25 and the second screen 26 is transmitted from the determination unit 55 to the image processing unit 50, and the processing of prompting the operator Op is performed. For example, information such as "Please face the screen," "Please mount the 3D glasses," or the like, is displayed on the display unit 22. Then, at this time, with respect to the operation order from the master input unit 2, the actuation of the slave manipulator 3 may be stopped. [0040]
In step S40, whether a switch in setting of the master control unit 41 is needed or not is determined.
For example, while the master control unit 41 performs the conversion processing of the operation order corresponding to the first screen 25, when the information showing "the operator Op is facing the second screen 26" is transmitted from the determination unit 55, since the switch in setting of the master control unit 41 is needed, the determination result becomes Yes, and the processing goes to step S41.
[0041]
In step S41, the master control unit 41 performs initialization to match a position and an orientation of the grip portion 21 A of the master input unit 2 to a position and an orientation of a distal end of the slave arm 31 for treatment in the video displayed on the second screen 26 based on the information received from the determination unit 55. The master control unit 41 calculates a difference between the position and orientation of the grip portion 21 A and the position and orientation of the distal end of the slave arm 31 for treatment in the second screen 26, and actuates a driving unit of the master input unit 2 such that the difference becomes zero, performing the initialization of the grip portion 21 A. At this time, a message such as "Initialization is in process. Please keep hands away from the grip portion," or the like, is displayed on the display unit 22 to prompt the operator.
In addition, the "positions" of the master arm and the slave arm are
three-dimensional positions represented in an XYZ coordinate system of predetermined areas of the master arm and the slave arm (for example, the grip portion 21 A, a distal end of the treatment instrument, and so on). The "orientation" of the master arm and the slave arm means a direction of the distal end with respect to the predetermined area as a reference point. In addition, in the master slave manipulator, position alignment and orientation alignment are well-known in the art, and a specific method thereof is not limited thereto.
[0042] Next, in step S42, the contents of the conversion processing of the operation order in the master control unit 41 are updated by the information from the determination unit 55. Accordingly, the master control unit 41 converts the operation order such that an actuation direction of the grip portion 21 A coincides with an actuation direction of the distal end of the slave arm 31 for treatment in the video selected by the operator Op.
After the conversion processing contents are updated, in step S43, the master control unit 41 transmits an actuation signal to the manipulator control unit 42 in which the conversion processing associated with the screen selected by the operator Op is performed with respect to the operation order. Then, the processing is terminated.
[0043]
When the information of the determination unit 55 coincides with the setting of the master control unit 41, the determination result becomes No, and the processing goes to step S44. In step S44, the master control unit 41 performs the conversion processing of the operation order with the setting at that time to transmit the actuation signal to the manipulator control unit 42. Then, the processing is terminated.
[0044]
According to the master slave manipulator 1 of the present embodiment, whetherthe face of the operator Op is facing any one of the screens 25 and 26 of the display unit 22 is determined by the determination unit 55 based on the information of the detection unit 24. Then, based on the determination result, the contents of the conversion processing are updated to perform the conversion processing associated with the video selected by the master control unit 41 with respect to the operation order such that the moving direction of the distal end of the slave arm 31 for treatment in the video selected by the operator Op is identical to the moving direction of the grip portion 21 A.
Accordingly, as the operator is merely facing the screen appropriate for the manipulation or operation to be performed, the contents of the conversion processing of the master control unit are automatically adjusted. As a result, the operator can intuitively operate the grip portion while looking at the screen, and intuitively operate the slave manipulator with no stress. [0045]
In addition, when the contents of the conversion processing of the master control unit 41 are updated, the initialization of the position and orientation of the grip portion 21 A is performed. For this reason, as well as the actuation direction of the grip portion 21 A, the position and orientation relation can also automatically be matched with the distal end of the slave arm 31 for treatment. Accordingly, the operator can more intuitively perform the operation.
[0046]
Further, the rotational operative field image displayed on the second screen 26 is generated by performing the image processing with respect to the video obtained by the observation means 32. For this reason, since the operator Op performs the manipulation at different points of view, there is no need to drive the observation means 32.
Accordingly, the operator can immediately switch the point of view of the operative field, and a series of manipulations can be smoothly performed. Furthermore, since interference with another slave arm due to driving of the observation means can be prevented, safety of the manipulation is improved.
[0047]
In addition, the first screen 25 and the second screen 26 are displayed in parallel. For this reason, the operator Op can visually and approximately confirm the other screen with peripheral vision while looking at the one screen and performing the manipulation. Accordingly, the operator can perform a determination that the other confirmed screen is in a manipulator disposition from which it is easy to perform the manipulation during the manipulation, and when the operator is facing the other screen as needed, it is possible to smoothly switch the screen used for the manipulation, intuitively continue the
manipulation regardless of a coordinate displacement after the switching.
[0048]
In the present embodiment, while an example in which the master control unit 41 drives the master input unit 2 to perform the initialization has been described, instead of this, the operator may perform the initialization with manual operations. For example, the driving unit is not installed at the master input unit, a foot switch for switching On/Off of transmission of the operation order from the master input unit to the master control unit is installed. Then, a configuration in which the operator moves the grip portion to a desired position intended as an initial position while pushing the foot switch and pushes down again the foot switch to terminate the initialization may be provided. In this case, the position and orientation of the grip portion may not be entirely matched with the position and orientation of the distal end of the slave arm. However, since the slave arm is operated based on a difference of a movement from the initial position and a priority of the initial position set by the operator, the operator can intuitively perform the operation at the setting in which the operator can most easily operate.
[0049]
A second embodiment of the present invention will be described with reference to FIGS. 5 and 6. The master slave manipulator 61 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1 in that, when the screen, which is gazed, is switched, a corresponding relation between the master arm and the slave arm is switched. In addition, in the following description, same elements in the above description are designated by like reference numerals, and a description thereof will be omitted.
[0050]
FIG. 5 is a diagram showing the master input unit 2 of the master slave manipulator 61. As shown in the display 23, three slave arms 62 A, 62B and 62C for treatment are installed at the slave manipulator 3. On the first screen 25, the slave arms 62A and 62B are disposed at a position at which the operator Op can easily and intuitively perform the operation. On the second screen 26 rotated 90 degrees rightward, the slave arms 62B and 62C are disposed at a position at which the operator Op can easily and intuitively perform the operation. Only two master arms are installed at the master input unit 2. For this reason, in the present embodiment, in each screen, two slave arms for treatment, which are easily and intuitively operated, are associated with the master arm. That is, correspondence relation between the master arm and the slave arm for treatment is varied according to the video displayed on each screen.
[0051]
FIG. 6 is a flowchart showing a flow of actuations of a master slave manipulator 61. In step S 11 , similar to the first embodiment, a conversion angle Θ for generating a second screen is set by the operator Op. Further, two slave arms for treatment operated by the master arm 21 are set to the first screen 25 and the second screen 26, respectively.
Thereafter, in step S41, the initialization is performed such that the position and orientation between the distal ends of the two slave arms set in step S 11 and the grip portion 21 A of the master input unit are matched with each other. Next, in step S42A, correspondence relation between the master arm and the slave arm and contents of the conversion processing of the operation order are updated.
Configurations other than those described above are basically same as the first embodiment.
[0052]
Even in the master slave manipulator 61 of the embodiment, as the operator is merely facing the screen more appropriate for the manipulation or operation to be performed, the contents of the conversion processing of the master control unit can be automatically updated, and the operator can intuitively operate the master arm while looking at the screen to operate the slave arm with no stress.
Further, since the correspondence between the master arm and the slave arm are automatically updated, in each screen, the optimal slave arm can be operated to perform the manipulation.
[0053]
In the embodiment, an example in which three slave arms for treatment are installed has been described. However, two slave arms for treatment may be installed. In addition, four or more slave arms for treatment may be installed. Further, instead of setting the conversion angle Oand the slave arm operated in each screen in step SI 1, a configuration in which the master control unit or the like automatically calculates a rotation angle, at which two slave arms having a different combination from the first screen are easily operated, to determine the conversion angle Θ, based on the positional relation between the observation means and each slave arm for treatment, may be provided. Here, the positional relation between the observation means and each slave arm for treatment may be calculated from the video acquired by the observation means, and may be calculated from the position information based on a value or the like of an encoder of the slave arm.
In addition, optimal correspondence between the slave arm and the master arm may be automatically calculated from the conversion angle Θ initially determined in step SI 1, on the basis of positional relation information between the observation means and the slave arm. Even in this case, similar to the above, the positional relation between the observation means and each slave arm may be calculated from the video acquired by the observation means, and may be calculated from the position information based on the value of the encoder of the slave arm.
As an another method, the correspondence between the slave arm and the master arm may be selected by the operator after step S40. A selecting method can be
performed by an input switch such as an interface or the like.
[0054]
A third embodiment of the present invention will be described with reference to FIGS. 7 to 9. A master slave manipulator 71 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1 in that a plurality of slave
manipulators are provided, and when the grazed screen is switched, the correspondence relation between the master arm and the slave manipulators is switched.
[0055]
FIG. 7 is a diagram showing the entire configuration of the master slave manipulator 71. The master slave manipulator 71 includes two slave manipulators designated by reference numerals 3A and 3B. The master slave manipulator 71 can simultaneously perform manipulations with respect to two patients PI and P2. In addition, the patients are not limited to two, but two slave manipulators can be disposed with respect to different diseased parts of one patient.
[0056]
FIG. 8 is a functional block diagram of the master slave manipulator 71. The slave manipulators 3A and 3B have observation means 32A and 32B, respectively. A video acquired by the observation means 32A is displayed on the first screen 25. A video acquired by the observation means 32B is displayed on the second screen 26.
A switch unit 72 is installed between the manipulator control unit 42 and the slave manipulators 3A and 3B. The manipulator control unit 42 is selectively connected to one of the slave manipulators 3 A and 3B, and the operation signal from the manipulator control unit is transmitted to the connected slave manipulator.
[0057]
FIG. 9 is a flowchart showing a flow of actuations of the master slave
manipulator 71. In the master slave manipulator 71, a step of setting a rotation angle Θ is not performed. When the observation means 32A and 32B arrive at areas at which the manipulations are performed in the body of the patient, in step S20, videos acquired by the observation means are displayed on the first screen 25 and the second screen 26.
[0058]
When the determination result of step S40 is Yes, in step S400, the master control unit 41 transmits an order to the switch unit 72, and switches the connection such that the slave manipulator, which is currently not connected, is connected to the manipulator control unit 42. Thereafter, the initialization of step S41 is performed.
Configurations other than those described above are basically same as the first embodiment.
[0059]
Even in the master slave manipulator 71 of the present embodiment, as the operator Op is merely facing the screen more appropriate for the manipulation or operation to be performed, the contents of the conversion processing of the master control unit are automatically updated. As a result, the operator can intuitively operate the master arm while looking at the screen, and thus, can operate the slave arm of the switched slave manipulator with no stress.
In addition, the master slave manipulator 71 of the present embodiment includes the plurality of slave manipulators, and thus, manipulations can be appropriately performed with respect to a plurality of patients or diseased parts.
In the present embodiment, three or more slave manipulators may be provided.
As will be apparent from the description of the first embodiment and the third embodiment, in the present invention, "a plurality of different videos of a object" is a concept including the case in which the object is one and the case in which the object is plural.
[0060]
A fourth embodiment of the present invention will be described with reference to FIGS. 10 and 11. The master slave manipulator 81 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1 in that a slave manipulator includes a plurality of observation means.
[0061]
FIG. 10 is a diagram showing the master input unit 2 of the master slave manipulator 81. FIG. 11 is a functional block diagram of the master slave manipulator 81. A slave manipulator 82 includes three slave arms 82 A, 82B and 82C for treatment. The same video as the second embodiment is displayed on the first screen 25 and the second screen 26.
However, the slave manipulator includes two observation means, a first endoscope 83 and a second endoscope 84. A video acquired by the first endoscope 83 is displayed on the first screen 25. A video acquired by the second endoscope 84 is displayed on the second screen 26. Accordingly, the video displayed on the second screen 26 is not the video in which the image processing is performed on the video of the first screen.
[0062] FIG. 12 is a flowchart showing a flow of actuations of a master slave manipulator 81. In the master slave manipulator 81 , in step SUA, only two slave arms operated by the master arm are set in the first screen 25 and the second screen 26, without setting a rotation angle Θ. The contents of the conversion processing in step S42A are
automatically calculated based on the positional relation and the like, between the first endoscope 83 and the second endoscope 84.
Configurations other than those described above are basically same as the second embodiment.
[0063]
Even in the master slave manipulator 81 of the present embodiment, as the operator Op is merely facing the screen more appropriate for the manipulation or operation to be performed, the conversion processing contents of the master control unit are automatically updated. As a result, the operator can intuitively operate the master arm while looking at the screen and thus operate the slave arm with no stress.
[0064]
In addition, since the master slave manipulator 81 of the present embodiment includes two observation means, the first endoscope 83 and the second endoscope 84, various operative field images other than the rotational operative field image can be displayed on the second screen 26. For example, the video acquired in one direction in which the tissue is manipulated is displayed on the first screen 25, and the video acquired in a direction opposite to the one direction in which the same tissue is manipulated is displayed on the second screen, so that each sequence of the manipulation can be performed at an appropriate angle while switching the screen used in the manipulation.
[0065]
In the above-mentioned example, the example in which the three slave arms for treatment are installed has been described. However, in the present embodiment, the number of slave arms for treatment may be two or fewer or may be four or more, and presence or absence of correspondence relation switching between the master arm and the slave arm for treatment in step S42A may be set according to the number. In addition, in the above-mentioned example, the example in which the two observation means are installed has been described. However, instead of that configuration, a configuration in which one observation means including a plurality of observation units is used and a video acquired by each observation unit is displayed on a display unit may be provided. In addition, the endoscopes of the observation means may not have the same structure. For example, one endoscope may be a direct vision type endoscope and the other endoscope may be a lateral vision type endoscope.
[0066]
A fifth embodiment of the present invention will be described. FIG. 14 is a diagram showing a medical manipulator system to which a medical master slave manipulator (hereinafter, simply referred to as "a master slave manipulator") 1001 of the present embodiment is applied. The master slave manipulator 1001 includes a master input unit 1002 having a master arm 1021 and issuing an operation order, and a slave manipulator 1003 having a slave arm 1031. The master slave manipulator 1001 is a system for remotely controlling the slave arm 1031 to follow an operation of the master arm 1021 by an operator (surgeon) Op. The operation order via the master arm 1021 is transmitted to a master control unit 1041 of a control unit 1004 and input into a
manipulator control unit 1042 after conversion processing (described later) is performed according to the necessity. Thereafter, an actuation signal is transmitted from the manipulator control unit 1042 to the slave manipulator 1003 to actuate the slave arm 1031.
[0067]
As shown in FIG. 14, the slave manipulator 1003 includes a plurality of slave arms 1031, and is installed at an operating table 1100 on which the patient P is laid.
Each of the slave arms has a plurality of joints with multiple degrees of freedom, and is configured to enable a multi-axis actuation. Each of the joints with multiple degrees of freedom is individually driven by a power unit (not shown). As the power unit, for example, a motor (a servo motor) having a servo mechanism provided with an incremental encoder, a speed reducer or the like can be used.
[0068] An observation means (not shown) such as an endoscope for acquiring a video of an operative field including an area to be manipulated (a subject) is attached to one of the plurality of slave arms 1031. A treatment instrument (not shown) for performing various treatments is attached to another slave arm. The observation means or the treatment instrument may be a well-known device appropriately selected and used. In addition, the slave arms include a plurality of power units (not shown) for driving the mounted treatment instruments or the like. A servo motor, for example, can also be employed as the power unit. In addition, in the following description, among the slave arms, the slave arm to which the treatment instrument is attached may be referred to as "a slave arm for treatment."
[0069]
The master input unit 1002 includes a plurality of master arms 1021 operated by the operator Op, and a display unit 1022 on which the video acquired by the
above-mentioned observation means is displayed. Each of the master arms 1021 includes a well-known structure to enable multiaxial actuation. Each of the master arms 1021 includes a grip portion (an operation unit) 1021 A disposed at a distal end thereof near the operator Op and gripped by the operator.
[0070]
FIG. 15 is a functional block diagram of the master slave manipulator 1001. As shown in FIGS. 14 and 15, the display unit 1022 includes a display 1023 on which a video is displayed, and a switch unit (a video selection means) 1024 configured to switch the video displayed on the display 1023.
A video of an operative field acquired by the observation means is displayed on the display 1023. In the present embodiment, two videos having deviation corresponding to a parallax error are projected on the display 1023. The operator Op can
three-dimensionally look at the video of the display 1023 through a well-known 3D glasses 1101 including a polarization mechanism, a shutter mechanism or the like.
[0071] The switch unit 1024 selectively connects the video signal transmitted f om an image processing unit (described later) to the display 1023 to display the predetermined video on the display 1023. In the present embodiment, the switch unit 1024 is actuated as the operator Op steps on the foot switch 1025 shown in FIG. 14. However, the input mechanism for actuating the switch unit 1024 is not particularly limited, but various switches can be appropriately selected and used.
[0072]
An image processing unit 1050 is installed between an observation means 1032 and a display unit 1022. The image processing unit 1050 is a well-known processing circuit or processing program. The video signal transmitted from the observation means 1032 is processed in a state in which the video can be displayed in the image processing unit 1050, and then a video signal is generated. The processed video signal is displayed on the display 1023 of the display unit 1022.
[0073]
An input conversion switch unit 1055 is installed between the foot switch 1025 and the master control unit 1041. The input conversion switch unit 1055 transmits the conversion processing contents to the master control unit 1041 such that the slave arm 1031 displayed on the display 1023 is intuitively operated by the master arm 1021 based on the information transmitted from the foot switch 1025.
[0074]
An actuation of the master slave manipulator 1001 configured as described above will be described.
FIG. 16 is a flowchart showing a flow of actuations of the master slave manipulator 1001.
First, in step SI 010, the operator Op sets conditions of the video intended to be displayed when the foot switch 1025 is pushed down. Here, as an example, a video (a switched video) in which a video (an initial video) of the operative field acquired by the observation means is rotated 90 degrees rightward is displayed. In this case, the operator Op inputs the rotation angle Θ (90 degrees rightward) into the master input unit 1002 via an interface (not shown) to set generation conditions of the switched video.
The input generation conditions of the switched video are transmitted to the image processing unit 1050 and the input conversion switch unit 1055. According to the above, in the input conversion switch unit 1055, based on the generation conditions, the contents of the conversion processing (hereinafter referred to "switch conversion processing") are automatically calculated to match the moving direction of the master arm with the moving direction of the slave arm upon display of the switched video, and temporarily stored in a storage unit such as ROM or RAM.
[0075]
When the video signal is transmitted from the observation means 1032, in step SI 020, the image processing unit 1050 performs processing for displaying the initial video with respect to the video signal to generate an initial video signal (a first video signal), and displays the signal on the display 1023 as it is. Simultaneously, image processing in response to the generation conditions input with respect to the initial video signal in step S 1010 is performed, and a switched video signal (a second video signal) for displaying the switched video is generated. That is, while the image processing unit 1050 normally generates the initial video signal and the switched video signal, at first, only the initial video is displayed on the display 1023 by the setting of the switch unit 1024.
The operator operates the master arm 1021 while looking at the video displayed on the display 1023. The operation order to the master arm 1021 is transmitted to the manipulator control unit 1042, in which a predetermined initial conversion is performed in the master control unit 1041, and transmitted to the slave manipulator 1003 to actuate the slave arm 1031. The master control unit 1041 continues the processing of the operation order by the initial conversion until the foot switch 1025 is pushed down.
[0076]
When the operator Op performs the manipulation while looking at the switched video, the operator Op pushes down the foot switch 1025 in step S1030. Then, in step SI 031, the switch unit 1024 changes the setting such that the switched video signal generated at the image processing unit 1050 is transmitted to the display 1023. Then, the switched image is displayed on the display 1023.
[0077]
The signal of the foot switch 1025 is also transmitted to the input conversion switch unit 1055. Accordingly, in step S1032, the input conversion switch unit 1055 transmits temporarily stored switch conversion processing to the master control unit 1041.
The master control unit 1041 in which the information is received from the input conversion switch unit 1055 performs, in step SI 040, initialization to match a position and an orientation of a grip portion 1021 A of the master input unit 1002 with a position and an orientation of a distal end of the slave arm 1031 for treatment displayed in the switched video. The master control unit 1041 calculates a difference between the position and orientation of the grip portion 1021 A and the position and orientation of the distal end of the slave arm 1031 for treatment in the switched video, and actuates the driving unit of the master input unit 1002 such that the difference becomes zero, performing the initialization of the grip portion 1021 A. At this time, a message such as "Initialization is in process. Please keep hands away from the grip portion," and so on, may be displayed on the display unit 1022 to prompt the operator.
In addition, the "position" of the master arm and slave arm is a three-dimensional position represented by an XYZ coordinate system of a predetermined area (for example, the grip portion 1021 A and the fdistal end of the treatment instrument, and so on) of the master arm and the slave arm. The "orientation" of the master arm and the slave arm means a direction of the distal end with respect to the predetermined area as a reference point. In addition, in the master slave manipulator, the position and orientation matching is a conventional technique, and a specific method thereof is not limited to the above.
[0078]
Next, in step SI 041, the contents of the conversion processing of the operation order in the master control unit 1041 are updated to the switch conversion processing received from the input conversion switch unit 1055. Accordingly, the master control unit 1041 converts the operation order such that an actuation direction of the grip portion 1021 A coincides with an actuation direction of the distal end of the slave arm 1031 for treatment in the switched video selected by the operator Op. After the conversion processing contents are updated, in step SI 042, the master control unit 1041 transmits the actuation signal to the manipulator control unit 1042 in which the conversion processing related to the screen selected by the operator Op is performed with respect to the operation order. Then, the processing is terminated.
In addition, when the operator Op pushes down the foot switch 1025 once more, the video of the display 1023 is switched to the initial video. Then, after the initialization of the master arm 1021, the conversion processing of the master control unit 1041 is updated to the initial conversion.
[0079]
According to the master slave manipulator 1001 of the present embodiment, when the operator Op pushes down the foot switch 1025, the video of the display 1023 is switched by the switch unit 1024 to the switched video of the condition previously set by the operator Op. Further, the contents of the conversion processing of the master control unit 1041 are updated to perform the switch conversion processing related to the switched video such that a moving direction of the distal end of the slave arm 1031 for treatment in the switched video is equal to a moving direction of the grip portion 1021 A.
Accordingly, as the operator merely switches the video displayed on the display 1023 using the foot switch 1025, the contents of the conversion processing of the master control unit can be automatically adjusted, and the operator can intuitively operate the grip portion while looking at the desired video, and thus intuitively operating the slave manipulator with no stress.
[0080]
In addition, upon switching of the video, the initialization of the position and orientation of the grip portion 1021 A is performed. For this reason, in addition to the actuation direction of the grip portion 1021 A, a relation of the position and orientation of the grip portion 1021 A is also automatically matched with the distal end of the slave arm 1031 for treatment. Accordingly, the operator can intuitively perform the operation. [0081]
Further, the switched video is generated by performing the image processing on the video acquired by the observation means 1032. For this reason, it is not necessary for the operator Op to drive the observation means 1032 to perform the manipulation at different view points. Accordingly, a time lag generated according to the switching of the view point is removed, and the operator can smoothly perform a series of
manipulations. In addition, since interference with another slave arm can be prevented by the driving of the observation means, safety of the manipulation is improved.
[0082]
In the present embodiment, while an example in which the master control unit 1041 drives the master input unit 1002 to perform the initialization has been described, the operator may perform the initialization with manual operations. For example, without installing the driving unit at the master input unit 1002, a switch for switching On/Off of transmission of the operation order from the master input unit to the master control unit is installed. Then, a configuration in which the operator moves the grip portion 1021 A to a desired position intended as the initial position while pushing the switch and pushes down the foot switch 1025 once more to complete the initialization may be provided. In this case, the position and orientation of the grip portion may not completely match the position and orientation of the distal end of the slave arm. However, since the slave arm is operated based on a difference value of a movement from the initial position with a priority of the initial position set by the operator, the operator can intuitively perform the operation at the setting in which the operator can most easily operate.
[0083]
In addition, the image processing, which becomes the generation conditions of the switched video, is not limited to the above-mentioned rotation processing but may be enlargement processing, reduction processing or the like. In this case, when the manipulation is performed while looking at the initial video and when the manipulation is performed while looking at the switched video, as a motion scale ratio between the master arm and the slave arm is varied, the intuitive operation can be continuously performed. For this reason, information of the motion scale ratio may be included in the switch conversion processing. Here, a plurality of image processings may be combined to set the generation conditions of the switched video.
[0084]
Further, two or more kinds of switched videos may be set. In this case, for example, the initial video and each switched video may be sequentially switched by pushing the foot switch 1025.
Furthermore, instead of normal generation of the switched video, the switched video may be generated and displayed on the display 1023 when the foot switch 1025 is pushed down.
[0085]
In addition, the switched image in which the rotation processing is performed according to the image processing maintains the 3D display so that the operator can visually confirm the image after the switching. For example, in the 3D display, while two images corresponding to binocular disparity are displayed on the same screen, in consideration of the binocular disparity corresponding to the rotation amount upon the image processing, the two images are re-converted to maintain the 3D display, and are displayed on a display device.
[0086]
A sixth embodiment of the present invention will be described with reference to FIGS. 17 A, 17B and 18. The master slave manipulator 1061 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1001 in that correspondence relation between the master arm and the slave arm is switched when the video of the display unit is switched. In addition, in the following description, same elements in the above description are designated by same reference numerals, and a description thereof will not be repeated here.
[0087]
Both of FIGS. 17A and 17B are diagrams showing the master input unit 1002 of the master slave manipulator 1061. As shown in the display 1023, three slave arms 1062A, 1062B and 1062C for treatment are installed at the slave manipulator 1003.
When the initial video is displayed on the display 1023, as shown in FIG. 17 A, the slave arms 1062A and 1062B are disposed at a position at which the intuitive operation is easily performed by the operator Op. When the switched video in which the initial video is rotated 90 degrees rightward is displayed on the display 1023, as shown in FIG. 17B, the slave arms 1062B and 1062C are disposed at a position at which the intuitive operation is easily performed by the operator Op.
Only two master arms are installed at the master input unit 1002. For this reason, in the present embodiment, the two slave arms for treatment and the two master arms, which are easily and intuitively operated, are related to each other in the initial video and the switched video, respectively. That is, according to the video displayed on the display 1023 of the display unit 1022, correspondence relation between the master arms and the slave arms for treatment is varied.
[0088]
FIG. 18 is a flowchart showing a flow of actuations of the master slave manipulator 1061. In step S 101 OA, similar to the sixth embodiment, a conversion angle Θ which is the generation conditions of the switched video is set. In addition, two slave arms for treatment operated by the master arm 1021 are set by the operator Op in the initial video and the switched video, respectively.
Thereafter, in step SI 040, the initialization is performed such that the positions and orientations between the distal ends of the two slave arms and the grip portions set in step S 101 OA are matched. Next, in step S 1041 A, correspondence relation between the master arm and the slave arm and the contents of the conversion processing of the operation order are updated.
Configurations other than those described above are basically same as the sixth embodiment.
[0089]
Even in the master slave manipulator 1061 of the present embodiment, as the image displayed on the display 1023 is merely switched, the contents of the conversion processing of the master control unit are automatically updated. For this reason, as the operator intuitively operates the master arm while looking at the selected video, the slave arm can be intuitively operated with no stress.
Further, since the correspondence relation between the master arm and the slave arm is also automatically updated, in each screen, the slave arm can be optimally operated to perform the manipulation.
[0090]
In the present embodiment, an example in which three slave arms for treatment are installed has been described. However, two slave arms for treatment may be installed. In addition, four or more slave arms for treatment may be installed. Further, instead of the setting the slave arm, which is operated, while looking at the generation conditions of the switch image and each video in step SI 01 OA, the master control unit or the like may automatically calculate a rotation angle at which the two slave arms differently combined than the first screen are easily operated, based on the positional relation between the observation means and each of the slave arms for treatment, and determine a conversion angle Θ. Here, the positional relation between the observation means and each of the slave arms for treatment may be calculated from the initial video and the switched video acquired by the observation means, and may be calculated from the position information based on a value or the like of the encoder of the slave arm.
In addition, the optimal correspondence between the slave arm and the master arm may be automatically calculated from the conversion angle Θ determined in step SI 01 OA based on the positional relation information between the observation means and the slave arm. Even in this case, similar to the above, the positional relation between the observation means and each of the slave arms may be calculated from the video acquired by the observation means, and may be calculated from the position information based on a value or the like of the encoder of the slave arm.
As another method, the correspondence between the slave arm and the master arm may be selected again by the operator after the switched video is displayed in step S 1031. An alternative method may be performed by an input switch such as an interface or the like.
[0091]
A seventh embodiment of the present invention will be described with reference to FIGS. 19 and 20. The master slave manipulator 1071 of the present embodiment is distinguished from the above-mentioned master slave manipulator 1001 in that the switched video is generated based on an initial video before the driving when the observation means is driven.
[0092]
FIG. 19 is a functional block diagram of the master slave manipulator 1071. The overall configuration of the master slave manipulator 1071 is basically similar to that of the master slave manipulator 1001 of the fifth embodiment. An observation means 1072 of the master slave manipulator 1071 includes a driving unit 1073. Then, as the driving unit 1073 is driven, a field of vision of the acquired video can be rotated. In addition, the observation means 1072 also includes a rotation amount detection unit 1074 constituted by a rotary encoder, and so on. Then, a rotation angle of the observation means 1072 according to the driving of the driving unit 1073 can be detected.
In the present embodiment, the signal of the foot switch 1025 is also transmitted to the image processing unit 1050, in addition to the switch unit 1024 and the input conversion switch unit 1055.
[0093]
An actuation of the master slave manipulator 1071 configured as described above will be described.
The operation not according to the driving of the observation means 1072 is basically similar to the fifth embodiment. When the manipulation using the video of the rotation angle different from any one of the initial video and the switched video set in step SI 010 is intended to be performed, the operator Op drives the driving unit 1073 by the operation order from the master arm 1021 or the like, rotates the observation means 1072, and searches for the video that becomes an appropriate operative field, updating the initial video.
[0094]
FIG. 20 is a flowchart showing a flow of updating the initial video. First, in step SI 051, the observation means 1072 is rotated, and search for an appropriate video as an operative field is performed.
In a step in which the video of the observation means 1072 arrives at a desired state appropriate for the manipulation, in step SI 052, the operator Op performs a predetermined update input in which the foot switch 1025 is combined with the operation of another input means.
[0095]
In step S1053, the image processing unit 1050, in which the updated input is received, updates the setting thereof such that the video acquired by the observation means 1072 becomes the initial video upon reception of the updated input.
Next, in step SI 054, the input conversion switch unit 1055 calculates the contents of the input conversion processing corresponding to the initial video after the update to transmit the contents to the master control unit 1041. The master control unit 1041 updates the contents of the initial conversion such that the contents of the received input conversion processing become the initial conversion.
[0096]
Further, next, in step SI 055, the image processing unit 1050 updates the generation conditions such that a difference of a rotation angle of the initial video before and after the update becomes the generation conditions of the switched video, based on the information of the rotation amount detection unit 1074. After that, the image processing is performed with respect to the signal of the initial video after the update, and a signal that can display substantially the same video as the initial video before the update is generated as a signal of the switched video.
In step S1056, the input conversion switch unit 1055 calculates the conversion processing corresponding to the switched video after the update, and temporarily stores the conversion processing as the switch conversion processing to the storage unit. In the example, since the initial image before the update becomes the switched video after the update, the contents of the initial conversion are temporarily stored as the switch conversion processing. Thereafter, in step SI 057, the initialization of the master arm 1021 is performed to correspond to the initial video after the update. Then, a series of processings are terminated.
In addition, a sequence of the processings from steps SI 053 to SI 056 is not particularly limited but may be appropriately varied. Further, these steps may be performed after step SI 057.
[0097]
Configurations other than those described above are basically same as the fifth embodiment. That is, when the operator Op pushes down the foot switch 1025, the switched video having the same angle as the initial video before the update, which is generated by performing the image processing on the initial video after the update, is displayed on the display. Then, the switch conversion processing corresponding to the switched video is transmitted to the master control unit 1041 to be applied thereto.
In addition, after the observation means 1072 is driven, when the foot switch 1025 is pushed down without performing the predetermined operation, the observation means 1072 is stopped, and the setting of the initial video is updated such that the video having the same angle as the initial video which is generated by performing the image processing on the video acquired by the observation means 1072 becomes the initial video.
[0098]
In the master slave manipulator 1071 of the present embodiment, as the driving unit 1073 is driven and the predetermined operation is performed on acquiring the desired video, the initial video most frequently used in the manipulation can be appropriately updated to the desired video.
[0099] In addition, the image processing unit 1050 and the input conversion switch unit 1055 are automatically set such that the initial video before the update becomes the switched video. For this reason, as only the foot switch 1025 is operated, the switched video easily returns to substantially the same video as the initial video before the update.
[0100]
In the present embodiment, instead of the rotation driving of the observation means, a predetermined operation may be performed after an enlargement reduction operation in which an observation optical system is driven. For example, if the predetermined operation is performed when the video becomes n times the initial video, the n-times video is updated to the initial video and the image processing is performed on the updated initial video so that the video reduced to 1/n times becomes the switched video. In this way, a plurality of appropriate magnifications are set while driving the observation optical system, and the video with the plurality of magnifications can be appropriately switched, and manipulation is performed.
[0101]
In addition, in the present embodiment, while an example in which the switched video is one has been described, a configuration in which the above-mentioned predetermined operation is performed plural times and a plurality of switched videos can be set may be provided. According to this configuration, the manipulation can be performed on the video in a previous state more than the state before the latest driving, and the manipulation can be more appropriately performed as a plurality of videos are used.
[0102]
While the respective embodiments of the present invention have been described as described above, the scope of the present invention is not limited to the embodiments, but various modifications may be made to various components, the components may be removed, and the configurations of the embodiments may be combined with each other, without departing from the spirit of the invention.
[0103] In the above-mentioned first to fourth embodiments, for example, when the video displayed on the second screen is generated by the image processing of the video of the first screen, the image processing is not limited to the above-mentioned rotation processing. As an example, as described in the modified example shown in FIG. 13, the video in which the enlargement processing is performed on the video of the first screen 25 may be displayed on the second screen 26. In this case, when the manipulation is performed while looking at the first screen 25 and when the manipulation is performed while looking at the second screen 26, the intuitive operation can be performed as the motion scale ratio between the master arm and the slave arm is varied. For this reason, when the contents of the conversion processing are updated, the motion scale ratio may be varied. Accordingly, when the manipulation is performed while looking at any one of the screens, a relation between the movement amount of the master arm and the movement of the slave arm may not be varied. In addition, the reduction processing may be performed, rather than the enlargement processing.
Further, in the above-mentioned first to fourth embodiments, the example in which the grip portion is connected to the master arm as the operation unit has been described. However, the operation unit may not include the master arm. For example, a position and an orientation of the operation unit or the operator's hands may be acquired by a motion sensor such as a camera or a position sensor.
[0104]
Furthermore, in the above-mentioned first to fourth embodiments, an example in which the detection unit detects which one of the screens the face of the operator faces, and the contents of the initialization or the conversion processing are updated based on the screen has been described. However, the detection unit may be configured to detect whether the face of the operator is facing any one of the screens based on the position or orientation of the operator. In addition, the screen on which the video selected by the operator to perform the manipulation is displayed may be input by an input means such as a switch or the like. In the master slave manipulator according to the above-mentioned first to fourth embodiments of the present embodiment, the conversion processing 8 contents are automatically updated based on the video selected by the operator, and the video is intentionally or unintentionally selected in the former case and intentionally selected in the latter case.
The input means is not limited to the foot switch but may be installed at any place.
[0105]
In addition, in the above-mentioned first to fourth embodiments, the
configuration of the display unit can be variously modified. For example, a screen of a display having one screen may be divided into two display regions, which function as a first screen and a second screen. Further, a head mount display may be used.
Furthermore, two or more screens may be installed to display different operative field images on the respective screens.
[0106]
In addition, in the above-mentioned fifth to seventh embodiments, the
configuration of the display of the display unit may be variously modified. For example, the head mount display may be used. Further, the display having two or more screens or display regions may be used. In particular, in the latter case, when a plurality of switched videos are set, some of the plurality of switched videos can be previously displayed on the display as the next candidate (and an n candidate). For this reason, the switching of the image can be more smoothly performed. When the two or more screens or display regions are adjacent to each other, even in the manipulation using the initial video, the switched video of the next candidate can be substantially confirmed with the eye at the peripheral field of vision, and thus, it is more preferable.
[0107]
In addition, in the above-mentioned fifth to seventh embodiments, as the plurality of switched videos are set, an environment for pseudo driving of the observation means can be made to. For example, when eleven sheets of switched videos are set at a rotation angle of 30 degrees and the videos are configured to be sequentially displayed by an input mechanism such as a rotation knob or the like, it is possible to perform the video adjustment as if the observation means is rotated in real time. Since the switched video is generated by the image processing, even when the switched image is enlarged within a certain range, the entire load applied to the master slave manipulator is hardly increased. Further, in the above-mentioned fifth to seventh embodiments of the present embodiment, even when the observation means cannot be rotated 360 degrees due to restriction of the mechanism, the angle of the video can be adjusted regardless of the restriction.
[Industrial Applicability]
[0108]
According to the medical master slave manipulator, the operator can intuitively operate the master input device to actuate the slave manipulator.
[Description of Reference Numerals]
[0109]
61, 71, 81, 1001, 1061, 1071 : master slave manipulator
2, 1002: master input unit
3, 3 A, 3B, 1003: slave manipulator
4, 1004: control unit
21, 1021 : master arm
21 A, 1021 A: grip portion (operation unit)
22, 1022: display unit
24: detection unit (video selection means)
31, 62 A, 62B, 62C, 82A, 82B, 82 C , 1031, 1062A, 1062B, 1062C: slave arm
83: first endoscope (observation means)
84: second endoscope (observation means)
OP: operator (surgeon)
1024: switch unit (video selection means)
1050: image processing unit
1072: observation means
1073: driving unit

Claims

[Document Name] Claims
[Claim 1]
A medical master slave manipulator systemcomprising:
a master input unit configured to send an operation command;
a slave manipulator operated by the master input device;
a control unit configured to transmit an operation signal to the slave manipulator based on the operation command;
a display unit configured to display a image of an object; and
an image selection means configured to select the image displayed on the display unit, wherein
the control unit transforms the operation command associated with the image selected by the image selection means.
[Claim 2]
The medical master slave manipulator system according to claim 1, wherein a plurality of different images of the object are displayed on the display unit,
the image selection means is configured such that an operator selects one image of the plurality of images, and
the control unit transforms the operation command associated with the image selected by the operator via the image selection means.
[Claim 3]
The medical master slave manipulator system according to claim 2, wherein the image selection means comprises a detection unit configured to detect the image that a face of the operator is facing.
[Claim 4]
The medical master slave manipulator system according to claim 2, wherein the image selection means comprises an input means configured to select the image by the operator.
[Claim 5] The medical master slave manipulator system according to any one of claims 2 to 4, wherein at least one of the plurality of images is generated through image processing of another image.
[Claim 6]
The medical master slave manipulator system according to claim 5, wherein at least one of the plurality of image is generated through rotation processing of another image.
[Claim 7]
The master slave manipulator system according to claim 5, wherein at least one of the plurality of image is generated through scalingprocessing of another image.
[Claim 8]
The medical master slave manipulator system according to any one of claims 2 to 4, wherein the plurality of images are obtained by a plurality of different imaging means, respectively.
[Claim 9]
The medical master slave manipulator system according to any one of claims 2 to 8, wherein the master input unit comprises an input device,
the slave manipulator includes a slave arm,
the number of slave arms is greater than the number of input devices, and in at least one of the transforming processings associated with the image, correspondence between the input device and the slave arm is different from another transforming processing.
[Claim 10]
The medical master slave manipulator system according to claim 8 or 9, the medical master slave manipulator system comprises a plurality of the slave manipulators.
[Claim 11]
The medical master slave manipulator system according to claim 1 , further comprising an image processing unit configured to generate a first image signal according to the image of the object and a second image signal in which image processing is performed on the first image signal,
wherein one of the first image signal and the second image signal is displayed on the display unit,
the image selection means comprises a switch unit configured to switch the image signal displayed on the display unit, and
when the switch unit switches the image signal displayed on the display unit, the control unit performs transforming processing associated with the image signal displayed on the display unit with respect to the operation command.
[Claim 12]
The medical master slave manipulator system according to claim 11 , wherein the master input unit comprises an input device,
the slave manipulator include a slave arm,
the number of slave arms is greater than the number of input devices, and correspondence between the input device and the slave arm is different from another transforming processing in transforming processing associated with the first image signal and transforming processing associated with the second image signal.
[Claim 13]
The medical master slave manipulator system according to claim 11, further comprising an imaging means including a driving unit and configured to acquire the first image signal,
wherein, as a predetermined update input is performed after driving the driving unit, contents of transforming processing associated with the first image signal and the first image signal are updated.
[Claim 14]
The medical master slave manipulator system according to claim 13, wherein, when the first image signal is updated, setting of the image processing is updated such that substantially the same image as the image displayed on the display unit by the first image signal before being updated is displayed on the display unit.
PCT/JP2012/067876 2011-07-07 2012-07-06 Medical master slave manipulator WO2013005862A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201280030004.3A CN103607971B (en) 2011-07-07 2012-07-06 Medical master slave manipulator
EP12807156.0A EP2729084A4 (en) 2011-07-07 2012-07-06 Medical master slave manipulator
US14/146,187 US9259283B2 (en) 2011-07-07 2014-01-02 Medical master slave manipulator system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2011-150977 2011-07-07
JP2011150978A JP5800610B2 (en) 2011-07-07 2011-07-07 Medical master-slave manipulator
JP2011-150978 2011-07-07
JP2011150977A JP5800609B2 (en) 2011-07-07 2011-07-07 Medical master-slave manipulator

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/146,187 Continuation US9259283B2 (en) 2011-07-07 2014-01-02 Medical master slave manipulator system

Publications (1)

Publication Number Publication Date
WO2013005862A1 true WO2013005862A1 (en) 2013-01-10

Family

ID=47437196

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/067876 WO2013005862A1 (en) 2011-07-07 2012-07-06 Medical master slave manipulator

Country Status (4)

Country Link
US (1) US9259283B2 (en)
EP (1) EP2729084A4 (en)
CN (1) CN103607971B (en)
WO (1) WO2013005862A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015049095A1 (en) * 2013-10-01 2015-04-09 gomtec GmbH Control device and method for controlling a robot system by means of gesture control
CN105228550A (en) * 2013-04-25 2016-01-06 直观外科手术操作公司 The visual visual field of control inputs of surgical device
WO2017221367A1 (en) * 2016-06-23 2017-12-28 オリンパス株式会社 Medical system
WO2019014493A1 (en) 2017-07-13 2019-01-17 Intuitive Surgical Operations, Inc. Systems and methods for switching control between multiple instrument arms

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9789608B2 (en) 2006-06-29 2017-10-17 Intuitive Surgical Operations, Inc. Synthetic representation of a surgical robot
US9718190B2 (en) 2006-06-29 2017-08-01 Intuitive Surgical Operations, Inc. Tool position and identification indicator displayed in a boundary area of a computer display screen
US10258425B2 (en) 2008-06-27 2019-04-16 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view of articulatable instruments extending out of a distal end of an entry guide
US10008017B2 (en) 2006-06-29 2018-06-26 Intuitive Surgical Operations, Inc. Rendering tool information as graphic overlays on displayed images of tools
US9469034B2 (en) 2007-06-13 2016-10-18 Intuitive Surgical Operations, Inc. Method and system for switching modes of a robotic system
US9089256B2 (en) 2008-06-27 2015-07-28 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide
US8620473B2 (en) * 2007-06-13 2013-12-31 Intuitive Surgical Operations, Inc. Medical robotic system with coupled control modes
US8423182B2 (en) 2009-03-09 2013-04-16 Intuitive Surgical Operations, Inc. Adaptable integrated energy control system for electrosurgical tools in robotic surgical systems
US9492927B2 (en) 2009-08-15 2016-11-15 Intuitive Surgical Operations, Inc. Application of force feedback on an input device to urge its operator to command an articulated instrument to a preferred pose
EP2627278B1 (en) 2010-10-11 2015-03-25 Ecole Polytechnique Fédérale de Lausanne (EPFL) Mechanical manipulator for surgical instruments
WO2013014621A2 (en) 2011-07-27 2013-01-31 Ecole Polytechnique Federale De Lausanne (Epfl) Mechanical teleoperated device for remote manipulation
EP2895098B1 (en) 2012-09-17 2022-08-10 Intuitive Surgical Operations, Inc. Methods and systems for assigning input devices to teleoperated surgical instrument functions
US10631939B2 (en) 2012-11-02 2020-04-28 Intuitive Surgical Operations, Inc. Systems and methods for mapping flux supply paths
US10864048B2 (en) 2012-11-02 2020-12-15 Intuitive Surgical Operations, Inc. Flux disambiguation for teleoperated surgical systems
US10507066B2 (en) 2013-02-15 2019-12-17 Intuitive Surgical Operations, Inc. Providing information of tools by filtering image areas adjacent to or on displayed images of the tools
EP3102139B1 (en) 2014-02-03 2018-06-13 DistalMotion SA Mechanical teleoperated device comprising an interchangeable distal instrument
US10357320B2 (en) 2014-08-27 2019-07-23 Distalmotion Sa Surgical system for microsurgical techniques
CN107205787B (en) 2014-12-19 2020-03-20 迪斯透莫森公司 Reusable surgical instrument for minimally invasive surgery
US10548680B2 (en) 2014-12-19 2020-02-04 Distalmotion Sa Articulated handle for mechanical telemanipulator
WO2016097861A1 (en) 2014-12-19 2016-06-23 Distalmotion Sa Sterile interface for articulated surgical instruments
EP3232977B1 (en) 2014-12-19 2020-01-29 DistalMotion SA Docking system for mechanical telemanipulator
EP4289385A3 (en) 2014-12-19 2024-03-27 DistalMotion SA Surgical instrument with articulated end-effector
EP3280337B1 (en) 2015-04-09 2019-11-13 DistalMotion SA Articulated hand-held instrument
US10568709B2 (en) 2015-04-09 2020-02-25 Distalmotion Sa Mechanical teleoperated device for remote manipulation
WO2016203858A1 (en) * 2015-06-18 2016-12-22 オリンパス株式会社 Medical system
JP6858124B2 (en) 2015-08-25 2021-04-14 川崎重工業株式会社 Remote control manipulator system and its operation method
EP3340897A1 (en) 2015-08-28 2018-07-04 DistalMotion SA Surgical instrument with increased actuation force
CN106377316B (en) * 2016-09-18 2020-07-14 上海交通大学 Operation equipment for thyroid minimally invasive surgery
US11058503B2 (en) 2017-05-11 2021-07-13 Distalmotion Sa Translational instrument interface for surgical robot and surgical robot systems comprising the same
WO2019155383A1 (en) 2018-02-07 2019-08-15 Distalmotion Sa Surgical robot systems comprising robotic telemanipulators and integrated laparoscopy
CN108962355A (en) * 2018-07-06 2018-12-07 腾讯科技（深圳）有限公司 A kind of association display methods, device and service equipment, the storage medium of image
JP7163115B2 (en) * 2018-09-12 2022-10-31 キヤノン株式会社 ROBOT SYSTEM, ROBOT SYSTEM CONTROL METHOD, PRODUCT MANUFACTURING METHOD, CONTROL DEVICE, OPERATION DEVICE, IMAGING DEVICE, CONTROL PROGRAM, AND RECORDING MEDIUM
GB2608751B (en) * 2018-10-03 2023-06-14 Cmr Surgical Ltd Methods and systems for providing assistance to a user of a surgical robot system
CN110448378B (en) * 2019-08-13 2021-03-02 北京唯迈医疗设备有限公司 Immersive intervention operation integrated console
CN111281649B (en) * 2020-03-03 2021-08-13 西安交通大学 Ophthalmic surgery robot system and control method thereof
US11844585B1 (en) 2023-02-10 2023-12-19 Distalmotion Sa Surgical robotics systems and devices having a sterile restart, and methods thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63150171A (en) * 1986-12-12 1988-06-22 株式会社日立製作所 Controller for manipulator
JPH07328016A (en) * 1994-06-14 1995-12-19 Olympus Optical Co Ltd Surgical manipulator system
JPH08275958A (en) * 1995-04-07 1996-10-22 Olympus Optical Co Ltd Manipulator device for operation
JP2008228967A (en) * 2007-03-20 2008-10-02 Hitachi Ltd Master-slave manipulator system
JP2008541990A (en) * 2005-06-06 2008-11-27 インテュイティブ サージカル， インコーポレイテッド Laparoscopic ultrasonic robotic surgical system
WO2010151438A1 (en) * 2009-06-23 2010-12-29 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD271795S (en) * 1981-02-27 1983-12-13 Combi Co., Ltd. Vaporizer
JP2664205B2 (en) 1988-06-10 1997-10-15 株式会社日立製作所 Manipulator control system
JPH0511713A (en) 1991-07-04 1993-01-22 Matsushita Electric Ind Co Ltd Display with infrared sensor
JPH05301180A (en) 1992-04-28 1993-11-16 Fujitsu Ltd Remote control system of doublr arms
JP3482228B2 (en) 1993-11-02 2003-12-22 オリンパス株式会社 Manipulator control system by gaze detection
US5876325A (en) 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
JPH08154321A (en) 1994-11-29 1996-06-11 Tokyo Electric Power Co Inc:The Remote control robot
JPH08155863A (en) 1994-12-02 1996-06-18 Fujitsu Ltd Remote robot operating system
JPH08223797A (en) 1995-02-13 1996-08-30 Nec Corp Display power device
JPH08309680A (en) 1996-07-01 1996-11-26 Hitachi Ltd Manipulator control system
US6847336B1 (en) * 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
FR2779339B1 (en) * 1998-06-09 2000-10-13 Integrated Surgical Systems Sa MATCHING METHOD AND APPARATUS FOR ROBOTIC SURGERY, AND MATCHING DEVICE COMPRISING APPLICATION
JP2000042960A (en) 1998-07-29 2000-02-15 Gifu Prefecture Remote control device for manipulator
US6659939B2 (en) 1998-11-20 2003-12-09 Intuitive Surgical, Inc. Cooperative minimally invasive telesurgical system
US6459926B1 (en) * 1998-11-20 2002-10-01 Intuitive Surgical, Inc. Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery
US6424885B1 (en) * 1999-04-07 2002-07-23 Intuitive Surgical, Inc. Camera referenced control in a minimally invasive surgical apparatus
US7607440B2 (en) * 2001-06-07 2009-10-27 Intuitive Surgical, Inc. Methods and apparatus for surgical planning
EP1467653A2 (en) * 2001-11-21 2004-10-20 Viatronix Incorporated System and method for visualization and navigation of threedimensional medical images
US6906328B2 (en) * 2002-06-12 2005-06-14 Koninklijke Philips Electronics N.V. Gamma camera workflow automation
US20050033117A1 (en) * 2003-06-02 2005-02-10 Olympus Corporation Object observation system and method of controlling object observation system
US8052636B2 (en) * 2004-03-05 2011-11-08 Hansen Medical, Inc. Robotic catheter system and methods
US7833221B2 (en) * 2004-10-22 2010-11-16 Ethicon Endo-Surgery, Inc. System and method for treatment of tissue using the tissue as a fiducial
US7501995B2 (en) * 2004-11-24 2009-03-10 General Electric Company System and method for presentation of enterprise, clinical, and decision support information utilizing eye tracking navigation
US7605837B2 (en) * 2005-06-02 2009-10-20 Lao Chan Yuen Display system and method
US8398541B2 (en) * 2006-06-06 2013-03-19 Intuitive Surgical Operations, Inc. Interactive user interfaces for robotic minimally invasive surgical systems
JP2007030136A (en) 2005-07-29 2007-02-08 Nisca Corp Minute object handling system
EP3155998B1 (en) 2005-10-20 2021-03-31 Intuitive Surgical Operations, Inc. Auxiliary image display and manipulation on a computer display in a medical robotic system
JP2009045099A (en) 2007-08-14 2009-03-05 Hoya Corp Electronic endoscope system
US8160199B2 (en) * 2007-10-12 2012-04-17 Siemens Medical Solutions Usa, Inc. System for 3-dimensional medical image data acquisition
JP5154961B2 (en) 2008-01-29 2013-02-27 テルモ株式会社 Surgery system
JP2009244949A (en) 2008-03-28 2009-10-22 Advanced Telecommunication Research Institute International Switching device for operational object
US8808164B2 (en) * 2008-03-28 2014-08-19 Intuitive Surgical Operations, Inc. Controlling a robotic surgical tool with a display monitor
US8803955B2 (en) * 2008-04-26 2014-08-12 Intuitive Surgical Operations, Inc. Augmented stereoscopic visualization for a surgical robot using a camera unit with a modified prism

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63150171A (en) * 1986-12-12 1988-06-22 株式会社日立製作所 Controller for manipulator
JPH07328016A (en) * 1994-06-14 1995-12-19 Olympus Optical Co Ltd Surgical manipulator system
JPH08275958A (en) * 1995-04-07 1996-10-22 Olympus Optical Co Ltd Manipulator device for operation
JP2008541990A (en) * 2005-06-06 2008-11-27 インテュイティブ サージカル， インコーポレイテッド Laparoscopic ultrasonic robotic surgical system
JP2008228967A (en) * 2007-03-20 2008-10-02 Hitachi Ltd Master-slave manipulator system
WO2010151438A1 (en) * 2009-06-23 2010-12-29 Intuitive Surgical Operations, Inc. Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2729084A4 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2988696A4 (en) * 2013-04-25 2016-11-30 Intuitive Surgical Operations Surgical equipment control input visualization field
CN105228550A (en) * 2013-04-25 2016-01-06 直观外科手术操作公司 The visual visual field of control inputs of surgical device
US9901411B2 (en) 2013-10-01 2018-02-27 Abb Gomtec Gmbh Control device and method for controlling a robot with a system by means of gesture control
CN105636542A (en) * 2013-10-01 2016-06-01 Abb高姆技术有限责任公司 Control device and method for controlling a robot system by means of gesture control
KR101797169B1 (en) * 2013-10-01 2017-11-13 에이비비 곰텍 게엠베하 Control device and method for controlling a robot system by means of gesture control
WO2015049095A1 (en) * 2013-10-01 2015-04-09 gomtec GmbH Control device and method for controlling a robot system by means of gesture control
WO2017221367A1 (en) * 2016-06-23 2017-12-28 オリンパス株式会社 Medical system
JPWO2017221367A1 (en) * 2016-06-23 2019-04-25 オリンパス株式会社 Medical system
US10729505B2 (en) 2016-06-23 2020-08-04 Olymps Corporation Medical system
WO2019014493A1 (en) 2017-07-13 2019-01-17 Intuitive Surgical Operations, Inc. Systems and methods for switching control between multiple instrument arms
CN110996825A (en) * 2017-07-13 2020-04-10 直观外科手术操作公司 System and method for switching control authority between multiple instrument arms
EP3651677A4 (en) * 2017-07-13 2021-03-31 Intuitive Surgical Operations, Inc. Systems and methods for switching control between multiple instrument arms
CN110996825B (en) * 2017-07-13 2023-12-05 直观外科手术操作公司 System and method for switching control between multiple instrument arms

Also Published As

Publication number Publication date
CN103607971B (en) 2016-08-31
CN103607971A (en) 2014-02-26
US9259283B2 (en) 2016-02-16
EP2729084A4 (en) 2015-03-04
US20140114481A1 (en) 2014-04-24
EP2729084A1 (en) 2014-05-14

Similar Documents

Publication Publication Date Title
US9259283B2 (en) Medical master slave manipulator system
US11857278B2 (en) Roboticized surgery system with improved control
EP3658057B1 (en) Association systems for manipulators
US9801690B2 (en) Synthetic representation of a surgical instrument
EP3385039A1 (en) Synthetic representation of a surgical robot
US20130024024A1 (en) Medical manipulator system
JP2015534835A (en) Surgery support system and control method for surgery support system
AU2021240407B2 (en) Virtual console for controlling a surgical robot
EP3552573A1 (en) Remote control apparatus and method of identifying target pedal
JP5800610B2 (en) Medical master-slave manipulator
JP5800609B2 (en) Medical master-slave manipulator
JP2020096923A (en) Surgery system
JP7301441B1 (en) Surgery support device
WO2023127026A1 (en) Surgery assisting device
WO2023127025A1 (en) Surgery assistance device
JP2023010761A (en) Camera control
CN118043005A (en) System and method for controlling a surgical robotic assembly in an internal body cavity

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12807156

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2012807156

Country of ref document: EP