WO2021047520A1 - Surgical robot and control method and control device for distal instrument thereof - Google Patents

Surgical robot and control method and control device for distal instrument thereof Download PDF

Info

Publication number
WO2021047520A1
WO2021047520A1 PCT/CN2020/114113 CN2020114113W WO2021047520A1 WO 2021047520 A1 WO2021047520 A1 WO 2021047520A1 CN 2020114113 W CN2020114113 W CN 2020114113W WO 2021047520 A1 WO2021047520 A1 WO 2021047520A1
Authority
WO
WIPO (PCT)
Prior art keywords
pose information
target pose
image
target
information
Prior art date
Application number
PCT/CN2020/114113
Other languages
French (fr)
Chinese (zh)
Inventor
高元倩
叶国强
Original Assignee
深圳市精锋医疗科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201910854104.1A external-priority patent/CN110464469B/en
Priority claimed from CN201910854900.5A external-priority patent/CN110464471B/en
Application filed by 深圳市精锋医疗科技有限公司 filed Critical 深圳市精锋医疗科技有限公司
Publication of WO2021047520A1 publication Critical patent/WO2021047520A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B34/37Master-slave robots

Definitions

  • This application relates to the field of medical equipment, and in particular to a control method and control device of a surgical robot and its terminal equipment.
  • Minimally invasive surgery refers to the use of laparoscopy, thoracoscopy and other modern medical instruments and related equipment to perform surgery inside the body cavity. Compared with traditional surgical methods, minimally invasive surgery has the advantages of less trauma, less pain, and faster recovery.
  • Minimally invasive surgical robots usually include a master operating table and a slave operating device.
  • the master operating table includes a handle.
  • the doctor sends control commands to the slave operating device through the operating handle.
  • the slave operating device includes a robotic arm and multiple operating arms mounted on the distal end of the robotic arm. ,
  • the operating arm has end instruments, which move with the handle when in working state to realize remote surgical operations.
  • End instruments include image end instruments that provide a surgical field of view and operating end instruments that perform surgical operations. It is often expected that a larger range of motion (that is, operating space, or flexibility) can be provided for operating end instruments under a fixed field of view during surgery. However, due to the limited range of motion of the operating arm itself, it can be considered to expand its range of motion in combination with the motion of the robotic arm. However, changes in the posture of the distal end of the robotic arm can easily lead to undesirable changes in the visual field, which may affect the safety of the operation.
  • a control method of an end instrument in a surgical robot includes: an obtaining step of obtaining initial target pose information of each of the controlled operation end instruments; a decomposition step of decomposing each of the initial target positions
  • the pose information obtains a set of pose information, each set of pose information includes the first component target pose information of the distal end of the manipulator in the first coordinate system and the end device of the controlled operation in the second coordinate system.
  • the target pose information of the second component of the coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm;
  • the validity of the pose information set is judged; in the calculation step, when at least one set of the pose information set is valid and the image end device is kept in the current pose, the calculation method is combined with each set of the pose information set.
  • the robot arm is controlled to move according to the first target pose information to make The distal end of the robotic arm reaches the corresponding target pose, and the motion of the operating arm corresponding to the end-of-image instrument is controlled according to the second target pose information so that the end-of-image instrument is maintained in the current pose, and according to each
  • the third target pose information controls the movement of the operating arm corresponding to the controlled operation end device so that the controlled operation end device reaches the corresponding target pose.
  • the calculation step includes: reaching a target position corresponding to the first component target pose information at the distal end of the robotic arm Under the condition of the pose, convert the current pose information of the image terminal device to obtain its target pose information in the second coordinate system; assign the first component target pose information to the first target pose information, Assign the converted target pose information of the image terminal device in the second coordinate system to the second target pose information, and assign the second component target pose information to the third target pose information .
  • the calculation step includes: reaching and validating at the distal end of the robotic arm Under the condition of the target pose corresponding to the first component target pose information in the pose information set, convert the current pose information of the image end device to obtain its target pose information in the second coordinate system, and Convert the current pose information of the controlled terminal device associated with each invalid pose information to obtain its second desired target pose information in the second coordinate system; add the valid pose information to the set
  • the first component of the target pose information is assigned to the first target pose information
  • the target pose information of the image end instrument in the second coordinate system is assigned to the second target pose information, which will effectively
  • the second component target pose information in the pose information set is assigned to the associated third target pose information of the controlled operation end device, and each of the second expected target poses is assigned to the corresponding recipient. Control the third target pose information of the terminal device.
  • the calculation step includes: reaching and Corresponding to the target pose corresponding to the first component target pose information in each valid pose information set, respectively convert the current pose information of the image end device to obtain its target in the second coordinate system Pose information; judge the validity of each target pose information of the end image device in the second coordinate system; when only one of the target pose information of the end image device is valid, the robot arm Under the condition that the remote end reaches the target pose corresponding to the first component target pose information in the effective pose information set that is associated with the effective target pose information of the end-of-image device, the conversion and the invalid target pose are converted.
  • the current pose information of each controlled terminal device associated with the target pose information set obtains its second expected target pose information in the second coordinate system, and converts it to the rest of the effective target pose information set
  • the associated initial target pose information of each of the controlled operation end instruments obtains its first expected target pose information in the second coordinate system; the validity of each of the first expected target pose information is judged; if Each of the first desired target pose information is valid, and the first component target pose information in the pose information set associated with the target pose information of the effective end image device is assigned to the first Target pose information, assigning the effective target pose information of the end image device to the second target pose information, and associate the pose information with the effective target pose information of the end image device
  • the second component target pose information in the set is assigned to the associated third target pose information of the controlled operation end device, and each of the first expected target pose information and each of the second expected target poses The information is respectively assigned to the corresponding third target pose information of the controlled operation end device; if at least part of the first expected target pose information is invalid, the effective one will be
  • each of the first expected target poses Information related to the current pose information of the controlled operation end device obtains its second desired target pose information in the second coordinate system; the target pose information of the effective end device of the image is associated with the pose information
  • the first component target pose information in the information set is assigned to the first target pose information
  • the effective target pose information of the end image device is assigned to the second target pose information, which will be associated with the effective target pose information.
  • the second component target pose information in the pose information set of the target pose information of the end image device is assigned to the third target pose information of the associated controlled operation end device, which will be valid for each
  • the first desired target pose information is respectively assigned to the corresponding third target pose information of the controlled operation end device, Assign each of the second desired target pose information to the corresponding third target pose information of the controlled operation end device; when two or more of the target pose information of the image end device are valid, Selecting one of the valid target pose information of the end-of-image device as valid, and invalidating the rest, enters the step when only one of the target pose information of the end-of-image device is valid.
  • the calculation step includes: reaching at the distal end of the robotic arm and corresponding to each valid pose Under the condition of the target pose corresponding to the first component target pose information in the information set, the current pose information of the image end device is converted to obtain its target pose information in the second coordinate system; The validity of each target pose information of the instrument in the second coordinate system is judged; when only one of the target pose information of the device at the end of the image is valid, the effective image is reached at the far end of the robotic arm.
  • the initial target pose information of each controlled operation terminal device obtains its first expected target pose information in the second coordinate system; the validity of each of the first expected target pose information is judged; if all The first desired target pose information is all valid, and the first component target pose information in the pose information set associated with the target pose information of the effective end image device is assigned to the first target pose Pose information, assigning the effective target pose information of the end image device to the second target pose information, which will be associated with the pose information set of the effective target pose information of the end image device
  • the second component of the target pose information is assigned to the associated third target pose information of the controlled operation end device, and each of the first desired target pose information is assigned to the corresponding control operation end device’s The third target pose information; if at least part of each of the first desired target pose information is invalid, reach at the distal end of the
  • the decomposition step includes: obtaining an input operation command related to the task freedom of the distal end of the robotic arm; combining the task freedom to separately decompose each of the initial target pose information to obtain information including the remote end of the robotic arm A set of pose information of the first component target pose information of the end device in the first coordinate system and the second component target pose information of the controlled operation terminal device in the second coordinate system.
  • the operation command includes a first operation command and a second operation command;
  • the first operation command is associated with the situation that the task freedom of the distal end of the robot arm completely matches the effective degree of freedom of the robot arm;
  • the second operation command is associated with a situation in which the task degree of freedom of the distal end of the robot arm completely matches the posture degree of freedom of the effective degree of freedom of the robot arm.
  • the decomposition step includes: acquiring the current pose information of the distal end of the robotic arm in the first coordinate system;
  • the initial target pose information obtains the second component target pose information; the validity of the second component target pose information is judged; if it is valid, when the controlled operation terminal device arrives with the first component Under the condition of the target pose corresponding to the two-component target pose information, convert the initial target pose information to obtain the first component target pose information; if it is invalid, adjust the second component target pose information to be valid and Update the second component target pose information, and convert the initial target pose under the condition that the controlled terminal device reaches the target pose corresponding to the updated second component target pose information Information to obtain the first component target pose information.
  • the first judgment step includes: judging the validity of the first component target pose information obtained by converting the initial target pose information; if the first component target pose information is valid, judging all The pose information set is valid; if the first component target pose information is invalid, it is determined that the pose information set is invalid.
  • the step of judging the validity of the target pose information includes: parsing the target pose information into target motion state parameters of each joint component in the corresponding arm body, and the arm body is the robot arm or The operating arm; compare the target motion state parameters of the joint components in the arm body with the motion state thresholds of the joint components in the arm body; if the target motion state parameters of the joint components in the arm body are If more than one exceeds the motion state threshold of the corresponding joint component, it is determined that the target pose information is invalid; if the target motion state parameter of each joint component in the arm body does not exceed the motion state threshold of the corresponding joint component, Then it is judged that the target pose information is valid.
  • the step of judging the validity of the target pose information includes: parsing the target pose information into target motion state parameters of each joint component in the corresponding arm body, and the arm body is the robot arm or The operating arm; compare the target motion state parameters of the joint components in the arm body with the motion state thresholds of the joint components in the arm body; if the target motion state parameters of the joint components in the arm body are If more than one exceeds the motion state threshold of the corresponding joint component, it is determined that the target pose information is invalid; if the target motion state parameter of each joint component in the arm body does not exceed the motion state threshold of the corresponding joint component, Then it is judged that the target pose information is valid.
  • a computer-readable storage medium is provided, and the computer-readable storage medium stores a computer program, and the computer program is configured to be executed by more than one processor to implement the method described in any one of the above embodiments. Steps of the control method.
  • a control device for a surgical robot including: a memory for storing a computer program; and a processor for loading and executing the computer program; wherein the computer program is configured to be processed by the The controller loads and executes the steps for implementing the control method described in any of the above embodiments.
  • a surgical robot including: a robotic arm; one or more operating arms with end instruments installed at the distal end of the robotic arm, the end instruments including an image end instrument and more than one manipulation end instruments, The operating end instruments are all configured as controlled operating end instruments; and control devices connected to the mechanical arm and the operating arm respectively; the control device is used to implement the implementation of any one of the foregoing embodiments Steps of the control method.
  • a surgical robot including: a robotic arm; an operating arm installed at the distal end of the robotic arm, the number of operating arms is more than two and each has one end instrument, and the end instrument includes one An image end device and more than one operation end device, at least one of the operation end devices is configured as a controlled operation end device, so that the controlled operation end device is the first end device, except for the first end device
  • the end instrument is a second end instrument; and a control device, which is respectively connected to the mechanical arm and the operating arm, and is configured to perform: the obtaining step, obtaining the first coordinate of each of the first end instruments
  • the initial target pose of the system; the decomposition step is to decompose each of the initial target pose information to obtain a set of pose information sets, and each set of the pose information sets includes the remote end of the robotic arm in the first coordinate system
  • the operating arm of the second end device moves to keep the second end device in the current posture.
  • FIG. 1 is a schematic structural diagram of an embodiment of a surgical robot according to this application.
  • Fig. 2 is a partial schematic diagram of the surgical robot shown in Fig. 1;
  • Fig. 3 is a partial schematic diagram of the surgical robot shown in Fig. 1;
  • FIG. 4 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application
  • FIG. 5 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to the present application
  • Fig. 6 is a simplified schematic diagram of an embodiment of the surgical robot according to the application in a use state
  • FIG. 7 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to the present application.
  • FIG. 8 is a simplified schematic diagram of another embodiment of the surgical robot according to the application in a use state
  • 9-12 are flowcharts of different embodiments of the control method of the end instrument in the surgical robot of this application.
  • FIG. 13 is a schematic diagram of the principle of the mechanical arm in the arm body mechanism of the surgical robot shown in FIG. 1;
  • FIG. 14 is a schematic diagram of the analysis of the spatial motion angle in the control method of the surgical robot of this application.
  • 15 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to this application.
  • 16 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a two-to-one operation mode;
  • FIG. 17 is an operation schematic diagram of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a two-to-one operation mode;
  • 18-19 are flowcharts of another embodiment of a method for controlling end instruments in a surgical robot according to the present application in a two-to-one operation mode;
  • 20 is a schematic diagram of operations in a two-to-one operation mode of another embodiment of a method for controlling end instruments in a surgical robot according to the present application;
  • FIG. 21 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a one-to-one operation mode;
  • 22 is a schematic diagram of the operation of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a one-to-one operation mode;
  • FIGS 23-24 are flowcharts of different embodiments of the control method of the end instrument in the surgical robot of this application.
  • FIG. 25 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to the present application.
  • FIG. 26 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to this application.
  • FIG. 27 is a simplified schematic diagram of an embodiment of a surgical robot according to the application in a use state
  • FIG. 28 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application.
  • FIG. 29 is a simplified schematic diagram of an embodiment of the surgical robot according to the application in a use state
  • FIGS 30 to 31 are flowcharts of different embodiments of the control method of the end instrument in the surgical robot of this application;
  • FIG. 32 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to this application.
  • FIG. 33 is a schematic structural diagram of another embodiment of a surgical robot according to this application.
  • distal and proximal used in this article are locators, which are commonly used terms in the field of interventional medical devices, where “distal” refers to the end far away from the operator during surgery, and “proximal” refers to surgery The end close to the operator during the process.
  • FIGS. 1 to 3 are respectively a schematic structural diagram of an embodiment of a surgical robot according to the present application, and a partial schematic diagram thereof.
  • the surgical robot includes a master operating table 1 and a slave operating device 2.
  • the master console 1 has a motion input device 11 and a display 12.
  • the doctor sends a control command to the slave operation device 2 by operating the motion input device 11, so that the slave operation device 2 performs corresponding operations according to the control command of the doctor to operate the motion input device 11, and
  • the operation area is observed through the display 12.
  • the slave operating device 2 has an arm body, and the arm body has a mechanical arm 21 and an operating arm 31 detachably installed at the distal end of the mechanical arm 21.
  • the mechanical arm 21 includes a base and a connecting component that are connected in sequence.
  • the connecting component has a plurality of joint components. In the configuration shown in FIG. 1, there are joint components 210 to 214.
  • the operating arm 31 includes a connecting rod 32, a connecting component 33, and an end instrument 34 connected in sequence.
  • the connecting assembly 33 has a plurality of joint components.
  • the operating arm 31 adjusts the posture of the end instrument 34 by adjusting the joint components; the end instrument 34 has an image End instrument 34A and operation end instrument 34B.
  • the operating arm 31 is mounted on the power mechanism 22 at the distal end of the mechanical arm 21 and is driven by the driving part of the power mechanism 22.
  • the robot arm 21 and/or the operating arm 31 can follow the motion input device 11 to move, and the robot arm 21 can also be dragged by applying an external force to move.
  • the motion input device 11 may be connected to the main console 1 through a wire, or connected to the main console 1 through a rotating link.
  • the motion input device 11 may be configured as a handheld type or a wearable type (often worn on the distal end of the wrist such as a finger or palm), which has multiple effective degrees of freedom.
  • the motion input device 11 is configured in the form of a handle shown in FIG. 3.
  • the number of effective degrees of freedom of the motion input device 11 is configured to be lower than the number of task degrees of freedom defined at the distal end of the arm; in another case, the number of effective degrees of freedom of the motion input device 11 is configured It is not less than the number of task degrees of freedom at the distal end of the arm.
  • the number of effective degrees of freedom of the motion input device 11 is at most 6.
  • the motion input device 11 is exemplarily configured to have 6 effective degrees of freedom, where
  • the effective degree of freedom of the motion input device 11 refers to the effective degree of freedom that can follow the movement of the hand, so that the doctor has a larger operating space, and can generate more meaningful data through the analysis of each effective degree of freedom, which satisfies almost Control of the robotic arm 21 in all configurations.
  • the motion input device 11 follows the hand motion of the doctor, and collects the motion information of the motion input device itself caused by the hand motion in real time. These motion information can be parsed into position information, posture information, speed information, acceleration information, and so on.
  • the motion input device 11 includes, but is not limited to, a magnetic navigation positioning sensor, an optical positioning sensor, or a link-type main operator.
  • a method for controlling end instruments in a surgical robot includes:
  • Step S1 the obtaining step, namely obtaining the initial target pose information of each controlled operation end device.
  • the operation end devices 34B installed on the power mechanism 22 are all configured as controlled operation end devices. One operator can control at most two controlled operation end devices 34B at the same time. When there are more than two controlled operation end devices 34B, more than two operators can perform coordinated control.
  • Step S2 a decomposition step, that is, to decompose each initial target pose information to obtain a set of pose information.
  • each set of pose information includes the first component target pose information of the distal end of the robotic arm in the first coordinate system and the second component target pose information of the controlled operation terminal device in the second coordinate system.
  • the first coordinate system refers to the base coordinate system of the robotic arm
  • the second coordinate system refers to the tool coordinate system of the robotic arm.
  • Step S3 the first judging step, namely judging the validity of each set of pose information.
  • the validity of the two component pose information included in each group of pose information set is judged. When the two component pose information are both valid, the set of pose information is considered valid. Otherwise, the set of pose information is considered valid. The pose information collection is deemed invalid.
  • Step S4 a calculation step, that is, under the condition that at least one set of pose information is valid and the image end instrument is kept in the current pose, combine each set of pose information to calculate the first position of the distal end of the robotic arm in the first coordinate system.
  • the target pose information, the second target pose information of the image end device in the second coordinate system, and the third target pose information of each controlled operation end device in the second coordinate system are, under the condition that at least one set of pose information is valid and the image end instrument is kept in the current pose, combine each set of pose information to calculate the first position of the distal end of the robotic arm in the first coordinate system.
  • each controlled operation end device 34B can reach the first desired posture. If several controlled operation end devices 34B cannot reach the first desired posture, it is expected that these cannot reach the first desired posture.
  • the controlled operation end device 34B can reach the second desired posture.
  • the first expected pose refers to two situations where the target pose corresponding to the initial target pose information (including the initial target pose (which is associated with the motion information input by the controlled motion input device) is consistent with or inconsistent with the current pose ).
  • the second desired posture refers to the current posture.
  • Step S5 the second judgment step, is to judge the validity of the first target pose information, the second target pose information, and the third target pose information.
  • Step S6 the control step, that is, when the first target pose information, the second target pose information, and the third target pose information are all valid, the robot arm is controlled to move according to the first target pose information to make the robot arm distal Reach the corresponding target pose, control the movement of the operating arm corresponding to the end-of-image device according to the second target pose information to keep the end-of-image device in the current pose, and control the end corresponding to the controlled operation according to the third target pose information
  • the operating arm of the instrument moves to make the controlled operating end instrument reach the corresponding target posture.
  • the controlled operation end device 34B can reach the first desired posture or the second desired posture; in addition, it can be combined with the robotic arm and the corresponding operating arm to move together in some scenarios to expand the controlled operation end device 34B. Range of motion to facilitate easier operation.
  • step S3 if the posture information sets obtained by the judgment are all invalid, it means that all controlled operation end devices 34B (including one or more controlled operation end devices) do not have Adjustability, therefore, no further steps are entered, that is, the control ends, and step S1 is returned.
  • the above step S4 that is, the calculation step includes:
  • Step S411 Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information, convert the current pose information of the image end device to obtain its target pose information in the second coordinate system.
  • the current pose information of each end device 34 can be the first coordinate system or the second coordinate system, or other reference coordinate systems. These coordinate systems can essentially interact with each other. Converted.
  • "current pose information” refers to current pose information in the second coordinate system, and of course, it can also be current pose information in other coordinate systems.
  • Step S412 Assign the first component target pose information to the first target pose information, assign the converted target pose information of the image end device in the second coordinate system to the second target pose information, and assign the second component The target pose information is assigned to the third target pose information.
  • step S5 that is, the second judgment step, since the pose information set has been determined to be valid, the first target pose information and the third target pose information are valid. Therefore, it is actually only necessary to determine whether the second target pose information is valid.
  • step S6 which is the control step.
  • the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose
  • the operating arm 31A is controlled to move according to the second target pose information to make the end of the image
  • the instrument 34A maintains the current pose, and controls the movement of the operating arm 31B according to the third target pose information so that the controlled operation end device 34B reaches the corresponding target pose (first desired pose).
  • step S3 when the controlled operation end device is configured as multiple, and in step S3, it is determined that only one pose information set is valid, and the rest of the pose information sets are invalid,
  • step S4 that is, the calculation step includes:
  • Step S421 under the condition that the distal end of the robot arm reaches the target pose corresponding to the first component target pose information in the effective pose information set, convert the current pose information of the image end device to obtain its position in the second coordinate system And convert the current pose information of the controlled operation end device associated with each invalid pose information to obtain its second expected target pose information in the second coordinate system.
  • Step S422 Assign the first component target pose information in the effective pose information set to the first target pose information, and assign the target pose information of the image end instrument in the second coordinate system to the second target pose information , Assign the second component target pose information in the effective pose information set to the third target pose information of the associated controlled operation end device, and assign each second desired target pose to the corresponding controlled operation end The third target pose information of the device.
  • step S5 the second judgment step, it is actually only necessary to judge whether the second target pose information of the end image device 34A and the third target pose information of the controlled operation end device 34B associated with each invalid pose information set are Effective.
  • the control ends.
  • step S6 is entered, which is a control step.
  • step S6 is entered, which is a control step.
  • the set of pose information associated with the controlled operation end device 34B1 is valid, and the two sets of pose information associated with the controlled operation end device 34B2-34B3 are invalid:
  • the third target pose information of each of ⁇ 34B3 controls the movement of the operating arms 31C ⁇ 31D so that the controlled operation end devices 34B2 ⁇ 34B3 reach the corresponding target pose (the second desired pose, that is, maintain the current pose).
  • Steps S1 to S6 including steps S421 to S422 are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B as shown in FIG. 8, but also applicable to the same robotic arm 21 having two, and four end devices according to its principle. More than one controlled operation end device 34B.
  • the foregoing step S4 that is, the calculation step includes:
  • Step S431 Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the
  • Step S432 judging the validity of each target pose information of the image terminal device in the second coordinate system.
  • step S433 if only one of the target pose information of the end image device is valid, step S433 is entered; if more than two of the target pose information of the end image device are valid, step S438 is entered.
  • Step S433 under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, conversion and invalidation
  • the current pose information of each controlled terminal device associated with the target pose information set obtains its second expected target pose information in the second coordinate system, and converts each receiver associated with the remaining effective target pose information set. Controlling the initial target pose information of the terminal device to obtain its first expected target pose information in the second coordinate system.
  • step S434 the validity of each first desired target pose information is judged.
  • step S435 if all the first desired target pose information is valid, go to step S435; if at least part of the first desired target pose information is invalid, go to step S436.
  • Step S435 Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device
  • the posture information, each of the first desired target posture information and each second desired target posture information is assigned to the third target posture information of the corresponding controlled operation end device.
  • the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; the second desired target pose information is correspondingly assigned to be associated with the invalid target pose information set The third target pose information of the controlled operation end device.
  • Step S436 under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the effective pose information set, which is associated with the target pose information of the effective end-of-image equipment, conversion and invalidation
  • the current pose information of the controlled operation end device associated with each first desired target pose information obtains its second desired target pose information in the second coordinate system.
  • Step S437 Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device Attitude information, each valid first expected target pose information is assigned to the third target pose information of the corresponding controlled operation end device, and each second expected target pose information obtained at different stages (ie conditions) is respectively assigned Assigned to the third target pose information of the corresponding controlled operation end device.
  • the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; each second desired target pose information is associated with two situations, one of which is related to invalid
  • the target pose information set in the other case is related to the invalid first expected target pose information (converting the first expected pose to the second expected pose), so it needs to be assigned correspondingly to the recipient associated with the corresponding situation.
  • Step S438 select one of the effective target pose information of the end-of-image device as valid and the rest as invalid, and enter step S433 when only one of the target pose information of the end-of-image device is valid.
  • step S438 it is possible to configure and form a variety of combinations that regard the target pose information of multiple valid image end devices as valid and invalid, and use the above steps S433 to S437 to perform calculations, and then combine the calculated A set of the first target pose information, the second target pose information, and each third target pose information are all valid to perform the control step of step S6.
  • the first target pose information, the second target pose information, and the third target pose information calculated in different combinations are valid, it can be determined according to some measurement indicators.
  • a certain group in which the first target pose information, the second target pose information, and each third target pose information are all valid is selected to perform the control step of step S6.
  • These metrics include, but are not limited to, more than one of the range of motion, motion speed, and motion acceleration of the arm (mechanical arm or manipulator arm), such as smaller arm motion range, lower motion speed, and lower motion acceleration. One or more of them are selected to select the first target pose information, the second target pose information, and each third target pose information used in step S6.
  • These metrics include, but are not limited to, the number of controlled-operated end devices that can achieve the first expected pose and the second expected pose. It is preferred to control the number of poses that can reach the first expected pose. These measurement indicators can also be combined with each other to select an optimal group to perform the control in step S6.
  • the priority may be set for each controlled operation terminal device in advance or in real time (such as by voice command) during the operation of the controlled operation terminal device, and in step S438, the controlled operation terminal device with higher priority may be selected in turn.
  • the target pose information of the effective image end device associated with the operation end device is considered valid, and the rest is considered invalid, so as to ensure that the control object with a higher priority can achieve the first desired pose as much as possible.
  • the priority setting can be set according to the authority of the operator, or according to the specific control object, which can be flexibly configured.
  • the correlation calculated according to the above step S431 is
  • the target pose information of the image end devices of the controlled operation end devices 34B2 and 34B3 in the second coordinate system are C2 and C3, respectively.
  • the target pose information of the controlled operation end device 34B1 in the second coordinate system is calculated according to step S433 (the second expected target pose Information), and the target pose information of the controlled operation terminal device 34B3 in the second coordinate system (the first desired target pose information).
  • step S434 Assuming that it is determined according to step S434 that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is valid:
  • step S6 the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose
  • the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current posture
  • control the movement of the operating arms 31C-31D according to the third target posture information of each of the controlled operating end devices 34B2 to 34B3 so that the controlled operating end devices 34B2 to 34B3 reach the corresponding target posture (the first desired posture) ).
  • step S434 Assuming that it is determined according to step S434 that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is invalid:
  • the second expected target pose information of the controlled operation end device 34B3 in the second coordinate system is calculated according to step S436, and passed After the value is assigned in step S437, the process proceeds to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6.
  • step S6 the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current pose, and controls the movement of the operating arms 31B, 34D according to the third target pose information of the controlled operating end devices 34B1 and 34B3 so that the controlled operating end devices 34B1 and 34B3 reach the corresponding target poses (the second desired Posture, that is, maintain the current posture), and control the movement of the operating arm 31C according to the third target posture information of the controlled operation end device 34B2 to make the controlled operation end device 34B2 reach the corresponding target posture (the first desired posture) ).
  • Steps S1 to S6 including steps S431 to S438 are not only applicable to the same robotic arm 21 with three controlled operation end devices 34B as shown in FIG. 8, but also applicable to the same robotic arm 21 having more than four receivers according to its principle. Control the operation of the terminal device 34B.
  • the above step S4 that is, the calculation step includes:
  • Step S441 Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information.
  • the target pose information of the second coordinate system Under the
  • Step S442 judging the validity of each target pose information of the image terminal device in the second coordinate system.
  • step S443 if only one of the target pose information of the end image device is valid, step S443 is entered; if more than two of the target pose information of the end image device are valid, step S448 is entered.
  • Step S443 Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set, which is associated with the target pose information of the effective end-of-image device, convert it to the other target poses.
  • the initial target pose information of each controlled terminal device associated with the effective target pose information set obtains its first expected target pose information in the second coordinate system.
  • step S444 the validity of each first desired target pose information is judged.
  • step S445 if all the first desired target pose information is valid, go to step S445; if at least part of the first desired target pose information is invalid, go to step S446.
  • Step S445 Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and set the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device Posture information, assigning each first desired target posture information to the third target posture information of the corresponding controlled operation end device.
  • Step S446 under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, conversion and invalidation
  • the current pose information of the controlled operation end device associated with each first desired target pose information obtains its second desired target pose information in the second coordinate system.
  • Step S447 Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device Attitude information, each valid first desired target pose information is assigned to the third target pose information of the corresponding controlled operation terminal device, and each second expected target pose information is assigned to the corresponding controlled operation terminal The third target pose information of the device.
  • the second expected target pose information here is only associated with the invalid first expected target pose information (converting the first expected pose to the second expected pose).
  • Step S448 selecting one of the valid target pose information of the end-of-image device as valid and the others as invalid, and enter step S443 when only one of the target pose information of the end-of-image device is valid.
  • the image end devices associated with the controlled operation end devices 34B1, 34B2, and 34B3 calculated according to the above step S441 are in the first
  • the target pose information of the two-coordinate system is C1, C2, and C3 respectively.
  • the target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system is calculated according to step S433. Pose information).
  • step S444 Assuming that it is determined according to step S444 that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system is valid:
  • step S6 the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current posture, and controls the operating arms 31B to 31D to move to the corresponding target posture (first desired posture) according to the third target posture information of the controlled operation end devices 34B1 to 34B3, respectively.
  • step S444 it is determined according to step S444 that the first expected target pose information of the controlled operation end device 34B2 and 34B3 in the second coordinate system is at least partially invalid, for example, the first expected target pose information of the controlled operation end device 34B2 in the second coordinate system
  • the information is valid, and the controlled operation terminal device 34B3 is invalid in the first expected target pose information in the second coordinate system:
  • the second expected target pose information of the controlled operation end device 34B3 in the second coordinate system is calculated according to step S446, and passed After the assignment in step S447, proceed to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, proceed to step S6.
  • step S6 the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current pose, and controls the operating arms 31B-31C to move to the corresponding target pose (the first desired pose) according to the third target pose information of the controlled operating terminal device 34B1-34B2, and according to the controlled operation end
  • the third target pose information of the instrument 34B2 corresponds to control the movement of the operating arm 31D to reach the corresponding target pose (the second desired pose).
  • step S444 Assuming that it is determined according to step S444 that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system is invalid:
  • step S446 Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B1, the second expected target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system is calculated according to step S446, After the assignment is performed in step S447, the process proceeds to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6.
  • step S6 the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current posture, and controls the operating arm 31B to move to the corresponding target posture (the first desired posture) according to the third target posture information of the controlled operation end device 34B1, and according to the controlled operation end device 34B2, 34B3
  • the third target pose information corresponding to control the operation arms 31C, 31D to move to the corresponding target pose (the second desired pose).
  • Steps S1 to S6 including steps S441 to S448 are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B as shown in FIG. 8, but also applicable to the same robotic arm 21 having two, or four, according to the principle. More than one controlled operation end device 34B.
  • the above step S1 that is, the obtaining step includes:
  • Step S11 Obtain the motion information of the motion of the remotely operated controlled object input by the motion input device.
  • the controlled object specifically refers to the controlled operation end device in this article.
  • Step S12 Analyze the motion information as the initial target pose information of the controlled object.
  • the motion information may be the pose information of the motion input device.
  • this step S12 includes:
  • Step S121 Analyze and map the motion information into the pose increment information of the controlled object.
  • mapping is a conversion relationship, which can include natural mapping relationships and unnatural mapping relationships.
  • the natural mapping relationship is a one-to-one correspondence, which refers to the horizontal movement increment information between the controlled motion input device and the controlled object to the horizontal movement increment information, the vertical movement increment information to the vertical movement increment information, front and back Move incremental information to forward and backward movement incremental information, yaw angle rotation increment information to yaw angle rotation increment information, pitch angle rotation increment information to pitch angle rotation increment information, and roll angle rotation increment information to roll angle Rotate incremental information.
  • the unnatural mapping relationship is a mapping relationship other than the natural mapping relationship.
  • the unnatural mapping relationship includes, but is not limited to, a conversion mapping relationship, which includes, but is not limited to, the aforementioned one-to-one mapping of the horizontal movement increment information, the vertical movement increment information, and the rotation increment information of the fixed coordinate system. It is the yaw angle increment information, pitch angle increment information and roll angle increment information of the controlled object. Configured as an unnatural mapping relationship, it is easier to control the controlled object in certain situations such as the two-to-one operation mode.
  • Step S122 Obtain position information of each joint component in the controlled object.
  • the corresponding position information can be obtained through position sensors such as encoders installed at each joint component of the controlled object.
  • the robot arm 21 has 5 degrees of freedom, and such a set of position information (d1, ⁇ 2 , ⁇ 3 , ⁇ 4 , ⁇ 5 ) can be collected by means of position sensors. .
  • Step S123 Calculate the current pose information of the controlled object in the first coordinate system according to the position information of each joint component.
  • the calculation can usually be combined with positive kinematics.
  • Establish a kinematic model of the fixed point of the robot arm 21 ie at point C, the origin of the tool coordinate system of the robot arm 21 is on the fixed point
  • the calculation method is
  • Step S124 combining the incremental pose information and the current pose information to calculate the initial target pose information of the controlled object in the first coordinate system.
  • the model conversion matrix of point C and the base Get the pose information of point C in the fixed coordinate system.
  • the rotation axis angle [ ⁇ x0 , ⁇ y0 , ⁇ z0 ]
  • ⁇ x0 is the rolling angle
  • ⁇ y0 is the yaw angle
  • ⁇ z0 is the pitch angle.
  • the degree of freedom of the rolling angle is lacking and ⁇ x0 is actually not adjustable.
  • the fixed coordinate system can be defined at the display, of course, it can also be defined at least at a position that is not movable during work.
  • step S6 that is, the control step, the control of the control object, that is, the robotic arm, the end-of-image device, and the end-of-operation device may include the following steps:
  • each joint component in the control object is controlled to link to reach the corresponding target pose.
  • this step S12 includes:
  • Step S125 Obtain a selection instruction related to the operation mode type input for the controlled object.
  • the operation mode includes two-to-one operation mode and one-to-one operation mode.
  • the two-to-one operation mode refers to the use of two controlled motion input devices to control a controlled object
  • the one-to-one operation mode refers to the use of one controlled motion input device to control a controlled object. Control a controlled object.
  • For the one-to-one operation mode it is possible to further select which motion input device is used as the controlled motion input device for control.
  • the same operator when the same operator moves both hands, depending on the configuration, it can be a two-to-one operation mode for one controlled object, or it can be a one-to-one operation mode for two controlled objects separately control.
  • the surgical robot provides enough motion input devices, this is still applicable to more than two operators.
  • step S126 the motion information input by the controlled motion input device is obtained in combination with the type of operation mode, and the motion information is parsed and mapped into the incremental pose information of the remote end of the controlled object in the first coordinate system.
  • step S126 when the selection instruction acquired in step S125 is associated with a two-to-one operation mode, step S126 includes:
  • Step S1261 Acquire respective first pose information of the two controlled motion input devices at the previous moment.
  • Step S1262 Obtain the respective second pose information of the two controlled motion input devices at a later time.
  • step S1263 the incremental pose information of the two controlled motion input devices in the fixed coordinate system is calculated by combining the first scale factor and the respective first pose information and second pose information of the two controlled motion input devices.
  • step S1263 it can be specifically implemented through the following steps:
  • the first scale factor is 0.5, that is, K 1 and K 2 are both 0.5
  • the acquired incremental pose information represents the two The incremental pose information of the center point of the connection between the controlled motion input devices.
  • K 1 and K 2 can also be assigned additional values.
  • K 1 and K 2 may be the same or different.
  • Step S1264 Map the incremental pose information of the two controlled motion input devices in the fixed coordinate system to the incremental pose information of the remote end of the controlled object in the first coordinate system.
  • step S126 when the selection instruction acquired in step S125 is associated with a two-to-one operation mode, step S126 may also include:
  • step S1265 the first position information of each of the two controlled motion input devices in the fixed coordinate system at the previous moment is obtained respectively.
  • Step S1266 Acquire the second position information of each of the two controlled motion input devices in the fixed coordinate system at a later time.
  • Step S1267 Combine the second scale factor and the first position information and second position information of the two controlled motion input devices in the fixed coordinate system to calculate and obtain the horizontal movement increment information of the two controlled motion input devices in the fixed coordinate system. , Vertical movement increment information and rotation increment information.
  • Step S1268 correspondingly map the horizontal movement increment information, vertical movement increment information and rotation increment information of the two controlled motion input devices in the fixed coordinate system to the yaw angle of the remote end of the controlled object in the first coordinate system Incremental information, pitch angle incremental information, and roll angle incremental information.
  • step S1268 calculates and obtains the position information of the two controlled motion input devices according to the first position information and the second position information of the two controlled motion input devices in the fixed coordinate system.
  • the steps of fixing the rotation increment information of the coordinate system include:
  • Step S12681 Establish a first position vector between the two controlled motion input devices at the previous moment.
  • Step S12682 establishing a second position vector between the two controlled motion input devices at a later time.
  • Step S12683 combining the third scale factor and the angle between the first position vector and the second position vector to obtain the rotation increment information of the two controlled motion input devices in the fixed coordinate system.
  • step S126 when the selection instruction obtained in step S125 is associated with a one-to-one operation mode, step S126 may include:
  • Step S12611 Acquire the first pose information of the controlled motion input device in the fixed coordinate system at the previous moment.
  • Step S12612 Obtain the second pose information of the controlled motion input device in the fixed coordinate system at a later time.
  • Step S12613 Combine the fourth scale factor and the first pose information and second pose information of the controlled motion input device in the fixed coordinate system to calculate and obtain the incremental pose information of the controlled motion input device in the fixed coordinate system.
  • Step S12614 Map the incremental pose information of the controlled motion input device in the fixed coordinate system to the incremental pose information of the remote end of the controlled object in the first coordinate system.
  • the RCM constrained movement can be realized by setting the task freedom of the distal end of the robotic arm, which is only related to the posture freedom.
  • the task degree of freedom of the distal end of the arm body can be understood as the degree of freedom that the distal end of the arm body allows to move in Cartesian space, which is at most 6 degrees.
  • the actual degree of freedom of the distal end of the arm body in Cartesian space is the effective degree of freedom, and the effective degree of freedom of the distal end of the arm body is related to its configuration (ie structural feature).
  • the effective degree of freedom of the distal end of the arm body can be understood as the arm body.
  • the degree of freedom that the distal end can achieve in Cartesian space.
  • the fixed point has a relatively fixed positional relationship with the distal end of the mechanical arm.
  • the origin of the second coordinate system in some embodiments may be the fixed point, and in other embodiments, the origin of the second coordinate system may also be a certain point on the distal end of the robotic arm.
  • step S2 that is, the decomposition step, it may include:
  • Step S211 Obtain the input operation command associated with the task freedom of the distal end of the robotic arm.
  • Step S212 Decompose each initial target pose information according to the degree of freedom of the task to obtain the first component target pose information of the distal end of the manipulator in the first coordinate system and the second component target of the controlled operation terminal device in the second coordinate system. A group of pose information collections.
  • the operation command may include a first operation command and a second operation command.
  • the first operation command is related to the situation that the task degree of freedom of the distal end of the robot arm 21 and the effective degree of freedom of the robot arm 21 completely match, so that the distal end of the robot arm can move freely within the effective degree of freedom of the robot arm;
  • the second operation command Related to the situation that the task freedom of the distal end of the robotic arm 21 is completely matched with the posture freedom of the effective freedom of the robotic arm 21, this second operation command corresponds to the above-mentioned RCM constraint movement, so that when the robotic arm 21 moves Make sure that its distal end, that is, the power mechanism 22 moves around a fixed point.
  • step S211 when the second operation command is obtained in step S211, the information related to the position freedom degree in the first component target pose information obtained by decomposition remains unchanged, but only the information related to the attitude degree of freedom changes. In this way, the distal end of the mechanical arm 21 moves around a fixed point, and the movement of the controlled operation end instrument 34B is mainly relied on to achieve the desired posture, which can ensure the safety of the operation.
  • step S2 that is, the decomposition step, it may include:
  • Step S221 acquiring the current pose information of the distal end of the robotic arm in the first coordinate system
  • Step S222 Under the condition that the distal end of the manipulator remains in the current pose corresponding to the current pose information, the initial target pose information is converted to obtain the second component target pose information;
  • Step S223 Judging the validity of the second component target pose information
  • step S224 if the second component target pose information is valid, go to step S224; otherwise, go to step S225.
  • Step S224 under the condition that the controlled terminal device reaches the target pose corresponding to the second component target pose information, convert the initial target pose information to obtain the first component target pose information;
  • Step S225 Adjust the second component target pose information to be valid and update the second component target pose information, and under the condition that the controlled operation terminal device reaches the target pose corresponding to the updated second component target pose information , Convert the initial target pose information to obtain the first component target pose information.
  • the corresponding operation arm is adjusted first. If the movement of the operation arm meets the adjustment of the controlled operation end device, only the operation arm movement is required. ; If the movement of the operating arm cannot meet the adjustment of the controlled operation terminal equipment, it can be adjusted in conjunction with the movement of the mechanical arm.
  • the first judgment step since the second component target pose information itself is valid or effective after adjustment, it is actually only necessary to judge the first component target pose information.
  • the pose information is valid, it can be judged that the corresponding pose information set is valid; otherwise, it can be judged that the pose information set is invalid.
  • T2 is the tool coordinate system of the controlled operation end instrument 34B
  • T1 is the tool coordinate system of the robotic arm
  • B is the base coordinate system of the robotic arm.
  • step S223 If it is determined in step S223 Is invalid, you can change Adjusted to be effective, and then due to with Is known, calculate
  • steps S1' to S6' of the control method shown in FIG. 25 are substantially the same as steps S1 to S6 of the control method shown in FIG. ,
  • the control method shown in Figure 25 includes:
  • Step S1' the obtaining step, namely obtaining the initial target pose information of each controlled operation end device.
  • the operating end device 34B installed on the power mechanism 22 includes a controlled operating end device (an operating end device that needs to be controlled by a motion input device) and an uncontrolled operating end device that is not configured (no need to use a motion input device). Controlled operating end equipment). One operator can control at most two controlled operation end devices 34B at the same time. When there are more than two controlled operation end devices 34B, more than two operators can perform coordinated control.
  • Step S2' decomposition step, that is, decomposing each initial target pose information to obtain a group of pose information sets.
  • each set of pose information includes the first component target pose information of the distal end of the robotic arm in the first coordinate system and the second component target pose information of the controlled operation terminal device in the second coordinate system.
  • the first coordinate system refers to the base coordinate system of the robotic arm
  • the second coordinate system refers to the tool coordinate system of the robotic arm.
  • Step S3' the first judging step, namely judging the validity of each set of pose information.
  • the validity of the two component pose information included in each group of pose information set is judged. When the two component pose information are both valid, the set of pose information is considered valid. Otherwise, the set of pose information is considered valid. The pose information collection is deemed invalid.
  • Step S4' the calculation step, that is, under the condition that at least one set of pose information is valid, and the image end device and each uncontrolled operation end device are kept in the current pose, the robot arm is calculated by combining each set of pose information The first target pose information of the distal end in the first coordinate system, the second target pose information of the image terminal device in the second coordinate system, and the third target pose information of each controlled operation end device in the second coordinate system And the fourth target pose information of each uncontrolled operation end device in the second coordinate system.
  • the uncontrolled operation end devices 34B can be maintained in the current posture; and it is preferred that each controlled operation end device 34B can reach the first desired posture. If several controlled operation end devices 34B cannot reach the first desired posture, If a desired posture is desired, it is expected that these controlled operation end instruments 34B that cannot reach the first desired posture can reach the second desired posture.
  • the first expected pose refers to two situations where the target pose corresponding to the initial target pose information (including the initial target pose (which is associated with the motion information input by the controlled motion input device) is consistent with or inconsistent with the current pose ).
  • the second desired posture refers to the current posture. When several controlled operation end instruments 34B cannot reach the first desired posture, it is intended to ensure that it/they can reach the second desired posture to ensure the safety of the operation.
  • Step S5' the second judgment step, is to judge the validity of the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information.
  • Step S6' the control step, that is, when the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information are all valid, control according to the first target pose information
  • the manipulator moves to make the distal end of the manipulator reach the corresponding target pose, and controls the movement of the operating arm corresponding to the end-of-image instrument according to the second target pose information to keep the end-of-image instrument at the current pose, according to each third target pose
  • the information control corresponds to the movement of the operating arm of the controlled operation end device to make the controlled operation end device reach the corresponding target pose, and controls the movement of the operating arm corresponding to the uncontrolled operation end device according to the fourth target pose information. Keep each uncontrolled operation end instrument in the current posture.
  • the image can be maintained
  • the end device 34A and the uncontrolled operation end device 34B are in the current posture to provide a stable field of view, while the controlled operation end device 34B reaches the first desired posture or the second desired posture; in addition, it can be used in certain scenarios Combining the mechanical arm and the corresponding operating arm to move together, the movement range of the controlled operating end instrument 34B is expanded, so that the operation can be performed more easily.
  • step S3' if all the posture information sets obtained by the judgment are invalid, it means that all controlled operation end devices 34B (including one or more controlled operation end devices) are not It is adjustable, so it does not enter the subsequent steps, that is, ends the control, and returns to step S1'.
  • the foregoing step S4' that is, the calculation step includes:
  • Step S411' under the condition that the distal end of the robotic arm reaches the target pose information corresponding to the first component target pose information, convert the current pose information of the image end instrument to obtain its target pose information in the second coordinate system, and Convert the current pose information of each uncontrolled operation terminal device to obtain its target pose information in the second coordinate system.
  • the current pose information of each end device 34 can be the first coordinate system or the second coordinate system, or other reference coordinate systems. These coordinate systems can essentially interact with each other. Converted.
  • "current pose information” refers to current pose information in the second coordinate system, and of course, it can also be current pose information in other coordinate systems.
  • Step S412' assign the first component target pose information to the first target pose information, assign the converted target pose information of the image end instrument in the second coordinate system to the second target pose information, and assign the second target pose information to the target pose information.
  • the component target pose information is assigned to the third target pose information, and the target pose information of each uncontrolled operation end device in the second coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
  • step S5' that is, the second judgment step
  • the pose information set since the pose information set has been determined to be valid, the first target pose information and the third target pose information are valid. Therefore, it is actually only necessary to determine whether the second target pose information and each fourth target pose information are valid.
  • step S6' which is the control step.
  • the operation end device 34B includes a controlled operation end device 34B1 and an uncontrolled operation end device 34B2.
  • the robot arm 21 is controlled to move so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operation arm 31A is controlled to move according to the second target pose information to keep the image end instrument 34A at the current position.
  • the calculation step includes:
  • Step S421' under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the effective pose information set, convert the current pose information of the image end device to obtain its second coordinate System target pose information, convert the current pose information of each uncontrolled operation end device to obtain its target pose information in the second coordinate system, and convert the control operation end device associated with each invalid pose information
  • the current pose information obtains its second desired target pose information in the second coordinate system.
  • Step S422' assign the first component target pose information in the effective pose information set to the first target pose information, and assign the target pose information of the image end instrument in the second coordinate system to the second target pose Information, assign the second component target pose information in the effective pose information set to the third target pose information of the associated controlled operation end device, and assign each second expected target pose to the corresponding controlled operation
  • the third target pose information of the end device, the target pose information of each uncontrolled operation end device in the second coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
  • step S5' is the second judgment step, it is actually only necessary to judge the second target pose information of the end image device 34A and the third target pose information of the controlled operation end device 34B associated with each invalid pose information set. Is it valid?
  • step S6' which is a control step.
  • the operation end equipment 34B includes controlled operation end equipment 34B1 to 34B3 and an uncontrolled operation end equipment 34B4. If the set of posture information associated with the controlled operation end device 34B1 is valid, and the two sets of posture information associated with the controlled operation end device 34B2 ⁇ 34B3 are invalid:
  • the third target pose information of each of ⁇ 34B3 controls the movement of the operating arms 31C ⁇ 31D so that the controlled operation end instruments 34B2 ⁇ 34B3 reach the corresponding target pose (the second desired pose, that is, maintain the current pose), and according to the first
  • the four-target pose information controls the movement of the operating arm 31E to keep the uncontrolled operating end device 34B4 in the current pose.
  • Steps S1' to S6' including steps S421' to S422' are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B shown in FIG. 29, but also applicable to the same robotic arm 21 having two One or more than four controlled-operation end devices 34B.
  • the foregoing step S4' that is, the calculation step includes:
  • Step S431' under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain the target pose information.
  • Target pose information in the second coordinate system is converted to obtain the target pose information.
  • Step S432' judging the validity of each target pose information of the image terminal device in the second coordinate system.
  • step S433' if only one of the target pose information of the end image device is valid, step S433' is entered; if more than two of the target pose information of the end image device are valid, step S438' is entered.
  • Step S433' under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, the conversion is
  • the current pose information of each controlled end device associated with the invalid target pose information set obtains its second expected target pose information in the second coordinate system
  • the current pose information of each uncontrolled end device is obtained by conversion Its target pose information in the second coordinate system, and convert the initial target pose information of each controlled terminal device associated with the remaining effective target pose information sets to obtain its first expected target position in the second coordinate system Posture information.
  • step S434' the validity of each first desired target pose information is judged.
  • step S435' if all the first desired target pose information is valid, go to step S435'; if at least part of the first desired target pose information is invalid, go to step S436'.
  • Step S435' assign the first component target pose information in the pose information set associated with the target pose information of the effective end image device to the first target pose information, and assign the target pose information of the effective end image device
  • the information is assigned to the second target pose information
  • the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Pose information, assign each first desired target pose information and each second desired target pose information to the third target pose information of the corresponding controlled operation end device, and place each uncontrolled operation end device in the first
  • the target pose information of the two-coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
  • the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; the second desired target pose information is correspondingly assigned to be associated with the invalid target pose information set The third target pose information of the controlled operation end device.
  • Step S436' under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, the conversion and The current pose information of the controlled operation end device associated with each invalid first desired target pose information obtains its second desired target pose information in the second coordinate system.
  • Step S437' assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose of the effective end-of-image equipment
  • the information is assigned to the second target pose information
  • the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Pose information
  • each valid first desired target pose information is assigned to the third target pose information of the corresponding controlled operation end device
  • each second desired target pose information obtained at different stages (ie, conditions) is assigned Respectively assign values to the third target pose information of the corresponding controlled operation end device, and assign the target pose information of each uncontrolled operation end device in the second coordinate system to the fourth target position of the corresponding uncontrolled operation end device Posture information.
  • the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; each second desired target pose information is associated with two situations, one of which is related to invalid
  • the target pose information set in the other case is related to the invalid first expected target pose information (converting the first expected pose to the second expected pose), so it needs to be assigned correspondingly to the recipient associated with the corresponding situation.
  • step S438' one of the valid target pose information of the end-of-picture equipment is selected as valid, and the rest are regarded as invalid, and step S433' is entered when only one of the target pose information of the end-of-picture equipment is valid.
  • step S438' it is possible to configure and form a variety of combinations that regard the target pose information of multiple valid end-of-image devices as valid and invalid, and use the aforementioned steps S433' to S437' to perform calculations.
  • a set of the calculated first target pose information, second target pose information, and each third target pose information are all valid for the control step of step S6'.
  • step S6' Control steps if more than two sets of correspondingly calculated first target pose information, second target pose information, each third target pose information, and each fourth target pose information in different combinations are valid. Then, according to some measurement indicators, it can be determined to select a group in which the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information are all valid to perform step S6' Control steps.
  • These metrics include, but are not limited to, more than one of the range of motion, motion speed, and motion acceleration of the arm (mechanical arm or manipulator arm), such as smaller arm motion range, lower motion speed, and lower motion acceleration. One or more of them are used to select the first target pose information, the second target pose information, and each third target pose information used in step S6'.
  • These metrics include, but are not limited to, the number of controlled-operated end devices that can achieve the first expected pose and the second expected pose. It is preferred to control the number of poses that can reach the first expected pose. These measurement indicators can also be combined with each other to select an optimal group for the control of step S6'.
  • the priority can be set for each controlled terminal device in advance or in real time (for example, by voice command) during the operation of the controlled terminal device, and in step S438', the recipients with higher priority are selected in turn.
  • the target pose information of the effective image end device associated with the control operation end device is considered valid, and the rest is considered invalid, so as to ensure that the control object with a higher priority can achieve the first desired pose as much as possible.
  • the priority setting can be set according to the authority of the operator, or can be set according to the specific control object, which can be flexibly configured.
  • the operation end equipment 34B includes controlled operation end equipment 34B1 to 34B3 and an uncontrolled operation end equipment 34B4.
  • the set of posture information associated with the controlled operation end device 34B1 is invalid, and the two sets of posture information associated with the controlled operation end device 34B2 ⁇ 34B3 are all valid, the calculation is related to the controlled operation end device according to the above step S431'
  • the target pose information of the image end instruments of 34B2 and 34B3 in the second coordinate system are C2 and C3, respectively.
  • the target pose information of the controlled operation end device 34B1 in the second coordinate system is calculated according to step S433' Posture information), the target posture information of the controlled operation end device 34B3 in the second coordinate system (the first desired target posture information), and the target posture information of the uncontrolled operation end device 34B4 in the second coordinate system.
  • step S434' it is determined that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is valid:
  • step S6' the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image
  • the instrument 34A maintains the current pose, and controls the movement of the operating arm 31B according to the third target pose information of the controlled operation end device 34B1 to make the controlled operation end device 34B reach the corresponding target pose (the second desired pose, that is, maintain the current Posture), according to the third target posture information of the controlled operation end devices 34B2 to 34B3, the operation arms 31C to 31D are controlled to move so that the controlled operation end devices 34B2 to 34B3 reach the corresponding target posture (the first desired posture). ), and control the movement of the operating arm 31E according to the fourth target pose information to keep the uncontrolled operating
  • step S434' Assuming that it is determined according to step S434' that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is invalid:
  • the second expected target pose information of the controlled operation end device 34B3 in the second coordinate system is calculated according to step S436', and After the value is assigned in step S437', the process proceeds to step S5', and when the first to fourth target pose information is valid, the process proceeds to step S6'.
  • step S6' the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image
  • the instrument 34A maintains the current pose, and controls the movement of the operating arms 31B, 34D according to the third target pose information of the controlled operating end devices 34B1, 34B3 so that the controlled operating end devices 34B1, 34B3 reach the corresponding target poses (second The desired posture, that is, the current posture is maintained), and the movement of the operating arm 31C is controlled according to the third target posture information of the controlled operation end device 34B2 to make the controlled operation end device 34B2 reach the corresponding target posture (the first desired position) Posture), and control the movement of the operating arm 31E according to the fourth target posture information to keep the uncontrolled operating end device 34B4 in the current posture.
  • Steps S1' to S6' including steps S431' to S438' are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B shown in FIG. 29, but also applicable to the same robotic arm 21 having four controlled operation end devices 34B according to its principle. More than one controlled operation end device 34B.
  • step S4' when there are more than two (including two or more) controlled end devices, and each posture information set is valid, the above step S4', that is, the calculation step includes:
  • Step S441' under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in each valid pose information set, the current pose information of the image end device is respectively converted to obtain the target pose information.
  • Target pose information in the second coordinate system is respectively converted to obtain the target pose information.
  • Step S442' judging the validity of each target pose information of the image terminal device in the second coordinate system.
  • step S443' if only one of the target pose information of the end image device is valid, step S443'; if more than two of the target pose information of the end image device are valid, step S448'.
  • Step S443' under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, convert each The current pose information of the uncontrolled operation terminal device obtains its target pose information in the second coordinate system, and the initial target pose information of each controlled operation terminal device associated with the remaining effective target pose information set is converted to obtain it.
  • step S444' the validity of each first desired target pose information is judged.
  • step S445' if all the first desired target pose information is valid, go to step S445'; if at least part of the first desired target pose information is invalid, go to step S446'.
  • Step S445' assign the first component target pose information in the pose information set associated with the target pose information of the effective end image device to the first target pose information, and assign the target pose information of the effective end image device
  • the information is assigned to the second target pose information
  • the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device
  • Posture information assign each first desired target posture information to the third target posture information of the corresponding controlled operation end device, and assign the target posture information of each uncontrolled operation end device in the second coordinate system to The fourth target pose information of the corresponding uncontrolled operation end device.
  • Step S446' under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, the conversion and The current pose information of the controlled operation end device associated with each invalid first desired target pose information obtains its second desired target pose information in the second coordinate system.
  • Step S447' assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose of the effective end-of-image equipment
  • the information is assigned to the second target pose information
  • the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Pose information
  • each valid first desired target pose information is assigned to the third target pose information of the corresponding controlled operation end device
  • each second desired target pose information is assigned to the corresponding controlled operation
  • the third target pose information of the end device, the target pose information of each uncontrolled operation end device in the second coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
  • the second expected target pose information here is only associated with the invalid first expected target pose information (converting the first expected pose to the second expected pose).
  • step S448' one of the valid target pose information of the end-of-picture equipment is selected as valid, and the rest are regarded as invalid, and step S443' is entered when only one of the target pose information of the end-of-picture equipment is valid.
  • the operation end equipment 34B includes controlled operation end equipment 34B1 to 34B3 and an uncontrolled operation end equipment 34B4. Assuming that the three sets of pose information associated with the controlled operation end devices 34B1 to 34B3 are all valid, the image end devices associated with the controlled operation end devices 34B1, 34B2, and 34B3 calculated according to the above step S441' are the targets in the second coordinate system
  • the pose information is C1, C2, C3, respectively.
  • the target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system (the first expectation) is calculated according to step S433' Target pose information), and calculate the target pose information of the uncontrolled operation end device 34B4 in the second coordinate system according to step S433' (same as the second expected target pose).
  • step S444 it is determined that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system are both valid:
  • step S6' the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image
  • the instrument 34A maintains the current pose, and controls the operating arms 31B to 31D to move to the corresponding target pose (the first desired pose) according to the third target pose information of the controlled operation end devices 34B1 to 34B3, and according to the fourth target pose.
  • the target pose information controls the movement of the operating arm 31E so that the uncontrolled operating end device 34B4 is maintained in the current pose.
  • step S444' it is determined according to step S444' that the first expected target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system is at least partially invalid, for example, the controlled operation end device 34B2 is in the first expected target position of the second coordinate system
  • the pose information is valid, and the controlled operation terminal device 34B3 is invalid in the first desired target pose information in the second coordinate system:
  • the second expected target pose information of the controlled operating end device 34B3 in the second coordinate system is calculated according to step S446', and After the value is assigned in step S447', the process proceeds to step S5', and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6'.
  • step S6' the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image
  • the instrument 34A maintains the current pose, and controls the operating arms 31B-31C to move to the corresponding target pose (the first desired pose) according to the third target pose information of the controlled operation terminal device 34B1-34B2, and operates according to the controlled operation
  • the third target pose information of the end device 34B2 controls the movement of the operating arm 31D to reach the corresponding target pose (the second desired pose), and controls the movement of the operating arm 31E according to the fourth target pose information to make the uncontrolled operation end
  • the instrument 34B4 remains in the current posture.
  • step S444' Assuming that it is determined according to step S444' that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system is invalid:
  • the second expected target pose information of the controlled operation end device 34B2 and 34B3 in the second coordinate system is calculated according to step S446' . And after assigning values through step S447', proceed to step S5', and when the first target pose information, second target pose information, and each third target pose information are all valid, proceed to step S6'.
  • step S6' the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image
  • the instrument 34A maintains the current pose, and controls the operating arm 31B to move to the corresponding target pose (first desired pose) according to the third target pose information of the controlled operation end device 34B1, and according to the controlled operation end device 34B2,
  • the third target pose information of 34B3 controls the movement of the operating arms 31C and 31D to reach the corresponding target poses (the second desired pose), and controls the motion of the operating arm 31E according to the fourth target pose information to make the uncontrolled operation end
  • the instrument 34B4 remains in the current posture.
  • Steps S1' to S6' including steps S441' to S448' are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B as shown in FIG. 29, but also applicable to the same robotic arm 21 having two controlled operation end devices 34B according to its principle. In the case of one, or more than four controlled-operation end devices 34B.
  • the number of uncontrolled operation end devices is not limited.
  • the controlled operating end device 34B can reach the first posture under the condition that the image end device 34A and the uncontrolled end device are kept in the current posture.
  • a desired posture achieves the purpose of the operation. If the first desired posture cannot be reached, it will try to ensure that the controlled operation end instrument 34B remains in the current posture to reduce the operation risk.
  • the step of judging the validity of the arbitrarily obtained target pose information includes:
  • Step S71 Analyze the target pose information into target motion state parameters of each joint component in the corresponding arm body.
  • step S72 the target motion state parameter of each joint component in the arm body is compared with the motion state threshold value of each joint component in the arm body.
  • Step S73 if more than one target motion state parameter of each joint component in the arm body exceeds the motion state threshold of the corresponding joint component, then it is judged that the target pose information is invalid; if the target motion state parameter of each joint component in the arm body does not exceed According to the motion state threshold of the corresponding joint component, it is judged that the target pose information is valid.
  • the motion state of each joint component in the arm body that exceeds the motion state threshold can be adjusted to within the corresponding motion state threshold to make it effective.
  • the motion state of each joint component in the arm body that exceeds the motion state threshold can be adjusted to the corresponding motion state threshold to make it effective, so that the operating arm can be moved to the limit as much as possible, and then adjusted with the mechanical arm.
  • the above-mentioned embodiments are suitable for controlling end instruments in a surgical robot of the type shown in FIG. 1.
  • This type of surgical robot includes a robotic arm 21 and one or more operating arms 31 with end instruments 34 installed at the distal end of the robotic arm 21, and both the robotic arm 21 and the operating arm 31 have several degrees of freedom.
  • the above-mentioned embodiments are also suitable for controlling end instruments in a surgical robot of the type shown in FIG. 33.
  • This type of surgical robot includes a main arm 32', one or more adjustment arms 30' installed at the distal end of the main arm 32', and one or more operating arms 31 with end instruments installed at the distal end of the adjustment arm 30' ', the main arm 32', the adjusting arm 30' and the operating arm 31' all have several degrees of freedom.
  • four adjustment arms 30' can be provided, and each adjustment arm 30' can be provided with only one operation arm 31'.
  • each adjustment arm 30' in the type of surgical robot shown in FIG. 33 can be regarded as The mechanical arm 21 in the surgical robot of the type shown in FIG. 1 is controlled; for example, according to the configuration, any adjustment arm 30' and the main arm 32' of the surgical robot of the type shown in FIG. It is considered that the robotic arm 21 in the surgical robot of the type shown in FIG. 1 performs control.
  • control method of a surgical robot is usually configured to be implemented in a processing system of the surgical robot, and the processing system has more than one processor.
  • a computer-readable storage medium stores a computer program configured to be executed by more than one processor to implement the control method described in any one of the above embodiments. step.
  • the surgical robot, its control method, and computer-readable storage medium of the present application have the following beneficial effects:
  • the end-of-image instrument 34A is controlled to move to maintain the current pose, and the end of the operation can be expanded by the movement of the robotic arm 21 while maintaining the same field of view.
  • the operating space of the device 34B is convenient and safe to use.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Robotics (AREA)
  • Surgery (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Manipulator (AREA)

Abstract

A surgical robot and a control method and a control device for a distal instrument (34) thereof. The control device is used to perform the following steps: acquire initial target poses of respective first distal instruments in a first coordinate system (S1); dividing respective pieces of initial target pose information to obtain respective groups of pose information sets (S2); when at least one group of pose information sets is valid and respective second distal instruments remain at current poses, combining the respective groups of pose information sets to perform calculation, and obtaining first target pose information of a distal end of a mechanical arm (21) in the first coordinate system, second target pose information of the respective second distal instruments in a second coordinate system and third target pose information; and when the first through third target pose information are valid, respectively controlling, according to the first through third target pose information, movement of the mechanical arm (21), a manipulator (31) corresponding to the first distal instrument and a manipulator (31) corresponding to the second distal instrument. The invention enables a surgical field of vision to remain unchanged while expanding a space for operating a distal instrument (34B).

Description

手术机器人及其末端器械的控制方法、控制装置Surgical robot and control method and control device of its terminal equipment
本申请要求于2019年09月10日提交中国专利局、申请号为CN 201910854900.5、申请名称为“手术机器人及其末端器械的控制方法、控制装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。本申请还要求于2019年09月10日提交中国专利局、申请号为CN 201910854104.1、申请名称为“手术机器人及末端器械的控制方法、控制装置、存储介质”的中国专利申请的优先权,其全部内容同样通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the Chinese Patent Office on September 10, 2019, the application number is CN 201910854900.5, and the application name is "control methods and control devices for surgical robots and their end devices", all of which are approved The reference is incorporated in this application. This application also requires the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is CN 201910854104.1, and the application title is "control methods, control devices, and storage media for surgical robots and end devices" on September 10, 2019. The entire content is also incorporated in this application by reference.
技术领域Technical field
本申请涉及医疗器械领域,特别是涉及一种手术机器人及其末端器械的控制方法、控制装置。This application relates to the field of medical equipment, and in particular to a control method and control device of a surgical robot and its terminal equipment.
背景技术Background technique
微创手术是指利用腹腔镜、胸腔镜等现代医疗器械及相关设备在人体腔体内部施行手术的一种手术方式。相比传统手术方式微创手术具有创伤小、疼痛轻、恢复快等优势。Minimally invasive surgery refers to the use of laparoscopy, thoracoscopy and other modern medical instruments and related equipment to perform surgery inside the body cavity. Compared with traditional surgical methods, minimally invasive surgery has the advantages of less trauma, less pain, and faster recovery.
随着科技的进步,微创手术机器人技术逐渐成熟,并被广泛应用。微创手术机器人通常包括主操作台及从操作设备,主操作台包括手柄,医生通过操作手柄向从操作设备发送控制命令,从操作设备包括机械臂及安装于机械臂远端的多个操作臂,操作臂具有末端器械,在工作状态时,末端器械跟随手柄移动,以实现远程手术操作。With the advancement of science and technology, minimally invasive surgery robot technology has gradually matured and been widely used. Minimally invasive surgical robots usually include a master operating table and a slave operating device. The master operating table includes a handle. The doctor sends control commands to the slave operating device through the operating handle. The slave operating device includes a robotic arm and multiple operating arms mounted on the distal end of the robotic arm. , The operating arm has end instruments, which move with the handle when in working state to realize remote surgical operations.
末端器械包括提供手术视野的图像末端器械及执行手术操作的操作末端器械,常期望手术时在固定视野下为操作末端器械提供更大的运动范围(即操作空间,亦可理解为灵活性),但由于受限于操作臂自身运动范围较小,可以考虑结合机械臂的运动来扩大其运动范围。然而,机械臂远端位姿的改变又容易导致不期望的视野发生改变的问题,可能影响手术安全性。End instruments include image end instruments that provide a surgical field of view and operating end instruments that perform surgical operations. It is often expected that a larger range of motion (that is, operating space, or flexibility) can be provided for operating end instruments under a fixed field of view during surgery. However, due to the limited range of motion of the operating arm itself, it can be considered to expand its range of motion in combination with the motion of the robotic arm. However, changes in the posture of the distal end of the robotic arm can easily lead to undesirable changes in the visual field, which may affect the safety of the operation.
发明内容Summary of the invention
基于此,有必要提供一种可扩大操作末端器械运动范围的同时保持视野不变的手术机器人及其末端器械的控制方法、控制装置。Based on this, it is necessary to provide a surgical robot and a control method and a control device for the end instrument that can expand the motion range of the operating end instrument while keeping the visual field unchanged.
一方面,提供一种手术机器人中末端器械的控制方法,所述控制方法包括:获取步骤,获取各所述受控操作末端器械的初始目标位姿信息;分解步骤,分解各所述初始目标位姿信息分别获得一组位姿信息集合,每组所述位姿信息集合包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述受控操作末端器械在第二坐标系的第二分量目标位姿信息,第一坐标系指所述机械臂的基坐标系,第二坐标系指所述机械臂的工具坐标系;第一判断步骤,对各组所述位姿信息集合的有效性进行判断;计算步骤,在至少有一组所述位姿信息集合有效且在所述图像末端器械保持于当前位姿的条件下,结合各组所述位姿信息集合计算所述机械臂远端在第一坐标系的第一目标位姿信息、所述图像末端器械在第二坐标系的第二目标位姿信息、及各所述受控操作末端器械分别在第二坐标系的第三目标位姿信息;第二判断步骤,对所述第一目标位姿信息、所述第二目标位姿信息及各所述第三目标位姿信息的有效性进行判断;控制步骤,在所述第一目标位姿信息、所述第二目标位姿信息及各所述第三目标位姿信息均有效时,根据所述第一目标位姿信息控制所述机械臂运动以使所述机械臂远端到达对应的目标位姿,根据所述第二目标位姿信息控制所述图像末端器械对应的操作臂运动以使所述图像末端器械保持于当前位姿,并根据各所述第三目标位姿信息控制对应所述受控操作末端器械的操作臂运动以使所述受控操作末端器械到达对应的目标位姿。In one aspect, there is provided a control method of an end instrument in a surgical robot. The control method includes: an obtaining step of obtaining initial target pose information of each of the controlled operation end instruments; a decomposition step of decomposing each of the initial target positions The pose information obtains a set of pose information, each set of pose information includes the first component target pose information of the distal end of the manipulator in the first coordinate system and the end device of the controlled operation in the second coordinate system. The target pose information of the second component of the coordinate system, the first coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm; The validity of the pose information set is judged; in the calculation step, when at least one set of the pose information set is valid and the image end device is kept in the current pose, the calculation method is combined with each set of the pose information set. The first target pose information of the distal end of the robotic arm in the first coordinate system, the second target pose information of the image end device in the second coordinate system, and the control operation end devices in the second coordinate system respectively The third target pose information of the system; the second judgment step is to judge the validity of the first target pose information, the second target pose information, and each of the third target pose information; control step , When the first target pose information, the second target pose information, and each of the third target pose information are all valid, the robot arm is controlled to move according to the first target pose information to make The distal end of the robotic arm reaches the corresponding target pose, and the motion of the operating arm corresponding to the end-of-image instrument is controlled according to the second target pose information so that the end-of-image instrument is maintained in the current pose, and according to each The third target pose information controls the movement of the operating arm corresponding to the controlled operation end device so that the controlled operation end device reaches the corresponding target pose.
其中,所述受控操作末端器械为一个,且所述位姿信息集合有效时,所述计算步骤包括:在所述机械臂远端到达与所述第一分量目标位姿信息对应的目标位姿的条件下,换算所述图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息;将所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将换算获得的所述图像末端器械在第二坐标系的目标位姿信息赋 值成所述第二目标位姿信息,将所述第二分量目标位姿信息赋值成所述第三目标位姿信息。Wherein, when there is one controlled operation terminal device and the pose information set is valid, the calculation step includes: reaching a target position corresponding to the first component target pose information at the distal end of the robotic arm Under the condition of the pose, convert the current pose information of the image terminal device to obtain its target pose information in the second coordinate system; assign the first component target pose information to the first target pose information, Assign the converted target pose information of the image terminal device in the second coordinate system to the second target pose information, and assign the second component target pose information to the third target pose information .
其中,所述受控操作末端器械为两个以上,且一个所述位姿信息集合有效、其余所述位姿信息集合无效时,所述计算步骤包括:在所述机械臂远端到达与有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算所述图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,并换算与各无效的所述位姿信息关联的所述受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;将有效的所述位姿信息集合中的第一分量目标位姿信息赋值成所述第一目标位姿信息,将所述图像末端器械在第二坐标系的目标位姿信息赋值成所述第二目标位姿信息,将有效的所述位姿信息集合中的第二分量目标位姿信息赋值成关联的所述受控操作末端器械的第三目标位姿信息,将各所述第二期望目标位姿分别赋值成相应所述受控操作末端器械的第三目标位姿信息。Wherein, when there are more than two controlled operation end instruments, and one of the pose information sets is valid, and the rest of the pose information sets are invalid, the calculation step includes: reaching and validating at the distal end of the robotic arm Under the condition of the target pose corresponding to the first component target pose information in the pose information set, convert the current pose information of the image end device to obtain its target pose information in the second coordinate system, and Convert the current pose information of the controlled terminal device associated with each invalid pose information to obtain its second desired target pose information in the second coordinate system; add the valid pose information to the set The first component of the target pose information is assigned to the first target pose information, and the target pose information of the image end instrument in the second coordinate system is assigned to the second target pose information, which will effectively The second component target pose information in the pose information set is assigned to the associated third target pose information of the controlled operation end device, and each of the second expected target poses is assigned to the corresponding recipient. Control the third target pose information of the terminal device.
其中,所述受控操作末端器械为多个,且两个以上所述位姿信息集合有效、其余所述位姿信息集合无效时,所述计算步骤包括:在所述机械臂远端到达与相应于各有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算所述图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息;对所述图像末端器械在第二坐标系的各目标位姿信息的有效性进行判断;在所述图像末端器械的各目标位姿信息中仅一个有效时,在所述机械臂远端到达与有效的所述图像末端器械的目标位姿信息关联的、有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的所述目标位姿信息集合关联的各所述受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息,并换算与其余有效的所述目标位姿信息集合关联的各所述受控操作末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息;对各所述第一期望目标位姿信息的有效性进行判断;如果各所述第一期望目标位姿信息均有效,将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集 合中的第一分量目标位姿信息赋值成所述第一目标位姿信息,将有效的所述图像末端器械的目标位姿信息赋值成所述第二目标位姿信息,将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集合中的第二分量目标位姿信息赋值成关联的所述受控操作末端器械的第三目标位姿信息,将各所述第一期望目标位姿信息及各所述第二期望目标位姿信息分别赋值成对应的所述受控操作末端器械的第三目标位姿信息;如果各所述第一期望目标位姿信息中至少部分无效,在所述机械臂远端到达与有效的所述图像末端器械的目标位姿信息关联的、有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的各所述第一期望目标位姿信息关联的所述受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;将关联于有效的所述图像末端器械的目标位姿信息所述位姿信息集合中的第一分量目标位姿信息赋值成所述第一目标位姿信息,将有效的所述图像末端器械的目标位姿信息赋值成所述第二目标位姿信息,将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集合中的第二分量目标位姿信息赋值成关联的所述受控操作末端器械的第三目标位姿信息,将有效的各所述第一期望目标位姿信息分别赋值成对应的所述受控操作末端器械的第三目标位姿信息,将各所述第二期望目标位姿信息分别赋值成对应的所述受控操作末端器械的第三目标位姿信息;在所述图像末端器械的各目标位姿信息中两个以上有效时,选择将有效的所述图像末端器械的目标位姿信息中的一个作为有效、将其余作为无效,进入在所述图像末端器械的各目标位姿信息中仅一个有效时的步骤。Wherein, when there are a plurality of the controlled operation end devices, and two or more of the pose information sets are valid, and the rest of the pose information sets are invalid, the calculation step includes: reaching and Corresponding to the target pose corresponding to the first component target pose information in each valid pose information set, respectively convert the current pose information of the image end device to obtain its target in the second coordinate system Pose information; judge the validity of each target pose information of the end image device in the second coordinate system; when only one of the target pose information of the end image device is valid, the robot arm Under the condition that the remote end reaches the target pose corresponding to the first component target pose information in the effective pose information set that is associated with the effective target pose information of the end-of-image device, the conversion and the invalid target pose are converted. The current pose information of each controlled terminal device associated with the target pose information set obtains its second expected target pose information in the second coordinate system, and converts it to the rest of the effective target pose information set The associated initial target pose information of each of the controlled operation end instruments obtains its first expected target pose information in the second coordinate system; the validity of each of the first expected target pose information is judged; if Each of the first desired target pose information is valid, and the first component target pose information in the pose information set associated with the target pose information of the effective end image device is assigned to the first Target pose information, assigning the effective target pose information of the end image device to the second target pose information, and associate the pose information with the effective target pose information of the end image device The second component target pose information in the set is assigned to the associated third target pose information of the controlled operation end device, and each of the first expected target pose information and each of the second expected target poses The information is respectively assigned to the corresponding third target pose information of the controlled operation end device; if at least part of the first expected target pose information is invalid, the effective one will be reached at the distal end of the robotic arm. Under the condition of the target pose corresponding to the first component target pose information in the effective pose information set associated with the target pose information of the end-of-image equipment, convert and invalid each of the first expected target poses Information related to the current pose information of the controlled operation end device obtains its second desired target pose information in the second coordinate system; the target pose information of the effective end device of the image is associated with the pose information The first component target pose information in the information set is assigned to the first target pose information, and the effective target pose information of the end image device is assigned to the second target pose information, which will be associated with the effective target pose information. The second component target pose information in the pose information set of the target pose information of the end image device is assigned to the third target pose information of the associated controlled operation end device, which will be valid for each The first desired target pose information is respectively assigned to the corresponding third target pose information of the controlled operation end device, Assign each of the second desired target pose information to the corresponding third target pose information of the controlled operation end device; when two or more of the target pose information of the image end device are valid, Selecting one of the valid target pose information of the end-of-image device as valid, and invalidating the rest, enters the step when only one of the target pose information of the end-of-image device is valid.
其中,所述受控操作末端器械为两个以上,且各所述位姿信息集合均有效时,所述计算步骤包括:在所述机械臂远端到达与相应于各有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算所述图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息;对所述图像末端器械在第二坐标系的各目标位姿信息的有效性进行判断;在所述图像末端器械的各目标位姿信息中仅一个有效时,在所述机械臂远端到达 与有效的所述图像末端器械的目标位姿信息关联的、有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与其余有效的所述目标位姿信息集合关联的各所述受控操作末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息;对各所述第一期望目标位姿信息的有效性进行判断;如果各所述第一期望目标位姿信息均有效,将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集合中的第一分量目标位姿信息赋值成所述第一目标位姿信息,将有效的所述图像末端器械的目标位姿信息赋值成所述第二目标位姿信息,将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集合中的第二分量目标位姿信息赋值成关联的所述受控操作末端器械的第三目标位姿信息,将各所述第一期望目标位姿信息赋值成对应的所述受控操作末端器械的第三目标位姿信息;如果各所述第一期望目标位姿信息中至少部分无效,在所述机械臂远端到达与有效的所述图像末端器械的目标位姿信息关联的、有效的所述位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的各所述第一期望目标位姿信息关联的所述受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集合中的第一分量目标位姿信息赋值成所述第一目标位姿信息,将有效的所述图像末端器械的目标位姿信息赋值成所述第二目标位姿信息,将关联于有效的所述图像末端器械的目标位姿信息的所述位姿信息集合中的第二分量目标位姿信息赋值成关联的所述受控操作末端器械的第三目标位姿信息,将有效的各所述第一期望目标位姿信息分别赋值成对应的所述受控操作末端器械的第三目标位姿信息,将各所述第二期望目标位姿信息分别赋值成对应的所述受控操作末端器械的第三目标位姿信息;在所述图像末端器械的各目标位姿信息中两个以上有效时,选择将有效的所述图像末端器械的目标位姿信息中的一个作为有效、将其余作为无效,进入在所述图像末端器械的各目标位姿信息中仅一个有效时的步骤。Wherein, when there are more than two controlled operation end instruments, and each of the pose information sets is valid, the calculation step includes: reaching at the distal end of the robotic arm and corresponding to each valid pose Under the condition of the target pose corresponding to the first component target pose information in the information set, the current pose information of the image end device is converted to obtain its target pose information in the second coordinate system; The validity of each target pose information of the instrument in the second coordinate system is judged; when only one of the target pose information of the device at the end of the image is valid, the effective image is reached at the far end of the robotic arm. Under the condition of the target pose information associated with the target pose information of the end device and the target pose corresponding to the first component target pose information in the effective pose information set, convert the target pose information associated with the remaining effective target pose information sets The initial target pose information of each controlled operation terminal device obtains its first expected target pose information in the second coordinate system; the validity of each of the first expected target pose information is judged; if all The first desired target pose information is all valid, and the first component target pose information in the pose information set associated with the target pose information of the effective end image device is assigned to the first target pose Pose information, assigning the effective target pose information of the end image device to the second target pose information, which will be associated with the pose information set of the effective target pose information of the end image device The second component of the target pose information is assigned to the associated third target pose information of the controlled operation end device, and each of the first desired target pose information is assigned to the corresponding control operation end device’s The third target pose information; if at least part of each of the first desired target pose information is invalid, reach at the distal end of the manipulator to a valid all that is associated with the effective target pose information of the end image device Under the condition of the target pose corresponding to the first component target pose information in the pose information set, convert the current pose of the controlled operation end device associated with each invalid desired target pose information The information obtains its second desired target pose information in the second coordinate system; the first component target pose information in the pose information set associated with the target pose information of the effective image end device is assigned to The first target pose information assigns the effective target pose information of the end image device to the second target pose information, which will be associated with all the effective target pose information of the end image device The second component target pose information in the pose information set is assigned to the associated third target pose information of the controlled operation end device, and each valid first expected target pose information is assigned to the corresponding The third target pose information of the controlled operation end device, each of the second desired target pose information is assigned to the corresponding third target pose information of the controlled operation end device; When two or more of the target pose information of the end image device are valid, select the target pose of the end image device that will be valid One of the information is regarded as valid, and the rest is regarded as invalid, and enter the step when only one of the target pose information of the image end device is valid.
其中,所述分解步骤包括:获取输入的关联于所述机械臂远端的任务自 由度的操作命令;结合所述任务自由度分别分解各所述初始目标位姿信息获得包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述受控操作末端器械在第二坐标系的第二分量目标位姿信息的一组位姿信息集合。Wherein, the decomposition step includes: obtaining an input operation command related to the task freedom of the distal end of the robotic arm; combining the task freedom to separately decompose each of the initial target pose information to obtain information including the remote end of the robotic arm A set of pose information of the first component target pose information of the end device in the first coordinate system and the second component target pose information of the controlled operation terminal device in the second coordinate system.
其中,所述操作命令包括第一操作命令和第二操作命令;所述第一操作命令同所述机械臂远端的任务自由度与所述机械臂的有效自由度完全匹配的情况相关联;所述第二操作命令同所述机械臂远端的任务自由度与所述机械臂的有效自由度中的姿态自由度完全匹配的情况相关联。Wherein, the operation command includes a first operation command and a second operation command; the first operation command is associated with the situation that the task freedom of the distal end of the robot arm completely matches the effective degree of freedom of the robot arm; The second operation command is associated with a situation in which the task degree of freedom of the distal end of the robot arm completely matches the posture degree of freedom of the effective degree of freedom of the robot arm.
其中,所述分解步骤包括:获取所述机械臂远端在第一坐标系的当前位姿信息;在所述机械臂远端保持于与其当前位姿信息对应的当前位姿的条件下,换算所述初始目标位姿信息获得所述第二分量目标位姿信息;对所述第二分量目标位姿信息的有效性进行判断;如果有效,在所述受控操作末端器械到达与所述第二分量目标位姿信息对应的目标位姿的条件下,换算所述初始目标位姿信息获得所述第一分量目标位姿信息;如果无效,调整所述第二分量目标位姿信息为有效并更新所述第二分量目标位姿信息,并在所述受控操作末端器械到达与更新后的所述第二分量目标位姿信息对应的目标位姿的条件下,换算所述初始目标位姿信息获得所述第一分量目标位姿信息。Wherein, the decomposition step includes: acquiring the current pose information of the distal end of the robotic arm in the first coordinate system; The initial target pose information obtains the second component target pose information; the validity of the second component target pose information is judged; if it is valid, when the controlled operation terminal device arrives with the first component Under the condition of the target pose corresponding to the two-component target pose information, convert the initial target pose information to obtain the first component target pose information; if it is invalid, adjust the second component target pose information to be valid and Update the second component target pose information, and convert the initial target pose under the condition that the controlled terminal device reaches the target pose corresponding to the updated second component target pose information Information to obtain the first component target pose information.
其中,所述第一判断步骤包括:对换算所述初始目标位姿信息获得的所述第一分量目标位姿信息的有效性进行判断;如果所述第一分量目标位姿信息有效,判断所述位姿信息集合为有效;如果所述第一分量目标位姿信息无效,判断所述位姿信息集合为无效。Wherein, the first judgment step includes: judging the validity of the first component target pose information obtained by converting the initial target pose information; if the first component target pose information is valid, judging all The pose information set is valid; if the first component target pose information is invalid, it is determined that the pose information set is invalid.
其中,所述对目标位姿信息的有效性进行判断的步骤包括:将所述目标位姿信息解析为相应臂体中各关节组件的目标运动状态参数,所述臂体是所述机械臂或所述操作臂;将所述臂体中各关节组件的目标运动状态参数与所述臂体中各关节组件的运动状态阈值进行对比;如果所述臂体中各关节组件的目标运动状态参数有一个以上超过相应所述关节组件的运动状态阈值,则判断所述目标位姿信息无效;如果所述臂体中各关节组件的目标运动状态参数均未超过相应所述关节组件的运动状态阈值,则判断所述目标位姿信息有 效。Wherein, the step of judging the validity of the target pose information includes: parsing the target pose information into target motion state parameters of each joint component in the corresponding arm body, and the arm body is the robot arm or The operating arm; compare the target motion state parameters of the joint components in the arm body with the motion state thresholds of the joint components in the arm body; if the target motion state parameters of the joint components in the arm body are If more than one exceeds the motion state threshold of the corresponding joint component, it is determined that the target pose information is invalid; if the target motion state parameter of each joint component in the arm body does not exceed the motion state threshold of the corresponding joint component, Then it is judged that the target pose information is valid.
其中,所述对目标位姿信息的有效性进行判断的步骤包括:将所述目标位姿信息解析为相应臂体中各关节组件的目标运动状态参数,所述臂体是所述机械臂或所述操作臂;将所述臂体中各关节组件的目标运动状态参数与所述臂体中各关节组件的运动状态阈值进行对比;如果所述臂体中各关节组件的目标运动状态参数有一个以上超过相应所述关节组件的运动状态阈值,则判断所述目标位姿信息无效;如果所述臂体中各关节组件的目标运动状态参数均未超过相应所述关节组件的运动状态阈值,则判断所述目标位姿信息有效。又一方面,提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被配置为由一个以上的处理器执行实现如上述任一项实施例所述的控制方法的步骤。Wherein, the step of judging the validity of the target pose information includes: parsing the target pose information into target motion state parameters of each joint component in the corresponding arm body, and the arm body is the robot arm or The operating arm; compare the target motion state parameters of the joint components in the arm body with the motion state thresholds of the joint components in the arm body; if the target motion state parameters of the joint components in the arm body are If more than one exceeds the motion state threshold of the corresponding joint component, it is determined that the target pose information is invalid; if the target motion state parameter of each joint component in the arm body does not exceed the motion state threshold of the corresponding joint component, Then it is judged that the target pose information is valid. In yet another aspect, a computer-readable storage medium is provided, and the computer-readable storage medium stores a computer program, and the computer program is configured to be executed by more than one processor to implement the method described in any one of the above embodiments. Steps of the control method.
又一方面,提供一种手术机器人的控制装置,包括:存储器,用于存储计算机程序;及处理器,用于加载并执行所述计算机程序;其中,所述计算机程序被配置为由所述处理器加载并执行实现如上述任一项实施例所述的控制方法的步骤。In yet another aspect, a control device for a surgical robot is provided, including: a memory for storing a computer program; and a processor for loading and executing the computer program; wherein the computer program is configured to be processed by the The controller loads and executes the steps for implementing the control method described in any of the above embodiments.
又一方面,提供一种手术机器人,包括:机械臂;装设于所述机械臂远端的一个以上具有末端器械的操作臂,所述末端器械包括一个图像末端器械和一个以上操作末端器械,所述操作末端器械均被配置为受控操作末端器械;及分别与所述机械臂和所述操作臂连接的控制装置;所述控制装置用于执行实现如上述任一项实施例所述的控制方法的步骤。In yet another aspect, a surgical robot is provided, including: a robotic arm; one or more operating arms with end instruments installed at the distal end of the robotic arm, the end instruments including an image end instrument and more than one manipulation end instruments, The operating end instruments are all configured as controlled operating end instruments; and control devices connected to the mechanical arm and the operating arm respectively; the control device is used to implement the implementation of any one of the foregoing embodiments Steps of the control method.
又一方面,提供一种手术机器人,包括:机械臂;操作臂,装设于所述机械臂远端,所述操作臂数量为两个以上且均具有一个末端器械,所述末端器械包括一个图像末端器械和一个以上操作末端器械,所述操作末端器械中至少一个被配置成受控操作末端器械,令所述受控操作末端器械为第一末端器械,令除所述第一末端器械以外的所述末端器械为第二末端器械;及控制装置,分别与所述机械臂和所述操作臂连接,被配置成用于执行:获取步骤,获取各所述第一末端器械在第一坐标系的初始目标位姿;分解步骤,分解各所 述初始目标位姿信息分别获得一组位姿信息集合,每组所述位姿信息集合均包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述第一末端器械在第二坐标系的第二分量目标位姿信息,第一坐标系指所述机械臂的基坐标系,第二坐标系指所述机械臂的工具坐标系;第一判断步骤,对各组所述位姿信息集合的有效性进行判断;计算步骤,在至少有一组所述位姿信息集合有效、且在各所述第二末端器械均保持于当前位姿的条件下,结合各组所述位姿信息集合计算所述机械臂远端在第一坐标系的第一目标位姿信息、各所述第一末端器械在第二坐标系的第二目标位姿信息、及各所述第二末端器械在第二坐标系的第三目标位姿信息;第二判断步骤,对所述第一至第三目标位姿信息的有效性进行判断;控制步骤,在所述第一至第三目标位姿信息均有效时,根据所述第一目标位姿信息控制所述机械臂运动以使所述机械臂远端到达对应的目标位姿,根据所述第二目标位姿信息控制对应所述第一末端器械的操作臂运动以使所述第一末端器械到达对应的目标位姿,并根据所述第三目标位姿信息控制对应所述第二末端器械的操作臂运动以使所述第二末端器械保持于当前位姿。In yet another aspect, a surgical robot is provided, including: a robotic arm; an operating arm installed at the distal end of the robotic arm, the number of operating arms is more than two and each has one end instrument, and the end instrument includes one An image end device and more than one operation end device, at least one of the operation end devices is configured as a controlled operation end device, so that the controlled operation end device is the first end device, except for the first end device The end instrument is a second end instrument; and a control device, which is respectively connected to the mechanical arm and the operating arm, and is configured to perform: the obtaining step, obtaining the first coordinate of each of the first end instruments The initial target pose of the system; the decomposition step is to decompose each of the initial target pose information to obtain a set of pose information sets, and each set of the pose information sets includes the remote end of the robotic arm in the first coordinate system The first component target pose information and the second component target pose information of the first end instrument in the second coordinate system, the first coordinate system refers to the base coordinate system of the robot arm, and the second coordinate system refers to the machine The tool coordinate system of the arm; the first judgment step is to judge the validity of each group of the pose information set; the calculation step, when at least one set of the pose information set is valid, and is in each of the second end instruments The first target pose information of the distal end of the manipulator in the first coordinate system is calculated by combining each set of the pose information under the condition of the current pose, and the first target pose information of each of the first end instruments in the second coordinate system is calculated. The second target pose information of the system, and the third target pose information of each of the second end devices in the second coordinate system; the second judgment step is to determine the validity of the first to third target pose information Make a judgment; a control step, when the first to third target pose information is valid, control the movement of the robot arm according to the first target pose information so that the distal end of the robot arm reaches the corresponding target position Posture, controlling the movement of the operating arm corresponding to the first end device according to the second target posture information so that the first end device reaches the corresponding target posture, and controlling the corresponding operation according to the third target posture information The operating arm of the second end device moves to keep the second end device in the current posture.
本申请具有如下有益效果:This application has the following beneficial effects:
通过控制机械臂运动使操作末端器械到达目标位姿的同时,控制图像末端器械运动以保持当前位姿,进而能够在保持视野不变的前提下,借助机械臂的运动扩大操作末端器械的操作空间,其使用方便、安全。By controlling the movement of the robotic arm to make the end-of-operation equipment reach the target pose, control the movement of the end-of-image equipment to maintain the current posture, thereby enabling the movement of the robotic arm to expand the operating space for operating the end-equipment while maintaining the same field of view. , Its use is convenient and safe.
附图说明Description of the drawings
图1为本申请手术机器人一实施例的结构示意图;FIG. 1 is a schematic structural diagram of an embodiment of a surgical robot according to this application;
图2为图1所示手术机器人的局部示意图;Fig. 2 is a partial schematic diagram of the surgical robot shown in Fig. 1;
图3为图1所示手术机器人的局部示意图;Fig. 3 is a partial schematic diagram of the surgical robot shown in Fig. 1;
图4为本申请手术机器人中末端器械的控制方法一实施例的流程图;4 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application;
图5为本申请手术机器人中末端器械的控制方法又一实施例的流程图;FIG. 5 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to the present application;
图6为本申请手术机器人一实施例使用状态下的简易示意图;Fig. 6 is a simplified schematic diagram of an embodiment of the surgical robot according to the application in a use state;
图7为本申请手术机器人中末端器械的控制方法又一实施例的流程图;FIG. 7 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to the present application;
图8为本申请手术机器人又一实施例使用状态下的简易示意图;FIG. 8 is a simplified schematic diagram of another embodiment of the surgical robot according to the application in a use state;
图9~图12为本申请手术机器人中末端器械的控制方法不同实施例的流程图;9-12 are flowcharts of different embodiments of the control method of the end instrument in the surgical robot of this application;
图13为图1所示手术机器人臂体机构中机械臂的原理示意图;13 is a schematic diagram of the principle of the mechanical arm in the arm body mechanism of the surgical robot shown in FIG. 1;
图14为本申请手术机器人的控制方法中对空间运动角度的解析示意图;FIG. 14 is a schematic diagram of the analysis of the spatial motion angle in the control method of the surgical robot of this application;
图15为本申请手术机器人中末端器械的控制方法又一实施例的流程图;15 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to this application;
图16为本申请手术机器人中末端器械的控制方法一实施例在二对一操作模式下的流程图;16 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a two-to-one operation mode;
图17为本申请手术机器人中末端器械的控制方法一实施例在二对一操作模式下的操作示意图;FIG. 17 is an operation schematic diagram of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a two-to-one operation mode;
图18~图19为本申请手术机器人中末端器械的控制方法另一实施例在二对一操作模式下的流程图;18-19 are flowcharts of another embodiment of a method for controlling end instruments in a surgical robot according to the present application in a two-to-one operation mode;
图20为本申请手术机器人中末端器械的控制方法另一实施例的二对一操作模式下的操作示意图;20 is a schematic diagram of operations in a two-to-one operation mode of another embodiment of a method for controlling end instruments in a surgical robot according to the present application;
图21为本申请手术机器人中末端器械的控制方法一实施例在一对一操作模式下的流程图;FIG. 21 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a one-to-one operation mode;
图22为本申请手术机器人中末端器械的控制方法一实施例在一对一操作模式下的操作示意图;22 is a schematic diagram of the operation of an embodiment of a method for controlling end instruments in a surgical robot according to the present application in a one-to-one operation mode;
图23~图24为本申请手术机器人中末端器械的控制方法不同实施例的流程图;Figures 23-24 are flowcharts of different embodiments of the control method of the end instrument in the surgical robot of this application;
图25为本申请手术机器人中末端器械的控制方法另一实施例的流程图;FIG. 25 is a flowchart of another embodiment of a method for controlling end instruments in a surgical robot according to the present application;
图26为本申请手术机器人中末端器械的控制方法一实施例的流程图;FIG. 26 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to this application;
图27为本申请手术机器人一实施例使用状态下的简易示意图;FIG. 27 is a simplified schematic diagram of an embodiment of a surgical robot according to the application in a use state;
图28为本申请手术机器人中末端器械的控制方法一实施例的流程图;FIG. 28 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to the present application;
图29为本申请手术机器人一实施例使用状态下的简易示意图;FIG. 29 is a simplified schematic diagram of an embodiment of the surgical robot according to the application in a use state;
图30~图31为本申请手术机器人中末端器械的控制方法不同实施例的 流程图;Figures 30 to 31 are flowcharts of different embodiments of the control method of the end instrument in the surgical robot of this application;
图32为本申请手术机器人中末端器械的控制方法一实施例的流程图;FIG. 32 is a flowchart of an embodiment of a method for controlling end instruments in a surgical robot according to this application;
图33为本申请手术机器人另一实施例的结构示意图。FIG. 33 is a schematic structural diagram of another embodiment of a surgical robot according to this application.
具体实施方式detailed description
为了便于理解本申请,下面将参照相关附图对本申请进行更全面的描述。附图中给出了本申请的较佳实施方式。但是,本申请可以以许多不同的形式来实现,并不限于本文所描述的实施方式。相反地,提供这些实施方式的目的是使对本申请的公开内容理解的更加透彻全面。In order to facilitate the understanding of the application, the application will be described in a more comprehensive manner with reference to the relevant drawings. The preferred embodiments of the application are shown in the accompanying drawings. However, this application can be implemented in many different forms and is not limited to the implementation described herein. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of this application more thorough and comprehensive.
需要说明的是,当元件被称为“设置于”另一个元件,它可以直接在另一个元件上或者也可以存在居中的元件。当一个元件被认为是“连接”另一个元件,它可以是直接连接到另一个元件或者可能同时存在居中元件。当一个元件被认为是“耦合”另一个元件,它可以是直接耦合到另一个元件或者可能同时存在居中元件。本文所使用的术语“垂直的”、“水平的”、“左”、“右”以及类似的表述只是为了说明的目的,并不表示是唯一的实施方式。本文所使用的术语“远端”、“近端”作为方位词,该方位词为介入医疗器械领域惯用术语,其中“远端”表示手术过程中远离操作者的一端,“近端”表示手术过程中靠近操作者的一端。It should be noted that when an element is referred to as being "disposed on" another element, it can be directly on the other element or a central element may also exist. When an element is considered to be "connected" to another element, it can be directly connected to the other element or an intermediate element may be present at the same time. When an element is considered to be "coupled" to another element, it can be directly coupled to the other element or an intermediate element may be present at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only, and are not meant to be the only embodiments. The terms "distal" and "proximal" used in this article are locators, which are commonly used terms in the field of interventional medical devices, where "distal" refers to the end far away from the operator during surgery, and "proximal" refers to surgery The end close to the operator during the process.
除非另有定义,本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中在本申请的说明书中所使用的术语只是为了描述具体的实施方式的目的,不是旨在于限制本申请。本文所使用的术语“及/或”包括一个或多个相关的所列项目的任意的和所有的组合。本文所使用的术语“各”包括一个及以上。本文所使用的术语“多个”包括两个及以上。Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of this application. The terminology used in the specification of the application herein is only for the purpose of describing specific embodiments, and is not intended to limit the application. The term "and/or" as used herein includes any and all combinations of one or more related listed items. The term "each" as used herein includes one and more. The term "plurality" as used herein includes two or more.
如图1至图3所示,其分别为本申请手术机器人一实施例的结构示意图,及其局部示意图。As shown in FIGS. 1 to 3, which are respectively a schematic structural diagram of an embodiment of a surgical robot according to the present application, and a partial schematic diagram thereof.
手术机器人包括主操作台1及从操作设备2。主操作台1具有运动输入 设备11及显示器12,医生通过操作运动输入设备11向从操作设备2发送控制命令,以令从操作设备2根据医生操作运动输入设备11的控制命令执行相应操作,并通过显示器12观察手术区域。其中,从操作设备2具有臂体,臂体具有机械臂21及可拆卸地装设于机械臂21远端的操作臂31。机械臂21包括依次连接的基座及连接组件,连接组件具有多个关节组件,在图1所示意的构型中具有关节组件210~214。操作臂31包括依次连接的连杆32、连接组件33及末端器械34,其中,连接组件33具有多个关节组件,操作臂31通过调节关节组件调节末端器械34的位姿;末端器械34具有图像末端器械34A及操作末端器械34B。更具体的,操作臂31安装于机械臂21远端的动力机构22上并受动力机构22中的驱动部进行驱动。其中,机械臂21及/或操作臂31可跟随运动输入设备11运动,且机械臂21也可被施加外力拖动而运动。The surgical robot includes a master operating table 1 and a slave operating device 2. The master console 1 has a motion input device 11 and a display 12. The doctor sends a control command to the slave operation device 2 by operating the motion input device 11, so that the slave operation device 2 performs corresponding operations according to the control command of the doctor to operate the motion input device 11, and The operation area is observed through the display 12. Among them, the slave operating device 2 has an arm body, and the arm body has a mechanical arm 21 and an operating arm 31 detachably installed at the distal end of the mechanical arm 21. The mechanical arm 21 includes a base and a connecting component that are connected in sequence. The connecting component has a plurality of joint components. In the configuration shown in FIG. 1, there are joint components 210 to 214. The operating arm 31 includes a connecting rod 32, a connecting component 33, and an end instrument 34 connected in sequence. The connecting assembly 33 has a plurality of joint components. The operating arm 31 adjusts the posture of the end instrument 34 by adjusting the joint components; the end instrument 34 has an image End instrument 34A and operation end instrument 34B. More specifically, the operating arm 31 is mounted on the power mechanism 22 at the distal end of the mechanical arm 21 and is driven by the driving part of the power mechanism 22. Among them, the robot arm 21 and/or the operating arm 31 can follow the motion input device 11 to move, and the robot arm 21 can also be dragged by applying an external force to move.
例如,运动输入设备11可以通过连线与主操作台1连接,或通过旋转的连杆与主操作台1相连接。运动输入设备11可以被配置为手持式或穿戴式(常佩戴于手腕远端如手指或手掌处),其具有多个有效自由度。示例性的,该运动输入设备11被配置为图3所示的手柄形式。一种情况下,运动输入设备11的有效自由度的数量被配置为低于定义于臂体远端任务自由度的数量;另一种情况下,运动输入设备11的有效自由度的数量被配置为不低于臂体远端的任务自由度的数量。运动输入设备11的有效自由度的数量至多为6个,为了能够灵活地对臂体在笛卡尔空间内的运动进行控制,运动输入设备11示例性地被配置为具有6个有效自由度,其中,运动输入设备11的有效自由度指可跟随手部运动的有效自由度,令医生具有较大的操作空间,且可以通过对各有效自由度的解析产生更多有意义的数据,满足对几乎所有构型的机械臂21的控制。For example, the motion input device 11 may be connected to the main console 1 through a wire, or connected to the main console 1 through a rotating link. The motion input device 11 may be configured as a handheld type or a wearable type (often worn on the distal end of the wrist such as a finger or palm), which has multiple effective degrees of freedom. Exemplarily, the motion input device 11 is configured in the form of a handle shown in FIG. 3. In one case, the number of effective degrees of freedom of the motion input device 11 is configured to be lower than the number of task degrees of freedom defined at the distal end of the arm; in another case, the number of effective degrees of freedom of the motion input device 11 is configured It is not less than the number of task degrees of freedom at the distal end of the arm. The number of effective degrees of freedom of the motion input device 11 is at most 6. In order to be able to flexibly control the movement of the arm in Cartesian space, the motion input device 11 is exemplarily configured to have 6 effective degrees of freedom, where The effective degree of freedom of the motion input device 11 refers to the effective degree of freedom that can follow the movement of the hand, so that the doctor has a larger operating space, and can generate more meaningful data through the analysis of each effective degree of freedom, which satisfies almost Control of the robotic arm 21 in all configurations.
该运动输入设备11跟随医生手部运动,实时采集手部运动造成的运动输入设备自身运动的运动信息。这些运动信息可以解析出位置信息、姿态信息、速度信息及加速度信息等。运动输入设备11包括但不限于磁导航定位传感器、 光学定位传感器、或者连杆式主操作手等。The motion input device 11 follows the hand motion of the doctor, and collects the motion information of the motion input device itself caused by the hand motion in real time. These motion information can be parsed into position information, posture information, speed information, acceleration information, and so on. The motion input device 11 includes, but is not limited to, a magnetic navigation positioning sensor, an optical positioning sensor, or a link-type main operator.
一实施例中,提供一种手术机器人中末端器械的控制方法。如图4所示,该控制方法包括:In one embodiment, a method for controlling end instruments in a surgical robot is provided. As shown in Figure 4, the control method includes:
步骤S1,获取步骤,即获取各受控操作末端器械的初始目标位姿信息。Step S1, the obtaining step, namely obtaining the initial target pose information of each controlled operation end device.
安装于动力机构22上的操作末端器械34B均被配置为受控操作末端器械。一个操作人员至多可以同时对两个受控操作末端器械34B进行控制,当受控操作末端器械34B为两个以上时,可以由两个以上的操作人员进行协同控制。The operation end devices 34B installed on the power mechanism 22 are all configured as controlled operation end devices. One operator can control at most two controlled operation end devices 34B at the same time. When there are more than two controlled operation end devices 34B, more than two operators can perform coordinated control.
步骤S2,分解步骤,即分解各初始目标位姿信息分别获得一组位姿信息集合。Step S2, a decomposition step, that is, to decompose each initial target pose information to obtain a set of pose information.
其中,每组位姿信息集合均包括机械臂远端在第一坐标系的第一分量目标位姿信息及受控操作末端器械在第二坐标系的第二分量目标位姿信息。第一坐标系指机械臂的基坐标系,第二坐标系指机械臂的工具坐标系。Wherein, each set of pose information includes the first component target pose information of the distal end of the robotic arm in the first coordinate system and the second component target pose information of the controlled operation terminal device in the second coordinate system. The first coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm.
步骤S3,第一判断步骤,即对各组位姿信息集合的有效性进行判断。Step S3, the first judging step, namely judging the validity of each set of pose information.
具体对每组位姿信息集合中包括的两个分量位姿信息的有效性进行判断,该两个分量位姿信息均有效时,该组位姿信息集合才被认定为有效,否则,该组位姿信息集合被认定为无效。Specifically, the validity of the two component pose information included in each group of pose information set is judged. When the two component pose information are both valid, the set of pose information is considered valid. Otherwise, the set of pose information is considered valid. The pose information collection is deemed invalid.
步骤S4,计算步骤,即在至少有一组位姿信息集合有效且在图像末端器械保持于当前位姿的条件下,结合各组位姿信息集合计算机械臂远端在第一坐标系的第一目标位姿信息、图像末端器械在第二坐标系的第二目标位姿信息、及各受控操作末端器械分别在第二坐标系的第三目标位姿信息。Step S4, a calculation step, that is, under the condition that at least one set of pose information is valid and the image end instrument is kept in the current pose, combine each set of pose information to calculate the first position of the distal end of the robotic arm in the first coordinate system. The target pose information, the second target pose information of the image end device in the second coordinate system, and the third target pose information of each controlled operation end device in the second coordinate system.
在该步骤中,优先期望各受控操作末端器械34B能够到达第一期望位姿,如果若干受控操作末端器械34B不能够到达第一期望位姿,则期望这些不能够到达第一期望位姿的受控操作末端器械34B能够到达第二期望位姿。该第一期望位姿指对应于初始目标位姿信息的目标位姿(包括初始目标位姿(其与受控运动输入设备输入的运动信息相关联)与当前位姿一致或不一致的两种情况)。该第二期望位姿指当前位姿,当若干受控操作末端器械34B不能到 达第一期望位姿的情况下,旨在确保它/它们能够到达第二期望位姿,以保证手术安全。In this step, it is preferred that each controlled operation end device 34B can reach the first desired posture. If several controlled operation end devices 34B cannot reach the first desired posture, it is expected that these cannot reach the first desired posture. The controlled operation end device 34B can reach the second desired posture. The first expected pose refers to two situations where the target pose corresponding to the initial target pose information (including the initial target pose (which is associated with the motion information input by the controlled motion input device) is consistent with or inconsistent with the current pose ). The second desired posture refers to the current posture. When several controlled operation end instruments 34B cannot reach the first desired posture, it is intended to ensure that it/they can reach the second desired posture to ensure the safety of the operation.
步骤S5,第二判断步骤,即对第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息的有效性进行判断。Step S5, the second judgment step, is to judge the validity of the first target pose information, the second target pose information, and the third target pose information.
步骤S6,控制步骤,即在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,根据第一目标位姿信息控制机械臂运动以使机械臂远端到达对应的目标位姿,根据第二目标位姿信息控制图像末端器械对应的操作臂运动以使图像末端器械保持于当前位姿,并根据各第三目标位姿信息控制对应于受控操作末端器械的操作臂运动以使受控操作末端器械到达对应的目标位姿。Step S6, the control step, that is, when the first target pose information, the second target pose information, and the third target pose information are all valid, the robot arm is controlled to move according to the first target pose information to make the robot arm distal Reach the corresponding target pose, control the movement of the operating arm corresponding to the end-of-image device according to the second target pose information to keep the end-of-image device in the current pose, and control the end corresponding to the controlled operation according to the third target pose information The operating arm of the instrument moves to make the controlled operating end instrument reach the corresponding target posture.
通过上述步骤S1~步骤S6,在获取的第一目标位姿信息、第二目标位姿信息及第三目标位姿信息均有效时,可以在保持图像末端器械34A于当前位姿以提供稳定视野的同时,使受控操作末端器械34B到达第一期望位姿或第二期望位姿;此外,可以在某些场景下结合机械臂及对应的操作臂一起运动,扩展受控操作末端器械34B的运动范围,以利于更容易地施展手术。Through the above steps S1 to S6, when the acquired first target pose information, second target pose information, and third target pose information are all valid, it is possible to maintain the image end device 34A in the current pose to provide a stable view At the same time, the controlled operation end device 34B can reach the first desired posture or the second desired posture; in addition, it can be combined with the robotic arm and the corresponding operating arm to move together in some scenarios to expand the controlled operation end device 34B. Range of motion to facilitate easier operation.
一实施例中,具体在上述步骤S3中,若经判断获得的各组位姿信息集合均无效时,表示各受控操作末端器械34B(包括一个及以上的受控操作末端器械)都不具备可调性,因而不再进入后续步骤,即结束控制,重新回到步骤S1。In one embodiment, specifically in the above step S3, if the posture information sets obtained by the judgment are all invalid, it means that all controlled operation end devices 34B (including one or more controlled operation end devices) do not have Adjustability, therefore, no further steps are entered, that is, the control ends, and step S1 is returned.
一实施例中,结合图5和图6参阅,在受控操作末端器械被配置为一个时,且该位姿信息集合有效时,上述步骤S4,即计算步骤包括:In an embodiment, referring to FIGS. 5 and 6, when the controlled operation end device is configured as one and the pose information set is valid, the above step S4, that is, the calculation step includes:
步骤S411,在机械臂远端到达与第一分量目标位姿信息对应的目标位姿的条件下,换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息。Step S411: Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information, convert the current pose information of the image end device to obtain its target pose information in the second coordinate system.
各末端器械34包括图像末端器械34A和受控操作末端器械34B的当前位姿信息可以是第一坐标系或第二坐标系,还可以是其它参考坐标系,这些坐标系之间实质是可以相互转换的。本文中示例性的,“当前位姿信息”指在 第二坐标系的当前位姿信息,当然也可以是其它坐标系的当前位姿信息。The current pose information of each end device 34, including the image end device 34A and the controlled operation end device 34B, can be the first coordinate system or the second coordinate system, or other reference coordinate systems. These coordinate systems can essentially interact with each other. Converted. As an example in this document, "current pose information" refers to current pose information in the second coordinate system, and of course, it can also be current pose information in other coordinate systems.
步骤S412,将第一分量目标位姿信息赋值成第一目标位姿信息,将换算获得的图像末端器械在第二坐标系的目标位姿信息赋值成第二目标位姿信息,将第二分量目标位姿信息赋值成第三目标位姿信息。Step S412: Assign the first component target pose information to the first target pose information, assign the converted target pose information of the image end device in the second coordinate system to the second target pose information, and assign the second component The target pose information is assigned to the third target pose information.
上述步骤S5即第二判断步骤中,由于该位姿信息集合已经确定是有效的,因而第一目标位姿信息和第三目标位姿信息是有效的。因此实际只需判断第二目标位姿信息是否有效即可。In the above step S5, that is, the second judgment step, since the pose information set has been determined to be valid, the first target pose information and the third target pose information are valid. Therefore, it is actually only necessary to determine whether the second target pose information is valid.
若第一至第三目标位姿信息并非均有效,结束控制。If the first to third target pose information are not all valid, the control ends.
若第一至第三目标位姿信息均有效,进入步骤S6即控制步骤。如图6所示,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据第三目标位姿信息控制操作臂31B运动以使受控操作末端器械34B到达对应的目标位姿(第一期望位姿)。If the first to third target pose information are all valid, enter step S6, which is the control step. As shown in FIG. 6, the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image The instrument 34A maintains the current pose, and controls the movement of the operating arm 31B according to the third target pose information so that the controlled operation end device 34B reaches the corresponding target pose (first desired pose).
一实施例中,结合图7和图8参阅,在受控操作末端器械被配置为多个,且在上述步骤S3经判断获得仅一个位姿信息集合有效、而其余位姿信息集合无效时,上述步骤S4,即计算步骤包括:In an embodiment, referring to Figs. 7 and 8, when the controlled operation end device is configured as multiple, and in step S3, it is determined that only one pose information set is valid, and the rest of the pose information sets are invalid, The foregoing step S4, that is, the calculation step includes:
步骤S421,在机械臂远端到达与有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,并换算与各无效的位姿信息关联的受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息。Step S421, under the condition that the distal end of the robot arm reaches the target pose corresponding to the first component target pose information in the effective pose information set, convert the current pose information of the image end device to obtain its position in the second coordinate system And convert the current pose information of the controlled operation end device associated with each invalid pose information to obtain its second expected target pose information in the second coordinate system.
步骤S422,将有效的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将图像末端器械在第二坐标系的目标位姿信息赋值成第二目标位姿信息,将有效的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将各第二期望目标位姿分别赋值成相应受控操作末端器械的第三目标位姿信息。Step S422: Assign the first component target pose information in the effective pose information set to the first target pose information, and assign the target pose information of the image end instrument in the second coordinate system to the second target pose information , Assign the second component target pose information in the effective pose information set to the third target pose information of the associated controlled operation end device, and assign each second desired target pose to the corresponding controlled operation end The third target pose information of the device.
上述步骤S5即第二判断步骤中,实际只需要判断图像末端器械34A的第二目标位姿信息及与各无效的位姿信息集合关联的受控操作末端器械34B 的第三目标位姿信息是否有效即可。In the above step S5, the second judgment step, it is actually only necessary to judge whether the second target pose information of the end image device 34A and the third target pose information of the controlled operation end device 34B associated with each invalid pose information set are Effective.
若第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息并非均有效,结束控制。If the first target pose information, the second target pose information, and the third target pose information are not all valid, the control ends.
若第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效,进入步骤S6即控制步骤。如图8所示,若受控操作末端器械34B1关联的一组位姿信息集合有效,而受控操作末端器械34B2~34B3关联的两组位姿信息集合无效:If the first target pose information, the second target pose information, and the third target pose information are all valid, step S6 is entered, which is a control step. As shown in Figure 8, if the set of pose information associated with the controlled operation end device 34B1 is valid, and the two sets of pose information associated with the controlled operation end device 34B2-34B3 are invalid:
根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1的第三目标位姿信息控制操作臂31B运动以使受控操作末端器械34B到达对应的目标位姿(第一期望位姿),并根据受控操作末端器械34B2~34B3各自的第三目标位姿信息控制操作臂31C~31D运动以使受控操作末端器械34B2~34B3到达对应的目标位姿(第二期望位姿,即保持当前位姿)。Control the movement of the robotic arm 21 according to the first target pose information so that the power mechanism 22 at the far end reaches the corresponding target pose, and control the movement of the operating arm 31A according to the second target pose information to keep the image end instrument 34A in the current pose , Control the movement of the operating arm 31B according to the third target posture information of the controlled operation end device 34B1 to make the controlled operation end device 34B reach the corresponding target posture (the first desired posture), and according to the controlled operation end device 34B2 The third target pose information of each of ~34B3 controls the movement of the operating arms 31C~31D so that the controlled operation end devices 34B2~34B3 reach the corresponding target pose (the second desired pose, that is, maintain the current pose).
含有步骤S421~步骤S422的步骤S1~S6除适用于图8所示同一机械臂21具有三个受控操作末端器械34B之外,根据其原理同样适用于同一机械臂21具有两个、及四个以上的受控操作末端器械34B的情况。Steps S1 to S6 including steps S421 to S422 are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B as shown in FIG. 8, but also applicable to the same robotic arm 21 having two, and four end devices according to its principle. More than one controlled operation end device 34B.
一实施例中,结合图8和图9参阅,受控操作末端器械为多个,且两个以上位姿信息集合有效、其余位姿信息集合无效时,上述步骤S4,即计算步骤包括:In an embodiment, referring to Figs. 8 and 9, when there are multiple controlled-operated end devices, and two or more pose information sets are valid, and the rest of the pose information sets are invalid, the foregoing step S4, that is, the calculation step includes:
步骤S431,在机械臂远端到达与相应于各有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息。Step S431: Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information. The target pose information of the second coordinate system.
步骤S432,对图像末端器械在第二坐标系的各目标位姿信息的有效性进行判断。Step S432, judging the validity of each target pose information of the image terminal device in the second coordinate system.
该步骤中,如果图像末端器械的各目标位姿信息中仅一个有效时,进入步骤S433;如果图像末端器械的各目标位姿信息中两个以上有效时,进入步 骤S438。In this step, if only one of the target pose information of the end image device is valid, step S433 is entered; if more than two of the target pose information of the end image device are valid, step S438 is entered.
步骤S433,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的目标位姿信息集合关联的各受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息,并换算与其余有效的目标位姿信息集合关联的各受控操作末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息。Step S433, under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, conversion and invalidation The current pose information of each controlled terminal device associated with the target pose information set obtains its second expected target pose information in the second coordinate system, and converts each receiver associated with the remaining effective target pose information set. Controlling the initial target pose information of the terminal device to obtain its first expected target pose information in the second coordinate system.
步骤S434,对各第一期望目标位姿信息的有效性进行判断。In step S434, the validity of each first desired target pose information is judged.
该步骤中,如果各第一期望目标位姿信息均有效,进入步骤S435;如果各第一期望目标位姿信息中至少部分无效,进入步骤S436。In this step, if all the first desired target pose information is valid, go to step S435; if at least part of the first desired target pose information is invalid, go to step S436.
步骤S435,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将各第一期望目标位姿信息及各第二期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息。Step S435: Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device The posture information, each of the first desired target posture information and each second desired target posture information is assigned to the third target posture information of the corresponding controlled operation end device.
其中,将有效的第一期望目标位姿信息对应赋值成关联的受控操作末端器械的第三目标位姿信息;将第二期望目标位姿信息对应赋值成关联于无效的目标位姿信息集合的受控操作末端器械的第三目标位姿信息。Among them, the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; the second desired target pose information is correspondingly assigned to be associated with the invalid target pose information set The third target pose information of the controlled operation end device.
步骤S436,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的各第一期望目标位姿信息关联的受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息。Step S436, under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the effective pose information set, which is associated with the target pose information of the effective end-of-image equipment, conversion and invalidation The current pose information of the controlled operation end device associated with each first desired target pose information obtains its second desired target pose information in the second coordinate system.
步骤S437,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器 械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将有效的各第一期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将不同阶段(即条件)获得的各第二期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息。Step S437: Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device Attitude information, each valid first expected target pose information is assigned to the third target pose information of the corresponding controlled operation end device, and each second expected target pose information obtained at different stages (ie conditions) is respectively assigned Assigned to the third target pose information of the corresponding controlled operation end device.
其中,将有效的第一期望目标位姿信息对应赋值成关联的受控操作末端器械的第三目标位姿信息;各第二期望目标位姿信息关联于两种情况,一种情况关联于无效的目标位姿信息集合,另一种情况关联于无效的第一期望目标位姿信息(转换第一期望位姿为第二期望位姿),因此需要将其对应赋值成关联于相应情况的受控操作末端器械。步骤S438,选择将有效的图像末端器械的目标位姿信息中的一个作为有效、将其余作为无效,并进入在图像末端器械的各目标位姿信息中仅一个有效时的步骤S433。Among them, the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; each second desired target pose information is associated with two situations, one of which is related to invalid The target pose information set in the other case is related to the invalid first expected target pose information (converting the first expected pose to the second expected pose), so it needs to be assigned correspondingly to the recipient associated with the corresponding situation. Control and operate the end equipment. Step S438, select one of the effective target pose information of the end-of-image device as valid and the rest as invalid, and enter step S433 when only one of the target pose information of the end-of-image device is valid.
该步骤S438中,可以配置形成多种将多个有效的图像末端器械的目标位姿信息视为有效及视为无效的组合,并分别利用上述步骤S433~步骤S437进行计算,并将计算出的第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效的一组来进行步骤S6的控制步骤。In this step S438, it is possible to configure and form a variety of combinations that regard the target pose information of multiple valid image end devices as valid and invalid, and use the above steps S433 to S437 to perform calculations, and then combine the calculated A set of the first target pose information, the second target pose information, and each third target pose information are all valid to perform the control step of step S6.
在一些实施例中,如果不同组合中对应计算出的第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息有两组以上均有效,那么可以根据一些衡量指标来确定选择第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效的某一组来进行步骤S6的控制步骤。这些衡量指标包括但不限于臂体(机械臂或操作臂)的运动范围、运动速度及运动加速度中的一种以上,可以采用如臂体运动范围更小、运动速度更小及运动加速度更小中的一种以上来选择出用于步骤S6的第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息。这些衡量指标包括但不限于能实现第一预期位姿、第二预期位姿的受控操作末端器械的数量。优先选择能够到达第一预期位姿的数量更多的来进行控制。这些衡量指标也可以相互结合以选取出最优的一组来进行步骤S6的控制。In some embodiments, if more than two sets of the first target pose information, the second target pose information, and the third target pose information calculated in different combinations are valid, it can be determined according to some measurement indicators. A certain group in which the first target pose information, the second target pose information, and each third target pose information are all valid is selected to perform the control step of step S6. These metrics include, but are not limited to, more than one of the range of motion, motion speed, and motion acceleration of the arm (mechanical arm or manipulator arm), such as smaller arm motion range, lower motion speed, and lower motion acceleration. One or more of them are selected to select the first target pose information, the second target pose information, and each third target pose information used in step S6. These metrics include, but are not limited to, the number of controlled-operated end devices that can achieve the first expected pose and the second expected pose. It is preferred to control the number of poses that can reach the first expected pose. These measurement indicators can also be combined with each other to select an optimal group to perform the control in step S6.
在一些实施例中,可以预先或者在操作受控操作末端器械的过程中实时(如通过语音指令)为各受控操作末端器械设置优先级,在步骤S438中依次选择优先级更高的受控操作末端器械所关联的有效的图像末端器械的目标位姿信息视为有效、将其余视为无效,以尽量保障较高优先级的控制对象能够实现第一期望位姿。对于优先级的设置,可以根据操作人员的权限来设置,也可以根据具体的控制对象来设置,可以灵活配置。In some embodiments, the priority may be set for each controlled operation terminal device in advance or in real time (such as by voice command) during the operation of the controlled operation terminal device, and in step S438, the controlled operation terminal device with higher priority may be selected in turn. The target pose information of the effective image end device associated with the operation end device is considered valid, and the rest is considered invalid, so as to ensure that the control object with a higher priority can achieve the first desired pose as much as possible. The priority setting can be set according to the authority of the operator, or according to the specific control object, which can be flexibly configured.
如图8所示,假设受控操作末端器械34B1关联的一组位姿信息集合无效、受控操作末端器械34B2~34B3关联的两组位姿信息集合均有效,根据上述步骤S431算出的关联于受控操作末端器械34B2、34B3的图像末端器械在第二坐标系的目标位姿信息分别为C2、C3。As shown in Figure 8, assuming that the set of pose information associated with the controlled operation end device 34B1 is invalid, and the two sets of pose information associated with the controlled operation end device 34B2-34B3 are all valid, the correlation calculated according to the above step S431 is The target pose information of the image end devices of the controlled operation end devices 34B2 and 34B3 in the second coordinate system are C2 and C3, respectively.
情况(1.1):假设经步骤S432判断出C2、C3均无效,结束控制。Situation (1.1): Assuming that it is determined in step S432 that both C2 and C3 are invalid, the control ends.
情况(1.2):假设经步骤S432判断出C2有效、C3无效。Case (1.2): Suppose that it is determined that C2 is valid and C3 is invalid after step S432.
基于受控操作末端器械34B2关联的一组位姿信息集合的第一分量位姿信息,根据步骤S433算出受控操作末端器械34B1在第二坐标系的目标位姿信息(第二期望目标位姿信息)、及受控操作末端器械34B3在第二坐标系的目标位姿信息(第一期望目标位姿信息)。Based on the first component pose information of a set of pose information sets associated with the controlled operation end device 34B2, the target pose information of the controlled operation end device 34B1 in the second coordinate system is calculated according to step S433 (the second expected target pose Information), and the target pose information of the controlled operation terminal device 34B3 in the second coordinate system (the first desired target pose information).
假设根据步骤S434判断出受控操作末端器械34B3在第二坐标系的第一期望目标位姿信息有效:Assuming that it is determined according to step S434 that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is valid:
通过步骤S435进行赋值后,进入上述步骤S5,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6。在步骤S6中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1的第三目标位姿信息控制操作臂31B运动以使受控操作末端器械34B到达对应的目标位姿(第二期望位姿,即保持当前位姿),并根据受控操作末端器械34B2~34B3各自的第三目标位姿信息控制操作臂31C~31D运动以使受控操作末端器械34B2~34B3到达对应的目标位姿(第一期望位姿)。After the value is assigned in step S435, the process proceeds to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6. In step S6, the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current posture, and controls the movement of the operating arm 31B according to the third target posture information of the controlled operation end device 34B1 to make the controlled operation end device 34B reach the corresponding target posture (the second desired posture, that is, maintain the current position Posture), and control the movement of the operating arms 31C-31D according to the third target posture information of each of the controlled operating end devices 34B2 to 34B3 so that the controlled operating end devices 34B2 to 34B3 reach the corresponding target posture (the first desired posture) ).
假设根据步骤S434判断出受控操作末端器械34B3在第二坐标系的第一期望目标位姿信息无效:Assuming that it is determined according to step S434 that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is invalid:
基于受控操作末端器械34B2关联的一组位姿信息集合的第一分量位姿信息,根据步骤S436计算出受控操作末端器械34B3在第二坐标系的第二期望目标位姿信息,并通过步骤S437进行赋值后,进入上述步骤S5,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6。在步骤S6中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1、34B3各自的第三目标位姿信息控制操作臂31B、34D运动以使受控操作末端器械34B1、34B3到达对应的目标位姿(第二期望位姿,即保持当前位姿),并根据受控操作末端器械34B2的第三目标位姿信息控制操作臂31C运动以使受控操作末端器械34B2到达对应的目标位姿(第一期望位姿)。Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B2, the second expected target pose information of the controlled operation end device 34B3 in the second coordinate system is calculated according to step S436, and passed After the value is assigned in step S437, the process proceeds to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6. In step S6, the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current pose, and controls the movement of the operating arms 31B, 34D according to the third target pose information of the controlled operating end devices 34B1 and 34B3 so that the controlled operating end devices 34B1 and 34B3 reach the corresponding target poses (the second desired Posture, that is, maintain the current posture), and control the movement of the operating arm 31C according to the third target posture information of the controlled operation end device 34B2 to make the controlled operation end device 34B2 reach the corresponding target posture (the first desired posture) ).
情况(1.3):假设经步骤S432判断出C2、C3均有效。Situation (1.3): Assume that it is determined that both C2 and C3 are valid in step S432.
选择将C2视为有效、C3视为无效及/或将C2视为无效、C3视为有效,进入上述情况(1.2)。Choose to regard C2 as valid, C3 as invalid and/or C2 as invalid and C3 as valid, enter the above situation (1.2).
含有步骤S431~步骤S438的步骤S1~S6除适用于图8所示同一机械臂21具有三个受控操作末端器械34B之外,根据其原理同样适用于同一机械臂21具有四个以上的受控操作末端器械34B的情况。Steps S1 to S6 including steps S431 to S438 are not only applicable to the same robotic arm 21 with three controlled operation end devices 34B as shown in FIG. 8, but also applicable to the same robotic arm 21 having more than four receivers according to its principle. Control the operation of the terminal device 34B.
一实施例中,结合图8和图10参阅,受控操作末端器械为两个以上(包括两个及以上),且各位姿信息集合均有效时,上述步骤S4,即计算步骤包括:In one embodiment, referring to Fig. 8 and Fig. 10, when there are more than two (including two or more) end devices for controlled operation, and each posture information set is valid, the above step S4, that is, the calculation step includes:
步骤S441,在机械臂远端到达与相应于各有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息。Step S441: Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain its current pose information. The target pose information of the second coordinate system.
步骤S442,对图像末端器械在第二坐标系的各目标位姿信息的有效性进行判断。Step S442, judging the validity of each target pose information of the image terminal device in the second coordinate system.
该步骤中,如果图像末端器械的各目标位姿信息中仅一个有效,进入步骤S443;如果图像末端器械的各目标位姿信息中两个以上有效,进入步骤S448。In this step, if only one of the target pose information of the end image device is valid, step S443 is entered; if more than two of the target pose information of the end image device are valid, step S448 is entered.
步骤S443,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与其余有效的目标位姿信息集合关联的各受控操作末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息。Step S443: Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set, which is associated with the target pose information of the effective end-of-image device, convert it to the other target poses. The initial target pose information of each controlled terminal device associated with the effective target pose information set obtains its first expected target pose information in the second coordinate system.
步骤S444,对各第一期望目标位姿信息的有效性进行判断。In step S444, the validity of each first desired target pose information is judged.
该步骤中,如果各第一期望目标位姿信息均有效,进入步骤S445;如果各第一期望目标位姿信息中至少部分无效,进入步骤S446。In this step, if all the first desired target pose information is valid, go to step S445; if at least part of the first desired target pose information is invalid, go to step S446.
步骤S445,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将各第一期望目标位姿信息赋值成对应的受控操作末端器械的第三目标位姿信息。Step S445: Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and set the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device Posture information, assigning each first desired target posture information to the third target posture information of the corresponding controlled operation end device.
步骤S446,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的各第一期望目标位姿信息关联的受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息。Step S446, under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, conversion and invalidation The current pose information of the controlled operation end device associated with each first desired target pose information obtains its second desired target pose information in the second coordinate system.
步骤S447,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将有效的各第一期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将各第二期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息。Step S447: Assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose information of the effective end-of-image equipment Assigned to the second target pose information, the second component of the target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target position of the associated controlled operation end device Attitude information, each valid first desired target pose information is assigned to the third target pose information of the corresponding controlled operation terminal device, and each second expected target pose information is assigned to the corresponding controlled operation terminal The third target pose information of the device.
这里的第二期望目标位姿信息仅关联于无效的第一期望目标位姿信息(转换第一期望位姿为第二期望位姿)这一种情况。The second expected target pose information here is only associated with the invalid first expected target pose information (converting the first expected pose to the second expected pose).
步骤S448,选择将有效的图像末端器械的目标位姿信息中的一个作为有效、将其余作为无效,并进入在图像末端器械的各目标位姿信息中仅一个有效时的步骤S443。Step S448, selecting one of the valid target pose information of the end-of-image device as valid and the others as invalid, and enter step S443 when only one of the target pose information of the end-of-image device is valid.
如图8所示,假设受控操作末端器械34B1~34B3关联的三组位姿信息集合均有效,根据上述步骤S441算出的关联于受控操作末端器械34B1、34B2、34B3的图像末端器械在第二坐标系的目标位姿信息分别为C1、C2、C3。As shown in Figure 8, assuming that the three sets of pose information associated with the controlled operation end devices 34B1 to 34B3 are all valid, the image end devices associated with the controlled operation end devices 34B1, 34B2, and 34B3 calculated according to the above step S441 are in the first The target pose information of the two-coordinate system is C1, C2, and C3 respectively.
情况(2.1):假设经步骤S442判断出C1~C3均无效,结束控制。Case (2.1): Assuming that it is determined in step S442 that all C1 to C3 are invalid, the control ends.
情况(2.2):假设经步骤S442判断出仅C1有效、C2和C3无效。Case (2.2): Assume that it is determined in step S442 that only C1 is valid, and C2 and C3 are invalid.
基于受控操作末端器械34B1关联的一组位姿信息集合的第一分量位姿信息,根据步骤S433算出受控操作末端器械34B2、34B3在第二坐标系的目标位姿信息(第一期望目标位姿信息)。Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B1, the target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system (the first desired target) is calculated according to step S433. Pose information).
假设根据步骤S444判断出受控操作末端器械34B2、34B3在第二坐标系的第一期望目标位姿信息均有效:Assuming that it is determined according to step S444 that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system is valid:
通过步骤S445进行赋值后,进入上述步骤S5,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6。在步骤S6中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,分别根据受控操作末端器械34B1~34B3的第三目标位姿信息对应控制操作臂31B~31D运动到达对应的目标位姿(第一期望位姿)。After the assignment is performed in step S445, the process proceeds to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6. In step S6, the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current posture, and controls the operating arms 31B to 31D to move to the corresponding target posture (first desired posture) according to the third target posture information of the controlled operation end devices 34B1 to 34B3, respectively.
假设根据步骤S444判断出受控操作末端器械34B2、34B3在第二坐标系的第一期望目标位姿信息至少部分无效,如受控操作末端器械34B2在第二坐标系的第一期望目标位姿信息有效、受控操作末端器械34B3在第二坐标系的第一期望目标位姿信息无效:Suppose it is determined according to step S444 that the first expected target pose information of the controlled operation end device 34B2 and 34B3 in the second coordinate system is at least partially invalid, for example, the first expected target pose information of the controlled operation end device 34B2 in the second coordinate system The information is valid, and the controlled operation terminal device 34B3 is invalid in the first expected target pose information in the second coordinate system:
基于受控操作末端器械34B1关联的一组位姿信息集合的第一分量位姿 信息,根据步骤S446计算出受控操作末端器械34B3在第二坐标系的第二期望目标位姿信息,并通过步骤S447进行赋值后,进入上述步骤S5,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6。在步骤S6中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1~34B2的第三目标位姿信息对应控制操作臂31B~31C运动到达对应的目标位姿(第一期望位姿),并根据受控操作末端器械34B2的第三目标位姿信息对应控制操作臂31D运动到达对应的目标位姿(第二期望位姿)。Based on the first component pose information of a set of pose information sets associated with the controlled operation end device 34B1, the second expected target pose information of the controlled operation end device 34B3 in the second coordinate system is calculated according to step S446, and passed After the assignment in step S447, proceed to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, proceed to step S6. In step S6, the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current pose, and controls the operating arms 31B-31C to move to the corresponding target pose (the first desired pose) according to the third target pose information of the controlled operating terminal device 34B1-34B2, and according to the controlled operation end The third target pose information of the instrument 34B2 corresponds to control the movement of the operating arm 31D to reach the corresponding target pose (the second desired pose).
假设根据步骤S444判断出受控操作末端器械34B2、34B3在第二坐标系的第一期望目标位姿信息均无效:Assuming that it is determined according to step S444 that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system is invalid:
基于受控操作末端器械34B1关联的一组位姿信息集合的第一分量位姿信息,根据步骤S446计算出受控操作末端器械34B2、34B3在第二坐标系的第二期望目标位姿信息,并通过步骤S447进行赋值后,进入上述步骤S5,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6。在步骤S6中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1的第三目标位姿信息对应控制操作臂31B运动到达对应的目标位姿(第一期望位姿),并根据受控操作末端器械34B2、34B3的第三目标位姿信息对应控制操作臂31C、31D运动到达对应的目标位姿(第二期望位姿)。Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B1, the second expected target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system is calculated according to step S446, After the assignment is performed in step S447, the process proceeds to step S5, and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6. In step S6, the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the image end instrument 34A maintains the current posture, and controls the operating arm 31B to move to the corresponding target posture (the first desired posture) according to the third target posture information of the controlled operation end device 34B1, and according to the controlled operation end device 34B2, 34B3 The third target pose information corresponding to control the operation arms 31C, 31D to move to the corresponding target pose (the second desired pose).
含有步骤S441~步骤S448的步骤S1~S6除适用于图8所示同一机械臂21具有三个受控操作末端器械34B之外,根据其原理同样适用于同一机械臂21具有两个、或四个以上的受控操作末端器械34B的情况。Steps S1 to S6 including steps S441 to S448 are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B as shown in FIG. 8, but also applicable to the same robotic arm 21 having two, or four, according to the principle. More than one controlled operation end device 34B.
通过上述实施例,通过结合机械臂21和操作臂31的运动,能够在图像末端器械34A保持于当前位姿的条件下,尽量确保受控操作末端器械34B能够到达第一期望位姿实现手术目的,如果不能到达第一期望位姿也会尽量确 保受控操作末端器械34B保持于当前位姿降低手术风险。Through the above-mentioned embodiment, by combining the movement of the mechanical arm 21 and the operating arm 31, it is possible to ensure that the controlled operation end instrument 34B can reach the first desired position to achieve the purpose of the operation under the condition that the end-of-image instrument 34A is kept in the current posture. If the first desired posture cannot be reached, it will try to ensure that the controlled operation end instrument 34B remains in the current posture to reduce the risk of surgery.
一实施例中,如图11所示,上述步骤S1,即获取步骤包括:In an embodiment, as shown in FIG. 11, the above step S1, that is, the obtaining step includes:
步骤S11,获取由运动输入设备输入遥操作受控对象运动的运动信息。Step S11: Obtain the motion information of the motion of the remotely operated controlled object input by the motion input device.
该受控对象在本文中具体指受控操作末端器械。The controlled object specifically refers to the controlled operation end device in this article.
步骤S12,解析运动信息为受控对象的初始目标位姿信息。Step S12: Analyze the motion information as the initial target pose information of the controlled object.
通常,该运动信息可以是运动输入设备的位姿信息。Generally, the motion information may be the pose information of the motion input device.
一实施例中,如图12所示,该步骤S12包括:In an embodiment, as shown in FIG. 12, this step S12 includes:
步骤S121,将运动信息解析映射为受控对象的位姿增量信息。Step S121: Analyze and map the motion information into the pose increment information of the controlled object.
其中,“映射”为一种转换关系,它可以包括自然映射关系和非自然映射关系。Among them, "mapping" is a conversion relationship, which can include natural mapping relationships and unnatural mapping relationships.
自然映射关系为一一对应的关系,指受控运动输入设备与受控对象之间的水平移动增量信息到水平移动增量信息、竖直移动增量信息到竖直移动增量信息、前后移动增量信息到前后移动增量信息、偏航角转动增量信息到偏航角转动增量信息、俯仰角转动增量信息到俯仰角转动增量信息及滚动角转动增量信息到滚动角转动增量信息。The natural mapping relationship is a one-to-one correspondence, which refers to the horizontal movement increment information between the controlled motion input device and the controlled object to the horizontal movement increment information, the vertical movement increment information to the vertical movement increment information, front and back Move incremental information to forward and backward movement incremental information, yaw angle rotation increment information to yaw angle rotation increment information, pitch angle rotation increment information to pitch angle rotation increment information, and roll angle rotation increment information to roll angle Rotate incremental information.
非自然映射关系为自然映射关系之外的映射关系。一示例中,该非自然映射关系包括但不限于转换映射关系,其包括但不限于前述的将固定坐标系的水平移动增量信息、竖直移动增量信息及转动增量信息一对一映射为受控对象的偏航角增量信息、俯仰角增量信息及滚动角增量信息。配置成非自然映射关系能够在如二对一操作模式等某些情况下较容易地对受控对象进行控制。The unnatural mapping relationship is a mapping relationship other than the natural mapping relationship. In an example, the unnatural mapping relationship includes, but is not limited to, a conversion mapping relationship, which includes, but is not limited to, the aforementioned one-to-one mapping of the horizontal movement increment information, the vertical movement increment information, and the rotation increment information of the fixed coordinate system. It is the yaw angle increment information, pitch angle increment information and roll angle increment information of the controlled object. Configured as an unnatural mapping relationship, it is easier to control the controlled object in certain situations such as the two-to-one operation mode.
步骤S122,获取受控对象中各关节组件的位置信息。Step S122: Obtain position information of each joint component in the controlled object.
具体可通过装设于受控对象中各关节组件处的位置传感器如编码器获取相应的位置信息。在以图1及图13示意的实施例中,该机械臂21具有5个自由度,借助各位置传感器能够采集到这样一组位置信息(d1,θ 2345)。 Specifically, the corresponding position information can be obtained through position sensors such as encoders installed at each joint component of the controlled object. In the embodiment illustrated in FIGS. 1 and 13, the robot arm 21 has 5 degrees of freedom, and such a set of position information (d1, θ 2 , θ 3 , θ 4 , θ 5 ) can be collected by means of position sensors. .
步骤S123,根据各关节组件的位置信息计算受控对象在第一坐标系的当 前位姿信息。Step S123: Calculate the current pose information of the controlled object in the first coordinate system according to the position information of each joint component.
其中,通常可以结合正运动学来进行计算。建立机械臂21的不动点(即C点处,机械臂21的工具坐标系的原点在不动点上)至机械臂21的基座的运动学模型,输出C点与基座的模型转换矩阵
Figure PCTCN2020114113-appb-000001
计算方法为
Figure PCTCN2020114113-appb-000002
Among them, the calculation can usually be combined with positive kinematics. Establish a kinematic model of the fixed point of the robot arm 21 (ie at point C, the origin of the tool coordinate system of the robot arm 21 is on the fixed point) to the base of the robot arm 21, and output the model conversion between point C and the base matrix
Figure PCTCN2020114113-appb-000001
The calculation method is
Figure PCTCN2020114113-appb-000002
步骤S124,结合增量位姿信息及当前位姿信息计算受控对象在第一坐标系的初始目标位姿信息。Step S124, combining the incremental pose information and the current pose information to calculate the initial target pose information of the controlled object in the first coordinate system.
其中,根据C点与基座的模型转换矩阵
Figure PCTCN2020114113-appb-000003
获取C点在固定坐标系的位姿信息。假设在不改变C点位置的情况下,旋转C点的坐标系,使其达到模型转换矩阵所描述的姿态,可得到旋转轴角度[θ x0y0z0],如图14所示。θ x0为滚动角,θ y0为偏航角,θ z0为俯仰角,事实上在图13所示的机械臂21中,缺乏滚动角的自由度进而实际上θ x0不可调。该固定坐标系举例可以定义在显示器处,当然,也可以定义在至少在工作时不可动的部位。
Among them, according to the model conversion matrix of point C and the base
Figure PCTCN2020114113-appb-000003
Get the pose information of point C in the fixed coordinate system. Assuming that without changing the position of point C, rotate the coordinate system of point C to reach the posture described by the model conversion matrix, and the rotation axis angle [θ x0y0z0 ] can be obtained, as shown in Figure 14. . θ x0 is the rolling angle, θ y0 is the yaw angle, and θ z0 is the pitch angle. In fact, in the robotic arm 21 shown in FIG. 13, the degree of freedom of the rolling angle is lacking and θ x0 is actually not adjustable. For example, the fixed coordinate system can be defined at the display, of course, it can also be defined at least at a position that is not movable during work.
进一步地,具体在上述步骤S6即控制步骤中,对于控制对象即机械臂、图像末端器械及操作末端器械的控制可以包括如下步骤:Further, specifically in the above-mentioned step S6, that is, the control step, the control of the control object, that is, the robotic arm, the end-of-image device, and the end-of-operation device may include the following steps:
根据控制对象远端的目标位姿信息计算其相应各关节组件的目标位置信息。如可通过逆运动学来计算。Calculate the target position information of the corresponding joint components according to the target pose information of the remote end of the control object. For example, it can be calculated by inverse kinematics.
根据各关节组件的目标位置信息控制控制对象中各关节组件联动到达对应的目标位姿。According to the target position information of each joint component, each joint component in the control object is controlled to link to reach the corresponding target pose.
一实施例中,如图15所示,该步骤S12包括:In an embodiment, as shown in FIG. 15, this step S12 includes:
步骤S125,获取针对受控对象输入的关联于操作模式类型的选择指令。Step S125: Obtain a selection instruction related to the operation mode type input for the controlled object.
操作模式包括二对一操作模式和一对一操作模式,二对一操作模式指用两个受控运动输入设备来控制一个受控对象,一对一操作模式指用一个受控运动输入设备来控制一个受控对象。在控制一个受控对象运动时,可以选择采用一对一操作模式或二对一操作模式。对于一对一操作模式而言,可以进一步选择采用哪一个运动输入设备作为受控运动输入设备来进行控制。举例而言,同一操作人员在双手动作时,根据配置,其可以是对一个受控对象进行的二对一操作模式的控制,也可以是对两个受控对象分别进行的一对一操 作模式的控制。当手术机器人提供足够多的运动输入设备时,这对于两个以上的操作人员仍然是适用的。The operation mode includes two-to-one operation mode and one-to-one operation mode. The two-to-one operation mode refers to the use of two controlled motion input devices to control a controlled object, and the one-to-one operation mode refers to the use of one controlled motion input device to control a controlled object. Control a controlled object. When controlling the movement of a controlled object, you can choose to use one-to-one operation mode or two-to-one operation mode. For the one-to-one operation mode, it is possible to further select which motion input device is used as the controlled motion input device for control. For example, when the same operator moves both hands, depending on the configuration, it can be a two-to-one operation mode for one controlled object, or it can be a one-to-one operation mode for two controlled objects separately control. When the surgical robot provides enough motion input devices, this is still applicable to more than two operators.
步骤S126,结合操作模式的类型获取受控运动输入设备输入的运动信息并将运动信息解析映射为受控对象远端在第一坐标系的增量位姿信息。In step S126, the motion information input by the controlled motion input device is obtained in combination with the type of operation mode, and the motion information is parsed and mapped into the incremental pose information of the remote end of the controlled object in the first coordinate system.
一实施例中,对于一对一操作模式,举例可以通过公式P n=KP n获得相应一个受控运动输入设备11在第n时刻的位姿信息P,其中,K是比例系数,通常,K>0,更佳的,1≥K>0,以实现对位姿的缩放,便于控制。 In an embodiment, for the one-to-one operation mode, for example, the pose information P of the corresponding controlled motion input device 11 at the nth time can be obtained by the formula P n =KP n, where K is the scale factor, and generally, K >0, better, 1≥K>0, in order to achieve zoom in and out of pose for easy control.
一实施例中,对于二对一操作模式,举例可以通过公式P n=K 1P nL+K 2P nR获得相应两个受控运动输入设备11在第n时刻的位姿信息P,其中,K 1和K 2分别表示不同运动输入设备11的比例系数,通常,K 1>0,K 2>0;更佳的,1≥K 1>0,1≥K 2>0。 In an embodiment, for the two-to-one operation mode, for example, the pose information P of the corresponding two controlled motion input devices 11 at the nth time can be obtained by the formula P n =K 1 P nL + K 2 P nR, where, K 1 and K 2 respectively represent the scale coefficients of different motion input devices 11, usually, K 1 >0, K 2 >0; more preferably, 1≥K 1 >0, 1≥K 2 >0.
计算某前后时刻一对一操作模式或二对一操作模式对应的受控运动输入设备11的增量位姿信息Δp n_n-1时,根据如下公式计算即可: When calculating the incremental pose information Δp n_n-1 of the controlled motion input device 11 corresponding to the one-to-one operation mode or the two-to-one operation mode at a certain time before and after, it can be calculated according to the following formula:
Δp n_n-1=P n-P n-1 Δp n_n-1 = P n -P n-1
一实施例中,如图16和图17所示,在步骤S125获取到的选择指令关联于二对一操作模式时,步骤S126包括:In an embodiment, as shown in FIG. 16 and FIG. 17, when the selection instruction acquired in step S125 is associated with a two-to-one operation mode, step S126 includes:
步骤S1261,分别获取前一时刻两个受控运动输入设备各自的第一位姿信息。Step S1261: Acquire respective first pose information of the two controlled motion input devices at the previous moment.
步骤S1262,分别获取后一时刻两个受控运动输入设备各自的第二位姿信息。Step S1262: Obtain the respective second pose information of the two controlled motion input devices at a later time.
步骤S1263,结合第一比例系数及两个受控运动输入设备各自的第一位姿信息、第二位姿信息计算获取两个受控运动输入设备在固定坐标系的增量位姿信息。In step S1263, the incremental pose information of the two controlled motion input devices in the fixed coordinate system is calculated by combining the first scale factor and the respective first pose information and second pose information of the two controlled motion input devices.
在该步骤S1263中,具体可通过如下步骤实现:In this step S1263, it can be specifically implemented through the following steps:
计算一受控运动输入设备的第一位姿信息和第二位姿信息在固定坐标系的增量位姿信息,并计算另一运动输入设备的第一位姿信息和第二位姿信息在固定坐标系的增量位姿信息。Calculate the incremental pose information of the first pose information and second pose information of a controlled motion input device in a fixed coordinate system, and calculate the first pose information and second pose information of another motion input device in the fixed coordinate system. The incremental pose information of the fixed coordinate system.
结合第一比例系数计算一运动输入设备在固定坐标系的增量位姿信息和另一运动输入设备在固定坐标系的增量位姿信息分别得到该两个运动输入设备在固定坐标系的增量位姿信息。Combining the first scale factor to calculate the incremental pose information of one motion input device in the fixed coordinate system and the incremental pose information of the other motion input device in the fixed coordinate system to obtain the increase of the two motion input devices in the fixed coordinate system. Measure pose information.
其中,在二对一操作模式中,示例性的,该第一比例系数取值为0.5,即将K 1和K 2均取值为0.5,则获取的增量位姿信息表示的是该两个受控运动输入设备之间连线的中心点的增量位姿信息。根据实际情况,也可以对K 1和K 2进行另外的赋值。K 1和K 2可以相同或不同。 Wherein, in the two-to-one operation mode, for example, the first scale factor is 0.5, that is, K 1 and K 2 are both 0.5, and the acquired incremental pose information represents the two The incremental pose information of the center point of the connection between the controlled motion input devices. According to actual conditions, K 1 and K 2 can also be assigned additional values. K 1 and K 2 may be the same or different.
步骤S1264,将两个受控运动输入设备在固定坐标系的增量位姿信息映射为受控对象远端在第一坐标系的增量位姿信息。Step S1264: Map the incremental pose information of the two controlled motion input devices in the fixed coordinate system to the incremental pose information of the remote end of the controlled object in the first coordinate system.
一实施例中,如图18所示,在步骤S125获取到的选择指令关联于二对一操作模式时,步骤S126也可以包括:In an embodiment, as shown in FIG. 18, when the selection instruction acquired in step S125 is associated with a two-to-one operation mode, step S126 may also include:
步骤S1265,分别获取前一时刻两个受控运动输入设备各自在固定坐标系的第一位置信息。In step S1265, the first position information of each of the two controlled motion input devices in the fixed coordinate system at the previous moment is obtained respectively.
步骤S1266,分别获取后一时刻两个受控运动输入设备各自在固定坐标系的第二位置信息。Step S1266: Acquire the second position information of each of the two controlled motion input devices in the fixed coordinate system at a later time.
步骤S1267,结合第二比例系数及两个受控运动输入设备各自在固定坐标系的第一位置信息、第二位置信息计算获取两个受控运动输入设备在固定坐标系的水平移动增量信息、竖直移动增量信息及转动增量信息。Step S1267: Combine the second scale factor and the first position information and second position information of the two controlled motion input devices in the fixed coordinate system to calculate and obtain the horizontal movement increment information of the two controlled motion input devices in the fixed coordinate system. , Vertical movement increment information and rotation increment information.
步骤S1268,将两个受控运动输入设备在固定坐标系的水平移动增量信息、竖直移动增量信息及转动增量信息对应映射为受控对象远端在第一坐标系的偏航角增量信息、俯仰角增量信息及滚动角增量信息。Step S1268, correspondingly map the horizontal movement increment information, vertical movement increment information and rotation increment information of the two controlled motion input devices in the fixed coordinate system to the yaw angle of the remote end of the controlled object in the first coordinate system Incremental information, pitch angle incremental information, and roll angle incremental information.
更进一步地,如图19和图20所示,上述步骤S1268在根据两个受控运动输入设备各自在固定坐标系的第一位置信息、第二位置信息计算获取两个受控运动输入设备在固定坐标系的转动增量信息的步骤之中,包括:Furthermore, as shown in FIG. 19 and FIG. 20, the above step S1268 calculates and obtains the position information of the two controlled motion input devices according to the first position information and the second position information of the two controlled motion input devices in the fixed coordinate system. The steps of fixing the rotation increment information of the coordinate system include:
步骤S12681,建立前一时刻两个受控运动输入设备之间的第一位置向量。Step S12681: Establish a first position vector between the two controlled motion input devices at the previous moment.
步骤S12682,建立后一时刻两个受控运动输入设备之间的第二位置向量。Step S12682, establishing a second position vector between the two controlled motion input devices at a later time.
步骤S12683,结合第三比例系数及第一位置向量与第二位置向量之间的 夹角获取两个受控运动输入设备在固定坐标系的转动增量信息。Step S12683, combining the third scale factor and the angle between the first position vector and the second position vector to obtain the rotation increment information of the two controlled motion input devices in the fixed coordinate system.
一实施例中,如图21和图22所示,在上述步骤S125获取到的选择指令关联于一对一操作模式时,上述步骤S126可以包括:In an embodiment, as shown in FIG. 21 and FIG. 22, when the selection instruction obtained in step S125 is associated with a one-to-one operation mode, step S126 may include:
步骤S12611,获取前一时刻受控运动输入设备在固定坐标系的第一位姿信息。Step S12611: Acquire the first pose information of the controlled motion input device in the fixed coordinate system at the previous moment.
步骤S12612,获取后一时刻受控运动输入设备在固定坐标系的第二位姿信息。Step S12612: Obtain the second pose information of the controlled motion input device in the fixed coordinate system at a later time.
步骤S12613,结合第四比例系数及受控运动输入设备在固定坐标系的第一位姿信息、第二位姿信息计算获取受控运动输入设备在固定坐标系的增量位姿信息。Step S12613: Combine the fourth scale factor and the first pose information and second pose information of the controlled motion input device in the fixed coordinate system to calculate and obtain the incremental pose information of the controlled motion input device in the fixed coordinate system.
步骤S12614,将受控运动输入设备在固定坐标系的增量位姿信息映射为受控对象远端在第一坐标系的增量位姿信息。Step S12614: Map the incremental pose information of the controlled motion input device in the fixed coordinate system to the incremental pose information of the remote end of the controlled object in the first coordinate system.
值得注意的是,在某些使用场景下,机械臂21运动时,需要确保机械臂21运动时使机械臂21远端绕不动点(远端运动中心,Remote Center of Motion)运动,即做RCM约束运动,具体可以通过对机械臂远端的任务自由度进行设置来确保实现,该任务自由度仅与姿态自由度相关。臂体远端的任务自由度可被理解为臂体远端在笛卡尔空间允许运动的自由度,其至多为6个。臂体远端在笛卡尔空间实际具有的自由度为有效自由度,臂体远端的有效自由度与其构型(即结构特征)相关,臂体远端的有效自由度可被理解为臂体远端在笛卡尔空间内可实现的自由度。It is worth noting that in some usage scenarios, when the robotic arm 21 is moving, it is necessary to ensure that the distal end of the robotic arm 21 moves around a stationary point (Remote Center of Motion) when the robotic arm 21 moves, that is, do The RCM constrained movement can be realized by setting the task freedom of the distal end of the robotic arm, which is only related to the posture freedom. The task degree of freedom of the distal end of the arm body can be understood as the degree of freedom that the distal end of the arm body allows to move in Cartesian space, which is at most 6 degrees. The actual degree of freedom of the distal end of the arm body in Cartesian space is the effective degree of freedom, and the effective degree of freedom of the distal end of the arm body is related to its configuration (ie structural feature). The effective degree of freedom of the distal end of the arm body can be understood as the arm body. The degree of freedom that the distal end can achieve in Cartesian space.
该不动点与机械臂远端具有一个相对固定的位置关系。根据具体的控制目的,一些实施例中第二坐标系的原点可以是该不动点,其他实施例中第二坐标系的原点也可以是机械臂远端上的某一点。The fixed point has a relatively fixed positional relationship with the distal end of the mechanical arm. According to specific control purposes, the origin of the second coordinate system in some embodiments may be the fixed point, and in other embodiments, the origin of the second coordinate system may also be a certain point on the distal end of the robotic arm.
一实施例中,如图23所示,具体在步骤S2即分解步骤中,可以包括:In an embodiment, as shown in FIG. 23, specifically in step S2, that is, the decomposition step, it may include:
步骤S211,获取输入的关联于机械臂远端的任务自由度的操作命令。Step S211: Obtain the input operation command associated with the task freedom of the distal end of the robotic arm.
步骤S212,结合任务自由度分别分解各初始目标位姿信息获得包括机械臂远端在第一坐标系的第一分量目标位姿信息及受控操作末端器械在第二坐 标系的第二分量目标位姿信息的一组位姿信息集合。Step S212: Decompose each initial target pose information according to the degree of freedom of the task to obtain the first component target pose information of the distal end of the manipulator in the first coordinate system and the second component target of the controlled operation terminal device in the second coordinate system. A group of pose information collections.
其中,该操作命令可以包括第一操作命令和第二操作命令。第一操作命令同机械臂21远端的任务自由度与机械臂21的有效自由度完全匹配的情况相关联,可以令机械臂远端在机械臂的有效自由度内自由运动;第二操作命令同机械臂21远端的任务自由度与机械臂21的有效自由度中的姿态自由度完全匹配的情况相关联,该第二操作命令即对应上述的RCM约束运动,以在机械臂21运动时确保其远端即动力机构22绕不动点运动。当然,还可以定义其它组合的任务自由度以方便控制,此处不再赘述。Wherein, the operation command may include a first operation command and a second operation command. The first operation command is related to the situation that the task degree of freedom of the distal end of the robot arm 21 and the effective degree of freedom of the robot arm 21 completely match, so that the distal end of the robot arm can move freely within the effective degree of freedom of the robot arm; the second operation command Related to the situation that the task freedom of the distal end of the robotic arm 21 is completely matched with the posture freedom of the effective freedom of the robotic arm 21, this second operation command corresponds to the above-mentioned RCM constraint movement, so that when the robotic arm 21 moves Make sure that its distal end, that is, the power mechanism 22 moves around a fixed point. Of course, you can also define other combinations of task freedom to facilitate control, which will not be repeated here.
例如在步骤S211中获取到第二操作命令时,分解获得的第一分量目标位姿信息中与位置自由度相关的信息保持不变、而只有与姿态自由度相关的信息发生变化。这样机械臂21远端绕不动点运动,而主要依赖受控操作末端器械34B的运动实现期望的位姿,能够确保手术安全。For example, when the second operation command is obtained in step S211, the information related to the position freedom degree in the first component target pose information obtained by decomposition remains unchanged, but only the information related to the attitude degree of freedom changes. In this way, the distal end of the mechanical arm 21 moves around a fixed point, and the movement of the controlled operation end instrument 34B is mainly relied on to achieve the desired posture, which can ensure the safety of the operation.
一实施例中,如图24所示,具体在步骤S2即分解步骤中,可以包括:In an embodiment, as shown in FIG. 24, specifically in step S2, that is, the decomposition step, it may include:
步骤S221,获取机械臂远端在第一坐标系的当前位姿信息;Step S221, acquiring the current pose information of the distal end of the robotic arm in the first coordinate system;
步骤S222,在机械臂远端保持于与其当前位姿信息对应的当前位姿的条件下,换算初始目标位姿信息获得第二分量目标位姿信息;Step S222: Under the condition that the distal end of the manipulator remains in the current pose corresponding to the current pose information, the initial target pose information is converted to obtain the second component target pose information;
步骤S223,对第二分量目标位姿信息的有效性进行判断;Step S223: Judging the validity of the second component target pose information;
该步骤中,如果第二分量目标位姿信息有效,进入步骤S224;否则,进入步骤S225。In this step, if the second component target pose information is valid, go to step S224; otherwise, go to step S225.
步骤S224,在受控操作末端器械到达与第二分量目标位姿信息对应的目标位姿的条件下,换算初始目标位姿信息获得第一分量目标位姿信息;Step S224, under the condition that the controlled terminal device reaches the target pose corresponding to the second component target pose information, convert the initial target pose information to obtain the first component target pose information;
步骤S225,调整第二分量目标位姿信息为有效并更新第二分量目标位姿信息,并在受控操作末端器械到达与更新后的第二分量目标位姿信息对应的目标位姿的条件下,换算初始目标位姿信息获得第一分量目标位姿信息。Step S225: Adjust the second component target pose information to be valid and update the second component target pose information, and under the condition that the controlled operation terminal device reaches the target pose corresponding to the updated second component target pose information , Convert the initial target pose information to obtain the first component target pose information.
通过上述步骤S221~步骤S225,在对受控操作末端器械的位姿进行调整时,优先调整对应的操作臂,如果操作臂的运动满足对受控操作末端器械的调整,则只需要操作臂运动;如果操作臂的运动不能满足对受控操作末端器 械的调整,则可以结合机械臂的运动来进行调整。Through the above steps S221 to S225, when adjusting the posture of the controlled operation end device, the corresponding operation arm is adjusted first. If the movement of the operation arm meets the adjustment of the controlled operation end device, only the operation arm movement is required. ; If the movement of the operating arm cannot meet the adjustment of the controlled operation terminal equipment, it can be adjusted in conjunction with the movement of the mechanical arm.
进而在上述步骤S3即第一判断步骤中,由于第二分量目标位姿信息本身有效或调整后有效,因此实际只需要对第一分量目标位姿信息进行判断即可,在该第一分量目标位姿信息有效时,则可以判断对应的位姿信息集合为有效,否则,则判断位姿信息集合为无效。Furthermore, in the above step S3, the first judgment step, since the second component target pose information itself is valid or effective after adjustment, it is actually only necessary to judge the first component target pose information. When the pose information is valid, it can be judged that the corresponding pose information set is valid; otherwise, it can be judged that the pose information set is invalid.
结合图6参阅,上述步骤S221~步骤S222可以通过如下方式实现,具体通过如下公式(1)实现:Referring to FIG. 6, the above steps S221 to S222 can be implemented in the following ways, specifically implemented by the following formula (1):
Figure PCTCN2020114113-appb-000004
Figure PCTCN2020114113-appb-000004
其中,
Figure PCTCN2020114113-appb-000005
是受控操作末端器械34B在第一坐标系的初始目标位姿信息,
Figure PCTCN2020114113-appb-000006
是机械臂远端在第一坐标系的当前位姿信息,
Figure PCTCN2020114113-appb-000007
是受控操作末端器械34B在第二坐标系的目标位姿信息。T2是受控操作末端器械34B的工具坐标系,T1是机械臂的工具坐标系,B是机械臂的基坐标系。计算时,由于先将
Figure PCTCN2020114113-appb-000008
Figure PCTCN2020114113-appb-000009
是已知的,因而可以计算
Figure PCTCN2020114113-appb-000010
among them,
Figure PCTCN2020114113-appb-000005
Is the initial target pose information of the controlled operation terminal device 34B in the first coordinate system,
Figure PCTCN2020114113-appb-000006
Is the current pose information of the distal end of the robotic arm in the first coordinate system,
Figure PCTCN2020114113-appb-000007
It is the target pose information of the controlled operation terminal device 34B in the second coordinate system. T2 is the tool coordinate system of the controlled operation end instrument 34B, T1 is the tool coordinate system of the robotic arm, and B is the base coordinate system of the robotic arm. When calculating, because first
Figure PCTCN2020114113-appb-000008
with
Figure PCTCN2020114113-appb-000009
Is known, so it can be calculated
Figure PCTCN2020114113-appb-000010
如果步骤S223中判断出
Figure PCTCN2020114113-appb-000011
是无效的,可以将
Figure PCTCN2020114113-appb-000012
调整成有效,然后由于
Figure PCTCN2020114113-appb-000013
Figure PCTCN2020114113-appb-000014
是已知的,计算
Figure PCTCN2020114113-appb-000015
If it is determined in step S223
Figure PCTCN2020114113-appb-000011
Is invalid, you can change
Figure PCTCN2020114113-appb-000012
Adjusted to be effective, and then due to
Figure PCTCN2020114113-appb-000013
with
Figure PCTCN2020114113-appb-000014
Is known, calculate
Figure PCTCN2020114113-appb-000015
本领域技术人员可以理解的是,前述实施例中涉及计算(换算)相应臂体远端在相应坐标系的目标位姿信息时,均可以利用上述公式(1)来实现,只是对于
Figure PCTCN2020114113-appb-000016
等的定义可能根据实际情况发生变化而已,比如,
Figure PCTCN2020114113-appb-000017
也可以是相应臂体在第一坐标系的当前位姿信息,此处不再一一赘述。
Those skilled in the art can understand that when the foregoing embodiments involve calculating (converting) the target pose information of the corresponding arm body distal end in the corresponding coordinate system, the above formula (1) can be used to achieve this, but for
Figure PCTCN2020114113-appb-000016
The definition of etc. may change based on actual conditions. For example,
Figure PCTCN2020114113-appb-000017
It may also be the current pose information of the corresponding arm body in the first coordinate system, which will not be repeated here.
另一实施例中,还提供另外一种手术机器人中末端器械的控制方法。参阅图25,图25所示的控制方法的步骤S1’~S6’与图4所示的控制方法的步骤S1~S6大致相同、但至少某些步骤在具体实施时存在一些区别,具体而言,图25所示的控制方法包括:In another embodiment, another method for controlling end instruments in a surgical robot is also provided. Referring to FIG. 25, steps S1' to S6' of the control method shown in FIG. 25 are substantially the same as steps S1 to S6 of the control method shown in FIG. , The control method shown in Figure 25 includes:
步骤S1’,获取步骤,即获取各受控操作末端器械的初始目标位姿信息。Step S1', the obtaining step, namely obtaining the initial target pose information of each controlled operation end device.
安装于动力机构22上的操作末端器械34B包括被配置为受控操作末端器械(需通过运动输入设备控制的操作末端器械)和未被配置的非受控操作末端器械(不需通过运动输入设备控制的操作末端器械)。一个操作人员至多 可以同时对两个受控操作末端器械34B进行控制,当受控操作末端器械34B为两个以上时,可以由两个以上的操作人员进行协同控制。The operating end device 34B installed on the power mechanism 22 includes a controlled operating end device (an operating end device that needs to be controlled by a motion input device) and an uncontrolled operating end device that is not configured (no need to use a motion input device). Controlled operating end equipment). One operator can control at most two controlled operation end devices 34B at the same time. When there are more than two controlled operation end devices 34B, more than two operators can perform coordinated control.
步骤S2’,分解步骤,即分解各初始目标位姿信息分别获得一组位姿信息集合。Step S2', decomposition step, that is, decomposing each initial target pose information to obtain a group of pose information sets.
其中,每组位姿信息集合均包括机械臂远端在第一坐标系的第一分量目标位姿信息及受控操作末端器械在第二坐标系的第二分量目标位姿信息。第一坐标系指机械臂的基坐标系,第二坐标系指机械臂的工具坐标系。Wherein, each set of pose information includes the first component target pose information of the distal end of the robotic arm in the first coordinate system and the second component target pose information of the controlled operation terminal device in the second coordinate system. The first coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm.
步骤S3’,第一判断步骤,即对各组位姿信息集合的有效性进行判断。Step S3', the first judging step, namely judging the validity of each set of pose information.
具体对每组位姿信息集合中包括的两个分量位姿信息的有效性进行判断,该两个分量位姿信息均有效时,该组位姿信息集合才被认定为有效,否则,该组位姿信息集合被认定为无效。Specifically, the validity of the two component pose information included in each group of pose information set is judged. When the two component pose information are both valid, the set of pose information is considered valid. Otherwise, the set of pose information is considered valid. The pose information collection is deemed invalid.
步骤S4’,计算步骤,即在至少有一组位姿信息集合有效、且在图像末端器械及各非受控操作末端器械保持于当前位姿的条件下,结合各组位姿信息集合计算机械臂远端在第一坐标系的第一目标位姿信息、图像末端器械在第二坐标系的第二目标位姿信息、各受控操作末端器械分别在第二坐标系的第三目标位姿信息及各非受控操作末端器械分别在第二坐标系的第四目标位姿信息。Step S4', the calculation step, that is, under the condition that at least one set of pose information is valid, and the image end device and each uncontrolled operation end device are kept in the current pose, the robot arm is calculated by combining each set of pose information The first target pose information of the distal end in the first coordinate system, the second target pose information of the image terminal device in the second coordinate system, and the third target pose information of each controlled operation end device in the second coordinate system And the fourth target pose information of each uncontrolled operation end device in the second coordinate system.
在该步骤中,期望非受控操作末端器械34B能够保持于当前位姿;并优先期望各受控操作末端器械34B能够到达第一期望位姿,如果若干受控操作末端器械34B不能够到达第一期望位姿,则期望这些不能够到达第一期望位姿的受控操作末端器械34B能够到达第二期望位姿。该第一期望位姿指对应于初始目标位姿信息的目标位姿(包括初始目标位姿(其与受控运动输入设备输入的运动信息相关联)与当前位姿一致或不一致的两种情况)。该第二期望位姿指当前位姿,当若干受控操作末端器械34B不能到达第一期望位姿的情况下,旨在确保它/它们能够到达第二期望位姿,以保证手术安全。In this step, it is expected that the uncontrolled operation end devices 34B can be maintained in the current posture; and it is preferred that each controlled operation end device 34B can reach the first desired posture. If several controlled operation end devices 34B cannot reach the first desired posture, If a desired posture is desired, it is expected that these controlled operation end instruments 34B that cannot reach the first desired posture can reach the second desired posture. The first expected pose refers to two situations where the target pose corresponding to the initial target pose information (including the initial target pose (which is associated with the motion information input by the controlled motion input device) is consistent with or inconsistent with the current pose ). The second desired posture refers to the current posture. When several controlled operation end instruments 34B cannot reach the first desired posture, it is intended to ensure that it/they can reach the second desired posture to ensure the safety of the operation.
步骤S5’,第二判断步骤,即对第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息的有效性进行判断。Step S5', the second judgment step, is to judge the validity of the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information.
步骤S6’,控制步骤,即在第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息均有效时,根据第一目标位姿信息控制机械臂运动以使机械臂远端到达对应的目标位姿,根据第二目标位姿信息控制图像末端器械对应的操作臂运动以使图像末端器械保持于当前位姿,根据各第三目标位姿信息控制对应于受控操作末端器械的操作臂运动以使受控操作末端器械到达对应的目标位姿,并根据各第四目标位姿信息控制对应于非受控操作末端器械的操作臂运动以使各非受控操作末端器械保持于当前位姿。Step S6', the control step, that is, when the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information are all valid, control according to the first target pose information The manipulator moves to make the distal end of the manipulator reach the corresponding target pose, and controls the movement of the operating arm corresponding to the end-of-image instrument according to the second target pose information to keep the end-of-image instrument at the current pose, according to each third target pose The information control corresponds to the movement of the operating arm of the controlled operation end device to make the controlled operation end device reach the corresponding target pose, and controls the movement of the operating arm corresponding to the uncontrolled operation end device according to the fourth target pose information. Keep each uncontrolled operation end instrument in the current posture.
通过上述步骤S1’~步骤S6’,在获取的第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息均有效时,可以在保持图像末端器械34A及非受控操作末端器械34B于当前位姿以提供稳定视野的同时,使受控操作末端器械34B到达第一期望位姿或第二期望位姿;此外,可以在某些场景下结合机械臂及对应的操作臂一起运动,扩展受控操作末端器械34B的运动范围,以利于更容易地施展手术。Through the above steps S1' to S6', when the acquired first target pose information, second target pose information, each third target pose information, and each fourth target pose information are all valid, the image can be maintained The end device 34A and the uncontrolled operation end device 34B are in the current posture to provide a stable field of view, while the controlled operation end device 34B reaches the first desired posture or the second desired posture; in addition, it can be used in certain scenarios Combining the mechanical arm and the corresponding operating arm to move together, the movement range of the controlled operating end instrument 34B is expanded, so that the operation can be performed more easily.
一实施例中,具体在上述步骤S3’中,若经判断获得的各组位姿信息集合均无效时,表示各受控操作末端器械34B(包括一个及以上的受控操作末端器械)都不具备可调性,因而不再进入后续步骤,即结束控制,重新回到步骤S1’。In one embodiment, specifically in the above step S3', if all the posture information sets obtained by the judgment are invalid, it means that all controlled operation end devices 34B (including one or more controlled operation end devices) are not It is adjustable, so it does not enter the subsequent steps, that is, ends the control, and returns to step S1'.
一实施例中,结合图26和图27参阅,在受控操作末端器械被配置为一个时,且该位姿信息集合有效时,上述步骤S4’,即计算步骤包括:In an embodiment, referring to Fig. 26 and Fig. 27, when the controlled operation end device is configured as one and the pose information set is valid, the foregoing step S4', that is, the calculation step includes:
步骤S411’,在机械臂远端到达与第一分量目标位姿信息对应的目标位姿的条件下,换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,并换算各非受控操作末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息。Step S411', under the condition that the distal end of the robotic arm reaches the target pose information corresponding to the first component target pose information, convert the current pose information of the image end instrument to obtain its target pose information in the second coordinate system, and Convert the current pose information of each uncontrolled operation terminal device to obtain its target pose information in the second coordinate system.
各末端器械34包括图像末端器械34A和受控操作末端器械34B的当前位姿信息可以是第一坐标系或第二坐标系,还可以是其它参考坐标系,这些坐标系之间实质是可以相互转换的。本文中示例性的,“当前位姿信息”指在 第二坐标系的当前位姿信息,当然也可以是其它坐标系的当前位姿信息。The current pose information of each end device 34, including the image end device 34A and the controlled operation end device 34B, can be the first coordinate system or the second coordinate system, or other reference coordinate systems. These coordinate systems can essentially interact with each other. Converted. As an example in this document, "current pose information" refers to current pose information in the second coordinate system, and of course, it can also be current pose information in other coordinate systems.
步骤S412’,将第一分量目标位姿信息赋值成第一目标位姿信息,将换算获得的图像末端器械在第二坐标系的目标位姿信息赋值成第二目标位姿信息,将第二分量目标位姿信息赋值成第三目标位姿信息,将各非受控操作末端器械在第二坐标系的目标位姿信息赋值成相应非受控操作末端器械的第四目标位姿信息。Step S412', assign the first component target pose information to the first target pose information, assign the converted target pose information of the image end instrument in the second coordinate system to the second target pose information, and assign the second target pose information to the target pose information. The component target pose information is assigned to the third target pose information, and the target pose information of each uncontrolled operation end device in the second coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
上述步骤S5’即第二判断步骤中,由于该位姿信息集合已经确定是有效的,因而第一目标位姿信息和第三目标位姿信息是有效的。因此实际只需判断第二目标位姿信息及各第四目标位姿信息是否有效即可。In the above step S5', that is, the second judgment step, since the pose information set has been determined to be valid, the first target pose information and the third target pose information are valid. Therefore, it is actually only necessary to determine whether the second target pose information and each fourth target pose information are valid.
若第一至第四目标位姿信息并非均有效,结束控制。If the first to fourth target pose information are not all valid, the control ends.
若第一至第四目标位姿信息均有效,进入步骤S6’即控制步骤。如图27所示,操作末端器械34B中包括受控操作末端器械34B1和非受控操作末端器械34B2。根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持于当前位姿,根据第三目标位姿信息控制操作臂31B运动以使受控操作末端器械34B1到达对应的目标位姿(第一期望位姿),根据第四目标位姿信息控制操作臂31C运动以使非受控操作末端器械34B2保持于当前位姿。If the first to fourth target pose information are all valid, go to step S6', which is the control step. As shown in FIG. 27, the operation end device 34B includes a controlled operation end device 34B1 and an uncontrolled operation end device 34B2. According to the first target pose information, the robot arm 21 is controlled to move so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operation arm 31A is controlled to move according to the second target pose information to keep the image end instrument 34A at the current position. Posture, control the movement of the operating arm 31B according to the third target posture information so that the controlled operation end device 34B1 reaches the corresponding target posture (the first desired posture), and control the movement of the operating arm 31C according to the fourth target posture information to make The uncontrolled operation end device 34B2 remains in the current posture.
一实施例中,结合图28和图29参阅,在受控操作末端器械被配置为多个,且在上述步骤S3’经判断获得仅一个位姿信息集合有效、而其余位姿信息集合无效时,上述步骤S4’,即计算步骤包括:In an embodiment, referring to Fig. 28 and Fig. 29, when the controlled operation terminal device is configured as multiple, and it is judged that only one pose information set is valid in the above step S3', and the other pose information sets are invalid , The above step S4', that is, the calculation step includes:
步骤S421’,在机械臂远端到达与有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,换算各非受控操作末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,并换算与各无效的位姿信息关联的受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息。Step S421', under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the effective pose information set, convert the current pose information of the image end device to obtain its second coordinate System target pose information, convert the current pose information of each uncontrolled operation end device to obtain its target pose information in the second coordinate system, and convert the control operation end device associated with each invalid pose information The current pose information obtains its second desired target pose information in the second coordinate system.
步骤S422’,将有效的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将图像末端器械在第二坐标系的目标位姿信息赋值成第二目标位姿信息,将有效的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将各第二期望目标位姿分别赋值成相应受控操作末端器械的第三目标位姿信息,将各非受控操作末端器械在第二坐标系的目标位姿信息赋值成相应非受控操作末端器械的第四目标位姿信息。Step S422', assign the first component target pose information in the effective pose information set to the first target pose information, and assign the target pose information of the image end instrument in the second coordinate system to the second target pose Information, assign the second component target pose information in the effective pose information set to the third target pose information of the associated controlled operation end device, and assign each second expected target pose to the corresponding controlled operation The third target pose information of the end device, the target pose information of each uncontrolled operation end device in the second coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
上述步骤S5’即第二判断步骤中,实际只需要判断图像末端器械34A的第二目标位姿信息及与各无效的位姿信息集合关联的受控操作末端器械34B的第三目标位姿信息是否有效即可。The above step S5' is the second judgment step, it is actually only necessary to judge the second target pose information of the end image device 34A and the third target pose information of the controlled operation end device 34B associated with each invalid pose information set. Is it valid?
若第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息并非均有效,结束控制。If the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information are not all valid, the control ends.
若第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息均有效,进入步骤S6’即控制步骤。如图29所示,操作末端器械34B中包括受控操作末端器械34B1~34B3和非受控操作末端器械34B4。若受控操作末端器械34B1关联的一组位姿信息集合有效,而受控操作末端器械34B2~34B3关联的两组位姿信息集合无效:If the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information are all valid, go to step S6', which is a control step. As shown in FIG. 29, the operation end equipment 34B includes controlled operation end equipment 34B1 to 34B3 and an uncontrolled operation end equipment 34B4. If the set of posture information associated with the controlled operation end device 34B1 is valid, and the two sets of posture information associated with the controlled operation end device 34B2~34B3 are invalid:
根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1的第三目标位姿信息控制操作臂31B运动以使受控操作末端器械34B到达对应的目标位姿(第一期望位姿),并根据受控操作末端器械34B2~34B3各自的第三目标位姿信息控制操作臂31C~31D运动以使受控操作末端器械34B2~34B3到达对应的目标位姿(第二期望位姿,即保持当前位姿),并根据第四目标位姿信息控制操作臂31E运动以使非受控操作末端器械34B4保持于当前位姿。Control the movement of the robotic arm 21 according to the first target pose information so that the power mechanism 22 at the far end reaches the corresponding target pose, and control the movement of the operating arm 31A according to the second target pose information to keep the image end instrument 34A in the current pose , Control the movement of the operating arm 31B according to the third target posture information of the controlled operation end device 34B1 to make the controlled operation end device 34B reach the corresponding target posture (the first desired posture), and according to the controlled operation end device 34B2 The third target pose information of each of ~34B3 controls the movement of the operating arms 31C~31D so that the controlled operation end instruments 34B2~34B3 reach the corresponding target pose (the second desired pose, that is, maintain the current pose), and according to the first The four-target pose information controls the movement of the operating arm 31E to keep the uncontrolled operating end device 34B4 in the current pose.
含有步骤S421’~步骤S422’的步骤S1’~S6’除适用于图29所示同一机械臂21具有三个受控操作末端器械34B之外,根据其原理同样适用于同一 机械臂21具有两个、及四个以上的受控操作末端器械34B的情况。Steps S1' to S6' including steps S421' to S422' are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B shown in FIG. 29, but also applicable to the same robotic arm 21 having two One or more than four controlled-operation end devices 34B.
一实施例中,结合图29和图30参阅,受控操作末端器械为多个,且两个以上位姿信息集合有效、其余位姿信息集合无效时,上述步骤S4’,即计算步骤包括:In one embodiment, referring to Fig. 29 and Fig. 30, when there are multiple controlled operation end devices, and two or more pose information sets are valid, and the remaining pose information sets are invalid, the foregoing step S4', that is, the calculation step includes:
步骤S431’,在机械臂远端到达与相应于各有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息。Step S431', under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in each valid pose information set, the current pose information of the image end device is converted to obtain the target pose information. Target pose information in the second coordinate system.
步骤S432’,对图像末端器械在第二坐标系的各目标位姿信息的有效性进行判断。Step S432', judging the validity of each target pose information of the image terminal device in the second coordinate system.
该步骤中,如果图像末端器械的各目标位姿信息中仅一个有效时,进入步骤S433’;如果图像末端器械的各目标位姿信息中两个以上有效时,进入步骤S438’。In this step, if only one of the target pose information of the end image device is valid, step S433' is entered; if more than two of the target pose information of the end image device are valid, step S438' is entered.
步骤S433’,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的目标位姿信息集合关联的各受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息,换算各非受控操作末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,并换算与其余有效的目标位姿信息集合关联的各受控操作末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息。Step S433', under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, the conversion is The current pose information of each controlled end device associated with the invalid target pose information set obtains its second expected target pose information in the second coordinate system, and the current pose information of each uncontrolled end device is obtained by conversion Its target pose information in the second coordinate system, and convert the initial target pose information of each controlled terminal device associated with the remaining effective target pose information sets to obtain its first expected target position in the second coordinate system Posture information.
步骤S434’,对各第一期望目标位姿信息的有效性进行判断。In step S434', the validity of each first desired target pose information is judged.
该步骤中,如果各第一期望目标位姿信息均有效,进入步骤S435’;如果各第一期望目标位姿信息中至少部分无效,进入步骤S436’。In this step, if all the first desired target pose information is valid, go to step S435'; if at least part of the first desired target pose information is invalid, go to step S436'.
步骤S435’,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将各第一期望目标位姿信息及各第 二期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将各非受控操作末端器械在第二坐标系的目标位姿信息赋值成相应非受控操作末端器械的第四目标位姿信息。Step S435', assign the first component target pose information in the pose information set associated with the target pose information of the effective end image device to the first target pose information, and assign the target pose information of the effective end image device The information is assigned to the second target pose information, and the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Pose information, assign each first desired target pose information and each second desired target pose information to the third target pose information of the corresponding controlled operation end device, and place each uncontrolled operation end device in the first The target pose information of the two-coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
其中,将有效的第一期望目标位姿信息对应赋值成关联的受控操作末端器械的第三目标位姿信息;将第二期望目标位姿信息对应赋值成关联于无效的目标位姿信息集合的受控操作末端器械的第三目标位姿信息。Among them, the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; the second desired target pose information is correspondingly assigned to be associated with the invalid target pose information set The third target pose information of the controlled operation end device.
步骤S436’,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的各第一期望目标位姿信息关联的受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息。Step S436', under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, the conversion and The current pose information of the controlled operation end device associated with each invalid first desired target pose information obtains its second desired target pose information in the second coordinate system.
步骤S437’,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将有效的各第一期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将不同阶段(即条件)获得的各第二期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将各非受控操作末端器械在第二坐标系的目标位姿信息赋值成相应非受控操作末端器械的第四目标位姿信息。Step S437', assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose of the effective end-of-image equipment The information is assigned to the second target pose information, and the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Pose information, each valid first desired target pose information is assigned to the third target pose information of the corresponding controlled operation end device, and each second desired target pose information obtained at different stages (ie, conditions) is assigned Respectively assign values to the third target pose information of the corresponding controlled operation end device, and assign the target pose information of each uncontrolled operation end device in the second coordinate system to the fourth target position of the corresponding uncontrolled operation end device Posture information.
其中,将有效的第一期望目标位姿信息对应赋值成关联的受控操作末端器械的第三目标位姿信息;各第二期望目标位姿信息关联于两种情况,一种情况关联于无效的目标位姿信息集合,另一种情况关联于无效的第一期望目标位姿信息(转换第一期望位姿为第二期望位姿),因此需要将其对应赋值成关联于相应情况的受控操作末端器械。步骤S438’,选择将有效的图像末端器械的目标位姿信息中的一个作为有效、将其余作为无效,并进入在图像末端器械的各目标位姿信息中仅一个有效时的步骤S433’。Among them, the effective first desired target pose information is correspondingly assigned to the third target pose information of the associated controlled operation end device; each second desired target pose information is associated with two situations, one of which is related to invalid The target pose information set in the other case is related to the invalid first expected target pose information (converting the first expected pose to the second expected pose), so it needs to be assigned correspondingly to the recipient associated with the corresponding situation. Control and operate the end equipment. In step S438', one of the valid target pose information of the end-of-picture equipment is selected as valid, and the rest are regarded as invalid, and step S433' is entered when only one of the target pose information of the end-of-picture equipment is valid.
该步骤S438’中,可以配置形成多种将多个有效的图像末端器械的目标位 姿信息视为有效及视为无效的组合,并分别利用上述步骤S433’~步骤S437’进行计算,并将计算出的第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效的一组来进行步骤S6’的控制步骤。In this step S438', it is possible to configure and form a variety of combinations that regard the target pose information of multiple valid end-of-image devices as valid and invalid, and use the aforementioned steps S433' to S437' to perform calculations. A set of the calculated first target pose information, second target pose information, and each third target pose information are all valid for the control step of step S6'.
在一些实施例中,如果不同组合中对应计算出的第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息有两组以上均有效,那么可以根据一些衡量指标来确定选择第一目标位姿信息、第二目标位姿信息、各第三目标位姿信息及各第四目标位姿信息均有效的某一组来进行步骤S6’的控制步骤。这些衡量指标包括但不限于臂体(机械臂或操作臂)的运动范围、运动速度及运动加速度中的一种以上,可以采用如臂体运动范围更小、运动速度更小及运动加速度更小中的一种以上来选择出用于步骤S6’的第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息。这些衡量指标包括但不限于能实现第一预期位姿、第二预期位姿的受控操作末端器械的数量。优先选择能够到达第一预期位姿的数量更多的来进行控制。这些衡量指标也可以相互结合以选取出最优的一组来进行步骤S6’的控制。In some embodiments, if more than two sets of correspondingly calculated first target pose information, second target pose information, each third target pose information, and each fourth target pose information in different combinations are valid, Then, according to some measurement indicators, it can be determined to select a group in which the first target pose information, the second target pose information, each third target pose information, and each fourth target pose information are all valid to perform step S6' Control steps. These metrics include, but are not limited to, more than one of the range of motion, motion speed, and motion acceleration of the arm (mechanical arm or manipulator arm), such as smaller arm motion range, lower motion speed, and lower motion acceleration. One or more of them are used to select the first target pose information, the second target pose information, and each third target pose information used in step S6'. These metrics include, but are not limited to, the number of controlled-operated end devices that can achieve the first expected pose and the second expected pose. It is preferred to control the number of poses that can reach the first expected pose. These measurement indicators can also be combined with each other to select an optimal group for the control of step S6'.
在一些实施例中,可以预先或者在操作受控操作末端器械的过程中实时(如通过语音指令)为各受控操作末端器械设置优先级,在步骤S438’中依次选择优先级更高的受控操作末端器械所关联的有效的图像末端器械的目标位姿信息视为有效、将其余视为无效,以尽量保障较高优先级的控制对象能够实现第一期望位姿。对于优先级的设置,可以根据操作人员的权限来设置,也可以根据具体的控制对象来设置,可以进行灵活配置。In some embodiments, the priority can be set for each controlled terminal device in advance or in real time (for example, by voice command) during the operation of the controlled terminal device, and in step S438', the recipients with higher priority are selected in turn. The target pose information of the effective image end device associated with the control operation end device is considered valid, and the rest is considered invalid, so as to ensure that the control object with a higher priority can achieve the first desired pose as much as possible. The priority setting can be set according to the authority of the operator, or can be set according to the specific control object, which can be flexibly configured.
如图29所示,操作末端器械34B中包括受控操作末端器械34B1~34B3和非受控操作末端器械34B4。假设受控操作末端器械34B1关联的一组位姿信息集合无效、受控操作末端器械34B2~34B3关联的两组位姿信息集合均有效,根据上述步骤S431’算出的关联于受控操作末端器械34B2、34B3的图像末端器械在第二坐标系的目标位姿信息分别为C2、C3。As shown in FIG. 29, the operation end equipment 34B includes controlled operation end equipment 34B1 to 34B3 and an uncontrolled operation end equipment 34B4. Assuming that the set of posture information associated with the controlled operation end device 34B1 is invalid, and the two sets of posture information associated with the controlled operation end device 34B2~34B3 are all valid, the calculation is related to the controlled operation end device according to the above step S431' The target pose information of the image end instruments of 34B2 and 34B3 in the second coordinate system are C2 and C3, respectively.
情况(1.1):假设经步骤S432’判断出C2、C3均无效,结束控制。Case (1.1): Assuming that it is determined in step S432' that both C2 and C3 are invalid, the control ends.
情况(1.2):假设经步骤S432’判断出C2有效、C3无效。Case (1.2): Suppose it is judged that C2 is valid and C3 is invalid in step S432'.
基于受控操作末端器械34B2关联的一组位姿信息集合的第一分量位姿信息,根据步骤S433’算出受控操作末端器械34B1在第二坐标系的目标位姿信息(第二期望目标位姿信息)、受控操作末端器械34B3在第二坐标系的目标位姿信息(第一期望目标位姿信息)、及非受控操作末端器械34B4在第二坐标系的目标位姿信息。Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B2, the target pose information of the controlled operation end device 34B1 in the second coordinate system (the second expected target position) is calculated according to step S433' Posture information), the target posture information of the controlled operation end device 34B3 in the second coordinate system (the first desired target posture information), and the target posture information of the uncontrolled operation end device 34B4 in the second coordinate system.
假设根据步骤S434’判断出受控操作末端器械34B3在第二坐标系的第一期望目标位姿信息有效:Assuming that according to step S434', it is determined that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is valid:
通过步骤S435’进行赋值后,进入上述步骤S5’,并在第一至第四目标位姿信息均有效时,进入步骤S6’。在步骤S6’中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1的第三目标位姿信息控制操作臂31B运动以使受控操作末端器械34B到达对应的目标位姿(第二期望位姿,即保持当前位姿),根据受控操作末端器械34B2~34B3各自的第三目标位姿信息控制操作臂31C~31D运动以使受控操作末端器械34B2~34B3到达对应的目标位姿(第一期望位姿),并根据第四目标位姿信息控制操作臂31E运动以使非受控操作末端器械34B4保持于当前位姿。After the value is assigned in step S435', the process proceeds to step S5', and when the first to fourth target pose information is valid, the process proceeds to step S6'. In step S6', the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image The instrument 34A maintains the current pose, and controls the movement of the operating arm 31B according to the third target pose information of the controlled operation end device 34B1 to make the controlled operation end device 34B reach the corresponding target pose (the second desired pose, that is, maintain the current Posture), according to the third target posture information of the controlled operation end devices 34B2 to 34B3, the operation arms 31C to 31D are controlled to move so that the controlled operation end devices 34B2 to 34B3 reach the corresponding target posture (the first desired posture). ), and control the movement of the operating arm 31E according to the fourth target pose information to keep the uncontrolled operating end device 34B4 in the current pose.
假设根据步骤S434’判断出受控操作末端器械34B3在第二坐标系的第一期望目标位姿信息无效:Assuming that it is determined according to step S434' that the first expected target pose information of the controlled operation end device 34B3 in the second coordinate system is invalid:
基于受控操作末端器械34B2关联的一组位姿信息集合的第一分量位姿信息,根据步骤S436’计算出受控操作末端器械34B3在第二坐标系的第二期望目标位姿信息,并通过步骤S437’进行赋值后,进入上述步骤S5’,并在第一至第四目标位姿信息均有效时,进入步骤S6’。在步骤S6’中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1、34B3各自的第三目标位姿信息控制操作臂31B、34D运动以使受控操作末端器械34B1、34B3到达对应的目标 位姿(第二期望位姿,即保持当前位姿),并根据受控操作末端器械34B2的第三目标位姿信息控制操作臂31C运动以使受控操作末端器械34B2到达对应的目标位姿(第一期望位姿),并根据第四目标位姿信息控制操作臂31E运动以使非受控操作末端器械34B4保持于当前位姿。Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B2, the second expected target pose information of the controlled operation end device 34B3 in the second coordinate system is calculated according to step S436', and After the value is assigned in step S437', the process proceeds to step S5', and when the first to fourth target pose information is valid, the process proceeds to step S6'. In step S6', the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image The instrument 34A maintains the current pose, and controls the movement of the operating arms 31B, 34D according to the third target pose information of the controlled operating end devices 34B1, 34B3 so that the controlled operating end devices 34B1, 34B3 reach the corresponding target poses (second The desired posture, that is, the current posture is maintained), and the movement of the operating arm 31C is controlled according to the third target posture information of the controlled operation end device 34B2 to make the controlled operation end device 34B2 reach the corresponding target posture (the first desired position) Posture), and control the movement of the operating arm 31E according to the fourth target posture information to keep the uncontrolled operating end device 34B4 in the current posture.
情况(1.3):假设经步骤S432’判断出C2、C3均有效。Case (1.3): Assume that it is judged that C2 and C3 are both valid in step S432'.
选择将C2视为有效、C3视为无效及/或将C2视为无效、C3视为有效,进入上述情况(1.2)。Choose to regard C2 as valid, C3 as invalid and/or C2 as invalid and C3 as valid, enter the above situation (1.2).
含有步骤S431’~步骤S438’的步骤S1’~S6’除适用于图29所示同一机械臂21具有三个受控操作末端器械34B之外,根据其原理同样适用于同一机械臂21具有四个以上的受控操作末端器械34B的情况。Steps S1' to S6' including steps S431' to S438' are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B shown in FIG. 29, but also applicable to the same robotic arm 21 having four controlled operation end devices 34B according to its principle. More than one controlled operation end device 34B.
一实施例中,结合图29和图31参阅,受控操作末端器械为两个以上(包括两个及以上),且各位姿信息集合均有效时,上述步骤S4’,即计算步骤包括:In an embodiment, referring to Fig. 29 and Fig. 31, when there are more than two (including two or more) controlled end devices, and each posture information set is valid, the above step S4', that is, the calculation step includes:
步骤S441’,在机械臂远端到达与相应于各有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算图像末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息。Step S441', under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in each valid pose information set, the current pose information of the image end device is respectively converted to obtain the target pose information. Target pose information in the second coordinate system.
步骤S442’,对图像末端器械在第二坐标系的各目标位姿信息的有效性进行判断。Step S442', judging the validity of each target pose information of the image terminal device in the second coordinate system.
该步骤中,如果图像末端器械的各目标位姿信息中仅一个有效,进入步骤S443’;如果图像末端器械的各目标位姿信息中两个以上有效,进入步骤S448’。In this step, if only one of the target pose information of the end image device is valid, step S443'; if more than two of the target pose information of the end image device are valid, step S448'.
步骤S443’,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算各非受控操作末端器械的当前位姿信息获得其在第二坐标系的目标位姿信息,换算与其余有效的目标位姿信息集合关联的各受控操作末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息。Step S443', under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, convert each The current pose information of the uncontrolled operation terminal device obtains its target pose information in the second coordinate system, and the initial target pose information of each controlled operation terminal device associated with the remaining effective target pose information set is converted to obtain it. The pose information of the first desired target in the second coordinate system.
步骤S444’,对各第一期望目标位姿信息的有效性进行判断。In step S444', the validity of each first desired target pose information is judged.
该步骤中,如果各第一期望目标位姿信息均有效,进入步骤S445’;如果各第一期望目标位姿信息中至少部分无效,进入步骤S446’。In this step, if all the first desired target pose information is valid, go to step S445'; if at least part of the first desired target pose information is invalid, go to step S446'.
步骤S445’,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将各第一期望目标位姿信息赋值成对应的受控操作末端器械的第三目标位姿信息,将各非受控操作末端器械在第二坐标系的目标位姿信息赋值成相应非受控操作末端器械的第四目标位姿信息。Step S445', assign the first component target pose information in the pose information set associated with the target pose information of the effective end image device to the first target pose information, and assign the target pose information of the effective end image device The information is assigned to the second target pose information, and the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Posture information, assign each first desired target posture information to the third target posture information of the corresponding controlled operation end device, and assign the target posture information of each uncontrolled operation end device in the second coordinate system to The fourth target pose information of the corresponding uncontrolled operation end device.
步骤S446’,在机械臂远端到达与有效的图像末端器械的目标位姿信息关联的、有效的位姿信息集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算与无效的各第一期望目标位姿信息关联的受控操作末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息。Step S446', under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component of the target pose information in the effective pose information set that is associated with the target pose information of the effective end-of-image device, the conversion and The current pose information of the controlled operation end device associated with each invalid first desired target pose information obtains its second desired target pose information in the second coordinate system.
步骤S447’,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第一分量目标位姿信息赋值成第一目标位姿信息,将有效的图像末端器械的目标位姿信息赋值成第二目标位姿信息,将关联于有效的图像末端器械的目标位姿信息的位姿信息集合中的第二分量目标位姿信息赋值成关联的受控操作末端器械的第三目标位姿信息,将有效的各第一期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将各第二期望目标位姿信息分别赋值成对应的受控操作末端器械的第三目标位姿信息,将各非受控操作末端器械在第二坐标系的目标位姿信息赋值成相应非受控操作末端器械的第四目标位姿信息。Step S447', assign the first component target pose information in the pose information set associated with the target pose information of the effective end-of-image equipment to the first target pose information, and assign the target pose of the effective end-of-image equipment The information is assigned to the second target pose information, and the second component target pose information in the pose information set related to the target pose information of the effective image end device is assigned to the third target of the associated controlled operation end device Pose information, each valid first desired target pose information is assigned to the third target pose information of the corresponding controlled operation end device, and each second desired target pose information is assigned to the corresponding controlled operation The third target pose information of the end device, the target pose information of each uncontrolled operation end device in the second coordinate system is assigned to the fourth target pose information of the corresponding uncontrolled operation end device.
这里的第二期望目标位姿信息仅关联于无效的第一期望目标位姿信息(转换第一期望位姿为第二期望位姿)这一种情况。The second expected target pose information here is only associated with the invalid first expected target pose information (converting the first expected pose to the second expected pose).
步骤S448’,选择将有效的图像末端器械的目标位姿信息中的一个作为有效、将其余作为无效,并进入在图像末端器械的各目标位姿信息中仅一个有 效时的步骤S443’。In step S448', one of the valid target pose information of the end-of-picture equipment is selected as valid, and the rest are regarded as invalid, and step S443' is entered when only one of the target pose information of the end-of-picture equipment is valid.
如图29所示,操作末端器械34B中包括受控操作末端器械34B1~34B3和非受控操作末端器械34B4。假设受控操作末端器械34B1~34B3关联的三组位姿信息集合均有效,根据上述步骤S441’算出的关联于受控操作末端器械34B1、34B2、34B3的图像末端器械在第二坐标系的目标位姿信息分别为C1、C2、C3。As shown in FIG. 29, the operation end equipment 34B includes controlled operation end equipment 34B1 to 34B3 and an uncontrolled operation end equipment 34B4. Assuming that the three sets of pose information associated with the controlled operation end devices 34B1 to 34B3 are all valid, the image end devices associated with the controlled operation end devices 34B1, 34B2, and 34B3 calculated according to the above step S441' are the targets in the second coordinate system The pose information is C1, C2, C3, respectively.
情况(2.1):假设经步骤S442’判断出C1~C3均无效,结束控制。Case (2.1): Assuming that it is determined in step S442' that all C1 to C3 are invalid, the control ends.
情况(2.2):假设经步骤S442’判断出仅C1有效、C2和C3无效。Case (2.2): Assume that it is judged in step S442' that only C1 is valid, and C2 and C3 are invalid.
基于受控操作末端器械34B1关联的一组位姿信息集合的第一分量位姿信息,根据步骤S433’算出受控操作末端器械34B2、34B3在第二坐标系的目标位姿信息(第一期望目标位姿信息),并根据步骤S433’算出非受控操作末端器械34B4在第二坐标系的目标位姿信息(同理于第二期望目标位姿)。Based on the first component pose information of a set of pose information associated with the controlled operation end device 34B1, the target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system (the first expectation) is calculated according to step S433' Target pose information), and calculate the target pose information of the uncontrolled operation end device 34B4 in the second coordinate system according to step S433' (same as the second expected target pose).
假设根据步骤S444’判断出受控操作末端器械34B2、34B3在第二坐标系的第一期望目标位姿信息均有效:Assuming that according to step S444’, it is determined that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system are both valid:
通过步骤S445’进行赋值后,进入上述步骤S5’,并在第一至第四目标位姿信息均有效时,进入步骤S6’。在步骤S6’中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,分别根据受控操作末端器械34B1~34B3的第三目标位姿信息对应控制操作臂31B~31D运动到达对应的目标位姿(第一期望位姿),并根据第四目标位姿信息控制操作臂31E运动以使非受控操作末端器械34B4保持于当前位姿。After the assignment is performed in step S445', the process proceeds to the above-mentioned step S5', and when the first to fourth target pose information is valid, the process proceeds to step S6'. In step S6', the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image The instrument 34A maintains the current pose, and controls the operating arms 31B to 31D to move to the corresponding target pose (the first desired pose) according to the third target pose information of the controlled operation end devices 34B1 to 34B3, and according to the fourth target pose. The target pose information controls the movement of the operating arm 31E so that the uncontrolled operating end device 34B4 is maintained in the current pose.
假设根据步骤S444’判断出受控操作末端器械34B2、34B3在第二坐标系的第一期望目标位姿信息至少部分无效,如受控操作末端器械34B2在第二坐标系的第一期望目标位姿信息有效、受控操作末端器械34B3在第二坐标系的第一期望目标位姿信息无效:Suppose it is determined according to step S444' that the first expected target pose information of the controlled operation end device 34B2, 34B3 in the second coordinate system is at least partially invalid, for example, the controlled operation end device 34B2 is in the first expected target position of the second coordinate system The pose information is valid, and the controlled operation terminal device 34B3 is invalid in the first desired target pose information in the second coordinate system:
基于受控操作末端器械34B1关联的一组位姿信息集合的第一分量位姿信息,根据步骤S446’计算出受控操作末端器械34B3在第二坐标系的第二期 望目标位姿信息,并通过步骤S447’进行赋值后,进入上述步骤S5’,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6’。在步骤S6’中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1~34B2的第三目标位姿信息对应控制操作臂31B~31C运动到达对应的目标位姿(第一期望位姿),并根据受控操作末端器械34B2的第三目标位姿信息对应控制操作臂31D运动到达对应的目标位姿(第二期望位姿),并根据第四目标位姿信息控制操作臂31E运动以使非受控操作末端器械34B4保持于当前位姿。Based on the first component pose information of a set of pose information sets associated with the controlled operating end device 34B1, the second expected target pose information of the controlled operating end device 34B3 in the second coordinate system is calculated according to step S446', and After the value is assigned in step S447', the process proceeds to step S5', and when the first target pose information, the second target pose information, and the third target pose information are all valid, the process proceeds to step S6'. In step S6', the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image The instrument 34A maintains the current pose, and controls the operating arms 31B-31C to move to the corresponding target pose (the first desired pose) according to the third target pose information of the controlled operation terminal device 34B1-34B2, and operates according to the controlled operation The third target pose information of the end device 34B2 controls the movement of the operating arm 31D to reach the corresponding target pose (the second desired pose), and controls the movement of the operating arm 31E according to the fourth target pose information to make the uncontrolled operation end The instrument 34B4 remains in the current posture.
假设根据步骤S444’判断出受控操作末端器械34B2、34B3在第二坐标系的第一期望目标位姿信息均无效:Assuming that it is determined according to step S444' that the first expected target pose information of the controlled operation end devices 34B2 and 34B3 in the second coordinate system is invalid:
基于受控操作末端器械34B1关联的一组位姿信息集合的第一分量位姿信息,根据步骤S446’计算出受控操作末端器械34B2、34B3在第二坐标系的第二期望目标位姿信息,并通过步骤S447’进行赋值后,进入上述步骤S5’,并在第一目标位姿信息、第二目标位姿信息及各第三目标位姿信息均有效时,进入步骤S6’。在步骤S6’中,根据第一目标位姿信息控制机械臂21运动以使其远端的动力机构22到达对应的目标位姿,根据第二目标位姿信息控制操作臂31A运动以使图像末端器械34A保持当前位姿,根据受控操作末端器械34B1的第三目标位姿信息对应控制操作臂31B运动到达对应的目标位姿(第一期望位姿),并根据受控操作末端器械34B2、34B3的第三目标位姿信息对应控制操作臂31C、31D运动到达对应的目标位姿(第二期望位姿),并根据第四目标位姿信息控制操作臂31E运动以使非受控操作末端器械34B4保持于当前位姿。Based on the first component pose information of the set of pose information associated with the controlled operation end device 34B1, the second expected target pose information of the controlled operation end device 34B2 and 34B3 in the second coordinate system is calculated according to step S446' , And after assigning values through step S447', proceed to step S5', and when the first target pose information, second target pose information, and each third target pose information are all valid, proceed to step S6'. In step S6', the robot arm 21 is controlled to move according to the first target pose information so that the power mechanism 22 at the distal end reaches the corresponding target pose, and the operating arm 31A is controlled to move according to the second target pose information to make the end of the image The instrument 34A maintains the current pose, and controls the operating arm 31B to move to the corresponding target pose (first desired pose) according to the third target pose information of the controlled operation end device 34B1, and according to the controlled operation end device 34B2, The third target pose information of 34B3 controls the movement of the operating arms 31C and 31D to reach the corresponding target poses (the second desired pose), and controls the motion of the operating arm 31E according to the fourth target pose information to make the uncontrolled operation end The instrument 34B4 remains in the current posture.
含有步骤S441’~步骤S448’的步骤S1’~S6’除适用于图29所示同一机械臂21具有三个受控操作末端器械34B之外,根据其原理同样适用于同一机械臂21具有两个、或四个以上的受控操作末端器械34B的情况。Steps S1' to S6' including steps S441' to S448' are not only applicable to the same robotic arm 21 having three controlled operation end devices 34B as shown in FIG. 29, but also applicable to the same robotic arm 21 having two controlled operation end devices 34B according to its principle. In the case of one, or more than four controlled-operation end devices 34B.
上述实施例中,不对非受控操作末端器械的数量进行限制。In the foregoing embodiment, the number of uncontrolled operation end devices is not limited.
通过上述实施例,通过结合机械臂21和操作臂31的运动,能够在图像末端器械34A及非受控操作末端器械保持于当前位姿的条件下,尽量确保受控操作末端器械34B能够到达第一期望位姿实现手术目的,如果不能到达第一期望位姿也会尽量确保受控操作末端器械34B保持于当前位姿降低手术风险。Through the above-mentioned embodiments, by combining the motions of the robotic arm 21 and the operating arm 31, it is possible to ensure as far as possible that the controlled operating end device 34B can reach the first posture under the condition that the image end device 34A and the uncontrolled end device are kept in the current posture. A desired posture achieves the purpose of the operation. If the first desired posture cannot be reached, it will try to ensure that the controlled operation end instrument 34B remains in the current posture to reduce the operation risk.
如图11~图22所示的适用于步骤S1的实施例同样适用于步骤S1’;如图23~图24所示的适用于步骤S2的实施例同样适用于步骤S2’。出于简洁的目的,对于这些具有普遍适用性的实施例不再重复赘述。The embodiment shown in Figs. 11-22, which is applicable to step S1, is also applicable to step S1'; the embodiment shown in Figs. 23-24, which is applicable to step S2, is also applicable to step S2’. For the sake of brevity, these universally applicable embodiments will not be repeated.
一实施例中,如图32所示,对于上述任意获得的目标位姿信息的有效性进行判断的步骤,包括:In an embodiment, as shown in FIG. 32, the step of judging the validity of the arbitrarily obtained target pose information includes:
步骤S71,将目标位姿信息解析为相应臂体中各关节组件的目标运动状态参数。Step S71: Analyze the target pose information into target motion state parameters of each joint component in the corresponding arm body.
步骤S72,将臂体中各关节组件的目标运动状态参数与臂体中各关节组件的运动状态阈值进行对比。In step S72, the target motion state parameter of each joint component in the arm body is compared with the motion state threshold value of each joint component in the arm body.
步骤S73,如果臂体中各关节组件的目标运动状态参数有一个以上超过相应关节组件的运动状态阈值,则判断目标位姿信息无效;如果臂体中各关节组件的目标运动状态参数均未超过相应关节组件的运动状态阈值,则判断目标位姿信息有效。Step S73, if more than one target motion state parameter of each joint component in the arm body exceeds the motion state threshold of the corresponding joint component, then it is judged that the target pose information is invalid; if the target motion state parameter of each joint component in the arm body does not exceed According to the motion state threshold of the corresponding joint component, it is judged that the target pose information is valid.
进而在前述步骤S225中,具体即在调整第二分量目标位姿信息为有效的步骤中,可以将超过运动状态阈值的臂体中个关节组件的运动状态调整至相应运动状态阈值以内以使其有效。一实施例中,可以将超过运动状态阈值的臂体中个关节组件的运动状态调整至相应运动状态阈值以使其有效,这样可以尽量让操作臂运动到极限,再配合机械臂进行调节。Furthermore, in the foregoing step S225, specifically, in the step of adjusting the second component target pose information to be effective, the motion state of each joint component in the arm body that exceeds the motion state threshold can be adjusted to within the corresponding motion state threshold to make it effective. In one embodiment, the motion state of each joint component in the arm body that exceeds the motion state threshold can be adjusted to the corresponding motion state threshold to make it effective, so that the operating arm can be moved to the limit as much as possible, and then adjusted with the mechanical arm.
上述实施例适用于对如图1所示类型的手术机器人中的末端器械进行控制。该类型的手术机器人包括一个机械臂21及装设于该机械臂21远端的一个以上的具有末端器械34的操作臂31,该机械臂21及操作臂31均具有若 干自由度。The above-mentioned embodiments are suitable for controlling end instruments in a surgical robot of the type shown in FIG. 1. This type of surgical robot includes a robotic arm 21 and one or more operating arms 31 with end instruments 34 installed at the distal end of the robotic arm 21, and both the robotic arm 21 and the operating arm 31 have several degrees of freedom.
上述实施例同样适用于对如图33所示类型的手术机器人中的末端器械进行控制。该类型的手术机器人包括一个主臂32’、装设于主臂32’远端的一个以上的调整臂30’及装设于调整臂30’远端的一个以上的具有末端器械的操作臂31’,该主臂32’、调整臂30’及操作臂31’均具有若干自由度。如图33所示,该手术机器人中,调整臂30’可以设置为四个,每个调整臂30’可以仅设置一个操作臂31’。根据实际使用场景,可以将如图33所示类型的手术机器人的三段式臂体结构配置为如图1所示类型的手术机器人的两段式臂体结构从而实现控制。一实施例中,在该两种类型的手术机器人中的操作臂的概念为一致的情况下,例如,根据配置,可以将如图33所示类型的手术机器人中的各调整臂30’视为如图1所示类型的手术机器人中的机械臂21进行控制;又例如,根据配置,也可以将如图33所示类型的手术机器人中的任一调整臂30’及主臂32’的整体视为如图1所示类型的手术机器人中的机械臂21进行控制。一实施例中,可以将如图33所示类型的手术机器人中的主臂32’视为如图1所示类型的手术机器人中的机械臂21、并将如图33所示类型的手术机器人中的调整臂30’及其对应的操作臂31’的整体视为如图1所示类型的手术机器人中的操作臂31进行控制。The above-mentioned embodiments are also suitable for controlling end instruments in a surgical robot of the type shown in FIG. 33. This type of surgical robot includes a main arm 32', one or more adjustment arms 30' installed at the distal end of the main arm 32', and one or more operating arms 31 with end instruments installed at the distal end of the adjustment arm 30' ', the main arm 32', the adjusting arm 30' and the operating arm 31' all have several degrees of freedom. As shown in Fig. 33, in the surgical robot, four adjustment arms 30' can be provided, and each adjustment arm 30' can be provided with only one operation arm 31'. According to actual usage scenarios, the three-stage arm structure of the surgical robot of the type shown in FIG. 33 can be configured as the two-stage arm structure of the surgical robot of the type shown in FIG. 1 to realize control. In one embodiment, when the concepts of the operating arms in the two types of surgical robots are the same, for example, depending on the configuration, each adjustment arm 30' in the type of surgical robot shown in FIG. 33 can be regarded as The mechanical arm 21 in the surgical robot of the type shown in FIG. 1 is controlled; for example, according to the configuration, any adjustment arm 30' and the main arm 32' of the surgical robot of the type shown in FIG. It is considered that the robotic arm 21 in the surgical robot of the type shown in FIG. 1 performs control. In an embodiment, the main arm 32' in the surgical robot of the type shown in FIG. 33 can be regarded as the mechanical arm 21 in the surgical robot of the type shown in FIG. 1, and the surgical robot of the type shown in FIG. 33 The entire adjustment arm 30' and its corresponding operating arm 31' are regarded as the operating arm 31 in the surgical robot of the type shown in FIG. 1 for control.
一实施例中,上述手术机器人的控制方法通常被配置为在手术机器人的处理系统中来实现,该处理系统具有一个以上的处理器。In an embodiment, the above-mentioned control method of a surgical robot is usually configured to be implemented in a processing system of the surgical robot, and the processing system has more than one processor.
一实施例中,提供一种计算机可读存储介质,计算机可读存储介质存储有计算机程序,该计算机程序被配置为由一个以上的处理器执行实现上述任一项实施例所述的控制方法的步骤。In one embodiment, a computer-readable storage medium is provided, and the computer-readable storage medium stores a computer program configured to be executed by more than one processor to implement the control method described in any one of the above embodiments. step.
本申请的手术机器人及其控制方法、计算机可读存储介质,具有如下有益效果:The surgical robot, its control method, and computer-readable storage medium of the present application have the following beneficial effects:
通过控制机械臂21运动使操作末端器械34B到达目标位姿的同时,控制图像末端器械34A运动以保持当前位姿,进而能够在保持视野不变的前提下,借助机械臂21的运动扩大操作末端器械34B的操作空间,其使用方便、 安全。By controlling the movement of the robotic arm 21 to make the end-of-operation instrument 34B reach the target pose, the end-of-image instrument 34A is controlled to move to maintain the current pose, and the end of the operation can be expanded by the movement of the robotic arm 21 while maintaining the same field of view. The operating space of the device 34B is convenient and safe to use.
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered as the scope of this specification.
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation manners of the present application, and their description is relatively specific and detailed, but they should not be understood as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can be made, and these all fall within the protection scope of this application. Therefore, the scope of protection of the patent of this application shall be subject to the appended claims.

Claims (19)

  1. 一种手术机器人,其特征在于,包括:A surgical robot, characterized in that it comprises:
    机械臂;Robotic arm
    操作臂,装设于所述机械臂远端,所述操作臂数量为两个以上且均具有一个末端器械,所述末端器械包括一个图像末端器械和一个以上操作末端器械,所述操作末端器械中至少一个被配置成受控操作末端器械,令所述受控操作末端器械为第一末端器械,令除所述第一末端器械以外的所述末端器械为第二末端器械;The operating arm is installed at the distal end of the robotic arm. The number of operating arms is more than two and each has one end instrument. The end instrument includes one image end instrument and more than one operation end instrument, the operation end instrument At least one of them is configured as a controlled operation end device, so that the controlled operation end device is a first end device, and the end device other than the first end device is a second end device;
    及控制装置,分别与所述机械臂和所述操作臂连接,被配置成用于执行:And a control device, respectively connected to the mechanical arm and the operating arm, and configured to execute:
    获取步骤,获取各所述第一末端器械在第一坐标系的初始目标位姿;The obtaining step is to obtain the initial target pose of each of the first end instruments in the first coordinate system;
    分解步骤,分解各所述初始目标位姿信息分别获得一组位姿信息集合,每组所述位姿信息集合均包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述第一末端器械在第二坐标系的第二分量目标位姿信息,第一坐标系指所述机械臂的基坐标系,第二坐标系指所述机械臂的工具坐标系;The decomposition step is to decompose each of the initial target pose information to obtain a set of pose information sets, each set of pose information sets including the first component target pose information of the distal end of the robotic arm in the first coordinate system And the second component target pose information of the first end instrument in a second coordinate system, where the first coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm;
    第一判断步骤,对各组所述位姿信息集合的有效性进行判断;The first judgment step is to judge the validity of each group of said pose information sets;
    计算步骤,在至少有一组所述位姿信息集合有效、且在各所述第二末端器械均保持于当前位姿的条件下,结合各组所述位姿信息集合计算所述机械臂远端在第一坐标系的第一目标位姿信息、各所述第一末端器械在第二坐标系的第二目标位姿信息、及各所述第二末端器械在第二坐标系的第三目标位姿信息;In the calculation step, under the condition that at least one set of the pose information set is valid and each of the second end instruments is maintained in the current pose, calculate the distal end of the robotic arm in combination with each set of the pose information set The first target pose information in the first coordinate system, the second target pose information of each of the first end devices in the second coordinate system, and the third target of each of the second end devices in the second coordinate system Pose information
    第二判断步骤,对所述第一至第三目标位姿信息的有效性进行判断;The second judgment step is to judge the validity of the first to third target pose information;
    控制步骤,在所述第一至第三目标位姿信息均有效时,根据所述第一目标位姿信息控制所述机械臂运动以使所述机械臂远端到达对应的目标位姿,根据所述第二目标位姿信息控制对应所述第一末端器械的操作臂运动以使所述第一末端器械到达对应的目标位姿,并根据所述第三目标位姿信息控制对应所述第二末端器械的操作臂运动以使所述第二末端器械保持于当前位姿。In the control step, when the first to third target pose information is valid, the robot arm is controlled to move according to the first target pose information so that the distal end of the robot arm reaches the corresponding target pose, according to The second target pose information controls the movement of the operating arm corresponding to the first end device to make the first end device reach the corresponding target pose, and controls the corresponding first end device according to the third target pose information. The operating arm of the second end device moves to keep the second end device in the current posture.
  2. 根据权利要求1所述的手术机器人,其特征在于,所述第一末端器械 为一个、且所述位姿信息集合有效,所述控制装置被配置成用于在所述计算步骤中执行:The surgical robot according to claim 1, wherein there is one first end instrument and the pose information set is valid, and the control device is configured to execute in the calculation step:
    在所述机械臂远端到达与所述第一分量目标位姿信息对应的目标位姿的条件下,换算各所述第二末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information, the current pose information of each second end instrument is converted to obtain its second coordinate system in the second coordinate system. Expected target pose information;
    将所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将所述第二分量目标位姿信息赋值成所述第二目标位姿信息,将所述第二期望目标位姿信息赋值成所述第三目标位姿信息。The first component target pose information is assigned to the first target pose information, the second component target pose information is assigned to the second target pose information, and the second desired target pose is assigned The pose information is assigned to the third target pose information.
  3. 根据权利要求1所述的手术机器人,其特征在于,所述第一末端器械为两个以上,且所述位姿信息集合中一组有效、其余无效,令有效的所述位姿信息集合为第一集合,并令无效的所述位姿信息集合为第二集合,所述控制装置被配置成用于在所述计算步骤中执行:The surgical robot according to claim 1, wherein there are more than two first end instruments, and one group of the pose information set is valid and the rest are invalid, so that the effective pose information set is The first set, and the invalid pose information set is the second set, and the control device is configured to perform in the calculation step:
    在所述机械臂远端到达与所述第一集合中的第一分量目标位姿信息对应的目标位姿的条件下,换算各所述第二末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息,并换算与所述第二集合关联的所述第一末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the first set, the current pose information of each of the second end instruments is converted to obtain the target pose information in the second end device. Second desired target pose information in the coordinate system, and convert the current pose information of the first end device associated with the second set to obtain the second desired target pose information in the second coordinate system;
    将所述第一集合中的第一分量目标位姿信息赋值成所述第一目标位姿信息,将所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将换算获得的所述第二末端器械的所述第二期望目标位姿信息赋值成相应所述第二末端器械的所述第三目标位姿信息。Assign the first component target pose information in the first set to the first target pose information, and assign the second component target pose information in the first set to be associated with the first set The second target pose information of the first end instrument, the second expected target pose information of the first end instrument obtained by conversion is assigned to the second target pose information corresponding to the first end instrument Two target pose information, and the second expected target pose information of the second end device obtained by conversion is assigned to the third target pose information of the corresponding second end device.
  4. 根据权利要求1所述的手术机器人,其特征在于,所述第一末端器械为多个,且所述位姿信息集合中两组有效、其余无效,令有效的所述位姿信息集合为第一集合,并令无效的所述位姿信息集合为第二集合,所述第二末端器械包括一个以上的所述操作末端器械,所述控制装置被配置成用于在所述计算步骤中执行:The surgical robot according to claim 1, wherein there are multiple first end instruments, and two groups in the pose information set are valid and the rest are invalid, so that the effective pose information set is the first One set, and the invalid pose information set is a second set, the second end device includes more than one operation end device, and the control device is configured to execute in the calculation step :
    在所述机械臂远端到达与各所述第一集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算所述图像末端器械的当前位姿信息获得其在第二坐标系的图像目标位姿信息;Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each of the first sets, the current pose information of the end-of-image equipment is converted to obtain its second target pose information. Image target pose information of the coordinate system;
    对各所述图像目标位姿信息的有效性进行判断;Judging the validity of each of the image target pose information;
    在所述图像目标位姿信息中有一个以上有效时,从有效的所述图像目标位姿信息中选择一个作为第一图像目标位姿信息,并将其余所述图像目标位姿信息均作为第二图像目标位姿信息,在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述第二图像目标位姿信息的所述第一集合关联的所述第一末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息,换算关联于所述第二集合的所述第一末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息,并换算关联于所述第二集合的除所述图像末端器械以外的所述第二末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;When more than one of the image target pose information is valid, one of the valid image target pose information is selected as the first image target pose information, and the remaining image target pose information is regarded as the first image target pose information. 2. Image target pose information, conditions for reaching the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image at the distal end of the robotic arm Next, convert the initial target pose information of the first end instrument associated with the first set of target pose information of the second image to obtain its first expected target pose information in the second coordinate system, Convert the current pose information of the first end device associated with the second set to obtain its second desired target pose information in the second coordinate system, and convert the image associated with the second set to divide the image The current pose information of the second end device other than the end device obtains its second desired target pose information in the second coordinate system;
    对各所述第一期望目标位姿信息的有效性进行判断;Judging the validity of each of the first desired target pose information;
    在各所述第一期望目标位姿信息均有效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第一期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息,并将换算获得的除所述图像末端器械以外的所述第二末端器械的所述第二期望目标位姿信息赋值成相应所述第二末端器械的所述第三目标位姿信息。When each of the first desired target pose information is valid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set The second target pose information, the first expected target pose information of the first end device obtained by conversion is assigned to the second target pose information corresponding to the first end device, and the conversion is obtained The second desired target pose information of the first end device is assigned to the second target pose information corresponding to the first end device, and the target pose information of the first image is assigned to the The third target pose information of the end image device, and the second expected target pose information of the second end device other than the end image device obtained by conversion is assigned to the corresponding second end The third target pose information of the device.
  5. 根据权利要求4所述的手术机器人,其特征在于,令所述第一期望目 标位姿信息中有效的为有效期望目标位姿信息,令所述第一期望目标位姿信息中无效的为无效期望目标位姿信息,所述控制装置被配置成用于在对各所述第一期望目标位姿信息的有效性进行判断的步骤中,获得到在各所述第一期望目标位姿信息中至少部分无效时,执行:The surgical robot according to claim 4, wherein the effective one in the first desired target pose information is the effective desired target pose information, and the one that is invalid in the first desired target pose information is invalid. Desired target pose information, and the control device is configured to obtain in each of the first desired target pose information in the step of judging the validity of each of the first desired target pose information When at least partially invalid, execute:
    在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述无效期望目标位姿信息的所述第一末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image, the conversion is associated with the The current pose information of the first end instrument that invalidates the desired target pose information obtains its second desired target pose information in the second coordinate system;
    在各所述第一期望目标位姿信息均无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息,并将换算获得的除所述图像末端器械以外的所述第二末端器械的所述第二期望目标位姿信息赋值成相应所述第二末端器械的所述第三目标位姿信息;When each of the first desired target pose information is invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set For the second target pose information, the converted second expected target pose information of the first end device associated with the invalid expected target pose information is assigned to the corresponding value of the first end device The second target pose information, assign the first image target pose information to the third target pose information of the end-of-image device, and convert the obtained information other than the end-of-image device Assigning the second desired target pose information of the second end device to the third target pose information corresponding to the second end device;
    在各所述第一期望目标位姿信息部分无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将所述有效期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息,并将换算获得的除所述图像末端 器械以外的所述第二末端器械的所述第二期望目标位姿信息赋值成相应所述第二末端器械的所述第三目标位姿信息。When each of the first desired target pose information is partially invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set The second target pose information, the effective expected target pose information is assigned to the second target pose information corresponding to the first end device, and the converted value is associated with the invalid expected target pose information The second desired target pose information of the first end device is assigned to the second target pose information corresponding to the first end device, and the target pose information of the first image is assigned to the The third target pose information of the end image device, and the second expected target pose information of the second end device other than the end image device obtained by conversion is assigned to the corresponding second end The third target pose information of the device.
  6. 根据权利要求1所述的手术机器人,其特征在于,所述第一末端器械为两个以上,且各组所述位姿信息集合均有效,令有效的所述位姿信息集合为第一集合,所述第二末端器械包括一个以上的所述操作末端器械,所述控制装置被配置成用于在计算步骤中执行:The surgical robot according to claim 1, wherein there are more than two first end instruments, and each set of the pose information set is valid, so that the effective pose information set is the first set , The second end instrument includes more than one operation end instrument, and the control device is configured to perform in the calculation step:
    在所述机械臂远端到达与各所述第一集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算所述图像末端器械的当前位姿信息获得其在第二坐标系的图像目标位姿信息;Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each of the first sets, the current pose information of the end-of-image equipment is converted to obtain its second target pose information. Image target pose information of the coordinate system;
    对各所述图像目标位姿信息的有效性进行判断;Judging the validity of each of the image target pose information;
    在所述图像目标位姿信息中有一个以上有效时,从有效的所述图像目标位姿信息中选择一个作为第一图像目标位姿信息,并将其余所述图像目标位姿信息均作为第二图像目标位姿信息,在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述第二图像目标位姿信息的所述第一集合关联的所述第一末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息,并换算除所述图像末端器械以外的所述第二末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;When more than one of the image target pose information is valid, one of the valid image target pose information is selected as the first image target pose information, and the remaining image target pose information is regarded as the first image target pose information. 2. Image target pose information, conditions for reaching the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image at the distal end of the robotic arm Next, convert the initial target pose information of the first end instrument associated with the first set of target pose information of the second image to obtain its first expected target pose information in the second coordinate system, And converting the current pose information of the second end device excluding the image end device to obtain its second desired target pose information in the second coordinate system;
    对各所述第一期望目标位姿信息的有效性进行判断;Judging the validity of each of the first desired target pose information;
    在各所述第一期望目标位姿信息均有效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第一期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息,并将换算获得的除所述图像末端器械以外的所述第二末端器械的所述第二期望 目标位姿信息赋值成相应所述第三目标位姿信息。When each of the first desired target pose information is valid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set associated with the first image target pose information to the first end device associated with the first set The second target pose information of the first end device obtained by conversion is assigned to the second target pose information of the corresponding first end device, and the second target pose information of the first end device is assigned. The first image target pose information is assigned to the third target pose information of the image end device, and the second end device's second end device other than the image end device is converted into the second target pose information. It is expected that the target pose information is assigned to the corresponding third target pose information.
  7. 根据权利要求6所述的手术机器人,其特征在于,令所述第一期望目标位姿信息中有效的为有效期望目标位姿信息,令所述第一期望目标位姿信息中无效的为无效期望目标位姿信息,所述控制装置被配置成用于在对各所述第一期望目标位姿信息的有效性进行判断的步骤中,获得到在各所述第一期望目标位姿信息中至少部分无效时,执行:The surgical robot according to claim 6, wherein the effective one in the first desired target pose information is the effective desired target pose information, and the one in the first desired target pose information that is invalid is invalid Desired target pose information, and the control device is configured to obtain in each of the first desired target pose information in the step of judging the validity of each of the first desired target pose information When at least partially invalid, execute:
    在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述无效期望目标位姿信息的所述第一末端器械的当前位姿信息而获得其在第二坐标系的第二期望目标位姿信息;Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image, the conversion is associated with the Invalidate the current pose information of the first end instrument in the desired target pose information to obtain its second desired target pose information in the second coordinate system;
    在各所述第一期望目标位姿信息均无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息,并将换算获得的除所述图像末端器械以外的所述第二末端器械的所述第二期望目标位姿信息赋值成相应所述第二末端器械的所述第三目标位姿信息;When each of the first desired target pose information is invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set For the second target pose information, the converted second expected target pose information of the first end device associated with the invalid expected target pose information is assigned to the corresponding value of the first end device The second target pose information, assign the first image target pose information to the third target pose information of the end-of-image device, and convert the obtained information other than the end-of-image device Assigning the second desired target pose information of the second end device to the third target pose information corresponding to the second end device;
    在各所述第一期望目标位姿信息部分无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将所述有效期望目标位姿赋值成相应所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端 器械的所述第二目标位姿信息,将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息,并将换算获得的除所述图像末端器械以外的所述第二末端器械的所述第二期望目标位姿信息赋值成相应所述第二末端器械的所述第三目标位姿信息。When each of the first desired target pose information is partially invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set The second target pose information, the effective expected target pose is assigned to the second target pose information corresponding to the first end device, and the converted value is associated with the invalid expected target pose information The second desired target pose information of the first end device is assigned to the second target pose information corresponding to the first end device, and the target pose information of the first image is assigned to the image The third target pose information of the end device, and the second expected target pose information of the second end device other than the image end device obtained by conversion is assigned to the corresponding second end device The third target pose information.
  8. 根据权利要求1所述的手术机器人,其特征在于,所述第一末端器械为多个,且所述位姿信息集合中两组有效、其余无效,令有效的所述位姿信息集合为第一集合,并令无效的所述位姿信息集合为第二集合,所述第二末端器械仅包括所述图像末端器械,所述控制装置被配置成用于在所述计算步骤中执行:The surgical robot according to claim 1, wherein there are multiple first end instruments, and two groups in the pose information set are valid and the rest are invalid, so that the effective pose information set is the first One set, and the invalid pose information set is a second set, the second end device only includes the image end device, and the control device is configured to execute in the calculation step:
    在所述机械臂远端到达与各所述第一集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算所述图像末端器械的当前位姿信息获得其在第二坐标系的图像目标位姿信息;Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each of the first sets, the current pose information of the end-of-image equipment is converted to obtain its second target pose information. Image target pose information of the coordinate system;
    对各所述图像目标位姿信息的有效性进行判断;Judging the validity of each of the image target pose information;
    在所述图像目标位姿信息中有一个以上有效时,从有效的所述图像目标位姿信息中选择一个作为第一图像目标位姿信息,并将其余所述图像目标位姿信息均作为第二图像目标位姿信息,在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述第二图像目标位姿信息的所述第一集合关联的所述第一末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息,换算关联于所述第二集合的所述第一末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;When more than one of the image target pose information is valid, one of the valid image target pose information is selected as the first image target pose information, and the remaining image target pose information is regarded as the first image target pose information. 2. Image target pose information, conditions for reaching the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image at the distal end of the robotic arm Next, convert the initial target pose information of the first end instrument associated with the first set of target pose information of the second image to obtain its first expected target pose information in the second coordinate system, Converting the current pose information of the first end device associated with the second set to obtain its second expected target pose information in the second coordinate system;
    对各所述第一期望目标位姿信息的有效性进行判断;Judging the validity of each of the first desired target pose information;
    在各所述第一期望目标位姿信息均有效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第一期望目标位姿 信息赋值成相应所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息。When each of the first desired target pose information is valid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set The second target pose information, the first expected target pose information of the first end device obtained by conversion is assigned to the second target pose information corresponding to the first end device, and the conversion is obtained The second desired target pose information of the first end device is assigned to the second target pose information of the corresponding first end device, and the target pose information of the first image is assigned to all The third target pose information of the image end device.
  9. 根据权利要求8所述的手术机器人,其特征在于,令所述第一期望目标位姿信息中有效的为有效期望目标位姿信息,令所述第一期望目标位姿信息中无效的为无效期望目标位姿信息,所述控制装置被配置成用于在对各所述第一期望目标位姿信息的有效性进行判断的步骤中,获得到在各所述第一期望目标位姿信息中至少部分无效时,执行:The surgical robot according to claim 8, characterized in that the valid one in the first desired target pose information is the valid desired target pose information, and the invalid one in the first desired target pose information is invalid Desired target pose information, and the control device is configured to obtain in each of the first desired target pose information in the step of judging the validity of each of the first desired target pose information When at least partially invalid, execute:
    在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述无效期望目标位姿信息的所述第一末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image, the conversion is associated with the The current pose information of the first end instrument that invalidates the desired target pose information obtains its second desired target pose information in the second coordinate system;
    在各所述第一期望目标位姿信息均无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息;When each of the first desired target pose information is invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set For the second target pose information, the converted second expected target pose information of the first end device associated with the invalid expected target pose information is assigned to the corresponding value of the first end device The second target pose information, and assign the first image target pose information to the third target pose information of the image end device;
    在各所述第一期望目标位姿信息部分无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将所述有效期望目标位姿赋值成相应所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息 的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息。When each of the first desired target pose information is partially invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set The second target pose information, the effective expected target pose is assigned to the second target pose information corresponding to the first end device, and the converted value is associated with the invalid expected target pose information The second desired target pose information of the first end device is assigned to the second target pose information corresponding to the first end device, and the target pose information of the first image is assigned to the The third target pose information of the end image device.
  10. 根据权利要求1所述的手术机器人,其特征在于,所述第一末端器械为两个以上,且各组所述位姿信息集合均有效,令有效的所述位姿信息集合为第一集合,所述第二末端器械仅包括所述图像末端器械,所述控制装置被配置成用于在所述计算步骤中执行:The surgical robot according to claim 1, wherein there are more than two first end instruments, and each set of the pose information set is valid, so that the effective pose information set is the first set , The second end instrument only includes the image end instrument, and the control device is configured to execute in the calculation step:
    在所述机械臂远端到达与各所述第一集合中的第一分量目标位姿信息对应的目标位姿的条件下,分别换算所述图像末端器械的当前位姿信息获得其在第二坐标系的图像目标位姿信息;Under the condition that the distal end of the manipulator reaches the target pose corresponding to the first component target pose information in each of the first sets, the current pose information of the end-of-image equipment is converted to obtain its second target pose information. Image target pose information of the coordinate system;
    对各所述图像目标位姿信息的有效性进行判断;Judging the validity of each of the image target pose information;
    在所述图像目标位姿信息中有一个以上有效时,从有效的所述图像目标位姿信息中选择一个作为第一图像目标位姿信息,并将其余所述图像目标位姿信息均作为第二图像目标位姿信息,在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述第二图像目标位姿信息的所述第一集合关联的所述第一末端器械的初始目标位姿信息获得其在第二坐标系的第一期望目标位姿信息;When more than one of the image target pose information is valid, one of the valid image target pose information is selected as the first image target pose information, and the remaining image target pose information is regarded as the first image target pose information. 2. Image target pose information, conditions for reaching the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image at the distal end of the robotic arm Next, converting the initial target pose information of the first end device associated with the first set of target pose information of the second image to obtain its first expected target pose information in the second coordinate system;
    对各所述第一期望目标位姿信息的有效性进行判断;Judging the validity of each of the first desired target pose information;
    在各所述第一期望目标位姿信息均有效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的所述第一末端器械的所述第一期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息。When each of the first desired target pose information is valid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set associated with the first image target pose information to the first end device associated with the first set The second target pose information of the first end device obtained by conversion is assigned the first expected target pose information of the first end device corresponding to the second target pose information of the first end device, and Assigning the first image target pose information to the third target pose information of the image end device.
  11. 根据权利要求10所述的手术机器人,其特征在于,令所述第一期望 目标位姿信息中有效的为有效期望目标位姿信息,令所述第一期望目标位姿信息中无效的为无效期望目标位姿信息,所述控制装置被配置成用于在对各所述第一期望目标位姿信息的有效性进行判断的步骤中,获得到在各所述第一期望目标位姿信息中至少部分无效时,执行:The surgical robot according to claim 10, wherein the effective one in the first desired target pose information is the effective desired target pose information, and the invalid one in the first desired target pose information is invalid Desired target pose information, and the control device is configured to obtain in each of the first desired target pose information in the step of judging the validity of each of the first desired target pose information When at least partially invalid, execute:
    在所述机械臂远端到达关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息对应的目标位姿的条件下,换算关联于所述无效期望目标位姿信息的所述第一末端器械的当前位姿信息获得其在第二坐标系的第二期望目标位姿信息;Under the condition that the distal end of the robotic arm reaches the target pose corresponding to the first component target pose information in the first set of target pose information associated with the first image, the conversion is associated with the The current pose information of the first end instrument that invalidates the desired target pose information obtains its second desired target pose information in the second coordinate system;
    在各所述第一期望目标位姿信息均无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息;When each of the first desired target pose information is invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set For the second target pose information, the converted second expected target pose information of the first end device associated with the invalid expected target pose information is assigned to the corresponding value of the first end device The second target pose information, and assign the first image target pose information to the third target pose information of the image end device;
    在各所述第一期望目标位姿信息部分无效时,将关联于所述第一图像目标位姿信息的所述第一集合中的所述第一分量目标位姿信息赋值成所述第一目标位姿信息,将关联于所述第一图像目标位姿信息的所述第一集合中的第二分量目标位姿信息赋值成关联于所述第一集合的所述第一末端器械的所述第二目标位姿信息,将所述有效期望目标位姿赋值成相应所述第一末端器械的所述第二目标位姿信息,将换算获得的关联于所述无效期望目标位姿信息的所述第一末端器械的所述第二期望目标位姿信息赋值成相应所述第一末端器械的所述第二目标位姿信息,并将所述第一图像目标位姿信息赋值成所述图像末端器械的所述第三目标位姿信息。When each of the first desired target pose information is partially invalid, assign the first component target pose information in the first set associated with the first image target pose information to the first Target pose information, assigning the second component target pose information in the first set related to the first image target pose information to all the first end instruments related to the first set The second target pose information, the effective expected target pose is assigned to the second target pose information corresponding to the first end device, and the converted value is associated with the invalid expected target pose information The second desired target pose information of the first end device is assigned to the second target pose information corresponding to the first end device, and the target pose information of the first image is assigned to the The third target pose information of the end image device.
  12. 根据权利要求1所述的手术机器人,其特征在于,所述控制装置被配置成用于在所述分解步骤中执行:The surgical robot according to claim 1, wherein the control device is configured to perform in the disassembling step:
    获取输入的关联于所述机械臂远端的任务自由度的操作命令;Acquiring an inputted operation command related to the task freedom of the distal end of the robotic arm;
    结合所述任务自由度分别分解各所述初始目标位姿信息获得包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述受控操作末端器械在第二坐标系的第二分量目标位姿信息的一组位姿信息集合。Combining the degree of freedom of the task, respectively decomposing each of the initial target pose information to obtain the first component target pose information including the distal end of the robotic arm in the first coordinate system and the controlled operation terminal instrument in the second coordinate system The second component of the target pose information is a set of pose information.
  13. 根据权利要求12所述的手术机器人,其特征在于:The surgical robot according to claim 12, characterized in that:
    所述操作命令包括第一操作命令和第二操作命令;The operation command includes a first operation command and a second operation command;
    所述第一操作命令同所述机械臂远端的任务自由度与所述机械臂的有效自由度完全匹配的情况相关联;The first operation command is associated with a situation where the task freedom of the distal end of the robotic arm completely matches the effective freedom of the robotic arm;
    所述第二操作命令同所述机械臂远端的任务自由度与所述机械臂的有效自由度中的姿态自由度完全匹配的情况相关联。The second operation command is associated with a situation in which the task degree of freedom of the distal end of the robot arm completely matches the posture degree of freedom of the effective degree of freedom of the robot arm.
  14. 根据权利要求1所述的手术机器人,其特征在于,所述控制装置被配置成用于在所述分解步骤中执行:The surgical robot according to claim 1, wherein the control device is configured to perform in the disassembling step:
    获取所述机械臂远端在第一坐标系的当前位姿信息;Acquiring current pose information of the distal end of the robotic arm in the first coordinate system;
    在所述机械臂远端保持于与其当前位姿信息对应的当前位姿的条件下,换算所述初始目标位姿信息获得所述第二分量目标位姿信息;Under the condition that the distal end of the manipulator remains in the current pose corresponding to its current pose information, converting the initial target pose information to obtain the second component target pose information;
    对所述第二分量目标位姿信息的有效性进行判断;Judging the validity of the second component target pose information;
    如果有效,在所述受控操作末端器械到达与所述第二分量目标位姿信息对应的目标位姿的条件下,换算所述初始目标位姿信息获得所述第一分量目标位姿信息;If it is valid, under the condition that the controlled operation terminal device reaches the target pose corresponding to the second component target pose information, convert the initial target pose information to obtain the first component target pose information;
    如果无效,调整所述第二分量目标位姿信息为有效并更新所述第二分量目标位姿信息,并在所述受控操作末端器械到达与更新后的所述第二分量目标位姿信息对应的目标位姿的条件下,换算所述初始目标位姿信息获得所述第一分量目标位姿信息。If it is invalid, adjust the second component target pose information to be valid and update the second component target pose information, and the device reaches and updated the second component target pose information at the end of the controlled operation Under the condition of the corresponding target pose, convert the initial target pose information to obtain the first component target pose information.
  15. 根据权利要求14所述的手术机器人,其特征在于,所述控制装置被配置成用于在所述第一判断步骤中执行:The surgical robot according to claim 14, wherein the control device is configured to perform in the first determining step:
    对换算所述初始目标位姿信息获得的所述第一分量目标位姿信息的有效性进行判断;Judging the validity of the first component target pose information obtained by converting the initial target pose information;
    如果所述第一分量目标位姿信息有效,判断所述位姿信息集合为有效;If the pose information of the first component target is valid, determining that the pose information set is valid;
    如果所述第一分量目标位姿信息无效,判断所述位姿信息集合为无效。If the pose information of the first component target is invalid, it is determined that the pose information set is invalid.
  16. 根据权利要求1所述的手术机器人,其特征在于,所述控制装置被配置成用于在所述对目标位姿信息的有效性进行判断的步骤中,执行:The surgical robot according to claim 1, wherein the control device is configured to execute in the step of judging the validity of the target pose information:
    将所述目标位姿信息解析为相应臂体中各关节组件的目标运动状态参数,所述臂体是所述机械臂或所述操作臂;Parse the target pose information into target motion state parameters of each joint component in a corresponding arm body, where the arm body is the mechanical arm or the operating arm;
    将所述臂体中各关节组件的目标运动状态参数与所述臂体中各关节组件的运动状态阈值进行对比;Comparing the target motion state parameter of each joint component in the arm body with the motion state threshold value of each joint component in the arm body;
    如果所述臂体中各关节组件的目标运动状态参数有一个以上超过相应所述关节组件的运动状态阈值,则判断所述目标位姿信息无效;如果所述臂体中各关节组件的目标运动状态参数均未超过相应所述关节组件的运动状态阈值,则判断所述目标位姿信息有效。If more than one target motion state parameter of each joint component in the arm body exceeds the motion state threshold of the corresponding joint component, it is determined that the target pose information is invalid; if the target motion state of each joint component in the arm body is If none of the state parameters exceeds the threshold of the motion state of the corresponding joint component, it is determined that the target pose information is valid.
  17. 根据权利要求1所述的手术机器人,其特征在于,所述控制装置被配置成用于在所述获取步骤中执行:The surgical robot according to claim 1, wherein the control device is configured to perform in the obtaining step:
    获取由运动输入设备输入的遥操作所述受控操作末端器械运动的运动信息,所述运动信息是所述运动输入设备的位姿信息;Acquiring movement information of the movement of the remotely operated controlled terminal device input by a movement input device, where the movement information is the pose information of the movement input device;
    解析所述运动信息为所述受控操作末端器械的初始目标位姿信息。Analyze the motion information as the initial target pose information of the controlled operation end device.
  18. 一种手术机器人中末端器械的控制方法,所述手术机器人包括机械臂及操作臂,所述操作臂装设于所述机械臂远端,所述操作臂数量为两个以上且均具有一个末端器械,所述末端器械包括一个图像末端器械和一个以上操作末端器械,所述操作末端器械中至少一个被配置成受控操作末端器械,令所述受控操作末端器械为第一末端器械,令除所述第一末端器械以外的所述末端器械为第二末端器械,其特征在于,所述控制方法包括如下步骤:A method for controlling terminal instruments in a surgical robot. The surgical robot includes a mechanical arm and an operating arm. The operating arm is installed at the distal end of the mechanical arm. The number of the operating arms is more than two and each has one end. An instrument, the end instrument includes an image end instrument and more than one operation end instrument, at least one of the operation end instruments is configured as a controlled operation end instrument, so that the controlled operation end instrument is the first end instrument, and The end instrument other than the first end instrument is a second end instrument, and is characterized in that the control method includes the following steps:
    获取步骤,获取各所述第一末端器械在第一坐标系的初始目标位姿;The obtaining step is to obtain the initial target pose of each of the first end instruments in the first coordinate system;
    分解步骤,分解各所述初始目标位姿信息分别获得一组位姿信息集合,每组所述位姿信息集合均包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述第一末端器械在第二坐标系的第二分量目标位姿信息,第一 坐标系指所述机械臂的基坐标系,第二坐标系指所述机械臂的工具坐标系;The decomposition step is to decompose each of the initial target pose information to obtain a set of pose information sets, each set of pose information sets including the first component target pose information of the distal end of the robotic arm in the first coordinate system And the second component target pose information of the first end instrument in a second coordinate system, where the first coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm;
    第一判断步骤,对各组所述位姿信息集合的有效性进行判断;The first judgment step is to judge the validity of each group of said pose information sets;
    计算步骤,在至少有一组所述位姿信息集合有效、且在各所述第二末端器械均保持于当前位姿的条件下,结合各组所述位姿信息集合计算所述机械臂远端在第一坐标系的第一目标位姿信息、各所述第一末端器械在第二坐标系的第二目标位姿信息、及各所述第二末端器械在第二坐标系的第三目标位姿信息;In the calculation step, under the condition that at least one set of the pose information set is valid and each of the second end instruments is maintained in the current pose, calculate the distal end of the robotic arm in combination with each set of the pose information set The first target pose information in the first coordinate system, the second target pose information of each of the first end devices in the second coordinate system, and the third target of each of the second end devices in the second coordinate system Pose information
    第二判断步骤,对所述第一至第三目标位姿信息的有效性进行判断;The second judgment step is to judge the validity of the first to third target pose information;
    控制步骤,在所述第一至第三目标位姿信息均有效时,根据所述第一目标位姿信息控制所述机械臂运动以使所述机械臂远端到达对应的目标位姿,根据所述第二目标位姿信息控制对应所述第一末端器械的操作臂运动以使所述第一末端器械到达对应的目标位姿,并根据所述第三目标位姿信息控制对应所述第二末端器械的操作臂运动以使所述第二末端器械保持于当前位姿。In the control step, when the first to third target pose information is valid, the robot arm is controlled to move according to the first target pose information so that the distal end of the robot arm reaches the corresponding target pose, according to The second target pose information controls the movement of the operating arm corresponding to the first end device to make the first end device reach the corresponding target pose, and controls the corresponding first end device according to the third target pose information. The operating arm of the second end device moves to keep the second end device in the current posture.
  19. 一种手术机器人中末端器械的控制装置,其特征在于,包括:A control device for end instruments in a surgical robot, which is characterized in that it comprises:
    存储器,用于存储计算机程序;Memory, used to store computer programs;
    及处理器,用于加载并执行所述计算机程序;And a processor for loading and executing the computer program;
    其中,所述计算机程序被配置为由所述处理器加载并执行实现如下步骤:Wherein, the computer program is configured to be loaded by the processor and executed to implement the following steps:
    获取步骤,获取各所述第一末端器械在第一坐标系的初始目标位姿;The obtaining step is to obtain the initial target pose of each of the first end instruments in the first coordinate system;
    分解步骤,分解各所述初始目标位姿信息分别获得一组位姿信息集合,每组所述位姿信息集合均包括所述机械臂远端在第一坐标系的第一分量目标位姿信息及所述第一末端器械在第二坐标系的第二分量目标位姿信息,第一坐标系指所述机械臂的基坐标系,第二坐标系指所述机械臂的工具坐标系;The decomposition step is to decompose each of the initial target pose information to obtain a set of pose information sets, each set of pose information sets including the first component target pose information of the distal end of the robotic arm in the first coordinate system And the second component target pose information of the first end instrument in a second coordinate system, where the first coordinate system refers to the base coordinate system of the robotic arm, and the second coordinate system refers to the tool coordinate system of the robotic arm;
    第一判断步骤,对各组所述位姿信息集合的有效性进行判断;The first judgment step is to judge the validity of each group of said pose information sets;
    计算步骤,在至少有一组所述位姿信息集合有效、且在各所述第二末端器械均保持于当前位姿的条件下,结合各组所述位姿信息集合计算所述机械臂远端在第一坐标系的第一目标位姿信息、各所述第一末端器械在第二坐标系的第二目标位姿信息、及各所述第二末端器械在第二坐标系的第三目标位 姿信息;In the calculation step, under the condition that at least one set of the pose information set is valid and each of the second end instruments is maintained in the current pose, calculate the distal end of the robotic arm in combination with each set of the pose information set The first target pose information in the first coordinate system, the second target pose information of each of the first end devices in the second coordinate system, and the third target of each of the second end devices in the second coordinate system Pose information
    第二判断步骤,对所述第一至第三目标位姿信息的有效性进行判断;The second judgment step is to judge the validity of the first to third target pose information;
    控制步骤,在所述第一至第三目标位姿信息均有效时,根据所述第一目标位姿信息控制所述机械臂运动以使所述机械臂远端到达对应的目标位姿,根据所述第二目标位姿信息控制对应所述第一末端器械的操作臂运动以使所述第一末端器械到达对应的目标位姿,并根据所述第三目标位姿信息控制对应所述第二末端器械的操作臂运动以使所述第二末端器械保持于当前位姿。In the control step, when the first to third target pose information is valid, the robot arm is controlled to move according to the first target pose information so that the distal end of the robot arm reaches the corresponding target pose, according to The second target pose information controls the movement of the operating arm corresponding to the first end device to make the first end device reach the corresponding target pose, and controls the corresponding first end device according to the third target pose information. The operating arm of the second end device moves to keep the second end device in the current posture.
PCT/CN2020/114113 2019-09-10 2020-09-08 Surgical robot and control method and control device for distal instrument thereof WO2021047520A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201910854104.1 2019-09-10
CN201910854104.1A CN110464469B (en) 2019-09-10 2019-09-10 Surgical robot, method and device for controlling distal end instrument, and storage medium
CN201910854900.5A CN110464471B (en) 2019-09-10 2019-09-10 Surgical robot and control method and control device for tail end instrument of surgical robot
CN201910854900.5 2019-09-10

Publications (1)

Publication Number Publication Date
WO2021047520A1 true WO2021047520A1 (en) 2021-03-18

Family

ID=74866117

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/114113 WO2021047520A1 (en) 2019-09-10 2020-09-08 Surgical robot and control method and control device for distal instrument thereof

Country Status (1)

Country Link
WO (1) WO2021047520A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113658247A (en) * 2021-07-29 2021-11-16 武汉联影智融医疗科技有限公司 Instrument space prediction method and device, computer equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180028054A1 (en) * 2008-03-28 2018-02-01 Intuitive Surgical Operations, Inc. Display monitor control of a telesurgical tool
CN109700537A (en) * 2018-12-29 2019-05-03 天津大学 Flexible surgical instrument operates arm system and micro-wound operation robot from hand system
CN110115630A (en) * 2010-05-14 2019-08-13 直观外科手术操作公司 Medical robotic system with coordinated type control model
CN110464469A (en) * 2019-09-10 2019-11-19 深圳市精锋医疗科技有限公司 The control method of operating robot and end instrument, control device, storage medium
CN110464471A (en) * 2019-09-10 2019-11-19 深圳市精锋医疗科技有限公司 The control method of operating robot and its end instrument, control device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180028054A1 (en) * 2008-03-28 2018-02-01 Intuitive Surgical Operations, Inc. Display monitor control of a telesurgical tool
CN110115630A (en) * 2010-05-14 2019-08-13 直观外科手术操作公司 Medical robotic system with coordinated type control model
CN109700537A (en) * 2018-12-29 2019-05-03 天津大学 Flexible surgical instrument operates arm system and micro-wound operation robot from hand system
CN110464469A (en) * 2019-09-10 2019-11-19 深圳市精锋医疗科技有限公司 The control method of operating robot and end instrument, control device, storage medium
CN110464471A (en) * 2019-09-10 2019-11-19 深圳市精锋医疗科技有限公司 The control method of operating robot and its end instrument, control device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113658247A (en) * 2021-07-29 2021-11-16 武汉联影智融医疗科技有限公司 Instrument space prediction method and device, computer equipment and storage medium
CN113658247B (en) * 2021-07-29 2024-05-28 武汉联影智融医疗科技有限公司 Instrument space prediction method, apparatus, computer device and storage medium

Similar Documents

Publication Publication Date Title
CN110464471B (en) Surgical robot and control method and control device for tail end instrument of surgical robot
WO2021047522A1 (en) Surgical robot, and control method and control device for distal instrument thereof
US11090814B2 (en) Robot control method
CN110559082B (en) Surgical robot and control method and control device for mechanical arm of surgical robot
CN108621156B (en) Robot control device, robot system, robot, and robot control method
CN110464470B (en) Surgical robot and control method and control device for arm body of surgical robot
EP2148629B1 (en) Frame mapping and force feedback methods, devices and systems
KR101891162B1 (en) Estimation of a position and orientation of a frame used in controlling movement of a tool
US9122275B2 (en) Robot and control method thereof
CN110464469B (en) Surgical robot, method and device for controlling distal end instrument, and storage medium
JP2017071018A (en) Robot system, robot, and robot controlling device
JP2018513711A (en) Very dexterous system user interface
US11701770B2 (en) Robot system and method of controlling robot system
JP2016020024A (en) Control device and control method for master-slave robot, master-slave robot, control program for master-slave robot, and integrated electronic circuit for control of master-slave robot
WO2021047520A1 (en) Surgical robot and control method and control device for distal instrument thereof
CN106965187B (en) Method for generating feedback force vector when bionic hand grabs object
Smoljkic et al. Constraint-based interaction control of robots featuring large compliance and deformation
JP2023175889A (en) Controlling movement of surgical robot arm
CN106003049B (en) The control method of people-machine cooperative system
US20220101213A1 (en) Method of performing display with respect to control parameters for robot, program, and information processing apparatus
JP2005329476A (en) Control method and device of operating member
JP7079899B2 (en) Robot joint control
JP2020082313A (en) Robot control device, learning device and robot control system
JP6079293B2 (en) Robot control system, robot, teaching device, program, and robot control method
JP7079881B2 (en) Robot joint control

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20862986

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20862986

Country of ref document: EP

Kind code of ref document: A1