GB2622790A - Control system for controlling a surgical robot arm - Google Patents

Control system for controlling a surgical robot arm Download PDF

Info

Publication number
GB2622790A
GB2622790A GB2214081.8A GB202214081A GB2622790A GB 2622790 A GB2622790 A GB 2622790A GB 202214081 A GB202214081 A GB 202214081A GB 2622790 A GB2622790 A GB 2622790A
Authority
GB
United Kingdom
Prior art keywords
end effector
control system
instrument
interface
effector element
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2214081.8A
Other versions
GB202214081D0 (en
Inventor
William Haydn Webster-Smith David
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CMR Surgical Ltd
Original Assignee
CMR Surgical Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CMR Surgical Ltd filed Critical CMR Surgical Ltd
Priority to GB2214081.8A priority Critical patent/GB2622790A/en
Publication of GB202214081D0 publication Critical patent/GB202214081D0/en
Priority to PCT/GB2023/052448 priority patent/WO2024069132A1/en
Publication of GB2622790A publication Critical patent/GB2622790A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1679Programme controls characterised by the tasks executed
    • B25J9/1692Calibration of manipulator

Abstract

A control system for controlling a surgical robot arm having a drive mechanism for driving a surgical instrument (206, Figure 2), the instrument comprising a first and second end effector elements (208-1,2, figure 3), and the drive mechanism comprising interface elements (530, figure 5) for controlling a spread angle between the end effector elements (Figure 7). The system is configured to, while the inner surfaces of the end effectors are exerting force against each other, vary an applied instrument drive force 902. For each applied drive force, a resultant spread angle is predicted in dependence on a measured position of the interface element 904. A linear relationship of the drive force and the predicted spread angle is fit 906. A spread offset value is determined by approximating a predicted spread angle when the applied drive force equals a predetermined force, using the linear relationship 908. The robot arm can then be controlled in dependence on this determined offset 910.

Description

CONTROL SYSTEM FOR CONTROLLING A SURGICAL ROBOT ARM
FIELD
This invention relates to a control system for controlling a surgical robot arm.
BACKGROUND
It is known to use robots for assisting and performing surgery. Figure 1 illustrates an example surgical robotic system 100, which comprises a surgical robot arm 101 for manipulating tissue.
The surgical robot arm 101 comprises a base 109. The base supports the surgical robot arm, and is itself attached rigidly to, for example, the operating theatre floor, the operating theatre ceiling or a trolley. The surgical robot arm 101 is articulated by means of multiple joints 104 along its length, which are used to locate a robotic surgical instrument 106 in a desired location relative to the patient 102. The robotic surgical instrument 106 could, for example, be a cutting or grasping device. A robotic surgical instrument 106 is attached to the distal end of the surgical robot arm 101. The robotic surgical instrument 106 is positioned within the body of the patient 102 so as to access a surgical site. At its distal end the robotic surgical instrument comprises an end effector 108 for performing aspects of a medical procedure. This type of medical procedure is often referred to as a minimally invasive surgical procedure.
The configuration of the surgical robot arm 101, and the configuration of the robotic surgical instrument 106 driven by the surgical robot arm 101, may be remotely controlled in response to inputs received at a remote surgeon console 120. A surgeon may provide inputs to the remote console. The remote surgeon console may comprise one or more surgeon input devices 123. For example, these may take the form of one or more hand controllers and/or foot pedals. A video feed of the surgical site may be captured by an endoscope, often attached to a further surgical robot arm (not shown in Figure 1 for simplicity), and displayed at a display 121 of the remote surgeon console.
A control system 124 connects the surgeon console 120 to the surgical robot arm 101. The control system 124 receives inputs from the surgeon input device(s) 123 and converts those inputs to control signals for controlling the surgical robot arm 101, and the robotic surgical instrument 106 driven by the surgical robot arm 101. It is important that the surgeon feels (e.g. perceives) that the movements of the surgical robot arm 101 and the robotic surgical instrument 106 accurately reflect the inputs they provide to the surgeon input device(s) 123.
SUMMARY OF THE INVENTION
According to aspects of the invention, there are provided control systems for controlling a surgical robot arm as set out in the accompanying claims.
According to an aspect of the invention, there is provided a surgical robotic system as set out in the accompanying claims.
According to other aspects of the invention, there are provided methods of controlling a surgical robot arm as set out in the accompanying claims.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will now be described by way of example with reference to the accompanying drawings. In the drawings: Figure 1 illustrates a surgical robotic system. Figure 2 illustrates a robotic surgical instrument.
Figures 3 and 4 illustrate the distal end of a robotic surgical instrument.
Figure 5 illustrates a robotic surgical instrument.
Figure 6A illustrates a drive mechanism for driving a robotic surgical instrument. Figure 6B illustrates a robotic surgical instrument attached to a drive mechanism for driving that robotic surgical instrument.
Figure 7 illustrates a spread angle between first and second end effector elements of a robotic surgical instrument.
Figure 8 illustrates a first experimental plot of applied instrument drive force against predicted resultant spread angle.
Figure 9 illustrates a first set of steps performed by the control system for controlling a robotic surgical instrument in dependence on a determined spread offset value.
Figure 10 illustrates a first set of steps performed by the control system for controlling a robotic surgical instrument in dependence on a determined interface position offset value.
Figure 11 illustrates a second experimental plot of applied instrument drive force against predicted resultant spread angle.
Figure 12 illustrates an experimental plot of the first derivative of applied instrument drive force with respect to predicted resultant spread angle against resultant spread angle.
Figure 13 illustrates a second set of steps performed by the control system for controlling a robotic surgical instrument in dependence on a determined spread offset value.
Figure 14 illustrates a second set of steps performed by the control system for controlling a robotic surgical instrument in dependence on a determined interface position offset value.
Figure 15A illustrates the true zero configuration and spread offset value relative to predicted resultant spread angles when closing a robotic surgical instrument.
Figure 15B illustrates the true zero configuration and spread offset value relative to lost motion compensating predicted resultant spread angles when closing a robotic surgical instrument.
Figure 16 illustrates a set of steps performed by the control system for compensating for lost motion.
Figure 17 illustrates a set of steps performed by the control system for determining a calibrated spread angle.
DETAILED DESCRIPTION OF THE DRAWINGS
The following description is presented to enable any person skilled in the art to make and use the invention, and is provided in the context of a particular application. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art.
The general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present invention. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
As described herein with reference to Figure 1, in surgical robotic system 100, a control system 124 connects a surgeon console 120 to the surgical robot arm 101. The control system receives inputs from the surgeon input device(s) 123 and converts those inputs to control signals for controlling the surgical robot arm 101, and the robotic surgical instrument 106 driven by the surgical robot arm 101. The control system 124 sends those control signals to the surgical robot arm 101, which drives the surgical instrument 106 accordingly. The control system may periodically (e.g. at irregular or at predetermined time intervals) receive inputs the surgeon input device(s) 123, and periodically (e.g. at irregularly or at predetermined time intervals) send corresponding control signals to the surgical robot arm 101. That is, the surgical robotic system 100 comprises a control system 124 for controlling a surgical robot arm 101.
The control system 124 comprises a processor and a memory. The memory stores, in a non-transient way, software code that can be executed by the processor to cause the processor to control the surgical robot arm 101 in the manner described herein.
The control system 124 may be separate from the remote surgeon console 120 and the surgical robot arm 101. The control system 124 may be collocated with the remote surgeon console 120. The control system 124 may be collocated with the surgical robot arm 101. The control system 124 may be distributed between the remote surgeon console 120 and the surgical robot arm 101.
Figure 2 illustrates a typical robotic surgical instrument 206 for use in a minimally invasive surgical procedure. \Mien attached thereto, the robotic surgical instrument 206 can be driven by a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1). The robotic surgical instrument 206 comprises a proximal base 201 by means of which the robotic surgical instrument can connect to (e.g. attach to) a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1). A shaft 202 extends between base 201 and an articulation 203. Articulation 203 connects the shaft 202 to an end effector 208. The end effector 208 is at the distal end of the robotic surgical instrument 206. The end effector 208 comprises a first end effector element 208-1 and a second end effector element 208-2. In Figure 2, a pair of serrated jaws are illustrated as the first and second end effector elements 208-1, 208-2. The articulation 203 permits the end effector 208, and one or both of its end effector elements 208-1, 208-2, to move relative to the shaft 202. It is desirable -although not essential -for at least two degrees of freedom (e.g. pitch and yaw) to be provided to the motion of the end effector 208 by means of the articulation.
Figures 3 to 7 illustrate one specific example of a robotic surgical instrument and a drive mechanism configured for driving that robotic surgical instrument. It is to be understood that the robotic surgical instrument and the drive mechanism shown in Figures 3 to 7 are described by way of example only for the purpose of aiding the reader's understanding of the principles described herein. It is to be understood that the principles described herein could be applied to various different robotic surgical instruments and/or various different drive mechanisms. For example, in Figures 3 to 7, the robotic surgical instrument uses a drive transfer mechanism comprising cables and pulleys, that drive mechanism being capable of independently controlling the first and second end effector elements. In an alternative example to which the principles described herein could also be applied, the robotic surgical instrument may use a drive transfer mechanism comprising one or more push-rods and a rack and pinion mechanism. In alternative examples to which the principles described herein could also be applied, the robotic surgical instrument may use a drive mechanism that is capable of: independently controlling the first and second end effector elements; controlling only one of the end effector elements; or controlling both the first and second end effector elements in tandem. The skilled person would be aware of numerous suitable robotic surgical instruments and drive mechanisms to which the principles described herein could be applied.
Figures 3 and 4 illustrate the distal end of a robotic surgical instrument 206. At its distal end the robotic surgical instrument 206 comprises an end effector 208 for performing aspects of a medical procedure. The end effector 208 comprises a first end effector element 208-1 and a second end effector element 208-2. Figure 3 shows the robotic surgical instrument 206 in an open configuration. In an open configuration, the inner surfaces of the first end effector element 208-1 and the second end effector element 208-2 are not in contact. In other words, in an open configuration, an inner surface of the first end effector element 208-1 is not exerting a force against an inner surface of the second end effector element 208-2, and vice versa. Figure 4 shows the robotic surgical instrument 206 in a closed configuration. In a closed configuration, the inner surfaces of the first end effector element 208-1 and the second end effector element 208-2 are in contact. In other words, in a closed configuration, an inner surface of the first end effector element 208-1 may be exerting a force against an inner surface of the second end effector element 208-2, and vice versa The end effector 208 is permitted to move relative to shaft 202 by means of articulation 203 comprising two yaw joints 314-1 and 314-2 and, optionally, a pitch joint 310. Optional pitch joint 310 enables the end effector 208 as a whole to rotate about a pitch axis 320. Yaw joints 314-1 and 314-2 enable the end effector elements 208-1 and 208-2, respectively, to rotate about a yaw axis 330. That is, the first and second end effector elements 208-1 and 208-2 are rotatably mounted with respect to one another. In the perspective views shown in Figures 3 and 4, only one of the two yaw joints is visible -yaw joint 314-1, which permits end effector element 208-1 to rotate about the yaw axis 330. As will be described in further detail herein, the first and second end effector elements 208-1 and 208-2 can be caused to "spread" by causing one or both of those end effector elements 208-1, 208-2 to rotate away from the other about the yaw axis 330. As such, the angle between the first end effector element 208-1 and the second end effector element 208-2 caused by the yawing of those end effector elements can be termed the spread angle.
In the robotic surgical instrument 206 shown in Figures 3 and 4, end effector elements 208-1 and 208-2 rotate about a common yaw axis 330 -although it is to be understood that this need not be the case. For example, the first and second end effector elements 208-1 and 2082 may rotate about different yaw axes -e.g. yaw axes that are offset with respect to one another.
In the robotic surgical instrument 206 shown in Figures 3 and 4, the first and second end effector elements 208-1 and 208-2 can rotate independently about the yaw axis 330. For example, one end effector element may rotate whilst the other end effector element remains stationary, and vice versa. It is to be understood that this need not be the case. For example, the first and second end effector elements 208-1 and 208-2 may not be independently rotatable -e.g. the first and second end effector elements 208-1 and 208-2 may only be rotatable about the yaw axis in opposing directions in tandem. In other examples, only one of the end effector elements may be rotatable, whilst the other end effector element remains stationary (e.g. fixed in place relative to the articulation 203).
In the robotic surgical instrument 206 shown in Figures 3 and 4, joints 310, 314 and 316 are driven by a drive transfer mechanism comprising cables and pulleys. In this example: rotation of the end effector 208 about pitch joint 310 is driven by cable Al causing the rotation of pitch pulley 312; rotation of the first end effector element 208-1 about the first yaw joint 314-1 is driven by cable B1 causing the rotation of first yaw pulley 316; and rotation of the second end effector element 208-2 about the second yaw joint 314-2 is driven by cable Cl causing the rotation of second yaw pulley 318. It is to be understood that Figures 3 and 4 shows just one example of a cable and pulley drive transfer mechanism, and that the various other suitable drive transfer mechanisms could be used to permit the end effector 208 to move relative to the shaft 202.
Figure 5 illustrates the proximal end of robotic surgical instrument 206 in further detail. As described herein, at its proximal end the robotic surgical instrument 206 comprises a base 201 by means of which the robotic surgical instrument can connect to (e.g. attach to) a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1). In the base 201, the drive transfer mechanism of robotic surgical instrument 206 comprises three instrument interface elements 530 (although only two are visible in Figure 5). Each instrument interface element 530 is secured to a respective cable (e.g. cables Al, B1 and Cl shown in Figures 3 and 4). That cable extends, via a series of pulleys, down shaft 202 for driving (e.g. transferring a driving force to) a respective joint of the robotic surgical instrument 206 -e.g. a respective one of pitch joint 310 and yaw joints 314-1 and 314-2 as described herein. Via said drive transfer mechanism, linear movement of an instrument interface element 530 (illustrated in Figure 5 using a double headed arrow) causes rotation about a respective joint 310, 314-1, 314-2 of the robotic surgical instrument 206. The instrument interface elements 530 are exposed so as to be capable of interfacing with a drive mechanism of the surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1). It is to be understood that Figure 5 shows just one example of a cable and pulley drive transfer mechanism, and that the various other suitable drive transfer mechanisms (e.g. other arrangements using cables to transfer drive forces, or alternative arrangements using pushrods to transfer drive forces) could be used to permit the end effector 208 to move relative to the shaft 202.
At its distal end, the surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1) comprises a drive mechanism configured for driving a robotic surgical instrument. Figure 6A illustrates an example drive mechanism 600 configured for driving robotic surgical instrument 206. The drive mechanism 600 comprises three drive assemblies 622, 626, 628. In the example shown in Figure 6A: the first drive assembly 622 is configured for driving rotation of the end effector 208 about pitch joint 310; the second drive assembly 626 is configured for driving rotation of the first end effector element 208-1 about the first yaw joint 314-1; and the third drive assembly 628 is configured for driving rotation of the second end effector element 208-2 about the second yaw joint 314-2.
Each drive assembly comprises a respective interface element 612, 616, 618 driven by a respective lead screw 632, 636, 638. The lead screws 632, 636, 638 are driven to rotate in order to convey linear motion (as illustrated in Figure 6 using double headed arrows) to the interface elements 612, 616, 618. In other words, the interface elements 612, 616, 618 are each driveable along a direction parallel to the longitudinal axis 650 of the distal end of the surgical robot arm along their respective lead screw 632, 636, 638.
Interface elements 612, 616, 618 each have a complimentary shape to their respective instrument interface element 530 (shown in Figure 5). For example, the interface elements 612, 616, 618 may be shaped so as to receive their respective instrument interface element 530, or vice versa. As such, each interface element 612, 616, 618 can apply a driving force to, and thereby cause linear movement of, its respective instrument interface element 530.
Each of the drive assemblies 622, 626, 628 comprises a force sensor (not shown in Figure 6A) for sensing the force applied at its respective interface element 612; 616, 618. For example, each force sensor may sense the force applied to an interface element -e.g. by its lead screw. Alternatively, or additionally, each force sensor may sense the force applied by an interface element -e.g. to its respective instrument interface element 530. In theory, the force applied to an interface element should equal the force applied by that interface element -although in reality some losses may be experienced, e.g. owing to friction in the drive mechanism. The sensed forces are output to the control system 124.
Each of the drive assemblies 622, 626, 628 comprises a position sensor (not shown in Figure 6A) for measuring the position of its respective interface element 612, 616, 618. In examples, the measured position may be: a position (e.g. a linear position) of the interface element along its direction of travel; or an angular orientation of a lead screw that is indicative of the position of the interface element that it drives. The position may be defined relative to a neutral (e.g. resting or "zero") position of the interface element, or may be defined relative to one end of its possible travel. The position of an interface element may be defined in absolute units (e.g. millimetres), or as a proportion (e.g. fraction or percentage) of the total possible travel of that interface element. For example, the position of an interface element may be defined as plus or minus X millimetres relative to a neutral (e.g. resting or "zero") position. The neutral (e.g. resting or "zero") position may be a position midway (e.g. halfway, although not necessarily) along the travel of that interface element. The position of an interface element may be defined as being "positive" (e.g. "plus" X millimetres) when the interface element is in a more distal position than its neutral (e.g. resting or "zero") position. Alternatively, the position of an interface element may be defined as being "positive" (e.g. "plus" X millimetres) when the interface element is in a more proximal position than its neutral (e.g. resting or "zero") position. The measured positions are output to the control system 124.
Figure 6B illustrates robotic surgical instrument 206 attached to drive mechanism 600. During attachment, the base 201 of the surgical instrument 206 is lowered into the drive mechanism 600 causing the instrument interface elements 530 of surgical instrument 206 to engage with their respective interface elements 612, 616, 618 of drive mechanism 600 The instrument interface elements 530 may engage directly with their respective interface elements 612, 616, 618. Alternatively, the instrument interface elements 530 may be separated from their respective interface elements 612, 616, 618 by an intermediate component (e.g. a sterile barrier -such as a sheet of flexible material) so as to engage indirectly with their respective interface element 612, 616, 618. In this way, the interface elements 612, 616, 618 of drive mechanism 600 can each apply an instrument drive force to their respective instrument interface element 530 of the drive transfer mechanism of robotic surgical instrument 206. The drive transfer mechanism of robotic surgical instrument 206 is configured for transferring those forces to the articulation 203 of robotic surgical instrument 206-e.g. comprising the pitch and yaw joints 310, 314-1 and 314-2 as described herein. As such, the drive transfer mechanism of robotic surgical instrument 206 is configured for transferring driving forces from interface elements 616 and 618 to the first end effector element 208-1 and the second end effector element 208-2, respectively. When the robotic surgical instrument 206 is attached to drive mechanism 600, the surgical robot arm 101 can drive movement of the first and second end effector elements 208-1, 208-2 by driving movement of the interface elements 612, 616, 618.
In the example robotic surgical instrument and drive mechanism shown in Figures 5 to 6, interface elements 616 and 618 are configured to interface with the robotic surgical instrument 206 for controlling the spread angle between the first end effector element 208-1 and the second end effector element 208-2. It is to be understood that, in alternative examples where the first and second end effector elements of a robotic surgical instrument are not independently rotatable (e.g. yawing of both the first and second end effector elements is driven in tandem by a common pulley, gear, or rack and pinion mechanism), or where only one of the end effector elements is rotatable whilst the other end effector element remains stationary (e.g. fixed in place relative to the articulation), the drive mechanism need only comprise one interface element for driving the yaw rotation of one or both of the first and second end effector elements so as to control the spread angle between those end effector elements. The skilled person would be aware of numerous suitable robotic surgical instruments and drive mechanisms of this alternative type. As such, according to the principles described herein, the drive mechanism comprises one or more interface elements configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element.
The control system 124 may use kinematic equations to relate the measured position of the one or more interface elements of the drive mechanism to a resultant spread angle between the first end effector element and the second end effector element. These kinematic equations may be dependent on the geometry of one or more components (e.g. pulleys, gears, rack and pinion mechanism etc.) of the drive transfer mechanism of the robotic surgical instrument.
An example set of kinematic equations suitable for use with the example robotic surgical instrument and drive mechanism shown in Figures 3 to 6 is described herein with reference to Figure 7 -which illustrates a spread angle Os between first and second end effector elements of a robotic surgical instrument. Figure 7 illustrates the distal end of robotic surgical instrument 206 comprising first end effector element 208-1 and second end effector element 208-2.
Figure 7 shows the robotic surgical instrument 206 in an open configuration.
In Figure 7, the first end effector element 208-1 is rotated about its yaw joint by a yaw angle 03". The yaw angle 034 may be defined relative to the longitudinal axis 700 of shaft 202. The yaw angle 03,1 shown in Figure 7, in which the first end effector element 208-1 is "above" the longitudinal axis 700 (as viewed in Figure 7), may be defined as a positive yaw angle. Were the first end effector element 208-1 to rotate to a position "below" the longitudinal axis 700 (as viewed in Figure 7), its yaw angle may then be defined as a negative yaw angle. The yaw angle 03,1 of the first end effector element 208-1 can be predicted using Equation 1, in which q" is the measured position of the interface element 616, ry, is the radius of the first yaw pulley 316, qi.0 is the measured position of the interface element 612, rp is the radius of the pitch pulley 312, and A is a pitch correction factor. By way of example only, the radius Ty, of the first yaw pulley 316 may be 2.1mm, the radius rp of the pitch pulley 312 may be 2.0mm, and the pitch correction factor A may be 1.75 mm/rad. Suitable values for these parameters may be stored by the control system 124 for each robotic surgical instrument.
0 = q11 Aqiu (1) YTj,i rpryi In Figure 7, the second end effector element 208-2 is rotated about its yaw joint by a yaw angle 03,z. The yaw angle 03,2 may be defined relative to the longitudinal axis 700 of shaft 202. The yaw angle 03,2 shown in Figure 7, in which the second end effector element 208-2 is "below" the longitudinal axis 700 (as viewed in Figure 7), may be defined as a negative yaw angle. Were the second end effector element 208-2 to rotate to a position "above" the longitudinal axis 700 (as viewed in Figure 7), its yaw angle may then be defined as a positive yaw angle. The yaw angle 03,2 of the second end effector element 208-2 can be predicted using Equation 2, in which q, is the measured position of the interface element 618, ry2 is the radius of the second yaw pulley 318, q10 is the measured position of the interface element 612, rp is the radius of the pitch pulley 312, and A is a pitch correction factor. By way of example only, the radius ry2 of the second yaw pulley 318 may be 2.1mm, the radius 7-2, of the pitch pulley 312 may be 2.0mm, and the pitch correction factor A may be 1.75 mm/rad. Suitable values for these parameters may be stored by the control system 124 for each robotic surgical instrument.
= Rs Agit) u312 ry2 rpry2 (2) The spread angle between the first end effector element 208-1 and the second end effector element 208-2 can be predicted using Equation 3.
Os = (Oyi -0y2) (3) Written out in full, by incorporating the relationships defined by Equations 1 and 2 into Equation 3, the spread angle between the first end effector element 208-1 and the second end effector element 208-2 can be predicted using Equation 4.
els = (q--Aq-) qy Aq,o) (4) ryi rpry ry2 rpry2 It follows that, in examples where the radius ryi of the first yaw pulley 316 is equal to the radius ry2 of the second yaw pulley 318, the "pitch" terms in Equation 4 cancel, such that the spread angle between the first end effector element 208-1 and the second end effector element 208-2 can be predicted using Equation 5.
Os = ryi ry 2 (5) It is noted that the kinematic equations defined in Equations 1 to 5 are specific examples suitable for the example robotic surgical instrument and drive mechanism shown in Figures 3 to 6. It is to be understood that the skilled person would have no difficulty generating suitable kinematic equations for other suitable robotic surgical instruments and drive mechanisms.
As described herein, it is important that the surgeon feels (e.g. perceives) that the movements of the robotic surgical instrument 106 accurately reflect the inputs they provide to the surgeon input device(s) 123.
The kinematic equations described above rely on a number of assumptions. For example, the kinematic equations assume that the drive transfer mechanism of the robotic surgical instrument is infinitely stiff and/or experiences negligible friction, such that no motion is lost (e.g. to friction or cable stretch) between the interface elements 616, 618 of the drive mechanism 600 and the yaw joints 314-1 and 314-2 of the robotic surgical instrument 206. In addition, the kinematic equations do not account for manufacturing variability in the drive mechanism and/or the drive transfer mechanism of the robotic surgical instrument. Nor do the kinematic equations account for the variability introduced by positioning of a sterile interface between the drive mechanism and the robotic surgical instrument. These factors may mean that the actual spread angle differs from the spread angle predicted by the control system using those kinematic equations.
For example, it has been observed by the inventors that, for certain robotic surgical instruments, the actual spread angle can be 150 or more when the kinematic equations predict spread angles of 0°. This level of error may be perceptible by the surgeon -e.g. as the robotic surgical instrument may be in an open configuration when the surgeon is commanding a closed configuration using the surgeon input device(s) 123. For other robotic surgical instruments, the inventors have observed that their end effectors can be in closed or "over-closed" configurations when the kinematic equations predict spread angles greater than 0°. In "over-closed" configurations, an inner surface of the first end effector element 208-1 is exerting a force against an inner surface of the second end effector element 208-2. This can be problematic as the surgeon may be exerting more force on an object held between the end effector elements than they were intending to. Further, during an instrument change, members of the operating room staff may find it difficult to detach a robotic surgical instrument that is in an over-closed configuration from the drive mechanism.
In the following, sets of steps that can be performed by the control system 124 for controlling the surgical robot arm 101 are described. A control system configured to perform one or more of these sets of steps can address one or more of the problems described above.
Concept 1 -spread offset value Figure 9 illustrates a first set of steps that can be performed by a control system (e.g. control system 124 shown in Figure 1) for controlling a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1) in dependence on a determined spread offset value. The surgical robot arm has a drive mechanism configured for driving a robotic surgical instrument. The robotic surgical instrument comprises a first end effector element and a second end effector element. The drive mechanism comprises one or more interface elements configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element.
In step 902, the control system is configured to cause an instrument drive force applied at the one or more interface elements to be varied. The applied forces may be measured using force sensors -such as those described with reference to Figure 5. The control system is configured to perform step 902 whilst an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element. In other words, the control system may be configured to perform step 902 whist the robotic surgical instrument is in a closed or "over-closed" configuration.
The control system may be configured to determine that the inner surface of the first end effector element is exerting a force against the inner surface of the second end effector element. Said determining may comprise: determining that the applied instrument drive forces exceed a predetermined instrument drive force threshold (e.g. -20N, where values more negative than that threshold are said to exceed that threshold); and/or determining that the applied instrument drive forces are within a predetermined range of instrument drive forces (e.g. -20N to -150N). Alternatively, or additionally, said determining may comprise: determining that the resultant spread angles predicted for the applied instrument drive forces (e.g. predicted using a kinematic equation such as Equation 4 or 5 described herein) are below a predetermined predicted spread angle threshold (e.g. -10°); and/or determining that the resultant spread angles predicted for the applied instrument drive forces are within a predetermined range of predicted spread angles (e.g. between -10° and -30°). Suitable thresholds and/or ranges may be stored by the control system 124 for each robotic surgical instrument.
In step 902, the control system may be configured to cause the instrument drive force to be varied so as to increase the force exerted by each of the first and second end effector elements on the other. Alternatively, the control system may be configured to cause the instrument drive force to be varied so as to decrease the force exerted by each of the first and second end effector elements on the other.
In step 902, the instrument drive force may be dependent on a first force applied at a first interface element (e.g. interface element 616 shown in Figure 6) for changing an angle (e.g. a yaw angle) of the first end effector element (e.g. first end effector element 208-1 shown in Figures 3 to 7) and a second force applied at a second interface element (e.g. interface element 618 shown in Figure 6) for changing an angle (e.g. a yaw angle) of the second end effector element (e.g. second end effector element 208-2 shown in Figures 3 to 7). The first force and the second force may be independently controllable. This may be the case in robotic surgical instruments in which the drive mechanism is capable of independently controlling the yaw rotation of the first and second end effector elements (e.g. as in the robotic surgical instrument 206 shown in Figures 3 to 7). In a specific example, the instrument drive force, F, is dependent on a sum of the first force, h, and the second force, fil, -e.g. as defined in Equation 6: F = To fn (6) Alternatively, in step 902, the instrument drive force may be dependent on a force applied at a single interface element for changing an angle (e.g. a yaw angle) of one or both of the first end effector element and the second end effector element. This may be the case in robotic surgical instruments in which the first and second end effector elements are not independently rotatable (e.g. yawing of both the first and second end effector elements is driven in tandem by a common pulley, gear, or rack and pinion mechanism), or in which only one of the end effector elements is rotatable whilst the other end effector element remains stationary (e.g. fixed in place relative to the articulation). In these examples, one interface element can control the spread angle between the first and second end effector elements.
In step 904, the control system is configured to predict, for each of at least two applied instrument drive forces, a resultant spread angle between the first end effector element and the second end effector element in dependence on a measured position of each of the one or more interface elements when that instrument drive force is applied. The positions of the interface elements may be measured using position sensors -such as those described with reference to Figure 5.
The control system may use a kinematic equation (e.g. Equation 4 or 5 described herein) to perform step 904. In other words, in step 904, the control system may be configured to predict, for each of the at least two applied instrument drive forces, the resultant spread angle between the first end effector element and the second end effector element in dependence on a measured position of each of the one or more interface elements when that instrument drive force is applied and the geometry of one or more components (e.g. pulleys, gears, rack and pinion mechanism etc.) of a drive transfer mechanism of the robotic surgical instrument configured for transferring force from the one or more interface elements to the first end effector element and/or the second end effector element.
Optionally, the resultant spread angles predicted in step 904 may be partially or fully lost motion compensating -as will be described in further detail below with reference to Figure 16.
By performing steps 902 and 904, the control system can generate two or more data pairs, each data pair including a sensed applied instrument drive force and a predicted resultant spread angle. A graph can be plotted using these data pairs. Figure 8 illustrates a first experimental plot of applied instrument drive force, F, against predicted resultant spread angle, O. The experimental data is shown by solid line 800. It is noted that Figure 8 shows "negative" resultant spread angles being predicted at certain instrument drive forces. Whilst, in reality, it is not possible to achieve negative spread angles using robotic surgical instruments of the type described herein -e.g. because the first and second end effector elements come into contact at spread angles of 0° and cannot rotate further past/through one another -negative spread angles can be predicted by the kinematic equations when the robotic surgical instrument is in a closed configuration and further "closing" instrument drive forces are being applied at the one or more instrument interface elements such that their measured position(s) change (e.g. owing to lost motion, such as by cable stretch in the drive transfer mechanism).
In Figure 8, the experimental plot can be roughly divided into two portions, each being approximately linear -a first portion on the left-hand-side having a higher gradient, and a second portion on the right-hand-side having a lower gradient. The first portion corresponds to data pairs generated whist an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element -e.g. whilst the robotic surgical instrument is in a closed or "over-closed" configuration. The second portion corresponds to data pairs generated whist the robotic surgical instrument is in an open configuration.
The data pairs generated by performing steps 902 and 904 as described herein would appear in the first portion of an experimental plot such as the one shown in Figure 8, as step 902 is performed whist an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element.
In step 906, the control system is configured to fit a linear relationship to the at least two applied instrument drive force and predicted resultant spread angle data pairs. An example linear relationship is shown by dashed line 802 in Figure 8. At least two force-spread data pairs are used to fit a linear relationship. Greater accuracy can be achieved by fitting the linear relationship to a greater number of data pairs, although doing so can also increase the computational load for the control system. In an example, the linear relationship can be fit using a first data pair having a first applied instrument drive force value above an upper force threshold and a second data pair having a second applied instrument drive force value below a lower force threshold. Greater accuracy can be achieved by setting the upper and lower force thresholds sufficiently far apart (e.g. at least 20N apart) such that the first and second data pairs do not have similar applied instrument drive force values.
The linear relationship may be defined by Equation 7, where k is a gradient of the linear relationship, and C is a y-intercept value.
F= Ices + C (7) In step 908, the control system is configured to determine a spread offset value. Determining the spread offset value comprises approximating, using the linear relationship fitted in step 906, a predicted spread angle when the applied instrument drive force would equal a predetermined force value. Said predicted spread angle may be determined as the spread offset value.
The predetermined force value may be the force value expected when the robotic surgical instrument is in a "zero configuration". When the control system is configured to cause the instrument drive force to be varied to close the robotic surgical instrument from an open configuration, the zero configuration is the configuration in which an inner surface of the first end effector element first contacts an inner surface of the second end effector element. \Mien the control system is configured to cause the instrument drive force to be varied to open the robotic surgical instrument from a closed configuration, the zero configuration is the configuration in which an inner surface of the first end effector element last contacts an inner surface of the second end effector element. Put another way, the zero configuration may be defined as a configuration in which an inner surface of the first end effector element is touching, but not exerting any force on, an inner surface of the second end effector element. As such, the predetermined force value may be zero. In other examples, the predetermined force may be greater than or less than zero -e.g. so as to account for the instrument drive force required to overcome frictional or gravitational forces experienced by the drive mechanism or the drive transfer mechanism.
Conceptually, approximating the predicted spread angle when the applied instrument drive force would equal the predetermined force value can comprise extrapolating the linear relationship to the predetermined force value. This is illustrated in Figure 8, where linear relationship 802 is extrapolated to a predetermined force value of zero (i.e. F = 0 on the y-axis). In this example, a predicted spread angle of -4.4° is approximated when the applied instrument drive force would equal zero. The predicted spread angle of -4.4° can be determined to be the spread offset value. This means that, in this Figure 8 example, the control system has determined that the robotic surgical instrument was in a "zero configuration" when the kinematic equations were predicting a spread angle of -4.4° (i.e. an over-closed configuration). It follows that, when the kinematic equations were predicting a spread angle of 0°, the robotic surgical instrument was in fact in an open configuration (e.g. with a spread angle of approximately +4.4°).
In step 910, the control system is configured to control the surgical robot arm to drive the robotic surgical instrument in dependence on the spread offset value. The control system may be configured to use the spread offset value to adjust subsequently predicted resultant spread angles. For example, the control system may be configured to subtract the spread offset value from the output of the kinematic equations used to predict a resultant spread angle for an applied instrument drive force so as to determine a calibrated spread angle. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to a configuration (e.g. a spread angle) that more closely matches the configuration (e.g. the spread angle) requested by the input received at the surgeon input device. In a specific example, the control system may be configured to use the spread offset value to determine a calibrated zero configuration for the robotic surgical instrument. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to the calibrated zero configuration when the input received at the surgeon input device requests that the robotic surgical instrument is in the zero configuration. For example, referring to Figure 8, in response to receiving an input at the surgeon input device requesting that the robotic surgical instrument is in the zero configuration (e.g. having a spread angle of 0°), the control system may control the surgical robot arm to apply an appropriate instrument drive force to drive the robotic surgical instrument to a predicted spread angle of - 4.4° (e.g. as subtracting the spread offset value, -4.4°, from the predicted spread angle, -4.4°, gives an adjusted spread angle of 00). That is, in this example, the control system can cause the one or more interface elements to be driven to respective measured positions that, when input to the kinematic equations, output a predicted spread angle of -4.4°.
Configuring the control system (e.g. control system 124 shown in Figure 1) to perform steps 902, 904, 906, 908 and 910 can improve the surgeon's perception that the movements of the robotic surgical instrument are accurately reflecting the inputs they provide to the surgeon input device.
The control system can be configured to perform steps 902, 904, 906 and 908 as part of a calibration process prior to using a robotic surgical instrument to perform aspects of a minimally invasive surgical procedure. For example, such a calibration process may be performed prior to beginning a minimally invasive surgical procedure, and/or each time a new robotic surgical instrument is attached to the surgical robot arm during the minimally invasive surgical procedure.
Alternatively, or additionally, the control system can be configured to perform steps 902, 904, 906 and 908 iteratively during a minimally invasive surgical procedure, so as to iteratively update the determined spread offset value. For example, the control system may be configured to automatically perform steps 902, 904, 906 and 908 each time it is determined that an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element during a minimally invasive surgical procedure. This approach of iteratively updating the determined spread offset value can advantageously take account of "wear and tear" of the robotic surgical instrument during the minimally invasive surgical procedure. In these examples, in order to mitigate against the control system determining a spread offset value whilst the robotic surgical instrument is grasping an object between its end effector elements (e.g. whilst robotic surgical instrument is in an open configuration) the control system may be configured to determine the spread offset value in dependence on a range of permissible spread offset values. For example, the range of permissible spread offset values may be -15° to +15°. The spread offset value may not be updated if the control system determines a spread offset value outside of that permissible range.
Concept 1 -interface position offset value In the set of steps described with reference to Figure 9, step 904 involves predicting a resultant spread angle in dependence on a measured position of each of the one or more interface elements. The following steps of Figure 9 are performed in dependence on that predicted resultant spread angle so as to control the surgical robot arm to drive the robotic surgical instrument in dependence on a spread offset value. In examples where a single interface element can control the spread angle between the first and second end effector elements, this "predicting" step need not be performed. This is because the measured position of that interface element will be indicative of a predicted spread angle between the first end effector element and the second end effector element. By contrast, in examples where the spread angle is dependent on the position of two or more interface elements, the position of any one of those interface elements alone is not necessarily indicative of the spread angle.
Figure 10 illustrates a first set of steps that can be performed by a control system (e.g. control system 124 shown in Figure 1) for controlling a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1) in dependence on a determined interface position offset value. The surgical robot arm has a drive mechanism configured for driving a robotic surgical instrument. The robotic surgical instrument comprises a first end effector element and a second end effector element. The drive mechanism comprises an interface element (e.g. a single interface element, or only one interface element) configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element.
Preferably, the control system can be configured to perform the set of steps described with reference to Figure 10 when a robotic surgical instrument in which the first and second end effector elements are not independently rotatable (e.g. yawing of both the first and second end effector elements is driven in tandem by a common pulley, gear, or rack and pinion mechanism), or in which only one of the end effector elements is rotatable whilst the other end effector element remains stationary (e.g. fixed in place relative to the articulation), is attached to the surgical robot arm.
In step 1002, the control system is configured to cause an instrument drive force applied at the interface element to be varied. In step 1002, the instrument drive force is applied at a single interface element for changing an angle (e.g. a yaw angle) of one or both of the first end effector element and the second end effector element. The applied forces may be measured using a force sensor -such as the force sensor described with reference to Figure 5. The control system is configured to perform step 1002 whilst an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element. In other words, the control system may be configured to perform step 1002 whist the robotic surgical instrument is in a closed or "over-closed" configuration.
In step 1002, the control system may be configured to determine that the inner surface of the first end effector element is exerting a force against the inner surface of the second end effector element. Said determining may comprise: determining that the applied instrument drive forces exceed a predetermined instrument drive force threshold (e.g. -20N, where values more negative than that threshold are said to exceed that threshold); and/or determining that the applied instrument drive forces are within a predetermined range of instrument drive forces (e.g. -20N to -150N). Alternatively, or additionally, said determining may comprise: determining that resultant spread angles predicted for the applied instrument drive forces (e.g. predicted using a suitable kinematic equation) are below a predetermined predicted spread angle threshold (e.g. -10°); and/or determining that resultant spread angles predicted for the applied instrument drive forces are within a predetermined range of predicted spread angles (e.g. between -10° and -30°). Suitable thresholds and/or ranges may be stored by the control system 124 for each robotic surgical instrument.
In step 1002, the control system may be configured to cause the instrument drive force to be varied so as to increase the force exerted by each of the first and second end effector elements on the other. Alternatively, the control system may be configured to cause the instrument drive force to be varied so as to decrease the force exerted by each of the first and second end effector elements on the other.
In step 1004, the control system is configured to, for each of at least two applied instrument drive forces, measure a position of the interface element when that instrument drive force is applied which is indicative of a predicted spread angle between the first end effector element and the second end effector element. The position of the interface element may be measured using a position sensor -such as the position sensor described with reference to Figure 5.
Optionally, the positions measured in step 1004 may be partially or fully lost motion compensating -as will be described in further detail below with reference to Figure 16.
By performing steps 1002 and 1004, the control system can generate two or more data pairs, each data pair including a sensed applied instrument drive force and a measured position of the interface element. A graph can be plotted using these data pairs.
In step 1006, the control system is configured to fit a linear relationship to the at least two applied instrument drive force and measured position data pairs. At least two force-position data pairs are used to fit a linear relationship. Greater accuracy can be achieved by fitting the linear relationship to a greater number of data pairs, although doing so can also increase the computational load for the control system. In an example, the linear relationship can be fit using a first data pair having a first applied instrument drive force value above an upper force threshold and a second data pair having a second applied instrument drive force value below a lower force threshold. Greater accuracy can be achieved by setting the upper and lower force thresholds sufficiently far apart (e.g. at least 20N apart) such that the first and second data pairs do not have similar applied instrument drive force values.
The linear relationship may be defined by Equation 8, where q is the measured position of the interface element, k is a gradient of the linear relationship, and C is a y-intercept value.
F = kq + C (8) In step 1008, the control system is configured to determine an interface position offset value. Determining the interface position offset value comprises approximating, using the linear relationship fitted in step 1006, an interface position when the applied instrument drive force would equal a predetermined force value. Said interface position angle may be determined as the interface position offset value. Conceptually, approximating the interface position when the applied instrument drive force would equal the predetermined force value can comprise extrapolating the linear relationship to the predetermined force value.
The predetermined force value may be the force value expected when the robotic surgical instrument is in a "zero configuration", as defined herein. The predetermined force value may be zero. In other examples, the predetermined force may be greater than or less than zero -e.g. so as to account for the instrument drive force required to overcome frictional or gravitational forces experienced by the drive mechanism or the drive transfer mechanism.
In step 1010, the control system is configured to control the surgical robot arm to drive the robotic surgical instrument in dependence on the interface position offset value. The control system may be configured to use the interface position offset value to adjust subsequently measured interface positions that are to be input to the kinematic equations used to predict a resultant spread angle for an applied instrument drive force. For example, the control system may be configured to subtract the interface position offset value from the measured interface positions so as to determine calibrated interface positions to be input to the kinematic equations. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to a configuration (e.g. a spread angle) that more closely matches the configuration (e.g. the spread angle) requested by the input received at the surgeon input device. In a specific example, the control system may be configured to use the interface position offset value to determine a calibrated zero configuration for the robotic surgical instrument. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to the calibrated zero configuration when the input received at the surgeon input device requests that the robotic surgical instrument is in the zero configuration. For example, the interface position offset value may be used to store a calibrated zero position for the interface element in the control system.
Configuring the control system (e.g. control system 124 shown in Figure 1) to perform steps 1002, 1004, 1006, 1008 and 1010 can improve the surgeon's perception that the movements of the robotic surgical instrument are accurately reflecting the inputs they provide to the surgeon input device.
The control system can be configured to perform steps 1002, 1004, 1006 and 1008 as part of a calibration process prior to using a robotic surgical instrument to perform aspects of a minimally invasive surgical procedure. For example, such a calibration process may be performed prior to beginning a minimally invasive surgical procedure, and/or each time a new robotic surgical instrument is attached to the surgical robot arm during the minimally invasive surgical procedure.
Alternatively, or additionally, the control system can be configured to perform steps 1002, 1004, 1006 and 1008 iteratively during a minimally invasive surgical procedure, so as to iteratively update the determined interface position offset value. For example, the control system may be configured to automatically perform steps 1002, 1004, 1006 and 1008 each time it is determined that an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element during a minimally invasive surgical procedure. This approach of iteratively updating the determined interface position offset value can advantageously take account of "wear and tear" of the robotic surgical instrument during the minimally invasive surgical procedure. In these examples, in order to mitigate against the control system determining an interface position offset value whilst the robotic surgical instrument is grasping an object between its end effector elements (e.g. whilst robotic surgical instrument is in an open configuration) the control system may be configured to determine the interface position offset value in dependence on a range of permissible interface position offset values. For example, the range of permissible interface position offset values may be indicative of predicted spread angles of -15° to +15° -e.g., for an example robotic surgical instrument, the range of permissible interface position offset values may be -1.2mm to +1.2mm as defined relative to the neutral (e.g. resting) position of the interface element, and/or -10% to +10% of the total possible travel of an interface element relative to its neutral (e.g. resting) position (e.g. at 50%, but not necessarily). The interface position offset value may not be updated if the control system determines an interface position offset value outside of that permissible range.
Concept 2 -spread offset value Figure 13 illustrates a second set of steps that can be performed by a control system (e.g. control system 124 shown in Figure 1) for controlling a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1) in dependence on a determined spread offset value. The surgical robot arm has a drive mechanism configured for driving a robotic surgical instrument. The robotic surgical instrument comprises a first end effector element and a second end effector element. The drive mechanism comprises one or more interface elements configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element.
In step 1302, the control system is configured to cause an instrument drive force applied at the one or more interface elements to be varied. The applied forces may be measured using force sensors -such as those described with reference to Figure 5.
In step 1302, the control system may be configured to cause the instrument drive force to be varied so as to close the robotic surgical instrument from an open configuration. Alternatively, the control system may be configured to cause the instrument drive force to be varied so as to open the robotic surgical instrument from a closed configuration.
In step 1302, the instrument drive force may be dependent on a first force applied at a first interface element (e.g. interface element 616 shown in Figure 6) for changing an angle (e.g. a yaw angle) of the first end effector element (e.g. first end effector element 208-1 shown in Figures 3 to 7) and a second force applied at a second interface element (e.g. interface element 618 shown in Figure 6) for changing an angle (e.g. a yaw angle) of the second end effector element (e.g. second end effector element 208-2 shown in Figures 3 to 7). The first force and the second force may be independently controllable. This may be the case in robotic surgical instruments in which the drive mechanism is capable of independently controlling the yaw rotation of the first and second end effector elements (e.g. as in the robotic surgical instrument 206 shown in Figures 3 to 7). In a specific example, the instrument drive force, F, is dependent on a sum of the first force, f, and the second force, f", -e.g. as defined in Equation 6 above.
Alternatively, in step 1302, the instrument drive force may be dependent on a force applied at a single interface element for changing an angle (e.g. a yaw angle) of one or both of the first end effector element and the second end effector element. This may be the case in robotic surgical instruments in which the first and second end effector elements are not independently rotatable (e.g. yawing of both the first and second end effector elements is driven in tandem by a common pulley, gear, or rack and pinion mechanism), or in which only one of the end effector elements is rotatable whilst the other end effector element remains stationary (e.g. fixed in place relative to the articulation). In these examples, one interface element can control the spread angle between the first and second end effector elements.
In step 1304, the control system is configured to predict, for each of a plurality of applied instrument drive forces, a resultant spread angle between the first end effector element and the second end effector element in dependence on a measured position of each of the one or more interface elements when that instrument drive force is applied. The positions of the interface elements may be measured using position sensors -such as those described with reference to Figure 5.
The control system may use a kinematic equation (e.g. Equation 4 or 5 described herein) to perform step 1304. In other words, in step 1304, the control system may be configured to predict, for each of the plurality of applied instrument drive forces, the resultant spread angle between the first end effector element and the second end effector element in dependence on a measured position of each of the one or more interface elements when that instrument drive force is applied and the geometry of one or more components (e.g. pulleys, gears, rack and pinion mechanism etc.) of a drive transfer mechanism of the robotic surgical instrument configured for transferring force from the one or more interface elements to the first end effector element and/or the second end effector element.
Optionally, the resultant spread angles predicted in step 1304 may be partially or fully lost motion compensating-as will be described in further detail below with reference to Figure 16.
By performing steps 1302 and 1304, the control system can generate a plurality of data pairs, each data pair including a sensed applied instrument drive force and a predicted resultant spread angle. A graph can be plotted using these data pairs. Figure 11 illustrates a second experimental plot of applied instrument drive force, F, against predicted resultant spread angle, O. In Figure 11, the experimental plot can be roughly divided into two portions, each being approximately linear -a first portion on the left-hand-side having a higher gradient, and a second portion on the right-hand-side having a lower gradient. The first portion corresponds to data pairs generated whist an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element -e.g. whilst the robotic surgical instrument is in a closed or "over-closed" configuration. The second portion corresponds to data pairs generated whist the robotic surgical instrument is in an open configuration. As such, it is desirable to determine where the boundary between the first and second portions lies, as this boundary represents the transition between the closed and open configurations of the robotic surgical instrument.
In step 1306, the control system is configured to determine, for each of the plurality of predicted resultant spread angles, an instrument stiffness value using a derivative of the applied instrument drive force with respect to the predicted resultant spread angle at that predicted resultant spread angle. For example, the derivative may be the first derivative of the applied instrument drive force with respect to the predicted resultant spread angle -as represented by Equation 9: dF dos (9) In order to mitigate against the control system performing step 1306 whilst the robotic surgical instrument is grasping an object between its end effector elements (e.g. whilst robotic surgical instrument the in an open configuration), the control system may be configured to determine an instrument stiffness value for each of the plurality of predicted resultant spread angles in response to determining that: the plurality of predicted resultant spread angles are within a predetermined range of spread angles (e.g. between 20° and -20°); the plurality of predicted resultant spread angles are predicted for applied instrument drive forces within a predetermined range of instrument drive forces (e.g. between -10N and -50N); and/or the predicted resultant spread angles of the plurality of predicted resultant spread angles are changing at a rate faster than a predetermined threshold (e.g. -30°/s, which represents robotic surgical instrument closing at a rate of 30°/s). Suitable thresholds and/or ranges may be stored by the control system 124 for each robotic surgical instrument.
Figure 12 illustrates plot of the first derivative of applied instrument drive force with respect to dF predicted resultant spread angle, -against resultant spread angle, O. The data shown in de Figure 12 has been derived by determining instrument stiffness values for the data shown in Figure 11.
In step 1308, the control system is configured to determine a spread offset value in dependence on the plurality of determined instrument stiffness values. Determining the spread offset value may comprise approximating a predicted spread angle at which a step change occurs in the determined instrument stiffness values. For example, such a step change can be seen in Figure 12. Said predicted spread angle may be determined as the spread offset value.
In an example, the control system may be configured to cause the instrument drive force to be varied to close the robotic surgical instrument from an open configuration. Referring to Figures 11 and 12, closing the robotic surgical instrument from an open configuration would cause data to be generated, chronologically, from the right-hand-side of those plots to lefthand-side (e.g. as the robotic surgical instrument closes from positive predicted spread angles to negative spread angles). In this example, determining the spread offset value can comprise approximating a predicted spread angle at which the determined instrument stiffness value first reaches or exceeds a predetermined threshold. Said predicted spread angle may be determined as the spread offset value. In Figure 12, this predetermined threshold is at an instrument stiffness value,-, of 2 NI°, as illustrated by dashed line 1200. A suitable threshold des may be stored by the control system 124 for each robotic surgical instrument. The approximate predicted spread angle, Os, at which the determined instrument stiffness value first reaches or exceeds this predetermined threshold is -5.5°, as illustrated by dashed line 1202. The predicted spread angle of -5.5° can be determined to be the spread offset value. This means that, in this Figure 12 example, the control system has determined that the robotic surgical instrument was in a "zero configuration", as defined herein, when the kinematic equations were predicting a spread angle of -5.5° (i.e. an over-closed configuration). It follows that, when the kinematic equations were predicting a spread angle of 00, the robotic surgical instrument was in fact in an open configuration (e.g. with a spread angle of approximately +5.5°).
In an alternative example, the control system may be configured to cause the instrument drive force to be varied to open the robotic surgical instrument from a closed configuration. Referring to Figures 11 and 12, opening the robotic surgical instrument from a closed configuration would cause data to be generated, chronologically, from the left-hand-side of those plots to right-hand-side (e.g. as the robotic surgical instrument opens from negative predicted spread angles to positive spread angles). In this example, determining the spread offset value can comprise approximating a predicted spread angle at which the determined instrument stiffness value first reaches or falls below a predetermined threshold (e.g. 0.5 N/°). A suitable threshold may be stored by the control system 124 for each robotic surgical instrument. Said predicted spread angle may be determined as the spread offset value.
In step 1310, the control system is configured to control the surgical robot arm to drive the robotic surgical instrument in dependence on the spread offset value. The control system may be configured to use the spread offset value to adjust subsequently predicted resultant spread angles. For example, the control system may be configured to subtract the spread offset value from the output of the kinematic equations used to predict a resultant spread angle for an applied instrument drive force so as to determine a calibrated spread angle. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to a configuration (e.g. a spread angle) that more closely matches the configuration (e.g. the spread angle) requested by the input received at the surgeon input device. In a specific example, the control system may be configured to use the spread offset value to determine a calibrated zero configuration for the robotic surgical instrument. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to the calibrated zero configuration when the input received at the surgeon input device requests that the robotic surgical instrument is in the zero configuration. For example, referring to Figure 12, in response to receiving an input at the surgeon input device requesting that the robotic surgical instrument is in the zero configuration (e.g. having a spread angle of 0°), the control system may control the surgical robot arm to apply an appropriate instrument drive force to drive the robotic surgical instrument to a predicted spread angle of -5.5° (e.g. as subtracting the spread offset value, -5.5°, from the predicted spread angle, -5.5°, gives an adjusted spread angle of 00). That is, in this example, the control system can cause the one or more interface elements to be driven to respective measured positions that, when input to the kinematic equations, output a predicted spread angle of -5.5°.
Configuring the control system (e.g. control system 124 shown in Figure 1) to perform steps 1302, 1304, 1306, 1308 and 1310 can improve the surgeon's perception that the movements of the robotic surgical instrument are accurately reflecting the inputs they provide to the surgeon input device.
The control system can be configured to perform steps 1302, 1304, 1306 and 1308 as part of a calibration process prior to using a robotic surgical instrument to perform aspects of a minimally invasive surgical procedure. For example, such a calibration process may be performed prior to beginning a minimally invasive surgical procedure, and/or each time a new robotic surgical instrument is attached to the surgical robot arm during the minimally invasive surgical procedure.
Alternatively, or additionally, the control system can be configured to perform steps 1302, 1304, 1306 and 1308 iteratively during a minimally invasive surgical procedure, so as to iteratively update the determined spread offset value. For example, the control system may be configured to automatically perform steps 1306 and 1308 each time the conditions for determining an instrument stiffness value, as described herein with reference to step 1306, are met during a minimally invasive surgical procedure This approach of iteratively updating the determined spread offset value can advantageously take account of "wear and tear" of the robotic surgical instrument during the minimally invasive surgical procedure. In these examples, in order to mitigate against the control system determining a spread offset value whilst the robotic surgical instrument is grasping an object between its end effector elements (e.g. whilst robotic surgical instrument the in an open configuration) the control system may be configured to determine the spread offset value in dependence on a range of permissible spread offset values. For example, the range of permissible spread offset values may be -15° to +15°. The spread offset value may not be updated if the control system determines a spread offset value outside of that permissible range.
Concept 2 -interface position offset value In the set of steps described with reference to Figure 13, step 1304 involves predicting a resultant spread angle in dependence on a measured position of each of the one or more interface elements. The following steps of Figure 13 are performed in dependence on that predicted resultant spread angle so as to control the surgical robot arm to drive the robotic surgical instrument in dependence on a spread offset value. In examples where a single interface element can control the spread angle between the first and second end effector elements, this "predicting" step need not be performed. This is because the measured position of that interface element will be indicative of a predicted spread angle between the first end effector element and the second end effector element. By contrast, in examples where the spread angle is dependent on the position of two or more interface elements, the position of any one of those interface elements alone is not necessarily indicative of the spread angle.
Figure 14 illustrates a second set of steps that can be performed by a control system (e.g. control system 124 shown in Figure 1) for controlling a surgical robot arm (e.g. surgical robot arm 101 shown in Figure 1) in dependence on a determined interface position offset value. The surgical robot arm has a drive mechanism configured for driving a robotic surgical instrument. The robotic surgical instrument comprises a first end effector element and a second end effector element. The drive mechanism comprises an interface element (e.g. a single interface element, or only one interface element) configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element.
Preferably, the control system can be configured to perform the set of steps described with reference to Figure 14 when a robotic surgical instrument in which the first and second end effector elements are not independently rotatable (e.g. yawing of both the first and second end effector elements is driven in tandem by a common pulley, gear, or rack and pinion mechanism), or in which only one of the end effector elements is rotatable whilst the other end effector element remains stationary (e.g. fixed in place relative to the articulation), is attached to the surgical robot arm.
In step 1402, the control system is configured to cause an instrument drive force applied at the interface element to be varied. In step 1402, the instrument drive force is applied at a single interface element for changing an angle (e.g. a yaw angle) of one or both of the first end effector element and the second end effector element. The applied forces may be measured using a force sensor -such as the force sensor described with reference to Figure 5.
In step 1402, the control system may be configured to cause the instrument drive force to be varied so as to close the robotic surgical instrument from an open configuration. Alternatively, the control system may be configured to cause the instrument drive force to be varied so as to open the robotic surgical instrument from a closed configuration.
In step 1404, the control system is configured to, for each of a plurality of applied instrument drive forces, measure a position of the interface element when that instrument drive force is applied which is indicative of a predicted spread angle between the first end effector element and the second end effector element. The position of the interface element may be measured using a position sensor -such as the position sensor described with reference to Figure 5.
Optionally, the positions measured in step 1404 may be partially or fully lost motion compensating -as will be described in further detail below with reference to Figure 16.
In step 1406, the control system is configured to determine, for each of the plurality of measured positions, an instrument stiffness value using a derivative of the applied instrument drive force with respect to the measured position at that measured position. For example, the derivative may be the first derivative of the applied instrument drive force with respect to the measured position -as represented by Equation 10, where q is the measured position of the interface element: dF dq (10) In order to mitigate against the control system performing step 1406 whilst the robotic surgical instrument is grasping an object between its end effector elements (e.g. whilst robotic surgical instrument the in an open configuration), the control system may be configured to determine an instrument stiffness value for each of the plurality of measured positions in response to determining that: the plurality of measured positions are within a predetermined range of measured positions (e.g. a predetermined range of measured positions that are indicative of predicted spread angles of between -20° and +20° -e.g., for an example robotic surgical instrument, the predetermined range of measured positions may be -2mm to +2mm); the plurality of measured positions are measured for applied instrument drive forces within a predetermined range of instrument drive forces (e.g. between -10N and -50N); and/or the measured positions of the plurality of measured positions are changing at a rate faster than a predetermined threshold (e.g. a predetermined threshold rate indicative of the robotic surgical instrument closing at a rate of 30°/s). Suitable thresholds and/or ranges may be stored by the control system 124 for each robotic surgical instrument.
In step 1408, the control system is configured to determine an interface position offset value in dependence on the plurality of determined instrument stiffness values. Determining the interface position offset value may comprise approximating a measured interface position at which a step change occurs in the determined instrument stiffness values. Said measured interface position may be determined as the interface position offset value.
In an example, the control system may be configured to cause the instrument drive force to be varied to close the robotic surgical instrument from an open configuration. In this example, determining the interface position offset value comprises approximating a measured position at which the determined instrument stiffness value first reaches or exceeds a predetermined threshold (e.g. 20 N/mm). A suitable threshold may be stored by the control system 124 for each robotic surgical instrument. Said measured interface position may be determined as the interface position offset value.
In an alternative example, the control system may be configured to cause the instrument drive force to be varied to open the robotic surgical instrument from a closed configuration. In this example, determining the interface position offset value comprises approximating a measured position at which the determined instrument stiffness value first reaches or falls below a predetermined threshold (e.g. 5 N/mm). A suitable threshold may be stored by the control system 124 for each robotic surgical instrument. Said measured interface position may be determined as the interface position offset value.
In step 1410, the control system is configured to control the surgical robot arm to drive the robotic surgical instrument in dependence on the interface position offset value. The control system may be configured to use the interface position offset value to adjust subsequently measured interface positions that are to be input to the kinematic equations used to predict a resultant spread angle for an applied instrument drive force. For example, the control system may be configured to subtract the interface position offset value from the measured interface positions so as to determine calibrated interface positions to be input to the kinematic equations. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to a configuration (e.g. a spread angle) that more closely matches the configuration (e.g. the spread angle) requested by the input received at the surgeon input device. In a specific example, the control system may be configured to use the interface position offset value to determine a calibrated zero configuration for the robotic surgical instrument. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to the calibrated zero configuration when the input received at the surgeon input device requests that the robotic surgical instrument is in the zero configuration.
Configuring the control system (e.g. control system 124 shown in Figure 1) to perform steps 1402, 1404, 1406, 1408 and 1410 can improve the surgeon's perception that the movements of the robotic surgical instrument are accurately reflecting the inputs they provide to the surgeon input device.
The control system can be configured to perform steps 1402, 1404, 1406 and 1408 as part of a calibration process prior to using a robotic surgical instrument to perform aspects of a minimally invasive surgical procedure. For example, such a calibration process may be performed prior to beginning a minimally invasive surgical procedure, and/or each time a new robotic surgical instrument is attached to the surgical robot arm during the minimally invasive surgical procedure.
Alternatively, or additionally, the control system can be configured to perform steps 1402, 1404, 1406 and 1408 iteratively during a minimally invasive surgical procedure, so as to iteratively update the determined interface position offset value. For example, the control system may be configured to automatically perform steps 1406 and 1408 each time the conditions for determining an instrument stiffness value, as described herein with reference to step 1406, are met during a minimally invasive surgical procedure This approach of iteratively updating the determined interface position offset value can advantageously take account of "wear and tear" of the robotic surgical instrument during the minimally invasive surgical procedure. In these examples, in order to mitigate against the control system determining an interface position offset value whilst the robotic surgical instrument is grasping an object between its end effector elements (e.g. whilst robotic surgical instrument the in an open configuration) the control system may be configured to determine the interface position offset value in dependence on a range of permissible interface position offset values. For example, the range of permissible interface position offset values may be indicative of predicted spread angles of -15° to +15° -e.g., for an example robotic surgical instrument, the range of permissible interface position offset values may be -1.2mm to +1.2mm as defined relative to the neutral (e.g. resting) position of the interface element, and/or -10% to +10% of the total possible travel of an interface element relative to its neutral (e.g. resting) position (e.g. at 50%, but not necessarily). The interface position offset value may not be updated if the control system determines an interface position offset value outside of that permissible range.
The control system may be configured to perform any one or more of the sets of steps described herein with reference to Figures 9, 10, 13 and 14. The control system may be configured to perform a different one of the sets of steps described herein with reference to Figures 9, 10, 13 and 14 depending on which (or what type of) robotic surgical instrument is attached to the surgical robot arm.
Lost motion compensation Optionally, the control system can be configured to control the surgical robot arm to drive the robotic surgical instrument to compensate for lost motion within the drive mechanism and/or the robotic surgical instrument. The control system can be configured to perform said lost motion compensation in combination with any of the sets of steps described herein with reference to Figures 9, 10, 13 and 14-although this need not be the case. Configuring the control system in this way can advantageously further improve the surgeon's perception that the movements of the robotic surgical instrument are accurately reflecting the inputs they provide to the surgeon input device.
Lost motion, sometimes referred to as backlash, can be caused by the attachment between the drive mechanism of the surgical robot arm and the robotic surgical instrument, and/or one or more components in the drive transfer mechanism of the robotic surgical instrument. For example, lost motion can be caused by one or more cables in the drive transfer mechanism of certain robotic surgical instruments stretching. Another source of lost motion can be the sterile barrier (e.g. sheet of flexible material) positioned between the drive mechanism and the robotic surgical instrument. Lost motion can cause a time lag between an interface element in the drive mechanism moving, and the corresponding end effector element(s) of the robotic surgical instrument moving.
The effects of lost motion can be understood with reference to Figure 15A -which illustrates the true zero configuration and spread offset value relative to predicted resultant spread angles when closing a robotic surgical instrument. In Figure 15A, the axis 1500 represents the predicted resultant spread angles for a robotic surgical instrument. As described herein, said predicted resultant spread angles can be determined using kinematic equations, such Equations 4 or 5. As shown by arrow 1502, Figure 15A is considering an example in which the robotic surgical instrument is closing from an open configuration. That is, the robotic surgical instrument is closing from a positive (i.e. "+ve") predicted spread angle to a negative (i.e. "-ve") predicted spread angle. The predicted spread angle (i.e. predicted 00) at which the kinematic equations predict the robotic surgical instrument will be in the zero configuration is shown as "predicted zero" 1504. The predicted spread angle at which the robotic surgical instrument is actually in the zero configuration is shown as "true zero" 1506. Using the sets of steps described herein with reference to Figures 9 or 13, a spread offset value 1508 can be determined. However, as shown in Figure 15A, owing to the effects of lost motion, the spread offset value 1508 can be larger than the actual offset between the "predicted zero" 1504 and the "true zero" 1506. This is because the sets of steps described herein with reference to Figures 9 or 13 use sensed instrument drive force and measured interface element position data collected at the drive mechanism, and so do not fully account for lost motion occurring "downstream" of that drive mechanism (e.g. in the sterile barrier and/or in the drive transfer mechanism of the surgical robot instrument).
The amount of difference between the "true zero" 1504" and "true zero plus lost motion" 1510, i.e. the amount of lost motion, can depend on the drive transfer mechanism of the robotic surgical instrument. For example, a significant source of lost motion is cable stretch. Hence, a drive transfer mechanism that uses cables with a lower resistance to elastic deformation (e.g. having a lower Young's modulus) would experience more lost motion relative to a drive transfer mechanism that uses cables with a higher resistance to elastic deformation (e.g. having a higher Young's modulus). Drive transfer mechanisms that use push-rods to transfer drive forces rather than cables may experience little to no lost motion -meaning that the lost motion compensation techniques described herein need not be performed for robotic surgical instruments having these types of drive transfer mechanisms.
Figure 16 illustrates a set of steps performed by the control system for compensating for lost motion.
In step 1602, the control system is configured to cause an instrument drive force applied at the one or more interface elements to be varied. The applied forces may be measured using force sensors -such as those described with reference to Figure 5. In step 1602, the control system may be configured to cause the instrument drive force to be varied so as to close the robotic surgical instrument from an open configuration.
In step 1604, the control system is configured to determine one or more interface stiffness values for each of the one or more interface elements. Each of the interface stiffness values is based on a derivative of the force applied at that interface element with respect to the measured position of that interface element. For example, Equation 11 can be used to determine an interface stiffness value for each of a first interface element (e.g. interface element 616 shown in Figure 6) for changing an angle (e.g. a yaw angle) of the first end effector element (e.g. first end effector element 208-1 shown in Figures 3 to 7) and a second interface element (e.g. interface element 618 shown in Figure 6) for changing an angle (e.g. a yaw angle) of the second end effector element (e.g. second end effector element 208-2 shown in Figures 3 to 7). In Equation 11, f is the force applied at the first interface element, is the measured position of the first interface element, k, is an interface stiffness value for the first interface element, f is the force applied at the second interface element, qn is the measured position of the second interface element, and kil is an interface stiffness value for the second interface element.
-
The control system may be configured to determine one or more interface stiffness values for each of the one or more interface elements in response to determining that: the predicted resultant spread angle for the applied instrument drive force is within a predetermined range of spread angles (e.g. between 20° and -20°); and/or the predicted resultant spread angles for a series of applied instrument drive forces are changing at a rate faster than a predetermined threshold (e.g. -30°/s, which represents robotic surgical instrument closing at a rate of 30°/s). Suitable thresholds and/or ranges may be stored by the control system 124 for each robotic surgical instrument.
The control system can be configured to determine a plurality of interface stiffness values for each of the one or more interface elements. For example, a plurality of interface stiffness values can be calculated at a respective plurality of different applied instrument drive forces.
The control system can be configured to determine an average interface stiffness value for each of the one or more interface elements in dependence on the plurality of interface stiffness values. For example, Equation 12 determines an average interface stiffness value for each of the first the second interface elements -i.e. average interface stiffness values k, and respectively. In Equation 12, each of the average interface stiffness values k, and /(11 can also be multiplied by a correction factor a. A suitable value for the correction factor a can be determined empirically. A suitable correction factor a may be stored by the control system 124 for each robotic surgical instrument. By way of example, a correction factor a of 0.015 was found to work well for the example robotic surgical instrument and drive mechanism shown in Figures 3 to 6. The output of Equation 12 is a corrected average interface stiffness value for each of the first the second interface elements -i.e. corrected average interface stiffness values k'9 and k'n, respectively.
ki9,11 = ak,41 (12) For each of the one or more interface elements, in step 1606, the control system is configured to determine, for an instrument drive force applied at that interface element, a lost motion compensating position of that interface element in dependence on the one or more determined interface stiffness values (e.g. the corrected average interface stiffness). For example, Equation 13 determines a lost motion compensating position for each of the first the second interface elements -i.e. lost motion compensating position eh and bin, respectively. Optionally, the sensed applied instrument drive forces, 1-9,11, can be filtered prior to being input to Equation 13 so as to mitigate against noisy force sensor readings. The skilled person would be aware of various methods for filtering the readings of a force sensor, and so said filtering methods will not be discussed further herein.
49,11 -q9.11 f911 (13) The lost motion compensating position of an interface element is a theoretical or hypothetical position of that interface element that is intended to compensate for the effects of lost motion when used in kinematic equations to predict the resultant spread angle of the robotic surgical instrument at that applied instrument drive force.
In step 1608, the control system is configured to predict, for the instrument drive force applied by the drive mechanism, a lost motion compensating resultant spread angle in dependence on the determined lost motion compensating positions of each of the one or more interface elements. For example, Equation 14 (based on Equation 5 described herein) predicts a lost motion compensating resultant spread angle, 5,, using the lost motion compensating positions 11, and q11. el
ry 5,2 The advantages of configuring the control system to predict lost motion compensating resultant spread angles as described herein with reference to Figure 16 can be understood with reference to Figure 15B -which illustrates the true zero configuration and spread offset (14) value relative to lost motion compensating predicted resultant spread angles when closing a robotic surgical instrument. Figure 15B uses the same raw applied instrument drive force and interface element position data as Figure 15A. In Figure 15B, the axis 1520 represents the lost motion compensating predicted resultant spread angles for a robotic surgical instrument.
As shown by arrow 1522, Figure 15B is considering an example in which the robotic surgical instrument is closing from an open configuration. That is, the robotic surgical instrument is closing from a positive (i.e. "+ve") lost motion compensating predicted spread angle to a negative (i.e. "-ve") lost motion compensating predicted spread angle. The lost motion compensating predicted spread angle (i.e. lost motion compensating predicted 0°) at which the lost motion compensating kinematic equations predict the robotic surgical instrument will be in the zero configuration is shown as "lost motion compensating predicted zero" 1524. The predicted spread angle at which the robotic surgical instrument is actually in the zero configuration is shown as "true zero" 1506. Using the sets of steps described herein with reference to Figures 9 or 13, a spread offset value 1508 can be determined. In Figure 15B (unlike in Figure 15A), the spread offset value 1508 matches the actual offset between the "lost motion compensating predicted zero" 1524 and the "true zero" 1506.
As a result, a combination of the lost motion compensating resultant spread angles predicted as described herein with reference to Figure 16 and the spread offset value determined as described herein with reference to Figures 9 or 13, can be used to determine calibrated spread angles for the robotic surgical instrument.
The sets of steps described herein with reference to Figure 16 to predict a lost motion compensating resultant spread angle, 5,, can be performed in parallel with the sets of steps described herein with reference to Figures 9 or 13 to determine a spread offset value. This is shown in Figure 17, which illustrates a set of steps performed by the control system for determining a calibrated spread angle.
In step 1702, the control system is configured to cause an instrument drive force applied at the one or more interface elements to be varied as described herein with reference to steps 902, 1002, 1302, 1402 and/or 1602.
In step 1704, the control system is configured to predict, for an instrument drive force applied by the drive mechanism, a lost motion compensating resultant spread angle, 5,, as described herein with reference to Figure 16.
In step 1706, the control system is configured to determine a spread offset value, So, as described herein with reference to Figures 9 or 13.
In step 1708, the control system is configured to determine, for the instrument drive force applied by the drive mechanism, a calibrated spread angle, Ws, in dependence on the predicted lost motion compensating resultant spread angle, as, and the spread offset value, So. For example, the control system may be configured to subtract the spread offset value, So, from the predicted lost motion compensating resultant spread angle, eis, so as to determine a calibrated spread angle, B's, for that instrument drive force applied by the drive mechanism (e.g. see Equation 15).
0'5 = -So (15) The calibrated spread angle, Eus, is a more accurate estimate of the actual spread angle between the first end effector element and the second end effector element when a given instrument drive force is applied. By determining calibrated spread angles, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to a configuration (e.g. a calibrated spread angle) that more closely matches the configuration (e.g. the spread angle) requested by the input received at the surgeon input device. That is, the control system can cause the one or more interface elements to be driven to respective measured positions that, when input to the kinematic equations, output the calibrated spread angle.
It is to be understood that, in examples where a single interface element can control the spread angle between the first and second end effector elements, e.g. as discussed with reference to Figures 10 and 14, the lost motion compensating position of that interface element output from step 1606 can be used to determine a calibrating position of the interface element. That is, in these examples step 1608 need not be performed. Instead, in these examples, the control system can be configured to determine, for an instrument drive force applied by the drive mechanism, a calibrating position of the interface element in dependence on the predicted lost motion compensating position of the interface element output from step 1606 and an interface position offset value, go, determined as described with reference to Figures 10 and 14. In an example, the control system may be configured to subtract the interface position offset value, go, from the predicted lost motion compensating position, q, of the interface element so as to determine a calibrating position, g', of the interface element for that instrument drive force applied by the drive mechanism (e.g. see Equation 16). (16)
The control system may be configured to input the calibrating position, q', into the kinematic equations used to predict a resultant spread angle for an applied instrument drive force so as to output the calibrated spread angle. In this way, the control system can control the surgical robot arm such that an appropriate instrument drive force is applied in order that the robotic surgical instrument is driven to a configuration (e.g. a calibrated spread angle) that more closely matches the configuration (e.g. the spread angle) requested by the input received at the surgeon input device.
It is to be understood that the sets of steps described herein with reference to Figure 16 could be performed independently of (i.e. need not necessarily be performed in combination with) the sets of steps described herein with reference to Figures 9, 10, 13 and 14.
It is to be understood that the principles described herein can be applied to control systems for controlling robot arms used for purposes other than surgery. For example, the robot arm may be used on a vehicle assembly line.
The applicant hereby discloses in isolation each individual feature described herein and any combination of two or more such features, to the extent that such features or combinations are capable of being carried out based on the present specification as a whole in the light of the common general knowledge of a person skilled in the art, irrespective of whether such features or combinations of features solve any problems disclosed herein, and without limitation to the scope of the claims. The applicant indicates that aspects of the present invention may consist of any such individual feature or combination of features. In view of the foregoing description it will be evident to a person skilled in the art that various modifications may be made within the scope of the invention.

Claims (25)

  1. CLAIMS1. A control system for controlling a surgical robot arm, the surgical robot arm having a drive mechanism configured for driving a robotic surgical instrument, said robotic surgical instrument comprising a first end effector element and a second end effector element, the drive mechanism comprising one or more interface elements configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element, the control system being configured to: whilst an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element, cause an instrument drive force applied at the one or more interface elements to be varied; predict, for each of at least two applied instrument drive forces, a resultant spread angle between the first end effector element and the second end effector element in dependence on a measured position of each of the one or more interface elements when that instrument drive force is applied; fit a linear relationship to the at least two applied instrument drive force and predicted resultant spread angle data pairs; determine a spread offset value, wherein determining the spread offset value comprises approximating, using the linear relationship, a predicted spread angle when the applied instrument drive force would equal a predetermined force value; and control the surgical robot arm to drive the robotic surgical instrument in dependence on the spread offset value.
  2. 2. The control system as claimed in claim 1, the control system being configured predict, for each of the at least two applied instrument drive forces, the resultant spread angle between the first end effector element and the second end effector element further in dependence on the geometry of one or more components of a drive transfer mechanism of the robotic surgical instrument configured for transferring force from the one or more interface elements to the first end effector element and/or the second end effector element.
  3. 3 The control system as claimed in claim 2, wherein the drive transfer mechanism comprises: one or more drive cables; and/or one or more push-rods.
  4. 4. The control system as claimed in any preceding claim, the control system being configured to use the spread offset value to adjust subsequently predicted resultant spread angles.
  5. 5. The control system as claimed in any preceding claim, the control system being configured to use the spread offset value to determine a calibrated zero configuration for the robotic surgical instrument, the calibrated zero configuration being: when the control system is configured to cause the instrument drive force to be varied to close the robotic surgical instrument from an open configuration, the configuration in which an inner surface of the first end effector element first contacts an inner surface of the second end effector element; or when the control system is configured to cause the instrument drive force to be varied to open the robotic surgical instrument from a closed configuration, the configuration in which an inner surface of the first end effector element last contacts an inner surface of the second end effector element.
  6. 6. The control system as claimed in any preceding claim, wherein the instrument drive force is dependent on a first force applied at a first interface element for changing an angle of the first end effector element and a second force applied at a second interface element for changing an angle of the second end effector element.
  7. 7. The control system as claimed in claim 6, wherein the instrument drive force is dependent on a sum of the first force and the second force.
  8. 8. The control system as claimed in claim 6 or 7, wherein the first force and the second force are independently controllable.
  9. 9. The control system as claimed in any of claims 1 to 5, wherein the instrument drive force is dependent on a force applied at a single interface element for changing an angle of one or both of the first end effector element and the second end effector element.
  10. 10. The control system as claimed in any preceding claim, wherein approximating the predicted spread angle when the applied instrument drive force would equal the 30 predetermined force value comprises extrapolating the linear relationship to the predetermined force value.
  11. 11. The control system as claimed in any preceding claim, the control system being configured to determine that the inner surface of the first end effector element is exerting a force against the inner surface of the second end effector element, said determining comprising: determining that the predicted resultant spread angles are below a predetermined predicted spread angle threshold; and/or determining that the predicted resultant spread angles are within a predetermined range of predicted spread angles.
  12. 12. The control system as claimed in any preceding claim, wherein the spread offset value is determined in dependence on a range of permissible spread offset values.
  13. 13. The control system as claimed in any preceding claim, the control system being further configured to predict, for an instrument drive force applied by the drive mechanism, a lost motion compensating resultant spread angle between the first end effector element and the second end effector element.
  14. 14. The control system as claimed in claim 13, the control system being further configured to determine, for the instrument drive force applied by the drive mechanism, a calibrated spread angle in dependence on the predicted lost motion compensating resultant spread angle and the spread offset value.
  15. 15. The control system as claimed in claim 13 or 14, the control system being configured to subtract the spread offset value from the predicted lost motion compensating resultant spread angle so as to determine a calibrated spread angle for that instrument drive force applied by the drive mechanism.
  16. 16. The control system as claimed in any of claims 13 to 15, the control system being configured to: for each of the one or more interface elements; determine one or more interface stiffness values, each of the interface stiffness values being based on a derivative of the force applied at that interface element with respect to a measured position of that interface element; and determine, for the instrument drive force applied at that interface element, a lost motion compensating position of that interface element in dependence on the one or more determined interface stiffness values; and predict, for the instrument drive force applied by the drive mechanism, the lost motion compensating resultant spread angle in dependence on the determined lost motion compensating positions of each of the one or more interface elements.
  17. 17. The control system as claimed in claim 16, the control system being configured to: determine, for each of the one or more interface elements, a plurality of interface stiffness values; determine an average interface stiffness value in dependence on the plurality of interface stiffness values; and determine, for the instrument drive force applied by the drive mechanism, the lost motion compensating position of that interface element in dependence on the average interface stiffness value.
  18. 18. The control system as claimed in any of claims 13 to 17, wherein lost motion is caused, at least in part, by one or more of: stretching of one or more cables configured to transfer the instrument drive force from the drive mechanism to the first end effector element and/or the second end effector element; friction within the drive mechanism; and friction within the robotic surgical instrument.
  19. 19. A control system for controlling a surgical robot arm, the surgical robot arm having a drive mechanism configured for driving a robotic surgical instrument, said robotic surgical instrument comprising a first end effector element and a second end effector element, the drive mechanism comprising an interface element configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element, the control system being configured to: whilst an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element, cause an instrument drive force applied at the interface element to be varied; for each of at least two applied instrument drive forces, measure a position of the interface element when that instrument drive force is applied which is indicative of a predicted spread angle between the first end effector element and the second end effector element; fit a linear relationship to the at least two applied instrument drive force and measured position data pairs; determine an interface position offset value, wherein determining the interface position offset value comprises approximating, using the linear relationship, an interface position when the applied instrument drive force would equal a predetermined force value; and control the surgical robot arm to drive the robotic surgical instrument in dependence on the interface position offset value.
  20. 20. The control system as claimed in any preceding claim, wherein the predetermined force value is zero.
  21. 21. The control system as claimed in any preceding claim, the control system being configured to cause the instrument drive force to be varied so as to: increase the force exerted by each of the first and second end effector elements on the other; or decrease the force exerted by each of the first and second end effector elements on the other.
  22. 22. The control system as claimed in any preceding claim, the control system being configured to determine that the inner surface of the first end effector element is exerting a force against the inner surface of the second end effector element, said determining comprising: determining that the applied instrument drive forces exceed a predetermined instrument drive force threshold; and/or determining that the applied instrument drive forces are within a predetermined range of instrument drive forces.
  23. 23. A surgical robotic system comprising: a surgical robot arm having a drive mechanism configured for driving a robotic surgical instrument, said robotic surgical instrument comprising a first end effector element and a second end effector element, the drive mechanism comprising one or more interface elements configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element; and a control system according to any of claims 1 to 22.
  24. 24. A method of controlling a surgical robot arm, the surgical robot arm having an drive mechanism configured for controlling a robotic surgical instrument, said robotic surgical instrument comprising a first end effector element and a second end effector element, the drive mechanism comprising one or more interface elements configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element, the control system being configured to: whilst an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element, causing an instrument drive force applied at the one or more interface elements to be varied; predicting, for each of at least two applied instrument drive forces, a resultant spread angle between the first end effector element and the second end effector element in dependence on a measured position of each of the one or more interface elements when that instrument drive force is applied; fitting a linear relationship to the at least two applied instrument drive force and predicted resultant spread angle data pairs; determining a spread offset value, wherein determining the spread offset value comprises approximating, using the linear relationship, a predicted spread angle when the applied instrument drive force would equal a predetermined force value; and controlling the surgical robot arm to drive the robotic surgical instrument in dependence on the spread offset value.
  25. 25. A method of controlling a surgical robot arm, the surgical robot arm having an drive mechanism configured for controlling a robotic surgical instrument, said robotic surgical instrument comprising a first end effector element and a second end effector element, the drive mechanism comprising an interface element configured to interface with the robotic surgical instrument for controlling a spread angle between the first end effector element and the second end effector element, the method comprising: whilst an inner surface of the first end effector element is exerting a force against an inner surface of the second end effector element, causing an instrument drive force applied at the interface element to be varied; for each of at least two applied instrument drive forces, measuring a position of the interface element when that instrument drive force is applied which is indicative of a predicted spread angle between the first end effector element and the second end effector element; fitting a linear relationship to the at least two applied instrument drive force and measured position data pairs; determining an interface position offset value, wherein determining the interface position offset value comprises approximating, using the linear relationship, an interface position when the applied instrument drive force would equal a predetermined force value; and controlling the surgical robot arm to drive the robotic surgical instrument in dependence on the interface position offset value.
GB2214081.8A 2022-09-27 2022-09-27 Control system for controlling a surgical robot arm Pending GB2622790A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB2214081.8A GB2622790A (en) 2022-09-27 2022-09-27 Control system for controlling a surgical robot arm
PCT/GB2023/052448 WO2024069132A1 (en) 2022-09-27 2023-09-21 Control system for controlling a surgical robot arm

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB2214081.8A GB2622790A (en) 2022-09-27 2022-09-27 Control system for controlling a surgical robot arm

Publications (2)

Publication Number Publication Date
GB202214081D0 GB202214081D0 (en) 2022-11-09
GB2622790A true GB2622790A (en) 2024-04-03

Family

ID=83978656

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2214081.8A Pending GB2622790A (en) 2022-09-27 2022-09-27 Control system for controlling a surgical robot arm

Country Status (1)

Country Link
GB (1) GB2622790A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050251110A1 (en) * 2004-05-04 2005-11-10 Intuitive Surgical, Inc. Tool grip calibration for robotic surgery
KR20090060752A (en) * 2007-12-10 2009-06-15 현대중공업 주식회사 Robot calibration method with joint stiffness parameters for the enhanced positioning accuracy
KR20160149649A (en) * 2015-06-18 2016-12-28 울산대학교 산학협력단 Robot calibration method including nonlinear joint stiffness
WO2017167687A2 (en) * 2016-03-29 2017-10-05 Cognibotics Ab Method, constraining device and system for determining geometric properties of a manipulator
WO2019090047A1 (en) * 2017-11-02 2019-05-09 Intuitive Surgical Operations, Inc. Systems and methods for end effector position set point correction
GB2597117A (en) * 2020-07-14 2022-01-19 Cmr Surgical Ltd Calibrating an instrument interface

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050251110A1 (en) * 2004-05-04 2005-11-10 Intuitive Surgical, Inc. Tool grip calibration for robotic surgery
KR20090060752A (en) * 2007-12-10 2009-06-15 현대중공업 주식회사 Robot calibration method with joint stiffness parameters for the enhanced positioning accuracy
KR20160149649A (en) * 2015-06-18 2016-12-28 울산대학교 산학협력단 Robot calibration method including nonlinear joint stiffness
WO2017167687A2 (en) * 2016-03-29 2017-10-05 Cognibotics Ab Method, constraining device and system for determining geometric properties of a manipulator
WO2019090047A1 (en) * 2017-11-02 2019-05-09 Intuitive Surgical Operations, Inc. Systems and methods for end effector position set point correction
GB2597117A (en) * 2020-07-14 2022-01-19 Cmr Surgical Ltd Calibrating an instrument interface

Also Published As

Publication number Publication date
GB202214081D0 (en) 2022-11-09

Similar Documents

Publication Publication Date Title
US20210401518A1 (en) Control of computer-assisted tele-operated systems
US8237388B2 (en) Manipulator and control method therefor
JP2018507727A (en) Measuring the normality of connector members in robotic surgical systems.
JP2016179168A5 (en)
US11723739B2 (en) Admittance compensation for surgical tool
US11478316B2 (en) Surgical robot system
US11160633B2 (en) Medical observation apparatus, driving control method, medical observation system, and support arm apparatus
EP3946833B1 (en) Reducing energy buildup in servo-controlled mechanisms
WO2021198664A1 (en) Control system of a surgical robot
CN111655185A (en) Active back drive of robot arm
GB2589380A (en) Controlling a surgical instrument
US20230149101A1 (en) Control system of a surgical robot
GB2622790A (en) Control system for controlling a surgical robot arm
GB2622791A (en) Control system for controlling a surgical robot arm
GB2622792A (en) Control system for controlling a surgical robot arm
WO2024069132A1 (en) Control system for controlling a surgical robot arm
AU2021225384B2 (en) Controlling movement of a surgical robot arm
WO2023162697A1 (en) Robotic surgery system and method for controlling robotic surgery system
US20230172676A1 (en) Control system of a surgical robot
WO2022221204A1 (en) Controlled resistance in backdrivable joints