WO2024022459A1 - Procédé et appareil d'alignement de positionnement pour bras micro-mécanique, et dispositif électronique - Google Patents

Procédé et appareil d'alignement de positionnement pour bras micro-mécanique, et dispositif électronique Download PDF

Info

Publication number
WO2024022459A1
WO2024022459A1 PCT/CN2023/109673 CN2023109673W WO2024022459A1 WO 2024022459 A1 WO2024022459 A1 WO 2024022459A1 CN 2023109673 W CN2023109673 W CN 2023109673W WO 2024022459 A1 WO2024022459 A1 WO 2024022459A1
Authority
WO
WIPO (PCT)
Prior art keywords
micro
manipulator
target
reachable
targets
Prior art date
Application number
PCT/CN2023/109673
Other languages
English (en)
Chinese (zh)
Inventor
宋亮
卓清山
陈聪
Original Assignee
中欧智薇(上海)机器人有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中欧智薇(上海)机器人有限公司 filed Critical 中欧智薇(上海)机器人有限公司
Publication of WO2024022459A1 publication Critical patent/WO2024022459A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70—Manipulators specially adapted for use in surgery
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J7/00—Micromanipulators

Definitions

  • the present invention relates to the field of micro-robot positioning technology, and in particular to a positioning and alignment method, device and electronic equipment for a micro-robot.
  • micro-robots in traditional orthopedic surgery scenarios as an example, the user needs to first move the micro-robot to a position close to the surgical area, then fix the micro-robot, and then start the micro-robot for fine positioning to achieve precise positioning.
  • the user needs to first move the micro-robot to a position close to the surgical area, then fix the micro-robot, and then start the micro-robot for fine positioning to achieve precise positioning.
  • frequent manual movement and fixation is required before starting the micro-robot, which increases manual operations, risks, and operation time, ultimately limiting the application. scope.
  • Embodiments of the present invention provide a positioning and alignment method, device and electronic equipment for a micro-robot to at least solve the problem in related technologies that the positioning of the micro-robot requires frequent manual movement and fixation, resulting in increased application time and risk. question.
  • a positioning and alignment method for a micro-manipulator including: determining the initial posture of the micro-manipulator in a stowed state and the center positions of multiple targets, wherein the initial The posture includes an initial position and an initial posture; according to the initial position and the center positions of multiple targets, the target area of the micro-manipulator in the motion plane is determined, where the target area is the target area of the micro-manipulator.
  • the instrument clamping front end can reach at least two target areas when the micro-manipulator is in the initial posture; the micro-manipulator is controlled to move from the initial position to a predetermined position in the target area, and the The micro-manipulator is fixed at the predetermined position, and , the predetermined position is any position within the target area; the micro-manipulator is controlled to use the predetermined position as a base point to convert from the stowed state to the unfolded state, and move to the reachable target in sequence. center position and align the reachable target.
  • determining the initial posture of the micro-manipulator in the stowed state includes: detecting a position mark attached to the micro-manipulator in the stowed state; determining based on the position mark The instrument holds the initial position and the initial posture of the front end in the physical space coordinate system, and uses the initial position and the initial posture as the initial posture.
  • determining the center positions of multiple targets includes: acquiring a planning image containing multiple targets; comparing the first marker point in the planning image with the second marker point in the physical space coordinate system. Register to obtain a registration matrix, where the coordinates of the first marker point in the image coordinate system correspond to the coordinates of the second marker point in the physical space coordinate system one-to-one; according to the registration matrix Perform coordinate transformation on multiple targets to obtain coordinates of multiple targets in the physical space coordinate system, and use the coordinates of multiple targets in the physical space coordinate system as multiple targets. central location.
  • obtaining a planning image containing a plurality of the targets includes: obtaining three-dimensional image data of a plurality of the targets; planning a plurality of the targets according to the three-dimensional image data to obtain the planning image, wherein , the target in the planning image includes an instrument entry point and a target end point.
  • determining the target area of the micro-manipulator in the motion plane based on the initial position and the center positions of multiple targets includes: obtaining the maximum movement radius of the micro-manipulator;
  • the motion plane of the arm determines the intersection point between the motion plane and multiple target extension lines, wherein the target extension line is an extension line connecting the target instrument entry point and the target end point to form a line segment; determine the initial The distance between the position and each intersection point; the target whose distance is less than or equal to the maximum movement radius is recorded in the list as the reachable target; the intersection point corresponding to the reachable target As the center, the maximum movement radius is used as the radius to generate a circular area of all reachable targets in the list in the motion plane; based on the circular area of all reachable targets in the motion plane, Generate a common intersection area and use the common intersection area as the target area.
  • controlling the micro-manipulator to move from the initial position to a predetermined position in the target area includes: displaying the initial position and the target area in real time; based on the real-time display of the initial position and the target area, moving the micromanipulator from the initial position to a predetermined position in the target area.
  • moving to the center position of the reachable targets in sequence includes: based on the motion plane of the micro-manipulator, determining the target extension corresponding to the motion plane and at least two reachable targets.
  • controlling the movement of the micro-manipulator to the central position of the reachable target includes: determining the movement range of the robot arm required to move the micro-manipulator to the central position of the reachable target; according to The movement range of the micro-manipulator moves the micro-manipulator to a central position of the reachable target.
  • the method further includes: obtaining the position of the micro-manipulator arm after completing the movement. posture; determine the angle difference and distance difference between the target line segment and the posture, wherein the target line segment is a line segment connected to the entry point of the instrument that can reach the target and the target end point; in the angle difference If the angle difference is less than the angle difference threshold and the distance difference is less than the distance difference threshold, it is determined that the micro-manipulator has reached the center position of the reachable target.
  • the method further includes: detecting whether the micro-manipulator is fixed in the target area; If so, control the micro-manipulator to move from the center position of the currently reachable target to the center position of the next reachable target, and align the next reachable target; If the micro-manipulator is not fixed in the target area, the micro-manipulator is returned to the stowed state, and the target area of the micro-manipulator is re-determined based on the remaining reachable targets.
  • fix the micro-manipulator at the predetermined position of the target area fix the micro-manipulator at the predetermined position of the target area, control the micro-manipulator to convert from the stowed state to the unfolded state with the predetermined position as the base point, and move to the remaining reachable areas in sequence.
  • the center position of the target and align the remaining reachable targets.
  • a positioning and alignment device for a micro-manipulator including: a first determination unit for determining the initial posture and multiple targets of the micro-manipulator in a stowed state. center position, wherein the initial pose includes an initial position and an initial posture; a second determination unit configured to determine the position of the micro-manipulator in the motion plane based on the initial position and the center positions of multiple targets.
  • a target area wherein the target area is an area where the instrument holding front end of the micro-manipulator can reach at least two of the targets when the micro-manipulator is in the initial posture;
  • the first control unit with In order to control the micro-manipulator to move from the initial position to a predetermined position in the target area, the micro-manipulator is fixed at the predetermined position, wherein the predetermined position is any one in the target area. Position;
  • the second control unit is used to control the micro-manipulator to convert from the stowed state to the unfolded state with the predetermined position as the base point, move in sequence to the center position of the reachable target, and control the reachable target. to align with the target.
  • an electronic device including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute any of the above. The method steps described steps.
  • a computer-readable storage medium includes a stored program, wherein when the program is running, the location of the computer-readable storage medium is controlled.
  • the device performs any of the method steps described above.
  • the initial posture of the micro-manipulator in the folded state and the center positions of multiple targets are determined, where the initial posture includes the initial position and the initial posture; according to the initial position and the centers of the multiple targets Position, determine the target area of the micro-manipulator in the motion plane, where the target area is an area where the instrument clamping front end of the micro-manipulator can reach at least two targets when the micro-manipulator is in the initial posture; control the micro-manipulator from the initial position The position moves to a predetermined position in the target area, and the micro-manipulator is fixed at the predetermined position, where the predetermined position is any position in the target area; the micro-manipulator is controlled to convert from the stowed state to the unfolded state based on the predetermined position, and then Move to the center of the reachable target and aim at the reachable target.
  • the embodiment of the present invention needs to control the micro-manipulator to move to the target area of the motion plane, fix the micro-manipulator at a predetermined position, and then control the micro-manipulator to move to the center of the reachable target in sequence, thereby achieving
  • the micro-manipulator aligns multiple reachable targets, thereby solving the technical problem in related technologies that the positioning of the micro-manipulator requires frequent manual movement and fixation, resulting in increased application time and risk, and reduces the number of moves and fixations. , the technical effect of reducing application time and risk.
  • Figure 1 is a flow chart of a positioning and alignment method for a micromanipulator provided by an embodiment of the present invention
  • Figure 2 is a schematic diagram of the intersection between the motion plane of the micro-manipulator and the target according to an embodiment of the present invention
  • Figure 3 is a schematic diagram of the common intersection area of the circle formed by all targets provided by the embodiment of the present invention.
  • Figure 4 is a schematic diagram showing that the micro-manipulator provided by the embodiment of the present invention has been aligned with the target 1;
  • FIG. 5 is a schematic diagram of a positioning and alignment device for a micromanipulator provided by an embodiment of the present invention.
  • a method for positioning and aligning a micro-manipulator is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be implemented in a computer system such as a set of computer-executable instructions. are performed, and, although a logical order is shown in the flowchart diagrams, in some cases the steps shown or described may be performed in a different order than herein.
  • Figure 1 is a flow chart of a positioning and alignment method for a micromanipulator provided by an embodiment of the present invention. As shown in Figure 1, the method includes the following steps:
  • Step S102 determine the initial posture of the micro-manipulator in the stowed state and the center positions of multiple targets, where the initial posture includes the initial position and the initial posture;
  • the above-mentioned micro-manipulator is a component of a micro-robot.
  • the micro-manipulator includes but is not limited to a lower actuator arm and an upper actuator arm.
  • the lower actuator arm is provided with an instrument clamping front end and a position mark.
  • the above-mentioned multiple targets are the positioning and alignment targets of the micro-manipulator, and these targets are located in small local areas.
  • the micro-manipulator arm in the retracted state can be placed above the area where multiple targets are located, and then the initial posture of the micro-manipulator arm in the retracted state is obtained.
  • position and posture or position and posture are also called poses.
  • Step S104 Determine the target area of the micro-manipulator in the motion plane based on the initial position and the center positions of the multiple targets, where the target area is the instrument clamping front end of the micro-manipulator that can reach at least 1 when the micro-manipulator is in the initial posture.
  • the above-mentioned target area is a part of the movement plane of the micro-manipulator, which belongs to the movement plane of the micro-manipulator; the above-mentioned micro-manipulator can cover multiple targets in the target area of the movement plane, that is, the micro-manipulator is fixed in the target area. Multiple targets that can be reached; optionally, multiple targets are located on the same side relative to the micro-manipulator.
  • the target area is reachable by the instrument clamping front end of the micro-manipulator when the micro-manipulator is in the initial position.
  • the area of multiple targets; the multiple targets are located on different sides relative to the micro-manipulator.
  • the target area is the area with the most targets that can be reached by the instrument clamping front end of the micro-manipulator when the micro-manipulator is in the initial position.
  • Step S106 control the micro-manipulator to move from the initial position to a predetermined position in the target area, and fix the micro-manipulator at the predetermined position, where the predetermined position is any position in the target area;
  • the micro-manipulator can be controlled to move from the initial position to any position in the target area, and then the micro-manipulator can be fixed at that position. A rough positioning can be achieved.
  • Step S108 control the micro-manipulator to switch from the folded state to the unfolded state with the predetermined position as the base point, and move sequentially Go to the center of the reachable target and align the reachable target.
  • controlling the micro-manipulator to move sequentially to the center position of the reachable target is related to the movement path of the micro-manipulator.
  • the movement path of the micro-manipulator includes the alignment sequence of at least two reachable targets
  • the alignment sequence of the at least two reachable targets can be flexibly adjusted according to the needs of the application scenario; for example, The alignment sequence of multiple reachable targets is preset as the movement path of the micro-manipulator, and then the micro-manipulator is controlled to move to the center of each reachable target in sequence according to the movement path; for another example, the micro-manipulator can be The movement plane of the arm is determined by the intersection point of the movement plane and the target extension line corresponding to multiple reachable targets.
  • the target extension line is the extension line of the line segment connected to the target instrument entry point and the target end point, and then the target extension line is connected to the predetermined position according to the predetermined position.
  • the distance between each intersection determines the alignment sequence of multiple reachable targets as the movement path of the micro-manipulator.
  • the micro-manipulator is controlled to move to the center of each reachable target in sequence according to the movement path; here it can be reached.
  • the alignment order of multiple targets includes but is not limited to the sorting result obtained by sorting the multiple reachable targets from small to large or from small to large according to the distance between the predetermined position and each intersection point.
  • performing a rough positioning of the micro-manipulator can achieve alignment of at least one reachable target.
  • the target area of the micro manipulator can cover all targets, only one rough positioning can be performed to achieve alignment of all targets; if the target area of the micro manipulator only covers part of the targets, multiple times are required.
  • multiple rough positionings are required to achieve alignment of all targets.
  • the above method can reduce the number of rough positioning, thereby reducing the time-consuming and operational risks of manual rough positioning.
  • the initial posture of the micro-manipulator in the folded state and the center positions of multiple targets are determined, where the initial posture includes the initial position and the initial posture; according to the initial position and the centers of the multiple targets Position, determine the target area of the micro-manipulator in the motion plane, where the target area is an area where the instrument clamping front end of the micro-manipulator can reach at least two targets when the micro-manipulator is in the initial posture; control the micro-manipulator from the initial position The position moves to a predetermined position in the target area, and the micro-manipulator is fixed at the predetermined position, where the predetermined position is any position in the target area; the micro-manipulator is controlled to convert from the stowed state to the unfolded state based on the predetermined position, and then Move to the center of the reachable target and aim at the reachable target.
  • the embodiment of the present invention needs to control the micro-manipulator to move to the target area of the motion plane, fix the micro-manipulator at a predetermined position, and then control the micro-manipulator to move to the center of the reachable target in sequence, thereby achieving
  • the micro-manipulator aligns multiple reachable targets, thereby solving the technical problem in related technologies that the positioning of the micro-manipulator requires frequent manual movement and fixation, resulting in increased application time and risk, and reduces the number of moves and fixations. , the technical effect of reducing application time and risk.
  • determining the initial posture of the micro-manipulator arm in the stowed state includes: detecting the position mark attached to the micro-manipulator arm in the stowed state; determining the instrument clamp according to the position mark Hold the initial position and initial attitude of the front end in the physical space coordinate system, and use the initial position and initial attitude as the initial pose.
  • the instrument holding front end of the micro manipulator can be detected by the detection equipment, and then the position mark attached to the micro manipulator is detected when the micro manipulator is in the folded state, and then based on the position mark
  • the initial posture also includes the initial position and initial posture.
  • the initial position and initial attitude of the instrument clamping front end in the physical space coordinate system are calculated using the position mark attached to the micro-manipulator, so that the retracted state of the micro-manipulator can be accurately obtained the initial pose below.
  • determining the center positions of multiple targets includes: acquiring a planning image containing multiple targets; comparing the first marker point in the planning image with the second marker point in the physical space coordinate system. Register to obtain a registration matrix, in which the coordinates of the first marker point in the image coordinate system correspond to the coordinates of the second marker point in the physical space coordinate system one-to-one; perform coordinate transformation on multiple targets according to the registration matrix, The coordinates of multiple targets in the physical space coordinate system are obtained, and the coordinates of the multiple targets in the physical space coordinate system are used as the center positions of the multiple targets.
  • the first marker point in the above planned image is the location of the physical marker point used when collecting the image.
  • the location of the physical marker point can be at the center of the target or at the edge of the area where multiple targets are located. There is no limit here. .
  • the quasi-matrix performs coordinate transformation on multiple targets to obtain the coordinates of the multiple targets in the physical space coordinate system, and uses the coordinates of the multiple targets in the physical space coordinate system as the center positions of the multiple targets.
  • the coordinates of multiple targets in the physical space coordinate system are obtained through coordinate transformation using a registration matrix, and then the center positions of the multiple targets can be obtained.
  • obtaining a planning image containing multiple targets includes: obtaining three-dimensional image data of multiple targets; planning the multiple targets based on the three-dimensional image data to obtain a planning image, wherein in the planning image The target includes the instrument entry point and the target end point.
  • instrument entry point and target end point are represented by three-dimensional coordinates.
  • the instrument entry point and target end point of any target in the three-dimensional image data can reflect the center position of the corresponding target in the three-dimensional space of the image.
  • multiple targets are planned through three-dimensional image data of multiple targets, and corresponding planning images are obtained to facilitate subsequent registration processing and coordinate transformation.
  • determining the target area of the micro-manipulator in the motion plane based on the initial position and the center positions of the multiple targets includes: obtaining the maximum movement radius of the micro-manipulator; based on the motion plane of the micro-manipulator , determine the intersection points of the motion plane and multiple target extension lines, where the target extension line is the extension line connecting the target instrument entry point and the target end point to form a line segment; determine the distance between the initial position and each intersection point; set the distance to be less than or equal to the maximum movement
  • the target of the radius is recorded in the list as a reachable target; using the intersection corresponding to the reachable target as the center and the maximum movement radius as the radius, all reachable targets in the list are generated in the circular area of the motion plane; according to all The reachable target is in the circular area of the motion plane, a common intersection area is generated, and the common intersection area is used as the target area.
  • the above maximum movement radius is the maximum movement distance of the micro-manipulator from the stowed state to the expansion in a single direction under fixed conditions; the above list is used to save reachable targets.
  • the target area of the micro-manipulator in the motion plane it is first necessary to obtain the maximum movement radius of the micro-manipulator, and then determine the intersection points of the motion plane and multiple target extension lines according to the motion plane of the micro-manipulator, and determine the initial The distance between the position and each intersection point, and then the target whose distance is less than or equal to the maximum movement radius is recorded in the list as the reachable target, and then the intersection point corresponding to the reachable target is used as the center and the maximum movement radius is used as the radius to generate a list All reachable targets are in the circular area of the motion plane. Finally, a common intersection area is generated based on all reachable targets in the circular area of the motion plane. This common intersection area is also the target area.
  • the target area of the micro-manipulator in the motion plane can be obtained more accurately, thereby fixing the micro-manipulator to the target area, which can effectively reduce the number of rough positioning.
  • controlling the micro-manipulator to move from the initial position to a predetermined position in the target area includes: displaying the initial position and the target area in real time; and moving the micro-manipulator from the original position and the target area based on the real-time display of the initial position and the target area.
  • the initial position is moved to a predetermined position in the target area.
  • the initial position and the target area are displayed in real time through visualization, and the micro-manipulator is controlled to move from the initial position to a predetermined position in the target area based on the visual display content, thereby realizing the visualization of the rough positioning of the micro-manipulator.
  • the initial position and target area are displayed more intuitively, which can reduce misoperation and grasp the execution dynamics of rough positioning in a timely manner.
  • moving to the center position of the reachable targets in sequence includes: determining the intersection point of the motion plane and target extension lines corresponding to at least two reachable targets according to the motion plane of the micro-manipulator, Among them, the target extension line is the extension line of the line segment connecting the target instrument entry point and the target end point; the movement path of the micro-manipulator is obtained, wherein the movement path of the micro-manipulator includes the alignment sequence of at least two targets that can be reached, The alignment sequence is determined based on the distance between the predetermined position and each intersection point; according to the movement path of the micro-manipulator, the micro-manipulator is controlled to move to the center position of the reachable target.
  • the at least two reachable targets can be sorted according to the distance between the predetermined position and each intersection point to obtain the alignment order of the at least two reachable targets.
  • the at least two reachable targets can be sorted according to the distance from small to large.
  • the targets are sorted to obtain the alignment sequence of at least two targets that can be reached, and the alignment sequence is used as the movement path of the micro-manipulator.
  • the alignment sequence obtained according to distance is: target 1, target 2 and target 3, then the micro-manipulator will first move to target 1, then move from target 1 to target 2, and then move from target 2 to target 3, and control the micro-manipulator to move to target 1, target 2 and The center position of target 3.
  • the selection of the alignment target is optimized and the target alignment efficiency is improved.
  • controlling the movement of the micro-manipulator to the central position of the reachable target includes: determining the movement range of the micro-manipulator required to move the micro-manipulator to the center position of the reachable target; according to the micro-machine The arm movement range moves the micro-manipulator to the center of the reachable target.
  • the above-mentioned robot arm movement range includes the movement distance of the upper actuator arm and/or the movement distance of the lower actuator arm;
  • the movement range of the robot arm required for the micro-manipulator to be deployed from the stowed state to the center position of the reachable target is used to control the movement of the micro-manipulator to the center position of the reachable target. This allows the micro-manipulator to accurately move to the center of the reachable target.
  • the above method further includes: obtaining the pose of the micro-manipulator arm after completing the movement; determining The angle difference and distance difference between the target line segment and the posture, where the target line segment is a line segment connected to the entry point of the instrument that can reach the target and the target end point; when the angle difference is less than the angle difference threshold and the distance difference is less than the distance In the case of a difference threshold, it is determined that the micro-manipulator has reached the center position of the reachable target.
  • the above pose includes the position and attitude of the micro-manipulator after completing its movement, where the position is represented by coordinates in the physical space coordinate system, and the attitude is represented by a rotation vector;
  • the pose of the micro-manipulator arm after completing the movement can be obtained, and then the angle difference between the target line segment and the pose can be calculated and distance difference, and then determine whether the angle difference is less than the angle difference threshold and whether the distance difference is less than the distance difference threshold. If the angle difference is less than the angle difference threshold and the distance difference is less than the distance difference threshold, then the micro When the robotic arm has reached the center position of the reachable target, it indicates that the micro robotic arm has moved into position.
  • the angle difference is greater than or equal to the angle difference threshold or the distance difference is greater than or equal to the distance difference threshold, it indicates that the micro manipulator has not moved in place, and the movement of the micro manipulator needs to be appropriately adjusted until the micro manipulator has been moved into position.
  • angle difference threshold and distance difference threshold can be set according to the needs of the application scenario;
  • angle difference threshold is 0.1 degrees, and the distance difference threshold is 0.3 mm.
  • the above method further includes: detecting whether the micro-manipulator is fixed in the target area; if the micro-manipulator is fixed in the target area, control The micro-manipulator moves from the center position of the currently reachable target to the center position of the next reachable target, and aligns the next reachable target; when the micro-manipulator is not fixed in the target area, then Return the micro-manipulator to the stowed state, re-determine the target area of the micro-manipulator based on the remaining reachable targets, fix the micro-manipulator at a predetermined position in the target area, and control the micro-manipulator to transition from the stowed state with the predetermined position as the base point. In the expanded state, move to the center of the remaining reachable targets in sequence and align the remaining reachable targets.
  • the micro manipulator Since the micro manipulator is prone to artificially moving its position after the target is aligned, the previous rough positioning of the micro manipulator cannot reach the remaining reachable targets. Therefore, in the present invention, after the micro manipulator is aligned with the target, It will detect whether the micro-manipulator is still fixed in the target area; if the micro-manipulator is fixed in the target area, the micro-manipulator can be controlled to move from the center position of the reachable target to the center position of the next reachable target.
  • the micro-manipulator can be returned to the stowed state, and the target area of the micro-manipulator is re-determined according to the remaining reachable targets, and the micro-manipulator can be moved to the target area.
  • the robotic arm is fixed at a predetermined position in the target area, and then controls the micro robotic arm to convert from the stowed state to the unfolded state based on the predetermined position, and then move to the center of the remaining reachable targets in sequence, and align the remaining reachable targets. allow.
  • the previous rough positioning is still effective, continue to align the remaining reachable targets. , otherwise it is necessary to re-perform rough positioning, that is, use the remaining reachable targets to re-determine the target area of the micro-manipulator to achieve positioning and alignment of the remaining reachable targets, thus avoiding invalid operations on the remaining reachable targets. .
  • Step 1 Rough positioning.
  • Step 2 Rough positioning.
  • Step 1.1 Use surgical planning software to plan the surgical target accordingly (generally, planning can be based on three-dimensional image data such as CT, MRI or ultrasound images).
  • the result of the planning is 2 points, each point is represented by (x, y, z) express.
  • the two points represent the target end point and the equipment entry point respectively.
  • the two points can ultimately be represented by a line segment or a vector;
  • Step 1.2 Use the navigation registration method to register the planning image with the physical spatial location.
  • the position of the physical marker point is used when collecting the image so that it can be scanned into the image so that it can be recognized by the algorithm.
  • the registration matrix is obtained by registering the physical marker points in the physical space coordinate system and the marker points in the image coordinate system.
  • the registration matrix is expressed in a 3 ⁇ 3 matrix;
  • Step 1.3 Transform all surgical targets according to the registration matrix to obtain the coordinates of the corresponding targets in the physical space coordinate system;
  • Step 1.4 Attach corresponding position marks to the micro-manipulator.
  • the instrument holding front end of the micro-manipulator can be a passive optical reflective mark or an electromagnetic sensor so that it can be detected by the optical or electromagnetic positioning system, thereby obtaining the instrument holding front end of the micro-manipulator.
  • Position and attitude in the physical space coordinate system including current position and rotation vector);
  • Step 1.5 When the micro-manipulator needs to be placed in the approximate area of the surgical area, the current position and target position of the manipulator (corresponding to the center position of the above target) are calculated based on the screen. Calculate the area that can cover the most targets at the same time and give the corresponding logo;
  • the optional calculation method is as follows: Assume that the maximum moving radius of the micro-manipulator from the stowed state to unfolding to a single direction under the current fixed conditions is x, where the value of The hardware parameters of the robotic arm are as follows;
  • FIG. 2 is a schematic diagram of the intersection of the motion plane of the micro-manipulator provided by the embodiment of the present invention and the target, as shown As shown in Figure 2, in order to move the micro-manipulator to the target trajectory, which is the line connecting the two points of the target, move the position B of the instrument held by the lower actuator arm to the target connection line B'.
  • B' is the intersection point of the plane where the lower actuator arm is located and the line connecting the two target points. Then the position A of the instrument held by the upper actuator arm is also moved to the above-mentioned connecting line A', where, A ′ is the intersection point of the plane where the upper actuator arm is located and the line connecting the two points of the target; the movement distance of the upper actuator arm is the movement of the mechanical arm, recorded as y′, and the movement of the upper actuator arm reaches the target when the lower actuator arm reaches The latter can be satisfied without too much consideration; and the moving distance of the lower actuator arm is the moving range of the mechanical arm mentioned above, which is x′. If x′ ⁇ x, it is considered to be included in the reachable range. target list;
  • the common intersection area of the circle formed by all targets is the area that can cover the most targets at the current position and posture of the micro-manipulator.
  • the common intersection areas of other circles are areas that can cover the corresponding targets at the same time;
  • Figure 3 is a schematic diagram of the common intersecting area of the circle formed by all targets provided by the embodiment of the present invention, as shown in Figure 3.
  • the dark area can cover the most area, while other areas cover relatively few targets.
  • Step 1.6 When moving the micro-manipulator, use the position mark attached to the micro-manipulator to move the micro-manipulator in real time.
  • the screen visually displays its position (circular dark area), and prompts the user based on the current position, the number of targets that the current micro-manipulator can cover, so that the user can understand the micro-manipulator and the above-mentioned target area that can be covered
  • the positional relationship guides the user to place the micro-manipulator to cover as many target areas as possible, and then fix it.
  • Step 2 Automatically move from the rough positioning position to the center position of a certain target
  • FIG. 4 is a schematic diagram of the micro manipulator provided by the embodiment of the present invention that has been aligned with the target 1. As shown in Figure 4, the micro manipulator has covered the target 1; during the movement of the micro manipulator, the position of the micro manipulator on the screen can be updated in real time. position (indicated by a dark circular area) to let the user know the progress of the movement and give prompts when the movement is in place.
  • the method for determining that the micro-manipulator has covered the target is as follows:
  • the current position and rotation vector are obtained according to the position sensor, and the angle difference and distance difference between the line connecting the two points of the target are calculated. If the angle difference and distance difference are less than a certain threshold (such as 0.3mm and 0.1 degrees), the micro-manipulator is considered to have covered the target.
  • a certain threshold such as 0.3mm and 0.1 degrees
  • Step 3 Move from the center of one target to the center of another target
  • the micro-manipulator When moving from one target to another, it is necessary to determine whether the position and posture of the micro-manipulator has changed since the last time the micro-manipulator was placed and locked. If the position has changed, it may have previously been considered that the micro-manipulator The initial placement area where the arm can cover multiple targets is no longer valid. At this time, it may not be possible to directly reach the corresponding target position through the automatic movement of the micro-manipulator. It is necessary to consider the possibility that the micro-manipulator is moving to a certain target position. Later, the position was artificially moved. In this case, although the rough fixation of the micro-manipulator at the beginning ensured that the micro-manipulator could reach several targets at the same time. However, due to human movement, the micro-manipulator may not be able to reach several targets that were previously thought to be reachable, so recalculation is required. In the specific implementation process, the following methods can be used:
  • Step (1) The position and posture of the micro manipulator at a certain target can be represented by a matrix C, which can be obtained based on the position and posture A of the micro manipulator in the stowed state combined with the movement posture of the micro manipulator itself.
  • Step (3) After obtaining the position and posture A, calculate the distance range of the movement posture from the position and posture A to the target that needs to be reached. If the movement distance and posture are within the one-directional movement range of the micro-manipulator starting from A, the micro-manipulator directly executes the corresponding movement posture instructions and reaches the corresponding target in one go. Otherwise, the corresponding target is considered unreachable. Pass The screen prompts that the micro-manipulator must return to the retracted state and perform rough positioning again.
  • FIG. 5 is a schematic diagram of a positioning and alignment device for a micro-manipulator provided by an embodiment of the present invention.
  • the positioning and alignment device of the micro manipulator includes: a first determination unit 52 , a second determination unit 54 , a first control unit 56 and a second control unit 58 .
  • the positioning and alignment device of the micro robotic arm will be described in detail below.
  • the first determination unit 52 is used to determine the initial posture of the micro-manipulator in the stowed state and the center positions of multiple targets, where the initial posture includes the initial position and the initial posture;
  • the second determination unit 54 is connected to the above-mentioned first determination unit 52 and is used to determine the target area of the micro-manipulator in the motion plane according to the initial position and the center positions of the multiple targets, where the target area is the instrument holder of the micro-manipulator.
  • the holding front end can reach the area of at least two targets when the micro manipulator is in the initial position;
  • the first control unit 56 is connected to the above-mentioned second determination unit 54 and is used to control the micro-manipulator to move from the initial position to a predetermined position in the target area and fix the micro-manipulator at the predetermined position, where the predetermined position is within the target area. any position;
  • the second control unit 58 is connected to the above-mentioned first control unit 56 and is used to control the micro-manipulator to convert from the stowed state to the unfolded state with the predetermined position as the base point, move to the center position of the reachable target in sequence, and control the reachable target. target to align.
  • the positioning and alignment device of the micro-manipulator is used to determine the initial posture of the micro-manipulator in the stowed state and the center positions of multiple targets, where the initial posture includes the initial position and the initial posture; Determine the target area of the micro-manipulator in the motion plane based on the initial position and the center positions of multiple targets, where the target area is that the instrument clamping front end of the micro-manipulator can reach at least two targets when the micro-manipulator is in the initial posture.
  • control the micro-manipulator to move from the initial position to a predetermined position in the target area, and fix the micro-manipulator at the predetermined position, where the predetermined position is any position within the target area; control the micro-manipulator to use the predetermined position as the base point by The folded state is converted to the unfolded state, and the system moves to the center of the reachable target in sequence, and aims at the reachable target.
  • the embodiment of the present invention needs to control the micro-manipulator to move to the target area of the motion plane, fix the micro-manipulator at a predetermined position, and then control the micro-manipulator to move to the center of the reachable target in sequence, thereby achieving
  • the micro-manipulator aligns multiple reachable targets, thereby solving the technical problem in related technologies that the positioning of the micro-manipulator requires frequent manual movement and fixation, resulting in increased application time and risk, and reduces the number of moves and fixations. , the technical effect of reducing application time and risk.
  • first determination unit 52 corresponds to steps S102 to S108 in the method embodiment, and the above-mentioned units are the same as the corresponding steps.
  • the implementation examples and application scenarios are the same, but are not limited to the content disclosed in the above method embodiments.
  • the above-mentioned first determination unit 52 includes: a detection module for detecting the position mark attached to the micro-manipulator when the micro-manipulator is in the stowed state; a first determination module for detecting the position according to the location of the micro-manipulator.
  • the mark determines the initial position and initial posture of the instrument clamping front end in the physical space coordinate system, and takes the initial position and initial posture as the initial posture.
  • the above-mentioned first determination unit 52 includes: a first acquisition module, used to acquire a planning image containing multiple targets; a registration module, used to compare the first marker point in the planning image with The second marker point in the physical space coordinate system is registered to obtain a registration matrix, in which the coordinates of the first marker point in the image coordinate system correspond to the coordinates of the second marker point in the physical space coordinate system; transformation The module is used to perform coordinate transformation on multiple targets according to the registration matrix, obtain the coordinates of multiple targets in the physical space coordinate system, and use the coordinates of the multiple targets in the physical space coordinate system as the center positions of the multiple targets.
  • the above-mentioned first acquisition module includes: a first acquisition sub-module for acquiring three-dimensional image data of multiple targets; and a first processing sub-module for processing multiple targets based on the three-dimensional image data. Perform planning to obtain a planning image, where the target in the planning image includes the instrument entry point and the target end point.
  • the above-mentioned second determination unit 54 includes: a second acquisition module, used to acquire the maximum movement radius of the micro-manipulator; and a second determination module, used to determine based on the motion plane of the micro-manipulator.
  • the above-mentioned first control unit 56 includes: a display module for displaying the initial position and the target area in real time; a first processing module for displaying the initial position and the target area of the miniature in real time.
  • the robotic arm moves from the initial position to a predetermined position in the target area.
  • the above-mentioned second control unit 58 includes: a fifth determination module, configured to determine, according to the movement plane of the micro-manipulator, the intersection point of the movement plane and target extension lines corresponding to at least two reachable targets, wherein the target extension The line is an extension line connecting the target instrument entry point and the target end point to form a line segment; the third acquisition module is used to acquire the movement path of the micro-manipulator, wherein the movement path of the micro-manipulator includes pairs of at least two targets that can be reached.
  • the alignment sequence is determined based on the distance between the predetermined position and each intersection point; the second processing module is used to control the micro-manipulator to move to the center position of the reachable target according to the movement path of the micro-manipulator.
  • the above-mentioned second processing module includes: a first determining sub-module for determining the micro The movement range of the manipulator arm required to move the manipulator arm to the center position of the reachable target; the second processing submodule is used to move the micro manipulator arm to the center position of the reachable target according to the movement range of the micro manipulator arm.
  • the above-mentioned second processing module also includes: a second acquisition sub-module, configured to acquire the The pose of the micro-manipulator after completing its movement; the second determination sub-module is used to determine the angle difference and distance difference between the target line segment and the pose, where the target line segment is the entry point of the instrument that can reach the target and the target end point connected into line segments; the third determination sub-module is used to determine that the micro-manipulator has reached the center position of the reachable target when the angle difference is less than the angle difference threshold and the distance difference is less than the distance difference threshold.
  • a second acquisition sub-module configured to acquire the The pose of the micro-manipulator after completing its movement
  • the second determination sub-module is used to determine the angle difference and distance difference between the target line segment and the pose, where the target line segment is the entry point of the instrument that can reach the target and the target end point connected into line segments
  • the third determination sub-module is used to determine that the micro-manipulator has reached the
  • the above-mentioned second control unit 58 also includes: a detection module for detecting whether the micro-manipulator is fixed in the target area after aligning the target reachable by the micro-manipulator; a third The processing module is used to control the micro-manipulator to move from the center position of the currently reachable target to the center position of the next reachable target when the micro-manipulator is fixed in the target area, and to control the next reachable target.
  • the target is aligned; the fourth processing module is used to return the micro-manipulator to the retracted state when the micro-manipulator is not fixed in the target area, and re-determine the target area of the micro-manipulator based on the remaining reachable targets.
  • Fix the micro-manipulator at a predetermined position in the target area control the micro-manipulator to convert from the stowed state to the unfolded state based on the predetermined position, move to the center position of the remaining reachable targets in sequence, and perform operations on the remaining reachable targets. alignment.
  • an electronic device including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform any of the above method steps .
  • a computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any of the above. The method steps of the item.
  • the above-mentioned computer-readable storage medium can be located in any computer terminal in the computer terminal group in the computer network, and/or in any mobile terminal in the mobile terminal group.
  • the above-mentioned computer-readable storage medium includes storage program of.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Robotics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

Des modes de réalisation de la présente invention divulguent un procédé et un appareil d'alignement de positionnement pour un bras micro-mécanique, et un dispositif électronique. Le procédé consiste à : déterminer une pose initiale du bras micro-mécanique dans un état plié et des positions centrales d'une pluralité de cibles, la pose initiale comprenant une position initiale et une posture initiale ; déterminer une zone cible du bras micro-mécanique dans un plan de mouvement en fonction de la position initiale et des positions centrales de la pluralité de cibles ; commander au bras micro-mécanique de se déplacer de la position initiale à une position prédéfinie de la zone cible, et fixer le bras micro-mécanique à la position prédéfinie ; et commander au bras micro-mécanique de passer de l'état plié à un état déplié en prenant la position prédéfinie en tant que point de base, de se déplacer successivement vers les positions centrales de cibles atteignables, et d'effectuer un alignement sur les cibles atteignables. La présente invention résout le problème technique selon lequel, un bras micro-mécanique dans l'état de la technique devant être fréquemment déplacé et fixé manuellement pour le positionnement, le temps d'application et le risque sont augmentés, et permet d'obtenir les effets techniques de réduction du nombre de temps de déplacement et de fixation et de réduction du temps d'application et du risque.
PCT/CN2023/109673 2022-07-29 2023-07-27 Procédé et appareil d'alignement de positionnement pour bras micro-mécanique, et dispositif électronique WO2024022459A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210902656.7A CN115153855B (zh) 2022-07-29 2022-07-29 一种微型机械臂的定位对准方法、装置及电子设备
CN202210902656.7 2022-07-29

Publications (1)

Publication Number Publication Date
WO2024022459A1 true WO2024022459A1 (fr) 2024-02-01

Family

ID=83476613

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/109673 WO2024022459A1 (fr) 2022-07-29 2023-07-27 Procédé et appareil d'alignement de positionnement pour bras micro-mécanique, et dispositif électronique

Country Status (2)

Country Link
CN (1) CN115153855B (fr)
WO (1) WO2024022459A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115153855B (zh) * 2022-07-29 2023-05-05 中欧智薇(上海)机器人有限公司 一种微型机械臂的定位对准方法、装置及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109310474A (zh) * 2016-09-19 2019-02-05 直观外科手术操作公司 用于远程可控臂的定位指示器系统和相关方法
CN109922750A (zh) * 2017-02-08 2019-06-21 直观外科手术操作公司 用于远程可控操纵器的重新定位系统和相关方法
CN112245011A (zh) * 2020-10-23 2021-01-22 微创（上海）医疗机器人有限公司 手术机器人系统、调整方法、存储介质及终端
WO2021224351A1 (fr) * 2020-05-05 2021-11-11 Ecential Robotics Système robotique chirurgical
CN113768640A (zh) * 2021-11-09 2021-12-10 极限人工智能有限公司 一种确定机械臂工作位姿的方法和装置
CN115153855A (zh) * 2022-07-29 2022-10-11 中欧智薇(上海)机器人有限公司 一种微型机械臂的定位对准方法、装置及电子设备

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012209769C5 (de) * 2012-06-12 2021-11-11 Kuka Deutschland Gmbh Verfahren zum Betreiben eines Roboters und Vorrichtung mit einem Roboter
EP3197646A4 (fr) * 2014-09-23 2018-06-06 Covidien LP Systèmes de support de bras robotique chirurgical, et procédés d'utilisation
US11141859B2 (en) * 2015-11-02 2021-10-12 Brainlab Ag Determining a configuration of a medical robotic arm
CA2917654C (fr) * 2016-01-14 2018-09-25 Synaptive Medical (Barbados) Inc. Systeme et methode de configuration de positions dans un systeme de positionnement chirurgical
CN106041941B (zh) * 2016-06-20 2018-04-06 广州视源电子科技股份有限公司 一种机械臂的轨迹规划方法及装置
US11166770B2 (en) * 2016-09-19 2021-11-09 Intuitive Surgical Operations, Inc. Base positioning system for a controllable arm and related methods
CA2977489C (fr) * 2017-08-28 2019-11-26 Synaptive Medical (Barbados) Inc. Bras de positionnement destine a un systeme de navigation chirurgicale
CN107813313A (zh) * 2017-12-11 2018-03-20 南京阿凡达机器人科技有限公司 机械臂运动的校正方法和装置
CN114449969A (zh) * 2019-09-30 2022-05-06 马科外科公司 用于引导工具的移动的系统和方法
CN111645079B (zh) * 2020-08-04 2020-11-10 天津滨电电力工程有限公司 一种带电作业机器人机械臂路径规划控制装置及其方法
CN112402020B (zh) * 2020-12-01 2022-02-22 北京天智航医疗科技股份有限公司 用于手术机器人机械臂的控制方法和装置、介质、设备
CN112618028B (zh) * 2021-01-06 2022-04-26 深圳市精锋医疗科技股份有限公司 手术机器人及其引导手术臂移动的方法、控制装置
AU2022205690A1 (en) * 2021-01-11 2023-07-27 Digital Surgery Systems, Inc. Registration degradation correction for surgical navigation procedures
CN112957125B (zh) * 2021-02-02 2022-07-29 哈尔滨思哲睿智能医疗设备有限公司 一种腔镜手术机器人的手术臂初始位姿规划方法及装置
CN113499137B (zh) * 2021-07-07 2022-07-12 南开大学 一种手术机器人导航定位系统及测量视角多目标优化方法
CN114559432B (zh) * 2022-03-02 2023-11-21 杭州柳叶刀机器人有限公司 手术机械臂自动定位寻路方法、装置、机器人及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109310474A (zh) * 2016-09-19 2019-02-05 直观外科手术操作公司 用于远程可控臂的定位指示器系统和相关方法
CN109922750A (zh) * 2017-02-08 2019-06-21 直观外科手术操作公司 用于远程可控操纵器的重新定位系统和相关方法
WO2021224351A1 (fr) * 2020-05-05 2021-11-11 Ecential Robotics Système robotique chirurgical
CN112245011A (zh) * 2020-10-23 2021-01-22 微创（上海）医疗机器人有限公司 手术机器人系统、调整方法、存储介质及终端
CN113768640A (zh) * 2021-11-09 2021-12-10 极限人工智能有限公司 一种确定机械臂工作位姿的方法和装置
CN115153855A (zh) * 2022-07-29 2022-10-11 中欧智薇(上海)机器人有限公司 一种微型机械臂的定位对准方法、装置及电子设备

Also Published As

Publication number Publication date
CN115153855B (zh) 2023-05-05
CN115153855A (zh) 2022-10-11

Similar Documents

Publication Publication Date Title
EP1215017B1 (fr) Dispositif d'apprentissage pour robot
US11890067B2 (en) Positioning arm for a surgical navigation system
WO2024022459A1 (fr) Procédé et appareil d'alignement de positionnement pour bras micro-mécanique, et dispositif électronique
CN108827154B (zh) 一种机器人无示教抓取方法、装置及计算机可读存储介质
US20090234502A1 (en) Apparatus for determining pickup pose of robot arm with camera
WO2016079967A1 (fr) Robot et système de robot
Iyer et al. A single arm, single camera system for automated suturing
CN113194862A (zh) 使用增强反射镜显示器设置外科机器人
WO2018043525A1 (fr) Système de robot, dispositif de commande de système de robot et procédé de commande de système de robot
JP2005300230A (ja) 計測装置
US20150134113A1 (en) Method for operating a robot
US20230347509A1 (en) Robot control apparatus, robot control method, and program
WO2023134237A1 (fr) Procédé, appareil et système d'étalonnage de système de coordonnées pour un robot, et support
Antonello et al. A fully automatic hand-eye calibration system
US20220000571A1 (en) System and method for assisting tool exchange
CN116459007A (zh) 手术机器人系统的机械臂构型确定方法、装置和设备
JP7392409B2 (ja) 設定装置、設定方法およびプログラム
JP2004009209A (ja) ロボットの教示装置
JPH0847881A (ja) ロボットの遠隔操作方法
JPH10264065A (ja) ロボットの遠隔操作支援装置
JP2002307346A (ja) ロボットの視覚座標校正方法および装置
US20230249341A1 (en) Robot teaching method and robot working method
CN115869069A (zh) 手术机器人控制方法、装置、设备、介质及系统
JPH0675617A (ja) カメラ視点変更方式
JP7372161B2 (ja) マニピュレータ、自動化方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23845664

Country of ref document: EP

Kind code of ref document: A1