WO2023000560A1 - Reduction trajectory automatic planning method for parallel fracture surgical robot - Google Patents

Reduction trajectory automatic planning method for parallel fracture surgical robot Download PDF

Info

Publication number
WO2023000560A1
WO2023000560A1 PCT/CN2021/131067 CN2021131067W WO2023000560A1 WO 2023000560 A1 WO2023000560 A1 WO 2023000560A1 CN 2021131067 W CN2021131067 W CN 2021131067W WO 2023000560 A1 WO2023000560 A1 WO 2023000560A1
Authority
WO
WIPO (PCT)
Prior art keywords
bone model
node
model
distal bone
trajectory
Prior art date
Application number
PCT/CN2021/131067
Other languages
French (fr)
Chinese (zh)
Inventor
孙涛
李锦龙
刘传耙
连宾宾
宋轶民
Original Assignee
天津大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 天津大学 filed Critical 天津大学
Publication of WO2023000560A1 publication Critical patent/WO2023000560A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/215Motion-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2119/00Details relating to the type or aim of the analysis or the optimisation
    • G06F2119/14Force analysis or force optimisation, e.g. static or dynamic forces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30008Bone
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30241Trajectory

Definitions

  • the invention relates to an automatic reset trajectory planning method, in particular to an automatic reset trajectory planning method for a parallel fracture surgery robot.
  • Traditional fracture reduction surgery needs to expose the bone tissue through a large incision, and the doctor restores the anatomical position of the fracture under direct vision.
  • Traditional reduction methods are limited by physician experience and intraoperative equipment, and there are risks such as large trauma, susceptibility to infection, and secondary fractures.
  • Parallel robot-assisted fracture reduction means that the doctor uses computer-aided software to plan the reset trajectory of the broken bone, and based on the robot kinematics algorithm, maps the reset trajectory of the broken bone to the robot's motion trajectory, and the robot executes the above trajectory to achieve the purpose of fracture reduction .
  • fracture reduction trajectory planning is a key link. Its purpose is to find an optimal trajectory, avoid collisions between bone fragments during the reduction process, reduce damage to soft tissues such as muscles, and enable the fractured bone fragments to be safely and accurately to its anatomical location.
  • the existing fracture reduction trajectory planning methods can be divided into two categories: interactive and automatic.
  • the interactive trajectory planning method means that the doctor uses the mouse or keyboard to adjust the position and posture of the broken bone fragments, and artificially designate the reset trajectory of the bone fragments. This type of method is mainly implemented by doctors. Due to the different experience of doctors, the generated trajectories are very different.
  • the automatic trajectory planning method the computer uses relevant algorithms to automatically generate the reset trajectory of the bone block.
  • the existing automatic trajectory planning methods have problems such as low collision detection accuracy, long reset path, and large muscle pulling force, and cannot obtain safe and effective fractures. Reset track.
  • the purpose of the present invention is to overcome the shortcomings of the prior art, to provide an automatic planning method for the reset trajectory of a parallel fracture surgery robot, to avoid the collision of bone blocks during the reset operation, to reduce the damage to soft tissues such as muscles, and to effectively improve fracture reduction. accuracy and efficiency.
  • the present invention adopts the following technical solutions:
  • the present invention is oriented towards an automatic reset trajectory planning method for a parallel fracture surgery robot, comprising the following steps:
  • (1a) scan and obtain the CT data of the fracture patient, utilize the ITK tool kit to segment the bone fragments from the CT data, and the described bone fragments include distal bone, proximal bone and healthy side bone;
  • (3a) respectively import the distal bone model and the proximal bone model into the three-dimensional virtual scene built by VTK;
  • step (4b) Use the ICP algorithm to obtain the conversion matrix between the patient's bone model after step (2e) and the standard skeletal muscle model obtained through step (4a), and then replace the standard skeletal muscle model with the reset one Patient bone model, and set the fixed connection relationship between the muscle attachment point and the distal bone model and the proximal bone model. If the muscle attachment point is close to the distal bone model, it is stipulated that the muscle attachment point is fixedly connected with the distal bone model; On the contrary, it is stipulated that the muscle attachment point is fixedly connected with the proximal bone model;
  • g(N i ) is the cost of moving the origin of the distal bone model coordinate system from the initial node N 1 to node N i ; h(N i ) indicates that the origin of the distal bone model coordinate system moves from node N i to the target node N
  • the cost of t ; r(N i ) c 1
  • is the attitude penalty function, which represents the cost required for the distal bone model coordinate system to rotate from the current node N i to the target node N t
  • c 1 is Correlation penalty coefficient
  • the trajectory nodes N 1 (0,0,0,0) and N t (O xt ,O xt ,O xt , ⁇ t ) set in step (5a) are used as the trajectory respectively planning start node and end node, and optimize the reset trajectory node according to the evaluation function f(N i ) set in step (5b), in the optimization process, use the method in step (3) to select all neighbors of N c
  • the domain nodes perform collision detection, and the reset trajectory node sequence N 2 , ⁇ ,N t-1 is optimized, and then the trajectory node N i (O xi ,O yi ,O zi , ⁇ i ) and the distal bone pose T According to the corresponding relationship between i , the optimized reset trajectory node sequence N 2 , ⁇ ,N t-1 is converted into the pose of the distal bone model to complete the fracture reduction trajectory planning.
  • the beneficial effects of the present invention are: the use of the collision detection method avoids the collision between the fractured bone fragments in the reset process, reduces the excessive pulling of the muscles through the OpenSim muscle force simulation, and shortens the fracture reduction path based on the improved A* search algorithm And improve the efficiency of trajectory planning.
  • Fig. 1 is the overall flow chart of the automatic planning method for the reset trajectory of the parallel fracture surgery robot of the present invention
  • Fig. 2 is a flow chart of fracture model acquisition
  • Figure 3 is a flow chart of the definition of the fracture initial and target poses
  • Fig. 4 is a schematic diagram of fracture reduction target extraction
  • Fig. 5 is a collision detection flowchart
  • Fig. 6 is a schematic diagram of CT image voxel size
  • Fig. 7 is a schematic diagram of the definition of the collision detection threshold
  • Fig. 8 is a schematic diagram of the OpenSim standard skeletal muscle model
  • Fig. 9 is a flow chart of muscle force analysis
  • Figure 10a is a schematic diagram of the patient's bone model and the standard bone model before replacement
  • Figure 10b is a schematic diagram of the patient's bone model and the standard bone model after replacement
  • Fig. 11 is a flow chart of fracture reduction track node optimization.
  • the automatic reset trajectory planning method for parallel fracture surgical robots of the present invention includes the following steps:
  • ITK Insight Segmentation and Registration Toolkit
  • the pose of the world coordinate system represents the pose T i of the distal bone model, and changes in the value of i correspond to changes in the pose of the distal bone model.
  • (3b) Calculate the shortest distance l between the proximal bone model and the distal bone model based on an octree search algorithm.
  • the size of the voxel is determined by the CT scanning accuracy. Assuming that the CT scanning accuracy is a ⁇ b ⁇ c, as shown in Figure 6, the maximum side length s max of the triangular surface can be obtained as:
  • the accuracy of CT scanning is generally 1mm ⁇ 1mm ⁇ 0.625mm, and the threshold of collision occurrence is 0.893mm.
  • the surface of the three-dimensional model of the distal bone and the proximal bone is composed of several triangular faces. If the bone blocks collide and the distal bone and the proximal bone interfere, there must be two or more intersecting triangular faces. If l>l', there will be no collision between the distal bone and the proximal bone; if l ⁇ l', there is a risk of collision between the distal bone and the proximal bone.
  • the construction parameters include geometry, mass, center of mass, joint position, muscle attachment points, and muscle parameters, etc.
  • the scaling factor is calculated as follows:
  • L i and L' i represent the distance between the individualized bone model and a certain pair of anatomical landmarks (such as the tip of the inner and outer malleolus) in the standard bone model after the reset is completed, and k represents the group number of the selected anatomical landmarks .
  • the joint parameters d x , d y , d z , ⁇ , ⁇ , ⁇ can be obtained; the joint parameters d x , d y , d z , ⁇ , ⁇ , ⁇
  • the OpenSim software outputs the pulling force of each muscle corresponding to the pose T i .
  • t T i is the pose matrix of the coordinate system O i -xi y i z i relative to the coordinate system O t -x t y t z t
  • t R i is the pose matrix of t T i
  • the axis n is the rotation axis of the distal bone model, the axis n remains unchanged during the rotation of the distal bone model from the initial pose to the target pose, so the direction of the axis n can be calculated by the following formula:
  • R t is the attitude matrix of T t .
  • the component ⁇ i of the trajectory node N i is calculated as follows:
  • R i is the attitude matrix of matrix T i
  • n ⁇ represents the anti-symmetric matrix of vector n
  • I is the identity matrix
  • g(N i ) is the cost of moving the origin of the distal bone model coordinate system from the initial node N 1 to node N i ; h(N i ) indicates that the origin of the distal bone model coordinate system moves from node N i to the target node N
  • the cost of t ; r(N i ) c 1
  • is the attitude penalty function, which represents the cost required for the distal bone model coordinate system to rotate from the current node N i to the target node N t
  • c 1 is Correlation penalty coefficient
  • the trajectory nodes N 1 (0,0,0,0) and N t (O xt ,O xt ,O xt , ⁇ t ) set in step (5a) are used as the trajectory respectively planning start node and end node, and optimize the reset trajectory node according to the evaluation function f(N i ) set in step (5b), in the optimization process, use the method in step (3) to select all neighbors of N c
  • the domain nodes perform collision detection, and the reset trajectory node sequence N 2 , ⁇ ,N t-1 is optimized, and then the trajectory node N i (O xi ,O yi ,O zi , ⁇ i ) and the distal bone pose T According to the corresponding relationship between i , the optimized reset trajectory node sequence N 2 , ⁇ ,N t-1 is converted into the pose of the distal bone model to complete the fracture reduction trajectory planning.
  • Step1 Define empty tables open and close, and insert the start node N 1 of the reset trajectory into the open table.
  • Step2 Determine whether the open table is empty, if open is empty, end the search; if it is not empty, find the node N c (O xc ,O xc ,O xc , ⁇ c ) with the smallest value of the evaluation function in the open table, record as the current node, then delete the node from the open table and insert it into the close table.
  • Step3 The neighbor node of the current node N c in the close table is N c+1 , and then use the method in step (5a) to map N c+1 to the pose of the distal bone model, and use the method in step (3)
  • the method performs collision detection on all neighborhood nodes of N c , and defines the collection of non-collided nodes as a child table;
  • Step4 Traverse each node N j in the child table, and calculate the new evaluation function value of node N j when N c is the parent node; if the open table contains node N j , and the new evaluation function value of node N j is smaller than the old value value of the evaluation function, then set the parent node of N j to N c ; if the open table does not contain node N j , set the parent node of N j to N c , and add N j to the open table.
  • Step5 Determine whether the end node N t is included in the open table, if so, terminate the search process, and execute Step6, otherwise return to Step2 and execute again.
  • Step6 When the target node N t is searched, it means that the trajectory planning is completed. Starting from the terminal node N t , the parent node is continuously searched upward until the parent node is the starting node N 1. N 1 , N 2 , ... N t together constitute the trajectory node of fracture reduction, and the above nodes are transformed into The pose of the distal bone model can be used to complete the fracture reduction trajectory planning.
  • the invention utilizes the collision detection technology to avoid the collision between broken bone blocks in the reset process, reduces the excessive pulling of the muscles through the OpenSim muscle force simulation, shortens the fracture reset path and improves the trajectory planning based on the improved A* search algorithm s efficiency. Therefore, an automatic reset trajectory planning method for a parallel fracture surgery robot of the present invention can meet the needs of clinical fracture reduction surgery.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • Geometry (AREA)
  • General Engineering & Computer Science (AREA)
  • Manipulator (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Disclosed in the present invention is a reduction trajectory automatic planning method for a parallel fracture surgical robot. The method comprises: on the basis of a CT image of a patient, obtaining a distal bone model, a proximal bone model and an intact-side bone model by means of three-dimensional reconstruction; acquiring a fracture reduction goal by taking the intact-side bone model of the patient as a reduction reference; defining a collision detection threshold, and searching for the minimum distance point between fractured bones on the basis of an octree search algorithm, so as to realize fractured bone collision detection; establishing a personalized fracture muscle model on the basis of an OpenSim standard model, and acquiring a muscle traction force in the reduction process; and designing a trajectory search node and an evaluation function of an A* algorithm by taking no collision, the minimum muscle traction force and the shortest path as goals, thereby realizing trajectory planning. By means of the method in the present invention, the collision between fractured bone blocks is prevented, the excessive traction of a muscle is reduced, and a fracture reduction path is shortened on the basis of an improved A* search algorithm, thereby improving a fracture reduction effect.

Description

面向并联骨折手术机器人的复位轨迹自动式规划方法Automatic reset trajectory planning method for parallel fracture surgery robot 技术领域technical field
本发明涉及复位轨迹自动式规划方法,尤其涉及一种面向并联骨折手术机器人的复位轨迹自动式规划方法。The invention relates to an automatic reset trajectory planning method, in particular to an automatic reset trajectory planning method for a parallel fracture surgery robot.
背景技术Background technique
传统骨折复位手术需要通过大切口的方式暴露骨组织,在直视条件下由医师恢复骨折断端的解剖位置。传统复位方法受制于医师经验和术中设备,存在创伤大、易感染、二次骨折等风险。Traditional fracture reduction surgery needs to expose the bone tissue through a large incision, and the doctor restores the anatomical position of the fracture under direct vision. Traditional reduction methods are limited by physician experience and intraoperative equipment, and there are risks such as large trauma, susceptibility to infection, and secondary fractures.
随着机器人技术和计算机信息技术与骨科医学的交叉融合中,基于并联机器人的骨折复位手术被普遍认为是实现骨折精准安全复位的优势方案。并联机器人凭借其微创、高精度等优点,能够有效解决传统复位手术的缺陷。With the integration of robotics, computer information technology and orthopedic medicine, fracture reduction surgery based on parallel robots is generally considered to be an advantageous solution to achieve precise and safe fracture reduction. With its advantages of minimal invasiveness and high precision, parallel robots can effectively solve the defects of traditional reduction surgery.
并联机器人辅助骨折复位是指医师利用计算机辅助软件对断骨的复位轨迹进行规划,并基于机器人运动学算法将断骨的复位轨迹映射为机器人的运动轨迹,机器人执行上述轨迹进而达到骨折复位的目的。上述过程中,骨折复位轨迹规划是关键环节,其目的在于寻找一条最优的轨迹,避免复位过程中骨块间的碰撞,减小对肌肉等软组织的损伤,使断骨骨块能够安全精准的到达其解剖位置。Parallel robot-assisted fracture reduction means that the doctor uses computer-aided software to plan the reset trajectory of the broken bone, and based on the robot kinematics algorithm, maps the reset trajectory of the broken bone to the robot's motion trajectory, and the robot executes the above trajectory to achieve the purpose of fracture reduction . In the above process, fracture reduction trajectory planning is a key link. Its purpose is to find an optimal trajectory, avoid collisions between bone fragments during the reduction process, reduce damage to soft tissues such as muscles, and enable the fractured bone fragments to be safely and accurately to its anatomical location.
现有的骨折复位轨迹规划方法可分为交互式和自动式两类。交互式轨迹规划方法指医师利用鼠标或键盘调整断骨骨块的位置和姿态,人为指定骨块的复位轨迹。该类方法主要依靠医生实现,由于医生经验不同,生成的轨迹存在很大差异。自动式轨迹规划方法由计算机采用相关算法自动生成骨块的复位轨迹,现有的自动式轨迹规划方法存在碰撞检测精度低、复位路径长以及肌肉牵拉力大等问题,无法获得安全有效的骨折复位轨迹。The existing fracture reduction trajectory planning methods can be divided into two categories: interactive and automatic. The interactive trajectory planning method means that the doctor uses the mouse or keyboard to adjust the position and posture of the broken bone fragments, and artificially designate the reset trajectory of the bone fragments. This type of method is mainly implemented by doctors. Due to the different experience of doctors, the generated trajectories are very different. In the automatic trajectory planning method, the computer uses relevant algorithms to automatically generate the reset trajectory of the bone block. The existing automatic trajectory planning methods have problems such as low collision detection accuracy, long reset path, and large muscle pulling force, and cannot obtain safe and effective fractures. Reset track.
综上所述,现有的骨折复位轨迹规划方法难以满足骨折临床手术的迫切需求。In summary, the existing fracture reduction trajectory planning methods are difficult to meet the urgent needs of fracture clinical surgery.
发明内容Contents of the invention
本发明的目的在于克服已有技术的缺点,提供一种面向并联骨折手术机器人的复位轨迹自动化规划方法,避免复位手术过程中骨块的碰撞,减小对肌肉等软组织的损伤,有效提高骨折复位的精度和效率。The purpose of the present invention is to overcome the shortcomings of the prior art, to provide an automatic planning method for the reset trajectory of a parallel fracture surgery robot, to avoid the collision of bone blocks during the reset operation, to reduce the damage to soft tissues such as muscles, and to effectively improve fracture reduction. accuracy and efficiency.
为达到上述目的,本发明采用下述技术方案:To achieve the above object, the present invention adopts the following technical solutions:
本发明面向并联骨折手术机器人的复位轨迹自动式规划方法,包括以下步骤:The present invention is oriented towards an automatic reset trajectory planning method for a parallel fracture surgery robot, comprising the following steps:
(1)获取患者的三维骨折模型,具体步骤为:(1) Obtain the three-dimensional fracture model of the patient, the specific steps are:
(1a)扫描并获取骨折患者的CT数据,利用ITK工具包从CT数据中分割出骨块,所述的骨块包括远端骨、近端骨以及健侧骨;(1a) scan and obtain the CT data of the fracture patient, utilize the ITK tool kit to segment the bone fragments from the CT data, and the described bone fragments include distal bone, proximal bone and healthy side bone;
(1b)利用VTK工具包封装的移动立方体算法对分割后的骨块进行三维重建,并将重建结果存储为二进制的STL网格模型,得到远端骨模型、近端骨模型以及健侧骨模型;各个模型表面由若干个三角面片构成;(1b) Use the moving cube algorithm encapsulated in the VTK toolkit to perform 3D reconstruction of the segmented bone block, and store the reconstruction result as a binary STL mesh model to obtain the distal bone model, proximal bone model and uninjured bone model ;Each model surface is composed of several triangle faces;
(2)定义远端骨复位的初始位姿和目标位姿,为后续的轨迹规划提供初始和目标节点,具体步骤为:(2) Define the initial pose and target pose of the distal bone reset, and provide the initial and target nodes for subsequent trajectory planning. The specific steps are:
(2a)利用VTK建立虚拟三维场景,分别导入远端骨模型、近端骨模型和健侧骨模型,初始导入状态下,各模型的模型坐标系均与三维虚拟场景的世界坐标系重合;(2a) Use VTK to build a virtual 3D scene, and import the distal bone model, proximal bone model, and uninjured bone model respectively. In the initial import state, the model coordinate systems of each model coincide with the world coordinate system of the 3D virtual scene;
(2b)定义远端骨模型的模型坐标系为O i-x iy iz i,i=1,2,···,t,利用坐标系O i-x iy iz i相对于世界坐标系的位姿表示远端骨模型的位姿T i,i取值的变化对应远端骨模型位姿的变化;当i=1时,远端骨模型的模型坐标系与世界坐标系重合,即初始状态下远端骨模型的位姿为单位矩阵T 1;当i=t时,远端骨模型的位姿T t即为所求的目标位姿; (2b) Define the model coordinate system of the distal bone model as O i -xi y i z i , i =1,2,...,t, and use the coordinate system O i -xi y i z i relative to the world The pose of the coordinate system represents the pose T i of the distal bone model, and the change in the value of i corresponds to the change of the pose of the distal bone model; when i=1, the model coordinate system of the distal bone model coincides with the world coordinate system , that is, the pose of the distal bone model in the initial state is the identity matrix T 1 ; when i=t, the pose T t of the distal bone model is the desired target pose;
(2c)以三维虚拟场景中的XZ平面为基准面,对健侧骨模型进行镜像变换;(2c) Taking the XZ plane in the three-dimensional virtual scene as a reference plane, performing mirror transformation on the bone model of the healthy side;
(2d)固定近端骨模型,利用ICP算法获取近端骨模型与镜像后的健侧骨模型之间的变换矩阵,使近端骨模型和镜像后的健侧骨模型重合;(2d) fix the proximal bone model, use the ICP algorithm to obtain the transformation matrix between the proximal bone model and the mirrored healthy side bone model, so that the proximal bone model and the mirrored healthy side bone model overlap;
(2e)固定镜像后的健侧骨模型,利用ICP算法获取远端骨模型和镜像后的健侧骨模型间的变换矩阵,使镜像后的健侧骨模型和远端骨模型重合;此时远端骨模型到达复位状态,读取远端骨模型的位姿T t,T t即为目标位姿; (2e) Fix the mirrored bone model of the healthy side, and use the ICP algorithm to obtain the transformation matrix between the distal bone model and the mirrored healthy side bone model, so that the mirrored healthy side bone model and the distal bone model overlap; at this time The distal bone model reaches the reset state, read the pose T t of the distal bone model, and T t is the target pose;
(3)对骨折处复位过程中远端骨模型和近端骨模型进行干涉分析,具体步骤为:(3) Perform interference analysis on the distal bone model and the proximal bone model during the fracture reduction process, the specific steps are:
(3a)在VTK搭建的三维虚拟场景中分别导入远端骨模型和近端骨模型;(3a) respectively import the distal bone model and the proximal bone model into the three-dimensional virtual scene built by VTK;
(3b)基于八叉树搜索算法,计算近端骨模型与远端骨模型间的最近距离l;(3b) Based on the octree search algorithm, calculate the shortest distance l between the proximal bone model and the distal bone model;
(3c)通过截取CT图像的体元获得构成各个模型的三角面片,然后计算得到复位过程中远端骨模型和近端骨模型发生碰撞的检测阈值l′;(3c) Obtain the triangular faces that constitute each model by intercepting the voxels of the CT image, and then calculate the detection threshold l' for the collision between the distal bone model and the proximal bone model during the reset process;
(3d)依据距离l判断远端骨模型与近端骨模型是否存在碰撞的风险,若l>l′,远端骨和近端骨一定不会发生碰撞;若l≤l′,远端骨和近端骨间存在碰撞的风险;(3d) Judging whether there is a risk of collision between the distal bone model and the proximal bone model based on the distance l, if l>l', the distal bone and the proximal bone will not collide; if l≤l', the distal bone model There is a risk of collision with the proximal bone;
(4)利用OpenSim软件提供的标准肌肉骨骼模型获取复位过程中各条肌肉的牵拉力 大小,具体步骤为:(4) Utilize the standard musculoskeletal model provided by OpenSim software to obtain the pulling force of each muscle in the reset process, and the specific steps are:
(4a)根据OpenSim标准骨模型与复位完成后患者骨模型解剖标志点间的拓扑关系,计算缩放系数s,然后利用缩放系数s对标准骨模型的构建参数进行缩放,得到与患者骨模型大小相近的标准骨骼肌肉模型;(4a) Calculate the scaling factor s according to the topological relationship between the OpenSim standard bone model and the anatomical landmarks of the patient's bone model after the reset, and then use the scaling factor s to scale the construction parameters of the standard bone model to obtain a bone model that is similar in size to the patient's The standard skeletal muscle model;
(4b)利用ICP算法,获取经过步骤(2e)完成复位后的患者骨模型与经过步骤(4a)获得的标准骨骼肌肉模型之间的转换矩阵,进而将标准骨骼肌肉模型替换为完成复位后的患者骨模型,并设置肌肉附着点和远端骨模型以及近端骨模型之间的固联关系,若肌肉附着点靠近远端骨模型,则规定该肌肉附着点与远端骨模型固联;反之,则规定该肌肉附着点与近端骨模型固联;(4b) Use the ICP algorithm to obtain the conversion matrix between the patient's bone model after step (2e) and the standard skeletal muscle model obtained through step (4a), and then replace the standard skeletal muscle model with the reset one Patient bone model, and set the fixed connection relationship between the muscle attachment point and the distal bone model and the proximal bone model. If the muscle attachment point is close to the distal bone model, it is stipulated that the muscle attachment point is fixedly connected with the distal bone model; On the contrary, it is stipulated that the muscle attachment point is fixedly connected with the proximal bone model;
(4c)首先,利用OpenSim软件的C++API接口,在三维虚拟场景中,建立远端骨模型和近端骨模型之间的六自由度关节,该六自由度关节具有沿O t-x ty tz t坐标轴x t、y t、z t的三个平移自由度和绕坐标轴x t、y t、z t的三个旋转自由度;其次,建立远端骨模型沿坐标轴x t、y t、z t平移的距离d x、d y、d z以及远端骨模型绕坐标轴x t、y t、z t旋转的角度α、β、γ与远端骨模型的位姿T i的关系式;最后,以T 1作为初始状态下远端骨模型的位姿,T t为目标位姿,模拟远端骨模型相对于近端骨模型的运动;若已知远端骨模型的位姿T i,则能够得到关节参数d x、d y、d z、α、β、γ;将关节参数d x、d y、d z、α、β、γ作为OpenSim软件的输入,则OpenSim软件输出与位姿T i相对应的各条肌肉的牵拉力大小; (4c) First, use the C++ API interface of OpenSim software to establish a six-degree-of-freedom joint between the distal bone model and the proximal bone model in the three-dimensional virtual scene. The six-degree-of-freedom joint has t y t z t coordinate axis x t , y t , z t three translation degrees of freedom and three rotation degrees of freedom around the coordinate axis x t , y t , z t ; secondly, establish the distal bone model along the coordinate axis The translational distance d x , d y , d z of x t , y t , z t and the angle α, β, γ of the rotation of the distal bone model around the coordinate axes x t , y t , z t and the position of the distal bone model The relational expression of pose T i ; finally, take T 1 as the pose of the distal bone model in the initial state, and T t as the target pose, to simulate the movement of the distal bone model relative to the proximal bone model; if the distal bone model is known T i of the bone model, the joint parameters d x , d y , d z , α, β, γ can be obtained; the joint parameters d x , d y , d z , α, β, γ are used as the input of the OpenSim software , then the OpenSim software outputs the pulling force of each muscle corresponding to the pose T i ;
(5)在A*算法原有执行流程的基础上,融合步骤(3)的碰撞检测方法和步骤(4)的肌肉力分析方法,通过对A*算法的轨迹节点和估价函数的重新设计,进行骨折复位轨迹规划,具体步骤为:(5) On the basis of the original execution process of the A* algorithm, the collision detection method in step (3) and the muscle force analysis method in step (4) are combined, and the trajectory nodes and evaluation functions of the A* algorithm are redesigned, Perform fracture reduction trajectory planning, the specific steps are:
(5a)定义与远端骨模型位姿T i一一对应的轨迹节点N i(O xi,O yi,O zii)(i=1,2,···,t),轨迹节点N i的分量O xi、O yi、O zi分别为坐标系O i-x iy iz i坐标原点O i的x、y、z分量,分量θ i表示远端骨模型绕远端骨模型的轴线n逆时针旋转的角度; (5a) Define the trajectory node N i (O xi ,O yi ,O zii )(i=1,2,···,t) corresponding to the pose T i of the distal bone model one-to-one, the trajectory node The components O xi , O yi , and O zi of N i are the x, y, and z components of the origin O i of the coordinate system O i -xi y i z i respectively , and the component θ i indicates that the distal bone model revolves around the The angle by which the axis n rotates counterclockwise;
(5b)结合骨折复位轨迹无碰撞、路径最短以及肌肉牵拉力最小的约束条件,将A*算法的估价函数定义为:(5b) Combining the constraints of no collision, the shortest path, and the smallest muscle pulling force on the fracture reduction trajectory, the evaluation function of the A* algorithm is defined as:
Figure PCTCN2021131067-appb-000001
Figure PCTCN2021131067-appb-000001
其中,g(N i)为远端骨模型坐标系原点从初始节点N 1运动到节点N i的代价;h(N i)表示远端骨模型坐标系原点从节点N i移动至目标节点N t的代价;r(N i)=c 1it|为姿态惩罚函数,表示远端骨模型坐标系从当前节点N i旋转至目标节点N t所需的代价,c 1为相关惩罚系数,c 1的取值应使r(N i)与g(N i)、h(N i)、m(N i)有相同的数量级;m(N i)=c 2(F i-F 1)为肌肉力惩罚函数,F i(i=1,2,···,t)表示远端骨模型位于轨迹节点N i时各肌肉力的代数和,其中,F i(i=1,2,···,t)为利用步骤(5a)中的方法将节点N i映射为远端骨模型的位姿T i,然后采用步骤(4c)中的方法获得的各肌肉力的代数和;c 2为相关惩罚系数,c 2的取值应使m(N i)与g(N i)、h(N i)、r(N i)有相同的数量级; Among them, g(N i ) is the cost of moving the origin of the distal bone model coordinate system from the initial node N 1 to node N i ; h(N i ) indicates that the origin of the distal bone model coordinate system moves from node N i to the target node N The cost of t ; r(N i )=c 1it | is the attitude penalty function, which represents the cost required for the distal bone model coordinate system to rotate from the current node N i to the target node N t , and c 1 is Correlation penalty coefficient, the value of c 1 should make r(N i ) have the same order of magnitude as g(N i ), h(N i ), m(N i ); m(N i )=c 2 (F i -F 1 ) is the muscle force penalty function, F i (i=1,2,...,t) represents the algebraic sum of the muscle forces when the distal bone model is located at the trajectory node N i , where F i (i= 1,2,···,t) use the method in step (5a) to map the node N i to the pose T i of the distal bone model, and then use the method in step (4c) to obtain the muscle force Algebraic sum; c 2 is the correlation penalty coefficient, the value of c 2 should make m(N i ) have the same order of magnitude as g(N i ), h(N i ), r(N i );
(5c)基于改进A*搜索算法,分别以步骤(5a)设定的轨迹节点N 1(0,0,0,0)和N t(O xt,O xt,O xtt)作为轨迹规划的起始节点和终点节点,并根据步骤(5b)设定的估价函数f(N i)对复位轨迹节点进行优选,在优选过程中采用步骤(3)中的方法对N c所有的邻域节点进行碰撞检测,优选出复位轨迹节点序列N 2,···,N t-1,然后由轨迹节点N i(O xi,O yi,O zii)和远端骨位姿T i之间的对应关系,将优选出的复位轨迹节点序列N 2,···,N t-1转换为远端骨模型的位姿,完成骨折复位轨迹规划。 (5c) Based on the improved A* search algorithm, the trajectory nodes N 1 (0,0,0,0) and N t (O xt ,O xt ,O xtt ) set in step (5a) are used as the trajectory respectively planning start node and end node, and optimize the reset trajectory node according to the evaluation function f(N i ) set in step (5b), in the optimization process, use the method in step (3) to select all neighbors of N c The domain nodes perform collision detection, and the reset trajectory node sequence N 2 ,···,N t-1 is optimized, and then the trajectory node N i (O xi ,O yi ,O zii ) and the distal bone pose T According to the corresponding relationship between i , the optimized reset trajectory node sequence N 2 ,···,N t-1 is converted into the pose of the distal bone model to complete the fracture reduction trajectory planning.
本发明的有益效果是:利用碰撞检测方法避免了复位过程中断骨骨块间的碰撞,通过OpenSim肌肉力仿真减小了对肌肉的过分牵拉,基于改进的A*搜索算法缩短了骨折复位路径以及提高了轨迹规划的效率。The beneficial effects of the present invention are: the use of the collision detection method avoids the collision between the fractured bone fragments in the reset process, reduces the excessive pulling of the muscles through the OpenSim muscle force simulation, and shortens the fracture reduction path based on the improved A* search algorithm And improve the efficiency of trajectory planning.
附图说明Description of drawings
图1是本发明的面向并联骨折手术机器人的复位轨迹自动式规划方法整体流程图;Fig. 1 is the overall flow chart of the automatic planning method for the reset trajectory of the parallel fracture surgery robot of the present invention;
图2是骨折模型获取流程图;Fig. 2 is a flow chart of fracture model acquisition;
图3是骨折初始与目标位姿的定义流程图;Figure 3 is a flow chart of the definition of the fracture initial and target poses;
图4是骨折复位目标提取示意图;Fig. 4 is a schematic diagram of fracture reduction target extraction;
图5是碰撞检测流程图;Fig. 5 is a collision detection flowchart;
图6是CT图像体元大小示意图;Fig. 6 is a schematic diagram of CT image voxel size;
图7是碰撞检测阈值定义示意图;Fig. 7 is a schematic diagram of the definition of the collision detection threshold;
图8是OpenSim标准骨骼肌肉模型示意图;Fig. 8 is a schematic diagram of the OpenSim standard skeletal muscle model;
图9是肌肉力分析流程图;Fig. 9 is a flow chart of muscle force analysis;
图10a是替换前的患者骨模型与标准骨模型示意图;Figure 10a is a schematic diagram of the patient's bone model and the standard bone model before replacement;
图10b是替换后的患者骨模型与标准骨模型示意图;Figure 10b is a schematic diagram of the patient's bone model and the standard bone model after replacement;
图11是骨折复位轨迹节点优选流程图。Fig. 11 is a flow chart of fracture reduction track node optimization.
具体实施方式detailed description
下面结合附图,对本发明的具体实施方式进行详细说明。The specific implementation manners of the present invention will be described in detail below in conjunction with the accompanying drawings.
参见附图,本发明的面向并联骨折手术机器人的复位轨迹自动式规划方法,包括以下步骤:Referring to the accompanying drawings, the automatic reset trajectory planning method for parallel fracture surgical robots of the present invention includes the following steps:
(1)获取患者的三维骨折模型,为后续步骤提供数据源,具体步骤为:(1) Obtain the patient's three-dimensional fracture model and provide a data source for the subsequent steps. The specific steps are:
(1a)扫描并获取骨折患者的CT数据,利用ITK(Insight Segmentation and Registration Toolkit)工具包从CT数据中分割出骨块,所述的骨块包括远端骨(断骨的近端)、近端骨(断骨的远端)以及健侧骨(未发生骨折的一侧)。(1a) Scan and obtain the CT data of the fracture patient, use the ITK (Insight Segmentation and Registration Toolkit) toolkit to segment the bone fragments from the CT data, and the bone fragments include the distal bone (the proximal end of the broken bone), the proximal The end bone (the distal end of the broken bone) and the uninjured bone (the side where the fracture did not occur).
(1b)利用VTK工具包封装的移动立方体算法对分割后的骨块进行三维重建,并将重建结果存储为二进制的STL网格模型,得到远端骨模型、近端骨模型以及健侧骨模型;各个模型表面由若干个三角面片构成。(1b) Use the moving cube algorithm encapsulated in the VTK toolkit to perform 3D reconstruction of the segmented bone block, and store the reconstruction result as a binary STL mesh model to obtain the distal bone model, proximal bone model and uninjured bone model ;Each model surface is composed of several triangle faces.
(2)定义远端骨复位的初始位姿和目标位姿,为后续的轨迹规划提供初始和目标节点,具体步骤为:(2) Define the initial pose and target pose of the distal bone reset, and provide the initial and target nodes for subsequent trajectory planning. The specific steps are:
(2a)利用VTK建立虚拟三维场景,分别导入远端骨模型、近端骨模型和健侧骨模型,初始导入状态下,各模型的模型坐标系均与三维虚拟场景的世界坐标系重合。(2a) Create a virtual 3D scene using VTK, and import the distal bone model, proximal bone model and uninjured bone model respectively. In the initial import state, the model coordinate system of each model coincides with the world coordinate system of the 3D virtual scene.
(2b)定义远端骨模型的模型坐标系为O i-x iy iz i(i=1,2,···,t),利用坐标系O i-x iy iz i相对于世界坐标系的位姿表示远端骨模型的位姿T i,i取值的变化对应远端骨模型位姿的变化。当i=1时,远端骨模型的模型坐标系与世界坐标系重合,即初始状态下远端骨模型的位姿为单位矩阵T 1;当i=t时,远端骨模型的位姿T t即为所求的目标位姿,T t的计算见后续步骤。 (2b) Define the model coordinate system of the distal bone model as O i -xi y i z i ( i =1,2,···,t), using the coordinate system O i -xi y i z i relative to The pose of the world coordinate system represents the pose T i of the distal bone model, and changes in the value of i correspond to changes in the pose of the distal bone model. When i=1, the model coordinate system of the distal bone model coincides with the world coordinate system, that is, the pose of the distal bone model in the initial state is the identity matrix T 1 ; when i=t, the pose of the distal bone model T t is the desired target pose, and the calculation of T t can be found in the following steps.
(2c)以三维虚拟场景中的XZ平面为基准面,对健侧骨模型进行镜像变换。(2c) Taking the XZ plane in the three-dimensional virtual scene as a reference plane, performing mirror transformation on the bone model of the healthy side.
(2d)固定近端骨模型,利用ICP算法获取近端骨模型与镜像后的健侧骨模型之间的变换矩阵,使近端骨模型和镜像后的健侧骨模型重合。(2d) Fix the proximal bone model, and use the ICP algorithm to obtain the transformation matrix between the proximal bone model and the mirrored healthy side bone model, so that the proximal bone model and the mirrored healthy side bone model coincide.
(2e)固定镜像后的健侧骨模型,利用ICP算法获取远端骨模型和镜像后的健侧骨模型间的变换矩阵,使镜像后的健侧骨模型和远端骨模型重合。此时远端骨模型到达复位状 态,读取远端骨模型的位姿T t,T t即为目标位姿。 (2e) Fix the mirrored healthy side bone model, and use the ICP algorithm to obtain the transformation matrix between the distal bone model and the mirrored healthy side bone model, so that the mirrored healthy side bone model and the distal bone model overlap. At this time, the distal bone model reaches the reset state, and the pose T t of the distal bone model is read, and T t is the target pose.
(3)对骨折处复位过程中远端骨模型和近端骨模型进行干涉分析,为后续轨迹规划提供约束条件,避免复位过程中远端骨模型和近端骨模型的碰撞,具体步骤为:(3) Perform interference analysis on the distal bone model and the proximal bone model during the fracture reduction process to provide constraints for subsequent trajectory planning and avoid collisions between the distal bone model and the proximal bone model during the reduction process. The specific steps are:
(3a)在VTK搭建的三维虚拟场景中分别导入远端骨模型和近端骨模型。(3a) Import the distal bone model and the proximal bone model respectively into the 3D virtual scene built by VTK.
(3b)基于八叉树搜索算法,计算近端骨模型与远端骨模型间的最近距离l。(3b) Calculate the shortest distance l between the proximal bone model and the distal bone model based on an octree search algorithm.
(3c)通过截取CT图像的体元获得构成各个模型的三角面片,然后计算得到复位过程中远端骨模型和近端骨模型发生碰撞的检测阈值l′;(3c) Obtain the triangular faces that constitute each model by intercepting the voxels of the CT image, and then calculate the detection threshold l' for the collision between the distal bone model and the proximal bone model during the reset process;
所述的检测阈值l′的计算过程如下:The calculation process of the detection threshold l' is as follows:
体元的大小由CT扫描精度确定,假设CT扫描精度为a×b×c,如图6所示,可得三角面片的最大边长s max为: The size of the voxel is determined by the CT scanning accuracy. Assuming that the CT scanning accuracy is a×b×c, as shown in Figure 6, the maximum side length s max of the triangular surface can be obtained as:
Figure PCTCN2021131067-appb-000002
Figure PCTCN2021131067-appb-000002
以最大边长s max构建等边三角形,如图7所示,在此种情况下定义碰撞检测阈值l′为: Construct an equilateral triangle with the maximum side length s max , as shown in Figure 7, in this case define the collision detection threshold l' as:
Figure PCTCN2021131067-appb-000003
Figure PCTCN2021131067-appb-000003
CT扫描精度普遍为1mm×1mm×0.625mm,可得碰撞发生的阈值为0.893mm。The accuracy of CT scanning is generally 1mm×1mm×0.625mm, and the threshold of collision occurrence is 0.893mm.
(3d)依据距离l判断远端骨模型与近端骨模型是否存在碰撞的风险,具体说明如下:(3d) Judging whether there is a risk of collision between the distal bone model and the proximal bone model based on the distance l, the specific instructions are as follows:
远端骨和近端骨的三维模型表面由若干三角面片构成。若骨块发生碰撞,远端骨和近端骨发生干涉,则必然存在两个及以上的相交三角面片。若l>l′,远端骨和近端骨一定不会发生碰撞;若l≤l′,远端骨和近端骨间存在碰撞的风险。The surface of the three-dimensional model of the distal bone and the proximal bone is composed of several triangular faces. If the bone blocks collide and the distal bone and the proximal bone interfere, there must be two or more intersecting triangular faces. If l>l', there will be no collision between the distal bone and the proximal bone; if l≤l', there is a risk of collision between the distal bone and the proximal bone.
(4)利用OpenSim软件提供的标准肌肉骨骼模型获取复位过程中各条肌肉的牵拉力大小,作为后续轨迹规划的约束条件,避免复位过程中肌肉等软组织的损伤,具体步骤为:(4) Use the standard musculoskeletal model provided by OpenSim software to obtain the pulling force of each muscle during the reset process, and use it as a constraint for subsequent trajectory planning to avoid damage to muscles and other soft tissues during the reset process. The specific steps are:
(4a)根据OpenSim标准骨模型(如图8所示)与复位完成后患者骨模型解剖标志点间的拓扑关系,计算缩放系数s,然后利用缩放系数s对标准骨模型的构建参数进行缩放,得到与患者骨模型大小相近的标准骨骼肌肉模型。(4a) According to the topological relationship between the OpenSim standard bone model (as shown in Figure 8) and the anatomical landmarks of the patient's bone model after the reset, calculate the scaling factor s, and then use the scaling factor s to scale the construction parameters of the standard bone model, Obtain a standard musculoskeletal model that is similar in size to the patient's bone model.
所述的构建参数包括几何体、质量、质心、关节位置、肌肉附着点以及肌肉参数等,缩放系数的计算如下:The construction parameters include geometry, mass, center of mass, joint position, muscle attachment points, and muscle parameters, etc. The scaling factor is calculated as follows:
Figure PCTCN2021131067-appb-000004
Figure PCTCN2021131067-appb-000004
其中,L i和L' i分别表示复位完成后个性化骨模型与标准骨模型中某一对解剖标志点(如内、 外踝尖)间的距离,k表示所选择的解剖标志点的组数。 Among them, L i and L' i represent the distance between the individualized bone model and a certain pair of anatomical landmarks (such as the tip of the inner and outer malleolus) in the standard bone model after the reset is completed, and k represents the group number of the selected anatomical landmarks .
(4b)利用ICP算法,获取经过步骤(2e)完成复位后的患者骨模型(参见图10a与经过步骤(4a)获得的标准骨骼肌肉模型之间的转换矩阵,进而将标准骨骼肌肉模型替换为完成复位后的患者骨模型,如图10b所示。并设置肌肉附着点和远端骨模型以及近端骨模型之间的固联关系,若肌肉附着点靠近远端骨模型,则规定该肌肉附着点与远端骨模型固联;反之,则规定该肌肉附着点与近端骨模型固联。(4b) Use the ICP algorithm to obtain the conversion matrix between the patient's bone model after step (2e) has been reset (see Figure 10a and the standard skeletal muscle model obtained through step (4a), and then replace the standard skeletal muscle model with The bone model of the patient after the reset is completed, as shown in Figure 10b. And set the fixed relationship between the muscle attachment point and the distal bone model and the proximal bone model. If the muscle attachment point is close to the distal bone model, the muscle attachment point is specified. The attachment point is fixedly connected with the distal bone model; otherwise, the muscle attachment point is fixedly connected with the proximal bone model.
(4c)首先,利用OpenSim软件的C++API接口,在三维虚拟场景中,建立远端骨模型和近端骨模型之间的六自由度关节,如图10b所示,该六自由度关节具有沿O t-x ty tz t坐标轴x t、y t、z t的三个平移自由度和绕坐标轴x t、y t、z t的三个旋转自由度。其次,建立远端骨模型沿坐标轴x t、y t、z t平移的距离d x、d y、d z以及远端骨模型绕坐标轴x t、y t、z t旋转的角度α、β、γ与远端骨模型的位姿T i的关系式。最后,以T 1作为初始状态下远端骨模型的位姿,T t为目标位姿,模拟远端骨模型相对于近端骨模型的运动。若已知远端骨模型的位姿T i,则能够得到关节参数d x、d y、d z、α、β、γ;将关节参数d x、d y、d z、α、β、γ作为OpenSim软件的输入,则OpenSim软件输出与位姿T i相对应的各条肌肉的牵拉力大小。 (4c) First, use the C++ API interface of the OpenSim software to establish a six-degree-of-freedom joint between the distal bone model and the proximal bone model in a three-dimensional virtual scene, as shown in Figure 10b, the six-degree-of-freedom joint It has three translation degrees of freedom along the O t -x t y tz t coordinate axes x t , y t , z t and three rotation degrees of freedom around the coordinate axes x t , y t , z t . Secondly, establish the translational distance d x , d y , d z of the distal bone model along the coordinate axes x t , y t , z t and the angle α, The relationship between β, γ and the pose T i of the distal bone model. Finally, taking T 1 as the pose of the distal bone model in the initial state, and T t as the target pose, the movement of the distal bone model relative to the proximal bone model is simulated. If the pose T i of the distal bone model is known, the joint parameters d x , d y , d z , α, β, γ can be obtained; the joint parameters d x , d y , d z , α, β, γ As the input of the OpenSim software, the OpenSim software outputs the pulling force of each muscle corresponding to the pose T i .
d x、d y、d z、α、β、γ与远端骨位姿T i具有如下关系: d x , d y , d z , α, β, γ have the following relationship with the distal bone pose T i :
Figure PCTCN2021131067-appb-000005
Figure PCTCN2021131067-appb-000005
其中, tT i为坐标系O i-x iy iz i相对于坐标系O t-x ty tz t的位姿矩阵, tR itT i的姿态矩阵, td itT i的位移向量,x=[1 0 0] T,y=[0 1 0] T,z=[0 0 1] T。(5)在A*算法原有执行流程的基础上,融合步骤(3)的碰撞检测方法和步骤(4)的肌肉力分析方法,通过对A*算法的轨迹节点和估价函数的重新设计,进行骨折复位轨迹规划,具体步骤为: Among them, t T i is the pose matrix of the coordinate system O i -xi y i z i relative to the coordinate system O t -x t y t z t , t R i is the pose matrix of t T i , and t d i is The displacement vector of t T i , x=[1 0 0] T , y=[0 1 0] T , z=[0 0 1] T . (5) On the basis of the original execution process of the A* algorithm, the collision detection method of step (3) and the muscle force analysis method of step (4) are combined, and the trajectory nodes and evaluation functions of the A* algorithm are redesigned, Perform fracture reduction trajectory planning, the specific steps are:
(5a)定义与远端骨模型位姿T i一一对应的轨迹节点N i(O xi,O yi,O zii)(i=1,2,···,t),轨迹节点N i的分量O xi、O yi、O zi分别为坐标系O i-x iy iz i坐标原点O i的x、y、z分量,分量θ i表示远端骨模型绕远端骨模型的轴线n逆时针旋转的角度。 (5a) Define the trajectory node N i (O xi ,O yi ,O zii )(i=1,2,···,t) corresponding to the pose T i of the distal bone model one-to-one, the trajectory node The components O xi , O yi , and O zi of N i are the x, y, and z components of the origin O i of the coordinate system O i -xi y i z i respectively , and the component θ i indicates that the distal bone model revolves around the The angle by which the axis n is rotated counterclockwise.
由轨迹节点N i(O xi,O yi,O zii)推导远端骨位姿T i的过程如下: The process of deriving the distal bone pose T i from the trajectory nodes N i (O xi , O yi , O zi , θ i ) is as follows:
由于轴线n是远端骨模型的旋转轴,远端骨模型从初始位姿旋转至目标位姿的过程中轴线n保持不变,因此轴线n的方向可由下式进行计算:Since the axis n is the rotation axis of the distal bone model, the axis n remains unchanged during the rotation of the distal bone model from the initial pose to the target pose, so the direction of the axis n can be calculated by the following formula:
R tn=n R t n=n
式中,R t为T t的姿态矩阵。轨迹节点N i的分量θ i的计算如下: In the formula, R t is the attitude matrix of T t . The component θ i of the trajectory node N i is calculated as follows:
Figure PCTCN2021131067-appb-000006
Figure PCTCN2021131067-appb-000006
已知旋转轴n的方向和旋转角θ i,由罗德里格斯公式可得: Knowing the direction of the rotation axis n and the rotation angle θ i , it can be obtained from the Rodrigues formula:
R i=cosθ iI+(1-cosθ i)nn T+sinθ in^ R i =cosθ i I+(1-cosθ i )nn T +sinθ i n^
式中,R i为矩阵T i的姿态矩阵,n^表示向量n的反对称矩阵,I为单位矩阵。 In the formula, R i is the attitude matrix of matrix T i , n^ represents the anti-symmetric matrix of vector n, and I is the identity matrix.
因此,已知轨迹节点N i的各个分量,可得远端骨位姿: Therefore, each component of the trajectory node N i is known, and the distal bone pose can be obtained:
Figure PCTCN2021131067-appb-000007
Figure PCTCN2021131067-appb-000007
(5b)结合骨折复位轨迹无碰撞、路径最短以及肌肉牵拉力最小的约束条件,将A*算法的估价函数定义为:(5b) Combining the constraints of no collision, the shortest path, and the smallest muscle pulling force on the fracture reduction trajectory, the evaluation function of the A* algorithm is defined as:
Figure PCTCN2021131067-appb-000008
Figure PCTCN2021131067-appb-000008
其中,g(N i)为远端骨模型坐标系原点从初始节点N 1运动到节点N i的代价;h(N i)表示远端骨模型坐标系原点从节点N i移动至目标节点N t的代价;r(N i)=c 1it|为姿态惩罚函数,表示远端骨模型坐标系从当前节点N i旋转至目标节点N t所需的代价,c 1为相关惩罚系数,c 1的取值应使r(N i)与g(N i)、h(N i)、m(N i)有相同的数量级;m(N i)=c 2(F i-F 1)为肌肉力惩罚函数,F i(i=1,2,···,t)表示远端骨模型位于轨迹节点N i时各肌肉力的代数和,其中,F i(i=1,2,···,t)为利用步骤(5a)中的方法将节点N i映射为远端骨模型的位姿T i,然后采用步骤(4c)中的方法获得的各肌肉力的代数和。c 2为相关惩罚系数,c 2的取值应使m(N i)与g(N i)、h(N i)、r(N i)有相同的数量级。 Among them, g(N i ) is the cost of moving the origin of the distal bone model coordinate system from the initial node N 1 to node N i ; h(N i ) indicates that the origin of the distal bone model coordinate system moves from node N i to the target node N The cost of t ; r(N i )=c 1it | is the attitude penalty function, which represents the cost required for the distal bone model coordinate system to rotate from the current node N i to the target node N t , and c 1 is Correlation penalty coefficient, the value of c 1 should make r(N i ) have the same order of magnitude as g(N i ), h(N i ), m(N i ); m(N i )=c 2 (F i -F 1 ) is the muscle force penalty function, F i (i=1,2,...,t) represents the algebraic sum of the muscle forces when the distal bone model is located at the trajectory node N i , where F i (i= 1,2,···,t) use the method in step (5a) to map the node N i to the pose T i of the distal bone model, and then use the method in step (4c) to obtain the muscle force Algebraic sum. c 2 is the correlation penalty coefficient, the value of c 2 should make m(N i ) have the same order of magnitude as g(N i ), h(N i ), r(N i ).
(5c)基于改进A*搜索算法,分别以步骤(5a)设定的轨迹节点N 1(0,0,0,0)和N t(O xt,O xt,O xtt)作为轨迹规划的起始节点和终点节点,并根据步骤(5b)设定的估价函 数f(N i)对复位轨迹节点进行优选,在优选过程中采用步骤(3)中的方法对N c所有的邻域节点进行碰撞检测,优选出复位轨迹节点序列N 2,···,N t-1,然后由轨迹节点N i(O xi,O yi,O zii)和远端骨位姿T i之间的对应关系,将优选出的复位轨迹节点序列N 2,···,N t-1转换为远端骨模型的位姿,完成骨折复位轨迹规划。 (5c) Based on the improved A* search algorithm, the trajectory nodes N 1 (0,0,0,0) and N t (O xt ,O xt ,O xtt ) set in step (5a) are used as the trajectory respectively planning start node and end node, and optimize the reset trajectory node according to the evaluation function f(N i ) set in step (5b), in the optimization process, use the method in step (3) to select all neighbors of N c The domain nodes perform collision detection, and the reset trajectory node sequence N 2 ,···,N t-1 is optimized, and then the trajectory node N i (O xi ,O yi ,O zii ) and the distal bone pose T According to the corresponding relationship between i , the optimized reset trajectory node sequence N 2 ,···,N t-1 is converted into the pose of the distal bone model to complete the fracture reduction trajectory planning.
如图11所示,优选骨折复位轨迹节点的具体过程如下:As shown in Figure 11, the specific process of optimizing fracture reduction trajectory nodes is as follows:
Step1:定义空表open和close,将复位轨迹起始节点N 1插入open表中。 Step1: Define empty tables open and close, and insert the start node N 1 of the reset trajectory into the open table.
Step2:判断open表是否为空,若open为空则结束搜索;若不为空则在open表中查找估价函数值最小的节点N c(O xc,O xc,O xcc),记为当前节点,然后从open表中删除该节点,并将其插入close表中。 Step2: Determine whether the open table is empty, if open is empty, end the search; if it is not empty, find the node N c (O xc ,O xc ,O xcc ) with the smallest value of the evaluation function in the open table, record as the current node, then delete the node from the open table and insert it into the close table.
Step3:close表中当前节点N c的邻域节点为N c+1,然后利用步骤(5a)中方法将N c+1映射为远端骨模型的位姿,并采用步骤(3)中的方法对N c所有的邻域节点进行碰撞检测,将未发生碰撞的节点的集合定义为child表; Step3: The neighbor node of the current node N c in the close table is N c+1 , and then use the method in step (5a) to map N c+1 to the pose of the distal bone model, and use the method in step (3) The method performs collision detection on all neighborhood nodes of N c , and defines the collection of non-collided nodes as a child table;
当前节点N c和当前节点N c的邻域节点N c+1存在关系如下: The relationship between the current node Nc and the neighbor node Nc +1 of the current node Nc is as follows:
Figure PCTCN2021131067-appb-000009
Figure PCTCN2021131067-appb-000009
Step4:遍历child表中的每个节点N j,计算以N c为父节点时节点N j新的估价函数值;若open表中包含节点N j,且节点N j新的估价函数值小于旧的估价函数值,则设置N j的父节点为N c;若open表中不包含节点N j,设置N j的父节点为N c,并将N j加入open表中。 Step4: Traverse each node N j in the child table, and calculate the new evaluation function value of node N j when N c is the parent node; if the open table contains node N j , and the new evaluation function value of node N j is smaller than the old value value of the evaluation function, then set the parent node of N j to N c ; if the open table does not contain node N j , set the parent node of N j to N c , and add N j to the open table.
Step5:判断open表中是否包含终点节点N t,若包含则终止搜索过程,执行Step6,否则返回Step2重新执行。 Step5: Determine whether the end node N t is included in the open table, if so, terminate the search process, and execute Step6, otherwise return to Step2 and execute again.
Step6:当搜索到目标节点N t时意味着轨迹规划完成。从终点节点N t开始,不断向上查找父节点,直至父节点为起始节点N 1时终止,N 1、N 2、...N t共同组成了骨折复位的轨迹节点,将上述节点转换为的远端骨模型的位姿,完成骨折复位轨迹规划。 Step6: When the target node N t is searched, it means that the trajectory planning is completed. Starting from the terminal node N t , the parent node is continuously searched upward until the parent node is the starting node N 1. N 1 , N 2 , ... N t together constitute the trajectory node of fracture reduction, and the above nodes are transformed into The pose of the distal bone model can be used to complete the fracture reduction trajectory planning.
本发明利用碰撞检测技术避免了复位过程中断骨骨块间的碰撞,通过OpenSim肌肉力仿真减小了对肌肉的过分牵拉,基于改进的A*搜索算法缩短了骨折复位路径以及提高 了轨迹规划的效率。故本发明的一种面向并联骨折手术机器人的复位轨迹自动式规划方法可满足骨折临床复位手术的需求。The invention utilizes the collision detection technology to avoid the collision between broken bone blocks in the reset process, reduces the excessive pulling of the muscles through the OpenSim muscle force simulation, shortens the fracture reset path and improves the trajectory planning based on the improved A* search algorithm s efficiency. Therefore, an automatic reset trajectory planning method for a parallel fracture surgery robot of the present invention can meet the needs of clinical fracture reduction surgery.

Claims (2)

  1. 面向并联骨折手术机器人的复位轨迹自动式规划方法,其特征在于包括以下步骤:The reset trajectory automatic planning method for parallel fracture surgery robot is characterized in that it comprises the following steps:
    (1)获取患者的三维骨折模型,具体步骤为:(1) Obtain the three-dimensional fracture model of the patient, the specific steps are:
    (1a)扫描并获取骨折患者的CT数据,利用ITK工具包从CT数据中分割出骨块,所述的骨块包括远端骨、近端骨以及健侧骨;(1a) scan and obtain the CT data of the fracture patient, utilize the ITK tool kit to segment the bone fragments from the CT data, and the described bone fragments include distal bone, proximal bone and healthy side bone;
    (1b)利用VTK工具包封装的移动立方体算法对分割后的骨块进行三维重建,并将重建结果存储为二进制的STL网格模型,得到远端骨模型、近端骨模型以及健侧骨模型;各个模型表面由若干个三角面片构成;(1b) Use the moving cube algorithm encapsulated in the VTK toolkit to perform 3D reconstruction of the segmented bone block, and store the reconstruction result as a binary STL mesh model to obtain the distal bone model, proximal bone model and uninjured bone model ;Each model surface is composed of several triangle faces;
    (2)定义远端骨复位的初始位姿和目标位姿,为后续的轨迹规划提供初始和目标节点,具体步骤为:(2) Define the initial pose and target pose of the distal bone reset, and provide the initial and target nodes for subsequent trajectory planning. The specific steps are:
    (2a)利用VTK建立虚拟三维场景,分别导入远端骨模型、近端骨模型和健侧骨模型,初始导入状态下,各模型的模型坐标系均与三维虚拟场景的世界坐标系重合;(2a) Use VTK to build a virtual 3D scene, and import the distal bone model, proximal bone model, and uninjured bone model respectively. In the initial import state, the model coordinate systems of each model coincide with the world coordinate system of the 3D virtual scene;
    (2b)定义远端骨模型的模型坐标系为O i-x iy iz i,i=1,2,…,t,利用坐标系O i-x iy iz i相对于世界坐标系的位姿表示远端骨模型的位姿T i,i取值的变化对应远端骨模型位姿的变化;当i=1时,远端骨模型的模型坐标系与世界坐标系重合,即初始状态下远端骨模型的位姿为单位矩阵T 1;当i=t时,远端骨模型的位姿T t即为所求的目标位姿; (2b) Define the model coordinate system of the distal bone model as O i -xi y i z i , i =1,2,...,t, use the coordinate system O i -xi y i z i relative to the world coordinate system The pose of represents the pose T i of the distal bone model, and the change of the value of i corresponds to the change of the pose of the distal bone model; when i=1, the model coordinate system of the distal bone model coincides with the world coordinate system, that is In the initial state, the pose of the distal bone model is the identity matrix T 1 ; when i=t, the pose T t of the distal bone model is the desired target pose;
    (2c)以三维虚拟场景中的XZ平面为基准面,对健侧骨模型进行镜像变换;(2c) Taking the XZ plane in the three-dimensional virtual scene as a reference plane, performing mirror transformation on the bone model of the healthy side;
    (2d)固定近端骨模型,利用ICP算法获取近端骨模型与镜像后的健侧骨模型之间的变换矩阵,使近端骨模型和镜像后的健侧骨模型重合;(2d) fix the proximal bone model, use the ICP algorithm to obtain the transformation matrix between the proximal bone model and the mirrored healthy side bone model, so that the proximal bone model and the mirrored healthy side bone model overlap;
    (2e)固定镜像后的健侧骨模型,利用ICP算法获取远端骨模型和镜像后的健侧骨模型间的变换矩阵,使镜像后的健侧骨模型和远端骨模型重合;此时远端骨模型到达复位状态,读取远端骨模型的位姿T t,T t即为目标位姿; (2e) Fix the mirrored bone model of the healthy side, and use the ICP algorithm to obtain the transformation matrix between the distal bone model and the mirrored healthy side bone model, so that the mirrored healthy side bone model and the distal bone model overlap; at this time The distal bone model reaches the reset state, read the pose T t of the distal bone model, and T t is the target pose;
    (3)对骨折处复位过程中远端骨模型和近端骨模型进行干涉分析,具体步骤为:(3) Perform interference analysis on the distal bone model and the proximal bone model during the fracture reduction process, the specific steps are:
    (3a)在VTK搭建的三维虚拟场景中分别导入远端骨模型和近端骨模型;(3a) respectively import the distal bone model and the proximal bone model into the three-dimensional virtual scene built by VTK;
    (3b)基于八叉树搜索算法,计算近端骨模型与远端骨模型间的最近距离l;(3b) Based on the octree search algorithm, calculate the shortest distance l between the proximal bone model and the distal bone model;
    (3c)通过截取CT图像的体元获得构成各个模型的三角面片,然后计算得到复位过程中远端骨模型和近端骨模型发生碰撞的检测阈值l′;(3c) Obtain the triangular faces that constitute each model by intercepting the voxels of the CT image, and then calculate the detection threshold l' for the collision between the distal bone model and the proximal bone model during the reset process;
    (3d)依据距离l判断远端骨模型与近端骨模型是否存在碰撞的风险,若l>l′,远端骨和近端骨一定不会发生碰撞;若l≤l′,远端骨和近端骨间存在碰撞的风险;(3d) Judging whether there is a risk of collision between the distal bone model and the proximal bone model based on the distance l, if l>l', the distal bone and the proximal bone will not collide; if l≤l', the distal bone model There is a risk of collision with the proximal bone;
    (4)利用OpenSim软件提供的标准肌肉骨骼模型获取复位过程中各条肌肉的牵拉力大小,具体步骤为:(4) Use the standard musculoskeletal model provided by OpenSim software to obtain the pulling force of each muscle during the reset process. The specific steps are:
    (4a)根据OpenSim标准骨模型与复位完成后患者骨模型解剖标志点间的拓扑关系,计算缩放系数s,然后利用缩放系数s对标准骨模型的构建参数进行缩放,得到与患者骨模型大小相近的标准骨骼肌肉模型;(4a) Calculate the scaling factor s according to the topological relationship between the OpenSim standard bone model and the anatomical landmarks of the patient's bone model after reset, and then use the scaling factor s to scale the construction parameters of the standard bone model to obtain a bone model that is similar in size to the patient's The standard skeletal muscle model;
    (4b)利用ICP算法,获取经过步骤(2e)完成复位后的患者骨模型与经过步骤(4a)获得的标准骨骼肌肉模型之间的转换矩阵,进而将标准骨骼肌肉模型替换为完成复位后的患者骨模型,并设置肌肉附着点和远端骨模型以及近端骨模型之间的固联关系,若肌肉附着点靠近远端骨模型,则规定该肌肉附着点与远端骨模型固联;反之,则规定该肌肉附着点与近端骨模型固联;(4b) Use the ICP algorithm to obtain the transformation matrix between the patient's bone model after step (2e) is reset and the standard skeletal muscle model obtained through step (4a), and then replace the standard skeletal muscle model with the reset one Patient bone model, and set the fixed connection relationship between the muscle attachment point and the distal bone model and the proximal bone model. If the muscle attachment point is close to the distal bone model, it is stipulated that the muscle attachment point is fixedly connected with the distal bone model; On the contrary, it is stipulated that the muscle attachment point is fixedly connected with the proximal bone model;
    (4c)首先,利用OpenSim软件的C++API接口,在三维虚拟场景中,建立远端骨模型和近端骨模型之间的六自由度关节,该六自由度关节具有沿O t-x ty tz t坐标轴x t、y t、z t的三个平移自由度和绕坐标轴x t、y t、z t的三个旋转自由度;其次,建立远端骨模型沿坐标轴x t、y t、z t平移的距离d x、d y、d z以及远端骨模型绕坐标轴x t、y t、z t旋转的角度α、β、γ与远端骨模型的位姿T i的关系式;最后,以T 1作为初始状态下远端骨模型的位姿,T t为目标位姿,模拟远端骨模型相对于近端骨模型的运动;若已知远端骨模型的位姿T i,则能够得到关节参数d x、d y、d z、α、β、γ;将关节参数d x、d y、d z、α、β、γ作为OpenSim软件的输入,则OpenSim软件输出与位姿T i相对应的各条肌肉的牵拉力大小; (4c) First, use the C++ API interface of OpenSim software to establish a six-degree-of-freedom joint between the distal bone model and the proximal bone model in the three-dimensional virtual scene. The six-degree-of-freedom joint has t y t z t coordinate axis x t , y t , z t three translation degrees of freedom and three rotation degrees of freedom around the coordinate axis x t , y t , z t ; secondly, establish the distal bone model along the coordinate axis The translational distance d x , d y , d z of x t , y t , z t and the angle α, β, γ of the rotation of the distal bone model around the coordinate axes x t , y t , z t and the position of the distal bone model The relational expression of pose T i ; finally, take T 1 as the pose of the distal bone model in the initial state, and T t as the target pose, to simulate the movement of the distal bone model relative to the proximal bone model; if the distal bone model is known T i of the bone model, the joint parameters d x , d y , d z , α, β, γ can be obtained; the joint parameters d x , d y , d z , α, β, γ are used as the input of the OpenSim software , then the OpenSim software outputs the pulling force of each muscle corresponding to the pose T i ;
    (5)在A*算法原有执行流程的基础上,融合步骤(3)的碰撞检测方法和步骤(4)的肌肉力分析方法,通过对A*算法的轨迹节点和估价函数的重新设计,进行骨折复位轨迹规划,具体步骤为:(5) On the basis of the original execution process of the A* algorithm, the collision detection method in step (3) and the muscle force analysis method in step (4) are combined, and the trajectory nodes and evaluation functions of the A* algorithm are redesigned, Perform fracture reduction trajectory planning, the specific steps are:
    (5a)定义与远端骨模型位姿T i一一对应的轨迹节点N i(O xi,O yi,O zii)(i=1,2,…,t),轨迹节点N i的分量O xi、O yi、O zi分别为坐标系O i-x iy iz i坐标原点O i的x、y、z分量,分量θ i表示远端骨模型绕远端骨模型的轴线n逆时针旋转的角度; (5a) Define the trajectory node N i (O xi , O yi , O zii ) (i=1,2,…,t) corresponding to the pose T i of the distal bone model one-to-one, and the trajectory node N i The components O xi , O yi , O zi are the x, y, and z components of the origin O i of the coordinate system O i -xi y i z i respectively , and the component θ i represents the axis of the distal bone model around the distal bone model n the angle of counterclockwise rotation;
    (5b)结合骨折复位轨迹无碰撞、路径最短以及肌肉牵拉力最小的约束条件,将A*算法的估价函数定义为:(5b) Combining the constraints of no collision, the shortest path, and the smallest muscle pulling force on the fracture reduction trajectory, the evaluation function of the A* algorithm is defined as:
    Figure PCTCN2021131067-appb-100001
    Figure PCTCN2021131067-appb-100001
    其中,g(N i)为远端骨模型坐标系原点从初始节点N 1运动到节点N i的代价;h(N i)表示远端骨模型坐标系原点从节点N i移动至目标节点N t的代价;r(N i)=c 1it|为姿态惩罚函数,表示远端骨模型坐标系从当前节点N i旋转至目标节点N t所需的代价,c 1为相关惩罚系数,c 1的取值应使r(N i)与g(N i)、h(N i)、m(N i)有相同的数量级;m(N i)=c 2(F i-F 1)为肌肉力惩罚函数,F i(i=1,2,…,t)表示远端骨模型位于轨迹节点N i时各肌肉力的代数和,其中,F i(i=1,2,…,t)为利用步骤(5a)中的方法将节点N i映射为远端骨模型的位姿T i,然后采用步骤(4c)中的方法获得的各肌肉力的代数和;c 2为相关惩罚系数,c 2的取值应使m(N i)与g(N i)、h(N i)、r(N i)有相同的数量级; Among them, g(N i ) is the cost of moving the origin of the distal bone model coordinate system from the initial node N 1 to node N i ; h(N i ) indicates that the origin of the distal bone model coordinate system moves from node N i to the target node N The cost of t ; r(N i )=c 1it | is the attitude penalty function, which represents the cost required for the distal bone model coordinate system to rotate from the current node N i to the target node N t , and c 1 is Correlation penalty coefficient, the value of c 1 should make r(N i ) have the same order of magnitude as g(N i ), h(N i ), m(N i ); m(N i )=c 2 (F i -F 1 ) is the muscle force penalty function, F i (i=1,2,...,t) represents the algebraic sum of the muscle forces when the distal bone model is located at the trajectory node N i , wherein, F i (i=1, 2,...,t) is the algebraic sum of each muscle force obtained by using the method in step (5a) to map the node N i to the pose T i of the distal bone model, and then using the method in step (4c); c 2 is the correlation penalty coefficient, the value of c 2 should make m(N i ) have the same order of magnitude as g(N i ), h(N i ), r(N i );
    (5c)基于改进A*搜索算法,分别以步骤(5a)设定的轨迹节点N 1(0,0,0,0)和N t(O xt,O xt,O xtt)作为轨迹规划的起始节点和终点节点,并根据步骤(5b)设定的估价函数f(N i)对复位轨迹节点进行优选,在优选过程中采用步骤(3)中的方法对N c所有的邻域节点进行碰撞检测,优选出复位轨迹节点序列N 2,…,N t-1,然后由轨迹节点N i(O xi,O yi,O zii)和远端骨位姿T i之间的对应关系,将优选出的复位轨迹节点序列N 2,…,N t-1转换为远端骨模型的位姿,完成骨折复位轨迹规划。 (5c) Based on the improved A* search algorithm, the trajectory nodes N 1 (0,0,0,0) and N t (O xt ,O xt ,O xtt ) set in step (5a) are used as the trajectory respectively planning start node and end node, and optimize the reset trajectory node according to the evaluation function f(N i ) set in step (5b), in the optimization process, use the method in step (3) to select all neighbors of N c The domain nodes perform collision detection, and the reset trajectory node sequence N 2 ,…,N t-1 is optimized, and then the trajectory node N i (O xi , O yi , O zii ) and the distal bone pose T i According to the corresponding relationship between them, the optimized reset trajectory node sequence N 2 ,...,N t-1 is converted into the pose of the distal bone model to complete the fracture reduction trajectory planning.
  2. 根据权利要求1所述的面向并联骨折手术机器人的复位轨迹自动式规划方法,其特征在于:优选骨折复位轨迹节点的具体过程如下:According to claim 1, the automatic reset trajectory planning method for parallel fracture surgical robots is characterized in that: the specific process of optimizing fracture reset trajectory nodes is as follows:
    Step1:定义空表open和close,将复位轨迹起始节点N 1插入open表中; Step1: Define empty tables open and close, and insert the starting node N 1 of the reset trajectory into the open table;
    Step2:判断open表是否为空,若open为空则结束搜索;若不为空则在open表中查找估价函数值最小的节点N c(O xc,O xc,O xcc),记为当前节点,然后从open表中删除该节点,并将其插入close表中; Step2: Determine whether the open table is empty, if open is empty, end the search; if it is not empty, find the node N c (O xc ,O xc ,O xcc ) with the smallest value of the evaluation function in the open table, record is the current node, then delete the node from the open table and insert it into the close table;
    Step3:close表中当前节点N c的邻域节点为N c+1,然后利用步骤(5a)中方法将N c+1映射为远端骨模型的位姿,并采用步骤(3)中的方法对N c所有的邻域节点进行碰撞检测,将未发生碰撞的节点的集合定义为child表; Step3: The neighbor node of the current node N c in the close table is N c+1 , and then use the method in step (5a) to map N c+1 to the pose of the distal bone model, and use the method in step (3) The method performs collision detection on all neighborhood nodes of N c , and defines the collection of non-collided nodes as a child table;
    当前节点N c和当前节点N c的邻域节点N c+1存在关系如下: The relationship between the current node Nc and the neighbor node Nc +1 of the current node Nc is as follows:
    Figure PCTCN2021131067-appb-100002
    Figure PCTCN2021131067-appb-100002
    Step4:遍历child表中的每个节点N j,计算以N c为父节点时节点N j新的估价函数值;若open表中包含节点N j,且节点N j新的估价函数值小于旧的估价函数值,则设置N j的父节点为N c;若open表中不包含节点N j,设置N j的父节点为N c,并将N j加入open表中; Step4: Traverse each node N j in the child table, and calculate the new evaluation function value of node N j when N c is the parent node; if the open table contains node N j , and the new evaluation function value of node N j is smaller than the old value value of the evaluation function, then set the parent node of N j to N c ; if the open table does not contain node N j , set the parent node of N j to N c , and add N j to the open table;
    Step5:判断open表中是否包含终点节点N t,若包含则终止搜索过程,执行Step6,否则返回Step2重新执行; Step5: Determine whether the end node N t is included in the open table, and if so, terminate the search process and execute Step6, otherwise return to Step2 and re-execute;
    Step6:当搜索到目标节点N t时意味着轨迹规划完成,从终点节点N t开始,不断向上查找父节点,直至父节点为起始节点N 1时终止,N 1、N 2、...N t共同组成了骨折复位的轨迹节点,将上述节点转换为的远端骨模型的位姿,完成骨折复位轨迹规划。 Step6: When the target node N t is searched, it means that the trajectory planning is completed. Starting from the end node N t , the parent node is continuously searched upward until the parent node is the starting node N 1. N 1 , N 2 , ... N t together constitute the trajectory nodes of fracture reduction, and the above nodes are converted into the pose of the distal bone model to complete the trajectory planning of fracture reduction.
PCT/CN2021/131067 2021-07-21 2021-11-17 Reduction trajectory automatic planning method for parallel fracture surgical robot WO2023000560A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110823988.1A CN113781495B (en) 2021-07-21 2021-07-21 Automatic reset track planning method for parallel fracture surgery robot
CN202110823988.1 2021-07-21

Publications (1)

Publication Number Publication Date
WO2023000560A1 true WO2023000560A1 (en) 2023-01-26

Family

ID=78836243

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/131067 WO2023000560A1 (en) 2021-07-21 2021-11-17 Reduction trajectory automatic planning method for parallel fracture surgical robot

Country Status (2)

Country Link
CN (1) CN113781495B (en)
WO (1) WO2023000560A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117723079A (en) * 2023-12-04 2024-03-19 青岛蚂蚁机器人有限责任公司 AGV global path planning method based on improved A star algorithm

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114974509B (en) * 2022-05-26 2024-05-10 哈尔滨工业大学 Fracture reduction path planning method, fracture reduction method and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111134842A (en) * 2020-01-20 2020-05-12 上海大学 Robot-assisted fracture reduction path planning method
CN111887989A (en) * 2020-07-27 2020-11-06 上海大学 Robot-assisted fracture space collision-prevention reduction path planning method
CN112164443A (en) * 2020-09-27 2021-01-01 上海擎泰仿真科技有限公司 Interactive simulation fracture reduction method
CN112370158A (en) * 2020-11-13 2021-02-19 毕建平 Robot fracture reduction path planning method and system and robot

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105955254B (en) * 2016-04-25 2019-03-29 广西大学 A kind of improved A* algorithm suitable for robot path search
CN106695802A (en) * 2017-03-19 2017-05-24 北京工业大学 Improved RRT<*> obstacle avoidance motion planning method based on multi-degree-of-freedom mechanical arm
CN107953334A (en) * 2017-12-25 2018-04-24 深圳禾思众成科技有限公司 A kind of industrial machinery arm Collision Free Path Planning based on A star algorithms
CN108356819B (en) * 2018-01-17 2020-08-14 西安交通大学 Industrial mechanical arm collision-free path planning method based on improved A-x algorithm
CN112034836B (en) * 2020-07-16 2023-06-16 北京信息科技大学 Mobile robot path planning method with improved A-algorithm

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111134842A (en) * 2020-01-20 2020-05-12 上海大学 Robot-assisted fracture reduction path planning method
CN111887989A (en) * 2020-07-27 2020-11-06 上海大学 Robot-assisted fracture space collision-prevention reduction path planning method
CN112164443A (en) * 2020-09-27 2021-01-01 上海擎泰仿真科技有限公司 Interactive simulation fracture reduction method
CN112370158A (en) * 2020-11-13 2021-02-19 毕建平 Robot fracture reduction path planning method and system and robot

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117723079A (en) * 2023-12-04 2024-03-19 青岛蚂蚁机器人有限责任公司 AGV global path planning method based on improved A star algorithm
CN117723079B (en) * 2023-12-04 2024-05-28 青岛蚂蚁机器人有限责任公司 AGV global path planning method based on improved A star algorithm

Also Published As

Publication number Publication date
CN113781495B (en) 2023-03-24
CN113781495A (en) 2021-12-10

Similar Documents

Publication Publication Date Title
WO2023000560A1 (en) Reduction trajectory automatic planning method for parallel fracture surgical robot
US11628012B2 (en) Patient positioning using a skeleton model
CN114041878A (en) Three-dimensional reconstruction method and system for CT image of bone joint replacement surgical robot
US11648061B2 (en) Method for determination of surgical procedure access
WO2021046455A1 (en) Fast and automatic pose estimation using intraoperatively located fiducials and single-view fluoroscopy
Gao et al. Fiducial-free 2D/3D registration for robot-assisted femoroplasty
US11523868B2 (en) Bone registration methods for robotic surgical procedures
CN114027985A (en) Robot for bone joint replacement surgery
Qin et al. Collaborative preoperative planning for operation-navigation dual-robot orthopedic surgery system
CN116523975A (en) Six-dimensional transformation-based robot global optimal solution space registration and calibration algorithm
CN116363093A (en) Method and device for searching rotation center of acetabulum, operation planning system and storage medium
Lu et al. Preoperative virtual reduction planning algorithm of fractured pelvis based on adaptive templates
Ta Development and implementation of a computational surgical planning model for pre-operative planning and post-operative assessment and analysis of total hip arthroplasty
Popescu et al. A new method to compare planned and achieved position of an orthopaedic implant
Irwansyah et al. Repositioning bone fragments using registration of paired-points and assisted-constraints in virtual bone reduction surgery
Qin et al. Pre-and Intra-operative Dynamic Registration for Total Knee Arthroplasty Based on CT Image Annotation
CN112201329A (en) Template-guided and data-driven three-dimensional broken bone segmentation and splicing method
Masutani et al. Modally controlled free form deformation for non-rigid registration in image-guided liver surgery
Zsemlye Shape prediction from partial information
Lu et al. Computer-Assisted Automatic Preoperative Path Planning Method for Pelvic Fracture Reduction Surgery Based on Enlarged RRT $^\ast $ Algorithm
CN115715703B (en) Channel planning method
CN116725662B (en) Fracture surgery planning method, device and storable medium based on two-dimensional images
Negrillo-Cárdenas et al. Automatic Detection of Distal Humerus Features: First Steps.
Luo et al. Survey of Navigation Guided Robotics for Orthopedic Surgical Assistance–Concept and Components
wei Song et al. Model-based segmentation of femoral head and acetabulum from CT images

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21950798

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE