CN116919590A - Surgical robot control method, device and medium for hallux valgus minimally invasive surgery - Google Patents
Surgical robot control method, device and medium for hallux valgus minimally invasive surgery Download PDFInfo
- Publication number
- CN116919590A CN116919590A CN202310885249.4A CN202310885249A CN116919590A CN 116919590 A CN116919590 A CN 116919590A CN 202310885249 A CN202310885249 A CN 202310885249A CN 116919590 A CN116919590 A CN 116919590A
- Authority
- CN
- China
- Prior art keywords
- coordinate system
- metatarsal
- position information
- mechanical arm
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 206010061159 Foot deformity Diseases 0.000 title claims abstract description 67
- 208000001963 Hallux Valgus Diseases 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000002324 minimally invasive surgery Methods 0.000 title claims abstract description 53
- 210000001872 metatarsal bone Anatomy 0.000 claims abstract description 146
- 210000002683 foot Anatomy 0.000 claims abstract description 74
- 238000001356 surgical procedure Methods 0.000 claims abstract description 12
- 230000003287 optical effect Effects 0.000 claims description 65
- 239000013598 vector Substances 0.000 claims description 23
- 238000006243 chemical reaction Methods 0.000 claims description 16
- 210000000988 bone and bone Anatomy 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 12
- 239000011159 matrix material Substances 0.000 claims description 11
- 238000012546 transfer Methods 0.000 claims description 6
- 238000013519 translation Methods 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 210000001906 first metatarsal bone Anatomy 0.000 description 7
- 230000009471 action Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 210000000281 joint capsule Anatomy 0.000 description 2
- 230000002980 postoperative effect Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000008733 trauma Effects 0.000 description 2
- 206010005949 Bone cancer Diseases 0.000 description 1
- 208000018084 Bone neoplasm Diseases 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 210000001142 back Anatomy 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000004744 fore-foot Anatomy 0.000 description 1
- 206010020718 hyperplasia Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/32—Surgical robots operating autonomously
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
Landscapes
- Health & Medical Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Robotics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Manipulator (AREA)
Abstract
The present disclosure discloses a surgical robot control method, apparatus, and medium for minimally invasive hallux valgus surgery. The method comprises the following steps: and carrying out coordinate system positive operation on the position information of the first metatarsal under the first metatarsal coordinate system, the position information of the tail end of the mechanical arm of the surgical robot under the mechanical arm coordinate system and the position information and path information of the hallux valgus minimally invasive surgery planning data information under the foot virtual model coordinate system so as to obtain the information of the first metatarsal, the tail end of the mechanical arm and the hallux valgus minimally invasive surgery planning data information under the world coordinate system, generating a first target position and a first moving path of the tail end of the mechanical arm under the world coordinate system based on the information, converting the first target position and the first moving path into a second target position and a second moving path through the coordinate system inverse operation, and driving the tail end of the mechanical arm to move according to the information. According to the embodiment of the disclosure, the operation of the surgical robot can be guided based on the information of the same coordinate system, so that the automatic control error is reduced, and the surgical accuracy is improved.
Description
Technical Field
The present disclosure relates generally to the field of minimally invasive surgery of hallux valgus. More particularly, the present disclosure relates to a surgical robot control method, apparatus, and medium for minimally invasive hallux valgus surgery.
Background
Hallux valgus is a clinically common deformity of the forefoot, severely affecting foot function and appearance, reducing quality of life. Minimally invasive surgery of hallux valgus is accepted by more and more patients because of the advantages of small trauma and rapid postoperative recovery, and becomes a main stream means for treating hallux valgus.
Typically, a minimally invasive hallux valgus procedure will fix the Kirschner wire in the patient's metatarsal position, pulling the patient's bone back through the traction of the Kirschner wire. With the development of robot technology at present, surgical robots are widely applied to the medical field, wherein the surgical robots for hallux valgus minimally invasive surgery can apply acting force to a kirschner wire under automatic control so as to complete target osteotomy and internal fixation guiding of each key step of the surgery and traction reduction of a target bone structure.
Because the requirement of the hallux valgus minimally invasive surgery on the operation precision is high, and the coordinate systems of the hallux valgus minimally invasive surgery planning scheme, the driving surgical robot and the patient foot are all different, the data information in the hallux valgus minimally invasive surgery planning scheme cannot be directly used for controlling the hallux valgus minimally invasive surgery robot. In addition, bone types for which bone surgery is aimed are different, and coordinate systems involved in the surgery are also different.
For the above-mentioned various reasons, there is a need to provide a surgical robot control scheme for minimally invasive surgery of hallux valgus, so as to achieve precise control of the minimally invasive surgical robot of hallux valgus.
Disclosure of Invention
To address at least one or more of the technical problems mentioned above, the present disclosure proposes, in various aspects, a surgical robotic control scheme for minimally invasive surgery of hallux valgus.
In a first aspect, the present disclosure provides a surgical robotic control method for minimally invasive hallux valgus surgery comprising: performing coordinate system positive operation on the position information of the first metatarsal under the first metatarsal coordinate system to obtain the position information of the first metatarsal under the world coordinate system; carrying out coordinate system positive operation on the position information of the tail end of the mechanical arm of the surgical robot under the mechanical arm coordinate system so as to obtain the position information of the tail end of the mechanical arm of the surgical robot under the world coordinate system; performing coordinate system forward operation on the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the foot virtual model coordinate system to obtain the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the world coordinate system; generating a first target position and a first moving path of the tail end of the mechanical arm under the world coordinate system based on the position information of the first metatarsal under the world coordinate system, the position information of the tail end of the mechanical arm under the world coordinate system and the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the world coordinate system; performing coordinate system inverse operation on the first target position and the first moving path to obtain a second target position and a second moving path of the first target position and the first moving path under the coordinate system of the mechanical arm; and driving the tail end of the mechanical arm to move to a second target position along a second moving path.
In some embodiments, wherein prior to performing the coordinate system positive operation on the position information of the first metatarsal in the first metatarsal coordinate system, the method further comprises: the first metatarsal coordinate system is calibrated using a first optical tracker fixed to the proximal first metatarsal k-wire and a second optical tracker fixed to the distal first metatarsal k-wire.
In some embodiments, wherein the axial direction of the first metatarsal proximal k-wire is parallel to the axial direction of the first metatarsal distal k-wire, and the center of the first optical tracker and the center of the second optical tracker are on the same vertical line; wherein, the perpendicular line is perpendicular to the axial direction of first metatarsal proximal kirschner wire and first metatarsal distal kirschner wire simultaneously, and intersects with first metatarsal proximal kirschner wire and first metatarsal distal kirschner wire.
In some embodiments, wherein calibrating the first metatarsal coordinate system comprises: centering an optical tracker number one as a first metatarsal coordinate system O 2 X 2 Y 2 Z 2 Is the origin of coordinates O of 2 The method comprises the steps of carrying out a first treatment on the surface of the Will pass through O 2 And a straight line parallel to the axial direction of the first metatarsal proximal Kirschner wire is determined as X of the first metatarsal coordinate system 2 A shaft; determining the central line of the first optical tracker and the second optical tracker as Y of the first metatarsal coordinate system 2 A shaft; will pass through O 2 And vertical X 2 Axes and Y 2 The straight line of the plane formed by the axes is determined as Z of the first metatarsal coordinate system 2 A shaft.
In some embodiments, wherein prior to performing the coordinate system positive operation on the position information of the manipulator end of the surgical robot under the manipulator coordinate system, the method further comprises: and calibrating a mechanical arm coordinate system by using a third optical tracker fixed on the tail end of the mechanical arm.
In some embodiments, the third optical tracker is fixed on the transfer disc at the end of the mechanical arm, the center of the third optical tracker coincides with the center of the transfer disc, and the plane of the third optical tracker is parallel to the plane of the transfer disc.
In some embodiments, wherein calibrating the robotic arm coordinate system comprises: centering the optical tracker No. three as the robotic arm coordinate system O 3 X 3 Y 3 Z 3 Is the origin of coordinates O of 3 The method comprises the steps of carrying out a first treatment on the surface of the Any two straight lines perpendicular to each other on the plane where the third optical tracker is located are respectively determined as X of a mechanical arm coordinate system 3 Axes and Y 3 A shaft; will pass through O 3 And a straight line perpendicular to the plane of the No. three optical tracker is determined as Z of a mechanical arm coordinate system 3 A shaft.
In some embodiments, wherein prior to coordinate system positive operation of the hallux valgus minimally invasive surgery planning data information with respect to the position information and the path information under the foot virtual model coordinate system, the method further comprises: calibrating a foot virtual model coordinate system; wherein the foot virtual model coordinate system O 1 X 1 Y 1 Z 1 The calibration process of (1) comprises: sequentially determining the lowest points of the first metatarsal, the fifth metatarsal and the root bone in the foot virtual model as a first positioning point a, a second positioning point b and a third positioning point c; will bea. b and c is determined as the origin O of coordinates of the foot virtual model coordinate system 1 The method comprises the steps of carrying out a first treatment on the surface of the Will pass through O 1 And a straight line perpendicular to the line ab is determined as X of the foot virtual model coordinate system 1 A shaft; will pass through O 1 And a straight line parallel to the connecting line ab is used as Y of a foot virtual model coordinate system 1 A shaft; will pass through O 1 And a straight line perpendicular to the plane formed by a, b and c is taken as Z of a foot virtual model coordinate system 1 A shaft.
In some embodiments, wherein prior to performing the coordinate system positive operation on the position information of the first metatarsal in the first metatarsal coordinate system, the method further comprises: calibrating a world coordinate system by using a binocular positioning camera in a control system of the surgical robot; the calibration process of the world coordinate system OXYZ comprises the following steps: determining the midpoint of the optical center connecting line of the left-eye camera and the right-eye camera in the binocular positioning camera as a coordinate origin O of a world coordinate system; determining the direction of the optical center of the left-eye camera pointing to the optical center of the right-eye camera as the positive direction of the X axis of the world coordinate system; determining a direction satisfying a Z-axis defining condition as a Z-axis positive direction of a world coordinate system, wherein the Z-axis defining condition includes: through the origin of coordinates O, is coplanar with the optical axes of the X-axis and the left-eye camera, is perpendicular to the X-axis and points to the direction of the field of view; and determining the direction passing through the origin of coordinates O and being perpendicular to the X axis and the Z axis and meeting the right hand rule of the coordinate system as the positive direction of the Y axis of the world coordinate system.
In some embodiments, wherein the coordinate system positive operation comprises converting the positional information under the first metatarsal coordinate system, the robotic arm coordinate system, or the foot virtual model coordinate system to positional information under the world coordinate system, wherein the conversion formula of the coordinate system positive operation is: wherein ,/>Representing position information in world coordinate system, +.>Representing position information in a first metatarsal coordinate system, a mechanical arm coordinate system or a foot virtual model coordinate system, W representing a coordinate system positive operation conversion matrix, wherein /> and /> and />The unit vector representing three coordinate axes of the first metatarsal coordinate system, the robot arm coordinate system or the foot virtual model coordinate system is a four-dimensional homogeneous coordinate vector under world coordinates.
In some embodiments, wherein the coordinate system inverse operation comprises converting the positional information in the world coordinate system into positional information in the first metatarsal coordinate system, the robotic arm coordinate system, or the foot virtual model coordinate system, wherein the conversion formula for the coordinate system inverse operation is: wherein ,W-1 The coordinate system inverse operation conversion matrix is represented, which is the inverse of the coordinate system positive operation conversion matrix.
In some embodiments, wherein the hallux valgus minimally invasive procedure planning data information comprises: position information of the virtual osteotomy guiding position, vector direction information of the virtual osteotomy guiding position, position information of the reset traction translation position, position information of the reset traction rotation position, path information of translation motion and rotation motion, position information of the internal fixation guiding position and vector direction information of the internal fixation guiding position.
In some embodiments, wherein the driving the arm tip to move along the second movement path to the second target position further comprises: updating the position information of the first metatarsal under the first metatarsal coordinate system and the position information of the tail end of the mechanical arm under the mechanical arm coordinate system in real time; converting the position information of the first metatarsal and the tail end of the mechanical arm acquired in real time into position information under a world coordinate system; converting the position information of the first metatarsal and the tail end of the mechanical arm, which are acquired in real time, under a world coordinate system into the position information of the foot virtual model coordinate system; and visually displaying the position change information of the first metatarsal and the tail end of the mechanical arm according to the position information of the first metatarsal and the tail end of the mechanical arm under the foot virtual model coordinate system, which is acquired in real time.
In a second aspect, the present disclosure provides an electronic device comprising: a processor; and a memory storing executable program instructions that, when executed by the processor, cause the apparatus to implement a method as in any of the first aspects.
In a third aspect, the present disclosure provides a computer-readable storage medium having stored thereon computer-readable instructions which, when executed by one or more processors, implement the method of any of the first aspects.
Through the surgical robot control method for the hallux valgus minimally invasive surgery provided by the embodiment of the disclosure, the position information of the first metatarsal bone under the first metatarsal bone coordinate system, the position information of the tail end of the mechanical arm under the mechanical arm coordinate system and the position information of the hallux valgus minimally invasive surgery planning data information under the foot virtual model coordinate system are unified into the world coordinate system through positive operation of the coordinate system, so that the mechanical arm can accurately control the tail end of the mechanical arm to move from the current position of the tail end of the mechanical arm to the first metatarsal bone by referring to the hallux valgus minimally invasive surgery planning data information, and accuracy deviation of automatic control of the surgical robot is reduced.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar or corresponding parts and in which:
FIG. 1 illustrates an exemplary flow chart of a method of controlling a hallux valgus minimally invasive surgical robot in accordance with some embodiments of the present disclosure;
FIG. 2 illustrates a schematic view of a first metatarsal coordinate system according to some embodiments of the present disclosure;
FIG. 3 illustrates a schematic diagram of a robotic arm coordinate system in accordance with some embodiments of the present disclosure;
FIG. 4 illustrates a schematic diagram of a foot virtual model coordinate system in accordance with some embodiments of the present disclosure;
FIG. 5 illustrates a schematic diagram of a world coordinate system of some embodiments of the present disclosure;
FIG. 6 illustrates an exemplary flow chart of a real-time updated surgical robot control method of some embodiments of the present disclosure;
fig. 7 shows an exemplary block diagram of the electronic device of an embodiment of the present disclosure.
Detailed Description
The following description of the embodiments of the present disclosure will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the disclosure. Based on the embodiments in this disclosure, all other embodiments that may be made by those skilled in the art without the inventive effort are within the scope of the present disclosure.
It should be understood that the terms "comprises" and "comprising," when used in this specification and the claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the present disclosure is for the purpose of describing particular embodiments only, and is not intended to be limiting of the disclosure. As used in the specification and claims of this disclosure, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be further understood that the term "and/or" as used in the present disclosure and claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in this specification and the claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
Specific embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
Exemplary application scenarios
Minimally invasive surgery of hallux valgus is accepted by more and more patients because of the advantages of small trauma and rapid postoperative recovery, and becomes a main stream means for treating hallux valgus. The hallux valgus minimally invasive surgery is to fix a Kirschner wire at the metatarsal position of a patient, and traction and reduction of bones of the patient are performed through traction action of the Kirschner wire.
With the development of robotics, surgical robots are widely used in the medical field, wherein surgical robots for hallux valgus minimally invasive surgery can apply forces to kirschner wires under automated control to accomplish targeted osteotomies and internal fixation of guides for each critical step of the surgery and traction reduction of targeted bone structures.
However, because the requirement of the hallux valgus minimally invasive surgery on the operation precision is high, and the coordinate systems of the generation of the hallux valgus minimally invasive surgery planning scheme, the driving of the surgery robot and the placement of the feet of the patient are different, the surgery robot cannot be controlled directly according to the data information in the hallux valgus minimally invasive surgery planning scheme.
Exemplary application scenario
In view of this, the embodiment of the disclosure provides a surgical robot control scheme for hallux valgus minimally invasive surgery, which can unify the position information of the first metatarsal under the first metatarsal coordinate system, the position information of the tail end of the mechanical arm under the mechanical arm coordinate system and the position information of the planning data information of the hallux valgus minimally invasive surgery under the foot virtual model coordinate system into a world coordinate system through positive operation of a coordinate system, so that the surgical robot is guided to perform the hallux valgus minimally invasive surgery by the position information under the same coordinate system, the automatic control error is reduced, and the precision of the hallux valgus minimally invasive surgery is improved.
Fig. 1 illustrates an exemplary flowchart of a method 100 of controlling a minimally invasive surgical robotic hallux valgus in accordance with some embodiments of the present disclosure.
As shown in fig. 1, in step S101, coordinate system positive operation is performed on the position information of the first metatarsal in the first metatarsal coordinate system to obtain the position information thereof in the world coordinate system. The hallux valgus minimally invasive surgery aims at the first metatarsal bone of a patient, the hyperplasia bone neoplasm is removed in the joint capsule of the first metatarsal joint through a small incision technology, and the displacement and fixation of the head osteotomy of the metatarsal bone are completed in the joint capsule.
During the operation, the doctor needs to set the acting force and direction of the mechanical arm according to the hallux valgus deflection angle of the patient, and the hallux valgus deflection angle of the patient takes the adjacent bone of the first metatarsal as a reference, so that a local coordinate system, namely the first metatarsal coordinate system, exists on the foot of the patient. Based on this, in some embodiments, it is also necessary to calibrate the first metatarsal coordinate system before performing step S101.
To assist those skilled in the art in understanding the first metatarsal coordinate system, the following describes a calibration procedure of the first metatarsal coordinate system, and fig. 2 shows a schematic view of the first metatarsal coordinate system 200 according to some embodiments of the present disclosure, where it is to be noted in advance that the first metatarsal coordinate system is calibrated based on a first optical tracker fixed to the first metatarsal proximal k-wire and a second optical tracker fixed to the first metatarsal distal k-wire.
First, the fixing manner of the first optical tracker and the second optical tracker is described, specifically, the first proximal k-wire of the metatarsal is placed at the end of the first metatarsal near the heel, the first distal k-wire of the metatarsal is placed at the end of the first metatarsal far from the heel, and the first optical tracker and the second optical tracker are respectively fixed at the portions of the first proximal k-wire of the metatarsal and the first distal k-wire of the metatarsal exposed outside the bone.
Further, in some embodiments, the centers of the first optical tracker and the second optical tracker are leveled. That is, in the case where the axial direction of the first metatarsal proximal k-wire is parallel to the axial direction of the first metatarsal distal k-wire, the center of the first optical tracker and the center of the second optical tracker are located on the same vertical line and the axial direction of the first metatarsal proximal k-wire is parallel to the axial direction of the first metatarsal distal k-wire, wherein the vertical line is perpendicular to both the axial directions of the first metatarsal proximal k-wire and the first metatarsal distal k-wire and intersects both the first metatarsal proximal k-wire and the first metatarsal distal k-wire.
Next, based on the already fixed optical tracker number one and optical tracker number two, the resulting first metatarsal coordinate system is calibrated as follows:
First determining a first metatarsal coordinate system O 2 X 2 Y 2 Z 2 Is the origin of coordinates O of 2 In the present embodiment, the center of the optical tracker number one is determined as the origin of coordinates O 2 。
Then determine X of the first metatarsal coordinate system 2 Axial direction, X in the present embodiment 2 The axial direction is the direction that the proximal Kirschner wire of the first metatarsal points to the foot of the patient, so that O can pass through 2 And a straight line parallel to the axial direction of the first metatarsal proximal Kirschner wire is determined as X of the first metatarsal coordinate system 2 A shaft.
Then Y of the first metatarsal coordinate system can be determined 2 In the axial direction, in the present embodiment, the central line of the first optical tracker and the second optical tracker is determined as Y of the first metatarsal coordinate system 2 A shaft.
Finally based on right rule and X 2 Axes and Y 2 Normal vector of shaftDetermination of Z of first metatarsal coordinate System 2 An axis, Z in this embodiment 2 The shaft being determined by passing O 2 And vertical X 2 Axes and Y 2 The straight line of the plane formed by the axes is determined as Z of the first metatarsal coordinate system 2 A shaft.
The first metatarsal coordinate system may be constructed based on the left hand rule, and Z may be determined by the right hand rule 2 The step of the shaft is only one example of the present embodiment and does not constitute a unique limitation of the present disclosure.
It should be further noted that, in the calibration process of the first metatarsal coordinate system, the first metatarsal coordinate system O 2 X 2 Y 2 Z 2 Middle X 2 Axes and Y 2 The order of the axes can be reversed, i.e. Y can be determined first 2 Axis, redetermine X 2 A shaft. In other embodiments, the first metatarsal coordinate system O 2 X 2 Y 2 Z 2 Middle X 2 Axes and Y 2 The shaft determination steps may also be performed simultaneously, and are not limited solely herein.
In step S102, the position information of the manipulator end of the surgical robot in the manipulator coordinate system is subjected to a coordinate system positive operation to obtain the position information thereof in the world coordinate system. In some embodiments, it is also necessary to calibrate the arm coordinate system using a third optical tracker fixed to the end of the arm before performing step S102. Further, an adapter disc is arranged at the tail end of a mechanical arm adopted by the surgical robot, one end of the Kirschner wire is fixed at the circle center of the adapter disc when the hallux valgus minimally invasive surgery is performed, correspondingly, when the mechanical arm coordinate system is calibrated, the third optical tracker is fixed on the adapter disc at the tail end of the mechanical arm, the center of the third optical tracker is enabled to coincide with the circle center of the adapter disc, and the plane where the third optical tracker is located is enabled to be parallel to the plane where the adapter disc is located.
To facilitate understanding of the robotic arm coordinate system based on the calibration of the optical tracker No. three, fig. 3 of the present disclosure shows a schematic diagram of the robotic arm coordinate system 300 of some embodiments of the present disclosure, and the robotic arm coordinate system 300 is further described below in conjunction with fig. 3.
As shown in fig. 3, based on the optical tracker No. three fixed in the above manner, the calibration process of the mechanical arm coordinate system may be specifically as follows:
first determining a mechanical arm coordinate system O 3 X 3 Y 3 Z 3 Is the origin of coordinates O of 3 In the present embodiment, the center of the optical tracker No. three may be determined as the robot arm coordinate system O 3 X 3 Y 3 Z 3 Is the origin of coordinates O of 3 。
Then determining the mechanical arm coordinate system O 3 X 3 Y 3 Z 3 X of (2) 3 Axes and Y 3 In this embodiment, two arbitrary straight lines perpendicular to each other on the plane on which the third optical tracker is located may be respectively determined as the X of the mechanical arm coordinate system 3 Axes and Y 3 The axis being, for example, X in the upward direction of the initial position of the adapter disk shown in FIG. 3 3 The axial direction is Y which is the left direction of the initial position of the switching disc 3 The axis is in the positive direction.
Finally, determining a mechanical arm coordinate system O 3 X 3 Y 3 Z 3 Z of (2) 3 A shaft, in this embodiment, may pass through O 3 And a straight line perpendicular to the plane of the No. three optical tracker is determined as Z of a mechanical arm coordinate system 3 The axis, e.g. as shown in FIG. 3, is Z in the normal vector direction passing through the center of the circle and pointing to one side of the Kirschner wire 3 The axis is in the positive direction.
In step S103, coordinate system positive operation is performed on the information of the hallux valgus minimally invasive surgery planning data information in the foot virtual model coordinate system, so as to obtain the information thereof in the world coordinate system. The information of the hallux valgus minimally invasive surgery planning data information under the foot virtual model coordinate system comprises position information and path information, and specifically comprises the following steps: position information of the virtual osteotomy guiding position, vector direction information of the virtual osteotomy guiding position, position information of the reset traction translation position, position information of the reset traction rotation position, path information of translation motion and rotation motion, position information of the internal fixation guiding position and vector direction information of the internal fixation guiding position.
It should be noted that, the hallux valgus minimally invasive surgery planning data information is a surgery planning scheme planned by a foot virtual model of a patient before surgery, so that the position information and the path information in the hallux valgus minimally invasive surgery planning data information are the position information and the path information under the foot virtual model coordinate system.
Further, the surgical robot used in this embodiment is connected with an interactive screen, and when performing the hallux valgus minimally invasive surgery, the hallux valgus minimally invasive surgery planning data information can be imported to view the virtual model of the foot of the patient on the interactive screen.
Because the planning data information of the hallux valgus minimally invasive surgery is planned under the coordinate system of the foot virtual model and is different from the coordinate system of the mechanical arm, the mechanical arm cannot be directly guided to move, and the mechanical arm needs to be unified under the world coordinate system through positive operation of the coordinate system. Further, the foot virtual model coordinate system needs to be calibrated before the coordinate system positive operation is executed.
To facilitate understanding of the foot virtual model coordinate system by those skilled in the art, fig. 4 of the present disclosure shows a schematic diagram of a foot virtual model coordinate system 400 according to some embodiments of the present disclosure, and a calibration process of the foot virtual model coordinate system 400 is described below in conjunction with fig. 4.
In order to determine the foot virtual model coordinate system O during calibration of the foot virtual model coordinate system 400 1 X 1 Y 1 Z 1 Is the origin of coordinates O of 1 It is necessary to determine three positioning points, namely a first positioning point a, a second positioning point b and a third positioning point c, and determine the geometric center of the triangle formed by the positioning points a, b and c as the origin of coordinates O of the foot virtual model coordinate system 1 . The first positioning point a is the lowest point of the first metatarsal in the foot virtual model, the second positioning point b is the lowest point of the fifth metatarsal, and the third positioning point c is the lowest point of the root bone. In the foot virtual model of the present embodiment, the direction in which the instep points to the sole is the direction from high to low.
Then, will go through O 1 And is connected with the wireThe ab-perpendicular line is determined as X of the foot virtual model coordinate system 1 Axes, in particular, X in the unit vector direction of the perpendicular to lines ab to c 1 The axis is in the positive direction.
Then will go through O 1 And a straight line parallel to the connecting line ab is used as Y of a foot virtual model coordinate system 1 Axes, in particular Y, in the direction of the unit vector corresponding to a-b 1 The axis is in the positive direction.
Finally, will go through O 1 And a straight line perpendicular to the plane formed by a, b and c is taken as Z of a foot virtual model coordinate system 1 An axis, in particular Z, in the normal vector direction of the plane abc pointing to the dorsum of the foot 1 The axis is in the positive direction.
It should be further noted that, in the calibration process of the foot virtual model coordinate system described above, the foot virtual model coordinate system is X 1 Axis, Y 1 Axis and Z 1 The order of determining the axes is not strictly limited, and in practical application, the three may be determined in any order or simultaneously.
In step S104, a first target position and a first movement path of the distal end of the manipulator in the world coordinate system are generated based on the position information and the path information of the first metatarsal, the distal end of the manipulator, and the hallux valgus minimally invasive surgery planning data information in the world coordinate system. The position information of the tail end of the mechanical arm under the world coordinate system can be understood as a starting position of the tail end of the mechanical arm when moving, the position information of the first metatarsal bone under the world coordinate system is a position which needs to be reached when the tail end of the mechanical arm moves, so that the mechanical arm can control the Kirschner wire fixed on the first metatarsal bone, and the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the world coordinate system are used for reflecting an action execution scheme of the tail end of the mechanical arm under the world coordinate system and specifically comprise actions such as bone cutting, shifting, fixing and the like.
It should be noted that, in this embodiment, the world coordinate system is calibrated by a binocular positioning camera in the control system of the surgical robot. Before the coordinate system positive operation is performed on the position information of the first metatarsal coordinate system, the mechanical arm coordinate system and the foot virtual model coordinate system, the world coordinate system may be calibrated by the following steps, and for ease of understanding, fig. 5 shows a schematic diagram of a world coordinate system 500 of some embodiments of the present disclosure.
When the world coordinate system is calibrated, the midpoint of the optical center connecting line of the left eye camera and the right eye camera in the binocular positioning camera is firstly determined as the coordinate origin O of the world coordinate system.
Then, the direction in which the optical center of the left-eye camera is directed to the optical center of the right-eye camera is determined as the positive X-axis direction of the world coordinate system.
Then, the direction satisfying the Z-axis definition condition is determined as the Z-axis positive direction of the world coordinate system. Wherein the Z-axis defining conditions include: passes through the origin of coordinates O, is coplanar with the optical axes of the X-axis and the left-eye camera, is perpendicular to the X-axis and points to the direction of the field of view.
And finally, determining the direction passing through the coordinate origin O and being perpendicular to the X axis and the Z axis and meeting the right hand rule of the coordinate system as the Y-axis positive direction of the world coordinate system.
It should be noted that, in the calibration process of the world coordinate system described above, the coordinate system is determined based on the right rule, and in practical application, the world coordinate system may be determined using the left rule. The world coordinate system determined based on the right hand rule above is only one example scheme that may be employed in the present embodiment, and does not constitute a unique limitation to the present disclosure.
The foregoing describes three local coordinate systems, the first metatarsal coordinate system, the robotic arm coordinate system, and the foot virtual model coordinate system, as well as a world coordinate system. In the surgical robot control method shown in the disclosure, the position information under any local coordinate system is converted into the position information under the world coordinate system through positive operation of the coordinate system, so that the coordinate system is unified, and the mechanical arm can complete movement by referring to the hallux valgus minimally invasive surgery planning data information.
In an embodiment of the present disclosure, the coordinate system positive operation includes converting the positional information in the first metatarsal coordinate system, the robot arm coordinate system, or the foot virtual model coordinate system into the positional information in the world coordinate system, specifically, the conversion formula of the coordinate system positive operation is wherein ,/>Representing position information in world coordinate system, +.>Representing position information in a first metatarsal coordinate system, a mechanical arm coordinate system or a foot virtual model coordinate system, W representing a coordinate system positive operation conversion matrix, wherein /> and /> and />The unit vector representing three coordinate axes of the first metatarsal coordinate system, the robot arm coordinate system or the foot virtual model coordinate system is a four-dimensional homogeneous coordinate vector under world coordinates.
Taking the first metatarsal coordinate system as an example, the first metatarsal coordinate system O 2 X 2 Y 2 Z 2 The following position information can be calculated by a calculation formulaConverted to world coordinate system, wherein->Representing the coordinate vector in the world coordinate system,representing a coordinate vector in the first metatarsal coordinate system.
Taking the mechanical arm coordinate system as an example, the mechanical arm coordinate system O 3 X 3 Y 3 Z 3 The following position information can be calculated by a calculation formulaConverted to world coordinate system, wherein->Representing coordinate vectors in world coordinate system, +.>Representing the coordinate vector in the robot arm coordinate system.
Taking a foot virtual model coordinate system as an example, a foot virtual model coordinate system O 1 X 1 Y 1 Z 1 The following position information can be calculated by a calculation formulaConverted to world coordinate system, wherein->Representing coordinate vectors in world coordinate system, +.>Representing coordinate vectors in the foot virtual model coordinate system.
In step S105, the first target position and the first movement path are subjected to a coordinate system inverse operation to obtain a second target position and a second movement path thereof under the robot arm coordinate system. Since the control unit of the robot arm still controls the robot arm itself to act under the robot arm coordinate system, after the first target position and the first movement path are determined, it is necessary to convert them into the second target position and the second movement path under the robot arm coordinate system by the inverse operation of the coordinate system.
Corresponding to the coordinate system positive operation, the coordinate system negative operation may include converting the position information under the world coordinate system into position information under the first metatarsal coordinate system, the robot arm coordinate system, or the foot virtual model coordinate system. The conversion formula used is that wherein ,W-1 And representing a coordinate system inverse operation conversion matrix which is an inverse matrix of the coordinate system positive operation conversion matrix.
Based on the conversion formula of the coordinate system inverse operation, step S105 may be performed by the calculation formulaA second target position and a second movement path are calculated.
In step S106, the distal end of the mechanical arm is driven to move to the second target position along the second movement path. Along with the movement of the tail end of the mechanical arm, the operation robot completes the osteotomy guiding, the reduction traction and the internal fixation guiding actions of the hallux valgus minimally invasive operation, and simultaneously, the position of the tail end of the mechanical arm is changed continuously, so that the position of the first metatarsal bone of the patient is changed.
Based on the real-time update of the first metatarsal position information and the arm end position information, some embodiments of the present disclosure also provide a real-time updated surgical robot control method in performing step S106. Fig. 6 illustrates an exemplary flow chart of a real-time updated surgical robot control method 600 of some embodiments of the present disclosure, it being understood that the real-time updated surgical robot control method may be performed on the basis of the control methods illustrated in the previous embodiments, and thus the features described above in connection with fig. 1-5 may be similarly applied thereto.
As shown in fig. 6, in step S601, the position information of the first metatarsal in the first metatarsal coordinate system and the position information of the arm end in the arm coordinate system are updated in real time. In this embodiment, the binocular positioning camera is capable of monitoring the optical tracker in real time, so as to track the position information of the first metatarsal under the first metatarsal coordinate system and the position information of the tail end of the mechanical arm under the mechanical arm coordinate system.
In step S602, the position information of the first metatarsal and the distal end of the mechanical arm acquired in real time is converted into position information in a world coordinate system. Similar to the previous embodiments, the real-time positional information of the first metatarsal and the distal end of the robotic arm may be unified into the world coordinate system by coordinate system positive operations. The process of the positive operation of the coordinate system is described in detail in the previous embodiments, and will not be repeated here.
In step S603, the position information of the first metatarsal and the distal end of the arm in the world coordinate system acquired in real time is converted into position information in the foot virtual model coordinate system. In step S603, in order to facilitate the doctor to view the operation execution situation in real time through the interactive screen, the position information of the first metatarsal and the distal end of the mechanical arm in the world coordinate system may be converted into the position information of the first metatarsal and the distal end of the mechanical arm in the foot virtual model coordinate system, and the conversion process may refer to the coordinate system inverse operation process in the foregoing embodiment, which is not described in detail herein.
In step S604, the position change information of the first metatarsal and the distal end of the mechanical arm is visually displayed according to the position information of the first metatarsal and the distal end of the mechanical arm under the coordinate system of the virtual model of the foot, which is acquired in real time. Step S604 may display the pose of the first metatarsal and the pose of the distal end of the robotic arm on a foot virtual model in an interactive screen.
In summary, the embodiments of the present disclosure provide a surgical robot control scheme for hallux valgus minimally invasive surgery, which can unify position information of a first metatarsal under a first metatarsal coordinate system, position information of a mechanical arm end under a mechanical arm coordinate system, and position information of hallux valgus minimally invasive surgery planning data information under a foot virtual model coordinate system into a world coordinate system through coordinate system positive operation, so that the surgical robot is guided to perform hallux valgus minimally invasive surgery operation by the position information under the same coordinate system, automatic control errors are reduced, and the precision of the hallux valgus minimally invasive surgery is improved.
Corresponding to the foregoing functional embodiments, an electronic device as shown in fig. 7 is also provided in the embodiments of the present disclosure. Fig. 7 shows an exemplary block diagram of an electronic device 700 of an embodiment of the disclosure.
An electronic device 700 shown in fig. 7, comprising: a processor 710; and a memory 720 having stored thereon executable program instructions which, when executed by the processor 710, cause the electronic device to implement any of the methods as described hereinbefore.
In the electronic apparatus 700 of fig. 7, only constituent elements related to the present embodiment are shown. Thus, it will be apparent to those of ordinary skill in the art that: the electronic device 700 may also include common constituent elements that are different from those shown in fig. 7.
Processor 710 may control the operation of electronic device 700. For example, the processor 710 controls the operation of the electronic device 700 by executing programs stored in the memory 720 on the electronic device 700. The processor 710 may be implemented by a Central Processing Unit (CPU), an Application Processor (AP), an artificial intelligence processor chip (IPU), etc. provided in the electronic device 700. However, the present disclosure is not limited thereto. In this embodiment, the processor 710 may be implemented in any suitable manner. For example, the processor 710 may take the form of, for example, a microprocessor or processor, and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable logic controller, and an embedded microcontroller, among others.
Memory 720 may be used to store hardware for various data, instructions that are processed in electronic device 700. For example, the memory 720 may store processed data and data to be processed in the electronic device 700. Memory 720 may store data sets that have been processed or to be processed by processor 710. Further, the memory 720 may store applications, drivers, etc. to be driven by the electronic device 700. For example: the memory 720 may store various programs related to coordinate system forward operations, coordinate system inverse operations, and the like to be performed by the processor 710. The memory 720 may be a DRAM, but the present disclosure is not limited thereto. Memory 720 may include at least one of volatile memory or non-volatile memory. The nonvolatile memory may include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), flash memory, phase change RAM (PRAM), magnetic RAM (MRAM), resistive RAM (RRAM), ferroelectric RAM (FRAM), and the like. Volatile memory can include Dynamic RAM (DRAM), static RAM (SRAM), synchronous DRAM (SDRAM), PRAM, MRAM, RRAM, ferroelectric RAM (FeRAM), and the like. In an embodiment, the memory 720 may include at least one of a Hard Disk Drive (HDD), a Solid State Drive (SSD), a high density flash memory (CF), a Secure Digital (SD) card, a Micro-secure digital (Micro-SD) card, a Mini-secure digital (Mini-SD) card, an extreme digital (xD) card, a cache (cache), or a memory stick.
In summary, specific functions implemented by the memory 720 and the processor 710 of the electronic device 700 provided in the embodiments of the present disclosure may be explained in comparison with the foregoing embodiments of the present disclosure, and may achieve the technical effects of the foregoing embodiments, which will not be repeated herein.
Alternatively, the present disclosure may also be implemented as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) having stored thereon computer program instructions (or computer programs, or computer instruction codes) which, when executed by a processor of an electronic device (or electronic device, server, etc.), cause the processor to perform part or all of the steps of the above-described methods according to the present disclosure.
While various embodiments of the present disclosure have been shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Numerous modifications, changes, and substitutions will occur to those skilled in the art without departing from the spirit and scope of the present disclosure. It should be understood that various alternatives to the embodiments of the disclosure described herein may be employed in practicing the disclosure. The appended claims are intended to define the scope of the disclosure and are therefore to cover all equivalents or alternatives falling within the scope of these claims.
Claims (15)
1. A surgical robot control method for minimally invasive surgery of hallux valgus, comprising:
performing coordinate system positive operation on the position information of the first metatarsal under the first metatarsal coordinate system to obtain the position information of the first metatarsal under the world coordinate system;
carrying out coordinate system positive operation on the position information of the tail end of the mechanical arm of the surgical robot under the mechanical arm coordinate system so as to obtain the position information of the tail end of the mechanical arm of the surgical robot under the world coordinate system;
performing coordinate system forward operation on the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the foot virtual model coordinate system to obtain the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the world coordinate system;
generating a first target position and a first movement path of the tail end of the mechanical arm under the world coordinate system based on the position information of the first metatarsal under the world coordinate system, the position information of the tail end of the mechanical arm under the world coordinate system and the position information and the path information of the hallux valgus minimally invasive surgery planning data information under the world coordinate system;
performing coordinate system inverse operation on the first target position and the first moving path to obtain a second target position and a second moving path of the first target position and the first moving path under a mechanical arm coordinate system; and
And driving the tail end of the mechanical arm to move to the second target position along the second moving path.
2. The method of claim 1, wherein prior to the coordinate system positive operation of the first metatarsal position information in the first metatarsal coordinate system, the method further comprises:
the first metatarsal coordinate system is calibrated using a first optical tracker fixed to the proximal first metatarsal k-wire and a second optical tracker fixed to the distal first metatarsal k-wire.
3. The method of claim 2, wherein the axial direction of the first metatarsal proximal k-wire is parallel to the axial direction of the first metatarsal distal k-wire, and the center of the first optical tracker and the center of the second optical tracker are on the same vertical line;
wherein the perpendicular line is perpendicular to the axial direction of the first metatarsal proximal Kirschner wire and the first metatarsal distal Kirschner wire simultaneously, and intersects both the first metatarsal proximal Kirschner wire and the first metatarsal distal Kirschner wire.
4. A method according to claim 2 or 3, wherein calibrating the first metatarsal coordinate system comprises:
Determining the center of the optical tracker number one as the first metatarsal coordinate system O 2 X 2 Y 2 Z 2 Is the origin of coordinates O of 2 ；
Will pass through O 2 And a straight line parallel to the axial direction of the first metatarsal proximal Kirschner wire is determined as X of the first metatarsal coordinate system 2 A shaft;
determining a center line of the first optical tracker and the second optical tracker as Y of the first metatarsal coordinate system 2 A shaft; and
will pass through O 2 And perpendicular to said X 2 Axes and Y 2 The straight line of the plane formed by the axes is determined as Z of the first metatarsal coordinate system 2 A shaft.
5. The method of claim 1, wherein prior to performing a coordinate system positive operation on position information of a robotic arm tip of the surgical robot in a robotic arm coordinate system, the method further comprises:
and calibrating the mechanical arm coordinate system by using a third optical tracker fixed on the tail end of the mechanical arm.
6. The method of claim 5, wherein the optical tracker No. three is fixed on a transfer disc at the end of the mechanical arm, the center of the optical tracker No. three coincides with the center of the transfer disc, and the plane of the optical tracker No. three is parallel to the plane of the transfer disc.
7. The method of claim 5 or 6, wherein calibrating the robotic arm coordinate system comprises:
determining the center of the third optical tracker as the mechanical arm coordinate system O 3 X 3 Y 3 Z 3 Is the origin of coordinates O of 3 ；
Any two straight lines perpendicular to each other on the plane where the third optical tracker is located are respectively determined as X of the mechanical arm coordinate system 3 Axes and Y 3 A shaft; and
will pass through O 3 And a straight line perpendicular to the plane of the third optical tracker is determined as Z of the mechanical arm coordinate system 3 A shaft.
8. The method of claim 1, wherein prior to coordinate system positive operation of the hallux valgus minimally invasive surgery planning data information with respect to the position information and the path information in the foot virtual model coordinate system, the method further comprises: calibrating the foot virtual model coordinate system;
wherein the foot virtual model coordinate system O 1 X 1 Y 1 Z 1 The calibration process of (1) comprises:
sequentially determining the lowest points of the first metatarsal, the fifth metatarsal and the root bone in the foot virtual model as a first positioning point a, a second positioning point b and a third positioning point c;
determining the geometric center of the triangle formed by a, b and c as the origin O of coordinates of the foot virtual model coordinate system 1 ；
Will pass through O 1 And a straight line perpendicular to the line ab is determined as X of the foot virtual model coordinate system 1 A shaft;
will pass through O 1 And a straight line parallel to the connecting line ab is used as Y of the foot virtual model coordinate system 1 A shaft; and
will pass through O 1 And a straight line perpendicular to the plane formed by a, b and c is taken as Z of the foot virtual model coordinate system 1 A shaft.
9. The method of claim 1, wherein prior to the coordinate system positive operation of the first metatarsal position information in the first metatarsal coordinate system, the method further comprises: calibrating the world coordinate system by using a binocular positioning camera in a control system of the surgical robot;
the calibration process of the world coordinate system OXYZ comprises the following steps:
determining the midpoint of the optical center connecting line of the left-eye camera and the right-eye camera in the binocular positioning camera as a coordinate origin O of the world coordinate system;
determining the direction of the optical center of the left eye camera pointing to the optical center of the right eye camera as the positive direction of the X axis of the world coordinate system;
determining a direction satisfying a Z-axis definition condition as a Z-axis positive direction of the world coordinate system, wherein the Z-axis definition condition includes: through a coordinate origin O, is coplanar with the optical axes of the X-axis and the left-eye camera, is perpendicular to the X-axis and points to the field of view; and
And determining the direction passing through the coordinate origin O and being perpendicular to the X axis and the Z axis and meeting the right hand rule of the coordinate system as the Y-axis positive direction of the world coordinate system.
10. The method of claim 1, wherein the coordinate system positive operation includes converting positional information in the first metatarsal coordinate system, the robotic arm coordinate system, or the foot virtual model coordinate system to positional information in the world coordinate system, wherein the coordinate system positive operation has a conversion formula of:
wherein ,representing position information in world coordinate system, +.>Representing position information in a first metatarsal coordinate system, a mechanical arm coordinate system or a foot virtual model coordinate system, W representing a coordinate system positive operation conversion matrix, < -> wherein /> and /> and />And a four-dimensional homogeneous coordinate vector of the unit vector representing three coordinate axes of the first metatarsal coordinate system, the mechanical arm coordinate system or the foot virtual model coordinate system under world coordinates.
11. The method of claim 10, wherein the coordinate system inverse operation includes scaling the positional information in the world coordinate system to positional information in the first metatarsal coordinate system, the robotic arm coordinate system, or the foot virtual model coordinate system, wherein the coordinate system inverse operation has a scaling formula:
wherein ,W-1 And representing a coordinate system inverse operation conversion matrix which is an inverse matrix of the coordinate system positive operation conversion matrix.
12. The method of claim 1, wherein the hallux valgus minimally invasive surgery planning data information comprises: position information of the virtual osteotomy guiding position, vector direction information of the virtual osteotomy guiding position, position information of the reset traction translation position, position information of the reset traction rotation position, path information of translation motion and rotation motion, position information of the internal fixation guiding position and vector direction information of the internal fixation guiding position.
13. The method of claim 1, wherein during driving the robotic arm tip along the second path of movement to the second target position, the method further comprises:
updating the position information of the first metatarsal under a first metatarsal coordinate system and the position information of the tail end of the mechanical arm under a mechanical arm coordinate system in real time;
converting the position information of the first metatarsal and the tail end of the mechanical arm acquired in real time into position information under a world coordinate system;
converting the position information of the first metatarsal and the tail end of the mechanical arm, which are acquired in real time, under a world coordinate system into the position information of the foot virtual model coordinate system; and
And visually displaying the position change information of the first metatarsal and the tail end of the mechanical arm according to the position information of the first metatarsal and the tail end of the mechanical arm under the foot virtual model coordinate system, which is acquired in real time.
14. A surgical robotic control device for use in minimally invasive hallux valgus surgery, comprising:
a processor; and
a memory storing executable program instructions that, when executed by the processor, cause the apparatus to implement the method of any one of claims 1-13.
15. A computer readable storage medium having stored thereon computer readable instructions which, when executed by one or more processors, implement the method of any of claims 1-13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310885249.4A CN116919590B (en) | 2023-07-18 | 2023-07-18 | Surgical robot control method, device and medium for hallux valgus minimally invasive surgery |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310885249.4A CN116919590B (en) | 2023-07-18 | 2023-07-18 | Surgical robot control method, device and medium for hallux valgus minimally invasive surgery |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116919590A true CN116919590A (en) | 2023-10-24 |
| CN116919590B CN116919590B (en) | 2024-05-31 |
Family
ID=88383829
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310885249.4A Active CN116919590B (en) | 2023-07-18 | 2023-07-18 | Surgical robot control method, device and medium for hallux valgus minimally invasive surgery |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116919590B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117297772A (en) * | 2023-11-30 | 2023-12-29 | 四川大学华西医院 | Method for planning hallux valgus operation of foot and related product |
| CN117297711A (en) * | 2023-11-30 | 2023-12-29 | 四川大学华西医院 | Reduction guide instrument for hallux valgus operation |
| CN117322951A (en) * | 2023-11-30 | 2024-01-02 | 四川大学华西医院 | Manufacturing method of thumb everting minimally invasive surgery guide plate, equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100211071A1 (en) * | 2009-02-13 | 2010-08-19 | Lettmann Jason W | Methods and devices for treating hallux valgus |
| CN102188279A (en) * | 2010-03-05 | 2011-09-21 | 张春霖 | Joint operation robot based on single coordinate system control |
| CN111345895A (en) * | 2020-03-13 | 2020-06-30 | 北京天智航医疗科技股份有限公司 | Total knee replacement surgery robot auxiliary system, control method and electronic equipment |
| CN113100939A (en) * | 2021-04-06 | 2021-07-13 | 德智鸿(上海)机器人有限责任公司 | Orthopedic surgery navigation method, device, computer equipment, system and storage medium |
| CN114209433A (en) * | 2021-12-31 | 2022-03-22 | 杭州三坛医疗科技有限公司 | Surgical robot navigation positioning method and device |
| WO2022155208A1 (en) * | 2021-01-12 | 2022-07-21 | Howmedica Osteonics Corp. | Computer-assisted lower-extremity surgical guidance |
| WO2022173806A1 (en) * | 2021-02-10 | 2022-08-18 | Crossroads Extremity Systems, Llc | Bunion correction system and method |
| CN115553923A (en) * | 2022-09-19 | 2023-01-03 | 重庆生物智能制造研究院 | Ankle joint surgical robot system and control method thereof |
| WO2023029363A1 (en) * | 2021-09-03 | 2023-03-09 | 北京长木谷医疗科技有限公司 | Navigation and positioning system and method for surgical robot |
-
2023
- 2023-07-18 CN CN202310885249.4A patent/CN116919590B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100211071A1 (en) * | 2009-02-13 | 2010-08-19 | Lettmann Jason W | Methods and devices for treating hallux valgus |
| CN102188279A (en) * | 2010-03-05 | 2011-09-21 | 张春霖 | Joint operation robot based on single coordinate system control |
| CN111345895A (en) * | 2020-03-13 | 2020-06-30 | 北京天智航医疗科技股份有限公司 | Total knee replacement surgery robot auxiliary system, control method and electronic equipment |
| WO2022155208A1 (en) * | 2021-01-12 | 2022-07-21 | Howmedica Osteonics Corp. | Computer-assisted lower-extremity surgical guidance |
| WO2022173806A1 (en) * | 2021-02-10 | 2022-08-18 | Crossroads Extremity Systems, Llc | Bunion correction system and method |
| CN113100939A (en) * | 2021-04-06 | 2021-07-13 | 德智鸿(上海)机器人有限责任公司 | Orthopedic surgery navigation method, device, computer equipment, system and storage medium |
| WO2023029363A1 (en) * | 2021-09-03 | 2023-03-09 | 北京长木谷医疗科技有限公司 | Navigation and positioning system and method for surgical robot |
| CN114209433A (en) * | 2021-12-31 | 2022-03-22 | 杭州三坛医疗科技有限公司 | Surgical robot navigation positioning method and device |
| CN115553923A (en) * | 2022-09-19 | 2023-01-03 | 重庆生物智能制造研究院 | Ankle joint surgical robot system and control method thereof |
Non-Patent Citations (2)
| Title |
|---|
| 李德欣;: "微创手术矫正拇外翻畸形", 中医正骨, no. 10, 20 October 2007 (2007-10-20), pages 62 * |
| 杨建玺;钱晋武;: "股骨骨折手术导航的特点及系统各坐标系之间的变换", 工程图学学报, no. 01, pages 78 - 82 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117297772A (en) * | 2023-11-30 | 2023-12-29 | 四川大学华西医院 | Method for planning hallux valgus operation of foot and related product |
| CN117297711A (en) * | 2023-11-30 | 2023-12-29 | 四川大学华西医院 | Reduction guide instrument for hallux valgus operation |
| CN117322951A (en) * | 2023-11-30 | 2024-01-02 | 四川大学华西医院 | Manufacturing method of thumb everting minimally invasive surgery guide plate, equipment and storage medium |
| CN117322951B (en) * | 2023-11-30 | 2024-02-09 | 四川大学华西医院 | Manufacturing method of thumb everting minimally invasive surgery guide plate, equipment and storage medium |
| CN117297772B (en) * | 2023-11-30 | 2024-02-13 | 四川大学华西医院 | Method for planning hallux valgus operation of foot and related product |
| CN117297711B (en) * | 2023-11-30 | 2024-02-20 | 四川大学华西医院 | Reduction guide instrument for hallux valgus operation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116919590B (en) | 2024-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116919590B (en) | Surgical robot control method, device and medium for hallux valgus minimally invasive surgery | |
| US11730544B2 (en) | Surgical systems and methods for facilitating ad-hoc intraoperative planning of surgical procedures | |
| JP5442993B2 (en) | 3D instrument path planning, simulation and control system | |
| JP2019122871A (en) | Master-to-slave orientation mapping when misaligned | |
| EP4090254A1 (en) | Systems and methods for autonomous suturing | |
| US20140171962A1 (en) | Registration and navigation using a three-dimensional tracking sensor | |
| CN111031933A (en) | Method and system for determining adjustment prescription of external fixation device | |
| WO2022188352A1 (en) | Augmented-reality-based interventional robot non-contact teleoperation system, and calibration method therefor | |
| CN113442169A (en) | Method and device for calibrating hands and eyes of robot, computer equipment and readable storage medium | |
| CN113524201B (en) | Active adjusting method and device for pose of mechanical arm, mechanical arm and readable storage medium | |
| WO2024140439A1 (en) | Surgical robot system and apparatus | |
| WO2023029922A1 (en) | Method and system for limiting movement area of robot | |
| US11666392B2 (en) | Device for guiding position of robot, method therefor, and system including the same | |
| AU2021228690A1 (en) | Methods and arrangements for external fixators | |
| US20240065774A1 (en) | Computer-assisted lower-extremity surgical guidance | |
| CN110772320A (en) | Registration method, registration device and computer readable storage medium | |
| KR101985915B1 (en) | System and method for controlling bone position using robot | |
| US20210030476A1 (en) | Medical system and medical system operating method | |
| CN115281802B (en) | Control method, equipment and system of puncture device | |
| CN115424701B (en) | Bone surface follow-up technology for optimal path planning | |
| JP2023116743A (en) | System and method for planning pedicle screw fixation | |
| US20220015844A1 (en) | Kinematics of wristed laparoscopic instruments | |
| CN214857401U (en) | Integrated system structure device | |
| JP7185901B2 (en) | Control device and control method for bone hole drill | |
| CN115227377A (en) | Positioning method, system, equipment and medium for surgical nail placement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |