CN114224498B - Master-slave control system for complex airway multi-mode tracheal intubation robot - Google Patents
Master-slave control system for complex airway multi-mode tracheal intubation robot Download PDFInfo
- Publication number
- CN114224498B CN114224498B CN202111523188.4A CN202111523188A CN114224498B CN 114224498 B CN114224498 B CN 114224498B CN 202111523188 A CN202111523188 A CN 202111523188A CN 114224498 B CN114224498 B CN 114224498B
- Authority
- CN
- China
- Prior art keywords
- information
- module
- matrix
- tail end
- master
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/35—Surgical robots for telesurgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M16/00—Devices for influencing the respiratory system of patients by gas treatment, e.g. mouth-to-mouth respiration; Tracheal tubes
- A61M16/04—Tracheal tubes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
- B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B2034/303—Surgical robots specifically adapted for manipulations within body lumens, e.g. within lumen of gut, spine, or blood vessels
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention relates to a master-slave control system for a complex airway multi-modal endotracheal intubation robot, which comprises: the master control end: the device comprises a control handle, a mouse and a keyboard which are respectively connected with an industrial personal computer; from the hand-executed end: the system comprises a soft lens delivery device for controlling the functional action of the tail end of the tracheal intubation robot and a multi-mode environment information acquisition device for acquiring operation site information; an industrial personal computer: the soft mirror delivery device is used for reading and processing the motion increment information generated by the control handle, converting the motion increment information of the control handle into pose increment information of the tail end of the control slave hand execution end and sending the pose increment information of the tail end to the soft mirror delivery device; a visualization assisting unit: the operation site information acquisition device is used for acquiring operation site information of a patient; a communication module: for communication between the respective components. Compared with the prior art, the method has the advantages of being easy to cooperate with multi-mode information monitoring, improving operation feeling and the like.
Description
Technical Field
The invention relates to the technical field of medical instruments, in particular to a master-slave control system of a multi-mode navigation trachea cannula robot for a complex airway.
Background
Endotracheal intubation is an operation usually performed by medical professionals before and after surgery in hospital operating rooms, for establishing an artificial airway for assisting the patient's breathing with a ventilator after the patient has not breathed spontaneously. What is more troublesome in the actual anesthesia is the clinical situation of complex airways, i.e. congenital dysplasia, structural changes of airways due to physiological or pathological causes. In the face of complex airway intubation surgery, because the treatment difficulty is high, a common hospital is difficult to provide a medical solution, so that a patient is gathered to a few large hospitals, and common doctors are more difficult to contact and learn to handle the situation, and therefore, the tracheal intubation robot system suitable for the complex airway is designed, and the medical pain point can be effectively relieved.
Considering the requirements of intuition and convenience for the operation of medical staff, the automatic intubation technology using multi-modal navigation is a better medical solution. The method is characterized in that the method assists a doctor to operate through visual assistance, target recognition, image splicing, depth information, three-dimensional reconstruction and other methods, and the intuitive feeling of the doctor operation can be improved; the trachea cannula operation is carried out by the cooperation of master-slave operation control and the soft lens propelling device to assist a doctor to remotely control, so that the defects that the operation does not conform to the habit of the doctor, the learning process is long, the popularization is difficult and the like caused by the insufficient ergonomic direction design of the conventional medical instrument can be improved.
And the master-slave control is that master hand equipment is introduced into the control end of the trachea cannula robot, the control end of the master hand is directly controlled by medical staff, the master hand sends an instruction to the slave hand execution end according to the operation of an operator to enable the slave hand to operate, and meanwhile, the slave hand feeds back field information such as vision, touch, hearing and the like to the medical staff through a sensor. By introducing a computer system into a control system, the design of a master hand and a slave hand can be considered according to respective functions and special requirements respectively, the robot system is different in structural design, and the actual operation control is in a master-slave mode with isomorphic effect, so that the robot system not only better accords with the operation habits of medical personnel, but also can better complete operation tasks, but the existing trachea cannula device generally lacks a teleoperation system or a control system for trachea cannula operation under the condition of a complex airway.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a master-slave control system for a complex airway multi-modal endotracheal intubation robot.
The purpose of the invention can be realized by the following technical scheme:
a master-slave control system for a complex airway multi-modal endotracheal intubation robot, the system comprising:
the master control end: the device comprises a control handle, a mouse and a keyboard which are respectively connected with an industrial personal computer, wherein the control handle is used as a main controller and used for generating motion increment information which enables a slave hand execution end to realize space motion in three motion freedom degrees;
from the hand-executed end: the system comprises a soft lens delivery device and a multi-mode environmental information acquisition device, wherein the soft lens delivery device is used for controlling the tail end of the trachea cannula robot to perform propelling, bending and rotating functional actions, and the multi-mode environmental information acquisition device is used for acquiring operation site information;
an industrial personal computer: the main processor is used for reading and processing the motion increment information generated by the control handle, converting the motion increment information of the control handle into pose increment information of the tail end of the control slave hand execution end according to an increment mapping rule, and sending the pose increment information of the tail end to the soft mirror delivery device;
a visualization assisting unit: the operation site information acquisition device is connected with an industrial personal computer and used for visually displaying the operation site information acquired by the multi-mode environment information acquisition device and displaying an operation interface, so that medical personnel and engineers can perform operation control on the upper computer through a mouse and a keyboard;
a communication module: the wireless communication system comprises a wired communication module and a wireless communication module which are used for realizing communication among all the parts respectively.
The soft lens delivery device comprises a main control board, and a propelling mechanism, a rotating mechanism, a twisting mechanism and a soft lens module which are respectively connected with the main control board, wherein the main control board is connected with the multi-mode environmental information acquisition device through a wireless communication module.
The propulsion mechanism and the rotating mechanism are respectively and correspondingly driven by a linear module servo motor and an integrated joint servo motor, the two servo motors are respectively connected with a D2 driver on the main control board, the D2 driver adopts an RS485 extension line to communicate with an industrial personal computer, and parameter reading and writing are carried out through a Modbus serial communication protocol.
The torsion mechanism is driven by an integrated steering engine, and the integrated steering engine is directly connected with an industrial personal computer to realize the control of the steering engine.
The operation site information collected by the multi-mode environmental information collection device comprises image information, depth information, sound information and carbon dioxide concentration information, wherein the image information is obtained by a depth camera arranged at the tail end of a soft lens module, the sound information is obtained by a sound detection module arranged at the tail end of the soft lens module, and the carbon dioxide concentration information is obtained by a carbon dioxide micro-sidestream monitoring module.
When carrying out complicated tracheal intubation operation, trachea cannula robot debugs to initial position and disposes soft mirror module, accomplish the preparation before teleoperation trachea cannula operation, when formally beginning to carry out teleoperation trachea cannula operation back, the terminal degree of depth camera of soft mirror module and the terminal environmental information of real-time incessant collection soft mirror module of sound detection module, including image information, degree of depth information and sound information, provide medical personnel and carry out vision navigation assistance and incessant anatomical structure tracking assistance after handling and the integration, medical personnel pass through the control handle of control master operation end under the assistance of vision navigation auxiliary information, control the soft mirror module of slave operation end and constantly impel to the trachea.
The front-back pitch angle theta of the control handle 1 The left-right inclination angle theta of the handle is controlled corresponding to the up-down pitch angle at the tail end of the soft lens module 2 Corresponding to the left and right bending degree of the tail end of the soft lens module, the advancing and retreating depths of the control handle key correspond to the advancing speed of the tail end of the soft lens module, wherein the key depth of the control handle is x 1 The depth of an advancing key is positive, the depth of a retreating key is negative, the industrial personal computer generates a main hand end operation matrix A after obtaining motion increment information generated by the control handle, the main hand end operation matrix A is mapped to an expected tail end displacement matrix B through a transformation matrix T, and B = T multiplied by A, the industrial personal computer transmits the expected tail end displacement matrix B to the visual auxiliary unit in real time for display, and the expected tail end displacement matrix B is displayed and is transmitted to the visual auxiliary unit in real timeThe tail end displacement matrix B is decomposed into products of three matrixes and respectively corresponds to the twisting, bending and propelling actions of the soft lens delivery device, the integrated steering engine, the integrated joint servo motor and the linear module servo motor feed back actual displacement information through the encoder and transmit the actual displacement information to the main control board and transmit the actual displacement information to the industrial personal computer through the wireless communication module, the industrial personal computer performs filtering processing on the obtained actual displacement information and combines the actual displacement information to generate an actual motion matrix C, a feedback adjustment matrix D is obtained by comparing the expected tail end displacement matrix B with the actual motion matrix C, and then the feedback adjustment matrix D and the next-time main hand end operation matrix A are combined t Combined and mapped to the next time desired end displacement matrix B through the transformation matrix T t 。
The industrial computer transmits the expected terminal displacement matrix B to the visual auxiliary unit in real time for display and decomposes the expected terminal displacement matrix B into products of three matrixes, and then the products have the following functions:
B＝X×Y×Z
X＝k 1 X 0
Y＝k 2 Y 0
Z＝k 3 Z 0
wherein X is a desired tip twist matrix, Y is a desired tip displacement matrix, Z is a desired tip advance matrix, X 0 As an integrated steering engine motion matrix, Y 0 As an integral joint servo motor motion matrix, Z 0 Is a linear module servo motor motion matrix, k 1 ，k 2 ，k 3 Respectively coefficient matrices.
When the surgery condition is more complicated, medical personnel further analyze and process the current environment condition through the visual field expanding navigation module and the three-dimensional airway environment construction module of the industrial personal computer, wherein, the visual field expanding navigation module widens the visual field obtained by the medical personnel through image splicing so that the medical personnel can judge and process, the three-dimensional airway environment construction module carries out three-dimensional reconstruction of the environment in the airway according to the visual information and the depth information in the adjacent time period so as to enable the medical personnel to know the environment condition in the airway more intuitively.
When the operation condition is further complicated, when meetting the operation condition that visual information can't the auxiliary treatment completely promptly, medical personnel obtain carbon dioxide partial pressure concentration information and show its waveform in the display through carbon dioxide little by-pass flow monitoring module, if observe continuous stable carbon dioxide square wave, it is glottic direction to explain this direction very probably, and medical personnel obtain the sound information near soft mirror module end through sound detection module, when soft mirror module end aims at the air current direction, if the air current sends clear sharp whistle sound when the terminal gas passage of soft mirror module, then explain this direction very probably is glottic direction.
Compared with the prior art, the invention has the following advantages:
the master-slave control system of the tracheal intubation surgical robot is used for the clinical situations of complex airways and the like, can assist a doctor to remotely control a tracheal intubation operation by matching master-slave operation control with the soft lens propelling device, and can improve the defect that the operation does not conform to the habit of the doctor due to the insufficient ergonomic direction design of the existing medical equipment. In addition, the method can assist the doctor in operating by combining visual assistance, target recognition, image splicing, depth information, three-dimensional reconstruction, carbon dioxide assisted positioning and other methods, and effectively improves the visual feeling of the doctor in operating.
Drawings
Fig. 1 is a schematic view of a usage scenario of a multi-modal navigation intubation robot system for complex airways.
Fig. 2 is a functional module diagram of a master-slave control system of the trachea cannula robot.
Fig. 3 is a control flow chart of the master-slave control system of the trachea cannula robot.
Fig. 4 is a schematic view of the external structure of the master hand control end.
Fig. 5 is a schematic diagram of the external structure of the slave hand-operated end.
The notation in the figure is:
1000. the robot comprises a master hand control end, 1100, a display screen, 1200, a control handle, 1300, an industrial personal computer, 1400, universal wheels, 1500, a mouse keyboard, 2000, a breathing machine, 3000, an operating table, 4000, a slave hand execution end, 4100, a delivery device, 4200, an electric cabinet, 4300, a six-degree-of-freedom cooperative mechanical arm, 4400 and a navigation instrument box.
Detailed Description
To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. The terms "vertical," "horizontal," "left," "right," and the like as used herein are for illustrative purposes only and do not represent the only embodiments.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
As shown in fig. 1, 4 and 5, the present invention provides a master-slave control system for a complex airway multi-modal endotracheal intubation robot, which includes a master hand control end 1000, a display screen 1100, a control handle 1200, an industrial personal computer 1300, a universal wheel 1400, a mouse keyboard 1500, a ventilator 2000, an operating table 3000, a slave hand execution end 4000, a delivery device 4100, an electric cabinet 4200, a six-degree-of-freedom cooperative mechanical arm 4300 and a navigation instrument box 4400.
As shown in fig. 2, the master-slave control system is in a manual and semi-automatic dual control mode, in the manual mode, medical staff operate the control handle to send a control command to the industrial personal computer according to the position information and navigation auxiliary information of the end of the soft lens module on the display screen, and after the industrial personal computer processes the information, the execution mechanism is directly controlled through the control command, or the execution mechanism is controlled through the control command of the slave control system; in the semi-automatic mode, part of control instructions are sent by the main control system to complete the control of the execution mechanism.
Specifically, the operation process of the master-slave control system in the manual mode is as follows:
medical personnel debug hose robot to initial position according to the operation requirement to dispose soft mirror module, begin afterwards to formally carry out teleoperation trachea cannula operation.
Firstly, the depth camera and other sensors at the tail end of the soft lens module continuously provide visual information, depth information, sound and other environment information of the tail end environment of the soft lens module, and the obtained information is directly transmitted to the industrial personal computer through the data line/wireless module. After the industrial personal computer obtains information, the information is processed by the internal anatomy structure uninterrupted tracking module, the vision field expanding navigation module and the three-dimensional airway environment construction module to obtain auxiliary navigation information, and the auxiliary navigation information is transmitted to the display screen through the data line and is provided for medical personnel to operate and reference.
When a complex operation condition is met, the medical staff can control the visual field expanding navigation module and the three-dimensional airway environment construction module to further analyze and process the current environment condition, wherein the visual field expanding navigation module can widen the visual field obtained by the medical staff through an image splicing method, and the medical staff can conveniently judge and process the visual field. The three-dimensional airway environment construction module can carry out three-dimensional reconstruction of the environment in the airway according to visual information and depth information in adjacent time periods, and can more intuitively help medical workers to know the environment condition in the airway.
When a particularly complex operation condition is met, namely the operation condition that visual information can not be assisted completely is met, the medical personnel can also control the modules for detecting the environmental information in a multi-mode manner, such as carbon dioxide detection, sound detection and the like. The carbon dioxide detection module can acquire CO2 partial pressure concentration information through the CO2 micro-bypass flow monitoring module and display the waveform of the information in the display, and if continuous and stable CO2 square waves are observed, the direction is most likely to be the glottis direction. The sound detection module can acquire sound information near the tail end of the soft lens, when the tail end of the soft lens is aligned to the direction of the airflow, the airflow can generate larger whistle when passing through a narrow air channel at the tail end of the soft lens, and if the clearer whistle is acquired, the direction is probably the glottis direction.
Subsequently, as shown in fig. 3, the medical staff operates the displacement of the end of the soft lens module by controlling the control handle of the control end of the main hand with the aid of the navigation information. The front and back pitching of the control handle corresponds to the up and down pitching of the tail end of the soft lens module, the left and right tilting of the control handle corresponds to the left and right bending of the tail end of the soft lens module, and the depth of the control handle key corresponds to the propelling speed of the tail end of the soft lens module. Wherein the front-back pitch angle of the control handle is theta 1 The left and right inclination angle of the control handle is theta 2 The depth of the key of the control handle is x 1 The forward key depth is recorded as positive, and the backward key depth is recorded as negative.
Meanwhile, the control handle transmits the obtained displacement information of the main hand end to an industrial personal computer of the main control system through a data line, and the industrial personal computer performs filtering processing on the obtained displacement information and combines the information to generate a main hand end operation matrix A. And then the industrial personal computer maps the main hand end operation matrix A to an expected end displacement matrix B through a transformation matrix T according to requirements, wherein B = T multiplied by A.
And after the expected terminal displacement matrix B is obtained, the industrial personal computer transmits the obtained expected terminal displacement matrix B to the monitoring module in real time and carries out visual display through a designed interface. Meanwhile, the industrial personal computer decomposes the expected terminal displacement matrix B into products of three matrixes according to requirements, and the products correspond to torsion, bending (rotation) and propulsion of the soft lens delivery device respectively, namely the integrated steering engine, the integrated joint servo motor and the linear module servo motor are driven, namely B = X multiplied by Y multiplied by Z, and X = k 1 X 0 ，Y＝k 2 Y 0 ，Z＝k 3 Z 0 Where B is the desired tip displacement matrix, X is the desired tip twist matrix, Y is the desired tip displacement matrix, and Z is the desired tip pushInto a matrix, X 0 As an integrated steering engine motion matrix, Y 0 As an integral joint servo motor motion matrix, Z 0 Is a linear module servo motor motion matrix, k 1 ，k 2 ，k 3 Is a matrix of coefficients. And obtaining the driving data of the motor according to the coefficient matrix, and further driving the motor to move.
Subsequently, the encoder is all installed to integration steering wheel, integration joint servo motor and sharp module servo motor and is used for the actual motion condition of feedback motor, and the encoder transmits the actual displacement information who obtains to the main control board on to transmit to the industrial computer through wireless module. And the industrial personal computer performs filtering processing on the obtained actual displacement information and combines the actual displacement information to generate an actual motion matrix C. Obtaining a feedback adjusting matrix D by comparing the expected tail end displacement matrix B with the actual motion matrix C, and then comparing the feedback adjusting matrix D with a next primary hand end operation matrix A t Combined and mapped to the next time desired end displacement matrix B through the transformation matrix T t 。
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (5)
1. A master-slave control system for a complex airway multi-modal endotracheal intubation robot, the system comprising:
the master control end: the device comprises a control handle, a mouse and a keyboard which are respectively connected with an industrial personal computer, wherein the control handle is used as a main controller and used for generating motion increment information which enables a slave hand execution end to realize space motion in three motion freedom degrees;
from the hand execution side: the system comprises a soft lens delivery device and a multi-mode environmental information acquisition device, wherein the soft lens delivery device is used for controlling the tail end of the trachea cannula robot to perform propelling, bending and rotating functional actions, and the multi-mode environmental information acquisition device is used for acquiring operation site information;
an industrial personal computer: the main processor is used for reading and processing the motion increment information generated by the control handle, converting the motion increment information of the control handle into pose increment information of the tail end of the control slave hand execution end according to an increment mapping rule, and sending the pose increment information of the tail end to the soft lens delivery device;
a visualization assisting unit: the operation site information acquisition device is connected with an industrial personal computer and used for visually displaying the operation site information acquired by the multi-mode environment information acquisition device and displaying an operation interface, so that medical personnel and engineers can perform operation control on the upper computer through a mouse and a keyboard;
a communication module: the system comprises a wired communication module and a wireless communication module, which are used for realizing the communication among all the parts respectively;
the soft lens delivery device comprises a main control board, and a propelling mechanism, a rotating mechanism, a twisting mechanism and a soft lens module which are respectively connected with the main control board, wherein the main control board is connected with the multi-mode environmental information acquisition device through a wireless communication module;
the operation site information collected by the multi-mode environmental information collection device comprises image information, depth information, sound information and carbon dioxide concentration information, wherein the image information is obtained by a depth camera arranged at the tail end of the soft lens module, the sound information is obtained by a sound detection module arranged at the tail end of the soft lens module, and the carbon dioxide concentration information is obtained by a carbon dioxide micro-bypass monitoring module;
when a complicated trachea cannula operation is carried out, the trachea cannula robot is debugged to an initial position and is configured with a soft lens module, the preparation before the teleoperation trachea cannula operation is finished, after the teleoperation trachea cannula operation is formally carried out, a depth camera and a sound detection module at the tail end of the soft lens module continuously acquire environmental information at the tail end of the soft lens module in real time, wherein the environmental information comprises image information, depth information and sound information, the environmental information is processed and integrated and then is provided for medical workers to carry out visual navigation assistance and uninterrupted anatomical structure tracking assistance, and the medical workers control the soft lens module at the slave hand execution end to continuously push towards the trachea by controlling a control handle at the master hand operation end under the assistance of the visual navigation assistance information;
the front-back pitch angle theta of the control handle 1 The left-right inclination angle theta of the handle is controlled corresponding to the up-down pitch angle at the tail end of the soft lens module 2 Corresponding to the left and right bending degree of the tail end of the soft lens module, the advancing and retreating depths of the control handle key correspond to the advancing speed of the tail end of the soft lens module, wherein the key depth of the control handle is x 1 The depth of an advancing key is positive, the depth of a retreating key is negative, an industrial personal computer generates a main hand end operation matrix A after motion increment information generated by a control handle is obtained, the main hand end operation matrix A is mapped to an expected tail end displacement matrix B through a transformation matrix T, and B = T multiplied by A, the industrial personal computer transmits the expected tail end displacement matrix B to a visual auxiliary unit in real time for display, decomposes the expected tail end displacement matrix B into products of three matrixes, respectively corresponds to twisting, bending and propelling actions of a soft mirror delivery device, an integrated steering engine, an integrated joint servo motor and a linear module servo motor feed back actual displacement information through an encoder and transmit the actual displacement information to a main control board, the actual displacement information is transmitted to the industrial personal computer through a wireless communication module, the obtained actual displacement information is subjected to filtering processing and then is combined to generate an actual motion matrix C, and a feedback adjustment matrix D and the next-time main hand end operation matrix A are obtained by comparing the expected tail end displacement matrix B and the actual motion matrix C t Combined and mapped to the expected end displacement matrix B of the next time through the transformation matrix T t ；
When the operation condition is further complicated, when meetting the operation condition that visual information can't the auxiliary treatment completely promptly, medical personnel obtain carbon dioxide partial pressure concentration information and show its waveform in the display through carbon dioxide little bypass flow monitoring module, if observe continuous stable carbon dioxide square wave, it is glottic direction to explain the terminal direction of soft mirror module extremely probably, and medical personnel obtain the sound information near soft mirror module end through sound detection module, when soft mirror module end aims at the air current direction, if the air current sends clear whistle sound when the terminal gas passage of soft mirror module, then explain that this direction is extremely probably glottic direction.
2. The master-slave control system for the complex airway multi-modal endotracheal intubation robot according to claim 1, wherein the propulsion mechanism and the rotation mechanism are respectively driven by a linear module servo motor and an integrated joint servo motor, the two servo motors are respectively connected with a D2 driver on the master control board, and the D2 driver is communicated with an industrial personal computer by an RS485 extension line and performs parameter reading and writing through a Modbus serial communication protocol.
3. The master-slave control system for the complex airway multi-modal tracheal intubation robot according to claim 1, wherein the torsion mechanism is driven by an integrated steering engine, and the integrated steering engine is directly connected with an industrial personal computer to realize the control of the steering engine.
4. The master-slave control system for the complex airway multi-modal endotracheal intubation robot according to claim 1, wherein the industrial personal computer transmits the desired tip displacement matrix B to the visualization auxiliary unit for display in real time and decomposes the desired tip displacement matrix B into the product of three matrices, then:
B＝X×Y×Z
X＝k 1 X 0
Y＝k 2 Y 0
Z＝k 3 Z 0
wherein X is a desired tip twist matrix, Y is a desired tip displacement matrix, Z is a desired tip advance matrix, X 0 As an integrated steering engine motion matrix, Y 0 As an integral joint servo motor motion matrix, Z 0 Is a linear module servo motor motion matrix, k 1 ，k 2 ，k 3 Respectively coefficient matrices.
5. The master-slave control system for the complex airway multi-modal tracheal intubation robot according to claim 1, wherein when the surgical situation is complex, medical staff further analyzes and processes the current environmental situation through a vision field expansion navigation module and a three-dimensional airway environment construction module of an industrial personal computer, wherein the vision field expansion navigation module expands the vision field obtained by the medical staff through image splicing so that the medical staff can judge and process the vision field, and the three-dimensional airway environment construction module performs three-dimensional reconstruction of the environment in the airway according to the visual information and the depth information in adjacent time periods so that the medical staff can know the environmental situation in the airway more intuitively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111523188.4A CN114224498B (en) | 2021-12-13 | 2021-12-13 | Master-slave control system for complex airway multi-mode tracheal intubation robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111523188.4A CN114224498B (en) | 2021-12-13 | 2021-12-13 | Master-slave control system for complex airway multi-mode tracheal intubation robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114224498A CN114224498A (en) | 2022-03-25 |
| CN114224498B true CN114224498B (en) | 2023-04-18 |
Family
ID=80755535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111523188.4A Active CN114224498B (en) | 2021-12-13 | 2021-12-13 | Master-slave control system for complex airway multi-mode tracheal intubation robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114224498B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114767268B (en) * | 2022-03-31 | 2023-09-22 | 复旦大学附属眼耳鼻喉科医院 | Anatomical structure tracking method and device suitable for endoscope navigation system |
| CN114699169A (en) * | 2022-03-31 | 2022-07-05 | 复旦大学附属眼耳鼻喉科医院 | Multi-mode navigation intubation system |
| CN117481801A (en) * | 2023-10-26 | 2024-02-02 | 北京瞳沐医疗科技有限公司 | Image-based ophthalmic robot control method, system, equipment and medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106413522A (en) * | 2014-01-24 | 2017-02-15 | 数字内镜检查股份有限公司 | Tracking the fundamental frequency of a voice signal in real time |
| CN109645960A (en) * | 2019-01-15 | 2019-04-19 | 浙江大学 | The physiological parameter generating device and its method of anthropomorphic robot |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1299650C (en) * | 2005-03-11 | 2007-02-14 | 天津大学 | Micro surgery operation robot control system with force sense |
| EP3459579A1 (en) * | 2012-11-15 | 2019-03-27 | The Trustees of the University of Pennsylvania | Nasal pulsatile oxygenation and ventilation airway apparatus |
| CN203468740U (en) * | 2013-08-07 | 2014-03-12 | 吴开俊 | Auxiliary manipulator system for flexible ureteroscope operation |
| CN204411441U (en) * | 2014-12-03 | 2015-06-24 | 于冬梅 | A kind of oxygen uptake for out operating-room anesthesia is held concurrently end-expiratory carbon dioxide detected catheter |
| CN108159541A (en) * | 2018-02-13 | 2018-06-15 | 李武兰 | A kind of trachea cannula guiding device |
| CN113318317A (en) * | 2021-06-26 | 2021-08-31 | 上海市第七人民医院(上海中医药大学附属第七人民医院) | Visual intubate system is assisted to air current |
| CN113769222A (en) * | 2021-09-13 | 2021-12-10 | 连云港市第一人民医院 | Visual trachea cannula with flushing and sucking functions |
-
2021
- 2021-12-13 CN CN202111523188.4A patent/CN114224498B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106413522A (en) * | 2014-01-24 | 2017-02-15 | 数字内镜检查股份有限公司 | Tracking the fundamental frequency of a voice signal in real time |
| CN109645960A (en) * | 2019-01-15 | 2019-04-19 | 浙江大学 | The physiological parameter generating device and its method of anthropomorphic robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114224498A (en) | 2022-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114224498B (en) | Master-slave control system for complex airway multi-mode tracheal intubation robot | |
| CN111588472B (en) | Surgical robot system | |
| CN105411681B (en) | The hand eye coordination control system and method for split type micro-wound operation robot | |
| KR102306959B1 (en) | Surgical robot and control method thereof | |
| WO2018214840A1 (en) | Surgical robot system, and method for displaying position of surgical instrument | |
| US8706301B2 (en) | Obtaining force information in a minimally invasive surgical procedure | |
| JP5384108B2 (en) | Remote control system | |
| US20140058564A1 (en) | Visual force feedback in a minimally invasive surgical procedure | |
| EP3613547A1 (en) | Synthetic representation of a surgical robot | |
| WO2022002159A1 (en) | Master-slave motion control method, robot system, device, and storage medium | |
| EP4306057A1 (en) | Portable remote ultrasound scanning system and compliance control method for safe ultrasound scanning | |
| CN106137399A (en) | A kind of operating robot integrated control system based on embedded computer | |
| CN107753109A (en) | Concentric tube robot device and its control method | |
| CN209474796U (en) | Surgical assistant system suitable for soft lens | |
| CN110215287A (en) | A kind of master-slave mode medical treatment control system | |
| CN113616333A (en) | Catheter movement assistance method, catheter movement assistance system, and readable storage medium | |
| US20230293252A1 (en) | Master-slave motion control method, robot system, device, and storage medium | |
| JP2004129782A (en) | Surgical manipulator and its operation input apparatus | |
| Ma et al. | Augmented reality-assisted autonomous view adjustment of a 6-DOF robotic stereo flexible endoscope | |
| KR20130015441A (en) | Surgical robot system | |
| CN112890954B (en) | Mechanical arm motion control method and system and surgical operation system | |
| CN114452003B (en) | Surgical robot | |
| CN219846789U (en) | surgical robot system | |
| US20230278222A1 (en) | Robotic system for remote operation of equipment in infectious environments | |
| CN114699169A (en) | Multi-mode navigation intubation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CB03 | Change of inventor or designer information |
Inventor after: Li Wenxian Inventor after: Wang Jiawei Inventor after: Wang Hongbo Inventor after: Han Yuan Inventor after: Luo Jingjing Inventor after: Cheng Qiying Inventor after: Pan Qiqi Inventor after: Zhou Haoyu Inventor after: Jia Xiaoxu Inventor before: Luo Jingjing Inventor before: Wang Jiawei Inventor before: Wang Hongbo Inventor before: Cheng Qiying Inventor before: Pan Qiqi Inventor before: Zhou Haoyu Inventor before: Jia Xiaoxu |
|
| CB03 | Change of inventor or designer information |