CN215458144U - Full-automatic B-ultrasonic inspection robot system - Google Patents

Full-automatic B-ultrasonic inspection robot system Download PDF

Info

Publication number
CN215458144U
CN215458144U CN202120775236.8U CN202120775236U CN215458144U CN 215458144 U CN215458144 U CN 215458144U CN 202120775236 U CN202120775236 U CN 202120775236U CN 215458144 U CN215458144 U CN 215458144U
Authority
CN
China
Prior art keywords
robot
control host
detection device
patient
ultrasonic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN202120775236.8U
Other languages
Chinese (zh)
Inventor
钟林红
姚凯文
李春泉
刘小平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanchang University
Original Assignee
Nanchang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanchang University filed Critical Nanchang University
Priority to CN202120775236.8U priority Critical patent/CN215458144U/en
Application granted granted Critical
Publication of CN215458144U publication Critical patent/CN215458144U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Ultra Sonic Daignosis Equipment (AREA)
  • Manipulator (AREA)

Abstract

The utility model provides a full-automatic B-ultrasonic inspection robot system which comprises a platform, a robot, a depth camera and a control host, wherein the depth camera is connected with the input end of the control host, the robot is connected with the output end of the control host, the robot has six or more degrees of freedom, an end effector of the robot is connected with an ultrasonic detection device and a force detection device, and the ultrasonic detection device and the force detection device are both connected with the input end of the control host. The present invention can be performed without a professional technician or a doctor for B-ultrasonic examination. The B-ultrasonic robot system provided by the utility model has the characteristics of intelligence, easiness in operation and high efficiency.

Description

Full-automatic B-ultrasonic inspection robot system
Technical Field
The utility model relates to the technical field of robots, in particular to a full-automatic B-ultrasonic inspection robot system.
Background
B-ultrasonic detection is an important technical means for acquiring the health condition of human organs, however, the existing B-ultrasonic detection equipment needs personnel with professional knowledge to operate, so that the B-ultrasonic detection efficiency is greatly reduced; moreover, when epidemic outbreaks or other high-contagious diseases occur, it is necessary to ensure the health and safety of detection personnel, and in recent years, the robot industry is rapidly developed and widely applied in the medical field, so that the robot is beneficial and possible to complete the task.
SUMMERY OF THE UTILITY MODEL
The utility model aims to provide a full-automatic B-ultrasonic inspection robot system which has the characteristics of easiness in operation and high efficiency.
The technical scheme adopted by the utility model is as follows:
the utility model provides a full-automatic B ultrasonic inspection robot system, includes platform, robot, degree of depth camera and main control system, the degree of depth camera is connected with main control system's input, the robot is connected with main control system's output, the robot has six or above degrees of freedom, the end effector of robot is connected with ultrasonic detection device and power detection device, ultrasonic detection device and power detection device all are connected with main control system's input.
Furthermore, marks are arranged on the platform and used for positioning the patient by the depth camera and establishing a coordinate system for posture change by the robot.
Furthermore, the platform is also provided with a fixing device for fixing the position of the patient so as to ensure that the position of the patient cannot change in the operation process of the system.
Furthermore, the depth camera is used for obtaining the body image information and the distance information of the patient, the distance from any pixel point in the visual field to the depth camera can be obtained, and after the patient lies on the platform flatly and shoots the patient, the data are sent to the control host in a unified mode.
Further, the control host calculates the approximate positions of the organs to be detected according to the actual body types of the patients, generates the moving tracks and postures of the robot end effector on the patients, converts the data into a series of arm joint angle data and sends the arm joint angle data to the robot.
Further, the robot end effector sends contact force information collected by the force detection device to the control host computer when moving on a human body according to a track sent by the control host computer, and the control host computer corrects the track position according to the actual force and the expected force.
Furthermore, the robot movement is simultaneously carried out by acquiring the human organ information in real time by the ultrasonic detection device, and sending the information to the control host for recording.
Further, the system is provided with an emergency stop button for moving the robot away from the body in the z-axis direction when pressed.
Compared with the prior art, the utility model has the following advantages and beneficial effects:
1) the full-automatic operation of the utility model does not need to increase the learning cost of personnel, only needs the first installation and debugging, and then only needs the self-operation of the patient, and the B-ultrasonic robot can automatically complete the B-ultrasonic examination.
2) The utility model can effectively reduce the risk of spreading infectious diseases caused by doctor-patient contact, and doctors can remotely see the doctor without contacting the patient.
3) The utility model has stronger safety performance, can not only detect the magnitude of the pressing force and automatically stop working when the force is large, but also can be added with an emergency brake button, so that the patient can automatically stop the working of the B-ultrasonic robot when feeling uncomfortable, thereby ensuring the personal safety of the patient.
Drawings
FIG. 1 is an overall configuration diagram of a B-ultrasonic inspection robot system according to the present invention;
FIG. 2 is a diagram of a working scenario of the system of the present invention;
FIG. 3 is a diagram of the complete operation process of the B-ultrasonic inspection robot system of the present invention.
The system comprises a robot 1, an ultrasonic detection device 2, a depth camera 3, a platform 4, a marker 5 and a control host 6.
Detailed Description
In order to make the technical problem and the technical solution to be solved by the present invention clearer, a fully automatic B-ultrasonic inspection robot system provided by the present invention is described in detail below with reference to the accompanying drawings and embodiments, and the detailed description is for explanation and not limitation of the present invention.
Referring to fig. 1-3, a full-automatic B-ultrasonic inspection robot system, the overall structure of which is shown in fig. 1, uses a six-degree-of-freedom universal robot arm to perform full-automatic ultrasonic inspection on a patient, and includes a platform 4, a robot 1, a depth camera 3 and a control host 6. The robot 1 is used for carrying out full-automatic ultrasonic examination on the patient, and the B-ultrasonic examination can be carried out on the patient in a full-automatic manner without the intervention of doctors or other professionals in the whole process. An ultrasonic detection device 2 and a force detection device are simultaneously connected to an end effector of the robot 1. The system uses the depth camera 3 to position the body position of the patient, analyzes the approximate positions of the organs to be detected according to the body type of the patient, and then sorts and sends depth information to the control host 6 to control the position and the posture of the mechanical arm of the robot 1. The flexible contact between the mechanical arm and the skin of the patient is achieved by adopting an impedance control algorithm. In order to provide a perfect reliability of the detected information, the end-effector of the mechanical arm will remain perpendicular to the patient's skin throughout the entire operation and exert a constant and appropriate force on the latter.
The patient should lie on a specific platform 4 when carrying out B ultrasonic examination, should have special mark 5 simultaneously by this platform 4 can make things convenient for depth camera 3 to fix a position the patient, still need have the position of device fixed patient in order to guarantee that its position can not change in addition, and the arm will also utilize these mark 5 to establish the coordinate system and carry out the gesture change.
The robotic arm used for surgery should have six or more degrees of freedom because six degrees of freedom are free to flexibly reach various positions in space and make a specified pose. For the purpose of detection, the end effector is provided with an ultrasonic detection device 2, and for the purpose of detection accuracy and patient comfort, the end effector is also provided with a force sensor or other sensors, so that the ultrasonic detection device 2 is always perpendicular to the contact surface of the ultrasonic detection device and a human body in the operation process of the mechanical arm, and a constant force with a proper magnitude is applied.
The contour of the human body is acquired by the depth camera 3, and the distance value from any pixel point in the visual field to the depth camera 3 can be acquired. The depth camera 3 obtains corresponding data by taking a picture of a patient lying on the platform 4, and the data is uniformly sent to the control host 6 to perform the desired control on the mechanical arm.
After obtaining the image information and the distance information of the patient body, the control host 6 analyzes the outline of the upper half of the patient body according to some characteristics of the human body surface by using an image recognition technology, and simulates a three-dimensional human body surface by combining the distance information.
According to the obtained human body surface data and the positioning marks 5, the control host 6 calculates the approximate positions of the organs to be detected according to the actual body type data of the patient, generates the moving track and posture of the robot end effector on the patient, converts the Cartesian space coordinate track data into a series of mechanical arm joint angle data and sends the mechanical arm joint angle data to the robot 1.
The robot end effector simultaneously sends contact force information collected by the force sensor to the control host 6 when the robot end effector moves on a human body according to a track sent by the control host 6, and the control host 6 corrects the track position according to actual force and expected force, so that the effect of inputting expected vertical force is achieved.
While the robot end effector moves according to the trajectory, the position of the end effector in the z-axis (i.e., perpendicular to the platform surface) needs to be changed in order to ensure that the force is constant. In order to ensure that the ultrasonic detection device 2 is perpendicular to the surface of the human body, the control host 6 calculates the normal of the contact surface of the current end effector and the human body in real time according to the z-axis coordinates output twice before and after, takes the normal as the attitude of the end effector, calculates inverse kinematics, and sends the joint angle to the robot 1. The robot 1 will move to the designated position and repeat the whole process until it reaches the end of the trajectory and leaves the body surface.
The robot 1 moves and simultaneously the ultrasonic detection device 2 acquires the human organ information in real time, and the information is sent to the control host 6 and recorded. If the measured organ image is not available, the robot 1 can be moved from the beginning until it meets the observation requirements; it may also be required to re-acquire an image of an organ separately.
The robot 1 should be guaranteed to output a constant and appropriate amount of force during the movement, and if the robot 1 for some reason outputs a force exceeding a threshold value or the detected patient feels uncomfortable to select to stop actively, the control host 6 will automatically move the robot 1 away from the human body along the z-axis direction. The system will set an emergency stop button to ensure patient safety.
The complete working process of the system is shown in fig. 3, and the specific implementation mode is as follows:
step 1, when starting, a patient lies on a special platform 4 and is fixed by a fixing device, so that the position of the patient is prevented from changing in the operation process of the robot 1.
And 2, starting an image acquisition program of the depth camera 3 at the control host 6, and sending the image information and the depth information to the control host 6 after the depth camera 3 finishes collecting the image information and the depth information.
And 3, combining the image information and the depth information by the control host 6 and processing the combined image information and the depth information into a three-dimensional human body upper body surface model.
And 4, deducing the distribution of each organ according to the body type of the patient by the control host 6 on the basis of the model, and planning the motion track of the robot 1.
And 5, according to the formed motion track, the control host 6 sends a control instruction to the robot 1, and the robot 1 moves to an initial position and starts to contact the surface of the human body.
And 6, after the movement starts, the robot 1 feeds back actual contact force information to the control host 6 in real time, the control host 6 adjusts the track obtained in the step 4 by using the impedance controller according to the error between the expected contact force and the actual contact force, and sends a control command to the robot 1.
And 7, simultaneously with the step 6, the control host 6 also adjusts the posture of the robot 1 in real time according to the position of the robot end effector on the surface of the human body, so that the robot is always vertical to the surface of the human body.
And 8, continuously returning the images to the control host 6 by the ultrasonic detection device 2 for recording in the running process of the robot 1.
And 9, after the robot 1 reaches the tail end of the track under the instruction of the control host 6, the robot is far away from the human body in the z-axis direction and then returns to the initial position. One duty cycle is completed.
The above embodiments are merely illustrative of the present invention and are not to be construed as limiting the utility model.

Claims (8)

1. A full-automatic B-ultrasonic inspection robot system is characterized in that: including platform, robot, degree of depth camera and main control system, the degree of depth camera is connected with the input of main control system, the robot is connected with the output of main control system, the robot has six or above degrees of freedom, the end effector of robot is connected with ultrasonic detection device and power detection device, ultrasonic detection device and power detection device all are connected with the input of main control system.
2. The fully automatic B-ultrasonic inspection robot system according to claim 1, wherein: the platform is provided with a mark for positioning a patient by the depth camera and for establishing a coordinate system for posture change by the robot.
3. The fully automatic B-ultrasonic inspection robot system according to claim 1, wherein: the platform is also provided with a fixing device for fixing the position of a patient so as to ensure that the position of the patient cannot change in the operation process of the system.
4. The fully automatic B-ultrasonic inspection robot system according to claim 1, wherein: the depth camera is used for obtaining image information and distance information of a patient body, the distance from any pixel point in a visual field to the depth camera can be obtained, and after the patient lies on the platform flatly and shoots, the data are sent to the control host in a unified mode.
5. The fully automatic B-ultrasonic inspection robot system according to claim 4, wherein: the control host calculates the approximate positions of the organs to be detected according to the actual body types of the patients, generates the moving tracks and postures of the robot end effector on the patients, converts the data into a series of mechanical arm joint angle data and sends the data to the robot.
6. The fully automatic B-ultrasonic inspection robot system according to claim 5, wherein: the robot end effector simultaneously sends contact force information collected by the force detection device to the control host when the robot end effector moves on a human body according to a track sent by the control host, and the control host corrects the track position according to actual force and expected force.
7. The fully automatic B-ultrasonic inspection robot system according to claim 6, wherein: and the robot moves, and simultaneously, the ultrasonic detection device acquires the information of the human organs in real time and sends the information to the control host for recording.
8. A fully automatic B-ultrasonic inspection robot system according to any one of claims 1 to 7, characterized in that: the system is also provided with an emergency stop button for moving the robot away from the body in the z-axis direction when pressed.
CN202120775236.8U 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system Expired - Fee Related CN215458144U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202120775236.8U CN215458144U (en) 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202120775236.8U CN215458144U (en) 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system

Publications (1)

Publication Number Publication Date
CN215458144U true CN215458144U (en) 2022-01-11

Family

ID=79774766

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202120775236.8U Expired - Fee Related CN215458144U (en) 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system

Country Status (1)

Country Link
CN (1) CN215458144U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114848019A (en) * 2022-04-19 2022-08-05 山东大学 Automatic heart ultrasonic detection system and method based on flexible cooperative robot
CN117731324A (en) * 2024-02-21 2024-03-22 北京智源人工智能研究院 Method and device for real-time force interaction control of an ultrasound probe on a contact surface

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114848019A (en) * 2022-04-19 2022-08-05 山东大学 Automatic heart ultrasonic detection system and method based on flexible cooperative robot
CN117731324A (en) * 2024-02-21 2024-03-22 北京智源人工智能研究院 Method and device for real-time force interaction control of an ultrasound probe on a contact surface

Similar Documents

Publication Publication Date Title
US20230000565A1 (en) Systems and methods for autonomous suturing
CN111906784A (en) Pharyngeal swab double-arm sampling robot based on machine vision guidance and sampling method
US20110046637A1 (en) Sensorized medical instrument
CN215458144U (en) Full-automatic B-ultrasonic inspection robot system
CN110680395A (en) Automatic ultrasonic scanning system
JP7157424B2 (en) INTERACTIVE INFORMATION TRANSMISSION SYSTEM AND INTERACTIVE INFORMATION TRANSMISSION METHOD AND INFORMATION TRANSMISSION SYSTEM
Sundaresan et al. Automated extraction of surgical needles from tissue phantoms
CN113876434A (en) Master-slave motion control method, robot system, device, and storage medium
CN113967071B (en) Control method and device for movement of mechanical arm of surgical robot along with operation bed
CN113633387B (en) Surgical field tracking supporting laparoscopic minimally invasive robot touch interaction method and system
CN115741732B (en) Interactive path planning and motion control method for massage robot
CN115670675A (en) Double-arm puncture robot system integrating ultrasonic information and tactile information
Zhang et al. A handheld master controller for robot-assisted microsurgery
Mathur et al. A semi-autonomous robotic system for remote trauma assessment
Peng et al. Endoscope FOV autonomous tracking method for robot-assisted surgery considering pose control, hand–eye coordination, and image definition
Si et al. Design and quantitative assessment of teleoperation-based human–robot collaboration method for robot-assisted sonography
Xia et al. A constrained optimization approach to virtual fixtures for multi-robot collaborative teleoperation
CN102768541B (en) The control method of operating robot and system
Huang et al. Robot-assisted deep venous thrombosis ultrasound examination using virtual fixture
CN113742992B (en) Master-slave control method based on deep learning and application
Dumpert et al. Semi-autonomous surgical tasks using a miniature in vivo surgical robot
CN113647972A (en) Double-arm cooperative robot control method and system for assisting oral medical image
CN112650120A (en) Robot remote control system, method and storage medium
CN118105174A (en) Control method, device and storage medium for surgical robot system
Xu et al. Maker based shape tracking of a flexible serpentine manipulator

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20220111

CF01 Termination of patent right due to non-payment of annual fee