CN215458144U - Full-automatic B-ultrasonic inspection robot system - Google Patents

Full-automatic B-ultrasonic inspection robot system Download PDF

Info

Publication number
CN215458144U
CN215458144U CN202120775236.8U CN202120775236U CN215458144U CN 215458144 U CN215458144 U CN 215458144U CN 202120775236 U CN202120775236 U CN 202120775236U CN 215458144 U CN215458144 U CN 215458144U
Authority
CN
China
Prior art keywords
robot
control host
patient
detection device
automatic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN202120775236.8U
Other languages
Chinese (zh)
Inventor
钟林红
姚凯文
李春泉
刘小平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanchang University
Original Assignee
Nanchang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanchang University filed Critical Nanchang University
Priority to CN202120775236.8U priority Critical patent/CN215458144U/en
Application granted granted Critical
Publication of CN215458144U publication Critical patent/CN215458144U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Ultra Sonic Daignosis Equipment (AREA)
  • Manipulator (AREA)

Abstract

The utility model provides a full-automatic B-ultrasonic inspection robot system which comprises a platform, a robot, a depth camera and a control host, wherein the depth camera is connected with the input end of the control host, the robot is connected with the output end of the control host, the robot has six or more degrees of freedom, an end effector of the robot is connected with an ultrasonic detection device and a force detection device, and the ultrasonic detection device and the force detection device are both connected with the input end of the control host. The present invention can be performed without a professional technician or a doctor for B-ultrasonic examination. The B-ultrasonic robot system provided by the utility model has the characteristics of intelligence, easiness in operation and high efficiency.

Description

Full-automatic B-ultrasonic inspection robot system
Technical Field
The utility model relates to the technical field of robots, in particular to a full-automatic B-ultrasonic inspection robot system.
Background
B-ultrasonic detection is an important technical means for acquiring the health condition of human organs, however, the existing B-ultrasonic detection equipment needs personnel with professional knowledge to operate, so that the B-ultrasonic detection efficiency is greatly reduced; moreover, when epidemic outbreaks or other high-contagious diseases occur, it is necessary to ensure the health and safety of detection personnel, and in recent years, the robot industry is rapidly developed and widely applied in the medical field, so that the robot is beneficial and possible to complete the task.
SUMMERY OF THE UTILITY MODEL
The utility model aims to provide a full-automatic B-ultrasonic inspection robot system which has the characteristics of easiness in operation and high efficiency.
The technical scheme adopted by the utility model is as follows:
the utility model provides a full-automatic B ultrasonic inspection robot system, includes platform, robot, degree of depth camera and main control system, the degree of depth camera is connected with main control system's input, the robot is connected with main control system's output, the robot has six or above degrees of freedom, the end effector of robot is connected with ultrasonic detection device and power detection device, ultrasonic detection device and power detection device all are connected with main control system's input.
Furthermore, marks are arranged on the platform and used for positioning the patient by the depth camera and establishing a coordinate system for posture change by the robot.
Furthermore, the platform is also provided with a fixing device for fixing the position of the patient so as to ensure that the position of the patient cannot change in the operation process of the system.
Furthermore, the depth camera is used for obtaining the body image information and the distance information of the patient, the distance from any pixel point in the visual field to the depth camera can be obtained, and after the patient lies on the platform flatly and shoots the patient, the data are sent to the control host in a unified mode.
Further, the control host calculates the approximate positions of the organs to be detected according to the actual body types of the patients, generates the moving tracks and postures of the robot end effector on the patients, converts the data into a series of arm joint angle data and sends the arm joint angle data to the robot.
Further, the robot end effector sends contact force information collected by the force detection device to the control host computer when moving on a human body according to a track sent by the control host computer, and the control host computer corrects the track position according to the actual force and the expected force.
Furthermore, the robot movement is simultaneously carried out by acquiring the human organ information in real time by the ultrasonic detection device, and sending the information to the control host for recording.
Further, the system is provided with an emergency stop button for moving the robot away from the body in the z-axis direction when pressed.
Compared with the prior art, the utility model has the following advantages and beneficial effects:
1) the full-automatic operation of the utility model does not need to increase the learning cost of personnel, only needs the first installation and debugging, and then only needs the self-operation of the patient, and the B-ultrasonic robot can automatically complete the B-ultrasonic examination.
2) The utility model can effectively reduce the risk of spreading infectious diseases caused by doctor-patient contact, and doctors can remotely see the doctor without contacting the patient.
3) The utility model has stronger safety performance, can not only detect the magnitude of the pressing force and automatically stop working when the force is large, but also can be added with an emergency brake button, so that the patient can automatically stop the working of the B-ultrasonic robot when feeling uncomfortable, thereby ensuring the personal safety of the patient.
Drawings
FIG. 1 is an overall configuration diagram of a B-ultrasonic inspection robot system according to the present invention;
FIG. 2 is a diagram of a working scenario of the system of the present invention;
FIG. 3 is a diagram of the complete operation process of the B-ultrasonic inspection robot system of the present invention.
The system comprises a robot 1, an ultrasonic detection device 2, a depth camera 3, a platform 4, a marker 5 and a control host 6.
Detailed Description
In order to make the technical problem and the technical solution to be solved by the present invention clearer, a fully automatic B-ultrasonic inspection robot system provided by the present invention is described in detail below with reference to the accompanying drawings and embodiments, and the detailed description is for explanation and not limitation of the present invention.
Referring to fig. 1-3, a full-automatic B-ultrasonic inspection robot system, the overall structure of which is shown in fig. 1, uses a six-degree-of-freedom universal robot arm to perform full-automatic ultrasonic inspection on a patient, and includes a platform 4, a robot 1, a depth camera 3 and a control host 6. The robot 1 is used for carrying out full-automatic ultrasonic examination on the patient, and the B-ultrasonic examination can be carried out on the patient in a full-automatic manner without the intervention of doctors or other professionals in the whole process. An ultrasonic detection device 2 and a force detection device are simultaneously connected to an end effector of the robot 1. The system uses the depth camera 3 to position the body position of the patient, analyzes the approximate positions of the organs to be detected according to the body type of the patient, and then sorts and sends depth information to the control host 6 to control the position and the posture of the mechanical arm of the robot 1. The flexible contact between the mechanical arm and the skin of the patient is achieved by adopting an impedance control algorithm. In order to provide a perfect reliability of the detected information, the end-effector of the mechanical arm will remain perpendicular to the patient's skin throughout the entire operation and exert a constant and appropriate force on the latter.
The patient should lie on a specific platform 4 when carrying out B ultrasonic examination, should have special mark 5 simultaneously by this platform 4 can make things convenient for depth camera 3 to fix a position the patient, still need have the position of device fixed patient in order to guarantee that its position can not change in addition, and the arm will also utilize these mark 5 to establish the coordinate system and carry out the gesture change.
The robotic arm used for surgery should have six or more degrees of freedom because six degrees of freedom are free to flexibly reach various positions in space and make a specified pose. For the purpose of detection, the end effector is provided with an ultrasonic detection device 2, and for the purpose of detection accuracy and patient comfort, the end effector is also provided with a force sensor or other sensors, so that the ultrasonic detection device 2 is always perpendicular to the contact surface of the ultrasonic detection device and a human body in the operation process of the mechanical arm, and a constant force with a proper magnitude is applied.
The contour of the human body is acquired by the depth camera 3, and the distance value from any pixel point in the visual field to the depth camera 3 can be acquired. The depth camera 3 obtains corresponding data by taking a picture of a patient lying on the platform 4, and the data is uniformly sent to the control host 6 to perform the desired control on the mechanical arm.
After obtaining the image information and the distance information of the patient body, the control host 6 analyzes the outline of the upper half of the patient body according to some characteristics of the human body surface by using an image recognition technology, and simulates a three-dimensional human body surface by combining the distance information.
According to the obtained human body surface data and the positioning marks 5, the control host 6 calculates the approximate positions of the organs to be detected according to the actual body type data of the patient, generates the moving track and posture of the robot end effector on the patient, converts the Cartesian space coordinate track data into a series of mechanical arm joint angle data and sends the mechanical arm joint angle data to the robot 1.
The robot end effector simultaneously sends contact force information collected by the force sensor to the control host 6 when the robot end effector moves on a human body according to a track sent by the control host 6, and the control host 6 corrects the track position according to actual force and expected force, so that the effect of inputting expected vertical force is achieved.
While the robot end effector moves according to the trajectory, the position of the end effector in the z-axis (i.e., perpendicular to the platform surface) needs to be changed in order to ensure that the force is constant. In order to ensure that the ultrasonic detection device 2 is perpendicular to the surface of the human body, the control host 6 calculates the normal of the contact surface of the current end effector and the human body in real time according to the z-axis coordinates output twice before and after, takes the normal as the attitude of the end effector, calculates inverse kinematics, and sends the joint angle to the robot 1. The robot 1 will move to the designated position and repeat the whole process until it reaches the end of the trajectory and leaves the body surface.
The robot 1 moves and simultaneously the ultrasonic detection device 2 acquires the human organ information in real time, and the information is sent to the control host 6 and recorded. If the measured organ image is not available, the robot 1 can be moved from the beginning until it meets the observation requirements; it may also be required to re-acquire an image of an organ separately.
The robot 1 should be guaranteed to output a constant and appropriate amount of force during the movement, and if the robot 1 for some reason outputs a force exceeding a threshold value or the detected patient feels uncomfortable to select to stop actively, the control host 6 will automatically move the robot 1 away from the human body along the z-axis direction. The system will set an emergency stop button to ensure patient safety.
The complete working process of the system is shown in fig. 3, and the specific implementation mode is as follows:
step 1, when starting, a patient lies on a special platform 4 and is fixed by a fixing device, so that the position of the patient is prevented from changing in the operation process of the robot 1.
And 2, starting an image acquisition program of the depth camera 3 at the control host 6, and sending the image information and the depth information to the control host 6 after the depth camera 3 finishes collecting the image information and the depth information.
And 3, combining the image information and the depth information by the control host 6 and processing the combined image information and the depth information into a three-dimensional human body upper body surface model.
And 4, deducing the distribution of each organ according to the body type of the patient by the control host 6 on the basis of the model, and planning the motion track of the robot 1.
And 5, according to the formed motion track, the control host 6 sends a control instruction to the robot 1, and the robot 1 moves to an initial position and starts to contact the surface of the human body.
And 6, after the movement starts, the robot 1 feeds back actual contact force information to the control host 6 in real time, the control host 6 adjusts the track obtained in the step 4 by using the impedance controller according to the error between the expected contact force and the actual contact force, and sends a control command to the robot 1.
And 7, simultaneously with the step 6, the control host 6 also adjusts the posture of the robot 1 in real time according to the position of the robot end effector on the surface of the human body, so that the robot is always vertical to the surface of the human body.
And 8, continuously returning the images to the control host 6 by the ultrasonic detection device 2 for recording in the running process of the robot 1.
And 9, after the robot 1 reaches the tail end of the track under the instruction of the control host 6, the robot is far away from the human body in the z-axis direction and then returns to the initial position. One duty cycle is completed.
The above embodiments are merely illustrative of the present invention and are not to be construed as limiting the utility model.

Claims (8)

1.一种全自动B超检查机器人系统,其特征在于:包括平台、机器人、深度相机和控制主机,所述深度相机与控制主机的输入端连接,所述机器人与控制主机的输出端连接,所述机器人具有六个或以上的自由度,所述机器人的末端执行器连接有超声波检测装置和力检测装置,所述超声波检测装置和力检测装置均与控制主机的输入端连接。1. a fully automatic B-ultrasound inspection robot system, is characterized in that: comprise platform, robot, depth camera and control host, described depth camera is connected with the input end of control host, and described robot is connected with the output end of control host, The robot has six or more degrees of freedom, and the end effector of the robot is connected with an ultrasonic detection device and a force detection device, both of which are connected to the input end of the control host. 2.根据权利要求1所述的一种全自动B超检查机器人系统,其特征在于:所述平台上设置有标记,用于深度相机对病患进行定位,还用于机器人建立坐标系进行姿态变化。2. A kind of automatic B-ultrasound inspection robot system according to claim 1, is characterized in that: described platform is provided with mark, is used for depth camera to position patient, also is used for robot to establish coordinate system to carry out attitude Variety. 3.根据权利要求1所述的一种全自动B超检查机器人系统,其特征在于:所述平台上还设置有固定装置,用于固定病患的位置以保证其位置在系统运行过程中不会变动。3. A kind of automatic B-ultrasound inspection robot system according to claim 1, is characterized in that: described platform is also provided with fixing device, is used for fixing the position of patient to ensure that its position is not in system operation process. will change. 4.根据权利要求1所述的一种全自动B超检查机器人系统,其特征在于:所述深度相机用于获得病患身体图像信息和距离信息,除获取视野内任一个像素点的色彩值之外还能得到该点到深度相机的距离,在病患平躺在平台上并进行拍摄后,这些数据将统一发送给控制主机。4. A kind of automatic B-ultrasound inspection robot system according to claim 1, is characterized in that: described depth camera is used for obtaining patient's body image information and distance information, except obtaining the color value of any pixel in the field of view In addition, the distance from the point to the depth camera can be obtained. After the patient lies flat on the platform and takes pictures, these data will be uniformly sent to the control host. 5.根据权利要求4所述的一种全自动B超检查机器人系统,其特征在于:所述控制主机根据病患实际体型计算各个待检测器官的大致位置并由此生成机器人末端执行器在病患身上运动的轨迹和姿态,之后再将这些数据转换成一系列的机械臂关节角数据发送至机器人。5. A fully automatic B-ultrasound inspection robot system according to claim 4, wherein the control host calculates the approximate position of each organ to be detected according to the actual body shape of the patient and thereby generates a robot end effector in the disease. The trajectory and posture of the patient's movement are then converted into a series of mechanical arm joint angle data and sent to the robot. 6.根据权利要求5所述的一种全自动B超检查机器人系统,其特征在于:所述机器人末端执行器根据控制主机发来的轨迹在人体上运动时同时将力检测装置采集的接触力信息发送给控制主机,控制主机根据实际力与期望力对轨迹位置进行修正。6. A fully automatic B-ultrasound inspection robot system according to claim 5, wherein the robot end effector simultaneously collects the contact force collected by the force detection device when the robot end effector moves on the human body according to the trajectory sent by the control host The information is sent to the control host, and the control host corrects the trajectory position according to the actual force and the expected force. 7.根据权利要求6所述的一种全自动B超检查机器人系统,其特征在于:所述机器人运动同时由超声波检测装置实时获取人体器官信息,并将这些信息发送至控制主机进行记录。7 . The fully automatic B-ultrasound inspection robot system according to claim 6 , wherein the robot acquires the information of human organs in real time by the ultrasonic detection device at the same time, and sends the information to the control host for recording. 8 . 8.根据权利要求1-7任一项所述的一种全自动B超检查机器人系统,其特征在于:所述系统还设置有紧急停止按钮,用于在按下时使机器人在z轴方向运动离开人体。8. A fully automatic B-ultrasound inspection robot system according to any one of claims 1-7, wherein the system is also provided with an emergency stop button for causing the robot to move in the z-axis direction when pressed Movement leaves the body.
CN202120775236.8U 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system Expired - Fee Related CN215458144U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202120775236.8U CN215458144U (en) 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202120775236.8U CN215458144U (en) 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system

Publications (1)

Publication Number Publication Date
CN215458144U true CN215458144U (en) 2022-01-11

Family

ID=79774766

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202120775236.8U Expired - Fee Related CN215458144U (en) 2021-04-15 2021-04-15 Full-automatic B-ultrasonic inspection robot system

Country Status (1)

Country Link
CN (1) CN215458144U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114848019A (en) * 2022-04-19 2022-08-05 山东大学 Automatic heart ultrasonic detection system and method based on flexible cooperative robot
CN117731324A (en) * 2024-02-21 2024-03-22 北京智源人工智能研究院 Method and device for real-time force interactive control of ultrasonic probe on contact surface

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114848019A (en) * 2022-04-19 2022-08-05 山东大学 Automatic heart ultrasonic detection system and method based on flexible cooperative robot
CN117731324A (en) * 2024-02-21 2024-03-22 北京智源人工智能研究院 Method and device for real-time force interactive control of ultrasonic probe on contact surface

Similar Documents

Publication Publication Date Title
CN110477956A (en) A kind of intelligent checking method of the robotic diagnostic system based on ultrasound image guidance
US20110046637A1 (en) Sensorized medical instrument
WO2021077476A1 (en) Automatic ultrasonic scanning system
CN105411681B (en) The hand eye coordination control system and method for split type micro-wound operation robot
CN215458144U (en) Full-automatic B-ultrasonic inspection robot system
CN113876434A (en) Master-slave motion control method, robot system, device, and storage medium
Chen et al. A collaborative robot for COVID-19 oropharyngeal swabbing
CN115670675A (en) A dual-arm puncture robot system fusing ultrasonic and tactile information
CN112132805B (en) A method and system for normalizing the state of ultrasonic robots based on human body characteristics
CN115741732B (en) Interactive path planning and motion control method for massage robot
Zhang et al. A handheld master controller for robot-assisted microsurgery
CN115089212A (en) A three-dimensional vision-guided robotic arm automatic neck ultrasound scanning method and system
Si et al. Design and quantitative assessment of teleoperation-based human–robot collaboration method for robot-assisted sonography
Lee et al. Robotic manipulation system design and control for non-contact remote diagnosis in otolaryngology: Digital twin approach
Peng et al. Endoscope FOV autonomous tracking method for robot-assisted surgery considering pose control, hand–eye coordination, and image definition
Huang et al. Robot-assisted deep venous thrombosis ultrasound examination using virtual fixture
CN102768541B (en) The control method of operating robot and system
CN113742992B (en) Master-slave control method based on deep learning and application
Dumpert et al. Semi-autonomous surgical tasks using a miniature in vivo surgical robot
CN113647972A (en) Double-arm cooperative robot control method and system for assisting oral medical image
CN112650120A (en) Robot remote control system, method and storage medium
Luo et al. Multi-modal autonomous ultrasound scanning for efficient human–machine fusion interaction
CN117731404A (en) Incremental master-slave mapping method of master-slave heterogeneous teleoperation system
CN111477318A (en) A Virtual Ultrasound Probe Tracking Method for Remote Manipulation
CN114668507B (en) Remote surgery visual feedback system and method

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20220111