CN216067465U - Medical somatosensory robot system based on inertial sensor - Google Patents
Medical somatosensory robot system based on inertial sensor Download PDFInfo
- Publication number
- CN216067465U CN216067465U CN202120896099.3U CN202120896099U CN216067465U CN 216067465 U CN216067465 U CN 216067465U CN 202120896099 U CN202120896099 U CN 202120896099U CN 216067465 U CN216067465 U CN 216067465U
- Authority
- CN
- China
- Prior art keywords
- robot
- inertial sensor
- hand
- medical
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000003238 somatosensory effect Effects 0.000 title claims abstract description 19
- 230000005540 biological transmission Effects 0.000 claims abstract description 13
- 238000004891 communication Methods 0.000 claims description 8
- 238000005452 bending Methods 0.000 claims description 4
- 239000004065 semiconductor Substances 0.000 claims description 3
- 238000001514 detection method Methods 0.000 abstract description 14
- 238000005516 engineering process Methods 0.000 abstract description 11
- 230000009471 action Effects 0.000 abstract description 6
- 238000000034 method Methods 0.000 description 12
- 238000004364 calculation method Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 238000004422 calculation algorithm Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 208000015181 infectious disease Diseases 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 150000007523 nucleic acids Chemical class 0.000 description 2
- 102000039446 nucleic acids Human genes 0.000 description 2
- 108020004707 nucleic acids Proteins 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 230000002035 prolonged effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 210000000689 upper leg Anatomy 0.000 description 2
- 206010035664 Pneumonia Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000004659 sterilization and disinfection Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Manipulator (AREA)
Abstract
The utility model discloses a medical somatosensory robot system based on an inertial sensor, which comprises hand wearable equipment, a robot and a Bluetooth module, wherein the hand wearable equipment is arranged on the robot; the hand wearable device is a wearable glove, an inertial sensor is arranged on the hand wearable device and used for capturing hand posture information of a user in real time and transmitting the hand posture information to the robot through the Bluetooth module, and the inertial sensor is a six-axis inertial sensor consisting of a three-axis accelerometer and a three-axis gyroscope; be provided with sensor group on the robot, sensor group is used for gathering the real-time status information of robot, and pass through bluetooth module feeds back to hand wearable equipment for the user looks over. Compared with the prior art, the utility model can detect more precise hand actions, has flexible and portable detection equipment, uses the low-power-consumption Bluetooth technology for information transmission, saves resources and improves the working efficiency.
Description
Technical Field
The utility model relates to the technical field of medical instruments, in particular to a medical somatosensory robot system based on an inertial sensor.
Background
The market demand of the Chinese robot is very huge. To date, china has been the first industrial robot application market worldwide for 7 years, accounting for about one third of the global market share. Among them, the medical industry is one of the application fields of robots which are developed most rapidly in recent years. Compared with other application fields, the medical field has uniqueness, a plurality of scenes of the medical field have dangerous or trivial work, and medical staff need safer and more efficient tools to ensure personal health safety. Moreover, since the outbreak of new coronary pneumonia epidemic situation, the demands of hospitals for robots such as disinfection robots and the like are explosively increased, the reduction of off-line contact becomes a common tacit of people, and the trend that the robots replace manpower is greatly accelerated. Therefore, demands for "high-precision" and "high-reliability" robots in the medical field are constantly increasing and continue to increase.
In terms of technical background, human-computer interaction technology has been studied at home and abroad. For example, a Kinect-based somatosensory interactive robot (electronic measurement technology, 2017, 40(08):139-143) proposed by Wasp and Libo in 2020 tracks and draws skeleton information of the whole body of a human body by using a skeleton tracking function of the Kinect, and then sends the tracked joint angle information of the human body to the robot through a Bluetooth interface, so that the robot simulates the action of the human body, and somatosensory interaction is realized.
However, the application of the current somatosensory technology has some defects. First, most of the prior art adopts optical sensing, such as Kinect by microsoft and Spark by major, and these technologies based on visual recognition can recognize human actions, but most of the detection devices are not smart, have problems of large volume and complex structure, and do not meet the popular trend of more and more compact off-line devices. Secondly, most of the existing somatosensory technologies are designed for large organs of the human body, such as the whole human body, thighs or arms, and a relatively large action amplitude needs to be detected to control the robot to complete corresponding actions, so that the robot is not friendly to users. In addition, in the process of human-computer interaction, signals adopt a wired transmission mode, so that the control of the robot is not flexible and convenient. Finally, the current technology focuses more on the control of the robot by the user, and does not make good use of the information fed back by the robot.
SUMMERY OF THE UTILITY MODEL
In view of the above problems, an object of the present invention is to provide a medical somatosensory robot system based on an inertial sensor, which uses the inertial sensor to replace the existing detection method of human body motion, and implements hand motion detection by arranging the inertial sensor on a wearable device similar to a glove, and implements human-computer interaction by using a low-power bluetooth communication method, and simultaneously monitors information such as real-time state and abnormal situation of the robot by the sensor arranged on the robot, and feeds the information back to the user, so as to better assist the user in controlling the robot.
To solve the above technical problem, an embodiment of the present invention provides the following solutions:
a medical somatosensory robot system based on an inertial sensor comprises hand wearable equipment, a robot and a Bluetooth module; the hand wearable device is a wearable glove, an inertial sensor is arranged on the hand wearable device and used for capturing hand posture information of a user in real time and transmitting the hand posture information to the robot through the Bluetooth module, and the inertial sensor is a six-axis inertial sensor consisting of a three-axis accelerometer and a three-axis gyroscope; be provided with sensor group on the robot, sensor group is used for gathering the real-time status information of robot, and pass through bluetooth module feeds back to hand wearable equipment for the user looks over.
Preferably, the three-axis accelerometer is a MEMS accelerometer and the three-axis gyroscope is a MEMS gyroscope.
Preferably, the bluetooth module adopts a CC2541 bluetooth low energy module, and performs communication transmission through a bluetooth 4.0 protocol.
Preferably, the hand wearable device further comprises a data processing module, wherein the data processing module is used for preprocessing initial data acquired by the inertial sensor by adopting a moving average filtering method and performing posture calculation on the preprocessed data by adopting an AHRS algorithm to obtain hand posture information of the user.
Preferably, the data processing module adopts an Arduino 101 module.
Preferably, the sensor group arranged on the robot comprises a temperature sensor, a humidity sensor and an ultrasonic sensor.
Preferably, the robot comprises a main control module, wherein the main control module adopts an STMF103 chip of an intentional semiconductor ST as a control core, the chip takes an ARM Cortex-M3 as an inner core, has the frequency of 72MHz, is internally provided with 265KROM and 48KRAM, and has a user program storage space of 1MB through an extended Flash chip; the chip is provided with 16 paths of IO input, 16 paths of ADC interfaces with 12-bit precision, 1 CDS series digital steering engine interface supporting cascade connection, a Bluetooth wireless transmission module and 12 paths of configurable external interrupt input interfaces.
Preferably, the hand posture information includes orientation information of a palm and a bending motion of a finger.
The technical scheme provided by the embodiment of the utility model has the beneficial effects that at least:
(1) the common image processing technology is abandoned in the equipment for detecting the hand motion of the human body, and the method of selecting the inertial sensor is adopted, so that the detection equipment can be designed into a form similar to a glove, a user only needs to wear the detection equipment on the hand, and the machine matched with the detection equipment can be remotely controlled by moving the hand, so that the detection equipment is intuitive and convenient, and the learning cost is low.
(2) The low-power consumption Bluetooth 4.0 transmission protocol replaces a wired or other wireless transmission protocol, so that the whole system becomes more concise and convenient, the power consumption of the whole equipment is very low, the service time is prolonged, and resources are saved.
(3) In the past, only the establishment and optimization of a one-way channel for controlling the robot by a user are emphasized. However, the robot in the utility model can feed back information to the user, so that the user can master the real-time state of the robot to realize better control of the robot.
(4) If be applied to medical field with it, medical personnel can realize through some teletherapy of remote control machine to the patient, can guarantee in the nucleic acid testing for example that patient and medical personnel keep apart completely, greatly reduced medical personnel's infection risk in the course of the work improves medical personnel's work efficiency greatly, practices thrift medical resources.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a medical somatosensory robot system based on an inertial sensor according to an embodiment of the utility model.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
The embodiment of the utility model provides a medical somatosensory robot system based on an inertial sensor, and as shown in fig. 1, the system comprises hand wearable equipment 1, a robot 2 and a Bluetooth module 3; the hand wearable device 1 is provided with an inertial sensor 101, and the inertial sensor 101 is used for capturing hand posture information of a user in real time and transmitting the hand posture information to the robot 2 through the Bluetooth module 3; be provided with sensor group 201 on the robot 2, sensor group 201 is used for gathering robot 2's real-time status information to feed back to hand wearable equipment 1 through bluetooth module 3, look over for the user.
In the embodiment of the utility model, the change of the hand gesture of the medical care personnel is monitored in real time through the inertial sensor 101 arranged on the hand wearable device 1, then the acquired hand gesture information is sent to the robot 2 through the low-power wireless Bluetooth transmission protocol, and the robot 2 performs corresponding actions according to the received data. In addition, the robot 2 is provided with the sensor group 201, information such as real-time state and emergency of the robot can be fed back to a user, the medical motion sensing robot can better match the user, respond to emergency, adapt to different requirements, and user experience is improved.
In the embodiment of the present invention, the hand wearable device 1 may be a wearable glove or other device, and the hand posture information includes information such as orientation information of a palm and a bending motion of a finger. Compared with the prior art that only large organs such as arms or thighs of a human body can be detected and large-amplitude actions can be detected, the method can detect finer finger actions, improves the detection accuracy and has wider application prospect.
Further, the inertial sensor 101 is a six-axis inertial sensor composed of a three-axis accelerometer and a three-axis gyroscope, the three-axis accelerometer is an MEMS accelerometer, and the three-axis gyroscope is an MEMS gyroscope. Compared with a traditional accelerometer and a traditional gyroscope, the MEMS accelerometer and the MEMS gyroscope have the advantages of being small in size, light in weight, low in power consumption and relatively low in cost, and have higher reliability and cost performance far superior to that of the traditional accelerometer and the traditional gyroscope. After the six-axis inertial sensor is formed by the three-axis acceleration sensor and the three-axis gyroscope, the main parameters of the carrier, such as angle, speed, displacement and the like, can be measured.
Further, the bluetooth module 3 adopts a CC2541 bluetooth low energy module, and performs communication transmission through a bluetooth 4.0 protocol. In recent decades, the technology of internet of things is continuously developing, and the wireless communication technology is also developing to a higher level on the premise of continuously improving the requirements in various aspects. Compared with wired communication, the wireless communication is more flexible and the cost performance is higher. Among them, bluetooth has formulated a 4.0 specification protocol in 2010, and bluetooth low energy is a core specification thereof, which makes bluetooth low energy faster, lower standby power consumption, and lower peak power than previous connections.
Further, the hand wearable device 1 further includes a data processing module 102, and the data processing module 102 is configured to perform preprocessing on the initial data acquired by the inertial sensor 101 by using a moving average filtering method, and perform posture calculation on the preprocessed data by using an AHRS algorithm to obtain hand posture information of the user.
For the initial data collected by the inertial sensor 101, we cannot use it directly, because the sensor will have errors for various reasons during the whole measurement process. These errors, if left unprocessed, are directly introduced into the attitude solution, which will cause the solution to deviate from the actual result, and therefore a pre-processing of the data directly acquired by the inertial sensor 101 is required. The utility model adopts a moving average filtering method, and the algorithm is easy to realize and has high smoothness.
For attitude calculation, the AHRS algorithm is selected, the attitude calculation method is a simpler attitude calculation method, the method is proposed by Ph.D. Sebastian Madgwick of Bristol university in England, the attitude calculation method is an attitude calculation algorithm based on a multi-axis inertial sensor, and the current spatial attitude can be calculated by performing data fusion processing on original data of the inertial sensor. In order to facilitate calculation, a quaternion method is mostly used for attitude calculation, and finally, quaternions are converted into attitude angles to be output.
In the embodiment of the present invention, the data processing module 102 is an Arduino 101 module. The Arduino 101 module can preprocess the acquired data and complete the attitude calculation, and then sends the acquired hand attitude information out through the Bluetooth module 3.
Further, the sensor group 201 provided in the robot 2 includes a series of sensors such as a temperature sensor, a humidity sensor, and an ultrasonic sensor, and can sense the current working state and any emergency situation of the robot 2 in real time.
Further, the robot 2 comprises a main control module 202, the main control module 202 adopts an STMF103 chip of an Italian semiconductor ST as a control core, the chip takes ARM Cortex-M3 as an inner core, the frequency can reach 72MHz, 265KROM and 48KRAM are arranged in the chip, and a user program storage space of 1MB is formed through an extended Flash chip; the chip is provided with 16 paths of IO input, 16 paths of ADC interfaces with 12-bit precision, 1 CDS series digital steering engine interface supporting cascade connection, a Bluetooth wireless transmission module and 12 paths of configurable external interrupt input interfaces, and can meet the control requirement of the robot 2.
In summary, the medical somatosensory robot system based on the inertial sensor provided by the utility model is characterized in that the inertial sensor 101 is arranged on the hand wearable device 1 similar to a glove, and the inertial sensor 101 captures hand posture information of a user, such as palm orientation information, finger bending motion and the like. Since the captured initial data has errors and cannot be directly used, the data processing module 102 is required to perform preprocessing and posture calculation on the initial data, then the obtained hand posture information is transmitted to the robot 2 through the bluetooth module 3, and the main control module 202 of the robot 2 controls the robot 2 to perform corresponding actions according to the hand posture information. In addition, the robot 2 is provided with a sensor group 201 including a temperature sensor, a humidity sensor, an ultrasonic sensor and the like, so as to monitor the working state and abnormal conditions of the robot in real time, and feed back to a user through the Bluetooth module 3, thereby helping the user to realize better control.
Compared with the prior art, the utility model has the following four advantages: a light-weight human hand motion detection device; a low power bluetooth wireless communication protocol; the robot can better protect medical care personnel by utilizing feedback information and in the medical treatment process; the working efficiency is improved.
Specifically, the utility model can bring the following beneficial effects:
(1) the common image processing technology is abandoned in the equipment for detecting the hand motion of the human body, and the method of selecting the inertial sensor is adopted, so that the detection equipment can be designed into a form similar to a glove, a user only needs to wear the detection equipment on the hand, and the machine matched with the detection equipment can be remotely controlled by moving the hand, so that the detection equipment is intuitive and convenient, and the learning cost is low.
(2) The low-power consumption Bluetooth 4.0 transmission protocol replaces a wired or other wireless transmission protocol, so that the whole system becomes more concise and convenient, the power consumption of the whole equipment is very low, the service time is prolonged, and resources are saved.
(3) In the past, only the establishment and optimization of a one-way channel for controlling the robot by a user are emphasized. However, the robot in the utility model can feed back information to the user, so that the user can master the real-time state of the robot to realize better control of the robot.
(4) If be applied to medical field with it, medical personnel can realize through some teletherapy of remote control machine to the patient, can guarantee in the nucleic acid testing for example that patient and medical personnel keep apart completely, greatly reduced medical personnel's infection risk in the course of the work improves medical personnel's work efficiency greatly, practices thrift medical resources.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the utility model, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (6)
1. A medical somatosensory robot system based on an inertial sensor is characterized by comprising hand wearable equipment, a robot and a Bluetooth module; the hand wearable device is a wearable glove, an inertial sensor is arranged on the hand wearable device and used for capturing hand posture information of a user in real time and transmitting the hand posture information to the robot through the Bluetooth module, and the inertial sensor is a six-axis inertial sensor consisting of a three-axis accelerometer and a three-axis gyroscope; be provided with sensor group on the robot, sensor group is used for gathering the real-time status information of robot, and pass through bluetooth module feeds back to hand wearable equipment for the user looks over.
2. The inertial sensor-based medical somatosensory robot system according to claim 1, wherein the triaxial accelerometer is a MEMS accelerometer and the triaxial gyroscope is a MEMS gyroscope.
3. The medical somatosensory robot system based on the inertial sensor according to claim 1, wherein the Bluetooth module adopts a CC2541 low-power Bluetooth module and performs communication transmission through a Bluetooth 4.0 protocol.
4. The medical somatosensory robot system based on the inertial sensor according to claim 1, wherein the sensor group arranged on the robot comprises a temperature sensor, a humidity sensor and an ultrasonic sensor.
5. The medical somatosensory robot system based on the inertial sensor is characterized in that the robot comprises a main control module, the main control module adopts an STMF103 chip of an ideological semiconductor ST as a control core, the chip adopts an ARM Cortex-M3 as an inner core, the frequency is 72MHz, the inner part of the chip is provided with 265KROM and 48KRAM, and the Flash chip is expanded to have a user program storage space of 1 MB; the chip is provided with 16 paths of IO input, 16 paths of ADC interfaces with 12-bit precision, 1 CDS series digital steering engine interface supporting cascade connection, a Bluetooth wireless transmission module and 12 paths of configurable external interrupt input interfaces.
6. The inertial sensor-based medical somatosensory robot system according to claim 1, wherein the hand pose information comprises palm orientation information and finger bending motion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202120896099.3U CN216067465U (en) | 2021-04-27 | 2021-04-27 | Medical somatosensory robot system based on inertial sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202120896099.3U CN216067465U (en) | 2021-04-27 | 2021-04-27 | Medical somatosensory robot system based on inertial sensor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN216067465U true CN216067465U (en) | 2022-03-18 |
Family
ID=80635529
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202120896099.3U Expired - Fee Related CN216067465U (en) | 2021-04-27 | 2021-04-27 | Medical somatosensory robot system based on inertial sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN216067465U (en) |
-
2021
- 2021-04-27 CN CN202120896099.3U patent/CN216067465U/en not_active Expired - Fee Related
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Guo et al. | Human-machine interaction sensing technology based on hand gesture recognition: A review | |
| Aggarwal et al. | Design and implementation of a wireless gesture controlled robotic arm with vision | |
| CN106326881B (en) | Gesture recognition method and gesture recognition device for realizing man-machine interaction | |
| CN104881118B (en) | A kind of donning system for being used to capture human upper limb locomotion information | |
| Bhuyan et al. | Gyro-accelerometer based control of a robotic arm using AVR microcontroller | |
| CN108187333A (en) | More inertia node wireless monitoring and evaluation system and methods in rehabilitation training of upper limbs | |
| CN107856014A (en) | Mechanical arm pose control method based on gesture recognition | |
| CN105014676A (en) | Robot motion control method | |
| CN108572586B (en) | Information processing apparatus and information processing system | |
| CN108828996A (en) | A kind of the mechanical arm remote control system and method for view-based access control model information | |
| CN110279420A (en) | Portable falling detection device and detection method based on extreme learning machine | |
| CN106853638A (en) | A kind of human-body biological signal tele-control system and method based on augmented reality | |
| CN212729816U (en) | Human motion capture system | |
| Yu et al. | Gesture-based telemanipulation of a humanoid robot for home service tasks | |
| Balakrishna et al. | A novel human robot interaction using the Wiimote | |
| CN216067465U (en) | Medical somatosensory robot system based on inertial sensor | |
| Sharma et al. | Design and implementation of robotic hand control using gesture recognition | |
| CN107914273A (en) | Mechanical arm teaching system based on gesture control | |
| CN113211466A (en) | Medical somatosensory robot system based on inertial sensor | |
| Kao et al. | Design and implementation of interaction system between humanoid robot and human hand gesture | |
| Balaji et al. | Smart phone accelerometer sensor based wireless robot for physically disabled people | |
| CN215347222U (en) | Intelligent glove for human-computer interaction | |
| CN204748634U (en) | Motion control system of robot | |
| CN209919901U (en) | Immersive mobile grabbing service robot hardware system | |
| CN111966228A (en) | Exoskeleton data glove |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20220318 |