CN213582081U - Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module - Google Patents
Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module Download PDFInfo
- Publication number
- CN213582081U CN213582081U CN202020898985.5U CN202020898985U CN213582081U CN 213582081 U CN213582081 U CN 213582081U CN 202020898985 U CN202020898985 U CN 202020898985U CN 213582081 U CN213582081 U CN 213582081U
- Authority
- CN
- China
- Prior art keywords
- gesture recognition
- acquisition module
- recognition system
- data acquisition
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The utility model relates to a gesture recognition system based on flexible antibiotic biomembrane multichannel data acquisition module. The graphene flexible sensor substrate is of a porous structure, contains copper phosphate, has a good antibacterial effect, and can effectively inhibit the formation of escherichia coli and staphylococcus aureus biofilms. The sensor is attached to five finger joints, and the sensor data of each gesture is acquired by a multi-channel data acquisition module. And the data is transmitted to an upper computer through a serial port for analysis and processing. And collecting different gestures by an artificial neural network algorithm of the upper computer and planning the gestures into correct categories. The system solves the problems of high cost and complex technology in the current gesture recognition field, and can be widely applied to consumers. If a gesture recognition control function is added, the communication between the human machine and the computer can be greatly optimized. Therefore, the gesture recognition glove system has wide application fields, including application fields such as smart home, intelligent wearing and VR.
Description
Technical Field
The utility model relates to a sensor field specifically relates to a gesture recognition system based on flexible antibiotic biomembrane multichannel data acquisition module.
Background
Sign language is similar to spoken language and written language in expression, and especially in man-machine interaction, sign language has a strong visual effect and can intuitively express an intention. The gesture recognition can be applied to the fields of teaching, man-machine interaction, medical research and the like. At the same time, it is important to help people better understand and communicate using sign language. Thus, the exploration of gestures helps computers to better understand human language.
Gesture recognition mainly includes visual image recognition, Electromyogram (EMG) recognition and data gloves. Capturing gestures with devices such as cameras is generally called visual image recognition, and the visual image recognition is fast in development speed and high in recognition rate. The system utilizes the embedded camera to monitor the fingertips and the positions of the fingertips, and achieves low delay and high spatial resolution. However, the technology has some problems that the accuracy of complex gesture collection is influenced by the environment and scene when the gesture is collected, and the technology cannot be applied to most mobile devices because the device is expensive. Surface electromyographic sensors provide potential techniques for gesture sensing and surface electromyographic signals indicative of the activity of the relevant muscle during gesture execution. However, these existing strategies are expensive and if in the form of a wearable device there is the problem of the sensor being too heavy.
Gesture recognition research based on data gloves brings vitality and vitality to the field of pattern recognition, such as optical marker data gloves and data gloves attached to arms. However, they have not been widely used due to the inconvenience of wearing and the special requirements of arm movement. Firstly, how to make the existing materials into the sensor suitable for data glove collection is always the key point of hardware research. The existing sensor can basically meet the requirement of data acquisition, but how to find a more appropriate material so that the data glove has a more accurate recognition rate constitutes one of the main problems of the project. In addition, the data acquisition port needs to be able to acquire real-time data of at least 5 strain sensors, and the existing equipment is generally expensive, bulky and inconvenient to carry, and generally only provides 2 test channels. In addition, the research of the actual gesture recognition algorithm is sometimes difficult. Existing sign language recognition techniques include template matching, artificial neural networks, and some algorithms in combination with other techniques. Therefore, how to select the proper sensor, multi-channel data acquisition device and matching algorithm is a considerable problem.
SUMMERY OF THE UTILITY MODEL
The utility model aims at providing a gesture recognition system based on flexible antibacterial biomembrane multichannel data acquisition module, the device can gather five finger joint's activity information simultaneously, uses the sensor to test and real-time analysis in order to confirm the sensor that each finger corresponds, draws the finger activity signal that corresponds the sensor and carries out the analysis.
In order to achieve the purpose, the following technical scheme is adopted in the experiment:
the gesture recognition system based on the flexible antibacterial biological membrane multichannel data acquisition module is characterized by comprising a main body part, a multichannel sensor data acquisition module and a PC (personal computer) terminal, wherein the main body part comprises a glove and a stretchable flexible sensor arranged at a joint part, the stretchable flexible sensor at least comprises an upper layer structure packaged by a planar PDMS (polydimethylsiloxane) film, an intermediate layer structure using grid graphene as a sensing element, and a lower layer structure with a porous foam structure at the bottom, wherein the upper part of the porous foam structure is the planar PDMS film, and copper phosphate oligomers are adsorbed in the porous foam structure.
The main body part comprises a glove and stretchable flexible sensors fixed to five finger joint parts on the glove, and the 5 stretchable flexible sensors are respectively fixed to corresponding positions of 5 finger knuckles in the glove, so that the sensors can be attached to fingers.
The multichannel data acquisition module mainly comprises a voltage signal acquisition module, an analog-digital conversion module and a signal transmission module.
Wherein, the multichannel data acquisition module is positioned at the lower end of the glove.
The voltage signal acquisition module measures voltage by adopting an operational amplifier circuit according to the principle of partial pressure and then passes through a formula
The calculation translates into a resistance value of the sensor.
The analog-digital conversion module is composed of a peripheral circuit of a main control chip, and the analog-digital conversion of the chip is utilized to convert the acquired resistance signals from analog to digital signals and transmit the signals to a PC (personal computer) end so as to realize data analysis and identification functions.
The signal transmission module is a Ch340 serial circuit, and the converted digital signal is transmitted to the PC terminal through the serial circuit to be analyzed and processed in the next step.
The PC end utilizes a written artificial neural network algorithm to extract the characteristics of the acquired gesture signals, compares the extracted signal characteristics with the characteristics of different types of gestures in the database, judges the gesture made by the tested person and displays the result.
The utility model has the advantages that: 1) the wearable strain sensor which is rapid in response, high in sensitivity, capable of effectively resisting bacteria and long in service life is used for expressing sign language signals; 2) the gesture language capturing device realizes a multi-path perception test; 3) the artificial neural network algorithm identifies the sign language signals, so that the accuracy of sign language identification is improved; 4) the substrate of the flexible sensor has an antibacterial effect due to the fact that the substrate contains the copper phosphate, and can effectively inhibit the formation of a biological film of escherichia coli and staphylococcus aureus, so that the breeding of bacteria at the contact part of the skin film is prevented. The system solves the problems of high cost and complex technology in the current gesture recognition field, and can be widely applied to consumers. If a gesture recognition control function is added, the communication between the human machine and the computer can be greatly optimized. Therefore, the gesture recognition glove system has wide application fields, including application fields such as smart home, intelligent wearing and VR.
Drawings
Fig. 1 is a schematic diagram of a main part of the design.
Fig. 2 is a schematic diagram of a voltage measuring circuit of the multi-channel data measuring module.
Fig. 3 shows the overall framework of the sign language recognition system.
Fig. 4 is a flow chart of the system operation.
Fig. 5 is a schematic structural diagram of a flexible graphene sensor.
Fig. 6 is a schematic structural view of the lower layer of the sensor.
Fig. 7 is a schematic view showing that the substrate of the flexible sensor has an antibacterial effect due to the copper phosphate.
Detailed Description
The conception, specific structure and technical effects of the present invention will be described clearly and completely with reference to the accompanying drawings and embodiments, so as to fully understand the objects, aspects and effects of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Furthermore, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any combination of one or more of the associated listed items.
As shown in fig. 1-5, the utility model discloses a gesture recognition glove system based on flexible sensor 12 of graphite alkene and multichannel data acquisition module, it includes main part 1 and multichannel sensor data acquisition module 2 and PC end 3.
Referring to fig. 1, the sign language recognition system mainly obtains the motion of each finger through the flexible stretchable sensors 12 located at five finger joint portions in the glove 11 of the main body portion 1, and the flexible stretchable sensors 12 in fig. 1 can be completely attached to the skin to accurately measure the slight bending motion of each finger. Wherein the data acquisition module 2 of the multi-channel sensor is positioned at the lower end of the data glove, and the module has the advantages of small volume and high measurement precision.
Referring to FIG. 2, a schematic circuit diagram of the voltage acquisition module 21 in the multi-channel sensor data acquisition module 2 is shown, wherein RsensorIs the resistance of the sensor, VccIs the voltage of the system power supply, RfIs the value of a reference resistance, VoutputIs the measured output voltage, according to the relationship of the voltage division by the following formula
Calculating to obtain Rsensor。
Referring to fig. 3, a structural block diagram of the sign language recognition system is shown, and the internal part of the system comprises a main body part 1, a multi-channel sensor data acquisition module 2 and a PC terminal 3, and the multi-channel sensor data acquisition module 2 comprises a voltage signal acquisition module 21, an analog-digital conversion module 22 and a signal transmission module 23. The voltage signal acquisition module 21 can measure and calculate the resistance value of each unit of the stretchable flexible sensor 12 by a voltage division principle, and the analog-digital conversion module 22 converts the resistance measured by the voltage signal acquisition module 21 from an analog signal to a digital signal so as to be transmitted to the PC terminal 3 by the signal transmission module 23 for further processing.
As shown in the overall flow diagram of the system 4 in the figure, the process of acquiring the activity data of five finger joints by the multi-channel sensor data acquisition module 2 and transmitting the activity data to the PC terminal 3 is S1, S2 is that the PC terminal 3 extracts the characteristics of the acquired gesture signals by using an artificial neural network algorithm, and S3 compares the extracted signal characteristics with the characteristics of different types of gestures in the database, determines the gesture made by the person to be tested, and displays the result.
Referring to fig. 5, the flexible and stretchable sensor has a three-layer structure, the upper layer is encapsulated by a planar PDMS film 121, the middle layer is a grid graphene 122 synthesized by a chemical vapor deposition method and used as a sensing element, and the lower layer is a PDMS film 123 with a porous foam structure at the bottom and a planar upper part.
The lower layer of the sensor is a PDMS membrane 123 with a porous foam structure A1 on the bottom and a flat A2 on the top, wherein copper phosphate is adsorbed in the porous foam structure.
The substrate of the flexible sensor has an antibacterial effect due to the fact that the substrate contains copper phosphate, and the copper phosphate oligomer contained in the substrate can effectively inhibit the formation of a biofilm of escherichia coli and staphylococcus aureus, so that the growth of bacteria at a skin contact part is prevented.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (7)
1. The gesture recognition system based on the flexible antibacterial biological membrane multichannel data acquisition module is characterized by comprising a main body part, a multichannel sensor data acquisition module and a PC (personal computer) terminal, wherein the main body part comprises a glove and a stretchable flexible sensor arranged at a joint part, the stretchable flexible sensor at least comprises an upper layer structure packaged by a planar PDMS (polydimethylsiloxane) film, an intermediate layer structure using grid graphene as a sensing element, and a lower layer structure with a porous foam structure at the bottom, wherein the upper part of the porous foam structure is the planar PDMS film, and copper phosphate oligomers are adsorbed in the porous foam structure.
2. The gesture recognition system of claim 1, wherein: the main body part comprises a glove and stretchable flexible sensors fixed on five finger joint parts of the glove, and the 5 stretchable flexible sensors are respectively fixed at corresponding positions of 5 finger knuckles in the glove, so that the sensors can be attached to fingers.
3. The gesture recognition system of claim 1, wherein: the multi-channel data acquisition module mainly comprises a voltage signal acquisition module, an analog-digital conversion module and a signal transmission module.
4. The gesture recognition system of claim 1, wherein: the multichannel data acquisition module is positioned at the lower end of the glove.
5. The gesture recognition system of claim 3, wherein: the voltage signal acquisition module measures voltage by adopting an operational amplifier circuit according to the principle of partial pressure and then passes through a formula
The calculation translates into a resistance value of the sensor.
6. The gesture recognition system of claim 3, wherein: the analog-digital conversion module is composed of a peripheral circuit of a main control chip, and the analog-digital conversion of the chip is utilized to convert the acquired resistance signal from analog to digital signal and transmit the digital signal to a PC (personal computer) end so as to realize the functions of data analysis and identification.
7. The gesture recognition system of claim 3, wherein: the signal transmission module is a Ch340 serial circuit, and the converted digital signals are transmitted to the PC end through the serial circuit so as to be analyzed and processed in the next step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020898985.5U CN213582081U (en) | 2020-05-25 | 2020-05-25 | Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020898985.5U CN213582081U (en) | 2020-05-25 | 2020-05-25 | Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN213582081U true CN213582081U (en) | 2021-06-29 |
Family
ID=76522052
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202020898985.5U Active CN213582081U (en) | 2020-05-25 | 2020-05-25 | Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN213582081U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114376565A (en) * | 2022-01-18 | 2022-04-22 | 法罗适(上海)医疗技术有限公司 | Data glove and manufacturing method thereof |
-
2020
- 2020-05-25 CN CN202020898985.5U patent/CN213582081U/en active Active
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114376565A (en) * | 2022-01-18 | 2022-04-22 | 法罗适(上海)医疗技术有限公司 | Data glove and manufacturing method thereof |
| CN114376565B (en) * | 2022-01-18 | 2022-08-30 | 法罗适(上海)医疗技术有限公司 | Data glove and manufacturing method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Jiang et al. | Feasibility of wrist-worn, real-time hand, and surface gesture recognition via sEMG and IMU sensing | |
| CN111443816A (en) | Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module | |
| CN106527738B (en) | A kind of multi information body feeling interaction glove system and method for virtual reality system | |
| Tognetti et al. | Wearable kinesthetic system for capturing and classifying upper limb gesture in post-stroke rehabilitation | |
| CN105380342A (en) | Intelligent insole system based on capacitive pressure sensors | |
| CN202494540U (en) | Manipulation data measuring system | |
| CN103654774A (en) | Wearable movable bracelet | |
| WO2007075703A2 (en) | Recordation of handwriting and hand movement using electromyography | |
| CN109141696B (en) | Flexible touch sensor based on piezoelectric film and signal processing system thereof | |
| CN105232052A (en) | Device for recognizing human lower limbs movement posture by virtue of combined sensor | |
| CN107803843A (en) | A kind of measuring of human health robot based on Raspberry Pi | |
| CN111426392A (en) | Infrared body surface temperature measuring equipment and detection method | |
| CN109765996A (en) | Insensitive gesture detection system and method are deviated to wearing position based on FMG armband | |
| CN213582081U (en) | Gesture recognition system based on flexible antibacterial biological membrane multi-channel data acquisition module | |
| CN108852361A (en) | Human body attitude monitoring method and clothes based on FBG sensing technology | |
| CN116909390A (en) | Multi-mode data acquisition system based on glove | |
| CN104856707A (en) | Pressure sensing data glove based on machine vision and gripping process judgment method thereof | |
| Rodriguez-Labra et al. | Development of a wireless robotic arm control system using piezoelectric sensors and neural networks | |
| Qiu et al. | A multisensory-feedback tactile glove with dense coverage of sensing arrays for object recognition | |
| Wang et al. | A flexible iontronic capacitive sensing array for hand gesture recognition using deep convolutional neural networks | |
| Fujiwara et al. | Identification of hand gestures using the inertial measurement unit of a smartphone: a proof-of-concept study | |
| CN105708441B (en) | Wearable fingerstall and electrocardiogram and pulse-tracing collection terminal | |
| Zhang et al. | High-performance surface electromyography armband design for gesture recognition | |
| Lu et al. | 3-D tactile-based object recognition for robot hands using force-sensitive and bend sensor arrays | |
| CN106805943A (en) | Blood glucose level data processing method and processing device based on Fractional Differential Equation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |