CN110764621A - Self-powered intelligent touch glove and mute gesture broadcasting system - Google Patents
Self-powered intelligent touch glove and mute gesture broadcasting system Download PDFInfo
- Publication number
- CN110764621A CN110764621A CN201911057956.4A CN201911057956A CN110764621A CN 110764621 A CN110764621 A CN 110764621A CN 201911057956 A CN201911057956 A CN 201911057956A CN 110764621 A CN110764621 A CN 110764621A
- Authority
- CN
- China
- Prior art keywords
- self
- powered
- flexible
- gesture
- chip microcomputer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 claims description 12
- 239000002184 metal Substances 0.000 claims description 9
- 239000004020 conductor Substances 0.000 claims description 8
- 239000003990 capacitor Substances 0.000 claims description 7
- 238000013473 artificial intelligence Methods 0.000 claims description 6
- 238000004146 energy storage Methods 0.000 claims description 5
- 210000001145 finger joint Anatomy 0.000 claims description 5
- 239000003792 electrolyte Substances 0.000 claims description 3
- 230000033001 locomotion Effects 0.000 abstract description 4
- 230000007547 defect Effects 0.000 abstract description 2
- 206010011878 Deafness Diseases 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a self-powered intelligent touch glove and a mute gesture broadcasting system. The system collects hand motions by using self-powered intelligent touch gloves and converts sensing signals into voice results through a signal collection circuit and a gesture recognition component. The requirement on power supply equipment is reduced, the defects of the traditional solid-state sensor are overcome, and the portability and the comfort level of the mute recognition equipment are improved.
Description
Technical Field
The invention relates to an intelligent mute recognition system, in particular to a self-powered intelligent touch glove and a mute gesture broadcasting system.
Background
The number of deaf-mutes in the world is more than 6500 ten thousand. The mute language is a common communication mode among the deaf-mute persons, but most of the common normal persons do not learn the mute language, so that the inconvenience of communication between the deaf-mute persons and the normal persons is caused. In order to solve the problem, the life of the deaf-mute group is more convenient, and the requirements are provided for a mute recognition system which is convenient for common people to use.
The current method of identifying the dummy language is basically divided into two types of image identification and sensor data-based identification.
The image recognition method utilizes a camera to capture hand movements. On the one hand, accurate capturing and recognition of hand movement in motion are difficult to achieve, and on the other hand, due to the reasons such as light angles, complete and clear hand images cannot be guaranteed to be obtained. In addition, the cost is high, and certain requirements are placed on the economic level of a using object.
The sensor-based mute recognition system usually adopts a traditional solid-state sensor and needs an external power supply, so that the portability and the comfort level of the wearable device are greatly reduced, and the requirements on the flexible self-powered portable mute recognition device are further met.
Disclosure of Invention
The invention aims to improve the intelligent mute recognition system and provides a self-powered intelligent touch glove and a mute gesture broadcasting system.
In order to achieve the purpose, the invention adopts the following technical scheme:
the utility model provides a self-powered intelligence sense of touch gloves and mute gesture report system, includes: the wearable glove comprises a wearable glove, a self-powered sensor, a signal acquisition and transmission assembly and a gesture recognition and voice broadcast assembly, wherein the self-powered sensor is arranged on the wearable glove, and the signal acquisition and transmission assembly is respectively connected with the power supply sensor and the gesture recognition and voice broadcast assembly; wherein:
the wearable glove is provided with a plurality of groups of self-powered sensors which are respectively positioned at the front two finger joints, the palm center and the finger joint heels of each finger on the back of the hand;
the signal acquisition transmission assembly comprises: the voltage dividing circuit comprises a plurality of groups of voltage dividing circuits and a single chip microcomputer, wherein each group of voltage dividing circuits is formed by connecting a constant value resistor with a group of self-powered sensors in series; one end of each fixed value resistor is grounded with the single chip microcomputer, the other end of each fixed value resistor is connected to an input pin of the single chip microcomputer to monitor voltage change on the single chip microcomputer, and meanwhile, the single chip microcomputer is connected with the gesture recognition and voice broadcast assembly through a USB interface;
gesture recognition and voice broadcast subassembly includes: and the gesture recognition module based on an artificial intelligence algorithm and the voice module corresponding to the mute gesture are both arranged in the PC.
The self-powered sensor is formed by connecting a flexible super capacitor and a flexible piezoresistive sensor in series.
The flexible piezoresistive sensor is a flexible sensing device which is assembled by a metal electrode and a flexible sponge added with a two-dimensional conductive material and has a metal electrode-sponge-metal electrode sandwich structure.
The flexible super capacitor is a flexible energy storage device which is assembled by a flexible sponge added with a two-dimensional conductive material, electrolyte and a battery diaphragm and has a sponge electrode-electrolyte-battery diaphragm-electrolyte-sponge electrode sandwich structure.
The invention has the beneficial effects that:
according to the invention, by applying the flexible sensor capable of self-powering, the requirement on power supply equipment is reduced, the defect that the traditional solid-state sensor is not light and flexible is overcome, and the portability and the comfort of the mute recognition equipment are improved.
Drawings
FIG. 1 is a schematic diagram of a smart touch glove and self-powered sensor according to the present invention;
FIG. 2 is a schematic diagram of an array voltage divider circuit according to the present invention;
FIG. 3 is a schematic structural view of the present invention;
FIG. 4 is a flow chart of the work flow of the gesture recognition module based on the artificial intelligence algorithm of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and examples.
Referring to fig. 3, the present invention includes: wearable gloves 1, self-powered sensor 2, signal acquisition transmission assembly 3, gesture recognition and voice broadcast subassembly 4, from power supply sensor 2 sets up on wearable gloves 1, and power supply sensor 2 and gesture recognition and voice broadcast subassembly 4 are connected respectively to signal acquisition transmission assembly 3.
Referring to fig. 1, a plurality of groups of self-powered sensors 2 are arranged on the wearable glove 1 and are respectively positioned at the front two knuckles, the palm center and the finger seam heel of each finger on the back of the hand to form an intelligent touch glove; the self-powered sensor 2 is formed by connecting a flexible super capacitor 21 and a flexible piezoresistive sensor 22 in series; the flexible piezoresistive sensor 21 is a flexible sensing device which is assembled by a metal electrode and a flexible sponge added with a two-dimensional conductive material and has a metal electrode-sponge-metal electrode sandwich structure; the flexible super capacitor 22 is a flexible energy storage device with a sandwich structure of sponge electrode-electrolyte-battery diaphragm-electrolyte-sponge electrode, which is assembled by a flexible sponge added with a two-dimensional conductive material, electrolyte and a battery diaphragm.
Referring to fig. 2, the signal acquisition and transmission assembly 3 includes: the voltage dividing circuit comprises a plurality of groups of voltage dividing circuits and a single chip microcomputer, wherein each group of voltage dividing circuits is formed by connecting a fixed value resistor R with a group of self-powered sensors 2 in series; one end of each constant value resistor R is grounded with the single chip microcomputer, the other end of each constant value resistor R is connected to an input pin of the single chip microcomputer to monitor voltage change of the single chip microcomputer, and meanwhile the single chip microcomputer is connected with the gesture recognition and voice broadcasting assembly 4 through a USB interface.
Gesture recognition and voice broadcast subassembly 4 includes: and the gesture recognition module based on an artificial intelligence algorithm and the voice module corresponding to the mute gesture are both arranged in the PC.
Examples
Referring to fig. 3, the present embodiment includes: the wearable glove comprises a wearable glove 1, a self-powered sensor 2, a signal acquisition and transmission component 3 and a gesture recognition and voice broadcasting component 4; sixteen groups of self-powered sensors 2 are distributed on the wearable glove 1, one group is pasted at the front two finger joints of each finger on the back of the hand, ten groups are pasted in total, two groups are pasted at the center of the palm, and the other four groups are pasted at four finger gaps respectively; the signal acquisition transmission assembly 3 includes: sixteen paths of voltage division circuits and a single chip microcomputer, wherein each group of voltage division circuits is formed by connecting a fixed value resistor R with a group of self-powered sensors 2 in series, one end of each fixed value resistor R is grounded with the single chip microcomputer, the other end of each fixed value resistor R is connected with an input pin of the single chip microcomputer to monitor voltage change of the single chip microcomputer, and meanwhile, the single chip microcomputer is connected with a PC end through a USB interface; gesture recognition and voice broadcast module 4 includes: the gesture recognition module based on the artificial intelligence algorithm and a preset voice file corresponding to the mute gesture both run at a PC (personal computer) end, and the application computer analyzes and processes signals based on the artificial intelligence algorithm, recognizes gesture information and calls the corresponding voice file to broadcast.
Referring to fig. 1, the self-powered sensor 2 is a flexible device with a sandwich structure and combined with energy storage and piezoresistive characteristics, which is assembled by a flexible sponge added with a two-dimensional conductive material, and is assembled into a flexible supercapacitor and a piezoresistive sensor respectively by applying the two characteristics, the flexible supercapacitor and the piezoresistive sensor are connected in series to form a self-powered sensor group, the piezoresistive sensor is accurately arranged at a joint, the flexible supercapacitor is arranged below the flexible supercapacitor in parallel, the flexible supercapacitor is a flexible energy storage device capable of bearing large deformation, and the piezoresistive sensor is a flexible sensor added with a two-dimensional conductive material, and the resistance value of the piezoresistive sensor can be changed remarkably along with the change of external pressure.
Referring to fig. 4, the gesture recognition and voice broadcasting assembly 4 includes: a voltage-grayscale map conversion module 41, a recognition module 42, an intelligent association module 43 and a voice broadcast module 44; the voltage-grayscale diagram conversion module 41 converts the sixteen read voltage signals into a four-by-four grayscale diagram according to the sensor position numbers; the recognition module 42 is used for calling a BP neural network based on training and recognizing a four-by-four gray-scale image to obtain a corresponding letter or number recognition result; the intelligent association module 43 performs intelligent association according to the user input content and the use habit, and recommends related content for the user to select; and the voice broadcasting module 44 calls the corresponding voice file according to the final result and performs voice broadcasting.
The specific working process of this embodiment:
1) use intelligent sense of touch gloves to gather hand action: the wearable glove is characterized in that a first joint and a second joint of five fingers of the wearable glove are respectively stuck with a group of self-powered sensing components at four finger gaps, and two groups of self-powered sensing components are stuck at the palm center; each group of self-powered sensing assemblies is formed by connecting a flexible super capacitor and a flexible piezoresistive sensor in series; the resistance value of the flexible piezoresistive sensor can change along with the action of the hand when the fingers bend, the palm opens and closes and the finger gaps extrude;
2) the transmission sensing signal is acquired by using a voltage division type signal acquisition circuit and a single chip microcomputer: sixteen groups of sensing assemblies, each group and a fixed value resistor are connected in series to form sixteen voltage dividing circuits, one end of each fixed value resistor is grounded with the single chip microcomputer, the other end of each fixed value resistor is connected to a signal input port of the single chip microcomputer to monitor voltage change on the fixed value resistor to be used as analog signal input, the single chip microcomputer is used for completing analog-digital signal conversion, and the obtained sixteen paths of digital sensors are transmitted to the PC through a USB interface;
3) the voltage-gray scale map conversion module converts the 16 paths of sensing signals into a 4x4 gray scale map according to the position numbers of the sensors. Reading the converted 4x4 gray-scale image by a neural network calling program, inputting the gray-scale image into the trained BP neural network for image recognition, and obtaining a recognition result which is a corresponding letter or number;
4) and the word combination program collects and arranges letters of the recognition result, intelligently recommends words with similar spellings for a user to select according to the existing input, and outputs the selection result to the output module. The user habit adaptive program adjusts the parameters of the word combination program according to the result of each selection, so that more common words are recommended, and the user habit adaptive program accords with personal use habits.
5) And the sound broadcasting module receives the identification result, displays the result on a screen and broadcasts a corresponding word.
Claims (4)
1. The utility model provides a self-powered intelligence sense of touch gloves and mute gesture report system which characterized in that, this system includes: the wearable glove comprises a wearable glove, a self-powered sensor, a signal acquisition and transmission assembly and a gesture recognition and voice broadcast assembly, wherein the self-powered sensor is arranged on the wearable glove, and the signal acquisition and transmission assembly is respectively connected with the self-powered sensor and the gesture recognition and voice broadcast assembly; wherein:
the wearable glove is provided with a plurality of groups of self-powered sensors which are respectively positioned at the front two finger joints, the palm center and the finger joint heels of each finger on the back of the hand;
the signal acquisition transmission assembly comprises: the voltage dividing circuit comprises a plurality of groups of voltage dividing circuits and a single chip microcomputer, wherein each group of voltage dividing circuits is formed by connecting a constant value resistor with a group of self-powered sensors in series; one end of each fixed value resistor is grounded with the single chip microcomputer, the other end of each fixed value resistor is connected to an input pin of the single chip microcomputer to monitor voltage change on the single chip microcomputer, and meanwhile, the single chip microcomputer is connected with the gesture recognition and voice broadcast assembly through a USB interface;
gesture recognition and voice broadcast subassembly includes: the gesture recognition module based on the artificial intelligence algorithm and the voice module corresponding to the mute gesture are arranged in the PC.
2. A self-powered smart touch glove and whisper gesture-broadcast system as in claim 1, wherein said self-powered sensor is: the flexible super capacitor is connected with the flexible piezoresistive sensor in series.
3. The self-powered smart touch glove and dumb gesture broadcast system of claim 2, wherein the flexible piezoresistive sensor is a flexible sensing device with a metal electrode-sponge-metal electrode sandwich structure assembled by metal electrodes and flexible sponge added with two-dimensional conductive material.
4. The self-powered intelligent touch glove and mute gesture broadcast system according to claim 2, wherein the flexible super capacitor is a flexible energy storage device with a sandwich structure of sponge electrode-electrolyte-battery diaphragm-electrolyte-sponge electrode, which is assembled by a flexible sponge added with a two-dimensional conductive material, an electrolyte and a battery diaphragm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911057956.4A CN110764621A (en) | 2019-11-01 | 2019-11-01 | Self-powered intelligent touch glove and mute gesture broadcasting system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911057956.4A CN110764621A (en) | 2019-11-01 | 2019-11-01 | Self-powered intelligent touch glove and mute gesture broadcasting system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110764621A true CN110764621A (en) | 2020-02-07 |
Family
ID=69335952
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911057956.4A Pending CN110764621A (en) | 2019-11-01 | 2019-11-01 | Self-powered intelligent touch glove and mute gesture broadcasting system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110764621A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111857334A (en) * | 2020-07-02 | 2020-10-30 | 上海交通大学 | Human body gesture letter recognition method and device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107063520A (en) * | 2017-01-05 | 2017-08-18 | 中南大学 | Flexible piezoresistance sensor and its method of production based on built-in electrode |
| US20180158370A1 (en) * | 2016-12-07 | 2018-06-07 | Thomas William Pryor | Hand motion interpretation and communication apparatus |
| CN109613976A (en) * | 2018-11-14 | 2019-04-12 | 华东师范大学 | A kind of intelligent flexible pressure sensing hand language recognition device |
| CN209070491U (en) * | 2018-11-14 | 2019-07-05 | 华东师范大学 | A kind of pliable pressure sensing hand language recognition device |
| CN110362195A (en) * | 2019-06-10 | 2019-10-22 | 东南大学 | Gesture identification and interactive system based on bistable state coding and Flexiable angular transducer |
-
2019
- 2019-11-01 CN CN201911057956.4A patent/CN110764621A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180158370A1 (en) * | 2016-12-07 | 2018-06-07 | Thomas William Pryor | Hand motion interpretation and communication apparatus |
| CN107063520A (en) * | 2017-01-05 | 2017-08-18 | 中南大学 | Flexible piezoresistance sensor and its method of production based on built-in electrode |
| CN109613976A (en) * | 2018-11-14 | 2019-04-12 | 华东师范大学 | A kind of intelligent flexible pressure sensing hand language recognition device |
| CN209070491U (en) * | 2018-11-14 | 2019-07-05 | 华东师范大学 | A kind of pliable pressure sensing hand language recognition device |
| CN110362195A (en) * | 2019-06-10 | 2019-10-22 | 东南大学 | Gesture identification and interactive system based on bistable state coding and Flexiable angular transducer |
Non-Patent Citations (1)
| Title |
|---|
| 张海霞: ""Alice Wonderlab最新成果：高可压缩性自驱动健康监测系统"", 《HTTPS://BLOG.SCIENCENET.CN/HOME.PHP?MOD=SPACE&UID=299&DO=BLOG&QUICKFORWARD=1&ID=1070685》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111857334A (en) * | 2020-07-02 | 2020-10-30 | 上海交通大学 | Human body gesture letter recognition method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11422623B2 (en) | Wrist worn computing device control systems and methods | |
| US9612661B2 (en) | Closed loop feedback interface for wearable devices | |
| Zhang et al. | Recognizing hand gestures with pressure-sensor-based motion sensing | |
| CN110008839B (en) | Intelligent sign language interaction system and method for self-adaptive gesture recognition | |
| Khodabandelou et al. | Attention-based gated recurrent unit for gesture recognition | |
| CN112428308B (en) | Robot touch action recognition system and recognition method | |
| CN110464356B (en) | Comprehensive monitoring method and system for exercise capacity | |
| CN104856707A (en) | Pressure sensing data glove based on machine vision and gripping process judgment method thereof | |
| CN110764621A (en) | Self-powered intelligent touch glove and mute gesture broadcasting system | |
| CN113856132B (en) | Rope skipping action recognition system and method and rope skipping | |
| CN110865709A (en) | Flexible sensor-based gesture recognition system and method and glove | |
| CN104765475A (en) | Wearable virtual keyboard and implementation method thereof | |
| CN111513731B (en) | Flexible intelligent detection device based on sufficient state monitoring attention | |
| CN113116363A (en) | Method for judging hand fatigue degree based on surface electromyographic signals | |
| CN110624217A (en) | Rehabilitation glove based on multi-sensor fusion and implementation method thereof | |
| CN116909390A (en) | Multi-mode data acquisition system based on glove | |
| CN112380943B (en) | Multi-position limb motion capture method based on electrical impedance | |
| CN114997227A (en) | Gesture recognition system based on muscle stress | |
| Tao et al. | Research on communication APP for deaf and mute people based on face emotion recognition technology | |
| CN109298792A (en) | For the four-way capacitance signal acquisition device of gesture identification and its recognition methods | |
| CN209070491U (en) | A kind of pliable pressure sensing hand language recognition device | |
| CN112883935A (en) | Neural network real-time sign language translation system equipment | |
| CN114063824A (en) | Pressure sensing module, pressure sensing detection method and device and electronic equipment | |
| CN114005174A (en) | Method and device for determining working state, electronic equipment and storage medium | |
| Wang et al. | Haptic Glove for Object Recognition and Hand Motion Detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200207 |
|
| WD01 | Invention patent application deemed withdrawn after publication |