CN206003392U - A kind of deaf-mute's social activity gloves - Google Patents

A kind of deaf-mute's social activity gloves Download PDF

Info

Publication number
CN206003392U
CN206003392U CN201620451331.1U CN201620451331U CN206003392U CN 206003392 U CN206003392 U CN 206003392U CN 201620451331 U CN201620451331 U CN 201620451331U CN 206003392 U CN206003392 U CN 206003392U
Authority
CN
China
Prior art keywords
deaf
mute
module
social activity
wifi module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201620451331.1U
Other languages
Chinese (zh)
Inventor
程树英
林鹏程
吴丽君
林培杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN201620451331.1U priority Critical patent/CN206003392U/en
Application granted granted Critical
Publication of CN206003392U publication Critical patent/CN206003392U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The utility model is related to a kind of deaf-mute social activity gloves.Be used for gathering the data glove of deaf-mute's gesture information including one, one for deaf-mute's gesture information data is activation for gathering the data glove to the WIFI module of mobile phone, one for the power module powered for data glove and WIFI module;The data glove includes a microcontroller and the sensor assembly for recognizing collection deaf-mute's gesture information being connected with the microcontroller, and the microcontroller is connected with the WIFI module.The utility model introduces the mode of two-way exchange by the communication of deaf-mute's social activity gloves and mobile phone so that normal person is it will be appreciated that while sign language, deaf-mute will also understand that the meaning of normal person's voice representative.

Description

A kind of deaf-mute's social activity gloves
Technical field
The utility model is related to a kind of for realizing the apparatus and method exchanged between deaf-mute and normal person, specifically leads to Cross sign language technology of identification and sign language is converted into the voice messaging output understood by normal person, while passing through speech recognition technology by language Sound is converted into the sign language information understood by deaf-mute, especially a kind of deaf-mute's social activity gloves.
Background technology
Deaf-mute is disadvantaged group of society, and they are in social edge, it is impossible to serve as work in numerous areas, This is largely because their exchanging caused by existing problems between normal person, and normal person cannot understand sign language generation The meaning of table, deaf-mute cannot obtain the meaning representated by normal person's voice.
Interpreting equipment generally existing on the market problems with present:
1st, interpreting equipment is heavy, it has not been convenient to which user carries, and causes availability to be had a greatly reduced quality;
2nd, interpreting equipment is substantially unidirectional, and such as sign language turns voice, and voice changes hands language, and the equipment for taking into account the two is that do not have Have.
Content of the invention
In view of this, the purpose of this utility model is to provide the two-way exchange that can be directed between deaf-mute and normal person, And the equipment that convenient use person carries.
For achieving the above object, the technical solution of the utility model is:A kind of deaf-mute's social activity gloves, are used for adopting including one The data glove of collection deaf-mute's gesture information, a deaf-mute's gesture information data is activation for being used for gathering the data glove are given The WIFI module of mobile phone, one are used for the power module that powers for data glove and WIFI module;The data glove includes that one is micro- Controller and the sensor assembly for recognizing collection deaf-mute's gesture information being connected with the microcontroller, the microcontroller It is connected with the WIFI module.
In the utility model embodiment, the sensor assembly includes the sensing for gathering hand joint flexibility information The sensor of device, the sensor of collection finger precedence information and collection hand exercise trace information.
In the utility model embodiment, described WIFI module adopts IEEE 802.11n standard, and frequency is 2.4GHz, the WIFI module turn WIFI module for serial ports, can be operated under AP, STA both of which.
In the utility model embodiment, the microcontroller adopts 32 103F RBT6 of STM.
In the utility model embodiment, the WIFI module is communicated with mobile phone, is provided with sign language on the mobile phone Identification module, sound identification module and voice playing module, the Sign Language Recognition module are used for recognizing that the WIFI module sends Deaf-mute's gesture information, and be converted to voice signal and played by voice playing module, the sound identification module is used for knowing Other normal person's voice messaging, and be converted to sign language picture and be shown in the enterprising road wheel of mobile phone screen and broadcast.
In the utility model embodiment, the sound identification module identification voice is Chinese speech.
In the utility model embodiment, the sign language picture be with comprising the dynamic of sign language meaning or static map Piece, is JPEG or GIF form.
In the utility model embodiment, the power module adopts lithium battery, and voltage swing is 3.7V, and capacity is 1300mAh.
Compared to prior art, the beneficial effects of the utility model are that, for deaf-mute, data glove is deaf and dumb by gathering The gesture information of people, is processed on the microcontroller in data glove, is then passed through Wifi module and is sent data to hand Generator terminal application program, final data are recognized and are converted into corresponding voice signal in mobile phone terminal realization and play back;For normal People, normal person carry out speech recognition by the application program of mobile phone terminal, and the result of speech recognition is carried out participle, obtain being suitable for hand These basic vocabularies are finally carried out carousel in the form of sign language picture by the basic vocabulary of language.
Description of the drawings
Fig. 1 is the system framework figure of one embodiment of the utility model.
Fig. 2 is flow process and the method schematic diagram of the deaf-mute using the utility model gloves of one embodiment of the utility model.
Fig. 3 is flow process and the method schematic diagram of the normal person using the utility model gloves of one embodiment of the utility model.
Specific embodiment
Now with detailed reference to preferred embodiment of the present utility model, its example is described in the accompanying drawings.Hereinafter, will ginseng Examine accompanying drawing preferred embodiment of the present utility model explained in detail.
A kind of deaf-mute's social activity gloves of the present utility model, are used for gathering the data hand of deaf-mute's gesture information including one Set, one be used for by the data glove gather deaf-mute's gesture information data is activation to mobile phone WIFI module, one be used for be The power module that data glove and WIFI module are powered;The data glove is included a microcontroller and is connected with the microcontroller The sensor assembly for recognizing collection deaf-mute's gesture information, the microcontroller is connected with the WIFI module.
The sensor assembly includes sensor, the collection finger precedence information for gathering hand joint flexibility information Sensor and collection hand exercise trace information sensor, those sensors can adopt MPU9250.
Described WIFI module adopts IEEE 802.11n standard, and frequency is 2.4GHz, and the WIFI module turns for serial ports WIFI module, can be operated under AP, STA both of which.
The microcontroller adopts 32 103F RBT6 of STM.
The WIFI module is communicated with mobile phone, be provided with the mobile phone Sign Language Recognition module, sound identification module and Voice playing module, the Sign Language Recognition module are used for recognizing deaf-mute's gesture information that the WIFI module sends, and change Played by voice playing module for voice signal, the sound identification module is used for recognizing normal person's voice messaging, and changes The enterprising road wheel of mobile phone screen is shown in for sign language picture to broadcast.The sound identification module identification voice is Chinese speech.The hand Sonagram piece is with the dynamic comprising sign language meaning or static images, is JPEG or GIF form.
The power module adopts lithium battery, and voltage swing is 3.7V, and capacity is 1300mAh.
Of the present utility model application example is told about in detail below.
Fig. 1 is the system framework figure of one embodiment of the utility model.
With reference to Fig. 1, deaf-mute's social activity gloves include:(1)For gathering the data glove of deaf-mute's gesture information;(2)With Mobile phone Sign Language Recognition module in the different gestures of identification(Can be realized by mobile phone terminal application program);(3)For data is activation WIFI module;(4)For the power module that powers.For deaf-mute, data glove passes through to gather the gesture information of deaf-mute, Processed on microcontroller in data glove, then pass through WIFI module and mobile phone terminal application program is sent data to, most Data are recognized and are converted into corresponding voice signal in mobile phone terminal realization and play back afterwards;For normal person, normal person passes through hand Machine sound identification module(Can be realized by the application program of mobile phone terminal)Speech recognition is carried out, the result of speech recognition is carried out point Word, obtains being suitable for the basic vocabulary of sign language, finally these basic vocabularies is carried out carousel in the form of sign language picture.
Fig. 2 be for the utility model embodiment deaf-mute using flow process and method.
With reference to Fig. 2, a kind of deaf-mute's using method of the social gloves of described deaf-mute, deaf-mute pass through wearing gloves, After carrying out the expression of sign language, data glove can gather corresponding gesture information, and be transmitted to application program of mobile phone end by WIFI, Corresponding Word message is identified as in application program of mobile phone up knob language, finally Word message is converted into corresponding voice signal Output.
Fig. 3 is the normal person of one embodiment of the utility model using flow process and method.
With reference to Fig. 3, described normal person is as follows with method using flow process:
After expressing voice, speech recognition is become corresponding Word message to normal person by application program of mobile phone, is then passed through Chinese Word Automatic Segmentation carries out the segmentation of sentence, is divided into the basic vocabulary for being suitable for sign language expression, for different bases This vocabulary reads corresponding sign language picture, and plays to Application Program Interface in the form of dynamically or statically.
As described above, the present invention can carry out the process that sign language turns voice, it is also possible to carry out the process that voice changes hands language.Special Not, equipment is improved a lot in portability.
Above-listed preferred embodiment, is further described to the purpose of this utility model, technical scheme and advantage, Should be understood that and preferred embodiment of the present utility model is the foregoing is only, not in order to limit the utility model, all Within spirit of the present utility model and principle, any modification, equivalent substitution and improvement that is made etc., should be included in this practicality Within new protection domain.

Claims (8)

1. a kind of deaf-mute social activity gloves, it is characterised in that:Including one be used for gather deaf-mute's gesture information data glove, one For deaf-mute's gesture information data is activation that the data glove is gathered to mobile phone WIFI module, one be used for as data hand The power module that set and WIFI module are powered;The data glove include a microcontroller and be connected with the microcontroller for The sensor assembly of identification collection deaf-mute's gesture information, the microcontroller are connected with the WIFI module.
2. a kind of deaf-mute social activity gloves according to claim 1, it is characterised in that:The sensor assembly includes collection The sensor of hand joint flexibility information, the sensor of collection finger precedence information and collection hand exercise track letter The sensor of breath.
3. a kind of deaf-mute social activity gloves according to claim 1, it is characterised in that:Described WIFI module adopts IEEE 802.11n standard, frequency are 2.4GHz, and the WIFI module turns WIFI module for serial ports, can be operated under AP, STA both of which.
4. a kind of deaf-mute social activity gloves according to claim 1, it is characterised in that:The microcontroller adopts STM 32 103F RBT6.
5. a kind of deaf-mute social activity gloves according to claim 1, it is characterised in that:The WIFI module is carried out with mobile phone Communication, is provided with Sign Language Recognition module, sound identification module and voice playing module on the mobile phone, the Sign Language Recognition module is used In the deaf-mute's gesture information for recognizing that the WIFI module sends, and be converted to voice signal and played by voice playing module, The sound identification module is used for recognizing normal person's voice messaging, and is converted to sign language picture and is shown in the enterprising road wheel of mobile phone screen Broadcast.
6. a kind of deaf-mute social activity gloves according to claim 5, it is characterised in that:The sound identification module recognizes language Sound is Chinese speech.
7. a kind of deaf-mute social activity gloves according to claim 5, it is characterised in that:The sign language picture be with including The dynamic of sign language meaning or static images, are JPEG or GIF form.
8. a kind of deaf-mute social activity gloves according to claim 1, it is characterised in that:The power module is using lithium electricity Pond, voltage swing are 3.7V, and capacity is 1300mAh.
CN201620451331.1U 2016-05-18 2016-05-18 A kind of deaf-mute's social activity gloves Expired - Fee Related CN206003392U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201620451331.1U CN206003392U (en) 2016-05-18 2016-05-18 A kind of deaf-mute's social activity gloves

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201620451331.1U CN206003392U (en) 2016-05-18 2016-05-18 A kind of deaf-mute's social activity gloves

Publications (1)

Publication Number Publication Date
CN206003392U true CN206003392U (en) 2017-03-08

Family

ID=58203891

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201620451331.1U Expired - Fee Related CN206003392U (en) 2016-05-18 2016-05-18 A kind of deaf-mute's social activity gloves

Country Status (1)

Country Link
CN (1) CN206003392U (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107067892A (en) * 2017-03-15 2017-08-18 南昌大学 Multi-information acquisition sign language interpretation system
CN107230414A (en) * 2017-06-16 2017-10-03 天津职业技术师范大学 A kind of SCM Based Sign Language Recognition translation system
CN108334197A (en) * 2018-01-26 2018-07-27 北京千丁互联科技有限公司 A kind of tool of communications for hearing-impaired people
CN109448696A (en) * 2018-12-27 2019-03-08 韩思清 A kind of sounding gloves apparatus with deaf-mute's two-way exchange
CN111240489A (en) * 2020-02-27 2020-06-05 广州大学华软软件学院 Gesture recognition method and system based on gesture recognition glove and gesture recognition glove

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107067892A (en) * 2017-03-15 2017-08-18 南昌大学 Multi-information acquisition sign language interpretation system
CN107230414A (en) * 2017-06-16 2017-10-03 天津职业技术师范大学 A kind of SCM Based Sign Language Recognition translation system
CN108334197A (en) * 2018-01-26 2018-07-27 北京千丁互联科技有限公司 A kind of tool of communications for hearing-impaired people
CN109448696A (en) * 2018-12-27 2019-03-08 韩思清 A kind of sounding gloves apparatus with deaf-mute's two-way exchange
CN111240489A (en) * 2020-02-27 2020-06-05 广州大学华软软件学院 Gesture recognition method and system based on gesture recognition glove and gesture recognition glove

Similar Documents

Publication Publication Date Title
CN206003392U (en) A kind of deaf-mute's social activity gloves
CN202315292U (en) Comprehensive greeting robot based on smart phone interaction
CN102500113A (en) Comprehensive greeting robot based on smart phone interaction
CN105807925A (en) Flexible electronic skin based lip language identification system and method
CN104134060A (en) Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
CN105938399B (en) The text input recognition methods of smart machine based on acoustics
CN106898197A (en) A kind of deaf-mute and the equipment of normal person's two-way exchange
CN107247711A (en) A kind of two-way translation method, mobile terminal and computer-readable recording medium
CN110070863A (en) A kind of sound control method and device
CN206179322U (en) Sign language interpreter bracelet
CN203149569U (en) Voice and gesture interactive translation device
CN106097835A (en) A kind of deaf mute exchanges the method for intelligent assistance system and exchange
CN107204141A (en) Wearable Braille reading equipment
CN206210144U (en) Gesture language-voice converts cap
CN201986001U (en) Mouth shape identification input mobile terminal
CN205486698U (en) Speech recognition system of looking for something based on single chip microcomputer control
CN104485104A (en) Intelligent wearable equipment
CN105807924A (en) Flexible electronic skin based interactive intelligent translation system and method
CN204208265U (en) Intelligent training shot
CN103295570A (en) Glove type sound production system
CN105759970A (en) Gesture recognition device based on bending sensor and sign language interpretation method
CN205177193U (en) Deaf and dumb patient AC installation
CN205396336U (en) Student is balance car for daily life
CN107301792A (en) A kind of intelligence accompanies child's early education platform
CN209132994U (en) A kind of novel intelligent educational robot

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170308

Termination date: 20200518