CN111354247A - Real-time communication system device for deaf-mute - Google Patents
Real-time communication system device for deaf-mute Download PDFInfo
- Publication number
- CN111354247A CN111354247A CN202010034997.8A CN202010034997A CN111354247A CN 111354247 A CN111354247 A CN 111354247A CN 202010034997 A CN202010034997 A CN 202010034997A CN 111354247 A CN111354247 A CN 111354247A
- Authority
- CN
- China
- Prior art keywords
- deaf
- skin
- real
- mute
- sensor group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/04—Devices for conversing with the deaf-blind
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Abstract
The invention discloses a real-time talking system device for deaf-mutes, relating to the field of artificial intelligence, wherein the left hand part of the real-time talking system device for deaf-mutes comprises: the gesture sensing device comprises a finger single-click gesture sensing sensor module 1, an MCU1, a communication module 1, a power supply module 1 and a sound horn 1; the right-hand portion includes: the gesture sensing sensor module 2 is sensed by single and double clicking of the finger, the MCU2, the communication module 2 and the power module 2 are sensed by the gesture sensing sensor module 2; the sensor module 2 is in wireless data communication with the MCU1 and the communication module 1 through the communication module 2. The real-time talking system device for the deaf-mute adopts a thermal bonding technology to manufacture the invisible socks, so as to solve the defects of complex manufacturing process, uncomfortable wearing, poor elasticity and short service life of the existing invisible socks.
Description
Technical Field
The invention relates to the field of intelligent communication society departments, in particular to a real-time communication system device for deaf-mutes.
Background
The deaf-mute is generally a condition of both hearing and language disorders. Deaf-mute is called when after birth or in the period of children, the person who has serious deafness and can not hear the speaking sound, so that the person can not learn to speak, or learn to speak initially and lose the speaking ability again due to deafness. The deaf-mute can not speak, and does not have any pathological changes in the central part or the peripheral part of the language system, but loses the possibility of simulating learning due to the hearing disorder; loss of ability to hear and discern language; it is not self-correcting. Deafness is the cause, and dumb is the result. The real-time communication of the deaf-mute has no good solution all the time, and the artificial cochlea is too expensive, thereby causing great life trouble for the small part of the deaf-mute population.
Disclosure of Invention
The invention aims to solve the technical problem of providing a real-time communication system device for deaf-mutes, which can transmit the human speaking voice and the harmonic tone, tone and part of tone of the human speaking voice and can transmit part of environmental sound at the same time.
In order to achieve the above purpose, the present invention provides the following technical solutions:
the deaf-mute real-time communication system device comprises a skin touch sensor module, a mcu, a pickup microphone receiving sensor group and a wireless module, wherein the skin touch sensor module, the mcu, the pickup microphone receiving sensor group and the wireless module are all connected with a power supply, the pickup microphone sensor group receives current environmental sounds or human speaking voice sounds and sends the current environmental sounds or the human speaking voice sounds to the mcu for processing through a wired or wireless module, the mcu processes the voice data sent by the pickup microphone sensor into initials (or English consonants) of Chinese pinyin through a voice recognition algorithm, the finals (or English vowels) of the Chinese pinyin and digital signals of Chinese pinyin tones are sent to a skin touch sensor group, and the skin touch sensor group triggers the touch nerves of the deaf mute and sends the touch nerves to the brain of the deaf mute. The brain of the deaf-mute analyzes the digital coding data of the specific rules of the initial consonant (or English consonant), the vowel (or English vowel) and the tone of the corresponding voice according to the specific coding signals transmitted by the skin tactility group, the wireless module receives the voice data recognized by other wireless equipment, the audio data transmitted by other wireless equipment can be the data of a pickup microphone or the audio data stored by other wireless equipment or the audio data generated by the coding of other wireless equipment modules, the skin tactility group consists of a plurality of skin tactoids, and the plurality of skin tactoids are close to the skin of the deaf mute and can be sensors for inducing the human skin tactility nerve feeling, the combination of the human skin tactility to the specific rules is realized through the digital signal coding, the coding data of the specific frequency combination and the specific intensity combination are processed into the sounds understood by the human brain, the sense of speech and strength of tone.
Preferably, the skin touch sensor group is composed of more than one skin touch sensors, the skin touch sensors are driven by a driving circuit, the skin touch sensors are combined into different coded vibrations with different frequencies, different grade intensities and different numbers, and correspond to 23 Chinese pinyin initials (or correspond to 28 English consonants), 39 Chinese finals (or 20 English vowels) and 5 Chinese pinyin tones. Therefore, the normal person speaks in real time, and the skin touch set does a group of specific touch vibration after the mcu processing, so that the deaf-mute can feel the meaning expressed by the current speaker in real time, and the purpose of real-time translation is achieved.
Preferably, the pickup microphone sensor group is a multi-position array microphone composed of more than one microphone, environment sound audio data acquired from different positions are processed into recognizable voice data through a noise reduction circuit and a noise reduction algorithm, the recognizable voice data are processed through an mcu as a voice recognition algorithm, and the data after the recognition algorithm are processed into specific coded digital information such as initials (or English consonants) of Chinese pinyin, finals of the Chinese pinyin, tones and partial whistles of the Chinese pinyin, fire alarms, alarms and the like through the mcu by a voice compiling algorithm.
The beneficial effect of adopting above technical scheme is: the deaf-mute real-time communication system device is developed for solving the problem that the deaf-mute feels the sound information innovation of the communication person with the deaf-mute in real time and developing a real-time voice recognition communication system for the deaf-mute. The deaf-mute real-time communication system device can transmit human speaking voice and the harmonic tone, tone and part of tone of the human speaking voice, and can transmit part of environmental sound at the same time, thereby providing sound information such as whistling, fire alarm, alarm and the like for the deaf-mute.
Drawings
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings.
FIG. 1 is a schematic structural diagram of the deaf-mute real-time communication system device;
fig. 2 is a working principle diagram of the deaf-mute real-time communication system device.
The system comprises a skin touch sensor module 1, a skin touch sensor module 2, a focus microphone receiving sensor module 3, a power supply 4 and a wireless module 5.
Detailed Description
The preferred embodiment of the deaf-mute real-time communication system device is described in detail in the following with the attached drawings.
Fig. 1 and fig. 2 show the specific implementation mode of the deaf-mute real-time communication system device:
with reference to fig. 1 and fig. 2, the deaf-mute real-time communication system device comprises a skin firmware which can be fixed on the skin, wherein the skin touch sensor module 1, the mcu2, the pickup microphone receiving sensor group 4 and the wireless module 5 are installed on the firmware, the skin touch sensor module 1, the mcu2, the pickup microphone receiving sensor group 4 and the wireless module 5 are all connected with a power supply 3, and the power supply 3 supplies electric energy to the skin touch sensor module 1, the mcu2, the pickup microphone receiving sensor group 4 and the wireless module 5. The pickup microphone sensor group 4 receives current environment sound or human speaking voice sound and sends the current environment sound or human speaking voice sound to the mcu2 for processing through a wired or wireless module, the mcu2 processes the voice data sent from the pickup microphone sensor 4 into initials (or English consonants) of Chinese pinyin through a voice recognition algorithm, the finals (or English vowels) of Chinese pinyin and digital signals of Chinese pinyin tones are sent to the skin touch sensor group 1, the skin touch sensor group 1 triggers the tactile nerves of the deaf and sends the tactile nerves to the brain of the deaf, and the brain of the deaf analyzes signals of specific codes sent from the skin touch sensor group 1 to obtain digital coded data of specific rules of the initials (or English consonants), the finals (or English vowels) and the tones.
The wireless module 5 receives voice data recognized by other wireless devices, and the audio data wirelessly transmitted by other wireless devices can be data of a pickup microphone or audio data stored by other wireless devices or audio data generated by encoding of other wireless device modules.
The skin tactility group 1 is composed of a plurality of skin tactility sensors, the plurality of skin tactility sensors are close to the skin of the deaf-mute and are sensors capable of inducing the human skin tactility nerve feeling, the human skin tactility is enabled to be combined with a specific rule through digital signal coding, coded data of a specific speed combination and a specific strength combination are processed through the brain of a human, and information such as voice, language sense, language strength and the like understood by human beings is processed.
The skin touch sensor group 1 is composed of more than one skin touch sensor, the skin touch sensor is driven by a driving circuit, the skin touch sensors are different in frequency, different in level intensity and different in number and are combined into different coded vibrations, 23 corresponding to Chinese pinyin initials (or 28 corresponding to English consonants), 39 corresponding to Chinese finals (or 20 corresponding to English vowels) and 5 corresponding to Chinese pinyin tones, so that a normal person speaks in real time, and the skin touch sensor group 1 is subjected to mcu processing to perform a group of specific touch vibration, so that a deaf mute can feel the meaning of the current speaker in real time, and the purpose of real-time translation is achieved.
The pickup microphone sensor group 4 is a multi-position array microphone composed of more than one microphone, environment sound audio data obtained from different positions are processed into recognizable voice data through a noise reduction circuit and a noise reduction algorithm, the recognizable voice data are processed into voice recognition algorithm through the mcu2, the data after the recognition algorithm are processed into specific coded digital information such as initial consonant of Chinese pinyin (or English consonant), vowel of Chinese pinyin, tone of Chinese pinyin and part whistle, fire, alarm and the like through the mcu2 through a voice compiling algorithm.
The deaf-mute real-time communication system device is developed for solving the problem that the deaf-mute feels the sound information innovation of the communication person with the deaf-mute in real time and developing a real-time voice recognition communication system for the deaf-mute. The deaf-mute real-time communication system device can transmit human speaking voice and the harmonic tone, tone and part of tone of the human speaking voice, and can transmit part of environmental sound at the same time, thereby providing sound information such as whistling, fire alarm, alarm and the like for the deaf-mute.
The above is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, many variations and modifications can be made without departing from the inventive concept of the present invention, which falls into the protection scope of the present invention.
Claims (3)
1. A deaf-mute real-time communication system device is characterized in that: the deaf-mute real-time communication system device comprises a skin touch sensor module (1), a mcu (2), a pickup microphone receiving sensor group (4) and a wireless module (5), wherein the skin touch sensor module (1), the mcu (2), the pickup microphone receiving sensor group (4) and the wireless module (5) are arranged on a firmware and are connected with a power supply (3), the pickup microphone sensor group (4) receives current environmental sounds or human speaking voice sounds and sends the current environmental sounds or the human speaking voice sounds to the mcu (2) for processing through a wired or wireless module, the mcu (2) processes voice data sent from the microphone sensor (4) into initials (or English consonants) of Chinese pinyin through a voice recognition algorithm, the finals (or English vowels) of Chinese pinyin and digital signals of Chinese pinyin tones are sent to the skin touch sensor group (1), and the skin touch sensor group (1) triggers the touch sense nerve of the deaf, the voice data which are identified by other wireless equipment are received by the wireless module (5), the audio data which are wirelessly transmitted by other wireless equipment can be data of a pickup microphone or audio data stored by other wireless equipment or audio data generated by the coding of other wireless equipment modules, the skin tactile sensor group (1) consists of a plurality of skin tactile sensors, the skin tactile sensors are close to the skin of the deaf-mute and can be sensors which can cause the human skin to feel the nerve feeling, the human skin feels to the combination of the specific rule through the digital signal coding, the coded data of the specific frequency combination and the specific strength combination, information such as voice, sense of speech, and strength of tone understood by human beings is processed via the human brain.
2. The deaf-mute real-time communication system device of claim 1, wherein: the skin touch sensor group (1) is composed of more than one skin touch sensor, the skin touch sensors are driven by a driving circuit, the skin touch sensors are different in frequency, different in grade strength and different in number and are combined into different coded vibrations, the skin touch sensors correspond to 23 Chinese pinyin initials (or 28 English consonants), 39 Chinese vowels (or 20 English vowels) and 5 Chinese pinyin tones, normal people speak in real time, and the skin touch sensor group (1) does a group of specific touch vibration after mcu processing, so that deaf mutes can feel the meaning of the expression of the current speakers in real time, and the purpose of real-time translation is achieved.
3. The deaf-mute real-time communication system device of claim 1, wherein: the pickup microphone sensor group (4) is a multi-position array microphone composed of more than one microphone, environment sound audio data obtained from different positions are processed into recognizable voice data through a noise reduction circuit and a noise reduction algorithm, the recognizable voice data are processed into a voice recognition algorithm through the mcu (2), and the data after the recognition algorithm are processed into specific coded digital information such as initial consonants (or English consonants) of Chinese pinyin, vowels of the Chinese pinyin, tones and partial whistles of the Chinese pinyin, fire alarms, alarms and the like through the mcu (2) through a voice compiling algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010034997.8A CN111354247A (en) | 2020-01-07 | 2020-01-07 | Real-time communication system device for deaf-mute |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010034997.8A CN111354247A (en) | 2020-01-07 | 2020-01-07 | Real-time communication system device for deaf-mute |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111354247A true CN111354247A (en) | 2020-06-30 |
Family
ID=71193956
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010034997.8A Pending CN111354247A (en) | 2020-01-07 | 2020-01-07 | Real-time communication system device for deaf-mute |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111354247A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0965969A1 (en) * | 1998-06-18 | 1999-12-22 | Gavriil Mikhailovich Fingerov | The method of conveying information to the nervous system of a person |
| CN1257696A (en) * | 1998-12-18 | 2000-06-28 | 李建文 | Contact-type electronic acouophone |
| CN1819719A (en) * | 2006-03-07 | 2006-08-16 | 钟茗 | Distributed skin stimulus artificial hearing device |
| CN102074150A (en) * | 2011-01-12 | 2011-05-25 | 无锡工艺职业技术学院 | Sentence and speech conversion device for the deaf to communicate with outside world |
| CN201920987U (en) * | 2010-12-07 | 2011-08-10 | 陕西科技大学 | Skin hearing apparatus based on Morse codes |
| CN203122761U (en) * | 2013-01-29 | 2013-08-14 | 西安高祖数码电子科技有限公司 | Skin feeling type phonendoscope |
| CN104835505A (en) * | 2015-05-20 | 2015-08-12 | 陕西科技大学 | Conversation device between normal person and deaf, dumb and blind people and application method thereof |
-
2020
- 2020-01-07 CN CN202010034997.8A patent/CN111354247A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0965969A1 (en) * | 1998-06-18 | 1999-12-22 | Gavriil Mikhailovich Fingerov | The method of conveying information to the nervous system of a person |
| CN1257696A (en) * | 1998-12-18 | 2000-06-28 | 李建文 | Contact-type electronic acouophone |
| CN1819719A (en) * | 2006-03-07 | 2006-08-16 | 钟茗 | Distributed skin stimulus artificial hearing device |
| CN201920987U (en) * | 2010-12-07 | 2011-08-10 | 陕西科技大学 | Skin hearing apparatus based on Morse codes |
| CN102074150A (en) * | 2011-01-12 | 2011-05-25 | 无锡工艺职业技术学院 | Sentence and speech conversion device for the deaf to communicate with outside world |
| CN203122761U (en) * | 2013-01-29 | 2013-08-14 | 西安高祖数码电子科技有限公司 | Skin feeling type phonendoscope |
| CN104835505A (en) * | 2015-05-20 | 2015-08-12 | 陕西科技大学 | Conversation device between normal person and deaf, dumb and blind people and application method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 李建文，侯媛媛，李江红: "五通道异步摩尔斯编码皮肤听声的研究", 《计算机工程与应用》, 15 December 2011 (2011-12-15), pages 125 - 127 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110753957B (en) | Haptic communication system using skin actuators to simulate continuous human touch | |
| US20200152223A1 (en) | Somatic, auditory and cochlear communication system and method | |
| US20100013612A1 (en) | Electro-Mechanical Systems for Enabling the Hearing Impaired and the Visually Impaired | |
| US10438609B2 (en) | System and device for audio translation to tactile response | |
| US8949129B2 (en) | Neural translator | |
| CN111432303B (en) | Monaural headset, intelligent electronic device, method, and computer-readable medium | |
| WO2004021738A1 (en) | Microphone and communication interface system | |
| Liberman et al. | Why are speech spectrograms hard to read? | |
| CN101494816A (en) | Hearing-aid device and method suitable for anacusia patient | |
| Dhanjal et al. | Tools and techniques of assistive technology for hearing impaired people | |
| Falk et al. | Augmentative communication based on realtime vocal cord vibration detection | |
| CN111354247A (en) | Real-time communication system device for deaf-mute | |
| Fourcin | Speech perception in the absence of speech productive ability | |
| Ifukube | Sound-based assistive technology | |
| Patel et al. | Teachable interfaces for individuals with dysarthric speech and severe physical disabilities | |
| CN106157750A (en) | A kind of intelligence deaf mute's pronunciation and exchange study glasses | |
| RU2312646C2 (en) | Apparatus for partial substitution of speaking and hearing functions | |
| Levitt | Processing of speech signals for physical and sensory disabilities. | |
| CN114979887A (en) | Wisdom education earphone | |
| Kishon-Rabin et al. | The role of hearing in speech and language acquisition and processing | |
| JP2016146870A (en) | Lifesaving support device | |
| Fry | Speech and language | |
| Varghese et al. | Dual mode appliance control system for people with severe disabilities | |
| Liberman et al. | On the efficiency of speech sounds | |
| KR200187251Y1 (en) | A device that translates voice into physical movement for education and entertainment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200630 |
|
| WD01 | Invention patent application deemed withdrawn after publication |