CN106157750A - A kind of intelligence deaf mute's pronunciation and exchange study glasses - Google Patents
A kind of intelligence deaf mute's pronunciation and exchange study glasses Download PDFInfo
- Publication number
- CN106157750A CN106157750A CN201610710580.2A CN201610710580A CN106157750A CN 106157750 A CN106157750 A CN 106157750A CN 201610710580 A CN201610710580 A CN 201610710580A CN 106157750 A CN106157750 A CN 106157750A
- Authority
- CN
- China
- Prior art keywords
- transparent display
- pronunciation
- information
- controller
- acoustic information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/10—Electronic devices other than hearing aids
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Educational Technology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Theoretical Computer Science (AREA)
- Acoustics & Sound (AREA)
- Otolaryngology (AREA)
- Ophthalmology & Optometry (AREA)
- Optics & Photonics (AREA)
- Rehabilitation Tools (AREA)
Abstract
The present invention relates to smart machine field, disclose a kind of intelligence deaf mute's pronunciation and exchange study glasses, including: eyeglass (3), picture frame (1), temple (2) and eyeglass (3), described eyeglass (3) is provided with transparent display；It is provided with photographic head and pick up on shown picture frame (1)；Described temple (2) is provided with controller bonnet (4), controller protecgulum (5) and speaker, it is provided with controller circuit board (6) among controller bonnet (4) and controller protecgulum (5), wherein, described controller circuit board (6) includes processor, memorizer, battery, described controller circuit board (6) respectively with described transparent display, photographic head, pick up connects, described memorizer, for storing the shape of the mouth as one speaks fixing under 3D pattern, vocal cords control, tongue position, air flow information, described transparent display has the 3D waveform of the sound of certain bandwidth for display, described speaker is for playing the sound corresponding with described 3D waveform.The present invention, so that the deaf mute with potential articulation ability carries out rehabilitation pronunciation training, can replace the audition of deaf mute to realize process simultaneously.
Description
Technical field
The present invention relates to smart machine field, particularly relate to a kind of intelligence deaf mute's pronunciation and exchange study glasses.
Background technology
China there are about 20,000,000 deaf mutes, they cannot communication as normal person, which results in their work, learn
Practise, entertain, seek medical advice, the confusion of the animation such as right-safeguarding, many low culture deaf mutes even face the crisis of existence.Once society
Ignore and not only allow them be in day by day fierce social competition in role passive, awkward, that feel oneself inferior, more make some
Having gone on the road broken laws and commit crime in straitened circumstances and lonely, deaf mute's survival status causes anxiety.
In all of deaf mute, major part is due to making an indiscreet remark that deafness just causes, from the point of view of the most sociable child
All the more so.The people of hearing loss, it is impossible to enough pronunciations, its basic reason is to have lacked the feedback mechanism of practice language pronunciation.
The pronunciation level that can be trained for normal person for a normal baby generally requires 2 years time the most long.This
On the one hand it is the growth of infant brain control language partial function, is the most also to control oral cavity muscle and of air-flow
Habit process.One language is the common recognition behavior sanctified by usage that a part of crowd is formed at the aspect that sounding is expressed.One or
A string fixing syllable is just used for expressing a fixing physical meaning.For common people, the learning process of language is exactly one
The process of individual imitation.Can be by imitating the meaning that sounding is expressed and the other side is identical of the Communicator heard with oneself.This is
The blank of study language.Without hearing the pronunciation of communicatee, with regard to neither one feedback mechanism, the most sociable deaf
People also cannot make the possibility of any imitation by the pronunciation listened.This has namely interrupted its pronunciation and study language
The possibility of speech.
Summary of the invention
The present invention provides a kind of intelligence deaf mute's pronunciation and exchange study glasses, solves deaf mute's sounding instruction in prior art
Practice and there is no feedback mechanism, the technical problem that training effectiveness is low.
It is an object of the invention to be achieved through the following technical solutions:
A kind of intelligence deaf mute's pronunciation and exchange study glasses, including: eyeglass 3, picture frame 1, temple 2 and eyeglass 3, described mirror
Sheet 3 is provided with transparent display；It is provided with photographic head and pick up on shown picture frame 1；Described temple 2 is provided with controller bonnet
4, controller circuit board 6 it is provided with among controller protecgulum 5 and speaker, controller bonnet 4 and controller protecgulum 5, wherein, described
Controller circuit board 6 includes processor, memorizer, battery, described controller circuit board 6 respectively with described transparent display, take the photograph
As head, pick up connect, described memorizer, for storing under 3D pattern the fixing shape of the mouth as one speaks, vocal cords control, tongue position, air-flow
Information, described transparent display has the 3D waveform of the sound of certain bandwidth for display, and described speaker is used for playing
The sound corresponding with described 3D waveform.
The present invention provides a kind of intelligence deaf mute's pronunciation and exchange study glasses, and the present invention is so that have potential pronunciation
The deaf mute of ability carries out rehabilitation pronunciation training, the audition of deaf mute can be replaced to realize process simultaneously.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to institute in embodiment
The accompanying drawing used is needed to be briefly described, it should be apparent that, the accompanying drawing in describing below is only some enforcements of the present invention
Example, for those of ordinary skill in the art, on the premise of not paying creative work, also can obtain according to these accompanying drawings
Obtain other accompanying drawing.
Fig. 1 is a kind of intelligence deaf mute's pronunciation and the structural representation of exchange study glasses of the embodiment of the present invention.
Detailed description of the invention
Understandable for enabling the above-mentioned purpose of the present invention, feature and advantage to become apparent from, real with concrete below in conjunction with the accompanying drawings
The present invention is further detailed explanation to execute mode.
As it is shown in figure 1, be a kind of intelligence deaf mute's pronunciation and exchange study glasses, including: eyeglass 3, picture frame 1, temple 2 and
Eyeglass 3, described eyeglass 3 is provided with transparent display；It is provided with photographic head and pick up on shown picture frame 1；Set in described temple 2
Have among controller bonnet 4, controller protecgulum 5 and speaker, controller bonnet 4 and controller protecgulum 5 and be provided with controller circuitry
Plate 6, wherein, described controller circuit board 6 includes processor, memorizer, battery, and described controller circuit board 6 is respectively with described
Transparent display, photographic head, pick up connect, described memorizer, for storing under 3D pattern the fixing shape of the mouth as one speaks, vocal cords control,
Tongue position, air flow information, described transparent display has the 3D waveform of sound of certain bandwidth for display, described in raise
Sound device is for playing the sound corresponding with described 3D waveform.
Wherein, described pick up, it is used for obtaining acoustic information；Processor on described controller circuit board 6, for institute
The acoustic information stating pick up acquisition carries out speech recognition, and identification information is shown on described transparent display.
The acoustic information that described pick up is obtained by described pick up carries out speech recognition, and identification information is shown in institute
State on transparent display, including:
Judge that the type of described acoustic information, the type of described acoustic information include linguistic information non-linguistic information, non-language
Speech information, such as vehicle whistle sound, tweedle, Diesel engine sound, electric saw sound or noise etc. have the spy that significantly lives
The sound of the information levied；
When the type of described acoustic information is linguistic information, described acoustic information is carried out speech recognition, right to obtain
The Word message answered；
When the type of described acoustic information is non-linguistic information, described acoustic information is carried out speech recognition, to obtain
Corresponding sounding thing information；
The information of speech recognition is shown on transparent display.
For non-language class voice, the prompting of corresponding waveform and the prompting of simple and clear character property also can be made, in order to
Deaf mute can make certain reaction when the sound that " hearing " is relevant.Except the sound that the mankind of standard speak and other are fixing
Sound type.The feature of related sound will be shown on glasses by equipment by audio frequency characteristics autonomic learning algorithm.
In the case of having muli-sounds, in addition it is also necessary to judge the tone color type that acoustic information is corresponding；When tone color type two kinds
Time, alternative sounds correspondence is shown on the transparent display of different eyeglasses；When tone color type is more than two kinds, will the most in unison
Phonic wheel stream shows on the transparent display of different eyeglasses.
Described memorizer there are pronunciation training storehouse, described training storehouse include 400 pinyin syllable without tone and 1300
It is made up of the syllable of tone, trains directly pronouncing as basic element with whole phonetic；Pronunciation storehouse has the audio band ripple of 3D
Shape and corresponding oral cavity action dynamic model.
The present invention is so that the deaf mute with potential articulation ability carries out rehabilitation pronunciation training.This device utilizes 3D
Audio frequency figure and speech recognition tools, it is established that original pronunciation feedback procedure belonging to ear auditory.Relevant feedback procedure is
Whether oneself pronunciation to language abecedarian meets the feedback correction process of the word pronunciation cognitive characteristics exchanging the other side, rectification
Result has same or like voice effect by making enunciator and the other side Communicator to same word.By to stationary tone
The 3D waveform with certain bandwidth of joint and three-dimensional perspective shape of the mouth as one speaks training mode, make the learner can be with 3D pattern
The lower fixing shape of the mouth as one speaks, vocal cords controls, tongue position, air flow information are as the foundation of sounding, using the waveform of 3D as sentencing of feeding back
Disconnected foundation carries out syllable repeatedly, individual character exercise.These exercises carry out " regular on the basis of the syllable, sound bank of standard
Change " exercise.By the foundation of effective feedback mechanism, deaf mute can be through carrying out basic pronunciation according to certain word speed
Express.Although the sound of oneself oneself can not be heard, but can be by word and waveform " sees " oneself pronunciation.The most also
The normal communication of certain word speed can be carried out with other people.Speech recognition aspect, carries out word in real time by the sound of speaker
Ground conversion, is transferred to the fixed area of eyeglass；The pronunciation of two people simultaneously spoken is distinguished, by its point by the difference of tone color
Come and show.This patent has preferable novelty and market competition advantage.
Being described in detail the present invention above, specific case used herein is to the principle of the present invention and embodiment party
Formula is set forth, and the explanation of above example is only intended to help to understand method and the core concept thereof of the present invention；Meanwhile, right
In one of ordinary skill in the art, according to the thought of the present invention, the most all can change
Part, in sum, this specification content should not be construed as limitation of the present invention.
Claims (5)
1. an intelligent deaf mute pronunciation and exchange study glasses, it is characterised in that including: eyeglass (3), picture frame (1), temple
(2) and eyeglass (3), described eyeglass (3) is provided with transparent display；It is provided with photographic head and pick up on shown picture frame (1)；Institute
State temple (2) and be provided with controller bonnet (4), controller protecgulum (5) and speaker, controller bonnet (4) and controller protecgulum
(5) being provided with controller circuit board (6) among, wherein, described controller circuit board (6) includes processor, memorizer, battery, institute
State controller circuit board (6) to be connected with described transparent display, photographic head, pick up respectively, described memorizer, be used for storing 3D
The shape of the mouth as one speaks fixing under pattern, vocal cords controls, tongue position, air flow information, described transparent display is used for display and has certain frequency
The 3D waveform of the sound of bandwidth, described speaker is for playing the sound corresponding with described 3D waveform.
Intelligence deaf mute's pronunciation the most according to claim 1 and exchange study glasses, it is characterised in that described pick up,
For obtaining acoustic information；Processor on described controller circuit board (6), for the acoustic information obtaining described pick up
Carry out speech recognition, and identification information is shown on described transparent display.
Intelligence deaf mute's pronunciation the most according to claim 2 and exchange study glasses, it is characterised in that described pick up described
The acoustic information that sound device obtains carries out speech recognition, and identification information is shown on described transparent display, including:
Judge that the type of described acoustic information, the type of described acoustic information include linguistic information non-linguistic information；
When the type of described acoustic information is linguistic information, described acoustic information is carried out speech recognition, to obtain correspondence
Word message；
When the type of described acoustic information is non-linguistic information, described acoustic information is carried out speech recognition, to obtain correspondence
Sounding thing information；
The information of speech recognition is shown on transparent display.
4. pronounce and exchange study glasses according to the intelligent deaf mute described in Claims 2 or 3, it is characterised in that described to institute
The acoustic information stating pick up acquisition carries out speech recognition, and identification information is shown on described transparent display, including:
Judge the tone color type that acoustic information is corresponding；
When tone color type two kinds, alternative sounds correspondence is shown on the transparent display of different eyeglasses；
When tone color type is more than two kinds, alternative sounds is shown in turn on the transparent display of different eyeglasses.
Intelligence deaf mute's pronunciation the most according to claim 1 and exchange study glasses, it is characterised in that in described memorizer
Have pronunciation training storehouse, described training storehouse to include 400 pinyin syllable without tone and 1300 be made up of the syllable of tone, training
Directly pronouncing as basic element with whole phonetic；The audio band waveform that pronunciation storehouse has 3D is dynamic with corresponding oral cavity action
Model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610710580.2A CN106157750A (en) | 2016-08-24 | 2016-08-24 | A kind of intelligence deaf mute's pronunciation and exchange study glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610710580.2A CN106157750A (en) | 2016-08-24 | 2016-08-24 | A kind of intelligence deaf mute's pronunciation and exchange study glasses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106157750A true CN106157750A (en) | 2016-11-23 |
Family
ID=57342717
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610710580.2A Pending CN106157750A (en) | 2016-08-24 | 2016-08-24 | A kind of intelligence deaf mute's pronunciation and exchange study glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106157750A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108831472A (en) * | 2018-06-27 | 2018-11-16 | 中山大学肿瘤防治中心 | A kind of artificial intelligence sonification system and vocal technique based on lip reading identification |
| CN110031976A (en) * | 2019-02-15 | 2019-07-19 | 山西见声科技有限公司 | A kind of glasses and its control method with warning function |
| WO2019238031A1 (en) * | 2018-06-11 | 2019-12-19 | 北京佳珥医学科技有限公司 | Lens structure and spectacles |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1204826A (en) * | 1998-04-18 | 1999-01-13 | 茹家佑 | Method for deaf-dumb voice learning dialogue and pronunciation synchronous feedback device |
| CN101494002A (en) * | 2009-03-05 | 2009-07-29 | 无敌科技(西安)有限公司 | Device and method for synchronously playing sound, mouth shape and finger speech |
| CN102663928A (en) * | 2012-03-07 | 2012-09-12 | 天津大学 | Electronic teaching method for deaf people to learn speaking |
| CN103646587A (en) * | 2013-12-05 | 2014-03-19 | 北京京东方光电科技有限公司 | deaf-mute people |
-
2016
- 2016-08-24 CN CN201610710580.2A patent/CN106157750A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1204826A (en) * | 1998-04-18 | 1999-01-13 | 茹家佑 | Method for deaf-dumb voice learning dialogue and pronunciation synchronous feedback device |
| CN101494002A (en) * | 2009-03-05 | 2009-07-29 | 无敌科技(西安)有限公司 | Device and method for synchronously playing sound, mouth shape and finger speech |
| CN102663928A (en) * | 2012-03-07 | 2012-09-12 | 天津大学 | Electronic teaching method for deaf people to learn speaking |
| CN103646587A (en) * | 2013-12-05 | 2014-03-19 | 北京京东方光电科技有限公司 | deaf-mute people |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019238031A1 (en) * | 2018-06-11 | 2019-12-19 | 北京佳珥医学科技有限公司 | Lens structure and spectacles |
| CN108831472A (en) * | 2018-06-27 | 2018-11-16 | 中山大学肿瘤防治中心 | A kind of artificial intelligence sonification system and vocal technique based on lip reading identification |
| CN108831472B (en) * | 2018-06-27 | 2022-03-11 | 中山大学肿瘤防治中心 | Artificial intelligent sounding system and sounding method based on lip language recognition |
| CN110031976A (en) * | 2019-02-15 | 2019-07-19 | 山西见声科技有限公司 | A kind of glasses and its control method with warning function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN207425137U (en) | English study training device based on the dialogue of VR real scenes | |
| Byrd et al. | Discovering speech, words, and mind | |
| WO2004090835A2 (en) | Methods for computer-assisted role-playing of life skills simulations | |
| CN101751809A (en) | Deaf children speech rehabilitation method and system based on three-dimensional head portrait | |
| CN108320625A (en) | Vibrational feedback system towards speech rehabilitation and device | |
| CN106157750A (en) | A kind of intelligence deaf mute's pronunciation and exchange study glasses | |
| Humes et al. | Audiology and communication disorders: An overview | |
| Liu et al. | An interactive speech training system with virtual reality articulation for Mandarin-speaking hearing impaired children | |
| CN206946127U (en) | A kind of glasses of deaf-mute | |
| Fletcher et al. | Speech modification by a deaf child through dynamic orometric modeling and feedback | |
| CN108345115A (en) | A kind of VR teaching equipment structures of gesture induction | |
| CN202996077U (en) | Indoor trainer used for Japanese learning | |
| Gorman | A framework for speechreading acquisition tools | |
| CN211578083U (en) | Touch-sensitive formula biostructure explanation interactive teaching aid | |
| JP5960792B2 (en) | Vocal sound practice aid | |
| CN206946128U (en) | A kind of glasses for being easy to deaf-mute to exchange | |
| Gfeller | Music therapy for children and adults who are deaf or hard of hearing | |
| CN214475857U (en) | Device for helping deaf children to learn natural language | |
| KR102630356B1 (en) | Electronic device, control method, and computer program for auditory language and cognitive rehabilitation of infants and children | |
| CN202067422U (en) | Pronounceable English phonetic symbol teaching stereo jigsaw | |
| Ren | Intelligent Swimming Voice Teaching Method Based on Bone Conduction | |
| CN207611499U (en) | Simple combination formula phonetic study device | |
| Wang et al. | Speech recognition system based on visual feature for the hearing impaired | |
| Rogers | The Voice as a Revelation of the Individual | |
| CN106621350A (en) | Perceptible robot toy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161123 |