CN107301863A - A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system - Google Patents
A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system Download PDFInfo
- Publication number
- CN107301863A CN107301863A CN201710571917.0A CN201710571917A CN107301863A CN 107301863 A CN107301863 A CN 107301863A CN 201710571917 A CN201710571917 A CN 201710571917A CN 107301863 A CN107301863 A CN 107301863A
- Authority
- CN
- China
- Prior art keywords
- deaf
- pronunciation
- rehabilitation
- training
- child
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 206010011878 Deafness Diseases 0.000 title claims abstract description 73
- 238000012549 training Methods 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 17
- 238000011156 evaluation Methods 0.000 claims abstract description 12
- 230000003993 interaction Effects 0.000 claims abstract description 7
- 206010013952 Dysphonia Diseases 0.000 claims description 23
- 210000000056 organ Anatomy 0.000 claims description 16
- 230000001755 vocal effect Effects 0.000 claims description 16
- 230000008859 change Effects 0.000 claims description 15
- 238000001228 spectrum Methods 0.000 claims description 11
- 238000012512 characterization method Methods 0.000 claims description 9
- 230000033764 rhythmic process Effects 0.000 claims description 9
- 210000000214 mouth Anatomy 0.000 claims description 7
- 150000001875 compounds Chemical class 0.000 claims description 6
- 230000036541 health Effects 0.000 claims description 6
- 230000002452 interceptive effect Effects 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 6
- 230000006399 behavior Effects 0.000 claims description 5
- 230000004888 barrier function Effects 0.000 claims description 4
- 238000007405 data analysis Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 230000002889 sympathetic effect Effects 0.000 claims description 3
- 238000012360 testing method Methods 0.000 claims description 3
- 210000001260 vocal cord Anatomy 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 4
- 238000012076 audiometry Methods 0.000 description 2
- 201000003723 learning disability Diseases 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010370 hearing loss Effects 0.000 description 1
- 231100000888 hearing loss Toxicity 0.000 description 1
- 208000016354 hearing loss disease Diseases 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003557 neuropsychological effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/10—Speech classification or search using distance or distortion measures between unknown speech and reference templates
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/24—Speech recognition using non-acoustical features
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/69—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for evaluating synthetic or decoded voice signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
- G10L2021/065—Aids for the handicapped in understanding
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention provides a kind of deaf-mute child's disfluency method of rehabilitation and system, using software analysis method, and with friendly human-computer interaction interface guide and excite the learning interest of deaf youngster, the problem of solving complex operation its be used in deaf youngster's autonomous learning;Greatly reduce its financial cost so that popularization of the invention is greatly enhanced;Evaluation grade is divided according to the different state of an illness of patient so that training is more targeted;Mitigate the working strength of speech rehabilitation therapist, and substantially increase the naturalness of dysaudia crowd pronunciation.
Description
Technical field
The present invention relates to deaf-mute child's aphasis rehabilitation field, specifically a kind of deaf-mute child's disfluency method of rehabilitation
And rehabilitation training system.
Background technology
Language is that the mankind express thoughts, transmission information participates in the significant capability of social human communication.It is by applying symbol
Ability to exchange is reached, is the result of complicated neuropsychological activity, is realized according to the routine of language society foundation.Symbol includes mouth
Head and written and posture, such as manual expression of emotion, thereby produce understanding, incoming, expression, four kinds of basic language of outflow
Behavior, speech refers to oracy, is the individual active procedure communicated using language, it is necessary to the fortune of lip and tongue
It is dynamic.
Disfluency caused by dysacousis, from the viewpoint of speech rehabilitation, obtain speech before with obtain speech it
The discriminating of dysacousis afterwards is critically important.Children are general to complete in seven years old or so speech and development, at this moment can be referred to as to obtain speech,
The processing knowledge hearing compensation problem of dysacousis after acquisition speech;It is particularly before obtaining speech in infant period
The disfluency caused by dysaudia more than degree, is treated without sense of hearing speech rehabilitation, and obtaining speech can be highly difficult.
Patent No. CN201310553325.8 Chinese patent discloses a kind of adult's hearing speech rehabilitation system, and this is
System causes the patient of disfluency mainly for because of hearing loss.This system is not suitable for children for adult.Speech is most
Good developmental stage was at 2 years old or so, and missing the training of this period can have a greatly reduced quality.
Investigate and find in the on-site inspection of school for learning disabilities, used equipment can be seen that its shortcoming at present for school for learning disabilities
Substantially, it is equipment too expensive, and needs professional to be operated, this has resulted in only a small number of deaf-mute childs can
Using to.High Cost Problems of its application platform of disfluency rehabilitation system in the market, the price of too expensive is difficult
To popularize, deaf-mute child can not be benefited at all.
Although country's area of computer aided speech audiometry technology is used in scientific research and clinic at present, all fail to obtain very
Good popularization and popularization and application.It is many to trace it to its cause, from the point of view of speech recognition assessment system, domestic Speech assessment and health
Multiple software pays attention to exploitation and the Function detection of software systems mostly, is mainly adapted to hearing rehabilitation mechanism and trainer uses,
Compliance, interactive and time, the financial cost of the less consideration person that listens to barrier;Also there is speech recognition assessment system database list simultaneously
First, speech audiometry material do not standardize, can not mutually approve using inconvenient operation is practical, in industry, the presence of dialect etc. because
Element influence.
The content of the invention
To solve the above problems, the invention provides a kind of new a kind of deaf-mute child's disfluency method of rehabilitation and health
Multiple training system, the present invention utilizes animation and game from compliance, the interactive section time financial cost for listening barrier children
Mode guides and excited the learning interest of deaf youngster;Operating platform is transplanted on mobile phone and tablet personal computer and causes man-machine interaction circle
Face more facilitate close friend, the problem of solving complex operation its be used in deaf youngster's autonomous learning;Its financial cost is greatly reduced,
So that the popularization of the present invention is greatly enhanced;Evaluation grade is divided according to the different state of an illness of patient so that training is more targeted;Subtract
Talk about the working strength of language rehabilitation therapist rashly, and substantially increase the naturalness of dysaudia crowd pronunciation.
To realize the technical purpose, a kind of deaf-mute child's disfluency method of rehabilitation of the invention, including implemented below step
Suddenly:
S1:Picture is shown on interactive device, to show sound-content and feature, allows deaf-mute child's Preliminary study to need what is learnt
Pronunciation content;The first step for developing speech is to understand speech, and the cartoon that the preparatory stage is liked by straightforward and children
Vivid and various cartoon pictures show the various features of sound, allow deaf-mute child's Preliminary study to pronounce content.
S2:Deaf-mute child is pronounced according to Self-Understanding, and gathers pronunciation content and the dynamic change of vocal organs;It is logical
Cross mobile microphone and gather dysaudia crowd in the preparatory stage to the pronunciation of the pronunciation content recognized before.
S3:Analyze deaf-mute child's pronunciation spectrum signature, sound articulation, the dynamic change characterization of vocal organs;Technology
Key is the corresponding pass between the dynamic change and voice spectrum of vocal organs when finding dysaudia crowd improper pronunciation
System.The key technical indexes is the definition of pronunciation, the normalization coordinate position of vocal organs.
S4:By deaf-mute child's pronunciation spectrum signature, sound articulation, the dynamic change characterization of vocal organs and health adult hair
The template matches of sound, judge the non-natural pronunciation part of deaf-mute child, its dysphonia are graded;
S5:Assessed according to the non-natural pronunciation part detected in previous step and dysphonia grade, grade is deaf-mute child
Select suitable training program and carry out rehabilitation training scheme prompting;
S6:Deaf-mute child's learning pronunciation under rehabilitation training prompting, and pronunciation content is gathered, rejudge non-natural pronunciation portion
Point, and its dysphonia is graded and rehabilitation training prompting.
Further, the non-natural pronunciation part of the judgement deaf-mute child is specifically that initial consonant, simple or compound vowel of a Chinese syllable harmony are adjusted and is estimated.
Further, it is the association that patient's lips and teeth tongue position is determined by the pronunciation evaluation to deaf youngster's initial consonant that the initial consonant, which is assessed,
Adjust motion conditions;It is the coordination fortune that patient's lips and teeth tongue position is determined by the pronunciation evaluation female to deaf r-ending retroflexion that the simple or compound vowel of a Chinese syllable, which is assessed,
Emotionally condition and sympathetic response situation;It is, by the assessment to deaf youngster's tone, to determine control situation of the patient to air-flow that the tone, which is assessed,;
Further, the dysphonia progress grading is divided into three-level;One-level dysphonia is dynamic for lip, but can not send sound;
Two grades of dysphonias can not send greatly the correct pronunciation of testing material, tone can not obtain correct rhythm for that can send sound
Rule;Three-level dysphonia, can the normal rhythm goods rhythm sound of fetching portion for that can pronounce.
Further, the collection pronunciation content, be specifically to sample frequency, sampling resolution, channel number setting, and to adopting
The pronunciation content collected carries out noise treatment.
Further, the rehabilitation training scheme includes words training, pronounciation training, vowel training, consonant training;Institute
It is to grasp tongue behaviour and lip using the animation of cartoon character in deaf youngster usually seen animation to be presented to child to state words training, is drawn
Play the learning interest of child;The pronounciation training can not be pronounced to avoid deaf youngster from only imitating the shape of the mouth as one speaks, is worked as using cartoon
When deaf youngster sends sound, animation, which changes, gives its visual feedback;Air-flow passes through when the vowel training is reason pronunciation
Oral cavity is not hindered by any, and vocal cord vibration corrects tongue position;The consonant training is correct one's pronunciation position and manner of articulation.
As the preferred of invention, in the pronounciation training, animation changes refers to that cartoon is moved to its visual feedback
Neutron bomb distance of transmitting range from pistol is drawn to be determined by the power of sound.
A kind of deaf-mute child's aphasis rehabilitation system, including:Sound acquisition module, image capture module, data analysis
Module, dysphonia grade evaluation module, rehabilitation training program decisions module, human-computer interaction module, database module.
Further, the database module includes pronunciation content and picture, health adult hair's audio spectrum signature, pronounces distinctly
Degree, the template of the dynamic change characterization of vocal organs, rehabilitation training scheme prompting animation.
The beneficial effects of the present invention are:
The present invention from listen barrier children compliance, interactive section time financial cost, using animation and game mode come
Guide and excite the learning interest of deaf youngster;Operating platform is transplanted on mobile phone and tablet personal computer and causes human-computer interaction interface more
It is convenient friendly, the problem of solving complex operation its be used in deaf youngster's autonomous learning;Greatly reduce its financial cost so that this
The popularization of invention is greatly enhanced;Evaluation grade is divided according to the different state of an illness of patient so that training is more targeted;Mitigate speech
The working strength of rehabilitation therapist, and substantially increase the naturalness of dysaudia crowd pronunciation.
Brief description of the drawings
Fig. 1 is the method for rehabilitation flow chart of the present invention;
Fig. 2 is the rehabilitation system block diagram of the present invention.
Embodiment
The technical scheme in the embodiment of the present invention will be clearly and completely described below.
As shown in figure 1, a kind of deaf-mute child's disfluency method of rehabilitation of the invention, including implemented below step:
S1:Pronounce in database content and picture are called, and picture is shown on interactive device, to show sound-content and spy
Levy, allow deaf-mute child's Preliminary study to need the pronunciation content learnt;The first step for developing speech is to understand speech, and the preparatory stage
The cartoon character and various cartoon pictures liked by straightforward and children shows the various features of sound, allows deaf-mute child
Virgin Preliminary study pronunciation content.
S2:Deaf-mute child is pronounced according to Self-Understanding, and gathers pronunciation content;Listened by sound acquisition module collection
Power obstacle crowd, to the pronunciation of the pronunciation content recognized before, vocal organs is gathered by image capture module in the preparatory stage
Dynamic change.
S3:Analyze deaf-mute child's pronunciation spectrum signature, sound articulation, the dynamic change characterization of vocal organs;Technology
Key is the corresponding pass between the dynamic change and voice spectrum of vocal organs when finding dysaudia crowd improper pronunciation
System.The key technical indexes is the definition of pronunciation, the normalization coordinate position of vocal organs.
S4:By deaf-mute child's pronunciation spectrum signature, sound articulation, the dynamic change characterization of vocal organs and database mould
The template matches of normal person's pronunciation in block, judge the non-natural pronunciation part of deaf-mute child, its dysphonia are graded;
S5:Assessed according to the non-natural pronunciation part detected in previous step and dysphonia grade, grade is deaf-mute child
Select suitable training program and carry out rehabilitation training scheme prompting;
S6:Deaf-mute child's learning pronunciation under rehabilitation training prompting, and pronunciation content is gathered, rejudge non-natural pronunciation portion
Point, and its dysphonia is graded and rehabilitation training prompting.
Further, the non-natural pronunciation part of the judgement deaf-mute child is specifically that initial consonant, simple or compound vowel of a Chinese syllable harmony are adjusted and is estimated.
Further, it is the association that patient's lips and teeth tongue position is determined by the pronunciation evaluation to deaf youngster's initial consonant that the initial consonant, which is assessed,
Adjust motion conditions;It is the coordination fortune that patient's lips and teeth tongue position is determined by the pronunciation evaluation female to deaf r-ending retroflexion that the simple or compound vowel of a Chinese syllable, which is assessed,
Emotionally condition and sympathetic response situation;It is, by the assessment to deaf youngster's tone, to determine control situation of the patient to air-flow that the tone, which is assessed,;
Further, the dysphonia progress grading is divided into three-level;One-level dysphonia is dynamic for lip, but can not send sound;
Two grades of dysphonias can not send greatly the correct pronunciation of testing material, tone can not obtain correct rhythm for that can send sound
Rule;Three-level dysphonia, can the normal rhythm goods rhythm sound of fetching portion for that can pronounce.
Further, the collection pronunciation content, be specifically to sample frequency, sampling resolution, channel number setting, and to adopting
The pronunciation content collected carries out noise treatment.
Further, the rehabilitation training scheme includes words training, pronounciation training, vowel training, consonant training;Institute
It is to grasp tongue behaviour and lip using the animation of cartoon character in deaf youngster usually seen animation to be presented to child to state words training, is drawn
Play the learning interest of child;The pronounciation training can not be pronounced to avoid deaf youngster from only imitating the shape of the mouth as one speaks, is worked as using cartoon
When deaf youngster sends sound, animation, which changes, gives its visual feedback;Air-flow passes through when the vowel training is reason pronunciation
Oral cavity is not hindered by any, and vocal cord vibration corrects tongue position;The consonant training is correct one's pronunciation position and manner of articulation.
As the preferred of invention, in the pronounciation training, animation changes refers to that cartoon is moved to its visual feedback
Neutron bomb distance of transmitting range from pistol is drawn to be determined by the power of sound.
A kind of deaf-mute child's aphasis rehabilitation system, including:Sound acquisition module, image capture module, data analysis
Module, dysphonia grade evaluation module, rehabilitation training program decisions module, human-computer interaction module, database module;The sound
Sound acquisition module, image capture module, human-computer interaction module include the basic hardware branch such as microphone, camera, display screen respectively
Hold.
Further, the database module includes pronunciation content and picture;Health adult hair's audio spectrum signature, pronounce distinctly
Degree, the template of the dynamic change characterization of vocal organs;Rehabilitation training scheme points out animation.
For the person of ordinary skill of the art, without departing from the concept of the premise of the invention, it can also do
Go out several modifications and improvements, these belong to protection scope of the present invention.
Claims (9)
1. a kind of deaf-mute child's disfluency method of rehabilitation, it is characterised in that including implemented below step:
S1:Picture is shown on interactive device, to show sound-content and feature, allows deaf-mute child's Preliminary study to need what is learnt
Pronunciation content;
S2:Deaf-mute child is pronounced according to Self-Understanding, and gathers pronunciation content and the dynamic change of vocal organs;
S3:Analyze deaf-mute child's pronunciation spectrum signature, sound articulation, the dynamic change characterization of vocal organs;
S4:Deaf-mute child is pronounced what spectrum signature, sound articulation, the dynamic change characterization of vocal organs and normal person pronounced
Template matches, judge the non-natural pronunciation part of deaf-mute child, its dysphonia are graded;
S5:Assessed according to the non-natural pronunciation part detected in previous step and dysphonia grade, grade is deaf-mute child
Select suitable training program and carry out rehabilitation training scheme prompting;
S6:Deaf-mute child's learning pronunciation under rehabilitation training prompting, and pronunciation content is gathered, rejudge non-natural pronunciation portion
Point, and its dysphonia is graded and rehabilitation training prompting.
2. a kind of deaf-mute child's disfluency method of rehabilitation according to claim 1, it is characterised in that the judgement is deaf and dumb
The non-natural pronunciation part of children is specifically that initial consonant, simple or compound vowel of a Chinese syllable harmony are adjusted and is estimated.
3. a kind of deaf-mute child's disfluency method of rehabilitation according to any one of claim 1 or 2, the initial consonant, which is assessed, is
By the pronunciation evaluation to deaf youngster's initial consonant, the coordinated movement of various economic factors situation of patient's lips and teeth tongue position is determined;It is to pass through that the simple or compound vowel of a Chinese syllable, which is assessed,
The pronunciation evaluation female to deaf r-ending retroflexion, determines the coordinated movement of various economic factors situation and sympathetic response situation of patient's lips and teeth tongue position;The tone is assessed
It is, by the assessment to deaf youngster's tone, to determine control situation of the patient to air-flow.
4. a kind of deaf-mute child's disfluency method of rehabilitation according to claim 1, it is characterised in that the dysphonia
Carry out grading and be divided into three-level;One-level dysphonia is dynamic for lip, but can not send sound;Two grades of dysphonias are that can send sound
Sound, can not send greatly the correct pronunciation of testing material, and tone can not obtain the correct rhythm;Three-level dysphonia is to send out
Sound, can the normal rhythm goods rhythm sound of fetching portion.
5. a kind of deaf-mute child's disfluency method of rehabilitation according to claim 1, it is characterised in that the collection pronunciation
Content, be specifically to sample frequency, sampling resolution, channel number setting, and noise treatment is carried out to the pronunciation content that collects.
6. a kind of deaf-mute child's aphasis method of rehabilitation according to claim 1, it is characterised in that the rehabilitation training
Scheme includes words training, pronounciation training, vowel training, consonant training;The words training is put down using deaf youngster
When see that tongue behaviour and lip behaviour are presented to child by the animation of cartoon character in animation, cause the learning interest of child;The sounding
Training can not be pronounced to avoid deaf youngster from only imitating the shape of the mouth as one speaks, and using cartoon when deaf youngster sends sound, animation becomes
Change and give its visual feedback;Air-flow is not hindered by oral cavity by any when the vowel training is reason pronunciation, vocal cord vibration,
Correct tongue position;The consonant training is correct one's pronunciation position and manner of articulation.
7. a kind of deaf-mute child's aphasis method of rehabilitation according to claim 1, it is characterised in that the pronounciation training
Middle animation changes to be referred to its visual feedback, and the distance of cartoon neutron bomb transmitting range from pistol is by sound
Power determine.
8. a kind of deaf-mute child of a kind of deaf-mute child's aphasis method of rehabilitation correspondence according to any one of claim 1 to 7
Virgin aphasis rehabilitation system, it is characterised in that including:Sound acquisition module, image capture module, data analysis module, hair
Sound barrier hinders grade evaluation module, rehabilitation training program decisions module, human-computer interaction module, database module.
9. a kind of deaf-mute child's aphasis rehabilitation system according to claim 8, it is characterised in that the database mould
Block includes pronunciation content and picture, health adult hair's audio spectrum signature, sound articulation, the mould of the dynamic change characterization of vocal organs
Plate, rehabilitation training scheme prompting animation.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710571917.0A CN107301863A (en) | 2017-07-13 | 2017-07-13 | A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710571917.0A CN107301863A (en) | 2017-07-13 | 2017-07-13 | A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107301863A true CN107301863A (en) | 2017-10-27 |
Family
ID=60133907
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710571917.0A Pending CN107301863A (en) | 2017-07-13 | 2017-07-13 | A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107301863A (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107967844A (en) * | 2017-12-15 | 2018-04-27 | 汪洁 | A kind of patients with Chinese aphasia mental language training method and training system |
CN108113651A (en) * | 2017-12-15 | 2018-06-05 | 汪洁 | A kind of patients with Chinese aphasia mental language evaluation method and evaluation system |
CN108376486A (en) * | 2018-01-17 | 2018-08-07 | 上海交通大学医学院附属瑞金医院 | A kind of method and system of trained sounding |
CN109064789A (en) * | 2018-08-17 | 2018-12-21 | 重庆第二师范学院 | A kind of adjoint cerebral palsy speaks with a lisp supplementary controlled system and method, assistor |
CN110415783A (en) * | 2018-04-26 | 2019-11-05 | 北京新海樱科技有限公司 | A kind of Functional Activities of OT method of rehabilitation based on body-sensing |
CN110782961A (en) * | 2019-10-28 | 2020-02-11 | 杭州南粟科技有限公司 | Intelligent hearing speech rehabilitation method and device, electronic equipment and medium |
CN111832412A (en) * | 2020-06-09 | 2020-10-27 | 北方工业大学 | Sound production training correction method and system |
CN113593374A (en) * | 2021-07-06 | 2021-11-02 | 浙江大学 | Multi-modal speech rehabilitation training system combining oral muscle training |
CN114566258A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Planning system for Chinese dysarthria correction scheme of autism assessment object |
CN114566257A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Correction scheme generation system for dysarthria of initial consonant b |
CN114566259A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Correction scheme generation system for m dysarthria of initial consonant |
CN114566256A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Correction scheme generation system for consonant d dysarthria |
CN114582369A (en) * | 2022-01-18 | 2022-06-03 | 华东师范大学 | Initial consonant dysarthria analysis system based on speech recognition |
CN114944218A (en) * | 2022-01-18 | 2022-08-26 | 华东师范大学 | Data query processing method and database system for correcting consonant dysarthria |
CN117747043A (en) * | 2023-12-19 | 2024-03-22 | 苏州维格纳信息科技有限公司 | Rehabilitation training system for auditory cognitive dysfunction |
CN114566259B (en) * | 2022-01-18 | 2024-06-25 | 华东师范大学 | Correction scheme generation system for m-structure dystonia of initial consonant |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1089246A2 (en) * | 1999-10-01 | 2001-04-04 | Siemens Aktiengesellschaft | Method and apparatus for speech impediment therapy |
CN101751809A (en) * | 2010-02-10 | 2010-06-23 | 长春大学 | Deaf children speech rehabilitation method and system based on three-dimensional head portrait |
CN102663925A (en) * | 2012-05-09 | 2012-09-12 | 长春大学 | Method and system for tongue training for language training of hearing-impaired children |
CN104537925A (en) * | 2014-12-01 | 2015-04-22 | 杨颖� | Language barrier child language training auxiliary system and method |
CN105982641A (en) * | 2015-01-30 | 2016-10-05 | 上海泰亿格康复医疗科技股份有限公司 | Speech and language hypoacousie multi-parameter diagnosis and rehabilitation apparatus and cloud rehabilitation system |
-
2017
- 2017-07-13 CN CN201710571917.0A patent/CN107301863A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1089246A2 (en) * | 1999-10-01 | 2001-04-04 | Siemens Aktiengesellschaft | Method and apparatus for speech impediment therapy |
CN101751809A (en) * | 2010-02-10 | 2010-06-23 | 长春大学 | Deaf children speech rehabilitation method and system based on three-dimensional head portrait |
CN102663925A (en) * | 2012-05-09 | 2012-09-12 | 长春大学 | Method and system for tongue training for language training of hearing-impaired children |
CN104537925A (en) * | 2014-12-01 | 2015-04-22 | 杨颖� | Language barrier child language training auxiliary system and method |
CN105982641A (en) * | 2015-01-30 | 2016-10-05 | 上海泰亿格康复医疗科技股份有限公司 | Speech and language hypoacousie multi-parameter diagnosis and rehabilitation apparatus and cloud rehabilitation system |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108113651A (en) * | 2017-12-15 | 2018-06-05 | 汪洁 | A kind of patients with Chinese aphasia mental language evaluation method and evaluation system |
CN107967844A (en) * | 2017-12-15 | 2018-04-27 | 汪洁 | A kind of patients with Chinese aphasia mental language training method and training system |
CN108376486A (en) * | 2018-01-17 | 2018-08-07 | 上海交通大学医学院附属瑞金医院 | A kind of method and system of trained sounding |
CN110415783A (en) * | 2018-04-26 | 2019-11-05 | 北京新海樱科技有限公司 | A kind of Functional Activities of OT method of rehabilitation based on body-sensing |
CN109064789A (en) * | 2018-08-17 | 2018-12-21 | 重庆第二师范学院 | A kind of adjoint cerebral palsy speaks with a lisp supplementary controlled system and method, assistor |
CN110782961A (en) * | 2019-10-28 | 2020-02-11 | 杭州南粟科技有限公司 | Intelligent hearing speech rehabilitation method and device, electronic equipment and medium |
CN111832412B (en) * | 2020-06-09 | 2024-04-09 | 北方工业大学 | Sounding training correction method and system |
CN111832412A (en) * | 2020-06-09 | 2020-10-27 | 北方工业大学 | Sound production training correction method and system |
CN113593374A (en) * | 2021-07-06 | 2021-11-02 | 浙江大学 | Multi-modal speech rehabilitation training system combining oral muscle training |
CN114566258A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Planning system for Chinese dysarthria correction scheme of autism assessment object |
CN114566259A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Correction scheme generation system for m dysarthria of initial consonant |
CN114566256A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Correction scheme generation system for consonant d dysarthria |
CN114582369A (en) * | 2022-01-18 | 2022-06-03 | 华东师范大学 | Initial consonant dysarthria analysis system based on speech recognition |
CN114944218A (en) * | 2022-01-18 | 2022-08-26 | 华东师范大学 | Data query processing method and database system for correcting consonant dysarthria |
CN114566257A (en) * | 2022-01-18 | 2022-05-31 | 华东师范大学 | Correction scheme generation system for dysarthria of initial consonant b |
CN114566259B (en) * | 2022-01-18 | 2024-06-25 | 华东师范大学 | Correction scheme generation system for m-structure dystonia of initial consonant |
CN117747043A (en) * | 2023-12-19 | 2024-03-22 | 苏州维格纳信息科技有限公司 | Rehabilitation training system for auditory cognitive dysfunction |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107301863A (en) | A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system | |
CN110556129B (en) | Bimodal emotion recognition model training method and bimodal emotion recognition method | |
CN105792752B (en) | Computing techniques for diagnosing and treating language-related disorders | |
Engwall | Analysis of and feedback on phonetic features in pronunciation training with a virtual teacher | |
Tran et al. | Improvement to a NAM-captured whisper-to-speech system | |
Green et al. | Lip movement exaggerations during infant-directed speech | |
WO2019024247A1 (en) | Data exchange network-based online teaching evaluation system and method | |
Kostoulas et al. | Affective speech interface in serious games for supporting therapy of mental disorders | |
Nickerson et al. | Teaching speech to the deaf: Can a computer help | |
Yap | Speech production under cognitive load: Effects and classification | |
Parnandi et al. | Development of a remote therapy tool for childhood apraxia of speech | |
Hair et al. | A longitudinal evaluation of tablet-based child speech therapy with Apraxia World | |
Calvo et al. | Evaluation of an automatic speech recognition platform for dysarthric speech | |
US20200111488A1 (en) | Analytics-based speech therapy | |
CN113658584A (en) | Intelligent pronunciation correction method and system | |
Rosenblum et al. | The impact and status of Carol Fowler's supramodal theory of multisensory speech perception | |
Aharonson et al. | A real-time phoneme counting algorithm and application for speech rate monitoring | |
CN107452370A (en) | A kind of application method of the judgment means of Chinese vowel followed by a nasal consonant dysphonia patient | |
Varano et al. | Speech-driven facial animations improve speech-in-noise comprehension of humans | |
Patel et al. | Teachable interfaces for individuals with dysarthric speech and severe physical disabilities | |
Hamidi | Digital tangible games for speech intervention | |
McKechnie | Exploring the use of technology for assessment and intensive treatment of childhood apraxia of speech | |
Talkar | Detection and Characterization of Autism Spectrum Disorder and Parkinson’s Disease Utilizing Measures of Speech-and Fine-Motor Coordination | |
Böck | Multimodal automatic user disposition recognition in human-machine interaction | |
Syed et al. | Sign recognition system for differently abled people |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171027 |
|
WD01 | Invention patent application deemed withdrawn after publication |