CN102920433B - Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech resonance - Google Patents
Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech resonance Download PDFInfo
- Publication number
- CN102920433B CN102920433B CN201210407803.XA CN201210407803A CN102920433B CN 102920433 B CN102920433 B CN 102920433B CN 201210407803 A CN201210407803 A CN 201210407803A CN 102920433 B CN102920433 B CN 102920433B
- Authority
- CN
- China
- Prior art keywords
- rehabilitation
- real
- sympathetic response
- data
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Rehabilitation Tools (AREA)
Abstract
The invention discloses a rehabilitation system based on a real-time audio-visual feedback and promotion technology for speech resonance. The rehabilitation system comprises a real-time measurement unit, a main control unit, and a real-time audio-visual feedback unit, wherein the real-time measurement unit is used for measuring data of resonance condition of a user in real time; the main control unit is connected with the real-time measurement unit, and is used for distinguishing resonance disorder of the user and setting a rehabilitation mode; and the real-time audio-visual feedback unit is connected with the main control unit, and is used for displaying and feeding back rehabilitation information and a rehabilitation result in real time. The method level and the modern technology level are combined to form the real-time audio-visual feedback and promotion technology for speech resonance. The invention also discloses a rehabilitation method based on the real-time audio-visual feedback and promotion technology for speech resonance.
Description
Technical field
The present invention relates to speech therapy field, relate in particular to a kind of rehabilitation system and method based on the real-time audiovisual feedback of speech sympathetic response and promotion technology.
Background technology
Sympathetic response obstacle refers in the process forming in speech, dyskinesia due to sympathetic response organs such as tongue, lip, soft palates, cause resonator volume abnormal, make speech focus point occur deviation, thereby affected its sympathetic response effect, sympathetic response obstacle is the important component part of speech disorder, and main manifestations is oral cavity sympathetic response obstacle, nasal cavity resonance obstacle and sympathetic response dystimbria obstacle.At present, the domestic treatment major embodiment for sympathetic response obstacle: the one, for the different obstruct classifying type of sympathetic response obstacle, refine pointedly different speeches and promoted Therapeutic Method, discuss each and promoted definition, indication, the essential of exercise and the key step of therapy, can select to the ill different promotion therapys, strong operability, has a stronger directive significance for clinical, reaches the object that promotes and improve speech disorder patient's resonant function; The 2nd, utilize sophisticated equipment, broadly, scatteredly patient's speech sound and computer are formed to simple alternate acknowledge, promote the local lifting of speech resonant function aspect, embodied that both pictures and texts are excellent, acoustic image develops simultaneously, transfer patient's learning initiative, excited patient's learning enthusiasm.To at present, integrate and promote therapy and sophisticated equipment to there is not yet bibliographical information for rehabilitation system and the method for rehabilitation thereof of the different obstruct type of sympathetic response obstacle, system, General Promotion resonant function.
Summary of the invention
The present invention has overcome the above-mentioned defect of prior art, has proposed a kind of rehabilitation system and method based on the real-time audiovisual feedback of speech sympathetic response and promotion technology.For this quasi-speech voice disorder of sympathetic response obstacle, associated methods aspect of the present invention and modern technologies aspect, by the real-time audiovisual feedback of speech sympathetic response and promotion technology, sympathetic response obstacle rehabilitation system and method based on the real-time audiovisual feedback of speech sympathetic response and promotion technology have been formed.Method of rehabilitation of the present invention makes symptom, method, form three realize effective perfect adaptation, promotes patient's speech resonant function ground to promote in maximum efficiency.
The present invention proposes the rehabilitation system based on the real-time audiovisual feedback of speech sympathetic response and promotion technology, comprising:
Real-time measuring unit, it is for measuring in real time the data of user's sympathetic response situation;
Main control unit, it is connected with described measuring unit, for differentiating user's sympathetic response obstacle and rehabilitation modality being set;
Real-time audiovisual feedback unit, it is connected with described main control unit, for showing in real time and information and the result of feeding back rehabilitation.
Wherein, described measuring unit comprises mike, nose flow detector.
Wherein, described main control unit comprises:
Rehabilitation content storage module, it is for the content of the speech sympathetic response promotion technology of storing rehabilitation course and using;
Rehabilitation execution module, it is connected with described rehabilitation content storage module and audiovisual feedback unit, for rehabilitation content described in rehabilitation modality and real time execution is set;
Real time discriminating module, it is connected with described real-time measuring unit and rehabilitation execution module, for real time discriminating user's sympathetic response situation.
Wherein, described sympathetic response the barrer types comprises the abnormal obstacle of oral cavity sympathetic response, the abnormal obstacle of nasal cavity resonance.
The invention allows for a kind of method of rehabilitation based on the real-time audiovisual feedback of speech sympathetic response and promotion technology, comprising:
Step 1: described real-time measuring unit is measured user's sympathetic response situation in real time, is sent to data the real time discriminating module of described main control unit in real time;
Step 2: described real time discriminating module is differentiated according to described data and reference standard, and be sent to described rehabilitation execution module during by differentiation fructufy;
Step 3: described rehabilitation execution module is according to described differentiation result, set rehabilitation modality, from described rehabilitation content storage module, read the content of speech sympathetic response promotion technology and carry out described rehabilitation modality content, execution result is transferred to described real-time audiovisual feedback unit;
Step 4: described real-time audiovisual feedback unit shows described execution result in real time.
Method of rehabilitation of the present invention, also further comprises:
Step 5: repeat described step 1 to step 4, until the data of user's sympathetic response situation stop while reaching described reference standard.
Wherein, in described step 1, the data of described sympathetic response situation comprise formant frequency data, nose data on flows.
Method of rehabilitation of the present invention, before described step 1, also further comprises:
Steps A 1: described real-time measuring unit is measured user's sympathetic response situation, is sent to data the real time discriminating module of described main control unit in real time;
Steps A 2: described real time discriminating module is differentiated according to user profile and described data and reference standard, judgement user's sympathetic response the barrer types;
Steps A 3: described real time discriminating module is sent to described rehabilitation execution module by described user profile and the barrer types information.
The present invention combines Real-time Feedback technology and audiovisual combination technology, form real-time audiovisual feedback technology, patient's rehabilitation course and result are entered to real-time dynamic monitoring, rehabilitation efficacy is evaluated timely, make patient can have target, by step, complete rehabilitation flow process by easy stages, thereby promote the lifting of patient's resonant function.
Accompanying drawing explanation
Fig. 1 is the pie graph that the present invention is based on the rehabilitation system of the real-time audiovisual feedback of speech sympathetic response and promotion technology.
Fig. 2 is the flow chart of method of rehabilitation of the present invention.
Fig. 3 is the survey map of formant frequency data in method of rehabilitation of the present invention.
Fig. 4 is the survey map of nose data on flows in method of rehabilitation of the present invention.
Fig. 5 is shown image during for the abnormal obstacle of oral cavity sympathetic response in method of rehabilitation of the present invention; Wherein, Fig. 5 (a) is the image of formant coupling, the image that Fig. 5 (b) follows the trail of for tongue position.
The specific embodiment
Below in conjunction with drawings and Examples, specific embodiments of the present invention are further described in detail, but should not limit the scope of the invention with this.
As Figure 1-5, the real-time measuring unit of 1-, 2-main control unit, the real-time audiovisual feedback of 3-unit, 21-rehabilitation content storage module, 22-rehabilitation execution module, 23-real time discriminating module.
The present invention is based on the rehabilitation system of the real-time audiovisual feedback of speech sympathetic response and promotion technology, comprising real-time measuring unit 1, main control unit 2 and real-time audiovisual feedback unit 3, as shown in Figure 1.
Measuring unit 1 is for measuring in real time the data of user's sympathetic response.Main control unit 2 is connected with real-time measuring unit 1, for differentiating user's sympathetic response obstacle, rehabilitation modality is set.Audiovisual feedback unit 3 is connected with main control unit 2 in real time, for showing in real time and information and the result of feeding back rehabilitation.
Wherein, measuring unit 1 comprises mike and nose flow detector in real time.
Wherein, main control unit 2 comprises rehabilitation content storage module 21, rehabilitation execution module 22, real time discriminating module 23.
The rehabilitation content that rehabilitation content storage module 21 is used for storing rehabilitation course, is included in the content of using speech sympathetic response promotion technology in rehabilitation course, comprises the information such as video, sound, word, image.
Rehabilitation execution module 22 is connected with rehabilitation content storage module 21 and audiovisual feedback unit 3, for rehabilitation modality and real time execution rehabilitation content are set.
Real time discriminating module 23 is connected with real-time measuring unit 1 and rehabilitation execution module 22, for real time discriminating user's sympathetic response situation.
Sympathetic response obstacle refers in the process forming in speech, dyskinesia due to sympathetic response organs such as tongue, lip, soft palates, cause resonator volume abnormal, make speech focus point occur deviation, thereby affected its sympathetic response effect, sympathetic response obstacle comprises oral cavity sympathetic response obstacle and nasal cavity resonance obstacle, also comprises sympathetic response dystimbria obstacle.Sympathetic response dystimbria obstacle can cause by oral cavity sympathetic response obstacle and nasal cavity resonance obstacle, and the differentiation of sympathetic response dystimbria obstacle is comparatively complicated.The present invention preferably differentiates and rehabilitation oral cavity sympathetic response obstacle and nasal cavity resonance obstacle.
Oral cavity sympathetic response obstacle comprises that anteposition focuses on, rear position focuses on and larynx position focuses on.It is that while speaking, tongue stretches excessively forward that anteposition focuses on, speech focus on be formed at lingual surface central authorities the place ahead, speech shows as faint and thin, is called anteposition focusing.After if while speaking, tongue position is too leaned on, speech focuses on the rear that is formed at lingual surface central authorities, and speech shows as oppressive and dull, is called rear position and focuses on.If tongue position excessively on the lower while speaking, speech focuses on the below that is formed at lingual surface central authorities, and sound sounds like and is locked in firmly throat, is called larynx position and focuses on.Sympathetic response obstacle in oral cavity is differentiated by formant frequency data.In sympathetic response process, the activity of sympathetic response organ has changed the size and shape of sound channel, the sympathetic response character of sound channel is changed, make some frequencies in sound spectrum obtain resonance reinforcement, other are weakened amount of decrease, and these resonant frequencies that are reinforced are called formant.Formant frequency data comprise the first formant frequency F1 and the second formant frequency F2.The first formant frequency F1 reflects size and the resonance state of pharyngeal cavity, is subject to down to issue the impact of motion conditions.Instantly issue while moving downward, oral cavity volume increases, and pharyngeal cavity volume reduces, and F1 increases; When lower jaw moves upward, oral cavity volume reduces, and pharyngeal cavity volume increases, and F1 reduces.The second formant frequency F2 reflects size and the resonance state in oral cavity, mainly discloses the situation that seesaws of tongue.When tongue travels forward, pharyngeal cavity volume increases, and oral cavity volume reduces, and F2 increases; When tongue moves backward, pharyngeal cavity volume reduces, and oral cavity volume increases, and F2 reduces.
Nasal cavity resonance obstacle comprises rhinophonia hyperfunctioning and rhinophonia hypofunction.Rhinophonia hyperfunctioning is mainly due to the open caused by abnormal of nasopharynx part.Soft palate is short and small because having for some organic diseases that may exist, cleft palate or palate muscular tension low inferior.Soft palate muscle group (levator veli palatini etc.) shrinks and diastole campaign disorder can cause soft palate and uvula to be lifted and descending motion cannot effectively be switched, and main manifestations is that nasal cavity resonance sound increases.Rhinophonia hypofunction is that patient cannot be imported/the gutturophony of m/ ,/n/ ,/ng/ nasal cavity into and carry out sympathetic response, and some vowels even the pronunciation of consonant also suffer distortion in various degree, most rhinophonia hypofunctions by organic diseases because causing.Nose flow detection is a kind of not damaged, simple and practical detection method.Nose data on flows is nasal cavity sound pressure level (n) and output sound pressure level (ratio of oral cavity sound pressure level (o) and nasal cavity sound pressure level (n) sum, available following formulate: nose flow=n/ (n+o) * 100%.Can judge more objectively too high or the too low and order of severity of patient's rhinophonia.
The method of rehabilitation that the present invention is based on the real-time audiovisual feedback of speech sympathetic response and promotion technology, as shown in Figure 2, comprising:
Step 1: measuring unit 1 is measured user's sympathetic response situation in real time in real time, is sent to data the real time discriminating module 23 of main control unit 2 in real time.The data of sympathetic response situation comprise formant frequency data, nose data on flows.
Step 2: real time discriminating module 23 is differentiated according to data and reference standard, and be sent to rehabilitation execution module 22 during by differentiation fructufy.
Step 3: rehabilitation execution module 22, according to differentiating result, is set rehabilitation modality, and reading and carry out rehabilitation modality content from rehabilitation content storage module 21 is speech sympathetic response promotion technology, and execution result is transferred to real-time audiovisual feedback unit 3.
Step 4: audiovisual feedback unit 3 shows execution result in real time in real time.
Method of rehabilitation of the present invention, further comprises step 5: repeated execution of steps one is to step 4, until the data of user's sympathetic response situation stop while reaching reference standard.
In the present invention, " reference standard " refers to the reference value of same age, other sympathetic response situation data of the same sex, for example table 1, table 2.
Method of rehabilitation of the present invention, before above-mentioned steps one, also further comprises the steps:
Steps A 1: measuring unit 1 is measured user's sympathetic response situation in real time, data is sent in real time to the real time discriminating module 23 of main control unit 2.
Steps A 2: real time discriminating module 23 is differentiated according to user profile and data and reference standard, judgement user's sympathetic response the barrer types.
Steps A 3: real time discriminating module 23 is sent to rehabilitation execution module 22 by user profile and the barrer types information.
Embodiment 1: the differentiation of sympathetic response the barrer types
Before implementing method of rehabilitation of the present invention, first carry out the differentiation of sympathetic response the barrer types.As shown in Figure 3 and Figure 4, user is dark air-breathingly to pronounce to real-time measuring unit 1 afterwards, and measuring unit 1 gathers user's sound in real time, and measuring unit 1 extracts user's formant frequency data (as Fig. 3), nose data on flows (as Fig. 4) automatically in real time.Measuring unit 1 by the result measuring (for example in real time, formant frequency data, nose data on flows) be sent to the real time discriminating module 23 in main control unit 2, real time discriminating module 23 according to user profile (for example, user's age, sex) automatically according to same age, other reference standard of the same sex (as shown in table 1, table 2), by formant frequency data judging user, whether there is the abnormal obstacle of oral cavity sympathetic response, and judge by nose data on flows whether user exists the abnormal obstacle of nasal cavity resonance.Real time discriminating unit 23 is sent to differentiation the barrer types information in rehabilitation execution module 22.
For example, certain user's sex is man, and at 12 years old age, it is F1=344.42Hz in the formant frequency of pronunciation/i/ that measuring unit 1 extracts this user automatically, F2=2195.69Hz, and the nose flow while reading " you do mother " is 28.56%.And 12 years old normal boy F2 is 3439Hz, the nose flow that normal boy reads " you do mother " is 62.95%.Therefore, real time discriminating unit 23 can judge that this user exists the abnormal obstacle of oral cavity sympathetic response, the abnormal obstacle of nasal cavity resonance automatically.
Table 1 formant frequency standard scale
Table 2 nose data on flows standard scale
Embodiment 2: for the method for rehabilitation of the abnormal obstacle of oral cavity sympathetic response
Rehabilitation execution module 22 arranges rehabilitation modality according to the user profile in embodiment 1 and the barrer types information, and rehabilitation execution module 22 rehabilitation modalities are set to the abnormal obstacle pattern of oral cavity sympathetic response, selects the abnormal promotion treatment of oral cavity sympathetic response.In the abnormal obstacle pattern of oral cavity sympathetic response, the user's that the more real-time measuring unit 1 of real time discriminating module 23 is measured formant data and the formant data in reference standard are made comparisons, and generate and differentiate result.Rehabilitation execution module 22 is carried out rehabilitation modality content according to differentiating result, and execution result is sent to real-time audiovisual feedback unit 3 shows.
Sympathetic response abnormal obstacle pattern in oral cavity is carried out as following steps:
Step 1: rehabilitation execution module 22 is according to the barrer types information of user in embodiment, and rehabilitation modality is set to the abnormal obstacle pattern of oral cavity sympathetic response, and according to this user's formant data, initial target is set, and it is 2250Hz that sympathetic response desired value is for example set.Rehabilitation execution module 22 reads the content of the abnormal obstacle pattern of oral cavity sympathetic response from rehabilitation content storage module 21, select the abnormal promotion treatment technology of oral cavity sympathetic response, as: " anteposition sound method ", " method lolls " operation, the picture of operation, video, sound and Word message are sent in real-time audiovisual feedback unit 3, audiovisual feedback unit 3 shows in the mode of audiovisual feedback in real time, for example the formant of the formant of user pronunciation and orthoepy is matched, the height of matching degree is proportionate with the distance of tight-wire walking, as shown in Fig. 5 (a).
Step 2: when user is in phonation, real-time measuring unit 1 Real-time Collection user's sympathetic response situation, audiovisual feedback unit 3 is in real time according to the pronounce distance of matching degree decision tight-wire walking of formant and orthoepy formant of patient in real time.If when user finishes sympathetic response, real time discriminating module 23 judges that animal does not reach terminal, real time discriminating module 23 is sent to failed result of determination in rehabilitation execution module 22, and rehabilitation execution module 22 shows failed result by audiovisual feedback unit 3 to user.
If when user finishes sympathetic response, real time discriminating module 23 judges that animal has reached terminal.Real time discriminating module 23 is sent to successful result of determination in rehabilitation execution module 22, and rehabilitation execution module 22 shows successful result by audiovisual feedback unit 3 to user.
Step 3: when animal completes tight-wire walking, real time discriminating module 23 compares the formant data in these formant data and reference standard, and comparative result is sent in rehabilitation execution module 22.When comparative result is that formant data reach reference standard, rehabilitation execution module 22 finishes operation.If comparative result is formant frequency data, do not reach reference standard, rehabilitation execution module 22 repeats the content of rehabilitation modality, and automatic lifting sympathetic response desired value (for example, promoting 100Hz), as shown in Fig. 5 (b).
Embodiment 3: for the method for rehabilitation of the abnormal obstacle of nasal cavity resonance
Rehabilitation execution module 22 arranges rehabilitation modality according to the user profile in embodiment 1 and the barrer types information, and rehabilitation execution module 22 rehabilitation modalities are set to the rehabilitation modality of the abnormal obstacle of nasal cavity resonance, selects the abnormal promotion treatment of nasal cavity resonance.In the abnormal obstacle rehabilitation modality of nasal cavity resonance, real time discriminating module 23 compares according to the user's that measuring unit 1 is measured in real time nose data on flows and the nose data on flows in reference standard, generates and differentiates result.Rehabilitation execution module 22 is carried out rehabilitation content according to differentiating result, and execution result is sent to real-time audiovisual feedback unit 3 shows.
For the abnormal obstacle of nasal cavity resonance, method of rehabilitation is as shown in following steps: sympathetic response abnormal obstacle pattern in oral cavity is carried out as following steps:
Step 1: rehabilitation execution module 22 is according to the barrer types of user in embodiment, rehabilitation modality is set to the abnormal obstacle pattern of nasal cavity resonance, and according to this user's nose data on flows, nose flow target value is set, it is that 35%. rehabilitation execution module 22 read the content of the abnormal obstacle pattern of nasal cavity resonance from rehabilitation content storage module 21 that nose flow target value is for example set, select the abnormal promotion treatment technology of nasal cavity resonance, as: " sympathetic response relaxation training ", " nasal cavity resonance method " operation, by the picture of operation, video, sound and Word message are sent in real-time audiovisual feedback unit 3, audiovisual feedback unit 3 shows in the mode of audiovisual feedback in real time, the variation that shows nose data on flows by nose flow diagram directly perceived.
Step 2: when user is in sympathetic response process, real-time measuring unit 1 Real-time Collection user's sympathetic response situation.If when user finishes sympathetic response, measuring nose data on flows is 28%, real time discriminating module 23 judges that nose data on flows does not reach nose flow target value, real time discriminating module 23 is sent to failed result of determination in rehabilitation execution module 22, and rehabilitation execution module 22 shows failed result by real-time audiovisual feedback unit 3 to user.
If when user finishes sympathetic response, measuring nose data on flows is 40%.Real time discriminating module 23 judges that nose data on flows has reached nose flow target value, and real time discriminating module 23 is sent to successful result of determination in rehabilitation execution module 22, and rehabilitation execution module 22 shows successful result by real-time audiovisual feedback unit 3 to user.
Step 3: when nose data on flows reaches nose flow target value, real time discriminating module 23 compares the nose data on flows in this nose data on flows and reference standard, and comparative result is sent in rehabilitation execution module 22.When comparative result is that nose data on flows reaches reference standard, rehabilitation execution module 22 finishes operation.If comparative result is nose data on flows, do not reach reference standard, rehabilitation execution module 22 repeats the content of rehabilitation modality, and automatically nose flow target value is promoted to 10%.
The foregoing is only preferred embodiment of the present invention, be not used for limiting practical range of the present invention.Under any, in technical field, have and conventionally know the knowledgeable, without departing from the spirit and scope of the present invention, when doing various changes and retouching, protection domain of the present invention should be as the criterion with the protection domain that claims were defined.
Claims (6)
1. the rehabilitation system based on the real-time audiovisual feedback of speech sympathetic response and promotion technology, is characterized in that, comprising:
Real-time measuring unit (1), it is for measuring in real time the data of user's speech sympathetic response situation; The data of described speech sympathetic response situation comprise formant frequency data and nose data on flows;
Main control unit (2), it is connected with described measuring unit (1), for differentiating user's sympathetic response obstacle and rehabilitation modality being set;
Real-time audiovisual feedback unit (3), it is connected with described main control unit (2), adopts the real-time audiovisual feedback technology of speech sympathetic response for information and the result of demonstration in real time and feedback rehabilitation,
Wherein, described main control unit (2) comprises rehabilitation content storage module (21), real time discriminating module (23) and rehabilitation execution module (22),
The rehabilitation content speech sympathetic response promotion technology contents that described rehabilitation content storage module (21) is used for storing rehabilitation course;
Described real time discriminating module (23) is connected with described real-time measuring unit (1) and described rehabilitation execution module (22), for receiving the data of described speech sympathetic response situation, according to described data and reference standard, differentiate user's sympathetic response the barrer types, and be sent to described rehabilitation execution module (22) during by differentiation fructufy; Described reference standard is the reference value of same age, other sympathetic response situation data of the same sex;
Described rehabilitation execution module (22) is connected with described rehabilitation content storage module (21) and real-time audiovisual feedback unit (3), for rehabilitation modality being set according to described differentiation result, from described rehabilitation content storage module (21), read and carry out the content of speech sympathetic response promotion technology described rehabilitation modality, execution result is transferred to described audiovisual feedback unit (3).
2. the rehabilitation system based on the real-time audiovisual feedback of speech sympathetic response and promotion technology as claimed in claim 1, is characterized in that, described real-time measuring unit (1) comprises mike, nose flow detector.
3. rehabilitation system as claimed in claim 1, is characterized in that, described sympathetic response the barrer types comprises the abnormal obstacle of oral cavity sympathetic response, the abnormal obstacle of nasal cavity resonance.
4. rehabilitation system as claimed in claim 1, is characterized in that, described rehabilitation modality comprises the abnormal obstacle pattern of oral cavity sympathetic response and the abnormal obstacle pattern of nasal cavity resonance.
5. rehabilitation system as claimed in claim 4, is characterized in that, under the abnormal obstacle pattern of described oral cavity sympathetic response,
Described rehabilitation execution module (22) is for arranging sympathetic response desired value, from rehabilitation content storage module (21), read the content of the abnormal obstacle pattern of oral cavity sympathetic response, the picture of operation, video, sound and Word message are sent to described audiovisual feedback unit (3);
Described audiovisual feedback unit (3) shows the matching degree of the formant of user pronunciation and the formant of orthoepy for the mode with audiovisual feedback, the height of described matching degree is proportionate with the distance of animal tight-wire walking; Described user pronunciation is collected by real-time measuring unit (1);
When user finishes sympathetic response, real time discriminating module (23) is for judging whether animal reaches terminal; In the situation that judging that animal does not reach terminal, real time discriminating module (23) is for being sent to failed result of determination rehabilitation execution module (22), and described rehabilitation execution module (22) is for showing failed result by audiovisual feedback unit (3) to user; In the situation that judging that animal reaches terminal, real time discriminating module (23) is for being sent to successful result of determination rehabilitation execution module (22), and described rehabilitation execution module (22) is for showing successful result by audiovisual feedback unit (3) to user;
When animal is covered steel wire, real time discriminating module (23) is also for relatively and by comparative result sending to rehabilitation execution module (22) by the formant data of formant data and reference standard; At comparative result, be formant data reach reference standard in the situation that, rehabilitation execution module (22) finishes operation; At comparative result, be that formant data do not reach in reference standard situation, rehabilitation execution module (22) repeats the content of rehabilitation modality, and automatic lifting sympathetic response desired value.
6. rehabilitation system as claimed in claim 4, is characterized in that, under the abnormal obstacle pattern of described nasal cavity resonance,
Described rehabilitation execution module (22) is for arranging nose flow target value, from rehabilitation content storage module (21), read the content of the abnormal obstacle pattern of nasal cavity resonance, the picture of operation, video, sound and Word message are sent to described audiovisual feedback unit (3);
Described audiovisual feedback unit (3) shows the variation of the nose data on flows of user pronunciation by nose flow diagram for the mode with audiovisual feedback; Described user pronunciation is collected by real-time measuring unit (1);
When user finishes sympathetic response, real time discriminating module (23) is for judging whether nose data on flows reaches desired value; In the situation that judgement does not reach desired value, real time discriminating module (23) is for being sent to failed result of determination rehabilitation execution module (22), and described rehabilitation execution module (22) is for showing failed result by audiovisual feedback unit (3) to user; In the situation that judgement reaches desired value, real time discriminating module (23) is for being sent to successful result of determination rehabilitation execution module (22), and described rehabilitation execution module (22) is for showing successful result by audiovisual feedback unit (3) to user;
When nose data on flows reaches desired value, real time discriminating module (23) is also for relatively and by comparative result sending to rehabilitation execution module (22) by the nose data on flows of nose data on flows and reference standard; At comparative result, be nose data on flows reach reference standard in the situation that, rehabilitation execution module (22) finishes operation; At comparative result, be that nose data on flows does not reach in reference standard situation, rehabilitation execution module (22) repeats the content of rehabilitation modality, and automatic lifting nose flow target value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210407803.XA CN102920433B (en) | 2012-10-23 | 2012-10-23 | Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech resonance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210407803.XA CN102920433B (en) | 2012-10-23 | 2012-10-23 | Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech resonance |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102920433A CN102920433A (en) | 2013-02-13 |
| CN102920433B true CN102920433B (en) | 2014-08-27 |
Family
ID=47635474
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210407803.XA Active CN102920433B (en) | 2012-10-23 | 2012-10-23 | Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech resonance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102920433B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103383845B (en) * | 2013-07-08 | 2017-03-22 | 上海泰亿格康复医疗科技股份有限公司 | Multi-dimensional dysarthria measuring system and method based on real-time vocal tract shape correction |
| CN103505183B (en) * | 2013-09-24 | 2016-01-20 | 上海泰亿格康复医疗科技股份有限公司 | Based on the speech disorder multi-dimensional measuring system of real-time verbal Conceptual Modeling |
| CN103519785B (en) * | 2013-09-24 | 2016-01-27 | 上海泰亿格康复服务有限公司 | Based on voice disorder multi-dimensional measuring system and the method thereof of real-time voice Conceptual Modeling |
| CN105286798B (en) * | 2015-11-04 | 2018-07-20 | 深圳市福生医疗器械有限公司 | Velopharyngeal closure detection device and detection method |
| JP7403129B2 (en) * | 2018-05-23 | 2023-12-22 | パナソニックＩｐマネジメント株式会社 | Eating and swallowing function evaluation method, program, eating and swallowing function evaluation device, and eating and swallowing function evaluation system |
| CN110870764A (en) * | 2019-06-27 | 2020-03-10 | 上海慧敏医疗器械有限公司 | Breathing rehabilitation instrument and method based on longest sound time real-time measurement and audio-visual feedback technology |
| CN110870763B (en) * | 2019-06-27 | 2023-05-16 | 上海慧敏医疗器械有限公司 | Nose resonance rehabilitation instrument and method based on nose-mouth resonance ratio measurement and audio-visual feedback technology |
| CN110870762B (en) * | 2019-06-27 | 2022-03-29 | 上海慧敏医疗器械有限公司 | Nasal cavity resonance rehabilitation instrument and method based on nasal flow measurement and audio-visual feedback technology |
| CN110870765A (en) * | 2019-06-27 | 2020-03-10 | 上海慧敏医疗器械有限公司 | Voice treatment instrument and method adopting glottis closing real-time measurement and audio-visual feedback technology |
| CN110876607A (en) * | 2019-06-27 | 2020-03-13 | 上海慧敏医疗器械有限公司 | Respiratory rehabilitation instrument and method based on maximum number capability measurement and audio-visual feedback technology |
| CN110876608A (en) * | 2019-06-27 | 2020-03-13 | 上海慧敏医疗器械有限公司 | Sound production rehabilitation instrument and method based on real-time fundamental frequency measurement and audio-visual feedback technology |
| CN110876609A (en) * | 2019-07-01 | 2020-03-13 | 上海慧敏医疗器械有限公司 | Voice treatment instrument and method for frequency band energy concentration rate measurement and audio-visual feedback |
| CN110881953A (en) * | 2019-07-09 | 2020-03-17 | 上海慧敏医疗器械有限公司 | Resonance rehabilitation instrument and method for resonance peak frequency disturbance measurement and audio-visual feedback |
| CN110664370B (en) * | 2019-09-26 | 2022-08-30 | 上海慧敏医疗器械有限公司 | Voice treatment instrument adopting fundamental frequency tremor real-time measurement and audio-visual feedback technology |
| CN110664371A (en) * | 2019-09-26 | 2020-01-10 | 泰亿爽琅国际贸易(上海)有限公司 | Resonance rehabilitation instrument and rehabilitation method based on resonance peak measurement and audio-visual feedback technology |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1115900A (en) * | 1994-04-12 | 1996-01-31 | 松下电气工业株式会社 | Synthesis-based speech training system |
| US6850882B1 (en) * | 2000-10-23 | 2005-02-01 | Martin Rothenberg | System for measuring velar function during speech |
| CN1635851A (en) * | 2000-09-19 | 2005-07-06 | 洛格米特里克斯公司 | Palatometer and nasometer apparatus |
-
2012
- 2012-10-23 CN CN201210407803.XA patent/CN102920433B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1115900A (en) * | 1994-04-12 | 1996-01-31 | 松下电气工业株式会社 | Synthesis-based speech training system |
| CN1635851A (en) * | 2000-09-19 | 2005-07-06 | 洛格米特里克斯公司 | Palatometer and nasometer apparatus |
| US6850882B1 (en) * | 2000-10-23 | 2005-02-01 | Martin Rothenberg | System for measuring velar function during speech |
Non-Patent Citations (2)
| Title |
|---|
| 共鸣障碍评估的原理与方法;杜晓新等;《中国听力语言康复科学杂志》;20110331(第3期);第66-69页 * |
| 杜晓新等.共鸣障碍评估的原理与方法.《中国听力语言康复科学杂志》.2011,(第3期),第66-69页. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102920433A (en) | 2013-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102920433B (en) | Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech resonance | |
| CN102920435B (en) | Rehabilitation system and method based on real-time audio-visual feedback and promotion technology for speech production | |
| CN102063903B (en) | Speech interactive training system and speech interactive training method | |
| CN103040468B (en) | Rehabilitation system and method based on speech and breathing real-time audio-visual feedback and facilitation technology | |
| Costa et al. | Immediate effects of the phonation into a straw exercise | |
| CN100397438C (en) | Method for computer assisting learning of deaf-dumb Chinese language pronunciation | |
| US20130158977A1 (en) | System and Method for Evaluating Speech Exposure | |
| CN104732977A (en) | On-line spoken language pronunciation quality evaluation method and system | |
| CN107301863A (en) | A kind of deaf-mute child's disfluency method of rehabilitation and rehabilitation training system | |
| CN102110399A (en) | Method, device and system for assisting explication | |
| CN108461011A (en) | A kind of method and wearable device of automatic identification music rhythm | |
| CN108630200A (en) | Voice keyword detection device and voice keyword detection method | |
| KR102444012B1 (en) | Device, method and program for speech impairment evaluation | |
| Romero et al. | Deep learning features for robust detection of acoustic events in sleep-disordered breathing | |
| Cielo et al. | Musculoskeletal stress syndrome, extrinsic laryngeal muscles and body posture: theoretical considerations | |
| RU2380760C1 (en) | Method of determining voice potentialities and teaching resonance vocal-speech technique | |
| CN109658909A (en) | A kind of intelligence small drum system and its implementation | |
| CN113658584A (en) | Intelligent pronunciation correction method and system | |
| US9928830B2 (en) | Information processing apparatus and information processing method | |
| Hu et al. | Auditory receptive field net based automatic snore detection for wearable devices | |
| KR102484006B1 (en) | Voice self-practice method for voice disorders and user device for voice therapy | |
| CN113936663A (en) | Method for detecting difficult airway, electronic device and storage medium thereof | |
| KR20210146825A (en) | Method and system for analyzing language development disorder and behavior development disorder by processing video information input to the camera and audio information input to the microphone in real time | |
| JP5360815B2 (en) | Speech training support apparatus and program thereof | |
| CN110870764A (en) | Breathing rehabilitation instrument and method based on longest sound time real-time measurement and audio-visual feedback technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Free format text: FORMER OWNER: SHANGHAI ZHABEI PRIVATE XIAOXIAOHU KINDERGARTEN Effective date: 20140213 |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20140213 Address after: 201611 Shanghai city Songjiang District students Pioneering Park No. 228 Applicant after: Tai Ge Electronics (Shanghai) Co., Ltd. Address before: 201611 Shanghai city Songjiang District students Pioneering Park No. 228 Applicant before: Tai Ge Electronics (Shanghai) Co., Ltd. Applicant before: Shanghai Zhabei District Private Xiaoxiaohu Kindergarten |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee |
Owner name: SHANGHAI TAIYIGE REHABILITATION THERAPY TECHNOLOGY Free format text: FORMER NAME: TIGER ELECTRONICS (SHANGHAI) CO., LTD. |
|
| CP03 | Change of name, title or address |
Address after: 201611 Shanghai Songjiang District Chedun town car No. 180 Jia Building 2 5A Patentee after: SHANGHAI TIGER REHABILITATION THERAPY SCIENCE AND TECHNOLOGY CO., LTD. Address before: 201611 Shanghai city Songjiang District students Pioneering Park No. 228 Patentee before: Tai Ge Electronics (Shanghai) Co., Ltd. |