CN101241656A - Computer assisted training method for mouth shape recognition capability - Google Patents
Computer assisted training method for mouth shape recognition capability Download PDFInfo
- Publication number
- CN101241656A CN101241656A CNA200810065810XA CN200810065810A CN101241656A CN 101241656 A CN101241656 A CN 101241656A CN A200810065810X A CNA200810065810X A CN A200810065810XA CN 200810065810 A CN200810065810 A CN 200810065810A CN 101241656 A CN101241656 A CN 101241656A
- Authority
- CN
- China
- Prior art keywords
- mouth
- shape recognition
- recognition capability
- pronunciation
- mouth shape
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The present invention discloses a computer aided training method for mouth-shape recognition ability which solves the technique problem of increasing training efficiency, saving time of teacher and parents. The method includes steps as follows: the user can select self-selection method or random method, when self-selection method is selected, the user watches pronouncing mouth-shape video and simulates pronouncing mouth-shape action and pronunciation; when random method is selected, computer plays pronouncing mouth-shape video, and interface displays letter, the user judges and computer gives correct answer. By comparison with present technique, the method can make computer replacing teacher or parents for training mouth-shape recognition ability by using computer multimedia function, so the method can save time of teacher or parents and has active action for increasing viability of deaf and dumb people and other hearing impaired people. The method is especially suitable for training mouth-shape recognition ability of hearing impaired people, such as deaf and dumb people, half-deafness people.
Description
Technical field
The present invention relates to a kind of method of utilizing the computer training mouth shape recognition capability, particularly a kind of method of utilizing computer training hearing and speech obstacle person's mouth shape recognition capability.
Background technology
Can't hear or during voice that the speaker that can not hear clearly sends, can change by the shape of the mouth as one speaks of observing the speaker, the meaning that the analysis and judgement latter is expressed, this analysis and judgement ability is a mouth shape recognition capability.Mouth shape recognition capability is a kind of ability of training out the day after tomorrow, in fields such as evidence obtaining, information, special educations its special effect is arranged.Particularly have the people of dysaudia, possess stronger mouth shape recognition capability and can remedy the inconvenience that brings by auditorily handicapped, partly or entirely understand speaker's semanteme, thereby lay the first stone for linking up with other people for deaf person and other.Therefore, train deaf-mute's mouth shape recognition capability consciously, for the quality of life of improving them, the ability to work that improves them all has important effect.Traditionally, to the training of deaf-mute's mouth shape recognition capability, mainly carry out shape of the mouth as one speaks demonstration Face to face by the teacher or the head of a family.Because the deaf-mute will just can remember the shape of the mouth as one speaks and semantic correspondence by observation many times, so, traditional method brings very big workload for the teacher and the head of a family, to such an extent as to the many teachers and the head of a family are owing to the patient mouth shape recognition capability training of having abandoned inadequately the student.
Summary of the invention
The computer assisted training method that the purpose of this invention is to provide a kind of mouth shape recognition capability, the technical matters that solve are the time of improving training effectiveness, saving the teacher or the head of a family.
The present invention is by the following technical solutions: a kind of computer assisted training method of mouth shape recognition capability may further comprise the steps: one, the user starts computing machine, selects free method or random approach by the interface; Two, the user selects the number of words of learning content; When three, using free method, the user clicks learning content on the interface, the shape of the mouth as one speaks video recording when watching the corresponding contents pronunciation, the shape of the mouth as one speaks action and the pronunciation of imitation pronunciation; When using random approach, computer random is broadcasted the pronunciation degree of lip-rounding video record of learning content, provides one group of above literal on the interface, and the user clicks one group of literal, judges pronunciation, and computing machine is informed user's correct option.
After method user of the present invention starts computing machine, select Chinese, English, French, German, Japanese, Russian or minority language.
Typing has the pronunciation video image of learning content in the method computing machine of the present invention.
Method computing machine inter-sync typing of the present invention has the audio content of pronunciation video image.
Method learning content of the present invention comprises: English phonetic symbol, letter, word, sentence and paragraph, the phonetic of Chinese, word, speech, sentence and paragraph.
Method number of words of the present invention is the number of words that comprises in word, speech, sentence or the paragraph.
Method computing machine of the present invention informs that user's correct option adopts interface display.
When method of the present invention was used free method or random approach, the user selected the sound accompaniment of corresponding pronunciation content according to interface prompt.
The free method study of method of the present invention finishes, and the user selects repetitive learning, withdraws from or returns.
Method random approach study of the present invention finishes, and the user selects to switch next topic, withdraws from or returns.
The present invention compared with prior art, utilize the computer media function, set up the method for for the teacher or the head of a family learner being carried out the mouth shape recognition capability training of system fully by computer generation, to improving training effectiveness, saving the teacher or the head of a family's time, the viability that improves deaf-mute and other person hard of hearing has positive role, be specially adapted to hearing and speech obstacle person, as the training of deaf-mute, half-deafness people's mouth shape recognition capability.
Description of drawings
Fig. 1 is the schematic flow sheet of the embodiment of the invention.
Fig. 2 is the Chinese information processing system master interface synoptic diagram of the embodiment of the invention.
Fig. 3 is that the free method of the embodiment of the invention is selected the interface synoptic diagram.
Fig. 4 is free method Mouth-Shape Recognition training (two words) interface synoptic diagram of the embodiment of the invention.
Fig. 5 is the english system master interface synoptic diagram of the embodiment of the invention.
Fig. 6 is that the Optional method of the embodiment of the invention selects the interface synoptic diagram.
Fig. 7 is that the Sentence training of the embodiment of the invention selects the interface synoptic diagram.
Fig. 8 is Optional method (3words) the interface synoptic diagram of the embodiment of the invention.
Fig. 9 is that the random approach of the embodiment of the invention is selected the interface synoptic diagram.
Figure 10 is free method Mouth-Shape Recognition training (three words) interface synoptic diagram of the embodiment of the invention.
Embodiment
Below in conjunction with drawings and Examples the present invention is described in further detail.As shown in Figure 1, the computer assisted training method of mouth shape recognition capability of the present invention, realize based on computer hardware and software systems, may further comprise the steps: one, the pronunciation video image of typing learning content in computing machine, the synchronous corresponding audio content of typing, learning content comprises: English phonetic symbol, letter, word, sentence and paragraph, the phonetic of Chinese, word, speech, sentence and paragraph; Two, the classification of the learning content in the computing machine is deposited, and catalogue is called in setting; Three, the user starts computing machine, selects " free method " or " random approach " by the interface; Four, after the user selects " free method " or " random approach ", select the number of words of learning content, number of words is the number of words that comprises in word, speech, sentence or the paragraph; When five, using free method, the user clicks learning content on the interface, the shape of the mouth as one speaks video recording when watching the corresponding contents pronunciation, the shape of the mouth as one speaks action and the pronunciation of imitation pronunciation; When using random approach, computer random is broadcasted the pronunciation degree of lip-rounding video record of learning content, provides one group of above literal on the interface, and the user clicks one group of literal, judges pronunciation, and computing machine is informed user's correct option; Six, study finishes, and repetitive learning, selects fresh content or withdraws from.
When using free method or random approach, can select the sound accompaniment of corresponding pronunciation content according to interface prompt.
Among the computer assisted training method embodiment of mouth shape recognition capability of the present invention, computer hardware adopts the hardware configuration of general purpose PC to get final product.For example: can adopt acer (grand base) Aspire SA85P type hardware configuration, operating system adopts Microsoft Window 2000/XP, and the CAT software of mouth shape recognition capability adopts according to " imperial shape " software of the present patent application exploitation 1.0 editions.The phonetic symbol of typing English, letter, word, sentence and paragraph in computing machine, the video image of the phonetic of Chinese, word, speech, sentence and paragraph pronunciation, the corresponding speech audio of typing synchronously.
Embodiment 1: the free method training of Chinese " sleep " two words, open computing machine, start the CAT software learning system of mouth shape recognition capability, select Chinese, as shown in Figure 2, enter Chinese information processing system master interface, the user clicks selection " free method ", as shown in Figure 3, enter free method and select the interface, the user clicks selection " two words ", as shown in Figure 4, enter free method Mouth-Shape Recognition training (two words) and select the interface, after the user clicks selection " sleep ", select again " pronunciation mouth shape is watched in click ", just can see the pronunciation mouth shape of sleep two words, if the sound accompaniment switch is chosen as " opening ", can hear the sound of " sleep " two words simultaneously, press the repeatedly shape of the mouth as one speaks of repeated observation pronunciation of " pronunciation mouth shape is watched in click " button, study finishes, click ESC Escape and can close this learning system, click return key and can return the bed interface.
Embodiment 2: the free coaching method of English 3 sentences that word constitutes, open computing machine, start the CAT software learning system of mouth shape recognition capability, select English, as shown in Figure 5, enter english system master interface, the user clicks selection " Optional method ", as shown in Figure 6, enter Optional method and select the interface, the user clicks selection " words ", as shown in Figure 7, enter Sentence training and select the interface, the user clicks selection " 3words ", as shown in Figure 8, enter Optional method (3words) and select the interface, after the user clicks selection " how are you ", choosing " Click to see lipshape " again, just can see the pronunciation mouth shape of how are you,, can hear the sound of " how are you " simultaneously if sound accompaniment is chosen as " open ", press the repeatedly shape of the mouth as one speaks of repeated observation pronunciation of " Click to see lipshape " button, study finishes, and clicks the Exit key and can close this learning system, clicks the Back key and can return the bed interface.
Method of the present invention can be used for the Mouth-Shape Recognition training of various language such as Chinese, English, French, German, Japanese, Russian, minority language.
Method of the present invention takes full advantage of the voice receiving device of multimedia computer, the video harvester and A plurality of hardware equippeds such as display are utilized the multimedia function of computer, replace teacher or the head of a family couple with machine The learner carries out the mouth shape recognition capability training of system, has greatly alleviated teacher and the head of a family's teaching load. This The advantage of invention is: 1. the CAT software of mouth shape recognition capability is easy to be easy-to-use, and the user can Independently use this study accessory system according to operation instruction on computers. 2. the user can be according to the needs choosing of self Select different learning methods, also can select arbitrarily the study content of different difficulty, learning process has in proper order Progressive, as to go from the simple to the complex characteristics. 3. utilize computer display to provide the content of learning to the learner, study The process visual pattern.
Claims (10)
1. the computer assisted training method of a mouth shape recognition capability, may further comprise the steps: one, the user starts computing machine, selects free method or random approach by the interface; Two, the user selects the number of words of learning content; When three, using free method, the user clicks learning content on the interface, the shape of the mouth as one speaks video recording when watching the corresponding contents pronunciation, the shape of the mouth as one speaks action and the pronunciation of imitation pronunciation; When using random approach, computer random is broadcasted the pronunciation degree of lip-rounding video record of learning content, provides one group of above literal on the interface, and the user clicks one group of literal, judges pronunciation, and computing machine is informed user's correct option.
2. the computer assisted training method of mouth shape recognition capability according to claim 1 is characterized in that: after described user starts computing machine, select Chinese, English, French, German, Japanese, Russian or minority language.
3. the computer assisted training method of mouth shape recognition capability according to claim 2 is characterized in that: typing has the pronunciation video image of learning content in the described computing machine.
4. the computer assisted training method of mouth shape recognition capability according to claim 3 is characterized in that: described computing machine inter-sync typing has the audio content of pronunciation video image.
5. the computer assisted training method of mouth shape recognition capability according to claim 4, it is characterized in that: described learning content comprises: English phonetic symbol, letter, word, sentence and paragraph, the phonetic of Chinese, word, speech, sentence and paragraph.
6. the computer assisted training method of mouth shape recognition capability according to claim 5, it is characterized in that: described number of words is the number of words that comprises in word, speech, sentence or the paragraph.
7. the computer assisted training method of mouth shape recognition capability according to claim 6 is characterized in that: described computing machine informs that user's correct option adopts interface display.
8. the computer assisted training method of mouth shape recognition capability according to claim 7, it is characterized in that: when free method of described use or random approach, the user selects the sound accompaniment of corresponding pronunciation content according to interface prompt.
9. the computer assisted training method of mouth shape recognition capability according to claim 8 is characterized in that: described free method study finishes, and the user selects repetitive learning, withdraws from or returns.
10. the computer assisted training method of mouth shape recognition capability according to claim 8 is characterized in that: described random approach study finishes, and the user selects to switch next topic, withdraws from or returns.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA200810065810XA CN101241656A (en) | 2008-03-11 | 2008-03-11 | Computer assisted training method for mouth shape recognition capability |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA200810065810XA CN101241656A (en) | 2008-03-11 | 2008-03-11 | Computer assisted training method for mouth shape recognition capability |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101241656A true CN101241656A (en) | 2008-08-13 |
Family
ID=39933146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA200810065810XA Pending CN101241656A (en) | 2008-03-11 | 2008-03-11 | Computer assisted training method for mouth shape recognition capability |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101241656A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751809A (en) * | 2010-02-10 | 2010-06-23 | 长春大学 | Deaf children speech rehabilitation method and system based on three-dimensional head portrait |
| CN103890825A (en) * | 2011-09-01 | 2014-06-25 | 斯碧奇弗斯股份有限公司 | Systems and methods for language learning |
| CN104537926A (en) * | 2014-12-01 | 2015-04-22 | 上海交通大学 | Auxiliary system and method for speech training of hearing-impaired children |
| CN105070118A (en) * | 2015-07-30 | 2015-11-18 | 广东小天才科技有限公司 | Method of correcting pronunciation aiming at language class learning and device of correcting pronunciation aiming at language class learning |
| CN105761559A (en) * | 2016-04-29 | 2016-07-13 | 东北电力大学 | Reversely resonant foreign language learning method based on strongest first impressions |
| CN107831684A (en) * | 2016-09-16 | 2018-03-23 | 天津思博科科技发展有限公司 | Using the shape of the mouth as one speaks pronunciation transposition of realizing of Robot Vision |
| CN107864353A (en) * | 2017-11-14 | 2018-03-30 | 维沃移动通信有限公司 | A kind of video recording method and mobile terminal |
| CN109389873A (en) * | 2017-08-08 | 2019-02-26 | 育远管理亚太私人有限公司 | Computer system and by computer implemented training system |
-
2008
- 2008-03-11 CN CNA200810065810XA patent/CN101241656A/en active Pending
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751809A (en) * | 2010-02-10 | 2010-06-23 | 长春大学 | Deaf children speech rehabilitation method and system based on three-dimensional head portrait |
| CN101751809B (en) * | 2010-02-10 | 2011-11-09 | 长春大学 | Deaf children speech rehabilitation method and system based on three-dimensional head portrait |
| CN103890825A (en) * | 2011-09-01 | 2014-06-25 | 斯碧奇弗斯股份有限公司 | Systems and methods for language learning |
| CN104537926A (en) * | 2014-12-01 | 2015-04-22 | 上海交通大学 | Auxiliary system and method for speech training of hearing-impaired children |
| CN105070118A (en) * | 2015-07-30 | 2015-11-18 | 广东小天才科技有限公司 | Method of correcting pronunciation aiming at language class learning and device of correcting pronunciation aiming at language class learning |
| CN105761559A (en) * | 2016-04-29 | 2016-07-13 | 东北电力大学 | Reversely resonant foreign language learning method based on strongest first impressions |
| CN107831684A (en) * | 2016-09-16 | 2018-03-23 | 天津思博科科技发展有限公司 | Using the shape of the mouth as one speaks pronunciation transposition of realizing of Robot Vision |
| CN109389873A (en) * | 2017-08-08 | 2019-02-26 | 育远管理亚太私人有限公司 | Computer system and by computer implemented training system |
| US10957210B2 (en) | 2017-08-08 | 2021-03-23 | Education Index Management Asia Pacific Pte. Ltd. | Language-adapted user interfaces |
| CN109389873B (en) * | 2017-08-08 | 2021-08-24 | 育远管理亚太私人有限公司 | Computer system and computer-implemented training system |
| CN107864353A (en) * | 2017-11-14 | 2018-03-30 | 维沃移动通信有限公司 | A kind of video recording method and mobile terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Quinto-Pozos | Teaching American Sign Language to hearing adult learners | |
| US7052278B2 (en) | Automated language acquisition system and method | |
| Liu et al. | Learning a tonal language by attending to the tone: An in vivo experiment | |
| CN101241656A (en) | Computer assisted training method for mouth shape recognition capability | |
| Zhan et al. | The role of technology in teaching and learning Chinese characters | |
| CN109147422B (en) | English learning system and comprehensive learning method thereof | |
| Wang et al. | Literacy instruction in primary level deaf education in China | |
| Wald | Creating accessible educational multimedia through editing automatic speech recognition captioning in real time | |
| Fauzi et al. | COLLEGE STUDENTS’PERCEPTIONS ON USING MOVIES FOR VOCABULARY LEARNING | |
| Yang | Sign language and oral/written language in deaf education in China | |
| Leah | Pronunciation instruction: A review of methods and techniques | |
| Ruddick et al. | The influence of near peer role models (NPRMs) in second language classrooms intended to improve students’ pronunciation when teacher intervention is not enough | |
| Lin | Chinese-speaking learners' cognitive comprehension problems with English video-based materials | |
| Munro et al. | Phonetics and second language teaching research | |
| Abdullah et al. | A prolonged dilemma: Traditional curriculum of Arabic Rhetoric (Balaghah) in Malaysia | |
| Motamedi et al. | Language development beyond the here-and-now: iconicity and displacement in child-directed communication | |
| Abufanas | Computer aided language learning system for Arabic for second language learners | |
| Liu | Chinese students' awareness of functions in their learning of spoken English | |
| Ismagilova | Increasing motivation to learn a foreign language by using videos in school | |
| Huang et al. | Effects of Bilingual Videos in National Innovation Project in College English Listening Teaching Under the Influences of Multi-modal Theory | |
| Jiang et al. | A meta‐analysis of training effects on English phonological awareness and reading in native Chinese speakers | |
| Zhuhadar et al. | A universal design infrastructure for multimodal presentation of materials in STEM programs: universal design | |
| US20040166479A1 (en) | System and method for language learning through listening and typing | |
| Chen | Research on Multidimensional Teaching Practice of EFL Students’ English Vocabulary From the Perspective of Educational Information Technology | |
| Fan | Teaching Chinese Characters to Chinese as a Second Language Learning Beginners with a Modified Approach |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20080813 |