CN101739870A - Interactive language learning system and method - Google Patents

Interactive language learning system and method Download PDF

Info

Publication number
CN101739870A
CN101739870A CN200910188702A CN200910188702A CN101739870A CN 101739870 A CN101739870 A CN 101739870A CN 200910188702 A CN200910188702 A CN 200910188702A CN 200910188702 A CN200910188702 A CN 200910188702A CN 101739870 A CN101739870 A CN 101739870A
Authority
CN
China
Prior art keywords
module
pronunciation
rhythm
mistake
learner
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN200910188702A
Other languages
Chinese (zh)
Other versions
CN101739870B (en
Inventor
王岚
李崇国
陈金玉
蒙美玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN2009101887026A priority Critical patent/CN101739870B/en
Publication of CN101739870A publication Critical patent/CN101739870A/en
Application granted granted Critical
Publication of CN101739870B publication Critical patent/CN101739870B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Electrically Operated Instructional Devices (AREA)

Abstract

The invention relates to an interactive language learning system and an interactive language learning method. A core module of the interactive language learning system comprises a feature extraction module, a voice recognition module, a pronunciation evaluation module, a rhythm detection module and a rhythm evaluation module, all of which form a pronunciation and rhythm detection module. The interactive language learning system can judge and feed back the voice input of a learner in real time, so that the learner can accurately know specific pronunciation errors, and provide the memory content by combining the feedback result and the dynamic memory curve. Therefore, the learner can improve the language level gradually and form an interactive learning style.

Description

Interacting language learning system and interacting language learning method
[technical field]
The present invention relates to a kind of interacting language learning system and interacting language learning method.
[background technology]
Language learning is one of very important part during people gain knowledge.Also there is increasing people to rely on the language learning aid to improve the speed and the efficient of language learning.Abundant learning content, interactive interactive mode, personalized course, the aspect such as to be convenient to operate be the inexorable trend of the development of langue leaning system.
Dictionary essence is a kind of assisted learning system, and it only is media with the literal, though helpful on reading and writing, can not play direct help for listening and speaking.Along with the continuous development of technology such as computing machine, multimedia, voice, can the assistant learning system that aspects such as listening, speaking, reading and writing have to a certain degree or part is supported be continued to bring out.From the appearance of e-dictionary, reading following machine finally, point reader, and some learning softwares are enriched the form of assisted learning system and function such as the appearance of hearing, writing software etc. gradually.
But the weak point of these systems is the part supports that only realized listening, speaking, reading and writing, each link of language learning is not organically combined, and lacks real-time false judgment and feedback, and the learner is just accepting passively.Wherein have system, but it finally gives learner's just mark or rank to voice quality evaluation and test, and the difficult tool accuracy of this mark and authority.The more important thing is, the learner is concerned about be own pronunciation concrete mistake, which place is wrong, still this evaluating pronunciation system is difficult to provide the result that the learner wants, and does not tell how the learner corrects a mistake.
Therefore, there is defective in prior art, needs to improve.
[summary of the invention]
In view of this, be necessary the interacting language learning system and the interacting language learning method that the real-time feedback learning error situation of a kind of energy are provided and have interactive exercise and interactive memory at the problems referred to above.
A kind of interacting language learning system comprises: voice acquisition module is used to gather learner's speech data; Pronunciation and prosody detection module are used for extracting the characteristic parameter that is used to pronounce with rhythm error-detecting from speech data, and to the degree that mistake is further judged and controlled wrong demonstration, obtain final phoneme mistake and rhythm mistake; Data storage and statistical module are used to write down described phoneme mistake and rhythm mistake, and give overall assessment in conjunction with these mistakes to learner's pronunciation situation, and evaluation result is fed back to interactive module; Interactive module comprises display interface, and described display interface is used to show phoneme mistake and rhythm mistake, learner the pronounce overall assessment and the help options of situation, and the pronunciation prompting is provided.
Preferably, described pronunciation and prosody detection module comprise: characteristic extracting module is used for extracting the characteristic parameter that is used to pronounce with rhythm error-detecting from described speech data; Sound identification module, is discerned described characteristic parameter in conjunction with language model or speech network based on acoustic model, obtains word sequence, aligned phoneme sequence, corresponding time border, likelihood probability value respectively; The pronunciation evaluation module is used for the aligned phoneme sequence that identification is obtained and the reference phoneme of system and compares alignment, obtains phoneme mistake and help options; Prosody detection module is used in conjunction with characteristic parameter, aligned phoneme sequence, time boundary information, adopts statistical model to obtain word and reads pattern, whole sentence intonation and time rhythm again; Rhythm evaluation module is used for reading word again pattern, whole sentence intonation and time rhythm with comparing with reference to pronunciation, obtains rhythm mistake and help options.
Preferably, the speech data of described voice acquisition module collection comprises that the pronunciation prompting that system is provided follow the speech data of reading and obtaining in a minute according to the sight that pronounces.
Preferably, described pronunciation evaluation module at first uses the method for statistics to carry out the differentiation of word level content in conjunction with described word sequence, aligned phoneme sequence, time border and likelihood probability value, if content is inconsistent, the system log (SYSLOG) content false, and the whole sentence of prompting content is undesirable in described interactive module, and the request learner re-enters voice; Otherwise phoneme is detected, obtain the phoneme mistake, comprise insertion, deletion, the replacement mistake of phoneme in the word.
Preferably, pattern read again in described word is that unit is judged with the syllable, comprises the position of main stressed syllable in the word and the position of time stressed syllable; Described whole sentence intonation is the sentence stress of whole word, i.e. the position of stressed syllable in this sentence, and it reflects whole fundamental frequency variation tendency based on syllable and intonation; Described time rhythm is the judgement to speed of speaking and duration.
Preferably, pronunciation text, the target learning content that this pronunciation text is the learner are adopted in the pronunciation of described interactive module prompting; Or adopt with reference to pronunciation, this is the received pronunciation that the people sent out of target language country with reference to pronunciation; Again or adopt the pronunciation sight, this pronunciation sight is the sight that system provides, and requires the learner according to this pronunciation sight in a minute.
Preferably, described interactive module also comprises inputting interface, and described inputting interface is used to select memory pattern, learning content or logs off; Described display interface also is used for the display system feedack, comprises audio frequency and spelling information and described data storage and statistical module feedack; Described interactive module is selected the language learning material, by audio frequency or text mode the learner is pointed out, audio prompt is the pronunciation that system provides needs memory, the requirement learner spells and follows and read, the spelling prompting is the text prompt that system provides the spelling content that needs memory, require the learner to spell, obtain spelling content; Described interacting language learning system also comprises text collection module and text spelling detection module, and described text collection module is used to gather described spelling content, obtains input text; Described text spelling detection module is used to check input text, by calculating the similarity editing distance of input text and model answer text, obtains misspelling; Described data storage and statistical module also are used to write down described misspelling; Described data storage and statistical module also wrap and expand a database, and concrete error statistics situation will be write this database in time, and this database is not only stored learning records, but also has stored learning content; System is according to the learning content of storing in the memory pattern of current error logging, selection and the database, select and produce new learning content and audio frequency and spelling prompting, feed back to described interactive module, thereby enter the interactive learning of next round, perhaps reselect learning content, or log off according to current study schedule.
Preferably, described misspelling comprises alternative, insertion and deletion error.
Preferably, described interactive module also is used to show the session operational scenarios of a group task form, after selected certain session operational scenarios of this interactive module, the subtask will occur, the information that the learner will provide according to this interactive module is carried out interactive operation and is pronounced and spell and finish the work; Described interacting language learning system also comprises user interface, operation discrimination module; Described user interface is used to gather described interactive operation; Described operation discrimination module is used to judge whether described interactive operation meets mission requirements, obtains operating mistake; Described data storage and statistical module also are used to write down described operating mistake, and described database has also been stored the information relevant with dialogue; Described interacting language learning system also comprises the session operational scenarios module, and error statistics and the information relevant with dialogue according to described data storage and statistical module output dynamically generate new session operational scenarios, and shows by described interactive module; The learner can select to enter new round study by described interactive module, perhaps withdraws from study.
Preferably, the implementation of described interacting language learning system be client/server approach, browser/server mode, a kind of based in the single cpu mode of embedded system.
A kind of interacting language learning method comprises: gather the speech data that the requirement of learner's follow procedure pronounces to obtain; From speech data, extract the characteristic parameter that is used to pronounce with rhythm error-detecting; Based on acoustic model, in conjunction with language model or speech network, characteristic parameter is discerned, obtain word sequence, aligned phoneme sequence, corresponding time border, likelihood probability value respectively; The reference phoneme of aligned phoneme sequence and system is compared alignment, obtain phoneme mistake and help options; In conjunction with characteristic parameter, aligned phoneme sequence, time boundary information, adopt statistical model to obtain word and read pattern, whole sentence intonation and time rhythm again; Read word again pattern, whole sentence intonation and time rhythm with comparing, obtain rhythm mistake and help options with reference to pronunciation; Show phoneme, rhythm mistake, the overall assessment and the help options of pronunciation situation, and the pronunciation prompting is provided.
Preferably, further comprising the steps of: before gathering speech data, the memory material of output audio or text mode requires the learner to pronounce and spells; Gather the spelling content that needs memory, obtain input text; Check input text, obtain misspelling; Carry out error statistics according to the phoneme that obtains, the rhythm and misspelling, write down concrete phoneme mistake, rhythm mistake and misspelling situation, and provide evaluation score and feedback information; Show and estimate score and feedback information; Receive the instruction of selecting memory pattern, learning content or quitting a program.
Preferably, further comprising the steps of: show session operational scenarios, the learner by the session operational scenarios requirement pronounce, spelling and interactive operation; Gather interactive operation; Judge that whether interactive operation meets mission requirements, obtains operating mistake; Carry out error statistics according to the phoneme that obtains, the rhythm, spelling and operating mistake, write down concrete phoneme pronunciation, the rhythm, spelling and operating mistake situation, and provide evaluation score and feedback; Dynamically generate new session operational scenarios, and show.
The real-time phonetic entry with the learner of above-mentioned interacting language learning system energy is judged and is fed back, learner's input audio frequency is carried out the rhythm detection of the utterance detection and the word level of phone-level, make the learner can accurately hold oneself the pronunciation concrete wrong part, and dynamically provide the memory content in conjunction with feedback result and memory curve, make the raising language proficiency that the learner can be incremental, form a kind of interactively mode of learning.
[description of drawings]
Fig. 1 is the synoptic diagram of interacting language learning system first embodiment.
Fig. 2 is the synoptic diagram of pronunciation and prosody detection module.
Fig. 3 is the synoptic diagram of interacting language learning system second embodiment.
Fig. 4 is the synoptic diagram of interacting language learning system the 3rd embodiment.
[embodiment]
Below in conjunction with accompanying drawing,, will make technical scheme of the present invention and other beneficial effects apparent by detailed description to the specific embodiment of the present invention.
Fig. 1 is the synoptic diagram of interacting language learning system first embodiment.Interacting language learning system comprises the two large divisions, promptly user oriented user side 11 and the data processing end 12 that carries out background process.User side 11 provides equipment and the display interface of gathering learner's behavior, comprises voice acquisition module 112, interactive module 111; Data processing end 12 is responsible for display message is handled and generated to the data that user side 11 is gathered, and comprises pronunciation and prosody detection module 121, data storage and statistical module 122.
Voice acquisition module 112 is used to gather learner's speech data.At first need to carry out silence detection for the voice that collect, it is by calculating audio frequency characteristics, whether for example energy (Energy), zero-crossing rate (ZeroCrossing Rate) etc. judge whether phonetic entry or input is quiet etc., do not have phonetic entry or quiet if differentiate, will require to gather again voice.
Pronunciation and prosody detection module 121 are used for extracting the characteristic parameter that is used to pronounce with rhythm error-detecting from speech data, and to the degree that mistake is further judged and controlled wrong demonstration, obtain final phoneme mistake and rhythm mistake.
Data storage and statistical module 122 recorded content mistakes, phoneme mistake and rhythm mistake, and give overall assessment to learner's pronunciation situation in conjunction with these mistakes, evaluation result is fed back to interactive module 111.
Interactive module 111 is used for this content, phoneme, rhythm mistake, and the overall assessment and the help options of pronunciation situation are shown to the learner, and the pronunciation prompting that comprises pronunciation text, reference pronunciation or pronunciation sight is provided.The target learning content that this pronunciation text is the learner is as word, phrase or sentence; This is the received pronunciation that the people sent out of target language country with reference to pronunciation; This pronunciation sight is the sight that system provides, and for example on the way runs into friend and greets to it, requires the learner to speak according to this sight.
Fig. 2 is the synoptic diagram of pronunciation and prosody detection module.Pronunciation and prosody detection module 121 comprise characteristic extracting module 202, sound identification module 203, pronunciation evaluation module 204, prosody detection module 205, rhythm evaluation module 206.
202 pairs of speech datas of characteristic extracting module extract the characteristic parameter that is used to pronounce with rhythm error-detecting, perception linear forecasting parameter PLP (Perceptual Linear Prediction coefficients) for example, Mel cepstrum coefficient MFCC (Mel-frequency cepstral coefficients), frame average energy (Energy), it is the energy of all frames of crossing over of vowel, the average fundamental frequency of frame (Pitch), it is the fundamental frequency of all frames of crossing over of vowel and to be crossed over frame number by it average, and their front and back comprise that to differential parameter the forward frame average energy is poor, the back is poor to the frame average energy, forward direction consonant frame average energy is poor, the average fundamental frequency of forward frame is poor, the back is poor to the average fundamental frequency of frame, the forward direction duration is poor, the back is to the duration difference etc.
Sound identification module 203 is based on acoustic model, and in conjunction with language model or speech network, characteristic parameter discerned, and obtains sequence, time corresponding border and the corresponding likelihood probability value (likelihood) of word level and phone-level respectively.Can use acoustic model and a pronunciation dictionary based on hidden Markov model (HMM, HiddenMarkov Model).Its acoustic model is to use the people (Native Speakers) that collected target language country to cover the voice of all phonemes and trains and obtains; Pronunciation dictionary has not only comprised correct pronunciation, has also comprised possible incorrect pronunciations simultaneously.Its language model or speech network are the statistical models at the word level probability of happening.With the speech data of reading to import, sound identification module 203 can use the pressure alignment schemes for the learner, and the combining with pronunciation text is discerned, and obtains word sequence and aligned phoneme sequence, and time border and likelihood probability value; For the learner according to require the to speak speech data of input of sight, sound identification module can the bluebeard compound network or language model decode, obtain word sequence and aligned phoneme sequence, and the time border.
Pronunciation evaluation module 204 at first uses the method for statistics to carry out the differentiation of word level content in conjunction with the input of sound identification module 203.If judge by the pronunciation prompting different with the word sequence of reference pronunciation with the speech data of reading to obtain, perhaps different with the model answer content by the speech data that obtains in a minute of pronunciation sight, to can not carry out the judgement of phone-level, and directly enter data storage and statistical module 122, the recorded content mistake, and the whole sentence of prompting content is undesirable in interactive module 111, and the request user re-enters voice; Otherwise use character string alignment algorithm, dynamic programming algorithm (Dynamic Programming Algorithm) for example, compare alignment and pronounce to estimate by the reference phoneme that aligned phoneme sequence and system are provided according to the feedback error precision of setting, obtain the phoneme mistake, comprise the insertion (Insertion) of phoneme in the word, deletion (Deletion) and replacement (Substitution) three class mistakes, and help options.
Prosody detection module 205 comprises that the word accent pattern (Lexical stress) of word level detects, the rhythm (Prosody) detects, its result, be aligned phoneme sequence, time corresponding boundary information, likelihood probability value in conjunction with sound identification module 203, with the average fundamental frequency information of frame average energy, frame that characteristic extracting module 202 obtains, pattern, whole sentence intonation and time rhythm situation read again in the word that the statistical model that provides according to system obtains in the speech data sentence.This statistical model can be the supporting vector machine model (SVM, Support Vector Machine) that obtains by training, perhaps neural network (Neural Network), perhaps hidden Markov model (HMM, Hidden Markov Model) etc.; Pattern read again in this word is that unit is judged with the syllable, comprises the position of main stressed syllable in the word and the position of time stressed syllable; This whole sentence intonation is the sentence stress of whole word, i.e. the position of stressed syllable in this sentence is based on whole fundamental frequency variation tendency of syllable and intonation; This time rhythm is the speed in a minute and the judgement of duration aspect.
Rhythm evaluation module 206 is read this word again pattern, whole sentence intonation and time rhythm with comparing with reference to pronunciation, and obtain word according to the feedback error accuracy requirement of setting and read the error situation of pattern again and corrects helps, and rhythm error situation and help options such as whole stressed syllable, whole tone and rhythm.
Fig. 3 is the synoptic diagram of interacting language learning system second embodiment.The text spelling detection module 123 that the difference of itself and first embodiment has been to increase the text collection module 113 that belongs to user side 11 and has belonged to data processing end 12, and will do corresponding expansion with the function of the direct-connected interactive module 111 of these two modules and data storage and statistical module 122.
Interactive module 111 comprises a display interface and an inputting interface.Display interface is used for the information that display system feeds back to the learner, comprises audio frequency and spelling information, data storage and statistical module 122 feedacks etc.Inputting interface is used to select memory pattern, learning content or logs off etc.Interactive module 111 is according to the language learning material that the learner selects or system is selected automatically, and such as word, phrase or a text chunk, the purpose at the language memory offers the learner by text or audio frequency mode.Audio prompt is the pronunciation that system provides needs memory, and requires the learner to spell and follow to read; Spelling prompting is the spelling content that system provides needs memory, such as the subalphbet of a word, and the perhaps part word of a sentence.The learner spells, reads simultaneously the content of needs memory according to prompting, thereby remembers simultaneously in pronunciation and spelling.
Text collection module 113 is used to gather the content of the needs memory of learner's spelling, obtains input text.
Text spelling detection module 123 is used to check input text, by calculating the similarity editing distance (Levenshtein distance) of input text and model answer text, obtain concrete alternative (Substitution), insert (Insertion), delete misspellings such as (Deletion).
Data storage and statistical module 122 carry out error statistics according to the voice mistake and the misspelling that obtain, recording learning person's concrete phoneme pronunciation mistake, rhythm mistake and misspelling situation, and provide evaluation score and feedback, show by interactive module 111.Data storage and statistical module 122 comprise a database, and concrete error statistics situation will be write this database in time; This database has not only been stored learner's learning records, but also has stored learning content, comprises corresponding multimedia messages and model answer etc.; System selects and produces new learning content and audio frequency and spelling prompting, thereby enter the interactive mode memory of next round according to the learning content of storing in the memory pattern of active user's mistake, selection and the database.The learner also can reselect learning content according to current study schedule, perhaps withdraws from this subsystem.
Fig. 4 is the synoptic diagram of interacting language learning system the 3rd embodiment.The key distinction of itself and second embodiment has been to increase the user interface 114 that belongs to user side 11 and has belonged to operation discrimination module 124, the session operational scenarios module 125 of data processing end 12, and will do corresponding expansion with the function of the direct-connected interactive module 111 of these three modules and data storage and statistical module 122.The 3rd embodiment of interacting language learning system combines language memory and dialogue (Dialogue), listening, speaking, reading and writing four key elements during fully practice language is learnt, and combine the utilization of learning language in the specific occasion by the mode of dialogue with specific scene.
Interactive module 111 is interface equipments towards the learner, is used for showing the session operational scenarios of a group task form to the learner, such as ask the way, buy vegetables, the scene of various use language such as tourism finishes the task of system's appointment; When the learner by this module after selected certain session operational scenarios, will successively occur dialogue, spelling, with read, subtask such as selection, the information that the learner provides according to session operational scenarios is carried out interactive operation, input voice and text message and is finished the work.
User interface 114 is used to gather the interactive operation of learner and system, for example with keyboard come controlling party to or use mouse to select, obtain that concrete learner internally holds or the selection of answer.
Operation discrimination module 124 is used to judge whether learner's interactive operation meets mission requirements, obtains operating mistake.
Data storage and statistical module 122 carry out error statistics according to the voice mistake, misspelling and the operating mistake that obtain, recording learning person's concrete phoneme pronunciation mistake, rhythm mistake, misspelling and operating mistake situation, and provide the evaluation score, show by interactive module 111.Data storage and statistical module 122 comprise a database, and concrete error statistics situation will be write this database in time; This database has not only been stored learner's learning records, has also stored learning content, comprises corresponding multimedia messages and model answer etc., and has stored the information relevant with dialogue, such as session operational scenarios information, mission bit stream etc.
Session operational scenarios module 125 is according to the error statistics situation of data storage and statistical module 122 outputs and session operational scenarios, mission bit stream, dynamically generate new session operational scenarios, and be shown to the learner by interactive module 111, the learner can select to enter the study of new round session operational scenarios by interactive module 111, perhaps selects to withdraw from study.
Above-mentioned interacting language learning system has multiple implementation, for example based on network client/server (Client/Server) mode, based on network browser/server (Browser/Server) mode, based on single cpu mode of embedded system or the like.
Based on network client, server mode: its client is learner's access terminal, phonetic entry, text input, voice playing and mouse-keyboard operation are provided, and the input audio frequency is finished functions such as silence detection, feature extraction and Network Transmission, session operational scenarios generation, and its server end is finished functions such as the incorrect pronunciations detection of input voice, word accent mode detection, rhythm detection, spell check, error feedback, help options feedback, the generation of session operational scenarios content, database manipulation, learning information statistics, Network Transmission.
Based on network browser, server mode: its browser is learner's access terminal, phonetic entry is provided, the text input, voice playing, the mouse-keyboard operation, Network Transmission, session operational scenarios, and by plug-in unit (Plug-in) finish to the input audio frequency finish operations such as silence detection and feature extraction, its server comprises data processing server and Web server, wherein the data server end is finished the incorrect pronunciations detection to the input voice, the word accent mode detection, the rhythm detects, spell check, error feedback, the help options feedback, conversation content generates, database manipulation, the learning information statistics, functions such as Network Transmission, wherein Web server is the access server of browser, carries out direct data transmission between browser and the data processing server.
Unit mode based on embedded system: mode detection, rhythm detection, spell check, error feedback, conversation content generation, database manipulation, learning information statistics etc. read again in incorrect pronunciations detection and the word of finishing phonetic entry, text input, voice playing, audio mute detection, audio feature extraction, input voice in a program frame.
Above-mentioned interacting language learning system has made up a kind of interacting language learning platform, make listening, speaking, reading and writing four key elements in the abundant practice language study of learner, each link of language learning is organically combined, provide the high scene dialogue study form of degree of freedom to improve learner's interest, the enthusiasm of transferring the learner initiatively participates in the middle of the study it, and provides real-time false judgment and feedback.
Above-mentioned interacting language learning system detects and the rhythm (Prosody) detection the incorrect pronunciations (Mispronunciation) that learner's input audio frequency carries out real-time phone-level (Phone-level), and the rhythm detects the word accent pattern (Lexical stress) that comprises word level and detects and correct help, the rhythm (Prosody) detection and imitate help; Wherein the incorrect pronunciations of phone-level detects the input voice is carried out the speech recognition of phone-level, and points out the concrete phoneme that it makes a mistake; Wherein the word accent mode detection of word level and the aligned phoneme sequence that correct to help the detection according to phone-level to obtain are carried out the identification of word level, identify the word stress pattern of word and provide the error type that compares with correct word stress pattern; Wherein rhythm detection and imitation help to comprise the sentence stressed (Sentence Stress) to the pronunciation statement, rhythm (Rhythm), the contrast of the rhythm of the check and analysis of intonation aspects such as (Intonation) and the statement of Received Pronunciation is differentiated, and is given in evaluation and and the help options of imitation Received Pronunciation statement on the rhythm.Make the learner can accurately hold oneself the pronunciation concrete wrong part.And dynamically provide the memory content in conjunction with feedback result and memory curve, make the raising language proficiency that the learner can be incremental.
The above embodiment has only been expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.

Claims (13)

1. an interacting language learning system is characterized in that, comprising:
Voice acquisition module is used to gather learner's speech data;
Pronunciation and prosody detection module are used for extracting the characteristic parameter that is used to pronounce with rhythm error-detecting from speech data, and to the degree that mistake is further judged and controlled wrong demonstration, obtain final phoneme mistake and rhythm mistake;
Data storage and statistical module are used to write down described phoneme mistake and rhythm mistake, and give overall assessment in conjunction with these mistakes to learner's pronunciation situation, and evaluation result is fed back to interactive module;
Interactive module comprises display interface, and described display interface is used to show phoneme mistake and rhythm mistake, learner the pronounce overall assessment and the help options of situation, and the pronunciation prompting is provided.
2. interacting language learning system according to claim 1 is characterized in that, described pronunciation and prosody detection module comprise:
Characteristic extracting module is used for extracting the characteristic parameter that is used to pronounce with rhythm error-detecting from described speech data;
Sound identification module, is discerned described characteristic parameter in conjunction with language model or speech network based on acoustic model, obtains word sequence, aligned phoneme sequence, corresponding time border, likelihood probability value respectively;
The pronunciation evaluation module is used for the aligned phoneme sequence that identification is obtained and the reference phoneme of system and compares alignment, obtains phoneme mistake and help options;
Prosody detection module is used in conjunction with characteristic parameter, aligned phoneme sequence, time boundary information, adopts statistical model to obtain word and reads pattern, whole sentence intonation and time rhythm again;
Rhythm evaluation module is used for reading word again pattern, whole sentence intonation and time rhythm with comparing with reference to pronunciation, obtains rhythm mistake and help options.
3. interacting language learning system according to claim 2 is characterized in that: the speech data of described voice acquisition module collection comprises that the pronunciation prompting that system is provided follow the speech data of reading and obtaining in a minute according to the sight that pronounces.
4. interacting language learning system according to claim 2, it is characterized in that: described pronunciation evaluation module at first uses the method for statistics to carry out the differentiation of word level content in conjunction with described word sequence, aligned phoneme sequence, time border and likelihood probability value, if content is inconsistent, the system log (SYSLOG) content false, and the whole sentence of prompting content is undesirable in described interactive module, and the request learner re-enters voice; Otherwise phoneme is detected, obtain the phoneme mistake, comprise insertion, deletion, the replacement mistake of phoneme in the word.
5. interacting language learning system according to claim 2 is characterized in that: pattern read again in described word is that unit is judged with the syllable, comprises the position of main stressed syllable in the word and the position of time stressed syllable; Described whole sentence intonation is the sentence stress of whole word, i.e. the position of stressed syllable in this sentence, and it reflects whole fundamental frequency variation tendency based on syllable and intonation; Described time rhythm is the judgement to speed of speaking and duration.
6. interacting language learning system according to claim 1 is characterized in that: pronunciation text, the target learning content that this pronunciation text is the learner are adopted in the pronunciation prompting of described interactive module; Or adopt with reference to pronunciation, this is the received pronunciation that the people sent out of target language country with reference to pronunciation; Again or adopt the pronunciation sight, this pronunciation sight is the sight that system provides, and requires the learner according to this pronunciation sight in a minute.
7. interacting language learning system according to claim 1 is characterized in that: described interactive module also comprises inputting interface, and described inputting interface is used to select memory pattern, learning content or logs off; Described display interface also is used for the display system feedack, comprises audio frequency and spelling information and described data storage and statistical module feedack; Described interactive module is selected the language learning material, by audio frequency or text mode the learner is pointed out, audio prompt is the pronunciation that system provides needs memory, the requirement learner spells and follows and read, the spelling prompting is the text prompt that system provides the spelling content that needs memory, require the learner to spell, obtain spelling content;
Described interacting language learning system also comprises text collection module and text spelling detection module, and described text collection module is used to gather described spelling content, obtains input text; Described text spelling detection module is used to check input text, by calculating the similarity editing distance of input text and model answer text, obtains misspelling;
Described data storage and statistical module also are used to write down described misspelling; Described data storage and statistical module also wrap and expand a database, and concrete error statistics situation will be write this database in time, and this database is not only stored learning records, but also has stored learning content; System is according to the learning content of storing in the memory pattern of current error logging, selection and the database, select and produce new learning content and audio frequency and spelling prompting, feed back to described interactive module, thereby enter the interactive learning of next round, perhaps reselect learning content, or log off according to current study schedule.
8. interacting language learning system according to claim 7 is characterized in that: described misspelling comprises alternative, insertion and deletion error.
9. interacting language learning system according to claim 8, it is characterized in that: described interactive module also is used to show the session operational scenarios of a group task form, after selected certain session operational scenarios of this interactive module, the subtask will appear, the information that the learner will provide according to this interactive module is carried out interactive operation and is pronounced and spell and finish the work;
Described interacting language learning system also comprises user interface, operation discrimination module; Described user interface is used to gather described interactive operation; Described operation discrimination module is used to judge whether described interactive operation meets mission requirements, obtains operating mistake;
Described data storage and statistical module also are used to write down described operating mistake, and described database has also been stored the information relevant with dialogue;
Described interacting language learning system also comprises the session operational scenarios module, and error statistics and the information relevant with dialogue according to described data storage and statistical module output dynamically generate new session operational scenarios, and shows by described interactive module; The learner can select to enter new round study by described interactive module, perhaps withdraws from study.
10. interacting language learning system according to claim 1 is characterized in that: the implementation of described interacting language learning system is client/server approach, browser/server mode, a kind of based in the single cpu mode of embedded system.
11. an interacting language learning method comprises:
Gather the speech data that the requirement of learner's follow procedure pronounces to obtain;
From speech data, extract the characteristic parameter that is used to pronounce with rhythm error-detecting;
Based on acoustic model, in conjunction with language model or speech network, characteristic parameter is discerned, obtain word sequence, aligned phoneme sequence, corresponding time border, likelihood probability value respectively;
The reference phoneme of aligned phoneme sequence and system is compared alignment, obtain phoneme mistake and help options;
In conjunction with characteristic parameter, aligned phoneme sequence, time boundary information, adopt statistical model to obtain word and read pattern, whole sentence intonation and time rhythm again;
Read word again pattern, whole sentence intonation and time rhythm with comparing, obtain rhythm mistake and help options with reference to pronunciation;
Show phoneme, rhythm mistake, the overall assessment and the help options of pronunciation situation, and the pronunciation prompting is provided.
12. interacting language learning method according to claim 11 is characterized in that, and is further comprising the steps of:
Before gathering speech data, the memory material of output audio or text mode requires the learner to pronounce and spells;
Gather the spelling content that needs memory, obtain input text;
Check input text, obtain misspelling;
Carry out error statistics according to the phoneme that obtains, the rhythm and misspelling, write down concrete phoneme mistake, rhythm mistake and misspelling situation, and provide evaluation score and feedback information;
Show and estimate score and feedback information;
Receive the instruction of selecting memory pattern, learning content or quitting a program.
13. interacting language learning method according to claim 12 is characterized in that, and is further comprising the steps of:
Show session operational scenarios, the learner by the session operational scenarios requirement pronounce, spelling and interactive operation;
Gather interactive operation;
Judge that whether interactive operation meets mission requirements, obtains operating mistake;
Carry out error statistics according to the phoneme that obtains, the rhythm, spelling and operating mistake, write down concrete phoneme pronunciation, the rhythm, spelling and operating mistake situation, and provide evaluation score and feedback;
Dynamically generate new session operational scenarios, and show.
CN2009101887026A 2009-12-03 2009-12-03 Interactive language learning system and method Active CN101739870B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009101887026A CN101739870B (en) 2009-12-03 2009-12-03 Interactive language learning system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009101887026A CN101739870B (en) 2009-12-03 2009-12-03 Interactive language learning system and method

Publications (2)

Publication Number Publication Date
CN101739870A true CN101739870A (en) 2010-06-16
CN101739870B CN101739870B (en) 2012-07-04

Family

ID=42463295

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009101887026A Active CN101739870B (en) 2009-12-03 2009-12-03 Interactive language learning system and method

Country Status (1)

Country Link
CN (1) CN101739870B (en)

Cited By (67)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682768A (en) * 2012-04-23 2012-09-19 天津大学 Chinese language learning system based on speech recognition technology
CN103021226A (en) * 2012-11-20 2013-04-03 北京语言大学 Voice evaluating method and device based on pronunciation rhythms
CN103310666A (en) * 2013-05-24 2013-09-18 深圳市九洲电器有限公司 Language learning device
CN103413550A (en) * 2013-08-30 2013-11-27 苏州跨界软件科技有限公司 Man-machine interactive language learning system and method
CN103505313A (en) * 2013-09-24 2014-01-15 泰亿格电子(上海)有限公司 System and method for lalopathy stress intervention on basis of real-time rhythm multi-dimensional modeling
CN103514768A (en) * 2013-10-24 2014-01-15 苏州市思玛特电力科技有限公司 Auxiliary teaching system
CN104299612A (en) * 2014-11-10 2015-01-21 科大讯飞股份有限公司 Method and device for detecting imitative sound similarity
CN104361896A (en) * 2014-12-04 2015-02-18 上海流利说信息技术有限公司 Voice quality evaluation equipment, method and system
CN104361895A (en) * 2014-12-04 2015-02-18 上海流利说信息技术有限公司 Voice quality evaluation equipment, method and system
CN104505103A (en) * 2014-12-04 2015-04-08 上海流利说信息技术有限公司 Voice quality evaluation equipment, method and system
CN104809676A (en) * 2015-05-11 2015-07-29 成都准星云学科技有限公司 Method and device for analyzing mistake type of answer
CN104835366A (en) * 2015-05-07 2015-08-12 肖思俐 Chinese language studying system
CN105139311A (en) * 2015-07-31 2015-12-09 谭瑞玲 Intelligent terminal based English teaching system
CN105162892A (en) * 2015-10-15 2015-12-16 戚克明 Language technique exercise treatment method, apparatus and system, and language technique exercise supervision method
CN105609098A (en) * 2015-12-18 2016-05-25 江苏易乐网络科技有限公司 Internet-based online learning system
CN105679135A (en) * 2016-04-06 2016-06-15 天津飞跃无限科技有限公司 Mobile on-line music level test system and method
CN106448288A (en) * 2016-11-01 2017-02-22 安阳师范学院 Interactive English learning system and method
CN106531182A (en) * 2016-12-16 2017-03-22 上海斐讯数据通信技术有限公司 Language learning system
CN107316638A (en) * 2017-06-28 2017-11-03 北京粉笔未来科技有限公司 A kind of poem recites evaluating method and system, a kind of terminal and storage medium
CN107958673A (en) * 2017-11-28 2018-04-24 北京先声教育科技有限公司 A kind of spoken language methods of marking and device
CN108469947A (en) * 2017-09-25 2018-08-31 杨秀梅 A kind of language breath training device of exceptional child
CN108492641A (en) * 2018-03-26 2018-09-04 贵州西西沃教育科技股份有限公司 A kind of English phonetic learning system
CN108492652A (en) * 2018-03-29 2018-09-04 吴浩东 A kind of English word intelligence spelling memory method and its intelligent realization system
CN108520650A (en) * 2018-03-27 2018-09-11 深圳市神经科学研究院 A kind of intelligent language training system and method
CN108536875A (en) * 2018-06-12 2018-09-14 重庆靖帛天域科技发展有限公司 Language autonomous learning systems based on big data interactive voice
CN108597538A (en) * 2018-03-05 2018-09-28 标贝(北京)科技有限公司 The evaluating method and system of speech synthesis system
CN108630046A (en) * 2018-04-20 2018-10-09 安徽展航信息科技发展有限公司 A kind of welder's electronic multimedia the network teaching platform
CN108648527A (en) * 2018-05-15 2018-10-12 郑州琼佩电子技术有限公司 A kind of pronunciation of English matching correcting method
CN108735220A (en) * 2018-04-11 2018-11-02 四川斐讯信息技术有限公司 A kind of language learning intelligent earphone, intelligent interactive system and man-machine interaction method
WO2018201688A1 (en) * 2017-05-05 2018-11-08 Boe Technology Group Co., Ltd. Microphone, vocal training apparatus comprising microphone and vocal analyzer, vocal training method, and non-transitory tangible computer-readable storage medium
CN108806719A (en) * 2018-06-19 2018-11-13 合肥凌极西雅电子科技有限公司 Interacting language learning system and its method
CN108806367A (en) * 2017-07-21 2018-11-13 河海大学 A kind of Oral English Practice voice correcting system
CN109119064A (en) * 2018-09-05 2019-01-01 东南大学 A kind of implementation method suitable for overturning the Oral English Teaching system in classroom
CN109255988A (en) * 2018-07-11 2019-01-22 北京美高森教育科技有限公司 Interactive learning methods based on incorrect pronunciations detection
CN109272793A (en) * 2018-11-21 2019-01-25 合肥虹慧达科技有限公司 Child interactive reading learning system
CN109410911A (en) * 2018-09-13 2019-03-01 何艳玲 Artificial intelligence learning method based on speech recognition
CN109493658A (en) * 2019-01-08 2019-03-19 上海健坤教育科技有限公司 Situated human-computer dialogue formula spoken language interactive learning method
WO2019075828A1 (en) * 2017-10-20 2019-04-25 深圳市鹰硕音频科技有限公司 Voice evaluation method and apparatus
CN109686383A (en) * 2017-10-18 2019-04-26 腾讯科技(深圳)有限公司 A kind of speech analysis method, device and storage medium
CN109697975A (en) * 2017-10-20 2019-04-30 深圳市鹰硕音频科技有限公司 A kind of Speech Assessment Methods and device
CN109712449A (en) * 2019-03-06 2019-05-03 武汉几古几古科技有限公司 A kind of intellectual education learning system improving child's learning initiative
CN109858014A (en) * 2018-12-10 2019-06-07 西南石油大学 Language message active critique system and its active proofreading method
CN110010123A (en) * 2018-01-16 2019-07-12 上海异构网络科技有限公司 English phonetic word pronunciation learning evaluation system and method
CN110047341A (en) * 2018-01-17 2019-07-23 希格纳姆国际股份有限公司 Scenario language facility for study, system and method
CN110085257A (en) * 2019-03-29 2019-08-02 语文出版社有限公司 A kind of rhythm automated decision system based on the study of national literature classics
CN110136748A (en) * 2019-05-16 2019-08-16 上海流利说信息技术有限公司 A kind of rhythm identification bearing calibration, device, equipment and storage medium
CN110223673A (en) * 2019-06-21 2019-09-10 龙马智芯(珠海横琴)科技有限公司 The processing method and processing device of voice, storage medium, electronic equipment
CN110246484A (en) * 2019-07-19 2019-09-17 山东劳动职业技术学院 A kind of intelligence pronunciation of English self-aid learning system
CN110600052A (en) * 2019-08-19 2019-12-20 天闻数媒科技(北京)有限公司 Voice evaluation method and device
CN110598208A (en) * 2019-08-14 2019-12-20 清华大学深圳研究生院 AI/ML enhanced pronunciation course design and personalized exercise planning method
CN110875032A (en) * 2018-08-31 2020-03-10 国立大学法人京都大学 Voice interaction system, voice interaction method, program, learning model generation device, and learning model generation method
CN110992986A (en) * 2019-12-04 2020-04-10 南京大学 Word syllable stress reading error detection method, device, electronic equipment and storage medium
CN111226222A (en) * 2017-08-03 2020-06-02 语冠信息技术(上海)有限公司 Depth context based syntax error correction using artificial neural networks
CN111599234A (en) * 2020-05-19 2020-08-28 黑龙江工业学院 Automatic English spoken language scoring system based on voice recognition
CN111724635A (en) * 2019-03-18 2020-09-29 云南尚途科技有限公司 Interactive online learning system for multidisciplinary teaching
CN111739527A (en) * 2020-06-01 2020-10-02 广东小天才科技有限公司 Speech recognition method, electronic device and computer readable storage medium
CN111768667A (en) * 2020-07-15 2020-10-13 唐山劳动技师学院 Interactive cycle demonstration method and system for English teaching
CN111968426A (en) * 2020-09-11 2020-11-20 河南农业职业学院 Foreign language teaching equipment based on internet
CN112053020A (en) * 2019-06-06 2020-12-08 兰贵曜威公司 Method, system and equipment for providing man-machine interactive auxiliary language learning
CN112086094A (en) * 2020-08-21 2020-12-15 广东小天才科技有限公司 Method for correcting pronunciation, terminal equipment and computer readable storage medium
CN112309371A (en) * 2019-07-30 2021-02-02 上海流利说信息技术有限公司 Intonation detection method, apparatus, device and computer readable storage medium
CN112307859A (en) * 2019-08-30 2021-02-02 北京字节跳动网络技术有限公司 User language level determination method and device, electronic equipment and medium
CN112349300A (en) * 2020-11-06 2021-02-09 北京乐学帮网络技术有限公司 Voice evaluation method and device
CN112384961A (en) * 2018-06-23 2021-02-19 方正熊猫有限公司 Symbol manipulation educational system and method
CN112541651A (en) * 2019-09-20 2021-03-23 卡西欧计算机株式会社 Electronic device, pronunciation learning method, and server device
CN113470447A (en) * 2021-06-29 2021-10-01 读书郎教育科技有限公司 System and method for assisting in memorizing words
CN116805495A (en) * 2023-08-17 2023-09-26 北京语言大学 Pronunciation deviation detection and action feedback method and system based on large language model

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102800314B (en) * 2012-07-17 2014-03-19 广东外语外贸大学 English sentence recognizing and evaluating system with feedback guidance and method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006133521A (en) * 2004-11-05 2006-05-25 Kotoba No Kabe Wo Koete:Kk Language training machine
CN101292281A (en) * 2005-09-29 2008-10-22 独立行政法人产业技术综合研究所 Pronunciation diagnosis device, pronunciation diagnosis method, recording medium, and pronunciation diagnosis program
JP4716192B2 (en) * 2006-12-27 2011-07-06 日本ビクター株式会社 Language learning system and language learning program
CN101105939B (en) * 2007-09-04 2012-07-18 安徽科大讯飞信息科技股份有限公司 Sonification guiding method
CN101551952A (en) * 2009-05-21 2009-10-07 无敌科技(西安)有限公司 Device and method for evaluating pronunciation

Cited By (86)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682768A (en) * 2012-04-23 2012-09-19 天津大学 Chinese language learning system based on speech recognition technology
CN103021226A (en) * 2012-11-20 2013-04-03 北京语言大学 Voice evaluating method and device based on pronunciation rhythms
CN103310666A (en) * 2013-05-24 2013-09-18 深圳市九洲电器有限公司 Language learning device
CN103413550A (en) * 2013-08-30 2013-11-27 苏州跨界软件科技有限公司 Man-machine interactive language learning system and method
CN103413550B (en) * 2013-08-30 2017-08-29 苏州跨界软件科技有限公司 A kind of man-machine interactive langue leaning system and method
CN103505313B (en) * 2013-09-24 2016-01-06 上海泰亿格康复医疗科技股份有限公司 Speech disorder based on real-time rhythm Conceptual Modeling reads interfering system and method thereof again
CN103505313A (en) * 2013-09-24 2014-01-15 泰亿格电子(上海)有限公司 System and method for lalopathy stress intervention on basis of real-time rhythm multi-dimensional modeling
CN103514768A (en) * 2013-10-24 2014-01-15 苏州市思玛特电力科技有限公司 Auxiliary teaching system
CN104299612B (en) * 2014-11-10 2017-11-07 科大讯飞股份有限公司 The detection method and device of imitative sound similarity
CN104299612A (en) * 2014-11-10 2015-01-21 科大讯飞股份有限公司 Method and device for detecting imitative sound similarity
CN104361896A (en) * 2014-12-04 2015-02-18 上海流利说信息技术有限公司 Voice quality evaluation equipment, method and system
CN104361896B (en) * 2014-12-04 2018-04-13 上海流利说信息技术有限公司 Voice quality assessment equipment, method and system
CN104361895A (en) * 2014-12-04 2015-02-18 上海流利说信息技术有限公司 Voice quality evaluation equipment, method and system
CN104505103A (en) * 2014-12-04 2015-04-08 上海流利说信息技术有限公司 Voice quality evaluation equipment, method and system
CN104361895B (en) * 2014-12-04 2018-12-18 上海流利说信息技术有限公司 Voice quality assessment equipment, method and system
CN104835366A (en) * 2015-05-07 2015-08-12 肖思俐 Chinese language studying system
CN104809676A (en) * 2015-05-11 2015-07-29 成都准星云学科技有限公司 Method and device for analyzing mistake type of answer
CN104809676B (en) * 2015-05-11 2019-12-17 林辉 Method and device for analyzing error type of answer
CN105139311A (en) * 2015-07-31 2015-12-09 谭瑞玲 Intelligent terminal based English teaching system
CN105162892A (en) * 2015-10-15 2015-12-16 戚克明 Language technique exercise treatment method, apparatus and system, and language technique exercise supervision method
CN105609098A (en) * 2015-12-18 2016-05-25 江苏易乐网络科技有限公司 Internet-based online learning system
CN105679135A (en) * 2016-04-06 2016-06-15 天津飞跃无限科技有限公司 Mobile on-line music level test system and method
CN106448288A (en) * 2016-11-01 2017-02-22 安阳师范学院 Interactive English learning system and method
CN106531182A (en) * 2016-12-16 2017-03-22 上海斐讯数据通信技术有限公司 Language learning system
WO2018201688A1 (en) * 2017-05-05 2018-11-08 Boe Technology Group Co., Ltd. Microphone, vocal training apparatus comprising microphone and vocal analyzer, vocal training method, and non-transitory tangible computer-readable storage medium
US10499149B2 (en) 2017-05-05 2019-12-03 Boe Technology Group Co., Ltd. Microphone, vocal training apparatus comprising microphone and vocal analyzer, vocal training method, and non-transitory tangible computer-readable storage medium
CN108806720A (en) * 2017-05-05 2018-11-13 京东方科技集团股份有限公司 Microphone, data processor, monitoring system and monitoring method
CN108806720B (en) * 2017-05-05 2019-12-06 京东方科技集团股份有限公司 Microphone, data processor, monitoring system and monitoring method
CN107316638A (en) * 2017-06-28 2017-11-03 北京粉笔未来科技有限公司 A kind of poem recites evaluating method and system, a kind of terminal and storage medium
CN108806367A (en) * 2017-07-21 2018-11-13 河海大学 A kind of Oral English Practice voice correcting system
CN111226222B (en) * 2017-08-03 2023-07-07 语冠信息技术(上海)有限公司 Depth context-based grammar error correction using artificial neural networks
CN111226222A (en) * 2017-08-03 2020-06-02 语冠信息技术(上海)有限公司 Depth context based syntax error correction using artificial neural networks
CN108469947A (en) * 2017-09-25 2018-08-31 杨秀梅 A kind of language breath training device of exceptional child
CN109686383B (en) * 2017-10-18 2021-03-23 腾讯科技(深圳)有限公司 Voice analysis method, device and storage medium
CN109686383A (en) * 2017-10-18 2019-04-26 腾讯科技(深圳)有限公司 A kind of speech analysis method, device and storage medium
WO2019075828A1 (en) * 2017-10-20 2019-04-25 深圳市鹰硕音频科技有限公司 Voice evaluation method and apparatus
CN109697988B (en) * 2017-10-20 2021-05-14 深圳市鹰硕教育服务有限公司 Voice evaluation method and device
CN109697988A (en) * 2017-10-20 2019-04-30 深圳市鹰硕音频科技有限公司 A kind of Speech Assessment Methods and device
CN109697975A (en) * 2017-10-20 2019-04-30 深圳市鹰硕音频科技有限公司 A kind of Speech Assessment Methods and device
CN107958673A (en) * 2017-11-28 2018-04-24 北京先声教育科技有限公司 A kind of spoken language methods of marking and device
CN110010123A (en) * 2018-01-16 2019-07-12 上海异构网络科技有限公司 English phonetic word pronunciation learning evaluation system and method
CN110047341A (en) * 2018-01-17 2019-07-23 希格纳姆国际股份有限公司 Scenario language facility for study, system and method
CN108597538A (en) * 2018-03-05 2018-09-28 标贝(北京)科技有限公司 The evaluating method and system of speech synthesis system
CN108492641A (en) * 2018-03-26 2018-09-04 贵州西西沃教育科技股份有限公司 A kind of English phonetic learning system
CN108520650A (en) * 2018-03-27 2018-09-11 深圳市神经科学研究院 A kind of intelligent language training system and method
CN108492652A (en) * 2018-03-29 2018-09-04 吴浩东 A kind of English word intelligence spelling memory method and its intelligent realization system
CN108735220A (en) * 2018-04-11 2018-11-02 四川斐讯信息技术有限公司 A kind of language learning intelligent earphone, intelligent interactive system and man-machine interaction method
CN108630046A (en) * 2018-04-20 2018-10-09 安徽展航信息科技发展有限公司 A kind of welder's electronic multimedia the network teaching platform
CN108648527A (en) * 2018-05-15 2018-10-12 郑州琼佩电子技术有限公司 A kind of pronunciation of English matching correcting method
CN108536875A (en) * 2018-06-12 2018-09-14 重庆靖帛天域科技发展有限公司 Language autonomous learning systems based on big data interactive voice
CN108806719A (en) * 2018-06-19 2018-11-13 合肥凌极西雅电子科技有限公司 Interacting language learning system and its method
CN112384961A (en) * 2018-06-23 2021-02-19 方正熊猫有限公司 Symbol manipulation educational system and method
CN109255988A (en) * 2018-07-11 2019-01-22 北京美高森教育科技有限公司 Interactive learning methods based on incorrect pronunciations detection
CN110875032A (en) * 2018-08-31 2020-03-10 国立大学法人京都大学 Voice interaction system, voice interaction method, program, learning model generation device, and learning model generation method
CN110875032B (en) * 2018-08-31 2023-10-10 国立大学法人京都大学 Voice interaction system, voice interaction method, program, learning model generation device, learning model generation method, and learning model generation program
CN109119064A (en) * 2018-09-05 2019-01-01 东南大学 A kind of implementation method suitable for overturning the Oral English Teaching system in classroom
CN109410911A (en) * 2018-09-13 2019-03-01 何艳玲 Artificial intelligence learning method based on speech recognition
CN109272793A (en) * 2018-11-21 2019-01-25 合肥虹慧达科技有限公司 Child interactive reading learning system
CN109858014A (en) * 2018-12-10 2019-06-07 西南石油大学 Language message active critique system and its active proofreading method
CN109493658A (en) * 2019-01-08 2019-03-19 上海健坤教育科技有限公司 Situated human-computer dialogue formula spoken language interactive learning method
CN109712449A (en) * 2019-03-06 2019-05-03 武汉几古几古科技有限公司 A kind of intellectual education learning system improving child's learning initiative
CN111724635A (en) * 2019-03-18 2020-09-29 云南尚途科技有限公司 Interactive online learning system for multidisciplinary teaching
CN110085257A (en) * 2019-03-29 2019-08-02 语文出版社有限公司 A kind of rhythm automated decision system based on the study of national literature classics
CN110136748A (en) * 2019-05-16 2019-08-16 上海流利说信息技术有限公司 A kind of rhythm identification bearing calibration, device, equipment and storage medium
CN112053020A (en) * 2019-06-06 2020-12-08 兰贵曜威公司 Method, system and equipment for providing man-machine interactive auxiliary language learning
CN110223673A (en) * 2019-06-21 2019-09-10 龙马智芯(珠海横琴)科技有限公司 The processing method and processing device of voice, storage medium, electronic equipment
CN110223673B (en) * 2019-06-21 2020-01-17 龙马智芯(珠海横琴)科技有限公司 Voice processing method and device, storage medium and electronic equipment
CN110246484A (en) * 2019-07-19 2019-09-17 山东劳动职业技术学院 A kind of intelligence pronunciation of English self-aid learning system
CN112309371A (en) * 2019-07-30 2021-02-02 上海流利说信息技术有限公司 Intonation detection method, apparatus, device and computer readable storage medium
CN110598208A (en) * 2019-08-14 2019-12-20 清华大学深圳研究生院 AI/ML enhanced pronunciation course design and personalized exercise planning method
CN110600052A (en) * 2019-08-19 2019-12-20 天闻数媒科技(北京)有限公司 Voice evaluation method and device
CN112307859B (en) * 2019-08-30 2024-06-07 北京字节跳动网络技术有限公司 User language level determining method and device, electronic equipment and medium
CN112307859A (en) * 2019-08-30 2021-02-02 北京字节跳动网络技术有限公司 User language level determination method and device, electronic equipment and medium
CN112541651B (en) * 2019-09-20 2024-05-31 卡西欧计算机株式会社 Electronic device, pronunciation learning method, server device, pronunciation learning processing system, and recording medium
CN112541651A (en) * 2019-09-20 2021-03-23 卡西欧计算机株式会社 Electronic device, pronunciation learning method, and server device
CN110992986B (en) * 2019-12-04 2022-06-07 南京大学 Word syllable stress reading error detection method, device, electronic equipment and storage medium
CN110992986A (en) * 2019-12-04 2020-04-10 南京大学 Word syllable stress reading error detection method, device, electronic equipment and storage medium
CN111599234A (en) * 2020-05-19 2020-08-28 黑龙江工业学院 Automatic English spoken language scoring system based on voice recognition
CN111739527A (en) * 2020-06-01 2020-10-02 广东小天才科技有限公司 Speech recognition method, electronic device and computer readable storage medium
CN111768667A (en) * 2020-07-15 2020-10-13 唐山劳动技师学院 Interactive cycle demonstration method and system for English teaching
CN112086094A (en) * 2020-08-21 2020-12-15 广东小天才科技有限公司 Method for correcting pronunciation, terminal equipment and computer readable storage medium
CN111968426A (en) * 2020-09-11 2020-11-20 河南农业职业学院 Foreign language teaching equipment based on internet
CN112349300A (en) * 2020-11-06 2021-02-09 北京乐学帮网络技术有限公司 Voice evaluation method and device
CN113470447A (en) * 2021-06-29 2021-10-01 读书郎教育科技有限公司 System and method for assisting in memorizing words
CN116805495A (en) * 2023-08-17 2023-09-26 北京语言大学 Pronunciation deviation detection and action feedback method and system based on large language model
CN116805495B (en) * 2023-08-17 2023-11-21 北京语言大学 Pronunciation deviation detection and action feedback method and system based on large language model

Also Published As

Publication number Publication date
CN101739870B (en) 2012-07-04

Similar Documents

Publication Publication Date Title
CN101739870B (en) Interactive language learning system and method
Yamagishi et al. Thousands of voices for HMM-based speech synthesis–Analysis and application of TTS systems built on various ASR corpora
CN101105939B (en) Sonification guiding method
US7412387B2 (en) Automatic improvement of spoken language
CN101751919B (en) Spoken Chinese stress automatic detection method
KR20170011636A (en) Speech recognition apparatus and method, Model generation apparatus and method for Speech recognition apparatus
WO1998002862A1 (en) Apparatus for interactive language training
CN101551947A (en) Computer system for assisting spoken language learning
CA2537503A1 (en) Unsupervised and active learning in automatic speech recognition for call classification
Qian et al. A two-pass framework of mispronunciation detection and diagnosis for computer-aided pronunciation training
Sefara et al. HMM-based speech synthesis system incorporated with language identification for low-resourced languages
Ibrahim et al. Improve design for automated Tajweed checking rules engine of Quranic verse recitation: a review
Audhkhasi et al. Reliability-Weighted Acoustic Model Adaptation Using Crowd Sourced Transcriptions.
Nagano et al. Data augmentation based on vowel stretch for improving children's speech recognition
Stuttle et al. A framework for dialogue data collection with a simulated ASR channel.
Kantor et al. Reading companion: The technical and social design of an automated reading tutor
Yu et al. Overview of SHRC-Ginkgo speech synthesis system for Blizzard Challenge 2013
CN115440193A (en) Pronunciation evaluation scoring method based on deep learning
Iriondo et al. Objective and subjective evaluation of an expressive speech corpus
Zheng [Retracted] An Analysis and Research on Chinese College Students’ Psychological Barriers in Oral English Output from a Cross‐Cultural Perspective
Cincarek et al. Development of preschool children subsystem for ASR and Q&A in a real-environment speech-oriented guidance task
Pellegrini et al. Extension of the lectra corpus: classroom lecture transcriptions in european portuguese
Schlippe et al. Rapid bootstrapping of a ukrainian large vocabulary continuous speech recognition system
Kumar et al. Formalizing expert knowledge for developing accurate speech recognizers.
Elfahal Automatic recognition and identification for mixed sudanese arabic–english languages speech

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant