WO2010133072A1 - Dispositif d'évaluation de la prononciation et procédé associé - Google Patents

Dispositif d'évaluation de la prononciation et procédé associé Download PDF

Info

Publication number
WO2010133072A1
WO2010133072A1 PCT/CN2009/075281 CN2009075281W WO2010133072A1 WO 2010133072 A1 WO2010133072 A1 WO 2010133072A1 CN 2009075281 W CN2009075281 W CN 2009075281W WO 2010133072 A1 WO2010133072 A1 WO 2010133072A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
module
pronunciation
text data
evaluation
Prior art date
Application number
PCT/CN2009/075281
Other languages
English (en)
Chinese (zh)
Inventor
陈淮琰
张斌
周骁
Original Assignee
无敌科技(西安)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 无敌科技(西安)有限公司 filed Critical 无敌科技(西安)有限公司
Publication of WO2010133072A1 publication Critical patent/WO2010133072A1/fr

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use

Definitions

  • the invention relates to a sounding evaluation device and a method thereof, in particular to a sounding evaluation function.
  • Portable electronic consumer products such as electronic dictionaries, mobile phones or personal digital assistants
  • portable electronic consumer products are increasingly favored by many people, and the requirements for the functions of portable electronic consumer products are getting higher and higher.
  • voice learning is one of the most frequently used and needed services for many users.
  • the present invention has been made to solve the above-mentioned technical problems existing in the background art, and proposes a sounding evaluation apparatus and method thereof.
  • the present invention is a pronunciation evaluation device for evaluating user pronunciation, and the special feature is as follows:
  • the device comprises: a storage module, storing a plurality of text data and a sound information corresponding to the text data, The reading parameter and the phonetic symbol data;
  • the input module provides the user to select the text data;
  • the display module displays the selected text data;
  • the audio output module plays the pronunciation audio corresponding to the selected text data;
  • the recording module records the audio signal input by the user;
  • the audio analysis module analyzes the input audio signal, compares the analysis result with the pronunciation parameter and the phonetic data of the corresponding text data, generates an evaluation result based on the phonetic data, and compares the waveform of the input audio signal with the sound waveform of the corresponding text data.
  • the audio analysis module controls the display module to display the evaluation result and the waveform comparison result, and the input module, the recording module and the storage module are respectively connected to the audio analysis module, and the audio analysis module The audio output module and the display module are respectively connected.
  • the audio analysis module described above analyzes the input audio signal according to the LPC cepstrum technique.
  • the above phonetic data contains syllables, and the evaluation results include evaluation scores corresponding to each syllable.
  • the above text data contains words, words or sentences.
  • a pronunciation evaluation method for evaluating user pronunciation which is special in that: The method includes the following steps:
  • the input audio signal is analyzed according to the LPC cepstrum technique.
  • the above phonetic data includes syllables, and the evaluation results include evaluation scores corresponding to each syllable.
  • the above text data contains words, words or sentences.
  • the sounding evaluation device and the method thereof provided by the invention first display words to the user, analyze the user's pronunciation after recording the user's pronunciation, and compare the analysis result with the word pronunciation parameters and the phonetic data, and generate the basis
  • Figure 1 is a block diagram of an embodiment of the apparatus of the present invention
  • FIG. 2 is a schematic diagram 1 of a display interface of an embodiment of the device of the present invention.
  • FIG. 3 is a schematic diagram 2 of a display interface of an embodiment of the device of the present invention.
  • Figure 4 is a flow chart of the method of the present invention.
  • 1- pronunciation evaluation device 11-storage module, 111-character data, 112-audio audio, 113- pronunciation parameters, 114-phonetic data, 12-input module, 13 display module, 14 audio output module, 1-5 Recording module, 151-input audio signal, 16-audio analysis module, 171-test result, 172-waveform alignment result.
  • the sounding evaluation device 1 includes a storage module 11 , an input module 12 , a display module 13 , an audio output module 14 , a recording module 15 , and an audio analysis module 16 .
  • the storage module 11 stores a plurality of text data 111 and a read audio signal 112 corresponding to the text data 111 . , the pronunciation parameter 113 and the phonetic data 114.
  • Text data 111 contains words, words, or statements.
  • the pronunciation audio 112 is the correct pronunciation of the corresponding text data 111, and can be used as a reference for the user to learn the pronunciation.
  • the phonetic symbol data 114 contains syllables.
  • the phonetic data of the word “abbreviation” includes five syllables such as “money”, violent, “,”, “mu,” and “Sh ll".
  • the pronunciation parameter 113 may include a pronunciation audio.
  • the storage module 11 can be a built-in memory, a memory card or an optical storage medium.
  • the input module 12 provides the user with the choice of text data.
  • the input module 12 can be a keyboard, a button group, a cursor controller or a touch module.
  • the display module 13 displays the text data 111 selected by the user, and the audio output module 14 plays the pronunciation audio 112 corresponding to the selected text data 111, so that the user can first listen to the correct pronunciation of the selected text data.
  • the display module 13 displays the phonetic symbol data 114 and other related data of the selected text data.
  • the recording module 15 is activated to record the audio signal 151 input by the user.
  • the display module 13 can display a prompt message to remind the user to start reading the selected text data 111.
  • the audio analysis module 16 analyzes the input audio signal 151, and compares the analysis result with the pronunciation parameter 113 and the phonetic data 114 of the corresponding character data 111 to generate a result 171 based on the phonetic data 114.
  • the audio analysis module 16 compares the waveform of the input audio signal 151 with the waveform of the read audio 112 of the corresponding text data 111, and controls the display module 13 to display the evaluation result 171 and the waveform comparison result 172.
  • the evaluation result 171 includes the evaluation score of each syllable corresponding to the phonetic symbol data 114.
  • the user views the evaluation result 171 to know which syllable pronunciation has a problem, and further corrects the pronunciation. For example, when practicing the pronunciation of the word "abbreviation", if the evaluation score of ", ' ⁇ " is lower, the user should pay more attention to the pronunciation and practice more, and observe the waveform comparison result to understand their pronunciation and Where the difference in correct pronunciation is, the effect of effectively correcting the pronunciation has been achieved.
  • the audio analysis module 16 is implemented in a software manner in which the processor executes the related audio analysis program.
  • the pronunciation evaluation device displays the English word "abbreviation” selected by the user to practice the pronunciation, and the pronunciation evaluation device first plays the built-in pronunciation of the English word "abbreviation", so that the user can listen to the pronunciation first and learn against the phonetic data. . After that, the pronunciation evaluation device displays a prompt message to remind the user to read the word, and the pronunciation evaluation device records the user's voice.
  • the pronunciation evaluation device is turned on for audio analysis and waveform comparison, and the evaluation scores and waveform comparison results of each syllable are displayed. For example, the user's pronunciation has lower scores in the three syllables such as ",i,,, "i” and "sh weaving". After observing the waveform, it can be found that the users in the three syllables seem to be over-sounding, so Users can understand the shortcomings of their pronunciation.
  • the method can be applied to an electronic device having a signal processing function, such as a computer, a portable electronic dictionary, a mobile phone, or a personal digital assistant (PDA).
  • a signal processing function such as a computer, a portable electronic dictionary, a mobile phone, or a personal digital assistant (PDA).
  • PDA personal digital assistant
  • step S1 a plurality of character data and pronunciation audio, pronunciation parameters and phonetic data corresponding to the character data are provided, for example, the data is stored in advance in a storage module of the electronic device.
  • the phonetic data contains syllables, and the pronunciation parameters include LPC cepstral parameters of the audio tones or other audio analysis parameters.
  • the storage module is built-in memory, memory card or optical storage media.
  • step S2 the user selects the text data of the pronunciation to be practiced, displays the selected text data in step S3 and plays the pronunciation audio corresponding to the selected text data, and displays the phonetic symbol of the selected text data on the screen of the electronic device. Data or other relevant data.
  • the prompt information may be displayed on the screen of the electronic device to remind the user to read the selected text data, and the audio signal input by the user is recorded in step S4, and then the input is analyzed in step S5.
  • the audio signal is compared with the pronunciation parameter and the phonetic data of the corresponding text data to generate an evaluation result based on the phonetic data.
  • the evaluation result includes the evaluation score of each syllable corresponding to the phonetic data, and the evaluation score may be an absolute score, a relative score, or a weight score.
  • step S6 the waveform of the input audio signal and the waveform of the sound of the corresponding text data are compared.
  • the evaluation result and the waveform comparison result are displayed in step S7.
  • the user views the evaluation results to know which syllable pronunciation has a problem, and further corrects the pronunciation.
  • the waveform comparison results give the user a clearer picture of why the pronunciation is poor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

L'invention concerne un dispositif (1) d'évaluation de la prononciation et un procédé associé. Le dispositif (1) comporte : un module de mémorisation (11) conçu pour mémoriser une pluralité de données littérales (111), des informations vocales de prononciation (112) correspondant aux données littérales (111), des paramètres de prononciation (113) et des données de symboles phonétiques (114) ; un module d'entrée (12) permettant à un utilisateur de sélectionner les données littérales (111) ; un module d'affichage (13) conçu pour afficher les données littérales (111) sélectionnées ; un module de sortie d'informations vocales de prononciation (14) conçu pour reproduire les informations vocales de prononciation (112) correspondant aux données littérales (111) sélectionnées ; un module d'enregistrement (15) conçu pour enregistrer un signal d'informations vocales (151) entré par l'utilisateur ; un module d'analyse audio (16) conçu pour analyser le signal d'informations vocales (151) entré et pour comparer le résultat de l'analyse aux paramètres de prononciation (113) correspondant aux données littérales (111) et aux données de symboles phonétiques (114), pour produire le résultat de l'évaluation compte tenu des données de symboles phonétiques (114), et pour comparer la forme d'onde du signal d'informations vocales (151) entré et la forme d'onde des informations vocales de prononciation (112) correspondant aux données littérales (111). Le module d'affichage (13) est commandé par le module d'analyse audio (16) et affichage le résultat de l'évaluation (171) et le résultat de la comparaison des formes d'onde (172).
PCT/CN2009/075281 2009-05-21 2009-12-03 Dispositif d'évaluation de la prononciation et procédé associé WO2010133072A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN 200910022631 CN101551952A (zh) 2009-05-21 2009-05-21 发音评测装置及其方法
CN200910022631.2 2009-05-21

Publications (1)

Publication Number Publication Date
WO2010133072A1 true WO2010133072A1 (fr) 2010-11-25

Family

ID=41156176

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2009/075281 WO2010133072A1 (fr) 2009-05-21 2009-12-03 Dispositif d'évaluation de la prononciation et procédé associé

Country Status (2)

Country Link
CN (1) CN101551952A (fr)
WO (1) WO2010133072A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112230875A (zh) * 2020-10-13 2021-01-15 华南师范大学 人工智能跟读方法和跟读机器人

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101551952A (zh) * 2009-05-21 2009-10-07 无敌科技(西安)有限公司 发音评测装置及其方法
CN101739870B (zh) * 2009-12-03 2012-07-04 深圳先进技术研究院 交互式语言学习系统及交互式语言学习方法
CN104599680B (zh) * 2013-10-30 2019-11-26 语冠信息技术（上海）有限公司 移动设备上的实时口语评价系统及方法
CN104485116B (zh) * 2014-12-04 2019-05-14 上海流利说信息技术有限公司 语音质量评价设备、方法和系统
CN105810211B (zh) * 2015-07-13 2019-11-29 维沃移动通信有限公司 一种音频数据的处理方法及终端
CN105118354A (zh) * 2015-09-14 2015-12-02 百度在线网络技术（北京）有限公司 用于语言学习的数据处理方法和装置
CN107038910A (zh) * 2016-02-04 2017-08-11 咸大根 垫子用语言学习系统及方法
CN107203539B (zh) * 2016-03-17 2020-07-14 曾雅梅 复数字词学习机的语音评测装置及其评测与连续语音图像化方法
CN108039180B (zh) * 2017-12-11 2021-03-12 广东小天才科技有限公司 一种儿童语言表达练习的成果获悉方法及麦克风设备
CN110085260A (zh) * 2019-05-16 2019-08-02 上海流利说信息技术有限公司 一种单词音节重音识别校正方法、装置、设备以及介质
CN113838479B (zh) * 2021-10-27 2023-10-24 海信集团控股股份有限公司 单词发音评测方法、服务器及系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002023613A (ja) * 2000-07-05 2002-01-23 Tomoe Bosai Tsushin Kk 語学学習システム
JP2003162291A (ja) * 2001-11-22 2003-06-06 Ricoh Co Ltd 語学学習装置
CN1510590A (zh) * 2002-12-24 2004-07-07 英业达股份有限公司 利用可视化对应发音提示的语言学习系统及方法
CN1512300A (zh) * 2002-12-30 2004-07-14 艾尔科技股份有限公司 自动标示音标以矫正发音的使用者接口、系统及方法
JP2004279799A (ja) * 2003-03-17 2004-10-07 Univ Waseda 発話評価装置及び発話評価方法
JP2006084966A (ja) * 2004-09-17 2006-03-30 Advanced Telecommunication Research Institute International 発話音声の自動評定装置およびコンピュータプログラム
CN101393694A (zh) * 2008-10-21 2009-03-25 无敌科技(西安)有限公司 一种具有汉字正音功能的汉字发音学习装置及其方法
CN101551952A (zh) * 2009-05-21 2009-10-07 无敌科技(西安)有限公司 发音评测装置及其方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002023613A (ja) * 2000-07-05 2002-01-23 Tomoe Bosai Tsushin Kk 語学学習システム
JP2003162291A (ja) * 2001-11-22 2003-06-06 Ricoh Co Ltd 語学学習装置
CN1510590A (zh) * 2002-12-24 2004-07-07 英业达股份有限公司 利用可视化对应发音提示的语言学习系统及方法
CN1512300A (zh) * 2002-12-30 2004-07-14 艾尔科技股份有限公司 自动标示音标以矫正发音的使用者接口、系统及方法
JP2004279799A (ja) * 2003-03-17 2004-10-07 Univ Waseda 発話評価装置及び発話評価方法
JP2006084966A (ja) * 2004-09-17 2006-03-30 Advanced Telecommunication Research Institute International 発話音声の自動評定装置およびコンピュータプログラム
CN101393694A (zh) * 2008-10-21 2009-03-25 无敌科技(西安)有限公司 一种具有汉字正音功能的汉字发音学习装置及其方法
CN101551952A (zh) * 2009-05-21 2009-10-07 无敌科技(西安)有限公司 发音评测装置及其方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112230875A (zh) * 2020-10-13 2021-01-15 华南师范大学 人工智能跟读方法和跟读机器人

Also Published As

Publication number Publication date
CN101551952A (zh) 2009-10-07

Similar Documents

Publication Publication Date Title
WO2010133072A1 (fr) Dispositif d'évaluation de la prononciation et procédé associé
KR101826714B1 (ko) 말하기 학습 기능을 구비한 외국어 학습 시스템 및 외국어 학습 방법
RU2340007C2 (ru) Устройство и способ для произнесения фонем
US20060194181A1 (en) Method and apparatus for electronic books with enhanced educational features
CN108520650A (zh) 一种智能语言训练系统和方法
JP2014529771A (ja) 言語学習のためのシステムおよび方法
JP2007206317A (ja) オーサリング方法、オーサリング装置およびプログラム
KR101164379B1 (ko) 사용자 맞춤형 컨텐츠 제작이 가능한 학습 장치 및 이를 이용한 학습 방법
CN111653265B (zh) 语音合成方法、装置、存储介质和电子设备
US20100318346A1 (en) Second language pronunciation and spelling
JP2015036788A (ja) 外国語の発音学習装置
Kaiser Mobile-assisted pronunciation training: The iPhone pronunciation app project
JP7376071B2 (ja) コンピュータプログラム、発音学習支援方法及び発音学習支援装置
JP6166831B1 (ja) 単語学習支援装置、単語学習支援プログラム、単語学習支援方法
WO2008035852A1 (fr) Procédé et appareils d'entraînement linguistique par appariement de prononciation et de caractère
KR20140078810A (ko) 언어 데이터 및 원어민의 발음 데이터를 이용한 리듬 패턴 학습장치 및 방법
KR20140087956A (ko) 단어 및 문장과 이미지 데이터 그리고 원어민의 발음 데이터를 이용한 파닉스 학습장치 및 방법
KR20140107067A (ko) 이미지 데이터와 원어민 발음 데이터를 이용한 단어 학습장치 및 방법
KR20140028527A (ko) 단어의 음절 및 원어민의 발음 데이터를 이용한 단어 학습장치 및 방법
KR20140079677A (ko) 언어 데이터 및 원어민의 발음 데이터를 이용한 연음 학습장치 및 방법
KR100593590B1 (ko) 콘텐츠 자동 생성방법 및 이를 이용한 어학학습방법
TWI281649B (en) System and method of dictation learning for correcting pronunciation
US20130149680A1 (en) Methods and systems for teaching a non-native language
CN102542854A (zh) 借助角色扮演学习发音的方法
KR20140079245A (ko) 언어 데이터 및 원어민의 발음 데이터를 이용한 리듬 패턴 학습장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09844824

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09844824

Country of ref document: EP

Kind code of ref document: A1