KR100699663B1 - 음성 인식 모델링을 사용하는 자동 언어 평가 시스템 및 방법 - Google Patents

음성 인식 모델링을 사용하는 자동 언어 평가 시스템 및 방법 Download PDF

Info

Publication number
KR100699663B1
KR100699663B1 KR1020017000526A KR20017000526A KR100699663B1 KR 100699663 B1 KR100699663 B1 KR 100699663B1 KR 1020017000526 A KR1020017000526 A KR 1020017000526A KR 20017000526 A KR20017000526 A KR 20017000526A KR 100699663 B1 KR100699663 B1 KR 100699663B1
Authority
KR
South Korea
Prior art keywords
response
item
task
difficulty
subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
KR1020017000526A
Other languages
English (en)
Korean (ko)
Other versions
KR20010074705A (ko
Inventor
브렌트 타운센드
Original Assignee
오디네이트 코오퍼레이션
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 오디네이트 코오퍼레이션 filed Critical 오디네이트 코오퍼레이션
Publication of KR20010074705A publication Critical patent/KR20010074705A/ko
Application granted granted Critical
Publication of KR100699663B1 publication Critical patent/KR100699663B1/ko
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/01—Assessment or evaluation of speech recognition systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/04—Speaking
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Machine Translation (AREA)
KR1020017000526A 1999-05-13 2000-05-12 음성 인식 모델링을 사용하는 자동 언어 평가 시스템 및 방법 Expired - Lifetime KR100699663B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/311,617 US7062441B1 (en) 1999-05-13 1999-05-13 Automated language assessment using speech recognition modeling
US09/311,617 1999-05-13

Publications (2)

Publication Number Publication Date
KR20010074705A KR20010074705A (ko) 2001-08-09
KR100699663B1 true KR100699663B1 (ko) 2007-03-23

Family

ID=23207697

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020017000526A Expired - Lifetime KR100699663B1 (ko) 1999-05-13 2000-05-12 음성 인식 모델링을 사용하는 자동 언어 평가 시스템 및 방법

Country Status (7)

Country Link
US (1) US7062441B1 (enExample)
EP (1) EP1095363A1 (enExample)
JP (1) JP4002401B2 (enExample)
KR (1) KR100699663B1 (enExample)
CN (1) CN1204537C (enExample)
AU (1) AU4845800A (enExample)
WO (1) WO2000070584A1 (enExample)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2390930B (en) * 1999-02-05 2004-03-10 Custom Speech Usa Inc System and method for automating transcription services
US7451085B2 (en) * 2000-10-13 2008-11-11 At&T Intellectual Property Ii, L.P. System and method for providing a compensated speech recognition model for speech recognition
US6953343B2 (en) * 2002-02-06 2005-10-11 Ordinate Corporation Automatic reading system and methods
US7407384B2 (en) * 2003-05-29 2008-08-05 Robert Bosch Gmbh System, method and device for language education through a voice portal server
DE10360044B3 (de) * 2003-12-18 2005-05-25 T-Mobile Deutschland Gmbh Verfahren zur Ermittlung der sprachlichen Fähigkeiten von Probanden
US8798518B2 (en) 2004-06-30 2014-08-05 Educational Testing Service Method and system for calibrating evidence models
US20060008781A1 (en) * 2004-07-06 2006-01-12 Ordinate Corporation System and method for measuring reading skills
US7660719B1 (en) 2004-08-19 2010-02-09 Bevocal Llc Configurable information collection system, method and computer program product utilizing speech recognition
US8708702B2 (en) * 2004-09-16 2014-04-29 Lena Foundation Systems and methods for learning using contextual feedback
US10223934B2 (en) 2004-09-16 2019-03-05 Lena Foundation Systems and methods for expressive language, developmental disorder, and emotion assessment, and contextual feedback
US9240188B2 (en) 2004-09-16 2016-01-19 Lena Foundation System and method for expressive language, developmental disorder, and emotion assessment
US7392187B2 (en) * 2004-09-20 2008-06-24 Educational Testing Service Method and system for the automatic generation of speech features for scoring high entropy speech
US8221126B2 (en) * 2004-11-22 2012-07-17 Bravobrava L.L.C. System and method for performing programmatic language learning tests and evaluations
US8272874B2 (en) * 2004-11-22 2012-09-25 Bravobrava L.L.C. System and method for assisting language learning
US8033831B2 (en) * 2004-11-22 2011-10-11 Bravobrava L.L.C. System and method for programmatically evaluating and aiding a person learning a new language
US7962327B2 (en) * 2004-12-17 2011-06-14 Industrial Technology Research Institute Pronunciation assessment method and system based on distinctive feature analysis
WO2006076280A2 (en) * 2005-01-11 2006-07-20 Educational Testing Service Method and system for assessing pronunciation difficulties of non-native speakers
US8200495B2 (en) 2005-02-04 2012-06-12 Vocollect, Inc. Methods and systems for considering information about an expected response when performing speech recognition
US7895039B2 (en) 2005-02-04 2011-02-22 Vocollect, Inc. Methods and systems for optimizing model adaptation for a speech recognition system
US7827032B2 (en) 2005-02-04 2010-11-02 Vocollect, Inc. Methods and systems for adapting a model for a speech recognition system
US7949533B2 (en) 2005-02-04 2011-05-24 Vococollect, Inc. Methods and systems for assessing and improving the performance of a speech recognition system
US7865362B2 (en) 2005-02-04 2011-01-04 Vocollect, Inc. Method and system for considering information about an expected response when performing speech recognition
WO2007015869A2 (en) * 2005-07-20 2007-02-08 Ordinate Corporation Spoken language proficiency assessment by computer
CN100397438C (zh) * 2005-11-04 2008-06-25 黄中伟 聋哑人汉语发音计算机辅助学习方法
US7949526B2 (en) * 2007-06-04 2011-05-24 Microsoft Corporation Voice aware demographic personalization
WO2008151212A1 (en) * 2007-06-04 2008-12-11 Nexidia Inc. Speech skills assessment
TWI336880B (en) * 2007-06-11 2011-02-01 Univ Nat Taiwan Voice processing methods and systems, and machine readable medium thereof
CN101739869B (zh) * 2008-11-19 2012-03-28 中国科学院自动化研究所 一种基于先验知识的发音评估与诊断系统
US8494857B2 (en) 2009-01-06 2013-07-23 Regents Of The University Of Minnesota Automatic measurement of speech fluency
EP2450877B1 (en) * 2010-11-09 2013-04-24 Sony Computer Entertainment Europe Limited System and method of speech evaluation
US8914290B2 (en) 2011-05-20 2014-12-16 Vocollect, Inc. Systems and methods for dynamically improving user intelligibility of synthesized speech in a work environment
US9679496B2 (en) * 2011-12-01 2017-06-13 Arkady Zilberman Reverse language resonance systems and methods for foreign language acquisition
US9576593B2 (en) 2012-03-15 2017-02-21 Regents Of The University Of Minnesota Automated verbal fluency assessment
US9449522B2 (en) * 2012-11-16 2016-09-20 Educational Testing Service Systems and methods for evaluating difficulty of spoken text
MX2015010582A (es) * 2013-02-15 2017-01-11 Voxy Inc Sistemas y metodos de aprendizaje de idiomas.
US9978395B2 (en) 2013-03-15 2018-05-22 Vocollect, Inc. Method and system for mitigating delay in receiving audio stream during production of sound from audio stream
CN104347081B (zh) * 2013-08-07 2019-07-02 腾讯科技（深圳）有限公司 一种测试场景说法覆盖度的方法和装置
US9412358B2 (en) 2014-05-13 2016-08-09 At&T Intellectual Property I, L.P. System and method for data-driven socially customized models for language generation
US9947322B2 (en) * 2015-02-26 2018-04-17 Arizona Board Of Regents Acting For And On Behalf Of Northern Arizona University Systems and methods for automated evaluation of human speech
GB2544070B (en) 2015-11-04 2021-12-29 The Chancellor Masters And Scholars Of The Univ Of Cambridge Speech processing system and method
US10714121B2 (en) 2016-07-27 2020-07-14 Vocollect, Inc. Distinguishing user speech from background speech in speech-dense environments
CN106123066B (zh) * 2016-08-06 2018-12-11 广东万家乐燃气具有限公司 一种带自学习功能的语音控制系统及吸油烟机
CN106847260B (zh) * 2016-12-20 2020-02-21 山东山大鸥玛软件股份有限公司 一种基于特征融合的英语口语自动评分方法
US10529357B2 (en) 2017-12-07 2020-01-07 Lena Foundation Systems and methods for automatic determination of infant cry and discrimination of cry from fussiness
CN108899012B (zh) * 2018-07-27 2021-04-20 中国电子产品可靠性与环境试验研究所（（工业和信息化部电子第五研究所）（中国赛宝实验室）） 语音交互设备评测方法、系统、计算机设备和存储介质
US20210049927A1 (en) * 2019-08-13 2021-02-18 Vanderbilt University System, method and computer program product for determining a reading error distance metric
WO2022140166A1 (en) * 2020-12-23 2022-06-30 Ello Technology, Inc. Systems and methods for speech validation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US559127A (en) * 1896-04-28 ellis
US4468204A (en) * 1982-02-25 1984-08-28 Scott Instruments Corporation Process of human-machine interactive educational instruction using voice response verification
US5870709A (en) * 1995-12-04 1999-02-09 Ordinate Corporation Method and apparatus for combining information from speech signals for adaptive interaction in teaching and testing

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5059127A (en) * 1989-10-26 1991-10-22 Educational Testing Service Computerized mastery testing system, a computer administered variable length sequential testing system for making pass/fail decisions
US5303327A (en) * 1991-07-02 1994-04-12 Duke University Communication test system
EP0671038B1 (en) * 1992-11-24 2003-05-14 Pavilion Technologies Inc. Operating a neural network with missing and/or incomplete data
EP0692135B1 (en) 1993-03-12 2000-08-16 Sri International Method and apparatus for voice-interactive language instruction
WO1998014934A1 (en) 1996-10-02 1998-04-09 Sri International Method and system for automatic text-independent grading of pronunciation for language instruction
US5857173A (en) 1997-01-30 1999-01-05 Motorola, Inc. Pronunciation measurement device and method
US6253181B1 (en) * 1999-01-22 2001-06-26 Matsushita Electric Industrial Co., Ltd. Speech recognition and teaching apparatus able to rapidly adapt to difficult speech of children and foreign speakers

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US559127A (en) * 1896-04-28 ellis
US4468204A (en) * 1982-02-25 1984-08-28 Scott Instruments Corporation Process of human-machine interactive educational instruction using voice response verification
US5870709A (en) * 1995-12-04 1999-02-09 Ordinate Corporation Method and apparatus for combining information from speech signals for adaptive interaction in teaching and testing

Also Published As

Publication number Publication date
WO2000070584A1 (en) 2000-11-23
EP1095363A1 (en) 2001-05-02
CN1316083A (zh) 2001-10-03
JP2002544570A (ja) 2002-12-24
CN1204537C (zh) 2005-06-01
KR20010074705A (ko) 2001-08-09
JP4002401B2 (ja) 2007-10-31
AU4845800A (en) 2000-12-05
US7062441B1 (en) 2006-06-13

Similar Documents

Publication Publication Date Title
KR100699663B1 (ko) 음성 인식 모델링을 사용하는 자동 언어 평가 시스템 및 방법
CN110782921B (zh) 语音测评方法和装置、存储介质及电子装置
US6953343B2 (en) Automatic reading system and methods
KR100747141B1 (ko) 테스트시스템, 테스트시스템 제어방법 및 그 제어방법을 실행하는 컴퓨터 프로그램을 기억하는 기억매체
CN108766415B (zh) 一种语音测评方法
CN105845134A (zh) 自由朗读题型的口语评测方法及系统
US9087519B2 (en) Computer-implemented systems and methods for evaluating prosodic features of speech
US20070033017A1 (en) Spoken language proficiency assessment by computer
US20140317032A1 (en) Systems and Methods for Generating Automated Evaluation Models
US8870575B2 (en) Language learning system, language learning method, and computer program product thereof
Zechner et al. Towards automatic scoring of non-native spontaneous speech
CN113486970B (zh) 阅读能力评测方法及装置
CN102194346A (zh) 一种自动分析词汇难度及注解难点词汇的嵌入式系统及方法
CN111199158A (zh) 一种民航客服的评分方法及装置
CN107240394A (zh) 一种动态自适应语音分析技术以用于人机口语考试的方法及系统
CN111383495A (zh) 一种用于口语教学的课中讲解系统、方法、装置及介质
US20060008781A1 (en) System and method for measuring reading skills
CN112700795B (zh) 口语发音质量评价方法、装置、设备及存储介质
CN117727214A (zh) 一种学习儿童语言学习等级测定方法、系统和存储介质
CN114241835B (zh) 一种学生口语质量评测方法和设备
CN117786105A (zh) 答题评分模型训练、答题评分方法、装置、设备和介质
CN111951827B (zh) 一种连读识别校正方法、装置、设备以及可读存储介质
CN114842875A (zh) 一种基于文本及语音识别的口语测评方法及系统
KR20090096952A (ko) 인지단어 그룹을 이용한 속해 훈련 서비스 제공 방법 및시스템
CN115440103B (zh) 朗读测评方法、系统、装置及存储介质

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20010112

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20050512

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20060811

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20070208

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20070319

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20070319

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20100309

Start annual number: 4

End annual number: 4

PR1001 Payment of annual fee

Payment date: 20110309

Start annual number: 5

End annual number: 5

PR1001 Payment of annual fee

Payment date: 20120308

Start annual number: 6

End annual number: 6

FPAY Annual fee payment

Payment date: 20130308

Year of fee payment: 7

PR1001 Payment of annual fee

Payment date: 20130308

Start annual number: 7

End annual number: 7

FPAY Annual fee payment

Payment date: 20140310

Year of fee payment: 8

PR1001 Payment of annual fee

Payment date: 20140310

Start annual number: 8

End annual number: 8

FPAY Annual fee payment

Payment date: 20150306

Year of fee payment: 9

PR1001 Payment of annual fee

Payment date: 20150306

Start annual number: 9

End annual number: 9

FPAY Annual fee payment

Payment date: 20160218

Year of fee payment: 10

PR1001 Payment of annual fee

Payment date: 20160218

Start annual number: 10

End annual number: 10

FPAY Annual fee payment

Payment date: 20170220

Year of fee payment: 11

PR1001 Payment of annual fee

Payment date: 20170220

Start annual number: 11

End annual number: 11

FPAY Annual fee payment

Payment date: 20180219

Year of fee payment: 12

PR1001 Payment of annual fee

Payment date: 20180219

Start annual number: 12

End annual number: 12

FPAY Annual fee payment

Payment date: 20200218

Year of fee payment: 14

PR1001 Payment of annual fee

Payment date: 20200218

Start annual number: 14

End annual number: 14

PC1801 Expiration of term

Termination date: 20201112

Termination category: Expiration of duration