TW468120B - Talk to learn system and method of foreign language - Google Patents

Talk to learn system and method of foreign language Download PDF

Info

Publication number
TW468120B
TW468120B TW089107671A TW89107671A TW468120B TW 468120 B TW468120 B TW 468120B TW 089107671 A TW089107671 A TW 089107671A TW 89107671 A TW89107671 A TW 89107671A TW 468120 B TW468120 B TW 468120B
Authority
TW
Taiwan
Prior art keywords
foreign language
user
speech recognition
patent application
pronunciation
Prior art date
Application number
TW089107671A
Other languages
Chinese (zh)
Inventor
Saying Shr-Ren Wen
Jou-Bin Wen
Jen Ren
Original Assignee
Inventec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Corp filed Critical Inventec Corp
Priority to TW089107671A priority Critical patent/TW468120B/en
Application granted granted Critical
Publication of TW468120B publication Critical patent/TW468120B/en

Links

Landscapes

  • Electrically Operated Instructional Devices (AREA)

Abstract

The invention provides a talk to learn system of foreign language. Its advantages lay on: (1) integrate voice recognition technique, design various man-machine voice exchange environment, and create an excellent talk to learn environment, allowing user to talk to machine interactively without needing to face other people who speak, further breaking the mental barrier to speak foreign language, acquiring the talk to learn interest of foreign language and increasing the learning efficiency. (2) The system design emphasis targets at letting user speak, so the system design avoids to defy the difficult and weak points of voice recognition technique, and particularly focuses on the pronunciation uniqueness of Chinese to bring up the method in establishing the vocal template of voice recognition appropriate for Chinese pronunciation so that the voice recognition rate in this design is very high, making the man-machine interactive capability higher and the designed learning environment specifically suitable for Chinese. (3) The design opens the ""pronunciation garden"" for pronunciation error correction, providing the standard speaking pronunciation template. The talk to learn system of foreign language in the invention primarily includes five categories: (1) voice recognition module independent to speaker. (2) Talk to learn contents of foreign language. (3) Voice input/output module. (4) Teaching application software for speaking of foreign language and (5) display module.

Description

4 6 81 2 0 五、發明說明(l) 本發明 外語教 習,從造句 語音技術的 這些品, 學外語的人 發音比較好 心理因素而 不能在此方 本發明 於: .整合 境,創造了 機器進行互 打破了開口 與提高學習 2. 本設 系統避免挑 人發音特點 建立方法, 機互動性, 用。 3. 為糾 提供了標準 係有關 學類電 到寫文 發展, 其最重 ,不僅 的人, 不敢開 面提供 提供了 了語音 一個报 動式交 說外語 效率的 叶系統 戰語音 ,提出 使得本 因而所 於一種外 子產品種· 章,從讀 說方面的 要的缺陷 是那些口 在與他人 口說外語 學外語的 一種外語 識別技術 好的外語 談,而不 的心理障 目的;。 重點在於 識別技術 了適合華 設計中的 設計出來 語口語學習系統及方法、9 類很多。從辭彙學賈到語法練 至|J寫’以及聽都很豐富。隨著 練習也漸漸走向市場。但綜觀 是口語練習的環境問題。很多 语發s差的人,就是那些〇語 進行口語交流時,也因為許多 。因此’目前的外語教學產品 人一個很好的學習方法、。 口語學習系統。它的優點在 人機語音交流環 ’讓使用者能與 說話_的人,從而 語口語學習興趣 說話,所以設計 ’並特別針對華 識別聲學模板的 常高’增加了人 別適合於華人使 ,設計了多種 口語學習環境 需要面對其他 礙’獲得了外 讓使用者開口 的難點和弱點 人發音之語音 語音識別率非 的學習環境特 正發音錯誤’本設計專門開設了 "音譜園地" 的外語口語發音模板》4 6 81 2 0 V. Description of the invention (l) The foreign language teaching of the present invention, from these products of sentence-making phonetic technology, people who learn foreign languages have better pronunciation. Psychological factors cannot be invented here: .Integrating the environment, creating a machine Interaction breaks the opening and improves learning. 2. The system is designed to avoid picking people's pronunciation characteristics and establish methods, machine interaction, and use. 3. Provided the standard department related to the development of electrical science to writing, which is the most important, not only the people, who dare not open the face to provide the voice of a system of spoken and spoken foreign language efficiency leaves the system voice, proposed to make This book is a foreign product type chapter. The major flaws in reading and speaking are those foreign languages that are good at foreign language recognition techniques that speak foreign languages and foreign languages with other people. The focus is on the identification technology, which is suitable for the Chinese design. The spoken and spoken language learning system and method, there are many 9 types. From vocabulary learning to grammar training to | J writing ’and listening. With the practice also gradually came to the market. But the overview is the environmental issue of oral practice. Many people who speak poorly, even those who have spoken in 0 language, also have many problems. Therefore, the current foreign language teaching products are a good learning method. Speaking learning system. Its advantage lies in the man-machine voice communication ring, which allows users to speak with people who are interested in speaking, so designing 'and especially targeting the constant high of the Chinese recognition acoustic template' increases the number of people suitable for Chinese speakers. Designed a variety of spoken language learning environments that need to face other obstacles. 'Learning environment that has difficulty in speaking to users and weak points. The pronunciation of non-speech recognition rate is abnormal. The pronunciation is wrong.' Foreign Spoken Pronunciation Templates

第5頁 4 6 81 2 0 五、發明說明(2) 友.面: 語教學題 學應用.漱 一套適合 :,,經部 #根據性 或女聲語 環境1% 了 五大功 :音譜.園 本發明之外語口語學習系統,主要包括五僻 —*與說話者無關的語音識別模組,二,外語α 材,三•語音輸入/輸出模組,四.外語口語教 體,及五·顯示模組。 我們以本發明所述之系統,在電腦上建立了 華人英語口語學習的環境,名為"Talk To Learn 分使用者試用後取得了不錯的效果,首先讓使用 別選擇M男聲",或"女聲”,以選用相對應的男聲 音識別聲學模板,從而提高费音識別率,此學習 ”說明"和”退出”兩個輔助功能外,系統還包含了 能:情景對話;語法練習;造句練習;單字關連 地。 以下,就圖式說明本發明之實施例。 圖式簡單說明 第1圖係顯示本發明之外語口語學習系統之結構圖。 第2圖係顯示一套"Talk To Learn"英語口語學習的環 境之主晝面。 第3圖係顯示"Talk To LearrT之控制流程圖。 第4圖係顯示情景對話操作界面。 第5圖係顯示情景對話之流程圖。 第6圖係顯示情景對話之控制流程圖。Page 5 4 6 81 2 0 V. Description of the invention (2) Friends. Faces: Application of language teaching questions. One set is suitable for: ,, 经 部 # Based on sexual or female voice environment 1% Five major achievements: music score. Garden The foreign language oral language learning system of the present invention mainly includes five remote- * speaker-independent speech recognition modules, two, foreign language alpha materials, three voice input / output modules, four foreign language spoken styles, and five display Module. We use the system described in the present invention to set up an environment for Chinese spoken English learning on a computer, named "Talk To Learn". After trials by users, we have achieved good results. First, let us not use M male voice ", or "Women" to select the corresponding male voice recognition acoustic template to improve the recognition rate of tolls. In addition to the two auxiliary functions of "Explanation" and "Exit", the system also includes the ability to: scene dialogue; grammar exercises ; Sentence practice; Words are connected. Hereinafter, embodiments of the present invention will be described with reference to the drawings. Brief Description of Drawings Fig. 1 is a structural diagram showing a foreign language oral language learning system of the present invention. Figure 2 shows a set of "Talk To Learn" masters of the spoken English environment. Figure 3 shows the control flow of "Talk To LearrT". Figure 4 shows the scene dialogue operation interface. Figure 5 is a flowchart showing a scenario dialogue. Fig. 6 is a control flowchart showing a scenario dialogue.

I 第7圖係顯示語法練習操作界面。 第8圖係顯示造句練習操作界面。I Figure 7 shows the interface for grammar practice. Figure 8 shows the operation interface of sentence making exercise.

第6頁 4 6 81 2 0Page 6 4 6 81 2 0

第9圖係顯示單字關逵I 筐in®/ 平子關運刼作界面: 圖係顯示音譜園地操作界面 實施例 示H種=學習“ 夯一__實施例如第1圖所Figure 9 shows the single-word Guan I basket in® / Pingzi Guanyun operation interface: Figure shows the music field garden operation interface. Example H type = learning "ram one __ implementation example shown in Figure 1

,與说話者#關的語章識別模組 為了適合任何華人用戶’並且他們事先無須進行複雜 a H、赴訓.練’開口就能說’就可以與電腦平台進行人機對 活,我們採用了與說話者無關的語音識別引擎 (Speaker independent Voice Recognition Engine)。可 以選用目如世界頂尖級語音識別公司如Drag〇n system, IBM等公司的語音識別引擎。 — 1 為了特別滿足華人用戶的發音特徵,我們選用上述語 音識別引擎的同時,必須對其僅適合歐美語系的語音聲學 模板進行改良,即加入華人發音特徵,建立適合之語 音聲學模板。其方法如下: 第一步:挑選合!的音素提供人(即錄音人)’錄音 人的選擇要求如下: (1) 不同地區: 可選擇以下.十大類人士 :高尚且優秀之台灣人士, 雙束,華中,華南,華北,東北西北,西南,港篇,瘦 外華裔..人.士。 (2) 不同年齡:The speech recognition module related to the speaker # is suitable for any Chinese users, and they do n’t need to perform complicated a H, go to training beforehand. You can perform man-machine interaction with the computer platform by practicing 'talk and speak'. A speaker independent Voice Recognition Engine is used. You can choose the speech recognition engine of the world's top speech recognition companies such as Dragon system, IBM and other companies. — 1 In order to specifically satisfy the pronunciation characteristics of Chinese users, we must improve the speech acoustic template that is only suitable for European and American languages while selecting the above speech recognition engine, that is, adding Chinese pronunciation characteristics to establish a suitable speech acoustic template. The method is as follows: Step 1: Pick the match! The phoneme provider (ie the recorder) 's selection requirements for recorders are as follows: (1) Different regions: The following can be selected. Ten categories of people: noble and excellent Taiwanese people, Shuangbei, Central China, South China, North China, Northeast Northwest, Southwest, Hong Kong articles, thin Chinese .. people. (2) Different ages:

4 6 812 五、發明說明(4) ------- 可選擇18:60歲不同年齡段的各類成年人。 (3 )男女比例: 由於男女聲發音上存在报大差異,所以為了避 音識別技術的難點和弱點,我們必須分別建立男簦和女^ 的聲學模板,因此男女錄音人各佔一半。 (4 )文化層次: 須選擇具有相當外語水準的錄音人,能狗比較正確 和流利地朗讀所要求的錄音題材。 (5)人數: 人數男女各5 0人以上為佳。 第二步:提取這些錄音數據中的聲音特徵值,建立 語音識別用的聲學模板。 二.外語口語教學題材 設計互動性較強的口語教雙題材。它包括以下幾個方 面的内容:情景對話;語法練習;造句練習;單字關連和 音譜園地。其中,音譜園地提供了所有教學題材中的詞和 句子的標準口語發音。 二•語音輸入/^輸出模組4 6 812 V. Description of the invention (4) ------- Various types of adults at different ages of 18:60 can be selected. (3) Male-female ratio: Due to the large differences in the pronunciation of male and female voices, in order to avoid the difficulties and weaknesses of sound recognition technology, we must create acoustic templates for male and female ^ respectively, so male and female voice recorders each account for half. (4) Cultural level: It is necessary to select a recording person with a considerable foreign language level, who can read the required recording subject matter correctly and fluently. (5) Number of people: 50 or more male and female are preferred. Step 2: Extract the characteristic values of the sound from these recorded data and establish an acoustic template for speech recognition. 2. The subject matter of oral English teaching in foreign languages. It includes the following aspects: situational dialogues; grammar exercises; sentence making exercises; vocabulary relations and musical notation. Among them, the music score field provides standard spoken pronunciation of words and sentences in all teaching topics. Two • Voice input / ^ output module

Microphone輸入提供使用者語音輸入的方式。它將用 戶的語音輸入到計算機中,(與說話者無關的)語音識別 引擎將其與聲學模板中的特定模板進行匹配,即進行語音 識別。·Microphone input provides users with voice input. It inputs the user's voice into the computer, and the (speaker-independent) speech recognition engine matches it with a specific template in the acoustic template, that is, speech recognition. ·

Speaker則是給用戶提供標準的外語口語發音。 而聲卡則主.要._完成模/數轉換。Speaker is to provide users with standard spoken foreign language pronunciation. The sound card is the main. To complete the A / D conversion.

第8頁 46 8 彳 20 五、發明說明(5) 四•外語口語教學應用軟體 它將上述功能很好地包裝整合,提供用戶/使用者一 個方便,活潑,輕鬆的口語學習環境。 五·顯示模組 顯示設備周來顯示外語口語教學題材及各種輔助信 息,以提示使用者順利完成各項練習。 外語口語學習的過程大體上可以描述如下,請參考第 1圖(圖中的數字為外語口語教學的控制步驟): 1-— 步驟一.輸入語音 ① 使用者通過Microphone輸入語音信號。 步驟二· 模/數轉換 ② 聲卡將語音信號從模擬信號轉換成計算機可以處 理的數字信藥(輸入)以及將計算機儲存的數字語.音信號轉. 換成模擬一信-號(輸出)。 步驟三· 語音識別(一) ③ 與說話者輊關的語音識別模組(簡稱語音識別模 組)對輸入的語音信號進行識別,且與假設的N個”對象” 的”模板”進行比/對,若與某一"對象η11的"模板"匹配成 r-一一 - - · -' 一 ' 功,則語音識別結果判定該輸入即為”對象η"。 ④ 外語ρ語教學應用軟體(簡稱應用軟體)將語音. 輸入判定為"對象rT。 ⑤ 將判定結果顯示在顯示設備上。 步驟三.詻音識別(二) ③語音敬別模組找不到_佳...„何一個”對象η"的"模板"Page 8 46 8 彳 20 V. Description of the invention (5) IV. Foreign language spoken language teaching application software It packs and integrates the above functions well, and provides users / users with a convenient, lively and relaxed learning environment. V. Display module The display device displays the subject matter of foreign language oral English teaching and various auxiliary information to remind users to successfully complete various exercises. The process of oral foreign language learning can be described as follows, please refer to Figure 1 (the numbers in the figure are the control steps of oral foreign language teaching): 1-— Step 1. Input the voice ① The user inputs the voice signal through the Microphone. Step 2 · Analog-to-digital conversion ② The sound card converts the voice signal from an analog signal into a digital medicament (input) that can be processed by a computer, and converts the digital speech and sound signals stored in the computer into an analog one-sign (sign). Step 3: Speech recognition (1) ③ The speech recognition module (referred to as the speech recognition module) that is related to the speaker recognizes the input voice signal and compares it with the hypothetical "template" of the "objects". Yes, if it matches the "template" of a certain "target object η11" as r-one one-----'one, the speech recognition result judges that the input is the "object η". ④ Foreign language ρ language teaching The application software (referred to as the application software) judges the voice input as the " target rT. ⑤ The judgment result is displayed on the display device. Step three. Voice recognition (two) ③ The voice recognition module cannot be found _ 佳 .. . "What" object η " " template "

第9頁 4 6 812 0 五、發明說明(6) - 與輸入語音匹配’則語音識別結果判定該輸入為,,錯誤輸 入。 ④ 應用影:體將語音輸入判定為I,錯誤輸入。 ⑤ 顯示判定結果。 因為本設計系統重點在於讓像用者開口說話,所以設 计系統避免挑戰語音識別上的難點和弱點,特別設計了外 語口敬教學題材’儘可能設計發音(聲學模板)存在很大 差異的:對象"作為假設對象。只要使用者的發音基本接近 候選的"I象"的"模板11,就很容易與之匹配,並不會與其 他對皇丄的"模板"發生藏淆,使使用者自信心大大提高, 外语口 S吾積極性大大提高、 步驅四•標準g語輸出 根據步驟三·語音識別(一)的結果,電腦平台會給 出不同的結果⑥0⑧,且輸出不同的標準口語與使闬者進 行對話。 任 的 中 容 。Μ 内 出 話 輸 W 。號 出 東信 給 音擬. 台 發模 平 語成 腦。口換 電音準轉 求發樣號 讀語用信 時口調字。 隨準體數音 以標軟將放 可的周卡队 還字應聲喇 者單是是是 用/Φ©⑧ 使子 句 何 我們以本發明所述之系統,在電腦上建立了一奪適合 華人英語口語學習的環境,名為"Talk To Learn".,經部 分使用者試用缘辱得了不錯的蟓果,現詳述如下:Page 9 4 6 812 0 V. Description of the invention (6)-Matching with the input speech ’, the speech recognition result judges that the input is, wrong input. ④ Application shadow: The body judges the voice input as I, and makes a mistake. ⑤ The judgment result is displayed. Because the focus of this design system is to let the user speak, the design system avoids the challenges and weaknesses in speech recognition. In particular, the foreign language oral teaching theme is designed to have as much pronunciation (acoustic template) as possible: Object " as a hypothetical object. As long as the user's pronunciation is basically close to the candidate " I 象 " template 11, it will be easy to match it, and it will not conceal with other "templates" to the emperor, making the user confident The mind has been greatly improved, and the motivation of the foreign language has been greatly improved. Step 4 • Standard g language output According to the result of step 3 · speech recognition (1), the computer platform will give different results ⑥0⑧, and output different standard spoken and used The talker talks. Ren's content. Outgoing call MW loses W. No. out of the East letter to the phonetic transcription. Oral change Electron tune transfer Ask for a sample number Transcribe the word when reading a pragmatic letter. With the quasi-voices, the weekly card team will be able to release the words, but the answer is simply to use / Φ © ⑧ to make clauses. We use the system described in the present invention to establish a suitable match on the computer. The environment for Chinese spoken English learning, named "Talk To Learn", has been tested by some users and has achieved good results. The details are as follows:

ηίίΐί mηίίΐί m

illill

第10頁 4 6 812 0 ----------- 五、發明說明^ "" ------- 首先讓使用者根據性見壤擇"男查",或,,女聲”, 用相對應的男—牵或女免語音識別聲學農赛,從而^高 識【?1.宇然後是主言面,如第2團_所示,除了"說明"和„退 ,Μ .兩個輔助功能外,系統還包含了五太一功...能:情章對 ,,香法練習;造句練習;單字關連;音譜園地。離. 統運行的控弗i流程如第3圖所示^ '、 以下對這五個功能分別加以說明: 一 ·情景對話 情景對話是模擬真實生活中的各種場景,讓使用者 與電滕進行互動式的交流。如第4圖.情景對話操作界面 所示,在”問題區域"電腦提出一個問題後,使用者可從系 統所提借之答案中挑選一個進行回答。由於這些答案並無 對_之分’只不過模擬各種可能的张況,因此使罔者可根 據自己的感受進行回答;而系統...亦會通過語.言識別進行判 斷,並根據你的回答來進行相應的對話,因此可實現使用 者與系統之間互動式的對話蜂習。我們以,’介紹"場景為 例’來看一下對話題材的設計i topic: Introduce yourselfPage 10 4 6 812 0 ----------- V. Description of the invention ^ " " ------- First let the user choose according to sexuality " 男 查 ", Or, female voice ", use the corresponding male-lead or female voice recognition acoustic farming competition, so ^ high cognition [? 1. Yu and then the main face, as shown in the second group _, except" quotation " ; And „Retreat, M. In addition to the two auxiliary functions, the system also contains the five Taiyi one function ... Ability: Psalm pair, Xiangxiang practice; Sentence practice; Single-word connection; Music score garden. The flow of the control system running as shown in Figure 3 ^ ', the following five functions are described separately: 1. Scenario dialogues Scenario dialogues are simulations of various scenarios in real life, allowing the user and Deng to conduct Interactive communication. As shown in Figure 4. Situational dialogue operation interface, after the computer asks a question in the "question area", the user can choose one of the answers borrowed from the system to answer. Because these answers are not correct, It just simulates various possible situations, so that the person can answer according to their own feelings; and the system ... will also judge by speech and speech recognition, and conduct the corresponding dialogue based on your answer, so it can be achieved Interactive dialogue between users and the system. Let ’s take a look at the design of the topic of conversation with “Introduction” as an example. I topic: Introduce yourself

Introduction:Introduction:

Bobby has found that Robot Computer is friendly. So Bobby wants to make friends with him. Robot is also interested in Bobby. So he is goingBobby has found that Robot Computer is friendly. So Bobby wants to make friends with him. Robot is also interested in Bobby. So he is going

4 6 81 2 0 五、發明說明(8) to ask some quest ions about Bobby and Bobby’s family.4 6 81 2 0 V. Description of Invention (8) to ask some quest ions about Bobby and Bobby ’s family.

Dialog:Dialog:

Robot: 氺1: Can you tell roe something about yourself? *2: First, what’s your name? ^3: Then how old are you? 氺4: But I really want to know. *5: I guess you’re 6, right? : Then you are 12 now, right?Robot: 氺 1: Can you tell roe something about yourself? * 2: First, what's your name? ^ 3: Then how old are you? 氺 4: But I really want to know. * 5: I guess you're 6 , Right?: Then you are 12 now, right?

第12頁Page 12

Bobby : 1 a : Yes, certainly. lb: All right. 1 c : What do you want to know? 2a : My name is Bobby. 2b: I’m Bobby. 2c : Bobby, B-O-B-B-Y, Bobby. 3a : I’m 12 years old. 3b: It’s a secret. 3c: Just gU£^JS. 4a : I'm 12. ^ 6 81 2 0 五' 發明說明(9) 4b: Six years ago I was 6. 4c: Don’t ask people about their age! 5a: Yes, you’re right. 5b: Yeah! You’ve guessed it! 5c: Right, I'm 12. 6a: Yes, i * m 12 years old. 6b: You’re good at math. 6c: How clever you are! 而對應每個_機_器發音 -個可能的對話就是語 其中,帶號的是機器之發音, 之句子,都有三俾可能的對話。這 音識別待識別ϋ,個對象。 例如,機器!*1句時,可能的對話是1&或^咬卜, 器再根據—不同的回答’說不同的句子,從而達到情i t 之功能。其對活路据如第5圖所示,整彳m n k 、 如下所示(參考扪圖和第6圖):個對活的控制過程 步驟一 * 輪入..語.音 號。①使用者通過Microphone輸入某一對象之語音信 步騍二.模/數轉換 ②聲卡將語音信號從模擬信號轉換瞀 理的數字信號(輪入)以及將計算機儲、成汁^機叮處 換成模擬信號(輸出)。 缉存的數字語音信號轉Bobby: 1 a: Yes, certainly. Lb: All right. 1 c: What do you want to know? 2a: My name is Bobby. 2b: I'm Bobby. 2c: Bobby, BOBBY, Bobby. 3a: I ' m 12 years old. 3b: It's a secret. 3c: Just gU £ ^ JS. 4a: I'm 12. ^ 6 81 2 0 Five 'Description of invention (9) 4b: Six years ago I was 6. 4c: Don 't ask people about their age! 5a: Yes, you're right. 5b: Yeah! You've guessed it! 5c: Right, I'm 12. 6a: Yes, i * m 12 years old. 6b: You 're good at math. 6c: How clever you are! And for each _machine_device pronunciation-one possible dialogue is the language, where the number is the pronunciation of the machine, the sentence, there are three possible dialogues. This sound identifies the object to be identified. For example, the machine! * 1 sentence, the possible dialogue is 1 & or ^ bite, and the device then speaks different sentences according to-different answers', so as to achieve the function of love it. The data on the live route is shown in Figure 5, and the rectification m n k is as follows (refer to the map and Figure 6): a control process of the live process Step 1 * Turn in.. ① The user inputs the voice message of a certain object through Microphone. 2. Analog-to-digital conversion. ② The sound card converts the voice signal from analog signal to digital signal (round rotation) and the computer storage and juice processing machine is replaced by Analog signal (output). Secret Digital Voice Signal Transfer

4 6 81 2 0 五、發明說明(ίο) ③ 與說話者無關的語音模組(簡稱語音識別模 组)對輸入..的語音信號進行識別’且與假設的及個"對象" 的"模板M進行比對,若與某一"餘象几的模板"匹配成 功,則語音識別結果判定該輸入即為V對象n"。 ④ 外語口語教學塵用.軟體(簡稱應用軟體)將語音 輸入判寒為"對象η"。 ⑤ 將判定結果顯示在顯示設備上。 步驟三.語音識別(二) ⑥語音識别模組找不到任何一盤二對象Π”的”模板” 與輸入語音匹配,則語音識別結果判定該输入為11錯誤輸 入"。 ' . .‘ , ©應用軟體.將語音輸入判定為”錯誤輸入”。 ⑧顯示判定結果乂 步驟四·標準口語輸出 根據步驟三.語音識別(一)的―兹果’電腦半台..會給 出不同的結果©©⑥,且輸出不同的標準口語與使闬者進 行對話。. 使用者還可以隨時請求電腦平台給出對話内容中的任 何句子/單字的標準α語發音。 ⑥是應用軟體調用標準口語羞壹庫。 @是聲卡將數字信號轉換成模擬信號輸出。 ⑧是制放音。 — 以上所示―就〜是情景對話中有關自我介紹"部份的内 容。另有其他部份如',興聲愛好"等等,這裡不再詳細列4 6 81 2 0 V. Description of the invention (ίο) ③ The speaker-independent speech module (referred to as speech recognition module) recognizes the input of the speech signal 'and it is related to the hypothetical " object " " Template M is compared. If the match with a " template of the residual image " is successful, the speech recognition result determines that the input is a V object n ". ④ The foreign language oral teaching software. The software (referred to as the application software) judges the speech input as "the target object". ⑤ Display the judgment result on the display device. Step 3. Speech recognition (2) ⑥ The speech recognition module cannot find any of the "templates" of the two objects Π "that match the input speech, then the speech recognition result judges that the input is 11 wrong input ". '..' , © Application software. The voice input is judged as “wrong input”. ⑧The judgment result is displayed. Step 4 · Standard spoken language output. According to the third step. Speech recognition (a) of the “Ziguo” computer half .. will give different The result is ©© ⑥, and different standard spoken language is output to talk with the messenger .. The user can also request the computer platform to give the standard alpha pronunciation of any sentence / word in the conversation content at any time. ⑥ The application software calls the standard spoken language壹 一 库. @ Is a sound card that converts digital signals to analog signals and outputs them. ⑧ It is a system for playback. — As shown above-just ~ is the content of self-introduction in the scene dialogue. Other parts such as' , Xingsheng Hobby " etc., no more detailed list here

第14頁Page 14

β 81 P 五、發明說明(li) -- 舉。在這種模擬實際生活的情景對話中,相信能讓使用者 勇於開口說話,’而提高生活中的口語能力。 二.語法練習 語法練習是讓使用者在練習英語語法時,也能進行 口語I望。具體操作界面如第7圖.語法練習操作界面所 示’其中,在"題目區"列出的題目如下:β 81 P V. Description of the Invention (li)-Examples. In this kind of situational dialogue that simulates real life, I believe that it will allow users to speak up, and improve their speaking skills in life. 2. Grammar exercises Grammar exercises allow users to practice oral English while practicing English grammar. The specific operation interface is shown in Figure 7. The grammar practice operation interface ’Among them, the topics listed in the " topic area " are as follows:

He is surprised the Robot can speakHe is surprised the Robot can speak

English. (a)which (b ) so (c) because (d) by 其中的四個答案就是待識別的"—對象,,,控制過程 與情景對話類似。可以看出,在題目區列出的題目是讓使 兩者練習語法周的。通常做法一般是選擇正確答案的序 號。但在本學f環境中則是朗讀_使用者所選定的答案。這 樣系統就可以對此進行語音識别,從而判斷出兔用考悬否 回答正確。在這種情沉下’使用考既練習了語法’又練習 了口語,從而得到了語法和口語的綜合練習。 三·造句練習 造句座..._.習是提供一組單字或詞组,讓使用考把它們 組合成一個完整.的句子。它的界面如第冬圖所示,在題目 區中列出了一組(四個)單字或詞組,讓使用者(他_們考 成句子。與傳統互法(如鍵盤或鼠標輸入)不同的是使用English. (A) which (b) so (c) because (d) by Four of the answers are to be identified-objects, and the control process is similar to the contextual dialogue. It can be seen that the topics listed in the topic area allow the two to practice grammar week. The usual practice is to choose the number of the correct answer. But in this environment, it is the answer chosen by the user. In this way, the system can perform speech recognition on this, so as to determine whether the rabbit used the test to answer correctly. In this situation, the ‘use test has both practiced grammar’ and spoken language, and thus has obtained a comprehensive practice of grammar and spoken language. 3. Sentence-making exercises Sentence-building ..._. Xi is to provide a set of words or phrases, and use the test to combine them into a complete sentence. Its interface is shown in the second figure, and a set of (four) words or phrases are listed in the subject area, so that users (they test them into sentences. It is different from traditional interactive methods (such as keyboard or mouse input) Is using

索15頁 46 81 2 0 五、發明說明(12) 者可以通過網讀相應的單字或詞组_來進行造句。如上例 四個單字或詞組分別是: (a) he is surprised (b) can speak English (c) the Robot (d) because 當使用者朗讀其中任何一谭詞組時,系統便會進行 語音識別’並將識別結兔_題示在"餐題區”中。這樣’朗讀 完四組單字或詞組後,一個完整的句子便顯示在”答題區" 中’並可告訴使用者答案是否正確.例如,造句後的句子 如果疋 he is surprised because the Robot can speak -——·. Eng 1 i sh” ’則本次造句結果正確。因此,在做造句練習 時’同樣也得到了 口語的練習。 四*單字關連See page 15 46 81 2 0 V. Description of the invention (12) The person can read the corresponding word or phrase _ on the Internet to make a sentence. As in the above example, the four words or phrases are: (a) he is surprised (b) can speak English (c) the Robot (d) because when the user reads any of the Tan phrases, the system will perform speech recognition 'and The recognition rabbit_question is displayed in the " meal question area. &Quot; In this way, after reading aloud four groups of words or phrases, a complete sentence will be displayed in the " answer area " and can tell the user whether the answer is correct. For example, if the sentence after making a sentence is surprisedhe is surprised because the Robot can speak -—— .. Eng 1 i sh "', then the result of this sentence is correct. Therefore, when doing the sentence making exercise', I also got oral practice. Four * words related

f字關連是為了讓使甩者找出與已知單字同意或万 .義的,=,從而掌握更多的單字量,為口語對話打下基 礎。單字關連的操作界面如j9圖·單字關連操作界面所 不如第j一圖,左面的,,題!區"列出了一組單字,-而右面 的1答遵區"中有一叙順序亂的反義詞。要求使罔者於 出每個單字的正確的反義詞。如下所示: 1 η foolishThe connection of the word f is to make the person who finds it agree with the known word or righteousness, =, so as to grasp more words and lay the foundation for the spoken dialogue. The single-word related operation interface is not as good as the j9 picture. The single-word related operation interface is not as good as the first picture. The left, ,, and the question! Area "lists a group of single words,-and the 1 answer compliance area" on the right has a sequence Messy antonyms. Ask the person who writes the correct antonym for each word. It looks like this: 1 η foolish

friend clean c1 ever dirty- light enemyfriend clean c1 ever dirty- light enemy

out 五、發明說明(13) heavy 練習時’當矣j®的某個單字反白(如圖單字 時,使用者必須在右面一找出铉單字的反義詞。使^ = 將選f力反義詞通過朗讀輪入到系統中,讓系統進語立 識別,然後在這兩個單字之間晝一根線。冑完全部:: 就完成了這一次的^字關連。同時系統可顯示答題是否且= 確。這樣,在做單字履連的時候,也讓使用者得 ^ 鍛鍊。其控制過程與情景H類似e —— 】 - 五.音譜園地 $ 上土一種練習時,都會讓使用者有機會鍛鍊口 語。為了讓用戶能掌握每種練習中的單字或句子的正確讀 晋’設計了音譜園地這個練f。在任何以上四種練習中, 八要使^王知道某個單字或句子如何發音,他都可以進 ΐϋϊϊ地來針對這些單免或詞組進行訓練,從而提高 英π的心a水平。音譜園地的操作界面如第1〇圖音譜園 地操作界鱼西示,舉例來說,當用戶在情景對話中想說 we lj "這句話時,如果他不會讀或者是認為讀得不 準確的祐他就可以進入音譜園地進行訓練。如第ι〇_ =示,在”標準發音波形區,,中會顯示標準發音的波形,同 時還有M標準發音放音鍵"讓使用者可以聆聽標準發音。然 ,"使用者學會以後可按”錄音鍵,,進行錄音。錄音完後就會 在"用戶發、音波形區"顯示兩戶费音的波形,讓周戶與標準 .發音波形進行比較,以知曉哪些部份讀得正確,两哪些部out V. Description of the invention (13) During heavy practice, when a word of 矣 j® is reversed (as shown in the figure, the user must find the antonym of the word 铉 on the right. Make ^ = will choose the f force antonym to pass Read into the system in turn, let the system enter the language recognition, and then a line between the two words. 胄 Complete part :: This completes the ^ character connection this time. At the same time, the system can show whether the answer and = True. In this way, the user can also exercise ^ when doing single-word running. The control process is similar to scenario H e】】-Five. Music spectrum field $ An exercise on the soil will give users a chance to exercise Spoken language. In order to allow users to master the correct reading of the words or sentences in each exercise, the practice of designing the musical notation field f is designed. In any of the above four exercises, the eighth must let the king know how to pronounce a word or sentence. He can train for these waivers or phrases to improve the level of the heart a. The operation interface of the music score field is shown in Figure 10 in the music score field. For example, when the user is in situation In the dialogue, when we want to say "we lj", if he ca n’t read or thinks that the reading is not accurate, he can enter the music field for training. As shown in section ι〇_ =, in the "standard pronunciation waveform area" , Will display the standard pronunciation waveform, and there are M standard pronunciation playback keys ", so that the user can listen to the standard pronunciation. However," users can press the "Record button" to record after learning. After recording Will display the waveforms of the two households' tones in the "User's hair, tone waveform area", and let the households compare with the standard .pronounced waveforms to know which parts are read correctly and which two parts

第17頁 五、發明說明(14) 份可能還讀得不 斷地聆聽兩戶發 準確〇經過這樣 能掌握該單字或 以上所述就 功能等與本發明 綜觀以上五 一個模擬的生活 其他四個功能中 何種練習,他都 是本發明所述之 境下進行外語口 雖然本發明 限定本發明,任 和範圍内,當可 範圍當視後附之 夠好°同時還可以從聲音 音與標準發音有何區別, 反覆的比較/訓練後,相 詞組的正,讀音。 疋該學習環境的五大功能 無關’因此這裡不再詳述 大功能’我們發現,(除了 環境讓使且者與機器進行 免都融入了口語練習}既 必須要用口語進行回答。 "一個外語口語學習系統” 語的學習將得到非常有效 已以較佳實施例揭露如上 何熟習此技藝者,在不脫 作些許之更動與潤飾,因 申請專利範圍所界定者為 上進行比較,不 自己的發音是否 信使用者就一定 其他一聲輔助 情景對話 互動的對 無論使用 這樣一個 。相信在 的結果。 ,然其益 離本發明 此本發明 能提供 話外, 者在做 環境王 這種環 养用以 之精神Page 17 Fifth, the invention description (14) You may also read and listen to the two households accurately. After this, you can master the word or the functions described above, and take a comprehensive look with the present invention. What kind of exercises in the function, he is to perform foreign language speaking in the context of the present invention. Although the present invention limits the present invention, within the scope and scope, when the range is good enough, it can be attached after viewing. What is the difference in pronunciation? After repeated comparisons / training, the correct phrase is pronounced.的 The five major functions of the learning environment are not relevant ', so the major functions are not described in detail here. We found that (except that the environment allows the messenger and the machine to be integrated into oral practice), both must be answered in spoken language. &Quot; A foreign language "Spoken language learning system" will be very effective in learning the language. It has been revealed in a preferred embodiment how those skilled in the art can make changes and retouching without making any changes. Because the scope defined in the scope of the patent application is compared, it is not their own. Whether the pronunciation is believed or not, the user must have another pair of contextual dialogue interactions, regardless of the use of such one. Believe in the result. However, the benefit of the present invention is that the present invention can provide the outside story, or the environment king. Used spirit

Claims (1)

B312J1_紐8_6?ι6年〇月補充心水_^ 六、申請專利範圍 1. 一種外語口語學習系統,包括: 一語音輸入/輸出模組,藉由該語音輸入/輸出模組 可輸入使用者之語音信號及輸出標準口語發音; 一與說話者無關的語音識別模組,具有複數個假設的 對象模板’藉以對輸入的語音信號進行識別,且與該語音 識別模組内的複數個假設的對象模板進行比對; 一外語口語教學應用模組,藉以將該語音輸入/輸出 模組所接收之語音信號及該與說話者無關的語音識別模組 所比對之結果,判定為一特定對象;以及 一顯示模組’顯示該外語口語教學應用模組判定結 果。 2 如申請專利範圍第1項所述之外語口語學習系統, 其中,該輸入/輸出模蚯,更包括一聲卡,可將語音信號 從模擬信號轉換成計算機可以處理的數字信號以及將計算 機儲存的數字語音信號轉換成模擬信號。 3.如申請專利範圍第1項所述之外語口語學習系統, .其中,該與說話者無關的語音識別模組,更包括一與說話 者無關的語音識別引擎及一華人語音聲學模板。 4·如申請專利範圍第3項所述之外語口語學習系統, 其中,該與說話者無關的語音識別引擎,是為IBM公司之 語音識別引擎。 5.如申請專利範圍第3項所述之外語口語學習系統, 其中,該與說話者無關的語音識別引擎,是為Dragon System公司之語音識別弓丨擎。 6.如申請專利範圍第3項所述之外語口語學習系統B312J1_New 8_6? 〇 6 years of supplementary __ Sixth, the scope of patent application 1. A foreign language spoken language learning system, including: a voice input / output module, the voice input / output module can input users Speech signal and output standard spoken pronunciation; a speaker-independent speech recognition module with a plurality of hypothetical object templates to recognize the input speech signal and a plurality of hypothetical Object template comparison; a foreign language oral teaching application module, by which the speech signal received by the speech input / output module and the speaker-independent speech recognition module are compared as a specific object ; And a display module 'displays the determination result of the foreign language spoken language teaching application module. 2 The foreign language spoken language learning system described in item 1 of the scope of patent application, wherein the input / output module further includes a sound card, which can convert a voice signal from an analog signal into a digital signal that can be processed by a computer and store the computer Digital voice signals are converted into analog signals. 3. The foreign language spoken language learning system according to item 1 of the scope of patent application, wherein the speaker-independent speech recognition module further includes a speaker-independent speech recognition engine and a Chinese speech acoustic template. 4. The foreign language spoken language learning system as described in item 3 of the scope of patent application, wherein the speaker-independent speech recognition engine is a speech recognition engine of IBM Corporation. 5. The foreign language spoken language learning system according to item 3 of the scope of patent application, wherein the speaker-independent speech recognition engine is a speech recognition engine of Dragon System. 6. Spoken foreign language learning system as described in item 3 of the scope of patent application 0549-5270TiVFl.pt c 第19頁 46 8120 t 仍年p月日修正/更正/補充 __案號8910767】 年月 日修正 , 六、申請專利範圍 一 其中’該華人語音聲學模板,其建立方法,包括: 挑選不同地區、不同年齡、具有外語能力之人士作 音素提供人;以及 ~ 提取該些音素提供人之錄音數據中的聲音特徵值,建 立語音識別用的聲學模板。 7. 如申請專利範圍第1項所述之外語口語學習系統, 其中,更包括一外語口語教學題材,提供所有教學題材中 的標準口語發音。 8. 如申請專利範圍第1項所述之外語口語學習系統, 其中’更包括情景對話之方法,該方法是由問題區域提出 一個問題後’使用者可從系統所提供之答案中挑選一個進 行回答,由於這些答案並無對錯之分’只不過模擬各種可 能的狀況,因此使用者可根攄自己的感受進行回答,而系 統亦會通過語音識別進行判斷,並根據回答來進行相應的 對話,而實現使用者與系統之間互動式的對話練習。 9_如申請專利範圍第丨項所述之外語口語學習系統, 其中’更包括語法練習之方法,該方法是由題目區提出一 個讓使用者練習語法用的問題’使用者可從系統所提供之 答案中挑選一個進行回答,這樣系統就可以對此進行語音 識別,從而判斷出使用者是否回答正確。 1 0 .如申請專利範圍第1項所述之外語口語學習系統’ 其中’更包括造句練習之方法,該方法是由題目區提供一 組單字或詞組,讓使用者把它們組合成一個完整的句子’ 當使用者朗讀其中任何一個詞組時,系統便會進行語音識 別,並將識別結果顯示在答題區中,朗讀完所有單字或詞0549-5270TiVFl.pt c page 19 46 8120 t still amended / corrected / added __ case number 8910767] amended month and day, six, the scope of the patent application one of the 'the Chinese voice acoustic template, its establishment method , Including: selecting people from different regions, different ages, and foreign language abilities as phoneme providers; and ~ extracting the sound feature values in the recording data of these phoneme providers, and establishing an acoustic template for speech recognition. 7. The foreign language spoken language learning system as described in item 1 of the scope of the patent application, which further includes a foreign language spoken language teaching subject matter, providing standard spoken pronunciation in all teaching subjects. 8. The foreign language spoken language learning system described in item 1 of the scope of patent application, which includes a method of contextual dialogue. This method is to ask a question from the question area. The user can choose one from the answers provided by the system. Answer, because these answers are not right or wrong, they just simulate various possible situations, so users can answer based on their own feelings, and the system will judge by voice recognition and conduct corresponding dialogue based on the answers. , And implement interactive dialogue exercises between users and the system. 9_ Foreign language spoken language learning system as described in item 丨 of the patent application scope, which includes 'the method of grammar practice, this method is to ask a question for the user to practice grammar from the subject area'. The user can provide it from the system. Pick one of the answers to answer, so that the system can perform speech recognition on it, so as to determine whether the user answered correctly. 10. The foreign language spoken language learning system as described in item 1 of the scope of the patent application, where 'also' includes a method of making sentences. This method is to provide a set of words or phrases in the subject area, and let users combine them into a complete Sentence 'When the user reads any one of the phrases aloud, the system will perform speech recognition and display the recognition results in the answer area, after reading all the words or words aloud 0549-5270TOl.ptc 第20頁 4 6 81 2 0 六、申請專利範圍 組後’ 一個完整的句子便顯_ 者答案是否正確。 顯不在善題區中,並可告訴使用 11·如申請專利範圍篦 其中,更包括單字關連之方:所;m語學習系統’ -組單字,而答題區中有一方法疋由題目區列出了 詞,使用者必須在右面找出的反義詞或同義 用者將選擇的反義詞戍同美Γ;早子的反義詞或同義詞’使 糸統進行語音識別,然後在這 j讓 完後系統顯示答題是否正確。單子之間晝-根線,做 並由12 ’ 專利範圍第1項所述之外語口語學習系统, 其中’更包括音譜·園地之方沐,兮士 β 區中會顯干栌進I立 μ方法疋在標準發音波形 匕甲會顯不標車發音的波形,且具有 用者可以聆聽標準發音,&用者 ::曰放曰鍵讓使 錄立*德#合y m 使用者亦可按錄音鍵進行錄音, 、曰&用戶發音波形區顯示用戶發音的波形。 13.—種外語口語學習方法,包括: 輸出可入/輸出模組’藉由執行該語音輸入/ 入使用者之語音信號及輪出標準口語發音; 轨仃一與說話者無關的語音識別 關的語音識別模钽具右通軲桐栩#从揭、、且该與說話者奔 入的祖立彳> 啤.*具有後數個假狄的對象模板,藉以對較 假設的對象模板進行比對; 两引犋組内的複數信 執订一外語口語教學應用模組,也立 輸出模組所接收之扭立 f 乂將該5"輸入/ 模组所比對之妗ί 說話者無關的語音識别 所比對之結果,判定為-特定對象;以及 執行一顯示极細 -_ J.J. ---_、、卫 II 7f ^ ^ ^ 口語教學應用模組判定 4 6 812 0 如年卜月公\修正/更正/補充 曰 佟正 ' __案號 89107671__£_ -m- 六、申請專利範圍 結果。 14.如申請專利範圍第13項所述之外語口 5吾學習方 法,其中該輸入/輸出模組,更包括一聲卡,可將語音信 號從模擬信號轉換成計算機可以處理的數字信號以及將計 算機儲存的數字語音信號轉換成模擬信號。 1 5.如申請專利範圍第1 3項所述之外語口語學習方 法,其中,該與說話者無關的語音識別模組,更包括一與 說話者無關的語音識別引擎及一華人語音聲學模板。 1 6 ·如申請專利範圍第1 5項所述之外語口語學習方 法’其中,該與說話者無關的語音識別引擎,是為1BM公 司之語音識別引擎。 1 7 ‘如申請專利範圍第丨5項所述之外語口語學習方 法’其中,該與說話者無關的語音識別引擎’是為Dragon System公司之語音識別引擎。 18.如申請專利範圍第丨5項所述之外語口語學習方 法’其中,該華人語音聲學模板,其建立方法,包括: 挑選不同地區、不同年齡、具有外語能力之人士作為 音素提供人;以及 提取該些音素提供人之錄音數據中的聲音特徵值,建 立語音識別用的聲學模板。 1 9.如申請專利範圍第丨3項所述之外語口語學習方 法,其中,更包括執行一外語口語教學題材’提供所有教 學題材中的標準口語發音。 2 0.如申請專利範園第丨3項所述之外語口語學習方 法’其中,更包括情景對話之方法,該方法是由問題區域0549-5270TOl.ptc Page 20 4 6 81 2 0 6. After applying for a patent, a complete sentence will show whether the answer is correct. It is not displayed in the problem area and can be used. 11 · If the scope of the patent application is applied, it also includes the party related to the word: So; m language learning system '-group of words, and there is a method in the answer area. Listed in the problem area For the word, the user must find the antonym on the right or the synonym user will choose the antonym with the same name; the son ’s antonym or synonyms' make the system perform speech recognition, and then after the j is finished, the system will display whether correct. Day-to-day line between lists, and made by 12 'foreign language spoken language learning system described in item 1 of the patent scope, where' more includes music scores, gardens, and squares, and the β area will significantly dry up. Method 疋 In the standard pronunciation waveform, the dagger will show the waveform of the standard car pronunciation, and the user can listen to the standard pronunciation. &Amp; User :: Put the key to make the recording record * 德 # 合 ym Users can also press The record button performs recording, and the & user pronunciation waveform area displays the waveform of the user's pronunciation. 13.—A foreign language spoken learning method, including: output input / output module 'by performing the voice input / input of the user's voice signal and rotating out of the standard spoken pronunciation; track one — speaker-independent speech recognition The speech recognition mold tantalum with right pass 轱 桐 昱 #consider, and the speaker who should run into the speaker > Beer. * Object template with the last few false di, to perform more hypothetical object templates Compare; The plural letters in the two quote groups subscribe to a foreign language spoken language teaching application module, and also stand up to the twisted f received by the output module. The 5 " input / module is compared to the speaker. The result of the speech recognition comparison is determined to be-a specific object; and a display with extremely fine -_ JJ ---_, and Wei II 7f ^ ^ ^ Spoken teaching application module determination 4 6 812 0 Public \ Amendment / Correction / Addition of "佟 正" __ Case No. 89107671__ £ _ -m- VI. Results of Patent Application. 14. The method of learning foreign languages as described in item 13 of the scope of patent application, wherein the input / output module further includes a sound card, which can convert a voice signal from an analog signal into a digital signal that can be processed by a computer and a computer The stored digital voice signals are converted into analog signals. 1 5. The spoken foreign language learning method according to item 13 of the scope of the patent application, wherein the speaker-independent speech recognition module further includes a speaker-independent speech recognition engine and a Chinese speech acoustic template. 16 · The spoken language learning method for foreign languages as described in Item 15 of the scope of the patent application, wherein the speaker-independent speech recognition engine is a speech recognition engine of 1BM. 1 7 ‘A foreign language spoken language learning method as described in item 5 of the patent application’, wherein the speaker-independent speech recognition engine is a speech recognition engine of Dragon System. 18. The method for learning spoken foreign languages as described in Item 5 of the scope of the patent application, wherein the method for establishing the Chinese speech acoustics template includes: selecting people from different regions, different ages, and foreign language abilities as phoneme providers; and The sound feature values in the recorded data provided by the phonemes are extracted to establish an acoustic template for speech recognition. 1 9. The foreign language spoken language learning method as described in item 3 of the patent application scope, which further includes performing a foreign language spoken language teaching subject matter 'to provide standard spoken pronunciation in all teaching topics. 2 0. The method for learning spoken foreign languages as described in item 丨 3 of the patent application park, which further includes a method of contextual dialogue, which is based on the problem area. 0549-527(OTFl.ptc 第22頁 46 812 u 修正 年 A 外牟〖。月兄日修正/更正/補金 __ 案號 89107671 六、申請專利範園 提出一個問題後,使用者可從系統所提供之答案中挑選一 個進行回答,由於這些答案並無對錯之分’只不過模擬各 種可能的狀況,因此使用者可根據自己的感受進行回答, 而系統亦會通過語音識別進行判斷,並根據回答來進行相 應的對話,而實現使用者與系統之間互動式的對話練習。 21.如申請專利範圍第1 3項所述之外語口語學習方 法’其中’更包括語法練習之方法,該方法是由題目區提 出一個讓使用者練習語法用的問題,使用者可從系統所提 供之答案中挑選一個進行回答,這樣系統就可以對此進行 語音識別’從而判斷出使用者是否回答正確。 2 2.如申請專利範圍第丨3項所述之外語口語學習方 法’其中’更包括造句練習之方法,該方法是由題目區提 供一組單字或詞組,讓使用者把它們組合成一個完整的句 子當使用者朗讀其中任何一個詞組時,系統便會進行語 音$別’並將識別結果顯示在答題區中,朗讀完所有單字 或组後’ 一個完整的句子便顯示在答題區中,並可告訴 使用者答案是否正確。 、23.如申請專利範圍第13項所述之外語口語學習方 出了一 =巴括早予關連之方法’該方法是由題目區列 益约組單子’而答題區中有一組順序被打亂的反義詞或 二,二使用者必須在右面找出該單字的反義詞或同義 :,堉έ者將選擇的反義詞或同義詞通過朗讀輸入到系統 嫂拙二統進行語音識別,然後在這兩個單字之間晝一根 線,做元後系統顯示答題是否正確。0549-527 (OTFl.ptc Page 22 46 812 u Amend the year A's external bill. 〖Modify / Correct / Fill the month__ Case No. 89107671 VI. After a patent application park asks a question, the user can download it from the system Choose one of the answers provided to answer. Because these answers are not right or wrong, they just simulate various possible situations, so users can answer according to their own feelings. The system will also judge by voice recognition, and According to the answer, the corresponding dialogue is carried out, and the interactive dialogue practice between the user and the system is realized. 21. As described in item 13 of the scope of the patent application, a foreign language learning method 'where' includes a method of grammar practice, which The method is to ask a question for the user to practice grammar from the question area. The user can choose one of the answers provided by the system to answer, so that the system can perform speech recognition on it to determine whether the user answered correctly. 2 2. As for the foreign language spoken language learning method described in item 丨 3 of the scope of application for patents, among which, the method of sentence making exercises is also included, In this method, a set of words or phrases is provided in the question area, so that the user can combine them into a complete sentence. When the user reads any of these words aloud, the system will perform a voice $ Don 'and display the recognition result in the answer area. After reading all the words or groups aloud, a complete sentence will be displayed in the answer area, and the user can be told whether the answer is correct. 23. A foreign language spoken language learner as described in item 13 of the scope of patent application = The method of associating with the early bracketing 'This method is to list the list of benefit groups in the title area' and the answer area has a set of antonyms or two, and the user must find the antonym or synonym of the word on the right : , The person who has input the selected antonym or synonym into the system by reading aloud for system speech recognition, and then a line between the two words, the system shows whether the answer is correct after doing yuan. 0549-5270TOFl.ptc 第23頁 申請專利3項所述之外語口語學習方 46 8120 ~Μ^671_4- 月 曰 修正 六、申請專利範圍 法,其中,更包括音譜園地之方法,該方法是在標準發音 波形區中會顯示標準發音的波形,且具有標準發音放音鍵 讓使用者可以聆聽標準發音,使用者亦可按錄音鍵進行錄 音,錄音完後就會在用戶發音波形區顯示用戶發音的波 形。0549-5270TOFl.ptc Page 23 Apply for a foreign language spoken language as described in 3 items of the patent 46 8120 ~ M ^ 671_4- Month Amendment VI. Patent Application Scope Law, which also includes the method of sound spectrum garden, this method is standard The waveform of the standard pronunciation is displayed in the pronunciation waveform area, and the standard pronunciation playback key allows the user to listen to the standard pronunciation. The user can also press the record button to record. After the recording, the user pronunciation is displayed in the user pronunciation waveform area. Waveform. 0549-5270TWFl.ptc 第24頁0549-5270TWFl.ptc Page 24
TW089107671A 2000-04-24 2000-04-24 Talk to learn system and method of foreign language TW468120B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW089107671A TW468120B (en) 2000-04-24 2000-04-24 Talk to learn system and method of foreign language

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW089107671A TW468120B (en) 2000-04-24 2000-04-24 Talk to learn system and method of foreign language

Publications (1)

Publication Number Publication Date
TW468120B true TW468120B (en) 2001-12-11

Family

ID=21659493

Family Applications (1)

Application Number Title Priority Date Filing Date
TW089107671A TW468120B (en) 2000-04-24 2000-04-24 Talk to learn system and method of foreign language

Country Status (1)

Country Link
TW (1) TW468120B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1295673C (en) * 2003-11-03 2007-01-17 微星科技股份有限公司 Voice correcting device and method
US7962327B2 (en) 2004-12-17 2011-06-14 Industrial Technology Research Institute Pronunciation assessment method and system based on distinctive feature analysis
TWI739286B (en) * 2020-01-21 2021-09-11 國立臺灣師範大學 Interactive learning system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1295673C (en) * 2003-11-03 2007-01-17 微星科技股份有限公司 Voice correcting device and method
US7962327B2 (en) 2004-12-17 2011-06-14 Industrial Technology Research Institute Pronunciation assessment method and system based on distinctive feature analysis
TWI739286B (en) * 2020-01-21 2021-09-11 國立臺灣師範大學 Interactive learning system

Similar Documents

Publication Publication Date Title
Baker et al. DiapixUK: task materials for the elicitation of multiple spontaneous speech dialogs
Porter et al. Authentic listening activities1
Kumar et al. Improving literacy in developing countries using speech recognition-supported games on mobile devices
Johnstone Linking identity and dialect through stancetaking
US8843372B1 (en) Natural conversational technology system and method
Ekayati Shadowing Technique on Students’ Listening Word Recognition
Schegloff Reflections on research on telephone conversation: Issues of cross-cultural scope and scholarly exchange, interactional import and consequences
Michael Automated Speech Recognition in language learning: Potential models, benefits and impact
CN108133632A (en) The training method and system of English Listening Comprehension
Huenerfauth et al. Evaluating importance of facial expression in American Sign Language and pidgin signed English animations
TWI270052B (en) System for selecting audio content by using speech recognition and method therefor
Wagner et al. The big australian speech corpus (the big asc)
Yu Learning a Foreign Language through Text and Memorisation: The Chinese Learners' Perceptions.
Watthajarukiat et al. An Investigation of English listening strategies used by Thai undergraduate students in public universities in the South
KR100450019B1 (en) Method of service for english training of interactive voice response using internet
JP6656529B2 (en) Foreign language conversation training system
JP2003228279A (en) Language learning apparatus using voice recognition, language learning method and storage medium for the same
Nicholson An impetus for change: Classroom analysis using Sinclair and Coulthard's model of spoken discourse
TW468120B (en) Talk to learn system and method of foreign language
Baker et al. LUCID: a corpus of spontaneous and read clear speech in British English
KR20010107035A (en) An internet english study service method for voice recognition and voice synthesis
Shukla Development of a human-AI teaming based mobile language learning solution for dual language learners in early and special educations
TW583610B (en) System and method using computer to train listening comprehension and pronunciation
Karlsen et al. Analysis of a simultaneousspeaker sound corpus
CN112863267B (en) English man-machine conversation system and learning method

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent
MM4A Annulment or lapse of patent due to non-payment of fees